Jun 15 05:48:36.933383 ip-10-0-128-243 systemd[1]: Starting Kubernetes Kubelet...
Jun 15 05:48:37.284138 ip-10-0-128-243 kubenswrapper[2566]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jun 15 05:48:37.284138 ip-10-0-128-243 kubenswrapper[2566]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Jun 15 05:48:37.284138 ip-10-0-128-243 kubenswrapper[2566]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jun 15 05:48:37.284138 ip-10-0-128-243 kubenswrapper[2566]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Jun 15 05:48:37.284138 ip-10-0-128-243 kubenswrapper[2566]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jun 15 05:48:37.285662 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:48:37.285577    2566 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Jun 15 05:48:37.288837 ip-10-0-128-243 kubenswrapper[2566]: W0615 05:48:37.288821    2566 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jun 15 05:48:37.288837 ip-10-0-128-243 kubenswrapper[2566]: W0615 05:48:37.288838    2566 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jun 15 05:48:37.288900 ip-10-0-128-243 kubenswrapper[2566]: W0615 05:48:37.288842    2566 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jun 15 05:48:37.288900 ip-10-0-128-243 kubenswrapper[2566]: W0615 05:48:37.288846    2566 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jun 15 05:48:37.288900 ip-10-0-128-243 kubenswrapper[2566]: W0615 05:48:37.288848    2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jun 15 05:48:37.288900 ip-10-0-128-243 kubenswrapper[2566]: W0615 05:48:37.288851    2566 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jun 15 05:48:37.288900 ip-10-0-128-243 kubenswrapper[2566]: W0615 05:48:37.288855    2566 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jun 15 05:48:37.288900 ip-10-0-128-243 kubenswrapper[2566]: W0615 05:48:37.288857    2566 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jun 15 05:48:37.288900 ip-10-0-128-243 kubenswrapper[2566]: W0615 05:48:37.288860    2566 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jun 15 05:48:37.288900 ip-10-0-128-243 kubenswrapper[2566]: W0615 05:48:37.288862    2566 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jun 15 05:48:37.288900 ip-10-0-128-243 kubenswrapper[2566]: W0615 05:48:37.288867    2566 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jun 15 05:48:37.288900 ip-10-0-128-243 kubenswrapper[2566]: W0615 05:48:37.288871    2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jun 15 05:48:37.288900 ip-10-0-128-243 kubenswrapper[2566]: W0615 05:48:37.288875    2566 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jun 15 05:48:37.288900 ip-10-0-128-243 kubenswrapper[2566]: W0615 05:48:37.288877    2566 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jun 15 05:48:37.289207 ip-10-0-128-243 kubenswrapper[2566]: W0615 05:48:37.288926    2566 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jun 15 05:48:37.289207 ip-10-0-128-243 kubenswrapper[2566]: W0615 05:48:37.288932    2566 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jun 15 05:48:37.289207 ip-10-0-128-243 kubenswrapper[2566]: W0615 05:48:37.288936    2566 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jun 15 05:48:37.289207 ip-10-0-128-243 kubenswrapper[2566]: W0615 05:48:37.288939    2566 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jun 15 05:48:37.289207 ip-10-0-128-243 kubenswrapper[2566]: W0615 05:48:37.288942    2566 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jun 15 05:48:37.289207 ip-10-0-128-243 kubenswrapper[2566]: W0615 05:48:37.288944    2566 feature_gate.go:328] unrecognized feature gate: DualReplica
Jun 15 05:48:37.289207 ip-10-0-128-243 kubenswrapper[2566]: W0615 05:48:37.288947    2566 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jun 15 05:48:37.289207 ip-10-0-128-243 kubenswrapper[2566]: W0615 05:48:37.288950    2566 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jun 15 05:48:37.289207 ip-10-0-128-243 kubenswrapper[2566]: W0615 05:48:37.288952    2566 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jun 15 05:48:37.289207 ip-10-0-128-243 kubenswrapper[2566]: W0615 05:48:37.288955    2566 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jun 15 05:48:37.289207 ip-10-0-128-243 kubenswrapper[2566]: W0615 05:48:37.288957    2566 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jun 15 05:48:37.289207 ip-10-0-128-243 kubenswrapper[2566]: W0615 05:48:37.288960    2566 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jun 15 05:48:37.289207 ip-10-0-128-243 kubenswrapper[2566]: W0615 05:48:37.288962    2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jun 15 05:48:37.289207 ip-10-0-128-243 kubenswrapper[2566]: W0615 05:48:37.288965    2566 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jun 15 05:48:37.289207 ip-10-0-128-243 kubenswrapper[2566]: W0615 05:48:37.288968    2566 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jun 15 05:48:37.289207 ip-10-0-128-243 kubenswrapper[2566]: W0615 05:48:37.288970    2566 feature_gate.go:328] unrecognized feature gate: Example
Jun 15 05:48:37.289207 ip-10-0-128-243 kubenswrapper[2566]: W0615 05:48:37.288973    2566 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jun 15 05:48:37.289207 ip-10-0-128-243 kubenswrapper[2566]: W0615 05:48:37.288975    2566 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jun 15 05:48:37.289207 ip-10-0-128-243 kubenswrapper[2566]: W0615 05:48:37.288978    2566 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jun 15 05:48:37.289649 ip-10-0-128-243 kubenswrapper[2566]: W0615 05:48:37.288981    2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jun 15 05:48:37.289649 ip-10-0-128-243 kubenswrapper[2566]: W0615 05:48:37.288983    2566 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jun 15 05:48:37.289649 ip-10-0-128-243 kubenswrapper[2566]: W0615 05:48:37.288985    2566 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jun 15 05:48:37.289649 ip-10-0-128-243 kubenswrapper[2566]: W0615 05:48:37.288988    2566 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jun 15 05:48:37.289649 ip-10-0-128-243 kubenswrapper[2566]: W0615 05:48:37.288991    2566 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jun 15 05:48:37.289649 ip-10-0-128-243 kubenswrapper[2566]: W0615 05:48:37.288994    2566 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jun 15 05:48:37.289649 ip-10-0-128-243 kubenswrapper[2566]: W0615 05:48:37.288998    2566 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jun 15 05:48:37.289649 ip-10-0-128-243 kubenswrapper[2566]: W0615 05:48:37.289001    2566 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jun 15 05:48:37.289649 ip-10-0-128-243 kubenswrapper[2566]: W0615 05:48:37.289004    2566 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jun 15 05:48:37.289649 ip-10-0-128-243 kubenswrapper[2566]: W0615 05:48:37.289006    2566 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jun 15 05:48:37.289649 ip-10-0-128-243 kubenswrapper[2566]: W0615 05:48:37.289009    2566 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jun 15 05:48:37.289649 ip-10-0-128-243 kubenswrapper[2566]: W0615 05:48:37.289011    2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jun 15 05:48:37.289649 ip-10-0-128-243 kubenswrapper[2566]: W0615 05:48:37.289013    2566 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jun 15 05:48:37.289649 ip-10-0-128-243 kubenswrapper[2566]: W0615 05:48:37.289016    2566 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jun 15 05:48:37.289649 ip-10-0-128-243 kubenswrapper[2566]: W0615 05:48:37.289019    2566 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jun 15 05:48:37.289649 ip-10-0-128-243 kubenswrapper[2566]: W0615 05:48:37.289022    2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jun 15 05:48:37.289649 ip-10-0-128-243 kubenswrapper[2566]: W0615 05:48:37.289025    2566 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jun 15 05:48:37.289649 ip-10-0-128-243 kubenswrapper[2566]: W0615 05:48:37.289027    2566 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jun 15 05:48:37.289649 ip-10-0-128-243 kubenswrapper[2566]: W0615 05:48:37.289030    2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jun 15 05:48:37.289649 ip-10-0-128-243 kubenswrapper[2566]: W0615 05:48:37.289032    2566 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jun 15 05:48:37.290156 ip-10-0-128-243 kubenswrapper[2566]: W0615 05:48:37.289035    2566 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jun 15 05:48:37.290156 ip-10-0-128-243 kubenswrapper[2566]: W0615 05:48:37.289037    2566 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jun 15 05:48:37.290156 ip-10-0-128-243 kubenswrapper[2566]: W0615 05:48:37.289040    2566 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jun 15 05:48:37.290156 ip-10-0-128-243 kubenswrapper[2566]: W0615 05:48:37.289042    2566 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jun 15 05:48:37.290156 ip-10-0-128-243 kubenswrapper[2566]: W0615 05:48:37.289045    2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jun 15 05:48:37.290156 ip-10-0-128-243 kubenswrapper[2566]: W0615 05:48:37.289048    2566 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jun 15 05:48:37.290156 ip-10-0-128-243 kubenswrapper[2566]: W0615 05:48:37.289050    2566 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jun 15 05:48:37.290156 ip-10-0-128-243 kubenswrapper[2566]: W0615 05:48:37.289052    2566 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jun 15 05:48:37.290156 ip-10-0-128-243 kubenswrapper[2566]: W0615 05:48:37.289055    2566 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jun 15 05:48:37.290156 ip-10-0-128-243 kubenswrapper[2566]: W0615 05:48:37.289059    2566 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jun 15 05:48:37.290156 ip-10-0-128-243 kubenswrapper[2566]: W0615 05:48:37.289061    2566 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jun 15 05:48:37.290156 ip-10-0-128-243 kubenswrapper[2566]: W0615 05:48:37.289064    2566 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jun 15 05:48:37.290156 ip-10-0-128-243 kubenswrapper[2566]: W0615 05:48:37.289066    2566 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jun 15 05:48:37.290156 ip-10-0-128-243 kubenswrapper[2566]: W0615 05:48:37.289068    2566 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jun 15 05:48:37.290156 ip-10-0-128-243 kubenswrapper[2566]: W0615 05:48:37.289071    2566 feature_gate.go:328] unrecognized feature gate: OSStreams
Jun 15 05:48:37.290156 ip-10-0-128-243 kubenswrapper[2566]: W0615 05:48:37.289073    2566 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jun 15 05:48:37.290156 ip-10-0-128-243 kubenswrapper[2566]: W0615 05:48:37.289076    2566 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jun 15 05:48:37.290156 ip-10-0-128-243 kubenswrapper[2566]: W0615 05:48:37.289091    2566 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jun 15 05:48:37.290156 ip-10-0-128-243 kubenswrapper[2566]: W0615 05:48:37.289095    2566 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jun 15 05:48:37.290156 ip-10-0-128-243 kubenswrapper[2566]: W0615 05:48:37.289098    2566 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jun 15 05:48:37.290629 ip-10-0-128-243 kubenswrapper[2566]: W0615 05:48:37.289101    2566 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jun 15 05:48:37.290629 ip-10-0-128-243 kubenswrapper[2566]: W0615 05:48:37.289103    2566 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jun 15 05:48:37.290629 ip-10-0-128-243 kubenswrapper[2566]: W0615 05:48:37.289106    2566 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jun 15 05:48:37.290629 ip-10-0-128-243 kubenswrapper[2566]: W0615 05:48:37.289108    2566 feature_gate.go:328] unrecognized feature gate: NewOLM
Jun 15 05:48:37.290629 ip-10-0-128-243 kubenswrapper[2566]: W0615 05:48:37.289111    2566 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jun 15 05:48:37.290629 ip-10-0-128-243 kubenswrapper[2566]: W0615 05:48:37.289113    2566 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jun 15 05:48:37.290629 ip-10-0-128-243 kubenswrapper[2566]: W0615 05:48:37.289118    2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jun 15 05:48:37.290629 ip-10-0-128-243 kubenswrapper[2566]: W0615 05:48:37.289121    2566 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jun 15 05:48:37.290629 ip-10-0-128-243 kubenswrapper[2566]: W0615 05:48:37.289123    2566 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jun 15 05:48:37.290629 ip-10-0-128-243 kubenswrapper[2566]: W0615 05:48:37.289126    2566 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jun 15 05:48:37.290629 ip-10-0-128-243 kubenswrapper[2566]: W0615 05:48:37.289129    2566 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jun 15 05:48:37.290629 ip-10-0-128-243 kubenswrapper[2566]: W0615 05:48:37.289131    2566 feature_gate.go:328] unrecognized feature gate: Example2
Jun 15 05:48:37.290629 ip-10-0-128-243 kubenswrapper[2566]: W0615 05:48:37.289134    2566 feature_gate.go:328] unrecognized feature gate: EventTTL
Jun 15 05:48:37.290629 ip-10-0-128-243 kubenswrapper[2566]: W0615 05:48:37.289137    2566 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jun 15 05:48:37.290629 ip-10-0-128-243 kubenswrapper[2566]: W0615 05:48:37.289140    2566 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jun 15 05:48:37.290629 ip-10-0-128-243 kubenswrapper[2566]: W0615 05:48:37.289142    2566 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jun 15 05:48:37.290629 ip-10-0-128-243 kubenswrapper[2566]: W0615 05:48:37.289145    2566 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jun 15 05:48:37.290629 ip-10-0-128-243 kubenswrapper[2566]: W0615 05:48:37.289148    2566 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jun 15 05:48:37.290629 ip-10-0-128-243 kubenswrapper[2566]: W0615 05:48:37.289150    2566 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jun 15 05:48:37.290629 ip-10-0-128-243 kubenswrapper[2566]: W0615 05:48:37.289153    2566 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jun 15 05:48:37.291129 ip-10-0-128-243 kubenswrapper[2566]: W0615 05:48:37.289155    2566 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jun 15 05:48:37.291129 ip-10-0-128-243 kubenswrapper[2566]: W0615 05:48:37.289158    2566 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jun 15 05:48:37.291129 ip-10-0-128-243 kubenswrapper[2566]: W0615 05:48:37.289160    2566 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jun 15 05:48:37.291129 ip-10-0-128-243 kubenswrapper[2566]: W0615 05:48:37.289163    2566 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jun 15 05:48:37.291129 ip-10-0-128-243 kubenswrapper[2566]: W0615 05:48:37.289165    2566 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jun 15 05:48:37.291129 ip-10-0-128-243 kubenswrapper[2566]: W0615 05:48:37.289168    2566 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jun 15 05:48:37.291129 ip-10-0-128-243 kubenswrapper[2566]: W0615 05:48:37.289847    2566 feature_gate.go:328] unrecognized feature gate: Example2
Jun 15 05:48:37.291129 ip-10-0-128-243 kubenswrapper[2566]: W0615 05:48:37.289853    2566 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jun 15 05:48:37.291129 ip-10-0-128-243 kubenswrapper[2566]: W0615 05:48:37.289856    2566 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jun 15 05:48:37.291129 ip-10-0-128-243 kubenswrapper[2566]: W0615 05:48:37.289858    2566 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jun 15 05:48:37.291129 ip-10-0-128-243 kubenswrapper[2566]: W0615 05:48:37.289881    2566 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jun 15 05:48:37.291129 ip-10-0-128-243 kubenswrapper[2566]: W0615 05:48:37.289885    2566 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jun 15 05:48:37.291129 ip-10-0-128-243 kubenswrapper[2566]: W0615 05:48:37.289889    2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jun 15 05:48:37.291129 ip-10-0-128-243 kubenswrapper[2566]: W0615 05:48:37.289892    2566 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jun 15 05:48:37.291129 ip-10-0-128-243 kubenswrapper[2566]: W0615 05:48:37.289895    2566 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jun 15 05:48:37.291129 ip-10-0-128-243 kubenswrapper[2566]: W0615 05:48:37.289898    2566 feature_gate.go:328] unrecognized feature gate: OSStreams
Jun 15 05:48:37.291129 ip-10-0-128-243 kubenswrapper[2566]: W0615 05:48:37.289901    2566 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jun 15 05:48:37.291129 ip-10-0-128-243 kubenswrapper[2566]: W0615 05:48:37.289904    2566 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jun 15 05:48:37.291129 ip-10-0-128-243 kubenswrapper[2566]: W0615 05:48:37.289908    2566 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jun 15 05:48:37.291129 ip-10-0-128-243 kubenswrapper[2566]: W0615 05:48:37.289911    2566 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jun 15 05:48:37.291649 ip-10-0-128-243 kubenswrapper[2566]: W0615 05:48:37.289914    2566 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jun 15 05:48:37.291649 ip-10-0-128-243 kubenswrapper[2566]: W0615 05:48:37.289916    2566 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jun 15 05:48:37.291649 ip-10-0-128-243 kubenswrapper[2566]: W0615 05:48:37.289919    2566 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jun 15 05:48:37.291649 ip-10-0-128-243 kubenswrapper[2566]: W0615 05:48:37.289921    2566 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jun 15 05:48:37.291649 ip-10-0-128-243 kubenswrapper[2566]: W0615 05:48:37.289924    2566 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jun 15 05:48:37.291649 ip-10-0-128-243 kubenswrapper[2566]: W0615 05:48:37.289926    2566 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jun 15 05:48:37.291649 ip-10-0-128-243 kubenswrapper[2566]: W0615 05:48:37.289929    2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jun 15 05:48:37.291649 ip-10-0-128-243 kubenswrapper[2566]: W0615 05:48:37.289932    2566 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jun 15 05:48:37.291649 ip-10-0-128-243 kubenswrapper[2566]: W0615 05:48:37.289934    2566 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jun 15 05:48:37.291649 ip-10-0-128-243 kubenswrapper[2566]: W0615 05:48:37.289937    2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jun 15 05:48:37.291649 ip-10-0-128-243 kubenswrapper[2566]: W0615 05:48:37.289939    2566 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jun 15 05:48:37.291649 ip-10-0-128-243 kubenswrapper[2566]: W0615 05:48:37.289941    2566 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jun 15 05:48:37.291649 ip-10-0-128-243 kubenswrapper[2566]: W0615 05:48:37.289944    2566 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jun 15 05:48:37.291649 ip-10-0-128-243 kubenswrapper[2566]: W0615 05:48:37.289947    2566 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jun 15 05:48:37.291649 ip-10-0-128-243 kubenswrapper[2566]: W0615 05:48:37.289949    2566 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jun 15 05:48:37.291649 ip-10-0-128-243 kubenswrapper[2566]: W0615 05:48:37.289951    2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jun 15 05:48:37.291649 ip-10-0-128-243 kubenswrapper[2566]: W0615 05:48:37.289954    2566 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jun 15 05:48:37.291649 ip-10-0-128-243 kubenswrapper[2566]: W0615 05:48:37.289956    2566 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jun 15 05:48:37.291649 ip-10-0-128-243 kubenswrapper[2566]: W0615 05:48:37.289959    2566 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jun 15 05:48:37.291649 ip-10-0-128-243 kubenswrapper[2566]: W0615 05:48:37.289962    2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jun 15 05:48:37.292143 ip-10-0-128-243 kubenswrapper[2566]: W0615 05:48:37.289966    2566 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jun 15 05:48:37.292143 ip-10-0-128-243 kubenswrapper[2566]: W0615 05:48:37.289970    2566 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jun 15 05:48:37.292143 ip-10-0-128-243 kubenswrapper[2566]: W0615 05:48:37.289973    2566 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jun 15 05:48:37.292143 ip-10-0-128-243 kubenswrapper[2566]: W0615 05:48:37.289976    2566 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jun 15 05:48:37.292143 ip-10-0-128-243 kubenswrapper[2566]: W0615 05:48:37.289979    2566 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jun 15 05:48:37.292143 ip-10-0-128-243 kubenswrapper[2566]: W0615 05:48:37.289982    2566 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jun 15 05:48:37.292143 ip-10-0-128-243 kubenswrapper[2566]: W0615 05:48:37.289985    2566 feature_gate.go:328] unrecognized feature gate: NewOLM
Jun 15 05:48:37.292143 ip-10-0-128-243 kubenswrapper[2566]: W0615 05:48:37.289987    2566 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jun 15 05:48:37.292143 ip-10-0-128-243 kubenswrapper[2566]: W0615 05:48:37.289990    2566 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jun 15 05:48:37.292143 ip-10-0-128-243 kubenswrapper[2566]: W0615 05:48:37.289992    2566 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jun 15 05:48:37.292143 ip-10-0-128-243 kubenswrapper[2566]: W0615 05:48:37.289996    2566 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jun 15 05:48:37.292143 ip-10-0-128-243 kubenswrapper[2566]: W0615 05:48:37.289998    2566 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jun 15 05:48:37.292143 ip-10-0-128-243 kubenswrapper[2566]: W0615 05:48:37.290001    2566 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jun 15 05:48:37.292143 ip-10-0-128-243 kubenswrapper[2566]: W0615 05:48:37.290003    2566 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jun 15 05:48:37.292143 ip-10-0-128-243 kubenswrapper[2566]: W0615 05:48:37.290006    2566 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jun 15 05:48:37.292143 ip-10-0-128-243 kubenswrapper[2566]: W0615 05:48:37.290008    2566 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jun 15 05:48:37.292143 ip-10-0-128-243 kubenswrapper[2566]: W0615 05:48:37.290011    2566 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jun 15 05:48:37.292143 ip-10-0-128-243 kubenswrapper[2566]: W0615 05:48:37.290014    2566 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jun 15 05:48:37.292143 ip-10-0-128-243 kubenswrapper[2566]: W0615 05:48:37.290017    2566 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jun 15 05:48:37.292591 ip-10-0-128-243 kubenswrapper[2566]: W0615 05:48:37.290019    2566 feature_gate.go:328] unrecognized feature gate: EventTTL
Jun 15 05:48:37.292591 ip-10-0-128-243 kubenswrapper[2566]: W0615 05:48:37.290021    2566 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jun 15 05:48:37.292591 ip-10-0-128-243 kubenswrapper[2566]: W0615 05:48:37.290024    2566 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jun 15 05:48:37.292591 ip-10-0-128-243 kubenswrapper[2566]: W0615 05:48:37.290026    2566 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jun 15 05:48:37.292591 ip-10-0-128-243 kubenswrapper[2566]: W0615 05:48:37.290031    2566 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jun 15 05:48:37.292591 ip-10-0-128-243 kubenswrapper[2566]: W0615 05:48:37.290034    2566 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jun 15 05:48:37.292591 ip-10-0-128-243 kubenswrapper[2566]: W0615 05:48:37.290036    2566 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jun 15 05:48:37.292591 ip-10-0-128-243 kubenswrapper[2566]: W0615 05:48:37.290039    2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jun 15 05:48:37.292591 ip-10-0-128-243 kubenswrapper[2566]: W0615 05:48:37.290041    2566 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jun 15 05:48:37.292591 ip-10-0-128-243 kubenswrapper[2566]: W0615 05:48:37.290044    2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jun 15 05:48:37.292591 ip-10-0-128-243 kubenswrapper[2566]: W0615 05:48:37.290047    2566 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jun 15 05:48:37.292591 ip-10-0-128-243 kubenswrapper[2566]: W0615 05:48:37.290049    2566 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jun 15 05:48:37.292591 ip-10-0-128-243 kubenswrapper[2566]: W0615 05:48:37.290052    2566 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jun 15 05:48:37.292591 ip-10-0-128-243 kubenswrapper[2566]: W0615 05:48:37.290055    2566 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jun 15 05:48:37.292591 ip-10-0-128-243 kubenswrapper[2566]: W0615 05:48:37.290057    2566 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jun 15 05:48:37.292591 ip-10-0-128-243 kubenswrapper[2566]: W0615 05:48:37.290060    2566 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jun 15 05:48:37.292591 ip-10-0-128-243 kubenswrapper[2566]: W0615 05:48:37.290062    2566 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jun 15 05:48:37.292591 ip-10-0-128-243 kubenswrapper[2566]: W0615 05:48:37.290065    2566 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jun 15 05:48:37.292591 ip-10-0-128-243 kubenswrapper[2566]: W0615 05:48:37.290068    2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jun 15 05:48:37.292591 ip-10-0-128-243 kubenswrapper[2566]: W0615 05:48:37.290070    2566 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jun 15 05:48:37.293066 ip-10-0-128-243 kubenswrapper[2566]: W0615 05:48:37.290073    2566 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jun 15 05:48:37.293066 ip-10-0-128-243 kubenswrapper[2566]: W0615 05:48:37.290075    2566 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jun 15 05:48:37.293066 ip-10-0-128-243 kubenswrapper[2566]: W0615 05:48:37.290095    2566 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jun 15 05:48:37.293066 ip-10-0-128-243 kubenswrapper[2566]: W0615 05:48:37.290099    2566 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jun 15 05:48:37.293066 ip-10-0-128-243 kubenswrapper[2566]: W0615 05:48:37.290101    2566 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jun 15 05:48:37.293066 ip-10-0-128-243 kubenswrapper[2566]: W0615 05:48:37.290104    2566 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jun 15 05:48:37.293066 ip-10-0-128-243 kubenswrapper[2566]: W0615 05:48:37.290109    2566 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jun 15 05:48:37.293066 ip-10-0-128-243 kubenswrapper[2566]: W0615 05:48:37.290113    2566 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jun 15 05:48:37.293066 ip-10-0-128-243 kubenswrapper[2566]: W0615 05:48:37.290116    2566 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jun 15 05:48:37.293066 ip-10-0-128-243 kubenswrapper[2566]: W0615 05:48:37.290119    2566 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jun 15 05:48:37.293066 ip-10-0-128-243 kubenswrapper[2566]: W0615 05:48:37.290121    2566 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jun 15 05:48:37.293066 ip-10-0-128-243 kubenswrapper[2566]: W0615 05:48:37.290124    2566 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jun 15 05:48:37.293066 ip-10-0-128-243 kubenswrapper[2566]: W0615 05:48:37.290126    2566 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jun 15 05:48:37.293066 ip-10-0-128-243 kubenswrapper[2566]: W0615 05:48:37.290129    2566 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jun 15 05:48:37.293066 ip-10-0-128-243 kubenswrapper[2566]: W0615 05:48:37.290131    2566 feature_gate.go:328] unrecognized feature gate: DualReplica
Jun 15 05:48:37.293066 ip-10-0-128-243 kubenswrapper[2566]: W0615 05:48:37.290134    2566 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jun 15 05:48:37.293066 ip-10-0-128-243 kubenswrapper[2566]: W0615 05:48:37.290141    2566 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jun 15 05:48:37.293066 ip-10-0-128-243 kubenswrapper[2566]: W0615 05:48:37.290143    2566 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jun 15 05:48:37.293066 ip-10-0-128-243 kubenswrapper[2566]: W0615 05:48:37.290146    2566 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jun 15 05:48:37.293066 ip-10-0-128-243 kubenswrapper[2566]: W0615 05:48:37.290149    2566 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jun 15 05:48:37.293555 ip-10-0-128-243 kubenswrapper[2566]: W0615 05:48:37.290151    2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jun 15 05:48:37.293555 ip-10-0-128-243 kubenswrapper[2566]: W0615 05:48:37.290154    2566 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jun 15 05:48:37.293555 ip-10-0-128-243 kubenswrapper[2566]: W0615 05:48:37.290156    2566 feature_gate.go:328] unrecognized feature gate: Example
Jun 15 05:48:37.293555 ip-10-0-128-243 kubenswrapper[2566]: W0615 05:48:37.290159    2566 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jun 15 05:48:37.293555 ip-10-0-128-243 kubenswrapper[2566]: W0615 05:48:37.290161    2566 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jun 15 05:48:37.293555 ip-10-0-128-243 kubenswrapper[2566]: W0615 05:48:37.290166    2566 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jun 15 05:48:37.293555 ip-10-0-128-243 kubenswrapper[2566]: W0615 05:48:37.290513    2566 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jun 15 05:48:37.293555 ip-10-0-128-243 kubenswrapper[2566]: W0615 05:48:37.290519    2566 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jun 15 05:48:37.293555 ip-10-0-128-243 kubenswrapper[2566]: W0615 05:48:37.290523    2566 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jun 15 05:48:37.293555 ip-10-0-128-243 kubenswrapper[2566]: W0615 05:48:37.290526    2566 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jun 15 05:48:37.293555 ip-10-0-128-243 kubenswrapper[2566]: W0615 05:48:37.290530    2566 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jun 15 05:48:37.293555 ip-10-0-128-243 kubenswrapper[2566]: W0615 05:48:37.290533    2566 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jun 15 05:48:37.293555 ip-10-0-128-243 kubenswrapper[2566]: W0615 05:48:37.290536    2566 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jun 15 05:48:37.293555 ip-10-0-128-243 kubenswrapper[2566]: W0615 05:48:37.290538    2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jun 15 05:48:37.293555 ip-10-0-128-243 kubenswrapper[2566]: W0615 05:48:37.290541    2566 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jun 15 05:48:37.293555 ip-10-0-128-243 kubenswrapper[2566]: W0615 05:48:37.290544    2566 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jun 15 05:48:37.293555 ip-10-0-128-243 kubenswrapper[2566]: W0615 05:48:37.290546    2566 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jun 15 05:48:37.293555 ip-10-0-128-243 kubenswrapper[2566]: W0615 05:48:37.290549    2566 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jun 15 05:48:37.293555 ip-10-0-128-243 kubenswrapper[2566]: W0615 05:48:37.290551    2566 feature_gate.go:328] unrecognized feature gate: Example2
Jun 15 05:48:37.294012 ip-10-0-128-243 kubenswrapper[2566]: W0615 05:48:37.290554    2566 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jun 15 05:48:37.294012 ip-10-0-128-243 kubenswrapper[2566]: W0615 05:48:37.290556    2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jun 15 05:48:37.294012 ip-10-0-128-243 kubenswrapper[2566]: W0615 05:48:37.290559    2566 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jun 15 05:48:37.294012 ip-10-0-128-243 kubenswrapper[2566]: W0615 05:48:37.290562    2566 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jun 15 05:48:37.294012 ip-10-0-128-243 kubenswrapper[2566]: W0615 05:48:37.290564    2566 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jun 15 05:48:37.294012 ip-10-0-128-243 kubenswrapper[2566]: W0615 05:48:37.290567    2566 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jun 15 05:48:37.294012 ip-10-0-128-243 kubenswrapper[2566]: W0615 05:48:37.290569    2566 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jun 15 05:48:37.294012 ip-10-0-128-243 kubenswrapper[2566]: W0615 05:48:37.290572    2566 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jun 15 05:48:37.294012 ip-10-0-128-243 kubenswrapper[2566]: W0615 05:48:37.290574    2566 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jun 15 05:48:37.294012 ip-10-0-128-243 kubenswrapper[2566]: W0615 05:48:37.290579    2566 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jun 15 05:48:37.294012 ip-10-0-128-243 kubenswrapper[2566]: W0615 05:48:37.290581    2566 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jun 15 05:48:37.294012 ip-10-0-128-243 kubenswrapper[2566]: W0615 05:48:37.290584    2566 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jun 15 05:48:37.294012 ip-10-0-128-243 kubenswrapper[2566]: W0615 05:48:37.290587    2566 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jun 15 05:48:37.294012 ip-10-0-128-243 kubenswrapper[2566]: W0615 05:48:37.290589    2566 feature_gate.go:328] unrecognized feature gate: EventTTL
Jun 15 05:48:37.294012 ip-10-0-128-243 kubenswrapper[2566]: W0615 05:48:37.290592    2566 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jun 15 05:48:37.294012 ip-10-0-128-243 kubenswrapper[2566]: W0615 05:48:37.290594    2566 feature_gate.go:328] unrecognized feature gate: OSStreams
Jun 15 05:48:37.294012 ip-10-0-128-243 kubenswrapper[2566]: W0615 05:48:37.290597    2566 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jun 15 05:48:37.294012 ip-10-0-128-243 kubenswrapper[2566]: W0615 05:48:37.290599    2566 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jun 15 05:48:37.294012 ip-10-0-128-243 kubenswrapper[2566]: W0615 05:48:37.290602    2566 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jun 15 05:48:37.294012 ip-10-0-128-243 kubenswrapper[2566]: W0615 05:48:37.290604    2566 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jun 15 05:48:37.294503 ip-10-0-128-243 kubenswrapper[2566]: W0615 05:48:37.290607    2566 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jun 15 05:48:37.294503 ip-10-0-128-243 kubenswrapper[2566]: W0615 05:48:37.290609    2566 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jun 15 05:48:37.294503 ip-10-0-128-243 kubenswrapper[2566]: W0615 05:48:37.290612    2566 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jun 15 05:48:37.294503 ip-10-0-128-243 kubenswrapper[2566]: W0615 05:48:37.290615    2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jun 15 05:48:37.294503 ip-10-0-128-243 kubenswrapper[2566]: W0615 05:48:37.290618    2566 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jun 15 05:48:37.294503 ip-10-0-128-243 kubenswrapper[2566]: W0615 05:48:37.290621    2566 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jun 15 05:48:37.294503 ip-10-0-128-243 kubenswrapper[2566]: W0615 05:48:37.290623    2566 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jun 15 05:48:37.294503 ip-10-0-128-243 kubenswrapper[2566]: W0615 05:48:37.290626    2566 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jun 15 05:48:37.294503 ip-10-0-128-243 kubenswrapper[2566]: W0615 05:48:37.290628    2566 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jun 15 05:48:37.294503 ip-10-0-128-243 kubenswrapper[2566]: W0615 05:48:37.290631    2566 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jun 15 05:48:37.294503 ip-10-0-128-243 kubenswrapper[2566]: W0615 05:48:37.290634    2566 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jun 15 05:48:37.294503 ip-10-0-128-243 kubenswrapper[2566]: W0615 05:48:37.290636    2566 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jun 15 05:48:37.294503 ip-10-0-128-243 kubenswrapper[2566]: W0615 05:48:37.290639    2566 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jun 15 05:48:37.294503 ip-10-0-128-243 kubenswrapper[2566]: W0615 05:48:37.290641    2566 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jun 15 05:48:37.294503 ip-10-0-128-243 kubenswrapper[2566]: W0615 05:48:37.290644    2566 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jun 15 05:48:37.294503 ip-10-0-128-243 kubenswrapper[2566]: W0615 05:48:37.290646    2566 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jun 15 05:48:37.294503 ip-10-0-128-243 kubenswrapper[2566]: W0615 05:48:37.290649    2566 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jun 15 05:48:37.294503 ip-10-0-128-243 kubenswrapper[2566]: W0615 05:48:37.290651    2566 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jun 15 05:48:37.294503 ip-10-0-128-243 kubenswrapper[2566]: W0615 05:48:37.290654    2566 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jun 15 05:48:37.294503 ip-10-0-128-243 kubenswrapper[2566]: W0615 05:48:37.290656    2566 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jun 15 05:48:37.294991 ip-10-0-128-243 kubenswrapper[2566]: W0615 05:48:37.290659    2566 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jun 15 05:48:37.294991 ip-10-0-128-243 kubenswrapper[2566]: W0615 05:48:37.290663    2566 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jun 15 05:48:37.294991 ip-10-0-128-243 kubenswrapper[2566]: W0615 05:48:37.290665    2566 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jun 15 05:48:37.294991 ip-10-0-128-243 kubenswrapper[2566]: W0615 05:48:37.290668    2566 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jun 15 05:48:37.294991 ip-10-0-128-243 kubenswrapper[2566]: W0615 05:48:37.290671    2566 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jun 15 05:48:37.294991 ip-10-0-128-243 kubenswrapper[2566]: W0615 05:48:37.290673    2566 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jun 15 05:48:37.294991 ip-10-0-128-243 kubenswrapper[2566]: W0615 05:48:37.290676    2566 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jun 15 05:48:37.294991 ip-10-0-128-243 kubenswrapper[2566]: W0615 05:48:37.290678    2566 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jun 15 05:48:37.294991 ip-10-0-128-243 kubenswrapper[2566]: W0615 05:48:37.290681    2566 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jun 15 05:48:37.294991 ip-10-0-128-243 kubenswrapper[2566]: W0615 05:48:37.290683    2566 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jun 15 05:48:37.294991 ip-10-0-128-243 kubenswrapper[2566]: W0615 05:48:37.290686    2566 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jun 15 05:48:37.294991 ip-10-0-128-243 kubenswrapper[2566]: W0615 05:48:37.290688    2566 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jun 15 05:48:37.294991 ip-10-0-128-243 kubenswrapper[2566]: W0615 05:48:37.290691    2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jun 15 05:48:37.294991 ip-10-0-128-243 kubenswrapper[2566]: W0615 05:48:37.290693    2566 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jun 15 05:48:37.294991 ip-10-0-128-243 kubenswrapper[2566]: W0615 05:48:37.290698    2566 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jun 15 05:48:37.294991 ip-10-0-128-243 kubenswrapper[2566]: W0615 05:48:37.290701    2566 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jun 15 05:48:37.294991 ip-10-0-128-243 kubenswrapper[2566]: W0615 05:48:37.290704    2566 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jun 15 05:48:37.294991 ip-10-0-128-243 kubenswrapper[2566]: W0615 05:48:37.290708    2566 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jun 15 05:48:37.294991 ip-10-0-128-243 kubenswrapper[2566]: W0615 05:48:37.290711    2566 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jun 15 05:48:37.294991 ip-10-0-128-243 kubenswrapper[2566]: W0615 05:48:37.290713    2566 feature_gate.go:328] unrecognized feature gate: NewOLM
Jun 15 05:48:37.295494 ip-10-0-128-243 kubenswrapper[2566]: W0615 05:48:37.290716    2566 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jun 15 05:48:37.295494 ip-10-0-128-243 kubenswrapper[2566]: W0615 05:48:37.290719    2566 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jun 15 05:48:37.295494 ip-10-0-128-243 kubenswrapper[2566]: W0615 05:48:37.290722    2566 feature_gate.go:328] unrecognized feature gate: Example
Jun 15 05:48:37.295494 ip-10-0-128-243 kubenswrapper[2566]: W0615 05:48:37.290724    2566 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jun 15 05:48:37.295494 ip-10-0-128-243 kubenswrapper[2566]: W0615 05:48:37.290727    2566 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jun 15 05:48:37.295494 ip-10-0-128-243 kubenswrapper[2566]: W0615 05:48:37.290730    2566 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jun 15 05:48:37.295494 ip-10-0-128-243 kubenswrapper[2566]: W0615 05:48:37.290732    2566 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jun 15 05:48:37.295494 ip-10-0-128-243 kubenswrapper[2566]: W0615 05:48:37.290734    2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jun 15 05:48:37.295494 ip-10-0-128-243 kubenswrapper[2566]: W0615 05:48:37.290739    2566 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jun 15 05:48:37.295494 ip-10-0-128-243 kubenswrapper[2566]: W0615 05:48:37.290741    2566 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jun 15 05:48:37.295494 ip-10-0-128-243 kubenswrapper[2566]: W0615 05:48:37.290744    2566 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jun 15 05:48:37.295494 ip-10-0-128-243 kubenswrapper[2566]: W0615 05:48:37.290747    2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jun 15 05:48:37.295494 ip-10-0-128-243 kubenswrapper[2566]: W0615 05:48:37.290749    2566 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jun 15 05:48:37.295494 ip-10-0-128-243 kubenswrapper[2566]: W0615 05:48:37.290753    2566 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jun 15 05:48:37.295494 ip-10-0-128-243 kubenswrapper[2566]: W0615 05:48:37.290755    2566 feature_gate.go:328] unrecognized feature gate: DualReplica
Jun 15 05:48:37.295494 ip-10-0-128-243 kubenswrapper[2566]: W0615 05:48:37.290758    2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jun 15 05:48:37.295494 ip-10-0-128-243 kubenswrapper[2566]: W0615 05:48:37.290761    2566 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jun 15 05:48:37.295494 ip-10-0-128-243 kubenswrapper[2566]: W0615 05:48:37.290763    2566 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jun 15 05:48:37.295494 ip-10-0-128-243 kubenswrapper[2566]: W0615 05:48:37.290766    2566 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jun 15 05:48:37.295494 ip-10-0-128-243 kubenswrapper[2566]: W0615 05:48:37.290768    2566 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jun 15 05:48:37.296054 ip-10-0-128-243 kubenswrapper[2566]: W0615 05:48:37.290772    2566 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jun 15 05:48:37.296054 ip-10-0-128-243 kubenswrapper[2566]: W0615 05:48:37.290777    2566 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jun 15 05:48:37.296054 ip-10-0-128-243 kubenswrapper[2566]: W0615 05:48:37.290780    2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jun 15 05:48:37.296054 ip-10-0-128-243 kubenswrapper[2566]: W0615 05:48:37.290782    2566 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jun 15 05:48:37.296054 ip-10-0-128-243 kubenswrapper[2566]: W0615 05:48:37.290785    2566 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jun 15 05:48:37.296054 ip-10-0-128-243 kubenswrapper[2566]: W0615 05:48:37.290788    2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jun 15 05:48:37.296054 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:48:37.290858    2566 flags.go:64] FLAG: --address="0.0.0.0"
Jun 15 05:48:37.296054 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:48:37.290865    2566 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Jun 15 05:48:37.296054 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:48:37.290870    2566 flags.go:64] FLAG: --anonymous-auth="true"
Jun 15 05:48:37.296054 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:48:37.290875    2566 flags.go:64] FLAG: --application-metrics-count-limit="100"
Jun 15 05:48:37.296054 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:48:37.290879    2566 flags.go:64] FLAG: --authentication-token-webhook="false"
Jun 15 05:48:37.296054 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:48:37.290882    2566 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Jun 15 05:48:37.296054 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:48:37.290886    2566 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Jun 15 05:48:37.296054 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:48:37.290890    2566 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Jun 15 05:48:37.296054 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:48:37.290893    2566 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Jun 15 05:48:37.296054 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:48:37.290896    2566 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Jun 15 05:48:37.296054 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:48:37.290899    2566 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Jun 15 05:48:37.296054 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:48:37.290902    2566 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Jun 15 05:48:37.296054 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:48:37.290905    2566 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Jun 15 05:48:37.296054 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:48:37.290908    2566 flags.go:64] FLAG: --cgroup-root=""
Jun 15 05:48:37.296054 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:48:37.290914    2566 flags.go:64] FLAG: --cgroups-per-qos="true"
Jun 15 05:48:37.296054 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:48:37.290917    2566 flags.go:64] FLAG: --client-ca-file=""
Jun 15 05:48:37.296624 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:48:37.290920    2566 flags.go:64] FLAG: --cloud-provider="external"
Jun 15 05:48:37.296624 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:48:37.290930    2566 flags.go:64] FLAG: --cluster-dns="[]"
Jun 15 05:48:37.296624 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:48:37.290935    2566 flags.go:64] FLAG: --cluster-domain=""
Jun 15 05:48:37.296624 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:48:37.290940    2566 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Jun 15 05:48:37.296624 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:48:37.290943    2566 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Jun 15 05:48:37.296624 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:48:37.290946    2566 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Jun 15 05:48:37.296624 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:48:37.290949    2566 flags.go:64] FLAG: --container-log-max-files="5"
Jun 15 05:48:37.296624 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:48:37.290953    2566 flags.go:64] FLAG: --container-log-max-size="10Mi"
Jun 15 05:48:37.296624 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:48:37.290955    2566 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Jun 15 05:48:37.296624 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:48:37.290958    2566 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Jun 15 05:48:37.296624 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:48:37.290962    2566 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Jun 15 05:48:37.296624 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:48:37.290965    2566 flags.go:64] FLAG: --contention-profiling="false"
Jun 15 05:48:37.296624 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:48:37.290967    2566 flags.go:64] FLAG: --cpu-cfs-quota="true"
Jun 15 05:48:37.296624 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:48:37.290970    2566 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Jun 15 05:48:37.296624 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:48:37.290974    2566 flags.go:64] FLAG: --cpu-manager-policy="none"
Jun 15 05:48:37.296624 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:48:37.290977    2566 flags.go:64] FLAG: --cpu-manager-policy-options=""
Jun 15 05:48:37.296624 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:48:37.290980    2566 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Jun 15 05:48:37.296624 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:48:37.290983    2566 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Jun 15 05:48:37.296624 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:48:37.290986    2566 flags.go:64] FLAG: --enable-debugging-handlers="true"
Jun 15 05:48:37.296624 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:48:37.290989    2566 flags.go:64] FLAG: --enable-load-reader="false"
Jun 15 05:48:37.296624 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:48:37.290992    2566 flags.go:64] FLAG: --enable-server="true"
Jun 15 05:48:37.296624 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:48:37.290995    2566 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Jun 15 05:48:37.296624 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:48:37.291000    2566 flags.go:64] FLAG: --event-burst="100"
Jun 15 05:48:37.296624 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:48:37.291003    2566 flags.go:64] FLAG: --event-qps="50"
Jun 15 05:48:37.296624 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:48:37.291006    2566 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Jun 15 05:48:37.297284 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:48:37.291009    2566 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Jun 15 05:48:37.297284 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:48:37.291012    2566 flags.go:64] FLAG: --eviction-hard=""
Jun 15 05:48:37.297284 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:48:37.291015    2566 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Jun 15 05:48:37.297284 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:48:37.291018    2566 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Jun 15 05:48:37.297284 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:48:37.291020    2566 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Jun 15 05:48:37.297284 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:48:37.291024    2566 flags.go:64] FLAG: --eviction-soft=""
Jun 15 05:48:37.297284 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:48:37.291027    2566 flags.go:64] FLAG: --eviction-soft-grace-period=""
Jun 15 05:48:37.297284 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:48:37.291030    2566 flags.go:64] FLAG: --exit-on-lock-contention="false"
Jun 15 05:48:37.297284 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:48:37.291033    2566 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Jun 15 05:48:37.297284 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:48:37.291035    2566 flags.go:64] FLAG: --experimental-mounter-path=""
Jun 15 05:48:37.297284 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:48:37.291040    2566 flags.go:64] FLAG: --fail-cgroupv1="false"
Jun 15 05:48:37.297284 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:48:37.291043    2566 flags.go:64] FLAG: --fail-swap-on="true"
Jun 15 05:48:37.297284 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:48:37.291045    2566 flags.go:64] FLAG: --feature-gates=""
Jun 15 05:48:37.297284 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:48:37.291049    2566 flags.go:64] FLAG: --file-check-frequency="20s"
Jun 15 05:48:37.297284 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:48:37.291052    2566 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Jun 15 05:48:37.297284 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:48:37.291055    2566 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Jun 15 05:48:37.297284 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:48:37.291058    2566 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Jun 15 05:48:37.297284 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:48:37.291061    2566 flags.go:64] FLAG: --healthz-port="10248"
Jun 15 05:48:37.297284 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:48:37.291064    2566 flags.go:64] FLAG: --help="false"
Jun 15 05:48:37.297284 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:48:37.291067    2566 flags.go:64] FLAG: --hostname-override="ip-10-0-128-243.ec2.internal"
Jun 15 05:48:37.297284 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:48:37.291070    2566 flags.go:64] FLAG: --housekeeping-interval="10s"
Jun 15 05:48:37.297284 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:48:37.291073    2566 flags.go:64] FLAG: --http-check-frequency="20s"
Jun 15 05:48:37.297284 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:48:37.291076    2566 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Jun 15 05:48:37.297875 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:48:37.291093    2566 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Jun 15 05:48:37.297875 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:48:37.291097    2566 flags.go:64] FLAG: --image-gc-high-threshold="85"
Jun 15 05:48:37.297875 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:48:37.291100    2566 flags.go:64] FLAG: --image-gc-low-threshold="80"
Jun 15 05:48:37.297875 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:48:37.291102    2566 flags.go:64] FLAG: --image-service-endpoint=""
Jun 15 05:48:37.297875 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:48:37.291106    2566 flags.go:64] FLAG: --kernel-memcg-notification="false"
Jun 15 05:48:37.297875 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:48:37.291108    2566 flags.go:64] FLAG: --kube-api-burst="100"
Jun 15 05:48:37.297875 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:48:37.291112    2566 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Jun 15 05:48:37.297875 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:48:37.291115    2566 flags.go:64] FLAG: --kube-api-qps="50"
Jun 15 05:48:37.297875 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:48:37.291118    2566 flags.go:64] FLAG: --kube-reserved=""
Jun 15 05:48:37.297875 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:48:37.291121    2566 flags.go:64] FLAG: --kube-reserved-cgroup=""
Jun 15 05:48:37.297875 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:48:37.291124    2566 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Jun 15 05:48:37.297875 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:48:37.291126    2566 flags.go:64] FLAG: --kubelet-cgroups=""
Jun 15 05:48:37.297875 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:48:37.291129    2566 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Jun 15 05:48:37.297875 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:48:37.291132    2566 flags.go:64] FLAG: --lock-file=""
Jun 15 05:48:37.297875 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:48:37.291136    2566 flags.go:64] FLAG: --log-cadvisor-usage="false"
Jun 15 05:48:37.297875 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:48:37.291139    2566 flags.go:64] FLAG: --log-flush-frequency="5s"
Jun 15 05:48:37.297875 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:48:37.291142    2566 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Jun 15 05:48:37.297875 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:48:37.291147    2566 flags.go:64] FLAG: --log-json-split-stream="false"
Jun 15 05:48:37.297875 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:48:37.291150    2566 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Jun 15 05:48:37.297875 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:48:37.291153    2566 flags.go:64] FLAG: --log-text-split-stream="false"
Jun 15 05:48:37.297875 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:48:37.291156    2566 flags.go:64] FLAG: --logging-format="text"
Jun 15 05:48:37.297875 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:48:37.291159    2566 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Jun 15 05:48:37.297875 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:48:37.291162    2566 flags.go:64] FLAG: --make-iptables-util-chains="true"
Jun 15 05:48:37.297875 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:48:37.291165    2566 flags.go:64] FLAG: --manifest-url=""
Jun 15 05:48:37.298794 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:48:37.291167    2566 flags.go:64] FLAG: --manifest-url-header=""
Jun 15 05:48:37.298794 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:48:37.291171    2566 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Jun 15 05:48:37.298794 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:48:37.291174    2566 flags.go:64] FLAG: --max-open-files="1000000"
Jun 15 05:48:37.298794 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:48:37.291178    2566 flags.go:64] FLAG: --max-pods="110"
Jun 15 05:48:37.298794 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:48:37.291181    2566 flags.go:64] FLAG: --maximum-dead-containers="-1"
Jun 15 05:48:37.298794 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:48:37.291183    2566 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Jun 15 05:48:37.298794 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:48:37.291186    2566 flags.go:64] FLAG: --memory-manager-policy="None"
Jun 15 05:48:37.298794 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:48:37.291189    2566 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Jun 15 05:48:37.298794 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:48:37.291192    2566 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Jun 15 05:48:37.298794 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:48:37.291194    2566 flags.go:64] FLAG: --node-ip="0.0.0.0"
Jun 15 05:48:37.298794 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:48:37.291197    2566 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Jun 15 05:48:37.298794 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:48:37.291204    2566 flags.go:64] FLAG: --node-status-max-images="50"
Jun 15 05:48:37.298794 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:48:37.291207    2566 flags.go:64] FLAG: --node-status-update-frequency="10s"
Jun 15 05:48:37.298794 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:48:37.291209    2566 flags.go:64] FLAG: --oom-score-adj="-999"
Jun 15 05:48:37.298794 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:48:37.291212    2566 flags.go:64] FLAG: --pod-cidr=""
Jun 15 05:48:37.298794 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:48:37.291216    2566 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:4a2e90c8ef7d783e4d635e24fb09435f5e1f6e954583512c0944f9e57bc77b52"
Jun 15 05:48:37.298794 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:48:37.291221    2566 flags.go:64] FLAG: --pod-manifest-path=""
Jun 15 05:48:37.298794 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:48:37.291224    2566 flags.go:64] FLAG: --pod-max-pids="-1"
Jun 15 05:48:37.298794 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:48:37.291226    2566 flags.go:64] FLAG: --pods-per-core="0"
Jun 15 05:48:37.298794 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:48:37.291229    2566 flags.go:64] FLAG: --port="10250"
Jun 15 05:48:37.298794 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:48:37.291232    2566 flags.go:64] FLAG: --protect-kernel-defaults="false"
Jun 15 05:48:37.298794 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:48:37.291235    2566 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-03e1126e637ce5fb7"
Jun 15 05:48:37.298794 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:48:37.291239    2566 flags.go:64] FLAG: --qos-reserved=""
Jun 15 05:48:37.298794 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:48:37.291241    2566 flags.go:64] FLAG: --read-only-port="10255"
Jun 15 05:48:37.299506 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:48:37.291244    2566 flags.go:64] FLAG: --register-node="true"
Jun 15 05:48:37.299506 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:48:37.291247    2566 flags.go:64] FLAG: --register-with-taints=""
Jun 15 05:48:37.299506 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:48:37.291250    2566 flags.go:64] FLAG: --registry-burst="10"
Jun 15 05:48:37.299506 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:48:37.291253    2566 flags.go:64] FLAG: --registry-qps="5"
Jun 15 05:48:37.299506 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:48:37.291256    2566 flags.go:64] FLAG: --reserved-cpus=""
Jun 15 05:48:37.299506 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:48:37.291259    2566 flags.go:64] FLAG: --reserved-memory=""
Jun 15 05:48:37.299506 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:48:37.291263    2566 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Jun 15 05:48:37.299506 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:48:37.291266    2566 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Jun 15 05:48:37.299506 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:48:37.291269    2566 flags.go:64] FLAG: --rotate-certificates="false"
Jun 15 05:48:37.299506 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:48:37.291272    2566 flags.go:64] FLAG: --rotate-server-certificates="false"
Jun 15 05:48:37.299506 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:48:37.291274    2566 flags.go:64] FLAG: --runonce="false"
Jun 15 05:48:37.299506 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:48:37.291277    2566 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Jun 15 05:48:37.299506 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:48:37.291280    2566 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Jun 15 05:48:37.299506 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:48:37.291283    2566 flags.go:64] FLAG: --seccomp-default="false"
Jun 15 05:48:37.299506 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:48:37.291285    2566 flags.go:64] FLAG: --serialize-image-pulls="true"
Jun 15 05:48:37.299506 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:48:37.291288    2566 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Jun 15 05:48:37.299506 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:48:37.291291    2566 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Jun 15 05:48:37.299506 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:48:37.291294    2566 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Jun 15 05:48:37.299506 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:48:37.291297    2566 flags.go:64] FLAG: --storage-driver-password="root"
Jun 15 05:48:37.299506 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:48:37.291299    2566 flags.go:64] FLAG: --storage-driver-secure="false"
Jun 15 05:48:37.299506 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:48:37.291302    2566 flags.go:64] FLAG: --storage-driver-table="stats"
Jun 15 05:48:37.299506 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:48:37.291305    2566 flags.go:64] FLAG: --storage-driver-user="root"
Jun 15 05:48:37.299506 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:48:37.291307    2566 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Jun 15 05:48:37.299506 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:48:37.291310    2566 flags.go:64] FLAG: --sync-frequency="1m0s"
Jun 15 05:48:37.299506 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:48:37.291314    2566 flags.go:64] FLAG: --system-cgroups=""
Jun 15 05:48:37.300130 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:48:37.291316    2566 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Jun 15 05:48:37.300130 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:48:37.291322    2566 flags.go:64] FLAG: --system-reserved-cgroup=""
Jun 15 05:48:37.300130 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:48:37.291325    2566 flags.go:64] FLAG: --tls-cert-file=""
Jun 15 05:48:37.300130 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:48:37.291327    2566 flags.go:64] FLAG: --tls-cipher-suites="[]"
Jun 15 05:48:37.300130 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:48:37.291332    2566 flags.go:64] FLAG: --tls-min-version=""
Jun 15 05:48:37.300130 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:48:37.291335    2566 flags.go:64] FLAG: --tls-private-key-file=""
Jun 15 05:48:37.300130 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:48:37.291338    2566 flags.go:64] FLAG: --topology-manager-policy="none"
Jun 15 05:48:37.300130 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:48:37.291341    2566 flags.go:64] FLAG: --topology-manager-policy-options=""
Jun 15 05:48:37.300130 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:48:37.291344    2566 flags.go:64] FLAG: --topology-manager-scope="container"
Jun 15 05:48:37.300130 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:48:37.291347    2566 flags.go:64] FLAG: --v="2"
Jun 15 05:48:37.300130 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:48:37.291350    2566 flags.go:64] FLAG: --version="false"
Jun 15 05:48:37.300130 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:48:37.291359    2566 flags.go:64] FLAG: --vmodule=""
Jun 15 05:48:37.300130 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:48:37.291363    2566 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Jun 15 05:48:37.300130 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:48:37.291366    2566 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Jun 15 05:48:37.300130 ip-10-0-128-243 kubenswrapper[2566]: W0615 05:48:37.291477    2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jun 15 05:48:37.300130 ip-10-0-128-243 kubenswrapper[2566]: W0615 05:48:37.291481    2566 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jun 15 05:48:37.300130 ip-10-0-128-243 kubenswrapper[2566]: W0615 05:48:37.291484    2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jun 15 05:48:37.300130 ip-10-0-128-243 kubenswrapper[2566]: W0615 05:48:37.291487    2566 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jun 15 05:48:37.300130 ip-10-0-128-243 kubenswrapper[2566]: W0615 05:48:37.291490    2566 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jun 15 05:48:37.300130 ip-10-0-128-243 kubenswrapper[2566]: W0615 05:48:37.291493    2566 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jun 15 05:48:37.300130 ip-10-0-128-243 kubenswrapper[2566]: W0615 05:48:37.291496    2566 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jun 15 05:48:37.300130 ip-10-0-128-243 kubenswrapper[2566]: W0615 05:48:37.291498    2566 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jun 15 05:48:37.300130 ip-10-0-128-243 kubenswrapper[2566]: W0615 05:48:37.291501    2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jun 15 05:48:37.300706 ip-10-0-128-243 kubenswrapper[2566]: W0615 05:48:37.291504    2566 feature_gate.go:328] unrecognized feature gate: NewOLM
Jun 15 05:48:37.300706 ip-10-0-128-243 kubenswrapper[2566]: W0615 05:48:37.291507    2566 feature_gate.go:328] unrecognized feature gate: Example
Jun 15 05:48:37.300706 ip-10-0-128-243 kubenswrapper[2566]: W0615 05:48:37.291510    2566 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jun 15 05:48:37.300706 ip-10-0-128-243 kubenswrapper[2566]: W0615 05:48:37.291513    2566 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jun 15 05:48:37.300706 ip-10-0-128-243 kubenswrapper[2566]: W0615 05:48:37.291515    2566 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jun 15 05:48:37.300706 ip-10-0-128-243 kubenswrapper[2566]: W0615 05:48:37.291518    2566 feature_gate.go:328] unrecognized feature gate: OSStreams
Jun 15 05:48:37.300706 ip-10-0-128-243 kubenswrapper[2566]: W0615 05:48:37.291521    2566 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jun 15 05:48:37.300706 ip-10-0-128-243 kubenswrapper[2566]: W0615 05:48:37.291523    2566 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jun 15 05:48:37.300706 ip-10-0-128-243 kubenswrapper[2566]: W0615 05:48:37.291526    2566 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jun 15 05:48:37.300706 ip-10-0-128-243 kubenswrapper[2566]: W0615 05:48:37.291529    2566 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jun 15 05:48:37.300706 ip-10-0-128-243 kubenswrapper[2566]: W0615 05:48:37.291532    2566 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jun 15 05:48:37.300706 ip-10-0-128-243 kubenswrapper[2566]: W0615 05:48:37.291534    2566 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jun 15 05:48:37.300706 ip-10-0-128-243 kubenswrapper[2566]: W0615 05:48:37.291537    2566 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jun 15 05:48:37.300706 ip-10-0-128-243 kubenswrapper[2566]: W0615 05:48:37.291539    2566 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jun 15 05:48:37.300706 ip-10-0-128-243 kubenswrapper[2566]: W0615 05:48:37.291542    2566 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jun 15 05:48:37.300706 ip-10-0-128-243 kubenswrapper[2566]: W0615 05:48:37.291544    2566 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jun 15 05:48:37.300706 ip-10-0-128-243 kubenswrapper[2566]: W0615 05:48:37.291547    2566 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jun 15 05:48:37.300706 ip-10-0-128-243 kubenswrapper[2566]: W0615 05:48:37.291549    2566 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jun 15 05:48:37.300706 ip-10-0-128-243 kubenswrapper[2566]: W0615 05:48:37.291552    2566 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jun 15 05:48:37.300706 ip-10-0-128-243 kubenswrapper[2566]: W0615 05:48:37.291554    2566 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jun 15 05:48:37.301214 ip-10-0-128-243 kubenswrapper[2566]: W0615 05:48:37.291557    2566 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jun 15 05:48:37.301214 ip-10-0-128-243 kubenswrapper[2566]: W0615 05:48:37.291559    2566 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jun 15 05:48:37.301214 ip-10-0-128-243 kubenswrapper[2566]: W0615 05:48:37.291562    2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jun 15 05:48:37.301214 ip-10-0-128-243 kubenswrapper[2566]: W0615 05:48:37.291564    2566 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jun 15 05:48:37.301214 ip-10-0-128-243 kubenswrapper[2566]: W0615 05:48:37.291567    2566 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jun 15 05:48:37.301214 ip-10-0-128-243 kubenswrapper[2566]: W0615 05:48:37.291569    2566 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jun 15 05:48:37.301214 ip-10-0-128-243 kubenswrapper[2566]: W0615 05:48:37.291572    2566 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jun 15 05:48:37.301214 ip-10-0-128-243 kubenswrapper[2566]: W0615 05:48:37.291574    2566 feature_gate.go:328] unrecognized feature gate: EventTTL
Jun 15 05:48:37.301214 ip-10-0-128-243 kubenswrapper[2566]: W0615 05:48:37.291577    2566 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jun 15 05:48:37.301214 ip-10-0-128-243 kubenswrapper[2566]: W0615 05:48:37.291579    2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jun 15 05:48:37.301214 ip-10-0-128-243 kubenswrapper[2566]: W0615 05:48:37.291581    2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jun 15 05:48:37.301214 ip-10-0-128-243 kubenswrapper[2566]: W0615 05:48:37.291584    2566 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jun 15 05:48:37.301214 ip-10-0-128-243 kubenswrapper[2566]: W0615 05:48:37.291586    2566 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jun 15 05:48:37.301214 ip-10-0-128-243 kubenswrapper[2566]: W0615 05:48:37.291588    2566 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jun 15 05:48:37.301214 ip-10-0-128-243 kubenswrapper[2566]: W0615 05:48:37.291592    2566 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jun 15 05:48:37.301214 ip-10-0-128-243 kubenswrapper[2566]: W0615 05:48:37.291596    2566 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jun 15 05:48:37.301214 ip-10-0-128-243 kubenswrapper[2566]: W0615 05:48:37.291600    2566 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jun 15 05:48:37.301214 ip-10-0-128-243 kubenswrapper[2566]: W0615 05:48:37.291603    2566 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jun 15 05:48:37.301214 ip-10-0-128-243 kubenswrapper[2566]: W0615 05:48:37.291606    2566 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jun 15 05:48:37.301683 ip-10-0-128-243 kubenswrapper[2566]: W0615 05:48:37.291609    2566 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jun 15 05:48:37.301683 ip-10-0-128-243 kubenswrapper[2566]: W0615 05:48:37.291611    2566 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jun 15 05:48:37.301683 ip-10-0-128-243 kubenswrapper[2566]: W0615 05:48:37.291614    2566 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jun 15 05:48:37.301683 ip-10-0-128-243 kubenswrapper[2566]: W0615 05:48:37.291617    2566 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jun 15 05:48:37.301683 ip-10-0-128-243 kubenswrapper[2566]: W0615 05:48:37.291620    2566 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jun 15 05:48:37.301683 ip-10-0-128-243 kubenswrapper[2566]: W0615 05:48:37.291622    2566 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jun 15 05:48:37.301683 ip-10-0-128-243 kubenswrapper[2566]: W0615 05:48:37.291625    2566 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jun 15 05:48:37.301683 ip-10-0-128-243 kubenswrapper[2566]: W0615 05:48:37.291627    2566 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jun 15 05:48:37.301683 ip-10-0-128-243 kubenswrapper[2566]: W0615 05:48:37.291630    2566 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jun 15 05:48:37.301683 ip-10-0-128-243 kubenswrapper[2566]: W0615 05:48:37.291632    2566 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jun 15 05:48:37.301683 ip-10-0-128-243 kubenswrapper[2566]: W0615 05:48:37.291635    2566 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jun 15 05:48:37.301683 ip-10-0-128-243 kubenswrapper[2566]: W0615 05:48:37.291637    2566 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jun 15 05:48:37.301683 ip-10-0-128-243 kubenswrapper[2566]: W0615 05:48:37.291640    2566 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jun 15 05:48:37.301683 ip-10-0-128-243 kubenswrapper[2566]: W0615 05:48:37.291644    2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jun 15 05:48:37.301683 ip-10-0-128-243 kubenswrapper[2566]: W0615 05:48:37.291646    2566 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jun 15 05:48:37.301683 ip-10-0-128-243 kubenswrapper[2566]: W0615 05:48:37.291649    2566 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jun 15 05:48:37.301683 ip-10-0-128-243 kubenswrapper[2566]: W0615 05:48:37.291652    2566 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jun 15 05:48:37.301683 ip-10-0-128-243 kubenswrapper[2566]: W0615 05:48:37.291655    2566 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jun 15 05:48:37.301683 ip-10-0-128-243 kubenswrapper[2566]: W0615 05:48:37.291657    2566 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jun 15 05:48:37.302156 ip-10-0-128-243 kubenswrapper[2566]: W0615 05:48:37.291660    2566 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jun 15 05:48:37.302156 ip-10-0-128-243 kubenswrapper[2566]: W0615 05:48:37.291663    2566 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jun 15 05:48:37.302156 ip-10-0-128-243 kubenswrapper[2566]: W0615 05:48:37.291665    2566 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jun 15 05:48:37.302156 ip-10-0-128-243 kubenswrapper[2566]: W0615 05:48:37.291668    2566 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jun 15 05:48:37.302156 ip-10-0-128-243 kubenswrapper[2566]: W0615 05:48:37.291670    2566 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jun 15 05:48:37.302156 ip-10-0-128-243 kubenswrapper[2566]: W0615 05:48:37.291673    2566 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jun 15 05:48:37.302156 ip-10-0-128-243 kubenswrapper[2566]: W0615 05:48:37.291675    2566 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jun 15 05:48:37.302156 ip-10-0-128-243 kubenswrapper[2566]: W0615 05:48:37.291678    2566 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jun 15 05:48:37.302156 ip-10-0-128-243 kubenswrapper[2566]: W0615 05:48:37.291680    2566 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jun 15 05:48:37.302156 ip-10-0-128-243 kubenswrapper[2566]: W0615 05:48:37.291683    2566 feature_gate.go:328] unrecognized feature gate: Example2
Jun 15 05:48:37.302156 ip-10-0-128-243 kubenswrapper[2566]: W0615 05:48:37.291685    2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jun 15 05:48:37.302156 ip-10-0-128-243 kubenswrapper[2566]: W0615 05:48:37.291688    2566 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jun 15 05:48:37.302156 ip-10-0-128-243 kubenswrapper[2566]: W0615 05:48:37.291690    2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jun 15 05:48:37.302156 ip-10-0-128-243 kubenswrapper[2566]: W0615 05:48:37.291692    2566 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jun 15 05:48:37.302156 ip-10-0-128-243 kubenswrapper[2566]: W0615 05:48:37.291695    2566 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jun 15 05:48:37.302156 ip-10-0-128-243 kubenswrapper[2566]: W0615 05:48:37.291697    2566 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jun 15 05:48:37.302156 ip-10-0-128-243 kubenswrapper[2566]: W0615 05:48:37.291700    2566 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jun 15 05:48:37.302156 ip-10-0-128-243 kubenswrapper[2566]: W0615 05:48:37.291702    2566 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jun 15 05:48:37.302156 ip-10-0-128-243 kubenswrapper[2566]: W0615 05:48:37.291705    2566 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jun 15 05:48:37.302156 ip-10-0-128-243 kubenswrapper[2566]: W0615 05:48:37.291707    2566 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jun 15 05:48:37.302638 ip-10-0-128-243 kubenswrapper[2566]: W0615 05:48:37.291711    2566 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jun 15 05:48:37.302638 ip-10-0-128-243 kubenswrapper[2566]: W0615 05:48:37.291713    2566 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jun 15 05:48:37.302638 ip-10-0-128-243 kubenswrapper[2566]: W0615 05:48:37.291716    2566 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jun 15 05:48:37.302638 ip-10-0-128-243 kubenswrapper[2566]: W0615 05:48:37.291718    2566 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jun 15 05:48:37.302638 ip-10-0-128-243 kubenswrapper[2566]: W0615 05:48:37.291721    2566 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jun 15 05:48:37.302638 ip-10-0-128-243 kubenswrapper[2566]: W0615 05:48:37.291723    2566 feature_gate.go:328] unrecognized feature gate: DualReplica
Jun 15 05:48:37.302638 ip-10-0-128-243 kubenswrapper[2566]: W0615 05:48:37.291727    2566 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jun 15 05:48:37.302638 ip-10-0-128-243 kubenswrapper[2566]: W0615 05:48:37.291730    2566 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jun 15 05:48:37.302638 ip-10-0-128-243 kubenswrapper[2566]: W0615 05:48:37.291732    2566 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jun 15 05:48:37.302638 ip-10-0-128-243 kubenswrapper[2566]: W0615 05:48:37.291735    2566 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jun 15 05:48:37.302638 ip-10-0-128-243 kubenswrapper[2566]: W0615 05:48:37.291739    2566 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jun 15 05:48:37.302638 ip-10-0-128-243 kubenswrapper[2566]: W0615 05:48:37.291742    2566 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jun 15 05:48:37.302638 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:48:37.292204    2566 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jun 15 05:48:37.302638 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:48:37.299778    2566 server.go:529] "Kubelet version" kubeletVersion="v1.34.8"
Jun 15 05:48:37.302638 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:48:37.299793    2566 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Jun 15 05:48:37.303018 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:48:37.299808    2566 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Jun 15 05:48:37.303018 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:48:37.299814    2566 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Jun 15 05:48:37.303018 ip-10-0-128-243 kubenswrapper[2566]: W0615 05:48:37.299870    2566 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jun 15 05:48:37.303018 ip-10-0-128-243 kubenswrapper[2566]: W0615 05:48:37.299877    2566 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jun 15 05:48:37.303018 ip-10-0-128-243 kubenswrapper[2566]: W0615 05:48:37.299881    2566 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jun 15 05:48:37.303018 ip-10-0-128-243 kubenswrapper[2566]: W0615 05:48:37.299884    2566 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jun 15 05:48:37.303018 ip-10-0-128-243 kubenswrapper[2566]: W0615 05:48:37.299887    2566 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jun 15 05:48:37.303018 ip-10-0-128-243 kubenswrapper[2566]: W0615 05:48:37.299890    2566 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jun 15 05:48:37.303018 ip-10-0-128-243 kubenswrapper[2566]: W0615 05:48:37.299893    2566 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jun 15 05:48:37.303018 ip-10-0-128-243 kubenswrapper[2566]: W0615 05:48:37.299896    2566 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jun 15 05:48:37.303018 ip-10-0-128-243 kubenswrapper[2566]: W0615 05:48:37.299899    2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jun 15 05:48:37.303018 ip-10-0-128-243 kubenswrapper[2566]: W0615 05:48:37.299902    2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jun 15 05:48:37.303018 ip-10-0-128-243 kubenswrapper[2566]: W0615 05:48:37.299904    2566 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jun 15 05:48:37.303018 ip-10-0-128-243 kubenswrapper[2566]: W0615 05:48:37.299907    2566 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jun 15 05:48:37.303018 ip-10-0-128-243 kubenswrapper[2566]: W0615 05:48:37.299909    2566 feature_gate.go:328] unrecognized feature gate: DualReplica
Jun 15 05:48:37.303018 ip-10-0-128-243 kubenswrapper[2566]: W0615 05:48:37.299912    2566 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jun 15 05:48:37.303018 ip-10-0-128-243 kubenswrapper[2566]: W0615 05:48:37.299915    2566 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jun 15 05:48:37.303018 ip-10-0-128-243 kubenswrapper[2566]: W0615 05:48:37.299917    2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jun 15 05:48:37.303018 ip-10-0-128-243 kubenswrapper[2566]: W0615 05:48:37.299920    2566 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jun 15 05:48:37.303531 ip-10-0-128-243 kubenswrapper[2566]: W0615 05:48:37.299922    2566 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jun 15 05:48:37.303531 ip-10-0-128-243 kubenswrapper[2566]: W0615 05:48:37.299925    2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jun 15 05:48:37.303531 ip-10-0-128-243 kubenswrapper[2566]: W0615 05:48:37.299927    2566 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jun 15 05:48:37.303531 ip-10-0-128-243 kubenswrapper[2566]: W0615 05:48:37.299930    2566 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jun 15 05:48:37.303531 ip-10-0-128-243 kubenswrapper[2566]: W0615 05:48:37.299933    2566 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jun 15 05:48:37.303531 ip-10-0-128-243 kubenswrapper[2566]: W0615 05:48:37.299941    2566 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jun 15 05:48:37.303531 ip-10-0-128-243 kubenswrapper[2566]: W0615 05:48:37.299944    2566 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jun 15 05:48:37.303531 ip-10-0-128-243 kubenswrapper[2566]: W0615 05:48:37.299946    2566 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jun 15 05:48:37.303531 ip-10-0-128-243 kubenswrapper[2566]: W0615 05:48:37.299949    2566 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jun 15 05:48:37.303531 ip-10-0-128-243 kubenswrapper[2566]: W0615 05:48:37.299951    2566 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jun 15 05:48:37.303531 ip-10-0-128-243 kubenswrapper[2566]: W0615 05:48:37.299954    2566 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jun 15 05:48:37.303531 ip-10-0-128-243 kubenswrapper[2566]: W0615 05:48:37.299956    2566 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jun 15 05:48:37.303531 ip-10-0-128-243 kubenswrapper[2566]: W0615 05:48:37.299960    2566 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jun 15 05:48:37.303531 ip-10-0-128-243 kubenswrapper[2566]: W0615 05:48:37.299963    2566 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jun 15 05:48:37.303531 ip-10-0-128-243 kubenswrapper[2566]: W0615 05:48:37.299966    2566 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jun 15 05:48:37.303531 ip-10-0-128-243 kubenswrapper[2566]: W0615 05:48:37.299968    2566 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jun 15 05:48:37.303531 ip-10-0-128-243 kubenswrapper[2566]: W0615 05:48:37.299971    2566 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jun 15 05:48:37.303531 ip-10-0-128-243 kubenswrapper[2566]: W0615 05:48:37.299974    2566 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jun 15 05:48:37.303531 ip-10-0-128-243 kubenswrapper[2566]: W0615 05:48:37.299976    2566 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jun 15 05:48:37.303531 ip-10-0-128-243 kubenswrapper[2566]: W0615 05:48:37.299979    2566 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jun 15 05:48:37.304036 ip-10-0-128-243 kubenswrapper[2566]: W0615 05:48:37.299982    2566 feature_gate.go:328] unrecognized feature gate: Example
Jun 15 05:48:37.304036 ip-10-0-128-243 kubenswrapper[2566]: W0615 05:48:37.299984    2566 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jun 15 05:48:37.304036 ip-10-0-128-243 kubenswrapper[2566]: W0615 05:48:37.299987    2566 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jun 15 05:48:37.304036 ip-10-0-128-243 kubenswrapper[2566]: W0615 05:48:37.299989    2566 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jun 15 05:48:37.304036 ip-10-0-128-243 kubenswrapper[2566]: W0615 05:48:37.299992    2566 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jun 15 05:48:37.304036 ip-10-0-128-243 kubenswrapper[2566]: W0615 05:48:37.299994    2566 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jun 15 05:48:37.304036 ip-10-0-128-243 kubenswrapper[2566]: W0615 05:48:37.299997    2566 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jun 15 05:48:37.304036 ip-10-0-128-243 kubenswrapper[2566]: W0615 05:48:37.299999    2566 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jun 15 05:48:37.304036 ip-10-0-128-243 kubenswrapper[2566]: W0615 05:48:37.300002    2566 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jun 15 05:48:37.304036 ip-10-0-128-243 kubenswrapper[2566]: W0615 05:48:37.300006    2566 feature_gate.go:328] unrecognized feature gate: OSStreams
Jun 15 05:48:37.304036 ip-10-0-128-243 kubenswrapper[2566]: W0615 05:48:37.300008    2566 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jun 15 05:48:37.304036 ip-10-0-128-243 kubenswrapper[2566]: W0615 05:48:37.300011    2566 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jun 15 05:48:37.304036 ip-10-0-128-243 kubenswrapper[2566]: W0615 05:48:37.300013    2566 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jun 15 05:48:37.304036 ip-10-0-128-243 kubenswrapper[2566]: W0615 05:48:37.300016    2566 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jun 15 05:48:37.304036 ip-10-0-128-243 kubenswrapper[2566]: W0615 05:48:37.300019    2566 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jun 15 05:48:37.304036 ip-10-0-128-243 kubenswrapper[2566]: W0615 05:48:37.300021    2566 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jun 15 05:48:37.304036 ip-10-0-128-243 kubenswrapper[2566]: W0615 05:48:37.300024    2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jun 15 05:48:37.304036 ip-10-0-128-243 kubenswrapper[2566]: W0615 05:48:37.300026    2566 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jun 15 05:48:37.304036 ip-10-0-128-243 kubenswrapper[2566]: W0615 05:48:37.300029    2566 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jun 15 05:48:37.304036 ip-10-0-128-243 kubenswrapper[2566]: W0615 05:48:37.300032    2566 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jun 15 05:48:37.304538 ip-10-0-128-243 kubenswrapper[2566]: W0615 05:48:37.300034    2566 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jun 15 05:48:37.304538 ip-10-0-128-243 kubenswrapper[2566]: W0615 05:48:37.300036    2566 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jun 15 05:48:37.304538 ip-10-0-128-243 kubenswrapper[2566]: W0615 05:48:37.300039    2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jun 15 05:48:37.304538 ip-10-0-128-243 kubenswrapper[2566]: W0615 05:48:37.300041    2566 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jun 15 05:48:37.304538 ip-10-0-128-243 kubenswrapper[2566]: W0615 05:48:37.300045    2566 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jun 15 05:48:37.304538 ip-10-0-128-243 kubenswrapper[2566]: W0615 05:48:37.300048    2566 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jun 15 05:48:37.304538 ip-10-0-128-243 kubenswrapper[2566]: W0615 05:48:37.300050    2566 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jun 15 05:48:37.304538 ip-10-0-128-243 kubenswrapper[2566]: W0615 05:48:37.300053    2566 feature_gate.go:328] unrecognized feature gate: EventTTL
Jun 15 05:48:37.304538 ip-10-0-128-243 kubenswrapper[2566]: W0615 05:48:37.300055    2566 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jun 15 05:48:37.304538 ip-10-0-128-243 kubenswrapper[2566]: W0615 05:48:37.300058    2566 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jun 15 05:48:37.304538 ip-10-0-128-243 kubenswrapper[2566]: W0615 05:48:37.300061    2566 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jun 15 05:48:37.304538 ip-10-0-128-243 kubenswrapper[2566]: W0615 05:48:37.300063    2566 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jun 15 05:48:37.304538 ip-10-0-128-243 kubenswrapper[2566]: W0615 05:48:37.300065    2566 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jun 15 05:48:37.304538 ip-10-0-128-243 kubenswrapper[2566]: W0615 05:48:37.300068    2566 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jun 15 05:48:37.304538 ip-10-0-128-243 kubenswrapper[2566]: W0615 05:48:37.300071    2566 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jun 15 05:48:37.304538 ip-10-0-128-243 kubenswrapper[2566]: W0615 05:48:37.300073    2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jun 15 05:48:37.304538 ip-10-0-128-243 kubenswrapper[2566]: W0615 05:48:37.300076    2566 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jun 15 05:48:37.304538 ip-10-0-128-243 kubenswrapper[2566]: W0615 05:48:37.300095    2566 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jun 15 05:48:37.304538 ip-10-0-128-243 kubenswrapper[2566]: W0615 05:48:37.300099    2566 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jun 15 05:48:37.304538 ip-10-0-128-243 kubenswrapper[2566]: W0615 05:48:37.300102    2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jun 15 05:48:37.305031 ip-10-0-128-243 kubenswrapper[2566]: W0615 05:48:37.300105    2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jun 15 05:48:37.305031 ip-10-0-128-243 kubenswrapper[2566]: W0615 05:48:37.300107    2566 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jun 15 05:48:37.305031 ip-10-0-128-243 kubenswrapper[2566]: W0615 05:48:37.300111    2566 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jun 15 05:48:37.305031 ip-10-0-128-243 kubenswrapper[2566]: W0615 05:48:37.300113    2566 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jun 15 05:48:37.305031 ip-10-0-128-243 kubenswrapper[2566]: W0615 05:48:37.300116    2566 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jun 15 05:48:37.305031 ip-10-0-128-243 kubenswrapper[2566]: W0615 05:48:37.300118    2566 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jun 15 05:48:37.305031 ip-10-0-128-243 kubenswrapper[2566]: W0615 05:48:37.300121    2566 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jun 15 05:48:37.305031 ip-10-0-128-243 kubenswrapper[2566]: W0615 05:48:37.300123    2566 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jun 15 05:48:37.305031 ip-10-0-128-243 kubenswrapper[2566]: W0615 05:48:37.300125    2566 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jun 15 05:48:37.305031 ip-10-0-128-243 kubenswrapper[2566]: W0615 05:48:37.300129    2566 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jun 15 05:48:37.305031 ip-10-0-128-243 kubenswrapper[2566]: W0615 05:48:37.300133    2566 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jun 15 05:48:37.305031 ip-10-0-128-243 kubenswrapper[2566]: W0615 05:48:37.300136    2566 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jun 15 05:48:37.305031 ip-10-0-128-243 kubenswrapper[2566]: W0615 05:48:37.300139    2566 feature_gate.go:328] unrecognized feature gate: Example2
Jun 15 05:48:37.305031 ip-10-0-128-243 kubenswrapper[2566]: W0615 05:48:37.300142    2566 feature_gate.go:328] unrecognized feature gate: NewOLM
Jun 15 05:48:37.305031 ip-10-0-128-243 kubenswrapper[2566]: W0615 05:48:37.300144    2566 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jun 15 05:48:37.305031 ip-10-0-128-243 kubenswrapper[2566]: W0615 05:48:37.300147    2566 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jun 15 05:48:37.305031 ip-10-0-128-243 kubenswrapper[2566]: W0615 05:48:37.300150    2566 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jun 15 05:48:37.305031 ip-10-0-128-243 kubenswrapper[2566]: W0615 05:48:37.300153    2566 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jun 15 05:48:37.305031 ip-10-0-128-243 kubenswrapper[2566]: W0615 05:48:37.300156    2566 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jun 15 05:48:37.305031 ip-10-0-128-243 kubenswrapper[2566]: W0615 05:48:37.300159    2566 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jun 15 05:48:37.305526 ip-10-0-128-243 kubenswrapper[2566]: W0615 05:48:37.300161    2566 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jun 15 05:48:37.305526 ip-10-0-128-243 kubenswrapper[2566]: W0615 05:48:37.300165    2566 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jun 15 05:48:37.305526 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:48:37.300171    2566 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jun 15 05:48:37.305526 ip-10-0-128-243 kubenswrapper[2566]: W0615 05:48:37.300302    2566 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jun 15 05:48:37.305526 ip-10-0-128-243 kubenswrapper[2566]: W0615 05:48:37.300308    2566 feature_gate.go:328] unrecognized feature gate: Example2
Jun 15 05:48:37.305526 ip-10-0-128-243 kubenswrapper[2566]: W0615 05:48:37.300311    2566 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jun 15 05:48:37.305526 ip-10-0-128-243 kubenswrapper[2566]: W0615 05:48:37.300314    2566 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jun 15 05:48:37.305526 ip-10-0-128-243 kubenswrapper[2566]: W0615 05:48:37.300317    2566 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jun 15 05:48:37.305526 ip-10-0-128-243 kubenswrapper[2566]: W0615 05:48:37.300320    2566 feature_gate.go:328] unrecognized feature gate: Example
Jun 15 05:48:37.305526 ip-10-0-128-243 kubenswrapper[2566]: W0615 05:48:37.300323    2566 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jun 15 05:48:37.305526 ip-10-0-128-243 kubenswrapper[2566]: W0615 05:48:37.300326    2566 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jun 15 05:48:37.305526 ip-10-0-128-243 kubenswrapper[2566]: W0615 05:48:37.300329    2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jun 15 05:48:37.305526 ip-10-0-128-243 kubenswrapper[2566]: W0615 05:48:37.300332    2566 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jun 15 05:48:37.305526 ip-10-0-128-243 kubenswrapper[2566]: W0615 05:48:37.300335    2566 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jun 15 05:48:37.305526 ip-10-0-128-243 kubenswrapper[2566]: W0615 05:48:37.300338    2566 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jun 15 05:48:37.305889 ip-10-0-128-243 kubenswrapper[2566]: W0615 05:48:37.300340    2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jun 15 05:48:37.305889 ip-10-0-128-243 kubenswrapper[2566]: W0615 05:48:37.300343    2566 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jun 15 05:48:37.305889 ip-10-0-128-243 kubenswrapper[2566]: W0615 05:48:37.300346    2566 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jun 15 05:48:37.305889 ip-10-0-128-243 kubenswrapper[2566]: W0615 05:48:37.300348    2566 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jun 15 05:48:37.305889 ip-10-0-128-243 kubenswrapper[2566]: W0615 05:48:37.300351    2566 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jun 15 05:48:37.305889 ip-10-0-128-243 kubenswrapper[2566]: W0615 05:48:37.300353    2566 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jun 15 05:48:37.305889 ip-10-0-128-243 kubenswrapper[2566]: W0615 05:48:37.300356    2566 feature_gate.go:328] unrecognized feature gate: EventTTL
Jun 15 05:48:37.305889 ip-10-0-128-243 kubenswrapper[2566]: W0615 05:48:37.300358    2566 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jun 15 05:48:37.305889 ip-10-0-128-243 kubenswrapper[2566]: W0615 05:48:37.300361    2566 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jun 15 05:48:37.305889 ip-10-0-128-243 kubenswrapper[2566]: W0615 05:48:37.300363    2566 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jun 15 05:48:37.305889 ip-10-0-128-243 kubenswrapper[2566]: W0615 05:48:37.300366    2566 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jun 15 05:48:37.305889 ip-10-0-128-243 kubenswrapper[2566]: W0615 05:48:37.300368    2566 feature_gate.go:328] unrecognized feature gate: OSStreams
Jun 15 05:48:37.305889 ip-10-0-128-243 kubenswrapper[2566]: W0615 05:48:37.300371    2566 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jun 15 05:48:37.305889 ip-10-0-128-243 kubenswrapper[2566]: W0615 05:48:37.300374    2566 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jun 15 05:48:37.305889 ip-10-0-128-243 kubenswrapper[2566]: W0615 05:48:37.300377    2566 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jun 15 05:48:37.305889 ip-10-0-128-243 kubenswrapper[2566]: W0615 05:48:37.300380    2566 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jun 15 05:48:37.305889 ip-10-0-128-243 kubenswrapper[2566]: W0615 05:48:37.300382    2566 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jun 15 05:48:37.305889 ip-10-0-128-243 kubenswrapper[2566]: W0615 05:48:37.300385    2566 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jun 15 05:48:37.305889 ip-10-0-128-243 kubenswrapper[2566]: W0615 05:48:37.300387    2566 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jun 15 05:48:37.305889 ip-10-0-128-243 kubenswrapper[2566]: W0615 05:48:37.300390    2566 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jun 15 05:48:37.306379 ip-10-0-128-243 kubenswrapper[2566]: W0615 05:48:37.300392    2566 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jun 15 05:48:37.306379 ip-10-0-128-243 kubenswrapper[2566]: W0615 05:48:37.300394    2566 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jun 15 05:48:37.306379 ip-10-0-128-243 kubenswrapper[2566]: W0615 05:48:37.300397    2566 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jun 15 05:48:37.306379 ip-10-0-128-243 kubenswrapper[2566]: W0615 05:48:37.300400    2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jun 15 05:48:37.306379 ip-10-0-128-243 kubenswrapper[2566]: W0615 05:48:37.300402    2566 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jun 15 05:48:37.306379 ip-10-0-128-243 kubenswrapper[2566]: W0615 05:48:37.300404    2566 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jun 15 05:48:37.306379 ip-10-0-128-243 kubenswrapper[2566]: W0615 05:48:37.300408    2566 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jun 15 05:48:37.306379 ip-10-0-128-243 kubenswrapper[2566]: W0615 05:48:37.300412    2566 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jun 15 05:48:37.306379 ip-10-0-128-243 kubenswrapper[2566]: W0615 05:48:37.300415    2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jun 15 05:48:37.306379 ip-10-0-128-243 kubenswrapper[2566]: W0615 05:48:37.300417    2566 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jun 15 05:48:37.306379 ip-10-0-128-243 kubenswrapper[2566]: W0615 05:48:37.300420    2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jun 15 05:48:37.306379 ip-10-0-128-243 kubenswrapper[2566]: W0615 05:48:37.300424    2566 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jun 15 05:48:37.306379 ip-10-0-128-243 kubenswrapper[2566]: W0615 05:48:37.300427    2566 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jun 15 05:48:37.306379 ip-10-0-128-243 kubenswrapper[2566]: W0615 05:48:37.300431    2566 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jun 15 05:48:37.306379 ip-10-0-128-243 kubenswrapper[2566]: W0615 05:48:37.300434    2566 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jun 15 05:48:37.306379 ip-10-0-128-243 kubenswrapper[2566]: W0615 05:48:37.300436    2566 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jun 15 05:48:37.306379 ip-10-0-128-243 kubenswrapper[2566]: W0615 05:48:37.300439    2566 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jun 15 05:48:37.306379 ip-10-0-128-243 kubenswrapper[2566]: W0615 05:48:37.300441    2566 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jun 15 05:48:37.306379 ip-10-0-128-243 kubenswrapper[2566]: W0615 05:48:37.300443    2566 feature_gate.go:328] unrecognized feature gate: NewOLM
Jun 15 05:48:37.306847 ip-10-0-128-243 kubenswrapper[2566]: W0615 05:48:37.300446    2566 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jun 15 05:48:37.306847 ip-10-0-128-243 kubenswrapper[2566]: W0615 05:48:37.300448    2566 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jun 15 05:48:37.306847 ip-10-0-128-243 kubenswrapper[2566]: W0615 05:48:37.300451    2566 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jun 15 05:48:37.306847 ip-10-0-128-243 kubenswrapper[2566]: W0615 05:48:37.300453    2566 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jun 15 05:48:37.306847 ip-10-0-128-243 kubenswrapper[2566]: W0615 05:48:37.300456    2566 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jun 15 05:48:37.306847 ip-10-0-128-243 kubenswrapper[2566]: W0615 05:48:37.300458    2566 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jun 15 05:48:37.306847 ip-10-0-128-243 kubenswrapper[2566]: W0615 05:48:37.300461    2566 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jun 15 05:48:37.306847 ip-10-0-128-243 kubenswrapper[2566]: W0615 05:48:37.300463    2566 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jun 15 05:48:37.306847 ip-10-0-128-243 kubenswrapper[2566]: W0615 05:48:37.300466    2566 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jun 15 05:48:37.306847 ip-10-0-128-243 kubenswrapper[2566]: W0615 05:48:37.300468    2566 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jun 15 05:48:37.306847 ip-10-0-128-243 kubenswrapper[2566]: W0615 05:48:37.300470    2566 feature_gate.go:328] unrecognized feature gate: DualReplica
Jun 15 05:48:37.306847 ip-10-0-128-243 kubenswrapper[2566]: W0615 05:48:37.300473    2566 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jun 15 05:48:37.306847 ip-10-0-128-243 kubenswrapper[2566]: W0615 05:48:37.300475    2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jun 15 05:48:37.306847 ip-10-0-128-243 kubenswrapper[2566]: W0615 05:48:37.300478    2566 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jun 15 05:48:37.306847 ip-10-0-128-243 kubenswrapper[2566]: W0615 05:48:37.300480    2566 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jun 15 05:48:37.306847 ip-10-0-128-243 kubenswrapper[2566]: W0615 05:48:37.300482    2566 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jun 15 05:48:37.306847 ip-10-0-128-243 kubenswrapper[2566]: W0615 05:48:37.300485    2566 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jun 15 05:48:37.306847 ip-10-0-128-243 kubenswrapper[2566]: W0615 05:48:37.300487    2566 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jun 15 05:48:37.306847 ip-10-0-128-243 kubenswrapper[2566]: W0615 05:48:37.300490    2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jun 15 05:48:37.306847 ip-10-0-128-243 kubenswrapper[2566]: W0615 05:48:37.300492    2566 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jun 15 05:48:37.307495 ip-10-0-128-243 kubenswrapper[2566]: W0615 05:48:37.300495    2566 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jun 15 05:48:37.307495 ip-10-0-128-243 kubenswrapper[2566]: W0615 05:48:37.300498    2566 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jun 15 05:48:37.307495 ip-10-0-128-243 kubenswrapper[2566]: W0615 05:48:37.300500    2566 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jun 15 05:48:37.307495 ip-10-0-128-243 kubenswrapper[2566]: W0615 05:48:37.300502    2566 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jun 15 05:48:37.307495 ip-10-0-128-243 kubenswrapper[2566]: W0615 05:48:37.300505    2566 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jun 15 05:48:37.307495 ip-10-0-128-243 kubenswrapper[2566]: W0615 05:48:37.300507    2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jun 15 05:48:37.307495 ip-10-0-128-243 kubenswrapper[2566]: W0615 05:48:37.300510    2566 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jun 15 05:48:37.307495 ip-10-0-128-243 kubenswrapper[2566]: W0615 05:48:37.300513    2566 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jun 15 05:48:37.307495 ip-10-0-128-243 kubenswrapper[2566]: W0615 05:48:37.300515    2566 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jun 15 05:48:37.307495 ip-10-0-128-243 kubenswrapper[2566]: W0615 05:48:37.300517    2566 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jun 15 05:48:37.307495 ip-10-0-128-243 kubenswrapper[2566]: W0615 05:48:37.300520    2566 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jun 15 05:48:37.307495 ip-10-0-128-243 kubenswrapper[2566]: W0615 05:48:37.300522    2566 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jun 15 05:48:37.307495 ip-10-0-128-243 kubenswrapper[2566]: W0615 05:48:37.300525    2566 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jun 15 05:48:37.307495 ip-10-0-128-243 kubenswrapper[2566]: W0615 05:48:37.300527    2566 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jun 15 05:48:37.307495 ip-10-0-128-243 kubenswrapper[2566]: W0615 05:48:37.300530    2566 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jun 15 05:48:37.307495 ip-10-0-128-243 kubenswrapper[2566]: W0615 05:48:37.300532    2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jun 15 05:48:37.307495 ip-10-0-128-243 kubenswrapper[2566]: W0615 05:48:37.300535    2566 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jun 15 05:48:37.307495 ip-10-0-128-243 kubenswrapper[2566]: W0615 05:48:37.300537    2566 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jun 15 05:48:37.307495 ip-10-0-128-243 kubenswrapper[2566]: W0615 05:48:37.300540    2566 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jun 15 05:48:37.307946 ip-10-0-128-243 kubenswrapper[2566]: W0615 05:48:37.300542    2566 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jun 15 05:48:37.307946 ip-10-0-128-243 kubenswrapper[2566]: W0615 05:48:37.300545    2566 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jun 15 05:48:37.307946 ip-10-0-128-243 kubenswrapper[2566]: W0615 05:48:37.300547    2566 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jun 15 05:48:37.307946 ip-10-0-128-243 kubenswrapper[2566]: W0615 05:48:37.300551    2566 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jun 15 05:48:37.307946 ip-10-0-128-243 kubenswrapper[2566]: W0615 05:48:37.300554    2566 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jun 15 05:48:37.307946 ip-10-0-128-243 kubenswrapper[2566]: W0615 05:48:37.300556    2566 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jun 15 05:48:37.307946 ip-10-0-128-243 kubenswrapper[2566]: W0615 05:48:37.300559    2566 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jun 15 05:48:37.307946 ip-10-0-128-243 kubenswrapper[2566]: W0615 05:48:37.300562    2566 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jun 15 05:48:37.307946 ip-10-0-128-243 kubenswrapper[2566]: W0615 05:48:37.300564    2566 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jun 15 05:48:37.307946 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:48:37.300569    2566 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jun 15 05:48:37.307946 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:48:37.300685    2566 server.go:962] "Client rotation is on, will bootstrap in background"
Jun 15 05:48:37.307946 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:48:37.303530    2566 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Jun 15 05:48:37.307946 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:48:37.304674    2566 server.go:1019] "Starting client certificate rotation"
Jun 15 05:48:37.307946 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:48:37.304771    2566 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jun 15 05:48:37.308337 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:48:37.304803    2566 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jun 15 05:48:37.308337 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:48:37.306753    2566 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jun 15 05:48:37.308337 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:48:37.307906    2566 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jun 15 05:48:37.314167 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:48:37.314153    2566 log.go:25] "Validated CRI v1 runtime API"
Jun 15 05:48:37.317038 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:48:37.317025    2566 log.go:25] "Validated CRI v1 image API"
Jun 15 05:48:37.317824 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:48:37.317806    2566 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Jun 15 05:48:37.321150 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:48:37.321118    2566 fs.go:135] Filesystem UUIDs: map[45ce250a-2797-4840-9e75-b3395635bb23:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2 c72d92c8-e08c-42aa-97e8-2547a73a6ff3:/dev/nvme0n1p4]
Jun 15 05:48:37.321150 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:48:37.321150    2566 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Jun 15 05:48:37.327855 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:48:37.327729    2566 manager.go:216] Machine: {Timestamp:2026-06-15 05:48:37.326317815 +0000 UTC m=+0.286075071 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3111641 MemoryCapacity:32812175360 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec231a3c649970638a7a5452fcd310de SystemUUID:ec231a3c-6499-7063-8a7a-5452fcd310de BootID:49b71897-7544-4bd2-b3b9-305ebc2c8682 Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16406085632 Type:vfs Inodes:4005392 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6562435072 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16406089728 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:61:1d:89:27:a5 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:61:1d:89:27:a5 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:46:bc:7a:1d:44:52 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:32812175360 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:34603008 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Jun 15 05:48:37.327855 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:48:37.327846    2566 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Jun 15 05:48:37.327976 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:48:37.327925    2566 manager.go:232] Version: {KernelVersion:5.14.0-570.120.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260608-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Jun 15 05:48:37.330333 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:48:37.330304    2566 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Jun 15 05:48:37.330497 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:48:37.330336    2566 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-128-243.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Jun 15 05:48:37.331035 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:48:37.331022    2566 topology_manager.go:138] "Creating topology manager with none policy"
Jun 15 05:48:37.331109 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:48:37.331041    2566 container_manager_linux.go:309] "Creating device plugin manager"
Jun 15 05:48:37.331109 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:48:37.331052    2566 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Jun 15 05:48:37.331743 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:48:37.331730    2566 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Jun 15 05:48:37.332688 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:48:37.332677    2566 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Jun 15 05:48:37.336165 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:48:37.336151    2566 state_mem.go:36] "Initialized new in-memory state store"
Jun 15 05:48:37.336301 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:48:37.336289    2566 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Jun 15 05:48:37.336930 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:48:37.336920    2566 kubelet.go:486] "Attempting to sync node with API server"
Jun 15 05:48:37.336985 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:48:37.336937    2566 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Jun 15 05:48:37.336985 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:48:37.336953    2566 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Jun 15 05:48:37.336985 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:48:37.336966    2566 kubelet.go:398] "Adding apiserver pod source"
Jun 15 05:48:37.336985 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:48:37.336980    2566 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Jun 15 05:48:37.339153 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:48:37.339122    2566 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jun 15 05:48:37.339234 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:48:37.339192    2566 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jun 15 05:48:37.344495 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:48:37.344475    2566 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.8-3.rhaos4.21.git91b4b0b.el9" apiVersion="v1"
Jun 15 05:48:37.346225 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:48:37.346209    2566 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Jun 15 05:48:37.346277 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:48:37.346253    2566 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Jun 15 05:48:37.347096 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:48:37.347061    2566 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jun 15 05:48:37.347248 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:48:37.347233    2566 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Jun 15 05:48:37.347295 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:48:37.347259    2566 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Jun 15 05:48:37.347295 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:48:37.347268    2566 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Jun 15 05:48:37.347295 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:48:37.347277    2566 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Jun 15 05:48:37.347295 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:48:37.347289    2566 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Jun 15 05:48:37.347412 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:48:37.347297    2566 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Jun 15 05:48:37.347412 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:48:37.347382    2566 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Jun 15 05:48:37.347412 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:48:37.347391    2566 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Jun 15 05:48:37.347528 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:48:37.347441    2566 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Jun 15 05:48:37.347528 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:48:37.347450    2566 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Jun 15 05:48:37.347528 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:48:37.347464    2566 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Jun 15 05:48:37.347528 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:48:37.347477    2566 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Jun 15 05:48:37.348227 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:48:37.348215    2566 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Jun 15 05:48:37.348265 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:48:37.348228    2566 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Jun 15 05:48:37.351465 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:48:37.351452    2566 server.go:1268] "Started kubelet"
Jun 15 05:48:37.351597 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:48:37.351545    2566 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Jun 15 05:48:37.351597 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:48:37.351550    2566 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Jun 15 05:48:37.351702 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:48:37.351628    2566 server_v1.go:49] "podresources" method="list" useActivePods=true
Jun 15 05:48:37.352424 ip-10-0-128-243 systemd[1]: Started Kubernetes Kubelet.
Jun 15 05:48:37.352987 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:48:37.352927    2566 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Jun 15 05:48:37.354278 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:48:37.354264    2566 server.go:310] "Adding debug handlers to kubelet server"
Jun 15 05:48:37.357336 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:48:37.357305    2566 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Jun 15 05:48:37.357336 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:48:37.357321    2566 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Jun 15 05:48:37.357508 ip-10-0-128-243 kubenswrapper[2566]: E0615 05:48:37.357489    2566 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-243.ec2.internal\" not found"
Jun 15 05:48:37.357619 ip-10-0-128-243 kubenswrapper[2566]: E0615 05:48:37.357594    2566 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-128-243.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Jun 15 05:48:37.357701 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:48:37.357683    2566 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-128-243.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jun 15 05:48:37.357805 ip-10-0-128-243 kubenswrapper[2566]: E0615 05:48:37.357767    2566 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Jun 15 05:48:37.357886 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:48:37.357855    2566 volume_manager.go:311] "The desired_state_of_world populator starts"
Jun 15 05:48:37.357886 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:48:37.357870    2566 volume_manager.go:313] "Starting Kubelet Volume Manager"
Jun 15 05:48:37.357977 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:48:37.357891    2566 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Jun 15 05:48:37.358025 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:48:37.357995    2566 reconstruct.go:97] "Volume reconstruction finished"
Jun 15 05:48:37.358025 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:48:37.358003    2566 reconciler.go:29] "Reconciler: start to sync state"
Jun 15 05:48:37.358997 ip-10-0-128-243 kubenswrapper[2566]: E0615 05:48:37.358057    2566 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-128-243.ec2.internal.18b92b19c9321f2b  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-128-243.ec2.internal,UID:ip-10-0-128-243.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-128-243.ec2.internal,},FirstTimestamp:2026-06-15 05:48:37.351423787 +0000 UTC m=+0.311181023,LastTimestamp:2026-06-15 05:48:37.351423787 +0000 UTC m=+0.311181023,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-128-243.ec2.internal,}"
Jun 15 05:48:37.359658 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:48:37.359634    2566 factory.go:55] Registering systemd factory
Jun 15 05:48:37.359658 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:48:37.359660    2566 factory.go:223] Registration of the systemd container factory successfully
Jun 15 05:48:37.360959 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:48:37.360930    2566 factory.go:153] Registering CRI-O factory
Jun 15 05:48:37.360959 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:48:37.360948    2566 factory.go:223] Registration of the crio container factory successfully
Jun 15 05:48:37.361134 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:48:37.360999    2566 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Jun 15 05:48:37.361134 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:48:37.361023    2566 factory.go:103] Registering Raw factory
Jun 15 05:48:37.361134 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:48:37.361055    2566 manager.go:1196] Started watching for new ooms in manager
Jun 15 05:48:37.361639 ip-10-0-128-243 kubenswrapper[2566]: E0615 05:48:37.361614    2566 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
Jun 15 05:48:37.361920 ip-10-0-128-243 kubenswrapper[2566]: E0615 05:48:37.361858    2566 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-128-243.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Jun 15 05:48:37.361998 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:48:37.361990    2566 manager.go:349] Starting recovery of all containers
Jun 15 05:48:37.362056 ip-10-0-128-243 kubenswrapper[2566]: E0615 05:48:37.362040    2566 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Jun 15 05:48:37.369253 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:48:37.369220    2566 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Jun 15 05:48:37.374588 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:48:37.374378    2566 manager.go:354] Recovery completed
Jun 15 05:48:37.378687 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:48:37.378673    2566 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jun 15 05:48:37.380345 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:48:37.380330    2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-243.ec2.internal" event="NodeHasSufficientMemory"
Jun 15 05:48:37.380414 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:48:37.380359    2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-243.ec2.internal" event="NodeHasNoDiskPressure"
Jun 15 05:48:37.380414 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:48:37.380368    2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-243.ec2.internal" event="NodeHasSufficientPID"
Jun 15 05:48:37.380781 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:48:37.380764    2566 cpu_manager.go:222] "Starting CPU manager" policy="none"
Jun 15 05:48:37.380781 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:48:37.380779    2566 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jun 15 05:48:37.380886 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:48:37.380780    2566 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Jun 15 05:48:37.380886 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:48:37.380811    2566 state_mem.go:36] "Initialized new in-memory state store"
Jun 15 05:48:37.381450 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:48:37.381437    2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-243.ec2.internal" event="NodeHasSufficientMemory"
Jun 15 05:48:37.381512 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:48:37.381462    2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-243.ec2.internal" event="NodeHasNoDiskPressure"
Jun 15 05:48:37.381512 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:48:37.381472    2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-243.ec2.internal" event="NodeHasSufficientPID"
Jun 15 05:48:37.382876 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:48:37.382864    2566 policy_none.go:49] "None policy: Start"
Jun 15 05:48:37.382915 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:48:37.382880    2566 memory_manager.go:187] "Starting memorymanager" policy="None"
Jun 15 05:48:37.382915 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:48:37.382890    2566 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Jun 15 05:48:37.384802 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:48:37.384791    2566 policy_none.go:47] "Start"
Jun 15 05:48:37.385599 ip-10-0-128-243 kubenswrapper[2566]: E0615 05:48:37.385523    2566 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-128-243.ec2.internal.18b92b19caeb7377  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-128-243.ec2.internal,UID:ip-10-0-128-243.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-128-243.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-128-243.ec2.internal,},FirstTimestamp:2026-06-15 05:48:37.380346743 +0000 UTC m=+0.340103978,LastTimestamp:2026-06-15 05:48:37.380346743 +0000 UTC m=+0.340103978,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-128-243.ec2.internal,}"
Jun 15 05:48:37.394270 ip-10-0-128-243 kubenswrapper[2566]: E0615 05:48:37.394202    2566 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-128-243.ec2.internal.18b92b19caebb3f8  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-128-243.ec2.internal,UID:ip-10-0-128-243.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-128-243.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-128-243.ec2.internal,},FirstTimestamp:2026-06-15 05:48:37.380363256 +0000 UTC m=+0.340120492,LastTimestamp:2026-06-15 05:48:37.380363256 +0000 UTC m=+0.340120492,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-128-243.ec2.internal,}"
Jun 15 05:48:37.400426 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:48:37.400411    2566 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-888j6"
Jun 15 05:48:37.407418 ip-10-0-128-243 kubenswrapper[2566]: E0615 05:48:37.407343    2566 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-128-243.ec2.internal.18b92b19caebd720  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-128-243.ec2.internal,UID:ip-10-0-128-243.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientPID,Message:Node ip-10-0-128-243.ec2.internal status is now: NodeHasSufficientPID,Source:EventSource{Component:kubelet,Host:ip-10-0-128-243.ec2.internal,},FirstTimestamp:2026-06-15 05:48:37.380372256 +0000 UTC m=+0.340129492,LastTimestamp:2026-06-15 05:48:37.380372256 +0000 UTC m=+0.340129492,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-128-243.ec2.internal,}"
Jun 15 05:48:37.410714 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:48:37.410687    2566 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-888j6"
Jun 15 05:48:37.425687 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:48:37.425671    2566 manager.go:337] "Starting Device Plugin manager"
Jun 15 05:48:37.449197 ip-10-0-128-243 kubenswrapper[2566]: E0615 05:48:37.425704    2566 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Jun 15 05:48:37.449197 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:48:37.425713    2566 server.go:87] "Starting device plugin registration server"
Jun 15 05:48:37.449197 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:48:37.425986    2566 eviction_manager.go:189] "Eviction manager: starting control loop"
Jun 15 05:48:37.449197 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:48:37.426023    2566 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Jun 15 05:48:37.449197 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:48:37.426100    2566 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Jun 15 05:48:37.449197 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:48:37.426183    2566 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Jun 15 05:48:37.449197 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:48:37.426191    2566 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Jun 15 05:48:37.449197 ip-10-0-128-243 kubenswrapper[2566]: E0615 05:48:37.426695    2566 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Jun 15 05:48:37.449197 ip-10-0-128-243 kubenswrapper[2566]: E0615 05:48:37.426748    2566 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-128-243.ec2.internal\" not found"
Jun 15 05:48:37.449197 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:48:37.435388    2566 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Jun 15 05:48:37.449197 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:48:37.435424    2566 status_manager.go:244] "Starting to sync pod status with apiserver"
Jun 15 05:48:37.449197 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:48:37.435443    2566 kubelet.go:2448] "Starting kubelet main sync loop"
Jun 15 05:48:37.449197 ip-10-0-128-243 kubenswrapper[2566]: E0615 05:48:37.435479    2566 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Jun 15 05:48:37.449197 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:48:37.438269    2566 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jun 15 05:48:37.526609 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:48:37.526576    2566 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jun 15 05:48:37.527620 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:48:37.527602    2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-243.ec2.internal" event="NodeHasSufficientMemory"
Jun 15 05:48:37.527719 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:48:37.527632    2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-243.ec2.internal" event="NodeHasNoDiskPressure"
Jun 15 05:48:37.527719 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:48:37.527643    2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-243.ec2.internal" event="NodeHasSufficientPID"
Jun 15 05:48:37.527719 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:48:37.527669    2566 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-128-243.ec2.internal"
Jun 15 05:48:37.535283 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:48:37.535240    2566 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-128-243.ec2.internal"
Jun 15 05:48:37.535283 ip-10-0-128-243 kubenswrapper[2566]: E0615 05:48:37.535263    2566 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-128-243.ec2.internal\": node \"ip-10-0-128-243.ec2.internal\" not found"
Jun 15 05:48:37.535694 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:48:37.535679    2566 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-243.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-128-243.ec2.internal"]
Jun 15 05:48:37.535757 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:48:37.535748    2566 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jun 15 05:48:37.537060 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:48:37.537043    2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-243.ec2.internal" event="NodeHasSufficientMemory"
Jun 15 05:48:37.537137 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:48:37.537094    2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-243.ec2.internal" event="NodeHasNoDiskPressure"
Jun 15 05:48:37.537137 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:48:37.537109    2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-243.ec2.internal" event="NodeHasSufficientPID"
Jun 15 05:48:37.539401 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:48:37.539388    2566 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jun 15 05:48:37.539592 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:48:37.539577    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-243.ec2.internal"
Jun 15 05:48:37.539639 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:48:37.539614    2566 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jun 15 05:48:37.540336 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:48:37.540318    2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-243.ec2.internal" event="NodeHasSufficientMemory"
Jun 15 05:48:37.540395 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:48:37.540347    2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-243.ec2.internal" event="NodeHasNoDiskPressure"
Jun 15 05:48:37.540395 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:48:37.540356    2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-243.ec2.internal" event="NodeHasSufficientPID"
Jun 15 05:48:37.540780 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:48:37.540762    2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-243.ec2.internal" event="NodeHasSufficientMemory"
Jun 15 05:48:37.540866 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:48:37.540789    2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-243.ec2.internal" event="NodeHasNoDiskPressure"
Jun 15 05:48:37.540866 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:48:37.540799    2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-243.ec2.internal" event="NodeHasSufficientPID"
Jun 15 05:48:37.542999 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:48:37.542974    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-243.ec2.internal"
Jun 15 05:48:37.543077 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:48:37.543008    2566 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jun 15 05:48:37.543696 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:48:37.543680    2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-243.ec2.internal" event="NodeHasSufficientMemory"
Jun 15 05:48:37.543768 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:48:37.543711    2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-243.ec2.internal" event="NodeHasNoDiskPressure"
Jun 15 05:48:37.543768 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:48:37.543724    2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-243.ec2.internal" event="NodeHasSufficientPID"
Jun 15 05:48:37.558397 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:48:37.558375    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/20fcfef3e673a6e0448477fc680fc5f1-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-128-243.ec2.internal\" (UID: \"20fcfef3e673a6e0448477fc680fc5f1\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-243.ec2.internal"
Jun 15 05:48:37.558488 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:48:37.558402    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/20fcfef3e673a6e0448477fc680fc5f1-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-128-243.ec2.internal\" (UID: \"20fcfef3e673a6e0448477fc680fc5f1\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-243.ec2.internal"
Jun 15 05:48:37.558488 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:48:37.558418    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/c8b2bbb1effaa631bc90559ca49e380a-config\") pod \"kube-apiserver-proxy-ip-10-0-128-243.ec2.internal\" (UID: \"c8b2bbb1effaa631bc90559ca49e380a\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-128-243.ec2.internal"
Jun 15 05:48:37.562690 ip-10-0-128-243 kubenswrapper[2566]: E0615 05:48:37.562673    2566 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-128-243.ec2.internal\" not found" node="ip-10-0-128-243.ec2.internal"
Jun 15 05:48:37.565972 ip-10-0-128-243 kubenswrapper[2566]: E0615 05:48:37.565955    2566 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-243.ec2.internal\" not found"
Jun 15 05:48:37.566791 ip-10-0-128-243 kubenswrapper[2566]: E0615 05:48:37.566779    2566 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-128-243.ec2.internal\" not found" node="ip-10-0-128-243.ec2.internal"
Jun 15 05:48:37.658597 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:48:37.658569    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/20fcfef3e673a6e0448477fc680fc5f1-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-128-243.ec2.internal\" (UID: \"20fcfef3e673a6e0448477fc680fc5f1\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-243.ec2.internal"
Jun 15 05:48:37.658597 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:48:37.658598    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/20fcfef3e673a6e0448477fc680fc5f1-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-128-243.ec2.internal\" (UID: \"20fcfef3e673a6e0448477fc680fc5f1\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-243.ec2.internal"
Jun 15 05:48:37.658781 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:48:37.658617    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/c8b2bbb1effaa631bc90559ca49e380a-config\") pod \"kube-apiserver-proxy-ip-10-0-128-243.ec2.internal\" (UID: \"c8b2bbb1effaa631bc90559ca49e380a\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-128-243.ec2.internal"
Jun 15 05:48:37.658781 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:48:37.658655    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/c8b2bbb1effaa631bc90559ca49e380a-config\") pod \"kube-apiserver-proxy-ip-10-0-128-243.ec2.internal\" (UID: \"c8b2bbb1effaa631bc90559ca49e380a\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-128-243.ec2.internal"
Jun 15 05:48:37.658781 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:48:37.658672    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/20fcfef3e673a6e0448477fc680fc5f1-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-128-243.ec2.internal\" (UID: \"20fcfef3e673a6e0448477fc680fc5f1\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-243.ec2.internal"
Jun 15 05:48:37.658781 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:48:37.658655    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/20fcfef3e673a6e0448477fc680fc5f1-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-128-243.ec2.internal\" (UID: \"20fcfef3e673a6e0448477fc680fc5f1\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-243.ec2.internal"
Jun 15 05:48:37.666568 ip-10-0-128-243 kubenswrapper[2566]: E0615 05:48:37.666547    2566 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-243.ec2.internal\" not found"
Jun 15 05:48:37.767272 ip-10-0-128-243 kubenswrapper[2566]: E0615 05:48:37.767226    2566 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-243.ec2.internal\" not found"
Jun 15 05:48:37.864991 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:48:37.864919    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-243.ec2.internal"
Jun 15 05:48:37.867870 ip-10-0-128-243 kubenswrapper[2566]: E0615 05:48:37.867852    2566 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-243.ec2.internal\" not found"
Jun 15 05:48:37.869996 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:48:37.869567    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-243.ec2.internal"
Jun 15 05:48:37.967981 ip-10-0-128-243 kubenswrapper[2566]: E0615 05:48:37.967941    2566 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-243.ec2.internal\" not found"
Jun 15 05:48:38.068456 ip-10-0-128-243 kubenswrapper[2566]: E0615 05:48:38.068424    2566 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-243.ec2.internal\" not found"
Jun 15 05:48:38.169125 ip-10-0-128-243 kubenswrapper[2566]: E0615 05:48:38.169031    2566 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-243.ec2.internal\" not found"
Jun 15 05:48:38.269555 ip-10-0-128-243 kubenswrapper[2566]: E0615 05:48:38.269526    2566 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-243.ec2.internal\" not found"
Jun 15 05:48:38.304735 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:48:38.304704    2566 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Jun 15 05:48:38.305290 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:48:38.304895    2566 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jun 15 05:48:38.318989 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:48:38.318958    2566 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jun 15 05:48:38.370576 ip-10-0-128-243 kubenswrapper[2566]: E0615 05:48:38.370548    2566 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-243.ec2.internal\" not found"
Jun 15 05:48:38.413388 ip-10-0-128-243 kubenswrapper[2566]: W0615 05:48:38.413351    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod20fcfef3e673a6e0448477fc680fc5f1.slice/crio-91ff2ed3cd61f724df678192a88fad5bca4d8a36af7dc355e6dc8b0929421851 WatchSource:0}: Error finding container 91ff2ed3cd61f724df678192a88fad5bca4d8a36af7dc355e6dc8b0929421851: Status 404 returned error can't find the container with id 91ff2ed3cd61f724df678192a88fad5bca4d8a36af7dc355e6dc8b0929421851
Jun 15 05:48:38.414023 ip-10-0-128-243 kubenswrapper[2566]: W0615 05:48:38.414007    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc8b2bbb1effaa631bc90559ca49e380a.slice/crio-e603e7931d6075068fef7a08e5ad3341034943f1fc33f25ab6d38a26b2792e2e WatchSource:0}: Error finding container e603e7931d6075068fef7a08e5ad3341034943f1fc33f25ab6d38a26b2792e2e: Status 404 returned error can't find the container with id e603e7931d6075068fef7a08e5ad3341034943f1fc33f25ab6d38a26b2792e2e
Jun 15 05:48:38.416105 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:48:38.416051    2566 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-06-14 05:43:37 +0000 UTC" deadline="2027-12-09 06:10:43.094328771 +0000 UTC"
Jun 15 05:48:38.416161 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:48:38.416108    2566 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="13008h22m4.678225277s"
Jun 15 05:48:38.417956 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:48:38.417943    2566 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jun 15 05:48:38.438315 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:48:38.438264    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-243.ec2.internal" event={"ID":"20fcfef3e673a6e0448477fc680fc5f1","Type":"ContainerStarted","Data":"91ff2ed3cd61f724df678192a88fad5bca4d8a36af7dc355e6dc8b0929421851"}
Jun 15 05:48:38.439322 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:48:38.439300    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-243.ec2.internal" event={"ID":"c8b2bbb1effaa631bc90559ca49e380a","Type":"ContainerStarted","Data":"e603e7931d6075068fef7a08e5ad3341034943f1fc33f25ab6d38a26b2792e2e"}
Jun 15 05:48:38.470764 ip-10-0-128-243 kubenswrapper[2566]: E0615 05:48:38.470741    2566 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-243.ec2.internal\" not found"
Jun 15 05:48:38.524916 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:48:38.524889    2566 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jun 15 05:48:38.526062 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:48:38.526045    2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-243.ec2.internal" event="NodeHasSufficientMemory"
Jun 15 05:48:38.526168 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:48:38.526097    2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-243.ec2.internal" event="NodeHasNoDiskPressure"
Jun 15 05:48:38.526168 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:48:38.526114    2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-243.ec2.internal" event="NodeHasSufficientPID"
Jun 15 05:48:38.571660 ip-10-0-128-243 kubenswrapper[2566]: E0615 05:48:38.571627    2566 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-243.ec2.internal\" not found"
Jun 15 05:48:38.672156 ip-10-0-128-243 kubenswrapper[2566]: E0615 05:48:38.672095    2566 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-243.ec2.internal\" not found"
Jun 15 05:48:38.772582 ip-10-0-128-243 kubenswrapper[2566]: E0615 05:48:38.772551    2566 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-243.ec2.internal\" not found"
Jun 15 05:48:38.804804 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:48:38.804776    2566 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Jun 15 05:48:38.843293 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:48:38.843264    2566 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Jun 15 05:48:38.858529 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:48:38.858505    2566 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-243.ec2.internal"
Jun 15 05:48:38.874677 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:48:38.874645    2566 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jun 15 05:48:38.875753 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:48:38.875730    2566 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-243.ec2.internal"
Jun 15 05:48:38.886874 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:48:38.886770    2566 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jun 15 05:48:39.339176 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:48:39.339138    2566 apiserver.go:52] "Watching apiserver"
Jun 15 05:48:39.345543 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:48:39.345521    2566 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Jun 15 05:48:39.345886 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:48:39.345863    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/node-resolver-n8bz5","openshift-multus/multus-6zzmq","openshift-multus/multus-additional-cni-plugins-c5vrl","openshift-multus/network-metrics-daemon-cbmww","openshift-network-diagnostics/network-check-target-gbdt4","openshift-ovn-kubernetes/ovnkube-node-f4bzh","kube-system/kube-apiserver-proxy-ip-10-0-128-243.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pwcsh","openshift-cluster-node-tuning-operator/tuned-jk5fv","openshift-image-registry/node-ca-frzbm","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-243.ec2.internal","openshift-network-operator/iptables-alerter-srxml","kube-system/global-pull-secret-syncer-hpg5s","kube-system/konnectivity-agent-xv9fc"]
Jun 15 05:48:39.348334 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:48:39.348318    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-frzbm"
Jun 15 05:48:39.350534 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:48:39.350511    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hpg5s"
Jun 15 05:48:39.350624 ip-10-0-128-243 kubenswrapper[2566]: E0615 05:48:39.350589    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hpg5s" podUID="7a806cb5-1d94-4558-9a7a-a734123af31b"
Jun 15 05:48:39.352736 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:48:39.352714    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-c5vrl"
Jun 15 05:48:39.354899 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:48:39.354881    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cbmww"
Jun 15 05:48:39.355016 ip-10-0-128-243 kubenswrapper[2566]: E0615 05:48:39.354956    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cbmww" podUID="d81bd047-22fb-452e-b2d2-073f232701c2"
Jun 15 05:48:39.355596 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:48:39.355579    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Jun 15 05:48:39.355677 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:48:39.355583    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Jun 15 05:48:39.355827 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:48:39.355806    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-v64lc\""
Jun 15 05:48:39.355950 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:48:39.355875    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Jun 15 05:48:39.356783 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:48:39.356761    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Jun 15 05:48:39.357005 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:48:39.356991    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Jun 15 05:48:39.357094 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:48:39.357060    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gbdt4"
Jun 15 05:48:39.357163 ip-10-0-128-243 kubenswrapper[2566]: E0615 05:48:39.357137    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gbdt4" podUID="7fb5709e-946d-4dc2-ac4f-72986f9adcdc"
Jun 15 05:48:39.357223 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:48:39.357173    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Jun 15 05:48:39.357285 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:48:39.357270    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-wm998\""
Jun 15 05:48:39.358602 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:48:39.358300    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Jun 15 05:48:39.358602 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:48:39.358484    2566 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Jun 15 05:48:39.358714 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:48:39.358658    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Jun 15 05:48:39.359496 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:48:39.359477    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-f4bzh"
Jun 15 05:48:39.361295 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:48:39.361280    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Jun 15 05:48:39.361982 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:48:39.361966    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-jk5fv"
Jun 15 05:48:39.364689 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:48:39.364665    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-xv9fc"
Jun 15 05:48:39.365986 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:48:39.365764    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Jun 15 05:48:39.365986 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:48:39.365851    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Jun 15 05:48:39.366389 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:48:39.366374    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-xnm2h\""
Jun 15 05:48:39.367502 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:48:39.367031    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-6zzmq"
Jun 15 05:48:39.367743 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:48:39.367726    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/5a1f8f83-55db-4fc7-872d-6b202daa0a31-node-log\") pod \"ovnkube-node-f4bzh\" (UID: \"5a1f8f83-55db-4fc7-872d-6b202daa0a31\") " pod="openshift-ovn-kubernetes/ovnkube-node-f4bzh"
Jun 15 05:48:39.367813 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:48:39.367756    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5a1f8f83-55db-4fc7-872d-6b202daa0a31-host-run-ovn-kubernetes\") pod \"ovnkube-node-f4bzh\" (UID: \"5a1f8f83-55db-4fc7-872d-6b202daa0a31\") " pod="openshift-ovn-kubernetes/ovnkube-node-f4bzh"
Jun 15 05:48:39.367813 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:48:39.367776    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/5a1f8f83-55db-4fc7-872d-6b202daa0a31-host-cni-bin\") pod \"ovnkube-node-f4bzh\" (UID: \"5a1f8f83-55db-4fc7-872d-6b202daa0a31\") " pod="openshift-ovn-kubernetes/ovnkube-node-f4bzh"
Jun 15 05:48:39.367813 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:48:39.367791    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/5a1f8f83-55db-4fc7-872d-6b202daa0a31-host-cni-netd\") pod \"ovnkube-node-f4bzh\" (UID: \"5a1f8f83-55db-4fc7-872d-6b202daa0a31\") " pod="openshift-ovn-kubernetes/ovnkube-node-f4bzh"
Jun 15 05:48:39.367941 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:48:39.367820    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/0246685c-f9e4-45b0-bb3f-b17957621809-cni-binary-copy\") pod \"multus-additional-cni-plugins-c5vrl\" (UID: \"0246685c-f9e4-45b0-bb3f-b17957621809\") " pod="openshift-multus/multus-additional-cni-plugins-c5vrl"
Jun 15 05:48:39.367941 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:48:39.367848    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/5a1f8f83-55db-4fc7-872d-6b202daa0a31-log-socket\") pod \"ovnkube-node-f4bzh\" (UID: \"5a1f8f83-55db-4fc7-872d-6b202daa0a31\") " pod="openshift-ovn-kubernetes/ovnkube-node-f4bzh"
Jun 15 05:48:39.367941 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:48:39.367886    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/0246685c-f9e4-45b0-bb3f-b17957621809-system-cni-dir\") pod \"multus-additional-cni-plugins-c5vrl\" (UID: \"0246685c-f9e4-45b0-bb3f-b17957621809\") " pod="openshift-multus/multus-additional-cni-plugins-c5vrl"
Jun 15 05:48:39.367941 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:48:39.367912    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/5a1f8f83-55db-4fc7-872d-6b202daa0a31-systemd-units\") pod \"ovnkube-node-f4bzh\" (UID: \"5a1f8f83-55db-4fc7-872d-6b202daa0a31\") " pod="openshift-ovn-kubernetes/ovnkube-node-f4bzh"
Jun 15 05:48:39.368160 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:48:39.367949    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/5a1f8f83-55db-4fc7-872d-6b202daa0a31-host-run-netns\") pod \"ovnkube-node-f4bzh\" (UID: \"5a1f8f83-55db-4fc7-872d-6b202daa0a31\") " pod="openshift-ovn-kubernetes/ovnkube-node-f4bzh"
Jun 15 05:48:39.368160 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:48:39.367972    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/5a1f8f83-55db-4fc7-872d-6b202daa0a31-run-systemd\") pod \"ovnkube-node-f4bzh\" (UID: \"5a1f8f83-55db-4fc7-872d-6b202daa0a31\") " pod="openshift-ovn-kubernetes/ovnkube-node-f4bzh"
Jun 15 05:48:39.368160 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:48:39.367995    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/7a806cb5-1d94-4558-9a7a-a734123af31b-dbus\") pod \"global-pull-secret-syncer-hpg5s\" (UID: \"7a806cb5-1d94-4558-9a7a-a734123af31b\") " pod="kube-system/global-pull-secret-syncer-hpg5s"
Jun 15 05:48:39.368160 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:48:39.368039    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/0246685c-f9e4-45b0-bb3f-b17957621809-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-c5vrl\" (UID: \"0246685c-f9e4-45b0-bb3f-b17957621809\") " pod="openshift-multus/multus-additional-cni-plugins-c5vrl"
Jun 15 05:48:39.368160 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:48:39.368103    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/5a1f8f83-55db-4fc7-872d-6b202daa0a31-etc-openvswitch\") pod \"ovnkube-node-f4bzh\" (UID: \"5a1f8f83-55db-4fc7-872d-6b202daa0a31\") " pod="openshift-ovn-kubernetes/ovnkube-node-f4bzh"
Jun 15 05:48:39.368160 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:48:39.368138    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ghvxz\" (UniqueName: \"kubernetes.io/projected/5a1f8f83-55db-4fc7-872d-6b202daa0a31-kube-api-access-ghvxz\") pod \"ovnkube-node-f4bzh\" (UID: \"5a1f8f83-55db-4fc7-872d-6b202daa0a31\") " pod="openshift-ovn-kubernetes/ovnkube-node-f4bzh"
Jun 15 05:48:39.368422 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:48:39.368166    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/5a1f8f83-55db-4fc7-872d-6b202daa0a31-host-slash\") pod \"ovnkube-node-f4bzh\" (UID: \"5a1f8f83-55db-4fc7-872d-6b202daa0a31\") " pod="openshift-ovn-kubernetes/ovnkube-node-f4bzh"
Jun 15 05:48:39.368422 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:48:39.368188    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/5a1f8f83-55db-4fc7-872d-6b202daa0a31-run-ovn\") pod \"ovnkube-node-f4bzh\" (UID: \"5a1f8f83-55db-4fc7-872d-6b202daa0a31\") " pod="openshift-ovn-kubernetes/ovnkube-node-f4bzh"
Jun 15 05:48:39.368422 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:48:39.368232    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5a1f8f83-55db-4fc7-872d-6b202daa0a31-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-f4bzh\" (UID: \"5a1f8f83-55db-4fc7-872d-6b202daa0a31\") " pod="openshift-ovn-kubernetes/ovnkube-node-f4bzh"
Jun 15 05:48:39.368422 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:48:39.368290    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kxttp\" (UniqueName: \"kubernetes.io/projected/d81bd047-22fb-452e-b2d2-073f232701c2-kube-api-access-kxttp\") pod \"network-metrics-daemon-cbmww\" (UID: \"d81bd047-22fb-452e-b2d2-073f232701c2\") " pod="openshift-multus/network-metrics-daemon-cbmww"
Jun 15 05:48:39.368422 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:48:39.368307    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/5a1f8f83-55db-4fc7-872d-6b202daa0a31-host-kubelet\") pod \"ovnkube-node-f4bzh\" (UID: \"5a1f8f83-55db-4fc7-872d-6b202daa0a31\") " pod="openshift-ovn-kubernetes/ovnkube-node-f4bzh"
Jun 15 05:48:39.368422 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:48:39.368325    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/5a1f8f83-55db-4fc7-872d-6b202daa0a31-ovnkube-config\") pod \"ovnkube-node-f4bzh\" (UID: \"5a1f8f83-55db-4fc7-872d-6b202daa0a31\") " pod="openshift-ovn-kubernetes/ovnkube-node-f4bzh"
Jun 15 05:48:39.368422 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:48:39.368368    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/2e630a88-8b65-4dd7-970d-cfd8e5d031c6-serviceca\") pod \"node-ca-frzbm\" (UID: \"2e630a88-8b65-4dd7-970d-cfd8e5d031c6\") " pod="openshift-image-registry/node-ca-frzbm"
Jun 15 05:48:39.368422 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:48:39.368396    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7a806cb5-1d94-4558-9a7a-a734123af31b-original-pull-secret\") pod \"global-pull-secret-syncer-hpg5s\" (UID: \"7a806cb5-1d94-4558-9a7a-a734123af31b\") " pod="kube-system/global-pull-secret-syncer-hpg5s"
Jun 15 05:48:39.368422 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:48:39.368422    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/0246685c-f9e4-45b0-bb3f-b17957621809-cnibin\") pod \"multus-additional-cni-plugins-c5vrl\" (UID: \"0246685c-f9e4-45b0-bb3f-b17957621809\") " pod="openshift-multus/multus-additional-cni-plugins-c5vrl"
Jun 15 05:48:39.368846 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:48:39.368446    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d81bd047-22fb-452e-b2d2-073f232701c2-metrics-certs\") pod \"network-metrics-daemon-cbmww\" (UID: \"d81bd047-22fb-452e-b2d2-073f232701c2\") " pod="openshift-multus/network-metrics-daemon-cbmww"
Jun 15 05:48:39.368846 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:48:39.368468    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/5a1f8f83-55db-4fc7-872d-6b202daa0a31-ovn-node-metrics-cert\") pod \"ovnkube-node-f4bzh\" (UID: \"5a1f8f83-55db-4fc7-872d-6b202daa0a31\") " pod="openshift-ovn-kubernetes/ovnkube-node-f4bzh"
Jun 15 05:48:39.368846 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:48:39.368491    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/5a1f8f83-55db-4fc7-872d-6b202daa0a31-ovnkube-script-lib\") pod \"ovnkube-node-f4bzh\" (UID: \"5a1f8f83-55db-4fc7-872d-6b202daa0a31\") " pod="openshift-ovn-kubernetes/ovnkube-node-f4bzh"
Jun 15 05:48:39.368846 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:48:39.368530    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/0246685c-f9e4-45b0-bb3f-b17957621809-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-c5vrl\" (UID: \"0246685c-f9e4-45b0-bb3f-b17957621809\") " pod="openshift-multus/multus-additional-cni-plugins-c5vrl"
Jun 15 05:48:39.368846 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:48:39.368552    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nc9t7\" (UniqueName: \"kubernetes.io/projected/7fb5709e-946d-4dc2-ac4f-72986f9adcdc-kube-api-access-nc9t7\") pod \"network-check-target-gbdt4\" (UID: \"7fb5709e-946d-4dc2-ac4f-72986f9adcdc\") " pod="openshift-network-diagnostics/network-check-target-gbdt4"
Jun 15 05:48:39.368846 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:48:39.368572    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/5a1f8f83-55db-4fc7-872d-6b202daa0a31-env-overrides\") pod \"ovnkube-node-f4bzh\" (UID: \"5a1f8f83-55db-4fc7-872d-6b202daa0a31\") " pod="openshift-ovn-kubernetes/ovnkube-node-f4bzh"
Jun 15 05:48:39.368846 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:48:39.368611    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f9dhk\" (UniqueName: \"kubernetes.io/projected/2e630a88-8b65-4dd7-970d-cfd8e5d031c6-kube-api-access-f9dhk\") pod \"node-ca-frzbm\" (UID: \"2e630a88-8b65-4dd7-970d-cfd8e5d031c6\") " pod="openshift-image-registry/node-ca-frzbm"
Jun 15 05:48:39.368846 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:48:39.368634    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/7a806cb5-1d94-4558-9a7a-a734123af31b-kubelet-config\") pod \"global-pull-secret-syncer-hpg5s\" (UID: \"7a806cb5-1d94-4558-9a7a-a734123af31b\") " pod="kube-system/global-pull-secret-syncer-hpg5s"
Jun 15 05:48:39.368846 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:48:39.368654    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/0246685c-f9e4-45b0-bb3f-b17957621809-os-release\") pod \"multus-additional-cni-plugins-c5vrl\" (UID: \"0246685c-f9e4-45b0-bb3f-b17957621809\") " pod="openshift-multus/multus-additional-cni-plugins-c5vrl"
Jun 15 05:48:39.368846 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:48:39.368691    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/0246685c-f9e4-45b0-bb3f-b17957621809-tuning-conf-dir\") pod \"multus-additional-cni-plugins-c5vrl\" (UID: \"0246685c-f9e4-45b0-bb3f-b17957621809\") " pod="openshift-multus/multus-additional-cni-plugins-c5vrl"
Jun 15 05:48:39.368846 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:48:39.368728    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jbdmh\" (UniqueName: \"kubernetes.io/projected/0246685c-f9e4-45b0-bb3f-b17957621809-kube-api-access-jbdmh\") pod \"multus-additional-cni-plugins-c5vrl\" (UID: \"0246685c-f9e4-45b0-bb3f-b17957621809\") " pod="openshift-multus/multus-additional-cni-plugins-c5vrl"
Jun 15 05:48:39.368846 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:48:39.368752    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/2e630a88-8b65-4dd7-970d-cfd8e5d031c6-host\") pod \"node-ca-frzbm\" (UID: \"2e630a88-8b65-4dd7-970d-cfd8e5d031c6\") " pod="openshift-image-registry/node-ca-frzbm"
Jun 15 05:48:39.368846 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:48:39.368798    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/5a1f8f83-55db-4fc7-872d-6b202daa0a31-var-lib-openvswitch\") pod \"ovnkube-node-f4bzh\" (UID: \"5a1f8f83-55db-4fc7-872d-6b202daa0a31\") " pod="openshift-ovn-kubernetes/ovnkube-node-f4bzh"
Jun 15 05:48:39.368846 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:48:39.368826    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/5a1f8f83-55db-4fc7-872d-6b202daa0a31-run-openvswitch\") pod \"ovnkube-node-f4bzh\" (UID: \"5a1f8f83-55db-4fc7-872d-6b202daa0a31\") " pod="openshift-ovn-kubernetes/ovnkube-node-f4bzh"
Jun 15 05:48:39.369524 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:48:39.369017    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Jun 15 05:48:39.369524 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:48:39.369401    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-n8bz5"
Jun 15 05:48:39.370990 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:48:39.370965    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-w96d2\""
Jun 15 05:48:39.371105 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:48:39.370969    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Jun 15 05:48:39.372014 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:48:39.371992    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pwcsh"
Jun 15 05:48:39.372811 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:48:39.372792    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Jun 15 05:48:39.373562 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:48:39.373543    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-c42wb\""
Jun 15 05:48:39.373562 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:48:39.373564    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Jun 15 05:48:39.373800 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:48:39.373783    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-fqz8g\""
Jun 15 05:48:39.373903 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:48:39.373889    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Jun 15 05:48:39.375150 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:48:39.374333    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Jun 15 05:48:39.375150 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:48:39.374424    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Jun 15 05:48:39.375150 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:48:39.374643    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Jun 15 05:48:39.375150 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:48:39.374727    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Jun 15 05:48:39.375150 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:48:39.374846    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-pwps8\""
Jun 15 05:48:39.375150 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:48:39.374980    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Jun 15 05:48:39.376543 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:48:39.376296    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-srxml"
Jun 15 05:48:39.377836 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:48:39.377818    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Jun 15 05:48:39.383151 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:48:39.383130    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Jun 15 05:48:39.383254 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:48:39.383161    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Jun 15 05:48:39.383254 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:48:39.383164    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Jun 15 05:48:39.383377 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:48:39.383261    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Jun 15 05:48:39.384978 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:48:39.384958    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Jun 15 05:48:39.385154 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:48:39.385134    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-l4srl\""
Jun 15 05:48:39.387603 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:48:39.387583    2566 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jun 15 05:48:39.387673 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:48:39.387645    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-sbs9d\""
Jun 15 05:48:39.404398 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:48:39.404381    2566 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-mp4zp"
Jun 15 05:48:39.415438 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:48:39.415411    2566 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-mp4zp"
Jun 15 05:48:39.459127 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:48:39.459105    2566 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Jun 15 05:48:39.469117 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:48:39.469014    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/2bfcdbc6-e206-4efc-8342-4b2a949e9111-sys\") pod \"tuned-jk5fv\" (UID: \"2bfcdbc6-e206-4efc-8342-4b2a949e9111\") " pod="openshift-cluster-node-tuning-operator/tuned-jk5fv"
Jun 15 05:48:39.469117 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:48:39.469050    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/2bfcdbc6-e206-4efc-8342-4b2a949e9111-var-lib-kubelet\") pod \"tuned-jk5fv\" (UID: \"2bfcdbc6-e206-4efc-8342-4b2a949e9111\") " pod="openshift-cluster-node-tuning-operator/tuned-jk5fv"
Jun 15 05:48:39.469117 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:48:39.469074    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/ed7324e7-cd07-4862-ba38-dfb225591afd-cnibin\") pod \"multus-6zzmq\" (UID: \"ed7324e7-cd07-4862-ba38-dfb225591afd\") " pod="openshift-multus/multus-6zzmq"
Jun 15 05:48:39.469117 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:48:39.469117    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/ed7324e7-cd07-4862-ba38-dfb225591afd-host-run-netns\") pod \"multus-6zzmq\" (UID: \"ed7324e7-cd07-4862-ba38-dfb225591afd\") " pod="openshift-multus/multus-6zzmq"
Jun 15 05:48:39.469436 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:48:39.469171    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/0246685c-f9e4-45b0-bb3f-b17957621809-os-release\") pod \"multus-additional-cni-plugins-c5vrl\" (UID: \"0246685c-f9e4-45b0-bb3f-b17957621809\") " pod="openshift-multus/multus-additional-cni-plugins-c5vrl"
Jun 15 05:48:39.469436 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:48:39.469215    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/2e630a88-8b65-4dd7-970d-cfd8e5d031c6-host\") pod \"node-ca-frzbm\" (UID: \"2e630a88-8b65-4dd7-970d-cfd8e5d031c6\") " pod="openshift-image-registry/node-ca-frzbm"
Jun 15 05:48:39.469436 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:48:39.469248    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/2bfcdbc6-e206-4efc-8342-4b2a949e9111-etc-sysctl-d\") pod \"tuned-jk5fv\" (UID: \"2bfcdbc6-e206-4efc-8342-4b2a949e9111\") " pod="openshift-cluster-node-tuning-operator/tuned-jk5fv"
Jun 15 05:48:39.469436 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:48:39.469273    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/ed7324e7-cd07-4862-ba38-dfb225591afd-cni-binary-copy\") pod \"multus-6zzmq\" (UID: \"ed7324e7-cd07-4862-ba38-dfb225591afd\") " pod="openshift-multus/multus-6zzmq"
Jun 15 05:48:39.469436 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:48:39.469286    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/0246685c-f9e4-45b0-bb3f-b17957621809-os-release\") pod \"multus-additional-cni-plugins-c5vrl\" (UID: \"0246685c-f9e4-45b0-bb3f-b17957621809\") " pod="openshift-multus/multus-additional-cni-plugins-c5vrl"
Jun 15 05:48:39.469436 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:48:39.469297    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/ed7324e7-cd07-4862-ba38-dfb225591afd-host-var-lib-cni-bin\") pod \"multus-6zzmq\" (UID: \"ed7324e7-cd07-4862-ba38-dfb225591afd\") " pod="openshift-multus/multus-6zzmq"
Jun 15 05:48:39.469436 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:48:39.469287    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/2e630a88-8b65-4dd7-970d-cfd8e5d031c6-host\") pod \"node-ca-frzbm\" (UID: \"2e630a88-8b65-4dd7-970d-cfd8e5d031c6\") " pod="openshift-image-registry/node-ca-frzbm"
Jun 15 05:48:39.469436 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:48:39.469321    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ed7324e7-cd07-4862-ba38-dfb225591afd-host-var-lib-kubelet\") pod \"multus-6zzmq\" (UID: \"ed7324e7-cd07-4862-ba38-dfb225591afd\") " pod="openshift-multus/multus-6zzmq"
Jun 15 05:48:39.469436 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:48:39.469343    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/ed7324e7-cd07-4862-ba38-dfb225591afd-multus-conf-dir\") pod \"multus-6zzmq\" (UID: \"ed7324e7-cd07-4862-ba38-dfb225591afd\") " pod="openshift-multus/multus-6zzmq"
Jun 15 05:48:39.469436 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:48:39.469377    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/5a1f8f83-55db-4fc7-872d-6b202daa0a31-var-lib-openvswitch\") pod \"ovnkube-node-f4bzh\" (UID: \"5a1f8f83-55db-4fc7-872d-6b202daa0a31\") " pod="openshift-ovn-kubernetes/ovnkube-node-f4bzh"
Jun 15 05:48:39.469436 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:48:39.469400    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/5a1f8f83-55db-4fc7-872d-6b202daa0a31-run-openvswitch\") pod \"ovnkube-node-f4bzh\" (UID: \"5a1f8f83-55db-4fc7-872d-6b202daa0a31\") " pod="openshift-ovn-kubernetes/ovnkube-node-f4bzh"
Jun 15 05:48:39.469959 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:48:39.469444    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/5a1f8f83-55db-4fc7-872d-6b202daa0a31-var-lib-openvswitch\") pod \"ovnkube-node-f4bzh\" (UID: \"5a1f8f83-55db-4fc7-872d-6b202daa0a31\") " pod="openshift-ovn-kubernetes/ovnkube-node-f4bzh"
Jun 15 05:48:39.469959 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:48:39.469464    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/5a1f8f83-55db-4fc7-872d-6b202daa0a31-run-openvswitch\") pod \"ovnkube-node-f4bzh\" (UID: \"5a1f8f83-55db-4fc7-872d-6b202daa0a31\") " pod="openshift-ovn-kubernetes/ovnkube-node-f4bzh"
Jun 15 05:48:39.469959 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:48:39.469466    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/5a1f8f83-55db-4fc7-872d-6b202daa0a31-node-log\") pod \"ovnkube-node-f4bzh\" (UID: \"5a1f8f83-55db-4fc7-872d-6b202daa0a31\") " pod="openshift-ovn-kubernetes/ovnkube-node-f4bzh"
Jun 15 05:48:39.469959 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:48:39.469491    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/5a1f8f83-55db-4fc7-872d-6b202daa0a31-node-log\") pod \"ovnkube-node-f4bzh\" (UID: \"5a1f8f83-55db-4fc7-872d-6b202daa0a31\") " pod="openshift-ovn-kubernetes/ovnkube-node-f4bzh"
Jun 15 05:48:39.469959 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:48:39.469495    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/5a1f8f83-55db-4fc7-872d-6b202daa0a31-host-cni-bin\") pod \"ovnkube-node-f4bzh\" (UID: \"5a1f8f83-55db-4fc7-872d-6b202daa0a31\") " pod="openshift-ovn-kubernetes/ovnkube-node-f4bzh"
Jun 15 05:48:39.469959 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:48:39.469521    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/5a1f8f83-55db-4fc7-872d-6b202daa0a31-systemd-units\") pod \"ovnkube-node-f4bzh\" (UID: \"5a1f8f83-55db-4fc7-872d-6b202daa0a31\") " pod="openshift-ovn-kubernetes/ovnkube-node-f4bzh"
Jun 15 05:48:39.469959 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:48:39.469551    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/7a806cb5-1d94-4558-9a7a-a734123af31b-dbus\") pod \"global-pull-secret-syncer-hpg5s\" (UID: \"7a806cb5-1d94-4558-9a7a-a734123af31b\") " pod="kube-system/global-pull-secret-syncer-hpg5s"
Jun 15 05:48:39.469959 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:48:39.469577    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2bfcdbc6-e206-4efc-8342-4b2a949e9111-tmp\") pod \"tuned-jk5fv\" (UID: \"2bfcdbc6-e206-4efc-8342-4b2a949e9111\") " pod="openshift-cluster-node-tuning-operator/tuned-jk5fv"
Jun 15 05:48:39.469959 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:48:39.469586    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/5a1f8f83-55db-4fc7-872d-6b202daa0a31-host-cni-bin\") pod \"ovnkube-node-f4bzh\" (UID: \"5a1f8f83-55db-4fc7-872d-6b202daa0a31\") " pod="openshift-ovn-kubernetes/ovnkube-node-f4bzh"
Jun 15 05:48:39.469959 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:48:39.469602    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/0246685c-f9e4-45b0-bb3f-b17957621809-cni-binary-copy\") pod \"multus-additional-cni-plugins-c5vrl\" (UID: \"0246685c-f9e4-45b0-bb3f-b17957621809\") " pod="openshift-multus/multus-additional-cni-plugins-c5vrl"
Jun 15 05:48:39.469959 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:48:39.469628    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/5a1f8f83-55db-4fc7-872d-6b202daa0a31-log-socket\") pod \"ovnkube-node-f4bzh\" (UID: \"5a1f8f83-55db-4fc7-872d-6b202daa0a31\") " pod="openshift-ovn-kubernetes/ovnkube-node-f4bzh"
Jun 15 05:48:39.469959 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:48:39.469658    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/7a806cb5-1d94-4558-9a7a-a734123af31b-dbus\") pod \"global-pull-secret-syncer-hpg5s\" (UID: \"7a806cb5-1d94-4558-9a7a-a734123af31b\") " pod="kube-system/global-pull-secret-syncer-hpg5s"
Jun 15 05:48:39.469959 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:48:39.469746    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/5a1f8f83-55db-4fc7-872d-6b202daa0a31-systemd-units\") pod \"ovnkube-node-f4bzh\" (UID: \"5a1f8f83-55db-4fc7-872d-6b202daa0a31\") " pod="openshift-ovn-kubernetes/ovnkube-node-f4bzh"
Jun 15 05:48:39.469959 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:48:39.469749    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/5a1f8f83-55db-4fc7-872d-6b202daa0a31-log-socket\") pod \"ovnkube-node-f4bzh\" (UID: \"5a1f8f83-55db-4fc7-872d-6b202daa0a31\") " pod="openshift-ovn-kubernetes/ovnkube-node-f4bzh"
Jun 15 05:48:39.469959 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:48:39.469785    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/2bfcdbc6-e206-4efc-8342-4b2a949e9111-etc-modprobe-d\") pod \"tuned-jk5fv\" (UID: \"2bfcdbc6-e206-4efc-8342-4b2a949e9111\") " pod="openshift-cluster-node-tuning-operator/tuned-jk5fv"
Jun 15 05:48:39.469959 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:48:39.469837    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/2bfcdbc6-e206-4efc-8342-4b2a949e9111-etc-tuned\") pod \"tuned-jk5fv\" (UID: \"2bfcdbc6-e206-4efc-8342-4b2a949e9111\") " pod="openshift-cluster-node-tuning-operator/tuned-jk5fv"
Jun 15 05:48:39.469959 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:48:39.469877    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ed7324e7-cd07-4862-ba38-dfb225591afd-etc-kubernetes\") pod \"multus-6zzmq\" (UID: \"ed7324e7-cd07-4862-ba38-dfb225591afd\") " pod="openshift-multus/multus-6zzmq"
Jun 15 05:48:39.470763 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:48:39.469910    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kb8s6\" (UniqueName: \"kubernetes.io/projected/ed7324e7-cd07-4862-ba38-dfb225591afd-kube-api-access-kb8s6\") pod \"multus-6zzmq\" (UID: \"ed7324e7-cd07-4862-ba38-dfb225591afd\") " pod="openshift-multus/multus-6zzmq"
Jun 15 05:48:39.470763 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:48:39.469934    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c1ebb64e-4a47-4507-b619-32502fb528ca-tmp-dir\") pod \"node-resolver-n8bz5\" (UID: \"c1ebb64e-4a47-4507-b619-32502fb528ca\") " pod="openshift-dns/node-resolver-n8bz5"
Jun 15 05:48:39.470763 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:48:39.469957    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/d0cff6b1-26d2-4059-a556-347772ca0557-etc-selinux\") pod \"aws-ebs-csi-driver-node-pwcsh\" (UID: \"d0cff6b1-26d2-4059-a556-347772ca0557\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pwcsh"
Jun 15 05:48:39.470763 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:48:39.469982    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/5a1f8f83-55db-4fc7-872d-6b202daa0a31-etc-openvswitch\") pod \"ovnkube-node-f4bzh\" (UID: \"5a1f8f83-55db-4fc7-872d-6b202daa0a31\") " pod="openshift-ovn-kubernetes/ovnkube-node-f4bzh"
Jun 15 05:48:39.470763 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:48:39.470008    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ghvxz\" (UniqueName: \"kubernetes.io/projected/5a1f8f83-55db-4fc7-872d-6b202daa0a31-kube-api-access-ghvxz\") pod \"ovnkube-node-f4bzh\" (UID: \"5a1f8f83-55db-4fc7-872d-6b202daa0a31\") " pod="openshift-ovn-kubernetes/ovnkube-node-f4bzh"
Jun 15 05:48:39.470763 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:48:39.470031    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2bfcdbc6-e206-4efc-8342-4b2a949e9111-etc-kubernetes\") pod \"tuned-jk5fv\" (UID: \"2bfcdbc6-e206-4efc-8342-4b2a949e9111\") " pod="openshift-cluster-node-tuning-operator/tuned-jk5fv"
Jun 15 05:48:39.470763 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:48:39.470058    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/5a1f8f83-55db-4fc7-872d-6b202daa0a31-run-ovn\") pod \"ovnkube-node-f4bzh\" (UID: \"5a1f8f83-55db-4fc7-872d-6b202daa0a31\") " pod="openshift-ovn-kubernetes/ovnkube-node-f4bzh"
Jun 15 05:48:39.470763 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:48:39.470068    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/5a1f8f83-55db-4fc7-872d-6b202daa0a31-etc-openvswitch\") pod \"ovnkube-node-f4bzh\" (UID: \"5a1f8f83-55db-4fc7-872d-6b202daa0a31\") " pod="openshift-ovn-kubernetes/ovnkube-node-f4bzh"
Jun 15 05:48:39.470763 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:48:39.470097    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/0246685c-f9e4-45b0-bb3f-b17957621809-cni-binary-copy\") pod \"multus-additional-cni-plugins-c5vrl\" (UID: \"0246685c-f9e4-45b0-bb3f-b17957621809\") " pod="openshift-multus/multus-additional-cni-plugins-c5vrl"
Jun 15 05:48:39.470763 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:48:39.470102    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/2bfcdbc6-e206-4efc-8342-4b2a949e9111-etc-sysctl-conf\") pod \"tuned-jk5fv\" (UID: \"2bfcdbc6-e206-4efc-8342-4b2a949e9111\") " pod="openshift-cluster-node-tuning-operator/tuned-jk5fv"
Jun 15 05:48:39.470763 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:48:39.470140    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/2bfcdbc6-e206-4efc-8342-4b2a949e9111-host\") pod \"tuned-jk5fv\" (UID: \"2bfcdbc6-e206-4efc-8342-4b2a949e9111\") " pod="openshift-cluster-node-tuning-operator/tuned-jk5fv"
Jun 15 05:48:39.470763 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:48:39.470163    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/5a1f8f83-55db-4fc7-872d-6b202daa0a31-run-ovn\") pod \"ovnkube-node-f4bzh\" (UID: \"5a1f8f83-55db-4fc7-872d-6b202daa0a31\") " pod="openshift-ovn-kubernetes/ovnkube-node-f4bzh"
Jun 15 05:48:39.470763 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:48:39.470166    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kxttp\" (UniqueName: \"kubernetes.io/projected/d81bd047-22fb-452e-b2d2-073f232701c2-kube-api-access-kxttp\") pod \"network-metrics-daemon-cbmww\" (UID: \"d81bd047-22fb-452e-b2d2-073f232701c2\") " pod="openshift-multus/network-metrics-daemon-cbmww"
Jun 15 05:48:39.470763 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:48:39.470192    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/5a1f8f83-55db-4fc7-872d-6b202daa0a31-host-kubelet\") pod \"ovnkube-node-f4bzh\" (UID: \"5a1f8f83-55db-4fc7-872d-6b202daa0a31\") " pod="openshift-ovn-kubernetes/ovnkube-node-f4bzh"
Jun 15 05:48:39.470763 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:48:39.470238    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/5a1f8f83-55db-4fc7-872d-6b202daa0a31-ovnkube-config\") pod \"ovnkube-node-f4bzh\" (UID: \"5a1f8f83-55db-4fc7-872d-6b202daa0a31\") " pod="openshift-ovn-kubernetes/ovnkube-node-f4bzh"
Jun 15 05:48:39.470763 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:48:39.470262    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7a806cb5-1d94-4558-9a7a-a734123af31b-original-pull-secret\") pod \"global-pull-secret-syncer-hpg5s\" (UID: \"7a806cb5-1d94-4558-9a7a-a734123af31b\") " pod="kube-system/global-pull-secret-syncer-hpg5s"
Jun 15 05:48:39.470763 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:48:39.470304    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/5a1f8f83-55db-4fc7-872d-6b202daa0a31-host-kubelet\") pod \"ovnkube-node-f4bzh\" (UID: \"5a1f8f83-55db-4fc7-872d-6b202daa0a31\") " pod="openshift-ovn-kubernetes/ovnkube-node-f4bzh"
Jun 15 05:48:39.471570 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:48:39.470326    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/ed7324e7-cd07-4862-ba38-dfb225591afd-multus-socket-dir-parent\") pod \"multus-6zzmq\" (UID: \"ed7324e7-cd07-4862-ba38-dfb225591afd\") " pod="openshift-multus/multus-6zzmq"
Jun 15 05:48:39.471570 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:48:39.470342    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/ed7324e7-cd07-4862-ba38-dfb225591afd-hostroot\") pod \"multus-6zzmq\" (UID: \"ed7324e7-cd07-4862-ba38-dfb225591afd\") " pod="openshift-multus/multus-6zzmq"
Jun 15 05:48:39.471570 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:48:39.470360    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/0246685c-f9e4-45b0-bb3f-b17957621809-cnibin\") pod \"multus-additional-cni-plugins-c5vrl\" (UID: \"0246685c-f9e4-45b0-bb3f-b17957621809\") " pod="openshift-multus/multus-additional-cni-plugins-c5vrl"
Jun 15 05:48:39.471570 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:48:39.470375    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/5a1f8f83-55db-4fc7-872d-6b202daa0a31-ovn-node-metrics-cert\") pod \"ovnkube-node-f4bzh\" (UID: \"5a1f8f83-55db-4fc7-872d-6b202daa0a31\") " pod="openshift-ovn-kubernetes/ovnkube-node-f4bzh"
Jun 15 05:48:39.471570 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:48:39.470395    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/5a1f8f83-55db-4fc7-872d-6b202daa0a31-ovnkube-script-lib\") pod \"ovnkube-node-f4bzh\" (UID: \"5a1f8f83-55db-4fc7-872d-6b202daa0a31\") " pod="openshift-ovn-kubernetes/ovnkube-node-f4bzh"
Jun 15 05:48:39.471570 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:48:39.470409    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/2bfcdbc6-e206-4efc-8342-4b2a949e9111-lib-modules\") pod \"tuned-jk5fv\" (UID: \"2bfcdbc6-e206-4efc-8342-4b2a949e9111\") " pod="openshift-cluster-node-tuning-operator/tuned-jk5fv"
Jun 15 05:48:39.471570 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:48:39.470424    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/9b076565-1f97-4867-a59b-23315d842e4e-agent-certs\") pod \"konnectivity-agent-xv9fc\" (UID: \"9b076565-1f97-4867-a59b-23315d842e4e\") " pod="kube-system/konnectivity-agent-xv9fc"
Jun 15 05:48:39.471570 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:48:39.470466    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/7a806cb5-1d94-4558-9a7a-a734123af31b-kubelet-config\") pod \"global-pull-secret-syncer-hpg5s\" (UID: \"7a806cb5-1d94-4558-9a7a-a734123af31b\") " pod="kube-system/global-pull-secret-syncer-hpg5s"
Jun 15 05:48:39.471570 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:48:39.470483    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/2bfcdbc6-e206-4efc-8342-4b2a949e9111-etc-systemd\") pod \"tuned-jk5fv\" (UID: \"2bfcdbc6-e206-4efc-8342-4b2a949e9111\") " pod="openshift-cluster-node-tuning-operator/tuned-jk5fv"
Jun 15 05:48:39.471570 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:48:39.470497    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/ed7324e7-cd07-4862-ba38-dfb225591afd-host-run-k8s-cni-cncf-io\") pod \"multus-6zzmq\" (UID: \"ed7324e7-cd07-4862-ba38-dfb225591afd\") " pod="openshift-multus/multus-6zzmq"
Jun 15 05:48:39.471570 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:48:39.470534    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/0246685c-f9e4-45b0-bb3f-b17957621809-tuning-conf-dir\") pod \"multus-additional-cni-plugins-c5vrl\" (UID: \"0246685c-f9e4-45b0-bb3f-b17957621809\") " pod="openshift-multus/multus-additional-cni-plugins-c5vrl"
Jun 15 05:48:39.471570 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:48:39.470550    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jbdmh\" (UniqueName: \"kubernetes.io/projected/0246685c-f9e4-45b0-bb3f-b17957621809-kube-api-access-jbdmh\") pod \"multus-additional-cni-plugins-c5vrl\" (UID: \"0246685c-f9e4-45b0-bb3f-b17957621809\") " pod="openshift-multus/multus-additional-cni-plugins-c5vrl"
Jun 15 05:48:39.471570 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:48:39.470566    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/9decf7bb-f0b0-494e-8d78-52b86faff279-iptables-alerter-script\") pod \"iptables-alerter-srxml\" (UID: \"9decf7bb-f0b0-494e-8d78-52b86faff279\") " pod="openshift-network-operator/iptables-alerter-srxml"
Jun 15 05:48:39.471570 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:48:39.470583    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5a1f8f83-55db-4fc7-872d-6b202daa0a31-host-run-ovn-kubernetes\") pod \"ovnkube-node-f4bzh\" (UID: \"5a1f8f83-55db-4fc7-872d-6b202daa0a31\") " pod="openshift-ovn-kubernetes/ovnkube-node-f4bzh"
Jun 15 05:48:39.471570 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:48:39.470599    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/5a1f8f83-55db-4fc7-872d-6b202daa0a31-host-cni-netd\") pod \"ovnkube-node-f4bzh\" (UID: \"5a1f8f83-55db-4fc7-872d-6b202daa0a31\") " pod="openshift-ovn-kubernetes/ovnkube-node-f4bzh"
Jun 15 05:48:39.471570 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:48:39.470615    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/0246685c-f9e4-45b0-bb3f-b17957621809-system-cni-dir\") pod \"multus-additional-cni-plugins-c5vrl\" (UID: \"0246685c-f9e4-45b0-bb3f-b17957621809\") " pod="openshift-multus/multus-additional-cni-plugins-c5vrl"
Jun 15 05:48:39.471570 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:48:39.470631    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/5a1f8f83-55db-4fc7-872d-6b202daa0a31-host-run-netns\") pod \"ovnkube-node-f4bzh\" (UID: \"5a1f8f83-55db-4fc7-872d-6b202daa0a31\") " pod="openshift-ovn-kubernetes/ovnkube-node-f4bzh"
Jun 15 05:48:39.472382 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:48:39.470645    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/5a1f8f83-55db-4fc7-872d-6b202daa0a31-run-systemd\") pod \"ovnkube-node-f4bzh\" (UID: \"5a1f8f83-55db-4fc7-872d-6b202daa0a31\") " pod="openshift-ovn-kubernetes/ovnkube-node-f4bzh"
Jun 15 05:48:39.472382 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:48:39.470659    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/ed7324e7-cd07-4862-ba38-dfb225591afd-host-var-lib-cni-multus\") pod \"multus-6zzmq\" (UID: \"ed7324e7-cd07-4862-ba38-dfb225591afd\") " pod="openshift-multus/multus-6zzmq"
Jun 15 05:48:39.472382 ip-10-0-128-243 kubenswrapper[2566]: E0615 05:48:39.470373    2566 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jun 15 05:48:39.472382 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:48:39.470737    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/5a1f8f83-55db-4fc7-872d-6b202daa0a31-ovnkube-config\") pod \"ovnkube-node-f4bzh\" (UID: \"5a1f8f83-55db-4fc7-872d-6b202daa0a31\") " pod="openshift-ovn-kubernetes/ovnkube-node-f4bzh"
Jun 15 05:48:39.472382 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:48:39.470713    2566 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Jun 15 05:48:39.472382 ip-10-0-128-243 kubenswrapper[2566]: E0615 05:48:39.470772    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7a806cb5-1d94-4558-9a7a-a734123af31b-original-pull-secret podName:7a806cb5-1d94-4558-9a7a-a734123af31b nodeName:}" failed. No retries permitted until 2026-06-15 05:48:39.970716043 +0000 UTC m=+2.930473266 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/7a806cb5-1d94-4558-9a7a-a734123af31b-original-pull-secret") pod "global-pull-secret-syncer-hpg5s" (UID: "7a806cb5-1d94-4558-9a7a-a734123af31b") : object "kube-system"/"original-pull-secret" not registered
Jun 15 05:48:39.472382 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:48:39.470780    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/0246685c-f9e4-45b0-bb3f-b17957621809-tuning-conf-dir\") pod \"multus-additional-cni-plugins-c5vrl\" (UID: \"0246685c-f9e4-45b0-bb3f-b17957621809\") " pod="openshift-multus/multus-additional-cni-plugins-c5vrl"
Jun 15 05:48:39.472382 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:48:39.470798    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/0246685c-f9e4-45b0-bb3f-b17957621809-cnibin\") pod \"multus-additional-cni-plugins-c5vrl\" (UID: \"0246685c-f9e4-45b0-bb3f-b17957621809\") " pod="openshift-multus/multus-additional-cni-plugins-c5vrl"
Jun 15 05:48:39.472382 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:48:39.470818    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/7a806cb5-1d94-4558-9a7a-a734123af31b-kubelet-config\") pod \"global-pull-secret-syncer-hpg5s\" (UID: \"7a806cb5-1d94-4558-9a7a-a734123af31b\") " pod="kube-system/global-pull-secret-syncer-hpg5s"
Jun 15 05:48:39.472382 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:48:39.470674    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/ed7324e7-cd07-4862-ba38-dfb225591afd-host-run-multus-certs\") pod \"multus-6zzmq\" (UID: \"ed7324e7-cd07-4862-ba38-dfb225591afd\") " pod="openshift-multus/multus-6zzmq"
Jun 15 05:48:39.472382 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:48:39.470850    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6djqr\" (UniqueName: \"kubernetes.io/projected/c1ebb64e-4a47-4507-b619-32502fb528ca-kube-api-access-6djqr\") pod \"node-resolver-n8bz5\" (UID: \"c1ebb64e-4a47-4507-b619-32502fb528ca\") " pod="openshift-dns/node-resolver-n8bz5"
Jun 15 05:48:39.472382 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:48:39.470865    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/9b076565-1f97-4867-a59b-23315d842e4e-konnectivity-ca\") pod \"konnectivity-agent-xv9fc\" (UID: \"9b076565-1f97-4867-a59b-23315d842e4e\") " pod="kube-system/konnectivity-agent-xv9fc"
Jun 15 05:48:39.472382 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:48:39.470885    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/0246685c-f9e4-45b0-bb3f-b17957621809-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-c5vrl\" (UID: \"0246685c-f9e4-45b0-bb3f-b17957621809\") " pod="openshift-multus/multus-additional-cni-plugins-c5vrl"
Jun 15 05:48:39.472382 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:48:39.470901    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7nljk\" (UniqueName: \"kubernetes.io/projected/9decf7bb-f0b0-494e-8d78-52b86faff279-kube-api-access-7nljk\") pod \"iptables-alerter-srxml\" (UID: \"9decf7bb-f0b0-494e-8d78-52b86faff279\") " pod="openshift-network-operator/iptables-alerter-srxml"
Jun 15 05:48:39.472382 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:48:39.470916    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/2bfcdbc6-e206-4efc-8342-4b2a949e9111-etc-sysconfig\") pod \"tuned-jk5fv\" (UID: \"2bfcdbc6-e206-4efc-8342-4b2a949e9111\") " pod="openshift-cluster-node-tuning-operator/tuned-jk5fv"
Jun 15 05:48:39.472382 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:48:39.470940    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ed7324e7-cd07-4862-ba38-dfb225591afd-system-cni-dir\") pod \"multus-6zzmq\" (UID: \"ed7324e7-cd07-4862-ba38-dfb225591afd\") " pod="openshift-multus/multus-6zzmq"
Jun 15 05:48:39.472382 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:48:39.470956    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ed7324e7-cd07-4862-ba38-dfb225591afd-multus-cni-dir\") pod \"multus-6zzmq\" (UID: \"ed7324e7-cd07-4862-ba38-dfb225591afd\") " pod="openshift-multus/multus-6zzmq"
Jun 15 05:48:39.473188 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:48:39.470970    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/ed7324e7-cd07-4862-ba38-dfb225591afd-os-release\") pod \"multus-6zzmq\" (UID: \"ed7324e7-cd07-4862-ba38-dfb225591afd\") " pod="openshift-multus/multus-6zzmq"
Jun 15 05:48:39.473188 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:48:39.470974    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/5a1f8f83-55db-4fc7-872d-6b202daa0a31-host-cni-netd\") pod \"ovnkube-node-f4bzh\" (UID: \"5a1f8f83-55db-4fc7-872d-6b202daa0a31\") " pod="openshift-ovn-kubernetes/ovnkube-node-f4bzh"
Jun 15 05:48:39.473188 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:48:39.470984    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/d0cff6b1-26d2-4059-a556-347772ca0557-kubelet-dir\") pod \"aws-ebs-csi-driver-node-pwcsh\" (UID: \"d0cff6b1-26d2-4059-a556-347772ca0557\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pwcsh"
Jun 15 05:48:39.473188 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:48:39.471011    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/d0cff6b1-26d2-4059-a556-347772ca0557-device-dir\") pod \"aws-ebs-csi-driver-node-pwcsh\" (UID: \"d0cff6b1-26d2-4059-a556-347772ca0557\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pwcsh"
Jun 15 05:48:39.473188 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:48:39.471027    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/5a1f8f83-55db-4fc7-872d-6b202daa0a31-host-slash\") pod \"ovnkube-node-f4bzh\" (UID: \"5a1f8f83-55db-4fc7-872d-6b202daa0a31\") " pod="openshift-ovn-kubernetes/ovnkube-node-f4bzh"
Jun 15 05:48:39.473188 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:48:39.471043    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5a1f8f83-55db-4fc7-872d-6b202daa0a31-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-f4bzh\" (UID: \"5a1f8f83-55db-4fc7-872d-6b202daa0a31\") " pod="openshift-ovn-kubernetes/ovnkube-node-f4bzh"
Jun 15 05:48:39.473188 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:48:39.471061    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g8vjr\" (UniqueName: \"kubernetes.io/projected/2bfcdbc6-e206-4efc-8342-4b2a949e9111-kube-api-access-g8vjr\") pod \"tuned-jk5fv\" (UID: \"2bfcdbc6-e206-4efc-8342-4b2a949e9111\") " pod="openshift-cluster-node-tuning-operator/tuned-jk5fv"
Jun 15 05:48:39.473188 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:48:39.471076    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/d0cff6b1-26d2-4059-a556-347772ca0557-sys-fs\") pod \"aws-ebs-csi-driver-node-pwcsh\" (UID: \"d0cff6b1-26d2-4059-a556-347772ca0557\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pwcsh"
Jun 15 05:48:39.473188 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:48:39.471112    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/2e630a88-8b65-4dd7-970d-cfd8e5d031c6-serviceca\") pod \"node-ca-frzbm\" (UID: \"2e630a88-8b65-4dd7-970d-cfd8e5d031c6\") " pod="openshift-image-registry/node-ca-frzbm"
Jun 15 05:48:39.473188 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:48:39.471126    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/d0cff6b1-26d2-4059-a556-347772ca0557-socket-dir\") pod \"aws-ebs-csi-driver-node-pwcsh\" (UID: \"d0cff6b1-26d2-4059-a556-347772ca0557\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pwcsh"
Jun 15 05:48:39.473188 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:48:39.471153    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/d0cff6b1-26d2-4059-a556-347772ca0557-registration-dir\") pod \"aws-ebs-csi-driver-node-pwcsh\" (UID: \"d0cff6b1-26d2-4059-a556-347772ca0557\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pwcsh"
Jun 15 05:48:39.473188 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:48:39.471166    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/0246685c-f9e4-45b0-bb3f-b17957621809-system-cni-dir\") pod \"multus-additional-cni-plugins-c5vrl\" (UID: \"0246685c-f9e4-45b0-bb3f-b17957621809\") " pod="openshift-multus/multus-additional-cni-plugins-c5vrl"
Jun 15 05:48:39.473188 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:48:39.470955    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5a1f8f83-55db-4fc7-872d-6b202daa0a31-host-run-ovn-kubernetes\") pod \"ovnkube-node-f4bzh\" (UID: \"5a1f8f83-55db-4fc7-872d-6b202daa0a31\") " pod="openshift-ovn-kubernetes/ovnkube-node-f4bzh"
Jun 15 05:48:39.473188 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:48:39.471174    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/5a1f8f83-55db-4fc7-872d-6b202daa0a31-ovnkube-script-lib\") pod \"ovnkube-node-f4bzh\" (UID: \"5a1f8f83-55db-4fc7-872d-6b202daa0a31\") " pod="openshift-ovn-kubernetes/ovnkube-node-f4bzh"
Jun 15 05:48:39.473188 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:48:39.471224    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d81bd047-22fb-452e-b2d2-073f232701c2-metrics-certs\") pod \"network-metrics-daemon-cbmww\" (UID: \"d81bd047-22fb-452e-b2d2-073f232701c2\") " pod="openshift-multus/network-metrics-daemon-cbmww"
Jun 15 05:48:39.473188 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:48:39.471257    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/9decf7bb-f0b0-494e-8d78-52b86faff279-host-slash\") pod \"iptables-alerter-srxml\" (UID: \"9decf7bb-f0b0-494e-8d78-52b86faff279\") " pod="openshift-network-operator/iptables-alerter-srxml"
Jun 15 05:48:39.473944 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:48:39.471284    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/2bfcdbc6-e206-4efc-8342-4b2a949e9111-run\") pod \"tuned-jk5fv\" (UID: \"2bfcdbc6-e206-4efc-8342-4b2a949e9111\") " pod="openshift-cluster-node-tuning-operator/tuned-jk5fv"
Jun 15 05:48:39.473944 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:48:39.471285    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/5a1f8f83-55db-4fc7-872d-6b202daa0a31-host-slash\") pod \"ovnkube-node-f4bzh\" (UID: \"5a1f8f83-55db-4fc7-872d-6b202daa0a31\") " pod="openshift-ovn-kubernetes/ovnkube-node-f4bzh"
Jun 15 05:48:39.473944 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:48:39.471212    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/5a1f8f83-55db-4fc7-872d-6b202daa0a31-host-run-netns\") pod \"ovnkube-node-f4bzh\" (UID: \"5a1f8f83-55db-4fc7-872d-6b202daa0a31\") " pod="openshift-ovn-kubernetes/ovnkube-node-f4bzh"
Jun 15 05:48:39.473944 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:48:39.471329    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/5a1f8f83-55db-4fc7-872d-6b202daa0a31-run-systemd\") pod \"ovnkube-node-f4bzh\" (UID: \"5a1f8f83-55db-4fc7-872d-6b202daa0a31\") " pod="openshift-ovn-kubernetes/ovnkube-node-f4bzh"
Jun 15 05:48:39.473944 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:48:39.471344    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/ed7324e7-cd07-4862-ba38-dfb225591afd-multus-daemon-config\") pod \"multus-6zzmq\" (UID: \"ed7324e7-cd07-4862-ba38-dfb225591afd\") " pod="openshift-multus/multus-6zzmq"
Jun 15 05:48:39.473944 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:48:39.471366    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/c1ebb64e-4a47-4507-b619-32502fb528ca-hosts-file\") pod \"node-resolver-n8bz5\" (UID: \"c1ebb64e-4a47-4507-b619-32502fb528ca\") " pod="openshift-dns/node-resolver-n8bz5"
Jun 15 05:48:39.473944 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:48:39.471382    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5a1f8f83-55db-4fc7-872d-6b202daa0a31-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-f4bzh\" (UID: \"5a1f8f83-55db-4fc7-872d-6b202daa0a31\") " pod="openshift-ovn-kubernetes/ovnkube-node-f4bzh"
Jun 15 05:48:39.473944 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:48:39.471387    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kb9g4\" (UniqueName: \"kubernetes.io/projected/d0cff6b1-26d2-4059-a556-347772ca0557-kube-api-access-kb9g4\") pod \"aws-ebs-csi-driver-node-pwcsh\" (UID: \"d0cff6b1-26d2-4059-a556-347772ca0557\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pwcsh"
Jun 15 05:48:39.473944 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:48:39.471425    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/0246685c-f9e4-45b0-bb3f-b17957621809-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-c5vrl\" (UID: \"0246685c-f9e4-45b0-bb3f-b17957621809\") " pod="openshift-multus/multus-additional-cni-plugins-c5vrl"
Jun 15 05:48:39.473944 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:48:39.471469    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nc9t7\" (UniqueName: \"kubernetes.io/projected/7fb5709e-946d-4dc2-ac4f-72986f9adcdc-kube-api-access-nc9t7\") pod \"network-check-target-gbdt4\" (UID: \"7fb5709e-946d-4dc2-ac4f-72986f9adcdc\") " pod="openshift-network-diagnostics/network-check-target-gbdt4"
Jun 15 05:48:39.473944 ip-10-0-128-243 kubenswrapper[2566]: E0615 05:48:39.471477    2566 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jun 15 05:48:39.473944 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:48:39.471515    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/5a1f8f83-55db-4fc7-872d-6b202daa0a31-env-overrides\") pod \"ovnkube-node-f4bzh\" (UID: \"5a1f8f83-55db-4fc7-872d-6b202daa0a31\") " pod="openshift-ovn-kubernetes/ovnkube-node-f4bzh"
Jun 15 05:48:39.473944 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:48:39.471532    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f9dhk\" (UniqueName: \"kubernetes.io/projected/2e630a88-8b65-4dd7-970d-cfd8e5d031c6-kube-api-access-f9dhk\") pod \"node-ca-frzbm\" (UID: \"2e630a88-8b65-4dd7-970d-cfd8e5d031c6\") " pod="openshift-image-registry/node-ca-frzbm"
Jun 15 05:48:39.473944 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:48:39.471553    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/2e630a88-8b65-4dd7-970d-cfd8e5d031c6-serviceca\") pod \"node-ca-frzbm\" (UID: \"2e630a88-8b65-4dd7-970d-cfd8e5d031c6\") " pod="openshift-image-registry/node-ca-frzbm"
Jun 15 05:48:39.473944 ip-10-0-128-243 kubenswrapper[2566]: E0615 05:48:39.471878    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d81bd047-22fb-452e-b2d2-073f232701c2-metrics-certs podName:d81bd047-22fb-452e-b2d2-073f232701c2 nodeName:}" failed. No retries permitted until 2026-06-15 05:48:39.971865973 +0000 UTC m=+2.931623196 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d81bd047-22fb-452e-b2d2-073f232701c2-metrics-certs") pod "network-metrics-daemon-cbmww" (UID: "d81bd047-22fb-452e-b2d2-073f232701c2") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jun 15 05:48:39.473944 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:48:39.471899    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/0246685c-f9e4-45b0-bb3f-b17957621809-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-c5vrl\" (UID: \"0246685c-f9e4-45b0-bb3f-b17957621809\") " pod="openshift-multus/multus-additional-cni-plugins-c5vrl"
Jun 15 05:48:39.474756 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:48:39.472138    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/0246685c-f9e4-45b0-bb3f-b17957621809-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-c5vrl\" (UID: \"0246685c-f9e4-45b0-bb3f-b17957621809\") " pod="openshift-multus/multus-additional-cni-plugins-c5vrl"
Jun 15 05:48:39.474756 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:48:39.472254    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/5a1f8f83-55db-4fc7-872d-6b202daa0a31-env-overrides\") pod \"ovnkube-node-f4bzh\" (UID: \"5a1f8f83-55db-4fc7-872d-6b202daa0a31\") " pod="openshift-ovn-kubernetes/ovnkube-node-f4bzh"
Jun 15 05:48:39.474756 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:48:39.474188    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/5a1f8f83-55db-4fc7-872d-6b202daa0a31-ovn-node-metrics-cert\") pod \"ovnkube-node-f4bzh\" (UID: \"5a1f8f83-55db-4fc7-872d-6b202daa0a31\") " pod="openshift-ovn-kubernetes/ovnkube-node-f4bzh"
Jun 15 05:48:39.490162 ip-10-0-128-243 kubenswrapper[2566]: E0615 05:48:39.490139    2566 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jun 15 05:48:39.490275 ip-10-0-128-243 kubenswrapper[2566]: E0615 05:48:39.490165    2566 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jun 15 05:48:39.490275 ip-10-0-128-243 kubenswrapper[2566]: E0615 05:48:39.490177    2566 projected.go:196] Error preparing data for projected volume kube-api-access-nc9t7 for pod openshift-network-diagnostics/network-check-target-gbdt4: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jun 15 05:48:39.490275 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:48:39.490203    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jbdmh\" (UniqueName: \"kubernetes.io/projected/0246685c-f9e4-45b0-bb3f-b17957621809-kube-api-access-jbdmh\") pod \"multus-additional-cni-plugins-c5vrl\" (UID: \"0246685c-f9e4-45b0-bb3f-b17957621809\") " pod="openshift-multus/multus-additional-cni-plugins-c5vrl"
Jun 15 05:48:39.490275 ip-10-0-128-243 kubenswrapper[2566]: E0615 05:48:39.490232    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/7fb5709e-946d-4dc2-ac4f-72986f9adcdc-kube-api-access-nc9t7 podName:7fb5709e-946d-4dc2-ac4f-72986f9adcdc nodeName:}" failed. No retries permitted until 2026-06-15 05:48:39.990215812 +0000 UTC m=+2.949973051 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-nc9t7" (UniqueName: "kubernetes.io/projected/7fb5709e-946d-4dc2-ac4f-72986f9adcdc-kube-api-access-nc9t7") pod "network-check-target-gbdt4" (UID: "7fb5709e-946d-4dc2-ac4f-72986f9adcdc") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jun 15 05:48:39.493138 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:48:39.492658    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ghvxz\" (UniqueName: \"kubernetes.io/projected/5a1f8f83-55db-4fc7-872d-6b202daa0a31-kube-api-access-ghvxz\") pod \"ovnkube-node-f4bzh\" (UID: \"5a1f8f83-55db-4fc7-872d-6b202daa0a31\") " pod="openshift-ovn-kubernetes/ovnkube-node-f4bzh"
Jun 15 05:48:39.494636 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:48:39.494555    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kxttp\" (UniqueName: \"kubernetes.io/projected/d81bd047-22fb-452e-b2d2-073f232701c2-kube-api-access-kxttp\") pod \"network-metrics-daemon-cbmww\" (UID: \"d81bd047-22fb-452e-b2d2-073f232701c2\") " pod="openshift-multus/network-metrics-daemon-cbmww"
Jun 15 05:48:39.494636 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:48:39.494597    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-f9dhk\" (UniqueName: \"kubernetes.io/projected/2e630a88-8b65-4dd7-970d-cfd8e5d031c6-kube-api-access-f9dhk\") pod \"node-ca-frzbm\" (UID: \"2e630a88-8b65-4dd7-970d-cfd8e5d031c6\") " pod="openshift-image-registry/node-ca-frzbm"
Jun 15 05:48:39.535021 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:48:39.534991    2566 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jun 15 05:48:39.571831 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:48:39.571801    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2bfcdbc6-e206-4efc-8342-4b2a949e9111-tmp\") pod \"tuned-jk5fv\" (UID: \"2bfcdbc6-e206-4efc-8342-4b2a949e9111\") " pod="openshift-cluster-node-tuning-operator/tuned-jk5fv"
Jun 15 05:48:39.571980 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:48:39.571841    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/2bfcdbc6-e206-4efc-8342-4b2a949e9111-etc-modprobe-d\") pod \"tuned-jk5fv\" (UID: \"2bfcdbc6-e206-4efc-8342-4b2a949e9111\") " pod="openshift-cluster-node-tuning-operator/tuned-jk5fv"
Jun 15 05:48:39.571980 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:48:39.571869    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/2bfcdbc6-e206-4efc-8342-4b2a949e9111-etc-tuned\") pod \"tuned-jk5fv\" (UID: \"2bfcdbc6-e206-4efc-8342-4b2a949e9111\") " pod="openshift-cluster-node-tuning-operator/tuned-jk5fv"
Jun 15 05:48:39.571980 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:48:39.571884    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ed7324e7-cd07-4862-ba38-dfb225591afd-etc-kubernetes\") pod \"multus-6zzmq\" (UID: \"ed7324e7-cd07-4862-ba38-dfb225591afd\") " pod="openshift-multus/multus-6zzmq"
Jun 15 05:48:39.571980 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:48:39.571900    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kb8s6\" (UniqueName: \"kubernetes.io/projected/ed7324e7-cd07-4862-ba38-dfb225591afd-kube-api-access-kb8s6\") pod \"multus-6zzmq\" (UID: \"ed7324e7-cd07-4862-ba38-dfb225591afd\") " pod="openshift-multus/multus-6zzmq"
Jun 15 05:48:39.571980 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:48:39.571956    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ed7324e7-cd07-4862-ba38-dfb225591afd-etc-kubernetes\") pod \"multus-6zzmq\" (UID: \"ed7324e7-cd07-4862-ba38-dfb225591afd\") " pod="openshift-multus/multus-6zzmq"
Jun 15 05:48:39.572168 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:48:39.572003    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c1ebb64e-4a47-4507-b619-32502fb528ca-tmp-dir\") pod \"node-resolver-n8bz5\" (UID: \"c1ebb64e-4a47-4507-b619-32502fb528ca\") " pod="openshift-dns/node-resolver-n8bz5"
Jun 15 05:48:39.572168 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:48:39.572006    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/2bfcdbc6-e206-4efc-8342-4b2a949e9111-etc-modprobe-d\") pod \"tuned-jk5fv\" (UID: \"2bfcdbc6-e206-4efc-8342-4b2a949e9111\") " pod="openshift-cluster-node-tuning-operator/tuned-jk5fv"
Jun 15 05:48:39.572168 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:48:39.572028    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/d0cff6b1-26d2-4059-a556-347772ca0557-etc-selinux\") pod \"aws-ebs-csi-driver-node-pwcsh\" (UID: \"d0cff6b1-26d2-4059-a556-347772ca0557\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pwcsh"
Jun 15 05:48:39.572168 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:48:39.572054    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2bfcdbc6-e206-4efc-8342-4b2a949e9111-etc-kubernetes\") pod \"tuned-jk5fv\" (UID: \"2bfcdbc6-e206-4efc-8342-4b2a949e9111\") " pod="openshift-cluster-node-tuning-operator/tuned-jk5fv"
Jun 15 05:48:39.572168 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:48:39.572074    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/2bfcdbc6-e206-4efc-8342-4b2a949e9111-etc-sysctl-conf\") pod \"tuned-jk5fv\" (UID: \"2bfcdbc6-e206-4efc-8342-4b2a949e9111\") " pod="openshift-cluster-node-tuning-operator/tuned-jk5fv"
Jun 15 05:48:39.572168 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:48:39.572111    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/2bfcdbc6-e206-4efc-8342-4b2a949e9111-host\") pod \"tuned-jk5fv\" (UID: \"2bfcdbc6-e206-4efc-8342-4b2a949e9111\") " pod="openshift-cluster-node-tuning-operator/tuned-jk5fv"
Jun 15 05:48:39.572168 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:48:39.572159    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/ed7324e7-cd07-4862-ba38-dfb225591afd-multus-socket-dir-parent\") pod \"multus-6zzmq\" (UID: \"ed7324e7-cd07-4862-ba38-dfb225591afd\") " pod="openshift-multus/multus-6zzmq"
Jun 15 05:48:39.572481 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:48:39.572183    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/ed7324e7-cd07-4862-ba38-dfb225591afd-hostroot\") pod \"multus-6zzmq\" (UID: \"ed7324e7-cd07-4862-ba38-dfb225591afd\") " pod="openshift-multus/multus-6zzmq"
Jun 15 05:48:39.572481 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:48:39.572215    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/2bfcdbc6-e206-4efc-8342-4b2a949e9111-lib-modules\") pod \"tuned-jk5fv\" (UID: \"2bfcdbc6-e206-4efc-8342-4b2a949e9111\") " pod="openshift-cluster-node-tuning-operator/tuned-jk5fv"
Jun 15 05:48:39.572481 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:48:39.572229    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/d0cff6b1-26d2-4059-a556-347772ca0557-etc-selinux\") pod \"aws-ebs-csi-driver-node-pwcsh\" (UID: \"d0cff6b1-26d2-4059-a556-347772ca0557\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pwcsh"
Jun 15 05:48:39.572481 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:48:39.572279    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/ed7324e7-cd07-4862-ba38-dfb225591afd-multus-socket-dir-parent\") pod \"multus-6zzmq\" (UID: \"ed7324e7-cd07-4862-ba38-dfb225591afd\") " pod="openshift-multus/multus-6zzmq"
Jun 15 05:48:39.572481 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:48:39.572310    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c1ebb64e-4a47-4507-b619-32502fb528ca-tmp-dir\") pod \"node-resolver-n8bz5\" (UID: \"c1ebb64e-4a47-4507-b619-32502fb528ca\") " pod="openshift-dns/node-resolver-n8bz5"
Jun 15 05:48:39.572481 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:48:39.572324    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/9b076565-1f97-4867-a59b-23315d842e4e-agent-certs\") pod \"konnectivity-agent-xv9fc\" (UID: \"9b076565-1f97-4867-a59b-23315d842e4e\") " pod="kube-system/konnectivity-agent-xv9fc"
Jun 15 05:48:39.572481 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:48:39.572329    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/2bfcdbc6-e206-4efc-8342-4b2a949e9111-lib-modules\") pod \"tuned-jk5fv\" (UID: \"2bfcdbc6-e206-4efc-8342-4b2a949e9111\") " pod="openshift-cluster-node-tuning-operator/tuned-jk5fv"
Jun 15 05:48:39.572481 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:48:39.572163    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2bfcdbc6-e206-4efc-8342-4b2a949e9111-etc-kubernetes\") pod \"tuned-jk5fv\" (UID: \"2bfcdbc6-e206-4efc-8342-4b2a949e9111\") " pod="openshift-cluster-node-tuning-operator/tuned-jk5fv"
Jun 15 05:48:39.572481 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:48:39.572354    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/2bfcdbc6-e206-4efc-8342-4b2a949e9111-etc-sysctl-conf\") pod \"tuned-jk5fv\" (UID: \"2bfcdbc6-e206-4efc-8342-4b2a949e9111\") " pod="openshift-cluster-node-tuning-operator/tuned-jk5fv"
Jun 15 05:48:39.572481 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:48:39.572358    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/2bfcdbc6-e206-4efc-8342-4b2a949e9111-etc-systemd\") pod \"tuned-jk5fv\" (UID: \"2bfcdbc6-e206-4efc-8342-4b2a949e9111\") " pod="openshift-cluster-node-tuning-operator/tuned-jk5fv"
Jun 15 05:48:39.572481 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:48:39.572384    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/ed7324e7-cd07-4862-ba38-dfb225591afd-hostroot\") pod \"multus-6zzmq\" (UID: \"ed7324e7-cd07-4862-ba38-dfb225591afd\") " pod="openshift-multus/multus-6zzmq"
Jun 15 05:48:39.572481 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:48:39.572405    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/2bfcdbc6-e206-4efc-8342-4b2a949e9111-host\") pod \"tuned-jk5fv\" (UID: \"2bfcdbc6-e206-4efc-8342-4b2a949e9111\") " pod="openshift-cluster-node-tuning-operator/tuned-jk5fv"
Jun 15 05:48:39.572481 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:48:39.572411    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/2bfcdbc6-e206-4efc-8342-4b2a949e9111-etc-systemd\") pod \"tuned-jk5fv\" (UID: \"2bfcdbc6-e206-4efc-8342-4b2a949e9111\") " pod="openshift-cluster-node-tuning-operator/tuned-jk5fv"
Jun 15 05:48:39.572481 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:48:39.572441    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/ed7324e7-cd07-4862-ba38-dfb225591afd-host-run-k8s-cni-cncf-io\") pod \"multus-6zzmq\" (UID: \"ed7324e7-cd07-4862-ba38-dfb225591afd\") " pod="openshift-multus/multus-6zzmq"
Jun 15 05:48:39.572481 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:48:39.572469    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/9decf7bb-f0b0-494e-8d78-52b86faff279-iptables-alerter-script\") pod \"iptables-alerter-srxml\" (UID: \"9decf7bb-f0b0-494e-8d78-52b86faff279\") " pod="openshift-network-operator/iptables-alerter-srxml"
Jun 15 05:48:39.573272 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:48:39.572496    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/ed7324e7-cd07-4862-ba38-dfb225591afd-host-var-lib-cni-multus\") pod \"multus-6zzmq\" (UID: \"ed7324e7-cd07-4862-ba38-dfb225591afd\") " pod="openshift-multus/multus-6zzmq"
Jun 15 05:48:39.573272 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:48:39.572520    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/ed7324e7-cd07-4862-ba38-dfb225591afd-host-run-multus-certs\") pod \"multus-6zzmq\" (UID: \"ed7324e7-cd07-4862-ba38-dfb225591afd\") " pod="openshift-multus/multus-6zzmq"
Jun 15 05:48:39.573272 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:48:39.572546    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6djqr\" (UniqueName: \"kubernetes.io/projected/c1ebb64e-4a47-4507-b619-32502fb528ca-kube-api-access-6djqr\") pod \"node-resolver-n8bz5\" (UID: \"c1ebb64e-4a47-4507-b619-32502fb528ca\") " pod="openshift-dns/node-resolver-n8bz5"
Jun 15 05:48:39.573272 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:48:39.572572    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/9b076565-1f97-4867-a59b-23315d842e4e-konnectivity-ca\") pod \"konnectivity-agent-xv9fc\" (UID: \"9b076565-1f97-4867-a59b-23315d842e4e\") " pod="kube-system/konnectivity-agent-xv9fc"
Jun 15 05:48:39.573272 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:48:39.572571    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/ed7324e7-cd07-4862-ba38-dfb225591afd-host-var-lib-cni-multus\") pod \"multus-6zzmq\" (UID: \"ed7324e7-cd07-4862-ba38-dfb225591afd\") " pod="openshift-multus/multus-6zzmq"
Jun 15 05:48:39.573272 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:48:39.572591    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/ed7324e7-cd07-4862-ba38-dfb225591afd-host-run-multus-certs\") pod \"multus-6zzmq\" (UID: \"ed7324e7-cd07-4862-ba38-dfb225591afd\") " pod="openshift-multus/multus-6zzmq"
Jun 15 05:48:39.573272 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:48:39.572498    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/ed7324e7-cd07-4862-ba38-dfb225591afd-host-run-k8s-cni-cncf-io\") pod \"multus-6zzmq\" (UID: \"ed7324e7-cd07-4862-ba38-dfb225591afd\") " pod="openshift-multus/multus-6zzmq"
Jun 15 05:48:39.573272 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:48:39.572596    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7nljk\" (UniqueName: \"kubernetes.io/projected/9decf7bb-f0b0-494e-8d78-52b86faff279-kube-api-access-7nljk\") pod \"iptables-alerter-srxml\" (UID: \"9decf7bb-f0b0-494e-8d78-52b86faff279\") " pod="openshift-network-operator/iptables-alerter-srxml"
Jun 15 05:48:39.573272 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:48:39.572733    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/2bfcdbc6-e206-4efc-8342-4b2a949e9111-etc-sysconfig\") pod \"tuned-jk5fv\" (UID: \"2bfcdbc6-e206-4efc-8342-4b2a949e9111\") " pod="openshift-cluster-node-tuning-operator/tuned-jk5fv"
Jun 15 05:48:39.573272 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:48:39.572832    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ed7324e7-cd07-4862-ba38-dfb225591afd-system-cni-dir\") pod \"multus-6zzmq\" (UID: \"ed7324e7-cd07-4862-ba38-dfb225591afd\") " pod="openshift-multus/multus-6zzmq"
Jun 15 05:48:39.573272 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:48:39.572854    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ed7324e7-cd07-4862-ba38-dfb225591afd-multus-cni-dir\") pod \"multus-6zzmq\" (UID: \"ed7324e7-cd07-4862-ba38-dfb225591afd\") " pod="openshift-multus/multus-6zzmq"
Jun 15 05:48:39.573272 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:48:39.572877    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/ed7324e7-cd07-4862-ba38-dfb225591afd-os-release\") pod \"multus-6zzmq\" (UID: \"ed7324e7-cd07-4862-ba38-dfb225591afd\") " pod="openshift-multus/multus-6zzmq"
Jun 15 05:48:39.573272 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:48:39.572900    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/d0cff6b1-26d2-4059-a556-347772ca0557-kubelet-dir\") pod \"aws-ebs-csi-driver-node-pwcsh\" (UID: \"d0cff6b1-26d2-4059-a556-347772ca0557\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pwcsh"
Jun 15 05:48:39.573272 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:48:39.572925    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/d0cff6b1-26d2-4059-a556-347772ca0557-device-dir\") pod \"aws-ebs-csi-driver-node-pwcsh\" (UID: \"d0cff6b1-26d2-4059-a556-347772ca0557\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pwcsh"
Jun 15 05:48:39.573272 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:48:39.572952    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g8vjr\" (UniqueName: \"kubernetes.io/projected/2bfcdbc6-e206-4efc-8342-4b2a949e9111-kube-api-access-g8vjr\") pod \"tuned-jk5fv\" (UID: \"2bfcdbc6-e206-4efc-8342-4b2a949e9111\") " pod="openshift-cluster-node-tuning-operator/tuned-jk5fv"
Jun 15 05:48:39.573272 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:48:39.572976    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/d0cff6b1-26d2-4059-a556-347772ca0557-sys-fs\") pod \"aws-ebs-csi-driver-node-pwcsh\" (UID: \"d0cff6b1-26d2-4059-a556-347772ca0557\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pwcsh"
Jun 15 05:48:39.573272 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:48:39.573002    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/d0cff6b1-26d2-4059-a556-347772ca0557-socket-dir\") pod \"aws-ebs-csi-driver-node-pwcsh\" (UID: \"d0cff6b1-26d2-4059-a556-347772ca0557\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pwcsh"
Jun 15 05:48:39.573907 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:48:39.573025    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/d0cff6b1-26d2-4059-a556-347772ca0557-registration-dir\") pod \"aws-ebs-csi-driver-node-pwcsh\" (UID: \"d0cff6b1-26d2-4059-a556-347772ca0557\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pwcsh"
Jun 15 05:48:39.573907 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:48:39.573061    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/9decf7bb-f0b0-494e-8d78-52b86faff279-host-slash\") pod \"iptables-alerter-srxml\" (UID: \"9decf7bb-f0b0-494e-8d78-52b86faff279\") " pod="openshift-network-operator/iptables-alerter-srxml"
Jun 15 05:48:39.573907 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:48:39.573053    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/9decf7bb-f0b0-494e-8d78-52b86faff279-iptables-alerter-script\") pod \"iptables-alerter-srxml\" (UID: \"9decf7bb-f0b0-494e-8d78-52b86faff279\") " pod="openshift-network-operator/iptables-alerter-srxml"
Jun 15 05:48:39.573907 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:48:39.573106    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/2bfcdbc6-e206-4efc-8342-4b2a949e9111-run\") pod \"tuned-jk5fv\" (UID: \"2bfcdbc6-e206-4efc-8342-4b2a949e9111\") " pod="openshift-cluster-node-tuning-operator/tuned-jk5fv"
Jun 15 05:48:39.573907 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:48:39.573125    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/d0cff6b1-26d2-4059-a556-347772ca0557-kubelet-dir\") pod \"aws-ebs-csi-driver-node-pwcsh\" (UID: \"d0cff6b1-26d2-4059-a556-347772ca0557\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pwcsh"
Jun 15 05:48:39.573907 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:48:39.573132    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/ed7324e7-cd07-4862-ba38-dfb225591afd-multus-daemon-config\") pod \"multus-6zzmq\" (UID: \"ed7324e7-cd07-4862-ba38-dfb225591afd\") " pod="openshift-multus/multus-6zzmq"
Jun 15 05:48:39.573907 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:48:39.573156    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/c1ebb64e-4a47-4507-b619-32502fb528ca-hosts-file\") pod \"node-resolver-n8bz5\" (UID: \"c1ebb64e-4a47-4507-b619-32502fb528ca\") " pod="openshift-dns/node-resolver-n8bz5"
Jun 15 05:48:39.573907 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:48:39.573167    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/9b076565-1f97-4867-a59b-23315d842e4e-konnectivity-ca\") pod \"konnectivity-agent-xv9fc\" (UID: \"9b076565-1f97-4867-a59b-23315d842e4e\") " pod="kube-system/konnectivity-agent-xv9fc"
Jun 15 05:48:39.573907 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:48:39.573181    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/d0cff6b1-26d2-4059-a556-347772ca0557-device-dir\") pod \"aws-ebs-csi-driver-node-pwcsh\" (UID: \"d0cff6b1-26d2-4059-a556-347772ca0557\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pwcsh"
Jun 15 05:48:39.573907 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:48:39.573183    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kb9g4\" (UniqueName: \"kubernetes.io/projected/d0cff6b1-26d2-4059-a556-347772ca0557-kube-api-access-kb9g4\") pod \"aws-ebs-csi-driver-node-pwcsh\" (UID: \"d0cff6b1-26d2-4059-a556-347772ca0557\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pwcsh"
Jun 15 05:48:39.573907 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:48:39.573220    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/d0cff6b1-26d2-4059-a556-347772ca0557-socket-dir\") pod \"aws-ebs-csi-driver-node-pwcsh\" (UID: \"d0cff6b1-26d2-4059-a556-347772ca0557\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pwcsh"
Jun 15 05:48:39.573907 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:48:39.573237    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/2bfcdbc6-e206-4efc-8342-4b2a949e9111-sys\") pod \"tuned-jk5fv\" (UID: \"2bfcdbc6-e206-4efc-8342-4b2a949e9111\") " pod="openshift-cluster-node-tuning-operator/tuned-jk5fv"
Jun 15 05:48:39.573907 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:48:39.573267    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/2bfcdbc6-e206-4efc-8342-4b2a949e9111-etc-sysconfig\") pod \"tuned-jk5fv\" (UID: \"2bfcdbc6-e206-4efc-8342-4b2a949e9111\") " pod="openshift-cluster-node-tuning-operator/tuned-jk5fv"
Jun 15 05:48:39.573907 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:48:39.573273    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/2bfcdbc6-e206-4efc-8342-4b2a949e9111-var-lib-kubelet\") pod \"tuned-jk5fv\" (UID: \"2bfcdbc6-e206-4efc-8342-4b2a949e9111\") " pod="openshift-cluster-node-tuning-operator/tuned-jk5fv"
Jun 15 05:48:39.573907 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:48:39.573297    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/ed7324e7-cd07-4862-ba38-dfb225591afd-cnibin\") pod \"multus-6zzmq\" (UID: \"ed7324e7-cd07-4862-ba38-dfb225591afd\") " pod="openshift-multus/multus-6zzmq"
Jun 15 05:48:39.573907 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:48:39.573313    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ed7324e7-cd07-4862-ba38-dfb225591afd-system-cni-dir\") pod \"multus-6zzmq\" (UID: \"ed7324e7-cd07-4862-ba38-dfb225591afd\") " pod="openshift-multus/multus-6zzmq"
Jun 15 05:48:39.573907 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:48:39.573319    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/ed7324e7-cd07-4862-ba38-dfb225591afd-host-run-netns\") pod \"multus-6zzmq\" (UID: \"ed7324e7-cd07-4862-ba38-dfb225591afd\") " pod="openshift-multus/multus-6zzmq"
Jun 15 05:48:39.574559 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:48:39.573346    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/2bfcdbc6-e206-4efc-8342-4b2a949e9111-etc-sysctl-d\") pod \"tuned-jk5fv\" (UID: \"2bfcdbc6-e206-4efc-8342-4b2a949e9111\") " pod="openshift-cluster-node-tuning-operator/tuned-jk5fv"
Jun 15 05:48:39.574559 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:48:39.573361    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ed7324e7-cd07-4862-ba38-dfb225591afd-multus-cni-dir\") pod \"multus-6zzmq\" (UID: \"ed7324e7-cd07-4862-ba38-dfb225591afd\") " pod="openshift-multus/multus-6zzmq"
Jun 15 05:48:39.574559 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:48:39.573369    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/ed7324e7-cd07-4862-ba38-dfb225591afd-cni-binary-copy\") pod \"multus-6zzmq\" (UID: \"ed7324e7-cd07-4862-ba38-dfb225591afd\") " pod="openshift-multus/multus-6zzmq"
Jun 15 05:48:39.574559 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:48:39.573385    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/2bfcdbc6-e206-4efc-8342-4b2a949e9111-run\") pod \"tuned-jk5fv\" (UID: \"2bfcdbc6-e206-4efc-8342-4b2a949e9111\") " pod="openshift-cluster-node-tuning-operator/tuned-jk5fv"
Jun 15 05:48:39.574559 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:48:39.573402    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/ed7324e7-cd07-4862-ba38-dfb225591afd-host-var-lib-cni-bin\") pod \"multus-6zzmq\" (UID: \"ed7324e7-cd07-4862-ba38-dfb225591afd\") " pod="openshift-multus/multus-6zzmq"
Jun 15 05:48:39.574559 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:48:39.573413    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/ed7324e7-cd07-4862-ba38-dfb225591afd-os-release\") pod \"multus-6zzmq\" (UID: \"ed7324e7-cd07-4862-ba38-dfb225591afd\") " pod="openshift-multus/multus-6zzmq"
Jun 15 05:48:39.574559 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:48:39.573427    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ed7324e7-cd07-4862-ba38-dfb225591afd-host-var-lib-kubelet\") pod \"multus-6zzmq\" (UID: \"ed7324e7-cd07-4862-ba38-dfb225591afd\") " pod="openshift-multus/multus-6zzmq"
Jun 15 05:48:39.574559 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:48:39.573439    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/d0cff6b1-26d2-4059-a556-347772ca0557-registration-dir\") pod \"aws-ebs-csi-driver-node-pwcsh\" (UID: \"d0cff6b1-26d2-4059-a556-347772ca0557\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pwcsh"
Jun 15 05:48:39.574559 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:48:39.573465    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/c1ebb64e-4a47-4507-b619-32502fb528ca-hosts-file\") pod \"node-resolver-n8bz5\" (UID: \"c1ebb64e-4a47-4507-b619-32502fb528ca\") " pod="openshift-dns/node-resolver-n8bz5"
Jun 15 05:48:39.574559 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:48:39.573472    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ed7324e7-cd07-4862-ba38-dfb225591afd-host-var-lib-kubelet\") pod \"multus-6zzmq\" (UID: \"ed7324e7-cd07-4862-ba38-dfb225591afd\") " pod="openshift-multus/multus-6zzmq"
Jun 15 05:48:39.574559 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:48:39.573479    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/9decf7bb-f0b0-494e-8d78-52b86faff279-host-slash\") pod \"iptables-alerter-srxml\" (UID: \"9decf7bb-f0b0-494e-8d78-52b86faff279\") " pod="openshift-network-operator/iptables-alerter-srxml"
Jun 15 05:48:39.574559 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:48:39.573491    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/ed7324e7-cd07-4862-ba38-dfb225591afd-multus-conf-dir\") pod \"multus-6zzmq\" (UID: \"ed7324e7-cd07-4862-ba38-dfb225591afd\") " pod="openshift-multus/multus-6zzmq"
Jun 15 05:48:39.574559 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:48:39.573520    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/2bfcdbc6-e206-4efc-8342-4b2a949e9111-var-lib-kubelet\") pod \"tuned-jk5fv\" (UID: \"2bfcdbc6-e206-4efc-8342-4b2a949e9111\") " pod="openshift-cluster-node-tuning-operator/tuned-jk5fv"
Jun 15 05:48:39.574559 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:48:39.573524    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/2bfcdbc6-e206-4efc-8342-4b2a949e9111-sys\") pod \"tuned-jk5fv\" (UID: \"2bfcdbc6-e206-4efc-8342-4b2a949e9111\") " pod="openshift-cluster-node-tuning-operator/tuned-jk5fv"
Jun 15 05:48:39.574559 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:48:39.573553    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/ed7324e7-cd07-4862-ba38-dfb225591afd-multus-conf-dir\") pod \"multus-6zzmq\" (UID: \"ed7324e7-cd07-4862-ba38-dfb225591afd\") " pod="openshift-multus/multus-6zzmq"
Jun 15 05:48:39.574559 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:48:39.573592    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/d0cff6b1-26d2-4059-a556-347772ca0557-sys-fs\") pod \"aws-ebs-csi-driver-node-pwcsh\" (UID: \"d0cff6b1-26d2-4059-a556-347772ca0557\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pwcsh"
Jun 15 05:48:39.574559 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:48:39.573628    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/ed7324e7-cd07-4862-ba38-dfb225591afd-cnibin\") pod \"multus-6zzmq\" (UID: \"ed7324e7-cd07-4862-ba38-dfb225591afd\") " pod="openshift-multus/multus-6zzmq"
Jun 15 05:48:39.574559 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:48:39.573628    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/2bfcdbc6-e206-4efc-8342-4b2a949e9111-etc-sysctl-d\") pod \"tuned-jk5fv\" (UID: \"2bfcdbc6-e206-4efc-8342-4b2a949e9111\") " pod="openshift-cluster-node-tuning-operator/tuned-jk5fv"
Jun 15 05:48:39.575165 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:48:39.573659    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/ed7324e7-cd07-4862-ba38-dfb225591afd-host-run-netns\") pod \"multus-6zzmq\" (UID: \"ed7324e7-cd07-4862-ba38-dfb225591afd\") " pod="openshift-multus/multus-6zzmq"
Jun 15 05:48:39.575165 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:48:39.573666    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/ed7324e7-cd07-4862-ba38-dfb225591afd-host-var-lib-cni-bin\") pod \"multus-6zzmq\" (UID: \"ed7324e7-cd07-4862-ba38-dfb225591afd\") " pod="openshift-multus/multus-6zzmq"
Jun 15 05:48:39.575165 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:48:39.573892    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/ed7324e7-cd07-4862-ba38-dfb225591afd-cni-binary-copy\") pod \"multus-6zzmq\" (UID: \"ed7324e7-cd07-4862-ba38-dfb225591afd\") " pod="openshift-multus/multus-6zzmq"
Jun 15 05:48:39.575165 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:48:39.573920    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/ed7324e7-cd07-4862-ba38-dfb225591afd-multus-daemon-config\") pod \"multus-6zzmq\" (UID: \"ed7324e7-cd07-4862-ba38-dfb225591afd\") " pod="openshift-multus/multus-6zzmq"
Jun 15 05:48:39.575165 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:48:39.574621    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/2bfcdbc6-e206-4efc-8342-4b2a949e9111-etc-tuned\") pod \"tuned-jk5fv\" (UID: \"2bfcdbc6-e206-4efc-8342-4b2a949e9111\") " pod="openshift-cluster-node-tuning-operator/tuned-jk5fv"
Jun 15 05:48:39.575165 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:48:39.574808    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2bfcdbc6-e206-4efc-8342-4b2a949e9111-tmp\") pod \"tuned-jk5fv\" (UID: \"2bfcdbc6-e206-4efc-8342-4b2a949e9111\") " pod="openshift-cluster-node-tuning-operator/tuned-jk5fv"
Jun 15 05:48:39.575165 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:48:39.574958    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/9b076565-1f97-4867-a59b-23315d842e4e-agent-certs\") pod \"konnectivity-agent-xv9fc\" (UID: \"9b076565-1f97-4867-a59b-23315d842e4e\") " pod="kube-system/konnectivity-agent-xv9fc"
Jun 15 05:48:39.584349 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:48:39.584314    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kb8s6\" (UniqueName: \"kubernetes.io/projected/ed7324e7-cd07-4862-ba38-dfb225591afd-kube-api-access-kb8s6\") pod \"multus-6zzmq\" (UID: \"ed7324e7-cd07-4862-ba38-dfb225591afd\") " pod="openshift-multus/multus-6zzmq"
Jun 15 05:48:39.585656 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:48:39.585638    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kb9g4\" (UniqueName: \"kubernetes.io/projected/d0cff6b1-26d2-4059-a556-347772ca0557-kube-api-access-kb9g4\") pod \"aws-ebs-csi-driver-node-pwcsh\" (UID: \"d0cff6b1-26d2-4059-a556-347772ca0557\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pwcsh"
Jun 15 05:48:39.585961 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:48:39.585931    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7nljk\" (UniqueName: \"kubernetes.io/projected/9decf7bb-f0b0-494e-8d78-52b86faff279-kube-api-access-7nljk\") pod \"iptables-alerter-srxml\" (UID: \"9decf7bb-f0b0-494e-8d78-52b86faff279\") " pod="openshift-network-operator/iptables-alerter-srxml"
Jun 15 05:48:39.586786 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:48:39.586760    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-g8vjr\" (UniqueName: \"kubernetes.io/projected/2bfcdbc6-e206-4efc-8342-4b2a949e9111-kube-api-access-g8vjr\") pod \"tuned-jk5fv\" (UID: \"2bfcdbc6-e206-4efc-8342-4b2a949e9111\") " pod="openshift-cluster-node-tuning-operator/tuned-jk5fv"
Jun 15 05:48:39.594590 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:48:39.594541    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6djqr\" (UniqueName: \"kubernetes.io/projected/c1ebb64e-4a47-4507-b619-32502fb528ca-kube-api-access-6djqr\") pod \"node-resolver-n8bz5\" (UID: \"c1ebb64e-4a47-4507-b619-32502fb528ca\") " pod="openshift-dns/node-resolver-n8bz5"
Jun 15 05:48:39.658870 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:48:39.658843    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-frzbm"
Jun 15 05:48:39.667183 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:48:39.667159    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-c5vrl"
Jun 15 05:48:39.679306 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:48:39.679285    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-f4bzh"
Jun 15 05:48:39.684294 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:48:39.684270    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-jk5fv"
Jun 15 05:48:39.690349 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:48:39.690326    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-xv9fc"
Jun 15 05:48:39.697279 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:48:39.697256    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-6zzmq"
Jun 15 05:48:39.705579 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:48:39.705556    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-n8bz5"
Jun 15 05:48:39.711374 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:48:39.711356    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pwcsh"
Jun 15 05:48:39.718066 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:48:39.718047    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-srxml"
Jun 15 05:48:39.976288 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:48:39.975965    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7a806cb5-1d94-4558-9a7a-a734123af31b-original-pull-secret\") pod \"global-pull-secret-syncer-hpg5s\" (UID: \"7a806cb5-1d94-4558-9a7a-a734123af31b\") " pod="kube-system/global-pull-secret-syncer-hpg5s"
Jun 15 05:48:39.976288 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:48:39.976030    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d81bd047-22fb-452e-b2d2-073f232701c2-metrics-certs\") pod \"network-metrics-daemon-cbmww\" (UID: \"d81bd047-22fb-452e-b2d2-073f232701c2\") " pod="openshift-multus/network-metrics-daemon-cbmww"
Jun 15 05:48:39.976288 ip-10-0-128-243 kubenswrapper[2566]: E0615 05:48:39.976135    2566 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jun 15 05:48:39.976288 ip-10-0-128-243 kubenswrapper[2566]: E0615 05:48:39.976147    2566 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jun 15 05:48:39.976288 ip-10-0-128-243 kubenswrapper[2566]: E0615 05:48:39.976203    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d81bd047-22fb-452e-b2d2-073f232701c2-metrics-certs podName:d81bd047-22fb-452e-b2d2-073f232701c2 nodeName:}" failed. No retries permitted until 2026-06-15 05:48:40.976188448 +0000 UTC m=+3.935945674 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d81bd047-22fb-452e-b2d2-073f232701c2-metrics-certs") pod "network-metrics-daemon-cbmww" (UID: "d81bd047-22fb-452e-b2d2-073f232701c2") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jun 15 05:48:39.976288 ip-10-0-128-243 kubenswrapper[2566]: E0615 05:48:39.976222    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7a806cb5-1d94-4558-9a7a-a734123af31b-original-pull-secret podName:7a806cb5-1d94-4558-9a7a-a734123af31b nodeName:}" failed. No retries permitted until 2026-06-15 05:48:40.976212023 +0000 UTC m=+3.935969251 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/7a806cb5-1d94-4558-9a7a-a734123af31b-original-pull-secret") pod "global-pull-secret-syncer-hpg5s" (UID: "7a806cb5-1d94-4558-9a7a-a734123af31b") : object "kube-system"/"original-pull-secret" not registered
Jun 15 05:48:40.077353 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:48:40.077317    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nc9t7\" (UniqueName: \"kubernetes.io/projected/7fb5709e-946d-4dc2-ac4f-72986f9adcdc-kube-api-access-nc9t7\") pod \"network-check-target-gbdt4\" (UID: \"7fb5709e-946d-4dc2-ac4f-72986f9adcdc\") " pod="openshift-network-diagnostics/network-check-target-gbdt4"
Jun 15 05:48:40.077522 ip-10-0-128-243 kubenswrapper[2566]: E0615 05:48:40.077482    2566 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jun 15 05:48:40.077522 ip-10-0-128-243 kubenswrapper[2566]: E0615 05:48:40.077503    2566 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jun 15 05:48:40.077522 ip-10-0-128-243 kubenswrapper[2566]: E0615 05:48:40.077512    2566 projected.go:196] Error preparing data for projected volume kube-api-access-nc9t7 for pod openshift-network-diagnostics/network-check-target-gbdt4: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jun 15 05:48:40.077678 ip-10-0-128-243 kubenswrapper[2566]: E0615 05:48:40.077567    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/7fb5709e-946d-4dc2-ac4f-72986f9adcdc-kube-api-access-nc9t7 podName:7fb5709e-946d-4dc2-ac4f-72986f9adcdc nodeName:}" failed. No retries permitted until 2026-06-15 05:48:41.077552357 +0000 UTC m=+4.037309579 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-nc9t7" (UniqueName: "kubernetes.io/projected/7fb5709e-946d-4dc2-ac4f-72986f9adcdc-kube-api-access-nc9t7") pod "network-check-target-gbdt4" (UID: "7fb5709e-946d-4dc2-ac4f-72986f9adcdc") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jun 15 05:48:40.297675 ip-10-0-128-243 kubenswrapper[2566]: W0615 05:48:40.297635    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poded7324e7_cd07_4862_ba38_dfb225591afd.slice/crio-fa9dcf322ad97e9d652b74e92703cf66a5ce540441962a06fc67ed61dee4bc42 WatchSource:0}: Error finding container fa9dcf322ad97e9d652b74e92703cf66a5ce540441962a06fc67ed61dee4bc42: Status 404 returned error can't find the container with id fa9dcf322ad97e9d652b74e92703cf66a5ce540441962a06fc67ed61dee4bc42
Jun 15 05:48:40.303573 ip-10-0-128-243 kubenswrapper[2566]: W0615 05:48:40.303547    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9decf7bb_f0b0_494e_8d78_52b86faff279.slice/crio-a5ab1335826563b6e4aabee5d91cb01bfad16a99ffe50b087288a3146cd30b72 WatchSource:0}: Error finding container a5ab1335826563b6e4aabee5d91cb01bfad16a99ffe50b087288a3146cd30b72: Status 404 returned error can't find the container with id a5ab1335826563b6e4aabee5d91cb01bfad16a99ffe50b087288a3146cd30b72
Jun 15 05:48:40.311408 ip-10-0-128-243 kubenswrapper[2566]: W0615 05:48:40.311377    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5a1f8f83_55db_4fc7_872d_6b202daa0a31.slice/crio-ab517bf30f7f02f048981f5315128b9be158b915076d9abff51a8ea6aa871d8e WatchSource:0}: Error finding container ab517bf30f7f02f048981f5315128b9be158b915076d9abff51a8ea6aa871d8e: Status 404 returned error can't find the container with id ab517bf30f7f02f048981f5315128b9be158b915076d9abff51a8ea6aa871d8e
Jun 15 05:48:40.313710 ip-10-0-128-243 kubenswrapper[2566]: W0615 05:48:40.313679    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd0cff6b1_26d2_4059_a556_347772ca0557.slice/crio-c743e9340a6474019093bb1a4b72ef1754414ac8d63707b9dc3f20142a1ef172 WatchSource:0}: Error finding container c743e9340a6474019093bb1a4b72ef1754414ac8d63707b9dc3f20142a1ef172: Status 404 returned error can't find the container with id c743e9340a6474019093bb1a4b72ef1754414ac8d63707b9dc3f20142a1ef172
Jun 15 05:48:40.314935 ip-10-0-128-243 kubenswrapper[2566]: W0615 05:48:40.314894    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0246685c_f9e4_45b0_bb3f_b17957621809.slice/crio-08d4db2ff86923507972332356e05f8dc4fa120995e1b7991c3686d869a2d112 WatchSource:0}: Error finding container 08d4db2ff86923507972332356e05f8dc4fa120995e1b7991c3686d869a2d112: Status 404 returned error can't find the container with id 08d4db2ff86923507972332356e05f8dc4fa120995e1b7991c3686d869a2d112
Jun 15 05:48:40.418947 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:48:40.418691    2566 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-14 05:43:39 +0000 UTC" deadline="2028-03-10 12:51:25.911343558 +0000 UTC"
Jun 15 05:48:40.418947 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:48:40.418948    2566 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15223h2m45.49240353s"
Jun 15 05:48:40.443942 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:48:40.443903    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-f4bzh" event={"ID":"5a1f8f83-55db-4fc7-872d-6b202daa0a31","Type":"ContainerStarted","Data":"ab517bf30f7f02f048981f5315128b9be158b915076d9abff51a8ea6aa871d8e"}
Jun 15 05:48:40.445069 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:48:40.445040    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-jk5fv" event={"ID":"2bfcdbc6-e206-4efc-8342-4b2a949e9111","Type":"ContainerStarted","Data":"bfe1452a2befb3e54b3f2adb076ff274946d1920b01fb2299d7db8dfdae21929"}
Jun 15 05:48:40.447182 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:48:40.447156    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-243.ec2.internal" event={"ID":"c8b2bbb1effaa631bc90559ca49e380a","Type":"ContainerStarted","Data":"e39d0420fc209e2eb2582cdd4b60e80f4babf5f28ab1603d534401b39ede437d"}
Jun 15 05:48:40.448343 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:48:40.448321    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-xv9fc" event={"ID":"9b076565-1f97-4867-a59b-23315d842e4e","Type":"ContainerStarted","Data":"c777a547898227e5dfbf378f69be414b5f5ee95fa27890b8f28690be7daeabb2"}
Jun 15 05:48:40.449476 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:48:40.449438    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-srxml" event={"ID":"9decf7bb-f0b0-494e-8d78-52b86faff279","Type":"ContainerStarted","Data":"a5ab1335826563b6e4aabee5d91cb01bfad16a99ffe50b087288a3146cd30b72"}
Jun 15 05:48:40.450712 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:48:40.450688    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-n8bz5" event={"ID":"c1ebb64e-4a47-4507-b619-32502fb528ca","Type":"ContainerStarted","Data":"bb71aef450ae4308cb36159433c944e75fbd1ef63d4ed551fa988d0d2f2a012d"}
Jun 15 05:48:40.451738 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:48:40.451717    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-6zzmq" event={"ID":"ed7324e7-cd07-4862-ba38-dfb225591afd","Type":"ContainerStarted","Data":"fa9dcf322ad97e9d652b74e92703cf66a5ce540441962a06fc67ed61dee4bc42"}
Jun 15 05:48:40.453205 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:48:40.453184    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-c5vrl" event={"ID":"0246685c-f9e4-45b0-bb3f-b17957621809","Type":"ContainerStarted","Data":"08d4db2ff86923507972332356e05f8dc4fa120995e1b7991c3686d869a2d112"}
Jun 15 05:48:40.454702 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:48:40.454683    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-frzbm" event={"ID":"2e630a88-8b65-4dd7-970d-cfd8e5d031c6","Type":"ContainerStarted","Data":"88604762f6ed5456d8ad07d54da0957efbb545bbebfba07d1c85acb47f006c05"}
Jun 15 05:48:40.455800 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:48:40.455783    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pwcsh" event={"ID":"d0cff6b1-26d2-4059-a556-347772ca0557","Type":"ContainerStarted","Data":"c743e9340a6474019093bb1a4b72ef1754414ac8d63707b9dc3f20142a1ef172"}
Jun 15 05:48:40.475333 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:48:40.475290    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-243.ec2.internal" podStartSLOduration=2.475278693 podStartE2EDuration="2.475278693s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-15 05:48:38 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 05:48:40.475199331 +0000 UTC m=+3.434956575" watchObservedRunningTime="2026-06-15 05:48:40.475278693 +0000 UTC m=+3.435035937"
Jun 15 05:48:40.984108 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:48:40.984005    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7a806cb5-1d94-4558-9a7a-a734123af31b-original-pull-secret\") pod \"global-pull-secret-syncer-hpg5s\" (UID: \"7a806cb5-1d94-4558-9a7a-a734123af31b\") " pod="kube-system/global-pull-secret-syncer-hpg5s"
Jun 15 05:48:40.984108 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:48:40.984097    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d81bd047-22fb-452e-b2d2-073f232701c2-metrics-certs\") pod \"network-metrics-daemon-cbmww\" (UID: \"d81bd047-22fb-452e-b2d2-073f232701c2\") " pod="openshift-multus/network-metrics-daemon-cbmww"
Jun 15 05:48:40.984314 ip-10-0-128-243 kubenswrapper[2566]: E0615 05:48:40.984257    2566 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jun 15 05:48:40.984386 ip-10-0-128-243 kubenswrapper[2566]: E0615 05:48:40.984319    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d81bd047-22fb-452e-b2d2-073f232701c2-metrics-certs podName:d81bd047-22fb-452e-b2d2-073f232701c2 nodeName:}" failed. No retries permitted until 2026-06-15 05:48:42.984300452 +0000 UTC m=+5.944057677 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d81bd047-22fb-452e-b2d2-073f232701c2-metrics-certs") pod "network-metrics-daemon-cbmww" (UID: "d81bd047-22fb-452e-b2d2-073f232701c2") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jun 15 05:48:40.984728 ip-10-0-128-243 kubenswrapper[2566]: E0615 05:48:40.984705    2566 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jun 15 05:48:40.984790 ip-10-0-128-243 kubenswrapper[2566]: E0615 05:48:40.984772    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7a806cb5-1d94-4558-9a7a-a734123af31b-original-pull-secret podName:7a806cb5-1d94-4558-9a7a-a734123af31b nodeName:}" failed. No retries permitted until 2026-06-15 05:48:42.984755223 +0000 UTC m=+5.944512449 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/7a806cb5-1d94-4558-9a7a-a734123af31b-original-pull-secret") pod "global-pull-secret-syncer-hpg5s" (UID: "7a806cb5-1d94-4558-9a7a-a734123af31b") : object "kube-system"/"original-pull-secret" not registered
Jun 15 05:48:41.085943 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:48:41.085339    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nc9t7\" (UniqueName: \"kubernetes.io/projected/7fb5709e-946d-4dc2-ac4f-72986f9adcdc-kube-api-access-nc9t7\") pod \"network-check-target-gbdt4\" (UID: \"7fb5709e-946d-4dc2-ac4f-72986f9adcdc\") " pod="openshift-network-diagnostics/network-check-target-gbdt4"
Jun 15 05:48:41.085943 ip-10-0-128-243 kubenswrapper[2566]: E0615 05:48:41.085512    2566 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jun 15 05:48:41.085943 ip-10-0-128-243 kubenswrapper[2566]: E0615 05:48:41.085533    2566 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jun 15 05:48:41.085943 ip-10-0-128-243 kubenswrapper[2566]: E0615 05:48:41.085545    2566 projected.go:196] Error preparing data for projected volume kube-api-access-nc9t7 for pod openshift-network-diagnostics/network-check-target-gbdt4: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jun 15 05:48:41.085943 ip-10-0-128-243 kubenswrapper[2566]: E0615 05:48:41.085605    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/7fb5709e-946d-4dc2-ac4f-72986f9adcdc-kube-api-access-nc9t7 podName:7fb5709e-946d-4dc2-ac4f-72986f9adcdc nodeName:}" failed. No retries permitted until 2026-06-15 05:48:43.085586174 +0000 UTC m=+6.045343403 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-nc9t7" (UniqueName: "kubernetes.io/projected/7fb5709e-946d-4dc2-ac4f-72986f9adcdc-kube-api-access-nc9t7") pod "network-check-target-gbdt4" (UID: "7fb5709e-946d-4dc2-ac4f-72986f9adcdc") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jun 15 05:48:41.419229 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:48:41.419108    2566 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-14 05:43:39 +0000 UTC" deadline="2028-01-13 09:28:34.371670626 +0000 UTC"
Jun 15 05:48:41.419229 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:48:41.419147    2566 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13851h39m52.952528433s"
Jun 15 05:48:41.437125 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:48:41.435959    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hpg5s"
Jun 15 05:48:41.437125 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:48:41.436030    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cbmww"
Jun 15 05:48:41.437125 ip-10-0-128-243 kubenswrapper[2566]: E0615 05:48:41.436180    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cbmww" podUID="d81bd047-22fb-452e-b2d2-073f232701c2"
Jun 15 05:48:41.437125 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:48:41.436625    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gbdt4"
Jun 15 05:48:41.437125 ip-10-0-128-243 kubenswrapper[2566]: E0615 05:48:41.436718    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gbdt4" podUID="7fb5709e-946d-4dc2-ac4f-72986f9adcdc"
Jun 15 05:48:41.437678 ip-10-0-128-243 kubenswrapper[2566]: E0615 05:48:41.437584    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hpg5s" podUID="7a806cb5-1d94-4558-9a7a-a734123af31b"
Jun 15 05:48:41.477551 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:48:41.476454    2566 generic.go:356] "Generic (PLEG): container finished" podID="20fcfef3e673a6e0448477fc680fc5f1" containerID="5907be6b46ee2850656602acc32cf167a387d48ce1001812507618f86672f1cd" exitCode=0
Jun 15 05:48:41.477551 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:48:41.477342    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-243.ec2.internal" event={"ID":"20fcfef3e673a6e0448477fc680fc5f1","Type":"ContainerDied","Data":"5907be6b46ee2850656602acc32cf167a387d48ce1001812507618f86672f1cd"}
Jun 15 05:48:42.494148 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:48:42.494111    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-243.ec2.internal" event={"ID":"20fcfef3e673a6e0448477fc680fc5f1","Type":"ContainerStarted","Data":"8fe8ce0d4bf6502e770f2dda51290b98c207ae6b7de9d596698830144349fa59"}
Jun 15 05:48:43.002485 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:48:43.002185    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d81bd047-22fb-452e-b2d2-073f232701c2-metrics-certs\") pod \"network-metrics-daemon-cbmww\" (UID: \"d81bd047-22fb-452e-b2d2-073f232701c2\") " pod="openshift-multus/network-metrics-daemon-cbmww"
Jun 15 05:48:43.002485 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:48:43.002280    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7a806cb5-1d94-4558-9a7a-a734123af31b-original-pull-secret\") pod \"global-pull-secret-syncer-hpg5s\" (UID: \"7a806cb5-1d94-4558-9a7a-a734123af31b\") " pod="kube-system/global-pull-secret-syncer-hpg5s"
Jun 15 05:48:43.002485 ip-10-0-128-243 kubenswrapper[2566]: E0615 05:48:43.002423    2566 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jun 15 05:48:43.002485 ip-10-0-128-243 kubenswrapper[2566]: E0615 05:48:43.002458    2566 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jun 15 05:48:43.002789 ip-10-0-128-243 kubenswrapper[2566]: E0615 05:48:43.002485    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7a806cb5-1d94-4558-9a7a-a734123af31b-original-pull-secret podName:7a806cb5-1d94-4558-9a7a-a734123af31b nodeName:}" failed. No retries permitted until 2026-06-15 05:48:47.002466967 +0000 UTC m=+9.962224194 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/7a806cb5-1d94-4558-9a7a-a734123af31b-original-pull-secret") pod "global-pull-secret-syncer-hpg5s" (UID: "7a806cb5-1d94-4558-9a7a-a734123af31b") : object "kube-system"/"original-pull-secret" not registered
Jun 15 05:48:43.002789 ip-10-0-128-243 kubenswrapper[2566]: E0615 05:48:43.002602    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d81bd047-22fb-452e-b2d2-073f232701c2-metrics-certs podName:d81bd047-22fb-452e-b2d2-073f232701c2 nodeName:}" failed. No retries permitted until 2026-06-15 05:48:47.002584076 +0000 UTC m=+9.962341322 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d81bd047-22fb-452e-b2d2-073f232701c2-metrics-certs") pod "network-metrics-daemon-cbmww" (UID: "d81bd047-22fb-452e-b2d2-073f232701c2") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jun 15 05:48:43.103585 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:48:43.103547    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nc9t7\" (UniqueName: \"kubernetes.io/projected/7fb5709e-946d-4dc2-ac4f-72986f9adcdc-kube-api-access-nc9t7\") pod \"network-check-target-gbdt4\" (UID: \"7fb5709e-946d-4dc2-ac4f-72986f9adcdc\") " pod="openshift-network-diagnostics/network-check-target-gbdt4"
Jun 15 05:48:43.103754 ip-10-0-128-243 kubenswrapper[2566]: E0615 05:48:43.103709    2566 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jun 15 05:48:43.103754 ip-10-0-128-243 kubenswrapper[2566]: E0615 05:48:43.103731    2566 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jun 15 05:48:43.103754 ip-10-0-128-243 kubenswrapper[2566]: E0615 05:48:43.103743    2566 projected.go:196] Error preparing data for projected volume kube-api-access-nc9t7 for pod openshift-network-diagnostics/network-check-target-gbdt4: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jun 15 05:48:43.103921 ip-10-0-128-243 kubenswrapper[2566]: E0615 05:48:43.103798    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/7fb5709e-946d-4dc2-ac4f-72986f9adcdc-kube-api-access-nc9t7 podName:7fb5709e-946d-4dc2-ac4f-72986f9adcdc nodeName:}" failed. No retries permitted until 2026-06-15 05:48:47.103780497 +0000 UTC m=+10.063537722 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-nc9t7" (UniqueName: "kubernetes.io/projected/7fb5709e-946d-4dc2-ac4f-72986f9adcdc-kube-api-access-nc9t7") pod "network-check-target-gbdt4" (UID: "7fb5709e-946d-4dc2-ac4f-72986f9adcdc") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jun 15 05:48:43.437306 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:48:43.436375    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hpg5s"
Jun 15 05:48:43.437306 ip-10-0-128-243 kubenswrapper[2566]: E0615 05:48:43.436505    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hpg5s" podUID="7a806cb5-1d94-4558-9a7a-a734123af31b"
Jun 15 05:48:43.437306 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:48:43.436899    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cbmww"
Jun 15 05:48:43.437306 ip-10-0-128-243 kubenswrapper[2566]: E0615 05:48:43.437005    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cbmww" podUID="d81bd047-22fb-452e-b2d2-073f232701c2"
Jun 15 05:48:43.437306 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:48:43.437103    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gbdt4"
Jun 15 05:48:43.437306 ip-10-0-128-243 kubenswrapper[2566]: E0615 05:48:43.437177    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gbdt4" podUID="7fb5709e-946d-4dc2-ac4f-72986f9adcdc"
Jun 15 05:48:45.440862 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:48:45.440109    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gbdt4"
Jun 15 05:48:45.440862 ip-10-0-128-243 kubenswrapper[2566]: E0615 05:48:45.440230    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gbdt4" podUID="7fb5709e-946d-4dc2-ac4f-72986f9adcdc"
Jun 15 05:48:45.440862 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:48:45.440592    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hpg5s"
Jun 15 05:48:45.440862 ip-10-0-128-243 kubenswrapper[2566]: E0615 05:48:45.440692    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hpg5s" podUID="7a806cb5-1d94-4558-9a7a-a734123af31b"
Jun 15 05:48:45.440862 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:48:45.440744    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cbmww"
Jun 15 05:48:45.440862 ip-10-0-128-243 kubenswrapper[2566]: E0615 05:48:45.440820    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cbmww" podUID="d81bd047-22fb-452e-b2d2-073f232701c2"
Jun 15 05:48:47.036782 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:48:47.036742    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d81bd047-22fb-452e-b2d2-073f232701c2-metrics-certs\") pod \"network-metrics-daemon-cbmww\" (UID: \"d81bd047-22fb-452e-b2d2-073f232701c2\") " pod="openshift-multus/network-metrics-daemon-cbmww"
Jun 15 05:48:47.037230 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:48:47.036814    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7a806cb5-1d94-4558-9a7a-a734123af31b-original-pull-secret\") pod \"global-pull-secret-syncer-hpg5s\" (UID: \"7a806cb5-1d94-4558-9a7a-a734123af31b\") " pod="kube-system/global-pull-secret-syncer-hpg5s"
Jun 15 05:48:47.037230 ip-10-0-128-243 kubenswrapper[2566]: E0615 05:48:47.036916    2566 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jun 15 05:48:47.037230 ip-10-0-128-243 kubenswrapper[2566]: E0615 05:48:47.036969    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7a806cb5-1d94-4558-9a7a-a734123af31b-original-pull-secret podName:7a806cb5-1d94-4558-9a7a-a734123af31b nodeName:}" failed. No retries permitted until 2026-06-15 05:48:55.036955815 +0000 UTC m=+17.996713052 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/7a806cb5-1d94-4558-9a7a-a734123af31b-original-pull-secret") pod "global-pull-secret-syncer-hpg5s" (UID: "7a806cb5-1d94-4558-9a7a-a734123af31b") : object "kube-system"/"original-pull-secret" not registered
Jun 15 05:48:47.037346 ip-10-0-128-243 kubenswrapper[2566]: E0615 05:48:47.037223    2566 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jun 15 05:48:47.037346 ip-10-0-128-243 kubenswrapper[2566]: E0615 05:48:47.037293    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d81bd047-22fb-452e-b2d2-073f232701c2-metrics-certs podName:d81bd047-22fb-452e-b2d2-073f232701c2 nodeName:}" failed. No retries permitted until 2026-06-15 05:48:55.037272315 +0000 UTC m=+17.997029554 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d81bd047-22fb-452e-b2d2-073f232701c2-metrics-certs") pod "network-metrics-daemon-cbmww" (UID: "d81bd047-22fb-452e-b2d2-073f232701c2") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jun 15 05:48:47.137982 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:48:47.137941    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nc9t7\" (UniqueName: \"kubernetes.io/projected/7fb5709e-946d-4dc2-ac4f-72986f9adcdc-kube-api-access-nc9t7\") pod \"network-check-target-gbdt4\" (UID: \"7fb5709e-946d-4dc2-ac4f-72986f9adcdc\") " pod="openshift-network-diagnostics/network-check-target-gbdt4"
Jun 15 05:48:47.138194 ip-10-0-128-243 kubenswrapper[2566]: E0615 05:48:47.138152    2566 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jun 15 05:48:47.138194 ip-10-0-128-243 kubenswrapper[2566]: E0615 05:48:47.138176    2566 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jun 15 05:48:47.138194 ip-10-0-128-243 kubenswrapper[2566]: E0615 05:48:47.138188    2566 projected.go:196] Error preparing data for projected volume kube-api-access-nc9t7 for pod openshift-network-diagnostics/network-check-target-gbdt4: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jun 15 05:48:47.138327 ip-10-0-128-243 kubenswrapper[2566]: E0615 05:48:47.138248    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/7fb5709e-946d-4dc2-ac4f-72986f9adcdc-kube-api-access-nc9t7 podName:7fb5709e-946d-4dc2-ac4f-72986f9adcdc nodeName:}" failed. No retries permitted until 2026-06-15 05:48:55.138231081 +0000 UTC m=+18.097988321 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-nc9t7" (UniqueName: "kubernetes.io/projected/7fb5709e-946d-4dc2-ac4f-72986f9adcdc-kube-api-access-nc9t7") pod "network-check-target-gbdt4" (UID: "7fb5709e-946d-4dc2-ac4f-72986f9adcdc") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jun 15 05:48:47.439536 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:48:47.437327    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cbmww"
Jun 15 05:48:47.439536 ip-10-0-128-243 kubenswrapper[2566]: E0615 05:48:47.437486    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cbmww" podUID="d81bd047-22fb-452e-b2d2-073f232701c2"
Jun 15 05:48:47.439536 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:48:47.439263    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gbdt4"
Jun 15 05:48:47.439536 ip-10-0-128-243 kubenswrapper[2566]: E0615 05:48:47.439353    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gbdt4" podUID="7fb5709e-946d-4dc2-ac4f-72986f9adcdc"
Jun 15 05:48:47.439536 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:48:47.439525    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hpg5s"
Jun 15 05:48:47.439941 ip-10-0-128-243 kubenswrapper[2566]: E0615 05:48:47.439629    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hpg5s" podUID="7a806cb5-1d94-4558-9a7a-a734123af31b"
Jun 15 05:48:49.436941 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:48:49.436421    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cbmww"
Jun 15 05:48:49.436941 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:48:49.436421    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gbdt4"
Jun 15 05:48:49.436941 ip-10-0-128-243 kubenswrapper[2566]: E0615 05:48:49.436587    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cbmww" podUID="d81bd047-22fb-452e-b2d2-073f232701c2"
Jun 15 05:48:49.436941 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:48:49.436644    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hpg5s"
Jun 15 05:48:49.436941 ip-10-0-128-243 kubenswrapper[2566]: E0615 05:48:49.436742    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gbdt4" podUID="7fb5709e-946d-4dc2-ac4f-72986f9adcdc"
Jun 15 05:48:49.436941 ip-10-0-128-243 kubenswrapper[2566]: E0615 05:48:49.436833    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hpg5s" podUID="7a806cb5-1d94-4558-9a7a-a734123af31b"
Jun 15 05:48:51.436616 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:48:51.436586    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cbmww"
Jun 15 05:48:51.437098 ip-10-0-128-243 kubenswrapper[2566]: E0615 05:48:51.436695    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cbmww" podUID="d81bd047-22fb-452e-b2d2-073f232701c2"
Jun 15 05:48:51.437098 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:48:51.437054    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gbdt4"
Jun 15 05:48:51.437212 ip-10-0-128-243 kubenswrapper[2566]: E0615 05:48:51.437143    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gbdt4" podUID="7fb5709e-946d-4dc2-ac4f-72986f9adcdc"
Jun 15 05:48:51.437212 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:48:51.437197    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hpg5s"
Jun 15 05:48:51.437312 ip-10-0-128-243 kubenswrapper[2566]: E0615 05:48:51.437254    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hpg5s" podUID="7a806cb5-1d94-4558-9a7a-a734123af31b"
Jun 15 05:48:53.436642 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:48:53.436144    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gbdt4"
Jun 15 05:48:53.436642 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:48:53.436177    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hpg5s"
Jun 15 05:48:53.436642 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:48:53.436144    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cbmww"
Jun 15 05:48:53.436642 ip-10-0-128-243 kubenswrapper[2566]: E0615 05:48:53.436267    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gbdt4" podUID="7fb5709e-946d-4dc2-ac4f-72986f9adcdc"
Jun 15 05:48:53.436642 ip-10-0-128-243 kubenswrapper[2566]: E0615 05:48:53.436343    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cbmww" podUID="d81bd047-22fb-452e-b2d2-073f232701c2"
Jun 15 05:48:53.436642 ip-10-0-128-243 kubenswrapper[2566]: E0615 05:48:53.436415    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hpg5s" podUID="7a806cb5-1d94-4558-9a7a-a734123af31b"
Jun 15 05:48:55.095811 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:48:55.095772    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7a806cb5-1d94-4558-9a7a-a734123af31b-original-pull-secret\") pod \"global-pull-secret-syncer-hpg5s\" (UID: \"7a806cb5-1d94-4558-9a7a-a734123af31b\") " pod="kube-system/global-pull-secret-syncer-hpg5s"
Jun 15 05:48:55.096272 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:48:55.095831    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d81bd047-22fb-452e-b2d2-073f232701c2-metrics-certs\") pod \"network-metrics-daemon-cbmww\" (UID: \"d81bd047-22fb-452e-b2d2-073f232701c2\") " pod="openshift-multus/network-metrics-daemon-cbmww"
Jun 15 05:48:55.096272 ip-10-0-128-243 kubenswrapper[2566]: E0615 05:48:55.095954    2566 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jun 15 05:48:55.096272 ip-10-0-128-243 kubenswrapper[2566]: E0615 05:48:55.095953    2566 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jun 15 05:48:55.096272 ip-10-0-128-243 kubenswrapper[2566]: E0615 05:48:55.096036    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d81bd047-22fb-452e-b2d2-073f232701c2-metrics-certs podName:d81bd047-22fb-452e-b2d2-073f232701c2 nodeName:}" failed. No retries permitted until 2026-06-15 05:49:11.09599036 +0000 UTC m=+34.055747586 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d81bd047-22fb-452e-b2d2-073f232701c2-metrics-certs") pod "network-metrics-daemon-cbmww" (UID: "d81bd047-22fb-452e-b2d2-073f232701c2") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jun 15 05:48:55.096272 ip-10-0-128-243 kubenswrapper[2566]: E0615 05:48:55.096059    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7a806cb5-1d94-4558-9a7a-a734123af31b-original-pull-secret podName:7a806cb5-1d94-4558-9a7a-a734123af31b nodeName:}" failed. No retries permitted until 2026-06-15 05:49:11.096048362 +0000 UTC m=+34.055805597 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/7a806cb5-1d94-4558-9a7a-a734123af31b-original-pull-secret") pod "global-pull-secret-syncer-hpg5s" (UID: "7a806cb5-1d94-4558-9a7a-a734123af31b") : object "kube-system"/"original-pull-secret" not registered
Jun 15 05:48:55.196715 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:48:55.196646    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nc9t7\" (UniqueName: \"kubernetes.io/projected/7fb5709e-946d-4dc2-ac4f-72986f9adcdc-kube-api-access-nc9t7\") pod \"network-check-target-gbdt4\" (UID: \"7fb5709e-946d-4dc2-ac4f-72986f9adcdc\") " pod="openshift-network-diagnostics/network-check-target-gbdt4"
Jun 15 05:48:55.196893 ip-10-0-128-243 kubenswrapper[2566]: E0615 05:48:55.196823    2566 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jun 15 05:48:55.196893 ip-10-0-128-243 kubenswrapper[2566]: E0615 05:48:55.196850    2566 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jun 15 05:48:55.196893 ip-10-0-128-243 kubenswrapper[2566]: E0615 05:48:55.196865    2566 projected.go:196] Error preparing data for projected volume kube-api-access-nc9t7 for pod openshift-network-diagnostics/network-check-target-gbdt4: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jun 15 05:48:55.197014 ip-10-0-128-243 kubenswrapper[2566]: E0615 05:48:55.196926    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/7fb5709e-946d-4dc2-ac4f-72986f9adcdc-kube-api-access-nc9t7 podName:7fb5709e-946d-4dc2-ac4f-72986f9adcdc nodeName:}" failed. No retries permitted until 2026-06-15 05:49:11.196907811 +0000 UTC m=+34.156665041 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-nc9t7" (UniqueName: "kubernetes.io/projected/7fb5709e-946d-4dc2-ac4f-72986f9adcdc-kube-api-access-nc9t7") pod "network-check-target-gbdt4" (UID: "7fb5709e-946d-4dc2-ac4f-72986f9adcdc") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jun 15 05:48:55.436099 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:48:55.436002    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gbdt4"
Jun 15 05:48:55.436099 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:48:55.436034    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hpg5s"
Jun 15 05:48:55.436099 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:48:55.436002    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cbmww"
Jun 15 05:48:55.436455 ip-10-0-128-243 kubenswrapper[2566]: E0615 05:48:55.436157    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gbdt4" podUID="7fb5709e-946d-4dc2-ac4f-72986f9adcdc"
Jun 15 05:48:55.436455 ip-10-0-128-243 kubenswrapper[2566]: E0615 05:48:55.436299    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cbmww" podUID="d81bd047-22fb-452e-b2d2-073f232701c2"
Jun 15 05:48:55.436455 ip-10-0-128-243 kubenswrapper[2566]: E0615 05:48:55.436375    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hpg5s" podUID="7a806cb5-1d94-4558-9a7a-a734123af31b"
Jun 15 05:48:57.436969 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:48:57.436928    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hpg5s"
Jun 15 05:48:57.437431 ip-10-0-128-243 kubenswrapper[2566]: E0615 05:48:57.437034    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hpg5s" podUID="7a806cb5-1d94-4558-9a7a-a734123af31b"
Jun 15 05:48:57.437431 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:48:57.437132    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gbdt4"
Jun 15 05:48:57.437431 ip-10-0-128-243 kubenswrapper[2566]: E0615 05:48:57.437236    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gbdt4" podUID="7fb5709e-946d-4dc2-ac4f-72986f9adcdc"
Jun 15 05:48:57.437431 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:48:57.437283    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cbmww"
Jun 15 05:48:57.437431 ip-10-0-128-243 kubenswrapper[2566]: E0615 05:48:57.437367    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cbmww" podUID="d81bd047-22fb-452e-b2d2-073f232701c2"
Jun 15 05:48:59.437022 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:48:59.436236    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hpg5s"
Jun 15 05:48:59.437022 ip-10-0-128-243 kubenswrapper[2566]: E0615 05:48:59.436357    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hpg5s" podUID="7a806cb5-1d94-4558-9a7a-a734123af31b"
Jun 15 05:48:59.437022 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:48:59.436710    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cbmww"
Jun 15 05:48:59.437022 ip-10-0-128-243 kubenswrapper[2566]: E0615 05:48:59.436810    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cbmww" podUID="d81bd047-22fb-452e-b2d2-073f232701c2"
Jun 15 05:48:59.437022 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:48:59.436878    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gbdt4"
Jun 15 05:48:59.437022 ip-10-0-128-243 kubenswrapper[2566]: E0615 05:48:59.436943    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gbdt4" podUID="7fb5709e-946d-4dc2-ac4f-72986f9adcdc"
Jun 15 05:48:59.528067 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:48:59.528039    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-6zzmq" event={"ID":"ed7324e7-cd07-4862-ba38-dfb225591afd","Type":"ContainerStarted","Data":"2bdc68e599cfb54206ac1a8e4120aaadee4eb4860375b50d7b9461d3703006d7"}
Jun 15 05:48:59.529514 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:48:59.529490    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-c5vrl" event={"ID":"0246685c-f9e4-45b0-bb3f-b17957621809","Type":"ContainerStarted","Data":"ef4709d84a2b7cb73b4aa4bfe103362781af9051319cf57237b438acae562be6"}
Jun 15 05:48:59.531205 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:48:59.531174    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-frzbm" event={"ID":"2e630a88-8b65-4dd7-970d-cfd8e5d031c6","Type":"ContainerStarted","Data":"e552a02cfa2cc9c8833964253b5e805b695a25da526d5f5f8775795b0bfb13c6"}
Jun 15 05:48:59.532591 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:48:59.532569    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pwcsh" event={"ID":"d0cff6b1-26d2-4059-a556-347772ca0557","Type":"ContainerStarted","Data":"3e5d1081ad8fa31cee5d97d2ecf66a8f89f07d5dc8b59e71f4a9992658b3fa47"}
Jun 15 05:48:59.533963 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:48:59.533937    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-f4bzh" event={"ID":"5a1f8f83-55db-4fc7-872d-6b202daa0a31","Type":"ContainerStarted","Data":"42a9275a7c44714c145ac3947e54eb394471cbd660d3a810d8eab9810c2bee82"}
Jun 15 05:48:59.535255 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:48:59.535234    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-jk5fv" event={"ID":"2bfcdbc6-e206-4efc-8342-4b2a949e9111","Type":"ContainerStarted","Data":"73373c393d90af0cda4af94f84dc68680ced324efbe45aaeda9b941d1d97c8d2"}
Jun 15 05:48:59.537907 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:48:59.537886    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-xv9fc" event={"ID":"9b076565-1f97-4867-a59b-23315d842e4e","Type":"ContainerStarted","Data":"920840ab7689f1a47b7328b16cd70d3b965a06b717b4bc6d62cace28f90ac4d9"}
Jun 15 05:48:59.539658 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:48:59.539641    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-n8bz5" event={"ID":"c1ebb64e-4a47-4507-b619-32502fb528ca","Type":"ContainerStarted","Data":"5b99fa1887d3b4f784f8a038b671b9f2f73d4a404a4f73ed8db0fb731a938148"}
Jun 15 05:48:59.548026 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:48:59.547987    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-243.ec2.internal" podStartSLOduration=21.547975895 podStartE2EDuration="21.547975895s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-15 05:48:38 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 05:48:42.517815896 +0000 UTC m=+5.477573142" watchObservedRunningTime="2026-06-15 05:48:59.547975895 +0000 UTC m=+22.507733189"
Jun 15 05:48:59.569027 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:48:59.568989    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-6zzmq" podStartSLOduration=3.688550127 podStartE2EDuration="22.568976086s" totalImagesPullingTime="18.880425959s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-15 05:48:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 05:48:59.547559738 +0000 UTC m=+22.507316994" watchObservedRunningTime="2026-06-15 05:48:59.568976086 +0000 UTC m=+22.528733330"
Jun 15 05:48:59.586262 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:48:59.586221    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-xv9fc" podStartSLOduration=3.742909549 podStartE2EDuration="22.586212034s" totalImagesPullingTime="18.843302485s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-15 05:48:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 05:48:59.58610571 +0000 UTC m=+22.545862956" watchObservedRunningTime="2026-06-15 05:48:59.586212034 +0000 UTC m=+22.545969279"
Jun 15 05:48:59.606764 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:48:59.606715    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-n8bz5" podStartSLOduration=3.748140219 podStartE2EDuration="22.606696418s" totalImagesPullingTime="18.858556199s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-15 05:48:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 05:48:59.606685369 +0000 UTC m=+22.566442615" watchObservedRunningTime="2026-06-15 05:48:59.606696418 +0000 UTC m=+22.566453666"
Jun 15 05:48:59.624518 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:48:59.624479    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-frzbm" podStartSLOduration=3.773704126 podStartE2EDuration="22.624466762s" totalImagesPullingTime="18.850762636s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-15 05:48:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 05:48:59.624072746 +0000 UTC m=+22.583829993" watchObservedRunningTime="2026-06-15 05:48:59.624466762 +0000 UTC m=+22.584224007"
Jun 15 05:48:59.645297 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:48:59.645258    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-jk5fv" podStartSLOduration=3.8007074259999998 podStartE2EDuration="22.645243354s" totalImagesPullingTime="18.844535928s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-15 05:48:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 05:48:59.644773005 +0000 UTC m=+22.604530249" watchObservedRunningTime="2026-06-15 05:48:59.645243354 +0000 UTC m=+22.605000599"
Jun 15 05:49:00.484796 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:49:00.484644    2566 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Jun 15 05:49:00.543277 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:49:00.543243    2566 generic.go:356] "Generic (PLEG): container finished" podID="0246685c-f9e4-45b0-bb3f-b17957621809" containerID="ef4709d84a2b7cb73b4aa4bfe103362781af9051319cf57237b438acae562be6" exitCode=0
Jun 15 05:49:00.543478 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:49:00.543335    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-c5vrl" event={"ID":"0246685c-f9e4-45b0-bb3f-b17957621809","Type":"ContainerDied","Data":"ef4709d84a2b7cb73b4aa4bfe103362781af9051319cf57237b438acae562be6"}
Jun 15 05:49:00.545183 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:49:00.545157    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pwcsh" event={"ID":"d0cff6b1-26d2-4059-a556-347772ca0557","Type":"ContainerStarted","Data":"33b33618cd6b38fa345db17b31c0a7be6b331317786b90d4f91c89301ca093da"}
Jun 15 05:49:00.548116 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:49:00.548094    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-f4bzh_5a1f8f83-55db-4fc7-872d-6b202daa0a31/ovn-acl-logging/0.log"
Jun 15 05:49:00.548458 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:49:00.548439    2566 generic.go:356] "Generic (PLEG): container finished" podID="5a1f8f83-55db-4fc7-872d-6b202daa0a31" containerID="ab4f7bc75522be72d42bf54c6a9e6d66f56e738c71e37e5b630cb0029575751d" exitCode=1
Jun 15 05:49:00.548535 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:49:00.548518    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-f4bzh" event={"ID":"5a1f8f83-55db-4fc7-872d-6b202daa0a31","Type":"ContainerStarted","Data":"786cec57de45b2bc5913d382197b5b926ce7b19f82c36f8dc3e5a6061c1b3cba"}
Jun 15 05:49:00.548594 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:49:00.548580    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-f4bzh" event={"ID":"5a1f8f83-55db-4fc7-872d-6b202daa0a31","Type":"ContainerStarted","Data":"0fbe2978fe7735cac4d3533a4bd2dfdc5b723b677260c674e51a5aeeefed0be2"}
Jun 15 05:49:00.548647 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:49:00.548618    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-f4bzh" event={"ID":"5a1f8f83-55db-4fc7-872d-6b202daa0a31","Type":"ContainerStarted","Data":"3b76faec6d69a57dbde2cd258098eab3cdd90eba742d5a405513dc62336f0066"}
Jun 15 05:49:00.548705 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:49:00.548652    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-f4bzh" event={"ID":"5a1f8f83-55db-4fc7-872d-6b202daa0a31","Type":"ContainerStarted","Data":"8754bee7fc499c30c7cc3637726ef9aa1ee82134d16f00ae8d2336156d086759"}
Jun 15 05:49:00.548705 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:49:00.548685    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-f4bzh" event={"ID":"5a1f8f83-55db-4fc7-872d-6b202daa0a31","Type":"ContainerDied","Data":"ab4f7bc75522be72d42bf54c6a9e6d66f56e738c71e37e5b630cb0029575751d"}
Jun 15 05:49:01.437847 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:49:01.437738    2566 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-06-15T05:49:00.484790496Z","UUID":"799aedd5-ea9e-48eb-8928-5b19400f24c3","Handler":null,"Name":"","Endpoint":""}
Jun 15 05:49:01.439441 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:49:01.439377    2566 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Jun 15 05:49:01.439441 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:49:01.439423    2566 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Jun 15 05:49:01.440141 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:49:01.439699    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hpg5s"
Jun 15 05:49:01.440141 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:49:01.439709    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cbmww"
Jun 15 05:49:01.440141 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:49:01.439821    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gbdt4"
Jun 15 05:49:01.440141 ip-10-0-128-243 kubenswrapper[2566]: E0615 05:49:01.439817    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hpg5s" podUID="7a806cb5-1d94-4558-9a7a-a734123af31b"
Jun 15 05:49:01.440141 ip-10-0-128-243 kubenswrapper[2566]: E0615 05:49:01.439913    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cbmww" podUID="d81bd047-22fb-452e-b2d2-073f232701c2"
Jun 15 05:49:01.440141 ip-10-0-128-243 kubenswrapper[2566]: E0615 05:49:01.440018    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gbdt4" podUID="7fb5709e-946d-4dc2-ac4f-72986f9adcdc"
Jun 15 05:49:01.552448 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:49:01.552423    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-srxml" event={"ID":"9decf7bb-f0b0-494e-8d78-52b86faff279","Type":"ContainerStarted","Data":"3bc43048a9452e40963922603fa5e188d8385b6820affba4298a5c09e4df0035"}
Jun 15 05:49:01.569383 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:49:01.569345    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-srxml" podStartSLOduration=5.720413397 podStartE2EDuration="24.569329031s" totalImagesPullingTime="18.848915634s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-15 05:48:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 05:49:01.568999762 +0000 UTC m=+24.528757007" watchObservedRunningTime="2026-06-15 05:49:01.569329031 +0000 UTC m=+24.529086275"
Jun 15 05:49:02.557990 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:49:02.557719    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pwcsh" event={"ID":"d0cff6b1-26d2-4059-a556-347772ca0557","Type":"ContainerStarted","Data":"46bb4828b9f94c59ad987c9c4094e542998f257ef8c9b3eca99fddac733dbc49"}
Jun 15 05:49:02.561189 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:49:02.561168    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-f4bzh_5a1f8f83-55db-4fc7-872d-6b202daa0a31/ovn-acl-logging/0.log"
Jun 15 05:49:02.561589 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:49:02.561561    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-f4bzh" event={"ID":"5a1f8f83-55db-4fc7-872d-6b202daa0a31","Type":"ContainerStarted","Data":"cd42bc778c1dd1657aafbda044962b04ca7a2fa05494f0721ac14069e08f375e"}
Jun 15 05:49:02.578891 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:49:02.578850    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pwcsh" podStartSLOduration=4.679864271 podStartE2EDuration="25.578833759s" totalImagesPullingTime="20.898969488s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-15 05:48:37 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 05:49:02.578359138 +0000 UTC m=+25.538116420" watchObservedRunningTime="2026-06-15 05:49:02.578833759 +0000 UTC m=+25.538591005"
Jun 15 05:49:03.435950 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:49:03.435922    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gbdt4"
Jun 15 05:49:03.436167 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:49:03.435987    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hpg5s"
Jun 15 05:49:03.436167 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:49:03.435992    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cbmww"
Jun 15 05:49:03.436167 ip-10-0-128-243 kubenswrapper[2566]: E0615 05:49:03.436096    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hpg5s" podUID="7a806cb5-1d94-4558-9a7a-a734123af31b"
Jun 15 05:49:03.436324 ip-10-0-128-243 kubenswrapper[2566]: E0615 05:49:03.436160    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gbdt4" podUID="7fb5709e-946d-4dc2-ac4f-72986f9adcdc"
Jun 15 05:49:03.436324 ip-10-0-128-243 kubenswrapper[2566]: E0615 05:49:03.436242    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cbmww" podUID="d81bd047-22fb-452e-b2d2-073f232701c2"
Jun 15 05:49:03.807414 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:49:03.807382    2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-xv9fc"
Jun 15 05:49:03.807991 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:49:03.807907    2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-xv9fc"
Jun 15 05:49:04.569002 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:49:04.568777    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-c5vrl" event={"ID":"0246685c-f9e4-45b0-bb3f-b17957621809","Type":"ContainerStarted","Data":"8ba7d69f3928bfa04d20f403e32af78e1794db611b47160f32bc2af6cb69c877"}
Jun 15 05:49:04.572881 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:49:04.572861    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-f4bzh_5a1f8f83-55db-4fc7-872d-6b202daa0a31/ovn-acl-logging/0.log"
Jun 15 05:49:04.573412 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:49:04.573387    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-f4bzh" event={"ID":"5a1f8f83-55db-4fc7-872d-6b202daa0a31","Type":"ContainerStarted","Data":"d10ea152f51dc983a33164c41ce80d7fca90af0011906ba102fdb5d5224122a3"}
Jun 15 05:49:04.573622 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:49:04.573600    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-xv9fc"
Jun 15 05:49:04.573880 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:49:04.573861    2566 scope.go:117] "RemoveContainer" containerID="ab4f7bc75522be72d42bf54c6a9e6d66f56e738c71e37e5b630cb0029575751d"
Jun 15 05:49:04.574323 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:49:04.574273    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-xv9fc"
Jun 15 05:49:05.436040 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:49:05.436014    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hpg5s"
Jun 15 05:49:05.436488 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:49:05.436014    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cbmww"
Jun 15 05:49:05.436488 ip-10-0-128-243 kubenswrapper[2566]: E0615 05:49:05.436137    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hpg5s" podUID="7a806cb5-1d94-4558-9a7a-a734123af31b"
Jun 15 05:49:05.436488 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:49:05.436014    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gbdt4"
Jun 15 05:49:05.436488 ip-10-0-128-243 kubenswrapper[2566]: E0615 05:49:05.436204    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cbmww" podUID="d81bd047-22fb-452e-b2d2-073f232701c2"
Jun 15 05:49:05.436488 ip-10-0-128-243 kubenswrapper[2566]: E0615 05:49:05.436284    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gbdt4" podUID="7fb5709e-946d-4dc2-ac4f-72986f9adcdc"
Jun 15 05:49:05.577588 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:49:05.577550    2566 generic.go:356] "Generic (PLEG): container finished" podID="0246685c-f9e4-45b0-bb3f-b17957621809" containerID="8ba7d69f3928bfa04d20f403e32af78e1794db611b47160f32bc2af6cb69c877" exitCode=0
Jun 15 05:49:05.577750 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:49:05.577640    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-c5vrl" event={"ID":"0246685c-f9e4-45b0-bb3f-b17957621809","Type":"ContainerDied","Data":"8ba7d69f3928bfa04d20f403e32af78e1794db611b47160f32bc2af6cb69c877"}
Jun 15 05:49:05.581577 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:49:05.581561    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-f4bzh_5a1f8f83-55db-4fc7-872d-6b202daa0a31/ovn-acl-logging/0.log"
Jun 15 05:49:05.581924 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:49:05.581900    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-f4bzh" event={"ID":"5a1f8f83-55db-4fc7-872d-6b202daa0a31","Type":"ContainerStarted","Data":"5560ef79c7a2f8edc52a95a3d1544afa01bcdd182b4ac100c19efc07b640812b"}
Jun 15 05:49:05.582169 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:49:05.582139    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-f4bzh"
Jun 15 05:49:05.582362 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:49:05.582344    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-f4bzh"
Jun 15 05:49:05.582426 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:49:05.582417    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-f4bzh"
Jun 15 05:49:05.597978 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:49:05.597961    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-f4bzh"
Jun 15 05:49:05.601469 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:49:05.601451    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-f4bzh"
Jun 15 05:49:05.666356 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:49:05.666242    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-f4bzh" podStartSLOduration=9.59250099 podStartE2EDuration="28.666223459s" totalImagesPullingTime="19.073722469s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-15 05:48:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 05:49:05.664364379 +0000 UTC m=+28.624121652" watchObservedRunningTime="2026-06-15 05:49:05.666223459 +0000 UTC m=+28.625980896"
Jun 15 05:49:06.413807 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:49:06.413785    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-hpg5s"]
Jun 15 05:49:06.413920 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:49:06.413874    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hpg5s"
Jun 15 05:49:06.414005 ip-10-0-128-243 kubenswrapper[2566]: E0615 05:49:06.413984    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hpg5s" podUID="7a806cb5-1d94-4558-9a7a-a734123af31b"
Jun 15 05:49:06.417755 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:49:06.417715    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-gbdt4"]
Jun 15 05:49:06.417874 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:49:06.417813    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gbdt4"
Jun 15 05:49:06.417938 ip-10-0-128-243 kubenswrapper[2566]: E0615 05:49:06.417915    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gbdt4" podUID="7fb5709e-946d-4dc2-ac4f-72986f9adcdc"
Jun 15 05:49:06.418387 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:49:06.418368    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-cbmww"]
Jun 15 05:49:06.418483 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:49:06.418457    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cbmww"
Jun 15 05:49:06.418577 ip-10-0-128-243 kubenswrapper[2566]: E0615 05:49:06.418560    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cbmww" podUID="d81bd047-22fb-452e-b2d2-073f232701c2"
Jun 15 05:49:06.589333 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:49:06.589246    2566 generic.go:356] "Generic (PLEG): container finished" podID="0246685c-f9e4-45b0-bb3f-b17957621809" containerID="229500e3fdae8de30b7ef24a13abe2f09a1ecb92875add3d38d5bad5d6b9e0e0" exitCode=0
Jun 15 05:49:06.589701 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:49:06.589338    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-c5vrl" event={"ID":"0246685c-f9e4-45b0-bb3f-b17957621809","Type":"ContainerDied","Data":"229500e3fdae8de30b7ef24a13abe2f09a1ecb92875add3d38d5bad5d6b9e0e0"}
Jun 15 05:49:07.436564 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:49:07.436490    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gbdt4"
Jun 15 05:49:07.436685 ip-10-0-128-243 kubenswrapper[2566]: E0615 05:49:07.436573    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gbdt4" podUID="7fb5709e-946d-4dc2-ac4f-72986f9adcdc"
Jun 15 05:49:07.593483 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:49:07.593450    2566 generic.go:356] "Generic (PLEG): container finished" podID="0246685c-f9e4-45b0-bb3f-b17957621809" containerID="72f18024ad5387ba95edb355339f99188c32d06c0787004400df9b9fcd101cbf" exitCode=0
Jun 15 05:49:07.593895 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:49:07.593531    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-c5vrl" event={"ID":"0246685c-f9e4-45b0-bb3f-b17957621809","Type":"ContainerDied","Data":"72f18024ad5387ba95edb355339f99188c32d06c0787004400df9b9fcd101cbf"}
Jun 15 05:49:08.436422 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:49:08.436380    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hpg5s"
Jun 15 05:49:08.436572 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:49:08.436432    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cbmww"
Jun 15 05:49:08.436572 ip-10-0-128-243 kubenswrapper[2566]: E0615 05:49:08.436516    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hpg5s" podUID="7a806cb5-1d94-4558-9a7a-a734123af31b"
Jun 15 05:49:08.436649 ip-10-0-128-243 kubenswrapper[2566]: E0615 05:49:08.436633    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cbmww" podUID="d81bd047-22fb-452e-b2d2-073f232701c2"
Jun 15 05:49:09.436175 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:49:09.435975    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gbdt4"
Jun 15 05:49:09.436594 ip-10-0-128-243 kubenswrapper[2566]: E0615 05:49:09.436251    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gbdt4" podUID="7fb5709e-946d-4dc2-ac4f-72986f9adcdc"
Jun 15 05:49:10.436063 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:49:10.436035    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hpg5s"
Jun 15 05:49:10.436063 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:49:10.436057    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cbmww"
Jun 15 05:49:10.436564 ip-10-0-128-243 kubenswrapper[2566]: E0615 05:49:10.436181    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hpg5s" podUID="7a806cb5-1d94-4558-9a7a-a734123af31b"
Jun 15 05:49:10.436564 ip-10-0-128-243 kubenswrapper[2566]: E0615 05:49:10.436250    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cbmww" podUID="d81bd047-22fb-452e-b2d2-073f232701c2"
Jun 15 05:49:11.109607 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:49:11.109568    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7a806cb5-1d94-4558-9a7a-a734123af31b-original-pull-secret\") pod \"global-pull-secret-syncer-hpg5s\" (UID: \"7a806cb5-1d94-4558-9a7a-a734123af31b\") " pod="kube-system/global-pull-secret-syncer-hpg5s"
Jun 15 05:49:11.109880 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:49:11.109627    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d81bd047-22fb-452e-b2d2-073f232701c2-metrics-certs\") pod \"network-metrics-daemon-cbmww\" (UID: \"d81bd047-22fb-452e-b2d2-073f232701c2\") " pod="openshift-multus/network-metrics-daemon-cbmww"
Jun 15 05:49:11.109880 ip-10-0-128-243 kubenswrapper[2566]: E0615 05:49:11.109740    2566 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jun 15 05:49:11.109880 ip-10-0-128-243 kubenswrapper[2566]: E0615 05:49:11.109741    2566 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jun 15 05:49:11.109880 ip-10-0-128-243 kubenswrapper[2566]: E0615 05:49:11.109803    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d81bd047-22fb-452e-b2d2-073f232701c2-metrics-certs podName:d81bd047-22fb-452e-b2d2-073f232701c2 nodeName:}" failed. No retries permitted until 2026-06-15 05:49:43.109783176 +0000 UTC m=+66.069540421 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d81bd047-22fb-452e-b2d2-073f232701c2-metrics-certs") pod "network-metrics-daemon-cbmww" (UID: "d81bd047-22fb-452e-b2d2-073f232701c2") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jun 15 05:49:11.109880 ip-10-0-128-243 kubenswrapper[2566]: E0615 05:49:11.109824    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7a806cb5-1d94-4558-9a7a-a734123af31b-original-pull-secret podName:7a806cb5-1d94-4558-9a7a-a734123af31b nodeName:}" failed. No retries permitted until 2026-06-15 05:49:43.109813695 +0000 UTC m=+66.069570932 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/7a806cb5-1d94-4558-9a7a-a734123af31b-original-pull-secret") pod "global-pull-secret-syncer-hpg5s" (UID: "7a806cb5-1d94-4558-9a7a-a734123af31b") : object "kube-system"/"original-pull-secret" not registered
Jun 15 05:49:11.211151 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:49:11.210886    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nc9t7\" (UniqueName: \"kubernetes.io/projected/7fb5709e-946d-4dc2-ac4f-72986f9adcdc-kube-api-access-nc9t7\") pod \"network-check-target-gbdt4\" (UID: \"7fb5709e-946d-4dc2-ac4f-72986f9adcdc\") " pod="openshift-network-diagnostics/network-check-target-gbdt4"
Jun 15 05:49:11.211151 ip-10-0-128-243 kubenswrapper[2566]: E0615 05:49:11.211130    2566 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jun 15 05:49:11.211151 ip-10-0-128-243 kubenswrapper[2566]: E0615 05:49:11.211154    2566 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jun 15 05:49:11.211412 ip-10-0-128-243 kubenswrapper[2566]: E0615 05:49:11.211168    2566 projected.go:196] Error preparing data for projected volume kube-api-access-nc9t7 for pod openshift-network-diagnostics/network-check-target-gbdt4: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jun 15 05:49:11.211412 ip-10-0-128-243 kubenswrapper[2566]: E0615 05:49:11.211236    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/7fb5709e-946d-4dc2-ac4f-72986f9adcdc-kube-api-access-nc9t7 podName:7fb5709e-946d-4dc2-ac4f-72986f9adcdc nodeName:}" failed. No retries permitted until 2026-06-15 05:49:43.211214824 +0000 UTC m=+66.170972051 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-nc9t7" (UniqueName: "kubernetes.io/projected/7fb5709e-946d-4dc2-ac4f-72986f9adcdc-kube-api-access-nc9t7") pod "network-check-target-gbdt4" (UID: "7fb5709e-946d-4dc2-ac4f-72986f9adcdc") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jun 15 05:49:11.436238 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:49:11.436155    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gbdt4"
Jun 15 05:49:11.436401 ip-10-0-128-243 kubenswrapper[2566]: E0615 05:49:11.436288    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gbdt4" podUID="7fb5709e-946d-4dc2-ac4f-72986f9adcdc"
Jun 15 05:49:12.350992 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:49:12.350966    2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-243.ec2.internal" event="NodeReady"
Jun 15 05:49:12.351185 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:49:12.351132    2566 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Jun 15 05:49:12.390809 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:49:12.390781    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-9547488fd-krhb7"]
Jun 15 05:49:12.424835 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:49:12.424807    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-8559c46f69-f7hlb"]
Jun 15 05:49:12.425728 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:49:12.425696    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-9547488fd-krhb7"
Jun 15 05:49:12.429950 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:49:12.429926    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\""
Jun 15 05:49:12.430788 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:49:12.430766    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\""
Jun 15 05:49:12.431190 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:49:12.431159    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-v69w4\""
Jun 15 05:49:12.431319 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:49:12.431301    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\""
Jun 15 05:49:12.440674 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:49:12.440654    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-7ccbfd59dc-42zqt"]
Jun 15 05:49:12.441114 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:49:12.440762    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cbmww"
Jun 15 05:49:12.441114 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:49:12.440762    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-8559c46f69-f7hlb"
Jun 15 05:49:12.441114 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:49:12.440866    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hpg5s"
Jun 15 05:49:12.444240 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:49:12.444221    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Jun 15 05:49:12.444338 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:49:12.444256    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Jun 15 05:49:12.444879 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:49:12.444858    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jun 15 05:49:12.445289 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:49:12.445269    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Jun 15 05:49:12.445485 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:49:12.445470    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-qnxfb\""
Jun 15 05:49:12.445679 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:49:12.445646    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jun 15 05:49:12.446887 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:49:12.446870    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-tqf9b\""
Jun 15 05:49:12.455545 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:49:12.455524    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-5bbd86d6bd-4bc2h"]
Jun 15 05:49:12.456605 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:49:12.456165    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-7ccbfd59dc-42zqt"
Jun 15 05:49:12.461123 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:49:12.460952    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\""
Jun 15 05:49:12.461231 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:49:12.461182    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\""
Jun 15 05:49:12.461700 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:49:12.461682    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\""
Jun 15 05:49:12.461823 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:49:12.461805    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-gxgv7\""
Jun 15 05:49:12.463642 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:49:12.463621    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\""
Jun 15 05:49:12.472702 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:49:12.472680    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Jun 15 05:49:12.481528 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:49:12.481507    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-bd4ccd799-2556x"]
Jun 15 05:49:12.481657 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:49:12.481639    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-5bbd86d6bd-4bc2h"
Jun 15 05:49:12.485195 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:49:12.484585    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-2glrg\""
Jun 15 05:49:12.485195 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:49:12.484746    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Jun 15 05:49:12.485195 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:49:12.485057    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Jun 15 05:49:12.485640 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:49:12.485618    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\""
Jun 15 05:49:12.490508 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:49:12.490488    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\""
Jun 15 05:49:12.493967 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:49:12.493948    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\""
Jun 15 05:49:12.502975 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:49:12.502956    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-9547488fd-krhb7"]
Jun 15 05:49:12.503102 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:49:12.503004    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-8559c46f69-f7hlb"]
Jun 15 05:49:12.503102 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:49:12.503023    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-bd4ccd799-2556x"]
Jun 15 05:49:12.503102 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:49:12.503040    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-7ccbfd59dc-42zqt"]
Jun 15 05:49:12.503102 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:49:12.503058    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-5bbd86d6bd-4bc2h"]
Jun 15 05:49:12.503102 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:49:12.503095    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-smfqb"]
Jun 15 05:49:12.503284 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:49:12.503134    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-bd4ccd799-2556x"
Jun 15 05:49:12.508546 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:49:12.508530    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-59qb4\""
Jun 15 05:49:12.508679 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:49:12.508600    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\""
Jun 15 05:49:12.509201 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:49:12.508988    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\""
Jun 15 05:49:12.521000 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:49:12.520979    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/0addacd9-d43e-43c0-8be8-608abc918f38-trusted-ca\") pod \"image-registry-8559c46f69-f7hlb\" (UID: \"0addacd9-d43e-43c0-8be8-608abc918f38\") " pod="openshift-image-registry/image-registry-8559c46f69-f7hlb"
Jun 15 05:49:12.521122 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:49:12.521004    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dw95z\" (UniqueName: \"kubernetes.io/projected/0addacd9-d43e-43c0-8be8-608abc918f38-kube-api-access-dw95z\") pod \"image-registry-8559c46f69-f7hlb\" (UID: \"0addacd9-d43e-43c0-8be8-608abc918f38\") " pod="openshift-image-registry/image-registry-8559c46f69-f7hlb"
Jun 15 05:49:12.521122 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:49:12.521029    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/0addacd9-d43e-43c0-8be8-608abc918f38-installation-pull-secrets\") pod \"image-registry-8559c46f69-f7hlb\" (UID: \"0addacd9-d43e-43c0-8be8-608abc918f38\") " pod="openshift-image-registry/image-registry-8559c46f69-f7hlb"
Jun 15 05:49:12.521122 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:49:12.521053    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/6771aa98-7d47-4ae5-b63e-7c6bb456a86b-config\") pod \"service-ca-operator-7ccbfd59dc-42zqt\" (UID: \"6771aa98-7d47-4ae5-b63e-7c6bb456a86b\") " pod="openshift-service-ca-operator/service-ca-operator-7ccbfd59dc-42zqt"
Jun 15 05:49:12.521122 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:49:12.521093    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kf6pj\" (UniqueName: \"kubernetes.io/projected/6771aa98-7d47-4ae5-b63e-7c6bb456a86b-kube-api-access-kf6pj\") pod \"service-ca-operator-7ccbfd59dc-42zqt\" (UID: \"6771aa98-7d47-4ae5-b63e-7c6bb456a86b\") " pod="openshift-service-ca-operator/service-ca-operator-7ccbfd59dc-42zqt"
Jun 15 05:49:12.521258 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:49:12.521122    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/0addacd9-d43e-43c0-8be8-608abc918f38-registry-tls\") pod \"image-registry-8559c46f69-f7hlb\" (UID: \"0addacd9-d43e-43c0-8be8-608abc918f38\") " pod="openshift-image-registry/image-registry-8559c46f69-f7hlb"
Jun 15 05:49:12.521258 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:49:12.521152    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/0addacd9-d43e-43c0-8be8-608abc918f38-ca-trust-extracted\") pod \"image-registry-8559c46f69-f7hlb\" (UID: \"0addacd9-d43e-43c0-8be8-608abc918f38\") " pod="openshift-image-registry/image-registry-8559c46f69-f7hlb"
Jun 15 05:49:12.521258 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:49:12.521171    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nh7xn\" (UniqueName: \"kubernetes.io/projected/7ed3b8df-025b-4073-95eb-c614783dac86-kube-api-access-nh7xn\") pod \"cluster-samples-operator-9547488fd-krhb7\" (UID: \"7ed3b8df-025b-4073-95eb-c614783dac86\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-9547488fd-krhb7"
Jun 15 05:49:12.521258 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:49:12.521198    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/6771aa98-7d47-4ae5-b63e-7c6bb456a86b-serving-cert\") pod \"service-ca-operator-7ccbfd59dc-42zqt\" (UID: \"6771aa98-7d47-4ae5-b63e-7c6bb456a86b\") " pod="openshift-service-ca-operator/service-ca-operator-7ccbfd59dc-42zqt"
Jun 15 05:49:12.521258 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:49:12.521237    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/0addacd9-d43e-43c0-8be8-608abc918f38-registry-certificates\") pod \"image-registry-8559c46f69-f7hlb\" (UID: \"0addacd9-d43e-43c0-8be8-608abc918f38\") " pod="openshift-image-registry/image-registry-8559c46f69-f7hlb"
Jun 15 05:49:12.521258 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:49:12.521252    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/0addacd9-d43e-43c0-8be8-608abc918f38-bound-sa-token\") pod \"image-registry-8559c46f69-f7hlb\" (UID: \"0addacd9-d43e-43c0-8be8-608abc918f38\") " pod="openshift-image-registry/image-registry-8559c46f69-f7hlb"
Jun 15 05:49:12.521429 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:49:12.521287    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/7ed3b8df-025b-4073-95eb-c614783dac86-samples-operator-tls\") pod \"cluster-samples-operator-9547488fd-krhb7\" (UID: \"7ed3b8df-025b-4073-95eb-c614783dac86\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-9547488fd-krhb7"
Jun 15 05:49:12.521429 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:49:12.521302    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/0addacd9-d43e-43c0-8be8-608abc918f38-image-registry-private-configuration\") pod \"image-registry-8559c46f69-f7hlb\" (UID: \"0addacd9-d43e-43c0-8be8-608abc918f38\") " pod="openshift-image-registry/image-registry-8559c46f69-f7hlb"
Jun 15 05:49:12.524310 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:49:12.523521    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-8bdfdcbd8-4fc26"]
Jun 15 05:49:12.524310 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:49:12.523595    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-smfqb"
Jun 15 05:49:12.526487 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:49:12.526464    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Jun 15 05:49:12.526592 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:49:12.526564    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Jun 15 05:49:12.527051 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:49:12.527035    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-bq244\""
Jun 15 05:49:12.541582 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:49:12.541563    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7c578b78fc-pr6nz"]
Jun 15 05:49:12.541705 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:49:12.541691    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-8bdfdcbd8-4fc26"
Jun 15 05:49:12.543953 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:49:12.543937    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\""
Jun 15 05:49:12.544030 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:49:12.543982    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\""
Jun 15 05:49:12.544243 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:49:12.544226    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\""
Jun 15 05:49:12.544336 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:49:12.544241    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Jun 15 05:49:12.544336 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:49:12.544295    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-nnlfr\""
Jun 15 05:49:12.544336 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:49:12.544228    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\""
Jun 15 05:49:12.544458 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:49:12.544341    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Jun 15 05:49:12.567364 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:49:12.567344    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7c578b78fc-pr6nz"
Jun 15 05:49:12.567364 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:49:12.567354    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-f9d7df769-jlxrk"]
Jun 15 05:49:12.570138 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:49:12.570066    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\""
Jun 15 05:49:12.570527 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:49:12.570180    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\""
Jun 15 05:49:12.570527 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:49:12.570243    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\""
Jun 15 05:49:12.570527 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:49:12.570255    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-28gm2\""
Jun 15 05:49:12.570527 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:49:12.570372    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\""
Jun 15 05:49:12.586488 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:49:12.586471    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-5dbbb5d744-ktjgp"]
Jun 15 05:49:12.586614 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:49:12.586599    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-f9d7df769-jlxrk"
Jun 15 05:49:12.588801 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:49:12.588783    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\""
Jun 15 05:49:12.588899 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:49:12.588884    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Jun 15 05:49:12.588969 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:49:12.588927    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Jun 15 05:49:12.589955 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:49:12.589938    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-7h65l\""
Jun 15 05:49:12.590038 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:49:12.589942    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\""
Jun 15 05:49:12.602216 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:49:12.602166    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-867b76cb74-qhtzq"]
Jun 15 05:49:12.602308 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:49:12.602269    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-5dbbb5d744-ktjgp"
Jun 15 05:49:12.605140 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:49:12.605073    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\""
Jun 15 05:49:12.605140 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:49:12.605114    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-j22qn\""
Jun 15 05:49:12.605256 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:49:12.605118    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\""
Jun 15 05:49:12.605396 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:49:12.605383    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\""
Jun 15 05:49:12.605439 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:49:12.605402    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\""
Jun 15 05:49:12.613724 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:49:12.613700    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\""
Jun 15 05:49:12.620265 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:49:12.620247    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-6947749cfc-lxqzc"]
Jun 15 05:49:12.620372 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:49:12.620358    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-867b76cb74-qhtzq"
Jun 15 05:49:12.622055 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:49:12.622034    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8pvh7\" (UniqueName: \"kubernetes.io/projected/3b8ee52d-b179-492b-960c-b978e06cd8a7-kube-api-access-8pvh7\") pod \"router-default-8bdfdcbd8-4fc26\" (UID: \"3b8ee52d-b179-492b-960c-b978e06cd8a7\") " pod="openshift-ingress/router-default-8bdfdcbd8-4fc26"
Jun 15 05:49:12.622144 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:49:12.622070    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/477f44b3-0328-417c-a5db-442ea835eb70-tmp-dir\") pod \"dns-default-smfqb\" (UID: \"477f44b3-0328-417c-a5db-442ea835eb70\") " pod="openshift-dns/dns-default-smfqb"
Jun 15 05:49:12.622144 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:49:12.622125    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6fqjj\" (UniqueName: \"kubernetes.io/projected/477f44b3-0328-417c-a5db-442ea835eb70-kube-api-access-6fqjj\") pod \"dns-default-smfqb\" (UID: \"477f44b3-0328-417c-a5db-442ea835eb70\") " pod="openshift-dns/dns-default-smfqb"
Jun 15 05:49:12.622242 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:49:12.622156    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/0addacd9-d43e-43c0-8be8-608abc918f38-ca-trust-extracted\") pod \"image-registry-8559c46f69-f7hlb\" (UID: \"0addacd9-d43e-43c0-8be8-608abc918f38\") " pod="openshift-image-registry/image-registry-8559c46f69-f7hlb"
Jun 15 05:49:12.622242 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:49:12.622181    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nh7xn\" (UniqueName: \"kubernetes.io/projected/7ed3b8df-025b-4073-95eb-c614783dac86-kube-api-access-nh7xn\") pod \"cluster-samples-operator-9547488fd-krhb7\" (UID: \"7ed3b8df-025b-4073-95eb-c614783dac86\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-9547488fd-krhb7"
Jun 15 05:49:12.622242 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:49:12.622204    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/477f44b3-0328-417c-a5db-442ea835eb70-config-volume\") pod \"dns-default-smfqb\" (UID: \"477f44b3-0328-417c-a5db-442ea835eb70\") " pod="openshift-dns/dns-default-smfqb"
Jun 15 05:49:12.622397 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:49:12.622242    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/0addacd9-d43e-43c0-8be8-608abc918f38-registry-certificates\") pod \"image-registry-8559c46f69-f7hlb\" (UID: \"0addacd9-d43e-43c0-8be8-608abc918f38\") " pod="openshift-image-registry/image-registry-8559c46f69-f7hlb"
Jun 15 05:49:12.622397 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:49:12.622269    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/3b8ee52d-b179-492b-960c-b978e06cd8a7-stats-auth\") pod \"router-default-8bdfdcbd8-4fc26\" (UID: \"3b8ee52d-b179-492b-960c-b978e06cd8a7\") " pod="openshift-ingress/router-default-8bdfdcbd8-4fc26"
Jun 15 05:49:12.622397 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:49:12.622288    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6cf65\" (UniqueName: \"kubernetes.io/projected/12ada117-da7b-47e4-bab9-92368a63edf8-kube-api-access-6cf65\") pod \"insights-operator-5bbd86d6bd-4bc2h\" (UID: \"12ada117-da7b-47e4-bab9-92368a63edf8\") " pod="openshift-insights/insights-operator-5bbd86d6bd-4bc2h"
Jun 15 05:49:12.622397 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:49:12.622315    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/0addacd9-d43e-43c0-8be8-608abc918f38-installation-pull-secrets\") pod \"image-registry-8559c46f69-f7hlb\" (UID: \"0addacd9-d43e-43c0-8be8-608abc918f38\") " pod="openshift-image-registry/image-registry-8559c46f69-f7hlb"
Jun 15 05:49:12.622397 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:49:12.622382    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/6771aa98-7d47-4ae5-b63e-7c6bb456a86b-config\") pod \"service-ca-operator-7ccbfd59dc-42zqt\" (UID: \"6771aa98-7d47-4ae5-b63e-7c6bb456a86b\") " pod="openshift-service-ca-operator/service-ca-operator-7ccbfd59dc-42zqt"
Jun 15 05:49:12.622635 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:49:12.622411    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/12ada117-da7b-47e4-bab9-92368a63edf8-tmp\") pod \"insights-operator-5bbd86d6bd-4bc2h\" (UID: \"12ada117-da7b-47e4-bab9-92368a63edf8\") " pod="openshift-insights/insights-operator-5bbd86d6bd-4bc2h"
Jun 15 05:49:12.622635 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:49:12.622438    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/12ada117-da7b-47e4-bab9-92368a63edf8-service-ca-bundle\") pod \"insights-operator-5bbd86d6bd-4bc2h\" (UID: \"12ada117-da7b-47e4-bab9-92368a63edf8\") " pod="openshift-insights/insights-operator-5bbd86d6bd-4bc2h"
Jun 15 05:49:12.622635 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:49:12.622459    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/477f44b3-0328-417c-a5db-442ea835eb70-metrics-tls\") pod \"dns-default-smfqb\" (UID: \"477f44b3-0328-417c-a5db-442ea835eb70\") " pod="openshift-dns/dns-default-smfqb"
Jun 15 05:49:12.622635 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:49:12.622487    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/3b8ee52d-b179-492b-960c-b978e06cd8a7-default-certificate\") pod \"router-default-8bdfdcbd8-4fc26\" (UID: \"3b8ee52d-b179-492b-960c-b978e06cd8a7\") " pod="openshift-ingress/router-default-8bdfdcbd8-4fc26"
Jun 15 05:49:12.622635 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:49:12.622517    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/12ada117-da7b-47e4-bab9-92368a63edf8-snapshots\") pod \"insights-operator-5bbd86d6bd-4bc2h\" (UID: \"12ada117-da7b-47e4-bab9-92368a63edf8\") " pod="openshift-insights/insights-operator-5bbd86d6bd-4bc2h"
Jun 15 05:49:12.622635 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:49:12.622575    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/6771aa98-7d47-4ae5-b63e-7c6bb456a86b-serving-cert\") pod \"service-ca-operator-7ccbfd59dc-42zqt\" (UID: \"6771aa98-7d47-4ae5-b63e-7c6bb456a86b\") " pod="openshift-service-ca-operator/service-ca-operator-7ccbfd59dc-42zqt"
Jun 15 05:49:12.622635 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:49:12.622609    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/0addacd9-d43e-43c0-8be8-608abc918f38-ca-trust-extracted\") pod \"image-registry-8559c46f69-f7hlb\" (UID: \"0addacd9-d43e-43c0-8be8-608abc918f38\") " pod="openshift-image-registry/image-registry-8559c46f69-f7hlb"
Jun 15 05:49:12.622970 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:49:12.622675    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\""
Jun 15 05:49:12.622970 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:49:12.622691    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\""
Jun 15 05:49:12.622970 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:49:12.622830    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-76djh\""
Jun 15 05:49:12.622970 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:49:12.622829    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/0addacd9-d43e-43c0-8be8-608abc918f38-registry-certificates\") pod \"image-registry-8559c46f69-f7hlb\" (UID: \"0addacd9-d43e-43c0-8be8-608abc918f38\") " pod="openshift-image-registry/image-registry-8559c46f69-f7hlb"
Jun 15 05:49:12.622970 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:49:12.622841    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/12ada117-da7b-47e4-bab9-92368a63edf8-serving-cert\") pod \"insights-operator-5bbd86d6bd-4bc2h\" (UID: \"12ada117-da7b-47e4-bab9-92368a63edf8\") " pod="openshift-insights/insights-operator-5bbd86d6bd-4bc2h"
Jun 15 05:49:12.622970 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:49:12.622866    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3b8ee52d-b179-492b-960c-b978e06cd8a7-metrics-certs\") pod \"router-default-8bdfdcbd8-4fc26\" (UID: \"3b8ee52d-b179-492b-960c-b978e06cd8a7\") " pod="openshift-ingress/router-default-8bdfdcbd8-4fc26"
Jun 15 05:49:12.622970 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:49:12.622926    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/0addacd9-d43e-43c0-8be8-608abc918f38-bound-sa-token\") pod \"image-registry-8559c46f69-f7hlb\" (UID: \"0addacd9-d43e-43c0-8be8-608abc918f38\") " pod="openshift-image-registry/image-registry-8559c46f69-f7hlb"
Jun 15 05:49:12.622970 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:49:12.622970    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/12ada117-da7b-47e4-bab9-92368a63edf8-trusted-ca-bundle\") pod \"insights-operator-5bbd86d6bd-4bc2h\" (UID: \"12ada117-da7b-47e4-bab9-92368a63edf8\") " pod="openshift-insights/insights-operator-5bbd86d6bd-4bc2h"
Jun 15 05:49:12.623353 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:49:12.622995    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3b8ee52d-b179-492b-960c-b978e06cd8a7-service-ca-bundle\") pod \"router-default-8bdfdcbd8-4fc26\" (UID: \"3b8ee52d-b179-492b-960c-b978e06cd8a7\") " pod="openshift-ingress/router-default-8bdfdcbd8-4fc26"
Jun 15 05:49:12.623353 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:49:12.623054    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/0addacd9-d43e-43c0-8be8-608abc918f38-trusted-ca\") pod \"image-registry-8559c46f69-f7hlb\" (UID: \"0addacd9-d43e-43c0-8be8-608abc918f38\") " pod="openshift-image-registry/image-registry-8559c46f69-f7hlb"
Jun 15 05:49:12.623353 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:49:12.623100    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dw95z\" (UniqueName: \"kubernetes.io/projected/0addacd9-d43e-43c0-8be8-608abc918f38-kube-api-access-dw95z\") pod \"image-registry-8559c46f69-f7hlb\" (UID: \"0addacd9-d43e-43c0-8be8-608abc918f38\") " pod="openshift-image-registry/image-registry-8559c46f69-f7hlb"
Jun 15 05:49:12.623353 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:49:12.623128    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j6p4t\" (UniqueName: \"kubernetes.io/projected/b1bd12ae-f8b5-4d48-bced-c60779b6f7c6-kube-api-access-j6p4t\") pod \"volume-data-source-validator-bd4ccd799-2556x\" (UID: \"b1bd12ae-f8b5-4d48-bced-c60779b6f7c6\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-bd4ccd799-2556x"
Jun 15 05:49:12.623353 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:49:12.623167    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/7ed3b8df-025b-4073-95eb-c614783dac86-samples-operator-tls\") pod \"cluster-samples-operator-9547488fd-krhb7\" (UID: \"7ed3b8df-025b-4073-95eb-c614783dac86\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-9547488fd-krhb7"
Jun 15 05:49:12.623353 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:49:12.623189    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/0addacd9-d43e-43c0-8be8-608abc918f38-image-registry-private-configuration\") pod \"image-registry-8559c46f69-f7hlb\" (UID: \"0addacd9-d43e-43c0-8be8-608abc918f38\") " pod="openshift-image-registry/image-registry-8559c46f69-f7hlb"
Jun 15 05:49:12.623353 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:49:12.623246    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kf6pj\" (UniqueName: \"kubernetes.io/projected/6771aa98-7d47-4ae5-b63e-7c6bb456a86b-kube-api-access-kf6pj\") pod \"service-ca-operator-7ccbfd59dc-42zqt\" (UID: \"6771aa98-7d47-4ae5-b63e-7c6bb456a86b\") " pod="openshift-service-ca-operator/service-ca-operator-7ccbfd59dc-42zqt"
Jun 15 05:49:12.623353 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:49:12.623274    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/0addacd9-d43e-43c0-8be8-608abc918f38-registry-tls\") pod \"image-registry-8559c46f69-f7hlb\" (UID: \"0addacd9-d43e-43c0-8be8-608abc918f38\") " pod="openshift-image-registry/image-registry-8559c46f69-f7hlb"
Jun 15 05:49:12.623353 ip-10-0-128-243 kubenswrapper[2566]: E0615 05:49:12.623290    2566 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jun 15 05:49:12.623724 ip-10-0-128-243 kubenswrapper[2566]: E0615 05:49:12.623374    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7ed3b8df-025b-4073-95eb-c614783dac86-samples-operator-tls podName:7ed3b8df-025b-4073-95eb-c614783dac86 nodeName:}" failed. No retries permitted until 2026-06-15 05:49:13.123354124 +0000 UTC m=+36.083111361 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/7ed3b8df-025b-4073-95eb-c614783dac86-samples-operator-tls") pod "cluster-samples-operator-9547488fd-krhb7" (UID: "7ed3b8df-025b-4073-95eb-c614783dac86") : secret "samples-operator-tls" not found
Jun 15 05:49:12.623724 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:49:12.623430    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/6771aa98-7d47-4ae5-b63e-7c6bb456a86b-config\") pod \"service-ca-operator-7ccbfd59dc-42zqt\" (UID: \"6771aa98-7d47-4ae5-b63e-7c6bb456a86b\") " pod="openshift-service-ca-operator/service-ca-operator-7ccbfd59dc-42zqt"
Jun 15 05:49:12.623724 ip-10-0-128-243 kubenswrapper[2566]: E0615 05:49:12.623440    2566 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jun 15 05:49:12.623724 ip-10-0-128-243 kubenswrapper[2566]: E0615 05:49:12.623452    2566 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-8559c46f69-f7hlb: secret "image-registry-tls" not found
Jun 15 05:49:12.623724 ip-10-0-128-243 kubenswrapper[2566]: E0615 05:49:12.623574    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0addacd9-d43e-43c0-8be8-608abc918f38-registry-tls podName:0addacd9-d43e-43c0-8be8-608abc918f38 nodeName:}" failed. No retries permitted until 2026-06-15 05:49:13.123557968 +0000 UTC m=+36.083315190 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/0addacd9-d43e-43c0-8be8-608abc918f38-registry-tls") pod "image-registry-8559c46f69-f7hlb" (UID: "0addacd9-d43e-43c0-8be8-608abc918f38") : secret "image-registry-tls" not found
Jun 15 05:49:12.623987 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:49:12.623965    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/0addacd9-d43e-43c0-8be8-608abc918f38-trusted-ca\") pod \"image-registry-8559c46f69-f7hlb\" (UID: \"0addacd9-d43e-43c0-8be8-608abc918f38\") " pod="openshift-image-registry/image-registry-8559c46f69-f7hlb"
Jun 15 05:49:12.627075 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:49:12.627044    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/6771aa98-7d47-4ae5-b63e-7c6bb456a86b-serving-cert\") pod \"service-ca-operator-7ccbfd59dc-42zqt\" (UID: \"6771aa98-7d47-4ae5-b63e-7c6bb456a86b\") " pod="openshift-service-ca-operator/service-ca-operator-7ccbfd59dc-42zqt"
Jun 15 05:49:12.627075 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:49:12.627111    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/0addacd9-d43e-43c0-8be8-608abc918f38-installation-pull-secrets\") pod \"image-registry-8559c46f69-f7hlb\" (UID: \"0addacd9-d43e-43c0-8be8-608abc918f38\") " pod="openshift-image-registry/image-registry-8559c46f69-f7hlb"
Jun 15 05:49:12.627075 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:49:12.627117    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/0addacd9-d43e-43c0-8be8-608abc918f38-image-registry-private-configuration\") pod \"image-registry-8559c46f69-f7hlb\" (UID: \"0addacd9-d43e-43c0-8be8-608abc918f38\") " pod="openshift-image-registry/image-registry-8559c46f69-f7hlb"
Jun 15 05:49:12.630719 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:49:12.630650    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nh7xn\" (UniqueName: \"kubernetes.io/projected/7ed3b8df-025b-4073-95eb-c614783dac86-kube-api-access-nh7xn\") pod \"cluster-samples-operator-9547488fd-krhb7\" (UID: \"7ed3b8df-025b-4073-95eb-c614783dac86\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-9547488fd-krhb7"
Jun 15 05:49:12.631779 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:49:12.631745    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dw95z\" (UniqueName: \"kubernetes.io/projected/0addacd9-d43e-43c0-8be8-608abc918f38-kube-api-access-dw95z\") pod \"image-registry-8559c46f69-f7hlb\" (UID: \"0addacd9-d43e-43c0-8be8-608abc918f38\") " pod="openshift-image-registry/image-registry-8559c46f69-f7hlb"
Jun 15 05:49:12.632506 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:49:12.632487    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/0addacd9-d43e-43c0-8be8-608abc918f38-bound-sa-token\") pod \"image-registry-8559c46f69-f7hlb\" (UID: \"0addacd9-d43e-43c0-8be8-608abc918f38\") " pod="openshift-image-registry/image-registry-8559c46f69-f7hlb"
Jun 15 05:49:12.632812 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:49:12.632793    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kf6pj\" (UniqueName: \"kubernetes.io/projected/6771aa98-7d47-4ae5-b63e-7c6bb456a86b-kube-api-access-kf6pj\") pod \"service-ca-operator-7ccbfd59dc-42zqt\" (UID: \"6771aa98-7d47-4ae5-b63e-7c6bb456a86b\") " pod="openshift-service-ca-operator/service-ca-operator-7ccbfd59dc-42zqt"
Jun 15 05:49:12.644841 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:49:12.644823    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-9gk6x"]
Jun 15 05:49:12.644934 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:49:12.644921    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-6947749cfc-lxqzc"
Jun 15 05:49:12.647584 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:49:12.647564    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jun 15 05:49:12.647668 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:49:12.647607    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-gxl6d\""
Jun 15 05:49:12.647668 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:49:12.647571    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jun 15 05:49:12.660787 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:49:12.660765    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-smfqb"]
Jun 15 05:49:12.660871 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:49:12.660808    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-867b76cb74-qhtzq"]
Jun 15 05:49:12.660871 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:49:12.660827    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-6947749cfc-lxqzc"]
Jun 15 05:49:12.660871 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:49:12.660847    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7c578b78fc-pr6nz"]
Jun 15 05:49:12.660871 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:49:12.660860    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-f9d7df769-jlxrk"]
Jun 15 05:49:12.660871 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:49:12.660868    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-9gk6x"
Jun 15 05:49:12.661017 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:49:12.660871    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-8bdfdcbd8-4fc26"]
Jun 15 05:49:12.661017 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:49:12.660998    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-5dbbb5d744-ktjgp"]
Jun 15 05:49:12.661104 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:49:12.661025    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-9gk6x"]
Jun 15 05:49:12.666898 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:49:12.666880    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Jun 15 05:49:12.667309 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:49:12.667288    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Jun 15 05:49:12.667409 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:49:12.667360    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-f5wbk\""
Jun 15 05:49:12.667514 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:49:12.667501    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Jun 15 05:49:12.724391 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:49:12.724363    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jpclz\" (UniqueName: \"kubernetes.io/projected/ab71270c-39e2-4162-864c-4f1515189432-kube-api-access-jpclz\") pod \"network-check-source-6947749cfc-lxqzc\" (UID: \"ab71270c-39e2-4162-864c-4f1515189432\") " pod="openshift-network-diagnostics/network-check-source-6947749cfc-lxqzc"
Jun 15 05:49:12.724523 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:49:12.724396    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/477f44b3-0328-417c-a5db-442ea835eb70-config-volume\") pod \"dns-default-smfqb\" (UID: \"477f44b3-0328-417c-a5db-442ea835eb70\") " pod="openshift-dns/dns-default-smfqb"
Jun 15 05:49:12.724523 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:49:12.724427    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/dc5c749d-22b4-461f-8c24-9da0f33c52f7-cert\") pod \"ingress-canary-9gk6x\" (UID: \"dc5c749d-22b4-461f-8c24-9da0f33c52f7\") " pod="openshift-ingress-canary/ingress-canary-9gk6x"
Jun 15 05:49:12.724523 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:49:12.724443    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/90916cd7-e2d5-4583-b5d6-8b254c9d091d-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-f9d7df769-jlxrk\" (UID: \"90916cd7-e2d5-4583-b5d6-8b254c9d091d\") " pod="openshift-monitoring/cluster-monitoring-operator-f9d7df769-jlxrk"
Jun 15 05:49:12.724523 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:49:12.724506    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/3b8ee52d-b179-492b-960c-b978e06cd8a7-stats-auth\") pod \"router-default-8bdfdcbd8-4fc26\" (UID: \"3b8ee52d-b179-492b-960c-b978e06cd8a7\") " pod="openshift-ingress/router-default-8bdfdcbd8-4fc26"
Jun 15 05:49:12.724721 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:49:12.724579    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6cf65\" (UniqueName: \"kubernetes.io/projected/12ada117-da7b-47e4-bab9-92368a63edf8-kube-api-access-6cf65\") pod \"insights-operator-5bbd86d6bd-4bc2h\" (UID: \"12ada117-da7b-47e4-bab9-92368a63edf8\") " pod="openshift-insights/insights-operator-5bbd86d6bd-4bc2h"
Jun 15 05:49:12.724721 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:49:12.724614    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gm7h6\" (UniqueName: \"kubernetes.io/projected/dc5c749d-22b4-461f-8c24-9da0f33c52f7-kube-api-access-gm7h6\") pod \"ingress-canary-9gk6x\" (UID: \"dc5c749d-22b4-461f-8c24-9da0f33c52f7\") " pod="openshift-ingress-canary/ingress-canary-9gk6x"
Jun 15 05:49:12.724721 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:49:12.724647    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/12ada117-da7b-47e4-bab9-92368a63edf8-tmp\") pod \"insights-operator-5bbd86d6bd-4bc2h\" (UID: \"12ada117-da7b-47e4-bab9-92368a63edf8\") " pod="openshift-insights/insights-operator-5bbd86d6bd-4bc2h"
Jun 15 05:49:12.724721 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:49:12.724676    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/18d62d01-84af-4660-af23-86aebdd4f714-nginx-conf\") pod \"networking-console-plugin-867b76cb74-qhtzq\" (UID: \"18d62d01-84af-4660-af23-86aebdd4f714\") " pod="openshift-network-console/networking-console-plugin-867b76cb74-qhtzq"
Jun 15 05:49:12.724721 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:49:12.724707    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/12ada117-da7b-47e4-bab9-92368a63edf8-service-ca-bundle\") pod \"insights-operator-5bbd86d6bd-4bc2h\" (UID: \"12ada117-da7b-47e4-bab9-92368a63edf8\") " pod="openshift-insights/insights-operator-5bbd86d6bd-4bc2h"
Jun 15 05:49:12.724977 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:49:12.724732    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/477f44b3-0328-417c-a5db-442ea835eb70-metrics-tls\") pod \"dns-default-smfqb\" (UID: \"477f44b3-0328-417c-a5db-442ea835eb70\") " pod="openshift-dns/dns-default-smfqb"
Jun 15 05:49:12.724977 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:49:12.724762    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/3b8ee52d-b179-492b-960c-b978e06cd8a7-default-certificate\") pod \"router-default-8bdfdcbd8-4fc26\" (UID: \"3b8ee52d-b179-492b-960c-b978e06cd8a7\") " pod="openshift-ingress/router-default-8bdfdcbd8-4fc26"
Jun 15 05:49:12.724977 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:49:12.724790    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-glsds\" (UniqueName: \"kubernetes.io/projected/90916cd7-e2d5-4583-b5d6-8b254c9d091d-kube-api-access-glsds\") pod \"cluster-monitoring-operator-f9d7df769-jlxrk\" (UID: \"90916cd7-e2d5-4583-b5d6-8b254c9d091d\") " pod="openshift-monitoring/cluster-monitoring-operator-f9d7df769-jlxrk"
Jun 15 05:49:12.724977 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:49:12.724817    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/0ed3f738-1daf-4d28-8c14-3c7b5139e7dd-config\") pod \"kube-storage-version-migrator-operator-7c578b78fc-pr6nz\" (UID: \"0ed3f738-1daf-4d28-8c14-3c7b5139e7dd\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7c578b78fc-pr6nz"
Jun 15 05:49:12.724977 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:49:12.724842    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wvnqf\" (UniqueName: \"kubernetes.io/projected/0ed3f738-1daf-4d28-8c14-3c7b5139e7dd-kube-api-access-wvnqf\") pod \"kube-storage-version-migrator-operator-7c578b78fc-pr6nz\" (UID: \"0ed3f738-1daf-4d28-8c14-3c7b5139e7dd\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7c578b78fc-pr6nz"
Jun 15 05:49:12.724977 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:49:12.724874    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/12ada117-da7b-47e4-bab9-92368a63edf8-snapshots\") pod \"insights-operator-5bbd86d6bd-4bc2h\" (UID: \"12ada117-da7b-47e4-bab9-92368a63edf8\") " pod="openshift-insights/insights-operator-5bbd86d6bd-4bc2h"
Jun 15 05:49:12.724977 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:49:12.724934    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cbzmb\" (UniqueName: \"kubernetes.io/projected/67da60eb-27f9-4bbd-8d12-64275e801143-kube-api-access-cbzmb\") pod \"console-operator-5dbbb5d744-ktjgp\" (UID: \"67da60eb-27f9-4bbd-8d12-64275e801143\") " pod="openshift-console-operator/console-operator-5dbbb5d744-ktjgp"
Jun 15 05:49:12.724977 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:49:12.724969    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/12ada117-da7b-47e4-bab9-92368a63edf8-serving-cert\") pod \"insights-operator-5bbd86d6bd-4bc2h\" (UID: \"12ada117-da7b-47e4-bab9-92368a63edf8\") " pod="openshift-insights/insights-operator-5bbd86d6bd-4bc2h"
Jun 15 05:49:12.725354 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:49:12.724994    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3b8ee52d-b179-492b-960c-b978e06cd8a7-metrics-certs\") pod \"router-default-8bdfdcbd8-4fc26\" (UID: \"3b8ee52d-b179-492b-960c-b978e06cd8a7\") " pod="openshift-ingress/router-default-8bdfdcbd8-4fc26"
Jun 15 05:49:12.725354 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:49:12.725026    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/90916cd7-e2d5-4583-b5d6-8b254c9d091d-telemetry-config\") pod \"cluster-monitoring-operator-f9d7df769-jlxrk\" (UID: \"90916cd7-e2d5-4583-b5d6-8b254c9d091d\") " pod="openshift-monitoring/cluster-monitoring-operator-f9d7df769-jlxrk"
Jun 15 05:49:12.725354 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:49:12.725039    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/12ada117-da7b-47e4-bab9-92368a63edf8-tmp\") pod \"insights-operator-5bbd86d6bd-4bc2h\" (UID: \"12ada117-da7b-47e4-bab9-92368a63edf8\") " pod="openshift-insights/insights-operator-5bbd86d6bd-4bc2h"
Jun 15 05:49:12.725354 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:49:12.725053    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/477f44b3-0328-417c-a5db-442ea835eb70-config-volume\") pod \"dns-default-smfqb\" (UID: \"477f44b3-0328-417c-a5db-442ea835eb70\") " pod="openshift-dns/dns-default-smfqb"
Jun 15 05:49:12.725354 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:49:12.725056    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/18d62d01-84af-4660-af23-86aebdd4f714-networking-console-plugin-cert\") pod \"networking-console-plugin-867b76cb74-qhtzq\" (UID: \"18d62d01-84af-4660-af23-86aebdd4f714\") " pod="openshift-network-console/networking-console-plugin-867b76cb74-qhtzq"
Jun 15 05:49:12.725354 ip-10-0-128-243 kubenswrapper[2566]: E0615 05:49:12.725055    2566 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jun 15 05:49:12.725354 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:49:12.725189    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/12ada117-da7b-47e4-bab9-92368a63edf8-trusted-ca-bundle\") pod \"insights-operator-5bbd86d6bd-4bc2h\" (UID: \"12ada117-da7b-47e4-bab9-92368a63edf8\") " pod="openshift-insights/insights-operator-5bbd86d6bd-4bc2h"
Jun 15 05:49:12.725354 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:49:12.725230    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3b8ee52d-b179-492b-960c-b978e06cd8a7-service-ca-bundle\") pod \"router-default-8bdfdcbd8-4fc26\" (UID: \"3b8ee52d-b179-492b-960c-b978e06cd8a7\") " pod="openshift-ingress/router-default-8bdfdcbd8-4fc26"
Jun 15 05:49:12.725354 ip-10-0-128-243 kubenswrapper[2566]: E0615 05:49:12.725240    2566 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jun 15 05:49:12.725354 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:49:12.725260    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/0ed3f738-1daf-4d28-8c14-3c7b5139e7dd-serving-cert\") pod \"kube-storage-version-migrator-operator-7c578b78fc-pr6nz\" (UID: \"0ed3f738-1daf-4d28-8c14-3c7b5139e7dd\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7c578b78fc-pr6nz"
Jun 15 05:49:12.725354 ip-10-0-128-243 kubenswrapper[2566]: E0615 05:49:12.725302    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3b8ee52d-b179-492b-960c-b978e06cd8a7-metrics-certs podName:3b8ee52d-b179-492b-960c-b978e06cd8a7 nodeName:}" failed. No retries permitted until 2026-06-15 05:49:13.225285021 +0000 UTC m=+36.185042270 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3b8ee52d-b179-492b-960c-b978e06cd8a7-metrics-certs") pod "router-default-8bdfdcbd8-4fc26" (UID: "3b8ee52d-b179-492b-960c-b978e06cd8a7") : secret "router-metrics-certs-default" not found
Jun 15 05:49:12.725354 ip-10-0-128-243 kubenswrapper[2566]: E0615 05:49:12.725344    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/477f44b3-0328-417c-a5db-442ea835eb70-metrics-tls podName:477f44b3-0328-417c-a5db-442ea835eb70 nodeName:}" failed. No retries permitted until 2026-06-15 05:49:13.22533003 +0000 UTC m=+36.185087254 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/477f44b3-0328-417c-a5db-442ea835eb70-metrics-tls") pod "dns-default-smfqb" (UID: "477f44b3-0328-417c-a5db-442ea835eb70") : secret "dns-default-metrics-tls" not found
Jun 15 05:49:12.725965 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:49:12.725375    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j6p4t\" (UniqueName: \"kubernetes.io/projected/b1bd12ae-f8b5-4d48-bced-c60779b6f7c6-kube-api-access-j6p4t\") pod \"volume-data-source-validator-bd4ccd799-2556x\" (UID: \"b1bd12ae-f8b5-4d48-bced-c60779b6f7c6\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-bd4ccd799-2556x"
Jun 15 05:49:12.725965 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:49:12.725458    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8pvh7\" (UniqueName: \"kubernetes.io/projected/3b8ee52d-b179-492b-960c-b978e06cd8a7-kube-api-access-8pvh7\") pod \"router-default-8bdfdcbd8-4fc26\" (UID: \"3b8ee52d-b179-492b-960c-b978e06cd8a7\") " pod="openshift-ingress/router-default-8bdfdcbd8-4fc26"
Jun 15 05:49:12.725965 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:49:12.725474    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/12ada117-da7b-47e4-bab9-92368a63edf8-snapshots\") pod \"insights-operator-5bbd86d6bd-4bc2h\" (UID: \"12ada117-da7b-47e4-bab9-92368a63edf8\") " pod="openshift-insights/insights-operator-5bbd86d6bd-4bc2h"
Jun 15 05:49:12.725965 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:49:12.725485    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/67da60eb-27f9-4bbd-8d12-64275e801143-serving-cert\") pod \"console-operator-5dbbb5d744-ktjgp\" (UID: \"67da60eb-27f9-4bbd-8d12-64275e801143\") " pod="openshift-console-operator/console-operator-5dbbb5d744-ktjgp"
Jun 15 05:49:12.725965 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:49:12.725510    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/477f44b3-0328-417c-a5db-442ea835eb70-tmp-dir\") pod \"dns-default-smfqb\" (UID: \"477f44b3-0328-417c-a5db-442ea835eb70\") " pod="openshift-dns/dns-default-smfqb"
Jun 15 05:49:12.725965 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:49:12.725527    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/12ada117-da7b-47e4-bab9-92368a63edf8-service-ca-bundle\") pod \"insights-operator-5bbd86d6bd-4bc2h\" (UID: \"12ada117-da7b-47e4-bab9-92368a63edf8\") " pod="openshift-insights/insights-operator-5bbd86d6bd-4bc2h"
Jun 15 05:49:12.725965 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:49:12.725536    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/67da60eb-27f9-4bbd-8d12-64275e801143-trusted-ca\") pod \"console-operator-5dbbb5d744-ktjgp\" (UID: \"67da60eb-27f9-4bbd-8d12-64275e801143\") " pod="openshift-console-operator/console-operator-5dbbb5d744-ktjgp"
Jun 15 05:49:12.725965 ip-10-0-128-243 kubenswrapper[2566]: E0615 05:49:12.725696    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/3b8ee52d-b179-492b-960c-b978e06cd8a7-service-ca-bundle podName:3b8ee52d-b179-492b-960c-b978e06cd8a7 nodeName:}" failed. No retries permitted until 2026-06-15 05:49:13.225679916 +0000 UTC m=+36.185437156 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/3b8ee52d-b179-492b-960c-b978e06cd8a7-service-ca-bundle") pod "router-default-8bdfdcbd8-4fc26" (UID: "3b8ee52d-b179-492b-960c-b978e06cd8a7") : configmap references non-existent config key: service-ca.crt
Jun 15 05:49:12.725965 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:49:12.725839    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/477f44b3-0328-417c-a5db-442ea835eb70-tmp-dir\") pod \"dns-default-smfqb\" (UID: \"477f44b3-0328-417c-a5db-442ea835eb70\") " pod="openshift-dns/dns-default-smfqb"
Jun 15 05:49:12.725965 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:49:12.725902    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6fqjj\" (UniqueName: \"kubernetes.io/projected/477f44b3-0328-417c-a5db-442ea835eb70-kube-api-access-6fqjj\") pod \"dns-default-smfqb\" (UID: \"477f44b3-0328-417c-a5db-442ea835eb70\") " pod="openshift-dns/dns-default-smfqb"
Jun 15 05:49:12.726446 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:49:12.726041    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/67da60eb-27f9-4bbd-8d12-64275e801143-config\") pod \"console-operator-5dbbb5d744-ktjgp\" (UID: \"67da60eb-27f9-4bbd-8d12-64275e801143\") " pod="openshift-console-operator/console-operator-5dbbb5d744-ktjgp"
Jun 15 05:49:12.726446 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:49:12.726316    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/12ada117-da7b-47e4-bab9-92368a63edf8-trusted-ca-bundle\") pod \"insights-operator-5bbd86d6bd-4bc2h\" (UID: \"12ada117-da7b-47e4-bab9-92368a63edf8\") " pod="openshift-insights/insights-operator-5bbd86d6bd-4bc2h"
Jun 15 05:49:12.727366 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:49:12.727334    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/3b8ee52d-b179-492b-960c-b978e06cd8a7-default-certificate\") pod \"router-default-8bdfdcbd8-4fc26\" (UID: \"3b8ee52d-b179-492b-960c-b978e06cd8a7\") " pod="openshift-ingress/router-default-8bdfdcbd8-4fc26"
Jun 15 05:49:12.727606 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:49:12.727589    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/3b8ee52d-b179-492b-960c-b978e06cd8a7-stats-auth\") pod \"router-default-8bdfdcbd8-4fc26\" (UID: \"3b8ee52d-b179-492b-960c-b978e06cd8a7\") " pod="openshift-ingress/router-default-8bdfdcbd8-4fc26"
Jun 15 05:49:12.727729 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:49:12.727703    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/12ada117-da7b-47e4-bab9-92368a63edf8-serving-cert\") pod \"insights-operator-5bbd86d6bd-4bc2h\" (UID: \"12ada117-da7b-47e4-bab9-92368a63edf8\") " pod="openshift-insights/insights-operator-5bbd86d6bd-4bc2h"
Jun 15 05:49:12.735166 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:49:12.735144    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6cf65\" (UniqueName: \"kubernetes.io/projected/12ada117-da7b-47e4-bab9-92368a63edf8-kube-api-access-6cf65\") pod \"insights-operator-5bbd86d6bd-4bc2h\" (UID: \"12ada117-da7b-47e4-bab9-92368a63edf8\") " pod="openshift-insights/insights-operator-5bbd86d6bd-4bc2h"
Jun 15 05:49:12.735166 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:49:12.735153    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8pvh7\" (UniqueName: \"kubernetes.io/projected/3b8ee52d-b179-492b-960c-b978e06cd8a7-kube-api-access-8pvh7\") pod \"router-default-8bdfdcbd8-4fc26\" (UID: \"3b8ee52d-b179-492b-960c-b978e06cd8a7\") " pod="openshift-ingress/router-default-8bdfdcbd8-4fc26"
Jun 15 05:49:12.735601 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:49:12.735587    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-j6p4t\" (UniqueName: \"kubernetes.io/projected/b1bd12ae-f8b5-4d48-bced-c60779b6f7c6-kube-api-access-j6p4t\") pod \"volume-data-source-validator-bd4ccd799-2556x\" (UID: \"b1bd12ae-f8b5-4d48-bced-c60779b6f7c6\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-bd4ccd799-2556x"
Jun 15 05:49:12.744698 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:49:12.744680    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6fqjj\" (UniqueName: \"kubernetes.io/projected/477f44b3-0328-417c-a5db-442ea835eb70-kube-api-access-6fqjj\") pod \"dns-default-smfqb\" (UID: \"477f44b3-0328-417c-a5db-442ea835eb70\") " pod="openshift-dns/dns-default-smfqb"
Jun 15 05:49:12.774114 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:49:12.774092    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-7ccbfd59dc-42zqt"
Jun 15 05:49:12.792575 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:49:12.792557    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-5bbd86d6bd-4bc2h"
Jun 15 05:49:12.812911 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:49:12.812765    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-bd4ccd799-2556x"
Jun 15 05:49:12.827178 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:49:12.827145    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/67da60eb-27f9-4bbd-8d12-64275e801143-serving-cert\") pod \"console-operator-5dbbb5d744-ktjgp\" (UID: \"67da60eb-27f9-4bbd-8d12-64275e801143\") " pod="openshift-console-operator/console-operator-5dbbb5d744-ktjgp"
Jun 15 05:49:12.827293 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:49:12.827181    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/67da60eb-27f9-4bbd-8d12-64275e801143-trusted-ca\") pod \"console-operator-5dbbb5d744-ktjgp\" (UID: \"67da60eb-27f9-4bbd-8d12-64275e801143\") " pod="openshift-console-operator/console-operator-5dbbb5d744-ktjgp"
Jun 15 05:49:12.827293 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:49:12.827214    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/67da60eb-27f9-4bbd-8d12-64275e801143-config\") pod \"console-operator-5dbbb5d744-ktjgp\" (UID: \"67da60eb-27f9-4bbd-8d12-64275e801143\") " pod="openshift-console-operator/console-operator-5dbbb5d744-ktjgp"
Jun 15 05:49:12.827293 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:49:12.827239    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jpclz\" (UniqueName: \"kubernetes.io/projected/ab71270c-39e2-4162-864c-4f1515189432-kube-api-access-jpclz\") pod \"network-check-source-6947749cfc-lxqzc\" (UID: \"ab71270c-39e2-4162-864c-4f1515189432\") " pod="openshift-network-diagnostics/network-check-source-6947749cfc-lxqzc"
Jun 15 05:49:12.827443 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:49:12.827291    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/dc5c749d-22b4-461f-8c24-9da0f33c52f7-cert\") pod \"ingress-canary-9gk6x\" (UID: \"dc5c749d-22b4-461f-8c24-9da0f33c52f7\") " pod="openshift-ingress-canary/ingress-canary-9gk6x"
Jun 15 05:49:12.827443 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:49:12.827315    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/90916cd7-e2d5-4583-b5d6-8b254c9d091d-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-f9d7df769-jlxrk\" (UID: \"90916cd7-e2d5-4583-b5d6-8b254c9d091d\") " pod="openshift-monitoring/cluster-monitoring-operator-f9d7df769-jlxrk"
Jun 15 05:49:12.827443 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:49:12.827355    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gm7h6\" (UniqueName: \"kubernetes.io/projected/dc5c749d-22b4-461f-8c24-9da0f33c52f7-kube-api-access-gm7h6\") pod \"ingress-canary-9gk6x\" (UID: \"dc5c749d-22b4-461f-8c24-9da0f33c52f7\") " pod="openshift-ingress-canary/ingress-canary-9gk6x"
Jun 15 05:49:12.827443 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:49:12.827386    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/18d62d01-84af-4660-af23-86aebdd4f714-nginx-conf\") pod \"networking-console-plugin-867b76cb74-qhtzq\" (UID: \"18d62d01-84af-4660-af23-86aebdd4f714\") " pod="openshift-network-console/networking-console-plugin-867b76cb74-qhtzq"
Jun 15 05:49:12.827443 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:49:12.827430    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-glsds\" (UniqueName: \"kubernetes.io/projected/90916cd7-e2d5-4583-b5d6-8b254c9d091d-kube-api-access-glsds\") pod \"cluster-monitoring-operator-f9d7df769-jlxrk\" (UID: \"90916cd7-e2d5-4583-b5d6-8b254c9d091d\") " pod="openshift-monitoring/cluster-monitoring-operator-f9d7df769-jlxrk"
Jun 15 05:49:12.827683 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:49:12.827455    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/0ed3f738-1daf-4d28-8c14-3c7b5139e7dd-config\") pod \"kube-storage-version-migrator-operator-7c578b78fc-pr6nz\" (UID: \"0ed3f738-1daf-4d28-8c14-3c7b5139e7dd\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7c578b78fc-pr6nz"
Jun 15 05:49:12.827683 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:49:12.827480    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wvnqf\" (UniqueName: \"kubernetes.io/projected/0ed3f738-1daf-4d28-8c14-3c7b5139e7dd-kube-api-access-wvnqf\") pod \"kube-storage-version-migrator-operator-7c578b78fc-pr6nz\" (UID: \"0ed3f738-1daf-4d28-8c14-3c7b5139e7dd\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7c578b78fc-pr6nz"
Jun 15 05:49:12.827683 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:49:12.827535    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cbzmb\" (UniqueName: \"kubernetes.io/projected/67da60eb-27f9-4bbd-8d12-64275e801143-kube-api-access-cbzmb\") pod \"console-operator-5dbbb5d744-ktjgp\" (UID: \"67da60eb-27f9-4bbd-8d12-64275e801143\") " pod="openshift-console-operator/console-operator-5dbbb5d744-ktjgp"
Jun 15 05:49:12.827683 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:49:12.827625    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/90916cd7-e2d5-4583-b5d6-8b254c9d091d-telemetry-config\") pod \"cluster-monitoring-operator-f9d7df769-jlxrk\" (UID: \"90916cd7-e2d5-4583-b5d6-8b254c9d091d\") " pod="openshift-monitoring/cluster-monitoring-operator-f9d7df769-jlxrk"
Jun 15 05:49:12.827683 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:49:12.827654    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/18d62d01-84af-4660-af23-86aebdd4f714-networking-console-plugin-cert\") pod \"networking-console-plugin-867b76cb74-qhtzq\" (UID: \"18d62d01-84af-4660-af23-86aebdd4f714\") " pod="openshift-network-console/networking-console-plugin-867b76cb74-qhtzq"
Jun 15 05:49:12.827915 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:49:12.827693    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/0ed3f738-1daf-4d28-8c14-3c7b5139e7dd-serving-cert\") pod \"kube-storage-version-migrator-operator-7c578b78fc-pr6nz\" (UID: \"0ed3f738-1daf-4d28-8c14-3c7b5139e7dd\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7c578b78fc-pr6nz"
Jun 15 05:49:12.827915 ip-10-0-128-243 kubenswrapper[2566]: E0615 05:49:12.827773    2566 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jun 15 05:49:12.827915 ip-10-0-128-243 kubenswrapper[2566]: E0615 05:49:12.827845    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/90916cd7-e2d5-4583-b5d6-8b254c9d091d-cluster-monitoring-operator-tls podName:90916cd7-e2d5-4583-b5d6-8b254c9d091d nodeName:}" failed. No retries permitted until 2026-06-15 05:49:13.327819688 +0000 UTC m=+36.287576931 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/90916cd7-e2d5-4583-b5d6-8b254c9d091d-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-f9d7df769-jlxrk" (UID: "90916cd7-e2d5-4583-b5d6-8b254c9d091d") : secret "cluster-monitoring-operator-tls" not found
Jun 15 05:49:12.828075 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:49:12.827951    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/67da60eb-27f9-4bbd-8d12-64275e801143-config\") pod \"console-operator-5dbbb5d744-ktjgp\" (UID: \"67da60eb-27f9-4bbd-8d12-64275e801143\") " pod="openshift-console-operator/console-operator-5dbbb5d744-ktjgp"
Jun 15 05:49:12.828075 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:49:12.828062    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/67da60eb-27f9-4bbd-8d12-64275e801143-trusted-ca\") pod \"console-operator-5dbbb5d744-ktjgp\" (UID: \"67da60eb-27f9-4bbd-8d12-64275e801143\") " pod="openshift-console-operator/console-operator-5dbbb5d744-ktjgp"
Jun 15 05:49:12.828585 ip-10-0-128-243 kubenswrapper[2566]: E0615 05:49:12.828472    2566 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jun 15 05:49:12.828585 ip-10-0-128-243 kubenswrapper[2566]: E0615 05:49:12.828530    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/18d62d01-84af-4660-af23-86aebdd4f714-networking-console-plugin-cert podName:18d62d01-84af-4660-af23-86aebdd4f714 nodeName:}" failed. No retries permitted until 2026-06-15 05:49:13.328512437 +0000 UTC m=+36.288269663 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/18d62d01-84af-4660-af23-86aebdd4f714-networking-console-plugin-cert") pod "networking-console-plugin-867b76cb74-qhtzq" (UID: "18d62d01-84af-4660-af23-86aebdd4f714") : secret "networking-console-plugin-cert" not found
Jun 15 05:49:12.828795 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:49:12.828618    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/0ed3f738-1daf-4d28-8c14-3c7b5139e7dd-config\") pod \"kube-storage-version-migrator-operator-7c578b78fc-pr6nz\" (UID: \"0ed3f738-1daf-4d28-8c14-3c7b5139e7dd\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7c578b78fc-pr6nz"
Jun 15 05:49:12.828795 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:49:12.828659    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/18d62d01-84af-4660-af23-86aebdd4f714-nginx-conf\") pod \"networking-console-plugin-867b76cb74-qhtzq\" (UID: \"18d62d01-84af-4660-af23-86aebdd4f714\") " pod="openshift-network-console/networking-console-plugin-867b76cb74-qhtzq"
Jun 15 05:49:12.828902 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:49:12.828796    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/90916cd7-e2d5-4583-b5d6-8b254c9d091d-telemetry-config\") pod \"cluster-monitoring-operator-f9d7df769-jlxrk\" (UID: \"90916cd7-e2d5-4583-b5d6-8b254c9d091d\") " pod="openshift-monitoring/cluster-monitoring-operator-f9d7df769-jlxrk"
Jun 15 05:49:12.830591 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:49:12.830571    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/67da60eb-27f9-4bbd-8d12-64275e801143-serving-cert\") pod \"console-operator-5dbbb5d744-ktjgp\" (UID: \"67da60eb-27f9-4bbd-8d12-64275e801143\") " pod="openshift-console-operator/console-operator-5dbbb5d744-ktjgp"
Jun 15 05:49:12.830800 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:49:12.830770    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/dc5c749d-22b4-461f-8c24-9da0f33c52f7-cert\") pod \"ingress-canary-9gk6x\" (UID: \"dc5c749d-22b4-461f-8c24-9da0f33c52f7\") " pod="openshift-ingress-canary/ingress-canary-9gk6x"
Jun 15 05:49:12.830874 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:49:12.830823    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/0ed3f738-1daf-4d28-8c14-3c7b5139e7dd-serving-cert\") pod \"kube-storage-version-migrator-operator-7c578b78fc-pr6nz\" (UID: \"0ed3f738-1daf-4d28-8c14-3c7b5139e7dd\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7c578b78fc-pr6nz"
Jun 15 05:49:12.837143 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:49:12.837118    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-glsds\" (UniqueName: \"kubernetes.io/projected/90916cd7-e2d5-4583-b5d6-8b254c9d091d-kube-api-access-glsds\") pod \"cluster-monitoring-operator-f9d7df769-jlxrk\" (UID: \"90916cd7-e2d5-4583-b5d6-8b254c9d091d\") " pod="openshift-monitoring/cluster-monitoring-operator-f9d7df769-jlxrk"
Jun 15 05:49:12.837241 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:49:12.837181    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jpclz\" (UniqueName: \"kubernetes.io/projected/ab71270c-39e2-4162-864c-4f1515189432-kube-api-access-jpclz\") pod \"network-check-source-6947749cfc-lxqzc\" (UID: \"ab71270c-39e2-4162-864c-4f1515189432\") " pod="openshift-network-diagnostics/network-check-source-6947749cfc-lxqzc"
Jun 15 05:49:12.837307 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:49:12.837266    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gm7h6\" (UniqueName: \"kubernetes.io/projected/dc5c749d-22b4-461f-8c24-9da0f33c52f7-kube-api-access-gm7h6\") pod \"ingress-canary-9gk6x\" (UID: \"dc5c749d-22b4-461f-8c24-9da0f33c52f7\") " pod="openshift-ingress-canary/ingress-canary-9gk6x"
Jun 15 05:49:12.837734 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:49:12.837713    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wvnqf\" (UniqueName: \"kubernetes.io/projected/0ed3f738-1daf-4d28-8c14-3c7b5139e7dd-kube-api-access-wvnqf\") pod \"kube-storage-version-migrator-operator-7c578b78fc-pr6nz\" (UID: \"0ed3f738-1daf-4d28-8c14-3c7b5139e7dd\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7c578b78fc-pr6nz"
Jun 15 05:49:12.839115 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:49:12.839066    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cbzmb\" (UniqueName: \"kubernetes.io/projected/67da60eb-27f9-4bbd-8d12-64275e801143-kube-api-access-cbzmb\") pod \"console-operator-5dbbb5d744-ktjgp\" (UID: \"67da60eb-27f9-4bbd-8d12-64275e801143\") " pod="openshift-console-operator/console-operator-5dbbb5d744-ktjgp"
Jun 15 05:49:12.875852 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:49:12.875819    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7c578b78fc-pr6nz"
Jun 15 05:49:12.911778 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:49:12.911752    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-5dbbb5d744-ktjgp"
Jun 15 05:49:12.952246 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:49:12.952219    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-6947749cfc-lxqzc"
Jun 15 05:49:12.960556 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:49:12.960532    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-7ccbfd59dc-42zqt"]
Jun 15 05:49:12.968528 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:49:12.968503    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-9gk6x"
Jun 15 05:49:12.969031 ip-10-0-128-243 kubenswrapper[2566]: W0615 05:49:12.969013    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6771aa98_7d47_4ae5_b63e_7c6bb456a86b.slice/crio-39ef71b3485b1cd8809103bb726daef6fce66d09f586e19dc9961e4d4b49724e WatchSource:0}: Error finding container 39ef71b3485b1cd8809103bb726daef6fce66d09f586e19dc9961e4d4b49724e: Status 404 returned error can't find the container with id 39ef71b3485b1cd8809103bb726daef6fce66d09f586e19dc9961e4d4b49724e
Jun 15 05:49:13.140491 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:49:13.132937    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/7ed3b8df-025b-4073-95eb-c614783dac86-samples-operator-tls\") pod \"cluster-samples-operator-9547488fd-krhb7\" (UID: \"7ed3b8df-025b-4073-95eb-c614783dac86\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-9547488fd-krhb7"
Jun 15 05:49:13.140491 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:49:13.132988    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/0addacd9-d43e-43c0-8be8-608abc918f38-registry-tls\") pod \"image-registry-8559c46f69-f7hlb\" (UID: \"0addacd9-d43e-43c0-8be8-608abc918f38\") " pod="openshift-image-registry/image-registry-8559c46f69-f7hlb"
Jun 15 05:49:13.140491 ip-10-0-128-243 kubenswrapper[2566]: E0615 05:49:13.133214    2566 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jun 15 05:49:13.140491 ip-10-0-128-243 kubenswrapper[2566]: E0615 05:49:13.133284    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7ed3b8df-025b-4073-95eb-c614783dac86-samples-operator-tls podName:7ed3b8df-025b-4073-95eb-c614783dac86 nodeName:}" failed. No retries permitted until 2026-06-15 05:49:14.133264094 +0000 UTC m=+37.093021322 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/7ed3b8df-025b-4073-95eb-c614783dac86-samples-operator-tls") pod "cluster-samples-operator-9547488fd-krhb7" (UID: "7ed3b8df-025b-4073-95eb-c614783dac86") : secret "samples-operator-tls" not found
Jun 15 05:49:13.140491 ip-10-0-128-243 kubenswrapper[2566]: E0615 05:49:13.133816    2566 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jun 15 05:49:13.140491 ip-10-0-128-243 kubenswrapper[2566]: E0615 05:49:13.133842    2566 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-8559c46f69-f7hlb: secret "image-registry-tls" not found
Jun 15 05:49:13.140491 ip-10-0-128-243 kubenswrapper[2566]: E0615 05:49:13.133893    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0addacd9-d43e-43c0-8be8-608abc918f38-registry-tls podName:0addacd9-d43e-43c0-8be8-608abc918f38 nodeName:}" failed. No retries permitted until 2026-06-15 05:49:14.133875889 +0000 UTC m=+37.093633115 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/0addacd9-d43e-43c0-8be8-608abc918f38-registry-tls") pod "image-registry-8559c46f69-f7hlb" (UID: "0addacd9-d43e-43c0-8be8-608abc918f38") : secret "image-registry-tls" not found
Jun 15 05:49:13.232195 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:49:13.229982    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7c578b78fc-pr6nz"]
Jun 15 05:49:13.234603 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:49:13.234537    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-5dbbb5d744-ktjgp"]
Jun 15 05:49:13.235411 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:49:13.234755    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3b8ee52d-b179-492b-960c-b978e06cd8a7-metrics-certs\") pod \"router-default-8bdfdcbd8-4fc26\" (UID: \"3b8ee52d-b179-492b-960c-b978e06cd8a7\") " pod="openshift-ingress/router-default-8bdfdcbd8-4fc26"
Jun 15 05:49:13.235411 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:49:13.234812    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3b8ee52d-b179-492b-960c-b978e06cd8a7-service-ca-bundle\") pod \"router-default-8bdfdcbd8-4fc26\" (UID: \"3b8ee52d-b179-492b-960c-b978e06cd8a7\") " pod="openshift-ingress/router-default-8bdfdcbd8-4fc26"
Jun 15 05:49:13.235411 ip-10-0-128-243 kubenswrapper[2566]: W0615 05:49:13.234817    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0ed3f738_1daf_4d28_8c14_3c7b5139e7dd.slice/crio-245bc664a9dd10a24100ef0dd407c96e2a59d3d4bdaa1790446f3a2174a5b5b4 WatchSource:0}: Error finding container 245bc664a9dd10a24100ef0dd407c96e2a59d3d4bdaa1790446f3a2174a5b5b4: Status 404 returned error can't find the container with id 245bc664a9dd10a24100ef0dd407c96e2a59d3d4bdaa1790446f3a2174a5b5b4
Jun 15 05:49:13.235411 ip-10-0-128-243 kubenswrapper[2566]: E0615 05:49:13.234941    2566 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jun 15 05:49:13.235411 ip-10-0-128-243 kubenswrapper[2566]: E0615 05:49:13.234953    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/3b8ee52d-b179-492b-960c-b978e06cd8a7-service-ca-bundle podName:3b8ee52d-b179-492b-960c-b978e06cd8a7 nodeName:}" failed. No retries permitted until 2026-06-15 05:49:14.234935426 +0000 UTC m=+37.194692664 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/3b8ee52d-b179-492b-960c-b978e06cd8a7-service-ca-bundle") pod "router-default-8bdfdcbd8-4fc26" (UID: "3b8ee52d-b179-492b-960c-b978e06cd8a7") : configmap references non-existent config key: service-ca.crt
Jun 15 05:49:13.235411 ip-10-0-128-243 kubenswrapper[2566]: E0615 05:49:13.234995    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3b8ee52d-b179-492b-960c-b978e06cd8a7-metrics-certs podName:3b8ee52d-b179-492b-960c-b978e06cd8a7 nodeName:}" failed. No retries permitted until 2026-06-15 05:49:14.23497921 +0000 UTC m=+37.194736434 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3b8ee52d-b179-492b-960c-b978e06cd8a7-metrics-certs") pod "router-default-8bdfdcbd8-4fc26" (UID: "3b8ee52d-b179-492b-960c-b978e06cd8a7") : secret "router-metrics-certs-default" not found
Jun 15 05:49:13.235411 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:49:13.235171    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/477f44b3-0328-417c-a5db-442ea835eb70-metrics-tls\") pod \"dns-default-smfqb\" (UID: \"477f44b3-0328-417c-a5db-442ea835eb70\") " pod="openshift-dns/dns-default-smfqb"
Jun 15 05:49:13.235411 ip-10-0-128-243 kubenswrapper[2566]: E0615 05:49:13.235293    2566 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jun 15 05:49:13.235411 ip-10-0-128-243 kubenswrapper[2566]: E0615 05:49:13.235342    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/477f44b3-0328-417c-a5db-442ea835eb70-metrics-tls podName:477f44b3-0328-417c-a5db-442ea835eb70 nodeName:}" failed. No retries permitted until 2026-06-15 05:49:14.235321031 +0000 UTC m=+37.195078280 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/477f44b3-0328-417c-a5db-442ea835eb70-metrics-tls") pod "dns-default-smfqb" (UID: "477f44b3-0328-417c-a5db-442ea835eb70") : secret "dns-default-metrics-tls" not found
Jun 15 05:49:13.245934 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:49:13.245806    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-bd4ccd799-2556x"]
Jun 15 05:49:13.255150 ip-10-0-128-243 kubenswrapper[2566]: W0615 05:49:13.255120    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb1bd12ae_f8b5_4d48_bced_c60779b6f7c6.slice/crio-e1863ecbeed2c68f350843a119833dbdb84ff4272052370746adaf3707a01a2a WatchSource:0}: Error finding container e1863ecbeed2c68f350843a119833dbdb84ff4272052370746adaf3707a01a2a: Status 404 returned error can't find the container with id e1863ecbeed2c68f350843a119833dbdb84ff4272052370746adaf3707a01a2a
Jun 15 05:49:13.265319 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:49:13.265241    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-9gk6x"]
Jun 15 05:49:13.268388 ip-10-0-128-243 kubenswrapper[2566]: W0615 05:49:13.268366    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddc5c749d_22b4_461f_8c24_9da0f33c52f7.slice/crio-6b01d37afabfb17fdb5d611abebe8f517faa82903d2b3f61c2b6ae7ce218af24 WatchSource:0}: Error finding container 6b01d37afabfb17fdb5d611abebe8f517faa82903d2b3f61c2b6ae7ce218af24: Status 404 returned error can't find the container with id 6b01d37afabfb17fdb5d611abebe8f517faa82903d2b3f61c2b6ae7ce218af24
Jun 15 05:49:13.278012 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:49:13.277986    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-6947749cfc-lxqzc"]
Jun 15 05:49:13.288492 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:49:13.288467    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-5bbd86d6bd-4bc2h"]
Jun 15 05:49:13.295396 ip-10-0-128-243 kubenswrapper[2566]: W0615 05:49:13.294387    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podab71270c_39e2_4162_864c_4f1515189432.slice/crio-35eb2108ae870dede359e1e181b7b95a1ab3ebaeed139fa83cb76cc981c3491b WatchSource:0}: Error finding container 35eb2108ae870dede359e1e181b7b95a1ab3ebaeed139fa83cb76cc981c3491b: Status 404 returned error can't find the container with id 35eb2108ae870dede359e1e181b7b95a1ab3ebaeed139fa83cb76cc981c3491b
Jun 15 05:49:13.336568 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:49:13.336537    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/18d62d01-84af-4660-af23-86aebdd4f714-networking-console-plugin-cert\") pod \"networking-console-plugin-867b76cb74-qhtzq\" (UID: \"18d62d01-84af-4660-af23-86aebdd4f714\") " pod="openshift-network-console/networking-console-plugin-867b76cb74-qhtzq"
Jun 15 05:49:13.336688 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:49:13.336669    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/90916cd7-e2d5-4583-b5d6-8b254c9d091d-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-f9d7df769-jlxrk\" (UID: \"90916cd7-e2d5-4583-b5d6-8b254c9d091d\") " pod="openshift-monitoring/cluster-monitoring-operator-f9d7df769-jlxrk"
Jun 15 05:49:13.336754 ip-10-0-128-243 kubenswrapper[2566]: E0615 05:49:13.336682    2566 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jun 15 05:49:13.336754 ip-10-0-128-243 kubenswrapper[2566]: E0615 05:49:13.336745    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/18d62d01-84af-4660-af23-86aebdd4f714-networking-console-plugin-cert podName:18d62d01-84af-4660-af23-86aebdd4f714 nodeName:}" failed. No retries permitted until 2026-06-15 05:49:14.336728754 +0000 UTC m=+37.296485976 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/18d62d01-84af-4660-af23-86aebdd4f714-networking-console-plugin-cert") pod "networking-console-plugin-867b76cb74-qhtzq" (UID: "18d62d01-84af-4660-af23-86aebdd4f714") : secret "networking-console-plugin-cert" not found
Jun 15 05:49:13.336843 ip-10-0-128-243 kubenswrapper[2566]: E0615 05:49:13.336825    2566 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jun 15 05:49:13.336906 ip-10-0-128-243 kubenswrapper[2566]: E0615 05:49:13.336885    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/90916cd7-e2d5-4583-b5d6-8b254c9d091d-cluster-monitoring-operator-tls podName:90916cd7-e2d5-4583-b5d6-8b254c9d091d nodeName:}" failed. No retries permitted until 2026-06-15 05:49:14.336870493 +0000 UTC m=+37.296627719 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/90916cd7-e2d5-4583-b5d6-8b254c9d091d-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-f9d7df769-jlxrk" (UID: "90916cd7-e2d5-4583-b5d6-8b254c9d091d") : secret "cluster-monitoring-operator-tls" not found
Jun 15 05:49:13.436163 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:49:13.436064    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gbdt4"
Jun 15 05:49:13.439204 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:49:13.439183    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-kxrkb\""
Jun 15 05:49:13.609771 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:49:13.609729    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5bbd86d6bd-4bc2h" event={"ID":"12ada117-da7b-47e4-bab9-92368a63edf8","Type":"ContainerStarted","Data":"fe0ed2fc7c582b6b7978a18351301f72766b0499cc69fedda68932d896b7b7bb"}
Jun 15 05:49:13.612125 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:49:13.612075    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-9gk6x" event={"ID":"dc5c749d-22b4-461f-8c24-9da0f33c52f7","Type":"ContainerStarted","Data":"6b01d37afabfb17fdb5d611abebe8f517faa82903d2b3f61c2b6ae7ce218af24"}
Jun 15 05:49:13.613292 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:49:13.613265    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-7ccbfd59dc-42zqt" event={"ID":"6771aa98-7d47-4ae5-b63e-7c6bb456a86b","Type":"ContainerStarted","Data":"39ef71b3485b1cd8809103bb726daef6fce66d09f586e19dc9961e4d4b49724e"}
Jun 15 05:49:13.614458 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:49:13.614429    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7c578b78fc-pr6nz" event={"ID":"0ed3f738-1daf-4d28-8c14-3c7b5139e7dd","Type":"ContainerStarted","Data":"245bc664a9dd10a24100ef0dd407c96e2a59d3d4bdaa1790446f3a2174a5b5b4"}
Jun 15 05:49:13.617692 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:49:13.617669    2566 generic.go:356] "Generic (PLEG): container finished" podID="0246685c-f9e4-45b0-bb3f-b17957621809" containerID="76dd08039fdf2cb971941e7b1aa0099c57469e45b8b560247c53bc9d59607e13" exitCode=0
Jun 15 05:49:13.617830 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:49:13.617796    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-c5vrl" event={"ID":"0246685c-f9e4-45b0-bb3f-b17957621809","Type":"ContainerDied","Data":"76dd08039fdf2cb971941e7b1aa0099c57469e45b8b560247c53bc9d59607e13"}
Jun 15 05:49:13.619201 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:49:13.619177    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-6947749cfc-lxqzc" event={"ID":"ab71270c-39e2-4162-864c-4f1515189432","Type":"ContainerStarted","Data":"35eb2108ae870dede359e1e181b7b95a1ab3ebaeed139fa83cb76cc981c3491b"}
Jun 15 05:49:13.620367 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:49:13.620340    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-5dbbb5d744-ktjgp" event={"ID":"67da60eb-27f9-4bbd-8d12-64275e801143","Type":"ContainerStarted","Data":"0d07742f14b2f531708a90f94218b9e3fb3beeb982c3c5d6348ef3d70b2f4977"}
Jun 15 05:49:13.621614 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:49:13.621597    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-bd4ccd799-2556x" event={"ID":"b1bd12ae-f8b5-4d48-bced-c60779b6f7c6","Type":"ContainerStarted","Data":"e1863ecbeed2c68f350843a119833dbdb84ff4272052370746adaf3707a01a2a"}
Jun 15 05:49:14.145587 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:49:14.145328    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/7ed3b8df-025b-4073-95eb-c614783dac86-samples-operator-tls\") pod \"cluster-samples-operator-9547488fd-krhb7\" (UID: \"7ed3b8df-025b-4073-95eb-c614783dac86\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-9547488fd-krhb7"
Jun 15 05:49:14.145799 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:49:14.145616    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/0addacd9-d43e-43c0-8be8-608abc918f38-registry-tls\") pod \"image-registry-8559c46f69-f7hlb\" (UID: \"0addacd9-d43e-43c0-8be8-608abc918f38\") " pod="openshift-image-registry/image-registry-8559c46f69-f7hlb"
Jun 15 05:49:14.145799 ip-10-0-128-243 kubenswrapper[2566]: E0615 05:49:14.145459    2566 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jun 15 05:49:14.145799 ip-10-0-128-243 kubenswrapper[2566]: E0615 05:49:14.145743    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7ed3b8df-025b-4073-95eb-c614783dac86-samples-operator-tls podName:7ed3b8df-025b-4073-95eb-c614783dac86 nodeName:}" failed. No retries permitted until 2026-06-15 05:49:16.145718623 +0000 UTC m=+39.105475862 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/7ed3b8df-025b-4073-95eb-c614783dac86-samples-operator-tls") pod "cluster-samples-operator-9547488fd-krhb7" (UID: "7ed3b8df-025b-4073-95eb-c614783dac86") : secret "samples-operator-tls" not found
Jun 15 05:49:14.145968 ip-10-0-128-243 kubenswrapper[2566]: E0615 05:49:14.145800    2566 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jun 15 05:49:14.145968 ip-10-0-128-243 kubenswrapper[2566]: E0615 05:49:14.145815    2566 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-8559c46f69-f7hlb: secret "image-registry-tls" not found
Jun 15 05:49:14.145968 ip-10-0-128-243 kubenswrapper[2566]: E0615 05:49:14.145864    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0addacd9-d43e-43c0-8be8-608abc918f38-registry-tls podName:0addacd9-d43e-43c0-8be8-608abc918f38 nodeName:}" failed. No retries permitted until 2026-06-15 05:49:16.145847393 +0000 UTC m=+39.105604633 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/0addacd9-d43e-43c0-8be8-608abc918f38-registry-tls") pod "image-registry-8559c46f69-f7hlb" (UID: "0addacd9-d43e-43c0-8be8-608abc918f38") : secret "image-registry-tls" not found
Jun 15 05:49:14.247148 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:49:14.247110    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/477f44b3-0328-417c-a5db-442ea835eb70-metrics-tls\") pod \"dns-default-smfqb\" (UID: \"477f44b3-0328-417c-a5db-442ea835eb70\") " pod="openshift-dns/dns-default-smfqb"
Jun 15 05:49:14.247325 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:49:14.247187    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3b8ee52d-b179-492b-960c-b978e06cd8a7-metrics-certs\") pod \"router-default-8bdfdcbd8-4fc26\" (UID: \"3b8ee52d-b179-492b-960c-b978e06cd8a7\") " pod="openshift-ingress/router-default-8bdfdcbd8-4fc26"
Jun 15 05:49:14.247325 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:49:14.247227    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3b8ee52d-b179-492b-960c-b978e06cd8a7-service-ca-bundle\") pod \"router-default-8bdfdcbd8-4fc26\" (UID: \"3b8ee52d-b179-492b-960c-b978e06cd8a7\") " pod="openshift-ingress/router-default-8bdfdcbd8-4fc26"
Jun 15 05:49:14.247433 ip-10-0-128-243 kubenswrapper[2566]: E0615 05:49:14.247381    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/3b8ee52d-b179-492b-960c-b978e06cd8a7-service-ca-bundle podName:3b8ee52d-b179-492b-960c-b978e06cd8a7 nodeName:}" failed. No retries permitted until 2026-06-15 05:49:16.247363718 +0000 UTC m=+39.207120958 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/3b8ee52d-b179-492b-960c-b978e06cd8a7-service-ca-bundle") pod "router-default-8bdfdcbd8-4fc26" (UID: "3b8ee52d-b179-492b-960c-b978e06cd8a7") : configmap references non-existent config key: service-ca.crt
Jun 15 05:49:14.247821 ip-10-0-128-243 kubenswrapper[2566]: E0615 05:49:14.247796    2566 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jun 15 05:49:14.247935 ip-10-0-128-243 kubenswrapper[2566]: E0615 05:49:14.247855    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/477f44b3-0328-417c-a5db-442ea835eb70-metrics-tls podName:477f44b3-0328-417c-a5db-442ea835eb70 nodeName:}" failed. No retries permitted until 2026-06-15 05:49:16.247840539 +0000 UTC m=+39.207597767 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/477f44b3-0328-417c-a5db-442ea835eb70-metrics-tls") pod "dns-default-smfqb" (UID: "477f44b3-0328-417c-a5db-442ea835eb70") : secret "dns-default-metrics-tls" not found
Jun 15 05:49:14.247935 ip-10-0-128-243 kubenswrapper[2566]: E0615 05:49:14.247913    2566 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jun 15 05:49:14.248049 ip-10-0-128-243 kubenswrapper[2566]: E0615 05:49:14.247945    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3b8ee52d-b179-492b-960c-b978e06cd8a7-metrics-certs podName:3b8ee52d-b179-492b-960c-b978e06cd8a7 nodeName:}" failed. No retries permitted until 2026-06-15 05:49:16.247933735 +0000 UTC m=+39.207690976 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3b8ee52d-b179-492b-960c-b978e06cd8a7-metrics-certs") pod "router-default-8bdfdcbd8-4fc26" (UID: "3b8ee52d-b179-492b-960c-b978e06cd8a7") : secret "router-metrics-certs-default" not found
Jun 15 05:49:14.347844 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:49:14.347812    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/90916cd7-e2d5-4583-b5d6-8b254c9d091d-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-f9d7df769-jlxrk\" (UID: \"90916cd7-e2d5-4583-b5d6-8b254c9d091d\") " pod="openshift-monitoring/cluster-monitoring-operator-f9d7df769-jlxrk"
Jun 15 05:49:14.348017 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:49:14.347927    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/18d62d01-84af-4660-af23-86aebdd4f714-networking-console-plugin-cert\") pod \"networking-console-plugin-867b76cb74-qhtzq\" (UID: \"18d62d01-84af-4660-af23-86aebdd4f714\") " pod="openshift-network-console/networking-console-plugin-867b76cb74-qhtzq"
Jun 15 05:49:14.348017 ip-10-0-128-243 kubenswrapper[2566]: E0615 05:49:14.347977    2566 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jun 15 05:49:14.348192 ip-10-0-128-243 kubenswrapper[2566]: E0615 05:49:14.348054    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/90916cd7-e2d5-4583-b5d6-8b254c9d091d-cluster-monitoring-operator-tls podName:90916cd7-e2d5-4583-b5d6-8b254c9d091d nodeName:}" failed. No retries permitted until 2026-06-15 05:49:16.348031406 +0000 UTC m=+39.307788648 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/90916cd7-e2d5-4583-b5d6-8b254c9d091d-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-f9d7df769-jlxrk" (UID: "90916cd7-e2d5-4583-b5d6-8b254c9d091d") : secret "cluster-monitoring-operator-tls" not found
Jun 15 05:49:14.348192 ip-10-0-128-243 kubenswrapper[2566]: E0615 05:49:14.348124    2566 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jun 15 05:49:14.348192 ip-10-0-128-243 kubenswrapper[2566]: E0615 05:49:14.348177    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/18d62d01-84af-4660-af23-86aebdd4f714-networking-console-plugin-cert podName:18d62d01-84af-4660-af23-86aebdd4f714 nodeName:}" failed. No retries permitted until 2026-06-15 05:49:16.3481615 +0000 UTC m=+39.307918738 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/18d62d01-84af-4660-af23-86aebdd4f714-networking-console-plugin-cert") pod "networking-console-plugin-867b76cb74-qhtzq" (UID: "18d62d01-84af-4660-af23-86aebdd4f714") : secret "networking-console-plugin-cert" not found
Jun 15 05:49:14.633187 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:49:14.633150    2566 generic.go:356] "Generic (PLEG): container finished" podID="0246685c-f9e4-45b0-bb3f-b17957621809" containerID="ed0e98b3992ae0ad1373dfa3fe836b9b826b2536a2bfed5ab9886338dc5d40c4" exitCode=0
Jun 15 05:49:14.633633 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:49:14.633219    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-c5vrl" event={"ID":"0246685c-f9e4-45b0-bb3f-b17957621809","Type":"ContainerDied","Data":"ed0e98b3992ae0ad1373dfa3fe836b9b826b2536a2bfed5ab9886338dc5d40c4"}
Jun 15 05:49:16.166522 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:49:16.166484    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/7ed3b8df-025b-4073-95eb-c614783dac86-samples-operator-tls\") pod \"cluster-samples-operator-9547488fd-krhb7\" (UID: \"7ed3b8df-025b-4073-95eb-c614783dac86\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-9547488fd-krhb7"
Jun 15 05:49:16.166522 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:49:16.166536    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/0addacd9-d43e-43c0-8be8-608abc918f38-registry-tls\") pod \"image-registry-8559c46f69-f7hlb\" (UID: \"0addacd9-d43e-43c0-8be8-608abc918f38\") " pod="openshift-image-registry/image-registry-8559c46f69-f7hlb"
Jun 15 05:49:16.166974 ip-10-0-128-243 kubenswrapper[2566]: E0615 05:49:16.166658    2566 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jun 15 05:49:16.166974 ip-10-0-128-243 kubenswrapper[2566]: E0615 05:49:16.166662    2566 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jun 15 05:49:16.166974 ip-10-0-128-243 kubenswrapper[2566]: E0615 05:49:16.166740    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7ed3b8df-025b-4073-95eb-c614783dac86-samples-operator-tls podName:7ed3b8df-025b-4073-95eb-c614783dac86 nodeName:}" failed. No retries permitted until 2026-06-15 05:49:20.166721082 +0000 UTC m=+43.126478306 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/7ed3b8df-025b-4073-95eb-c614783dac86-samples-operator-tls") pod "cluster-samples-operator-9547488fd-krhb7" (UID: "7ed3b8df-025b-4073-95eb-c614783dac86") : secret "samples-operator-tls" not found
Jun 15 05:49:16.166974 ip-10-0-128-243 kubenswrapper[2566]: E0615 05:49:16.166674    2566 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-8559c46f69-f7hlb: secret "image-registry-tls" not found
Jun 15 05:49:16.166974 ip-10-0-128-243 kubenswrapper[2566]: E0615 05:49:16.166809    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0addacd9-d43e-43c0-8be8-608abc918f38-registry-tls podName:0addacd9-d43e-43c0-8be8-608abc918f38 nodeName:}" failed. No retries permitted until 2026-06-15 05:49:20.166794234 +0000 UTC m=+43.126551481 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/0addacd9-d43e-43c0-8be8-608abc918f38-registry-tls") pod "image-registry-8559c46f69-f7hlb" (UID: "0addacd9-d43e-43c0-8be8-608abc918f38") : secret "image-registry-tls" not found
Jun 15 05:49:16.267612 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:49:16.267583    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/477f44b3-0328-417c-a5db-442ea835eb70-metrics-tls\") pod \"dns-default-smfqb\" (UID: \"477f44b3-0328-417c-a5db-442ea835eb70\") " pod="openshift-dns/dns-default-smfqb"
Jun 15 05:49:16.267829 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:49:16.267654    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3b8ee52d-b179-492b-960c-b978e06cd8a7-metrics-certs\") pod \"router-default-8bdfdcbd8-4fc26\" (UID: \"3b8ee52d-b179-492b-960c-b978e06cd8a7\") " pod="openshift-ingress/router-default-8bdfdcbd8-4fc26"
Jun 15 05:49:16.267829 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:49:16.267692    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3b8ee52d-b179-492b-960c-b978e06cd8a7-service-ca-bundle\") pod \"router-default-8bdfdcbd8-4fc26\" (UID: \"3b8ee52d-b179-492b-960c-b978e06cd8a7\") " pod="openshift-ingress/router-default-8bdfdcbd8-4fc26"
Jun 15 05:49:16.267829 ip-10-0-128-243 kubenswrapper[2566]: E0615 05:49:16.267761    2566 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jun 15 05:49:16.267829 ip-10-0-128-243 kubenswrapper[2566]: E0615 05:49:16.267813    2566 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jun 15 05:49:16.267829 ip-10-0-128-243 kubenswrapper[2566]: E0615 05:49:16.267830    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/3b8ee52d-b179-492b-960c-b978e06cd8a7-service-ca-bundle podName:3b8ee52d-b179-492b-960c-b978e06cd8a7 nodeName:}" failed. No retries permitted until 2026-06-15 05:49:20.267813709 +0000 UTC m=+43.227570936 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/3b8ee52d-b179-492b-960c-b978e06cd8a7-service-ca-bundle") pod "router-default-8bdfdcbd8-4fc26" (UID: "3b8ee52d-b179-492b-960c-b978e06cd8a7") : configmap references non-existent config key: service-ca.crt
Jun 15 05:49:16.268098 ip-10-0-128-243 kubenswrapper[2566]: E0615 05:49:16.267849    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/477f44b3-0328-417c-a5db-442ea835eb70-metrics-tls podName:477f44b3-0328-417c-a5db-442ea835eb70 nodeName:}" failed. No retries permitted until 2026-06-15 05:49:20.26784151 +0000 UTC m=+43.227598733 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/477f44b3-0328-417c-a5db-442ea835eb70-metrics-tls") pod "dns-default-smfqb" (UID: "477f44b3-0328-417c-a5db-442ea835eb70") : secret "dns-default-metrics-tls" not found
Jun 15 05:49:16.268098 ip-10-0-128-243 kubenswrapper[2566]: E0615 05:49:16.267862    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3b8ee52d-b179-492b-960c-b978e06cd8a7-metrics-certs podName:3b8ee52d-b179-492b-960c-b978e06cd8a7 nodeName:}" failed. No retries permitted until 2026-06-15 05:49:20.26785619 +0000 UTC m=+43.227613412 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3b8ee52d-b179-492b-960c-b978e06cd8a7-metrics-certs") pod "router-default-8bdfdcbd8-4fc26" (UID: "3b8ee52d-b179-492b-960c-b978e06cd8a7") : secret "router-metrics-certs-default" not found
Jun 15 05:49:16.368672 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:49:16.368637    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/90916cd7-e2d5-4583-b5d6-8b254c9d091d-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-f9d7df769-jlxrk\" (UID: \"90916cd7-e2d5-4583-b5d6-8b254c9d091d\") " pod="openshift-monitoring/cluster-monitoring-operator-f9d7df769-jlxrk"
Jun 15 05:49:16.368823 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:49:16.368732    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/18d62d01-84af-4660-af23-86aebdd4f714-networking-console-plugin-cert\") pod \"networking-console-plugin-867b76cb74-qhtzq\" (UID: \"18d62d01-84af-4660-af23-86aebdd4f714\") " pod="openshift-network-console/networking-console-plugin-867b76cb74-qhtzq"
Jun 15 05:49:16.368823 ip-10-0-128-243 kubenswrapper[2566]: E0615 05:49:16.368796    2566 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jun 15 05:49:16.368930 ip-10-0-128-243 kubenswrapper[2566]: E0615 05:49:16.368871    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/90916cd7-e2d5-4583-b5d6-8b254c9d091d-cluster-monitoring-operator-tls podName:90916cd7-e2d5-4583-b5d6-8b254c9d091d nodeName:}" failed. No retries permitted until 2026-06-15 05:49:20.368855046 +0000 UTC m=+43.328612289 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/90916cd7-e2d5-4583-b5d6-8b254c9d091d-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-f9d7df769-jlxrk" (UID: "90916cd7-e2d5-4583-b5d6-8b254c9d091d") : secret "cluster-monitoring-operator-tls" not found
Jun 15 05:49:16.368930 ip-10-0-128-243 kubenswrapper[2566]: E0615 05:49:16.368873    2566 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jun 15 05:49:16.369019 ip-10-0-128-243 kubenswrapper[2566]: E0615 05:49:16.368930    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/18d62d01-84af-4660-af23-86aebdd4f714-networking-console-plugin-cert podName:18d62d01-84af-4660-af23-86aebdd4f714 nodeName:}" failed. No retries permitted until 2026-06-15 05:49:20.368918724 +0000 UTC m=+43.328675947 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/18d62d01-84af-4660-af23-86aebdd4f714-networking-console-plugin-cert") pod "networking-console-plugin-867b76cb74-qhtzq" (UID: "18d62d01-84af-4660-af23-86aebdd4f714") : secret "networking-console-plugin-cert" not found
Jun 15 05:49:20.209421 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:49:20.209383    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/7ed3b8df-025b-4073-95eb-c614783dac86-samples-operator-tls\") pod \"cluster-samples-operator-9547488fd-krhb7\" (UID: \"7ed3b8df-025b-4073-95eb-c614783dac86\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-9547488fd-krhb7"
Jun 15 05:49:20.209421 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:49:20.209425    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/0addacd9-d43e-43c0-8be8-608abc918f38-registry-tls\") pod \"image-registry-8559c46f69-f7hlb\" (UID: \"0addacd9-d43e-43c0-8be8-608abc918f38\") " pod="openshift-image-registry/image-registry-8559c46f69-f7hlb"
Jun 15 05:49:20.209968 ip-10-0-128-243 kubenswrapper[2566]: E0615 05:49:20.209549    2566 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jun 15 05:49:20.209968 ip-10-0-128-243 kubenswrapper[2566]: E0615 05:49:20.209551    2566 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jun 15 05:49:20.209968 ip-10-0-128-243 kubenswrapper[2566]: E0615 05:49:20.209618    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7ed3b8df-025b-4073-95eb-c614783dac86-samples-operator-tls podName:7ed3b8df-025b-4073-95eb-c614783dac86 nodeName:}" failed. No retries permitted until 2026-06-15 05:49:28.2096026 +0000 UTC m=+51.169359823 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/7ed3b8df-025b-4073-95eb-c614783dac86-samples-operator-tls") pod "cluster-samples-operator-9547488fd-krhb7" (UID: "7ed3b8df-025b-4073-95eb-c614783dac86") : secret "samples-operator-tls" not found
Jun 15 05:49:20.209968 ip-10-0-128-243 kubenswrapper[2566]: E0615 05:49:20.209560    2566 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-8559c46f69-f7hlb: secret "image-registry-tls" not found
Jun 15 05:49:20.209968 ip-10-0-128-243 kubenswrapper[2566]: E0615 05:49:20.209690    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0addacd9-d43e-43c0-8be8-608abc918f38-registry-tls podName:0addacd9-d43e-43c0-8be8-608abc918f38 nodeName:}" failed. No retries permitted until 2026-06-15 05:49:28.209679339 +0000 UTC m=+51.169436580 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/0addacd9-d43e-43c0-8be8-608abc918f38-registry-tls") pod "image-registry-8559c46f69-f7hlb" (UID: "0addacd9-d43e-43c0-8be8-608abc918f38") : secret "image-registry-tls" not found
Jun 15 05:49:20.310074 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:49:20.310044    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/477f44b3-0328-417c-a5db-442ea835eb70-metrics-tls\") pod \"dns-default-smfqb\" (UID: \"477f44b3-0328-417c-a5db-442ea835eb70\") " pod="openshift-dns/dns-default-smfqb"
Jun 15 05:49:20.310200 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:49:20.310111    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3b8ee52d-b179-492b-960c-b978e06cd8a7-metrics-certs\") pod \"router-default-8bdfdcbd8-4fc26\" (UID: \"3b8ee52d-b179-492b-960c-b978e06cd8a7\") " pod="openshift-ingress/router-default-8bdfdcbd8-4fc26"
Jun 15 05:49:20.310200 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:49:20.310142    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3b8ee52d-b179-492b-960c-b978e06cd8a7-service-ca-bundle\") pod \"router-default-8bdfdcbd8-4fc26\" (UID: \"3b8ee52d-b179-492b-960c-b978e06cd8a7\") " pod="openshift-ingress/router-default-8bdfdcbd8-4fc26"
Jun 15 05:49:20.310313 ip-10-0-128-243 kubenswrapper[2566]: E0615 05:49:20.310209    2566 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jun 15 05:49:20.310313 ip-10-0-128-243 kubenswrapper[2566]: E0615 05:49:20.310235    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/3b8ee52d-b179-492b-960c-b978e06cd8a7-service-ca-bundle podName:3b8ee52d-b179-492b-960c-b978e06cd8a7 nodeName:}" failed. No retries permitted until 2026-06-15 05:49:28.310222867 +0000 UTC m=+51.269980090 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/3b8ee52d-b179-492b-960c-b978e06cd8a7-service-ca-bundle") pod "router-default-8bdfdcbd8-4fc26" (UID: "3b8ee52d-b179-492b-960c-b978e06cd8a7") : configmap references non-existent config key: service-ca.crt
Jun 15 05:49:20.310313 ip-10-0-128-243 kubenswrapper[2566]: E0615 05:49:20.310240    2566 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jun 15 05:49:20.310313 ip-10-0-128-243 kubenswrapper[2566]: E0615 05:49:20.310266    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/477f44b3-0328-417c-a5db-442ea835eb70-metrics-tls podName:477f44b3-0328-417c-a5db-442ea835eb70 nodeName:}" failed. No retries permitted until 2026-06-15 05:49:28.310248615 +0000 UTC m=+51.270005840 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/477f44b3-0328-417c-a5db-442ea835eb70-metrics-tls") pod "dns-default-smfqb" (UID: "477f44b3-0328-417c-a5db-442ea835eb70") : secret "dns-default-metrics-tls" not found
Jun 15 05:49:20.310313 ip-10-0-128-243 kubenswrapper[2566]: E0615 05:49:20.310295    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3b8ee52d-b179-492b-960c-b978e06cd8a7-metrics-certs podName:3b8ee52d-b179-492b-960c-b978e06cd8a7 nodeName:}" failed. No retries permitted until 2026-06-15 05:49:28.310279019 +0000 UTC m=+51.270036259 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3b8ee52d-b179-492b-960c-b978e06cd8a7-metrics-certs") pod "router-default-8bdfdcbd8-4fc26" (UID: "3b8ee52d-b179-492b-960c-b978e06cd8a7") : secret "router-metrics-certs-default" not found
Jun 15 05:49:20.411384 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:49:20.411349    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/18d62d01-84af-4660-af23-86aebdd4f714-networking-console-plugin-cert\") pod \"networking-console-plugin-867b76cb74-qhtzq\" (UID: \"18d62d01-84af-4660-af23-86aebdd4f714\") " pod="openshift-network-console/networking-console-plugin-867b76cb74-qhtzq"
Jun 15 05:49:20.411538 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:49:20.411455    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/90916cd7-e2d5-4583-b5d6-8b254c9d091d-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-f9d7df769-jlxrk\" (UID: \"90916cd7-e2d5-4583-b5d6-8b254c9d091d\") " pod="openshift-monitoring/cluster-monitoring-operator-f9d7df769-jlxrk"
Jun 15 05:49:20.411538 ip-10-0-128-243 kubenswrapper[2566]: E0615 05:49:20.411505    2566 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jun 15 05:49:20.411647 ip-10-0-128-243 kubenswrapper[2566]: E0615 05:49:20.411583    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/18d62d01-84af-4660-af23-86aebdd4f714-networking-console-plugin-cert podName:18d62d01-84af-4660-af23-86aebdd4f714 nodeName:}" failed. No retries permitted until 2026-06-15 05:49:28.41156302 +0000 UTC m=+51.371320266 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/18d62d01-84af-4660-af23-86aebdd4f714-networking-console-plugin-cert") pod "networking-console-plugin-867b76cb74-qhtzq" (UID: "18d62d01-84af-4660-af23-86aebdd4f714") : secret "networking-console-plugin-cert" not found
Jun 15 05:49:20.411647 ip-10-0-128-243 kubenswrapper[2566]: E0615 05:49:20.411595    2566 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jun 15 05:49:20.411647 ip-10-0-128-243 kubenswrapper[2566]: E0615 05:49:20.411640    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/90916cd7-e2d5-4583-b5d6-8b254c9d091d-cluster-monitoring-operator-tls podName:90916cd7-e2d5-4583-b5d6-8b254c9d091d nodeName:}" failed. No retries permitted until 2026-06-15 05:49:28.411628885 +0000 UTC m=+51.371386171 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/90916cd7-e2d5-4583-b5d6-8b254c9d091d-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-f9d7df769-jlxrk" (UID: "90916cd7-e2d5-4583-b5d6-8b254c9d091d") : secret "cluster-monitoring-operator-tls" not found
Jun 15 05:49:20.652679 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:49:20.652650    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-c5vrl" event={"ID":"0246685c-f9e4-45b0-bb3f-b17957621809","Type":"ContainerStarted","Data":"0581510c7a781d9d5a71076759119f26b49306fbb09bdc4767c08fd4210a1929"}
Jun 15 05:49:21.658062 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:49:21.657978    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7c578b78fc-pr6nz" event={"ID":"0ed3f738-1daf-4d28-8c14-3c7b5139e7dd","Type":"ContainerStarted","Data":"9350a0c246f42993958f527e286a94641d1e415ee15ab0c324798f2414e1fd3c"}
Jun 15 05:49:21.660069 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:49:21.660033    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-6947749cfc-lxqzc" event={"ID":"ab71270c-39e2-4162-864c-4f1515189432","Type":"ContainerStarted","Data":"0ea786b52fbe486472b6afdf979afb39bc043d19fa8e157ab7bcaaf2a2994582"}
Jun 15 05:49:21.663184 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:49:21.663162    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5dbbb5d744-ktjgp_67da60eb-27f9-4bbd-8d12-64275e801143/console-operator/0.log"
Jun 15 05:49:21.663283 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:49:21.663199    2566 generic.go:356] "Generic (PLEG): container finished" podID="67da60eb-27f9-4bbd-8d12-64275e801143" containerID="3e9497e757a10ade756ccf083d801a718538b79b19b528eb33b66a77a57b2459" exitCode=255
Jun 15 05:49:21.663283 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:49:21.663273    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-5dbbb5d744-ktjgp" event={"ID":"67da60eb-27f9-4bbd-8d12-64275e801143","Type":"ContainerDied","Data":"3e9497e757a10ade756ccf083d801a718538b79b19b528eb33b66a77a57b2459"}
Jun 15 05:49:21.663540 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:49:21.663509    2566 scope.go:117] "RemoveContainer" containerID="3e9497e757a10ade756ccf083d801a718538b79b19b528eb33b66a77a57b2459"
Jun 15 05:49:21.666286 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:49:21.666256    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-bd4ccd799-2556x" event={"ID":"b1bd12ae-f8b5-4d48-bced-c60779b6f7c6","Type":"ContainerStarted","Data":"c3a6e38a22047a8bc3c310e523c48f4ef7c7969763912c5dcb5c86867eb03b34"}
Jun 15 05:49:21.667924 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:49:21.667889    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5bbd86d6bd-4bc2h" event={"ID":"12ada117-da7b-47e4-bab9-92368a63edf8","Type":"ContainerStarted","Data":"6dadd812a2871e6f4d6c59155cc66232da35062175592dd20060237ba48a6dc9"}
Jun 15 05:49:21.669373 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:49:21.669350    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-9gk6x" event={"ID":"dc5c749d-22b4-461f-8c24-9da0f33c52f7","Type":"ContainerStarted","Data":"550f14988ab640bba4f4042acb8bdbdc79987b48d1e1382167aaff0c886229cd"}
Jun 15 05:49:21.671359 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:49:21.671338    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-7ccbfd59dc-42zqt" event={"ID":"6771aa98-7d47-4ae5-b63e-7c6bb456a86b","Type":"ContainerStarted","Data":"713b1558b808b974d7b03433718d4f9f4126190e1d1007c65c7d5b76a146d0fb"}
Jun 15 05:49:21.678407 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:49:21.678365    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7c578b78fc-pr6nz" podStartSLOduration=34.349843903 podStartE2EDuration="41.678349957s" totalImagesPullingTime="7.328506054s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-15 05:48:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 05:49:21.677601272 +0000 UTC m=+44.637358555" watchObservedRunningTime="2026-06-15 05:49:21.678349957 +0000 UTC m=+44.638107198"
Jun 15 05:49:21.702286 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:49:21.702240    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-operator-5bbd86d6bd-4bc2h" podStartSLOduration=34.434949216 podStartE2EDuration="41.702222031s" totalImagesPullingTime="7.267272815s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-15 05:48:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 05:49:21.701992096 +0000 UTC m=+44.661749340" watchObservedRunningTime="2026-06-15 05:49:21.702222031 +0000 UTC m=+44.661979278"
Jun 15 05:49:21.747051 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:49:21.746999    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-6947749cfc-lxqzc" podStartSLOduration=34.468770465 podStartE2EDuration="41.746978987s" totalImagesPullingTime="7.278208522s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-15 05:48:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 05:49:21.745266534 +0000 UTC m=+44.705023835" watchObservedRunningTime="2026-06-15 05:49:21.746978987 +0000 UTC m=+44.706736233"
Jun 15 05:49:21.768360 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:49:21.768297    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-c5vrl" podStartSLOduration=15.269379043 podStartE2EDuration="44.768276629s" totalImagesPullingTime="29.498897586s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-15 05:48:37 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 05:49:21.766589678 +0000 UTC m=+44.726346925" watchObservedRunningTime="2026-06-15 05:49:21.768276629 +0000 UTC m=+44.728033878"
Jun 15 05:49:21.804851 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:49:21.804746    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-7ccbfd59dc-42zqt" podStartSLOduration=34.236838797 podStartE2EDuration="41.804725721s" totalImagesPullingTime="7.567886924s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-15 05:48:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 05:49:21.787626843 +0000 UTC m=+44.747384090" watchObservedRunningTime="2026-06-15 05:49:21.804725721 +0000 UTC m=+44.764482966"
Jun 15 05:49:21.805559 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:49:21.805524    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-bd4ccd799-2556x" podStartSLOduration=34.533991569 podStartE2EDuration="41.805515771s" totalImagesPullingTime="7.271524202s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-15 05:48:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 05:49:21.80406166 +0000 UTC m=+44.763818908" watchObservedRunningTime="2026-06-15 05:49:21.805515771 +0000 UTC m=+44.765272997"
Jun 15 05:49:21.824959 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:49:21.824549    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-9gk6x" podStartSLOduration=2.532480443 podStartE2EDuration="9.824528227s" totalImagesPullingTime="7.292047784s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-15 05:49:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 05:49:21.822824687 +0000 UTC m=+44.782581933" watchObservedRunningTime="2026-06-15 05:49:21.824528227 +0000 UTC m=+44.784285473"
Jun 15 05:49:22.676454 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:49:22.676423    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5dbbb5d744-ktjgp_67da60eb-27f9-4bbd-8d12-64275e801143/console-operator/1.log"
Jun 15 05:49:22.676944 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:49:22.676932    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5dbbb5d744-ktjgp_67da60eb-27f9-4bbd-8d12-64275e801143/console-operator/0.log"
Jun 15 05:49:22.676996 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:49:22.676964    2566 generic.go:356] "Generic (PLEG): container finished" podID="67da60eb-27f9-4bbd-8d12-64275e801143" containerID="542a5c8cccda87cc0fb6413ba055f41eb6ba331af09a37388b3bad0f7c1d69f2" exitCode=255
Jun 15 05:49:22.677051 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:49:22.677035    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-5dbbb5d744-ktjgp" event={"ID":"67da60eb-27f9-4bbd-8d12-64275e801143","Type":"ContainerDied","Data":"542a5c8cccda87cc0fb6413ba055f41eb6ba331af09a37388b3bad0f7c1d69f2"}
Jun 15 05:49:22.677144 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:49:22.677130    2566 scope.go:117] "RemoveContainer" containerID="3e9497e757a10ade756ccf083d801a718538b79b19b528eb33b66a77a57b2459"
Jun 15 05:49:22.677329 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:49:22.677304    2566 scope.go:117] "RemoveContainer" containerID="542a5c8cccda87cc0fb6413ba055f41eb6ba331af09a37388b3bad0f7c1d69f2"
Jun 15 05:49:22.677510 ip-10-0-128-243 kubenswrapper[2566]: E0615 05:49:22.677483    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-5dbbb5d744-ktjgp_openshift-console-operator(67da60eb-27f9-4bbd-8d12-64275e801143)\"" pod="openshift-console-operator/console-operator-5dbbb5d744-ktjgp" podUID="67da60eb-27f9-4bbd-8d12-64275e801143"
Jun 15 05:49:22.716467 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:49:22.716438    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-sfxtc"]
Jun 15 05:49:22.738012 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:49:22.737991    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-sfxtc"]
Jun 15 05:49:22.738144 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:49:22.738098    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-sfxtc"
Jun 15 05:49:22.740336 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:49:22.740312    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Jun 15 05:49:22.740530 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:49:22.740326    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-lbvfg\""
Jun 15 05:49:22.740530 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:49:22.740365    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Jun 15 05:49:22.912160 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:49:22.912131    2566 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-5dbbb5d744-ktjgp"
Jun 15 05:49:22.912303 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:49:22.912177    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-5dbbb5d744-ktjgp"
Jun 15 05:49:22.934537 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:49:22.934477    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/06cb31df-a606-4e81-ae47-a49ee7dd6083-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-sfxtc\" (UID: \"06cb31df-a606-4e81-ae47-a49ee7dd6083\") " pod="openshift-insights/insights-runtime-extractor-sfxtc"
Jun 15 05:49:22.934537 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:49:22.934512    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/06cb31df-a606-4e81-ae47-a49ee7dd6083-crio-socket\") pod \"insights-runtime-extractor-sfxtc\" (UID: \"06cb31df-a606-4e81-ae47-a49ee7dd6083\") " pod="openshift-insights/insights-runtime-extractor-sfxtc"
Jun 15 05:49:22.934666 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:49:22.934538    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/06cb31df-a606-4e81-ae47-a49ee7dd6083-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-sfxtc\" (UID: \"06cb31df-a606-4e81-ae47-a49ee7dd6083\") " pod="openshift-insights/insights-runtime-extractor-sfxtc"
Jun 15 05:49:22.934705 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:49:22.934666    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cgmzw\" (UniqueName: \"kubernetes.io/projected/06cb31df-a606-4e81-ae47-a49ee7dd6083-kube-api-access-cgmzw\") pod \"insights-runtime-extractor-sfxtc\" (UID: \"06cb31df-a606-4e81-ae47-a49ee7dd6083\") " pod="openshift-insights/insights-runtime-extractor-sfxtc"
Jun 15 05:49:22.934738 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:49:22.934723    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/06cb31df-a606-4e81-ae47-a49ee7dd6083-data-volume\") pod \"insights-runtime-extractor-sfxtc\" (UID: \"06cb31df-a606-4e81-ae47-a49ee7dd6083\") " pod="openshift-insights/insights-runtime-extractor-sfxtc"
Jun 15 05:49:23.035231 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:49:23.035199    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/06cb31df-a606-4e81-ae47-a49ee7dd6083-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-sfxtc\" (UID: \"06cb31df-a606-4e81-ae47-a49ee7dd6083\") " pod="openshift-insights/insights-runtime-extractor-sfxtc"
Jun 15 05:49:23.035348 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:49:23.035241    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/06cb31df-a606-4e81-ae47-a49ee7dd6083-crio-socket\") pod \"insights-runtime-extractor-sfxtc\" (UID: \"06cb31df-a606-4e81-ae47-a49ee7dd6083\") " pod="openshift-insights/insights-runtime-extractor-sfxtc"
Jun 15 05:49:23.035348 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:49:23.035266    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/06cb31df-a606-4e81-ae47-a49ee7dd6083-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-sfxtc\" (UID: \"06cb31df-a606-4e81-ae47-a49ee7dd6083\") " pod="openshift-insights/insights-runtime-extractor-sfxtc"
Jun 15 05:49:23.035348 ip-10-0-128-243 kubenswrapper[2566]: E0615 05:49:23.035338    2566 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jun 15 05:49:23.035533 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:49:23.035356    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cgmzw\" (UniqueName: \"kubernetes.io/projected/06cb31df-a606-4e81-ae47-a49ee7dd6083-kube-api-access-cgmzw\") pod \"insights-runtime-extractor-sfxtc\" (UID: \"06cb31df-a606-4e81-ae47-a49ee7dd6083\") " pod="openshift-insights/insights-runtime-extractor-sfxtc"
Jun 15 05:49:23.035533 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:49:23.035397    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/06cb31df-a606-4e81-ae47-a49ee7dd6083-data-volume\") pod \"insights-runtime-extractor-sfxtc\" (UID: \"06cb31df-a606-4e81-ae47-a49ee7dd6083\") " pod="openshift-insights/insights-runtime-extractor-sfxtc"
Jun 15 05:49:23.035533 ip-10-0-128-243 kubenswrapper[2566]: E0615 05:49:23.035422    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/06cb31df-a606-4e81-ae47-a49ee7dd6083-kube-rbac-proxy-cm podName:06cb31df-a606-4e81-ae47-a49ee7dd6083 nodeName:}" failed. No retries permitted until 2026-06-15 05:49:23.535401395 +0000 UTC m=+46.495158631 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/06cb31df-a606-4e81-ae47-a49ee7dd6083-kube-rbac-proxy-cm") pod "insights-runtime-extractor-sfxtc" (UID: "06cb31df-a606-4e81-ae47-a49ee7dd6083") : configmap "kube-rbac-proxy" not found
Jun 15 05:49:23.035533 ip-10-0-128-243 kubenswrapper[2566]: E0615 05:49:23.035451    2566 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jun 15 05:49:23.035533 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:49:23.035462    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/06cb31df-a606-4e81-ae47-a49ee7dd6083-crio-socket\") pod \"insights-runtime-extractor-sfxtc\" (UID: \"06cb31df-a606-4e81-ae47-a49ee7dd6083\") " pod="openshift-insights/insights-runtime-extractor-sfxtc"
Jun 15 05:49:23.035758 ip-10-0-128-243 kubenswrapper[2566]: E0615 05:49:23.035570    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/06cb31df-a606-4e81-ae47-a49ee7dd6083-insights-runtime-extractor-tls podName:06cb31df-a606-4e81-ae47-a49ee7dd6083 nodeName:}" failed. No retries permitted until 2026-06-15 05:49:23.535553531 +0000 UTC m=+46.495310759 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/06cb31df-a606-4e81-ae47-a49ee7dd6083-insights-runtime-extractor-tls") pod "insights-runtime-extractor-sfxtc" (UID: "06cb31df-a606-4e81-ae47-a49ee7dd6083") : secret "insights-runtime-extractor-tls" not found
Jun 15 05:49:23.035758 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:49:23.035652    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/06cb31df-a606-4e81-ae47-a49ee7dd6083-data-volume\") pod \"insights-runtime-extractor-sfxtc\" (UID: \"06cb31df-a606-4e81-ae47-a49ee7dd6083\") " pod="openshift-insights/insights-runtime-extractor-sfxtc"
Jun 15 05:49:23.045230 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:49:23.045202    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cgmzw\" (UniqueName: \"kubernetes.io/projected/06cb31df-a606-4e81-ae47-a49ee7dd6083-kube-api-access-cgmzw\") pod \"insights-runtime-extractor-sfxtc\" (UID: \"06cb31df-a606-4e81-ae47-a49ee7dd6083\") " pod="openshift-insights/insights-runtime-extractor-sfxtc"
Jun 15 05:49:23.539055 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:49:23.539019    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/06cb31df-a606-4e81-ae47-a49ee7dd6083-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-sfxtc\" (UID: \"06cb31df-a606-4e81-ae47-a49ee7dd6083\") " pod="openshift-insights/insights-runtime-extractor-sfxtc"
Jun 15 05:49:23.539229 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:49:23.539074    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/06cb31df-a606-4e81-ae47-a49ee7dd6083-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-sfxtc\" (UID: \"06cb31df-a606-4e81-ae47-a49ee7dd6083\") " pod="openshift-insights/insights-runtime-extractor-sfxtc"
Jun 15 05:49:23.539229 ip-10-0-128-243 kubenswrapper[2566]: E0615 05:49:23.539160    2566 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jun 15 05:49:23.539229 ip-10-0-128-243 kubenswrapper[2566]: E0615 05:49:23.539221    2566 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jun 15 05:49:23.539327 ip-10-0-128-243 kubenswrapper[2566]: E0615 05:49:23.539239    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/06cb31df-a606-4e81-ae47-a49ee7dd6083-kube-rbac-proxy-cm podName:06cb31df-a606-4e81-ae47-a49ee7dd6083 nodeName:}" failed. No retries permitted until 2026-06-15 05:49:24.539222814 +0000 UTC m=+47.498980037 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/06cb31df-a606-4e81-ae47-a49ee7dd6083-kube-rbac-proxy-cm") pod "insights-runtime-extractor-sfxtc" (UID: "06cb31df-a606-4e81-ae47-a49ee7dd6083") : configmap "kube-rbac-proxy" not found
Jun 15 05:49:23.539327 ip-10-0-128-243 kubenswrapper[2566]: E0615 05:49:23.539259    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/06cb31df-a606-4e81-ae47-a49ee7dd6083-insights-runtime-extractor-tls podName:06cb31df-a606-4e81-ae47-a49ee7dd6083 nodeName:}" failed. No retries permitted until 2026-06-15 05:49:24.539248833 +0000 UTC m=+47.499006056 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/06cb31df-a606-4e81-ae47-a49ee7dd6083-insights-runtime-extractor-tls") pod "insights-runtime-extractor-sfxtc" (UID: "06cb31df-a606-4e81-ae47-a49ee7dd6083") : secret "insights-runtime-extractor-tls" not found
Jun 15 05:49:23.681209 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:49:23.681182    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5dbbb5d744-ktjgp_67da60eb-27f9-4bbd-8d12-64275e801143/console-operator/1.log"
Jun 15 05:49:23.681650 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:49:23.681566    2566 scope.go:117] "RemoveContainer" containerID="542a5c8cccda87cc0fb6413ba055f41eb6ba331af09a37388b3bad0f7c1d69f2"
Jun 15 05:49:23.681772 ip-10-0-128-243 kubenswrapper[2566]: E0615 05:49:23.681749    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-5dbbb5d744-ktjgp_openshift-console-operator(67da60eb-27f9-4bbd-8d12-64275e801143)\"" pod="openshift-console-operator/console-operator-5dbbb5d744-ktjgp" podUID="67da60eb-27f9-4bbd-8d12-64275e801143"
Jun 15 05:49:24.547545 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:49:24.547520    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/06cb31df-a606-4e81-ae47-a49ee7dd6083-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-sfxtc\" (UID: \"06cb31df-a606-4e81-ae47-a49ee7dd6083\") " pod="openshift-insights/insights-runtime-extractor-sfxtc"
Jun 15 05:49:24.547725 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:49:24.547565    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/06cb31df-a606-4e81-ae47-a49ee7dd6083-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-sfxtc\" (UID: \"06cb31df-a606-4e81-ae47-a49ee7dd6083\") " pod="openshift-insights/insights-runtime-extractor-sfxtc"
Jun 15 05:49:24.547725 ip-10-0-128-243 kubenswrapper[2566]: E0615 05:49:24.547635    2566 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jun 15 05:49:24.547725 ip-10-0-128-243 kubenswrapper[2566]: E0615 05:49:24.547680    2566 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jun 15 05:49:24.547725 ip-10-0-128-243 kubenswrapper[2566]: E0615 05:49:24.547692    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/06cb31df-a606-4e81-ae47-a49ee7dd6083-kube-rbac-proxy-cm podName:06cb31df-a606-4e81-ae47-a49ee7dd6083 nodeName:}" failed. No retries permitted until 2026-06-15 05:49:26.547677888 +0000 UTC m=+49.507435110 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/06cb31df-a606-4e81-ae47-a49ee7dd6083-kube-rbac-proxy-cm") pod "insights-runtime-extractor-sfxtc" (UID: "06cb31df-a606-4e81-ae47-a49ee7dd6083") : configmap "kube-rbac-proxy" not found
Jun 15 05:49:24.547725 ip-10-0-128-243 kubenswrapper[2566]: E0615 05:49:24.547724    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/06cb31df-a606-4e81-ae47-a49ee7dd6083-insights-runtime-extractor-tls podName:06cb31df-a606-4e81-ae47-a49ee7dd6083 nodeName:}" failed. No retries permitted until 2026-06-15 05:49:26.547713562 +0000 UTC m=+49.507470784 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/06cb31df-a606-4e81-ae47-a49ee7dd6083-insights-runtime-extractor-tls") pod "insights-runtime-extractor-sfxtc" (UID: "06cb31df-a606-4e81-ae47-a49ee7dd6083") : secret "insights-runtime-extractor-tls" not found
Jun 15 05:49:24.685329 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:49:24.685300    2566 scope.go:117] "RemoveContainer" containerID="542a5c8cccda87cc0fb6413ba055f41eb6ba331af09a37388b3bad0f7c1d69f2"
Jun 15 05:49:24.686071 ip-10-0-128-243 kubenswrapper[2566]: E0615 05:49:24.686043    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-5dbbb5d744-ktjgp_openshift-console-operator(67da60eb-27f9-4bbd-8d12-64275e801143)\"" pod="openshift-console-operator/console-operator-5dbbb5d744-ktjgp" podUID="67da60eb-27f9-4bbd-8d12-64275e801143"
Jun 15 05:49:25.503963 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:49:25.503933    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-n8bz5_c1ebb64e-4a47-4507-b619-32502fb528ca/dns-node-resolver/0.log"
Jun 15 05:49:26.304777 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:49:26.304754    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-frzbm_2e630a88-8b65-4dd7-970d-cfd8e5d031c6/node-ca/0.log"
Jun 15 05:49:26.564131 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:49:26.564040    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/06cb31df-a606-4e81-ae47-a49ee7dd6083-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-sfxtc\" (UID: \"06cb31df-a606-4e81-ae47-a49ee7dd6083\") " pod="openshift-insights/insights-runtime-extractor-sfxtc"
Jun 15 05:49:26.564131 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:49:26.564120    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/06cb31df-a606-4e81-ae47-a49ee7dd6083-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-sfxtc\" (UID: \"06cb31df-a606-4e81-ae47-a49ee7dd6083\") " pod="openshift-insights/insights-runtime-extractor-sfxtc"
Jun 15 05:49:26.564302 ip-10-0-128-243 kubenswrapper[2566]: E0615 05:49:26.564166    2566 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jun 15 05:49:26.564302 ip-10-0-128-243 kubenswrapper[2566]: E0615 05:49:26.564235    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/06cb31df-a606-4e81-ae47-a49ee7dd6083-kube-rbac-proxy-cm podName:06cb31df-a606-4e81-ae47-a49ee7dd6083 nodeName:}" failed. No retries permitted until 2026-06-15 05:49:30.564217086 +0000 UTC m=+53.523974328 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/06cb31df-a606-4e81-ae47-a49ee7dd6083-kube-rbac-proxy-cm") pod "insights-runtime-extractor-sfxtc" (UID: "06cb31df-a606-4e81-ae47-a49ee7dd6083") : configmap "kube-rbac-proxy" not found
Jun 15 05:49:26.564302 ip-10-0-128-243 kubenswrapper[2566]: E0615 05:49:26.564262    2566 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jun 15 05:49:26.564396 ip-10-0-128-243 kubenswrapper[2566]: E0615 05:49:26.564332    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/06cb31df-a606-4e81-ae47-a49ee7dd6083-insights-runtime-extractor-tls podName:06cb31df-a606-4e81-ae47-a49ee7dd6083 nodeName:}" failed. No retries permitted until 2026-06-15 05:49:30.564315033 +0000 UTC m=+53.524072256 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/06cb31df-a606-4e81-ae47-a49ee7dd6083-insights-runtime-extractor-tls") pod "insights-runtime-extractor-sfxtc" (UID: "06cb31df-a606-4e81-ae47-a49ee7dd6083") : secret "insights-runtime-extractor-tls" not found
Jun 15 05:49:27.310092 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:49:27.310061    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-9gk6x_dc5c749d-22b4-461f-8c24-9da0f33c52f7/serve-healthcheck-canary/0.log"
Jun 15 05:49:28.105391 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:49:28.105361    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-7c578b78fc-pr6nz_0ed3f738-1daf-4d28-8c14-3c7b5139e7dd/kube-storage-version-migrator-operator/0.log"
Jun 15 05:49:28.277858 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:49:28.277819    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/7ed3b8df-025b-4073-95eb-c614783dac86-samples-operator-tls\") pod \"cluster-samples-operator-9547488fd-krhb7\" (UID: \"7ed3b8df-025b-4073-95eb-c614783dac86\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-9547488fd-krhb7"
Jun 15 05:49:28.277858 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:49:28.277856    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/0addacd9-d43e-43c0-8be8-608abc918f38-registry-tls\") pod \"image-registry-8559c46f69-f7hlb\" (UID: \"0addacd9-d43e-43c0-8be8-608abc918f38\") " pod="openshift-image-registry/image-registry-8559c46f69-f7hlb"
Jun 15 05:49:28.278054 ip-10-0-128-243 kubenswrapper[2566]: E0615 05:49:28.277971    2566 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jun 15 05:49:28.278054 ip-10-0-128-243 kubenswrapper[2566]: E0615 05:49:28.278014    2566 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jun 15 05:49:28.278054 ip-10-0-128-243 kubenswrapper[2566]: E0615 05:49:28.278026    2566 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-8559c46f69-f7hlb: secret "image-registry-tls" not found
Jun 15 05:49:28.278054 ip-10-0-128-243 kubenswrapper[2566]: E0615 05:49:28.278035    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7ed3b8df-025b-4073-95eb-c614783dac86-samples-operator-tls podName:7ed3b8df-025b-4073-95eb-c614783dac86 nodeName:}" failed. No retries permitted until 2026-06-15 05:49:44.278020575 +0000 UTC m=+67.237777803 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/7ed3b8df-025b-4073-95eb-c614783dac86-samples-operator-tls") pod "cluster-samples-operator-9547488fd-krhb7" (UID: "7ed3b8df-025b-4073-95eb-c614783dac86") : secret "samples-operator-tls" not found
Jun 15 05:49:28.278215 ip-10-0-128-243 kubenswrapper[2566]: E0615 05:49:28.278063    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0addacd9-d43e-43c0-8be8-608abc918f38-registry-tls podName:0addacd9-d43e-43c0-8be8-608abc918f38 nodeName:}" failed. No retries permitted until 2026-06-15 05:49:44.278052525 +0000 UTC m=+67.237809749 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/0addacd9-d43e-43c0-8be8-608abc918f38-registry-tls") pod "image-registry-8559c46f69-f7hlb" (UID: "0addacd9-d43e-43c0-8be8-608abc918f38") : secret "image-registry-tls" not found
Jun 15 05:49:28.378886 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:49:28.378789    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/477f44b3-0328-417c-a5db-442ea835eb70-metrics-tls\") pod \"dns-default-smfqb\" (UID: \"477f44b3-0328-417c-a5db-442ea835eb70\") " pod="openshift-dns/dns-default-smfqb"
Jun 15 05:49:28.378886 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:49:28.378851    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3b8ee52d-b179-492b-960c-b978e06cd8a7-metrics-certs\") pod \"router-default-8bdfdcbd8-4fc26\" (UID: \"3b8ee52d-b179-492b-960c-b978e06cd8a7\") " pod="openshift-ingress/router-default-8bdfdcbd8-4fc26"
Jun 15 05:49:28.378886 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:49:28.378886    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3b8ee52d-b179-492b-960c-b978e06cd8a7-service-ca-bundle\") pod \"router-default-8bdfdcbd8-4fc26\" (UID: \"3b8ee52d-b179-492b-960c-b978e06cd8a7\") " pod="openshift-ingress/router-default-8bdfdcbd8-4fc26"
Jun 15 05:49:28.379379 ip-10-0-128-243 kubenswrapper[2566]: E0615 05:49:28.378939    2566 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jun 15 05:49:28.379379 ip-10-0-128-243 kubenswrapper[2566]: E0615 05:49:28.379009    2566 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jun 15 05:49:28.379379 ip-10-0-128-243 kubenswrapper[2566]: E0615 05:49:28.379059    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/477f44b3-0328-417c-a5db-442ea835eb70-metrics-tls podName:477f44b3-0328-417c-a5db-442ea835eb70 nodeName:}" failed. No retries permitted until 2026-06-15 05:49:44.379044628 +0000 UTC m=+67.338801850 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/477f44b3-0328-417c-a5db-442ea835eb70-metrics-tls") pod "dns-default-smfqb" (UID: "477f44b3-0328-417c-a5db-442ea835eb70") : secret "dns-default-metrics-tls" not found
Jun 15 05:49:28.379379 ip-10-0-128-243 kubenswrapper[2566]: E0615 05:49:28.379075    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/3b8ee52d-b179-492b-960c-b978e06cd8a7-service-ca-bundle podName:3b8ee52d-b179-492b-960c-b978e06cd8a7 nodeName:}" failed. No retries permitted until 2026-06-15 05:49:44.379068425 +0000 UTC m=+67.338825652 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/3b8ee52d-b179-492b-960c-b978e06cd8a7-service-ca-bundle") pod "router-default-8bdfdcbd8-4fc26" (UID: "3b8ee52d-b179-492b-960c-b978e06cd8a7") : configmap references non-existent config key: service-ca.crt
Jun 15 05:49:28.379379 ip-10-0-128-243 kubenswrapper[2566]: E0615 05:49:28.379103    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3b8ee52d-b179-492b-960c-b978e06cd8a7-metrics-certs podName:3b8ee52d-b179-492b-960c-b978e06cd8a7 nodeName:}" failed. No retries permitted until 2026-06-15 05:49:44.379097822 +0000 UTC m=+67.338855045 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3b8ee52d-b179-492b-960c-b978e06cd8a7-metrics-certs") pod "router-default-8bdfdcbd8-4fc26" (UID: "3b8ee52d-b179-492b-960c-b978e06cd8a7") : secret "router-metrics-certs-default" not found
Jun 15 05:49:28.479914 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:49:28.479879    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/90916cd7-e2d5-4583-b5d6-8b254c9d091d-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-f9d7df769-jlxrk\" (UID: \"90916cd7-e2d5-4583-b5d6-8b254c9d091d\") " pod="openshift-monitoring/cluster-monitoring-operator-f9d7df769-jlxrk"
Jun 15 05:49:28.480107 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:49:28.479975    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/18d62d01-84af-4660-af23-86aebdd4f714-networking-console-plugin-cert\") pod \"networking-console-plugin-867b76cb74-qhtzq\" (UID: \"18d62d01-84af-4660-af23-86aebdd4f714\") " pod="openshift-network-console/networking-console-plugin-867b76cb74-qhtzq"
Jun 15 05:49:28.480107 ip-10-0-128-243 kubenswrapper[2566]: E0615 05:49:28.480036    2566 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jun 15 05:49:28.480188 ip-10-0-128-243 kubenswrapper[2566]: E0615 05:49:28.480134    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/90916cd7-e2d5-4583-b5d6-8b254c9d091d-cluster-monitoring-operator-tls podName:90916cd7-e2d5-4583-b5d6-8b254c9d091d nodeName:}" failed. No retries permitted until 2026-06-15 05:49:44.480114549 +0000 UTC m=+67.439871780 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/90916cd7-e2d5-4583-b5d6-8b254c9d091d-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-f9d7df769-jlxrk" (UID: "90916cd7-e2d5-4583-b5d6-8b254c9d091d") : secret "cluster-monitoring-operator-tls" not found
Jun 15 05:49:28.480188 ip-10-0-128-243 kubenswrapper[2566]: E0615 05:49:28.480132    2566 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jun 15 05:49:28.480261 ip-10-0-128-243 kubenswrapper[2566]: E0615 05:49:28.480238    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/18d62d01-84af-4660-af23-86aebdd4f714-networking-console-plugin-cert podName:18d62d01-84af-4660-af23-86aebdd4f714 nodeName:}" failed. No retries permitted until 2026-06-15 05:49:44.480226218 +0000 UTC m=+67.439983440 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/18d62d01-84af-4660-af23-86aebdd4f714-networking-console-plugin-cert") pod "networking-console-plugin-867b76cb74-qhtzq" (UID: "18d62d01-84af-4660-af23-86aebdd4f714") : secret "networking-console-plugin-cert" not found
Jun 15 05:49:30.599437 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:49:30.599402    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/06cb31df-a606-4e81-ae47-a49ee7dd6083-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-sfxtc\" (UID: \"06cb31df-a606-4e81-ae47-a49ee7dd6083\") " pod="openshift-insights/insights-runtime-extractor-sfxtc"
Jun 15 05:49:30.599821 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:49:30.599453    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/06cb31df-a606-4e81-ae47-a49ee7dd6083-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-sfxtc\" (UID: \"06cb31df-a606-4e81-ae47-a49ee7dd6083\") " pod="openshift-insights/insights-runtime-extractor-sfxtc"
Jun 15 05:49:30.599821 ip-10-0-128-243 kubenswrapper[2566]: E0615 05:49:30.599570    2566 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jun 15 05:49:30.599821 ip-10-0-128-243 kubenswrapper[2566]: E0615 05:49:30.599621    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/06cb31df-a606-4e81-ae47-a49ee7dd6083-insights-runtime-extractor-tls podName:06cb31df-a606-4e81-ae47-a49ee7dd6083 nodeName:}" failed. No retries permitted until 2026-06-15 05:49:38.599608778 +0000 UTC m=+61.559366001 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/06cb31df-a606-4e81-ae47-a49ee7dd6083-insights-runtime-extractor-tls") pod "insights-runtime-extractor-sfxtc" (UID: "06cb31df-a606-4e81-ae47-a49ee7dd6083") : secret "insights-runtime-extractor-tls" not found
Jun 15 05:49:30.599946 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:49:30.599925    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/06cb31df-a606-4e81-ae47-a49ee7dd6083-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-sfxtc\" (UID: \"06cb31df-a606-4e81-ae47-a49ee7dd6083\") " pod="openshift-insights/insights-runtime-extractor-sfxtc"
Jun 15 05:49:37.437345 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:49:37.437308    2566 scope.go:117] "RemoveContainer" containerID="542a5c8cccda87cc0fb6413ba055f41eb6ba331af09a37388b3bad0f7c1d69f2"
Jun 15 05:49:37.604907 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:49:37.604881    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-f4bzh"
Jun 15 05:49:37.728568 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:49:37.728494    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5dbbb5d744-ktjgp_67da60eb-27f9-4bbd-8d12-64275e801143/console-operator/2.log"
Jun 15 05:49:37.728897 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:49:37.728881    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5dbbb5d744-ktjgp_67da60eb-27f9-4bbd-8d12-64275e801143/console-operator/1.log"
Jun 15 05:49:37.728967 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:49:37.728915    2566 generic.go:356] "Generic (PLEG): container finished" podID="67da60eb-27f9-4bbd-8d12-64275e801143" containerID="779dd9d36536d99dd84e280a284a339dd069700e898eb129695778882f5512d3" exitCode=255
Jun 15 05:49:37.728967 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:49:37.728950    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-5dbbb5d744-ktjgp" event={"ID":"67da60eb-27f9-4bbd-8d12-64275e801143","Type":"ContainerDied","Data":"779dd9d36536d99dd84e280a284a339dd069700e898eb129695778882f5512d3"}
Jun 15 05:49:37.729047 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:49:37.729016    2566 scope.go:117] "RemoveContainer" containerID="542a5c8cccda87cc0fb6413ba055f41eb6ba331af09a37388b3bad0f7c1d69f2"
Jun 15 05:49:37.729356 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:49:37.729339    2566 scope.go:117] "RemoveContainer" containerID="779dd9d36536d99dd84e280a284a339dd069700e898eb129695778882f5512d3"
Jun 15 05:49:37.729524 ip-10-0-128-243 kubenswrapper[2566]: E0615 05:49:37.729505    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 20s restarting failed container=console-operator pod=console-operator-5dbbb5d744-ktjgp_openshift-console-operator(67da60eb-27f9-4bbd-8d12-64275e801143)\"" pod="openshift-console-operator/console-operator-5dbbb5d744-ktjgp" podUID="67da60eb-27f9-4bbd-8d12-64275e801143"
Jun 15 05:49:38.671874 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:49:38.671837    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/06cb31df-a606-4e81-ae47-a49ee7dd6083-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-sfxtc\" (UID: \"06cb31df-a606-4e81-ae47-a49ee7dd6083\") " pod="openshift-insights/insights-runtime-extractor-sfxtc"
Jun 15 05:49:38.674264 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:49:38.674236    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/06cb31df-a606-4e81-ae47-a49ee7dd6083-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-sfxtc\" (UID: \"06cb31df-a606-4e81-ae47-a49ee7dd6083\") " pod="openshift-insights/insights-runtime-extractor-sfxtc"
Jun 15 05:49:38.733183 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:49:38.733153    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5dbbb5d744-ktjgp_67da60eb-27f9-4bbd-8d12-64275e801143/console-operator/2.log"
Jun 15 05:49:38.951011 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:49:38.950928    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-lbvfg\""
Jun 15 05:49:38.959001 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:49:38.958981    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-sfxtc"
Jun 15 05:49:39.090542 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:49:39.090514    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-sfxtc"]
Jun 15 05:49:39.093798 ip-10-0-128-243 kubenswrapper[2566]: W0615 05:49:39.093770    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod06cb31df_a606_4e81_ae47_a49ee7dd6083.slice/crio-66f9678990f8acfcad7a57cc9193baf98bc56dda74f09e6beec417e0e5dbca23 WatchSource:0}: Error finding container 66f9678990f8acfcad7a57cc9193baf98bc56dda74f09e6beec417e0e5dbca23: Status 404 returned error can't find the container with id 66f9678990f8acfcad7a57cc9193baf98bc56dda74f09e6beec417e0e5dbca23
Jun 15 05:49:39.740052 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:49:39.740022    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-sfxtc" event={"ID":"06cb31df-a606-4e81-ae47-a49ee7dd6083","Type":"ContainerStarted","Data":"66f9678990f8acfcad7a57cc9193baf98bc56dda74f09e6beec417e0e5dbca23"}
Jun 15 05:49:42.751120 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:49:42.751021    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-sfxtc" event={"ID":"06cb31df-a606-4e81-ae47-a49ee7dd6083","Type":"ContainerStarted","Data":"8130685dfa3f7ac637602f55367929e8ae0505f51406518305c8bb196519e239"}
Jun 15 05:49:42.912830 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:49:42.912796    2566 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-5dbbb5d744-ktjgp"
Jun 15 05:49:42.912969 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:49:42.912877    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-5dbbb5d744-ktjgp"
Jun 15 05:49:42.913216 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:49:42.913202    2566 scope.go:117] "RemoveContainer" containerID="779dd9d36536d99dd84e280a284a339dd069700e898eb129695778882f5512d3"
Jun 15 05:49:42.913372 ip-10-0-128-243 kubenswrapper[2566]: E0615 05:49:42.913354    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 20s restarting failed container=console-operator pod=console-operator-5dbbb5d744-ktjgp_openshift-console-operator(67da60eb-27f9-4bbd-8d12-64275e801143)\"" pod="openshift-console-operator/console-operator-5dbbb5d744-ktjgp" podUID="67da60eb-27f9-4bbd-8d12-64275e801143"
Jun 15 05:49:43.116661 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:49:43.116622    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d81bd047-22fb-452e-b2d2-073f232701c2-metrics-certs\") pod \"network-metrics-daemon-cbmww\" (UID: \"d81bd047-22fb-452e-b2d2-073f232701c2\") " pod="openshift-multus/network-metrics-daemon-cbmww"
Jun 15 05:49:43.116838 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:49:43.116713    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7a806cb5-1d94-4558-9a7a-a734123af31b-original-pull-secret\") pod \"global-pull-secret-syncer-hpg5s\" (UID: \"7a806cb5-1d94-4558-9a7a-a734123af31b\") " pod="kube-system/global-pull-secret-syncer-hpg5s"
Jun 15 05:49:43.119349 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:49:43.119320    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jun 15 05:49:43.119444 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:49:43.119354    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jun 15 05:49:43.129632 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:49:43.129606    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d81bd047-22fb-452e-b2d2-073f232701c2-metrics-certs\") pod \"network-metrics-daemon-cbmww\" (UID: \"d81bd047-22fb-452e-b2d2-073f232701c2\") " pod="openshift-multus/network-metrics-daemon-cbmww"
Jun 15 05:49:43.129809 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:49:43.129787    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7a806cb5-1d94-4558-9a7a-a734123af31b-original-pull-secret\") pod \"global-pull-secret-syncer-hpg5s\" (UID: \"7a806cb5-1d94-4558-9a7a-a734123af31b\") " pod="kube-system/global-pull-secret-syncer-hpg5s"
Jun 15 05:49:43.217161 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:49:43.217128    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nc9t7\" (UniqueName: \"kubernetes.io/projected/7fb5709e-946d-4dc2-ac4f-72986f9adcdc-kube-api-access-nc9t7\") pod \"network-check-target-gbdt4\" (UID: \"7fb5709e-946d-4dc2-ac4f-72986f9adcdc\") " pod="openshift-network-diagnostics/network-check-target-gbdt4"
Jun 15 05:49:43.219799 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:49:43.219775    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nc9t7\" (UniqueName: \"kubernetes.io/projected/7fb5709e-946d-4dc2-ac4f-72986f9adcdc-kube-api-access-nc9t7\") pod \"network-check-target-gbdt4\" (UID: \"7fb5709e-946d-4dc2-ac4f-72986f9adcdc\") " pod="openshift-network-diagnostics/network-check-target-gbdt4"
Jun 15 05:49:43.354572 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:49:43.354539    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-tqf9b\""
Jun 15 05:49:43.362779 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:49:43.362752    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cbmww"
Jun 15 05:49:43.368045 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:49:43.368000    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hpg5s"
Jun 15 05:49:43.448097 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:49:43.448059    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-kxrkb\""
Jun 15 05:49:43.456816 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:49:43.456793    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gbdt4"
Jun 15 05:49:43.578849 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:49:43.578824    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-cbmww"]
Jun 15 05:49:43.580740 ip-10-0-128-243 kubenswrapper[2566]: W0615 05:49:43.580714    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd81bd047_22fb_452e_b2d2_073f232701c2.slice/crio-d76587393b51bcaf818ec597c70896e1f6a15af5dd9225ecb1f1ffcd4d80aa8b WatchSource:0}: Error finding container d76587393b51bcaf818ec597c70896e1f6a15af5dd9225ecb1f1ffcd4d80aa8b: Status 404 returned error can't find the container with id d76587393b51bcaf818ec597c70896e1f6a15af5dd9225ecb1f1ffcd4d80aa8b
Jun 15 05:49:43.593474 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:49:43.593445    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-hpg5s"]
Jun 15 05:49:43.597337 ip-10-0-128-243 kubenswrapper[2566]: W0615 05:49:43.597311    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7a806cb5_1d94_4558_9a7a_a734123af31b.slice/crio-e269c83482badbf4252035504c1304f0dc1637911f0788c06f7c9a57b84a20c2 WatchSource:0}: Error finding container e269c83482badbf4252035504c1304f0dc1637911f0788c06f7c9a57b84a20c2: Status 404 returned error can't find the container with id e269c83482badbf4252035504c1304f0dc1637911f0788c06f7c9a57b84a20c2
Jun 15 05:49:43.643223 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:49:43.643153    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-gbdt4"]
Jun 15 05:49:43.645970 ip-10-0-128-243 kubenswrapper[2566]: W0615 05:49:43.645944    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7fb5709e_946d_4dc2_ac4f_72986f9adcdc.slice/crio-c7d2f40750a9c44d932b6fc07d69013b7874239c4d2a6be716f9473ef8c20c77 WatchSource:0}: Error finding container c7d2f40750a9c44d932b6fc07d69013b7874239c4d2a6be716f9473ef8c20c77: Status 404 returned error can't find the container with id c7d2f40750a9c44d932b6fc07d69013b7874239c4d2a6be716f9473ef8c20c77
Jun 15 05:49:43.755970 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:49:43.755934    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-gbdt4" event={"ID":"7fb5709e-946d-4dc2-ac4f-72986f9adcdc","Type":"ContainerStarted","Data":"a1785a8bb2fc26a3fd704d492c600043bb36413698caa305bc653ec3ba5442e4"}
Jun 15 05:49:43.756353 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:49:43.755989    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-gbdt4" event={"ID":"7fb5709e-946d-4dc2-ac4f-72986f9adcdc","Type":"ContainerStarted","Data":"c7d2f40750a9c44d932b6fc07d69013b7874239c4d2a6be716f9473ef8c20c77"}
Jun 15 05:49:43.757037 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:49:43.757013    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-hpg5s" event={"ID":"7a806cb5-1d94-4558-9a7a-a734123af31b","Type":"ContainerStarted","Data":"e269c83482badbf4252035504c1304f0dc1637911f0788c06f7c9a57b84a20c2"}
Jun 15 05:49:43.758029 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:49:43.758008    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-cbmww" event={"ID":"d81bd047-22fb-452e-b2d2-073f232701c2","Type":"ContainerStarted","Data":"d76587393b51bcaf818ec597c70896e1f6a15af5dd9225ecb1f1ffcd4d80aa8b"}
Jun 15 05:49:43.759544 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:49:43.759526    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-sfxtc" event={"ID":"06cb31df-a606-4e81-ae47-a49ee7dd6083","Type":"ContainerStarted","Data":"a418d0b608e97671d936ac08b1613a12e023e06f829614474ee9d9c25d70fba5"}
Jun 15 05:49:44.328690 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:49:44.328652    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/0addacd9-d43e-43c0-8be8-608abc918f38-registry-tls\") pod \"image-registry-8559c46f69-f7hlb\" (UID: \"0addacd9-d43e-43c0-8be8-608abc918f38\") " pod="openshift-image-registry/image-registry-8559c46f69-f7hlb"
Jun 15 05:49:44.328882 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:49:44.328842    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/7ed3b8df-025b-4073-95eb-c614783dac86-samples-operator-tls\") pod \"cluster-samples-operator-9547488fd-krhb7\" (UID: \"7ed3b8df-025b-4073-95eb-c614783dac86\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-9547488fd-krhb7"
Jun 15 05:49:44.334218 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:49:44.334186    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/7ed3b8df-025b-4073-95eb-c614783dac86-samples-operator-tls\") pod \"cluster-samples-operator-9547488fd-krhb7\" (UID: \"7ed3b8df-025b-4073-95eb-c614783dac86\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-9547488fd-krhb7"
Jun 15 05:49:44.336319 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:49:44.336292    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/0addacd9-d43e-43c0-8be8-608abc918f38-registry-tls\") pod \"image-registry-8559c46f69-f7hlb\" (UID: \"0addacd9-d43e-43c0-8be8-608abc918f38\") " pod="openshift-image-registry/image-registry-8559c46f69-f7hlb"
Jun 15 05:49:44.430351 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:49:44.430310    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/477f44b3-0328-417c-a5db-442ea835eb70-metrics-tls\") pod \"dns-default-smfqb\" (UID: \"477f44b3-0328-417c-a5db-442ea835eb70\") " pod="openshift-dns/dns-default-smfqb"
Jun 15 05:49:44.430536 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:49:44.430388    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3b8ee52d-b179-492b-960c-b978e06cd8a7-metrics-certs\") pod \"router-default-8bdfdcbd8-4fc26\" (UID: \"3b8ee52d-b179-492b-960c-b978e06cd8a7\") " pod="openshift-ingress/router-default-8bdfdcbd8-4fc26"
Jun 15 05:49:44.430536 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:49:44.430435    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3b8ee52d-b179-492b-960c-b978e06cd8a7-service-ca-bundle\") pod \"router-default-8bdfdcbd8-4fc26\" (UID: \"3b8ee52d-b179-492b-960c-b978e06cd8a7\") " pod="openshift-ingress/router-default-8bdfdcbd8-4fc26"
Jun 15 05:49:44.431220 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:49:44.431192    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3b8ee52d-b179-492b-960c-b978e06cd8a7-service-ca-bundle\") pod \"router-default-8bdfdcbd8-4fc26\" (UID: \"3b8ee52d-b179-492b-960c-b978e06cd8a7\") " pod="openshift-ingress/router-default-8bdfdcbd8-4fc26"
Jun 15 05:49:44.434443 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:49:44.434106    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/477f44b3-0328-417c-a5db-442ea835eb70-metrics-tls\") pod \"dns-default-smfqb\" (UID: \"477f44b3-0328-417c-a5db-442ea835eb70\") " pod="openshift-dns/dns-default-smfqb"
Jun 15 05:49:44.434443 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:49:44.434398    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3b8ee52d-b179-492b-960c-b978e06cd8a7-metrics-certs\") pod \"router-default-8bdfdcbd8-4fc26\" (UID: \"3b8ee52d-b179-492b-960c-b978e06cd8a7\") " pod="openshift-ingress/router-default-8bdfdcbd8-4fc26"
Jun 15 05:49:44.531223 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:49:44.531183    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/18d62d01-84af-4660-af23-86aebdd4f714-networking-console-plugin-cert\") pod \"networking-console-plugin-867b76cb74-qhtzq\" (UID: \"18d62d01-84af-4660-af23-86aebdd4f714\") " pod="openshift-network-console/networking-console-plugin-867b76cb74-qhtzq"
Jun 15 05:49:44.531390 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:49:44.531276    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/90916cd7-e2d5-4583-b5d6-8b254c9d091d-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-f9d7df769-jlxrk\" (UID: \"90916cd7-e2d5-4583-b5d6-8b254c9d091d\") " pod="openshift-monitoring/cluster-monitoring-operator-f9d7df769-jlxrk"
Jun 15 05:49:44.535244 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:49:44.535216    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/18d62d01-84af-4660-af23-86aebdd4f714-networking-console-plugin-cert\") pod \"networking-console-plugin-867b76cb74-qhtzq\" (UID: \"18d62d01-84af-4660-af23-86aebdd4f714\") " pod="openshift-network-console/networking-console-plugin-867b76cb74-qhtzq"
Jun 15 05:49:44.540608 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:49:44.540579    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/90916cd7-e2d5-4583-b5d6-8b254c9d091d-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-f9d7df769-jlxrk\" (UID: \"90916cd7-e2d5-4583-b5d6-8b254c9d091d\") " pod="openshift-monitoring/cluster-monitoring-operator-f9d7df769-jlxrk"
Jun 15 05:49:44.549045 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:49:44.549009    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-v69w4\""
Jun 15 05:49:44.558993 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:49:44.558732    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-9547488fd-krhb7"
Jun 15 05:49:44.563196 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:49:44.563178    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-qnxfb\""
Jun 15 05:49:44.571373 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:49:44.571352    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-8559c46f69-f7hlb"
Jun 15 05:49:44.636101 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:49:44.636056    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-bq244\""
Jun 15 05:49:44.651103 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:49:44.644238    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-smfqb"
Jun 15 05:49:44.652218 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:49:44.651997    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-nnlfr\""
Jun 15 05:49:44.659962 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:49:44.659885    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-8bdfdcbd8-4fc26"
Jun 15 05:49:44.702054 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:49:44.697429    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-7h65l\""
Jun 15 05:49:44.705488 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:49:44.705259    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-f9d7df769-jlxrk"
Jun 15 05:49:44.748910 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:49:44.748684    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-76djh\""
Jun 15 05:49:44.758889 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:49:44.756549    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-867b76cb74-qhtzq"
Jun 15 05:49:44.775750 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:49:44.775667    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-gbdt4"
Jun 15 05:49:44.805371 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:49:44.804246    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-gbdt4" podStartSLOduration=67.804222675 podStartE2EDuration="1m7.804222675s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-15 05:48:37 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 05:49:44.795626766 +0000 UTC m=+67.755384032" watchObservedRunningTime="2026-06-15 05:49:44.804222675 +0000 UTC m=+67.763979922"
Jun 15 05:49:44.849798 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:49:44.849719    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-9547488fd-krhb7"]
Jun 15 05:49:44.870989 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:49:44.870903    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-8559c46f69-f7hlb"]
Jun 15 05:49:44.903868 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:49:44.903590    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-8bdfdcbd8-4fc26"]
Jun 15 05:49:44.915840 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:49:44.915812    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-smfqb"]
Jun 15 05:49:44.941343 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:49:44.941303    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-f9d7df769-jlxrk"]
Jun 15 05:49:45.538735 ip-10-0-128-243 kubenswrapper[2566]: W0615 05:49:45.538704    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3b8ee52d_b179_492b_960c_b978e06cd8a7.slice/crio-2a899a665cce63e666e528bc8bd1f2a0e8674338c746a39a84d153b1cda29547 WatchSource:0}: Error finding container 2a899a665cce63e666e528bc8bd1f2a0e8674338c746a39a84d153b1cda29547: Status 404 returned error can't find the container with id 2a899a665cce63e666e528bc8bd1f2a0e8674338c746a39a84d153b1cda29547
Jun 15 05:49:45.540693 ip-10-0-128-243 kubenswrapper[2566]: W0615 05:49:45.540663    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod477f44b3_0328_417c_a5db_442ea835eb70.slice/crio-efdde28d30e09b4bbab9b9e53f68264d2db2bbc3c8555d14cf465c6db6a19fee WatchSource:0}: Error finding container efdde28d30e09b4bbab9b9e53f68264d2db2bbc3c8555d14cf465c6db6a19fee: Status 404 returned error can't find the container with id efdde28d30e09b4bbab9b9e53f68264d2db2bbc3c8555d14cf465c6db6a19fee
Jun 15 05:49:45.541060 ip-10-0-128-243 kubenswrapper[2566]: W0615 05:49:45.541039    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0addacd9_d43e_43c0_8be8_608abc918f38.slice/crio-eaf8c1a7e3bbd5611e5adb0575feb59d88c641950815fd3a190ed8dd4a017b8f WatchSource:0}: Error finding container eaf8c1a7e3bbd5611e5adb0575feb59d88c641950815fd3a190ed8dd4a017b8f: Status 404 returned error can't find the container with id eaf8c1a7e3bbd5611e5adb0575feb59d88c641950815fd3a190ed8dd4a017b8f
Jun 15 05:49:45.725822 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:49:45.725788    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-867b76cb74-qhtzq"]
Jun 15 05:49:45.729715 ip-10-0-128-243 kubenswrapper[2566]: W0615 05:49:45.729684    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod18d62d01_84af_4660_af23_86aebdd4f714.slice/crio-95edc0630b47fe8a8458f975a48f87061dd98f0526e2db45552770b690b7145b WatchSource:0}: Error finding container 95edc0630b47fe8a8458f975a48f87061dd98f0526e2db45552770b690b7145b: Status 404 returned error can't find the container with id 95edc0630b47fe8a8458f975a48f87061dd98f0526e2db45552770b690b7145b
Jun 15 05:49:45.779959 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:49:45.779919    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-867b76cb74-qhtzq" event={"ID":"18d62d01-84af-4660-af23-86aebdd4f714","Type":"ContainerStarted","Data":"95edc0630b47fe8a8458f975a48f87061dd98f0526e2db45552770b690b7145b"}
Jun 15 05:49:45.781361 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:49:45.781326    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-f9d7df769-jlxrk" event={"ID":"90916cd7-e2d5-4583-b5d6-8b254c9d091d","Type":"ContainerStarted","Data":"9f0aabc470c87028cb8c41609eaac816f1dc2bb731b4a3913f3e466d557108c6"}
Jun 15 05:49:45.783189 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:49:45.783161    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-8bdfdcbd8-4fc26" event={"ID":"3b8ee52d-b179-492b-960c-b978e06cd8a7","Type":"ContainerStarted","Data":"cadc5a22fe5cf51fc24e4ca448f8938b0980a7dfb0314c47a77eafda7e2a4be0"}
Jun 15 05:49:45.783314 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:49:45.783209    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-8bdfdcbd8-4fc26" event={"ID":"3b8ee52d-b179-492b-960c-b978e06cd8a7","Type":"ContainerStarted","Data":"2a899a665cce63e666e528bc8bd1f2a0e8674338c746a39a84d153b1cda29547"}
Jun 15 05:49:45.785177 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:49:45.784877    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-8559c46f69-f7hlb" event={"ID":"0addacd9-d43e-43c0-8be8-608abc918f38","Type":"ContainerStarted","Data":"d01998c908be5d67695c535b5f7e02634ddfc9cb0cc623f8b1395b5a0e64c034"}
Jun 15 05:49:45.785177 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:49:45.784936    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-8559c46f69-f7hlb" event={"ID":"0addacd9-d43e-43c0-8be8-608abc918f38","Type":"ContainerStarted","Data":"eaf8c1a7e3bbd5611e5adb0575feb59d88c641950815fd3a190ed8dd4a017b8f"}
Jun 15 05:49:45.785177 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:49:45.785067    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-8559c46f69-f7hlb"
Jun 15 05:49:45.787513 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:49:45.787486    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-cbmww" event={"ID":"d81bd047-22fb-452e-b2d2-073f232701c2","Type":"ContainerStarted","Data":"a348371f77f27db6cab6e5baedbb3d5a5a1821dc76d40e9eb5388938e9c2e318"}
Jun 15 05:49:45.787605 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:49:45.787539    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-cbmww" event={"ID":"d81bd047-22fb-452e-b2d2-073f232701c2","Type":"ContainerStarted","Data":"43a33d843668e9e8390ccee2d7279d28a4b482de0a5aa64f51eac89b3dd0179a"}
Jun 15 05:49:45.789244 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:49:45.789189    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-9547488fd-krhb7" event={"ID":"7ed3b8df-025b-4073-95eb-c614783dac86","Type":"ContainerStarted","Data":"d6d9017cd9043486688aadd1ea2ec53b317c4941c3d905e56c54318adb7a3494"}
Jun 15 05:49:45.791712 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:49:45.791690    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-sfxtc" event={"ID":"06cb31df-a606-4e81-ae47-a49ee7dd6083","Type":"ContainerStarted","Data":"aeca548236bdbaddd9e8c5698b95f0316f0dafdde9e91c899d4acd202e5780fb"}
Jun 15 05:49:45.793219 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:49:45.793200    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-smfqb" event={"ID":"477f44b3-0328-417c-a5db-442ea835eb70","Type":"ContainerStarted","Data":"efdde28d30e09b4bbab9b9e53f68264d2db2bbc3c8555d14cf465c6db6a19fee"}
Jun 15 05:49:45.804757 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:49:45.804644    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/router-default-8bdfdcbd8-4fc26" podStartSLOduration=65.804627035 podStartE2EDuration="1m5.804627035s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-15 05:48:40 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 05:49:45.803981461 +0000 UTC m=+68.763738704" watchObservedRunningTime="2026-06-15 05:49:45.804627035 +0000 UTC m=+68.764384281"
Jun 15 05:49:45.824016 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:49:45.823965    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-cbmww" podStartSLOduration=67.731071927 podStartE2EDuration="1m8.823952519s" totalImagesPullingTime="1.092880592s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-15 05:48:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 05:49:45.823215698 +0000 UTC m=+68.782972970" watchObservedRunningTime="2026-06-15 05:49:45.823952519 +0000 UTC m=+68.783709741"
Jun 15 05:49:45.844109 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:49:45.843625    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-sfxtc" podStartSLOduration=17.558520808 podStartE2EDuration="23.843610238s" totalImagesPullingTime="6.28508943s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-15 05:49:22 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 05:49:45.842672523 +0000 UTC m=+68.802429770" watchObservedRunningTime="2026-06-15 05:49:45.843610238 +0000 UTC m=+68.803367460"
Jun 15 05:49:45.864918 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:49:45.864872    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-8559c46f69-f7hlb" podStartSLOduration=68.864857069 podStartE2EDuration="1m8.864857069s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-15 05:48:37 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 05:49:45.863989346 +0000 UTC m=+68.823746610" watchObservedRunningTime="2026-06-15 05:49:45.864857069 +0000 UTC m=+68.824614313"
Jun 15 05:49:46.660703 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:49:46.660658    2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-8bdfdcbd8-4fc26"
Jun 15 05:49:46.664036 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:49:46.663961    2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-8bdfdcbd8-4fc26"
Jun 15 05:49:46.799720 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:49:46.799657    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-8bdfdcbd8-4fc26"
Jun 15 05:49:46.801519 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:49:46.801493    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-8bdfdcbd8-4fc26"
Jun 15 05:49:50.818218 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:49:50.818142    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-smfqb" event={"ID":"477f44b3-0328-417c-a5db-442ea835eb70","Type":"ContainerStarted","Data":"9d699f1eada8c50f687b6b614441dece32ab8be682037d5bb0cde49abd6e7ba9"}
Jun 15 05:49:50.821638 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:49:50.821602    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-hpg5s" event={"ID":"7a806cb5-1d94-4558-9a7a-a734123af31b","Type":"ContainerStarted","Data":"67295101661e8ceff11cacb8470106268dcf1765cc158e34f56b777f4257e680"}
Jun 15 05:49:50.825921 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:49:50.824538    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-867b76cb74-qhtzq" event={"ID":"18d62d01-84af-4660-af23-86aebdd4f714","Type":"ContainerStarted","Data":"181a26d32e519b21446e157e049fe5a3ea9d947c2a5f13484db38174541f8013"}
Jun 15 05:49:50.829815 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:49:50.829330    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-f9d7df769-jlxrk" event={"ID":"90916cd7-e2d5-4583-b5d6-8b254c9d091d","Type":"ContainerStarted","Data":"19a7235283897cf53370ea7c168d4684b60857e9dbf98ffc98cf8fe67b25dca0"}
Jun 15 05:49:50.832468 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:49:50.832000    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-9547488fd-krhb7" event={"ID":"7ed3b8df-025b-4073-95eb-c614783dac86","Type":"ContainerStarted","Data":"258db0057ba55c3d743dfe7cdd28dd92e7429f968dda8250222d3a02e2a1af3f"}
Jun 15 05:49:50.832468 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:49:50.832048    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-9547488fd-krhb7" event={"ID":"7ed3b8df-025b-4073-95eb-c614783dac86","Type":"ContainerStarted","Data":"af142d05f27d1fda7a0d8a6096a968a5bfad535b75e977d772e93047b8c330d4"}
Jun 15 05:49:50.842116 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:49:50.842046    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-hpg5s" podStartSLOduration=66.981253399 podStartE2EDuration="1m13.841975549s" totalImagesPullingTime="6.86072215s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-15 05:48:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 05:49:50.840562714 +0000 UTC m=+73.800319964" watchObservedRunningTime="2026-06-15 05:49:50.841975549 +0000 UTC m=+73.801732794"
Jun 15 05:49:50.860817 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:49:50.859508    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-9547488fd-krhb7" podStartSLOduration=66.047397065 podStartE2EDuration="1m10.859490356s" totalImagesPullingTime="4.812093291s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-15 05:48:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 05:49:50.858464111 +0000 UTC m=+73.818221356" watchObservedRunningTime="2026-06-15 05:49:50.859490356 +0000 UTC m=+73.819247602"
Jun 15 05:49:50.882946 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:49:50.882587    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-console/networking-console-plugin-867b76cb74-qhtzq" podStartSLOduration=66.154509191 podStartE2EDuration="1m10.882573928s" totalImagesPullingTime="4.728064737s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-15 05:48:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 05:49:50.882360226 +0000 UTC m=+73.842117497" watchObservedRunningTime="2026-06-15 05:49:50.882573928 +0000 UTC m=+73.842331173"
Jun 15 05:49:50.906988 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:49:50.906933    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-f9d7df769-jlxrk" podStartSLOduration=65.991552059 podStartE2EDuration="1m10.906902802s" totalImagesPullingTime="4.915350743s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-15 05:48:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 05:49:50.905267811 +0000 UTC m=+73.865025056" watchObservedRunningTime="2026-06-15 05:49:50.906902802 +0000 UTC m=+73.866660048"
Jun 15 05:49:51.837445 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:49:51.837403    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-smfqb" event={"ID":"477f44b3-0328-417c-a5db-442ea835eb70","Type":"ContainerStarted","Data":"b713284772fecf4a96e202a48a76475fcafd9b6e3b7467cd802f127fbf1b888f"}
Jun 15 05:49:51.838030 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:49:51.838013    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-smfqb"
Jun 15 05:49:51.855563 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:49:51.855518    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-smfqb" podStartSLOduration=34.934751341 podStartE2EDuration="39.855503069s" totalImagesPullingTime="4.920751728s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-15 05:49:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 05:49:51.854827136 +0000 UTC m=+74.814584417" watchObservedRunningTime="2026-06-15 05:49:51.855503069 +0000 UTC m=+74.815260314"
Jun 15 05:49:57.438962 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:49:57.438822    2566 scope.go:117] "RemoveContainer" containerID="779dd9d36536d99dd84e280a284a339dd069700e898eb129695778882f5512d3"
Jun 15 05:49:57.439377 ip-10-0-128-243 kubenswrapper[2566]: E0615 05:49:57.439029    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 20s restarting failed container=console-operator pod=console-operator-5dbbb5d744-ktjgp_openshift-console-operator(67da60eb-27f9-4bbd-8d12-64275e801143)\"" pod="openshift-console-operator/console-operator-5dbbb5d744-ktjgp" podUID="67da60eb-27f9-4bbd-8d12-64275e801143"
Jun 15 05:50:00.719969 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:50:00.719931    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-kxn65"]
Jun 15 05:50:00.722806 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:50:00.722783    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-kxn65"
Jun 15 05:50:00.725037 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:50:00.725009    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Jun 15 05:50:00.725347 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:50:00.725327    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-dzg2h\""
Jun 15 05:50:00.725456 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:50:00.725436    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Jun 15 05:50:00.726006 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:50:00.725988    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Jun 15 05:50:00.726156 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:50:00.726142    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Jun 15 05:50:00.874278 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:50:00.874246    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/309faaf7-95ec-4874-864b-96aa5a898a38-node-exporter-textfile\") pod \"node-exporter-kxn65\" (UID: \"309faaf7-95ec-4874-864b-96aa5a898a38\") " pod="openshift-monitoring/node-exporter-kxn65"
Jun 15 05:50:00.874437 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:50:00.874283    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/309faaf7-95ec-4874-864b-96aa5a898a38-node-exporter-tls\") pod \"node-exporter-kxn65\" (UID: \"309faaf7-95ec-4874-864b-96aa5a898a38\") " pod="openshift-monitoring/node-exporter-kxn65"
Jun 15 05:50:00.874437 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:50:00.874304    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/309faaf7-95ec-4874-864b-96aa5a898a38-root\") pod \"node-exporter-kxn65\" (UID: \"309faaf7-95ec-4874-864b-96aa5a898a38\") " pod="openshift-monitoring/node-exporter-kxn65"
Jun 15 05:50:00.874437 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:50:00.874361    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/309faaf7-95ec-4874-864b-96aa5a898a38-sys\") pod \"node-exporter-kxn65\" (UID: \"309faaf7-95ec-4874-864b-96aa5a898a38\") " pod="openshift-monitoring/node-exporter-kxn65"
Jun 15 05:50:00.874437 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:50:00.874380    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/309faaf7-95ec-4874-864b-96aa5a898a38-metrics-client-ca\") pod \"node-exporter-kxn65\" (UID: \"309faaf7-95ec-4874-864b-96aa5a898a38\") " pod="openshift-monitoring/node-exporter-kxn65"
Jun 15 05:50:00.874437 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:50:00.874403    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/309faaf7-95ec-4874-864b-96aa5a898a38-node-exporter-wtmp\") pod \"node-exporter-kxn65\" (UID: \"309faaf7-95ec-4874-864b-96aa5a898a38\") " pod="openshift-monitoring/node-exporter-kxn65"
Jun 15 05:50:00.874595 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:50:00.874483    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rkws5\" (UniqueName: \"kubernetes.io/projected/309faaf7-95ec-4874-864b-96aa5a898a38-kube-api-access-rkws5\") pod \"node-exporter-kxn65\" (UID: \"309faaf7-95ec-4874-864b-96aa5a898a38\") " pod="openshift-monitoring/node-exporter-kxn65"
Jun 15 05:50:00.874595 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:50:00.874519    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/309faaf7-95ec-4874-864b-96aa5a898a38-node-exporter-accelerators-collector-config\") pod \"node-exporter-kxn65\" (UID: \"309faaf7-95ec-4874-864b-96aa5a898a38\") " pod="openshift-monitoring/node-exporter-kxn65"
Jun 15 05:50:00.874595 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:50:00.874539    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/309faaf7-95ec-4874-864b-96aa5a898a38-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-kxn65\" (UID: \"309faaf7-95ec-4874-864b-96aa5a898a38\") " pod="openshift-monitoring/node-exporter-kxn65"
Jun 15 05:50:00.975378 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:50:00.975301    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/309faaf7-95ec-4874-864b-96aa5a898a38-metrics-client-ca\") pod \"node-exporter-kxn65\" (UID: \"309faaf7-95ec-4874-864b-96aa5a898a38\") " pod="openshift-monitoring/node-exporter-kxn65"
Jun 15 05:50:00.975378 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:50:00.975335    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/309faaf7-95ec-4874-864b-96aa5a898a38-node-exporter-wtmp\") pod \"node-exporter-kxn65\" (UID: \"309faaf7-95ec-4874-864b-96aa5a898a38\") " pod="openshift-monitoring/node-exporter-kxn65"
Jun 15 05:50:00.975378 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:50:00.975367    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rkws5\" (UniqueName: \"kubernetes.io/projected/309faaf7-95ec-4874-864b-96aa5a898a38-kube-api-access-rkws5\") pod \"node-exporter-kxn65\" (UID: \"309faaf7-95ec-4874-864b-96aa5a898a38\") " pod="openshift-monitoring/node-exporter-kxn65"
Jun 15 05:50:00.975630 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:50:00.975389    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/309faaf7-95ec-4874-864b-96aa5a898a38-node-exporter-accelerators-collector-config\") pod \"node-exporter-kxn65\" (UID: \"309faaf7-95ec-4874-864b-96aa5a898a38\") " pod="openshift-monitoring/node-exporter-kxn65"
Jun 15 05:50:00.975630 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:50:00.975419    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/309faaf7-95ec-4874-864b-96aa5a898a38-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-kxn65\" (UID: \"309faaf7-95ec-4874-864b-96aa5a898a38\") " pod="openshift-monitoring/node-exporter-kxn65"
Jun 15 05:50:00.975630 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:50:00.975444    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/309faaf7-95ec-4874-864b-96aa5a898a38-node-exporter-textfile\") pod \"node-exporter-kxn65\" (UID: \"309faaf7-95ec-4874-864b-96aa5a898a38\") " pod="openshift-monitoring/node-exporter-kxn65"
Jun 15 05:50:00.975630 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:50:00.975470    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/309faaf7-95ec-4874-864b-96aa5a898a38-node-exporter-tls\") pod \"node-exporter-kxn65\" (UID: \"309faaf7-95ec-4874-864b-96aa5a898a38\") " pod="openshift-monitoring/node-exporter-kxn65"
Jun 15 05:50:00.975630 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:50:00.975497    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/309faaf7-95ec-4874-864b-96aa5a898a38-root\") pod \"node-exporter-kxn65\" (UID: \"309faaf7-95ec-4874-864b-96aa5a898a38\") " pod="openshift-monitoring/node-exporter-kxn65"
Jun 15 05:50:00.975630 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:50:00.975506    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/309faaf7-95ec-4874-864b-96aa5a898a38-node-exporter-wtmp\") pod \"node-exporter-kxn65\" (UID: \"309faaf7-95ec-4874-864b-96aa5a898a38\") " pod="openshift-monitoring/node-exporter-kxn65"
Jun 15 05:50:00.975630 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:50:00.975540    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/309faaf7-95ec-4874-864b-96aa5a898a38-sys\") pod \"node-exporter-kxn65\" (UID: \"309faaf7-95ec-4874-864b-96aa5a898a38\") " pod="openshift-monitoring/node-exporter-kxn65"
Jun 15 05:50:00.975630 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:50:00.975582    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/309faaf7-95ec-4874-864b-96aa5a898a38-root\") pod \"node-exporter-kxn65\" (UID: \"309faaf7-95ec-4874-864b-96aa5a898a38\") " pod="openshift-monitoring/node-exporter-kxn65"
Jun 15 05:50:00.975630 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:50:00.975610    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/309faaf7-95ec-4874-864b-96aa5a898a38-sys\") pod \"node-exporter-kxn65\" (UID: \"309faaf7-95ec-4874-864b-96aa5a898a38\") " pod="openshift-monitoring/node-exporter-kxn65"
Jun 15 05:50:00.975630 ip-10-0-128-243 kubenswrapper[2566]: E0615 05:50:00.975614    2566 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found
Jun 15 05:50:00.976030 ip-10-0-128-243 kubenswrapper[2566]: E0615 05:50:00.975697    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/309faaf7-95ec-4874-864b-96aa5a898a38-node-exporter-tls podName:309faaf7-95ec-4874-864b-96aa5a898a38 nodeName:}" failed. No retries permitted until 2026-06-15 05:50:01.475675033 +0000 UTC m=+84.435432260 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/309faaf7-95ec-4874-864b-96aa5a898a38-node-exporter-tls") pod "node-exporter-kxn65" (UID: "309faaf7-95ec-4874-864b-96aa5a898a38") : secret "node-exporter-tls" not found
Jun 15 05:50:00.976030 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:50:00.975802    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/309faaf7-95ec-4874-864b-96aa5a898a38-node-exporter-textfile\") pod \"node-exporter-kxn65\" (UID: \"309faaf7-95ec-4874-864b-96aa5a898a38\") " pod="openshift-monitoring/node-exporter-kxn65"
Jun 15 05:50:00.976030 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:50:00.975948    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/309faaf7-95ec-4874-864b-96aa5a898a38-metrics-client-ca\") pod \"node-exporter-kxn65\" (UID: \"309faaf7-95ec-4874-864b-96aa5a898a38\") " pod="openshift-monitoring/node-exporter-kxn65"
Jun 15 05:50:00.976176 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:50:00.976112    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/309faaf7-95ec-4874-864b-96aa5a898a38-node-exporter-accelerators-collector-config\") pod \"node-exporter-kxn65\" (UID: \"309faaf7-95ec-4874-864b-96aa5a898a38\") " pod="openshift-monitoring/node-exporter-kxn65"
Jun 15 05:50:00.977846 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:50:00.977829    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/309faaf7-95ec-4874-864b-96aa5a898a38-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-kxn65\" (UID: \"309faaf7-95ec-4874-864b-96aa5a898a38\") " pod="openshift-monitoring/node-exporter-kxn65"
Jun 15 05:50:00.988008 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:50:00.987985    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rkws5\" (UniqueName: \"kubernetes.io/projected/309faaf7-95ec-4874-864b-96aa5a898a38-kube-api-access-rkws5\") pod \"node-exporter-kxn65\" (UID: \"309faaf7-95ec-4874-864b-96aa5a898a38\") " pod="openshift-monitoring/node-exporter-kxn65"
Jun 15 05:50:01.479706 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:50:01.479660    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/309faaf7-95ec-4874-864b-96aa5a898a38-node-exporter-tls\") pod \"node-exporter-kxn65\" (UID: \"309faaf7-95ec-4874-864b-96aa5a898a38\") " pod="openshift-monitoring/node-exporter-kxn65"
Jun 15 05:50:01.482060 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:50:01.482033    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/309faaf7-95ec-4874-864b-96aa5a898a38-node-exporter-tls\") pod \"node-exporter-kxn65\" (UID: \"309faaf7-95ec-4874-864b-96aa5a898a38\") " pod="openshift-monitoring/node-exporter-kxn65"
Jun 15 05:50:01.632409 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:50:01.632374    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-kxn65"
Jun 15 05:50:01.643432 ip-10-0-128-243 kubenswrapper[2566]: W0615 05:50:01.643405    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod309faaf7_95ec_4874_864b_96aa5a898a38.slice/crio-a17e877948acbd16d3b3e7ac5dcf4601d8ef0e2c06955541a25be5235303665d WatchSource:0}: Error finding container a17e877948acbd16d3b3e7ac5dcf4601d8ef0e2c06955541a25be5235303665d: Status 404 returned error can't find the container with id a17e877948acbd16d3b3e7ac5dcf4601d8ef0e2c06955541a25be5235303665d
Jun 15 05:50:01.874979 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:50:01.874936    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-kxn65" event={"ID":"309faaf7-95ec-4874-864b-96aa5a898a38","Type":"ContainerStarted","Data":"a17e877948acbd16d3b3e7ac5dcf4601d8ef0e2c06955541a25be5235303665d"}
Jun 15 05:50:02.847933 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:50:02.847868    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-smfqb"
Jun 15 05:50:02.883324 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:50:02.883293    2566 generic.go:356] "Generic (PLEG): container finished" podID="309faaf7-95ec-4874-864b-96aa5a898a38" containerID="8c0f447e348039bf4b37ca6c7ad27c7b6e272a792d1b4c0698602f500609bb79" exitCode=0
Jun 15 05:50:02.883688 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:50:02.883340    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-kxn65" event={"ID":"309faaf7-95ec-4874-864b-96aa5a898a38","Type":"ContainerDied","Data":"8c0f447e348039bf4b37ca6c7ad27c7b6e272a792d1b4c0698602f500609bb79"}
Jun 15 05:50:03.889020 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:50:03.888980    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-kxn65" event={"ID":"309faaf7-95ec-4874-864b-96aa5a898a38","Type":"ContainerStarted","Data":"8edbe79e38d8eae4f13d2eda6d10848cb2a8f820964d307bf5e1e2cb31fc09b2"}
Jun 15 05:50:03.889418 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:50:03.889052    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-kxn65" event={"ID":"309faaf7-95ec-4874-864b-96aa5a898a38","Type":"ContainerStarted","Data":"de448f5168ebb569c0a0a2579362b82064d1b76e09c3543d62b6ec9a579a827d"}
Jun 15 05:50:03.914224 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:50:03.914178    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-kxn65" podStartSLOduration=2.930879273 podStartE2EDuration="3.914162572s" totalImagesPullingTime="911.783629ms" totalInitContainerRuntime="71.49967ms" isStatefulPod=true podCreationTimestamp="2026-06-15 05:50:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 05:50:03.911982066 +0000 UTC m=+86.871739443" watchObservedRunningTime="2026-06-15 05:50:03.914162572 +0000 UTC m=+86.873919817"
Jun 15 05:50:06.803230 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:50:06.803202    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-8559c46f69-f7hlb"
Jun 15 05:50:09.436701 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:50:09.436666    2566 scope.go:117] "RemoveContainer" containerID="779dd9d36536d99dd84e280a284a339dd069700e898eb129695778882f5512d3"
Jun 15 05:50:09.913426 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:50:09.913396    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5dbbb5d744-ktjgp_67da60eb-27f9-4bbd-8d12-64275e801143/console-operator/2.log"
Jun 15 05:50:09.913575 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:50:09.913460    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-5dbbb5d744-ktjgp" event={"ID":"67da60eb-27f9-4bbd-8d12-64275e801143","Type":"ContainerStarted","Data":"651ce627735962bec04ab832077408768e3dffe0a80e6ec033c46b2189a23509"}
Jun 15 05:50:09.913931 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:50:09.913749    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-5dbbb5d744-ktjgp"
Jun 15 05:50:09.919242 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:50:09.919218    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-5dbbb5d744-ktjgp"
Jun 15 05:50:09.983344 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:50:09.983287    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console-operator/console-operator-5dbbb5d744-ktjgp" podStartSLOduration=82.666158348 podStartE2EDuration="1m29.983273187s" totalImagesPullingTime="7.317114839s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-15 05:48:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 05:50:09.956538182 +0000 UTC m=+92.916295426" watchObservedRunningTime="2026-06-15 05:50:09.983273187 +0000 UTC m=+92.943030434"
Jun 15 05:50:13.680395 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:50:13.680352    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-8559c46f69-f7hlb"]
Jun 15 05:50:16.801676 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:50:16.801649    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-gbdt4"
Jun 15 05:50:38.700472 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:50:38.700418    2566 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-image-registry/image-registry-8559c46f69-f7hlb" podUID="0addacd9-d43e-43c0-8be8-608abc918f38" containerName="registry" containerID="cri-o://d01998c908be5d67695c535b5f7e02634ddfc9cb0cc623f8b1395b5a0e64c034" gracePeriod=30
Jun 15 05:50:38.945827 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:50:38.945805    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-8559c46f69-f7hlb"
Jun 15 05:50:39.016416 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:50:39.016389    2566 generic.go:356] "Generic (PLEG): container finished" podID="0addacd9-d43e-43c0-8be8-608abc918f38" containerID="d01998c908be5d67695c535b5f7e02634ddfc9cb0cc623f8b1395b5a0e64c034" exitCode=0
Jun 15 05:50:39.016560 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:50:39.016430    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-8559c46f69-f7hlb"
Jun 15 05:50:39.016560 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:50:39.016429    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-8559c46f69-f7hlb" event={"ID":"0addacd9-d43e-43c0-8be8-608abc918f38","Type":"ContainerDied","Data":"d01998c908be5d67695c535b5f7e02634ddfc9cb0cc623f8b1395b5a0e64c034"}
Jun 15 05:50:39.016560 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:50:39.016554    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-8559c46f69-f7hlb" event={"ID":"0addacd9-d43e-43c0-8be8-608abc918f38","Type":"ContainerDied","Data":"eaf8c1a7e3bbd5611e5adb0575feb59d88c641950815fd3a190ed8dd4a017b8f"}
Jun 15 05:50:39.016675 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:50:39.016580    2566 scope.go:117] "RemoveContainer" containerID="d01998c908be5d67695c535b5f7e02634ddfc9cb0cc623f8b1395b5a0e64c034"
Jun 15 05:50:39.024216 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:50:39.024200    2566 scope.go:117] "RemoveContainer" containerID="d01998c908be5d67695c535b5f7e02634ddfc9cb0cc623f8b1395b5a0e64c034"
Jun 15 05:50:39.024481 ip-10-0-128-243 kubenswrapper[2566]: E0615 05:50:39.024458    2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d01998c908be5d67695c535b5f7e02634ddfc9cb0cc623f8b1395b5a0e64c034\": container with ID starting with d01998c908be5d67695c535b5f7e02634ddfc9cb0cc623f8b1395b5a0e64c034 not found: ID does not exist" containerID="d01998c908be5d67695c535b5f7e02634ddfc9cb0cc623f8b1395b5a0e64c034"
Jun 15 05:50:39.024566 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:50:39.024491    2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d01998c908be5d67695c535b5f7e02634ddfc9cb0cc623f8b1395b5a0e64c034"} err="failed to get container status \"d01998c908be5d67695c535b5f7e02634ddfc9cb0cc623f8b1395b5a0e64c034\": rpc error: code = NotFound desc = could not find container \"d01998c908be5d67695c535b5f7e02634ddfc9cb0cc623f8b1395b5a0e64c034\": container with ID starting with d01998c908be5d67695c535b5f7e02634ddfc9cb0cc623f8b1395b5a0e64c034 not found: ID does not exist"
Jun 15 05:50:39.050230 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:50:39.050201    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dw95z\" (UniqueName: \"kubernetes.io/projected/0addacd9-d43e-43c0-8be8-608abc918f38-kube-api-access-dw95z\") pod \"0addacd9-d43e-43c0-8be8-608abc918f38\" (UID: \"0addacd9-d43e-43c0-8be8-608abc918f38\") "
Jun 15 05:50:39.050362 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:50:39.050240    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/0addacd9-d43e-43c0-8be8-608abc918f38-trusted-ca\") pod \"0addacd9-d43e-43c0-8be8-608abc918f38\" (UID: \"0addacd9-d43e-43c0-8be8-608abc918f38\") "
Jun 15 05:50:39.050362 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:50:39.050301    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/0addacd9-d43e-43c0-8be8-608abc918f38-ca-trust-extracted\") pod \"0addacd9-d43e-43c0-8be8-608abc918f38\" (UID: \"0addacd9-d43e-43c0-8be8-608abc918f38\") "
Jun 15 05:50:39.050362 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:50:39.050328    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/0addacd9-d43e-43c0-8be8-608abc918f38-registry-certificates\") pod \"0addacd9-d43e-43c0-8be8-608abc918f38\" (UID: \"0addacd9-d43e-43c0-8be8-608abc918f38\") "
Jun 15 05:50:39.050518 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:50:39.050360    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/0addacd9-d43e-43c0-8be8-608abc918f38-image-registry-private-configuration\") pod \"0addacd9-d43e-43c0-8be8-608abc918f38\" (UID: \"0addacd9-d43e-43c0-8be8-608abc918f38\") "
Jun 15 05:50:39.050518 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:50:39.050389    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/0addacd9-d43e-43c0-8be8-608abc918f38-bound-sa-token\") pod \"0addacd9-d43e-43c0-8be8-608abc918f38\" (UID: \"0addacd9-d43e-43c0-8be8-608abc918f38\") "
Jun 15 05:50:39.050518 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:50:39.050434    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/0addacd9-d43e-43c0-8be8-608abc918f38-installation-pull-secrets\") pod \"0addacd9-d43e-43c0-8be8-608abc918f38\" (UID: \"0addacd9-d43e-43c0-8be8-608abc918f38\") "
Jun 15 05:50:39.050885 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:50:39.050859    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/0addacd9-d43e-43c0-8be8-608abc918f38-registry-tls\") pod \"0addacd9-d43e-43c0-8be8-608abc918f38\" (UID: \"0addacd9-d43e-43c0-8be8-608abc918f38\") "
Jun 15 05:50:39.051580 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:50:39.050991    2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0addacd9-d43e-43c0-8be8-608abc918f38-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "0addacd9-d43e-43c0-8be8-608abc918f38" (UID: "0addacd9-d43e-43c0-8be8-608abc918f38"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jun 15 05:50:39.051580 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:50:39.051216    2566 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/0addacd9-d43e-43c0-8be8-608abc918f38-trusted-ca\") on node \"ip-10-0-128-243.ec2.internal\" DevicePath \"\""
Jun 15 05:50:39.051580 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:50:39.051318    2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0addacd9-d43e-43c0-8be8-608abc918f38-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "0addacd9-d43e-43c0-8be8-608abc918f38" (UID: "0addacd9-d43e-43c0-8be8-608abc918f38"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jun 15 05:50:39.054892 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:50:39.054815    2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0addacd9-d43e-43c0-8be8-608abc918f38-kube-api-access-dw95z" (OuterVolumeSpecName: "kube-api-access-dw95z") pod "0addacd9-d43e-43c0-8be8-608abc918f38" (UID: "0addacd9-d43e-43c0-8be8-608abc918f38"). InnerVolumeSpecName "kube-api-access-dw95z". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jun 15 05:50:39.057873 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:50:39.057826    2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0addacd9-d43e-43c0-8be8-608abc918f38-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "0addacd9-d43e-43c0-8be8-608abc918f38" (UID: "0addacd9-d43e-43c0-8be8-608abc918f38"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jun 15 05:50:39.058743 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:50:39.058677    2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0addacd9-d43e-43c0-8be8-608abc918f38-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "0addacd9-d43e-43c0-8be8-608abc918f38" (UID: "0addacd9-d43e-43c0-8be8-608abc918f38"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jun 15 05:50:39.058743 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:50:39.058684    2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0addacd9-d43e-43c0-8be8-608abc918f38-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "0addacd9-d43e-43c0-8be8-608abc918f38" (UID: "0addacd9-d43e-43c0-8be8-608abc918f38"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jun 15 05:50:39.058743 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:50:39.058730    2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0addacd9-d43e-43c0-8be8-608abc918f38-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "0addacd9-d43e-43c0-8be8-608abc918f38" (UID: "0addacd9-d43e-43c0-8be8-608abc918f38"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jun 15 05:50:39.062118 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:50:39.062073    2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0addacd9-d43e-43c0-8be8-608abc918f38-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "0addacd9-d43e-43c0-8be8-608abc918f38" (UID: "0addacd9-d43e-43c0-8be8-608abc918f38"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jun 15 05:50:39.151860 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:50:39.151835    2566 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/0addacd9-d43e-43c0-8be8-608abc918f38-ca-trust-extracted\") on node \"ip-10-0-128-243.ec2.internal\" DevicePath \"\""
Jun 15 05:50:39.151860 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:50:39.151858    2566 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/0addacd9-d43e-43c0-8be8-608abc918f38-registry-certificates\") on node \"ip-10-0-128-243.ec2.internal\" DevicePath \"\""
Jun 15 05:50:39.152009 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:50:39.151870    2566 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/0addacd9-d43e-43c0-8be8-608abc918f38-image-registry-private-configuration\") on node \"ip-10-0-128-243.ec2.internal\" DevicePath \"\""
Jun 15 05:50:39.152009 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:50:39.151903    2566 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/0addacd9-d43e-43c0-8be8-608abc918f38-bound-sa-token\") on node \"ip-10-0-128-243.ec2.internal\" DevicePath \"\""
Jun 15 05:50:39.152009 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:50:39.151912    2566 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/0addacd9-d43e-43c0-8be8-608abc918f38-installation-pull-secrets\") on node \"ip-10-0-128-243.ec2.internal\" DevicePath \"\""
Jun 15 05:50:39.152009 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:50:39.151922    2566 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/0addacd9-d43e-43c0-8be8-608abc918f38-registry-tls\") on node \"ip-10-0-128-243.ec2.internal\" DevicePath \"\""
Jun 15 05:50:39.152009 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:50:39.151929    2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dw95z\" (UniqueName: \"kubernetes.io/projected/0addacd9-d43e-43c0-8be8-608abc918f38-kube-api-access-dw95z\") on node \"ip-10-0-128-243.ec2.internal\" DevicePath \"\""
Jun 15 05:50:39.346940 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:50:39.346911    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-8559c46f69-f7hlb"]
Jun 15 05:50:39.348811 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:50:39.348787    2566 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-8559c46f69-f7hlb"]
Jun 15 05:50:39.440663 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:50:39.440631    2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0addacd9-d43e-43c0-8be8-608abc918f38" path="/var/lib/kubelet/pods/0addacd9-d43e-43c0-8be8-608abc918f38/volumes"
Jun 15 05:50:42.029529 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:50:42.029491    2566 generic.go:356] "Generic (PLEG): container finished" podID="12ada117-da7b-47e4-bab9-92368a63edf8" containerID="6dadd812a2871e6f4d6c59155cc66232da35062175592dd20060237ba48a6dc9" exitCode=0
Jun 15 05:50:42.029919 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:50:42.029559    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5bbd86d6bd-4bc2h" event={"ID":"12ada117-da7b-47e4-bab9-92368a63edf8","Type":"ContainerDied","Data":"6dadd812a2871e6f4d6c59155cc66232da35062175592dd20060237ba48a6dc9"}
Jun 15 05:50:42.029974 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:50:42.029957    2566 scope.go:117] "RemoveContainer" containerID="6dadd812a2871e6f4d6c59155cc66232da35062175592dd20060237ba48a6dc9"
Jun 15 05:50:43.035248 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:50:43.035212    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5bbd86d6bd-4bc2h" event={"ID":"12ada117-da7b-47e4-bab9-92368a63edf8","Type":"ContainerStarted","Data":"d9b86ab406e3e46a3ae310416ab5630d991b9d542abc1b0f317aa7a19f003350"}
Jun 15 05:50:52.069866 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:50:52.069833    2566 generic.go:356] "Generic (PLEG): container finished" podID="0ed3f738-1daf-4d28-8c14-3c7b5139e7dd" containerID="9350a0c246f42993958f527e286a94641d1e415ee15ab0c324798f2414e1fd3c" exitCode=0
Jun 15 05:50:52.070287 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:50:52.069906    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7c578b78fc-pr6nz" event={"ID":"0ed3f738-1daf-4d28-8c14-3c7b5139e7dd","Type":"ContainerDied","Data":"9350a0c246f42993958f527e286a94641d1e415ee15ab0c324798f2414e1fd3c"}
Jun 15 05:50:52.070287 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:50:52.070212    2566 scope.go:117] "RemoveContainer" containerID="9350a0c246f42993958f527e286a94641d1e415ee15ab0c324798f2414e1fd3c"
Jun 15 05:50:53.076024 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:50:53.075987    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7c578b78fc-pr6nz" event={"ID":"0ed3f738-1daf-4d28-8c14-3c7b5139e7dd","Type":"ContainerStarted","Data":"cb8b7ddc17a7c7f8ea64852858301d68aba30e1121163d0c27fe951192a43e1c"}
Jun 15 05:50:53.077465 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:50:53.077441    2566 generic.go:356] "Generic (PLEG): container finished" podID="6771aa98-7d47-4ae5-b63e-7c6bb456a86b" containerID="713b1558b808b974d7b03433718d4f9f4126190e1d1007c65c7d5b76a146d0fb" exitCode=0
Jun 15 05:50:53.077589 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:50:53.077473    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-7ccbfd59dc-42zqt" event={"ID":"6771aa98-7d47-4ae5-b63e-7c6bb456a86b","Type":"ContainerDied","Data":"713b1558b808b974d7b03433718d4f9f4126190e1d1007c65c7d5b76a146d0fb"}
Jun 15 05:50:53.077738 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:50:53.077724    2566 scope.go:117] "RemoveContainer" containerID="713b1558b808b974d7b03433718d4f9f4126190e1d1007c65c7d5b76a146d0fb"
Jun 15 05:50:54.083927 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:50:54.083887    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-7ccbfd59dc-42zqt" event={"ID":"6771aa98-7d47-4ae5-b63e-7c6bb456a86b","Type":"ContainerStarted","Data":"c4f625601d6a783887dfa5a09898da9acdb32488a02b5084e3561c62bbf2b478"}
Jun 15 05:53:37.375543 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:53:37.375501    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5dbbb5d744-ktjgp_67da60eb-27f9-4bbd-8d12-64275e801143/console-operator/2.log"
Jun 15 05:53:37.376070 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:53:37.375517    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5dbbb5d744-ktjgp_67da60eb-27f9-4bbd-8d12-64275e801143/console-operator/2.log"
Jun 15 05:53:37.382057 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:53:37.382034    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-f4bzh_5a1f8f83-55db-4fc7-872d-6b202daa0a31/ovn-acl-logging/0.log"
Jun 15 05:53:37.382303 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:53:37.382286    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-f4bzh_5a1f8f83-55db-4fc7-872d-6b202daa0a31/ovn-acl-logging/0.log"
Jun 15 05:53:37.386187 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:53:37.386153    2566 kubelet.go:1648] "Image garbage collection succeeded"
Jun 15 05:53:38.808923 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:53:38.808866    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6c8d649c94-rsjqv"]
Jun 15 05:53:38.811179 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:53:38.809172    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0addacd9-d43e-43c0-8be8-608abc918f38" containerName="registry"
Jun 15 05:53:38.811179 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:53:38.809187    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="0addacd9-d43e-43c0-8be8-608abc918f38" containerName="registry"
Jun 15 05:53:38.811179 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:53:38.809249    2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="0addacd9-d43e-43c0-8be8-608abc918f38" containerName="registry"
Jun 15 05:53:38.811972 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:53:38.811954    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6c8d649c94-rsjqv"
Jun 15 05:53:38.815835 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:53:38.815802    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\""
Jun 15 05:53:38.815835 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:53:38.815819    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\""
Jun 15 05:53:38.816011 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:53:38.815802    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-hub-kubeconfig\""
Jun 15 05:53:38.816011 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:53:38.815802    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\""
Jun 15 05:53:38.816011 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:53:38.815855    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-dockercfg-k8jcs\""
Jun 15 05:53:38.823285 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:53:38.823256    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6c8d649c94-rsjqv"]
Jun 15 05:53:38.864715 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:53:38.864688    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/0a996c6d-b741-4177-828c-40534a36a94d-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-6c8d649c94-rsjqv\" (UID: \"0a996c6d-b741-4177-828c-40534a36a94d\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6c8d649c94-rsjqv"
Jun 15 05:53:38.864826 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:53:38.864726    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nt6c2\" (UniqueName: \"kubernetes.io/projected/0a996c6d-b741-4177-828c-40534a36a94d-kube-api-access-nt6c2\") pod \"managed-serviceaccount-addon-agent-6c8d649c94-rsjqv\" (UID: \"0a996c6d-b741-4177-828c-40534a36a94d\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6c8d649c94-rsjqv"
Jun 15 05:53:38.965368 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:53:38.965336    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/0a996c6d-b741-4177-828c-40534a36a94d-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-6c8d649c94-rsjqv\" (UID: \"0a996c6d-b741-4177-828c-40534a36a94d\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6c8d649c94-rsjqv"
Jun 15 05:53:38.965500 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:53:38.965374    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nt6c2\" (UniqueName: \"kubernetes.io/projected/0a996c6d-b741-4177-828c-40534a36a94d-kube-api-access-nt6c2\") pod \"managed-serviceaccount-addon-agent-6c8d649c94-rsjqv\" (UID: \"0a996c6d-b741-4177-828c-40534a36a94d\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6c8d649c94-rsjqv"
Jun 15 05:53:38.968004 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:53:38.967980    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/0a996c6d-b741-4177-828c-40534a36a94d-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-6c8d649c94-rsjqv\" (UID: \"0a996c6d-b741-4177-828c-40534a36a94d\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6c8d649c94-rsjqv"
Jun 15 05:53:38.974696 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:53:38.974674    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nt6c2\" (UniqueName: \"kubernetes.io/projected/0a996c6d-b741-4177-828c-40534a36a94d-kube-api-access-nt6c2\") pod \"managed-serviceaccount-addon-agent-6c8d649c94-rsjqv\" (UID: \"0a996c6d-b741-4177-828c-40534a36a94d\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6c8d649c94-rsjqv"
Jun 15 05:53:39.127764 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:53:39.127689    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6c8d649c94-rsjqv"
Jun 15 05:53:39.253169 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:53:39.253140    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6c8d649c94-rsjqv"]
Jun 15 05:53:39.255938 ip-10-0-128-243 kubenswrapper[2566]: W0615 05:53:39.255901    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod0a996c6d_b741_4177_828c_40534a36a94d.slice/crio-f69895db5b3e1c875c1f31c457ce31ab6b4ba40bc967dd041d32d4d6651c89e7 WatchSource:0}: Error finding container f69895db5b3e1c875c1f31c457ce31ab6b4ba40bc967dd041d32d4d6651c89e7: Status 404 returned error can't find the container with id f69895db5b3e1c875c1f31c457ce31ab6b4ba40bc967dd041d32d4d6651c89e7
Jun 15 05:53:39.258229 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:53:39.258212    2566 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jun 15 05:53:39.563037 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:53:39.563007    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/59039e319e11338a40c6b6f1054d265f40bb50ceac6068d5c59955d29cp6bhq"]
Jun 15 05:53:39.567495 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:53:39.567478    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/59039e319e11338a40c6b6f1054d265f40bb50ceac6068d5c59955d29cp6bhq"
Jun 15 05:53:39.567848 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:53:39.567829    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e9e3bc63-36e8-4b25-959f-c1fb8d739406-bundle\") pod \"59039e319e11338a40c6b6f1054d265f40bb50ceac6068d5c59955d29cp6bhq\" (UID: \"e9e3bc63-36e8-4b25-959f-c1fb8d739406\") " pod="openshift-marketplace/59039e319e11338a40c6b6f1054d265f40bb50ceac6068d5c59955d29cp6bhq"
Jun 15 05:53:39.567903 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:53:39.567875    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e9e3bc63-36e8-4b25-959f-c1fb8d739406-util\") pod \"59039e319e11338a40c6b6f1054d265f40bb50ceac6068d5c59955d29cp6bhq\" (UID: \"e9e3bc63-36e8-4b25-959f-c1fb8d739406\") " pod="openshift-marketplace/59039e319e11338a40c6b6f1054d265f40bb50ceac6068d5c59955d29cp6bhq"
Jun 15 05:53:39.567942 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:53:39.567899    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b6rv8\" (UniqueName: \"kubernetes.io/projected/e9e3bc63-36e8-4b25-959f-c1fb8d739406-kube-api-access-b6rv8\") pod \"59039e319e11338a40c6b6f1054d265f40bb50ceac6068d5c59955d29cp6bhq\" (UID: \"e9e3bc63-36e8-4b25-959f-c1fb8d739406\") " pod="openshift-marketplace/59039e319e11338a40c6b6f1054d265f40bb50ceac6068d5c59955d29cp6bhq"
Jun 15 05:53:39.570112 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:53:39.570071    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Jun 15 05:53:39.570216 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:53:39.570162    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Jun 15 05:53:39.570834 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:53:39.570818    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-48sh7\""
Jun 15 05:53:39.575729 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:53:39.575709    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/59039e319e11338a40c6b6f1054d265f40bb50ceac6068d5c59955d29cp6bhq"]
Jun 15 05:53:39.665837 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:53:39.665811    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6c8d649c94-rsjqv" event={"ID":"0a996c6d-b741-4177-828c-40534a36a94d","Type":"ContainerStarted","Data":"f69895db5b3e1c875c1f31c457ce31ab6b4ba40bc967dd041d32d4d6651c89e7"}
Jun 15 05:53:39.668313 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:53:39.668291    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e9e3bc63-36e8-4b25-959f-c1fb8d739406-bundle\") pod \"59039e319e11338a40c6b6f1054d265f40bb50ceac6068d5c59955d29cp6bhq\" (UID: \"e9e3bc63-36e8-4b25-959f-c1fb8d739406\") " pod="openshift-marketplace/59039e319e11338a40c6b6f1054d265f40bb50ceac6068d5c59955d29cp6bhq"
Jun 15 05:53:39.668407 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:53:39.668339    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e9e3bc63-36e8-4b25-959f-c1fb8d739406-util\") pod \"59039e319e11338a40c6b6f1054d265f40bb50ceac6068d5c59955d29cp6bhq\" (UID: \"e9e3bc63-36e8-4b25-959f-c1fb8d739406\") " pod="openshift-marketplace/59039e319e11338a40c6b6f1054d265f40bb50ceac6068d5c59955d29cp6bhq"
Jun 15 05:53:39.668476 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:53:39.668460    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b6rv8\" (UniqueName: \"kubernetes.io/projected/e9e3bc63-36e8-4b25-959f-c1fb8d739406-kube-api-access-b6rv8\") pod \"59039e319e11338a40c6b6f1054d265f40bb50ceac6068d5c59955d29cp6bhq\" (UID: \"e9e3bc63-36e8-4b25-959f-c1fb8d739406\") " pod="openshift-marketplace/59039e319e11338a40c6b6f1054d265f40bb50ceac6068d5c59955d29cp6bhq"
Jun 15 05:53:39.668693 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:53:39.668674    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e9e3bc63-36e8-4b25-959f-c1fb8d739406-util\") pod \"59039e319e11338a40c6b6f1054d265f40bb50ceac6068d5c59955d29cp6bhq\" (UID: \"e9e3bc63-36e8-4b25-959f-c1fb8d739406\") " pod="openshift-marketplace/59039e319e11338a40c6b6f1054d265f40bb50ceac6068d5c59955d29cp6bhq"
Jun 15 05:53:39.668727 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:53:39.668690    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e9e3bc63-36e8-4b25-959f-c1fb8d739406-bundle\") pod \"59039e319e11338a40c6b6f1054d265f40bb50ceac6068d5c59955d29cp6bhq\" (UID: \"e9e3bc63-36e8-4b25-959f-c1fb8d739406\") " pod="openshift-marketplace/59039e319e11338a40c6b6f1054d265f40bb50ceac6068d5c59955d29cp6bhq"
Jun 15 05:53:39.678229 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:53:39.678207    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-b6rv8\" (UniqueName: \"kubernetes.io/projected/e9e3bc63-36e8-4b25-959f-c1fb8d739406-kube-api-access-b6rv8\") pod \"59039e319e11338a40c6b6f1054d265f40bb50ceac6068d5c59955d29cp6bhq\" (UID: \"e9e3bc63-36e8-4b25-959f-c1fb8d739406\") " pod="openshift-marketplace/59039e319e11338a40c6b6f1054d265f40bb50ceac6068d5c59955d29cp6bhq"
Jun 15 05:53:39.877721 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:53:39.877655    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/59039e319e11338a40c6b6f1054d265f40bb50ceac6068d5c59955d29cp6bhq"
Jun 15 05:53:40.052034 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:53:40.051635    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/59039e319e11338a40c6b6f1054d265f40bb50ceac6068d5c59955d29cp6bhq"]
Jun 15 05:53:40.054775 ip-10-0-128-243 kubenswrapper[2566]: W0615 05:53:40.054739    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode9e3bc63_36e8_4b25_959f_c1fb8d739406.slice/crio-f0393aa99a5a2227f24f77f90e71ed2d0b7afbf82855a34f1762e3a068a8c56c WatchSource:0}: Error finding container f0393aa99a5a2227f24f77f90e71ed2d0b7afbf82855a34f1762e3a068a8c56c: Status 404 returned error can't find the container with id f0393aa99a5a2227f24f77f90e71ed2d0b7afbf82855a34f1762e3a068a8c56c
Jun 15 05:53:40.672150 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:53:40.672111    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/59039e319e11338a40c6b6f1054d265f40bb50ceac6068d5c59955d29cp6bhq" event={"ID":"e9e3bc63-36e8-4b25-959f-c1fb8d739406","Type":"ContainerStarted","Data":"f0393aa99a5a2227f24f77f90e71ed2d0b7afbf82855a34f1762e3a068a8c56c"}
Jun 15 05:53:42.684318 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:53:42.684269    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6c8d649c94-rsjqv" event={"ID":"0a996c6d-b741-4177-828c-40534a36a94d","Type":"ContainerStarted","Data":"e2d6b164d58c01693380bf4031672e329d4eae66a64b39f85d703a7da04b07ec"}
Jun 15 05:53:42.702884 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:53:42.702829    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6c8d649c94-rsjqv" podStartSLOduration=2.174132958 podStartE2EDuration="4.702810134s" totalImagesPullingTime="2.528677176s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-15 05:53:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 05:53:42.701924067 +0000 UTC m=+305.661681313" watchObservedRunningTime="2026-06-15 05:53:42.702810134 +0000 UTC m=+305.662567381"
Jun 15 05:53:46.701954 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:53:46.701866    2566 generic.go:356] "Generic (PLEG): container finished" podID="e9e3bc63-36e8-4b25-959f-c1fb8d739406" containerID="779a5edb6dc61a3797b6016002ecd124a679382995532aad8ed4650b82043e8c" exitCode=0
Jun 15 05:53:46.702368 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:53:46.701949    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/59039e319e11338a40c6b6f1054d265f40bb50ceac6068d5c59955d29cp6bhq" event={"ID":"e9e3bc63-36e8-4b25-959f-c1fb8d739406","Type":"ContainerDied","Data":"779a5edb6dc61a3797b6016002ecd124a679382995532aad8ed4650b82043e8c"}
Jun 15 05:53:48.711478 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:53:48.711446    2566 generic.go:356] "Generic (PLEG): container finished" podID="e9e3bc63-36e8-4b25-959f-c1fb8d739406" containerID="21e00230577d43dccaaffd0942aa740888bed560295becbf0f6a87787b795e11" exitCode=0
Jun 15 05:53:48.711846 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:53:48.711505    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/59039e319e11338a40c6b6f1054d265f40bb50ceac6068d5c59955d29cp6bhq" event={"ID":"e9e3bc63-36e8-4b25-959f-c1fb8d739406","Type":"ContainerDied","Data":"21e00230577d43dccaaffd0942aa740888bed560295becbf0f6a87787b795e11"}
Jun 15 05:53:54.742533 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:53:54.742501    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/59039e319e11338a40c6b6f1054d265f40bb50ceac6068d5c59955d29cp6bhq" event={"ID":"e9e3bc63-36e8-4b25-959f-c1fb8d739406","Type":"ContainerStarted","Data":"75a0027d8125a54f4f3ff9d7c1d6842e7d3b7452cd89bb93fd4b0f912b04e91f"}
Jun 15 05:53:54.763578 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:53:54.763524    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-marketplace/59039e319e11338a40c6b6f1054d265f40bb50ceac6068d5c59955d29cp6bhq" podStartSLOduration=1.6252470190000001 podStartE2EDuration="15.763510071s" totalImagesPullingTime="14.138263052s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-15 05:53:39 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 05:53:54.762330847 +0000 UTC m=+317.722088114" watchObservedRunningTime="2026-06-15 05:53:54.763510071 +0000 UTC m=+317.723267315"
Jun 15 05:53:55.747976 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:53:55.747947    2566 generic.go:356] "Generic (PLEG): container finished" podID="e9e3bc63-36e8-4b25-959f-c1fb8d739406" containerID="75a0027d8125a54f4f3ff9d7c1d6842e7d3b7452cd89bb93fd4b0f912b04e91f" exitCode=0
Jun 15 05:53:55.748374 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:53:55.748004    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/59039e319e11338a40c6b6f1054d265f40bb50ceac6068d5c59955d29cp6bhq" event={"ID":"e9e3bc63-36e8-4b25-959f-c1fb8d739406","Type":"ContainerDied","Data":"75a0027d8125a54f4f3ff9d7c1d6842e7d3b7452cd89bb93fd4b0f912b04e91f"}
Jun 15 05:53:56.871232 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:53:56.871201    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/59039e319e11338a40c6b6f1054d265f40bb50ceac6068d5c59955d29cp6bhq"
Jun 15 05:53:56.909723 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:53:56.909698    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-b6rv8\" (UniqueName: \"kubernetes.io/projected/e9e3bc63-36e8-4b25-959f-c1fb8d739406-kube-api-access-b6rv8\") pod \"e9e3bc63-36e8-4b25-959f-c1fb8d739406\" (UID: \"e9e3bc63-36e8-4b25-959f-c1fb8d739406\") "
Jun 15 05:53:56.909826 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:53:56.909736    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e9e3bc63-36e8-4b25-959f-c1fb8d739406-bundle\") pod \"e9e3bc63-36e8-4b25-959f-c1fb8d739406\" (UID: \"e9e3bc63-36e8-4b25-959f-c1fb8d739406\") "
Jun 15 05:53:56.909826 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:53:56.909775    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e9e3bc63-36e8-4b25-959f-c1fb8d739406-util\") pod \"e9e3bc63-36e8-4b25-959f-c1fb8d739406\" (UID: \"e9e3bc63-36e8-4b25-959f-c1fb8d739406\") "
Jun 15 05:53:56.910326 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:53:56.910302    2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e9e3bc63-36e8-4b25-959f-c1fb8d739406-bundle" (OuterVolumeSpecName: "bundle") pod "e9e3bc63-36e8-4b25-959f-c1fb8d739406" (UID: "e9e3bc63-36e8-4b25-959f-c1fb8d739406"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jun 15 05:53:56.911916 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:53:56.911893    2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e9e3bc63-36e8-4b25-959f-c1fb8d739406-kube-api-access-b6rv8" (OuterVolumeSpecName: "kube-api-access-b6rv8") pod "e9e3bc63-36e8-4b25-959f-c1fb8d739406" (UID: "e9e3bc63-36e8-4b25-959f-c1fb8d739406"). InnerVolumeSpecName "kube-api-access-b6rv8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jun 15 05:53:56.914267 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:53:56.914242    2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e9e3bc63-36e8-4b25-959f-c1fb8d739406-util" (OuterVolumeSpecName: "util") pod "e9e3bc63-36e8-4b25-959f-c1fb8d739406" (UID: "e9e3bc63-36e8-4b25-959f-c1fb8d739406"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jun 15 05:53:57.010384 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:53:57.010354    2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-b6rv8\" (UniqueName: \"kubernetes.io/projected/e9e3bc63-36e8-4b25-959f-c1fb8d739406-kube-api-access-b6rv8\") on node \"ip-10-0-128-243.ec2.internal\" DevicePath \"\""
Jun 15 05:53:57.010483 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:53:57.010383    2566 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e9e3bc63-36e8-4b25-959f-c1fb8d739406-bundle\") on node \"ip-10-0-128-243.ec2.internal\" DevicePath \"\""
Jun 15 05:53:57.010483 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:53:57.010398    2566 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e9e3bc63-36e8-4b25-959f-c1fb8d739406-util\") on node \"ip-10-0-128-243.ec2.internal\" DevicePath \"\""
Jun 15 05:53:57.756054 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:53:57.756017    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/59039e319e11338a40c6b6f1054d265f40bb50ceac6068d5c59955d29cp6bhq" event={"ID":"e9e3bc63-36e8-4b25-959f-c1fb8d739406","Type":"ContainerDied","Data":"f0393aa99a5a2227f24f77f90e71ed2d0b7afbf82855a34f1762e3a068a8c56c"}
Jun 15 05:53:57.756212 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:53:57.756073    2566 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="f0393aa99a5a2227f24f77f90e71ed2d0b7afbf82855a34f1762e3a068a8c56c"
Jun 15 05:53:57.756212 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:53:57.756031    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/59039e319e11338a40c6b6f1054d265f40bb50ceac6068d5c59955d29cp6bhq"
Jun 15 05:54:06.811529 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:54:06.809453    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-keda/keda-operator-674595557b-rbf4c"]
Jun 15 05:54:06.811529 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:54:06.810059    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e9e3bc63-36e8-4b25-959f-c1fb8d739406" containerName="util"
Jun 15 05:54:06.811529 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:54:06.810077    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="e9e3bc63-36e8-4b25-959f-c1fb8d739406" containerName="util"
Jun 15 05:54:06.811529 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:54:06.810124    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e9e3bc63-36e8-4b25-959f-c1fb8d739406" containerName="pull"
Jun 15 05:54:06.811529 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:54:06.810134    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="e9e3bc63-36e8-4b25-959f-c1fb8d739406" containerName="pull"
Jun 15 05:54:06.811529 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:54:06.810162    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e9e3bc63-36e8-4b25-959f-c1fb8d739406" containerName="extract"
Jun 15 05:54:06.811529 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:54:06.810171    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="e9e3bc63-36e8-4b25-959f-c1fb8d739406" containerName="extract"
Jun 15 05:54:06.811529 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:54:06.810303    2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="e9e3bc63-36e8-4b25-959f-c1fb8d739406" containerName="extract"
Jun 15 05:54:06.856029 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:54:06.855991    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-keda/keda-operator-674595557b-rbf4c"]
Jun 15 05:54:06.856202 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:54:06.856125    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-keda/keda-operator-674595557b-rbf4c"
Jun 15 05:54:06.859947 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:54:06.859928    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-keda\"/\"keda-ocp-cabundle\""
Jun 15 05:54:06.860069 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:54:06.859962    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-keda\"/\"openshift-service-ca.crt\""
Jun 15 05:54:06.860491 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:54:06.860471    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-keda\"/\"keda-operator-dockercfg-2v4gw\""
Jun 15 05:54:06.860491 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:54:06.860486    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-keda\"/\"kube-root-ca.crt\""
Jun 15 05:54:06.860642 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:54:06.860477    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-keda\"/\"kedaorg-certs\""
Jun 15 05:54:06.860781 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:54:06.860763    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-keda\"/\"keda-operator-certs\""
Jun 15 05:54:06.986567 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:54:06.986533    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cabundle0\" (UniqueName: \"kubernetes.io/configmap/ccf80d80-d63d-440c-b353-096d507525ee-cabundle0\") pod \"keda-operator-674595557b-rbf4c\" (UID: \"ccf80d80-d63d-440c-b353-096d507525ee\") " pod="openshift-keda/keda-operator-674595557b-rbf4c"
Jun 15 05:54:06.986567 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:54:06.986570    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/ccf80d80-d63d-440c-b353-096d507525ee-certificates\") pod \"keda-operator-674595557b-rbf4c\" (UID: \"ccf80d80-d63d-440c-b353-096d507525ee\") " pod="openshift-keda/keda-operator-674595557b-rbf4c"
Jun 15 05:54:06.986800 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:54:06.986651    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mtckw\" (UniqueName: \"kubernetes.io/projected/ccf80d80-d63d-440c-b353-096d507525ee-kube-api-access-mtckw\") pod \"keda-operator-674595557b-rbf4c\" (UID: \"ccf80d80-d63d-440c-b353-096d507525ee\") " pod="openshift-keda/keda-operator-674595557b-rbf4c"
Jun 15 05:54:07.061287 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:54:07.061254    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-keda/keda-metrics-apiserver-68788fbd9b-bsktr"]
Jun 15 05:54:07.083342 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:54:07.083266    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-keda/keda-metrics-apiserver-68788fbd9b-bsktr"]
Jun 15 05:54:07.083477 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:54:07.083356    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-keda/keda-metrics-apiserver-68788fbd9b-bsktr"
Jun 15 05:54:07.087245 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:54:07.087210    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mtckw\" (UniqueName: \"kubernetes.io/projected/ccf80d80-d63d-440c-b353-096d507525ee-kube-api-access-mtckw\") pod \"keda-operator-674595557b-rbf4c\" (UID: \"ccf80d80-d63d-440c-b353-096d507525ee\") " pod="openshift-keda/keda-operator-674595557b-rbf4c"
Jun 15 05:54:07.087341 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:54:07.087262    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cabundle0\" (UniqueName: \"kubernetes.io/configmap/ccf80d80-d63d-440c-b353-096d507525ee-cabundle0\") pod \"keda-operator-674595557b-rbf4c\" (UID: \"ccf80d80-d63d-440c-b353-096d507525ee\") " pod="openshift-keda/keda-operator-674595557b-rbf4c"
Jun 15 05:54:07.087341 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:54:07.087291    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/ccf80d80-d63d-440c-b353-096d507525ee-certificates\") pod \"keda-operator-674595557b-rbf4c\" (UID: \"ccf80d80-d63d-440c-b353-096d507525ee\") " pod="openshift-keda/keda-operator-674595557b-rbf4c"
Jun 15 05:54:07.087461 ip-10-0-128-243 kubenswrapper[2566]: E0615 05:54:07.087381    2566 projected.go:266] Couldn't get secret openshift-keda/keda-operator-certs: secret "keda-operator-certs" not found
Jun 15 05:54:07.087461 ip-10-0-128-243 kubenswrapper[2566]: E0615 05:54:07.087397    2566 secret.go:281] references non-existent secret key: ca.crt
Jun 15 05:54:07.087461 ip-10-0-128-243 kubenswrapper[2566]: E0615 05:54:07.087409    2566 projected.go:279] Couldn't get secret payload openshift-keda/kedaorg-certs: references non-existent secret key: ca.crt
Jun 15 05:54:07.087461 ip-10-0-128-243 kubenswrapper[2566]: E0615 05:54:07.087421    2566 projected.go:196] Error preparing data for projected volume certificates for pod openshift-keda/keda-operator-674595557b-rbf4c: [secret "keda-operator-certs" not found, references non-existent secret key: ca.crt]
Jun 15 05:54:07.087654 ip-10-0-128-243 kubenswrapper[2566]: E0615 05:54:07.087482    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ccf80d80-d63d-440c-b353-096d507525ee-certificates podName:ccf80d80-d63d-440c-b353-096d507525ee nodeName:}" failed. No retries permitted until 2026-06-15 05:54:07.587463357 +0000 UTC m=+330.547220580 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "certificates" (UniqueName: "kubernetes.io/projected/ccf80d80-d63d-440c-b353-096d507525ee-certificates") pod "keda-operator-674595557b-rbf4c" (UID: "ccf80d80-d63d-440c-b353-096d507525ee") : [secret "keda-operator-certs" not found, references non-existent secret key: ca.crt]
Jun 15 05:54:07.087935 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:54:07.087913    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cabundle0\" (UniqueName: \"kubernetes.io/configmap/ccf80d80-d63d-440c-b353-096d507525ee-cabundle0\") pod \"keda-operator-674595557b-rbf4c\" (UID: \"ccf80d80-d63d-440c-b353-096d507525ee\") " pod="openshift-keda/keda-operator-674595557b-rbf4c"
Jun 15 05:54:07.088531 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:54:07.088509    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-keda\"/\"keda-metrics-apiserver-certs\""
Jun 15 05:54:07.097157 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:54:07.097136    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mtckw\" (UniqueName: \"kubernetes.io/projected/ccf80d80-d63d-440c-b353-096d507525ee-kube-api-access-mtckw\") pod \"keda-operator-674595557b-rbf4c\" (UID: \"ccf80d80-d63d-440c-b353-096d507525ee\") " pod="openshift-keda/keda-operator-674595557b-rbf4c"
Jun 15 05:54:07.188161 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:54:07.188119    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"temp-vol\" (UniqueName: \"kubernetes.io/empty-dir/e3e28f3f-7f59-4028-8499-1a29c7d9b564-temp-vol\") pod \"keda-metrics-apiserver-68788fbd9b-bsktr\" (UID: \"e3e28f3f-7f59-4028-8499-1a29c7d9b564\") " pod="openshift-keda/keda-metrics-apiserver-68788fbd9b-bsktr"
Jun 15 05:54:07.188400 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:54:07.188219    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/e3e28f3f-7f59-4028-8499-1a29c7d9b564-certificates\") pod \"keda-metrics-apiserver-68788fbd9b-bsktr\" (UID: \"e3e28f3f-7f59-4028-8499-1a29c7d9b564\") " pod="openshift-keda/keda-metrics-apiserver-68788fbd9b-bsktr"
Jun 15 05:54:07.188400 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:54:07.188246    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q5l4v\" (UniqueName: \"kubernetes.io/projected/e3e28f3f-7f59-4028-8499-1a29c7d9b564-kube-api-access-q5l4v\") pod \"keda-metrics-apiserver-68788fbd9b-bsktr\" (UID: \"e3e28f3f-7f59-4028-8499-1a29c7d9b564\") " pod="openshift-keda/keda-metrics-apiserver-68788fbd9b-bsktr"
Jun 15 05:54:07.289426 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:54:07.289387    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/e3e28f3f-7f59-4028-8499-1a29c7d9b564-certificates\") pod \"keda-metrics-apiserver-68788fbd9b-bsktr\" (UID: \"e3e28f3f-7f59-4028-8499-1a29c7d9b564\") " pod="openshift-keda/keda-metrics-apiserver-68788fbd9b-bsktr"
Jun 15 05:54:07.289426 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:54:07.289428    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q5l4v\" (UniqueName: \"kubernetes.io/projected/e3e28f3f-7f59-4028-8499-1a29c7d9b564-kube-api-access-q5l4v\") pod \"keda-metrics-apiserver-68788fbd9b-bsktr\" (UID: \"e3e28f3f-7f59-4028-8499-1a29c7d9b564\") " pod="openshift-keda/keda-metrics-apiserver-68788fbd9b-bsktr"
Jun 15 05:54:07.289675 ip-10-0-128-243 kubenswrapper[2566]: E0615 05:54:07.289528    2566 secret.go:281] references non-existent secret key: tls.crt
Jun 15 05:54:07.289675 ip-10-0-128-243 kubenswrapper[2566]: E0615 05:54:07.289549    2566 projected.go:279] Couldn't get secret payload openshift-keda/kedaorg-certs: references non-existent secret key: tls.crt
Jun 15 05:54:07.289675 ip-10-0-128-243 kubenswrapper[2566]: E0615 05:54:07.289567    2566 projected.go:196] Error preparing data for projected volume certificates for pod openshift-keda/keda-metrics-apiserver-68788fbd9b-bsktr: references non-existent secret key: tls.crt
Jun 15 05:54:07.289675 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:54:07.289597    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"temp-vol\" (UniqueName: \"kubernetes.io/empty-dir/e3e28f3f-7f59-4028-8499-1a29c7d9b564-temp-vol\") pod \"keda-metrics-apiserver-68788fbd9b-bsktr\" (UID: \"e3e28f3f-7f59-4028-8499-1a29c7d9b564\") " pod="openshift-keda/keda-metrics-apiserver-68788fbd9b-bsktr"
Jun 15 05:54:07.289675 ip-10-0-128-243 kubenswrapper[2566]: E0615 05:54:07.289612    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e3e28f3f-7f59-4028-8499-1a29c7d9b564-certificates podName:e3e28f3f-7f59-4028-8499-1a29c7d9b564 nodeName:}" failed. No retries permitted until 2026-06-15 05:54:07.789597437 +0000 UTC m=+330.749354659 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "certificates" (UniqueName: "kubernetes.io/projected/e3e28f3f-7f59-4028-8499-1a29c7d9b564-certificates") pod "keda-metrics-apiserver-68788fbd9b-bsktr" (UID: "e3e28f3f-7f59-4028-8499-1a29c7d9b564") : references non-existent secret key: tls.crt
Jun 15 05:54:07.289995 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:54:07.289974    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"temp-vol\" (UniqueName: \"kubernetes.io/empty-dir/e3e28f3f-7f59-4028-8499-1a29c7d9b564-temp-vol\") pod \"keda-metrics-apiserver-68788fbd9b-bsktr\" (UID: \"e3e28f3f-7f59-4028-8499-1a29c7d9b564\") " pod="openshift-keda/keda-metrics-apiserver-68788fbd9b-bsktr"
Jun 15 05:54:07.299968 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:54:07.299944    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-q5l4v\" (UniqueName: \"kubernetes.io/projected/e3e28f3f-7f59-4028-8499-1a29c7d9b564-kube-api-access-q5l4v\") pod \"keda-metrics-apiserver-68788fbd9b-bsktr\" (UID: \"e3e28f3f-7f59-4028-8499-1a29c7d9b564\") " pod="openshift-keda/keda-metrics-apiserver-68788fbd9b-bsktr"
Jun 15 05:54:07.592157 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:54:07.592111    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/ccf80d80-d63d-440c-b353-096d507525ee-certificates\") pod \"keda-operator-674595557b-rbf4c\" (UID: \"ccf80d80-d63d-440c-b353-096d507525ee\") " pod="openshift-keda/keda-operator-674595557b-rbf4c"
Jun 15 05:54:07.592339 ip-10-0-128-243 kubenswrapper[2566]: E0615 05:54:07.592253    2566 secret.go:281] references non-existent secret key: ca.crt
Jun 15 05:54:07.592339 ip-10-0-128-243 kubenswrapper[2566]: E0615 05:54:07.592273    2566 projected.go:279] Couldn't get secret payload openshift-keda/kedaorg-certs: references non-existent secret key: ca.crt
Jun 15 05:54:07.592339 ip-10-0-128-243 kubenswrapper[2566]: E0615 05:54:07.592282    2566 projected.go:196] Error preparing data for projected volume certificates for pod openshift-keda/keda-operator-674595557b-rbf4c: references non-existent secret key: ca.crt
Jun 15 05:54:07.592440 ip-10-0-128-243 kubenswrapper[2566]: E0615 05:54:07.592351    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ccf80d80-d63d-440c-b353-096d507525ee-certificates podName:ccf80d80-d63d-440c-b353-096d507525ee nodeName:}" failed. No retries permitted until 2026-06-15 05:54:08.592334687 +0000 UTC m=+331.552091909 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "certificates" (UniqueName: "kubernetes.io/projected/ccf80d80-d63d-440c-b353-096d507525ee-certificates") pod "keda-operator-674595557b-rbf4c" (UID: "ccf80d80-d63d-440c-b353-096d507525ee") : references non-existent secret key: ca.crt
Jun 15 05:54:07.794569 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:54:07.794532    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/e3e28f3f-7f59-4028-8499-1a29c7d9b564-certificates\") pod \"keda-metrics-apiserver-68788fbd9b-bsktr\" (UID: \"e3e28f3f-7f59-4028-8499-1a29c7d9b564\") " pod="openshift-keda/keda-metrics-apiserver-68788fbd9b-bsktr"
Jun 15 05:54:07.794764 ip-10-0-128-243 kubenswrapper[2566]: E0615 05:54:07.794664    2566 secret.go:281] references non-existent secret key: tls.crt
Jun 15 05:54:07.794764 ip-10-0-128-243 kubenswrapper[2566]: E0615 05:54:07.794680    2566 projected.go:279] Couldn't get secret payload openshift-keda/kedaorg-certs: references non-existent secret key: tls.crt
Jun 15 05:54:07.794764 ip-10-0-128-243 kubenswrapper[2566]: E0615 05:54:07.794700    2566 projected.go:196] Error preparing data for projected volume certificates for pod openshift-keda/keda-metrics-apiserver-68788fbd9b-bsktr: references non-existent secret key: tls.crt
Jun 15 05:54:07.794764 ip-10-0-128-243 kubenswrapper[2566]: E0615 05:54:07.794759    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e3e28f3f-7f59-4028-8499-1a29c7d9b564-certificates podName:e3e28f3f-7f59-4028-8499-1a29c7d9b564 nodeName:}" failed. No retries permitted until 2026-06-15 05:54:08.794742837 +0000 UTC m=+331.754500063 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "certificates" (UniqueName: "kubernetes.io/projected/e3e28f3f-7f59-4028-8499-1a29c7d9b564-certificates") pod "keda-metrics-apiserver-68788fbd9b-bsktr" (UID: "e3e28f3f-7f59-4028-8499-1a29c7d9b564") : references non-existent secret key: tls.crt
Jun 15 05:54:08.601999 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:54:08.601966    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/ccf80d80-d63d-440c-b353-096d507525ee-certificates\") pod \"keda-operator-674595557b-rbf4c\" (UID: \"ccf80d80-d63d-440c-b353-096d507525ee\") " pod="openshift-keda/keda-operator-674595557b-rbf4c"
Jun 15 05:54:08.602399 ip-10-0-128-243 kubenswrapper[2566]: E0615 05:54:08.602137    2566 secret.go:281] references non-existent secret key: ca.crt
Jun 15 05:54:08.602399 ip-10-0-128-243 kubenswrapper[2566]: E0615 05:54:08.602156    2566 projected.go:279] Couldn't get secret payload openshift-keda/kedaorg-certs: references non-existent secret key: ca.crt
Jun 15 05:54:08.602399 ip-10-0-128-243 kubenswrapper[2566]: E0615 05:54:08.602165    2566 projected.go:196] Error preparing data for projected volume certificates for pod openshift-keda/keda-operator-674595557b-rbf4c: references non-existent secret key: ca.crt
Jun 15 05:54:08.602399 ip-10-0-128-243 kubenswrapper[2566]: E0615 05:54:08.602216    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ccf80d80-d63d-440c-b353-096d507525ee-certificates podName:ccf80d80-d63d-440c-b353-096d507525ee nodeName:}" failed. No retries permitted until 2026-06-15 05:54:10.602202177 +0000 UTC m=+333.561959403 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "certificates" (UniqueName: "kubernetes.io/projected/ccf80d80-d63d-440c-b353-096d507525ee-certificates") pod "keda-operator-674595557b-rbf4c" (UID: "ccf80d80-d63d-440c-b353-096d507525ee") : references non-existent secret key: ca.crt
Jun 15 05:54:08.804451 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:54:08.804421    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/e3e28f3f-7f59-4028-8499-1a29c7d9b564-certificates\") pod \"keda-metrics-apiserver-68788fbd9b-bsktr\" (UID: \"e3e28f3f-7f59-4028-8499-1a29c7d9b564\") " pod="openshift-keda/keda-metrics-apiserver-68788fbd9b-bsktr"
Jun 15 05:54:08.804627 ip-10-0-128-243 kubenswrapper[2566]: E0615 05:54:08.804559    2566 secret.go:281] references non-existent secret key: tls.crt
Jun 15 05:54:08.804627 ip-10-0-128-243 kubenswrapper[2566]: E0615 05:54:08.804575    2566 projected.go:279] Couldn't get secret payload openshift-keda/kedaorg-certs: references non-existent secret key: tls.crt
Jun 15 05:54:08.804627 ip-10-0-128-243 kubenswrapper[2566]: E0615 05:54:08.804591    2566 projected.go:196] Error preparing data for projected volume certificates for pod openshift-keda/keda-metrics-apiserver-68788fbd9b-bsktr: references non-existent secret key: tls.crt
Jun 15 05:54:08.804719 ip-10-0-128-243 kubenswrapper[2566]: E0615 05:54:08.804638    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e3e28f3f-7f59-4028-8499-1a29c7d9b564-certificates podName:e3e28f3f-7f59-4028-8499-1a29c7d9b564 nodeName:}" failed. No retries permitted until 2026-06-15 05:54:10.804625113 +0000 UTC m=+333.764382337 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "certificates" (UniqueName: "kubernetes.io/projected/e3e28f3f-7f59-4028-8499-1a29c7d9b564-certificates") pod "keda-metrics-apiserver-68788fbd9b-bsktr" (UID: "e3e28f3f-7f59-4028-8499-1a29c7d9b564") : references non-existent secret key: tls.crt
Jun 15 05:54:10.618565 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:54:10.618527    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/ccf80d80-d63d-440c-b353-096d507525ee-certificates\") pod \"keda-operator-674595557b-rbf4c\" (UID: \"ccf80d80-d63d-440c-b353-096d507525ee\") " pod="openshift-keda/keda-operator-674595557b-rbf4c"
Jun 15 05:54:10.621232 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:54:10.621207    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/ccf80d80-d63d-440c-b353-096d507525ee-certificates\") pod \"keda-operator-674595557b-rbf4c\" (UID: \"ccf80d80-d63d-440c-b353-096d507525ee\") " pod="openshift-keda/keda-operator-674595557b-rbf4c"
Jun 15 05:54:10.766425 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:54:10.766393    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-keda/keda-operator-674595557b-rbf4c"
Jun 15 05:54:10.819616 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:54:10.819581    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/e3e28f3f-7f59-4028-8499-1a29c7d9b564-certificates\") pod \"keda-metrics-apiserver-68788fbd9b-bsktr\" (UID: \"e3e28f3f-7f59-4028-8499-1a29c7d9b564\") " pod="openshift-keda/keda-metrics-apiserver-68788fbd9b-bsktr"
Jun 15 05:54:10.822376 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:54:10.822349    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/e3e28f3f-7f59-4028-8499-1a29c7d9b564-certificates\") pod \"keda-metrics-apiserver-68788fbd9b-bsktr\" (UID: \"e3e28f3f-7f59-4028-8499-1a29c7d9b564\") " pod="openshift-keda/keda-metrics-apiserver-68788fbd9b-bsktr"
Jun 15 05:54:10.899295 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:54:10.899229    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-keda/keda-operator-674595557b-rbf4c"]
Jun 15 05:54:10.901409 ip-10-0-128-243 kubenswrapper[2566]: W0615 05:54:10.901384    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podccf80d80_d63d_440c_b353_096d507525ee.slice/crio-f1a528f9661e31f90a60d94fbf5eaf99fa0182593e5af672ff3ab0dc3cec0c6d WatchSource:0}: Error finding container f1a528f9661e31f90a60d94fbf5eaf99fa0182593e5af672ff3ab0dc3cec0c6d: Status 404 returned error can't find the container with id f1a528f9661e31f90a60d94fbf5eaf99fa0182593e5af672ff3ab0dc3cec0c6d
Jun 15 05:54:10.992845 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:54:10.992809    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-keda/keda-metrics-apiserver-68788fbd9b-bsktr"
Jun 15 05:54:11.127143 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:54:11.127110    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-keda/keda-metrics-apiserver-68788fbd9b-bsktr"]
Jun 15 05:54:11.130014 ip-10-0-128-243 kubenswrapper[2566]: W0615 05:54:11.129991    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode3e28f3f_7f59_4028_8499_1a29c7d9b564.slice/crio-1503c89759230a53314436f41ebe435a976378d8b3567e8b047b0f9ce5155303 WatchSource:0}: Error finding container 1503c89759230a53314436f41ebe435a976378d8b3567e8b047b0f9ce5155303: Status 404 returned error can't find the container with id 1503c89759230a53314436f41ebe435a976378d8b3567e8b047b0f9ce5155303
Jun 15 05:54:11.811672 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:54:11.811598    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-keda/keda-metrics-apiserver-68788fbd9b-bsktr" event={"ID":"e3e28f3f-7f59-4028-8499-1a29c7d9b564","Type":"ContainerStarted","Data":"1503c89759230a53314436f41ebe435a976378d8b3567e8b047b0f9ce5155303"}
Jun 15 05:54:11.813016 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:54:11.812968    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-keda/keda-operator-674595557b-rbf4c" event={"ID":"ccf80d80-d63d-440c-b353-096d507525ee","Type":"ContainerStarted","Data":"f1a528f9661e31f90a60d94fbf5eaf99fa0182593e5af672ff3ab0dc3cec0c6d"}
Jun 15 05:54:14.829834 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:54:14.829794    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-keda/keda-operator-674595557b-rbf4c" event={"ID":"ccf80d80-d63d-440c-b353-096d507525ee","Type":"ContainerStarted","Data":"b181c24701b916c29cd3b1007b69847362eb2438954e1b3cca24dc0a574793c4"}
Jun 15 05:54:14.830347 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:54:14.829955    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-keda/keda-operator-674595557b-rbf4c"
Jun 15 05:54:14.831558 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:54:14.831532    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-keda/keda-metrics-apiserver-68788fbd9b-bsktr" event={"ID":"e3e28f3f-7f59-4028-8499-1a29c7d9b564","Type":"ContainerStarted","Data":"4fd4393123aee1339c6398dac2393c853e9d25c431ac0f7437aa88c932078154"}
Jun 15 05:54:14.831670 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:54:14.831655    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-keda/keda-metrics-apiserver-68788fbd9b-bsktr"
Jun 15 05:54:14.847761 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:54:14.847699    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-keda/keda-operator-674595557b-rbf4c" podStartSLOduration=5.252567345 podStartE2EDuration="8.847684584s" totalImagesPullingTime="3.595117239s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-15 05:54:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 05:54:14.847416899 +0000 UTC m=+337.807174145" watchObservedRunningTime="2026-06-15 05:54:14.847684584 +0000 UTC m=+337.807441830"
Jun 15 05:54:14.864870 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:54:14.864818    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-keda/keda-metrics-apiserver-68788fbd9b-bsktr" podStartSLOduration=4.502184351 podStartE2EDuration="7.864798302s" totalImagesPullingTime="3.362613951s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-15 05:54:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 05:54:14.864255094 +0000 UTC m=+337.824012366" watchObservedRunningTime="2026-06-15 05:54:14.864798302 +0000 UTC m=+337.824555548"
Jun 15 05:54:25.839840 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:54:25.839762    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-keda/keda-metrics-apiserver-68788fbd9b-bsktr"
Jun 15 05:54:35.837864 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:54:35.837836    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-keda/keda-operator-674595557b-rbf4c"
Jun 15 05:55:17.113841 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:55:17.113807    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve/seaweedfs-64568bcd49-7b68h"]
Jun 15 05:55:17.117438 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:55:17.117412    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/seaweedfs-64568bcd49-7b68h"
Jun 15 05:55:17.121296 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:55:17.121274    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"default-dockercfg-k7mxw\""
Jun 15 05:55:17.121598 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:55:17.121580    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve\"/\"kube-root-ca.crt\""
Jun 15 05:55:17.121759 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:55:17.121743    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"mlpipeline-s3-artifact\""
Jun 15 05:55:17.122008 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:55:17.121992    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve\"/\"openshift-service-ca.crt\""
Jun 15 05:55:17.130773 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:55:17.130751    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/seaweedfs-64568bcd49-7b68h"]
Jun 15 05:55:17.226422 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:55:17.226392    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/9d0c9047-a4e3-4d33-b25d-7bc100346ca9-data\") pod \"seaweedfs-64568bcd49-7b68h\" (UID: \"9d0c9047-a4e3-4d33-b25d-7bc100346ca9\") " pod="kserve/seaweedfs-64568bcd49-7b68h"
Jun 15 05:55:17.226422 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:55:17.226423    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rzgsg\" (UniqueName: \"kubernetes.io/projected/9d0c9047-a4e3-4d33-b25d-7bc100346ca9-kube-api-access-rzgsg\") pod \"seaweedfs-64568bcd49-7b68h\" (UID: \"9d0c9047-a4e3-4d33-b25d-7bc100346ca9\") " pod="kserve/seaweedfs-64568bcd49-7b68h"
Jun 15 05:55:17.327020 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:55:17.326982    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/9d0c9047-a4e3-4d33-b25d-7bc100346ca9-data\") pod \"seaweedfs-64568bcd49-7b68h\" (UID: \"9d0c9047-a4e3-4d33-b25d-7bc100346ca9\") " pod="kserve/seaweedfs-64568bcd49-7b68h"
Jun 15 05:55:17.327020 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:55:17.327021    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rzgsg\" (UniqueName: \"kubernetes.io/projected/9d0c9047-a4e3-4d33-b25d-7bc100346ca9-kube-api-access-rzgsg\") pod \"seaweedfs-64568bcd49-7b68h\" (UID: \"9d0c9047-a4e3-4d33-b25d-7bc100346ca9\") " pod="kserve/seaweedfs-64568bcd49-7b68h"
Jun 15 05:55:17.327614 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:55:17.327594    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/9d0c9047-a4e3-4d33-b25d-7bc100346ca9-data\") pod \"seaweedfs-64568bcd49-7b68h\" (UID: \"9d0c9047-a4e3-4d33-b25d-7bc100346ca9\") " pod="kserve/seaweedfs-64568bcd49-7b68h"
Jun 15 05:55:17.337761 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:55:17.337727    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rzgsg\" (UniqueName: \"kubernetes.io/projected/9d0c9047-a4e3-4d33-b25d-7bc100346ca9-kube-api-access-rzgsg\") pod \"seaweedfs-64568bcd49-7b68h\" (UID: \"9d0c9047-a4e3-4d33-b25d-7bc100346ca9\") " pod="kserve/seaweedfs-64568bcd49-7b68h"
Jun 15 05:55:17.426937 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:55:17.426861    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/seaweedfs-64568bcd49-7b68h"
Jun 15 05:55:17.563226 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:55:17.563204    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/seaweedfs-64568bcd49-7b68h"]
Jun 15 05:55:17.565746 ip-10-0-128-243 kubenswrapper[2566]: W0615 05:55:17.565716    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9d0c9047_a4e3_4d33_b25d_7bc100346ca9.slice/crio-35ef9f8ee4741b9b6c41e3400977995e53f53cef74cec20ae06ad39409a7ffcf WatchSource:0}: Error finding container 35ef9f8ee4741b9b6c41e3400977995e53f53cef74cec20ae06ad39409a7ffcf: Status 404 returned error can't find the container with id 35ef9f8ee4741b9b6c41e3400977995e53f53cef74cec20ae06ad39409a7ffcf
Jun 15 05:55:18.065029 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:55:18.064976    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/seaweedfs-64568bcd49-7b68h" event={"ID":"9d0c9047-a4e3-4d33-b25d-7bc100346ca9","Type":"ContainerStarted","Data":"35ef9f8ee4741b9b6c41e3400977995e53f53cef74cec20ae06ad39409a7ffcf"}
Jun 15 05:55:21.078901 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:55:21.078847    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/seaweedfs-64568bcd49-7b68h" event={"ID":"9d0c9047-a4e3-4d33-b25d-7bc100346ca9","Type":"ContainerStarted","Data":"0a9e4aae0cc56ce5016d0d24322ef01ac54a21184ea2910e6ed49bf73cf7b284"}
Jun 15 05:55:21.079341 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:55:21.078920    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve/seaweedfs-64568bcd49-7b68h"
Jun 15 05:55:21.099634 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:55:21.098608    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve/seaweedfs-64568bcd49-7b68h" podStartSLOduration=1.091198802 podStartE2EDuration="4.098586513s" totalImagesPullingTime="3.007387711s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-15 05:55:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 05:55:21.097697769 +0000 UTC m=+404.057455013" watchObservedRunningTime="2026-06-15 05:55:21.098586513 +0000 UTC m=+404.058343759"
Jun 15 05:55:27.084652 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:55:27.084619    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve/seaweedfs-64568bcd49-7b68h"
Jun 15 05:55:53.085975 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:55:53.085942    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dndpr2"]
Jun 15 05:55:53.091476 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:55:53.091457    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dndpr2"
Jun 15 05:55:53.094200 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:55:53.094176    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Jun 15 05:55:53.094318 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:55:53.094177    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Jun 15 05:55:53.094956 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:55:53.094939    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-48sh7\""
Jun 15 05:55:53.098612 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:55:53.098593    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dndpr2"]
Jun 15 05:55:53.205777 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:55:53.205747    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/57491372-10bc-44c2-8ed1-f3dc2de888ab-bundle\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dndpr2\" (UID: \"57491372-10bc-44c2-8ed1-f3dc2de888ab\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dndpr2"
Jun 15 05:55:53.205960 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:55:53.205798    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/57491372-10bc-44c2-8ed1-f3dc2de888ab-util\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dndpr2\" (UID: \"57491372-10bc-44c2-8ed1-f3dc2de888ab\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dndpr2"
Jun 15 05:55:53.205960 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:55:53.205844    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jk59j\" (UniqueName: \"kubernetes.io/projected/57491372-10bc-44c2-8ed1-f3dc2de888ab-kube-api-access-jk59j\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dndpr2\" (UID: \"57491372-10bc-44c2-8ed1-f3dc2de888ab\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dndpr2"
Jun 15 05:55:53.307178 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:55:53.307134    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/57491372-10bc-44c2-8ed1-f3dc2de888ab-util\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dndpr2\" (UID: \"57491372-10bc-44c2-8ed1-f3dc2de888ab\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dndpr2"
Jun 15 05:55:53.307364 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:55:53.307201    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jk59j\" (UniqueName: \"kubernetes.io/projected/57491372-10bc-44c2-8ed1-f3dc2de888ab-kube-api-access-jk59j\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dndpr2\" (UID: \"57491372-10bc-44c2-8ed1-f3dc2de888ab\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dndpr2"
Jun 15 05:55:53.307364 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:55:53.307235    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/57491372-10bc-44c2-8ed1-f3dc2de888ab-bundle\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dndpr2\" (UID: \"57491372-10bc-44c2-8ed1-f3dc2de888ab\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dndpr2"
Jun 15 05:55:53.307552 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:55:53.307532    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/57491372-10bc-44c2-8ed1-f3dc2de888ab-util\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dndpr2\" (UID: \"57491372-10bc-44c2-8ed1-f3dc2de888ab\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dndpr2"
Jun 15 05:55:53.307590 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:55:53.307552    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/57491372-10bc-44c2-8ed1-f3dc2de888ab-bundle\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dndpr2\" (UID: \"57491372-10bc-44c2-8ed1-f3dc2de888ab\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dndpr2"
Jun 15 05:55:53.317027 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:55:53.316994    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jk59j\" (UniqueName: \"kubernetes.io/projected/57491372-10bc-44c2-8ed1-f3dc2de888ab-kube-api-access-jk59j\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dndpr2\" (UID: \"57491372-10bc-44c2-8ed1-f3dc2de888ab\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dndpr2"
Jun 15 05:55:53.401557 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:55:53.401473    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dndpr2"
Jun 15 05:55:53.535408 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:55:53.535354    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dndpr2"]
Jun 15 05:55:53.537663 ip-10-0-128-243 kubenswrapper[2566]: W0615 05:55:53.537629    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod57491372_10bc_44c2_8ed1_f3dc2de888ab.slice/crio-9836524fa8bbd0d33c1260bec8b3455668f2d50dcaf232b05ead8a1483c988d2 WatchSource:0}: Error finding container 9836524fa8bbd0d33c1260bec8b3455668f2d50dcaf232b05ead8a1483c988d2: Status 404 returned error can't find the container with id 9836524fa8bbd0d33c1260bec8b3455668f2d50dcaf232b05ead8a1483c988d2
Jun 15 05:55:54.206186 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:55:54.206078    2566 generic.go:356] "Generic (PLEG): container finished" podID="57491372-10bc-44c2-8ed1-f3dc2de888ab" containerID="e49d45cfdde3818c2056ab234d11e8526f1c53f9342a8cb742cb9611f856ab99" exitCode=0
Jun 15 05:55:54.206186 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:55:54.206140    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dndpr2" event={"ID":"57491372-10bc-44c2-8ed1-f3dc2de888ab","Type":"ContainerDied","Data":"e49d45cfdde3818c2056ab234d11e8526f1c53f9342a8cb742cb9611f856ab99"}
Jun 15 05:55:54.206186 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:55:54.206175    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dndpr2" event={"ID":"57491372-10bc-44c2-8ed1-f3dc2de888ab","Type":"ContainerStarted","Data":"9836524fa8bbd0d33c1260bec8b3455668f2d50dcaf232b05ead8a1483c988d2"}
Jun 15 05:56:18.304561 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:56:18.304526    2566 generic.go:356] "Generic (PLEG): container finished" podID="57491372-10bc-44c2-8ed1-f3dc2de888ab" containerID="b45991ae237812d60d107756b0341e88e7ac2ecdc7a460f347d1085eead35e49" exitCode=0
Jun 15 05:56:18.304561 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:56:18.304562    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dndpr2" event={"ID":"57491372-10bc-44c2-8ed1-f3dc2de888ab","Type":"ContainerDied","Data":"b45991ae237812d60d107756b0341e88e7ac2ecdc7a460f347d1085eead35e49"}
Jun 15 05:56:18.483222 ip-10-0-128-243 kubenswrapper[2566]: E0615 05:56:18.483168    2566 cadvisor_stats_provider.go:567] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod57491372_10bc_44c2_8ed1_f3dc2de888ab.slice/crio-70aec27f365ad03ca4fb8b31101da22716b78d3e238a64acb1113090bf884958.scope\": RecentStats: unable to find data in memory cache], [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod57491372_10bc_44c2_8ed1_f3dc2de888ab.slice/crio-conmon-70aec27f365ad03ca4fb8b31101da22716b78d3e238a64acb1113090bf884958.scope\": RecentStats: unable to find data in memory cache]"
Jun 15 05:56:19.310484 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:56:19.310446    2566 generic.go:356] "Generic (PLEG): container finished" podID="57491372-10bc-44c2-8ed1-f3dc2de888ab" containerID="70aec27f365ad03ca4fb8b31101da22716b78d3e238a64acb1113090bf884958" exitCode=0
Jun 15 05:56:19.310860 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:56:19.310543    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dndpr2" event={"ID":"57491372-10bc-44c2-8ed1-f3dc2de888ab","Type":"ContainerDied","Data":"70aec27f365ad03ca4fb8b31101da22716b78d3e238a64acb1113090bf884958"}
Jun 15 05:56:20.435490 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:56:20.435463    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dndpr2"
Jun 15 05:56:20.511519 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:56:20.511493    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/57491372-10bc-44c2-8ed1-f3dc2de888ab-util\") pod \"57491372-10bc-44c2-8ed1-f3dc2de888ab\" (UID: \"57491372-10bc-44c2-8ed1-f3dc2de888ab\") "
Jun 15 05:56:20.511678 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:56:20.511541    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/57491372-10bc-44c2-8ed1-f3dc2de888ab-bundle\") pod \"57491372-10bc-44c2-8ed1-f3dc2de888ab\" (UID: \"57491372-10bc-44c2-8ed1-f3dc2de888ab\") "
Jun 15 05:56:20.511678 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:56:20.511567    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jk59j\" (UniqueName: \"kubernetes.io/projected/57491372-10bc-44c2-8ed1-f3dc2de888ab-kube-api-access-jk59j\") pod \"57491372-10bc-44c2-8ed1-f3dc2de888ab\" (UID: \"57491372-10bc-44c2-8ed1-f3dc2de888ab\") "
Jun 15 05:56:20.512286 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:56:20.512263    2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/57491372-10bc-44c2-8ed1-f3dc2de888ab-bundle" (OuterVolumeSpecName: "bundle") pod "57491372-10bc-44c2-8ed1-f3dc2de888ab" (UID: "57491372-10bc-44c2-8ed1-f3dc2de888ab"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jun 15 05:56:20.513839 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:56:20.513816    2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/57491372-10bc-44c2-8ed1-f3dc2de888ab-kube-api-access-jk59j" (OuterVolumeSpecName: "kube-api-access-jk59j") pod "57491372-10bc-44c2-8ed1-f3dc2de888ab" (UID: "57491372-10bc-44c2-8ed1-f3dc2de888ab"). InnerVolumeSpecName "kube-api-access-jk59j". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jun 15 05:56:20.516785 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:56:20.516761    2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/57491372-10bc-44c2-8ed1-f3dc2de888ab-util" (OuterVolumeSpecName: "util") pod "57491372-10bc-44c2-8ed1-f3dc2de888ab" (UID: "57491372-10bc-44c2-8ed1-f3dc2de888ab"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jun 15 05:56:20.612484 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:56:20.612426    2566 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/57491372-10bc-44c2-8ed1-f3dc2de888ab-util\") on node \"ip-10-0-128-243.ec2.internal\" DevicePath \"\""
Jun 15 05:56:20.612484 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:56:20.612448    2566 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/57491372-10bc-44c2-8ed1-f3dc2de888ab-bundle\") on node \"ip-10-0-128-243.ec2.internal\" DevicePath \"\""
Jun 15 05:56:20.612484 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:56:20.612458    2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jk59j\" (UniqueName: \"kubernetes.io/projected/57491372-10bc-44c2-8ed1-f3dc2de888ab-kube-api-access-jk59j\") on node \"ip-10-0-128-243.ec2.internal\" DevicePath \"\""
Jun 15 05:56:21.320299 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:56:21.320273    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dndpr2"
Jun 15 05:56:21.320299 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:56:21.320283    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dndpr2" event={"ID":"57491372-10bc-44c2-8ed1-f3dc2de888ab","Type":"ContainerDied","Data":"9836524fa8bbd0d33c1260bec8b3455668f2d50dcaf232b05ead8a1483c988d2"}
Jun 15 05:56:21.320538 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:56:21.320323    2566 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="9836524fa8bbd0d33c1260bec8b3455668f2d50dcaf232b05ead8a1483c988d2"
Jun 15 05:56:26.575208 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:56:26.575165    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-5b66478c58-rz2zl"]
Jun 15 05:56:26.575661 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:56:26.575449    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="57491372-10bc-44c2-8ed1-f3dc2de888ab" containerName="util"
Jun 15 05:56:26.575661 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:56:26.575459    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="57491372-10bc-44c2-8ed1-f3dc2de888ab" containerName="util"
Jun 15 05:56:26.575661 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:56:26.575474    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="57491372-10bc-44c2-8ed1-f3dc2de888ab" containerName="extract"
Jun 15 05:56:26.575661 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:56:26.575479    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="57491372-10bc-44c2-8ed1-f3dc2de888ab" containerName="extract"
Jun 15 05:56:26.575661 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:56:26.575491    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="57491372-10bc-44c2-8ed1-f3dc2de888ab" containerName="pull"
Jun 15 05:56:26.575661 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:56:26.575497    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="57491372-10bc-44c2-8ed1-f3dc2de888ab" containerName="pull"
Jun 15 05:56:26.575661 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:56:26.575540    2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="57491372-10bc-44c2-8ed1-f3dc2de888ab" containerName="extract"
Jun 15 05:56:26.578324 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:56:26.578306    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-5b66478c58-rz2zl"
Jun 15 05:56:26.580723 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:56:26.580701    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager-operator\"/\"cert-manager-operator-controller-manager-dockercfg-q6gcg\""
Jun 15 05:56:26.580970 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:56:26.580943    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"kube-root-ca.crt\""
Jun 15 05:56:26.581063 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:56:26.580999    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"openshift-service-ca.crt\""
Jun 15 05:56:26.590979 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:56:26.590957    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-5b66478c58-rz2zl"]
Jun 15 05:56:26.656358 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:56:26.656329    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ce6db52e-33e5-4b2b-9ad9-ea5f126ba59d-tmp\") pod \"cert-manager-operator-controller-manager-5b66478c58-rz2zl\" (UID: \"ce6db52e-33e5-4b2b-9ad9-ea5f126ba59d\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-5b66478c58-rz2zl"
Jun 15 05:56:26.656467 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:56:26.656361    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wrmx9\" (UniqueName: \"kubernetes.io/projected/ce6db52e-33e5-4b2b-9ad9-ea5f126ba59d-kube-api-access-wrmx9\") pod \"cert-manager-operator-controller-manager-5b66478c58-rz2zl\" (UID: \"ce6db52e-33e5-4b2b-9ad9-ea5f126ba59d\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-5b66478c58-rz2zl"
Jun 15 05:56:26.757527 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:56:26.757497    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wrmx9\" (UniqueName: \"kubernetes.io/projected/ce6db52e-33e5-4b2b-9ad9-ea5f126ba59d-kube-api-access-wrmx9\") pod \"cert-manager-operator-controller-manager-5b66478c58-rz2zl\" (UID: \"ce6db52e-33e5-4b2b-9ad9-ea5f126ba59d\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-5b66478c58-rz2zl"
Jun 15 05:56:26.757648 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:56:26.757567    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ce6db52e-33e5-4b2b-9ad9-ea5f126ba59d-tmp\") pod \"cert-manager-operator-controller-manager-5b66478c58-rz2zl\" (UID: \"ce6db52e-33e5-4b2b-9ad9-ea5f126ba59d\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-5b66478c58-rz2zl"
Jun 15 05:56:26.757869 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:56:26.757855    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ce6db52e-33e5-4b2b-9ad9-ea5f126ba59d-tmp\") pod \"cert-manager-operator-controller-manager-5b66478c58-rz2zl\" (UID: \"ce6db52e-33e5-4b2b-9ad9-ea5f126ba59d\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-5b66478c58-rz2zl"
Jun 15 05:56:26.767391 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:56:26.767367    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wrmx9\" (UniqueName: \"kubernetes.io/projected/ce6db52e-33e5-4b2b-9ad9-ea5f126ba59d-kube-api-access-wrmx9\") pod \"cert-manager-operator-controller-manager-5b66478c58-rz2zl\" (UID: \"ce6db52e-33e5-4b2b-9ad9-ea5f126ba59d\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-5b66478c58-rz2zl"
Jun 15 05:56:26.886831 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:56:26.886745    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-5b66478c58-rz2zl"
Jun 15 05:56:27.020806 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:56:27.020738    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-5b66478c58-rz2zl"]
Jun 15 05:56:27.023024 ip-10-0-128-243 kubenswrapper[2566]: W0615 05:56:27.023001    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podce6db52e_33e5_4b2b_9ad9_ea5f126ba59d.slice/crio-af087c8937b6f3beb335924965fd7dda651219b1862d96bc73a059cb9cd4cc95 WatchSource:0}: Error finding container af087c8937b6f3beb335924965fd7dda651219b1862d96bc73a059cb9cd4cc95: Status 404 returned error can't find the container with id af087c8937b6f3beb335924965fd7dda651219b1862d96bc73a059cb9cd4cc95
Jun 15 05:56:27.345747 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:56:27.345715    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-5b66478c58-rz2zl" event={"ID":"ce6db52e-33e5-4b2b-9ad9-ea5f126ba59d","Type":"ContainerStarted","Data":"af087c8937b6f3beb335924965fd7dda651219b1862d96bc73a059cb9cd4cc95"}
Jun 15 05:56:29.358736 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:56:29.358692    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-5b66478c58-rz2zl" event={"ID":"ce6db52e-33e5-4b2b-9ad9-ea5f126ba59d","Type":"ContainerStarted","Data":"d24a76eab065b88d27908f58bc5b5b86f816606fa598f884ea8f984d13a2608d"}
Jun 15 05:56:29.391951 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:56:29.391908    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager-operator/cert-manager-operator-controller-manager-5b66478c58-rz2zl" podStartSLOduration=1.712173224 podStartE2EDuration="3.391895516s" totalImagesPullingTime="1.679722292s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-15 05:56:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 05:56:29.387029216 +0000 UTC m=+472.346786487" watchObservedRunningTime="2026-06-15 05:56:29.391895516 +0000 UTC m=+472.351652763"
Jun 15 05:56:34.940957 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:56:34.940924    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-cainjector-5d99449ffd-ljn77"]
Jun 15 05:56:34.944224 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:56:34.944208    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-5d99449ffd-ljn77"
Jun 15 05:56:34.948908 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:56:34.948882    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\""
Jun 15 05:56:34.949031 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:56:34.948962    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\""
Jun 15 05:56:34.949823 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:56:34.949800    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-cainjector-dockercfg-bbsjd\""
Jun 15 05:56:35.006961 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:56:35.006930    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-5d99449ffd-ljn77"]
Jun 15 05:56:35.027213 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:56:35.027172    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/ba7eb93b-480b-465b-8932-88349ec2e0d2-bound-sa-token\") pod \"cert-manager-cainjector-5d99449ffd-ljn77\" (UID: \"ba7eb93b-480b-465b-8932-88349ec2e0d2\") " pod="cert-manager/cert-manager-cainjector-5d99449ffd-ljn77"
Jun 15 05:56:35.027378 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:56:35.027239    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vjtks\" (UniqueName: \"kubernetes.io/projected/ba7eb93b-480b-465b-8932-88349ec2e0d2-kube-api-access-vjtks\") pod \"cert-manager-cainjector-5d99449ffd-ljn77\" (UID: \"ba7eb93b-480b-465b-8932-88349ec2e0d2\") " pod="cert-manager/cert-manager-cainjector-5d99449ffd-ljn77"
Jun 15 05:56:35.127961 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:56:35.127919    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vjtks\" (UniqueName: \"kubernetes.io/projected/ba7eb93b-480b-465b-8932-88349ec2e0d2-kube-api-access-vjtks\") pod \"cert-manager-cainjector-5d99449ffd-ljn77\" (UID: \"ba7eb93b-480b-465b-8932-88349ec2e0d2\") " pod="cert-manager/cert-manager-cainjector-5d99449ffd-ljn77"
Jun 15 05:56:35.128162 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:56:35.128000    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/ba7eb93b-480b-465b-8932-88349ec2e0d2-bound-sa-token\") pod \"cert-manager-cainjector-5d99449ffd-ljn77\" (UID: \"ba7eb93b-480b-465b-8932-88349ec2e0d2\") " pod="cert-manager/cert-manager-cainjector-5d99449ffd-ljn77"
Jun 15 05:56:35.138554 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:56:35.138523    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/ba7eb93b-480b-465b-8932-88349ec2e0d2-bound-sa-token\") pod \"cert-manager-cainjector-5d99449ffd-ljn77\" (UID: \"ba7eb93b-480b-465b-8932-88349ec2e0d2\") " pod="cert-manager/cert-manager-cainjector-5d99449ffd-ljn77"
Jun 15 05:56:35.138667 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:56:35.138555    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vjtks\" (UniqueName: \"kubernetes.io/projected/ba7eb93b-480b-465b-8932-88349ec2e0d2-kube-api-access-vjtks\") pod \"cert-manager-cainjector-5d99449ffd-ljn77\" (UID: \"ba7eb93b-480b-465b-8932-88349ec2e0d2\") " pod="cert-manager/cert-manager-cainjector-5d99449ffd-ljn77"
Jun 15 05:56:35.252658 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:56:35.252593    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-5d99449ffd-ljn77"
Jun 15 05:56:35.389112 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:56:35.389073    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-5d99449ffd-ljn77"]
Jun 15 05:56:35.391319 ip-10-0-128-243 kubenswrapper[2566]: W0615 05:56:35.391293    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podba7eb93b_480b_465b_8932_88349ec2e0d2.slice/crio-1cf847db3c4281d29874dd9bb6c466001277401650d688baa15fa7692c19dfe3 WatchSource:0}: Error finding container 1cf847db3c4281d29874dd9bb6c466001277401650d688baa15fa7692c19dfe3: Status 404 returned error can't find the container with id 1cf847db3c4281d29874dd9bb6c466001277401650d688baa15fa7692c19dfe3
Jun 15 05:56:35.759001 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:56:35.758971    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ftwjj5"]
Jun 15 05:56:35.763562 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:56:35.763543    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ftwjj5"
Jun 15 05:56:35.769223 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:56:35.769170    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Jun 15 05:56:35.770137 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:56:35.770117    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-48sh7\""
Jun 15 05:56:35.770880 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:56:35.770861    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Jun 15 05:56:35.779294 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:56:35.779271    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ftwjj5"]
Jun 15 05:56:35.836031 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:56:35.835996    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-drn45\" (UniqueName: \"kubernetes.io/projected/987eed8c-b0b1-41fb-805d-020efadb5653-kube-api-access-drn45\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ftwjj5\" (UID: \"987eed8c-b0b1-41fb-805d-020efadb5653\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ftwjj5"
Jun 15 05:56:35.836031 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:56:35.836036    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/987eed8c-b0b1-41fb-805d-020efadb5653-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ftwjj5\" (UID: \"987eed8c-b0b1-41fb-805d-020efadb5653\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ftwjj5"
Jun 15 05:56:35.836299 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:56:35.836060    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/987eed8c-b0b1-41fb-805d-020efadb5653-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ftwjj5\" (UID: \"987eed8c-b0b1-41fb-805d-020efadb5653\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ftwjj5"
Jun 15 05:56:35.936878 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:56:35.936841    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-drn45\" (UniqueName: \"kubernetes.io/projected/987eed8c-b0b1-41fb-805d-020efadb5653-kube-api-access-drn45\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ftwjj5\" (UID: \"987eed8c-b0b1-41fb-805d-020efadb5653\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ftwjj5"
Jun 15 05:56:35.936878 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:56:35.936880    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/987eed8c-b0b1-41fb-805d-020efadb5653-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ftwjj5\" (UID: \"987eed8c-b0b1-41fb-805d-020efadb5653\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ftwjj5"
Jun 15 05:56:35.937067 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:56:35.936902    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/987eed8c-b0b1-41fb-805d-020efadb5653-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ftwjj5\" (UID: \"987eed8c-b0b1-41fb-805d-020efadb5653\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ftwjj5"
Jun 15 05:56:35.937293 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:56:35.937273    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/987eed8c-b0b1-41fb-805d-020efadb5653-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ftwjj5\" (UID: \"987eed8c-b0b1-41fb-805d-020efadb5653\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ftwjj5"
Jun 15 05:56:35.937334 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:56:35.937299    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/987eed8c-b0b1-41fb-805d-020efadb5653-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ftwjj5\" (UID: \"987eed8c-b0b1-41fb-805d-020efadb5653\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ftwjj5"
Jun 15 05:56:35.947257 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:56:35.947240    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-drn45\" (UniqueName: \"kubernetes.io/projected/987eed8c-b0b1-41fb-805d-020efadb5653-kube-api-access-drn45\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ftwjj5\" (UID: \"987eed8c-b0b1-41fb-805d-020efadb5653\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ftwjj5"
Jun 15 05:56:36.073383 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:56:36.073305    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ftwjj5"
Jun 15 05:56:36.231669 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:56:36.231634    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ftwjj5"]
Jun 15 05:56:36.232889 ip-10-0-128-243 kubenswrapper[2566]: W0615 05:56:36.232856    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod987eed8c_b0b1_41fb_805d_020efadb5653.slice/crio-6f8c9122be2efa72c7a89fac39a85dfc0c24116c39b24258ecd9b6012c691c12 WatchSource:0}: Error finding container 6f8c9122be2efa72c7a89fac39a85dfc0c24116c39b24258ecd9b6012c691c12: Status 404 returned error can't find the container with id 6f8c9122be2efa72c7a89fac39a85dfc0c24116c39b24258ecd9b6012c691c12
Jun 15 05:56:36.391366 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:56:36.391335    2566 generic.go:356] "Generic (PLEG): container finished" podID="987eed8c-b0b1-41fb-805d-020efadb5653" containerID="f74031e9e7dda0572de7635d193ed04314d44538635974894b88acd26b9d14a4" exitCode=0
Jun 15 05:56:36.391518 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:56:36.391426    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ftwjj5" event={"ID":"987eed8c-b0b1-41fb-805d-020efadb5653","Type":"ContainerDied","Data":"f74031e9e7dda0572de7635d193ed04314d44538635974894b88acd26b9d14a4"}
Jun 15 05:56:36.391518 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:56:36.391485    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ftwjj5" event={"ID":"987eed8c-b0b1-41fb-805d-020efadb5653","Type":"ContainerStarted","Data":"6f8c9122be2efa72c7a89fac39a85dfc0c24116c39b24258ecd9b6012c691c12"}
Jun 15 05:56:36.392844 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:56:36.392808    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-5d99449ffd-ljn77" event={"ID":"ba7eb93b-480b-465b-8932-88349ec2e0d2","Type":"ContainerStarted","Data":"1cf847db3c4281d29874dd9bb6c466001277401650d688baa15fa7692c19dfe3"}
Jun 15 05:56:39.412714 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:56:39.412675    2566 generic.go:356] "Generic (PLEG): container finished" podID="987eed8c-b0b1-41fb-805d-020efadb5653" containerID="c1841c55fc591672991b81e74b9a62a498560644aece1865e17f5dbbe0f098af" exitCode=0
Jun 15 05:56:39.413241 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:56:39.412744    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ftwjj5" event={"ID":"987eed8c-b0b1-41fb-805d-020efadb5653","Type":"ContainerDied","Data":"c1841c55fc591672991b81e74b9a62a498560644aece1865e17f5dbbe0f098af"}
Jun 15 05:56:39.414451 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:56:39.414428    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-5d99449ffd-ljn77" event={"ID":"ba7eb93b-480b-465b-8932-88349ec2e0d2","Type":"ContainerStarted","Data":"4946a02251c0e3e957754a6ebf495d1ca85a551b2a86c608519effded4ecf9fd"}
Jun 15 05:56:39.465452 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:56:39.465403    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-cainjector-5d99449ffd-ljn77" podStartSLOduration=2.134647851 podStartE2EDuration="5.465388914s" totalImagesPullingTime="3.330741063s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-15 05:56:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 05:56:39.463075948 +0000 UTC m=+482.422833190" watchObservedRunningTime="2026-06-15 05:56:39.465388914 +0000 UTC m=+482.425146160"
Jun 15 05:56:40.420828 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:56:40.420791    2566 generic.go:356] "Generic (PLEG): container finished" podID="987eed8c-b0b1-41fb-805d-020efadb5653" containerID="550bfca72fdee69d35e663329357ad46295d2488e4185473eefad1751a74c4f5" exitCode=0
Jun 15 05:56:40.421217 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:56:40.420876    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ftwjj5" event={"ID":"987eed8c-b0b1-41fb-805d-020efadb5653","Type":"ContainerDied","Data":"550bfca72fdee69d35e663329357ad46295d2488e4185473eefad1751a74c4f5"}
Jun 15 05:56:41.552393 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:56:41.552369    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ftwjj5"
Jun 15 05:56:41.682779 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:56:41.682704    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/987eed8c-b0b1-41fb-805d-020efadb5653-bundle\") pod \"987eed8c-b0b1-41fb-805d-020efadb5653\" (UID: \"987eed8c-b0b1-41fb-805d-020efadb5653\") "
Jun 15 05:56:41.682779 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:56:41.682762    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-drn45\" (UniqueName: \"kubernetes.io/projected/987eed8c-b0b1-41fb-805d-020efadb5653-kube-api-access-drn45\") pod \"987eed8c-b0b1-41fb-805d-020efadb5653\" (UID: \"987eed8c-b0b1-41fb-805d-020efadb5653\") "
Jun 15 05:56:41.682951 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:56:41.682810    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/987eed8c-b0b1-41fb-805d-020efadb5653-util\") pod \"987eed8c-b0b1-41fb-805d-020efadb5653\" (UID: \"987eed8c-b0b1-41fb-805d-020efadb5653\") "
Jun 15 05:56:41.683246 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:56:41.683204    2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/987eed8c-b0b1-41fb-805d-020efadb5653-bundle" (OuterVolumeSpecName: "bundle") pod "987eed8c-b0b1-41fb-805d-020efadb5653" (UID: "987eed8c-b0b1-41fb-805d-020efadb5653"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jun 15 05:56:41.685048 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:56:41.685027    2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/987eed8c-b0b1-41fb-805d-020efadb5653-kube-api-access-drn45" (OuterVolumeSpecName: "kube-api-access-drn45") pod "987eed8c-b0b1-41fb-805d-020efadb5653" (UID: "987eed8c-b0b1-41fb-805d-020efadb5653"). InnerVolumeSpecName "kube-api-access-drn45". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jun 15 05:56:41.749540 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:56:41.749506    2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/987eed8c-b0b1-41fb-805d-020efadb5653-util" (OuterVolumeSpecName: "util") pod "987eed8c-b0b1-41fb-805d-020efadb5653" (UID: "987eed8c-b0b1-41fb-805d-020efadb5653"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jun 15 05:56:41.784263 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:56:41.784231    2566 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/987eed8c-b0b1-41fb-805d-020efadb5653-bundle\") on node \"ip-10-0-128-243.ec2.internal\" DevicePath \"\""
Jun 15 05:56:41.784263 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:56:41.784260    2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-drn45\" (UniqueName: \"kubernetes.io/projected/987eed8c-b0b1-41fb-805d-020efadb5653-kube-api-access-drn45\") on node \"ip-10-0-128-243.ec2.internal\" DevicePath \"\""
Jun 15 05:56:41.784418 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:56:41.784273    2566 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/987eed8c-b0b1-41fb-805d-020efadb5653-util\") on node \"ip-10-0-128-243.ec2.internal\" DevicePath \"\""
Jun 15 05:56:42.430724 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:56:42.430699    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ftwjj5"
Jun 15 05:56:42.430724 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:56:42.430714    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ftwjj5" event={"ID":"987eed8c-b0b1-41fb-805d-020efadb5653","Type":"ContainerDied","Data":"6f8c9122be2efa72c7a89fac39a85dfc0c24116c39b24258ecd9b6012c691c12"}
Jun 15 05:56:42.430926 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:56:42.430761    2566 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="6f8c9122be2efa72c7a89fac39a85dfc0c24116c39b24258ecd9b6012c691c12"
Jun 15 05:56:48.774137 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:56:48.774104    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-d9kj2"]
Jun 15 05:56:48.774532 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:56:48.774385    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="987eed8c-b0b1-41fb-805d-020efadb5653" containerName="pull"
Jun 15 05:56:48.774532 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:56:48.774395    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="987eed8c-b0b1-41fb-805d-020efadb5653" containerName="pull"
Jun 15 05:56:48.774532 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:56:48.774418    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="987eed8c-b0b1-41fb-805d-020efadb5653" containerName="extract"
Jun 15 05:56:48.774532 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:56:48.774423    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="987eed8c-b0b1-41fb-805d-020efadb5653" containerName="extract"
Jun 15 05:56:48.774532 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:56:48.774431    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="987eed8c-b0b1-41fb-805d-020efadb5653" containerName="util"
Jun 15 05:56:48.774532 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:56:48.774437    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="987eed8c-b0b1-41fb-805d-020efadb5653" containerName="util"
Jun 15 05:56:48.774532 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:56:48.774490    2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="987eed8c-b0b1-41fb-805d-020efadb5653" containerName="extract"
Jun 15 05:56:48.780060 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:56:48.780042    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-d9kj2"
Jun 15 05:56:48.784149 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:56:48.784129    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\""
Jun 15 05:56:48.785022 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:56:48.785003    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\""
Jun 15 05:56:48.785022 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:56:48.785036    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"openshift-lws-operator-dockercfg-zfjdj\""
Jun 15 05:56:48.802138 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:56:48.802112    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-d9kj2"]
Jun 15 05:56:48.936121 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:56:48.936061    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gkl62\" (UniqueName: \"kubernetes.io/projected/ed12ca90-c9df-4952-b12f-148a722dbd7b-kube-api-access-gkl62\") pod \"openshift-lws-operator-fd8ccff4c-d9kj2\" (UID: \"ed12ca90-c9df-4952-b12f-148a722dbd7b\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-d9kj2"
Jun 15 05:56:48.936121 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:56:48.936120    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ed12ca90-c9df-4952-b12f-148a722dbd7b-tmp\") pod \"openshift-lws-operator-fd8ccff4c-d9kj2\" (UID: \"ed12ca90-c9df-4952-b12f-148a722dbd7b\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-d9kj2"
Jun 15 05:56:49.037592 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:56:49.037472    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gkl62\" (UniqueName: \"kubernetes.io/projected/ed12ca90-c9df-4952-b12f-148a722dbd7b-kube-api-access-gkl62\") pod \"openshift-lws-operator-fd8ccff4c-d9kj2\" (UID: \"ed12ca90-c9df-4952-b12f-148a722dbd7b\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-d9kj2"
Jun 15 05:56:49.037592 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:56:49.037531    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ed12ca90-c9df-4952-b12f-148a722dbd7b-tmp\") pod \"openshift-lws-operator-fd8ccff4c-d9kj2\" (UID: \"ed12ca90-c9df-4952-b12f-148a722dbd7b\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-d9kj2"
Jun 15 05:56:49.037938 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:56:49.037915    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ed12ca90-c9df-4952-b12f-148a722dbd7b-tmp\") pod \"openshift-lws-operator-fd8ccff4c-d9kj2\" (UID: \"ed12ca90-c9df-4952-b12f-148a722dbd7b\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-d9kj2"
Jun 15 05:56:49.049980 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:56:49.049946    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gkl62\" (UniqueName: \"kubernetes.io/projected/ed12ca90-c9df-4952-b12f-148a722dbd7b-kube-api-access-gkl62\") pod \"openshift-lws-operator-fd8ccff4c-d9kj2\" (UID: \"ed12ca90-c9df-4952-b12f-148a722dbd7b\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-d9kj2"
Jun 15 05:56:49.088662 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:56:49.088633    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-d9kj2"
Jun 15 05:56:49.228881 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:56:49.228857    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-d9kj2"]
Jun 15 05:56:49.231288 ip-10-0-128-243 kubenswrapper[2566]: W0615 05:56:49.231269    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poded12ca90_c9df_4952_b12f_148a722dbd7b.slice/crio-02a8ca0298d18859b017476b98bd76b0b75b81c97a602aad904bbbf5e93d35de WatchSource:0}: Error finding container 02a8ca0298d18859b017476b98bd76b0b75b81c97a602aad904bbbf5e93d35de: Status 404 returned error can't find the container with id 02a8ca0298d18859b017476b98bd76b0b75b81c97a602aad904bbbf5e93d35de
Jun 15 05:56:49.461922 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:56:49.461837    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-d9kj2" event={"ID":"ed12ca90-c9df-4952-b12f-148a722dbd7b","Type":"ContainerStarted","Data":"02a8ca0298d18859b017476b98bd76b0b75b81c97a602aad904bbbf5e93d35de"}
Jun 15 05:56:52.478019 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:56:52.477976    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-d9kj2" event={"ID":"ed12ca90-c9df-4952-b12f-148a722dbd7b","Type":"ContainerStarted","Data":"89e0714325e31bb719949b12a44d31d85b90d3f495ddb7ca93507084fdf28d2e"}
Jun 15 05:56:52.496451 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:56:52.496406    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-d9kj2" podStartSLOduration=2.220740302 podStartE2EDuration="4.496391056s" totalImagesPullingTime="2.275650754s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-15 05:56:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 05:56:52.495014543 +0000 UTC m=+495.454771794" watchObservedRunningTime="2026-06-15 05:56:52.496391056 +0000 UTC m=+495.456148300"
Jun 15 05:57:04.749665 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:57:04.749630    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06mmw9m"]
Jun 15 05:57:04.752927 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:57:04.752909    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06mmw9m"
Jun 15 05:57:04.755456 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:57:04.755436    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Jun 15 05:57:04.756322 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:57:04.756303    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Jun 15 05:57:04.756395 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:57:04.756347    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-48sh7\""
Jun 15 05:57:04.763675 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:57:04.763655    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06mmw9m"]
Jun 15 05:57:04.864568 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:57:04.864532    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7jg98\" (UniqueName: \"kubernetes.io/projected/eab5fd2f-75fb-455f-a612-3d15730885d0-kube-api-access-7jg98\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06mmw9m\" (UID: \"eab5fd2f-75fb-455f-a612-3d15730885d0\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06mmw9m"
Jun 15 05:57:04.864568 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:57:04.864572    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/eab5fd2f-75fb-455f-a612-3d15730885d0-util\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06mmw9m\" (UID: \"eab5fd2f-75fb-455f-a612-3d15730885d0\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06mmw9m"
Jun 15 05:57:04.864784 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:57:04.864609    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/eab5fd2f-75fb-455f-a612-3d15730885d0-bundle\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06mmw9m\" (UID: \"eab5fd2f-75fb-455f-a612-3d15730885d0\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06mmw9m"
Jun 15 05:57:04.965919 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:57:04.965866    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7jg98\" (UniqueName: \"kubernetes.io/projected/eab5fd2f-75fb-455f-a612-3d15730885d0-kube-api-access-7jg98\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06mmw9m\" (UID: \"eab5fd2f-75fb-455f-a612-3d15730885d0\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06mmw9m"
Jun 15 05:57:04.965919 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:57:04.965923    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/eab5fd2f-75fb-455f-a612-3d15730885d0-util\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06mmw9m\" (UID: \"eab5fd2f-75fb-455f-a612-3d15730885d0\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06mmw9m"
Jun 15 05:57:04.966178 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:57:04.965963    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/eab5fd2f-75fb-455f-a612-3d15730885d0-bundle\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06mmw9m\" (UID: \"eab5fd2f-75fb-455f-a612-3d15730885d0\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06mmw9m"
Jun 15 05:57:04.966354 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:57:04.966336    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/eab5fd2f-75fb-455f-a612-3d15730885d0-util\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06mmw9m\" (UID: \"eab5fd2f-75fb-455f-a612-3d15730885d0\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06mmw9m"
Jun 15 05:57:04.966389 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:57:04.966365    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/eab5fd2f-75fb-455f-a612-3d15730885d0-bundle\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06mmw9m\" (UID: \"eab5fd2f-75fb-455f-a612-3d15730885d0\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06mmw9m"
Jun 15 05:57:04.977893 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:57:04.977863    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7jg98\" (UniqueName: \"kubernetes.io/projected/eab5fd2f-75fb-455f-a612-3d15730885d0-kube-api-access-7jg98\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06mmw9m\" (UID: \"eab5fd2f-75fb-455f-a612-3d15730885d0\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06mmw9m"
Jun 15 05:57:05.062462 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:57:05.062433    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06mmw9m"
Jun 15 05:57:05.205880 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:57:05.205844    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06mmw9m"]
Jun 15 05:57:05.534971 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:57:05.534933    2566 generic.go:356] "Generic (PLEG): container finished" podID="eab5fd2f-75fb-455f-a612-3d15730885d0" containerID="87abced06cd36605e9dab01bd565f7b564c3fa916ab339ea2fb9b472340a90f1" exitCode=0
Jun 15 05:57:05.535193 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:57:05.534979    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06mmw9m" event={"ID":"eab5fd2f-75fb-455f-a612-3d15730885d0","Type":"ContainerDied","Data":"87abced06cd36605e9dab01bd565f7b564c3fa916ab339ea2fb9b472340a90f1"}
Jun 15 05:57:05.535193 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:57:05.535029    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06mmw9m" event={"ID":"eab5fd2f-75fb-455f-a612-3d15730885d0","Type":"ContainerStarted","Data":"42260b5d90a233a1f825899c4da3764b46b8f5f8857499978f4b7ef6cc901903"}
Jun 15 05:57:06.541128 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:57:06.541094    2566 generic.go:356] "Generic (PLEG): container finished" podID="eab5fd2f-75fb-455f-a612-3d15730885d0" containerID="0e48e6e70c7e295b74d7efc49a85cca29ceffa12d0e9d69416c7074600c9ac1b" exitCode=0
Jun 15 05:57:06.541513 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:57:06.541169    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06mmw9m" event={"ID":"eab5fd2f-75fb-455f-a612-3d15730885d0","Type":"ContainerDied","Data":"0e48e6e70c7e295b74d7efc49a85cca29ceffa12d0e9d69416c7074600c9ac1b"}
Jun 15 05:57:07.547797 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:57:07.547761    2566 generic.go:356] "Generic (PLEG): container finished" podID="eab5fd2f-75fb-455f-a612-3d15730885d0" containerID="e55cca1a968e8365b0e3e3243f8c878bcff2c019d72662c43696e62ea59e65f0" exitCode=0
Jun 15 05:57:07.548208 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:57:07.547855    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06mmw9m" event={"ID":"eab5fd2f-75fb-455f-a612-3d15730885d0","Type":"ContainerDied","Data":"e55cca1a968e8365b0e3e3243f8c878bcff2c019d72662c43696e62ea59e65f0"}
Jun 15 05:57:08.678333 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:57:08.678306    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06mmw9m"
Jun 15 05:57:08.795855 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:57:08.795823    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/eab5fd2f-75fb-455f-a612-3d15730885d0-util\") pod \"eab5fd2f-75fb-455f-a612-3d15730885d0\" (UID: \"eab5fd2f-75fb-455f-a612-3d15730885d0\") "
Jun 15 05:57:08.796009 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:57:08.795875    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/eab5fd2f-75fb-455f-a612-3d15730885d0-bundle\") pod \"eab5fd2f-75fb-455f-a612-3d15730885d0\" (UID: \"eab5fd2f-75fb-455f-a612-3d15730885d0\") "
Jun 15 05:57:08.796009 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:57:08.795909    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7jg98\" (UniqueName: \"kubernetes.io/projected/eab5fd2f-75fb-455f-a612-3d15730885d0-kube-api-access-7jg98\") pod \"eab5fd2f-75fb-455f-a612-3d15730885d0\" (UID: \"eab5fd2f-75fb-455f-a612-3d15730885d0\") "
Jun 15 05:57:08.796915 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:57:08.796888    2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/eab5fd2f-75fb-455f-a612-3d15730885d0-bundle" (OuterVolumeSpecName: "bundle") pod "eab5fd2f-75fb-455f-a612-3d15730885d0" (UID: "eab5fd2f-75fb-455f-a612-3d15730885d0"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jun 15 05:57:08.798168 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:57:08.798138    2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/eab5fd2f-75fb-455f-a612-3d15730885d0-kube-api-access-7jg98" (OuterVolumeSpecName: "kube-api-access-7jg98") pod "eab5fd2f-75fb-455f-a612-3d15730885d0" (UID: "eab5fd2f-75fb-455f-a612-3d15730885d0"). InnerVolumeSpecName "kube-api-access-7jg98". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jun 15 05:57:08.801898 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:57:08.801865    2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/eab5fd2f-75fb-455f-a612-3d15730885d0-util" (OuterVolumeSpecName: "util") pod "eab5fd2f-75fb-455f-a612-3d15730885d0" (UID: "eab5fd2f-75fb-455f-a612-3d15730885d0"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jun 15 05:57:08.897423 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:57:08.897361    2566 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/eab5fd2f-75fb-455f-a612-3d15730885d0-util\") on node \"ip-10-0-128-243.ec2.internal\" DevicePath \"\""
Jun 15 05:57:08.897423 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:57:08.897391    2566 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/eab5fd2f-75fb-455f-a612-3d15730885d0-bundle\") on node \"ip-10-0-128-243.ec2.internal\" DevicePath \"\""
Jun 15 05:57:08.897423 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:57:08.897400    2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7jg98\" (UniqueName: \"kubernetes.io/projected/eab5fd2f-75fb-455f-a612-3d15730885d0-kube-api-access-7jg98\") on node \"ip-10-0-128-243.ec2.internal\" DevicePath \"\""
Jun 15 05:57:09.559142 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:57:09.559111    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06mmw9m"
Jun 15 05:57:09.559313 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:57:09.559114    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06mmw9m" event={"ID":"eab5fd2f-75fb-455f-a612-3d15730885d0","Type":"ContainerDied","Data":"42260b5d90a233a1f825899c4da3764b46b8f5f8857499978f4b7ef6cc901903"}
Jun 15 05:57:09.559313 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:57:09.559239    2566 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="42260b5d90a233a1f825899c4da3764b46b8f5f8857499978f4b7ef6cc901903"
Jun 15 05:57:14.495470 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:57:14.495433    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762az498b"]
Jun 15 05:57:14.495850 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:57:14.495743    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="eab5fd2f-75fb-455f-a612-3d15730885d0" containerName="util"
Jun 15 05:57:14.495850 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:57:14.495755    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="eab5fd2f-75fb-455f-a612-3d15730885d0" containerName="util"
Jun 15 05:57:14.495850 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:57:14.495783    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="eab5fd2f-75fb-455f-a612-3d15730885d0" containerName="pull"
Jun 15 05:57:14.495850 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:57:14.495789    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="eab5fd2f-75fb-455f-a612-3d15730885d0" containerName="pull"
Jun 15 05:57:14.495850 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:57:14.495796    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="eab5fd2f-75fb-455f-a612-3d15730885d0" containerName="extract"
Jun 15 05:57:14.495850 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:57:14.495804    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="eab5fd2f-75fb-455f-a612-3d15730885d0" containerName="extract"
Jun 15 05:57:14.496026 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:57:14.495869    2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="eab5fd2f-75fb-455f-a612-3d15730885d0" containerName="extract"
Jun 15 05:57:14.499328 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:57:14.499311    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762az498b"
Jun 15 05:57:14.510999 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:57:14.510976    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Jun 15 05:57:14.510999 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:57:14.510994    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-48sh7\""
Jun 15 05:57:14.513011 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:57:14.512997    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Jun 15 05:57:14.523237 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:57:14.523212    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762az498b"]
Jun 15 05:57:14.643570 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:57:14.643538    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-brjgf\" (UniqueName: \"kubernetes.io/projected/fc3e18ec-f114-485f-9767-bf8b6dbfb190-kube-api-access-brjgf\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762az498b\" (UID: \"fc3e18ec-f114-485f-9767-bf8b6dbfb190\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762az498b"
Jun 15 05:57:14.643732 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:57:14.643586    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/fc3e18ec-f114-485f-9767-bf8b6dbfb190-bundle\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762az498b\" (UID: \"fc3e18ec-f114-485f-9767-bf8b6dbfb190\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762az498b"
Jun 15 05:57:14.643732 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:57:14.643625    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/fc3e18ec-f114-485f-9767-bf8b6dbfb190-util\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762az498b\" (UID: \"fc3e18ec-f114-485f-9767-bf8b6dbfb190\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762az498b"
Jun 15 05:57:14.744540 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:57:14.744501    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/fc3e18ec-f114-485f-9767-bf8b6dbfb190-bundle\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762az498b\" (UID: \"fc3e18ec-f114-485f-9767-bf8b6dbfb190\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762az498b"
Jun 15 05:57:14.744714 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:57:14.744545    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/fc3e18ec-f114-485f-9767-bf8b6dbfb190-util\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762az498b\" (UID: \"fc3e18ec-f114-485f-9767-bf8b6dbfb190\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762az498b"
Jun 15 05:57:14.744714 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:57:14.744601    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-brjgf\" (UniqueName: \"kubernetes.io/projected/fc3e18ec-f114-485f-9767-bf8b6dbfb190-kube-api-access-brjgf\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762az498b\" (UID: \"fc3e18ec-f114-485f-9767-bf8b6dbfb190\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762az498b"
Jun 15 05:57:14.744992 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:57:14.744966    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/fc3e18ec-f114-485f-9767-bf8b6dbfb190-bundle\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762az498b\" (UID: \"fc3e18ec-f114-485f-9767-bf8b6dbfb190\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762az498b"
Jun 15 05:57:14.745031 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:57:14.744972    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/fc3e18ec-f114-485f-9767-bf8b6dbfb190-util\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762az498b\" (UID: \"fc3e18ec-f114-485f-9767-bf8b6dbfb190\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762az498b"
Jun 15 05:57:14.757849 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:57:14.757823    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-brjgf\" (UniqueName: \"kubernetes.io/projected/fc3e18ec-f114-485f-9767-bf8b6dbfb190-kube-api-access-brjgf\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762az498b\" (UID: \"fc3e18ec-f114-485f-9767-bf8b6dbfb190\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762az498b"
Jun 15 05:57:14.807662 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:57:14.807634    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762az498b"
Jun 15 05:57:14.989555 ip-10-0-128-243 kubenswrapper[2566]: W0615 05:57:14.989524    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfc3e18ec_f114_485f_9767_bf8b6dbfb190.slice/crio-8ee2dd6a58d330eb0880180c9a6cf6a223d964db332fbfd14ed626193f0af70c WatchSource:0}: Error finding container 8ee2dd6a58d330eb0880180c9a6cf6a223d964db332fbfd14ed626193f0af70c: Status 404 returned error can't find the container with id 8ee2dd6a58d330eb0880180c9a6cf6a223d964db332fbfd14ed626193f0af70c
Jun 15 05:57:15.002902 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:57:15.002874    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762az498b"]
Jun 15 05:57:15.505688 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:57:15.505661    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-74f47976d9-pw9bq"]
Jun 15 05:57:15.508919 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:57:15.508902    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-74f47976d9-pw9bq"
Jun 15 05:57:15.514193 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:57:15.514168    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\""
Jun 15 05:57:15.514360 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:57:15.514189    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\""
Jun 15 05:57:15.514360 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:57:15.514189    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-4hzvt\""
Jun 15 05:57:15.514506 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:57:15.514486    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\""
Jun 15 05:57:15.522609 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:57:15.522587    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-74f47976d9-pw9bq"]
Jun 15 05:57:15.552214 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:57:15.552191    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/3270b170-9c07-47e3-b8fa-3b8cdbfbcf10-metrics-cert\") pod \"lws-controller-manager-74f47976d9-pw9bq\" (UID: \"3270b170-9c07-47e3-b8fa-3b8cdbfbcf10\") " pod="openshift-lws-operator/lws-controller-manager-74f47976d9-pw9bq"
Jun 15 05:57:15.552324 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:57:15.552233    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/3270b170-9c07-47e3-b8fa-3b8cdbfbcf10-manager-config\") pod \"lws-controller-manager-74f47976d9-pw9bq\" (UID: \"3270b170-9c07-47e3-b8fa-3b8cdbfbcf10\") " pod="openshift-lws-operator/lws-controller-manager-74f47976d9-pw9bq"
Jun 15 05:57:15.552324 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:57:15.552252    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/3270b170-9c07-47e3-b8fa-3b8cdbfbcf10-cert\") pod \"lws-controller-manager-74f47976d9-pw9bq\" (UID: \"3270b170-9c07-47e3-b8fa-3b8cdbfbcf10\") " pod="openshift-lws-operator/lws-controller-manager-74f47976d9-pw9bq"
Jun 15 05:57:15.552324 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:57:15.552270    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cqpxh\" (UniqueName: \"kubernetes.io/projected/3270b170-9c07-47e3-b8fa-3b8cdbfbcf10-kube-api-access-cqpxh\") pod \"lws-controller-manager-74f47976d9-pw9bq\" (UID: \"3270b170-9c07-47e3-b8fa-3b8cdbfbcf10\") " pod="openshift-lws-operator/lws-controller-manager-74f47976d9-pw9bq"
Jun 15 05:57:15.587761 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:57:15.587731    2566 generic.go:356] "Generic (PLEG): container finished" podID="fc3e18ec-f114-485f-9767-bf8b6dbfb190" containerID="8c41ddb3465d097c484538f0a0343d5ab82febfc7f7906de807feb7da103c9e8" exitCode=0
Jun 15 05:57:15.587903 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:57:15.587821    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762az498b" event={"ID":"fc3e18ec-f114-485f-9767-bf8b6dbfb190","Type":"ContainerDied","Data":"8c41ddb3465d097c484538f0a0343d5ab82febfc7f7906de807feb7da103c9e8"}
Jun 15 05:57:15.587903 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:57:15.587881    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762az498b" event={"ID":"fc3e18ec-f114-485f-9767-bf8b6dbfb190","Type":"ContainerStarted","Data":"8ee2dd6a58d330eb0880180c9a6cf6a223d964db332fbfd14ed626193f0af70c"}
Jun 15 05:57:15.652988 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:57:15.652956    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/3270b170-9c07-47e3-b8fa-3b8cdbfbcf10-metrics-cert\") pod \"lws-controller-manager-74f47976d9-pw9bq\" (UID: \"3270b170-9c07-47e3-b8fa-3b8cdbfbcf10\") " pod="openshift-lws-operator/lws-controller-manager-74f47976d9-pw9bq"
Jun 15 05:57:15.653195 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:57:15.653014    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/3270b170-9c07-47e3-b8fa-3b8cdbfbcf10-manager-config\") pod \"lws-controller-manager-74f47976d9-pw9bq\" (UID: \"3270b170-9c07-47e3-b8fa-3b8cdbfbcf10\") " pod="openshift-lws-operator/lws-controller-manager-74f47976d9-pw9bq"
Jun 15 05:57:15.653195 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:57:15.653032    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/3270b170-9c07-47e3-b8fa-3b8cdbfbcf10-cert\") pod \"lws-controller-manager-74f47976d9-pw9bq\" (UID: \"3270b170-9c07-47e3-b8fa-3b8cdbfbcf10\") " pod="openshift-lws-operator/lws-controller-manager-74f47976d9-pw9bq"
Jun 15 05:57:15.653195 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:57:15.653055    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cqpxh\" (UniqueName: \"kubernetes.io/projected/3270b170-9c07-47e3-b8fa-3b8cdbfbcf10-kube-api-access-cqpxh\") pod \"lws-controller-manager-74f47976d9-pw9bq\" (UID: \"3270b170-9c07-47e3-b8fa-3b8cdbfbcf10\") " pod="openshift-lws-operator/lws-controller-manager-74f47976d9-pw9bq"
Jun 15 05:57:15.653771 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:57:15.653704    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/3270b170-9c07-47e3-b8fa-3b8cdbfbcf10-manager-config\") pod \"lws-controller-manager-74f47976d9-pw9bq\" (UID: \"3270b170-9c07-47e3-b8fa-3b8cdbfbcf10\") " pod="openshift-lws-operator/lws-controller-manager-74f47976d9-pw9bq"
Jun 15 05:57:15.655591 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:57:15.655570    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/3270b170-9c07-47e3-b8fa-3b8cdbfbcf10-metrics-cert\") pod \"lws-controller-manager-74f47976d9-pw9bq\" (UID: \"3270b170-9c07-47e3-b8fa-3b8cdbfbcf10\") " pod="openshift-lws-operator/lws-controller-manager-74f47976d9-pw9bq"
Jun 15 05:57:15.655682 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:57:15.655601    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/3270b170-9c07-47e3-b8fa-3b8cdbfbcf10-cert\") pod \"lws-controller-manager-74f47976d9-pw9bq\" (UID: \"3270b170-9c07-47e3-b8fa-3b8cdbfbcf10\") " pod="openshift-lws-operator/lws-controller-manager-74f47976d9-pw9bq"
Jun 15 05:57:15.663604 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:57:15.663578    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cqpxh\" (UniqueName: \"kubernetes.io/projected/3270b170-9c07-47e3-b8fa-3b8cdbfbcf10-kube-api-access-cqpxh\") pod \"lws-controller-manager-74f47976d9-pw9bq\" (UID: \"3270b170-9c07-47e3-b8fa-3b8cdbfbcf10\") " pod="openshift-lws-operator/lws-controller-manager-74f47976d9-pw9bq"
Jun 15 05:57:15.818178 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:57:15.818141    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-74f47976d9-pw9bq"
Jun 15 05:57:15.962178 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:57:15.962151    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-74f47976d9-pw9bq"]
Jun 15 05:57:15.964765 ip-10-0-128-243 kubenswrapper[2566]: W0615 05:57:15.964737    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3270b170_9c07_47e3_b8fa_3b8cdbfbcf10.slice/crio-676f75b6c5fcf56ffb4e26263ada4b0cbd1c977799f633315c125892aa190743 WatchSource:0}: Error finding container 676f75b6c5fcf56ffb4e26263ada4b0cbd1c977799f633315c125892aa190743: Status 404 returned error can't find the container with id 676f75b6c5fcf56ffb4e26263ada4b0cbd1c977799f633315c125892aa190743
Jun 15 05:57:16.593813 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:57:16.593784    2566 generic.go:356] "Generic (PLEG): container finished" podID="fc3e18ec-f114-485f-9767-bf8b6dbfb190" containerID="5fb264628f4746377d05b4809c91a9aa78f213a42a57b1a3408f66b680103ae4" exitCode=0
Jun 15 05:57:16.594284 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:57:16.593862    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762az498b" event={"ID":"fc3e18ec-f114-485f-9767-bf8b6dbfb190","Type":"ContainerDied","Data":"5fb264628f4746377d05b4809c91a9aa78f213a42a57b1a3408f66b680103ae4"}
Jun 15 05:57:16.595219 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:57:16.595195    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-74f47976d9-pw9bq" event={"ID":"3270b170-9c07-47e3-b8fa-3b8cdbfbcf10","Type":"ContainerStarted","Data":"676f75b6c5fcf56ffb4e26263ada4b0cbd1c977799f633315c125892aa190743"}
Jun 15 05:57:17.604727 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:57:17.604693    2566 generic.go:356] "Generic (PLEG): container finished" podID="fc3e18ec-f114-485f-9767-bf8b6dbfb190" containerID="32a7abe800bfd268d20c961354aef7a5401c4ff51a2a0044009a0a6b8ad8b1f3" exitCode=0
Jun 15 05:57:17.605182 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:57:17.604745    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762az498b" event={"ID":"fc3e18ec-f114-485f-9767-bf8b6dbfb190","Type":"ContainerDied","Data":"32a7abe800bfd268d20c961354aef7a5401c4ff51a2a0044009a0a6b8ad8b1f3"}
Jun 15 05:57:18.610389 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:57:18.610352    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-74f47976d9-pw9bq" event={"ID":"3270b170-9c07-47e3-b8fa-3b8cdbfbcf10","Type":"ContainerStarted","Data":"7aefc8fdee69805305a1695dad0e2da7615c10e93c9daaed5ff3aea2ffd881e5"}
Jun 15 05:57:18.610831 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:57:18.610694    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-74f47976d9-pw9bq"
Jun 15 05:57:18.638308 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:57:18.638240    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-74f47976d9-pw9bq" podStartSLOduration=1.204604035 podStartE2EDuration="3.638220541s" totalImagesPullingTime="2.433616506s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-15 05:57:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 05:57:18.636658979 +0000 UTC m=+521.596416250" watchObservedRunningTime="2026-06-15 05:57:18.638220541 +0000 UTC m=+521.597977789"
Jun 15 05:57:18.749290 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:57:18.749262    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762az498b"
Jun 15 05:57:18.782209 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:57:18.782172    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/fc3e18ec-f114-485f-9767-bf8b6dbfb190-util\") pod \"fc3e18ec-f114-485f-9767-bf8b6dbfb190\" (UID: \"fc3e18ec-f114-485f-9767-bf8b6dbfb190\") "
Jun 15 05:57:18.782362 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:57:18.782292    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/fc3e18ec-f114-485f-9767-bf8b6dbfb190-bundle\") pod \"fc3e18ec-f114-485f-9767-bf8b6dbfb190\" (UID: \"fc3e18ec-f114-485f-9767-bf8b6dbfb190\") "
Jun 15 05:57:18.782362 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:57:18.782341    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-brjgf\" (UniqueName: \"kubernetes.io/projected/fc3e18ec-f114-485f-9767-bf8b6dbfb190-kube-api-access-brjgf\") pod \"fc3e18ec-f114-485f-9767-bf8b6dbfb190\" (UID: \"fc3e18ec-f114-485f-9767-bf8b6dbfb190\") "
Jun 15 05:57:18.783406 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:57:18.783364    2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fc3e18ec-f114-485f-9767-bf8b6dbfb190-bundle" (OuterVolumeSpecName: "bundle") pod "fc3e18ec-f114-485f-9767-bf8b6dbfb190" (UID: "fc3e18ec-f114-485f-9767-bf8b6dbfb190"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jun 15 05:57:18.784817 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:57:18.784784    2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fc3e18ec-f114-485f-9767-bf8b6dbfb190-kube-api-access-brjgf" (OuterVolumeSpecName: "kube-api-access-brjgf") pod "fc3e18ec-f114-485f-9767-bf8b6dbfb190" (UID: "fc3e18ec-f114-485f-9767-bf8b6dbfb190"). InnerVolumeSpecName "kube-api-access-brjgf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jun 15 05:57:18.788556 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:57:18.788532    2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fc3e18ec-f114-485f-9767-bf8b6dbfb190-util" (OuterVolumeSpecName: "util") pod "fc3e18ec-f114-485f-9767-bf8b6dbfb190" (UID: "fc3e18ec-f114-485f-9767-bf8b6dbfb190"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jun 15 05:57:18.883701 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:57:18.883647    2566 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/fc3e18ec-f114-485f-9767-bf8b6dbfb190-util\") on node \"ip-10-0-128-243.ec2.internal\" DevicePath \"\""
Jun 15 05:57:18.883701 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:57:18.883694    2566 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/fc3e18ec-f114-485f-9767-bf8b6dbfb190-bundle\") on node \"ip-10-0-128-243.ec2.internal\" DevicePath \"\""
Jun 15 05:57:18.883701 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:57:18.883706    2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-brjgf\" (UniqueName: \"kubernetes.io/projected/fc3e18ec-f114-485f-9767-bf8b6dbfb190-kube-api-access-brjgf\") on node \"ip-10-0-128-243.ec2.internal\" DevicePath \"\""
Jun 15 05:57:19.616592 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:57:19.616564    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762az498b"
Jun 15 05:57:19.616988 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:57:19.616592    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762az498b" event={"ID":"fc3e18ec-f114-485f-9767-bf8b6dbfb190","Type":"ContainerDied","Data":"8ee2dd6a58d330eb0880180c9a6cf6a223d964db332fbfd14ed626193f0af70c"}
Jun 15 05:57:19.616988 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:57:19.616637    2566 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="8ee2dd6a58d330eb0880180c9a6cf6a223d964db332fbfd14ed626193f0af70c"
Jun 15 05:57:29.618805 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:57:29.618722    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-74f47976d9-pw9bq"
Jun 15 05:57:42.381797 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:57:42.381756    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/0e9e3357d40614682d1ebdb402e8ba62e1e258fb473e6f54140aafff3629dgw"]
Jun 15 05:57:42.382208 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:57:42.382153    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fc3e18ec-f114-485f-9767-bf8b6dbfb190" containerName="pull"
Jun 15 05:57:42.382208 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:57:42.382167    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="fc3e18ec-f114-485f-9767-bf8b6dbfb190" containerName="pull"
Jun 15 05:57:42.382208 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:57:42.382177    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fc3e18ec-f114-485f-9767-bf8b6dbfb190" containerName="util"
Jun 15 05:57:42.382208 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:57:42.382182    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="fc3e18ec-f114-485f-9767-bf8b6dbfb190" containerName="util"
Jun 15 05:57:42.382208 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:57:42.382188    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fc3e18ec-f114-485f-9767-bf8b6dbfb190" containerName="extract"
Jun 15 05:57:42.382208 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:57:42.382193    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="fc3e18ec-f114-485f-9767-bf8b6dbfb190" containerName="extract"
Jun 15 05:57:42.382392 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:57:42.382265    2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="fc3e18ec-f114-485f-9767-bf8b6dbfb190" containerName="extract"
Jun 15 05:57:42.384838 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:57:42.384817    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/0e9e3357d40614682d1ebdb402e8ba62e1e258fb473e6f54140aafff3629dgw"
Jun 15 05:57:42.391393 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:57:42.391372    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Jun 15 05:57:42.392026 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:57:42.392011    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Jun 15 05:57:42.392338 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:57:42.392322    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-48sh7\""
Jun 15 05:57:42.404507 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:57:42.404478    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/0e9e3357d40614682d1ebdb402e8ba62e1e258fb473e6f54140aafff3629dgw"]
Jun 15 05:57:42.474405 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:57:42.474378    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4792213b-94b8-44a3-8d1d-3f0d67bc3e32-util\") pod \"0e9e3357d40614682d1ebdb402e8ba62e1e258fb473e6f54140aafff3629dgw\" (UID: \"4792213b-94b8-44a3-8d1d-3f0d67bc3e32\") " pod="openshift-marketplace/0e9e3357d40614682d1ebdb402e8ba62e1e258fb473e6f54140aafff3629dgw"
Jun 15 05:57:42.474523 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:57:42.474417    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4792213b-94b8-44a3-8d1d-3f0d67bc3e32-bundle\") pod \"0e9e3357d40614682d1ebdb402e8ba62e1e258fb473e6f54140aafff3629dgw\" (UID: \"4792213b-94b8-44a3-8d1d-3f0d67bc3e32\") " pod="openshift-marketplace/0e9e3357d40614682d1ebdb402e8ba62e1e258fb473e6f54140aafff3629dgw"
Jun 15 05:57:42.474523 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:57:42.474489    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x4j76\" (UniqueName: \"kubernetes.io/projected/4792213b-94b8-44a3-8d1d-3f0d67bc3e32-kube-api-access-x4j76\") pod \"0e9e3357d40614682d1ebdb402e8ba62e1e258fb473e6f54140aafff3629dgw\" (UID: \"4792213b-94b8-44a3-8d1d-3f0d67bc3e32\") " pod="openshift-marketplace/0e9e3357d40614682d1ebdb402e8ba62e1e258fb473e6f54140aafff3629dgw"
Jun 15 05:57:42.488325 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:57:42.488300    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/bae555bbad109ca402088e3881b25cb56b5908707d8ffbb6cfca172a45hjdxq"]
Jun 15 05:57:42.490395 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:57:42.490382    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/bae555bbad109ca402088e3881b25cb56b5908707d8ffbb6cfca172a45hjdxq"
Jun 15 05:57:42.501957 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:57:42.501928    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/bae555bbad109ca402088e3881b25cb56b5908707d8ffbb6cfca172a45hjdxq"]
Jun 15 05:57:42.569587 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:57:42.569564    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/299160ebe81f164e400242457c5a1580453e7d84fd8087b72a6eb317efnnw7v"]
Jun 15 05:57:42.571838 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:57:42.571825    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/299160ebe81f164e400242457c5a1580453e7d84fd8087b72a6eb317efnnw7v"
Jun 15 05:57:42.575320 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:57:42.575300    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/abb19610-3c38-40f5-beac-4a3bf0b91c60-util\") pod \"bae555bbad109ca402088e3881b25cb56b5908707d8ffbb6cfca172a45hjdxq\" (UID: \"abb19610-3c38-40f5-beac-4a3bf0b91c60\") " pod="openshift-marketplace/bae555bbad109ca402088e3881b25cb56b5908707d8ffbb6cfca172a45hjdxq"
Jun 15 05:57:42.575497 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:57:42.575473    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/abb19610-3c38-40f5-beac-4a3bf0b91c60-bundle\") pod \"bae555bbad109ca402088e3881b25cb56b5908707d8ffbb6cfca172a45hjdxq\" (UID: \"abb19610-3c38-40f5-beac-4a3bf0b91c60\") " pod="openshift-marketplace/bae555bbad109ca402088e3881b25cb56b5908707d8ffbb6cfca172a45hjdxq"
Jun 15 05:57:42.575571 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:57:42.575524    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x4j76\" (UniqueName: \"kubernetes.io/projected/4792213b-94b8-44a3-8d1d-3f0d67bc3e32-kube-api-access-x4j76\") pod \"0e9e3357d40614682d1ebdb402e8ba62e1e258fb473e6f54140aafff3629dgw\" (UID: \"4792213b-94b8-44a3-8d1d-3f0d67bc3e32\") " pod="openshift-marketplace/0e9e3357d40614682d1ebdb402e8ba62e1e258fb473e6f54140aafff3629dgw"
Jun 15 05:57:42.575571 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:57:42.575555    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nbz84\" (UniqueName: \"kubernetes.io/projected/abb19610-3c38-40f5-beac-4a3bf0b91c60-kube-api-access-nbz84\") pod \"bae555bbad109ca402088e3881b25cb56b5908707d8ffbb6cfca172a45hjdxq\" (UID: \"abb19610-3c38-40f5-beac-4a3bf0b91c60\") " pod="openshift-marketplace/bae555bbad109ca402088e3881b25cb56b5908707d8ffbb6cfca172a45hjdxq"
Jun 15 05:57:42.575680 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:57:42.575666    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4792213b-94b8-44a3-8d1d-3f0d67bc3e32-util\") pod \"0e9e3357d40614682d1ebdb402e8ba62e1e258fb473e6f54140aafff3629dgw\" (UID: \"4792213b-94b8-44a3-8d1d-3f0d67bc3e32\") " pod="openshift-marketplace/0e9e3357d40614682d1ebdb402e8ba62e1e258fb473e6f54140aafff3629dgw"
Jun 15 05:57:42.575736 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:57:42.575716    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4792213b-94b8-44a3-8d1d-3f0d67bc3e32-bundle\") pod \"0e9e3357d40614682d1ebdb402e8ba62e1e258fb473e6f54140aafff3629dgw\" (UID: \"4792213b-94b8-44a3-8d1d-3f0d67bc3e32\") " pod="openshift-marketplace/0e9e3357d40614682d1ebdb402e8ba62e1e258fb473e6f54140aafff3629dgw"
Jun 15 05:57:42.575949 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:57:42.575930    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4792213b-94b8-44a3-8d1d-3f0d67bc3e32-util\") pod \"0e9e3357d40614682d1ebdb402e8ba62e1e258fb473e6f54140aafff3629dgw\" (UID: \"4792213b-94b8-44a3-8d1d-3f0d67bc3e32\") " pod="openshift-marketplace/0e9e3357d40614682d1ebdb402e8ba62e1e258fb473e6f54140aafff3629dgw"
Jun 15 05:57:42.576014 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:57:42.575959    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4792213b-94b8-44a3-8d1d-3f0d67bc3e32-bundle\") pod \"0e9e3357d40614682d1ebdb402e8ba62e1e258fb473e6f54140aafff3629dgw\" (UID: \"4792213b-94b8-44a3-8d1d-3f0d67bc3e32\") " pod="openshift-marketplace/0e9e3357d40614682d1ebdb402e8ba62e1e258fb473e6f54140aafff3629dgw"
Jun 15 05:57:42.583316 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:57:42.583293    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/299160ebe81f164e400242457c5a1580453e7d84fd8087b72a6eb317efnnw7v"]
Jun 15 05:57:42.586797 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:57:42.586775    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-x4j76\" (UniqueName: \"kubernetes.io/projected/4792213b-94b8-44a3-8d1d-3f0d67bc3e32-kube-api-access-x4j76\") pod \"0e9e3357d40614682d1ebdb402e8ba62e1e258fb473e6f54140aafff3629dgw\" (UID: \"4792213b-94b8-44a3-8d1d-3f0d67bc3e32\") " pod="openshift-marketplace/0e9e3357d40614682d1ebdb402e8ba62e1e258fb473e6f54140aafff3629dgw"
Jun 15 05:57:42.673311 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:57:42.673251    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/dfb463963134e06ca8af237506332ca9f4291363930963c9e058bbb69c524vb"]
Jun 15 05:57:42.675317 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:57:42.675303    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/dfb463963134e06ca8af237506332ca9f4291363930963c9e058bbb69c524vb"
Jun 15 05:57:42.676308 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:57:42.676289    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s7tzj\" (UniqueName: \"kubernetes.io/projected/557f1e46-65a9-44be-9fca-659d01671f9e-kube-api-access-s7tzj\") pod \"299160ebe81f164e400242457c5a1580453e7d84fd8087b72a6eb317efnnw7v\" (UID: \"557f1e46-65a9-44be-9fca-659d01671f9e\") " pod="openshift-marketplace/299160ebe81f164e400242457c5a1580453e7d84fd8087b72a6eb317efnnw7v"
Jun 15 05:57:42.676372 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:57:42.676323    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/557f1e46-65a9-44be-9fca-659d01671f9e-bundle\") pod \"299160ebe81f164e400242457c5a1580453e7d84fd8087b72a6eb317efnnw7v\" (UID: \"557f1e46-65a9-44be-9fca-659d01671f9e\") " pod="openshift-marketplace/299160ebe81f164e400242457c5a1580453e7d84fd8087b72a6eb317efnnw7v"
Jun 15 05:57:42.676372 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:57:42.676346    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/abb19610-3c38-40f5-beac-4a3bf0b91c60-bundle\") pod \"bae555bbad109ca402088e3881b25cb56b5908707d8ffbb6cfca172a45hjdxq\" (UID: \"abb19610-3c38-40f5-beac-4a3bf0b91c60\") " pod="openshift-marketplace/bae555bbad109ca402088e3881b25cb56b5908707d8ffbb6cfca172a45hjdxq"
Jun 15 05:57:42.676372 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:57:42.676365    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nbz84\" (UniqueName: \"kubernetes.io/projected/abb19610-3c38-40f5-beac-4a3bf0b91c60-kube-api-access-nbz84\") pod \"bae555bbad109ca402088e3881b25cb56b5908707d8ffbb6cfca172a45hjdxq\" (UID: \"abb19610-3c38-40f5-beac-4a3bf0b91c60\") " pod="openshift-marketplace/bae555bbad109ca402088e3881b25cb56b5908707d8ffbb6cfca172a45hjdxq"
Jun 15 05:57:42.676492 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:57:42.676435    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/557f1e46-65a9-44be-9fca-659d01671f9e-util\") pod \"299160ebe81f164e400242457c5a1580453e7d84fd8087b72a6eb317efnnw7v\" (UID: \"557f1e46-65a9-44be-9fca-659d01671f9e\") " pod="openshift-marketplace/299160ebe81f164e400242457c5a1580453e7d84fd8087b72a6eb317efnnw7v"
Jun 15 05:57:42.676544 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:57:42.676522    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/abb19610-3c38-40f5-beac-4a3bf0b91c60-util\") pod \"bae555bbad109ca402088e3881b25cb56b5908707d8ffbb6cfca172a45hjdxq\" (UID: \"abb19610-3c38-40f5-beac-4a3bf0b91c60\") " pod="openshift-marketplace/bae555bbad109ca402088e3881b25cb56b5908707d8ffbb6cfca172a45hjdxq"
Jun 15 05:57:42.677101 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:57:42.677053    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/abb19610-3c38-40f5-beac-4a3bf0b91c60-bundle\") pod \"bae555bbad109ca402088e3881b25cb56b5908707d8ffbb6cfca172a45hjdxq\" (UID: \"abb19610-3c38-40f5-beac-4a3bf0b91c60\") " pod="openshift-marketplace/bae555bbad109ca402088e3881b25cb56b5908707d8ffbb6cfca172a45hjdxq"
Jun 15 05:57:42.677220 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:57:42.677196    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/abb19610-3c38-40f5-beac-4a3bf0b91c60-util\") pod \"bae555bbad109ca402088e3881b25cb56b5908707d8ffbb6cfca172a45hjdxq\" (UID: \"abb19610-3c38-40f5-beac-4a3bf0b91c60\") " pod="openshift-marketplace/bae555bbad109ca402088e3881b25cb56b5908707d8ffbb6cfca172a45hjdxq"
Jun 15 05:57:42.686207 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:57:42.686182    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/dfb463963134e06ca8af237506332ca9f4291363930963c9e058bbb69c524vb"]
Jun 15 05:57:42.688997 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:57:42.688975    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nbz84\" (UniqueName: \"kubernetes.io/projected/abb19610-3c38-40f5-beac-4a3bf0b91c60-kube-api-access-nbz84\") pod \"bae555bbad109ca402088e3881b25cb56b5908707d8ffbb6cfca172a45hjdxq\" (UID: \"abb19610-3c38-40f5-beac-4a3bf0b91c60\") " pod="openshift-marketplace/bae555bbad109ca402088e3881b25cb56b5908707d8ffbb6cfca172a45hjdxq"
Jun 15 05:57:42.693294 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:57:42.693278    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/0e9e3357d40614682d1ebdb402e8ba62e1e258fb473e6f54140aafff3629dgw"
Jun 15 05:57:42.777712 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:57:42.777673    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0bcc4d9b-acd0-4e12-886f-42660f3f762b-bundle\") pod \"dfb463963134e06ca8af237506332ca9f4291363930963c9e058bbb69c524vb\" (UID: \"0bcc4d9b-acd0-4e12-886f-42660f3f762b\") " pod="openshift-marketplace/dfb463963134e06ca8af237506332ca9f4291363930963c9e058bbb69c524vb"
Jun 15 05:57:42.777857 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:57:42.777721    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/557f1e46-65a9-44be-9fca-659d01671f9e-util\") pod \"299160ebe81f164e400242457c5a1580453e7d84fd8087b72a6eb317efnnw7v\" (UID: \"557f1e46-65a9-44be-9fca-659d01671f9e\") " pod="openshift-marketplace/299160ebe81f164e400242457c5a1580453e7d84fd8087b72a6eb317efnnw7v"
Jun 15 05:57:42.777857 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:57:42.777756    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mwshk\" (UniqueName: \"kubernetes.io/projected/0bcc4d9b-acd0-4e12-886f-42660f3f762b-kube-api-access-mwshk\") pod \"dfb463963134e06ca8af237506332ca9f4291363930963c9e058bbb69c524vb\" (UID: \"0bcc4d9b-acd0-4e12-886f-42660f3f762b\") " pod="openshift-marketplace/dfb463963134e06ca8af237506332ca9f4291363930963c9e058bbb69c524vb"
Jun 15 05:57:42.777857 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:57:42.777821    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0bcc4d9b-acd0-4e12-886f-42660f3f762b-util\") pod \"dfb463963134e06ca8af237506332ca9f4291363930963c9e058bbb69c524vb\" (UID: \"0bcc4d9b-acd0-4e12-886f-42660f3f762b\") " pod="openshift-marketplace/dfb463963134e06ca8af237506332ca9f4291363930963c9e058bbb69c524vb"
Jun 15 05:57:42.778041 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:57:42.777872    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s7tzj\" (UniqueName: \"kubernetes.io/projected/557f1e46-65a9-44be-9fca-659d01671f9e-kube-api-access-s7tzj\") pod \"299160ebe81f164e400242457c5a1580453e7d84fd8087b72a6eb317efnnw7v\" (UID: \"557f1e46-65a9-44be-9fca-659d01671f9e\") " pod="openshift-marketplace/299160ebe81f164e400242457c5a1580453e7d84fd8087b72a6eb317efnnw7v"
Jun 15 05:57:42.778041 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:57:42.777997    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/557f1e46-65a9-44be-9fca-659d01671f9e-bundle\") pod \"299160ebe81f164e400242457c5a1580453e7d84fd8087b72a6eb317efnnw7v\" (UID: \"557f1e46-65a9-44be-9fca-659d01671f9e\") " pod="openshift-marketplace/299160ebe81f164e400242457c5a1580453e7d84fd8087b72a6eb317efnnw7v"
Jun 15 05:57:42.778193 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:57:42.778169    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/557f1e46-65a9-44be-9fca-659d01671f9e-util\") pod \"299160ebe81f164e400242457c5a1580453e7d84fd8087b72a6eb317efnnw7v\" (UID: \"557f1e46-65a9-44be-9fca-659d01671f9e\") " pod="openshift-marketplace/299160ebe81f164e400242457c5a1580453e7d84fd8087b72a6eb317efnnw7v"
Jun 15 05:57:42.778381 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:57:42.778359    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/557f1e46-65a9-44be-9fca-659d01671f9e-bundle\") pod \"299160ebe81f164e400242457c5a1580453e7d84fd8087b72a6eb317efnnw7v\" (UID: \"557f1e46-65a9-44be-9fca-659d01671f9e\") " pod="openshift-marketplace/299160ebe81f164e400242457c5a1580453e7d84fd8087b72a6eb317efnnw7v"
Jun 15 05:57:42.788368 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:57:42.788343    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-s7tzj\" (UniqueName: \"kubernetes.io/projected/557f1e46-65a9-44be-9fca-659d01671f9e-kube-api-access-s7tzj\") pod \"299160ebe81f164e400242457c5a1580453e7d84fd8087b72a6eb317efnnw7v\" (UID: \"557f1e46-65a9-44be-9fca-659d01671f9e\") " pod="openshift-marketplace/299160ebe81f164e400242457c5a1580453e7d84fd8087b72a6eb317efnnw7v"
Jun 15 05:57:42.799189 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:57:42.799167    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/bae555bbad109ca402088e3881b25cb56b5908707d8ffbb6cfca172a45hjdxq"
Jun 15 05:57:42.827861 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:57:42.827833    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/0e9e3357d40614682d1ebdb402e8ba62e1e258fb473e6f54140aafff3629dgw"]
Jun 15 05:57:42.828974 ip-10-0-128-243 kubenswrapper[2566]: W0615 05:57:42.828947    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4792213b_94b8_44a3_8d1d_3f0d67bc3e32.slice/crio-8912d7a0bc5be7d27ce30758b1e323cb3d12ec9b23bc6aa596d396edc5256d54 WatchSource:0}: Error finding container 8912d7a0bc5be7d27ce30758b1e323cb3d12ec9b23bc6aa596d396edc5256d54: Status 404 returned error can't find the container with id 8912d7a0bc5be7d27ce30758b1e323cb3d12ec9b23bc6aa596d396edc5256d54
Jun 15 05:57:42.878999 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:57:42.878876    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mwshk\" (UniqueName: \"kubernetes.io/projected/0bcc4d9b-acd0-4e12-886f-42660f3f762b-kube-api-access-mwshk\") pod \"dfb463963134e06ca8af237506332ca9f4291363930963c9e058bbb69c524vb\" (UID: \"0bcc4d9b-acd0-4e12-886f-42660f3f762b\") " pod="openshift-marketplace/dfb463963134e06ca8af237506332ca9f4291363930963c9e058bbb69c524vb"
Jun 15 05:57:42.878999 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:57:42.878949    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0bcc4d9b-acd0-4e12-886f-42660f3f762b-util\") pod \"dfb463963134e06ca8af237506332ca9f4291363930963c9e058bbb69c524vb\" (UID: \"0bcc4d9b-acd0-4e12-886f-42660f3f762b\") " pod="openshift-marketplace/dfb463963134e06ca8af237506332ca9f4291363930963c9e058bbb69c524vb"
Jun 15 05:57:42.879125 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:57:42.879032    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0bcc4d9b-acd0-4e12-886f-42660f3f762b-bundle\") pod \"dfb463963134e06ca8af237506332ca9f4291363930963c9e058bbb69c524vb\" (UID: \"0bcc4d9b-acd0-4e12-886f-42660f3f762b\") " pod="openshift-marketplace/dfb463963134e06ca8af237506332ca9f4291363930963c9e058bbb69c524vb"
Jun 15 05:57:42.879374 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:57:42.879348    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0bcc4d9b-acd0-4e12-886f-42660f3f762b-util\") pod \"dfb463963134e06ca8af237506332ca9f4291363930963c9e058bbb69c524vb\" (UID: \"0bcc4d9b-acd0-4e12-886f-42660f3f762b\") " pod="openshift-marketplace/dfb463963134e06ca8af237506332ca9f4291363930963c9e058bbb69c524vb"
Jun 15 05:57:42.879474 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:57:42.879385    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0bcc4d9b-acd0-4e12-886f-42660f3f762b-bundle\") pod \"dfb463963134e06ca8af237506332ca9f4291363930963c9e058bbb69c524vb\" (UID: \"0bcc4d9b-acd0-4e12-886f-42660f3f762b\") " pod="openshift-marketplace/dfb463963134e06ca8af237506332ca9f4291363930963c9e058bbb69c524vb"
Jun 15 05:57:42.880550 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:57:42.880527    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/299160ebe81f164e400242457c5a1580453e7d84fd8087b72a6eb317efnnw7v"
Jun 15 05:57:42.891648 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:57:42.891619    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mwshk\" (UniqueName: \"kubernetes.io/projected/0bcc4d9b-acd0-4e12-886f-42660f3f762b-kube-api-access-mwshk\") pod \"dfb463963134e06ca8af237506332ca9f4291363930963c9e058bbb69c524vb\" (UID: \"0bcc4d9b-acd0-4e12-886f-42660f3f762b\") " pod="openshift-marketplace/dfb463963134e06ca8af237506332ca9f4291363930963c9e058bbb69c524vb"
Jun 15 05:57:42.953392 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:57:42.953362    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/bae555bbad109ca402088e3881b25cb56b5908707d8ffbb6cfca172a45hjdxq"]
Jun 15 05:57:42.972276 ip-10-0-128-243 kubenswrapper[2566]: W0615 05:57:42.972242    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podabb19610_3c38_40f5_beac_4a3bf0b91c60.slice/crio-e4ae799306b96fd19a2d1428c926b1a20972478918d365b0b461996ef805f37b WatchSource:0}: Error finding container e4ae799306b96fd19a2d1428c926b1a20972478918d365b0b461996ef805f37b: Status 404 returned error can't find the container with id e4ae799306b96fd19a2d1428c926b1a20972478918d365b0b461996ef805f37b
Jun 15 05:57:42.987491 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:57:42.987470    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/dfb463963134e06ca8af237506332ca9f4291363930963c9e058bbb69c524vb"
Jun 15 05:57:43.024294 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:57:43.024273    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/299160ebe81f164e400242457c5a1580453e7d84fd8087b72a6eb317efnnw7v"]
Jun 15 05:57:43.025988 ip-10-0-128-243 kubenswrapper[2566]: W0615 05:57:43.025965    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod557f1e46_65a9_44be_9fca_659d01671f9e.slice/crio-5dfc6a66e5d19bbf632456bb62d700d243b080fda09e98ca951b516ff0b7502a WatchSource:0}: Error finding container 5dfc6a66e5d19bbf632456bb62d700d243b080fda09e98ca951b516ff0b7502a: Status 404 returned error can't find the container with id 5dfc6a66e5d19bbf632456bb62d700d243b080fda09e98ca951b516ff0b7502a
Jun 15 05:57:43.140565 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:57:43.140531    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/dfb463963134e06ca8af237506332ca9f4291363930963c9e058bbb69c524vb"]
Jun 15 05:57:43.183912 ip-10-0-128-243 kubenswrapper[2566]: W0615 05:57:43.183853    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0bcc4d9b_acd0_4e12_886f_42660f3f762b.slice/crio-488bf02756a8a3c41f67cf595c70a321edc162e06913e002ea4eebb8f9bc16b4 WatchSource:0}: Error finding container 488bf02756a8a3c41f67cf595c70a321edc162e06913e002ea4eebb8f9bc16b4: Status 404 returned error can't find the container with id 488bf02756a8a3c41f67cf595c70a321edc162e06913e002ea4eebb8f9bc16b4
Jun 15 05:57:43.728867 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:57:43.728832    2566 generic.go:356] "Generic (PLEG): container finished" podID="557f1e46-65a9-44be-9fca-659d01671f9e" containerID="80f3c08c9cbdc4c4423c1c7c8d6bcbf9654e1ee6e880e2be10eb3b4ab8e32955" exitCode=0
Jun 15 05:57:43.729386 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:57:43.728917    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/299160ebe81f164e400242457c5a1580453e7d84fd8087b72a6eb317efnnw7v" event={"ID":"557f1e46-65a9-44be-9fca-659d01671f9e","Type":"ContainerDied","Data":"80f3c08c9cbdc4c4423c1c7c8d6bcbf9654e1ee6e880e2be10eb3b4ab8e32955"}
Jun 15 05:57:43.729386 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:57:43.728983    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/299160ebe81f164e400242457c5a1580453e7d84fd8087b72a6eb317efnnw7v" event={"ID":"557f1e46-65a9-44be-9fca-659d01671f9e","Type":"ContainerStarted","Data":"5dfc6a66e5d19bbf632456bb62d700d243b080fda09e98ca951b516ff0b7502a"}
Jun 15 05:57:43.730599 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:57:43.730576    2566 generic.go:356] "Generic (PLEG): container finished" podID="abb19610-3c38-40f5-beac-4a3bf0b91c60" containerID="a465cb8310490a74809870cd8c668ae7b015c0664fa946950237f7c25a71880b" exitCode=0
Jun 15 05:57:43.730689 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:57:43.730667    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/bae555bbad109ca402088e3881b25cb56b5908707d8ffbb6cfca172a45hjdxq" event={"ID":"abb19610-3c38-40f5-beac-4a3bf0b91c60","Type":"ContainerDied","Data":"a465cb8310490a74809870cd8c668ae7b015c0664fa946950237f7c25a71880b"}
Jun 15 05:57:43.730756 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:57:43.730719    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/bae555bbad109ca402088e3881b25cb56b5908707d8ffbb6cfca172a45hjdxq" event={"ID":"abb19610-3c38-40f5-beac-4a3bf0b91c60","Type":"ContainerStarted","Data":"e4ae799306b96fd19a2d1428c926b1a20972478918d365b0b461996ef805f37b"}
Jun 15 05:57:43.732169 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:57:43.732151    2566 generic.go:356] "Generic (PLEG): container finished" podID="0bcc4d9b-acd0-4e12-886f-42660f3f762b" containerID="0df7eeec710300b645a5c7a680084fde32957562243f28d83854a2d828273d11" exitCode=0
Jun 15 05:57:43.732229 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:57:43.732213    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/dfb463963134e06ca8af237506332ca9f4291363930963c9e058bbb69c524vb" event={"ID":"0bcc4d9b-acd0-4e12-886f-42660f3f762b","Type":"ContainerDied","Data":"0df7eeec710300b645a5c7a680084fde32957562243f28d83854a2d828273d11"}
Jun 15 05:57:43.732278 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:57:43.732247    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/dfb463963134e06ca8af237506332ca9f4291363930963c9e058bbb69c524vb" event={"ID":"0bcc4d9b-acd0-4e12-886f-42660f3f762b","Type":"ContainerStarted","Data":"488bf02756a8a3c41f67cf595c70a321edc162e06913e002ea4eebb8f9bc16b4"}
Jun 15 05:57:43.733763 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:57:43.733739    2566 generic.go:356] "Generic (PLEG): container finished" podID="4792213b-94b8-44a3-8d1d-3f0d67bc3e32" containerID="018f3fce0cc84d4e0485eb6882be665ed4146b60f7aa67e92608be544394ae72" exitCode=0
Jun 15 05:57:43.733838 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:57:43.733785    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/0e9e3357d40614682d1ebdb402e8ba62e1e258fb473e6f54140aafff3629dgw" event={"ID":"4792213b-94b8-44a3-8d1d-3f0d67bc3e32","Type":"ContainerDied","Data":"018f3fce0cc84d4e0485eb6882be665ed4146b60f7aa67e92608be544394ae72"}
Jun 15 05:57:43.733838 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:57:43.733819    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/0e9e3357d40614682d1ebdb402e8ba62e1e258fb473e6f54140aafff3629dgw" event={"ID":"4792213b-94b8-44a3-8d1d-3f0d67bc3e32","Type":"ContainerStarted","Data":"8912d7a0bc5be7d27ce30758b1e323cb3d12ec9b23bc6aa596d396edc5256d54"}
Jun 15 05:57:44.740481 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:57:44.740452    2566 generic.go:356] "Generic (PLEG): container finished" podID="0bcc4d9b-acd0-4e12-886f-42660f3f762b" containerID="d6e4c26d6924001f6d843b5836273818fa140d366b39e0d01aad9a1b7fcf7a79" exitCode=0
Jun 15 05:57:44.740800 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:57:44.740533    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/dfb463963134e06ca8af237506332ca9f4291363930963c9e058bbb69c524vb" event={"ID":"0bcc4d9b-acd0-4e12-886f-42660f3f762b","Type":"ContainerDied","Data":"d6e4c26d6924001f6d843b5836273818fa140d366b39e0d01aad9a1b7fcf7a79"}
Jun 15 05:57:44.742429 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:57:44.742408    2566 generic.go:356] "Generic (PLEG): container finished" podID="4792213b-94b8-44a3-8d1d-3f0d67bc3e32" containerID="0a0ce7c2c620cda492872bf9c1aad617a6e37f0448937c8e4152ccd39dcff8ac" exitCode=0
Jun 15 05:57:44.742515 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:57:44.742486    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/0e9e3357d40614682d1ebdb402e8ba62e1e258fb473e6f54140aafff3629dgw" event={"ID":"4792213b-94b8-44a3-8d1d-3f0d67bc3e32","Type":"ContainerDied","Data":"0a0ce7c2c620cda492872bf9c1aad617a6e37f0448937c8e4152ccd39dcff8ac"}
Jun 15 05:57:44.744621 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:57:44.744598    2566 generic.go:356] "Generic (PLEG): container finished" podID="557f1e46-65a9-44be-9fca-659d01671f9e" containerID="0d2bd3d23eeeb8dee05f626e9701b4f022323c3ecc3d125525744f12737916ce" exitCode=0
Jun 15 05:57:44.744692 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:57:44.744671    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/299160ebe81f164e400242457c5a1580453e7d84fd8087b72a6eb317efnnw7v" event={"ID":"557f1e46-65a9-44be-9fca-659d01671f9e","Type":"ContainerDied","Data":"0d2bd3d23eeeb8dee05f626e9701b4f022323c3ecc3d125525744f12737916ce"}
Jun 15 05:57:45.751217 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:57:45.751183    2566 generic.go:356] "Generic (PLEG): container finished" podID="abb19610-3c38-40f5-beac-4a3bf0b91c60" containerID="cf2edf04789eb1baf82ca2c1b1dbe53452553edb3bf0bf0bd0d8c83d20637316" exitCode=0
Jun 15 05:57:45.751662 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:57:45.751275    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/bae555bbad109ca402088e3881b25cb56b5908707d8ffbb6cfca172a45hjdxq" event={"ID":"abb19610-3c38-40f5-beac-4a3bf0b91c60","Type":"ContainerDied","Data":"cf2edf04789eb1baf82ca2c1b1dbe53452553edb3bf0bf0bd0d8c83d20637316"}
Jun 15 05:57:45.753602 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:57:45.753583    2566 generic.go:356] "Generic (PLEG): container finished" podID="0bcc4d9b-acd0-4e12-886f-42660f3f762b" containerID="42176808562f5b17f2f91d1e7a07757b4fb9a483feef5f6b035dea3fc2978fc2" exitCode=0
Jun 15 05:57:45.753705 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:57:45.753648    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/dfb463963134e06ca8af237506332ca9f4291363930963c9e058bbb69c524vb" event={"ID":"0bcc4d9b-acd0-4e12-886f-42660f3f762b","Type":"ContainerDied","Data":"42176808562f5b17f2f91d1e7a07757b4fb9a483feef5f6b035dea3fc2978fc2"}
Jun 15 05:57:45.755756 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:57:45.755724    2566 generic.go:356] "Generic (PLEG): container finished" podID="4792213b-94b8-44a3-8d1d-3f0d67bc3e32" containerID="217bd8a36f2355c5ebae9499ecf6168db20b95b4dcd443d99bd2ef367593f7be" exitCode=0
Jun 15 05:57:45.755857 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:57:45.755800    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/0e9e3357d40614682d1ebdb402e8ba62e1e258fb473e6f54140aafff3629dgw" event={"ID":"4792213b-94b8-44a3-8d1d-3f0d67bc3e32","Type":"ContainerDied","Data":"217bd8a36f2355c5ebae9499ecf6168db20b95b4dcd443d99bd2ef367593f7be"}
Jun 15 05:57:45.757798 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:57:45.757779    2566 generic.go:356] "Generic (PLEG): container finished" podID="557f1e46-65a9-44be-9fca-659d01671f9e" containerID="8690fdce56d8beed71d8e55213e282cfc2f7bfd80c0a9dddb0e303bff0932216" exitCode=0
Jun 15 05:57:45.757877 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:57:45.757834    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/299160ebe81f164e400242457c5a1580453e7d84fd8087b72a6eb317efnnw7v" event={"ID":"557f1e46-65a9-44be-9fca-659d01671f9e","Type":"ContainerDied","Data":"8690fdce56d8beed71d8e55213e282cfc2f7bfd80c0a9dddb0e303bff0932216"}
Jun 15 05:57:46.766244 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:57:46.766213    2566 generic.go:356] "Generic (PLEG): container finished" podID="abb19610-3c38-40f5-beac-4a3bf0b91c60" containerID="6f7f4a6a89b757b51c4fab42774ed97b34e578e31a6f00e1e6dcb24957e859ae" exitCode=0
Jun 15 05:57:46.766683 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:57:46.766345    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/bae555bbad109ca402088e3881b25cb56b5908707d8ffbb6cfca172a45hjdxq" event={"ID":"abb19610-3c38-40f5-beac-4a3bf0b91c60","Type":"ContainerDied","Data":"6f7f4a6a89b757b51c4fab42774ed97b34e578e31a6f00e1e6dcb24957e859ae"}
Jun 15 05:57:46.920568 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:57:46.920536    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/299160ebe81f164e400242457c5a1580453e7d84fd8087b72a6eb317efnnw7v"
Jun 15 05:57:46.950452 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:57:46.950427    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/0e9e3357d40614682d1ebdb402e8ba62e1e258fb473e6f54140aafff3629dgw"
Jun 15 05:57:46.953665 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:57:46.953645    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/dfb463963134e06ca8af237506332ca9f4291363930963c9e058bbb69c524vb"
Jun 15 05:57:47.014374 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:57:47.014341    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/557f1e46-65a9-44be-9fca-659d01671f9e-util\") pod \"557f1e46-65a9-44be-9fca-659d01671f9e\" (UID: \"557f1e46-65a9-44be-9fca-659d01671f9e\") "
Jun 15 05:57:47.014537 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:57:47.014386    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-s7tzj\" (UniqueName: \"kubernetes.io/projected/557f1e46-65a9-44be-9fca-659d01671f9e-kube-api-access-s7tzj\") pod \"557f1e46-65a9-44be-9fca-659d01671f9e\" (UID: \"557f1e46-65a9-44be-9fca-659d01671f9e\") "
Jun 15 05:57:47.014537 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:57:47.014415    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/557f1e46-65a9-44be-9fca-659d01671f9e-bundle\") pod \"557f1e46-65a9-44be-9fca-659d01671f9e\" (UID: \"557f1e46-65a9-44be-9fca-659d01671f9e\") "
Jun 15 05:57:47.014537 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:57:47.014438    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4792213b-94b8-44a3-8d1d-3f0d67bc3e32-util\") pod \"4792213b-94b8-44a3-8d1d-3f0d67bc3e32\" (UID: \"4792213b-94b8-44a3-8d1d-3f0d67bc3e32\") "
Jun 15 05:57:47.014537 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:57:47.014480    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mwshk\" (UniqueName: \"kubernetes.io/projected/0bcc4d9b-acd0-4e12-886f-42660f3f762b-kube-api-access-mwshk\") pod \"0bcc4d9b-acd0-4e12-886f-42660f3f762b\" (UID: \"0bcc4d9b-acd0-4e12-886f-42660f3f762b\") "
Jun 15 05:57:47.014537 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:57:47.014533    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0bcc4d9b-acd0-4e12-886f-42660f3f762b-bundle\") pod \"0bcc4d9b-acd0-4e12-886f-42660f3f762b\" (UID: \"0bcc4d9b-acd0-4e12-886f-42660f3f762b\") "
Jun 15 05:57:47.014781 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:57:47.014560    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4792213b-94b8-44a3-8d1d-3f0d67bc3e32-bundle\") pod \"4792213b-94b8-44a3-8d1d-3f0d67bc3e32\" (UID: \"4792213b-94b8-44a3-8d1d-3f0d67bc3e32\") "
Jun 15 05:57:47.014781 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:57:47.014626    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0bcc4d9b-acd0-4e12-886f-42660f3f762b-util\") pod \"0bcc4d9b-acd0-4e12-886f-42660f3f762b\" (UID: \"0bcc4d9b-acd0-4e12-886f-42660f3f762b\") "
Jun 15 05:57:47.014781 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:57:47.014656    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-x4j76\" (UniqueName: \"kubernetes.io/projected/4792213b-94b8-44a3-8d1d-3f0d67bc3e32-kube-api-access-x4j76\") pod \"4792213b-94b8-44a3-8d1d-3f0d67bc3e32\" (UID: \"4792213b-94b8-44a3-8d1d-3f0d67bc3e32\") "
Jun 15 05:57:47.015896 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:57:47.014956    2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/557f1e46-65a9-44be-9fca-659d01671f9e-bundle" (OuterVolumeSpecName: "bundle") pod "557f1e46-65a9-44be-9fca-659d01671f9e" (UID: "557f1e46-65a9-44be-9fca-659d01671f9e"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jun 15 05:57:47.015896 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:57:47.015525    2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0bcc4d9b-acd0-4e12-886f-42660f3f762b-bundle" (OuterVolumeSpecName: "bundle") pod "0bcc4d9b-acd0-4e12-886f-42660f3f762b" (UID: "0bcc4d9b-acd0-4e12-886f-42660f3f762b"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jun 15 05:57:47.015896 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:57:47.015591    2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4792213b-94b8-44a3-8d1d-3f0d67bc3e32-bundle" (OuterVolumeSpecName: "bundle") pod "4792213b-94b8-44a3-8d1d-3f0d67bc3e32" (UID: "4792213b-94b8-44a3-8d1d-3f0d67bc3e32"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jun 15 05:57:47.017301 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:57:47.017236    2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/557f1e46-65a9-44be-9fca-659d01671f9e-kube-api-access-s7tzj" (OuterVolumeSpecName: "kube-api-access-s7tzj") pod "557f1e46-65a9-44be-9fca-659d01671f9e" (UID: "557f1e46-65a9-44be-9fca-659d01671f9e"). InnerVolumeSpecName "kube-api-access-s7tzj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jun 15 05:57:47.017301 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:57:47.017239    2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0bcc4d9b-acd0-4e12-886f-42660f3f762b-kube-api-access-mwshk" (OuterVolumeSpecName: "kube-api-access-mwshk") pod "0bcc4d9b-acd0-4e12-886f-42660f3f762b" (UID: "0bcc4d9b-acd0-4e12-886f-42660f3f762b"). InnerVolumeSpecName "kube-api-access-mwshk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jun 15 05:57:47.017425 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:57:47.017381    2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4792213b-94b8-44a3-8d1d-3f0d67bc3e32-kube-api-access-x4j76" (OuterVolumeSpecName: "kube-api-access-x4j76") pod "4792213b-94b8-44a3-8d1d-3f0d67bc3e32" (UID: "4792213b-94b8-44a3-8d1d-3f0d67bc3e32"). InnerVolumeSpecName "kube-api-access-x4j76". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jun 15 05:57:47.021914 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:57:47.021888    2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0bcc4d9b-acd0-4e12-886f-42660f3f762b-util" (OuterVolumeSpecName: "util") pod "0bcc4d9b-acd0-4e12-886f-42660f3f762b" (UID: "0bcc4d9b-acd0-4e12-886f-42660f3f762b"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jun 15 05:57:47.023540 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:57:47.023500    2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4792213b-94b8-44a3-8d1d-3f0d67bc3e32-util" (OuterVolumeSpecName: "util") pod "4792213b-94b8-44a3-8d1d-3f0d67bc3e32" (UID: "4792213b-94b8-44a3-8d1d-3f0d67bc3e32"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jun 15 05:57:47.023674 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:57:47.023657    2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/557f1e46-65a9-44be-9fca-659d01671f9e-util" (OuterVolumeSpecName: "util") pod "557f1e46-65a9-44be-9fca-659d01671f9e" (UID: "557f1e46-65a9-44be-9fca-659d01671f9e"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jun 15 05:57:47.115899 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:57:47.115873    2566 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0bcc4d9b-acd0-4e12-886f-42660f3f762b-bundle\") on node \"ip-10-0-128-243.ec2.internal\" DevicePath \"\""
Jun 15 05:57:47.115899 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:57:47.115895    2566 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4792213b-94b8-44a3-8d1d-3f0d67bc3e32-bundle\") on node \"ip-10-0-128-243.ec2.internal\" DevicePath \"\""
Jun 15 05:57:47.116032 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:57:47.115904    2566 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0bcc4d9b-acd0-4e12-886f-42660f3f762b-util\") on node \"ip-10-0-128-243.ec2.internal\" DevicePath \"\""
Jun 15 05:57:47.116032 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:57:47.115912    2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-x4j76\" (UniqueName: \"kubernetes.io/projected/4792213b-94b8-44a3-8d1d-3f0d67bc3e32-kube-api-access-x4j76\") on node \"ip-10-0-128-243.ec2.internal\" DevicePath \"\""
Jun 15 05:57:47.116032 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:57:47.115921    2566 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/557f1e46-65a9-44be-9fca-659d01671f9e-util\") on node \"ip-10-0-128-243.ec2.internal\" DevicePath \"\""
Jun 15 05:57:47.116032 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:57:47.115929    2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-s7tzj\" (UniqueName: \"kubernetes.io/projected/557f1e46-65a9-44be-9fca-659d01671f9e-kube-api-access-s7tzj\") on node \"ip-10-0-128-243.ec2.internal\" DevicePath \"\""
Jun 15 05:57:47.116032 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:57:47.115936    2566 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/557f1e46-65a9-44be-9fca-659d01671f9e-bundle\") on node \"ip-10-0-128-243.ec2.internal\" DevicePath \"\""
Jun 15 05:57:47.116032 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:57:47.115945    2566 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4792213b-94b8-44a3-8d1d-3f0d67bc3e32-util\") on node \"ip-10-0-128-243.ec2.internal\" DevicePath \"\""
Jun 15 05:57:47.116032 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:57:47.115952    2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mwshk\" (UniqueName: \"kubernetes.io/projected/0bcc4d9b-acd0-4e12-886f-42660f3f762b-kube-api-access-mwshk\") on node \"ip-10-0-128-243.ec2.internal\" DevicePath \"\""
Jun 15 05:57:47.778617 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:57:47.778576    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/dfb463963134e06ca8af237506332ca9f4291363930963c9e058bbb69c524vb" event={"ID":"0bcc4d9b-acd0-4e12-886f-42660f3f762b","Type":"ContainerDied","Data":"488bf02756a8a3c41f67cf595c70a321edc162e06913e002ea4eebb8f9bc16b4"}
Jun 15 05:57:47.779041 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:57:47.778659    2566 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="488bf02756a8a3c41f67cf595c70a321edc162e06913e002ea4eebb8f9bc16b4"
Jun 15 05:57:47.779041 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:57:47.778597    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/dfb463963134e06ca8af237506332ca9f4291363930963c9e058bbb69c524vb"
Jun 15 05:57:47.780587 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:57:47.780558    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/0e9e3357d40614682d1ebdb402e8ba62e1e258fb473e6f54140aafff3629dgw" event={"ID":"4792213b-94b8-44a3-8d1d-3f0d67bc3e32","Type":"ContainerDied","Data":"8912d7a0bc5be7d27ce30758b1e323cb3d12ec9b23bc6aa596d396edc5256d54"}
Jun 15 05:57:47.780703 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:57:47.780605    2566 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="8912d7a0bc5be7d27ce30758b1e323cb3d12ec9b23bc6aa596d396edc5256d54"
Jun 15 05:57:47.780703 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:57:47.780572    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/0e9e3357d40614682d1ebdb402e8ba62e1e258fb473e6f54140aafff3629dgw"
Jun 15 05:57:47.782862 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:57:47.782839    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/299160ebe81f164e400242457c5a1580453e7d84fd8087b72a6eb317efnnw7v"
Jun 15 05:57:47.782979 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:57:47.782859    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/299160ebe81f164e400242457c5a1580453e7d84fd8087b72a6eb317efnnw7v" event={"ID":"557f1e46-65a9-44be-9fca-659d01671f9e","Type":"ContainerDied","Data":"5dfc6a66e5d19bbf632456bb62d700d243b080fda09e98ca951b516ff0b7502a"}
Jun 15 05:57:47.782979 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:57:47.782910    2566 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="5dfc6a66e5d19bbf632456bb62d700d243b080fda09e98ca951b516ff0b7502a"
Jun 15 05:57:47.899180 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:57:47.899144    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/bae555bbad109ca402088e3881b25cb56b5908707d8ffbb6cfca172a45hjdxq"
Jun 15 05:57:48.023609 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:57:48.023582    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nbz84\" (UniqueName: \"kubernetes.io/projected/abb19610-3c38-40f5-beac-4a3bf0b91c60-kube-api-access-nbz84\") pod \"abb19610-3c38-40f5-beac-4a3bf0b91c60\" (UID: \"abb19610-3c38-40f5-beac-4a3bf0b91c60\") "
Jun 15 05:57:48.023779 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:57:48.023625    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/abb19610-3c38-40f5-beac-4a3bf0b91c60-bundle\") pod \"abb19610-3c38-40f5-beac-4a3bf0b91c60\" (UID: \"abb19610-3c38-40f5-beac-4a3bf0b91c60\") "
Jun 15 05:57:48.023779 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:57:48.023675    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/abb19610-3c38-40f5-beac-4a3bf0b91c60-util\") pod \"abb19610-3c38-40f5-beac-4a3bf0b91c60\" (UID: \"abb19610-3c38-40f5-beac-4a3bf0b91c60\") "
Jun 15 05:57:48.024211 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:57:48.024185    2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/abb19610-3c38-40f5-beac-4a3bf0b91c60-bundle" (OuterVolumeSpecName: "bundle") pod "abb19610-3c38-40f5-beac-4a3bf0b91c60" (UID: "abb19610-3c38-40f5-beac-4a3bf0b91c60"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jun 15 05:57:48.025813 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:57:48.025792    2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/abb19610-3c38-40f5-beac-4a3bf0b91c60-kube-api-access-nbz84" (OuterVolumeSpecName: "kube-api-access-nbz84") pod "abb19610-3c38-40f5-beac-4a3bf0b91c60" (UID: "abb19610-3c38-40f5-beac-4a3bf0b91c60"). InnerVolumeSpecName "kube-api-access-nbz84". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jun 15 05:57:48.028974 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:57:48.028898    2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/abb19610-3c38-40f5-beac-4a3bf0b91c60-util" (OuterVolumeSpecName: "util") pod "abb19610-3c38-40f5-beac-4a3bf0b91c60" (UID: "abb19610-3c38-40f5-beac-4a3bf0b91c60"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jun 15 05:57:48.125145 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:57:48.125107    2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nbz84\" (UniqueName: \"kubernetes.io/projected/abb19610-3c38-40f5-beac-4a3bf0b91c60-kube-api-access-nbz84\") on node \"ip-10-0-128-243.ec2.internal\" DevicePath \"\""
Jun 15 05:57:48.125145 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:57:48.125142    2566 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/abb19610-3c38-40f5-beac-4a3bf0b91c60-bundle\") on node \"ip-10-0-128-243.ec2.internal\" DevicePath \"\""
Jun 15 05:57:48.125145 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:57:48.125151    2566 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/abb19610-3c38-40f5-beac-4a3bf0b91c60-util\") on node \"ip-10-0-128-243.ec2.internal\" DevicePath \"\""
Jun 15 05:57:48.789093 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:57:48.789050    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/bae555bbad109ca402088e3881b25cb56b5908707d8ffbb6cfca172a45hjdxq"
Jun 15 05:57:48.789450 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:57:48.789104    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/bae555bbad109ca402088e3881b25cb56b5908707d8ffbb6cfca172a45hjdxq" event={"ID":"abb19610-3c38-40f5-beac-4a3bf0b91c60","Type":"ContainerDied","Data":"e4ae799306b96fd19a2d1428c926b1a20972478918d365b0b461996ef805f37b"}
Jun 15 05:57:48.789450 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:57:48.789144    2566 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="e4ae799306b96fd19a2d1428c926b1a20972478918d365b0b461996ef805f37b"
Jun 15 05:58:12.548037 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:58:12.548005    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-console-plugin-7dbb555447-w6b6b"]
Jun 15 05:58:12.548528 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:58:12.548310    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4792213b-94b8-44a3-8d1d-3f0d67bc3e32" containerName="extract"
Jun 15 05:58:12.548528 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:58:12.548321    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="4792213b-94b8-44a3-8d1d-3f0d67bc3e32" containerName="extract"
Jun 15 05:58:12.548528 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:58:12.548330    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0bcc4d9b-acd0-4e12-886f-42660f3f762b" containerName="extract"
Jun 15 05:58:12.548528 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:58:12.548336    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="0bcc4d9b-acd0-4e12-886f-42660f3f762b" containerName="extract"
Jun 15 05:58:12.548528 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:58:12.548344    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="abb19610-3c38-40f5-beac-4a3bf0b91c60" containerName="extract"
Jun 15 05:58:12.548528 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:58:12.548351    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="abb19610-3c38-40f5-beac-4a3bf0b91c60" containerName="extract"
Jun 15 05:58:12.548528 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:58:12.548358    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0bcc4d9b-acd0-4e12-886f-42660f3f762b" containerName="util"
Jun 15 05:58:12.548528 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:58:12.548364    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="0bcc4d9b-acd0-4e12-886f-42660f3f762b" containerName="util"
Jun 15 05:58:12.548528 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:58:12.548373    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="557f1e46-65a9-44be-9fca-659d01671f9e" containerName="util"
Jun 15 05:58:12.548528 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:58:12.548378    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="557f1e46-65a9-44be-9fca-659d01671f9e" containerName="util"
Jun 15 05:58:12.548528 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:58:12.548385    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="abb19610-3c38-40f5-beac-4a3bf0b91c60" containerName="util"
Jun 15 05:58:12.548528 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:58:12.548389    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="abb19610-3c38-40f5-beac-4a3bf0b91c60" containerName="util"
Jun 15 05:58:12.548528 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:58:12.548395    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="abb19610-3c38-40f5-beac-4a3bf0b91c60" containerName="pull"
Jun 15 05:58:12.548528 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:58:12.548400    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="abb19610-3c38-40f5-beac-4a3bf0b91c60" containerName="pull"
Jun 15 05:58:12.548528 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:58:12.548407    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="557f1e46-65a9-44be-9fca-659d01671f9e" containerName="extract"
Jun 15 05:58:12.548528 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:58:12.548412    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="557f1e46-65a9-44be-9fca-659d01671f9e" containerName="extract"
Jun 15 05:58:12.548528 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:58:12.548419    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0bcc4d9b-acd0-4e12-886f-42660f3f762b" containerName="pull"
Jun 15 05:58:12.548528 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:58:12.548423    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="0bcc4d9b-acd0-4e12-886f-42660f3f762b" containerName="pull"
Jun 15 05:58:12.548528 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:58:12.548429    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4792213b-94b8-44a3-8d1d-3f0d67bc3e32" containerName="pull"
Jun 15 05:58:12.548528 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:58:12.548434    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="4792213b-94b8-44a3-8d1d-3f0d67bc3e32" containerName="pull"
Jun 15 05:58:12.548528 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:58:12.548439    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="557f1e46-65a9-44be-9fca-659d01671f9e" containerName="pull"
Jun 15 05:58:12.548528 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:58:12.548445    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="557f1e46-65a9-44be-9fca-659d01671f9e" containerName="pull"
Jun 15 05:58:12.548528 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:58:12.548450    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4792213b-94b8-44a3-8d1d-3f0d67bc3e32" containerName="util"
Jun 15 05:58:12.548528 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:58:12.548455    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="4792213b-94b8-44a3-8d1d-3f0d67bc3e32" containerName="util"
Jun 15 05:58:12.548528 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:58:12.548501    2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="557f1e46-65a9-44be-9fca-659d01671f9e" containerName="extract"
Jun 15 05:58:12.548528 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:58:12.548511    2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="abb19610-3c38-40f5-beac-4a3bf0b91c60" containerName="extract"
Jun 15 05:58:12.548528 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:58:12.548517    2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="4792213b-94b8-44a3-8d1d-3f0d67bc3e32" containerName="extract"
Jun 15 05:58:12.548528 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:58:12.548524    2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="0bcc4d9b-acd0-4e12-886f-42660f3f762b" containerName="extract"
Jun 15 05:58:12.551371 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:58:12.551355    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-7dbb555447-w6b6b"
Jun 15 05:58:12.553537 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:58:12.553515    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"plugin-serving-cert\""
Jun 15 05:58:12.553866 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:58:12.553842    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Jun 15 05:58:12.553939 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:58:12.553918    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Jun 15 05:58:12.553986 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:58:12.553942    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kuadrant-console-nginx-conf\""
Jun 15 05:58:12.554039 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:58:12.553918    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-dvq6x\""
Jun 15 05:58:12.559347 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:58:12.559329    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-7dbb555447-w6b6b"]
Jun 15 05:58:12.634033 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:58:12.633999    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qtcmm\" (UniqueName: \"kubernetes.io/projected/e1a93313-40c4-40c9-a035-6066ffed7081-kube-api-access-qtcmm\") pod \"kuadrant-console-plugin-7dbb555447-w6b6b\" (UID: \"e1a93313-40c4-40c9-a035-6066ffed7081\") " pod="kuadrant-system/kuadrant-console-plugin-7dbb555447-w6b6b"
Jun 15 05:58:12.634215 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:58:12.634059    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/e1a93313-40c4-40c9-a035-6066ffed7081-plugin-serving-cert\") pod \"kuadrant-console-plugin-7dbb555447-w6b6b\" (UID: \"e1a93313-40c4-40c9-a035-6066ffed7081\") " pod="kuadrant-system/kuadrant-console-plugin-7dbb555447-w6b6b"
Jun 15 05:58:12.634215 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:58:12.634121    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/e1a93313-40c4-40c9-a035-6066ffed7081-nginx-conf\") pod \"kuadrant-console-plugin-7dbb555447-w6b6b\" (UID: \"e1a93313-40c4-40c9-a035-6066ffed7081\") " pod="kuadrant-system/kuadrant-console-plugin-7dbb555447-w6b6b"
Jun 15 05:58:12.735408 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:58:12.735377    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/e1a93313-40c4-40c9-a035-6066ffed7081-nginx-conf\") pod \"kuadrant-console-plugin-7dbb555447-w6b6b\" (UID: \"e1a93313-40c4-40c9-a035-6066ffed7081\") " pod="kuadrant-system/kuadrant-console-plugin-7dbb555447-w6b6b"
Jun 15 05:58:12.735590 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:58:12.735420    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qtcmm\" (UniqueName: \"kubernetes.io/projected/e1a93313-40c4-40c9-a035-6066ffed7081-kube-api-access-qtcmm\") pod \"kuadrant-console-plugin-7dbb555447-w6b6b\" (UID: \"e1a93313-40c4-40c9-a035-6066ffed7081\") " pod="kuadrant-system/kuadrant-console-plugin-7dbb555447-w6b6b"
Jun 15 05:58:12.735590 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:58:12.735479    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/e1a93313-40c4-40c9-a035-6066ffed7081-plugin-serving-cert\") pod \"kuadrant-console-plugin-7dbb555447-w6b6b\" (UID: \"e1a93313-40c4-40c9-a035-6066ffed7081\") " pod="kuadrant-system/kuadrant-console-plugin-7dbb555447-w6b6b"
Jun 15 05:58:12.736134 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:58:12.736115    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/e1a93313-40c4-40c9-a035-6066ffed7081-nginx-conf\") pod \"kuadrant-console-plugin-7dbb555447-w6b6b\" (UID: \"e1a93313-40c4-40c9-a035-6066ffed7081\") " pod="kuadrant-system/kuadrant-console-plugin-7dbb555447-w6b6b"
Jun 15 05:58:12.738032 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:58:12.738012    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/e1a93313-40c4-40c9-a035-6066ffed7081-plugin-serving-cert\") pod \"kuadrant-console-plugin-7dbb555447-w6b6b\" (UID: \"e1a93313-40c4-40c9-a035-6066ffed7081\") " pod="kuadrant-system/kuadrant-console-plugin-7dbb555447-w6b6b"
Jun 15 05:58:12.745370 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:58:12.745347    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qtcmm\" (UniqueName: \"kubernetes.io/projected/e1a93313-40c4-40c9-a035-6066ffed7081-kube-api-access-qtcmm\") pod \"kuadrant-console-plugin-7dbb555447-w6b6b\" (UID: \"e1a93313-40c4-40c9-a035-6066ffed7081\") " pod="kuadrant-system/kuadrant-console-plugin-7dbb555447-w6b6b"
Jun 15 05:58:12.860894 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:58:12.860788    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-7dbb555447-w6b6b"
Jun 15 05:58:12.995101 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:58:12.995051    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-7dbb555447-w6b6b"]
Jun 15 05:58:12.996708 ip-10-0-128-243 kubenswrapper[2566]: W0615 05:58:12.996672    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pode1a93313_40c4_40c9_a035_6066ffed7081.slice/crio-54ccce970cfaff4de10612403149c721d2b94f98513e14cbb73b5fc107e66ca0 WatchSource:0}: Error finding container 54ccce970cfaff4de10612403149c721d2b94f98513e14cbb73b5fc107e66ca0: Status 404 returned error can't find the container with id 54ccce970cfaff4de10612403149c721d2b94f98513e14cbb73b5fc107e66ca0
Jun 15 05:58:13.916134 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:58:13.916070    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-7dbb555447-w6b6b" event={"ID":"e1a93313-40c4-40c9-a035-6066ffed7081","Type":"ContainerStarted","Data":"54ccce970cfaff4de10612403149c721d2b94f98513e14cbb73b5fc107e66ca0"}
Jun 15 05:58:17.939936 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:58:17.939840    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-7dbb555447-w6b6b" event={"ID":"e1a93313-40c4-40c9-a035-6066ffed7081","Type":"ContainerStarted","Data":"39d720f9962d8eae1f3a8e81b2bd77577716a773f9b066984b92ade35b06e06f"}
Jun 15 05:58:17.967788 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:58:17.967740    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-console-plugin-7dbb555447-w6b6b" podStartSLOduration=1.446229942 podStartE2EDuration="5.967725656s" totalImagesPullingTime="4.521495714s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-15 05:58:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 05:58:17.966622545 +0000 UTC m=+580.926379791" watchObservedRunningTime="2026-06-15 05:58:17.967725656 +0000 UTC m=+580.927482901"
Jun 15 05:58:37.412102 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:58:37.412060    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5dbbb5d744-ktjgp_67da60eb-27f9-4bbd-8d12-64275e801143/console-operator/2.log"
Jun 15 05:58:37.412510 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:58:37.412067    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5dbbb5d744-ktjgp_67da60eb-27f9-4bbd-8d12-64275e801143/console-operator/2.log"
Jun 15 05:58:37.417667 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:58:37.417644    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-f4bzh_5a1f8f83-55db-4fc7-872d-6b202daa0a31/ovn-acl-logging/0.log"
Jun 15 05:58:37.417785 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:58:37.417766    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-f4bzh_5a1f8f83-55db-4fc7-872d-6b202daa0a31/ovn-acl-logging/0.log"
Jun 15 05:58:54.318490 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:58:54.318411    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-88c64b96b-6kpcd"]
Jun 15 05:58:54.336290 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:58:54.336245    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-88c64b96b-6kpcd"]
Jun 15 05:58:54.336376 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:58:54.336332    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-88c64b96b-6kpcd"
Jun 15 05:58:54.339025 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:58:54.339005    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-6ncq5\""
Jun 15 05:58:54.379146 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:58:54.379119    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bzfgh\" (UniqueName: \"kubernetes.io/projected/41dc35ad-d735-454c-b815-2a764e932ab2-kube-api-access-bzfgh\") pod \"authorino-88c64b96b-6kpcd\" (UID: \"41dc35ad-d735-454c-b815-2a764e932ab2\") " pod="kuadrant-system/authorino-88c64b96b-6kpcd"
Jun 15 05:58:54.479661 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:58:54.479635    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bzfgh\" (UniqueName: \"kubernetes.io/projected/41dc35ad-d735-454c-b815-2a764e932ab2-kube-api-access-bzfgh\") pod \"authorino-88c64b96b-6kpcd\" (UID: \"41dc35ad-d735-454c-b815-2a764e932ab2\") " pod="kuadrant-system/authorino-88c64b96b-6kpcd"
Jun 15 05:58:54.495008 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:58:54.494982    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bzfgh\" (UniqueName: \"kubernetes.io/projected/41dc35ad-d735-454c-b815-2a764e932ab2-kube-api-access-bzfgh\") pod \"authorino-88c64b96b-6kpcd\" (UID: \"41dc35ad-d735-454c-b815-2a764e932ab2\") " pod="kuadrant-system/authorino-88c64b96b-6kpcd"
Jun 15 05:58:54.645060 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:58:54.644967    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-88c64b96b-6kpcd"
Jun 15 05:58:54.662999 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:58:54.662975    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-544488d7bd-x96dr"]
Jun 15 05:58:54.666409 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:58:54.666395    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-544488d7bd-x96dr"
Jun 15 05:58:54.674751 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:58:54.674695    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-544488d7bd-x96dr"]
Jun 15 05:58:54.681202 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:58:54.681173    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5r2xm\" (UniqueName: \"kubernetes.io/projected/d70c7062-c11b-4062-9f00-17fb659dc673-kube-api-access-5r2xm\") pod \"authorino-544488d7bd-x96dr\" (UID: \"d70c7062-c11b-4062-9f00-17fb659dc673\") " pod="kuadrant-system/authorino-544488d7bd-x96dr"
Jun 15 05:58:54.780961 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:58:54.780934    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-88c64b96b-6kpcd"]
Jun 15 05:58:54.781701 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:58:54.781677    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5r2xm\" (UniqueName: \"kubernetes.io/projected/d70c7062-c11b-4062-9f00-17fb659dc673-kube-api-access-5r2xm\") pod \"authorino-544488d7bd-x96dr\" (UID: \"d70c7062-c11b-4062-9f00-17fb659dc673\") " pod="kuadrant-system/authorino-544488d7bd-x96dr"
Jun 15 05:58:54.782474 ip-10-0-128-243 kubenswrapper[2566]: W0615 05:58:54.782438    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod41dc35ad_d735_454c_b815_2a764e932ab2.slice/crio-bcc72a19b1bc296ce6b11468d3f49ffab6b9f235bf273e78e9f73223c1c449a9 WatchSource:0}: Error finding container bcc72a19b1bc296ce6b11468d3f49ffab6b9f235bf273e78e9f73223c1c449a9: Status 404 returned error can't find the container with id bcc72a19b1bc296ce6b11468d3f49ffab6b9f235bf273e78e9f73223c1c449a9
Jun 15 05:58:54.783794 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:58:54.783776    2566 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jun 15 05:58:54.791462 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:58:54.791444    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5r2xm\" (UniqueName: \"kubernetes.io/projected/d70c7062-c11b-4062-9f00-17fb659dc673-kube-api-access-5r2xm\") pod \"authorino-544488d7bd-x96dr\" (UID: \"d70c7062-c11b-4062-9f00-17fb659dc673\") " pod="kuadrant-system/authorino-544488d7bd-x96dr"
Jun 15 05:58:54.978666 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:58:54.978587    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-544488d7bd-x96dr"
Jun 15 05:58:55.111266 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:58:55.111241    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-544488d7bd-x96dr"]
Jun 15 05:58:55.112951 ip-10-0-128-243 kubenswrapper[2566]: W0615 05:58:55.112920    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podd70c7062_c11b_4062_9f00_17fb659dc673.slice/crio-ccca7ede2b8e77a29953d75d9da2ca33dea92288959f9e928fddaaaf56273c77 WatchSource:0}: Error finding container ccca7ede2b8e77a29953d75d9da2ca33dea92288959f9e928fddaaaf56273c77: Status 404 returned error can't find the container with id ccca7ede2b8e77a29953d75d9da2ca33dea92288959f9e928fddaaaf56273c77
Jun 15 05:58:55.119271 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:58:55.119243    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-544488d7bd-x96dr" event={"ID":"d70c7062-c11b-4062-9f00-17fb659dc673","Type":"ContainerStarted","Data":"ccca7ede2b8e77a29953d75d9da2ca33dea92288959f9e928fddaaaf56273c77"}
Jun 15 05:58:55.120485 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:58:55.120459    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-88c64b96b-6kpcd" event={"ID":"41dc35ad-d735-454c-b815-2a764e932ab2","Type":"ContainerStarted","Data":"bcc72a19b1bc296ce6b11468d3f49ffab6b9f235bf273e78e9f73223c1c449a9"}
Jun 15 05:58:57.132485 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:58:57.132448    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-88c64b96b-6kpcd" event={"ID":"41dc35ad-d735-454c-b815-2a764e932ab2","Type":"ContainerStarted","Data":"cbd152e72e60f6718e2d546838eb65bfd106673f67e232d82e32f8cf1d43fb46"}
Jun 15 05:58:57.133858 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:58:57.133831    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-544488d7bd-x96dr" event={"ID":"d70c7062-c11b-4062-9f00-17fb659dc673","Type":"ContainerStarted","Data":"71ec2e611c6f1e4ceb3a4aa8f95c5bdf3a0cc370c7e432038cc82cb1be6fb369"}
Jun 15 05:58:57.150674 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:58:57.150627    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-88c64b96b-6kpcd" podStartSLOduration=1.369393476 podStartE2EDuration="3.15061165s" totalImagesPullingTime="1.781218174s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-15 05:58:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 05:58:57.148777038 +0000 UTC m=+620.108534283" watchObservedRunningTime="2026-06-15 05:58:57.15061165 +0000 UTC m=+620.110368894"
Jun 15 05:58:57.172046 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:58:57.172003    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-544488d7bd-x96dr" podStartSLOduration=1.7258975840000002 podStartE2EDuration="3.171987969s" totalImagesPullingTime="1.446090385s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-15 05:58:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 05:58:57.171427081 +0000 UTC m=+620.131184327" watchObservedRunningTime="2026-06-15 05:58:57.171987969 +0000 UTC m=+620.131745215"
Jun 15 05:58:57.198431 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:58:57.198401    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-88c64b96b-6kpcd"]
Jun 15 05:58:59.143555 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:58:59.143509    2566 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-88c64b96b-6kpcd" podUID="41dc35ad-d735-454c-b815-2a764e932ab2" containerName="authorino" containerID="cri-o://cbd152e72e60f6718e2d546838eb65bfd106673f67e232d82e32f8cf1d43fb46" gracePeriod=30
Jun 15 05:58:59.387906 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:58:59.387884    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-88c64b96b-6kpcd"
Jun 15 05:58:59.420128 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:58:59.420040    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bzfgh\" (UniqueName: \"kubernetes.io/projected/41dc35ad-d735-454c-b815-2a764e932ab2-kube-api-access-bzfgh\") pod \"41dc35ad-d735-454c-b815-2a764e932ab2\" (UID: \"41dc35ad-d735-454c-b815-2a764e932ab2\") "
Jun 15 05:58:59.422276 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:58:59.422247    2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/41dc35ad-d735-454c-b815-2a764e932ab2-kube-api-access-bzfgh" (OuterVolumeSpecName: "kube-api-access-bzfgh") pod "41dc35ad-d735-454c-b815-2a764e932ab2" (UID: "41dc35ad-d735-454c-b815-2a764e932ab2"). InnerVolumeSpecName "kube-api-access-bzfgh". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jun 15 05:58:59.521193 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:58:59.521166    2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bzfgh\" (UniqueName: \"kubernetes.io/projected/41dc35ad-d735-454c-b815-2a764e932ab2-kube-api-access-bzfgh\") on node \"ip-10-0-128-243.ec2.internal\" DevicePath \"\""
Jun 15 05:59:00.150452 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:59:00.150418    2566 generic.go:356] "Generic (PLEG): container finished" podID="41dc35ad-d735-454c-b815-2a764e932ab2" containerID="cbd152e72e60f6718e2d546838eb65bfd106673f67e232d82e32f8cf1d43fb46" exitCode=0
Jun 15 05:59:00.150983 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:59:00.150458    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-88c64b96b-6kpcd"
Jun 15 05:59:00.150983 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:59:00.150510    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-88c64b96b-6kpcd" event={"ID":"41dc35ad-d735-454c-b815-2a764e932ab2","Type":"ContainerDied","Data":"cbd152e72e60f6718e2d546838eb65bfd106673f67e232d82e32f8cf1d43fb46"}
Jun 15 05:59:00.150983 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:59:00.150557    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-88c64b96b-6kpcd" event={"ID":"41dc35ad-d735-454c-b815-2a764e932ab2","Type":"ContainerDied","Data":"bcc72a19b1bc296ce6b11468d3f49ffab6b9f235bf273e78e9f73223c1c449a9"}
Jun 15 05:59:00.150983 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:59:00.150579    2566 scope.go:117] "RemoveContainer" containerID="cbd152e72e60f6718e2d546838eb65bfd106673f67e232d82e32f8cf1d43fb46"
Jun 15 05:59:00.159190 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:59:00.159178    2566 scope.go:117] "RemoveContainer" containerID="cbd152e72e60f6718e2d546838eb65bfd106673f67e232d82e32f8cf1d43fb46"
Jun 15 05:59:00.159448 ip-10-0-128-243 kubenswrapper[2566]: E0615 05:59:00.159430    2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cbd152e72e60f6718e2d546838eb65bfd106673f67e232d82e32f8cf1d43fb46\": container with ID starting with cbd152e72e60f6718e2d546838eb65bfd106673f67e232d82e32f8cf1d43fb46 not found: ID does not exist" containerID="cbd152e72e60f6718e2d546838eb65bfd106673f67e232d82e32f8cf1d43fb46"
Jun 15 05:59:00.159508 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:59:00.159456    2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cbd152e72e60f6718e2d546838eb65bfd106673f67e232d82e32f8cf1d43fb46"} err="failed to get container status \"cbd152e72e60f6718e2d546838eb65bfd106673f67e232d82e32f8cf1d43fb46\": rpc error: code = NotFound desc = could not find container \"cbd152e72e60f6718e2d546838eb65bfd106673f67e232d82e32f8cf1d43fb46\": container with ID starting with cbd152e72e60f6718e2d546838eb65bfd106673f67e232d82e32f8cf1d43fb46 not found: ID does not exist"
Jun 15 05:59:00.168007 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:59:00.167986    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-88c64b96b-6kpcd"]
Jun 15 05:59:00.176720 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:59:00.176698    2566 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-88c64b96b-6kpcd"]
Jun 15 05:59:01.441133 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:59:01.441073    2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="41dc35ad-d735-454c-b815-2a764e932ab2" path="/var/lib/kubelet/pods/41dc35ad-d735-454c-b815-2a764e932ab2/volumes"
Jun 15 05:59:20.020094 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:59:20.020046    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-686db986cb-n5rxl"]
Jun 15 05:59:20.020454 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:59:20.020378    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="41dc35ad-d735-454c-b815-2a764e932ab2" containerName="authorino"
Jun 15 05:59:20.020454 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:59:20.020392    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="41dc35ad-d735-454c-b815-2a764e932ab2" containerName="authorino"
Jun 15 05:59:20.020454 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:59:20.020448    2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="41dc35ad-d735-454c-b815-2a764e932ab2" containerName="authorino"
Jun 15 05:59:20.024635 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:59:20.024618    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-686db986cb-n5rxl"
Jun 15 05:59:20.028907 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:59:20.028864    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\""
Jun 15 05:59:20.031584 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:59:20.031452    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-686db986cb-n5rxl"]
Jun 15 05:59:20.080862 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:59:20.080838    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2r279\" (UniqueName: \"kubernetes.io/projected/82db39b0-d5da-43ef-8722-238f3f7cfeed-kube-api-access-2r279\") pod \"authorino-686db986cb-n5rxl\" (UID: \"82db39b0-d5da-43ef-8722-238f3f7cfeed\") " pod="kuadrant-system/authorino-686db986cb-n5rxl"
Jun 15 05:59:20.080967 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:59:20.080899    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/82db39b0-d5da-43ef-8722-238f3f7cfeed-tls-cert\") pod \"authorino-686db986cb-n5rxl\" (UID: \"82db39b0-d5da-43ef-8722-238f3f7cfeed\") " pod="kuadrant-system/authorino-686db986cb-n5rxl"
Jun 15 05:59:20.181748 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:59:20.181715    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2r279\" (UniqueName: \"kubernetes.io/projected/82db39b0-d5da-43ef-8722-238f3f7cfeed-kube-api-access-2r279\") pod \"authorino-686db986cb-n5rxl\" (UID: \"82db39b0-d5da-43ef-8722-238f3f7cfeed\") " pod="kuadrant-system/authorino-686db986cb-n5rxl"
Jun 15 05:59:20.181886 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:59:20.181760    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/82db39b0-d5da-43ef-8722-238f3f7cfeed-tls-cert\") pod \"authorino-686db986cb-n5rxl\" (UID: \"82db39b0-d5da-43ef-8722-238f3f7cfeed\") " pod="kuadrant-system/authorino-686db986cb-n5rxl"
Jun 15 05:59:20.184256 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:59:20.184226    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/82db39b0-d5da-43ef-8722-238f3f7cfeed-tls-cert\") pod \"authorino-686db986cb-n5rxl\" (UID: \"82db39b0-d5da-43ef-8722-238f3f7cfeed\") " pod="kuadrant-system/authorino-686db986cb-n5rxl"
Jun 15 05:59:20.191686 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:59:20.191657    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2r279\" (UniqueName: \"kubernetes.io/projected/82db39b0-d5da-43ef-8722-238f3f7cfeed-kube-api-access-2r279\") pod \"authorino-686db986cb-n5rxl\" (UID: \"82db39b0-d5da-43ef-8722-238f3f7cfeed\") " pod="kuadrant-system/authorino-686db986cb-n5rxl"
Jun 15 05:59:20.333981 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:59:20.333901    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-686db986cb-n5rxl"
Jun 15 05:59:20.462590 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:59:20.462557    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-686db986cb-n5rxl"]
Jun 15 05:59:20.465660 ip-10-0-128-243 kubenswrapper[2566]: W0615 05:59:20.465625    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod82db39b0_d5da_43ef_8722_238f3f7cfeed.slice/crio-3eae9fb8287600392bbd0bbcf9056d706a530b17eb783425624b502feffb043e WatchSource:0}: Error finding container 3eae9fb8287600392bbd0bbcf9056d706a530b17eb783425624b502feffb043e: Status 404 returned error can't find the container with id 3eae9fb8287600392bbd0bbcf9056d706a530b17eb783425624b502feffb043e
Jun 15 05:59:21.266452 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:59:21.266414    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-686db986cb-n5rxl" event={"ID":"82db39b0-d5da-43ef-8722-238f3f7cfeed","Type":"ContainerStarted","Data":"9b3a1ac119424c77fb25955e3cc384742ed4ba7059ddf9abe2178f4af25af3e4"}
Jun 15 05:59:21.266853 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:59:21.266458    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-686db986cb-n5rxl" event={"ID":"82db39b0-d5da-43ef-8722-238f3f7cfeed","Type":"ContainerStarted","Data":"3eae9fb8287600392bbd0bbcf9056d706a530b17eb783425624b502feffb043e"}
Jun 15 05:59:21.284507 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:59:21.284459    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-686db986cb-n5rxl" podStartSLOduration=1.961242367 podStartE2EDuration="2.284445249s" totalImagesPullingTime="323.202882ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-15 05:59:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 05:59:21.282482314 +0000 UTC m=+644.242239559" watchObservedRunningTime="2026-06-15 05:59:21.284445249 +0000 UTC m=+644.244202495"
Jun 15 05:59:21.316554 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:59:21.316522    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-544488d7bd-x96dr"]
Jun 15 05:59:21.316753 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:59:21.316732    2566 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-544488d7bd-x96dr" podUID="d70c7062-c11b-4062-9f00-17fb659dc673" containerName="authorino" containerID="cri-o://71ec2e611c6f1e4ceb3a4aa8f95c5bdf3a0cc370c7e432038cc82cb1be6fb369" gracePeriod=30
Jun 15 05:59:21.559156 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:59:21.559125    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-544488d7bd-x96dr"
Jun 15 05:59:21.595044 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:59:21.595012    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5r2xm\" (UniqueName: \"kubernetes.io/projected/d70c7062-c11b-4062-9f00-17fb659dc673-kube-api-access-5r2xm\") pod \"d70c7062-c11b-4062-9f00-17fb659dc673\" (UID: \"d70c7062-c11b-4062-9f00-17fb659dc673\") "
Jun 15 05:59:21.597182 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:59:21.597152    2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d70c7062-c11b-4062-9f00-17fb659dc673-kube-api-access-5r2xm" (OuterVolumeSpecName: "kube-api-access-5r2xm") pod "d70c7062-c11b-4062-9f00-17fb659dc673" (UID: "d70c7062-c11b-4062-9f00-17fb659dc673"). InnerVolumeSpecName "kube-api-access-5r2xm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jun 15 05:59:21.696307 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:59:21.696279    2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5r2xm\" (UniqueName: \"kubernetes.io/projected/d70c7062-c11b-4062-9f00-17fb659dc673-kube-api-access-5r2xm\") on node \"ip-10-0-128-243.ec2.internal\" DevicePath \"\""
Jun 15 05:59:22.272346 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:59:22.272309    2566 generic.go:356] "Generic (PLEG): container finished" podID="d70c7062-c11b-4062-9f00-17fb659dc673" containerID="71ec2e611c6f1e4ceb3a4aa8f95c5bdf3a0cc370c7e432038cc82cb1be6fb369" exitCode=0
Jun 15 05:59:22.272346 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:59:22.272348    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-544488d7bd-x96dr"
Jun 15 05:59:22.272783 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:59:22.272391    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-544488d7bd-x96dr" event={"ID":"d70c7062-c11b-4062-9f00-17fb659dc673","Type":"ContainerDied","Data":"71ec2e611c6f1e4ceb3a4aa8f95c5bdf3a0cc370c7e432038cc82cb1be6fb369"}
Jun 15 05:59:22.272783 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:59:22.272432    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-544488d7bd-x96dr" event={"ID":"d70c7062-c11b-4062-9f00-17fb659dc673","Type":"ContainerDied","Data":"ccca7ede2b8e77a29953d75d9da2ca33dea92288959f9e928fddaaaf56273c77"}
Jun 15 05:59:22.272783 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:59:22.272453    2566 scope.go:117] "RemoveContainer" containerID="71ec2e611c6f1e4ceb3a4aa8f95c5bdf3a0cc370c7e432038cc82cb1be6fb369"
Jun 15 05:59:22.281314 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:59:22.281299    2566 scope.go:117] "RemoveContainer" containerID="71ec2e611c6f1e4ceb3a4aa8f95c5bdf3a0cc370c7e432038cc82cb1be6fb369"
Jun 15 05:59:22.281569 ip-10-0-128-243 kubenswrapper[2566]: E0615 05:59:22.281549    2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"71ec2e611c6f1e4ceb3a4aa8f95c5bdf3a0cc370c7e432038cc82cb1be6fb369\": container with ID starting with 71ec2e611c6f1e4ceb3a4aa8f95c5bdf3a0cc370c7e432038cc82cb1be6fb369 not found: ID does not exist" containerID="71ec2e611c6f1e4ceb3a4aa8f95c5bdf3a0cc370c7e432038cc82cb1be6fb369"
Jun 15 05:59:22.281634 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:59:22.281577    2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"71ec2e611c6f1e4ceb3a4aa8f95c5bdf3a0cc370c7e432038cc82cb1be6fb369"} err="failed to get container status \"71ec2e611c6f1e4ceb3a4aa8f95c5bdf3a0cc370c7e432038cc82cb1be6fb369\": rpc error: code = NotFound desc = could not find container \"71ec2e611c6f1e4ceb3a4aa8f95c5bdf3a0cc370c7e432038cc82cb1be6fb369\": container with ID starting with 71ec2e611c6f1e4ceb3a4aa8f95c5bdf3a0cc370c7e432038cc82cb1be6fb369 not found: ID does not exist"
Jun 15 05:59:22.296312 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:59:22.296289    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-544488d7bd-x96dr"]
Jun 15 05:59:22.301943 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:59:22.301921    2566 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-544488d7bd-x96dr"]
Jun 15 05:59:23.441526 ip-10-0-128-243 kubenswrapper[2566]: I0615 05:59:23.441496    2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d70c7062-c11b-4062-9f00-17fb659dc673" path="/var/lib/kubelet/pods/d70c7062-c11b-4062-9f00-17fb659dc673/volumes"
Jun 15 06:01:49.825100 ip-10-0-128-243 kubenswrapper[2566]: I0615 06:01:49.825041    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/scheduler-ha-replicas-test-kserve-5d7479f884-f4vfq"]
Jun 15 06:01:49.825519 ip-10-0-128-243 kubenswrapper[2566]: I0615 06:01:49.825477    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d70c7062-c11b-4062-9f00-17fb659dc673" containerName="authorino"
Jun 15 06:01:49.825519 ip-10-0-128-243 kubenswrapper[2566]: I0615 06:01:49.825492    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="d70c7062-c11b-4062-9f00-17fb659dc673" containerName="authorino"
Jun 15 06:01:49.825600 ip-10-0-128-243 kubenswrapper[2566]: I0615 06:01:49.825559    2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="d70c7062-c11b-4062-9f00-17fb659dc673" containerName="authorino"
Jun 15 06:01:49.827545 ip-10-0-128-243 kubenswrapper[2566]: I0615 06:01:49.827526    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/scheduler-ha-replicas-test-kserve-5d7479f884-f4vfq"
Jun 15 06:01:49.830644 ip-10-0-128-243 kubenswrapper[2566]: I0615 06:01:49.830611    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"scheduler-ha-replicas-test-kserve-self-signed-certs\""
Jun 15 06:01:49.830757 ip-10-0-128-243 kubenswrapper[2566]: I0615 06:01:49.830689    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"kube-root-ca.crt\""
Jun 15 06:01:49.830888 ip-10-0-128-243 kubenswrapper[2566]: I0615 06:01:49.830871    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"default-dockercfg-fjfwp\""
Jun 15 06:01:49.830967 ip-10-0-128-243 kubenswrapper[2566]: I0615 06:01:49.830951    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"openshift-service-ca.crt\""
Jun 15 06:01:49.837596 ip-10-0-128-243 kubenswrapper[2566]: I0615 06:01:49.837573    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/scheduler-ha-replicas-test-kserve-5d7479f884-f4vfq"]
Jun 15 06:01:49.899068 ip-10-0-128-243 kubenswrapper[2566]: I0615 06:01:49.899043    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/24b359f7-d13b-4e54-a722-55a2de50705f-tmp-dir\") pod \"scheduler-ha-replicas-test-kserve-5d7479f884-f4vfq\" (UID: \"24b359f7-d13b-4e54-a722-55a2de50705f\") " pod="kserve-ci-e2e-test/scheduler-ha-replicas-test-kserve-5d7479f884-f4vfq"
Jun 15 06:01:49.899210 ip-10-0-128-243 kubenswrapper[2566]: I0615 06:01:49.899110    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/24b359f7-d13b-4e54-a722-55a2de50705f-tls-certs\") pod \"scheduler-ha-replicas-test-kserve-5d7479f884-f4vfq\" (UID: \"24b359f7-d13b-4e54-a722-55a2de50705f\") " pod="kserve-ci-e2e-test/scheduler-ha-replicas-test-kserve-5d7479f884-f4vfq"
Jun 15 06:01:49.899210 ip-10-0-128-243 kubenswrapper[2566]: I0615 06:01:49.899134    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/24b359f7-d13b-4e54-a722-55a2de50705f-home\") pod \"scheduler-ha-replicas-test-kserve-5d7479f884-f4vfq\" (UID: \"24b359f7-d13b-4e54-a722-55a2de50705f\") " pod="kserve-ci-e2e-test/scheduler-ha-replicas-test-kserve-5d7479f884-f4vfq"
Jun 15 06:01:49.899287 ip-10-0-128-243 kubenswrapper[2566]: I0615 06:01:49.899227    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/24b359f7-d13b-4e54-a722-55a2de50705f-dshm\") pod \"scheduler-ha-replicas-test-kserve-5d7479f884-f4vfq\" (UID: \"24b359f7-d13b-4e54-a722-55a2de50705f\") " pod="kserve-ci-e2e-test/scheduler-ha-replicas-test-kserve-5d7479f884-f4vfq"
Jun 15 06:01:49.899287 ip-10-0-128-243 kubenswrapper[2566]: I0615 06:01:49.899265    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/24b359f7-d13b-4e54-a722-55a2de50705f-model-cache\") pod \"scheduler-ha-replicas-test-kserve-5d7479f884-f4vfq\" (UID: \"24b359f7-d13b-4e54-a722-55a2de50705f\") " pod="kserve-ci-e2e-test/scheduler-ha-replicas-test-kserve-5d7479f884-f4vfq"
Jun 15 06:01:49.899356 ip-10-0-128-243 kubenswrapper[2566]: I0615 06:01:49.899290    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-spd44\" (UniqueName: \"kubernetes.io/projected/24b359f7-d13b-4e54-a722-55a2de50705f-kube-api-access-spd44\") pod \"scheduler-ha-replicas-test-kserve-5d7479f884-f4vfq\" (UID: \"24b359f7-d13b-4e54-a722-55a2de50705f\") " pod="kserve-ci-e2e-test/scheduler-ha-replicas-test-kserve-5d7479f884-f4vfq"
Jun 15 06:01:50.000707 ip-10-0-128-243 kubenswrapper[2566]: I0615 06:01:50.000670    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/24b359f7-d13b-4e54-a722-55a2de50705f-dshm\") pod \"scheduler-ha-replicas-test-kserve-5d7479f884-f4vfq\" (UID: \"24b359f7-d13b-4e54-a722-55a2de50705f\") " pod="kserve-ci-e2e-test/scheduler-ha-replicas-test-kserve-5d7479f884-f4vfq"
Jun 15 06:01:50.000896 ip-10-0-128-243 kubenswrapper[2566]: I0615 06:01:50.000730    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/24b359f7-d13b-4e54-a722-55a2de50705f-model-cache\") pod \"scheduler-ha-replicas-test-kserve-5d7479f884-f4vfq\" (UID: \"24b359f7-d13b-4e54-a722-55a2de50705f\") " pod="kserve-ci-e2e-test/scheduler-ha-replicas-test-kserve-5d7479f884-f4vfq"
Jun 15 06:01:50.000896 ip-10-0-128-243 kubenswrapper[2566]: I0615 06:01:50.000765    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-spd44\" (UniqueName: \"kubernetes.io/projected/24b359f7-d13b-4e54-a722-55a2de50705f-kube-api-access-spd44\") pod \"scheduler-ha-replicas-test-kserve-5d7479f884-f4vfq\" (UID: \"24b359f7-d13b-4e54-a722-55a2de50705f\") " pod="kserve-ci-e2e-test/scheduler-ha-replicas-test-kserve-5d7479f884-f4vfq"
Jun 15 06:01:50.000896 ip-10-0-128-243 kubenswrapper[2566]: I0615 06:01:50.000795    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/24b359f7-d13b-4e54-a722-55a2de50705f-tmp-dir\") pod \"scheduler-ha-replicas-test-kserve-5d7479f884-f4vfq\" (UID: \"24b359f7-d13b-4e54-a722-55a2de50705f\") " pod="kserve-ci-e2e-test/scheduler-ha-replicas-test-kserve-5d7479f884-f4vfq"
Jun 15 06:01:50.000896 ip-10-0-128-243 kubenswrapper[2566]: I0615 06:01:50.000853    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/24b359f7-d13b-4e54-a722-55a2de50705f-tls-certs\") pod \"scheduler-ha-replicas-test-kserve-5d7479f884-f4vfq\" (UID: \"24b359f7-d13b-4e54-a722-55a2de50705f\") " pod="kserve-ci-e2e-test/scheduler-ha-replicas-test-kserve-5d7479f884-f4vfq"
Jun 15 06:01:50.000896 ip-10-0-128-243 kubenswrapper[2566]: I0615 06:01:50.000881    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/24b359f7-d13b-4e54-a722-55a2de50705f-home\") pod \"scheduler-ha-replicas-test-kserve-5d7479f884-f4vfq\" (UID: \"24b359f7-d13b-4e54-a722-55a2de50705f\") " pod="kserve-ci-e2e-test/scheduler-ha-replicas-test-kserve-5d7479f884-f4vfq"
Jun 15 06:01:50.001223 ip-10-0-128-243 kubenswrapper[2566]: I0615 06:01:50.001193    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/24b359f7-d13b-4e54-a722-55a2de50705f-model-cache\") pod \"scheduler-ha-replicas-test-kserve-5d7479f884-f4vfq\" (UID: \"24b359f7-d13b-4e54-a722-55a2de50705f\") " pod="kserve-ci-e2e-test/scheduler-ha-replicas-test-kserve-5d7479f884-f4vfq"
Jun 15 06:01:50.001355 ip-10-0-128-243 kubenswrapper[2566]: I0615 06:01:50.001332    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/24b359f7-d13b-4e54-a722-55a2de50705f-tmp-dir\") pod \"scheduler-ha-replicas-test-kserve-5d7479f884-f4vfq\" (UID: \"24b359f7-d13b-4e54-a722-55a2de50705f\") " pod="kserve-ci-e2e-test/scheduler-ha-replicas-test-kserve-5d7479f884-f4vfq"
Jun 15 06:01:50.001670 ip-10-0-128-243 kubenswrapper[2566]: I0615 06:01:50.001648    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/24b359f7-d13b-4e54-a722-55a2de50705f-home\") pod \"scheduler-ha-replicas-test-kserve-5d7479f884-f4vfq\" (UID: \"24b359f7-d13b-4e54-a722-55a2de50705f\") " pod="kserve-ci-e2e-test/scheduler-ha-replicas-test-kserve-5d7479f884-f4vfq"
Jun 15 06:01:50.003533 ip-10-0-128-243 kubenswrapper[2566]: I0615 06:01:50.003512    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/24b359f7-d13b-4e54-a722-55a2de50705f-dshm\") pod \"scheduler-ha-replicas-test-kserve-5d7479f884-f4vfq\" (UID: \"24b359f7-d13b-4e54-a722-55a2de50705f\") " pod="kserve-ci-e2e-test/scheduler-ha-replicas-test-kserve-5d7479f884-f4vfq"
Jun 15 06:01:50.004149 ip-10-0-128-243 kubenswrapper[2566]: I0615 06:01:50.004125    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/24b359f7-d13b-4e54-a722-55a2de50705f-tls-certs\") pod \"scheduler-ha-replicas-test-kserve-5d7479f884-f4vfq\" (UID: \"24b359f7-d13b-4e54-a722-55a2de50705f\") " pod="kserve-ci-e2e-test/scheduler-ha-replicas-test-kserve-5d7479f884-f4vfq"
Jun 15 06:01:50.009900 ip-10-0-128-243 kubenswrapper[2566]: I0615 06:01:50.009875    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-spd44\" (UniqueName: \"kubernetes.io/projected/24b359f7-d13b-4e54-a722-55a2de50705f-kube-api-access-spd44\") pod \"scheduler-ha-replicas-test-kserve-5d7479f884-f4vfq\" (UID: \"24b359f7-d13b-4e54-a722-55a2de50705f\") " pod="kserve-ci-e2e-test/scheduler-ha-replicas-test-kserve-5d7479f884-f4vfq"
Jun 15 06:01:50.138634 ip-10-0-128-243 kubenswrapper[2566]: I0615 06:01:50.138525    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/scheduler-ha-replicas-test-kserve-5d7479f884-f4vfq"
Jun 15 06:01:50.280932 ip-10-0-128-243 kubenswrapper[2566]: I0615 06:01:50.280903    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/scheduler-ha-replicas-test-kserve-5d7479f884-f4vfq"]
Jun 15 06:01:50.283444 ip-10-0-128-243 kubenswrapper[2566]: W0615 06:01:50.283416    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod24b359f7_d13b_4e54_a722_55a2de50705f.slice/crio-b6302515476db3f19306d79ed2358eea32973abf95d1bad8d5ba1dcf9d4b5fbe WatchSource:0}: Error finding container b6302515476db3f19306d79ed2358eea32973abf95d1bad8d5ba1dcf9d4b5fbe: Status 404 returned error can't find the container with id b6302515476db3f19306d79ed2358eea32973abf95d1bad8d5ba1dcf9d4b5fbe
Jun 15 06:01:51.011307 ip-10-0-128-243 kubenswrapper[2566]: I0615 06:01:51.011266    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/scheduler-ha-replicas-test-kserve-5d7479f884-f4vfq" event={"ID":"24b359f7-d13b-4e54-a722-55a2de50705f","Type":"ContainerStarted","Data":"b6302515476db3f19306d79ed2358eea32973abf95d1bad8d5ba1dcf9d4b5fbe"}
Jun 15 06:01:52.017905 ip-10-0-128-243 kubenswrapper[2566]: I0615 06:01:52.017867    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/scheduler-ha-replicas-test-kserve-5d7479f884-f4vfq" event={"ID":"24b359f7-d13b-4e54-a722-55a2de50705f","Type":"ContainerStarted","Data":"79cbb774a5c53e08db9aac82c51bb1621869810fbecffca2460a3b5128fe8151"}
Jun 15 06:01:52.034772 ip-10-0-128-243 kubenswrapper[2566]: I0615 06:01:52.034683    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/scheduler-ha-replicas-test-kserve-5d7479f884-f4vfq" podStartSLOduration=1.952252144 podStartE2EDuration="3.034668949s" totalImagesPullingTime="1.082416805s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-15 06:01:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 06:01:52.034391839 +0000 UTC m=+794.994149106" watchObservedRunningTime="2026-06-15 06:01:52.034668949 +0000 UTC m=+794.994426193"
Jun 15 06:02:00.139305 ip-10-0-128-243 kubenswrapper[2566]: I0615 06:02:00.139202    2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kserve-ci-e2e-test/scheduler-ha-replicas-test-kserve-5d7479f884-f4vfq"
Jun 15 06:02:00.139305 ip-10-0-128-243 kubenswrapper[2566]: I0615 06:02:00.139282    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/scheduler-ha-replicas-test-kserve-5d7479f884-f4vfq"
Jun 15 06:02:00.151761 ip-10-0-128-243 kubenswrapper[2566]: I0615 06:02:00.151732    2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kserve-ci-e2e-test/scheduler-ha-replicas-test-kserve-5d7479f884-f4vfq"
Jun 15 06:02:01.074942 ip-10-0-128-243 kubenswrapper[2566]: I0615 06:02:01.074912    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/scheduler-ha-replicas-test-kserve-5d7479f884-f4vfq"
Jun 15 06:02:16.854899 ip-10-0-128-243 kubenswrapper[2566]: I0615 06:02:16.854868    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/gw-section-name-router-with-gat-2f0a622e-kserve-779977f94cgh8n6"]
Jun 15 06:02:16.857022 ip-10-0-128-243 kubenswrapper[2566]: I0615 06:02:16.856999    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/gw-section-name-router-with-gat-2f0a622e-kserve-779977f94cgh8n6"
Jun 15 06:02:16.859381 ip-10-0-128-243 kubenswrapper[2566]: I0615 06:02:16.859364    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"gw-sec0c69dceeb48768325d1a53a749e65786-kserve-self-signed-certs\""
Jun 15 06:02:16.867269 ip-10-0-128-243 kubenswrapper[2566]: I0615 06:02:16.867246    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/gw-section-name-router-with-gat-2f0a622e-kserve-779977f94cgh8n6"]
Jun 15 06:02:16.918272 ip-10-0-128-243 kubenswrapper[2566]: I0615 06:02:16.918240    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/19d98ef8-dc64-4363-875e-ddc7729aa2cf-dshm\") pod \"gw-section-name-router-with-gat-2f0a622e-kserve-779977f94cgh8n6\" (UID: \"19d98ef8-dc64-4363-875e-ddc7729aa2cf\") " pod="kserve-ci-e2e-test/gw-section-name-router-with-gat-2f0a622e-kserve-779977f94cgh8n6"
Jun 15 06:02:16.918425 ip-10-0-128-243 kubenswrapper[2566]: I0615 06:02:16.918281    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/19d98ef8-dc64-4363-875e-ddc7729aa2cf-model-cache\") pod \"gw-section-name-router-with-gat-2f0a622e-kserve-779977f94cgh8n6\" (UID: \"19d98ef8-dc64-4363-875e-ddc7729aa2cf\") " pod="kserve-ci-e2e-test/gw-section-name-router-with-gat-2f0a622e-kserve-779977f94cgh8n6"
Jun 15 06:02:16.918425 ip-10-0-128-243 kubenswrapper[2566]: I0615 06:02:16.918370    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dx4hq\" (UniqueName: \"kubernetes.io/projected/19d98ef8-dc64-4363-875e-ddc7729aa2cf-kube-api-access-dx4hq\") pod \"gw-section-name-router-with-gat-2f0a622e-kserve-779977f94cgh8n6\" (UID: \"19d98ef8-dc64-4363-875e-ddc7729aa2cf\") " pod="kserve-ci-e2e-test/gw-section-name-router-with-gat-2f0a622e-kserve-779977f94cgh8n6"
Jun 15 06:02:16.918425 ip-10-0-128-243 kubenswrapper[2566]: I0615 06:02:16.918404    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/19d98ef8-dc64-4363-875e-ddc7729aa2cf-home\") pod \"gw-section-name-router-with-gat-2f0a622e-kserve-779977f94cgh8n6\" (UID: \"19d98ef8-dc64-4363-875e-ddc7729aa2cf\") " pod="kserve-ci-e2e-test/gw-section-name-router-with-gat-2f0a622e-kserve-779977f94cgh8n6"
Jun 15 06:02:16.918425 ip-10-0-128-243 kubenswrapper[2566]: I0615 06:02:16.918421    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/19d98ef8-dc64-4363-875e-ddc7729aa2cf-tmp-dir\") pod \"gw-section-name-router-with-gat-2f0a622e-kserve-779977f94cgh8n6\" (UID: \"19d98ef8-dc64-4363-875e-ddc7729aa2cf\") " pod="kserve-ci-e2e-test/gw-section-name-router-with-gat-2f0a622e-kserve-779977f94cgh8n6"
Jun 15 06:02:16.918606 ip-10-0-128-243 kubenswrapper[2566]: I0615 06:02:16.918439    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/19d98ef8-dc64-4363-875e-ddc7729aa2cf-tls-certs\") pod \"gw-section-name-router-with-gat-2f0a622e-kserve-779977f94cgh8n6\" (UID: \"19d98ef8-dc64-4363-875e-ddc7729aa2cf\") " pod="kserve-ci-e2e-test/gw-section-name-router-with-gat-2f0a622e-kserve-779977f94cgh8n6"
Jun 15 06:02:17.019624 ip-10-0-128-243 kubenswrapper[2566]: I0615 06:02:17.019588    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dx4hq\" (UniqueName: \"kubernetes.io/projected/19d98ef8-dc64-4363-875e-ddc7729aa2cf-kube-api-access-dx4hq\") pod \"gw-section-name-router-with-gat-2f0a622e-kserve-779977f94cgh8n6\" (UID: \"19d98ef8-dc64-4363-875e-ddc7729aa2cf\") " pod="kserve-ci-e2e-test/gw-section-name-router-with-gat-2f0a622e-kserve-779977f94cgh8n6"
Jun 15 06:02:17.019791 ip-10-0-128-243 kubenswrapper[2566]: I0615 06:02:17.019632    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/19d98ef8-dc64-4363-875e-ddc7729aa2cf-home\") pod \"gw-section-name-router-with-gat-2f0a622e-kserve-779977f94cgh8n6\" (UID: \"19d98ef8-dc64-4363-875e-ddc7729aa2cf\") " pod="kserve-ci-e2e-test/gw-section-name-router-with-gat-2f0a622e-kserve-779977f94cgh8n6"
Jun 15 06:02:17.019791 ip-10-0-128-243 kubenswrapper[2566]: I0615 06:02:17.019660    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/19d98ef8-dc64-4363-875e-ddc7729aa2cf-tmp-dir\") pod \"gw-section-name-router-with-gat-2f0a622e-kserve-779977f94cgh8n6\" (UID: \"19d98ef8-dc64-4363-875e-ddc7729aa2cf\") " pod="kserve-ci-e2e-test/gw-section-name-router-with-gat-2f0a622e-kserve-779977f94cgh8n6"
Jun 15 06:02:17.019791 ip-10-0-128-243 kubenswrapper[2566]: I0615 06:02:17.019777    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/19d98ef8-dc64-4363-875e-ddc7729aa2cf-tls-certs\") pod \"gw-section-name-router-with-gat-2f0a622e-kserve-779977f94cgh8n6\" (UID: \"19d98ef8-dc64-4363-875e-ddc7729aa2cf\") " pod="kserve-ci-e2e-test/gw-section-name-router-with-gat-2f0a622e-kserve-779977f94cgh8n6"
Jun 15 06:02:17.019953 ip-10-0-128-243 kubenswrapper[2566]: I0615 06:02:17.019879    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/19d98ef8-dc64-4363-875e-ddc7729aa2cf-dshm\") pod \"gw-section-name-router-with-gat-2f0a622e-kserve-779977f94cgh8n6\" (UID: \"19d98ef8-dc64-4363-875e-ddc7729aa2cf\") " pod="kserve-ci-e2e-test/gw-section-name-router-with-gat-2f0a622e-kserve-779977f94cgh8n6"
Jun 15 06:02:17.019953 ip-10-0-128-243 kubenswrapper[2566]: I0615 06:02:17.019916    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/19d98ef8-dc64-4363-875e-ddc7729aa2cf-model-cache\") pod \"gw-section-name-router-with-gat-2f0a622e-kserve-779977f94cgh8n6\" (UID: \"19d98ef8-dc64-4363-875e-ddc7729aa2cf\") " pod="kserve-ci-e2e-test/gw-section-name-router-with-gat-2f0a622e-kserve-779977f94cgh8n6"
Jun 15 06:02:17.020167 ip-10-0-128-243 kubenswrapper[2566]: I0615 06:02:17.020148    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/19d98ef8-dc64-4363-875e-ddc7729aa2cf-tmp-dir\") pod \"gw-section-name-router-with-gat-2f0a622e-kserve-779977f94cgh8n6\" (UID: \"19d98ef8-dc64-4363-875e-ddc7729aa2cf\") " pod="kserve-ci-e2e-test/gw-section-name-router-with-gat-2f0a622e-kserve-779977f94cgh8n6"
Jun 15 06:02:17.020230 ip-10-0-128-243 kubenswrapper[2566]: I0615 06:02:17.020182    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/19d98ef8-dc64-4363-875e-ddc7729aa2cf-home\") pod \"gw-section-name-router-with-gat-2f0a622e-kserve-779977f94cgh8n6\" (UID: \"19d98ef8-dc64-4363-875e-ddc7729aa2cf\") " pod="kserve-ci-e2e-test/gw-section-name-router-with-gat-2f0a622e-kserve-779977f94cgh8n6"
Jun 15 06:02:17.020319 ip-10-0-128-243 kubenswrapper[2566]: I0615 06:02:17.020302    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/19d98ef8-dc64-4363-875e-ddc7729aa2cf-model-cache\") pod \"gw-section-name-router-with-gat-2f0a622e-kserve-779977f94cgh8n6\" (UID: \"19d98ef8-dc64-4363-875e-ddc7729aa2cf\") " pod="kserve-ci-e2e-test/gw-section-name-router-with-gat-2f0a622e-kserve-779977f94cgh8n6"
Jun 15 06:02:17.022257 ip-10-0-128-243 kubenswrapper[2566]: I0615 06:02:17.022235    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/19d98ef8-dc64-4363-875e-ddc7729aa2cf-dshm\") pod \"gw-section-name-router-with-gat-2f0a622e-kserve-779977f94cgh8n6\" (UID: \"19d98ef8-dc64-4363-875e-ddc7729aa2cf\") " pod="kserve-ci-e2e-test/gw-section-name-router-with-gat-2f0a622e-kserve-779977f94cgh8n6"
Jun 15 06:02:17.022382 ip-10-0-128-243 kubenswrapper[2566]: I0615 06:02:17.022365    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/19d98ef8-dc64-4363-875e-ddc7729aa2cf-tls-certs\") pod \"gw-section-name-router-with-gat-2f0a622e-kserve-779977f94cgh8n6\" (UID: \"19d98ef8-dc64-4363-875e-ddc7729aa2cf\") " pod="kserve-ci-e2e-test/gw-section-name-router-with-gat-2f0a622e-kserve-779977f94cgh8n6"
Jun 15 06:02:17.045017 ip-10-0-128-243 kubenswrapper[2566]: I0615 06:02:17.044994    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dx4hq\" (UniqueName: \"kubernetes.io/projected/19d98ef8-dc64-4363-875e-ddc7729aa2cf-kube-api-access-dx4hq\") pod \"gw-section-name-router-with-gat-2f0a622e-kserve-779977f94cgh8n6\" (UID: \"19d98ef8-dc64-4363-875e-ddc7729aa2cf\") " pod="kserve-ci-e2e-test/gw-section-name-router-with-gat-2f0a622e-kserve-779977f94cgh8n6"
Jun 15 06:02:17.167525 ip-10-0-128-243 kubenswrapper[2566]: I0615 06:02:17.167450    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/gw-section-name-router-with-gat-2f0a622e-kserve-779977f94cgh8n6"
Jun 15 06:02:17.309364 ip-10-0-128-243 kubenswrapper[2566]: I0615 06:02:17.309340    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/gw-section-name-router-with-gat-2f0a622e-kserve-779977f94cgh8n6"]
Jun 15 06:02:17.311244 ip-10-0-128-243 kubenswrapper[2566]: W0615 06:02:17.311221    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod19d98ef8_dc64_4363_875e_ddc7729aa2cf.slice/crio-2325e80ed983f08c7b7d8de6f6d9df9a53bdc6a2c6746e1a35b4881555235ab7 WatchSource:0}: Error finding container 2325e80ed983f08c7b7d8de6f6d9df9a53bdc6a2c6746e1a35b4881555235ab7: Status 404 returned error can't find the container with id 2325e80ed983f08c7b7d8de6f6d9df9a53bdc6a2c6746e1a35b4881555235ab7
Jun 15 06:02:18.148901 ip-10-0-128-243 kubenswrapper[2566]: I0615 06:02:18.148871    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/gw-section-name-router-with-gat-2f0a622e-kserve-779977f94cgh8n6" event={"ID":"19d98ef8-dc64-4363-875e-ddc7729aa2cf","Type":"ContainerStarted","Data":"2b5ea9afbb7b66edd3b82d197d64232d43aa3bf7afab29b50ee64c1abbc64d4e"}
Jun 15 06:02:18.149344 ip-10-0-128-243 kubenswrapper[2566]: I0615 06:02:18.148937    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/gw-section-name-router-with-gat-2f0a622e-kserve-779977f94cgh8n6" event={"ID":"19d98ef8-dc64-4363-875e-ddc7729aa2cf","Type":"ContainerStarted","Data":"2325e80ed983f08c7b7d8de6f6d9df9a53bdc6a2c6746e1a35b4881555235ab7"}
Jun 15 06:02:18.169656 ip-10-0-128-243 kubenswrapper[2566]: I0615 06:02:18.169612    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/gw-section-name-router-with-gat-2f0a622e-kserve-779977f94cgh8n6" podStartSLOduration=2.169597112 podStartE2EDuration="2.169597112s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-15 06:02:16 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 06:02:18.167469082 +0000 UTC m=+821.127226326" watchObservedRunningTime="2026-06-15 06:02:18.169597112 +0000 UTC m=+821.129354362"
Jun 15 06:02:27.167902 ip-10-0-128-243 kubenswrapper[2566]: I0615 06:02:27.167862    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/gw-section-name-router-with-gat-2f0a622e-kserve-779977f94cgh8n6"
Jun 15 06:02:27.168426 ip-10-0-128-243 kubenswrapper[2566]: I0615 06:02:27.167955    2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kserve-ci-e2e-test/gw-section-name-router-with-gat-2f0a622e-kserve-779977f94cgh8n6"
Jun 15 06:02:27.180283 ip-10-0-128-243 kubenswrapper[2566]: I0615 06:02:27.180256    2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kserve-ci-e2e-test/gw-section-name-router-with-gat-2f0a622e-kserve-779977f94cgh8n6"
Jun 15 06:02:27.211134 ip-10-0-128-243 kubenswrapper[2566]: I0615 06:02:27.211109    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/gw-section-name-router-with-gat-2f0a622e-kserve-779977f94cgh8n6"
Jun 15 06:02:53.233661 ip-10-0-128-243 kubenswrapper[2566]: I0615 06:02:53.233626    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/gw-section-name-router-with-gat-2f0a622e-kserve-779977f94cgh8n6"]
Jun 15 06:03:08.248346 ip-10-0-128-243 kubenswrapper[2566]: I0615 06:03:08.248311    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/scheduler-ha-replicas-test-kserve-5d7479f884-f4vfq"]
Jun 15 06:03:08.254450 ip-10-0-128-243 kubenswrapper[2566]: I0615 06:03:08.254397    2566 kuberuntime_container.go:872] "Killing container with a grace period" pod="kserve-ci-e2e-test/gw-section-name-router-with-gat-2f0a622e-kserve-779977f94cgh8n6" podUID="19d98ef8-dc64-4363-875e-ddc7729aa2cf" containerName="main" containerID="cri-o://2b5ea9afbb7b66edd3b82d197d64232d43aa3bf7afab29b50ee64c1abbc64d4e" gracePeriod=45
Jun 15 06:03:08.412165 ip-10-0-128-243 kubenswrapper[2566]: I0615 06:03:08.412134    2566 generic.go:356] "Generic (PLEG): container finished" podID="19d98ef8-dc64-4363-875e-ddc7729aa2cf" containerID="2b5ea9afbb7b66edd3b82d197d64232d43aa3bf7afab29b50ee64c1abbc64d4e" exitCode=0
Jun 15 06:03:08.412313 ip-10-0-128-243 kubenswrapper[2566]: I0615 06:03:08.412209    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/gw-section-name-router-with-gat-2f0a622e-kserve-779977f94cgh8n6" event={"ID":"19d98ef8-dc64-4363-875e-ddc7729aa2cf","Type":"ContainerDied","Data":"2b5ea9afbb7b66edd3b82d197d64232d43aa3bf7afab29b50ee64c1abbc64d4e"}
Jun 15 06:03:08.516354 ip-10-0-128-243 kubenswrapper[2566]: I0615 06:03:08.516334    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/gw-section-name-router-with-gat-2f0a622e-kserve-779977f94cgh8n6"
Jun 15 06:03:08.540866 ip-10-0-128-243 kubenswrapper[2566]: I0615 06:03:08.540840    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/19d98ef8-dc64-4363-875e-ddc7729aa2cf-home\") pod \"19d98ef8-dc64-4363-875e-ddc7729aa2cf\" (UID: \"19d98ef8-dc64-4363-875e-ddc7729aa2cf\") "
Jun 15 06:03:08.540988 ip-10-0-128-243 kubenswrapper[2566]: I0615 06:03:08.540911    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/19d98ef8-dc64-4363-875e-ddc7729aa2cf-dshm\") pod \"19d98ef8-dc64-4363-875e-ddc7729aa2cf\" (UID: \"19d98ef8-dc64-4363-875e-ddc7729aa2cf\") "
Jun 15 06:03:08.540988 ip-10-0-128-243 kubenswrapper[2566]: I0615 06:03:08.540942    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/19d98ef8-dc64-4363-875e-ddc7729aa2cf-tmp-dir\") pod \"19d98ef8-dc64-4363-875e-ddc7729aa2cf\" (UID: \"19d98ef8-dc64-4363-875e-ddc7729aa2cf\") "
Jun 15 06:03:08.541112 ip-10-0-128-243 kubenswrapper[2566]: I0615 06:03:08.540984    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/19d98ef8-dc64-4363-875e-ddc7729aa2cf-tls-certs\") pod \"19d98ef8-dc64-4363-875e-ddc7729aa2cf\" (UID: \"19d98ef8-dc64-4363-875e-ddc7729aa2cf\") "
Jun 15 06:03:08.541112 ip-10-0-128-243 kubenswrapper[2566]: I0615 06:03:08.541064    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/19d98ef8-dc64-4363-875e-ddc7729aa2cf-model-cache\") pod \"19d98ef8-dc64-4363-875e-ddc7729aa2cf\" (UID: \"19d98ef8-dc64-4363-875e-ddc7729aa2cf\") "
Jun 15 06:03:08.541226 ip-10-0-128-243 kubenswrapper[2566]: I0615 06:03:08.541113    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dx4hq\" (UniqueName: \"kubernetes.io/projected/19d98ef8-dc64-4363-875e-ddc7729aa2cf-kube-api-access-dx4hq\") pod \"19d98ef8-dc64-4363-875e-ddc7729aa2cf\" (UID: \"19d98ef8-dc64-4363-875e-ddc7729aa2cf\") "
Jun 15 06:03:08.541226 ip-10-0-128-243 kubenswrapper[2566]: I0615 06:03:08.541170    2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/19d98ef8-dc64-4363-875e-ddc7729aa2cf-home" (OuterVolumeSpecName: "home") pod "19d98ef8-dc64-4363-875e-ddc7729aa2cf" (UID: "19d98ef8-dc64-4363-875e-ddc7729aa2cf"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jun 15 06:03:08.541331 ip-10-0-128-243 kubenswrapper[2566]: I0615 06:03:08.541252    2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/19d98ef8-dc64-4363-875e-ddc7729aa2cf-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "19d98ef8-dc64-4363-875e-ddc7729aa2cf" (UID: "19d98ef8-dc64-4363-875e-ddc7729aa2cf"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jun 15 06:03:08.541464 ip-10-0-128-243 kubenswrapper[2566]: I0615 06:03:08.541424    2566 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/19d98ef8-dc64-4363-875e-ddc7729aa2cf-tmp-dir\") on node \"ip-10-0-128-243.ec2.internal\" DevicePath \"\""
Jun 15 06:03:08.541464 ip-10-0-128-243 kubenswrapper[2566]: I0615 06:03:08.541434    2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/19d98ef8-dc64-4363-875e-ddc7729aa2cf-model-cache" (OuterVolumeSpecName: "model-cache") pod "19d98ef8-dc64-4363-875e-ddc7729aa2cf" (UID: "19d98ef8-dc64-4363-875e-ddc7729aa2cf"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jun 15 06:03:08.541464 ip-10-0-128-243 kubenswrapper[2566]: I0615 06:03:08.541449    2566 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/19d98ef8-dc64-4363-875e-ddc7729aa2cf-home\") on node \"ip-10-0-128-243.ec2.internal\" DevicePath \"\""
Jun 15 06:03:08.543352 ip-10-0-128-243 kubenswrapper[2566]: I0615 06:03:08.543330    2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/19d98ef8-dc64-4363-875e-ddc7729aa2cf-kube-api-access-dx4hq" (OuterVolumeSpecName: "kube-api-access-dx4hq") pod "19d98ef8-dc64-4363-875e-ddc7729aa2cf" (UID: "19d98ef8-dc64-4363-875e-ddc7729aa2cf"). InnerVolumeSpecName "kube-api-access-dx4hq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jun 15 06:03:08.543572 ip-10-0-128-243 kubenswrapper[2566]: I0615 06:03:08.543551    2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/19d98ef8-dc64-4363-875e-ddc7729aa2cf-dshm" (OuterVolumeSpecName: "dshm") pod "19d98ef8-dc64-4363-875e-ddc7729aa2cf" (UID: "19d98ef8-dc64-4363-875e-ddc7729aa2cf"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jun 15 06:03:08.543572 ip-10-0-128-243 kubenswrapper[2566]: I0615 06:03:08.543557    2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/19d98ef8-dc64-4363-875e-ddc7729aa2cf-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "19d98ef8-dc64-4363-875e-ddc7729aa2cf" (UID: "19d98ef8-dc64-4363-875e-ddc7729aa2cf"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jun 15 06:03:08.642524 ip-10-0-128-243 kubenswrapper[2566]: I0615 06:03:08.642498    2566 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/19d98ef8-dc64-4363-875e-ddc7729aa2cf-model-cache\") on node \"ip-10-0-128-243.ec2.internal\" DevicePath \"\""
Jun 15 06:03:08.642524 ip-10-0-128-243 kubenswrapper[2566]: I0615 06:03:08.642524    2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dx4hq\" (UniqueName: \"kubernetes.io/projected/19d98ef8-dc64-4363-875e-ddc7729aa2cf-kube-api-access-dx4hq\") on node \"ip-10-0-128-243.ec2.internal\" DevicePath \"\""
Jun 15 06:03:08.642674 ip-10-0-128-243 kubenswrapper[2566]: I0615 06:03:08.642534    2566 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/19d98ef8-dc64-4363-875e-ddc7729aa2cf-dshm\") on node \"ip-10-0-128-243.ec2.internal\" DevicePath \"\""
Jun 15 06:03:08.642674 ip-10-0-128-243 kubenswrapper[2566]: I0615 06:03:08.642542    2566 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/19d98ef8-dc64-4363-875e-ddc7729aa2cf-tls-certs\") on node \"ip-10-0-128-243.ec2.internal\" DevicePath \"\""
Jun 15 06:03:09.418605 ip-10-0-128-243 kubenswrapper[2566]: I0615 06:03:09.418576    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/gw-section-name-router-with-gat-2f0a622e-kserve-779977f94cgh8n6"
Jun 15 06:03:09.419097 ip-10-0-128-243 kubenswrapper[2566]: I0615 06:03:09.418619    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/gw-section-name-router-with-gat-2f0a622e-kserve-779977f94cgh8n6" event={"ID":"19d98ef8-dc64-4363-875e-ddc7729aa2cf","Type":"ContainerDied","Data":"2325e80ed983f08c7b7d8de6f6d9df9a53bdc6a2c6746e1a35b4881555235ab7"}
Jun 15 06:03:09.419097 ip-10-0-128-243 kubenswrapper[2566]: I0615 06:03:09.418678    2566 scope.go:117] "RemoveContainer" containerID="2b5ea9afbb7b66edd3b82d197d64232d43aa3bf7afab29b50ee64c1abbc64d4e"
Jun 15 06:03:09.441461 ip-10-0-128-243 kubenswrapper[2566]: I0615 06:03:09.441439    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/gw-section-name-router-with-gat-2f0a622e-kserve-779977f94cgh8n6"]
Jun 15 06:03:09.446982 ip-10-0-128-243 kubenswrapper[2566]: I0615 06:03:09.446961    2566 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/gw-section-name-router-with-gat-2f0a622e-kserve-779977f94cgh8n6"]
Jun 15 06:03:11.443753 ip-10-0-128-243 kubenswrapper[2566]: I0615 06:03:11.443721    2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="19d98ef8-dc64-4363-875e-ddc7729aa2cf" path="/var/lib/kubelet/pods/19d98ef8-dc64-4363-875e-ddc7729aa2cf/volumes"
Jun 15 06:03:23.269681 ip-10-0-128-243 kubenswrapper[2566]: I0615 06:03:23.269641    2566 kuberuntime_container.go:872] "Killing container with a grace period" pod="kserve-ci-e2e-test/scheduler-ha-replicas-test-kserve-5d7479f884-f4vfq" podUID="24b359f7-d13b-4e54-a722-55a2de50705f" containerName="main" containerID="cri-o://79cbb774a5c53e08db9aac82c51bb1621869810fbecffca2460a3b5128fe8151" gracePeriod=45
Jun 15 06:03:23.489888 ip-10-0-128-243 kubenswrapper[2566]: I0615 06:03:23.489776    2566 generic.go:356] "Generic (PLEG): container finished" podID="24b359f7-d13b-4e54-a722-55a2de50705f" containerID="79cbb774a5c53e08db9aac82c51bb1621869810fbecffca2460a3b5128fe8151" exitCode=0
Jun 15 06:03:23.490022 ip-10-0-128-243 kubenswrapper[2566]: I0615 06:03:23.489882    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/scheduler-ha-replicas-test-kserve-5d7479f884-f4vfq" event={"ID":"24b359f7-d13b-4e54-a722-55a2de50705f","Type":"ContainerDied","Data":"79cbb774a5c53e08db9aac82c51bb1621869810fbecffca2460a3b5128fe8151"}
Jun 15 06:03:23.511902 ip-10-0-128-243 kubenswrapper[2566]: I0615 06:03:23.511876    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/scheduler-ha-replicas-test-kserve-5d7479f884-f4vfq"
Jun 15 06:03:23.560465 ip-10-0-128-243 kubenswrapper[2566]: I0615 06:03:23.560381    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-spd44\" (UniqueName: \"kubernetes.io/projected/24b359f7-d13b-4e54-a722-55a2de50705f-kube-api-access-spd44\") pod \"24b359f7-d13b-4e54-a722-55a2de50705f\" (UID: \"24b359f7-d13b-4e54-a722-55a2de50705f\") "
Jun 15 06:03:23.560465 ip-10-0-128-243 kubenswrapper[2566]: I0615 06:03:23.560423    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/24b359f7-d13b-4e54-a722-55a2de50705f-tmp-dir\") pod \"24b359f7-d13b-4e54-a722-55a2de50705f\" (UID: \"24b359f7-d13b-4e54-a722-55a2de50705f\") "
Jun 15 06:03:23.560655 ip-10-0-128-243 kubenswrapper[2566]: I0615 06:03:23.560551    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/24b359f7-d13b-4e54-a722-55a2de50705f-model-cache\") pod \"24b359f7-d13b-4e54-a722-55a2de50705f\" (UID: \"24b359f7-d13b-4e54-a722-55a2de50705f\") "
Jun 15 06:03:23.560655 ip-10-0-128-243 kubenswrapper[2566]: I0615 06:03:23.560597    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/24b359f7-d13b-4e54-a722-55a2de50705f-home\") pod \"24b359f7-d13b-4e54-a722-55a2de50705f\" (UID: \"24b359f7-d13b-4e54-a722-55a2de50705f\") "
Jun 15 06:03:23.560655 ip-10-0-128-243 kubenswrapper[2566]: I0615 06:03:23.560622    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/24b359f7-d13b-4e54-a722-55a2de50705f-dshm\") pod \"24b359f7-d13b-4e54-a722-55a2de50705f\" (UID: \"24b359f7-d13b-4e54-a722-55a2de50705f\") "
Jun 15 06:03:23.560655 ip-10-0-128-243 kubenswrapper[2566]: I0615 06:03:23.560642    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/24b359f7-d13b-4e54-a722-55a2de50705f-tls-certs\") pod \"24b359f7-d13b-4e54-a722-55a2de50705f\" (UID: \"24b359f7-d13b-4e54-a722-55a2de50705f\") "
Jun 15 06:03:23.560808 ip-10-0-128-243 kubenswrapper[2566]: I0615 06:03:23.560699    2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/24b359f7-d13b-4e54-a722-55a2de50705f-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "24b359f7-d13b-4e54-a722-55a2de50705f" (UID: "24b359f7-d13b-4e54-a722-55a2de50705f"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jun 15 06:03:23.560874 ip-10-0-128-243 kubenswrapper[2566]: I0615 06:03:23.560835    2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/24b359f7-d13b-4e54-a722-55a2de50705f-model-cache" (OuterVolumeSpecName: "model-cache") pod "24b359f7-d13b-4e54-a722-55a2de50705f" (UID: "24b359f7-d13b-4e54-a722-55a2de50705f"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jun 15 06:03:23.560924 ip-10-0-128-243 kubenswrapper[2566]: I0615 06:03:23.560878    2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/24b359f7-d13b-4e54-a722-55a2de50705f-home" (OuterVolumeSpecName: "home") pod "24b359f7-d13b-4e54-a722-55a2de50705f" (UID: "24b359f7-d13b-4e54-a722-55a2de50705f"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jun 15 06:03:23.560973 ip-10-0-128-243 kubenswrapper[2566]: I0615 06:03:23.560950    2566 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/24b359f7-d13b-4e54-a722-55a2de50705f-model-cache\") on node \"ip-10-0-128-243.ec2.internal\" DevicePath \"\""
Jun 15 06:03:23.560973 ip-10-0-128-243 kubenswrapper[2566]: I0615 06:03:23.560966    2566 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/24b359f7-d13b-4e54-a722-55a2de50705f-home\") on node \"ip-10-0-128-243.ec2.internal\" DevicePath \"\""
Jun 15 06:03:23.561066 ip-10-0-128-243 kubenswrapper[2566]: I0615 06:03:23.560976    2566 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/24b359f7-d13b-4e54-a722-55a2de50705f-tmp-dir\") on node \"ip-10-0-128-243.ec2.internal\" DevicePath \"\""
Jun 15 06:03:23.562713 ip-10-0-128-243 kubenswrapper[2566]: I0615 06:03:23.562686    2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/24b359f7-d13b-4e54-a722-55a2de50705f-kube-api-access-spd44" (OuterVolumeSpecName: "kube-api-access-spd44") pod "24b359f7-d13b-4e54-a722-55a2de50705f" (UID: "24b359f7-d13b-4e54-a722-55a2de50705f"). InnerVolumeSpecName "kube-api-access-spd44". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jun 15 06:03:23.562820 ip-10-0-128-243 kubenswrapper[2566]: I0615 06:03:23.562775    2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/24b359f7-d13b-4e54-a722-55a2de50705f-dshm" (OuterVolumeSpecName: "dshm") pod "24b359f7-d13b-4e54-a722-55a2de50705f" (UID: "24b359f7-d13b-4e54-a722-55a2de50705f"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jun 15 06:03:23.562859 ip-10-0-128-243 kubenswrapper[2566]: I0615 06:03:23.562813    2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/24b359f7-d13b-4e54-a722-55a2de50705f-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "24b359f7-d13b-4e54-a722-55a2de50705f" (UID: "24b359f7-d13b-4e54-a722-55a2de50705f"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jun 15 06:03:23.661870 ip-10-0-128-243 kubenswrapper[2566]: I0615 06:03:23.661816    2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-spd44\" (UniqueName: \"kubernetes.io/projected/24b359f7-d13b-4e54-a722-55a2de50705f-kube-api-access-spd44\") on node \"ip-10-0-128-243.ec2.internal\" DevicePath \"\""
Jun 15 06:03:23.661870 ip-10-0-128-243 kubenswrapper[2566]: I0615 06:03:23.661862    2566 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/24b359f7-d13b-4e54-a722-55a2de50705f-dshm\") on node \"ip-10-0-128-243.ec2.internal\" DevicePath \"\""
Jun 15 06:03:23.661870 ip-10-0-128-243 kubenswrapper[2566]: I0615 06:03:23.661874    2566 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/24b359f7-d13b-4e54-a722-55a2de50705f-tls-certs\") on node \"ip-10-0-128-243.ec2.internal\" DevicePath \"\""
Jun 15 06:03:24.496823 ip-10-0-128-243 kubenswrapper[2566]: I0615 06:03:24.496786    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/scheduler-ha-replicas-test-kserve-5d7479f884-f4vfq" event={"ID":"24b359f7-d13b-4e54-a722-55a2de50705f","Type":"ContainerDied","Data":"b6302515476db3f19306d79ed2358eea32973abf95d1bad8d5ba1dcf9d4b5fbe"}
Jun 15 06:03:24.496823 ip-10-0-128-243 kubenswrapper[2566]: I0615 06:03:24.496815    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/scheduler-ha-replicas-test-kserve-5d7479f884-f4vfq"
Jun 15 06:03:24.497311 ip-10-0-128-243 kubenswrapper[2566]: I0615 06:03:24.496860    2566 scope.go:117] "RemoveContainer" containerID="79cbb774a5c53e08db9aac82c51bb1621869810fbecffca2460a3b5128fe8151"
Jun 15 06:03:24.519012 ip-10-0-128-243 kubenswrapper[2566]: I0615 06:03:24.518978    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/scheduler-ha-replicas-test-kserve-5d7479f884-f4vfq"]
Jun 15 06:03:24.525510 ip-10-0-128-243 kubenswrapper[2566]: I0615 06:03:24.525483    2566 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/scheduler-ha-replicas-test-kserve-5d7479f884-f4vfq"]
Jun 15 06:03:25.447870 ip-10-0-128-243 kubenswrapper[2566]: I0615 06:03:25.447824    2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="24b359f7-d13b-4e54-a722-55a2de50705f" path="/var/lib/kubelet/pods/24b359f7-d13b-4e54-a722-55a2de50705f/volumes"
Jun 15 06:03:31.743306 ip-10-0-128-243 kubenswrapper[2566]: I0615 06:03:31.743272    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/scheduler-custom-template-test-kserve-96f8b89cb-j7r99"]
Jun 15 06:03:31.743777 ip-10-0-128-243 kubenswrapper[2566]: I0615 06:03:31.743754    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="19d98ef8-dc64-4363-875e-ddc7729aa2cf" containerName="main"
Jun 15 06:03:31.743777 ip-10-0-128-243 kubenswrapper[2566]: I0615 06:03:31.743773    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="19d98ef8-dc64-4363-875e-ddc7729aa2cf" containerName="main"
Jun 15 06:03:31.743899 ip-10-0-128-243 kubenswrapper[2566]: I0615 06:03:31.743789    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="24b359f7-d13b-4e54-a722-55a2de50705f" containerName="main"
Jun 15 06:03:31.743899 ip-10-0-128-243 kubenswrapper[2566]: I0615 06:03:31.743797    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="24b359f7-d13b-4e54-a722-55a2de50705f" containerName="main"
Jun 15 06:03:31.743899 ip-10-0-128-243 kubenswrapper[2566]: I0615 06:03:31.743892    2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="24b359f7-d13b-4e54-a722-55a2de50705f" containerName="main"
Jun 15 06:03:31.744038 ip-10-0-128-243 kubenswrapper[2566]: I0615 06:03:31.743905    2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="19d98ef8-dc64-4363-875e-ddc7729aa2cf" containerName="main"
Jun 15 06:03:31.745719 ip-10-0-128-243 kubenswrapper[2566]: I0615 06:03:31.745698    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/scheduler-custom-template-test-kserve-96f8b89cb-j7r99"
Jun 15 06:03:31.749334 ip-10-0-128-243 kubenswrapper[2566]: I0615 06:03:31.749308    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"scheduler-custom-template-test-kserve-self-signed-certs\""
Jun 15 06:03:31.749460 ip-10-0-128-243 kubenswrapper[2566]: I0615 06:03:31.749309    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"openshift-service-ca.crt\""
Jun 15 06:03:31.749460 ip-10-0-128-243 kubenswrapper[2566]: I0615 06:03:31.749332    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"kube-root-ca.crt\""
Jun 15 06:03:31.749583 ip-10-0-128-243 kubenswrapper[2566]: I0615 06:03:31.749344    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"default-dockercfg-fjfwp\""
Jun 15 06:03:31.757053 ip-10-0-128-243 kubenswrapper[2566]: I0615 06:03:31.757027    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/scheduler-custom-template-test-kserve-96f8b89cb-j7r99"]
Jun 15 06:03:31.831639 ip-10-0-128-243 kubenswrapper[2566]: I0615 06:03:31.831599    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/58e8237d-7f88-445b-9eab-5e008a4cbcc5-tls-certs\") pod \"scheduler-custom-template-test-kserve-96f8b89cb-j7r99\" (UID: \"58e8237d-7f88-445b-9eab-5e008a4cbcc5\") " pod="kserve-ci-e2e-test/scheduler-custom-template-test-kserve-96f8b89cb-j7r99"
Jun 15 06:03:31.831639 ip-10-0-128-243 kubenswrapper[2566]: I0615 06:03:31.831644    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/58e8237d-7f88-445b-9eab-5e008a4cbcc5-tmp-dir\") pod \"scheduler-custom-template-test-kserve-96f8b89cb-j7r99\" (UID: \"58e8237d-7f88-445b-9eab-5e008a4cbcc5\") " pod="kserve-ci-e2e-test/scheduler-custom-template-test-kserve-96f8b89cb-j7r99"
Jun 15 06:03:31.831857 ip-10-0-128-243 kubenswrapper[2566]: I0615 06:03:31.831672    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/58e8237d-7f88-445b-9eab-5e008a4cbcc5-model-cache\") pod \"scheduler-custom-template-test-kserve-96f8b89cb-j7r99\" (UID: \"58e8237d-7f88-445b-9eab-5e008a4cbcc5\") " pod="kserve-ci-e2e-test/scheduler-custom-template-test-kserve-96f8b89cb-j7r99"
Jun 15 06:03:31.831857 ip-10-0-128-243 kubenswrapper[2566]: I0615 06:03:31.831762    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/58e8237d-7f88-445b-9eab-5e008a4cbcc5-home\") pod \"scheduler-custom-template-test-kserve-96f8b89cb-j7r99\" (UID: \"58e8237d-7f88-445b-9eab-5e008a4cbcc5\") " pod="kserve-ci-e2e-test/scheduler-custom-template-test-kserve-96f8b89cb-j7r99"
Jun 15 06:03:31.831857 ip-10-0-128-243 kubenswrapper[2566]: I0615 06:03:31.831792    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-42h4t\" (UniqueName: \"kubernetes.io/projected/58e8237d-7f88-445b-9eab-5e008a4cbcc5-kube-api-access-42h4t\") pod \"scheduler-custom-template-test-kserve-96f8b89cb-j7r99\" (UID: \"58e8237d-7f88-445b-9eab-5e008a4cbcc5\") " pod="kserve-ci-e2e-test/scheduler-custom-template-test-kserve-96f8b89cb-j7r99"
Jun 15 06:03:31.831857 ip-10-0-128-243 kubenswrapper[2566]: I0615 06:03:31.831815    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/58e8237d-7f88-445b-9eab-5e008a4cbcc5-dshm\") pod \"scheduler-custom-template-test-kserve-96f8b89cb-j7r99\" (UID: \"58e8237d-7f88-445b-9eab-5e008a4cbcc5\") " pod="kserve-ci-e2e-test/scheduler-custom-template-test-kserve-96f8b89cb-j7r99"
Jun 15 06:03:31.933227 ip-10-0-128-243 kubenswrapper[2566]: I0615 06:03:31.933178    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/58e8237d-7f88-445b-9eab-5e008a4cbcc5-model-cache\") pod \"scheduler-custom-template-test-kserve-96f8b89cb-j7r99\" (UID: \"58e8237d-7f88-445b-9eab-5e008a4cbcc5\") " pod="kserve-ci-e2e-test/scheduler-custom-template-test-kserve-96f8b89cb-j7r99"
Jun 15 06:03:31.933423 ip-10-0-128-243 kubenswrapper[2566]: I0615 06:03:31.933246    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/58e8237d-7f88-445b-9eab-5e008a4cbcc5-home\") pod \"scheduler-custom-template-test-kserve-96f8b89cb-j7r99\" (UID: \"58e8237d-7f88-445b-9eab-5e008a4cbcc5\") " pod="kserve-ci-e2e-test/scheduler-custom-template-test-kserve-96f8b89cb-j7r99"
Jun 15 06:03:31.933423 ip-10-0-128-243 kubenswrapper[2566]: I0615 06:03:31.933268    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-42h4t\" (UniqueName: \"kubernetes.io/projected/58e8237d-7f88-445b-9eab-5e008a4cbcc5-kube-api-access-42h4t\") pod \"scheduler-custom-template-test-kserve-96f8b89cb-j7r99\" (UID: \"58e8237d-7f88-445b-9eab-5e008a4cbcc5\") " pod="kserve-ci-e2e-test/scheduler-custom-template-test-kserve-96f8b89cb-j7r99"
Jun 15 06:03:31.933423 ip-10-0-128-243 kubenswrapper[2566]: I0615 06:03:31.933286    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/58e8237d-7f88-445b-9eab-5e008a4cbcc5-dshm\") pod \"scheduler-custom-template-test-kserve-96f8b89cb-j7r99\" (UID: \"58e8237d-7f88-445b-9eab-5e008a4cbcc5\") " pod="kserve-ci-e2e-test/scheduler-custom-template-test-kserve-96f8b89cb-j7r99"
Jun 15 06:03:31.933423 ip-10-0-128-243 kubenswrapper[2566]: I0615 06:03:31.933317    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/58e8237d-7f88-445b-9eab-5e008a4cbcc5-tls-certs\") pod \"scheduler-custom-template-test-kserve-96f8b89cb-j7r99\" (UID: \"58e8237d-7f88-445b-9eab-5e008a4cbcc5\") " pod="kserve-ci-e2e-test/scheduler-custom-template-test-kserve-96f8b89cb-j7r99"
Jun 15 06:03:31.933423 ip-10-0-128-243 kubenswrapper[2566]: I0615 06:03:31.933348    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/58e8237d-7f88-445b-9eab-5e008a4cbcc5-tmp-dir\") pod \"scheduler-custom-template-test-kserve-96f8b89cb-j7r99\" (UID: \"58e8237d-7f88-445b-9eab-5e008a4cbcc5\") " pod="kserve-ci-e2e-test/scheduler-custom-template-test-kserve-96f8b89cb-j7r99"
Jun 15 06:03:31.933675 ip-10-0-128-243 kubenswrapper[2566]: I0615 06:03:31.933615    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/58e8237d-7f88-445b-9eab-5e008a4cbcc5-model-cache\") pod \"scheduler-custom-template-test-kserve-96f8b89cb-j7r99\" (UID: \"58e8237d-7f88-445b-9eab-5e008a4cbcc5\") " pod="kserve-ci-e2e-test/scheduler-custom-template-test-kserve-96f8b89cb-j7r99"
Jun 15 06:03:31.933716 ip-10-0-128-243 kubenswrapper[2566]: I0615 06:03:31.933670    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/58e8237d-7f88-445b-9eab-5e008a4cbcc5-home\") pod \"scheduler-custom-template-test-kserve-96f8b89cb-j7r99\" (UID: \"58e8237d-7f88-445b-9eab-5e008a4cbcc5\") " pod="kserve-ci-e2e-test/scheduler-custom-template-test-kserve-96f8b89cb-j7r99"
Jun 15 06:03:31.933753 ip-10-0-128-243 kubenswrapper[2566]: I0615 06:03:31.933719    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/58e8237d-7f88-445b-9eab-5e008a4cbcc5-tmp-dir\") pod \"scheduler-custom-template-test-kserve-96f8b89cb-j7r99\" (UID: \"58e8237d-7f88-445b-9eab-5e008a4cbcc5\") " pod="kserve-ci-e2e-test/scheduler-custom-template-test-kserve-96f8b89cb-j7r99"
Jun 15 06:03:31.935841 ip-10-0-128-243 kubenswrapper[2566]: I0615 06:03:31.935810    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/58e8237d-7f88-445b-9eab-5e008a4cbcc5-dshm\") pod \"scheduler-custom-template-test-kserve-96f8b89cb-j7r99\" (UID: \"58e8237d-7f88-445b-9eab-5e008a4cbcc5\") " pod="kserve-ci-e2e-test/scheduler-custom-template-test-kserve-96f8b89cb-j7r99"
Jun 15 06:03:31.936132 ip-10-0-128-243 kubenswrapper[2566]: I0615 06:03:31.936112    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/58e8237d-7f88-445b-9eab-5e008a4cbcc5-tls-certs\") pod \"scheduler-custom-template-test-kserve-96f8b89cb-j7r99\" (UID: \"58e8237d-7f88-445b-9eab-5e008a4cbcc5\") " pod="kserve-ci-e2e-test/scheduler-custom-template-test-kserve-96f8b89cb-j7r99"
Jun 15 06:03:31.942625 ip-10-0-128-243 kubenswrapper[2566]: I0615 06:03:31.942601    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-42h4t\" (UniqueName: \"kubernetes.io/projected/58e8237d-7f88-445b-9eab-5e008a4cbcc5-kube-api-access-42h4t\") pod \"scheduler-custom-template-test-kserve-96f8b89cb-j7r99\" (UID: \"58e8237d-7f88-445b-9eab-5e008a4cbcc5\") " pod="kserve-ci-e2e-test/scheduler-custom-template-test-kserve-96f8b89cb-j7r99"
Jun 15 06:03:32.057257 ip-10-0-128-243 kubenswrapper[2566]: I0615 06:03:32.057219    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/scheduler-custom-template-test-kserve-96f8b89cb-j7r99"
Jun 15 06:03:32.193148 ip-10-0-128-243 kubenswrapper[2566]: I0615 06:03:32.193126    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/scheduler-custom-template-test-kserve-96f8b89cb-j7r99"]
Jun 15 06:03:32.194744 ip-10-0-128-243 kubenswrapper[2566]: W0615 06:03:32.194712    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod58e8237d_7f88_445b_9eab_5e008a4cbcc5.slice/crio-75af627be3fd510143c7266dcc32f32312423dd978982fcf376f45e7d1dcc988 WatchSource:0}: Error finding container 75af627be3fd510143c7266dcc32f32312423dd978982fcf376f45e7d1dcc988: Status 404 returned error can't find the container with id 75af627be3fd510143c7266dcc32f32312423dd978982fcf376f45e7d1dcc988
Jun 15 06:03:32.538124 ip-10-0-128-243 kubenswrapper[2566]: I0615 06:03:32.538064    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/scheduler-custom-template-test-kserve-96f8b89cb-j7r99" event={"ID":"58e8237d-7f88-445b-9eab-5e008a4cbcc5","Type":"ContainerStarted","Data":"e311d8700a61d7cecdd1fdd033e979eaf39a97827dfa7f146ae26e3f58f49231"}
Jun 15 06:03:32.538316 ip-10-0-128-243 kubenswrapper[2566]: I0615 06:03:32.538134    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/scheduler-custom-template-test-kserve-96f8b89cb-j7r99" event={"ID":"58e8237d-7f88-445b-9eab-5e008a4cbcc5","Type":"ContainerStarted","Data":"75af627be3fd510143c7266dcc32f32312423dd978982fcf376f45e7d1dcc988"}
Jun 15 06:03:32.557607 ip-10-0-128-243 kubenswrapper[2566]: I0615 06:03:32.557555    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/scheduler-custom-template-test-kserve-96f8b89cb-j7r99" podStartSLOduration=1.557540435 podStartE2EDuration="1.557540435s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-15 06:03:31 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 06:03:32.555068641 +0000 UTC m=+895.514825907" watchObservedRunningTime="2026-06-15 06:03:32.557540435 +0000 UTC m=+895.517297718"
Jun 15 06:03:37.451148 ip-10-0-128-243 kubenswrapper[2566]: I0615 06:03:37.451115    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5dbbb5d744-ktjgp_67da60eb-27f9-4bbd-8d12-64275e801143/console-operator/2.log"
Jun 15 06:03:37.457419 ip-10-0-128-243 kubenswrapper[2566]: I0615 06:03:37.457394    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5dbbb5d744-ktjgp_67da60eb-27f9-4bbd-8d12-64275e801143/console-operator/2.log"
Jun 15 06:03:37.461580 ip-10-0-128-243 kubenswrapper[2566]: I0615 06:03:37.461558    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-f4bzh_5a1f8f83-55db-4fc7-872d-6b202daa0a31/ovn-acl-logging/0.log"
Jun 15 06:03:37.462537 ip-10-0-128-243 kubenswrapper[2566]: I0615 06:03:37.462514    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-f4bzh_5a1f8f83-55db-4fc7-872d-6b202daa0a31/ovn-acl-logging/0.log"
Jun 15 06:03:42.058264 ip-10-0-128-243 kubenswrapper[2566]: I0615 06:03:42.058236    2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kserve-ci-e2e-test/scheduler-custom-template-test-kserve-96f8b89cb-j7r99"
Jun 15 06:03:42.058654 ip-10-0-128-243 kubenswrapper[2566]: I0615 06:03:42.058291    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/scheduler-custom-template-test-kserve-96f8b89cb-j7r99"
Jun 15 06:03:42.070613 ip-10-0-128-243 kubenswrapper[2566]: I0615 06:03:42.070588    2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kserve-ci-e2e-test/scheduler-custom-template-test-kserve-96f8b89cb-j7r99"
Jun 15 06:03:42.598644 ip-10-0-128-243 kubenswrapper[2566]: I0615 06:03:42.598621    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/scheduler-custom-template-test-kserve-96f8b89cb-j7r99"
Jun 15 06:04:06.646623 ip-10-0-128-243 kubenswrapper[2566]: I0615 06:04:06.646588    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/scheduler-custom-template-test-kserve-96f8b89cb-j7r99"]
Jun 15 06:04:21.666971 ip-10-0-128-243 kubenswrapper[2566]: I0615 06:04:21.666928    2566 kuberuntime_container.go:872] "Killing container with a grace period" pod="kserve-ci-e2e-test/scheduler-custom-template-test-kserve-96f8b89cb-j7r99" podUID="58e8237d-7f88-445b-9eab-5e008a4cbcc5" containerName="main" containerID="cri-o://e311d8700a61d7cecdd1fdd033e979eaf39a97827dfa7f146ae26e3f58f49231" gracePeriod=45
Jun 15 06:04:21.784551 ip-10-0-128-243 kubenswrapper[2566]: I0615 06:04:21.784518    2566 generic.go:356] "Generic (PLEG): container finished" podID="58e8237d-7f88-445b-9eab-5e008a4cbcc5" containerID="e311d8700a61d7cecdd1fdd033e979eaf39a97827dfa7f146ae26e3f58f49231" exitCode=0
Jun 15 06:04:21.784669 ip-10-0-128-243 kubenswrapper[2566]: I0615 06:04:21.784579    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/scheduler-custom-template-test-kserve-96f8b89cb-j7r99" event={"ID":"58e8237d-7f88-445b-9eab-5e008a4cbcc5","Type":"ContainerDied","Data":"e311d8700a61d7cecdd1fdd033e979eaf39a97827dfa7f146ae26e3f58f49231"}
Jun 15 06:04:21.905531 ip-10-0-128-243 kubenswrapper[2566]: I0615 06:04:21.905509    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/scheduler-custom-template-test-kserve-96f8b89cb-j7r99"
Jun 15 06:04:21.941161 ip-10-0-128-243 kubenswrapper[2566]: I0615 06:04:21.941098    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/58e8237d-7f88-445b-9eab-5e008a4cbcc5-home\") pod \"58e8237d-7f88-445b-9eab-5e008a4cbcc5\" (UID: \"58e8237d-7f88-445b-9eab-5e008a4cbcc5\") "
Jun 15 06:04:21.941272 ip-10-0-128-243 kubenswrapper[2566]: I0615 06:04:21.941174    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/58e8237d-7f88-445b-9eab-5e008a4cbcc5-tmp-dir\") pod \"58e8237d-7f88-445b-9eab-5e008a4cbcc5\" (UID: \"58e8237d-7f88-445b-9eab-5e008a4cbcc5\") "
Jun 15 06:04:21.941272 ip-10-0-128-243 kubenswrapper[2566]: I0615 06:04:21.941250    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-42h4t\" (UniqueName: \"kubernetes.io/projected/58e8237d-7f88-445b-9eab-5e008a4cbcc5-kube-api-access-42h4t\") pod \"58e8237d-7f88-445b-9eab-5e008a4cbcc5\" (UID: \"58e8237d-7f88-445b-9eab-5e008a4cbcc5\") "
Jun 15 06:04:21.941358 ip-10-0-128-243 kubenswrapper[2566]: I0615 06:04:21.941271    2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/58e8237d-7f88-445b-9eab-5e008a4cbcc5-home" (OuterVolumeSpecName: "home") pod "58e8237d-7f88-445b-9eab-5e008a4cbcc5" (UID: "58e8237d-7f88-445b-9eab-5e008a4cbcc5"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jun 15 06:04:21.941358 ip-10-0-128-243 kubenswrapper[2566]: I0615 06:04:21.941284    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/58e8237d-7f88-445b-9eab-5e008a4cbcc5-tls-certs\") pod \"58e8237d-7f88-445b-9eab-5e008a4cbcc5\" (UID: \"58e8237d-7f88-445b-9eab-5e008a4cbcc5\") "
Jun 15 06:04:21.941358 ip-10-0-128-243 kubenswrapper[2566]: I0615 06:04:21.941332    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/58e8237d-7f88-445b-9eab-5e008a4cbcc5-dshm\") pod \"58e8237d-7f88-445b-9eab-5e008a4cbcc5\" (UID: \"58e8237d-7f88-445b-9eab-5e008a4cbcc5\") "
Jun 15 06:04:21.941510 ip-10-0-128-243 kubenswrapper[2566]: I0615 06:04:21.941364    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/58e8237d-7f88-445b-9eab-5e008a4cbcc5-model-cache\") pod \"58e8237d-7f88-445b-9eab-5e008a4cbcc5\" (UID: \"58e8237d-7f88-445b-9eab-5e008a4cbcc5\") "
Jun 15 06:04:21.941510 ip-10-0-128-243 kubenswrapper[2566]: I0615 06:04:21.941445    2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/58e8237d-7f88-445b-9eab-5e008a4cbcc5-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "58e8237d-7f88-445b-9eab-5e008a4cbcc5" (UID: "58e8237d-7f88-445b-9eab-5e008a4cbcc5"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jun 15 06:04:21.941658 ip-10-0-128-243 kubenswrapper[2566]: I0615 06:04:21.941637    2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/58e8237d-7f88-445b-9eab-5e008a4cbcc5-model-cache" (OuterVolumeSpecName: "model-cache") pod "58e8237d-7f88-445b-9eab-5e008a4cbcc5" (UID: "58e8237d-7f88-445b-9eab-5e008a4cbcc5"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jun 15 06:04:21.941803 ip-10-0-128-243 kubenswrapper[2566]: I0615 06:04:21.941640    2566 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/58e8237d-7f88-445b-9eab-5e008a4cbcc5-home\") on node \"ip-10-0-128-243.ec2.internal\" DevicePath \"\""
Jun 15 06:04:21.941803 ip-10-0-128-243 kubenswrapper[2566]: I0615 06:04:21.941677    2566 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/58e8237d-7f88-445b-9eab-5e008a4cbcc5-tmp-dir\") on node \"ip-10-0-128-243.ec2.internal\" DevicePath \"\""
Jun 15 06:04:21.943421 ip-10-0-128-243 kubenswrapper[2566]: I0615 06:04:21.943388    2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/58e8237d-7f88-445b-9eab-5e008a4cbcc5-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "58e8237d-7f88-445b-9eab-5e008a4cbcc5" (UID: "58e8237d-7f88-445b-9eab-5e008a4cbcc5"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jun 15 06:04:21.943513 ip-10-0-128-243 kubenswrapper[2566]: I0615 06:04:21.943471    2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/58e8237d-7f88-445b-9eab-5e008a4cbcc5-dshm" (OuterVolumeSpecName: "dshm") pod "58e8237d-7f88-445b-9eab-5e008a4cbcc5" (UID: "58e8237d-7f88-445b-9eab-5e008a4cbcc5"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jun 15 06:04:21.943783 ip-10-0-128-243 kubenswrapper[2566]: I0615 06:04:21.943768    2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/58e8237d-7f88-445b-9eab-5e008a4cbcc5-kube-api-access-42h4t" (OuterVolumeSpecName: "kube-api-access-42h4t") pod "58e8237d-7f88-445b-9eab-5e008a4cbcc5" (UID: "58e8237d-7f88-445b-9eab-5e008a4cbcc5"). InnerVolumeSpecName "kube-api-access-42h4t". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jun 15 06:04:22.042531 ip-10-0-128-243 kubenswrapper[2566]: I0615 06:04:22.042498    2566 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/58e8237d-7f88-445b-9eab-5e008a4cbcc5-tls-certs\") on node \"ip-10-0-128-243.ec2.internal\" DevicePath \"\""
Jun 15 06:04:22.042531 ip-10-0-128-243 kubenswrapper[2566]: I0615 06:04:22.042525    2566 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/58e8237d-7f88-445b-9eab-5e008a4cbcc5-dshm\") on node \"ip-10-0-128-243.ec2.internal\" DevicePath \"\""
Jun 15 06:04:22.042531 ip-10-0-128-243 kubenswrapper[2566]: I0615 06:04:22.042535    2566 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/58e8237d-7f88-445b-9eab-5e008a4cbcc5-model-cache\") on node \"ip-10-0-128-243.ec2.internal\" DevicePath \"\""
Jun 15 06:04:22.042753 ip-10-0-128-243 kubenswrapper[2566]: I0615 06:04:22.042544    2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-42h4t\" (UniqueName: \"kubernetes.io/projected/58e8237d-7f88-445b-9eab-5e008a4cbcc5-kube-api-access-42h4t\") on node \"ip-10-0-128-243.ec2.internal\" DevicePath \"\""
Jun 15 06:04:22.790340 ip-10-0-128-243 kubenswrapper[2566]: I0615 06:04:22.790308    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/scheduler-custom-template-test-kserve-96f8b89cb-j7r99"
Jun 15 06:04:22.790340 ip-10-0-128-243 kubenswrapper[2566]: I0615 06:04:22.790336    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/scheduler-custom-template-test-kserve-96f8b89cb-j7r99" event={"ID":"58e8237d-7f88-445b-9eab-5e008a4cbcc5","Type":"ContainerDied","Data":"75af627be3fd510143c7266dcc32f32312423dd978982fcf376f45e7d1dcc988"}
Jun 15 06:04:22.790873 ip-10-0-128-243 kubenswrapper[2566]: I0615 06:04:22.790410    2566 scope.go:117] "RemoveContainer" containerID="e311d8700a61d7cecdd1fdd033e979eaf39a97827dfa7f146ae26e3f58f49231"
Jun 15 06:04:22.812418 ip-10-0-128-243 kubenswrapper[2566]: I0615 06:04:22.812394    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/scheduler-custom-template-test-kserve-96f8b89cb-j7r99"]
Jun 15 06:04:22.816283 ip-10-0-128-243 kubenswrapper[2566]: I0615 06:04:22.816262    2566 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/scheduler-custom-template-test-kserve-96f8b89cb-j7r99"]
Jun 15 06:04:23.441434 ip-10-0-128-243 kubenswrapper[2566]: I0615 06:04:23.441406    2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="58e8237d-7f88-445b-9eab-5e008a4cbcc5" path="/var/lib/kubelet/pods/58e8237d-7f88-445b-9eab-5e008a4cbcc5/volumes"
Jun 15 06:05:37.640408 ip-10-0-128-243 kubenswrapper[2566]: I0615 06:05:37.640376    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/llmisvc-router-managed-test-llm-e45d1f79-kserve-598bf9c8c-g56wd"]
Jun 15 06:05:37.640938 ip-10-0-128-243 kubenswrapper[2566]: I0615 06:05:37.640663    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="58e8237d-7f88-445b-9eab-5e008a4cbcc5" containerName="main"
Jun 15 06:05:37.640938 ip-10-0-128-243 kubenswrapper[2566]: I0615 06:05:37.640674    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="58e8237d-7f88-445b-9eab-5e008a4cbcc5" containerName="main"
Jun 15 06:05:37.640938 ip-10-0-128-243 kubenswrapper[2566]: I0615 06:05:37.640739    2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="58e8237d-7f88-445b-9eab-5e008a4cbcc5" containerName="main"
Jun 15 06:05:37.643515 ip-10-0-128-243 kubenswrapper[2566]: I0615 06:05:37.643497    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/llmisvc-router-managed-test-llm-e45d1f79-kserve-598bf9c8c-g56wd"
Jun 15 06:05:37.646499 ip-10-0-128-243 kubenswrapper[2566]: I0615 06:05:37.646476    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"default-dockercfg-fjfwp\""
Jun 15 06:05:37.646499 ip-10-0-128-243 kubenswrapper[2566]: I0615 06:05:37.646493    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"llmisv5c7e67b6c51568d1d6d13829a9337f2a-kserve-self-signed-certs\""
Jun 15 06:05:37.646650 ip-10-0-128-243 kubenswrapper[2566]: I0615 06:05:37.646497    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"kube-root-ca.crt\""
Jun 15 06:05:37.646650 ip-10-0-128-243 kubenswrapper[2566]: I0615 06:05:37.646536    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"openshift-service-ca.crt\""
Jun 15 06:05:37.654750 ip-10-0-128-243 kubenswrapper[2566]: I0615 06:05:37.654726    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/llmisvc-router-managed-test-llm-e45d1f79-kserve-598bf9c8c-g56wd"]
Jun 15 06:05:37.757625 ip-10-0-128-243 kubenswrapper[2566]: I0615 06:05:37.757591    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/abf7fc6d-06ab-43de-badb-6ef68a360dd8-home\") pod \"llmisvc-router-managed-test-llm-e45d1f79-kserve-598bf9c8c-g56wd\" (UID: \"abf7fc6d-06ab-43de-badb-6ef68a360dd8\") " pod="kserve-ci-e2e-test/llmisvc-router-managed-test-llm-e45d1f79-kserve-598bf9c8c-g56wd"
Jun 15 06:05:37.757625 ip-10-0-128-243 kubenswrapper[2566]: I0615 06:05:37.757627    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/abf7fc6d-06ab-43de-badb-6ef68a360dd8-tmp-dir\") pod \"llmisvc-router-managed-test-llm-e45d1f79-kserve-598bf9c8c-g56wd\" (UID: \"abf7fc6d-06ab-43de-badb-6ef68a360dd8\") " pod="kserve-ci-e2e-test/llmisvc-router-managed-test-llm-e45d1f79-kserve-598bf9c8c-g56wd"
Jun 15 06:05:37.757879 ip-10-0-128-243 kubenswrapper[2566]: I0615 06:05:37.757652    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/abf7fc6d-06ab-43de-badb-6ef68a360dd8-tls-certs\") pod \"llmisvc-router-managed-test-llm-e45d1f79-kserve-598bf9c8c-g56wd\" (UID: \"abf7fc6d-06ab-43de-badb-6ef68a360dd8\") " pod="kserve-ci-e2e-test/llmisvc-router-managed-test-llm-e45d1f79-kserve-598bf9c8c-g56wd"
Jun 15 06:05:37.757879 ip-10-0-128-243 kubenswrapper[2566]: I0615 06:05:37.757777    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/abf7fc6d-06ab-43de-badb-6ef68a360dd8-model-cache\") pod \"llmisvc-router-managed-test-llm-e45d1f79-kserve-598bf9c8c-g56wd\" (UID: \"abf7fc6d-06ab-43de-badb-6ef68a360dd8\") " pod="kserve-ci-e2e-test/llmisvc-router-managed-test-llm-e45d1f79-kserve-598bf9c8c-g56wd"
Jun 15 06:05:37.757879 ip-10-0-128-243 kubenswrapper[2566]: I0615 06:05:37.757828    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h8lrd\" (UniqueName: \"kubernetes.io/projected/abf7fc6d-06ab-43de-badb-6ef68a360dd8-kube-api-access-h8lrd\") pod \"llmisvc-router-managed-test-llm-e45d1f79-kserve-598bf9c8c-g56wd\" (UID: \"abf7fc6d-06ab-43de-badb-6ef68a360dd8\") " pod="kserve-ci-e2e-test/llmisvc-router-managed-test-llm-e45d1f79-kserve-598bf9c8c-g56wd"
Jun 15 06:05:37.758003 ip-10-0-128-243 kubenswrapper[2566]: I0615 06:05:37.757875    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/abf7fc6d-06ab-43de-badb-6ef68a360dd8-dshm\") pod \"llmisvc-router-managed-test-llm-e45d1f79-kserve-598bf9c8c-g56wd\" (UID: \"abf7fc6d-06ab-43de-badb-6ef68a360dd8\") " pod="kserve-ci-e2e-test/llmisvc-router-managed-test-llm-e45d1f79-kserve-598bf9c8c-g56wd"
Jun 15 06:05:37.858379 ip-10-0-128-243 kubenswrapper[2566]: I0615 06:05:37.858339    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/abf7fc6d-06ab-43de-badb-6ef68a360dd8-home\") pod \"llmisvc-router-managed-test-llm-e45d1f79-kserve-598bf9c8c-g56wd\" (UID: \"abf7fc6d-06ab-43de-badb-6ef68a360dd8\") " pod="kserve-ci-e2e-test/llmisvc-router-managed-test-llm-e45d1f79-kserve-598bf9c8c-g56wd"
Jun 15 06:05:37.858566 ip-10-0-128-243 kubenswrapper[2566]: I0615 06:05:37.858393    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/abf7fc6d-06ab-43de-badb-6ef68a360dd8-tmp-dir\") pod \"llmisvc-router-managed-test-llm-e45d1f79-kserve-598bf9c8c-g56wd\" (UID: \"abf7fc6d-06ab-43de-badb-6ef68a360dd8\") " pod="kserve-ci-e2e-test/llmisvc-router-managed-test-llm-e45d1f79-kserve-598bf9c8c-g56wd"
Jun 15 06:05:37.858566 ip-10-0-128-243 kubenswrapper[2566]: I0615 06:05:37.858428    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/abf7fc6d-06ab-43de-badb-6ef68a360dd8-tls-certs\") pod \"llmisvc-router-managed-test-llm-e45d1f79-kserve-598bf9c8c-g56wd\" (UID: \"abf7fc6d-06ab-43de-badb-6ef68a360dd8\") " pod="kserve-ci-e2e-test/llmisvc-router-managed-test-llm-e45d1f79-kserve-598bf9c8c-g56wd"
Jun 15 06:05:37.858566 ip-10-0-128-243 kubenswrapper[2566]: I0615 06:05:37.858509    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/abf7fc6d-06ab-43de-badb-6ef68a360dd8-model-cache\") pod \"llmisvc-router-managed-test-llm-e45d1f79-kserve-598bf9c8c-g56wd\" (UID: \"abf7fc6d-06ab-43de-badb-6ef68a360dd8\") " pod="kserve-ci-e2e-test/llmisvc-router-managed-test-llm-e45d1f79-kserve-598bf9c8c-g56wd"
Jun 15 06:05:37.858566 ip-10-0-128-243 kubenswrapper[2566]: I0615 06:05:37.858553    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h8lrd\" (UniqueName: \"kubernetes.io/projected/abf7fc6d-06ab-43de-badb-6ef68a360dd8-kube-api-access-h8lrd\") pod \"llmisvc-router-managed-test-llm-e45d1f79-kserve-598bf9c8c-g56wd\" (UID: \"abf7fc6d-06ab-43de-badb-6ef68a360dd8\") " pod="kserve-ci-e2e-test/llmisvc-router-managed-test-llm-e45d1f79-kserve-598bf9c8c-g56wd"
Jun 15 06:05:37.858789 ip-10-0-128-243 kubenswrapper[2566]: I0615 06:05:37.858590    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/abf7fc6d-06ab-43de-badb-6ef68a360dd8-dshm\") pod \"llmisvc-router-managed-test-llm-e45d1f79-kserve-598bf9c8c-g56wd\" (UID: \"abf7fc6d-06ab-43de-badb-6ef68a360dd8\") " pod="kserve-ci-e2e-test/llmisvc-router-managed-test-llm-e45d1f79-kserve-598bf9c8c-g56wd"
Jun 15 06:05:37.858844 ip-10-0-128-243 kubenswrapper[2566]: I0615 06:05:37.858794    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/abf7fc6d-06ab-43de-badb-6ef68a360dd8-home\") pod \"llmisvc-router-managed-test-llm-e45d1f79-kserve-598bf9c8c-g56wd\" (UID: \"abf7fc6d-06ab-43de-badb-6ef68a360dd8\") " pod="kserve-ci-e2e-test/llmisvc-router-managed-test-llm-e45d1f79-kserve-598bf9c8c-g56wd"
Jun 15 06:05:37.859274 ip-10-0-128-243 kubenswrapper[2566]: I0615 06:05:37.859230    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/abf7fc6d-06ab-43de-badb-6ef68a360dd8-tmp-dir\") pod \"llmisvc-router-managed-test-llm-e45d1f79-kserve-598bf9c8c-g56wd\" (UID: \"abf7fc6d-06ab-43de-badb-6ef68a360dd8\") " pod="kserve-ci-e2e-test/llmisvc-router-managed-test-llm-e45d1f79-kserve-598bf9c8c-g56wd"
Jun 15 06:05:37.859576 ip-10-0-128-243 kubenswrapper[2566]: I0615 06:05:37.859269    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/abf7fc6d-06ab-43de-badb-6ef68a360dd8-model-cache\") pod \"llmisvc-router-managed-test-llm-e45d1f79-kserve-598bf9c8c-g56wd\" (UID: \"abf7fc6d-06ab-43de-badb-6ef68a360dd8\") " pod="kserve-ci-e2e-test/llmisvc-router-managed-test-llm-e45d1f79-kserve-598bf9c8c-g56wd"
Jun 15 06:05:37.861490 ip-10-0-128-243 kubenswrapper[2566]: I0615 06:05:37.861468    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/abf7fc6d-06ab-43de-badb-6ef68a360dd8-tls-certs\") pod \"llmisvc-router-managed-test-llm-e45d1f79-kserve-598bf9c8c-g56wd\" (UID: \"abf7fc6d-06ab-43de-badb-6ef68a360dd8\") " pod="kserve-ci-e2e-test/llmisvc-router-managed-test-llm-e45d1f79-kserve-598bf9c8c-g56wd"
Jun 15 06:05:37.861729 ip-10-0-128-243 kubenswrapper[2566]: I0615 06:05:37.861712    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/abf7fc6d-06ab-43de-badb-6ef68a360dd8-dshm\") pod \"llmisvc-router-managed-test-llm-e45d1f79-kserve-598bf9c8c-g56wd\" (UID: \"abf7fc6d-06ab-43de-badb-6ef68a360dd8\") " pod="kserve-ci-e2e-test/llmisvc-router-managed-test-llm-e45d1f79-kserve-598bf9c8c-g56wd"
Jun 15 06:05:37.870680 ip-10-0-128-243 kubenswrapper[2566]: I0615 06:05:37.870659    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-h8lrd\" (UniqueName: \"kubernetes.io/projected/abf7fc6d-06ab-43de-badb-6ef68a360dd8-kube-api-access-h8lrd\") pod \"llmisvc-router-managed-test-llm-e45d1f79-kserve-598bf9c8c-g56wd\" (UID: \"abf7fc6d-06ab-43de-badb-6ef68a360dd8\") " pod="kserve-ci-e2e-test/llmisvc-router-managed-test-llm-e45d1f79-kserve-598bf9c8c-g56wd"
Jun 15 06:05:37.955787 ip-10-0-128-243 kubenswrapper[2566]: I0615 06:05:37.955694    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/llmisvc-router-managed-test-llm-e45d1f79-kserve-598bf9c8c-g56wd"
Jun 15 06:05:38.088366 ip-10-0-128-243 kubenswrapper[2566]: I0615 06:05:38.088344    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/llmisvc-router-managed-test-llm-e45d1f79-kserve-598bf9c8c-g56wd"]
Jun 15 06:05:38.089945 ip-10-0-128-243 kubenswrapper[2566]: W0615 06:05:38.089920    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podabf7fc6d_06ab_43de_badb_6ef68a360dd8.slice/crio-c8590067ac31bc7e7df516399d41e008b063ec10ef7ca1023e9e8564b710b213 WatchSource:0}: Error finding container c8590067ac31bc7e7df516399d41e008b063ec10ef7ca1023e9e8564b710b213: Status 404 returned error can't find the container with id c8590067ac31bc7e7df516399d41e008b063ec10ef7ca1023e9e8564b710b213
Jun 15 06:05:38.162880 ip-10-0-128-243 kubenswrapper[2566]: I0615 06:05:38.162854    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/llmisvc-router-managed-test-llm-e45d1f79-kserve-598bf9c8c-g56wd" event={"ID":"abf7fc6d-06ab-43de-badb-6ef68a360dd8","Type":"ContainerStarted","Data":"95e5c058ef744fbf3e1b2a3f0e320514e783671a421176ad331640a1d5972731"}
Jun 15 06:05:38.162987 ip-10-0-128-243 kubenswrapper[2566]: I0615 06:05:38.162913    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/llmisvc-router-managed-test-llm-e45d1f79-kserve-598bf9c8c-g56wd" event={"ID":"abf7fc6d-06ab-43de-badb-6ef68a360dd8","Type":"ContainerStarted","Data":"c8590067ac31bc7e7df516399d41e008b063ec10ef7ca1023e9e8564b710b213"}
Jun 15 06:05:38.183844 ip-10-0-128-243 kubenswrapper[2566]: I0615 06:05:38.183796    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/llmisvc-router-managed-test-llm-e45d1f79-kserve-598bf9c8c-g56wd" podStartSLOduration=1.183781679 podStartE2EDuration="1.183781679s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-15 06:05:37 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 06:05:38.181368893 +0000 UTC m=+1021.141126138" watchObservedRunningTime="2026-06-15 06:05:38.183781679 +0000 UTC m=+1021.143538924"
Jun 15 06:05:47.956497 ip-10-0-128-243 kubenswrapper[2566]: I0615 06:05:47.956463    2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kserve-ci-e2e-test/llmisvc-router-managed-test-llm-e45d1f79-kserve-598bf9c8c-g56wd"
Jun 15 06:05:47.956997 ip-10-0-128-243 kubenswrapper[2566]: I0615 06:05:47.956529    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/llmisvc-router-managed-test-llm-e45d1f79-kserve-598bf9c8c-g56wd"
Jun 15 06:05:47.969003 ip-10-0-128-243 kubenswrapper[2566]: I0615 06:05:47.968970    2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kserve-ci-e2e-test/llmisvc-router-managed-test-llm-e45d1f79-kserve-598bf9c8c-g56wd"
Jun 15 06:05:48.223302 ip-10-0-128-243 kubenswrapper[2566]: I0615 06:05:48.223221    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/llmisvc-router-managed-test-llm-e45d1f79-kserve-598bf9c8c-g56wd"
Jun 15 06:06:11.067293 ip-10-0-128-243 kubenswrapper[2566]: I0615 06:06:11.067256    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/llmisvc-router-managed-test-llm-e45d1f79-kserve-598bf9c8c-g56wd"]
Jun 15 06:06:26.087613 ip-10-0-128-243 kubenswrapper[2566]: I0615 06:06:26.087513    2566 kuberuntime_container.go:872] "Killing container with a grace period" pod="kserve-ci-e2e-test/llmisvc-router-managed-test-llm-e45d1f79-kserve-598bf9c8c-g56wd" podUID="abf7fc6d-06ab-43de-badb-6ef68a360dd8" containerName="main" containerID="cri-o://95e5c058ef744fbf3e1b2a3f0e320514e783671a421176ad331640a1d5972731" gracePeriod=45
Jun 15 06:06:26.326750 ip-10-0-128-243 kubenswrapper[2566]: I0615 06:06:26.326729    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/llmisvc-router-managed-test-llm-e45d1f79-kserve-598bf9c8c-g56wd"
Jun 15 06:06:26.337985 ip-10-0-128-243 kubenswrapper[2566]: I0615 06:06:26.337934    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/abf7fc6d-06ab-43de-badb-6ef68a360dd8-home\") pod \"abf7fc6d-06ab-43de-badb-6ef68a360dd8\" (UID: \"abf7fc6d-06ab-43de-badb-6ef68a360dd8\") "
Jun 15 06:06:26.338107 ip-10-0-128-243 kubenswrapper[2566]: I0615 06:06:26.337990    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/abf7fc6d-06ab-43de-badb-6ef68a360dd8-tmp-dir\") pod \"abf7fc6d-06ab-43de-badb-6ef68a360dd8\" (UID: \"abf7fc6d-06ab-43de-badb-6ef68a360dd8\") "
Jun 15 06:06:26.338107 ip-10-0-128-243 kubenswrapper[2566]: I0615 06:06:26.338015    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/abf7fc6d-06ab-43de-badb-6ef68a360dd8-dshm\") pod \"abf7fc6d-06ab-43de-badb-6ef68a360dd8\" (UID: \"abf7fc6d-06ab-43de-badb-6ef68a360dd8\") "
Jun 15 06:06:26.338107 ip-10-0-128-243 kubenswrapper[2566]: I0615 06:06:26.338038    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-h8lrd\" (UniqueName: \"kubernetes.io/projected/abf7fc6d-06ab-43de-badb-6ef68a360dd8-kube-api-access-h8lrd\") pod \"abf7fc6d-06ab-43de-badb-6ef68a360dd8\" (UID: \"abf7fc6d-06ab-43de-badb-6ef68a360dd8\") "
Jun 15 06:06:26.338107 ip-10-0-128-243 kubenswrapper[2566]: I0615 06:06:26.338054    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/abf7fc6d-06ab-43de-badb-6ef68a360dd8-model-cache\") pod \"abf7fc6d-06ab-43de-badb-6ef68a360dd8\" (UID: \"abf7fc6d-06ab-43de-badb-6ef68a360dd8\") "
Jun 15 06:06:26.338107 ip-10-0-128-243 kubenswrapper[2566]: I0615 06:06:26.338095    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/abf7fc6d-06ab-43de-badb-6ef68a360dd8-tls-certs\") pod \"abf7fc6d-06ab-43de-badb-6ef68a360dd8\" (UID: \"abf7fc6d-06ab-43de-badb-6ef68a360dd8\") "
Jun 15 06:06:26.338587 ip-10-0-128-243 kubenswrapper[2566]: I0615 06:06:26.338244    2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/abf7fc6d-06ab-43de-badb-6ef68a360dd8-home" (OuterVolumeSpecName: "home") pod "abf7fc6d-06ab-43de-badb-6ef68a360dd8" (UID: "abf7fc6d-06ab-43de-badb-6ef68a360dd8"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jun 15 06:06:26.338587 ip-10-0-128-243 kubenswrapper[2566]: I0615 06:06:26.338358    2566 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/abf7fc6d-06ab-43de-badb-6ef68a360dd8-home\") on node \"ip-10-0-128-243.ec2.internal\" DevicePath \"\""
Jun 15 06:06:26.338587 ip-10-0-128-243 kubenswrapper[2566]: I0615 06:06:26.338384    2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/abf7fc6d-06ab-43de-badb-6ef68a360dd8-model-cache" (OuterVolumeSpecName: "model-cache") pod "abf7fc6d-06ab-43de-badb-6ef68a360dd8" (UID: "abf7fc6d-06ab-43de-badb-6ef68a360dd8"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jun 15 06:06:26.338587 ip-10-0-128-243 kubenswrapper[2566]: I0615 06:06:26.338402    2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/abf7fc6d-06ab-43de-badb-6ef68a360dd8-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "abf7fc6d-06ab-43de-badb-6ef68a360dd8" (UID: "abf7fc6d-06ab-43de-badb-6ef68a360dd8"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jun 15 06:06:26.340368 ip-10-0-128-243 kubenswrapper[2566]: I0615 06:06:26.340345    2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/abf7fc6d-06ab-43de-badb-6ef68a360dd8-kube-api-access-h8lrd" (OuterVolumeSpecName: "kube-api-access-h8lrd") pod "abf7fc6d-06ab-43de-badb-6ef68a360dd8" (UID: "abf7fc6d-06ab-43de-badb-6ef68a360dd8"). InnerVolumeSpecName "kube-api-access-h8lrd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jun 15 06:06:26.340446 ip-10-0-128-243 kubenswrapper[2566]: I0615 06:06:26.340366    2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/abf7fc6d-06ab-43de-badb-6ef68a360dd8-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "abf7fc6d-06ab-43de-badb-6ef68a360dd8" (UID: "abf7fc6d-06ab-43de-badb-6ef68a360dd8"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jun 15 06:06:26.340446 ip-10-0-128-243 kubenswrapper[2566]: I0615 06:06:26.340408    2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/abf7fc6d-06ab-43de-badb-6ef68a360dd8-dshm" (OuterVolumeSpecName: "dshm") pod "abf7fc6d-06ab-43de-badb-6ef68a360dd8" (UID: "abf7fc6d-06ab-43de-badb-6ef68a360dd8"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jun 15 06:06:26.421964 ip-10-0-128-243 kubenswrapper[2566]: I0615 06:06:26.421925    2566 generic.go:356] "Generic (PLEG): container finished" podID="abf7fc6d-06ab-43de-badb-6ef68a360dd8" containerID="95e5c058ef744fbf3e1b2a3f0e320514e783671a421176ad331640a1d5972731" exitCode=0
Jun 15 06:06:26.422141 ip-10-0-128-243 kubenswrapper[2566]: I0615 06:06:26.421975    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/llmisvc-router-managed-test-llm-e45d1f79-kserve-598bf9c8c-g56wd"
Jun 15 06:06:26.422141 ip-10-0-128-243 kubenswrapper[2566]: I0615 06:06:26.422016    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/llmisvc-router-managed-test-llm-e45d1f79-kserve-598bf9c8c-g56wd" event={"ID":"abf7fc6d-06ab-43de-badb-6ef68a360dd8","Type":"ContainerDied","Data":"95e5c058ef744fbf3e1b2a3f0e320514e783671a421176ad331640a1d5972731"}
Jun 15 06:06:26.422141 ip-10-0-128-243 kubenswrapper[2566]: I0615 06:06:26.422070    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/llmisvc-router-managed-test-llm-e45d1f79-kserve-598bf9c8c-g56wd" event={"ID":"abf7fc6d-06ab-43de-badb-6ef68a360dd8","Type":"ContainerDied","Data":"c8590067ac31bc7e7df516399d41e008b063ec10ef7ca1023e9e8564b710b213"}
Jun 15 06:06:26.422141 ip-10-0-128-243 kubenswrapper[2566]: I0615 06:06:26.422109    2566 scope.go:117] "RemoveContainer" containerID="95e5c058ef744fbf3e1b2a3f0e320514e783671a421176ad331640a1d5972731"
Jun 15 06:06:26.431545 ip-10-0-128-243 kubenswrapper[2566]: I0615 06:06:26.431529    2566 scope.go:117] "RemoveContainer" containerID="95e5c058ef744fbf3e1b2a3f0e320514e783671a421176ad331640a1d5972731"
Jun 15 06:06:26.431781 ip-10-0-128-243 kubenswrapper[2566]: E0615 06:06:26.431761    2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"95e5c058ef744fbf3e1b2a3f0e320514e783671a421176ad331640a1d5972731\": container with ID starting with 95e5c058ef744fbf3e1b2a3f0e320514e783671a421176ad331640a1d5972731 not found: ID does not exist" containerID="95e5c058ef744fbf3e1b2a3f0e320514e783671a421176ad331640a1d5972731"
Jun 15 06:06:26.431836 ip-10-0-128-243 kubenswrapper[2566]: I0615 06:06:26.431790    2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"95e5c058ef744fbf3e1b2a3f0e320514e783671a421176ad331640a1d5972731"} err="failed to get container status \"95e5c058ef744fbf3e1b2a3f0e320514e783671a421176ad331640a1d5972731\": rpc error: code = NotFound desc = could not find container \"95e5c058ef744fbf3e1b2a3f0e320514e783671a421176ad331640a1d5972731\": container with ID starting with 95e5c058ef744fbf3e1b2a3f0e320514e783671a421176ad331640a1d5972731 not found: ID does not exist"
Jun 15 06:06:26.439683 ip-10-0-128-243 kubenswrapper[2566]: I0615 06:06:26.439665    2566 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/abf7fc6d-06ab-43de-badb-6ef68a360dd8-tls-certs\") on node \"ip-10-0-128-243.ec2.internal\" DevicePath \"\""
Jun 15 06:06:26.439768 ip-10-0-128-243 kubenswrapper[2566]: I0615 06:06:26.439686    2566 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/abf7fc6d-06ab-43de-badb-6ef68a360dd8-tmp-dir\") on node \"ip-10-0-128-243.ec2.internal\" DevicePath \"\""
Jun 15 06:06:26.439768 ip-10-0-128-243 kubenswrapper[2566]: I0615 06:06:26.439695    2566 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/abf7fc6d-06ab-43de-badb-6ef68a360dd8-dshm\") on node \"ip-10-0-128-243.ec2.internal\" DevicePath \"\""
Jun 15 06:06:26.439768 ip-10-0-128-243 kubenswrapper[2566]: I0615 06:06:26.439703    2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-h8lrd\" (UniqueName: \"kubernetes.io/projected/abf7fc6d-06ab-43de-badb-6ef68a360dd8-kube-api-access-h8lrd\") on node \"ip-10-0-128-243.ec2.internal\" DevicePath \"\""
Jun 15 06:06:26.439768 ip-10-0-128-243 kubenswrapper[2566]: I0615 06:06:26.439713    2566 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/abf7fc6d-06ab-43de-badb-6ef68a360dd8-model-cache\") on node \"ip-10-0-128-243.ec2.internal\" DevicePath \"\""
Jun 15 06:06:26.444148 ip-10-0-128-243 kubenswrapper[2566]: I0615 06:06:26.444127    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/llmisvc-router-managed-test-llm-e45d1f79-kserve-598bf9c8c-g56wd"]
Jun 15 06:06:26.448479 ip-10-0-128-243 kubenswrapper[2566]: I0615 06:06:26.448457    2566 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/llmisvc-router-managed-test-llm-e45d1f79-kserve-598bf9c8c-g56wd"]
Jun 15 06:06:27.441462 ip-10-0-128-243 kubenswrapper[2566]: I0615 06:06:27.441431    2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="abf7fc6d-06ab-43de-badb-6ef68a360dd8" path="/var/lib/kubelet/pods/abf7fc6d-06ab-43de-badb-6ef68a360dd8/volumes"
Jun 15 06:06:39.147562 ip-10-0-128-243 kubenswrapper[2566]: I0615 06:06:39.147530    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/llmisvc-router-managed-test-llm-5b1e8f15-kserve-7c5bd57d44b7wp8"]
Jun 15 06:06:39.147968 ip-10-0-128-243 kubenswrapper[2566]: I0615 06:06:39.147884    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="abf7fc6d-06ab-43de-badb-6ef68a360dd8" containerName="main"
Jun 15 06:06:39.147968 ip-10-0-128-243 kubenswrapper[2566]: I0615 06:06:39.147898    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="abf7fc6d-06ab-43de-badb-6ef68a360dd8" containerName="main"
Jun 15 06:06:39.147968 ip-10-0-128-243 kubenswrapper[2566]: I0615 06:06:39.147968    2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="abf7fc6d-06ab-43de-badb-6ef68a360dd8" containerName="main"
Jun 15 06:06:39.151952 ip-10-0-128-243 kubenswrapper[2566]: I0615 06:06:39.151933    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/llmisvc-router-managed-test-llm-5b1e8f15-kserve-7c5bd57d44b7wp8"
Jun 15 06:06:39.155192 ip-10-0-128-243 kubenswrapper[2566]: I0615 06:06:39.155161    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"kube-root-ca.crt\""
Jun 15 06:06:39.155312 ip-10-0-128-243 kubenswrapper[2566]: I0615 06:06:39.155164    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"default-dockercfg-fjfwp\""
Jun 15 06:06:39.155312 ip-10-0-128-243 kubenswrapper[2566]: I0615 06:06:39.155166    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"openshift-service-ca.crt\""
Jun 15 06:06:39.155312 ip-10-0-128-243 kubenswrapper[2566]: I0615 06:06:39.155167    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"llmisve55ae740357a3a31a27cdb8b66ffe20f-kserve-self-signed-certs\""
Jun 15 06:06:39.161550 ip-10-0-128-243 kubenswrapper[2566]: I0615 06:06:39.161441    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/llmisvc-router-managed-test-llm-5b1e8f15-kserve-7c5bd57d44b7wp8"]
Jun 15 06:06:39.239928 ip-10-0-128-243 kubenswrapper[2566]: I0615 06:06:39.239905    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/be8770ba-8db8-4a0c-99b7-a16c4f499392-dshm\") pod \"llmisvc-router-managed-test-llm-5b1e8f15-kserve-7c5bd57d44b7wp8\" (UID: \"be8770ba-8db8-4a0c-99b7-a16c4f499392\") " pod="kserve-ci-e2e-test/llmisvc-router-managed-test-llm-5b1e8f15-kserve-7c5bd57d44b7wp8"
Jun 15 06:06:39.240058 ip-10-0-128-243 kubenswrapper[2566]: I0615 06:06:39.239935    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/be8770ba-8db8-4a0c-99b7-a16c4f499392-model-cache\") pod \"llmisvc-router-managed-test-llm-5b1e8f15-kserve-7c5bd57d44b7wp8\" (UID: \"be8770ba-8db8-4a0c-99b7-a16c4f499392\") " pod="kserve-ci-e2e-test/llmisvc-router-managed-test-llm-5b1e8f15-kserve-7c5bd57d44b7wp8"
Jun 15 06:06:39.240058 ip-10-0-128-243 kubenswrapper[2566]: I0615 06:06:39.239974    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-82nwf\" (UniqueName: \"kubernetes.io/projected/be8770ba-8db8-4a0c-99b7-a16c4f499392-kube-api-access-82nwf\") pod \"llmisvc-router-managed-test-llm-5b1e8f15-kserve-7c5bd57d44b7wp8\" (UID: \"be8770ba-8db8-4a0c-99b7-a16c4f499392\") " pod="kserve-ci-e2e-test/llmisvc-router-managed-test-llm-5b1e8f15-kserve-7c5bd57d44b7wp8"
Jun 15 06:06:39.240058 ip-10-0-128-243 kubenswrapper[2566]: I0615 06:06:39.240032    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/be8770ba-8db8-4a0c-99b7-a16c4f499392-home\") pod \"llmisvc-router-managed-test-llm-5b1e8f15-kserve-7c5bd57d44b7wp8\" (UID: \"be8770ba-8db8-4a0c-99b7-a16c4f499392\") " pod="kserve-ci-e2e-test/llmisvc-router-managed-test-llm-5b1e8f15-kserve-7c5bd57d44b7wp8"
Jun 15 06:06:39.240210 ip-10-0-128-243 kubenswrapper[2566]: I0615 06:06:39.240076    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/be8770ba-8db8-4a0c-99b7-a16c4f499392-tls-certs\") pod \"llmisvc-router-managed-test-llm-5b1e8f15-kserve-7c5bd57d44b7wp8\" (UID: \"be8770ba-8db8-4a0c-99b7-a16c4f499392\") " pod="kserve-ci-e2e-test/llmisvc-router-managed-test-llm-5b1e8f15-kserve-7c5bd57d44b7wp8"
Jun 15 06:06:39.240210 ip-10-0-128-243 kubenswrapper[2566]: I0615 06:06:39.240130    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/be8770ba-8db8-4a0c-99b7-a16c4f499392-tmp-dir\") pod \"llmisvc-router-managed-test-llm-5b1e8f15-kserve-7c5bd57d44b7wp8\" (UID: \"be8770ba-8db8-4a0c-99b7-a16c4f499392\") " pod="kserve-ci-e2e-test/llmisvc-router-managed-test-llm-5b1e8f15-kserve-7c5bd57d44b7wp8"
Jun 15 06:06:39.340793 ip-10-0-128-243 kubenswrapper[2566]: I0615 06:06:39.340762    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/be8770ba-8db8-4a0c-99b7-a16c4f499392-tmp-dir\") pod \"llmisvc-router-managed-test-llm-5b1e8f15-kserve-7c5bd57d44b7wp8\" (UID: \"be8770ba-8db8-4a0c-99b7-a16c4f499392\") " pod="kserve-ci-e2e-test/llmisvc-router-managed-test-llm-5b1e8f15-kserve-7c5bd57d44b7wp8"
Jun 15 06:06:39.340895 ip-10-0-128-243 kubenswrapper[2566]: I0615 06:06:39.340806    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/be8770ba-8db8-4a0c-99b7-a16c4f499392-dshm\") pod \"llmisvc-router-managed-test-llm-5b1e8f15-kserve-7c5bd57d44b7wp8\" (UID: \"be8770ba-8db8-4a0c-99b7-a16c4f499392\") " pod="kserve-ci-e2e-test/llmisvc-router-managed-test-llm-5b1e8f15-kserve-7c5bd57d44b7wp8"
Jun 15 06:06:39.340895 ip-10-0-128-243 kubenswrapper[2566]: I0615 06:06:39.340825    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/be8770ba-8db8-4a0c-99b7-a16c4f499392-model-cache\") pod \"llmisvc-router-managed-test-llm-5b1e8f15-kserve-7c5bd57d44b7wp8\" (UID: \"be8770ba-8db8-4a0c-99b7-a16c4f499392\") " pod="kserve-ci-e2e-test/llmisvc-router-managed-test-llm-5b1e8f15-kserve-7c5bd57d44b7wp8"
Jun 15 06:06:39.340895 ip-10-0-128-243 kubenswrapper[2566]: I0615 06:06:39.340858    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-82nwf\" (UniqueName: \"kubernetes.io/projected/be8770ba-8db8-4a0c-99b7-a16c4f499392-kube-api-access-82nwf\") pod \"llmisvc-router-managed-test-llm-5b1e8f15-kserve-7c5bd57d44b7wp8\" (UID: \"be8770ba-8db8-4a0c-99b7-a16c4f499392\") " pod="kserve-ci-e2e-test/llmisvc-router-managed-test-llm-5b1e8f15-kserve-7c5bd57d44b7wp8"
Jun 15 06:06:39.340895 ip-10-0-128-243 kubenswrapper[2566]: I0615 06:06:39.340883    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/be8770ba-8db8-4a0c-99b7-a16c4f499392-home\") pod \"llmisvc-router-managed-test-llm-5b1e8f15-kserve-7c5bd57d44b7wp8\" (UID: \"be8770ba-8db8-4a0c-99b7-a16c4f499392\") " pod="kserve-ci-e2e-test/llmisvc-router-managed-test-llm-5b1e8f15-kserve-7c5bd57d44b7wp8"
Jun 15 06:06:39.341043 ip-10-0-128-243 kubenswrapper[2566]: I0615 06:06:39.340911    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/be8770ba-8db8-4a0c-99b7-a16c4f499392-tls-certs\") pod \"llmisvc-router-managed-test-llm-5b1e8f15-kserve-7c5bd57d44b7wp8\" (UID: \"be8770ba-8db8-4a0c-99b7-a16c4f499392\") " pod="kserve-ci-e2e-test/llmisvc-router-managed-test-llm-5b1e8f15-kserve-7c5bd57d44b7wp8"
Jun 15 06:06:39.341289 ip-10-0-128-243 kubenswrapper[2566]: I0615 06:06:39.341267    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/be8770ba-8db8-4a0c-99b7-a16c4f499392-model-cache\") pod \"llmisvc-router-managed-test-llm-5b1e8f15-kserve-7c5bd57d44b7wp8\" (UID: \"be8770ba-8db8-4a0c-99b7-a16c4f499392\") " pod="kserve-ci-e2e-test/llmisvc-router-managed-test-llm-5b1e8f15-kserve-7c5bd57d44b7wp8"
Jun 15 06:06:39.341369 ip-10-0-128-243 kubenswrapper[2566]: I0615 06:06:39.341287    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/be8770ba-8db8-4a0c-99b7-a16c4f499392-tmp-dir\") pod \"llmisvc-router-managed-test-llm-5b1e8f15-kserve-7c5bd57d44b7wp8\" (UID: \"be8770ba-8db8-4a0c-99b7-a16c4f499392\") " pod="kserve-ci-e2e-test/llmisvc-router-managed-test-llm-5b1e8f15-kserve-7c5bd57d44b7wp8"
Jun 15 06:06:39.341369 ip-10-0-128-243 kubenswrapper[2566]: I0615 06:06:39.341357    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/be8770ba-8db8-4a0c-99b7-a16c4f499392-home\") pod \"llmisvc-router-managed-test-llm-5b1e8f15-kserve-7c5bd57d44b7wp8\" (UID: \"be8770ba-8db8-4a0c-99b7-a16c4f499392\") " pod="kserve-ci-e2e-test/llmisvc-router-managed-test-llm-5b1e8f15-kserve-7c5bd57d44b7wp8"
Jun 15 06:06:39.343097 ip-10-0-128-243 kubenswrapper[2566]: I0615 06:06:39.343067    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/be8770ba-8db8-4a0c-99b7-a16c4f499392-dshm\") pod \"llmisvc-router-managed-test-llm-5b1e8f15-kserve-7c5bd57d44b7wp8\" (UID: \"be8770ba-8db8-4a0c-99b7-a16c4f499392\") " pod="kserve-ci-e2e-test/llmisvc-router-managed-test-llm-5b1e8f15-kserve-7c5bd57d44b7wp8"
Jun 15 06:06:39.343425 ip-10-0-128-243 kubenswrapper[2566]: I0615 06:06:39.343409    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/be8770ba-8db8-4a0c-99b7-a16c4f499392-tls-certs\") pod \"llmisvc-router-managed-test-llm-5b1e8f15-kserve-7c5bd57d44b7wp8\" (UID: \"be8770ba-8db8-4a0c-99b7-a16c4f499392\") " pod="kserve-ci-e2e-test/llmisvc-router-managed-test-llm-5b1e8f15-kserve-7c5bd57d44b7wp8"
Jun 15 06:06:39.353625 ip-10-0-128-243 kubenswrapper[2566]: I0615 06:06:39.353604    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-82nwf\" (UniqueName: \"kubernetes.io/projected/be8770ba-8db8-4a0c-99b7-a16c4f499392-kube-api-access-82nwf\") pod \"llmisvc-router-managed-test-llm-5b1e8f15-kserve-7c5bd57d44b7wp8\" (UID: \"be8770ba-8db8-4a0c-99b7-a16c4f499392\") " pod="kserve-ci-e2e-test/llmisvc-router-managed-test-llm-5b1e8f15-kserve-7c5bd57d44b7wp8"
Jun 15 06:06:39.462704 ip-10-0-128-243 kubenswrapper[2566]: I0615 06:06:39.462627    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/llmisvc-router-managed-test-llm-5b1e8f15-kserve-7c5bd57d44b7wp8"
Jun 15 06:06:39.593013 ip-10-0-128-243 kubenswrapper[2566]: I0615 06:06:39.592986    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/llmisvc-router-managed-test-llm-5b1e8f15-kserve-7c5bd57d44b7wp8"]
Jun 15 06:06:39.594798 ip-10-0-128-243 kubenswrapper[2566]: W0615 06:06:39.594771    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbe8770ba_8db8_4a0c_99b7_a16c4f499392.slice/crio-580d75f817dcd4eebce6e3b75386e411a4259fc2f9fd1adf170216036dc7544b WatchSource:0}: Error finding container 580d75f817dcd4eebce6e3b75386e411a4259fc2f9fd1adf170216036dc7544b: Status 404 returned error can't find the container with id 580d75f817dcd4eebce6e3b75386e411a4259fc2f9fd1adf170216036dc7544b
Jun 15 06:06:40.491934 ip-10-0-128-243 kubenswrapper[2566]: I0615 06:06:40.491895    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/llmisvc-router-managed-test-llm-5b1e8f15-kserve-7c5bd57d44b7wp8" event={"ID":"be8770ba-8db8-4a0c-99b7-a16c4f499392","Type":"ContainerStarted","Data":"cfc86b1647130920b0fede877a2100ac2a0ef189a788249428d22f85aa834abd"}
Jun 15 06:06:40.492347 ip-10-0-128-243 kubenswrapper[2566]: I0615 06:06:40.491953    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/llmisvc-router-managed-test-llm-5b1e8f15-kserve-7c5bd57d44b7wp8" event={"ID":"be8770ba-8db8-4a0c-99b7-a16c4f499392","Type":"ContainerStarted","Data":"580d75f817dcd4eebce6e3b75386e411a4259fc2f9fd1adf170216036dc7544b"}
Jun 15 06:06:40.509727 ip-10-0-128-243 kubenswrapper[2566]: I0615 06:06:40.509680    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/llmisvc-router-managed-test-llm-5b1e8f15-kserve-7c5bd57d44b7wp8" podStartSLOduration=1.5096674970000001 podStartE2EDuration="1.509667497s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-15 06:06:39 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 06:06:40.507871124 +0000 UTC m=+1083.467628384" watchObservedRunningTime="2026-06-15 06:06:40.509667497 +0000 UTC m=+1083.469424742"
Jun 15 06:06:49.463389 ip-10-0-128-243 kubenswrapper[2566]: I0615 06:06:49.463359    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/llmisvc-router-managed-test-llm-5b1e8f15-kserve-7c5bd57d44b7wp8"
Jun 15 06:06:49.463834 ip-10-0-128-243 kubenswrapper[2566]: I0615 06:06:49.463428    2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kserve-ci-e2e-test/llmisvc-router-managed-test-llm-5b1e8f15-kserve-7c5bd57d44b7wp8"
Jun 15 06:06:49.475936 ip-10-0-128-243 kubenswrapper[2566]: I0615 06:06:49.475915    2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kserve-ci-e2e-test/llmisvc-router-managed-test-llm-5b1e8f15-kserve-7c5bd57d44b7wp8"
Jun 15 06:06:49.546320 ip-10-0-128-243 kubenswrapper[2566]: I0615 06:06:49.546293    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/llmisvc-router-managed-test-llm-5b1e8f15-kserve-7c5bd57d44b7wp8"
Jun 15 06:08:37.488394 ip-10-0-128-243 kubenswrapper[2566]: I0615 06:08:37.488363    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5dbbb5d744-ktjgp_67da60eb-27f9-4bbd-8d12-64275e801143/console-operator/2.log"
Jun 15 06:08:37.491150 ip-10-0-128-243 kubenswrapper[2566]: I0615 06:08:37.491129    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5dbbb5d744-ktjgp_67da60eb-27f9-4bbd-8d12-64275e801143/console-operator/2.log"
Jun 15 06:08:37.493613 ip-10-0-128-243 kubenswrapper[2566]: I0615 06:08:37.493592    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-f4bzh_5a1f8f83-55db-4fc7-872d-6b202daa0a31/ovn-acl-logging/0.log"
Jun 15 06:08:37.498926 ip-10-0-128-243 kubenswrapper[2566]: I0615 06:08:37.498910    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-f4bzh_5a1f8f83-55db-4fc7-872d-6b202daa0a31/ovn-acl-logging/0.log"
Jun 15 06:13:37.523273 ip-10-0-128-243 kubenswrapper[2566]: I0615 06:13:37.523243    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5dbbb5d744-ktjgp_67da60eb-27f9-4bbd-8d12-64275e801143/console-operator/2.log"
Jun 15 06:13:37.528708 ip-10-0-128-243 kubenswrapper[2566]: I0615 06:13:37.528677    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5dbbb5d744-ktjgp_67da60eb-27f9-4bbd-8d12-64275e801143/console-operator/2.log"
Jun 15 06:13:37.528934 ip-10-0-128-243 kubenswrapper[2566]: I0615 06:13:37.528914    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-f4bzh_5a1f8f83-55db-4fc7-872d-6b202daa0a31/ovn-acl-logging/0.log"
Jun 15 06:13:37.534322 ip-10-0-128-243 kubenswrapper[2566]: I0615 06:13:37.534306    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-f4bzh_5a1f8f83-55db-4fc7-872d-6b202daa0a31/ovn-acl-logging/0.log"
Jun 15 06:18:37.559935 ip-10-0-128-243 kubenswrapper[2566]: I0615 06:18:37.559838    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5dbbb5d744-ktjgp_67da60eb-27f9-4bbd-8d12-64275e801143/console-operator/2.log"
Jun 15 06:18:37.566788 ip-10-0-128-243 kubenswrapper[2566]: I0615 06:18:37.565550    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-f4bzh_5a1f8f83-55db-4fc7-872d-6b202daa0a31/ovn-acl-logging/0.log"
Jun 15 06:18:37.572542 ip-10-0-128-243 kubenswrapper[2566]: I0615 06:18:37.572523    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5dbbb5d744-ktjgp_67da60eb-27f9-4bbd-8d12-64275e801143/console-operator/2.log"
Jun 15 06:18:37.577863 ip-10-0-128-243 kubenswrapper[2566]: I0615 06:18:37.577848    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-f4bzh_5a1f8f83-55db-4fc7-872d-6b202daa0a31/ovn-acl-logging/0.log"
Jun 15 06:23:37.593751 ip-10-0-128-243 kubenswrapper[2566]: I0615 06:23:37.593638    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5dbbb5d744-ktjgp_67da60eb-27f9-4bbd-8d12-64275e801143/console-operator/2.log"
Jun 15 06:23:37.600327 ip-10-0-128-243 kubenswrapper[2566]: I0615 06:23:37.600304    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-f4bzh_5a1f8f83-55db-4fc7-872d-6b202daa0a31/ovn-acl-logging/0.log"
Jun 15 06:23:37.608641 ip-10-0-128-243 kubenswrapper[2566]: I0615 06:23:37.608623    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5dbbb5d744-ktjgp_67da60eb-27f9-4bbd-8d12-64275e801143/console-operator/2.log"
Jun 15 06:23:37.613589 ip-10-0-128-243 kubenswrapper[2566]: I0615 06:23:37.613573    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-f4bzh_5a1f8f83-55db-4fc7-872d-6b202daa0a31/ovn-acl-logging/0.log"
Jun 15 06:24:07.531108 ip-10-0-128-243 kubenswrapper[2566]: I0615 06:24:07.531063    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-e95b1dc1-kserve-76859b4cd44w7x4"]
Jun 15 06:24:07.534287 ip-10-0-128-243 kubenswrapper[2566]: I0615 06:24:07.534271    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-e95b1dc1-kserve-76859b4cd44w7x4"
Jun 15 06:24:07.536720 ip-10-0-128-243 kubenswrapper[2566]: I0615 06:24:07.536698    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"llmisv122f03714c5bdf915a2917fdf1262b98-kserve-self-signed-certs\""
Jun 15 06:24:07.546022 ip-10-0-128-243 kubenswrapper[2566]: I0615 06:24:07.546001    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-e95b1dc1-kserve-76859b4cd44w7x4"]
Jun 15 06:24:07.626489 ip-10-0-128-243 kubenswrapper[2566]: I0615 06:24:07.626456    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2f38dae1-448f-4cf5-82df-9f7de187fea6-tmp-dir\") pod \"llmisvc-model-fb-opt-125m-route-e95b1dc1-kserve-76859b4cd44w7x4\" (UID: \"2f38dae1-448f-4cf5-82df-9f7de187fea6\") " pod="kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-e95b1dc1-kserve-76859b4cd44w7x4"
Jun 15 06:24:07.626656 ip-10-0-128-243 kubenswrapper[2566]: I0615 06:24:07.626516    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mprwc\" (UniqueName: \"kubernetes.io/projected/2f38dae1-448f-4cf5-82df-9f7de187fea6-kube-api-access-mprwc\") pod \"llmisvc-model-fb-opt-125m-route-e95b1dc1-kserve-76859b4cd44w7x4\" (UID: \"2f38dae1-448f-4cf5-82df-9f7de187fea6\") " pod="kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-e95b1dc1-kserve-76859b4cd44w7x4"
Jun 15 06:24:07.626656 ip-10-0-128-243 kubenswrapper[2566]: I0615 06:24:07.626555    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2f38dae1-448f-4cf5-82df-9f7de187fea6-model-cache\") pod \"llmisvc-model-fb-opt-125m-route-e95b1dc1-kserve-76859b4cd44w7x4\" (UID: \"2f38dae1-448f-4cf5-82df-9f7de187fea6\") " pod="kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-e95b1dc1-kserve-76859b4cd44w7x4"
Jun 15 06:24:07.626656 ip-10-0-128-243 kubenswrapper[2566]: I0615 06:24:07.626574    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2f38dae1-448f-4cf5-82df-9f7de187fea6-home\") pod \"llmisvc-model-fb-opt-125m-route-e95b1dc1-kserve-76859b4cd44w7x4\" (UID: \"2f38dae1-448f-4cf5-82df-9f7de187fea6\") " pod="kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-e95b1dc1-kserve-76859b4cd44w7x4"
Jun 15 06:24:07.626656 ip-10-0-128-243 kubenswrapper[2566]: I0615 06:24:07.626605    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2f38dae1-448f-4cf5-82df-9f7de187fea6-dshm\") pod \"llmisvc-model-fb-opt-125m-route-e95b1dc1-kserve-76859b4cd44w7x4\" (UID: \"2f38dae1-448f-4cf5-82df-9f7de187fea6\") " pod="kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-e95b1dc1-kserve-76859b4cd44w7x4"
Jun 15 06:24:07.626656 ip-10-0-128-243 kubenswrapper[2566]: I0615 06:24:07.626652    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2f38dae1-448f-4cf5-82df-9f7de187fea6-tls-certs\") pod \"llmisvc-model-fb-opt-125m-route-e95b1dc1-kserve-76859b4cd44w7x4\" (UID: \"2f38dae1-448f-4cf5-82df-9f7de187fea6\") " pod="kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-e95b1dc1-kserve-76859b4cd44w7x4"
Jun 15 06:24:07.727767 ip-10-0-128-243 kubenswrapper[2566]: I0615 06:24:07.727729    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mprwc\" (UniqueName: \"kubernetes.io/projected/2f38dae1-448f-4cf5-82df-9f7de187fea6-kube-api-access-mprwc\") pod \"llmisvc-model-fb-opt-125m-route-e95b1dc1-kserve-76859b4cd44w7x4\" (UID: \"2f38dae1-448f-4cf5-82df-9f7de187fea6\") " pod="kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-e95b1dc1-kserve-76859b4cd44w7x4"
Jun 15 06:24:07.727956 ip-10-0-128-243 kubenswrapper[2566]: I0615 06:24:07.727789    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2f38dae1-448f-4cf5-82df-9f7de187fea6-model-cache\") pod \"llmisvc-model-fb-opt-125m-route-e95b1dc1-kserve-76859b4cd44w7x4\" (UID: \"2f38dae1-448f-4cf5-82df-9f7de187fea6\") " pod="kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-e95b1dc1-kserve-76859b4cd44w7x4"
Jun 15 06:24:07.727956 ip-10-0-128-243 kubenswrapper[2566]: I0615 06:24:07.727813    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2f38dae1-448f-4cf5-82df-9f7de187fea6-home\") pod \"llmisvc-model-fb-opt-125m-route-e95b1dc1-kserve-76859b4cd44w7x4\" (UID: \"2f38dae1-448f-4cf5-82df-9f7de187fea6\") " pod="kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-e95b1dc1-kserve-76859b4cd44w7x4"
Jun 15 06:24:07.727956 ip-10-0-128-243 kubenswrapper[2566]: I0615 06:24:07.727830    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2f38dae1-448f-4cf5-82df-9f7de187fea6-dshm\") pod \"llmisvc-model-fb-opt-125m-route-e95b1dc1-kserve-76859b4cd44w7x4\" (UID: \"2f38dae1-448f-4cf5-82df-9f7de187fea6\") " pod="kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-e95b1dc1-kserve-76859b4cd44w7x4"
Jun 15 06:24:07.728155 ip-10-0-128-243 kubenswrapper[2566]: I0615 06:24:07.727969    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2f38dae1-448f-4cf5-82df-9f7de187fea6-tls-certs\") pod \"llmisvc-model-fb-opt-125m-route-e95b1dc1-kserve-76859b4cd44w7x4\" (UID: \"2f38dae1-448f-4cf5-82df-9f7de187fea6\") " pod="kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-e95b1dc1-kserve-76859b4cd44w7x4"
Jun 15 06:24:07.728155 ip-10-0-128-243 kubenswrapper[2566]: I0615 06:24:07.728019    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2f38dae1-448f-4cf5-82df-9f7de187fea6-tmp-dir\") pod \"llmisvc-model-fb-opt-125m-route-e95b1dc1-kserve-76859b4cd44w7x4\" (UID: \"2f38dae1-448f-4cf5-82df-9f7de187fea6\") " pod="kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-e95b1dc1-kserve-76859b4cd44w7x4"
Jun 15 06:24:07.728339 ip-10-0-128-243 kubenswrapper[2566]: I0615 06:24:07.728320    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2f38dae1-448f-4cf5-82df-9f7de187fea6-model-cache\") pod \"llmisvc-model-fb-opt-125m-route-e95b1dc1-kserve-76859b4cd44w7x4\" (UID: \"2f38dae1-448f-4cf5-82df-9f7de187fea6\") " pod="kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-e95b1dc1-kserve-76859b4cd44w7x4"
Jun 15 06:24:07.728410 ip-10-0-128-243 kubenswrapper[2566]: I0615 06:24:07.728368    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2f38dae1-448f-4cf5-82df-9f7de187fea6-home\") pod \"llmisvc-model-fb-opt-125m-route-e95b1dc1-kserve-76859b4cd44w7x4\" (UID: \"2f38dae1-448f-4cf5-82df-9f7de187fea6\") " pod="kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-e95b1dc1-kserve-76859b4cd44w7x4"
Jun 15 06:24:07.728410 ip-10-0-128-243 kubenswrapper[2566]: I0615 06:24:07.728391    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2f38dae1-448f-4cf5-82df-9f7de187fea6-tmp-dir\") pod \"llmisvc-model-fb-opt-125m-route-e95b1dc1-kserve-76859b4cd44w7x4\" (UID: \"2f38dae1-448f-4cf5-82df-9f7de187fea6\") " pod="kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-e95b1dc1-kserve-76859b4cd44w7x4"
Jun 15 06:24:07.730205 ip-10-0-128-243 kubenswrapper[2566]: I0615 06:24:07.730184    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2f38dae1-448f-4cf5-82df-9f7de187fea6-dshm\") pod \"llmisvc-model-fb-opt-125m-route-e95b1dc1-kserve-76859b4cd44w7x4\" (UID: \"2f38dae1-448f-4cf5-82df-9f7de187fea6\") " pod="kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-e95b1dc1-kserve-76859b4cd44w7x4"
Jun 15 06:24:07.730565 ip-10-0-128-243 kubenswrapper[2566]: I0615 06:24:07.730543    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2f38dae1-448f-4cf5-82df-9f7de187fea6-tls-certs\") pod \"llmisvc-model-fb-opt-125m-route-e95b1dc1-kserve-76859b4cd44w7x4\" (UID: \"2f38dae1-448f-4cf5-82df-9f7de187fea6\") " pod="kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-e95b1dc1-kserve-76859b4cd44w7x4"
Jun 15 06:24:07.736670 ip-10-0-128-243 kubenswrapper[2566]: I0615 06:24:07.736642    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mprwc\" (UniqueName: \"kubernetes.io/projected/2f38dae1-448f-4cf5-82df-9f7de187fea6-kube-api-access-mprwc\") pod \"llmisvc-model-fb-opt-125m-route-e95b1dc1-kserve-76859b4cd44w7x4\" (UID: \"2f38dae1-448f-4cf5-82df-9f7de187fea6\") " pod="kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-e95b1dc1-kserve-76859b4cd44w7x4"
Jun 15 06:24:07.845752 ip-10-0-128-243 kubenswrapper[2566]: I0615 06:24:07.845671    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-e95b1dc1-kserve-76859b4cd44w7x4"
Jun 15 06:24:07.983327 ip-10-0-128-243 kubenswrapper[2566]: I0615 06:24:07.983299    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-e95b1dc1-kserve-76859b4cd44w7x4"]
Jun 15 06:24:07.984682 ip-10-0-128-243 kubenswrapper[2566]: W0615 06:24:07.984653    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2f38dae1_448f_4cf5_82df_9f7de187fea6.slice/crio-731cc8bc63f3b447f36d6da910e7c1fa3295ef13cf11c6370ae3d33badb24863 WatchSource:0}: Error finding container 731cc8bc63f3b447f36d6da910e7c1fa3295ef13cf11c6370ae3d33badb24863: Status 404 returned error can't find the container with id 731cc8bc63f3b447f36d6da910e7c1fa3295ef13cf11c6370ae3d33badb24863
Jun 15 06:24:08.751406 ip-10-0-128-243 kubenswrapper[2566]: I0615 06:24:08.751369    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-e95b1dc1-kserve-76859b4cd44w7x4" event={"ID":"2f38dae1-448f-4cf5-82df-9f7de187fea6","Type":"ContainerStarted","Data":"4c8a52816da8179fd5dab54a23bc804400035b0ecded610aee87606709dc579b"}
Jun 15 06:24:08.751860 ip-10-0-128-243 kubenswrapper[2566]: I0615 06:24:08.751450    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-e95b1dc1-kserve-76859b4cd44w7x4" event={"ID":"2f38dae1-448f-4cf5-82df-9f7de187fea6","Type":"ContainerStarted","Data":"731cc8bc63f3b447f36d6da910e7c1fa3295ef13cf11c6370ae3d33badb24863"}
Jun 15 06:24:08.769933 ip-10-0-128-243 kubenswrapper[2566]: I0615 06:24:08.769885    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-e95b1dc1-kserve-76859b4cd44w7x4" podStartSLOduration=1.7698706180000001 podStartE2EDuration="1.769870618s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-15 06:24:07 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 06:24:08.768703972 +0000 UTC m=+2131.728461255" watchObservedRunningTime="2026-06-15 06:24:08.769870618 +0000 UTC m=+2131.729627863"
Jun 15 06:24:17.845798 ip-10-0-128-243 kubenswrapper[2566]: I0615 06:24:17.845763    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-e95b1dc1-kserve-76859b4cd44w7x4"
Jun 15 06:24:17.846299 ip-10-0-128-243 kubenswrapper[2566]: I0615 06:24:17.845829    2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-e95b1dc1-kserve-76859b4cd44w7x4"
Jun 15 06:24:17.858628 ip-10-0-128-243 kubenswrapper[2566]: I0615 06:24:17.858605    2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-e95b1dc1-kserve-76859b4cd44w7x4"
Jun 15 06:24:18.813822 ip-10-0-128-243 kubenswrapper[2566]: I0615 06:24:18.813784    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-e95b1dc1-kserve-76859b4cd44w7x4"
Jun 15 06:24:19.579998 ip-10-0-128-243 kubenswrapper[2566]: I0615 06:24:19.579966    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-e95b1dc1-kserve-76859b4cd44w7x4"]
Jun 15 06:24:19.926759 ip-10-0-128-243 kubenswrapper[2566]: E0615 06:24:19.926660    2566 secret.go:189] Couldn't get secret kserve-ci-e2e-test/llmisv122f03714c5bdf915a2917fdf1262b98-kserve-self-signed-certs: secret "llmisv122f03714c5bdf915a2917fdf1262b98-kserve-self-signed-certs" not found
Jun 15 06:24:19.926759 ip-10-0-128-243 kubenswrapper[2566]: E0615 06:24:19.926742    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2f38dae1-448f-4cf5-82df-9f7de187fea6-tls-certs podName:2f38dae1-448f-4cf5-82df-9f7de187fea6 nodeName:}" failed. No retries permitted until 2026-06-15 06:24:20.426725883 +0000 UTC m=+2143.386483106 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certs" (UniqueName: "kubernetes.io/secret/2f38dae1-448f-4cf5-82df-9f7de187fea6-tls-certs") pod "llmisvc-model-fb-opt-125m-route-e95b1dc1-kserve-76859b4cd44w7x4" (UID: "2f38dae1-448f-4cf5-82df-9f7de187fea6") : secret "llmisv122f03714c5bdf915a2917fdf1262b98-kserve-self-signed-certs" not found
Jun 15 06:24:20.430771 ip-10-0-128-243 kubenswrapper[2566]: E0615 06:24:20.430736    2566 secret.go:189] Couldn't get secret kserve-ci-e2e-test/llmisv122f03714c5bdf915a2917fdf1262b98-kserve-self-signed-certs: secret "llmisv122f03714c5bdf915a2917fdf1262b98-kserve-self-signed-certs" not found
Jun 15 06:24:20.430952 ip-10-0-128-243 kubenswrapper[2566]: E0615 06:24:20.430818    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2f38dae1-448f-4cf5-82df-9f7de187fea6-tls-certs podName:2f38dae1-448f-4cf5-82df-9f7de187fea6 nodeName:}" failed. No retries permitted until 2026-06-15 06:24:21.430804987 +0000 UTC m=+2144.390562210 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "tls-certs" (UniqueName: "kubernetes.io/secret/2f38dae1-448f-4cf5-82df-9f7de187fea6-tls-certs") pod "llmisvc-model-fb-opt-125m-route-e95b1dc1-kserve-76859b4cd44w7x4" (UID: "2f38dae1-448f-4cf5-82df-9f7de187fea6") : secret "llmisv122f03714c5bdf915a2917fdf1262b98-kserve-self-signed-certs" not found
Jun 15 06:24:21.438884 ip-10-0-128-243 kubenswrapper[2566]: E0615 06:24:21.438840    2566 secret.go:189] Couldn't get secret kserve-ci-e2e-test/llmisv122f03714c5bdf915a2917fdf1262b98-kserve-self-signed-certs: secret "llmisv122f03714c5bdf915a2917fdf1262b98-kserve-self-signed-certs" not found
Jun 15 06:24:21.439301 ip-10-0-128-243 kubenswrapper[2566]: E0615 06:24:21.438975    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2f38dae1-448f-4cf5-82df-9f7de187fea6-tls-certs podName:2f38dae1-448f-4cf5-82df-9f7de187fea6 nodeName:}" failed. No retries permitted until 2026-06-15 06:24:23.438951523 +0000 UTC m=+2146.398708798 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "tls-certs" (UniqueName: "kubernetes.io/secret/2f38dae1-448f-4cf5-82df-9f7de187fea6-tls-certs") pod "llmisvc-model-fb-opt-125m-route-e95b1dc1-kserve-76859b4cd44w7x4" (UID: "2f38dae1-448f-4cf5-82df-9f7de187fea6") : secret "llmisv122f03714c5bdf915a2917fdf1262b98-kserve-self-signed-certs" not found
Jun 15 06:24:23.456990 ip-10-0-128-243 kubenswrapper[2566]: E0615 06:24:23.456960    2566 secret.go:189] Couldn't get secret kserve-ci-e2e-test/llmisv122f03714c5bdf915a2917fdf1262b98-kserve-self-signed-certs: secret "llmisv122f03714c5bdf915a2917fdf1262b98-kserve-self-signed-certs" not found
Jun 15 06:24:23.457395 ip-10-0-128-243 kubenswrapper[2566]: E0615 06:24:23.457019    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2f38dae1-448f-4cf5-82df-9f7de187fea6-tls-certs podName:2f38dae1-448f-4cf5-82df-9f7de187fea6 nodeName:}" failed. No retries permitted until 2026-06-15 06:24:27.457006214 +0000 UTC m=+2150.416763437 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "tls-certs" (UniqueName: "kubernetes.io/secret/2f38dae1-448f-4cf5-82df-9f7de187fea6-tls-certs") pod "llmisvc-model-fb-opt-125m-route-e95b1dc1-kserve-76859b4cd44w7x4" (UID: "2f38dae1-448f-4cf5-82df-9f7de187fea6") : secret "llmisv122f03714c5bdf915a2917fdf1262b98-kserve-self-signed-certs" not found
Jun 15 06:24:27.491636 ip-10-0-128-243 kubenswrapper[2566]: E0615 06:24:27.491555    2566 secret.go:189] Couldn't get secret kserve-ci-e2e-test/llmisv122f03714c5bdf915a2917fdf1262b98-kserve-self-signed-certs: secret "llmisv122f03714c5bdf915a2917fdf1262b98-kserve-self-signed-certs" not found
Jun 15 06:24:27.491636 ip-10-0-128-243 kubenswrapper[2566]: E0615 06:24:27.491620    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2f38dae1-448f-4cf5-82df-9f7de187fea6-tls-certs podName:2f38dae1-448f-4cf5-82df-9f7de187fea6 nodeName:}" failed. No retries permitted until 2026-06-15 06:24:35.491606238 +0000 UTC m=+2158.451363461 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "tls-certs" (UniqueName: "kubernetes.io/secret/2f38dae1-448f-4cf5-82df-9f7de187fea6-tls-certs") pod "llmisvc-model-fb-opt-125m-route-e95b1dc1-kserve-76859b4cd44w7x4" (UID: "2f38dae1-448f-4cf5-82df-9f7de187fea6") : secret "llmisv122f03714c5bdf915a2917fdf1262b98-kserve-self-signed-certs" not found
Jun 15 06:24:35.563909 ip-10-0-128-243 kubenswrapper[2566]: E0615 06:24:35.563876    2566 secret.go:189] Couldn't get secret kserve-ci-e2e-test/llmisv122f03714c5bdf915a2917fdf1262b98-kserve-self-signed-certs: secret "llmisv122f03714c5bdf915a2917fdf1262b98-kserve-self-signed-certs" not found
Jun 15 06:24:35.564311 ip-10-0-128-243 kubenswrapper[2566]: E0615 06:24:35.563944    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2f38dae1-448f-4cf5-82df-9f7de187fea6-tls-certs podName:2f38dae1-448f-4cf5-82df-9f7de187fea6 nodeName:}" failed. No retries permitted until 2026-06-15 06:24:51.56392986 +0000 UTC m=+2174.523687083 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "tls-certs" (UniqueName: "kubernetes.io/secret/2f38dae1-448f-4cf5-82df-9f7de187fea6-tls-certs") pod "llmisvc-model-fb-opt-125m-route-e95b1dc1-kserve-76859b4cd44w7x4" (UID: "2f38dae1-448f-4cf5-82df-9f7de187fea6") : secret "llmisv122f03714c5bdf915a2917fdf1262b98-kserve-self-signed-certs" not found
Jun 15 06:24:35.833588 ip-10-0-128-243 kubenswrapper[2566]: I0615 06:24:35.833496    2566 kuberuntime_container.go:872] "Killing container with a grace period" pod="kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-e95b1dc1-kserve-76859b4cd44w7x4" podUID="2f38dae1-448f-4cf5-82df-9f7de187fea6" containerName="main" containerID="cri-o://4c8a52816da8179fd5dab54a23bc804400035b0ecded610aee87606709dc579b" gracePeriod=45
Jun 15 06:24:36.084270 ip-10-0-128-243 kubenswrapper[2566]: I0615 06:24:36.084215    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-e95b1dc1-kserve-76859b4cd44w7x4"
Jun 15 06:24:36.269580 ip-10-0-128-243 kubenswrapper[2566]: I0615 06:24:36.269550    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2f38dae1-448f-4cf5-82df-9f7de187fea6-model-cache\") pod \"2f38dae1-448f-4cf5-82df-9f7de187fea6\" (UID: \"2f38dae1-448f-4cf5-82df-9f7de187fea6\") "
Jun 15 06:24:36.269773 ip-10-0-128-243 kubenswrapper[2566]: I0615 06:24:36.269620    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mprwc\" (UniqueName: \"kubernetes.io/projected/2f38dae1-448f-4cf5-82df-9f7de187fea6-kube-api-access-mprwc\") pod \"2f38dae1-448f-4cf5-82df-9f7de187fea6\" (UID: \"2f38dae1-448f-4cf5-82df-9f7de187fea6\") "
Jun 15 06:24:36.269773 ip-10-0-128-243 kubenswrapper[2566]: I0615 06:24:36.269653    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2f38dae1-448f-4cf5-82df-9f7de187fea6-tls-certs\") pod \"2f38dae1-448f-4cf5-82df-9f7de187fea6\" (UID: \"2f38dae1-448f-4cf5-82df-9f7de187fea6\") "
Jun 15 06:24:36.269773 ip-10-0-128-243 kubenswrapper[2566]: I0615 06:24:36.269681    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2f38dae1-448f-4cf5-82df-9f7de187fea6-home\") pod \"2f38dae1-448f-4cf5-82df-9f7de187fea6\" (UID: \"2f38dae1-448f-4cf5-82df-9f7de187fea6\") "
Jun 15 06:24:36.269773 ip-10-0-128-243 kubenswrapper[2566]: I0615 06:24:36.269698    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2f38dae1-448f-4cf5-82df-9f7de187fea6-dshm\") pod \"2f38dae1-448f-4cf5-82df-9f7de187fea6\" (UID: \"2f38dae1-448f-4cf5-82df-9f7de187fea6\") "
Jun 15 06:24:36.269773 ip-10-0-128-243 kubenswrapper[2566]: I0615 06:24:36.269727    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2f38dae1-448f-4cf5-82df-9f7de187fea6-tmp-dir\") pod \"2f38dae1-448f-4cf5-82df-9f7de187fea6\" (UID: \"2f38dae1-448f-4cf5-82df-9f7de187fea6\") "
Jun 15 06:24:36.270038 ip-10-0-128-243 kubenswrapper[2566]: I0615 06:24:36.269887    2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2f38dae1-448f-4cf5-82df-9f7de187fea6-model-cache" (OuterVolumeSpecName: "model-cache") pod "2f38dae1-448f-4cf5-82df-9f7de187fea6" (UID: "2f38dae1-448f-4cf5-82df-9f7de187fea6"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jun 15 06:24:36.270133 ip-10-0-128-243 kubenswrapper[2566]: I0615 06:24:36.270003    2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2f38dae1-448f-4cf5-82df-9f7de187fea6-home" (OuterVolumeSpecName: "home") pod "2f38dae1-448f-4cf5-82df-9f7de187fea6" (UID: "2f38dae1-448f-4cf5-82df-9f7de187fea6"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jun 15 06:24:36.270133 ip-10-0-128-243 kubenswrapper[2566]: I0615 06:24:36.270072    2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2f38dae1-448f-4cf5-82df-9f7de187fea6-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "2f38dae1-448f-4cf5-82df-9f7de187fea6" (UID: "2f38dae1-448f-4cf5-82df-9f7de187fea6"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jun 15 06:24:36.272014 ip-10-0-128-243 kubenswrapper[2566]: I0615 06:24:36.271989    2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2f38dae1-448f-4cf5-82df-9f7de187fea6-kube-api-access-mprwc" (OuterVolumeSpecName: "kube-api-access-mprwc") pod "2f38dae1-448f-4cf5-82df-9f7de187fea6" (UID: "2f38dae1-448f-4cf5-82df-9f7de187fea6"). InnerVolumeSpecName "kube-api-access-mprwc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jun 15 06:24:36.272145 ip-10-0-128-243 kubenswrapper[2566]: I0615 06:24:36.271987    2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2f38dae1-448f-4cf5-82df-9f7de187fea6-dshm" (OuterVolumeSpecName: "dshm") pod "2f38dae1-448f-4cf5-82df-9f7de187fea6" (UID: "2f38dae1-448f-4cf5-82df-9f7de187fea6"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jun 15 06:24:36.272145 ip-10-0-128-243 kubenswrapper[2566]: I0615 06:24:36.272076    2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2f38dae1-448f-4cf5-82df-9f7de187fea6-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "2f38dae1-448f-4cf5-82df-9f7de187fea6" (UID: "2f38dae1-448f-4cf5-82df-9f7de187fea6"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jun 15 06:24:36.371200 ip-10-0-128-243 kubenswrapper[2566]: I0615 06:24:36.371120    2566 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2f38dae1-448f-4cf5-82df-9f7de187fea6-home\") on node \"ip-10-0-128-243.ec2.internal\" DevicePath \"\""
Jun 15 06:24:36.371200 ip-10-0-128-243 kubenswrapper[2566]: I0615 06:24:36.371143    2566 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2f38dae1-448f-4cf5-82df-9f7de187fea6-dshm\") on node \"ip-10-0-128-243.ec2.internal\" DevicePath \"\""
Jun 15 06:24:36.371200 ip-10-0-128-243 kubenswrapper[2566]: I0615 06:24:36.371151    2566 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2f38dae1-448f-4cf5-82df-9f7de187fea6-tmp-dir\") on node \"ip-10-0-128-243.ec2.internal\" DevicePath \"\""
Jun 15 06:24:36.371200 ip-10-0-128-243 kubenswrapper[2566]: I0615 06:24:36.371161    2566 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2f38dae1-448f-4cf5-82df-9f7de187fea6-model-cache\") on node \"ip-10-0-128-243.ec2.internal\" DevicePath \"\""
Jun 15 06:24:36.371200 ip-10-0-128-243 kubenswrapper[2566]: I0615 06:24:36.371169    2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mprwc\" (UniqueName: \"kubernetes.io/projected/2f38dae1-448f-4cf5-82df-9f7de187fea6-kube-api-access-mprwc\") on node \"ip-10-0-128-243.ec2.internal\" DevicePath \"\""
Jun 15 06:24:36.371200 ip-10-0-128-243 kubenswrapper[2566]: I0615 06:24:36.371178    2566 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2f38dae1-448f-4cf5-82df-9f7de187fea6-tls-certs\") on node \"ip-10-0-128-243.ec2.internal\" DevicePath \"\""
Jun 15 06:24:36.904261 ip-10-0-128-243 kubenswrapper[2566]: I0615 06:24:36.904229    2566 generic.go:356] "Generic (PLEG): container finished" podID="2f38dae1-448f-4cf5-82df-9f7de187fea6" containerID="4c8a52816da8179fd5dab54a23bc804400035b0ecded610aee87606709dc579b" exitCode=0
Jun 15 06:24:36.904641 ip-10-0-128-243 kubenswrapper[2566]: I0615 06:24:36.904274    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-e95b1dc1-kserve-76859b4cd44w7x4"
Jun 15 06:24:36.904641 ip-10-0-128-243 kubenswrapper[2566]: I0615 06:24:36.904316    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-e95b1dc1-kserve-76859b4cd44w7x4" event={"ID":"2f38dae1-448f-4cf5-82df-9f7de187fea6","Type":"ContainerDied","Data":"4c8a52816da8179fd5dab54a23bc804400035b0ecded610aee87606709dc579b"}
Jun 15 06:24:36.904641 ip-10-0-128-243 kubenswrapper[2566]: I0615 06:24:36.904368    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-e95b1dc1-kserve-76859b4cd44w7x4" event={"ID":"2f38dae1-448f-4cf5-82df-9f7de187fea6","Type":"ContainerDied","Data":"731cc8bc63f3b447f36d6da910e7c1fa3295ef13cf11c6370ae3d33badb24863"}
Jun 15 06:24:36.904641 ip-10-0-128-243 kubenswrapper[2566]: I0615 06:24:36.904391    2566 scope.go:117] "RemoveContainer" containerID="4c8a52816da8179fd5dab54a23bc804400035b0ecded610aee87606709dc579b"
Jun 15 06:24:36.914053 ip-10-0-128-243 kubenswrapper[2566]: I0615 06:24:36.914036    2566 scope.go:117] "RemoveContainer" containerID="4c8a52816da8179fd5dab54a23bc804400035b0ecded610aee87606709dc579b"
Jun 15 06:24:36.914377 ip-10-0-128-243 kubenswrapper[2566]: E0615 06:24:36.914360    2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4c8a52816da8179fd5dab54a23bc804400035b0ecded610aee87606709dc579b\": container with ID starting with 4c8a52816da8179fd5dab54a23bc804400035b0ecded610aee87606709dc579b not found: ID does not exist" containerID="4c8a52816da8179fd5dab54a23bc804400035b0ecded610aee87606709dc579b"
Jun 15 06:24:36.914426 ip-10-0-128-243 kubenswrapper[2566]: I0615 06:24:36.914386    2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4c8a52816da8179fd5dab54a23bc804400035b0ecded610aee87606709dc579b"} err="failed to get container status \"4c8a52816da8179fd5dab54a23bc804400035b0ecded610aee87606709dc579b\": rpc error: code = NotFound desc = could not find container \"4c8a52816da8179fd5dab54a23bc804400035b0ecded610aee87606709dc579b\": container with ID starting with 4c8a52816da8179fd5dab54a23bc804400035b0ecded610aee87606709dc579b not found: ID does not exist"
Jun 15 06:24:36.928447 ip-10-0-128-243 kubenswrapper[2566]: I0615 06:24:36.928421    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-e95b1dc1-kserve-76859b4cd44w7x4"]
Jun 15 06:24:36.931985 ip-10-0-128-243 kubenswrapper[2566]: I0615 06:24:36.931962    2566 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-e95b1dc1-kserve-76859b4cd44w7x4"]
Jun 15 06:24:37.442156 ip-10-0-128-243 kubenswrapper[2566]: I0615 06:24:37.442124    2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2f38dae1-448f-4cf5-82df-9f7de187fea6" path="/var/lib/kubelet/pods/2f38dae1-448f-4cf5-82df-9f7de187fea6/volumes"
Jun 15 06:25:34.644346 ip-10-0-128-243 kubenswrapper[2566]: I0615 06:25:34.644316    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_llmisvc-router-managed-test-llm-5b1e8f15-kserve-7c5bd57d44b7wp8_be8770ba-8db8-4a0c-99b7-a16c4f499392/main/0.log"
Jun 15 06:25:41.760972 ip-10-0-128-243 kubenswrapper[2566]: I0615 06:25:41.760939    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/llmisvc-router-managed-test-llm-4b931143-kserve-66f88bc44dcnc5x"]
Jun 15 06:25:41.761524 ip-10-0-128-243 kubenswrapper[2566]: I0615 06:25:41.761414    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2f38dae1-448f-4cf5-82df-9f7de187fea6" containerName="main"
Jun 15 06:25:41.761524 ip-10-0-128-243 kubenswrapper[2566]: I0615 06:25:41.761436    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="2f38dae1-448f-4cf5-82df-9f7de187fea6" containerName="main"
Jun 15 06:25:41.761524 ip-10-0-128-243 kubenswrapper[2566]: I0615 06:25:41.761504    2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="2f38dae1-448f-4cf5-82df-9f7de187fea6" containerName="main"
Jun 15 06:25:41.764568 ip-10-0-128-243 kubenswrapper[2566]: I0615 06:25:41.764548    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/llmisvc-router-managed-test-llm-4b931143-kserve-66f88bc44dcnc5x"
Jun 15 06:25:41.766957 ip-10-0-128-243 kubenswrapper[2566]: I0615 06:25:41.766934    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"llmisvca2d2d7d499abb359505529ebe02c136-kserve-self-signed-certs\""
Jun 15 06:25:41.775531 ip-10-0-128-243 kubenswrapper[2566]: I0615 06:25:41.775501    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/llmisvc-router-managed-test-llm-4b931143-kserve-66f88bc44dcnc5x"]
Jun 15 06:25:41.801930 ip-10-0-128-243 kubenswrapper[2566]: I0615 06:25:41.801893    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d0c46224-53bd-4494-b0c7-835a49a21cf7-dshm\") pod \"llmisvc-router-managed-test-llm-4b931143-kserve-66f88bc44dcnc5x\" (UID: \"d0c46224-53bd-4494-b0c7-835a49a21cf7\") " pod="kserve-ci-e2e-test/llmisvc-router-managed-test-llm-4b931143-kserve-66f88bc44dcnc5x"
Jun 15 06:25:41.802119 ip-10-0-128-243 kubenswrapper[2566]: I0615 06:25:41.801940    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vl9lq\" (UniqueName: \"kubernetes.io/projected/d0c46224-53bd-4494-b0c7-835a49a21cf7-kube-api-access-vl9lq\") pod \"llmisvc-router-managed-test-llm-4b931143-kserve-66f88bc44dcnc5x\" (UID: \"d0c46224-53bd-4494-b0c7-835a49a21cf7\") " pod="kserve-ci-e2e-test/llmisvc-router-managed-test-llm-4b931143-kserve-66f88bc44dcnc5x"
Jun 15 06:25:41.802119 ip-10-0-128-243 kubenswrapper[2566]: I0615 06:25:41.802001    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d0c46224-53bd-4494-b0c7-835a49a21cf7-home\") pod \"llmisvc-router-managed-test-llm-4b931143-kserve-66f88bc44dcnc5x\" (UID: \"d0c46224-53bd-4494-b0c7-835a49a21cf7\") " pod="kserve-ci-e2e-test/llmisvc-router-managed-test-llm-4b931143-kserve-66f88bc44dcnc5x"
Jun 15 06:25:41.802119 ip-10-0-128-243 kubenswrapper[2566]: I0615 06:25:41.802051    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d0c46224-53bd-4494-b0c7-835a49a21cf7-model-cache\") pod \"llmisvc-router-managed-test-llm-4b931143-kserve-66f88bc44dcnc5x\" (UID: \"d0c46224-53bd-4494-b0c7-835a49a21cf7\") " pod="kserve-ci-e2e-test/llmisvc-router-managed-test-llm-4b931143-kserve-66f88bc44dcnc5x"
Jun 15 06:25:41.802245 ip-10-0-128-243 kubenswrapper[2566]: I0615 06:25:41.802155    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d0c46224-53bd-4494-b0c7-835a49a21cf7-tmp-dir\") pod \"llmisvc-router-managed-test-llm-4b931143-kserve-66f88bc44dcnc5x\" (UID: \"d0c46224-53bd-4494-b0c7-835a49a21cf7\") " pod="kserve-ci-e2e-test/llmisvc-router-managed-test-llm-4b931143-kserve-66f88bc44dcnc5x"
Jun 15 06:25:41.802245 ip-10-0-128-243 kubenswrapper[2566]: I0615 06:25:41.802184    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d0c46224-53bd-4494-b0c7-835a49a21cf7-tls-certs\") pod \"llmisvc-router-managed-test-llm-4b931143-kserve-66f88bc44dcnc5x\" (UID: \"d0c46224-53bd-4494-b0c7-835a49a21cf7\") " pod="kserve-ci-e2e-test/llmisvc-router-managed-test-llm-4b931143-kserve-66f88bc44dcnc5x"
Jun 15 06:25:41.903193 ip-10-0-128-243 kubenswrapper[2566]: I0615 06:25:41.903154    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d0c46224-53bd-4494-b0c7-835a49a21cf7-tmp-dir\") pod \"llmisvc-router-managed-test-llm-4b931143-kserve-66f88bc44dcnc5x\" (UID: \"d0c46224-53bd-4494-b0c7-835a49a21cf7\") " pod="kserve-ci-e2e-test/llmisvc-router-managed-test-llm-4b931143-kserve-66f88bc44dcnc5x"
Jun 15 06:25:41.903193 ip-10-0-128-243 kubenswrapper[2566]: I0615 06:25:41.903199    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d0c46224-53bd-4494-b0c7-835a49a21cf7-tls-certs\") pod \"llmisvc-router-managed-test-llm-4b931143-kserve-66f88bc44dcnc5x\" (UID: \"d0c46224-53bd-4494-b0c7-835a49a21cf7\") " pod="kserve-ci-e2e-test/llmisvc-router-managed-test-llm-4b931143-kserve-66f88bc44dcnc5x"
Jun 15 06:25:41.903447 ip-10-0-128-243 kubenswrapper[2566]: I0615 06:25:41.903232    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d0c46224-53bd-4494-b0c7-835a49a21cf7-dshm\") pod \"llmisvc-router-managed-test-llm-4b931143-kserve-66f88bc44dcnc5x\" (UID: \"d0c46224-53bd-4494-b0c7-835a49a21cf7\") " pod="kserve-ci-e2e-test/llmisvc-router-managed-test-llm-4b931143-kserve-66f88bc44dcnc5x"
Jun 15 06:25:41.903447 ip-10-0-128-243 kubenswrapper[2566]: I0615 06:25:41.903259    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vl9lq\" (UniqueName: \"kubernetes.io/projected/d0c46224-53bd-4494-b0c7-835a49a21cf7-kube-api-access-vl9lq\") pod \"llmisvc-router-managed-test-llm-4b931143-kserve-66f88bc44dcnc5x\" (UID: \"d0c46224-53bd-4494-b0c7-835a49a21cf7\") " pod="kserve-ci-e2e-test/llmisvc-router-managed-test-llm-4b931143-kserve-66f88bc44dcnc5x"
Jun 15 06:25:41.903447 ip-10-0-128-243 kubenswrapper[2566]: I0615 06:25:41.903283    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d0c46224-53bd-4494-b0c7-835a49a21cf7-home\") pod \"llmisvc-router-managed-test-llm-4b931143-kserve-66f88bc44dcnc5x\" (UID: \"d0c46224-53bd-4494-b0c7-835a49a21cf7\") " pod="kserve-ci-e2e-test/llmisvc-router-managed-test-llm-4b931143-kserve-66f88bc44dcnc5x"
Jun 15 06:25:41.903447 ip-10-0-128-243 kubenswrapper[2566]: I0615 06:25:41.903298    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d0c46224-53bd-4494-b0c7-835a49a21cf7-model-cache\") pod \"llmisvc-router-managed-test-llm-4b931143-kserve-66f88bc44dcnc5x\" (UID: \"d0c46224-53bd-4494-b0c7-835a49a21cf7\") " pod="kserve-ci-e2e-test/llmisvc-router-managed-test-llm-4b931143-kserve-66f88bc44dcnc5x"
Jun 15 06:25:41.903649 ip-10-0-128-243 kubenswrapper[2566]: I0615 06:25:41.903630    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d0c46224-53bd-4494-b0c7-835a49a21cf7-tmp-dir\") pod \"llmisvc-router-managed-test-llm-4b931143-kserve-66f88bc44dcnc5x\" (UID: \"d0c46224-53bd-4494-b0c7-835a49a21cf7\") " pod="kserve-ci-e2e-test/llmisvc-router-managed-test-llm-4b931143-kserve-66f88bc44dcnc5x"
Jun 15 06:25:41.903721 ip-10-0-128-243 kubenswrapper[2566]: I0615 06:25:41.903698    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d0c46224-53bd-4494-b0c7-835a49a21cf7-model-cache\") pod \"llmisvc-router-managed-test-llm-4b931143-kserve-66f88bc44dcnc5x\" (UID: \"d0c46224-53bd-4494-b0c7-835a49a21cf7\") " pod="kserve-ci-e2e-test/llmisvc-router-managed-test-llm-4b931143-kserve-66f88bc44dcnc5x"
Jun 15 06:25:41.903782 ip-10-0-128-243 kubenswrapper[2566]: I0615 06:25:41.903741    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d0c46224-53bd-4494-b0c7-835a49a21cf7-home\") pod \"llmisvc-router-managed-test-llm-4b931143-kserve-66f88bc44dcnc5x\" (UID: \"d0c46224-53bd-4494-b0c7-835a49a21cf7\") " pod="kserve-ci-e2e-test/llmisvc-router-managed-test-llm-4b931143-kserve-66f88bc44dcnc5x"
Jun 15 06:25:41.905686 ip-10-0-128-243 kubenswrapper[2566]: I0615 06:25:41.905665    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d0c46224-53bd-4494-b0c7-835a49a21cf7-dshm\") pod \"llmisvc-router-managed-test-llm-4b931143-kserve-66f88bc44dcnc5x\" (UID: \"d0c46224-53bd-4494-b0c7-835a49a21cf7\") " pod="kserve-ci-e2e-test/llmisvc-router-managed-test-llm-4b931143-kserve-66f88bc44dcnc5x"
Jun 15 06:25:41.905820 ip-10-0-128-243 kubenswrapper[2566]: I0615 06:25:41.905802    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d0c46224-53bd-4494-b0c7-835a49a21cf7-tls-certs\") pod \"llmisvc-router-managed-test-llm-4b931143-kserve-66f88bc44dcnc5x\" (UID: \"d0c46224-53bd-4494-b0c7-835a49a21cf7\") " pod="kserve-ci-e2e-test/llmisvc-router-managed-test-llm-4b931143-kserve-66f88bc44dcnc5x"
Jun 15 06:25:41.912866 ip-10-0-128-243 kubenswrapper[2566]: I0615 06:25:41.912839    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vl9lq\" (UniqueName: \"kubernetes.io/projected/d0c46224-53bd-4494-b0c7-835a49a21cf7-kube-api-access-vl9lq\") pod \"llmisvc-router-managed-test-llm-4b931143-kserve-66f88bc44dcnc5x\" (UID: \"d0c46224-53bd-4494-b0c7-835a49a21cf7\") " pod="kserve-ci-e2e-test/llmisvc-router-managed-test-llm-4b931143-kserve-66f88bc44dcnc5x"
Jun 15 06:25:42.076807 ip-10-0-128-243 kubenswrapper[2566]: I0615 06:25:42.076714    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/llmisvc-router-managed-test-llm-4b931143-kserve-66f88bc44dcnc5x"
Jun 15 06:25:42.212273 ip-10-0-128-243 kubenswrapper[2566]: I0615 06:25:42.212242    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/llmisvc-router-managed-test-llm-4b931143-kserve-66f88bc44dcnc5x"]
Jun 15 06:25:42.214318 ip-10-0-128-243 kubenswrapper[2566]: W0615 06:25:42.214287    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd0c46224_53bd_4494_b0c7_835a49a21cf7.slice/crio-7aed35e8cef8029c32b64911206f5ebaccc3ab3e8c66702741a1f4970a5d6ae4 WatchSource:0}: Error finding container 7aed35e8cef8029c32b64911206f5ebaccc3ab3e8c66702741a1f4970a5d6ae4: Status 404 returned error can't find the container with id 7aed35e8cef8029c32b64911206f5ebaccc3ab3e8c66702741a1f4970a5d6ae4
Jun 15 06:25:42.245972 ip-10-0-128-243 kubenswrapper[2566]: I0615 06:25:42.245944    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/llmisvc-router-managed-test-llm-4b931143-kserve-66f88bc44dcnc5x" event={"ID":"d0c46224-53bd-4494-b0c7-835a49a21cf7","Type":"ContainerStarted","Data":"7aed35e8cef8029c32b64911206f5ebaccc3ab3e8c66702741a1f4970a5d6ae4"}
Jun 15 06:25:43.253315 ip-10-0-128-243 kubenswrapper[2566]: I0615 06:25:43.253280    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/llmisvc-router-managed-test-llm-4b931143-kserve-66f88bc44dcnc5x" event={"ID":"d0c46224-53bd-4494-b0c7-835a49a21cf7","Type":"ContainerStarted","Data":"32a6110a7b59885b076d50ddc1d5fbec6164561b724352dbf2a3ef11973d7444"}
Jun 15 06:25:43.274393 ip-10-0-128-243 kubenswrapper[2566]: I0615 06:25:43.274351    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/llmisvc-router-managed-test-llm-4b931143-kserve-66f88bc44dcnc5x" podStartSLOduration=2.2743376619999998 podStartE2EDuration="2.274337662s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-15 06:25:41 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 06:25:43.271627969 +0000 UTC m=+2226.231385214" watchObservedRunningTime="2026-06-15 06:25:43.274337662 +0000 UTC m=+2226.234094907"
Jun 15 06:25:52.077403 ip-10-0-128-243 kubenswrapper[2566]: I0615 06:25:52.077355    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/llmisvc-router-managed-test-llm-4b931143-kserve-66f88bc44dcnc5x"
Jun 15 06:25:52.077886 ip-10-0-128-243 kubenswrapper[2566]: I0615 06:25:52.077441    2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kserve-ci-e2e-test/llmisvc-router-managed-test-llm-4b931143-kserve-66f88bc44dcnc5x"
Jun 15 06:25:52.090360 ip-10-0-128-243 kubenswrapper[2566]: I0615 06:25:52.090328    2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kserve-ci-e2e-test/llmisvc-router-managed-test-llm-4b931143-kserve-66f88bc44dcnc5x"
Jun 15 06:25:52.317851 ip-10-0-128-243 kubenswrapper[2566]: I0615 06:25:52.317817    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/llmisvc-router-managed-test-llm-4b931143-kserve-66f88bc44dcnc5x"
Jun 15 06:28:37.628699 ip-10-0-128-243 kubenswrapper[2566]: I0615 06:28:37.628591    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5dbbb5d744-ktjgp_67da60eb-27f9-4bbd-8d12-64275e801143/console-operator/2.log"
Jun 15 06:28:37.634160 ip-10-0-128-243 kubenswrapper[2566]: I0615 06:28:37.634140    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-f4bzh_5a1f8f83-55db-4fc7-872d-6b202daa0a31/ovn-acl-logging/0.log"
Jun 15 06:28:37.643244 ip-10-0-128-243 kubenswrapper[2566]: I0615 06:28:37.643228    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5dbbb5d744-ktjgp_67da60eb-27f9-4bbd-8d12-64275e801143/console-operator/2.log"
Jun 15 06:28:37.648648 ip-10-0-128-243 kubenswrapper[2566]: I0615 06:28:37.648631    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-f4bzh_5a1f8f83-55db-4fc7-872d-6b202daa0a31/ovn-acl-logging/0.log"
Jun 15 06:33:37.664054 ip-10-0-128-243 kubenswrapper[2566]: I0615 06:33:37.663951    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5dbbb5d744-ktjgp_67da60eb-27f9-4bbd-8d12-64275e801143/console-operator/2.log"
Jun 15 06:33:37.670149 ip-10-0-128-243 kubenswrapper[2566]: I0615 06:33:37.670129    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-f4bzh_5a1f8f83-55db-4fc7-872d-6b202daa0a31/ovn-acl-logging/0.log"
Jun 15 06:33:37.678453 ip-10-0-128-243 kubenswrapper[2566]: I0615 06:33:37.678436    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5dbbb5d744-ktjgp_67da60eb-27f9-4bbd-8d12-64275e801143/console-operator/2.log"
Jun 15 06:33:37.683733 ip-10-0-128-243 kubenswrapper[2566]: I0615 06:33:37.683717    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-f4bzh_5a1f8f83-55db-4fc7-872d-6b202daa0a31/ovn-acl-logging/0.log"
Jun 15 06:38:37.699157 ip-10-0-128-243 kubenswrapper[2566]: I0615 06:38:37.699026    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5dbbb5d744-ktjgp_67da60eb-27f9-4bbd-8d12-64275e801143/console-operator/2.log"
Jun 15 06:38:37.704573 ip-10-0-128-243 kubenswrapper[2566]: I0615 06:38:37.704555    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-f4bzh_5a1f8f83-55db-4fc7-872d-6b202daa0a31/ovn-acl-logging/0.log"
Jun 15 06:38:37.720412 ip-10-0-128-243 kubenswrapper[2566]: I0615 06:38:37.720391    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5dbbb5d744-ktjgp_67da60eb-27f9-4bbd-8d12-64275e801143/console-operator/2.log"
Jun 15 06:38:37.726428 ip-10-0-128-243 kubenswrapper[2566]: I0615 06:38:37.726412    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-f4bzh_5a1f8f83-55db-4fc7-872d-6b202daa0a31/ovn-acl-logging/0.log"
Jun 15 06:43:37.732399 ip-10-0-128-243 kubenswrapper[2566]: I0615 06:43:37.732275    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5dbbb5d744-ktjgp_67da60eb-27f9-4bbd-8d12-64275e801143/console-operator/2.log"
Jun 15 06:43:37.738455 ip-10-0-128-243 kubenswrapper[2566]: I0615 06:43:37.738436    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-f4bzh_5a1f8f83-55db-4fc7-872d-6b202daa0a31/ovn-acl-logging/0.log"
Jun 15 06:43:37.756360 ip-10-0-128-243 kubenswrapper[2566]: I0615 06:43:37.756337    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5dbbb5d744-ktjgp_67da60eb-27f9-4bbd-8d12-64275e801143/console-operator/2.log"
Jun 15 06:43:37.761877 ip-10-0-128-243 kubenswrapper[2566]: I0615 06:43:37.761855    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-f4bzh_5a1f8f83-55db-4fc7-872d-6b202daa0a31/ovn-acl-logging/0.log"
Jun 15 06:44:38.539857 ip-10-0-128-243 kubenswrapper[2566]: I0615 06:44:38.539825    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_llmisvc-router-managed-test-llm-4b931143-kserve-66f88bc44dcnc5x_d0c46224-53bd-4494-b0c7-835a49a21cf7/main/0.log"
Jun 15 06:48:37.773821 ip-10-0-128-243 kubenswrapper[2566]: I0615 06:48:37.773794    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5dbbb5d744-ktjgp_67da60eb-27f9-4bbd-8d12-64275e801143/console-operator/2.log"
Jun 15 06:48:37.780053 ip-10-0-128-243 kubenswrapper[2566]: I0615 06:48:37.780028    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-f4bzh_5a1f8f83-55db-4fc7-872d-6b202daa0a31/ovn-acl-logging/0.log"
Jun 15 06:48:37.792891 ip-10-0-128-243 kubenswrapper[2566]: I0615 06:48:37.792871    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5dbbb5d744-ktjgp_67da60eb-27f9-4bbd-8d12-64275e801143/console-operator/2.log"
Jun 15 06:48:37.798556 ip-10-0-128-243 kubenswrapper[2566]: I0615 06:48:37.798540    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-f4bzh_5a1f8f83-55db-4fc7-872d-6b202daa0a31/ovn-acl-logging/0.log"
Jun 15 06:52:11.662810 ip-10-0-128-243 kubenswrapper[2566]: I0615 06:52:11.662775    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/router-gateway-2-openshift-default-78c98f6f4c-ddrqp"]
Jun 15 06:52:11.666230 ip-10-0-128-243 kubenswrapper[2566]: I0615 06:52:11.666208    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/router-gateway-2-openshift-default-78c98f6f4c-ddrqp"
Jun 15 06:52:11.668638 ip-10-0-128-243 kubenswrapper[2566]: I0615 06:52:11.668618    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"router-gateway-2-openshift-default-dockercfg-xg4xw\""
Jun 15 06:52:11.668750 ip-10-0-128-243 kubenswrapper[2566]: I0615 06:52:11.668622    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"openshift-gw-ca-root-cert\""
Jun 15 06:52:11.678161 ip-10-0-128-243 kubenswrapper[2566]: I0615 06:52:11.678139    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/router-gateway-2-openshift-default-78c98f6f4c-ddrqp"]
Jun 15 06:52:11.728695 ip-10-0-128-243 kubenswrapper[2566]: I0615 06:52:11.728663    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f371b3cf-555f-408b-83c0-9350d5cc73f7-istio-data\") pod \"router-gateway-2-openshift-default-78c98f6f4c-ddrqp\" (UID: \"f371b3cf-555f-408b-83c0-9350d5cc73f7\") " pod="kserve-ci-e2e-test/router-gateway-2-openshift-default-78c98f6f4c-ddrqp"
Jun 15 06:52:11.728695 ip-10-0-128-243 kubenswrapper[2566]: I0615 06:52:11.728695    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f371b3cf-555f-408b-83c0-9350d5cc73f7-istio-podinfo\") pod \"router-gateway-2-openshift-default-78c98f6f4c-ddrqp\" (UID: \"f371b3cf-555f-408b-83c0-9350d5cc73f7\") " pod="kserve-ci-e2e-test/router-gateway-2-openshift-default-78c98f6f4c-ddrqp"
Jun 15 06:52:11.728868 ip-10-0-128-243 kubenswrapper[2566]: I0615 06:52:11.728729    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f371b3cf-555f-408b-83c0-9350d5cc73f7-credential-socket\") pod \"router-gateway-2-openshift-default-78c98f6f4c-ddrqp\" (UID: \"f371b3cf-555f-408b-83c0-9350d5cc73f7\") " pod="kserve-ci-e2e-test/router-gateway-2-openshift-default-78c98f6f4c-ddrqp"
Jun 15 06:52:11.728868 ip-10-0-128-243 kubenswrapper[2566]: I0615 06:52:11.728804    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f371b3cf-555f-408b-83c0-9350d5cc73f7-istio-token\") pod \"router-gateway-2-openshift-default-78c98f6f4c-ddrqp\" (UID: \"f371b3cf-555f-408b-83c0-9350d5cc73f7\") " pod="kserve-ci-e2e-test/router-gateway-2-openshift-default-78c98f6f4c-ddrqp"
Jun 15 06:52:11.728868 ip-10-0-128-243 kubenswrapper[2566]: I0615 06:52:11.728835    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f371b3cf-555f-408b-83c0-9350d5cc73f7-istio-envoy\") pod \"router-gateway-2-openshift-default-78c98f6f4c-ddrqp\" (UID: \"f371b3cf-555f-408b-83c0-9350d5cc73f7\") " pod="kserve-ci-e2e-test/router-gateway-2-openshift-default-78c98f6f4c-ddrqp"
Jun 15 06:52:11.728868 ip-10-0-128-243 kubenswrapper[2566]: I0615 06:52:11.728854    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f2wh2\" (UniqueName: \"kubernetes.io/projected/f371b3cf-555f-408b-83c0-9350d5cc73f7-kube-api-access-f2wh2\") pod \"router-gateway-2-openshift-default-78c98f6f4c-ddrqp\" (UID: \"f371b3cf-555f-408b-83c0-9350d5cc73f7\") " pod="kserve-ci-e2e-test/router-gateway-2-openshift-default-78c98f6f4c-ddrqp"
Jun 15 06:52:11.729066 ip-10-0-128-243 kubenswrapper[2566]: I0615 06:52:11.728888    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f371b3cf-555f-408b-83c0-9350d5cc73f7-workload-socket\") pod \"router-gateway-2-openshift-default-78c98f6f4c-ddrqp\" (UID: \"f371b3cf-555f-408b-83c0-9350d5cc73f7\") " pod="kserve-ci-e2e-test/router-gateway-2-openshift-default-78c98f6f4c-ddrqp"
Jun 15 06:52:11.729066 ip-10-0-128-243 kubenswrapper[2566]: I0615 06:52:11.728907    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f371b3cf-555f-408b-83c0-9350d5cc73f7-workload-certs\") pod \"router-gateway-2-openshift-default-78c98f6f4c-ddrqp\" (UID: \"f371b3cf-555f-408b-83c0-9350d5cc73f7\") " pod="kserve-ci-e2e-test/router-gateway-2-openshift-default-78c98f6f4c-ddrqp"
Jun 15 06:52:11.729066 ip-10-0-128-243 kubenswrapper[2566]: I0615 06:52:11.728933    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f371b3cf-555f-408b-83c0-9350d5cc73f7-istiod-ca-cert\") pod \"router-gateway-2-openshift-default-78c98f6f4c-ddrqp\" (UID: \"f371b3cf-555f-408b-83c0-9350d5cc73f7\") " pod="kserve-ci-e2e-test/router-gateway-2-openshift-default-78c98f6f4c-ddrqp"
Jun 15 06:52:11.830191 ip-10-0-128-243 kubenswrapper[2566]: I0615 06:52:11.830147    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f371b3cf-555f-408b-83c0-9350d5cc73f7-credential-socket\") pod \"router-gateway-2-openshift-default-78c98f6f4c-ddrqp\" (UID: \"f371b3cf-555f-408b-83c0-9350d5cc73f7\") " pod="kserve-ci-e2e-test/router-gateway-2-openshift-default-78c98f6f4c-ddrqp"
Jun 15 06:52:11.830369 ip-10-0-128-243 kubenswrapper[2566]: I0615 06:52:11.830207    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f371b3cf-555f-408b-83c0-9350d5cc73f7-istio-token\") pod \"router-gateway-2-openshift-default-78c98f6f4c-ddrqp\" (UID: \"f371b3cf-555f-408b-83c0-9350d5cc73f7\") " pod="kserve-ci-e2e-test/router-gateway-2-openshift-default-78c98f6f4c-ddrqp"
Jun 15 06:52:11.830417 ip-10-0-128-243 kubenswrapper[2566]: I0615 06:52:11.830392    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f371b3cf-555f-408b-83c0-9350d5cc73f7-istio-envoy\") pod \"router-gateway-2-openshift-default-78c98f6f4c-ddrqp\" (UID: \"f371b3cf-555f-408b-83c0-9350d5cc73f7\") " pod="kserve-ci-e2e-test/router-gateway-2-openshift-default-78c98f6f4c-ddrqp"
Jun 15 06:52:11.830417 ip-10-0-128-243 kubenswrapper[2566]: I0615 06:52:11.830408    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f2wh2\" (UniqueName: \"kubernetes.io/projected/f371b3cf-555f-408b-83c0-9350d5cc73f7-kube-api-access-f2wh2\") pod \"router-gateway-2-openshift-default-78c98f6f4c-ddrqp\" (UID: \"f371b3cf-555f-408b-83c0-9350d5cc73f7\") " pod="kserve-ci-e2e-test/router-gateway-2-openshift-default-78c98f6f4c-ddrqp"
Jun 15 06:52:11.830506 ip-10-0-128-243 kubenswrapper[2566]: I0615 06:52:11.830433    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f371b3cf-555f-408b-83c0-9350d5cc73f7-workload-socket\") pod \"router-gateway-2-openshift-default-78c98f6f4c-ddrqp\" (UID: \"f371b3cf-555f-408b-83c0-9350d5cc73f7\") " pod="kserve-ci-e2e-test/router-gateway-2-openshift-default-78c98f6f4c-ddrqp"
Jun 15 06:52:11.830506 ip-10-0-128-243 kubenswrapper[2566]: I0615 06:52:11.830451    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f371b3cf-555f-408b-83c0-9350d5cc73f7-workload-certs\") pod \"router-gateway-2-openshift-default-78c98f6f4c-ddrqp\" (UID: \"f371b3cf-555f-408b-83c0-9350d5cc73f7\") " pod="kserve-ci-e2e-test/router-gateway-2-openshift-default-78c98f6f4c-ddrqp"
Jun 15 06:52:11.830506 ip-10-0-128-243 kubenswrapper[2566]: I0615 06:52:11.830476    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f371b3cf-555f-408b-83c0-9350d5cc73f7-istiod-ca-cert\") pod \"router-gateway-2-openshift-default-78c98f6f4c-ddrqp\" (UID: \"f371b3cf-555f-408b-83c0-9350d5cc73f7\") " pod="kserve-ci-e2e-test/router-gateway-2-openshift-default-78c98f6f4c-ddrqp"
Jun 15 06:52:11.830681 ip-10-0-128-243 kubenswrapper[2566]: I0615 06:52:11.830516    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f371b3cf-555f-408b-83c0-9350d5cc73f7-istio-data\") pod \"router-gateway-2-openshift-default-78c98f6f4c-ddrqp\" (UID: \"f371b3cf-555f-408b-83c0-9350d5cc73f7\") " pod="kserve-ci-e2e-test/router-gateway-2-openshift-default-78c98f6f4c-ddrqp"
Jun 15 06:52:11.830681 ip-10-0-128-243 kubenswrapper[2566]: I0615 06:52:11.830540    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f371b3cf-555f-408b-83c0-9350d5cc73f7-istio-podinfo\") pod \"router-gateway-2-openshift-default-78c98f6f4c-ddrqp\" (UID: \"f371b3cf-555f-408b-83c0-9350d5cc73f7\") " pod="kserve-ci-e2e-test/router-gateway-2-openshift-default-78c98f6f4c-ddrqp"
Jun 15 06:52:11.830681 ip-10-0-128-243 kubenswrapper[2566]: I0615 06:52:11.830613    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f371b3cf-555f-408b-83c0-9350d5cc73f7-credential-socket\") pod \"router-gateway-2-openshift-default-78c98f6f4c-ddrqp\" (UID: \"f371b3cf-555f-408b-83c0-9350d5cc73f7\") " pod="kserve-ci-e2e-test/router-gateway-2-openshift-default-78c98f6f4c-ddrqp"
Jun 15 06:52:11.831156 ip-10-0-128-243 kubenswrapper[2566]: I0615 06:52:11.831125    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f371b3cf-555f-408b-83c0-9350d5cc73f7-workload-certs\") pod \"router-gateway-2-openshift-default-78c98f6f4c-ddrqp\" (UID: \"f371b3cf-555f-408b-83c0-9350d5cc73f7\") " pod="kserve-ci-e2e-test/router-gateway-2-openshift-default-78c98f6f4c-ddrqp"
Jun 15 06:52:11.831457 ip-10-0-128-243 kubenswrapper[2566]: I0615 06:52:11.831157    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f371b3cf-555f-408b-83c0-9350d5cc73f7-workload-socket\") pod \"router-gateway-2-openshift-default-78c98f6f4c-ddrqp\" (UID: \"f371b3cf-555f-408b-83c0-9350d5cc73f7\") " pod="kserve-ci-e2e-test/router-gateway-2-openshift-default-78c98f6f4c-ddrqp"
Jun 15 06:52:11.831457 ip-10-0-128-243 kubenswrapper[2566]: I0615 06:52:11.831195    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f371b3cf-555f-408b-83c0-9350d5cc73f7-istio-data\") pod \"router-gateway-2-openshift-default-78c98f6f4c-ddrqp\" (UID: \"f371b3cf-555f-408b-83c0-9350d5cc73f7\") " pod="kserve-ci-e2e-test/router-gateway-2-openshift-default-78c98f6f4c-ddrqp"
Jun 15 06:52:11.831457 ip-10-0-128-243 kubenswrapper[2566]: I0615 06:52:11.831249    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f371b3cf-555f-408b-83c0-9350d5cc73f7-istiod-ca-cert\") pod \"router-gateway-2-openshift-default-78c98f6f4c-ddrqp\" (UID: \"f371b3cf-555f-408b-83c0-9350d5cc73f7\") " pod="kserve-ci-e2e-test/router-gateway-2-openshift-default-78c98f6f4c-ddrqp"
Jun 15 06:52:11.832725 ip-10-0-128-243 kubenswrapper[2566]: I0615 06:52:11.832702    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f371b3cf-555f-408b-83c0-9350d5cc73f7-istio-envoy\") pod \"router-gateway-2-openshift-default-78c98f6f4c-ddrqp\" (UID: \"f371b3cf-555f-408b-83c0-9350d5cc73f7\") " pod="kserve-ci-e2e-test/router-gateway-2-openshift-default-78c98f6f4c-ddrqp"
Jun 15 06:52:11.833130 ip-10-0-128-243 kubenswrapper[2566]: I0615 06:52:11.833072    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f371b3cf-555f-408b-83c0-9350d5cc73f7-istio-podinfo\") pod \"router-gateway-2-openshift-default-78c98f6f4c-ddrqp\" (UID: \"f371b3cf-555f-408b-83c0-9350d5cc73f7\") " pod="kserve-ci-e2e-test/router-gateway-2-openshift-default-78c98f6f4c-ddrqp"
Jun 15 06:52:11.838934 ip-10-0-128-243 kubenswrapper[2566]: I0615 06:52:11.838907    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f371b3cf-555f-408b-83c0-9350d5cc73f7-istio-token\") pod \"router-gateway-2-openshift-default-78c98f6f4c-ddrqp\" (UID: \"f371b3cf-555f-408b-83c0-9350d5cc73f7\") " pod="kserve-ci-e2e-test/router-gateway-2-openshift-default-78c98f6f4c-ddrqp"
Jun 15 06:52:11.839166 ip-10-0-128-243 kubenswrapper[2566]: I0615 06:52:11.839150    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-f2wh2\" (UniqueName: \"kubernetes.io/projected/f371b3cf-555f-408b-83c0-9350d5cc73f7-kube-api-access-f2wh2\") pod \"router-gateway-2-openshift-default-78c98f6f4c-ddrqp\" (UID: \"f371b3cf-555f-408b-83c0-9350d5cc73f7\") " pod="kserve-ci-e2e-test/router-gateway-2-openshift-default-78c98f6f4c-ddrqp"
Jun 15 06:52:11.977711 ip-10-0-128-243 kubenswrapper[2566]: I0615 06:52:11.977621    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/router-gateway-2-openshift-default-78c98f6f4c-ddrqp"
Jun 15 06:52:12.116446 ip-10-0-128-243 kubenswrapper[2566]: I0615 06:52:12.116415    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/router-gateway-2-openshift-default-78c98f6f4c-ddrqp"]
Jun 15 06:52:12.119506 ip-10-0-128-243 kubenswrapper[2566]: W0615 06:52:12.119476    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf371b3cf_555f_408b_83c0_9350d5cc73f7.slice/crio-b5dae3fef1224f61ed8b6eccadf0bd0f20a484400fb2cc07d1a9bc6f7127ceaa WatchSource:0}: Error finding container b5dae3fef1224f61ed8b6eccadf0bd0f20a484400fb2cc07d1a9bc6f7127ceaa: Status 404 returned error can't find the container with id b5dae3fef1224f61ed8b6eccadf0bd0f20a484400fb2cc07d1a9bc6f7127ceaa
Jun 15 06:52:12.121444 ip-10-0-128-243 kubenswrapper[2566]: I0615 06:52:12.121427    2566 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jun 15 06:52:12.265963 ip-10-0-128-243 kubenswrapper[2566]: I0615 06:52:12.265928    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/router-gateway-2-openshift-default-78c98f6f4c-ddrqp" event={"ID":"f371b3cf-555f-408b-83c0-9350d5cc73f7","Type":"ContainerStarted","Data":"b5dae3fef1224f61ed8b6eccadf0bd0f20a484400fb2cc07d1a9bc6f7127ceaa"}
Jun 15 06:52:14.613333 ip-10-0-128-243 kubenswrapper[2566]: I0615 06:52:14.613295    2566 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jun 15 06:52:14.613621 ip-10-0-128-243 kubenswrapper[2566]: I0615 06:52:14.613370    2566 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jun 15 06:52:14.613621 ip-10-0-128-243 kubenswrapper[2566]: I0615 06:52:14.613415    2566 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jun 15 06:52:15.284513 ip-10-0-128-243 kubenswrapper[2566]: I0615 06:52:15.284469    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/router-gateway-2-openshift-default-78c98f6f4c-ddrqp" event={"ID":"f371b3cf-555f-408b-83c0-9350d5cc73f7","Type":"ContainerStarted","Data":"9ae0dff3bf8b74e369c42955bafc86b92627d90687bde475fcfdae0b6bbd1a71"}
Jun 15 06:52:15.306922 ip-10-0-128-243 kubenswrapper[2566]: I0615 06:52:15.306872    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/router-gateway-2-openshift-default-78c98f6f4c-ddrqp" podStartSLOduration=1.81546943 podStartE2EDuration="4.306857737s" totalImagesPullingTime="2.491388307s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-15 06:52:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 06:52:15.304804942 +0000 UTC m=+3818.264562187" watchObservedRunningTime="2026-06-15 06:52:15.306857737 +0000 UTC m=+3818.266614982"
Jun 15 06:52:15.978425 ip-10-0-128-243 kubenswrapper[2566]: I0615 06:52:15.978335    2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kserve-ci-e2e-test/router-gateway-2-openshift-default-78c98f6f4c-ddrqp"
Jun 15 06:52:15.983696 ip-10-0-128-243 kubenswrapper[2566]: I0615 06:52:15.983667    2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kserve-ci-e2e-test/router-gateway-2-openshift-default-78c98f6f4c-ddrqp"
Jun 15 06:52:16.292364 ip-10-0-128-243 kubenswrapper[2566]: I0615 06:52:16.292298    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/router-gateway-2-openshift-default-78c98f6f4c-ddrqp"
Jun 15 06:52:16.294662 ip-10-0-128-243 kubenswrapper[2566]: I0615 06:52:16.294635    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/router-gateway-2-openshift-default-78c98f6f4c-ddrqp"
Jun 15 06:52:25.343623 ip-10-0-128-243 kubenswrapper[2566]: I0615 06:52:25.343588    2566 generic.go:356] "Generic (PLEG): container finished" podID="f371b3cf-555f-408b-83c0-9350d5cc73f7" containerID="9ae0dff3bf8b74e369c42955bafc86b92627d90687bde475fcfdae0b6bbd1a71" exitCode=0
Jun 15 06:52:25.344061 ip-10-0-128-243 kubenswrapper[2566]: I0615 06:52:25.343663    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/router-gateway-2-openshift-default-78c98f6f4c-ddrqp" event={"ID":"f371b3cf-555f-408b-83c0-9350d5cc73f7","Type":"ContainerDied","Data":"9ae0dff3bf8b74e369c42955bafc86b92627d90687bde475fcfdae0b6bbd1a71"}
Jun 15 06:52:25.344061 ip-10-0-128-243 kubenswrapper[2566]: I0615 06:52:25.344032    2566 scope.go:117] "RemoveContainer" containerID="9ae0dff3bf8b74e369c42955bafc86b92627d90687bde475fcfdae0b6bbd1a71"
Jun 15 06:52:25.345909 ip-10-0-128-243 kubenswrapper[2566]: I0615 06:52:25.345877    2566 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jun 15 06:52:25.346025 ip-10-0-128-243 kubenswrapper[2566]: I0615 06:52:25.345963    2566 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jun 15 06:52:25.346025 ip-10-0-128-243 kubenswrapper[2566]: I0615 06:52:25.346012    2566 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jun 15 06:52:26.351254 ip-10-0-128-243 kubenswrapper[2566]: I0615 06:52:26.351224    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/router-gateway-2-openshift-default-78c98f6f4c-ddrqp" event={"ID":"f371b3cf-555f-408b-83c0-9350d5cc73f7","Type":"ContainerStarted","Data":"ce3685a199f04edd97c2b553570a005168e6c7c6f5550891a28eeb29aea205e1"}
Jun 15 06:52:26.978119 ip-10-0-128-243 kubenswrapper[2566]: I0615 06:52:26.978049    2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kserve-ci-e2e-test/router-gateway-2-openshift-default-78c98f6f4c-ddrqp"
Jun 15 06:52:26.979393 ip-10-0-128-243 kubenswrapper[2566]: I0615 06:52:26.979343    2566 prober.go:120] "Probe failed" probeType="Startup" pod="kserve-ci-e2e-test/router-gateway-2-openshift-default-78c98f6f4c-ddrqp" podUID="f371b3cf-555f-408b-83c0-9350d5cc73f7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.48:15021/healthz/ready\": dial tcp 10.132.0.48:15021: connect: connection refused"
Jun 15 06:52:27.978341 ip-10-0-128-243 kubenswrapper[2566]: I0615 06:52:27.978298    2566 prober.go:120] "Probe failed" probeType="Startup" pod="kserve-ci-e2e-test/router-gateway-2-openshift-default-78c98f6f4c-ddrqp" podUID="f371b3cf-555f-408b-83c0-9350d5cc73f7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.48:15021/healthz/ready\": dial tcp 10.132.0.48:15021: connect: connection refused"
Jun 15 06:52:28.978282 ip-10-0-128-243 kubenswrapper[2566]: I0615 06:52:28.978236    2566 prober.go:120] "Probe failed" probeType="Startup" pod="kserve-ci-e2e-test/router-gateway-2-openshift-default-78c98f6f4c-ddrqp" podUID="f371b3cf-555f-408b-83c0-9350d5cc73f7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.48:15021/healthz/ready\": dial tcp 10.132.0.48:15021: connect: connection refused"
Jun 15 06:52:29.978520 ip-10-0-128-243 kubenswrapper[2566]: I0615 06:52:29.978474    2566 prober.go:120] "Probe failed" probeType="Startup" pod="kserve-ci-e2e-test/router-gateway-2-openshift-default-78c98f6f4c-ddrqp" podUID="f371b3cf-555f-408b-83c0-9350d5cc73f7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.48:15021/healthz/ready\": dial tcp 10.132.0.48:15021: connect: connection refused"
Jun 15 06:52:30.978583 ip-10-0-128-243 kubenswrapper[2566]: I0615 06:52:30.978539    2566 prober.go:120] "Probe failed" probeType="Startup" pod="kserve-ci-e2e-test/router-gateway-2-openshift-default-78c98f6f4c-ddrqp" podUID="f371b3cf-555f-408b-83c0-9350d5cc73f7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.48:15021/healthz/ready\": dial tcp 10.132.0.48:15021: connect: connection refused"
Jun 15 06:52:31.293164 ip-10-0-128-243 kubenswrapper[2566]: I0615 06:52:31.293120    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/router-gateway-2-openshift-default-78c98f6f4c-ddrqp"
Jun 15 06:52:31.982437 ip-10-0-128-243 kubenswrapper[2566]: I0615 06:52:31.982405    2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kserve-ci-e2e-test/router-gateway-2-openshift-default-78c98f6f4c-ddrqp"
Jun 15 06:52:31.983382 ip-10-0-128-243 kubenswrapper[2566]: I0615 06:52:31.983361    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/router-gateway-2-openshift-default-78c98f6f4c-ddrqp"
Jun 15 06:53:37.809305 ip-10-0-128-243 kubenswrapper[2566]: I0615 06:53:37.809278    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5dbbb5d744-ktjgp_67da60eb-27f9-4bbd-8d12-64275e801143/console-operator/2.log"
Jun 15 06:53:37.815053 ip-10-0-128-243 kubenswrapper[2566]: I0615 06:53:37.815017    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-f4bzh_5a1f8f83-55db-4fc7-872d-6b202daa0a31/ovn-acl-logging/0.log"
Jun 15 06:53:37.828395 ip-10-0-128-243 kubenswrapper[2566]: I0615 06:53:37.828369    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5dbbb5d744-ktjgp_67da60eb-27f9-4bbd-8d12-64275e801143/console-operator/2.log"
Jun 15 06:53:37.833890 ip-10-0-128-243 kubenswrapper[2566]: I0615 06:53:37.833869    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-f4bzh_5a1f8f83-55db-4fc7-872d-6b202daa0a31/ovn-acl-logging/0.log"
Jun 15 06:58:37.845850 ip-10-0-128-243 kubenswrapper[2566]: I0615 06:58:37.845820    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5dbbb5d744-ktjgp_67da60eb-27f9-4bbd-8d12-64275e801143/console-operator/2.log"
Jun 15 06:58:37.851934 ip-10-0-128-243 kubenswrapper[2566]: I0615 06:58:37.851907    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-f4bzh_5a1f8f83-55db-4fc7-872d-6b202daa0a31/ovn-acl-logging/0.log"
Jun 15 06:58:37.872495 ip-10-0-128-243 kubenswrapper[2566]: I0615 06:58:37.872468    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5dbbb5d744-ktjgp_67da60eb-27f9-4bbd-8d12-64275e801143/console-operator/2.log"
Jun 15 06:58:37.880913 ip-10-0-128-243 kubenswrapper[2566]: I0615 06:58:37.880888    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-f4bzh_5a1f8f83-55db-4fc7-872d-6b202daa0a31/ovn-acl-logging/0.log"
Jun 15 07:03:37.890027 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:03:37.889910    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5dbbb5d744-ktjgp_67da60eb-27f9-4bbd-8d12-64275e801143/console-operator/2.log"
Jun 15 07:03:37.895636 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:03:37.895615    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-f4bzh_5a1f8f83-55db-4fc7-872d-6b202daa0a31/ovn-acl-logging/0.log"
Jun 15 07:03:37.912266 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:03:37.912247    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5dbbb5d744-ktjgp_67da60eb-27f9-4bbd-8d12-64275e801143/console-operator/2.log"
Jun 15 07:03:37.917371 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:03:37.917350    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-f4bzh_5a1f8f83-55db-4fc7-872d-6b202daa0a31/ovn-acl-logging/0.log"
Jun 15 07:08:37.923990 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:08:37.923881    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5dbbb5d744-ktjgp_67da60eb-27f9-4bbd-8d12-64275e801143/console-operator/2.log"
Jun 15 07:08:37.929926 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:08:37.929904    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-f4bzh_5a1f8f83-55db-4fc7-872d-6b202daa0a31/ovn-acl-logging/0.log"
Jun 15 07:08:37.955914 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:08:37.955884    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5dbbb5d744-ktjgp_67da60eb-27f9-4bbd-8d12-64275e801143/console-operator/2.log"
Jun 15 07:08:37.961831 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:08:37.961802    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-f4bzh_5a1f8f83-55db-4fc7-872d-6b202daa0a31/ovn-acl-logging/0.log"
Jun 15 07:10:30.111429 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:10:30.111392    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-dc21cb14-kserve-mn-0-1"]
Jun 15 07:10:30.115008 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:10:30.114983    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-dc21cb14-kserve-mn-0-1"
Jun 15 07:10:30.117420 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:10:30.117398    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"llmisvc-model-fb-opt-125m-route-dc21cb-57cf7736-dockercfg-sxhgn\""
Jun 15 07:10:30.117549 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:10:30.117403    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"seaweedfs-s3-creds\""
Jun 15 07:10:30.117549 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:10:30.117447    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"llmisv32fd5468e8138ec3cd54cf7b9c18cfb0-kserve-self-signed-certs\""
Jun 15 07:10:30.126635 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:10:30.126614    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-dc21cb14-kserve-mn-0-1"]
Jun 15 07:10:30.225904 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:10:30.225872    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/ae13ab10-6e7c-46ec-8438-ec2ab0fdd224-kserve-provision-location\") pod \"llmisvc-model-fb-opt-125m-route-dc21cb14-kserve-mn-0-1\" (UID: \"ae13ab10-6e7c-46ec-8438-ec2ab0fdd224\") " pod="kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-dc21cb14-kserve-mn-0-1"
Jun 15 07:10:30.226127 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:10:30.225907    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dpn64\" (UniqueName: \"kubernetes.io/projected/ae13ab10-6e7c-46ec-8438-ec2ab0fdd224-kube-api-access-dpn64\") pod \"llmisvc-model-fb-opt-125m-route-dc21cb14-kserve-mn-0-1\" (UID: \"ae13ab10-6e7c-46ec-8438-ec2ab0fdd224\") " pod="kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-dc21cb14-kserve-mn-0-1"
Jun 15 07:10:30.226127 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:10:30.225930    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ae13ab10-6e7c-46ec-8438-ec2ab0fdd224-model-cache\") pod \"llmisvc-model-fb-opt-125m-route-dc21cb14-kserve-mn-0-1\" (UID: \"ae13ab10-6e7c-46ec-8438-ec2ab0fdd224\") " pod="kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-dc21cb14-kserve-mn-0-1"
Jun 15 07:10:30.226127 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:10:30.225957    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ae13ab10-6e7c-46ec-8438-ec2ab0fdd224-dshm\") pod \"llmisvc-model-fb-opt-125m-route-dc21cb14-kserve-mn-0-1\" (UID: \"ae13ab10-6e7c-46ec-8438-ec2ab0fdd224\") " pod="kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-dc21cb14-kserve-mn-0-1"
Jun 15 07:10:30.226127 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:10:30.226076    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ae13ab10-6e7c-46ec-8438-ec2ab0fdd224-tmp-dir\") pod \"llmisvc-model-fb-opt-125m-route-dc21cb14-kserve-mn-0-1\" (UID: \"ae13ab10-6e7c-46ec-8438-ec2ab0fdd224\") " pod="kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-dc21cb14-kserve-mn-0-1"
Jun 15 07:10:30.226336 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:10:30.226166    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ae13ab10-6e7c-46ec-8438-ec2ab0fdd224-home\") pod \"llmisvc-model-fb-opt-125m-route-dc21cb14-kserve-mn-0-1\" (UID: \"ae13ab10-6e7c-46ec-8438-ec2ab0fdd224\") " pod="kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-dc21cb14-kserve-mn-0-1"
Jun 15 07:10:30.226336 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:10:30.226186    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ae13ab10-6e7c-46ec-8438-ec2ab0fdd224-tls-certs\") pod \"llmisvc-model-fb-opt-125m-route-dc21cb14-kserve-mn-0-1\" (UID: \"ae13ab10-6e7c-46ec-8438-ec2ab0fdd224\") " pod="kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-dc21cb14-kserve-mn-0-1"
Jun 15 07:10:30.327391 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:10:30.327354    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ae13ab10-6e7c-46ec-8438-ec2ab0fdd224-tmp-dir\") pod \"llmisvc-model-fb-opt-125m-route-dc21cb14-kserve-mn-0-1\" (UID: \"ae13ab10-6e7c-46ec-8438-ec2ab0fdd224\") " pod="kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-dc21cb14-kserve-mn-0-1"
Jun 15 07:10:30.327579 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:10:30.327407    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ae13ab10-6e7c-46ec-8438-ec2ab0fdd224-home\") pod \"llmisvc-model-fb-opt-125m-route-dc21cb14-kserve-mn-0-1\" (UID: \"ae13ab10-6e7c-46ec-8438-ec2ab0fdd224\") " pod="kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-dc21cb14-kserve-mn-0-1"
Jun 15 07:10:30.327579 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:10:30.327435    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ae13ab10-6e7c-46ec-8438-ec2ab0fdd224-tls-certs\") pod \"llmisvc-model-fb-opt-125m-route-dc21cb14-kserve-mn-0-1\" (UID: \"ae13ab10-6e7c-46ec-8438-ec2ab0fdd224\") " pod="kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-dc21cb14-kserve-mn-0-1"
Jun 15 07:10:30.327579 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:10:30.327490    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/ae13ab10-6e7c-46ec-8438-ec2ab0fdd224-kserve-provision-location\") pod \"llmisvc-model-fb-opt-125m-route-dc21cb14-kserve-mn-0-1\" (UID: \"ae13ab10-6e7c-46ec-8438-ec2ab0fdd224\") " pod="kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-dc21cb14-kserve-mn-0-1"
Jun 15 07:10:30.327579 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:10:30.327519    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dpn64\" (UniqueName: \"kubernetes.io/projected/ae13ab10-6e7c-46ec-8438-ec2ab0fdd224-kube-api-access-dpn64\") pod \"llmisvc-model-fb-opt-125m-route-dc21cb14-kserve-mn-0-1\" (UID: \"ae13ab10-6e7c-46ec-8438-ec2ab0fdd224\") " pod="kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-dc21cb14-kserve-mn-0-1"
Jun 15 07:10:30.327579 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:10:30.327543    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ae13ab10-6e7c-46ec-8438-ec2ab0fdd224-model-cache\") pod \"llmisvc-model-fb-opt-125m-route-dc21cb14-kserve-mn-0-1\" (UID: \"ae13ab10-6e7c-46ec-8438-ec2ab0fdd224\") " pod="kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-dc21cb14-kserve-mn-0-1"
Jun 15 07:10:30.327579 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:10:30.327568    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ae13ab10-6e7c-46ec-8438-ec2ab0fdd224-dshm\") pod \"llmisvc-model-fb-opt-125m-route-dc21cb14-kserve-mn-0-1\" (UID: \"ae13ab10-6e7c-46ec-8438-ec2ab0fdd224\") " pod="kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-dc21cb14-kserve-mn-0-1"
Jun 15 07:10:30.327903 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:10:30.327830    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ae13ab10-6e7c-46ec-8438-ec2ab0fdd224-home\") pod \"llmisvc-model-fb-opt-125m-route-dc21cb14-kserve-mn-0-1\" (UID: \"ae13ab10-6e7c-46ec-8438-ec2ab0fdd224\") " pod="kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-dc21cb14-kserve-mn-0-1"
Jun 15 07:10:30.327903 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:10:30.327881    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ae13ab10-6e7c-46ec-8438-ec2ab0fdd224-tmp-dir\") pod \"llmisvc-model-fb-opt-125m-route-dc21cb14-kserve-mn-0-1\" (UID: \"ae13ab10-6e7c-46ec-8438-ec2ab0fdd224\") " pod="kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-dc21cb14-kserve-mn-0-1"
Jun 15 07:10:30.328128 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:10:30.328101    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/ae13ab10-6e7c-46ec-8438-ec2ab0fdd224-kserve-provision-location\") pod \"llmisvc-model-fb-opt-125m-route-dc21cb14-kserve-mn-0-1\" (UID: \"ae13ab10-6e7c-46ec-8438-ec2ab0fdd224\") " pod="kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-dc21cb14-kserve-mn-0-1"
Jun 15 07:10:30.328128 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:10:30.328120    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ae13ab10-6e7c-46ec-8438-ec2ab0fdd224-model-cache\") pod \"llmisvc-model-fb-opt-125m-route-dc21cb14-kserve-mn-0-1\" (UID: \"ae13ab10-6e7c-46ec-8438-ec2ab0fdd224\") " pod="kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-dc21cb14-kserve-mn-0-1"
Jun 15 07:10:30.329898 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:10:30.329880    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ae13ab10-6e7c-46ec-8438-ec2ab0fdd224-dshm\") pod \"llmisvc-model-fb-opt-125m-route-dc21cb14-kserve-mn-0-1\" (UID: \"ae13ab10-6e7c-46ec-8438-ec2ab0fdd224\") " pod="kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-dc21cb14-kserve-mn-0-1"
Jun 15 07:10:30.330498 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:10:30.330482    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ae13ab10-6e7c-46ec-8438-ec2ab0fdd224-tls-certs\") pod \"llmisvc-model-fb-opt-125m-route-dc21cb14-kserve-mn-0-1\" (UID: \"ae13ab10-6e7c-46ec-8438-ec2ab0fdd224\") " pod="kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-dc21cb14-kserve-mn-0-1"
Jun 15 07:10:30.336812 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:10:30.336789    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dpn64\" (UniqueName: \"kubernetes.io/projected/ae13ab10-6e7c-46ec-8438-ec2ab0fdd224-kube-api-access-dpn64\") pod \"llmisvc-model-fb-opt-125m-route-dc21cb14-kserve-mn-0-1\" (UID: \"ae13ab10-6e7c-46ec-8438-ec2ab0fdd224\") " pod="kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-dc21cb14-kserve-mn-0-1"
Jun 15 07:10:30.425329 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:10:30.425239    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-dc21cb14-kserve-mn-0-1"
Jun 15 07:10:30.563143 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:10:30.563118    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-dc21cb14-kserve-mn-0-1"]
Jun 15 07:10:30.564470 ip-10-0-128-243 kubenswrapper[2566]: W0615 07:10:30.564439    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podae13ab10_6e7c_46ec_8438_ec2ab0fdd224.slice/crio-eb1a66c54d357c6a93fc0b6e8f78e9e329eb87d4c10787c8eeee1e8537df1d06 WatchSource:0}: Error finding container eb1a66c54d357c6a93fc0b6e8f78e9e329eb87d4c10787c8eeee1e8537df1d06: Status 404 returned error can't find the container with id eb1a66c54d357c6a93fc0b6e8f78e9e329eb87d4c10787c8eeee1e8537df1d06
Jun 15 07:10:30.566582 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:10:30.566556    2566 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jun 15 07:10:30.878287 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:10:30.878253    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-dc21cb14-kserve-mn-0-1" event={"ID":"ae13ab10-6e7c-46ec-8438-ec2ab0fdd224","Type":"ContainerStarted","Data":"eb1a66c54d357c6a93fc0b6e8f78e9e329eb87d4c10787c8eeee1e8537df1d06"}
Jun 15 07:10:34.907586 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:10:34.907547    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-dc21cb14-kserve-mn-0-1" event={"ID":"ae13ab10-6e7c-46ec-8438-ec2ab0fdd224","Type":"ContainerStarted","Data":"89a3697bf104cefe84b49dbf7bb4470643008dc873bfb5a1ac76ab6720589bed"}
Jun 15 07:10:45.971819 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:10:45.971784    2566 generic.go:356] "Generic (PLEG): container finished" podID="ae13ab10-6e7c-46ec-8438-ec2ab0fdd224" containerID="89a3697bf104cefe84b49dbf7bb4470643008dc873bfb5a1ac76ab6720589bed" exitCode=0
Jun 15 07:10:45.972379 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:10:45.971867    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-dc21cb14-kserve-mn-0-1" event={"ID":"ae13ab10-6e7c-46ec-8438-ec2ab0fdd224","Type":"ContainerDied","Data":"89a3697bf104cefe84b49dbf7bb4470643008dc873bfb5a1ac76ab6720589bed"}
Jun 15 07:11:14.166960 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:11:14.166924    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-dc21cb14-kserve-mn-0-1" event={"ID":"ae13ab10-6e7c-46ec-8438-ec2ab0fdd224","Type":"ContainerStarted","Data":"0bd3e4f243c2750629dd784f739c593a64d62b0c93c2c55c9d5b9d3b551d55ab"}
Jun 15 07:11:14.193269 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:11:14.193215    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-dc21cb14-kserve-mn-0-1" podStartSLOduration=1.894835802 podStartE2EDuration="44.193184922s" totalImagesPullingTime="31.393441901s" totalInitContainerRuntime="10.904907219s" isStatefulPod=false podCreationTimestamp="2026-06-15 07:10:30 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 07:11:14.191785572 +0000 UTC m=+4957.151542819" watchObservedRunningTime="2026-06-15 07:11:14.193184922 +0000 UTC m=+4957.152942168"
Jun 15 07:13:37.959116 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:13:37.958970    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5dbbb5d744-ktjgp_67da60eb-27f9-4bbd-8d12-64275e801143/console-operator/2.log"
Jun 15 07:13:37.964551 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:13:37.964532    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-f4bzh_5a1f8f83-55db-4fc7-872d-6b202daa0a31/ovn-acl-logging/0.log"
Jun 15 07:13:37.995205 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:13:37.995183    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5dbbb5d744-ktjgp_67da60eb-27f9-4bbd-8d12-64275e801143/console-operator/2.log"
Jun 15 07:13:38.000299 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:13:38.000280    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-f4bzh_5a1f8f83-55db-4fc7-872d-6b202daa0a31/ovn-acl-logging/0.log"
Jun 15 07:17:06.170614 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:17:06.170543    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/stop-feature-test-kserve-7c64ccc5f7-hmdd6"]
Jun 15 07:17:06.173785 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:17:06.173765    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/stop-feature-test-kserve-7c64ccc5f7-hmdd6"
Jun 15 07:17:06.176741 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:17:06.176721    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"stop-feature-test-kserve-self-signed-certs\""
Jun 15 07:17:06.197322 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:17:06.197298    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/stop-feature-test-kserve-7c64ccc5f7-hmdd6"]
Jun 15 07:17:06.281526 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:17:06.281494    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/880c6e0f-dbd8-40f8-a728-875527ab43db-kserve-provision-location\") pod \"stop-feature-test-kserve-7c64ccc5f7-hmdd6\" (UID: \"880c6e0f-dbd8-40f8-a728-875527ab43db\") " pod="kserve-ci-e2e-test/stop-feature-test-kserve-7c64ccc5f7-hmdd6"
Jun 15 07:17:06.281526 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:17:06.281529    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/880c6e0f-dbd8-40f8-a728-875527ab43db-dshm\") pod \"stop-feature-test-kserve-7c64ccc5f7-hmdd6\" (UID: \"880c6e0f-dbd8-40f8-a728-875527ab43db\") " pod="kserve-ci-e2e-test/stop-feature-test-kserve-7c64ccc5f7-hmdd6"
Jun 15 07:17:06.281717 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:17:06.281550    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/880c6e0f-dbd8-40f8-a728-875527ab43db-tls-certs\") pod \"stop-feature-test-kserve-7c64ccc5f7-hmdd6\" (UID: \"880c6e0f-dbd8-40f8-a728-875527ab43db\") " pod="kserve-ci-e2e-test/stop-feature-test-kserve-7c64ccc5f7-hmdd6"
Jun 15 07:17:06.281717 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:17:06.281625    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tt97g\" (UniqueName: \"kubernetes.io/projected/880c6e0f-dbd8-40f8-a728-875527ab43db-kube-api-access-tt97g\") pod \"stop-feature-test-kserve-7c64ccc5f7-hmdd6\" (UID: \"880c6e0f-dbd8-40f8-a728-875527ab43db\") " pod="kserve-ci-e2e-test/stop-feature-test-kserve-7c64ccc5f7-hmdd6"
Jun 15 07:17:06.281717 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:17:06.281657    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/880c6e0f-dbd8-40f8-a728-875527ab43db-model-cache\") pod \"stop-feature-test-kserve-7c64ccc5f7-hmdd6\" (UID: \"880c6e0f-dbd8-40f8-a728-875527ab43db\") " pod="kserve-ci-e2e-test/stop-feature-test-kserve-7c64ccc5f7-hmdd6"
Jun 15 07:17:06.281717 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:17:06.281675    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/880c6e0f-dbd8-40f8-a728-875527ab43db-home\") pod \"stop-feature-test-kserve-7c64ccc5f7-hmdd6\" (UID: \"880c6e0f-dbd8-40f8-a728-875527ab43db\") " pod="kserve-ci-e2e-test/stop-feature-test-kserve-7c64ccc5f7-hmdd6"
Jun 15 07:17:06.281717 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:17:06.281699    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/880c6e0f-dbd8-40f8-a728-875527ab43db-tmp-dir\") pod \"stop-feature-test-kserve-7c64ccc5f7-hmdd6\" (UID: \"880c6e0f-dbd8-40f8-a728-875527ab43db\") " pod="kserve-ci-e2e-test/stop-feature-test-kserve-7c64ccc5f7-hmdd6"
Jun 15 07:17:06.382750 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:17:06.382725    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tt97g\" (UniqueName: \"kubernetes.io/projected/880c6e0f-dbd8-40f8-a728-875527ab43db-kube-api-access-tt97g\") pod \"stop-feature-test-kserve-7c64ccc5f7-hmdd6\" (UID: \"880c6e0f-dbd8-40f8-a728-875527ab43db\") " pod="kserve-ci-e2e-test/stop-feature-test-kserve-7c64ccc5f7-hmdd6"
Jun 15 07:17:06.382936 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:17:06.382762    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/880c6e0f-dbd8-40f8-a728-875527ab43db-model-cache\") pod \"stop-feature-test-kserve-7c64ccc5f7-hmdd6\" (UID: \"880c6e0f-dbd8-40f8-a728-875527ab43db\") " pod="kserve-ci-e2e-test/stop-feature-test-kserve-7c64ccc5f7-hmdd6"
Jun 15 07:17:06.382936 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:17:06.382784    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/880c6e0f-dbd8-40f8-a728-875527ab43db-home\") pod \"stop-feature-test-kserve-7c64ccc5f7-hmdd6\" (UID: \"880c6e0f-dbd8-40f8-a728-875527ab43db\") " pod="kserve-ci-e2e-test/stop-feature-test-kserve-7c64ccc5f7-hmdd6"
Jun 15 07:17:06.382936 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:17:06.382904    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/880c6e0f-dbd8-40f8-a728-875527ab43db-tmp-dir\") pod \"stop-feature-test-kserve-7c64ccc5f7-hmdd6\" (UID: \"880c6e0f-dbd8-40f8-a728-875527ab43db\") " pod="kserve-ci-e2e-test/stop-feature-test-kserve-7c64ccc5f7-hmdd6"
Jun 15 07:17:06.383151 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:17:06.382967    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/880c6e0f-dbd8-40f8-a728-875527ab43db-kserve-provision-location\") pod \"stop-feature-test-kserve-7c64ccc5f7-hmdd6\" (UID: \"880c6e0f-dbd8-40f8-a728-875527ab43db\") " pod="kserve-ci-e2e-test/stop-feature-test-kserve-7c64ccc5f7-hmdd6"
Jun 15 07:17:06.383151 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:17:06.382989    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/880c6e0f-dbd8-40f8-a728-875527ab43db-dshm\") pod \"stop-feature-test-kserve-7c64ccc5f7-hmdd6\" (UID: \"880c6e0f-dbd8-40f8-a728-875527ab43db\") " pod="kserve-ci-e2e-test/stop-feature-test-kserve-7c64ccc5f7-hmdd6"
Jun 15 07:17:06.383151 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:17:06.383013    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/880c6e0f-dbd8-40f8-a728-875527ab43db-tls-certs\") pod \"stop-feature-test-kserve-7c64ccc5f7-hmdd6\" (UID: \"880c6e0f-dbd8-40f8-a728-875527ab43db\") " pod="kserve-ci-e2e-test/stop-feature-test-kserve-7c64ccc5f7-hmdd6"
Jun 15 07:17:06.383151 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:17:06.383141    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/880c6e0f-dbd8-40f8-a728-875527ab43db-home\") pod \"stop-feature-test-kserve-7c64ccc5f7-hmdd6\" (UID: \"880c6e0f-dbd8-40f8-a728-875527ab43db\") " pod="kserve-ci-e2e-test/stop-feature-test-kserve-7c64ccc5f7-hmdd6"
Jun 15 07:17:06.383330 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:17:06.383200    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/880c6e0f-dbd8-40f8-a728-875527ab43db-model-cache\") pod \"stop-feature-test-kserve-7c64ccc5f7-hmdd6\" (UID: \"880c6e0f-dbd8-40f8-a728-875527ab43db\") " pod="kserve-ci-e2e-test/stop-feature-test-kserve-7c64ccc5f7-hmdd6"
Jun 15 07:17:06.383330 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:17:06.383256    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/880c6e0f-dbd8-40f8-a728-875527ab43db-tmp-dir\") pod \"stop-feature-test-kserve-7c64ccc5f7-hmdd6\" (UID: \"880c6e0f-dbd8-40f8-a728-875527ab43db\") " pod="kserve-ci-e2e-test/stop-feature-test-kserve-7c64ccc5f7-hmdd6"
Jun 15 07:17:06.383330 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:17:06.383312    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/880c6e0f-dbd8-40f8-a728-875527ab43db-kserve-provision-location\") pod \"stop-feature-test-kserve-7c64ccc5f7-hmdd6\" (UID: \"880c6e0f-dbd8-40f8-a728-875527ab43db\") " pod="kserve-ci-e2e-test/stop-feature-test-kserve-7c64ccc5f7-hmdd6"
Jun 15 07:17:06.385420 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:17:06.385402    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/880c6e0f-dbd8-40f8-a728-875527ab43db-dshm\") pod \"stop-feature-test-kserve-7c64ccc5f7-hmdd6\" (UID: \"880c6e0f-dbd8-40f8-a728-875527ab43db\") " pod="kserve-ci-e2e-test/stop-feature-test-kserve-7c64ccc5f7-hmdd6"
Jun 15 07:17:06.385797 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:17:06.385778    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/880c6e0f-dbd8-40f8-a728-875527ab43db-tls-certs\") pod \"stop-feature-test-kserve-7c64ccc5f7-hmdd6\" (UID: \"880c6e0f-dbd8-40f8-a728-875527ab43db\") " pod="kserve-ci-e2e-test/stop-feature-test-kserve-7c64ccc5f7-hmdd6"
Jun 15 07:17:06.391377 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:17:06.391347    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tt97g\" (UniqueName: \"kubernetes.io/projected/880c6e0f-dbd8-40f8-a728-875527ab43db-kube-api-access-tt97g\") pod \"stop-feature-test-kserve-7c64ccc5f7-hmdd6\" (UID: \"880c6e0f-dbd8-40f8-a728-875527ab43db\") " pod="kserve-ci-e2e-test/stop-feature-test-kserve-7c64ccc5f7-hmdd6"
Jun 15 07:17:06.483787 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:17:06.483709    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/stop-feature-test-kserve-7c64ccc5f7-hmdd6"
Jun 15 07:17:06.625472 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:17:06.625430    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/stop-feature-test-kserve-7c64ccc5f7-hmdd6"]
Jun 15 07:17:06.625828 ip-10-0-128-243 kubenswrapper[2566]: W0615 07:17:06.625802    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod880c6e0f_dbd8_40f8_a728_875527ab43db.slice/crio-78a49cc9f79f42b71857f4e4e6d382c1a359577a57e1fa62810f80c71c7b1899 WatchSource:0}: Error finding container 78a49cc9f79f42b71857f4e4e6d382c1a359577a57e1fa62810f80c71c7b1899: Status 404 returned error can't find the container with id 78a49cc9f79f42b71857f4e4e6d382c1a359577a57e1fa62810f80c71c7b1899
Jun 15 07:17:06.630388 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:17:06.630367    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"seaweedfs-s3-creds\""
Jun 15 07:17:07.051259 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:17:07.051218    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/stop-feature-test-kserve-7c64ccc5f7-hmdd6" event={"ID":"880c6e0f-dbd8-40f8-a728-875527ab43db","Type":"ContainerStarted","Data":"a9e1d7d30abc7c1092a9bc4a702a9b191fc7e797bc315984f3e21644e7c44082"}
Jun 15 07:17:07.051503 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:17:07.051270    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/stop-feature-test-kserve-7c64ccc5f7-hmdd6" event={"ID":"880c6e0f-dbd8-40f8-a728-875527ab43db","Type":"ContainerStarted","Data":"78a49cc9f79f42b71857f4e4e6d382c1a359577a57e1fa62810f80c71c7b1899"}
Jun 15 07:17:43.251777 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:17:43.251746    2566 generic.go:356] "Generic (PLEG): container finished" podID="880c6e0f-dbd8-40f8-a728-875527ab43db" containerID="a9e1d7d30abc7c1092a9bc4a702a9b191fc7e797bc315984f3e21644e7c44082" exitCode=0
Jun 15 07:17:43.252193 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:17:43.251813    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/stop-feature-test-kserve-7c64ccc5f7-hmdd6" event={"ID":"880c6e0f-dbd8-40f8-a728-875527ab43db","Type":"ContainerDied","Data":"a9e1d7d30abc7c1092a9bc4a702a9b191fc7e797bc315984f3e21644e7c44082"}
Jun 15 07:17:44.258921 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:17:44.258888    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/stop-feature-test-kserve-7c64ccc5f7-hmdd6" event={"ID":"880c6e0f-dbd8-40f8-a728-875527ab43db","Type":"ContainerStarted","Data":"3bb61f6879541a116fc5781887debd35a6738dcccc97354115354340f3991c59"}
Jun 15 07:17:44.286664 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:17:44.286600    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/stop-feature-test-kserve-7c64ccc5f7-hmdd6" podStartSLOduration=1.811219474 podStartE2EDuration="38.286577339s" totalImagesPullingTime="0s" totalInitContainerRuntime="36.475357865s" isStatefulPod=false podCreationTimestamp="2026-06-15 07:17:06 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 07:17:44.283274409 +0000 UTC m=+5347.243031653" watchObservedRunningTime="2026-06-15 07:17:44.286577339 +0000 UTC m=+5347.246334590"
Jun 15 07:17:46.484415 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:17:46.484381    2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kserve-ci-e2e-test/stop-feature-test-kserve-7c64ccc5f7-hmdd6"
Jun 15 07:17:46.484896 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:17:46.484454    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/stop-feature-test-kserve-7c64ccc5f7-hmdd6"
Jun 15 07:17:46.485990 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:17:46.485955    2566 prober.go:120] "Probe failed" probeType="Startup" pod="kserve-ci-e2e-test/stop-feature-test-kserve-7c64ccc5f7-hmdd6" podUID="880c6e0f-dbd8-40f8-a728-875527ab43db" containerName="main" probeResult="failure" output="Get \"https://10.132.0.50:8000/health\": dial tcp 10.132.0.50:8000: connect: connection refused"
Jun 15 07:17:52.542430 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:17:52.542391    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-dc21cb14-kserve-mn-0-1"]
Jun 15 07:17:56.484956 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:17:56.484908    2566 prober.go:120] "Probe failed" probeType="Startup" pod="kserve-ci-e2e-test/stop-feature-test-kserve-7c64ccc5f7-hmdd6" podUID="880c6e0f-dbd8-40f8-a728-875527ab43db" containerName="main" probeResult="failure" output="Get \"https://10.132.0.50:8000/health\": dial tcp 10.132.0.50:8000: connect: connection refused"
Jun 15 07:18:06.484722 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:18:06.484668    2566 prober.go:120] "Probe failed" probeType="Startup" pod="kserve-ci-e2e-test/stop-feature-test-kserve-7c64ccc5f7-hmdd6" podUID="880c6e0f-dbd8-40f8-a728-875527ab43db" containerName="main" probeResult="failure" output="Get \"https://10.132.0.50:8000/health\": dial tcp 10.132.0.50:8000: connect: connection refused"
Jun 15 07:18:07.566538 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:18:07.566494    2566 kuberuntime_container.go:872] "Killing container with a grace period" pod="kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-dc21cb14-kserve-mn-0-1" podUID="ae13ab10-6e7c-46ec-8438-ec2ab0fdd224" containerName="main" containerID="cri-o://0bd3e4f243c2750629dd784f739c593a64d62b0c93c2c55c9d5b9d3b551d55ab" gracePeriod=45
Jun 15 07:18:08.223689 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:18:08.223664    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-dc21cb14-kserve-mn-0-1"
Jun 15 07:18:08.332499 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:18:08.332411    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ae13ab10-6e7c-46ec-8438-ec2ab0fdd224-model-cache\") pod \"ae13ab10-6e7c-46ec-8438-ec2ab0fdd224\" (UID: \"ae13ab10-6e7c-46ec-8438-ec2ab0fdd224\") "
Jun 15 07:18:08.332651 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:18:08.332504    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ae13ab10-6e7c-46ec-8438-ec2ab0fdd224-dshm\") pod \"ae13ab10-6e7c-46ec-8438-ec2ab0fdd224\" (UID: \"ae13ab10-6e7c-46ec-8438-ec2ab0fdd224\") "
Jun 15 07:18:08.332651 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:18:08.332543    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ae13ab10-6e7c-46ec-8438-ec2ab0fdd224-tmp-dir\") pod \"ae13ab10-6e7c-46ec-8438-ec2ab0fdd224\" (UID: \"ae13ab10-6e7c-46ec-8438-ec2ab0fdd224\") "
Jun 15 07:18:08.332651 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:18:08.332577    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ae13ab10-6e7c-46ec-8438-ec2ab0fdd224-home\") pod \"ae13ab10-6e7c-46ec-8438-ec2ab0fdd224\" (UID: \"ae13ab10-6e7c-46ec-8438-ec2ab0fdd224\") "
Jun 15 07:18:08.332651 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:18:08.332614    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ae13ab10-6e7c-46ec-8438-ec2ab0fdd224-tls-certs\") pod \"ae13ab10-6e7c-46ec-8438-ec2ab0fdd224\" (UID: \"ae13ab10-6e7c-46ec-8438-ec2ab0fdd224\") "
Jun 15 07:18:08.332651 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:18:08.332644    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dpn64\" (UniqueName: \"kubernetes.io/projected/ae13ab10-6e7c-46ec-8438-ec2ab0fdd224-kube-api-access-dpn64\") pod \"ae13ab10-6e7c-46ec-8438-ec2ab0fdd224\" (UID: \"ae13ab10-6e7c-46ec-8438-ec2ab0fdd224\") "
Jun 15 07:18:08.332904 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:18:08.332685    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/ae13ab10-6e7c-46ec-8438-ec2ab0fdd224-kserve-provision-location\") pod \"ae13ab10-6e7c-46ec-8438-ec2ab0fdd224\" (UID: \"ae13ab10-6e7c-46ec-8438-ec2ab0fdd224\") "
Jun 15 07:18:08.333103 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:18:08.332685    2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ae13ab10-6e7c-46ec-8438-ec2ab0fdd224-model-cache" (OuterVolumeSpecName: "model-cache") pod "ae13ab10-6e7c-46ec-8438-ec2ab0fdd224" (UID: "ae13ab10-6e7c-46ec-8438-ec2ab0fdd224"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jun 15 07:18:08.333335 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:18:08.333284    2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ae13ab10-6e7c-46ec-8438-ec2ab0fdd224-home" (OuterVolumeSpecName: "home") pod "ae13ab10-6e7c-46ec-8438-ec2ab0fdd224" (UID: "ae13ab10-6e7c-46ec-8438-ec2ab0fdd224"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jun 15 07:18:08.334000 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:18:08.333971    2566 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ae13ab10-6e7c-46ec-8438-ec2ab0fdd224-model-cache\") on node \"ip-10-0-128-243.ec2.internal\" DevicePath \"\""
Jun 15 07:18:08.334124 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:18:08.334004    2566 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ae13ab10-6e7c-46ec-8438-ec2ab0fdd224-home\") on node \"ip-10-0-128-243.ec2.internal\" DevicePath \"\""
Jun 15 07:18:08.335009 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:18:08.334977    2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ae13ab10-6e7c-46ec-8438-ec2ab0fdd224-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "ae13ab10-6e7c-46ec-8438-ec2ab0fdd224" (UID: "ae13ab10-6e7c-46ec-8438-ec2ab0fdd224"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jun 15 07:18:08.335301 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:18:08.335273    2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ae13ab10-6e7c-46ec-8438-ec2ab0fdd224-dshm" (OuterVolumeSpecName: "dshm") pod "ae13ab10-6e7c-46ec-8438-ec2ab0fdd224" (UID: "ae13ab10-6e7c-46ec-8438-ec2ab0fdd224"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jun 15 07:18:08.335390 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:18:08.335293    2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ae13ab10-6e7c-46ec-8438-ec2ab0fdd224-kube-api-access-dpn64" (OuterVolumeSpecName: "kube-api-access-dpn64") pod "ae13ab10-6e7c-46ec-8438-ec2ab0fdd224" (UID: "ae13ab10-6e7c-46ec-8438-ec2ab0fdd224"). InnerVolumeSpecName "kube-api-access-dpn64". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jun 15 07:18:08.345636 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:18:08.345608    2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ae13ab10-6e7c-46ec-8438-ec2ab0fdd224-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "ae13ab10-6e7c-46ec-8438-ec2ab0fdd224" (UID: "ae13ab10-6e7c-46ec-8438-ec2ab0fdd224"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jun 15 07:18:08.397097 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:18:08.397041    2566 generic.go:356] "Generic (PLEG): container finished" podID="ae13ab10-6e7c-46ec-8438-ec2ab0fdd224" containerID="0bd3e4f243c2750629dd784f739c593a64d62b0c93c2c55c9d5b9d3b551d55ab" exitCode=0
Jun 15 07:18:08.397097 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:18:08.397099    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-dc21cb14-kserve-mn-0-1"
Jun 15 07:18:08.397296 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:18:08.397109    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-dc21cb14-kserve-mn-0-1" event={"ID":"ae13ab10-6e7c-46ec-8438-ec2ab0fdd224","Type":"ContainerDied","Data":"0bd3e4f243c2750629dd784f739c593a64d62b0c93c2c55c9d5b9d3b551d55ab"}
Jun 15 07:18:08.397296 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:18:08.397161    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-dc21cb14-kserve-mn-0-1" event={"ID":"ae13ab10-6e7c-46ec-8438-ec2ab0fdd224","Type":"ContainerDied","Data":"eb1a66c54d357c6a93fc0b6e8f78e9e329eb87d4c10787c8eeee1e8537df1d06"}
Jun 15 07:18:08.397296 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:18:08.397191    2566 scope.go:117] "RemoveContainer" containerID="0bd3e4f243c2750629dd784f739c593a64d62b0c93c2c55c9d5b9d3b551d55ab"
Jun 15 07:18:08.406628 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:18:08.406606    2566 scope.go:117] "RemoveContainer" containerID="89a3697bf104cefe84b49dbf7bb4470643008dc873bfb5a1ac76ab6720589bed"
Jun 15 07:18:08.408889 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:18:08.408856    2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ae13ab10-6e7c-46ec-8438-ec2ab0fdd224-kserve-provision-location" (OuterVolumeSpecName: "kserve-provision-location") pod "ae13ab10-6e7c-46ec-8438-ec2ab0fdd224" (UID: "ae13ab10-6e7c-46ec-8438-ec2ab0fdd224"). InnerVolumeSpecName "kserve-provision-location". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jun 15 07:18:08.417181 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:18:08.417149    2566 scope.go:117] "RemoveContainer" containerID="0bd3e4f243c2750629dd784f739c593a64d62b0c93c2c55c9d5b9d3b551d55ab"
Jun 15 07:18:08.417487 ip-10-0-128-243 kubenswrapper[2566]: E0615 07:18:08.417464    2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0bd3e4f243c2750629dd784f739c593a64d62b0c93c2c55c9d5b9d3b551d55ab\": container with ID starting with 0bd3e4f243c2750629dd784f739c593a64d62b0c93c2c55c9d5b9d3b551d55ab not found: ID does not exist" containerID="0bd3e4f243c2750629dd784f739c593a64d62b0c93c2c55c9d5b9d3b551d55ab"
Jun 15 07:18:08.417577 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:18:08.417499    2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0bd3e4f243c2750629dd784f739c593a64d62b0c93c2c55c9d5b9d3b551d55ab"} err="failed to get container status \"0bd3e4f243c2750629dd784f739c593a64d62b0c93c2c55c9d5b9d3b551d55ab\": rpc error: code = NotFound desc = could not find container \"0bd3e4f243c2750629dd784f739c593a64d62b0c93c2c55c9d5b9d3b551d55ab\": container with ID starting with 0bd3e4f243c2750629dd784f739c593a64d62b0c93c2c55c9d5b9d3b551d55ab not found: ID does not exist"
Jun 15 07:18:08.417577 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:18:08.417525    2566 scope.go:117] "RemoveContainer" containerID="89a3697bf104cefe84b49dbf7bb4470643008dc873bfb5a1ac76ab6720589bed"
Jun 15 07:18:08.417784 ip-10-0-128-243 kubenswrapper[2566]: E0615 07:18:08.417765    2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"89a3697bf104cefe84b49dbf7bb4470643008dc873bfb5a1ac76ab6720589bed\": container with ID starting with 89a3697bf104cefe84b49dbf7bb4470643008dc873bfb5a1ac76ab6720589bed not found: ID does not exist" containerID="89a3697bf104cefe84b49dbf7bb4470643008dc873bfb5a1ac76ab6720589bed"
Jun 15 07:18:08.417828 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:18:08.417794    2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"89a3697bf104cefe84b49dbf7bb4470643008dc873bfb5a1ac76ab6720589bed"} err="failed to get container status \"89a3697bf104cefe84b49dbf7bb4470643008dc873bfb5a1ac76ab6720589bed\": rpc error: code = NotFound desc = could not find container \"89a3697bf104cefe84b49dbf7bb4470643008dc873bfb5a1ac76ab6720589bed\": container with ID starting with 89a3697bf104cefe84b49dbf7bb4470643008dc873bfb5a1ac76ab6720589bed not found: ID does not exist"
Jun 15 07:18:08.435274 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:18:08.435254    2566 reconciler_common.go:299] "Volume detached for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/ae13ab10-6e7c-46ec-8438-ec2ab0fdd224-kserve-provision-location\") on node \"ip-10-0-128-243.ec2.internal\" DevicePath \"\""
Jun 15 07:18:08.435343 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:18:08.435277    2566 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ae13ab10-6e7c-46ec-8438-ec2ab0fdd224-dshm\") on node \"ip-10-0-128-243.ec2.internal\" DevicePath \"\""
Jun 15 07:18:08.435343 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:18:08.435306    2566 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ae13ab10-6e7c-46ec-8438-ec2ab0fdd224-tmp-dir\") on node \"ip-10-0-128-243.ec2.internal\" DevicePath \"\""
Jun 15 07:18:08.435343 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:18:08.435315    2566 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ae13ab10-6e7c-46ec-8438-ec2ab0fdd224-tls-certs\") on node \"ip-10-0-128-243.ec2.internal\" DevicePath \"\""
Jun 15 07:18:08.435343 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:18:08.435323    2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dpn64\" (UniqueName: \"kubernetes.io/projected/ae13ab10-6e7c-46ec-8438-ec2ab0fdd224-kube-api-access-dpn64\") on node \"ip-10-0-128-243.ec2.internal\" DevicePath \"\""
Jun 15 07:18:08.722751 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:18:08.722719    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-dc21cb14-kserve-mn-0-1"]
Jun 15 07:18:08.725525 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:18:08.725503    2566 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-dc21cb14-kserve-mn-0-1"]
Jun 15 07:18:09.442363 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:18:09.442330    2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ae13ab10-6e7c-46ec-8438-ec2ab0fdd224" path="/var/lib/kubelet/pods/ae13ab10-6e7c-46ec-8438-ec2ab0fdd224/volumes"
Jun 15 07:18:16.485158 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:18:16.485045    2566 prober.go:120] "Probe failed" probeType="Startup" pod="kserve-ci-e2e-test/stop-feature-test-kserve-7c64ccc5f7-hmdd6" podUID="880c6e0f-dbd8-40f8-a728-875527ab43db" containerName="main" probeResult="failure" output="Get \"https://10.132.0.50:8000/health\": dial tcp 10.132.0.50:8000: connect: connection refused"
Jun 15 07:18:25.250145 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:18:25.250045    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/scheduler-inline-config-test-kserve-d5fb8b768-9kwjd"]
Jun 15 07:18:25.250618 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:18:25.250597    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ae13ab10-6e7c-46ec-8438-ec2ab0fdd224" containerName="main"
Jun 15 07:18:25.250692 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:18:25.250622    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="ae13ab10-6e7c-46ec-8438-ec2ab0fdd224" containerName="main"
Jun 15 07:18:25.250692 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:18:25.250655    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ae13ab10-6e7c-46ec-8438-ec2ab0fdd224" containerName="storage-initializer"
Jun 15 07:18:25.250692 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:18:25.250665    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="ae13ab10-6e7c-46ec-8438-ec2ab0fdd224" containerName="storage-initializer"
Jun 15 07:18:25.250849 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:18:25.250756    2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="ae13ab10-6e7c-46ec-8438-ec2ab0fdd224" containerName="main"
Jun 15 07:18:25.256427 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:18:25.256396    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/scheduler-inline-config-test-kserve-d5fb8b768-9kwjd"
Jun 15 07:18:25.259317 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:18:25.259287    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"scheduler-inline-config-test-kserve-self-signed-certs\""
Jun 15 07:18:25.265024 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:18:25.264997    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/scheduler-inline-config-test-kserve-d5fb8b768-9kwjd"]
Jun 15 07:18:25.287578 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:18:25.287546    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ca29a175-e50d-4168-8402-bbac25a5ea11-tls-certs\") pod \"scheduler-inline-config-test-kserve-d5fb8b768-9kwjd\" (UID: \"ca29a175-e50d-4168-8402-bbac25a5ea11\") " pod="kserve-ci-e2e-test/scheduler-inline-config-test-kserve-d5fb8b768-9kwjd"
Jun 15 07:18:25.287699 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:18:25.287596    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ca29a175-e50d-4168-8402-bbac25a5ea11-dshm\") pod \"scheduler-inline-config-test-kserve-d5fb8b768-9kwjd\" (UID: \"ca29a175-e50d-4168-8402-bbac25a5ea11\") " pod="kserve-ci-e2e-test/scheduler-inline-config-test-kserve-d5fb8b768-9kwjd"
Jun 15 07:18:25.287699 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:18:25.287621    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ca29a175-e50d-4168-8402-bbac25a5ea11-home\") pod \"scheduler-inline-config-test-kserve-d5fb8b768-9kwjd\" (UID: \"ca29a175-e50d-4168-8402-bbac25a5ea11\") " pod="kserve-ci-e2e-test/scheduler-inline-config-test-kserve-d5fb8b768-9kwjd"
Jun 15 07:18:25.287699 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:18:25.287659    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ca29a175-e50d-4168-8402-bbac25a5ea11-tmp-dir\") pod \"scheduler-inline-config-test-kserve-d5fb8b768-9kwjd\" (UID: \"ca29a175-e50d-4168-8402-bbac25a5ea11\") " pod="kserve-ci-e2e-test/scheduler-inline-config-test-kserve-d5fb8b768-9kwjd"
Jun 15 07:18:25.287839 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:18:25.287729    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ca29a175-e50d-4168-8402-bbac25a5ea11-model-cache\") pod \"scheduler-inline-config-test-kserve-d5fb8b768-9kwjd\" (UID: \"ca29a175-e50d-4168-8402-bbac25a5ea11\") " pod="kserve-ci-e2e-test/scheduler-inline-config-test-kserve-d5fb8b768-9kwjd"
Jun 15 07:18:25.287839 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:18:25.287775    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6pc9r\" (UniqueName: \"kubernetes.io/projected/ca29a175-e50d-4168-8402-bbac25a5ea11-kube-api-access-6pc9r\") pod \"scheduler-inline-config-test-kserve-d5fb8b768-9kwjd\" (UID: \"ca29a175-e50d-4168-8402-bbac25a5ea11\") " pod="kserve-ci-e2e-test/scheduler-inline-config-test-kserve-d5fb8b768-9kwjd"
Jun 15 07:18:25.388507 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:18:25.388474    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ca29a175-e50d-4168-8402-bbac25a5ea11-dshm\") pod \"scheduler-inline-config-test-kserve-d5fb8b768-9kwjd\" (UID: \"ca29a175-e50d-4168-8402-bbac25a5ea11\") " pod="kserve-ci-e2e-test/scheduler-inline-config-test-kserve-d5fb8b768-9kwjd"
Jun 15 07:18:25.388507 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:18:25.388512    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ca29a175-e50d-4168-8402-bbac25a5ea11-home\") pod \"scheduler-inline-config-test-kserve-d5fb8b768-9kwjd\" (UID: \"ca29a175-e50d-4168-8402-bbac25a5ea11\") " pod="kserve-ci-e2e-test/scheduler-inline-config-test-kserve-d5fb8b768-9kwjd"
Jun 15 07:18:25.388746 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:18:25.388534    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ca29a175-e50d-4168-8402-bbac25a5ea11-tmp-dir\") pod \"scheduler-inline-config-test-kserve-d5fb8b768-9kwjd\" (UID: \"ca29a175-e50d-4168-8402-bbac25a5ea11\") " pod="kserve-ci-e2e-test/scheduler-inline-config-test-kserve-d5fb8b768-9kwjd"
Jun 15 07:18:25.388746 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:18:25.388571    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ca29a175-e50d-4168-8402-bbac25a5ea11-model-cache\") pod \"scheduler-inline-config-test-kserve-d5fb8b768-9kwjd\" (UID: \"ca29a175-e50d-4168-8402-bbac25a5ea11\") " pod="kserve-ci-e2e-test/scheduler-inline-config-test-kserve-d5fb8b768-9kwjd"
Jun 15 07:18:25.388746 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:18:25.388706    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6pc9r\" (UniqueName: \"kubernetes.io/projected/ca29a175-e50d-4168-8402-bbac25a5ea11-kube-api-access-6pc9r\") pod \"scheduler-inline-config-test-kserve-d5fb8b768-9kwjd\" (UID: \"ca29a175-e50d-4168-8402-bbac25a5ea11\") " pod="kserve-ci-e2e-test/scheduler-inline-config-test-kserve-d5fb8b768-9kwjd"
Jun 15 07:18:25.388905 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:18:25.388751    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ca29a175-e50d-4168-8402-bbac25a5ea11-tls-certs\") pod \"scheduler-inline-config-test-kserve-d5fb8b768-9kwjd\" (UID: \"ca29a175-e50d-4168-8402-bbac25a5ea11\") " pod="kserve-ci-e2e-test/scheduler-inline-config-test-kserve-d5fb8b768-9kwjd"
Jun 15 07:18:25.389056 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:18:25.389032    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ca29a175-e50d-4168-8402-bbac25a5ea11-home\") pod \"scheduler-inline-config-test-kserve-d5fb8b768-9kwjd\" (UID: \"ca29a175-e50d-4168-8402-bbac25a5ea11\") " pod="kserve-ci-e2e-test/scheduler-inline-config-test-kserve-d5fb8b768-9kwjd"
Jun 15 07:18:25.389156 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:18:25.389059    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ca29a175-e50d-4168-8402-bbac25a5ea11-model-cache\") pod \"scheduler-inline-config-test-kserve-d5fb8b768-9kwjd\" (UID: \"ca29a175-e50d-4168-8402-bbac25a5ea11\") " pod="kserve-ci-e2e-test/scheduler-inline-config-test-kserve-d5fb8b768-9kwjd"
Jun 15 07:18:25.389156 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:18:25.389140    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ca29a175-e50d-4168-8402-bbac25a5ea11-tmp-dir\") pod \"scheduler-inline-config-test-kserve-d5fb8b768-9kwjd\" (UID: \"ca29a175-e50d-4168-8402-bbac25a5ea11\") " pod="kserve-ci-e2e-test/scheduler-inline-config-test-kserve-d5fb8b768-9kwjd"
Jun 15 07:18:25.390983 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:18:25.390957    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ca29a175-e50d-4168-8402-bbac25a5ea11-dshm\") pod \"scheduler-inline-config-test-kserve-d5fb8b768-9kwjd\" (UID: \"ca29a175-e50d-4168-8402-bbac25a5ea11\") " pod="kserve-ci-e2e-test/scheduler-inline-config-test-kserve-d5fb8b768-9kwjd"
Jun 15 07:18:25.391276 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:18:25.391258    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ca29a175-e50d-4168-8402-bbac25a5ea11-tls-certs\") pod \"scheduler-inline-config-test-kserve-d5fb8b768-9kwjd\" (UID: \"ca29a175-e50d-4168-8402-bbac25a5ea11\") " pod="kserve-ci-e2e-test/scheduler-inline-config-test-kserve-d5fb8b768-9kwjd"
Jun 15 07:18:25.397408 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:18:25.397388    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6pc9r\" (UniqueName: \"kubernetes.io/projected/ca29a175-e50d-4168-8402-bbac25a5ea11-kube-api-access-6pc9r\") pod \"scheduler-inline-config-test-kserve-d5fb8b768-9kwjd\" (UID: \"ca29a175-e50d-4168-8402-bbac25a5ea11\") " pod="kserve-ci-e2e-test/scheduler-inline-config-test-kserve-d5fb8b768-9kwjd"
Jun 15 07:18:25.569471 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:18:25.569431    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/scheduler-inline-config-test-kserve-d5fb8b768-9kwjd"
Jun 15 07:18:25.709308 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:18:25.709282    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/scheduler-inline-config-test-kserve-d5fb8b768-9kwjd"]
Jun 15 07:18:25.711314 ip-10-0-128-243 kubenswrapper[2566]: W0615 07:18:25.711279    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podca29a175_e50d_4168_8402_bbac25a5ea11.slice/crio-44180aae7b49cad73b8a7d487e49fce162f8ed9f92cf5483420839247f5518c3 WatchSource:0}: Error finding container 44180aae7b49cad73b8a7d487e49fce162f8ed9f92cf5483420839247f5518c3: Status 404 returned error can't find the container with id 44180aae7b49cad73b8a7d487e49fce162f8ed9f92cf5483420839247f5518c3
Jun 15 07:18:26.484830 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:18:26.484791    2566 prober.go:120] "Probe failed" probeType="Startup" pod="kserve-ci-e2e-test/stop-feature-test-kserve-7c64ccc5f7-hmdd6" podUID="880c6e0f-dbd8-40f8-a728-875527ab43db" containerName="main" probeResult="failure" output="Get \"https://10.132.0.50:8000/health\": dial tcp 10.132.0.50:8000: connect: connection refused"
Jun 15 07:18:26.505699 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:18:26.505664    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/scheduler-inline-config-test-kserve-d5fb8b768-9kwjd" event={"ID":"ca29a175-e50d-4168-8402-bbac25a5ea11","Type":"ContainerStarted","Data":"764ab552d0157da1472f74fe86307f1fc0940d2892b662c8860acf79fa264d9c"}
Jun 15 07:18:26.505896 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:18:26.505722    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/scheduler-inline-config-test-kserve-d5fb8b768-9kwjd" event={"ID":"ca29a175-e50d-4168-8402-bbac25a5ea11","Type":"ContainerStarted","Data":"44180aae7b49cad73b8a7d487e49fce162f8ed9f92cf5483420839247f5518c3"}
Jun 15 07:18:26.524300 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:18:26.524235    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/scheduler-inline-config-test-kserve-d5fb8b768-9kwjd" podStartSLOduration=1.52421553 podStartE2EDuration="1.52421553s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-15 07:18:25 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 07:18:26.523188057 +0000 UTC m=+5389.482945279" watchObservedRunningTime="2026-06-15 07:18:26.52421553 +0000 UTC m=+5389.483972776"
Jun 15 07:18:35.569846 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:18:35.569811    2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kserve-ci-e2e-test/scheduler-inline-config-test-kserve-d5fb8b768-9kwjd"
Jun 15 07:18:35.570368 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:18:35.569868    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/scheduler-inline-config-test-kserve-d5fb8b768-9kwjd"
Jun 15 07:18:35.582188 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:18:35.582156    2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kserve-ci-e2e-test/scheduler-inline-config-test-kserve-d5fb8b768-9kwjd"
Jun 15 07:18:36.484986 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:18:36.484932    2566 prober.go:120] "Probe failed" probeType="Startup" pod="kserve-ci-e2e-test/stop-feature-test-kserve-7c64ccc5f7-hmdd6" podUID="880c6e0f-dbd8-40f8-a728-875527ab43db" containerName="main" probeResult="failure" output="Get \"https://10.132.0.50:8000/health\": dial tcp 10.132.0.50:8000: connect: connection refused"
Jun 15 07:18:36.581411 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:18:36.581375    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/scheduler-inline-config-test-kserve-d5fb8b768-9kwjd"
Jun 15 07:18:37.996639 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:18:37.996534    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5dbbb5d744-ktjgp_67da60eb-27f9-4bbd-8d12-64275e801143/console-operator/2.log"
Jun 15 07:18:38.002525 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:18:38.002504    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-f4bzh_5a1f8f83-55db-4fc7-872d-6b202daa0a31/ovn-acl-logging/0.log"
Jun 15 07:18:38.033109 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:18:38.033067    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5dbbb5d744-ktjgp_67da60eb-27f9-4bbd-8d12-64275e801143/console-operator/2.log"
Jun 15 07:18:38.039302 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:18:38.039284    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-f4bzh_5a1f8f83-55db-4fc7-872d-6b202daa0a31/ovn-acl-logging/0.log"
Jun 15 07:18:46.484655 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:18:46.484605    2566 prober.go:120] "Probe failed" probeType="Startup" pod="kserve-ci-e2e-test/stop-feature-test-kserve-7c64ccc5f7-hmdd6" podUID="880c6e0f-dbd8-40f8-a728-875527ab43db" containerName="main" probeResult="failure" output="Get \"https://10.132.0.50:8000/health\": dial tcp 10.132.0.50:8000: connect: connection refused"
Jun 15 07:18:56.484719 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:18:56.484675    2566 prober.go:120] "Probe failed" probeType="Startup" pod="kserve-ci-e2e-test/stop-feature-test-kserve-7c64ccc5f7-hmdd6" podUID="880c6e0f-dbd8-40f8-a728-875527ab43db" containerName="main" probeResult="failure" output="Get \"https://10.132.0.50:8000/health\": dial tcp 10.132.0.50:8000: connect: connection refused"
Jun 15 07:18:58.682405 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:18:58.682367    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/scheduler-inline-config-test-kserve-d5fb8b768-9kwjd"]
Jun 15 07:19:06.484778 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:19:06.484735    2566 prober.go:120] "Probe failed" probeType="Startup" pod="kserve-ci-e2e-test/stop-feature-test-kserve-7c64ccc5f7-hmdd6" podUID="880c6e0f-dbd8-40f8-a728-875527ab43db" containerName="main" probeResult="failure" output="Get \"https://10.132.0.50:8000/health\": dial tcp 10.132.0.50:8000: connect: connection refused"
Jun 15 07:19:13.707543 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:19:13.707506    2566 kuberuntime_container.go:872] "Killing container with a grace period" pod="kserve-ci-e2e-test/scheduler-inline-config-test-kserve-d5fb8b768-9kwjd" podUID="ca29a175-e50d-4168-8402-bbac25a5ea11" containerName="main" containerID="cri-o://764ab552d0157da1472f74fe86307f1fc0940d2892b662c8860acf79fa264d9c" gracePeriod=45
Jun 15 07:19:13.960129 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:19:13.960054    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/scheduler-inline-config-test-kserve-d5fb8b768-9kwjd"
Jun 15 07:19:14.037099 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:19:14.037055    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ca29a175-e50d-4168-8402-bbac25a5ea11-dshm\") pod \"ca29a175-e50d-4168-8402-bbac25a5ea11\" (UID: \"ca29a175-e50d-4168-8402-bbac25a5ea11\") "
Jun 15 07:19:14.037289 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:19:14.037163    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6pc9r\" (UniqueName: \"kubernetes.io/projected/ca29a175-e50d-4168-8402-bbac25a5ea11-kube-api-access-6pc9r\") pod \"ca29a175-e50d-4168-8402-bbac25a5ea11\" (UID: \"ca29a175-e50d-4168-8402-bbac25a5ea11\") "
Jun 15 07:19:14.037289 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:19:14.037195    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ca29a175-e50d-4168-8402-bbac25a5ea11-home\") pod \"ca29a175-e50d-4168-8402-bbac25a5ea11\" (UID: \"ca29a175-e50d-4168-8402-bbac25a5ea11\") "
Jun 15 07:19:14.037289 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:19:14.037247    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ca29a175-e50d-4168-8402-bbac25a5ea11-tmp-dir\") pod \"ca29a175-e50d-4168-8402-bbac25a5ea11\" (UID: \"ca29a175-e50d-4168-8402-bbac25a5ea11\") "
Jun 15 07:19:14.037471 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:19:14.037294    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ca29a175-e50d-4168-8402-bbac25a5ea11-tls-certs\") pod \"ca29a175-e50d-4168-8402-bbac25a5ea11\" (UID: \"ca29a175-e50d-4168-8402-bbac25a5ea11\") "
Jun 15 07:19:14.037471 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:19:14.037323    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ca29a175-e50d-4168-8402-bbac25a5ea11-model-cache\") pod \"ca29a175-e50d-4168-8402-bbac25a5ea11\" (UID: \"ca29a175-e50d-4168-8402-bbac25a5ea11\") "
Jun 15 07:19:14.037581 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:19:14.037531    2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ca29a175-e50d-4168-8402-bbac25a5ea11-home" (OuterVolumeSpecName: "home") pod "ca29a175-e50d-4168-8402-bbac25a5ea11" (UID: "ca29a175-e50d-4168-8402-bbac25a5ea11"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jun 15 07:19:14.037581 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:19:14.037544    2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ca29a175-e50d-4168-8402-bbac25a5ea11-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "ca29a175-e50d-4168-8402-bbac25a5ea11" (UID: "ca29a175-e50d-4168-8402-bbac25a5ea11"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jun 15 07:19:14.037670 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:19:14.037660    2566 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ca29a175-e50d-4168-8402-bbac25a5ea11-home\") on node \"ip-10-0-128-243.ec2.internal\" DevicePath \"\""
Jun 15 07:19:14.037722 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:19:14.037705    2566 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ca29a175-e50d-4168-8402-bbac25a5ea11-tmp-dir\") on node \"ip-10-0-128-243.ec2.internal\" DevicePath \"\""
Jun 15 07:19:14.037770 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:19:14.037744    2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ca29a175-e50d-4168-8402-bbac25a5ea11-model-cache" (OuterVolumeSpecName: "model-cache") pod "ca29a175-e50d-4168-8402-bbac25a5ea11" (UID: "ca29a175-e50d-4168-8402-bbac25a5ea11"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jun 15 07:19:14.039497 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:19:14.039464    2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ca29a175-e50d-4168-8402-bbac25a5ea11-dshm" (OuterVolumeSpecName: "dshm") pod "ca29a175-e50d-4168-8402-bbac25a5ea11" (UID: "ca29a175-e50d-4168-8402-bbac25a5ea11"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jun 15 07:19:14.039497 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:19:14.039475    2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ca29a175-e50d-4168-8402-bbac25a5ea11-kube-api-access-6pc9r" (OuterVolumeSpecName: "kube-api-access-6pc9r") pod "ca29a175-e50d-4168-8402-bbac25a5ea11" (UID: "ca29a175-e50d-4168-8402-bbac25a5ea11"). InnerVolumeSpecName "kube-api-access-6pc9r". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jun 15 07:19:14.039639 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:19:14.039536    2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ca29a175-e50d-4168-8402-bbac25a5ea11-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "ca29a175-e50d-4168-8402-bbac25a5ea11" (UID: "ca29a175-e50d-4168-8402-bbac25a5ea11"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jun 15 07:19:14.139230 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:19:14.139195    2566 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ca29a175-e50d-4168-8402-bbac25a5ea11-dshm\") on node \"ip-10-0-128-243.ec2.internal\" DevicePath \"\""
Jun 15 07:19:14.139230 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:19:14.139228    2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6pc9r\" (UniqueName: \"kubernetes.io/projected/ca29a175-e50d-4168-8402-bbac25a5ea11-kube-api-access-6pc9r\") on node \"ip-10-0-128-243.ec2.internal\" DevicePath \"\""
Jun 15 07:19:14.139434 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:19:14.139239    2566 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ca29a175-e50d-4168-8402-bbac25a5ea11-tls-certs\") on node \"ip-10-0-128-243.ec2.internal\" DevicePath \"\""
Jun 15 07:19:14.139434 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:19:14.139249    2566 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ca29a175-e50d-4168-8402-bbac25a5ea11-model-cache\") on node \"ip-10-0-128-243.ec2.internal\" DevicePath \"\""
Jun 15 07:19:14.794511 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:19:14.794477    2566 generic.go:356] "Generic (PLEG): container finished" podID="ca29a175-e50d-4168-8402-bbac25a5ea11" containerID="764ab552d0157da1472f74fe86307f1fc0940d2892b662c8860acf79fa264d9c" exitCode=0
Jun 15 07:19:14.794511 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:19:14.794516    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/scheduler-inline-config-test-kserve-d5fb8b768-9kwjd" event={"ID":"ca29a175-e50d-4168-8402-bbac25a5ea11","Type":"ContainerDied","Data":"764ab552d0157da1472f74fe86307f1fc0940d2892b662c8860acf79fa264d9c"}
Jun 15 07:19:14.795071 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:19:14.794528    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/scheduler-inline-config-test-kserve-d5fb8b768-9kwjd"
Jun 15 07:19:14.795071 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:19:14.794556    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/scheduler-inline-config-test-kserve-d5fb8b768-9kwjd" event={"ID":"ca29a175-e50d-4168-8402-bbac25a5ea11","Type":"ContainerDied","Data":"44180aae7b49cad73b8a7d487e49fce162f8ed9f92cf5483420839247f5518c3"}
Jun 15 07:19:14.795071 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:19:14.794578    2566 scope.go:117] "RemoveContainer" containerID="764ab552d0157da1472f74fe86307f1fc0940d2892b662c8860acf79fa264d9c"
Jun 15 07:19:14.807038 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:19:14.807006    2566 scope.go:117] "RemoveContainer" containerID="764ab552d0157da1472f74fe86307f1fc0940d2892b662c8860acf79fa264d9c"
Jun 15 07:19:14.807505 ip-10-0-128-243 kubenswrapper[2566]: E0615 07:19:14.807483    2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"764ab552d0157da1472f74fe86307f1fc0940d2892b662c8860acf79fa264d9c\": container with ID starting with 764ab552d0157da1472f74fe86307f1fc0940d2892b662c8860acf79fa264d9c not found: ID does not exist" containerID="764ab552d0157da1472f74fe86307f1fc0940d2892b662c8860acf79fa264d9c"
Jun 15 07:19:14.807598 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:19:14.807511    2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"764ab552d0157da1472f74fe86307f1fc0940d2892b662c8860acf79fa264d9c"} err="failed to get container status \"764ab552d0157da1472f74fe86307f1fc0940d2892b662c8860acf79fa264d9c\": rpc error: code = NotFound desc = could not find container \"764ab552d0157da1472f74fe86307f1fc0940d2892b662c8860acf79fa264d9c\": container with ID starting with 764ab552d0157da1472f74fe86307f1fc0940d2892b662c8860acf79fa264d9c not found: ID does not exist"
Jun 15 07:19:14.818901 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:19:14.818876    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/scheduler-inline-config-test-kserve-d5fb8b768-9kwjd"]
Jun 15 07:19:14.822740 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:19:14.822718    2566 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/scheduler-inline-config-test-kserve-d5fb8b768-9kwjd"]
Jun 15 07:19:15.443378 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:19:15.443347    2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ca29a175-e50d-4168-8402-bbac25a5ea11" path="/var/lib/kubelet/pods/ca29a175-e50d-4168-8402-bbac25a5ea11/volumes"
Jun 15 07:19:16.484260 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:19:16.484155    2566 prober.go:120] "Probe failed" probeType="Startup" pod="kserve-ci-e2e-test/stop-feature-test-kserve-7c64ccc5f7-hmdd6" podUID="880c6e0f-dbd8-40f8-a728-875527ab43db" containerName="main" probeResult="failure" output="Get \"https://10.132.0.50:8000/health\": dial tcp 10.132.0.50:8000: connect: connection refused"
Jun 15 07:19:26.485116 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:19:26.485057    2566 prober.go:120] "Probe failed" probeType="Startup" pod="kserve-ci-e2e-test/stop-feature-test-kserve-7c64ccc5f7-hmdd6" podUID="880c6e0f-dbd8-40f8-a728-875527ab43db" containerName="main" probeResult="failure" output="Get \"https://10.132.0.50:8000/health\": dial tcp 10.132.0.50:8000: connect: connection refused"
Jun 15 07:19:36.494979 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:19:36.494948    2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kserve-ci-e2e-test/stop-feature-test-kserve-7c64ccc5f7-hmdd6"
Jun 15 07:19:36.502905 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:19:36.502882    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/stop-feature-test-kserve-7c64ccc5f7-hmdd6"
Jun 15 07:19:38.645679 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:19:38.645641    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/llmisvc-model-qwen2-5-0-5b-rout-4c1ba212-kserve-7c94bd674-cpqpr"]
Jun 15 07:19:38.646045 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:19:38.645996    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ca29a175-e50d-4168-8402-bbac25a5ea11" containerName="main"
Jun 15 07:19:38.646045 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:19:38.646009    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="ca29a175-e50d-4168-8402-bbac25a5ea11" containerName="main"
Jun 15 07:19:38.646155 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:19:38.646108    2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="ca29a175-e50d-4168-8402-bbac25a5ea11" containerName="main"
Jun 15 07:19:38.650433 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:19:38.650412    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/llmisvc-model-qwen2-5-0-5b-rout-4c1ba212-kserve-7c94bd674-cpqpr"
Jun 15 07:19:38.652760 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:19:38.652736    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"llmisv431d7e30f13554296364403a5b6365f5-kserve-self-signed-certs\""
Jun 15 07:19:38.660510 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:19:38.660482    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/llmisvc-model-qwen2-5-0-5b-rout-4c1ba212-kserve-7c94bd674-cpqpr"]
Jun 15 07:19:38.759564 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:19:38.759529    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l4xz9\" (UniqueName: \"kubernetes.io/projected/b705c2db-7ec1-4059-b4e5-1af80dc11a77-kube-api-access-l4xz9\") pod \"llmisvc-model-qwen2-5-0-5b-rout-4c1ba212-kserve-7c94bd674-cpqpr\" (UID: \"b705c2db-7ec1-4059-b4e5-1af80dc11a77\") " pod="kserve-ci-e2e-test/llmisvc-model-qwen2-5-0-5b-rout-4c1ba212-kserve-7c94bd674-cpqpr"
Jun 15 07:19:38.759564 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:19:38.759578    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b705c2db-7ec1-4059-b4e5-1af80dc11a77-home\") pod \"llmisvc-model-qwen2-5-0-5b-rout-4c1ba212-kserve-7c94bd674-cpqpr\" (UID: \"b705c2db-7ec1-4059-b4e5-1af80dc11a77\") " pod="kserve-ci-e2e-test/llmisvc-model-qwen2-5-0-5b-rout-4c1ba212-kserve-7c94bd674-cpqpr"
Jun 15 07:19:38.759832 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:19:38.759600    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b705c2db-7ec1-4059-b4e5-1af80dc11a77-dshm\") pod \"llmisvc-model-qwen2-5-0-5b-rout-4c1ba212-kserve-7c94bd674-cpqpr\" (UID: \"b705c2db-7ec1-4059-b4e5-1af80dc11a77\") " pod="kserve-ci-e2e-test/llmisvc-model-qwen2-5-0-5b-rout-4c1ba212-kserve-7c94bd674-cpqpr"
Jun 15 07:19:38.759832 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:19:38.759661    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b705c2db-7ec1-4059-b4e5-1af80dc11a77-tmp-dir\") pod \"llmisvc-model-qwen2-5-0-5b-rout-4c1ba212-kserve-7c94bd674-cpqpr\" (UID: \"b705c2db-7ec1-4059-b4e5-1af80dc11a77\") " pod="kserve-ci-e2e-test/llmisvc-model-qwen2-5-0-5b-rout-4c1ba212-kserve-7c94bd674-cpqpr"
Jun 15 07:19:38.759832 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:19:38.759733    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b705c2db-7ec1-4059-b4e5-1af80dc11a77-model-cache\") pod \"llmisvc-model-qwen2-5-0-5b-rout-4c1ba212-kserve-7c94bd674-cpqpr\" (UID: \"b705c2db-7ec1-4059-b4e5-1af80dc11a77\") " pod="kserve-ci-e2e-test/llmisvc-model-qwen2-5-0-5b-rout-4c1ba212-kserve-7c94bd674-cpqpr"
Jun 15 07:19:38.759832 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:19:38.759800    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b705c2db-7ec1-4059-b4e5-1af80dc11a77-tls-certs\") pod \"llmisvc-model-qwen2-5-0-5b-rout-4c1ba212-kserve-7c94bd674-cpqpr\" (UID: \"b705c2db-7ec1-4059-b4e5-1af80dc11a77\") " pod="kserve-ci-e2e-test/llmisvc-model-qwen2-5-0-5b-rout-4c1ba212-kserve-7c94bd674-cpqpr"
Jun 15 07:19:38.860625 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:19:38.860579    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b705c2db-7ec1-4059-b4e5-1af80dc11a77-model-cache\") pod \"llmisvc-model-qwen2-5-0-5b-rout-4c1ba212-kserve-7c94bd674-cpqpr\" (UID: \"b705c2db-7ec1-4059-b4e5-1af80dc11a77\") " pod="kserve-ci-e2e-test/llmisvc-model-qwen2-5-0-5b-rout-4c1ba212-kserve-7c94bd674-cpqpr"
Jun 15 07:19:38.860625 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:19:38.860625    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b705c2db-7ec1-4059-b4e5-1af80dc11a77-tls-certs\") pod \"llmisvc-model-qwen2-5-0-5b-rout-4c1ba212-kserve-7c94bd674-cpqpr\" (UID: \"b705c2db-7ec1-4059-b4e5-1af80dc11a77\") " pod="kserve-ci-e2e-test/llmisvc-model-qwen2-5-0-5b-rout-4c1ba212-kserve-7c94bd674-cpqpr"
Jun 15 07:19:38.860885 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:19:38.860665    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l4xz9\" (UniqueName: \"kubernetes.io/projected/b705c2db-7ec1-4059-b4e5-1af80dc11a77-kube-api-access-l4xz9\") pod \"llmisvc-model-qwen2-5-0-5b-rout-4c1ba212-kserve-7c94bd674-cpqpr\" (UID: \"b705c2db-7ec1-4059-b4e5-1af80dc11a77\") " pod="kserve-ci-e2e-test/llmisvc-model-qwen2-5-0-5b-rout-4c1ba212-kserve-7c94bd674-cpqpr"
Jun 15 07:19:38.860885 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:19:38.860707    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b705c2db-7ec1-4059-b4e5-1af80dc11a77-home\") pod \"llmisvc-model-qwen2-5-0-5b-rout-4c1ba212-kserve-7c94bd674-cpqpr\" (UID: \"b705c2db-7ec1-4059-b4e5-1af80dc11a77\") " pod="kserve-ci-e2e-test/llmisvc-model-qwen2-5-0-5b-rout-4c1ba212-kserve-7c94bd674-cpqpr"
Jun 15 07:19:38.860885 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:19:38.860731    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b705c2db-7ec1-4059-b4e5-1af80dc11a77-dshm\") pod \"llmisvc-model-qwen2-5-0-5b-rout-4c1ba212-kserve-7c94bd674-cpqpr\" (UID: \"b705c2db-7ec1-4059-b4e5-1af80dc11a77\") " pod="kserve-ci-e2e-test/llmisvc-model-qwen2-5-0-5b-rout-4c1ba212-kserve-7c94bd674-cpqpr"
Jun 15 07:19:38.860885 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:19:38.860759    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b705c2db-7ec1-4059-b4e5-1af80dc11a77-tmp-dir\") pod \"llmisvc-model-qwen2-5-0-5b-rout-4c1ba212-kserve-7c94bd674-cpqpr\" (UID: \"b705c2db-7ec1-4059-b4e5-1af80dc11a77\") " pod="kserve-ci-e2e-test/llmisvc-model-qwen2-5-0-5b-rout-4c1ba212-kserve-7c94bd674-cpqpr"
Jun 15 07:19:38.861141 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:19:38.861048    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b705c2db-7ec1-4059-b4e5-1af80dc11a77-model-cache\") pod \"llmisvc-model-qwen2-5-0-5b-rout-4c1ba212-kserve-7c94bd674-cpqpr\" (UID: \"b705c2db-7ec1-4059-b4e5-1af80dc11a77\") " pod="kserve-ci-e2e-test/llmisvc-model-qwen2-5-0-5b-rout-4c1ba212-kserve-7c94bd674-cpqpr"
Jun 15 07:19:38.861141 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:19:38.861118    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b705c2db-7ec1-4059-b4e5-1af80dc11a77-home\") pod \"llmisvc-model-qwen2-5-0-5b-rout-4c1ba212-kserve-7c94bd674-cpqpr\" (UID: \"b705c2db-7ec1-4059-b4e5-1af80dc11a77\") " pod="kserve-ci-e2e-test/llmisvc-model-qwen2-5-0-5b-rout-4c1ba212-kserve-7c94bd674-cpqpr"
Jun 15 07:19:38.861303 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:19:38.861284    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b705c2db-7ec1-4059-b4e5-1af80dc11a77-tmp-dir\") pod \"llmisvc-model-qwen2-5-0-5b-rout-4c1ba212-kserve-7c94bd674-cpqpr\" (UID: \"b705c2db-7ec1-4059-b4e5-1af80dc11a77\") " pod="kserve-ci-e2e-test/llmisvc-model-qwen2-5-0-5b-rout-4c1ba212-kserve-7c94bd674-cpqpr"
Jun 15 07:19:38.863444 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:19:38.863418    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b705c2db-7ec1-4059-b4e5-1af80dc11a77-dshm\") pod \"llmisvc-model-qwen2-5-0-5b-rout-4c1ba212-kserve-7c94bd674-cpqpr\" (UID: \"b705c2db-7ec1-4059-b4e5-1af80dc11a77\") " pod="kserve-ci-e2e-test/llmisvc-model-qwen2-5-0-5b-rout-4c1ba212-kserve-7c94bd674-cpqpr"
Jun 15 07:19:38.863563 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:19:38.863537    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b705c2db-7ec1-4059-b4e5-1af80dc11a77-tls-certs\") pod \"llmisvc-model-qwen2-5-0-5b-rout-4c1ba212-kserve-7c94bd674-cpqpr\" (UID: \"b705c2db-7ec1-4059-b4e5-1af80dc11a77\") " pod="kserve-ci-e2e-test/llmisvc-model-qwen2-5-0-5b-rout-4c1ba212-kserve-7c94bd674-cpqpr"
Jun 15 07:19:38.870613 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:19:38.870587    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-l4xz9\" (UniqueName: \"kubernetes.io/projected/b705c2db-7ec1-4059-b4e5-1af80dc11a77-kube-api-access-l4xz9\") pod \"llmisvc-model-qwen2-5-0-5b-rout-4c1ba212-kserve-7c94bd674-cpqpr\" (UID: \"b705c2db-7ec1-4059-b4e5-1af80dc11a77\") " pod="kserve-ci-e2e-test/llmisvc-model-qwen2-5-0-5b-rout-4c1ba212-kserve-7c94bd674-cpqpr"
Jun 15 07:19:38.961908 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:19:38.961809    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/llmisvc-model-qwen2-5-0-5b-rout-4c1ba212-kserve-7c94bd674-cpqpr"
Jun 15 07:19:39.107184 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:19:39.107157    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/llmisvc-model-qwen2-5-0-5b-rout-4c1ba212-kserve-7c94bd674-cpqpr"]
Jun 15 07:19:39.109933 ip-10-0-128-243 kubenswrapper[2566]: W0615 07:19:39.109901    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb705c2db_7ec1_4059_b4e5_1af80dc11a77.slice/crio-5c03ca46edb9ae334619e9c0fcbbfc794b848888a392d9c4c909d0213f423742 WatchSource:0}: Error finding container 5c03ca46edb9ae334619e9c0fcbbfc794b848888a392d9c4c909d0213f423742: Status 404 returned error can't find the container with id 5c03ca46edb9ae334619e9c0fcbbfc794b848888a392d9c4c909d0213f423742
Jun 15 07:19:39.937556 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:19:39.937520    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/llmisvc-model-qwen2-5-0-5b-rout-4c1ba212-kserve-7c94bd674-cpqpr" event={"ID":"b705c2db-7ec1-4059-b4e5-1af80dc11a77","Type":"ContainerStarted","Data":"2b0e99392313fb6b74abb5ffe5aed49e1f31b52f636cacf3778b561122ad5e0b"}
Jun 15 07:19:39.938017 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:19:39.937571    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/llmisvc-model-qwen2-5-0-5b-rout-4c1ba212-kserve-7c94bd674-cpqpr" event={"ID":"b705c2db-7ec1-4059-b4e5-1af80dc11a77","Type":"ContainerStarted","Data":"5c03ca46edb9ae334619e9c0fcbbfc794b848888a392d9c4c909d0213f423742"}
Jun 15 07:19:39.965369 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:19:39.965314    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/llmisvc-model-qwen2-5-0-5b-rout-4c1ba212-kserve-7c94bd674-cpqpr" podStartSLOduration=1.965297039 podStartE2EDuration="1.965297039s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-15 07:19:38 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 07:19:39.964311514 +0000 UTC m=+5462.924068804" watchObservedRunningTime="2026-06-15 07:19:39.965297039 +0000 UTC m=+5462.925054284"
Jun 15 07:19:48.962784 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:19:48.962747    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/llmisvc-model-qwen2-5-0-5b-rout-4c1ba212-kserve-7c94bd674-cpqpr"
Jun 15 07:19:48.963279 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:19:48.962818    2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kserve-ci-e2e-test/llmisvc-model-qwen2-5-0-5b-rout-4c1ba212-kserve-7c94bd674-cpqpr"
Jun 15 07:19:48.975625 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:19:48.975601    2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kserve-ci-e2e-test/llmisvc-model-qwen2-5-0-5b-rout-4c1ba212-kserve-7c94bd674-cpqpr"
Jun 15 07:19:49.000318 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:19:49.000289    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/llmisvc-model-qwen2-5-0-5b-rout-4c1ba212-kserve-7c94bd674-cpqpr"
Jun 15 07:19:59.422994 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:19:59.422897    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/stop-feature-test-kserve-7c64ccc5f7-hmdd6"]
Jun 15 07:20:14.447522 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:20:14.447459    2566 kuberuntime_container.go:872] "Killing container with a grace period" pod="kserve-ci-e2e-test/stop-feature-test-kserve-7c64ccc5f7-hmdd6" podUID="880c6e0f-dbd8-40f8-a728-875527ab43db" containerName="main" containerID="cri-o://3bb61f6879541a116fc5781887debd35a6738dcccc97354115354340f3991c59" gracePeriod=45
Jun 15 07:20:15.129262 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:20:15.129232    2566 generic.go:356] "Generic (PLEG): container finished" podID="880c6e0f-dbd8-40f8-a728-875527ab43db" containerID="3bb61f6879541a116fc5781887debd35a6738dcccc97354115354340f3991c59" exitCode=0
Jun 15 07:20:15.129432 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:20:15.129306    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/stop-feature-test-kserve-7c64ccc5f7-hmdd6" event={"ID":"880c6e0f-dbd8-40f8-a728-875527ab43db","Type":"ContainerDied","Data":"3bb61f6879541a116fc5781887debd35a6738dcccc97354115354340f3991c59"}
Jun 15 07:20:15.199098 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:20:15.199051    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/stop-feature-test-kserve-7c64ccc5f7-hmdd6"
Jun 15 07:20:15.297828 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:20:15.297796    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/880c6e0f-dbd8-40f8-a728-875527ab43db-dshm\") pod \"880c6e0f-dbd8-40f8-a728-875527ab43db\" (UID: \"880c6e0f-dbd8-40f8-a728-875527ab43db\") "
Jun 15 07:20:15.297828 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:20:15.297831    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tt97g\" (UniqueName: \"kubernetes.io/projected/880c6e0f-dbd8-40f8-a728-875527ab43db-kube-api-access-tt97g\") pod \"880c6e0f-dbd8-40f8-a728-875527ab43db\" (UID: \"880c6e0f-dbd8-40f8-a728-875527ab43db\") "
Jun 15 07:20:15.298029 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:20:15.297861    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/880c6e0f-dbd8-40f8-a728-875527ab43db-tmp-dir\") pod \"880c6e0f-dbd8-40f8-a728-875527ab43db\" (UID: \"880c6e0f-dbd8-40f8-a728-875527ab43db\") "
Jun 15 07:20:15.298029 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:20:15.297942    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/880c6e0f-dbd8-40f8-a728-875527ab43db-tls-certs\") pod \"880c6e0f-dbd8-40f8-a728-875527ab43db\" (UID: \"880c6e0f-dbd8-40f8-a728-875527ab43db\") "
Jun 15 07:20:15.298029 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:20:15.297996    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/880c6e0f-dbd8-40f8-a728-875527ab43db-kserve-provision-location\") pod \"880c6e0f-dbd8-40f8-a728-875527ab43db\" (UID: \"880c6e0f-dbd8-40f8-a728-875527ab43db\") "
Jun 15 07:20:15.298029 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:20:15.298020    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/880c6e0f-dbd8-40f8-a728-875527ab43db-home\") pod \"880c6e0f-dbd8-40f8-a728-875527ab43db\" (UID: \"880c6e0f-dbd8-40f8-a728-875527ab43db\") "
Jun 15 07:20:15.298261 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:20:15.298050    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/880c6e0f-dbd8-40f8-a728-875527ab43db-model-cache\") pod \"880c6e0f-dbd8-40f8-a728-875527ab43db\" (UID: \"880c6e0f-dbd8-40f8-a728-875527ab43db\") "
Jun 15 07:20:15.298549 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:20:15.298514    2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/880c6e0f-dbd8-40f8-a728-875527ab43db-model-cache" (OuterVolumeSpecName: "model-cache") pod "880c6e0f-dbd8-40f8-a728-875527ab43db" (UID: "880c6e0f-dbd8-40f8-a728-875527ab43db"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jun 15 07:20:15.298760 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:20:15.298732    2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/880c6e0f-dbd8-40f8-a728-875527ab43db-home" (OuterVolumeSpecName: "home") pod "880c6e0f-dbd8-40f8-a728-875527ab43db" (UID: "880c6e0f-dbd8-40f8-a728-875527ab43db"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jun 15 07:20:15.300251 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:20:15.300228    2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/880c6e0f-dbd8-40f8-a728-875527ab43db-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "880c6e0f-dbd8-40f8-a728-875527ab43db" (UID: "880c6e0f-dbd8-40f8-a728-875527ab43db"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jun 15 07:20:15.300663 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:20:15.300642    2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/880c6e0f-dbd8-40f8-a728-875527ab43db-dshm" (OuterVolumeSpecName: "dshm") pod "880c6e0f-dbd8-40f8-a728-875527ab43db" (UID: "880c6e0f-dbd8-40f8-a728-875527ab43db"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jun 15 07:20:15.300738 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:20:15.300656    2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/880c6e0f-dbd8-40f8-a728-875527ab43db-kube-api-access-tt97g" (OuterVolumeSpecName: "kube-api-access-tt97g") pod "880c6e0f-dbd8-40f8-a728-875527ab43db" (UID: "880c6e0f-dbd8-40f8-a728-875527ab43db"). InnerVolumeSpecName "kube-api-access-tt97g". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jun 15 07:20:15.316116 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:20:15.316065    2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/880c6e0f-dbd8-40f8-a728-875527ab43db-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "880c6e0f-dbd8-40f8-a728-875527ab43db" (UID: "880c6e0f-dbd8-40f8-a728-875527ab43db"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jun 15 07:20:15.360271 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:20:15.360234    2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/880c6e0f-dbd8-40f8-a728-875527ab43db-kserve-provision-location" (OuterVolumeSpecName: "kserve-provision-location") pod "880c6e0f-dbd8-40f8-a728-875527ab43db" (UID: "880c6e0f-dbd8-40f8-a728-875527ab43db"). InnerVolumeSpecName "kserve-provision-location". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jun 15 07:20:15.399556 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:20:15.399520    2566 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/880c6e0f-dbd8-40f8-a728-875527ab43db-dshm\") on node \"ip-10-0-128-243.ec2.internal\" DevicePath \"\""
Jun 15 07:20:15.399556 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:20:15.399550    2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tt97g\" (UniqueName: \"kubernetes.io/projected/880c6e0f-dbd8-40f8-a728-875527ab43db-kube-api-access-tt97g\") on node \"ip-10-0-128-243.ec2.internal\" DevicePath \"\""
Jun 15 07:20:15.399556 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:20:15.399561    2566 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/880c6e0f-dbd8-40f8-a728-875527ab43db-tmp-dir\") on node \"ip-10-0-128-243.ec2.internal\" DevicePath \"\""
Jun 15 07:20:15.399792 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:20:15.399570    2566 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/880c6e0f-dbd8-40f8-a728-875527ab43db-tls-certs\") on node \"ip-10-0-128-243.ec2.internal\" DevicePath \"\""
Jun 15 07:20:15.399792 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:20:15.399579    2566 reconciler_common.go:299] "Volume detached for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/880c6e0f-dbd8-40f8-a728-875527ab43db-kserve-provision-location\") on node \"ip-10-0-128-243.ec2.internal\" DevicePath \"\""
Jun 15 07:20:15.399792 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:20:15.399589    2566 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/880c6e0f-dbd8-40f8-a728-875527ab43db-home\") on node \"ip-10-0-128-243.ec2.internal\" DevicePath \"\""
Jun 15 07:20:15.399792 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:20:15.399598    2566 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/880c6e0f-dbd8-40f8-a728-875527ab43db-model-cache\") on node \"ip-10-0-128-243.ec2.internal\" DevicePath \"\""
Jun 15 07:20:16.136545 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:20:16.136518    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/stop-feature-test-kserve-7c64ccc5f7-hmdd6"
Jun 15 07:20:16.136545 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:20:16.136538    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/stop-feature-test-kserve-7c64ccc5f7-hmdd6" event={"ID":"880c6e0f-dbd8-40f8-a728-875527ab43db","Type":"ContainerDied","Data":"78a49cc9f79f42b71857f4e4e6d382c1a359577a57e1fa62810f80c71c7b1899"}
Jun 15 07:20:16.137020 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:20:16.136611    2566 scope.go:117] "RemoveContainer" containerID="3bb61f6879541a116fc5781887debd35a6738dcccc97354115354340f3991c59"
Jun 15 07:20:16.148435 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:20:16.148412    2566 scope.go:117] "RemoveContainer" containerID="a9e1d7d30abc7c1092a9bc4a702a9b191fc7e797bc315984f3e21644e7c44082"
Jun 15 07:20:16.165137 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:20:16.161742    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/stop-feature-test-kserve-7c64ccc5f7-hmdd6"]
Jun 15 07:20:16.168720 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:20:16.168695    2566 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/stop-feature-test-kserve-7c64ccc5f7-hmdd6"]
Jun 15 07:20:17.441697 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:20:17.441662    2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="880c6e0f-dbd8-40f8-a728-875527ab43db" path="/var/lib/kubelet/pods/880c6e0f-dbd8-40f8-a728-875527ab43db/volumes"
Jun 15 07:20:18.059992 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:20:18.059957    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/stop-feature-test-kserve-7c64ccc5f7-jgr84"]
Jun 15 07:20:18.060326 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:20:18.060309    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="880c6e0f-dbd8-40f8-a728-875527ab43db" containerName="storage-initializer"
Jun 15 07:20:18.060326 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:20:18.060325    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="880c6e0f-dbd8-40f8-a728-875527ab43db" containerName="storage-initializer"
Jun 15 07:20:18.060496 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:20:18.060345    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="880c6e0f-dbd8-40f8-a728-875527ab43db" containerName="main"
Jun 15 07:20:18.060496 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:20:18.060351    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="880c6e0f-dbd8-40f8-a728-875527ab43db" containerName="main"
Jun 15 07:20:18.060496 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:20:18.060430    2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="880c6e0f-dbd8-40f8-a728-875527ab43db" containerName="main"
Jun 15 07:20:18.065328 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:20:18.065310    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/stop-feature-test-kserve-7c64ccc5f7-jgr84"
Jun 15 07:20:18.067806 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:20:18.067782    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"seaweedfs-s3-creds\""
Jun 15 07:20:18.067949 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:20:18.067932    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"stop-feature-test-kserve-self-signed-certs\""
Jun 15 07:20:18.076221 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:20:18.076200    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/stop-feature-test-kserve-7c64ccc5f7-jgr84"]
Jun 15 07:20:18.123498 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:20:18.123467    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/bea31c00-51b2-4b68-a8bc-ce92bfd48224-model-cache\") pod \"stop-feature-test-kserve-7c64ccc5f7-jgr84\" (UID: \"bea31c00-51b2-4b68-a8bc-ce92bfd48224\") " pod="kserve-ci-e2e-test/stop-feature-test-kserve-7c64ccc5f7-jgr84"
Jun 15 07:20:18.123498 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:20:18.123505    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/bea31c00-51b2-4b68-a8bc-ce92bfd48224-kserve-provision-location\") pod \"stop-feature-test-kserve-7c64ccc5f7-jgr84\" (UID: \"bea31c00-51b2-4b68-a8bc-ce92bfd48224\") " pod="kserve-ci-e2e-test/stop-feature-test-kserve-7c64ccc5f7-jgr84"
Jun 15 07:20:18.123758 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:20:18.123534    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bea31c00-51b2-4b68-a8bc-ce92bfd48224-tls-certs\") pod \"stop-feature-test-kserve-7c64ccc5f7-jgr84\" (UID: \"bea31c00-51b2-4b68-a8bc-ce92bfd48224\") " pod="kserve-ci-e2e-test/stop-feature-test-kserve-7c64ccc5f7-jgr84"
Jun 15 07:20:18.123758 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:20:18.123639    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/bea31c00-51b2-4b68-a8bc-ce92bfd48224-home\") pod \"stop-feature-test-kserve-7c64ccc5f7-jgr84\" (UID: \"bea31c00-51b2-4b68-a8bc-ce92bfd48224\") " pod="kserve-ci-e2e-test/stop-feature-test-kserve-7c64ccc5f7-jgr84"
Jun 15 07:20:18.123758 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:20:18.123670    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bea31c00-51b2-4b68-a8bc-ce92bfd48224-tmp-dir\") pod \"stop-feature-test-kserve-7c64ccc5f7-jgr84\" (UID: \"bea31c00-51b2-4b68-a8bc-ce92bfd48224\") " pod="kserve-ci-e2e-test/stop-feature-test-kserve-7c64ccc5f7-jgr84"
Jun 15 07:20:18.123866 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:20:18.123782    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/bea31c00-51b2-4b68-a8bc-ce92bfd48224-dshm\") pod \"stop-feature-test-kserve-7c64ccc5f7-jgr84\" (UID: \"bea31c00-51b2-4b68-a8bc-ce92bfd48224\") " pod="kserve-ci-e2e-test/stop-feature-test-kserve-7c64ccc5f7-jgr84"
Jun 15 07:20:18.123866 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:20:18.123818    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pcfsh\" (UniqueName: \"kubernetes.io/projected/bea31c00-51b2-4b68-a8bc-ce92bfd48224-kube-api-access-pcfsh\") pod \"stop-feature-test-kserve-7c64ccc5f7-jgr84\" (UID: \"bea31c00-51b2-4b68-a8bc-ce92bfd48224\") " pod="kserve-ci-e2e-test/stop-feature-test-kserve-7c64ccc5f7-jgr84"
Jun 15 07:20:18.224468 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:20:18.224435    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bea31c00-51b2-4b68-a8bc-ce92bfd48224-tls-certs\") pod \"stop-feature-test-kserve-7c64ccc5f7-jgr84\" (UID: \"bea31c00-51b2-4b68-a8bc-ce92bfd48224\") " pod="kserve-ci-e2e-test/stop-feature-test-kserve-7c64ccc5f7-jgr84"
Jun 15 07:20:18.224656 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:20:18.224482    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/bea31c00-51b2-4b68-a8bc-ce92bfd48224-home\") pod \"stop-feature-test-kserve-7c64ccc5f7-jgr84\" (UID: \"bea31c00-51b2-4b68-a8bc-ce92bfd48224\") " pod="kserve-ci-e2e-test/stop-feature-test-kserve-7c64ccc5f7-jgr84"
Jun 15 07:20:18.224656 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:20:18.224510    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bea31c00-51b2-4b68-a8bc-ce92bfd48224-tmp-dir\") pod \"stop-feature-test-kserve-7c64ccc5f7-jgr84\" (UID: \"bea31c00-51b2-4b68-a8bc-ce92bfd48224\") " pod="kserve-ci-e2e-test/stop-feature-test-kserve-7c64ccc5f7-jgr84"
Jun 15 07:20:18.224656 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:20:18.224559    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/bea31c00-51b2-4b68-a8bc-ce92bfd48224-dshm\") pod \"stop-feature-test-kserve-7c64ccc5f7-jgr84\" (UID: \"bea31c00-51b2-4b68-a8bc-ce92bfd48224\") " pod="kserve-ci-e2e-test/stop-feature-test-kserve-7c64ccc5f7-jgr84"
Jun 15 07:20:18.224656 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:20:18.224585    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pcfsh\" (UniqueName: \"kubernetes.io/projected/bea31c00-51b2-4b68-a8bc-ce92bfd48224-kube-api-access-pcfsh\") pod \"stop-feature-test-kserve-7c64ccc5f7-jgr84\" (UID: \"bea31c00-51b2-4b68-a8bc-ce92bfd48224\") " pod="kserve-ci-e2e-test/stop-feature-test-kserve-7c64ccc5f7-jgr84"
Jun 15 07:20:18.224656 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:20:18.224625    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/bea31c00-51b2-4b68-a8bc-ce92bfd48224-model-cache\") pod \"stop-feature-test-kserve-7c64ccc5f7-jgr84\" (UID: \"bea31c00-51b2-4b68-a8bc-ce92bfd48224\") " pod="kserve-ci-e2e-test/stop-feature-test-kserve-7c64ccc5f7-jgr84"
Jun 15 07:20:18.224656 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:20:18.224654    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/bea31c00-51b2-4b68-a8bc-ce92bfd48224-kserve-provision-location\") pod \"stop-feature-test-kserve-7c64ccc5f7-jgr84\" (UID: \"bea31c00-51b2-4b68-a8bc-ce92bfd48224\") " pod="kserve-ci-e2e-test/stop-feature-test-kserve-7c64ccc5f7-jgr84"
Jun 15 07:20:18.224954 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:20:18.224927    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/bea31c00-51b2-4b68-a8bc-ce92bfd48224-home\") pod \"stop-feature-test-kserve-7c64ccc5f7-jgr84\" (UID: \"bea31c00-51b2-4b68-a8bc-ce92bfd48224\") " pod="kserve-ci-e2e-test/stop-feature-test-kserve-7c64ccc5f7-jgr84"
Jun 15 07:20:18.225015 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:20:18.224964    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bea31c00-51b2-4b68-a8bc-ce92bfd48224-tmp-dir\") pod \"stop-feature-test-kserve-7c64ccc5f7-jgr84\" (UID: \"bea31c00-51b2-4b68-a8bc-ce92bfd48224\") " pod="kserve-ci-e2e-test/stop-feature-test-kserve-7c64ccc5f7-jgr84"
Jun 15 07:20:18.225057 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:20:18.225026    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/bea31c00-51b2-4b68-a8bc-ce92bfd48224-kserve-provision-location\") pod \"stop-feature-test-kserve-7c64ccc5f7-jgr84\" (UID: \"bea31c00-51b2-4b68-a8bc-ce92bfd48224\") " pod="kserve-ci-e2e-test/stop-feature-test-kserve-7c64ccc5f7-jgr84"
Jun 15 07:20:18.225155 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:20:18.225123    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/bea31c00-51b2-4b68-a8bc-ce92bfd48224-model-cache\") pod \"stop-feature-test-kserve-7c64ccc5f7-jgr84\" (UID: \"bea31c00-51b2-4b68-a8bc-ce92bfd48224\") " pod="kserve-ci-e2e-test/stop-feature-test-kserve-7c64ccc5f7-jgr84"
Jun 15 07:20:18.227049 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:20:18.227020    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/bea31c00-51b2-4b68-a8bc-ce92bfd48224-dshm\") pod \"stop-feature-test-kserve-7c64ccc5f7-jgr84\" (UID: \"bea31c00-51b2-4b68-a8bc-ce92bfd48224\") " pod="kserve-ci-e2e-test/stop-feature-test-kserve-7c64ccc5f7-jgr84"
Jun 15 07:20:18.227235 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:20:18.227221    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bea31c00-51b2-4b68-a8bc-ce92bfd48224-tls-certs\") pod \"stop-feature-test-kserve-7c64ccc5f7-jgr84\" (UID: \"bea31c00-51b2-4b68-a8bc-ce92bfd48224\") " pod="kserve-ci-e2e-test/stop-feature-test-kserve-7c64ccc5f7-jgr84"
Jun 15 07:20:18.233600 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:20:18.233572    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pcfsh\" (UniqueName: \"kubernetes.io/projected/bea31c00-51b2-4b68-a8bc-ce92bfd48224-kube-api-access-pcfsh\") pod \"stop-feature-test-kserve-7c64ccc5f7-jgr84\" (UID: \"bea31c00-51b2-4b68-a8bc-ce92bfd48224\") " pod="kserve-ci-e2e-test/stop-feature-test-kserve-7c64ccc5f7-jgr84"
Jun 15 07:20:18.376968 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:20:18.376875    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/stop-feature-test-kserve-7c64ccc5f7-jgr84"
Jun 15 07:20:18.520362 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:20:18.520331    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/stop-feature-test-kserve-7c64ccc5f7-jgr84"]
Jun 15 07:20:18.521160 ip-10-0-128-243 kubenswrapper[2566]: W0615 07:20:18.521135    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbea31c00_51b2_4b68_a8bc_ce92bfd48224.slice/crio-b42f22ec69931f1064a80db025abdbb5af52a60dc2fa7f518edb878ff72e7008 WatchSource:0}: Error finding container b42f22ec69931f1064a80db025abdbb5af52a60dc2fa7f518edb878ff72e7008: Status 404 returned error can't find the container with id b42f22ec69931f1064a80db025abdbb5af52a60dc2fa7f518edb878ff72e7008
Jun 15 07:20:19.155099 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:20:19.155060    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/stop-feature-test-kserve-7c64ccc5f7-jgr84" event={"ID":"bea31c00-51b2-4b68-a8bc-ce92bfd48224","Type":"ContainerStarted","Data":"c49f36c027b43f83766747e7290969c4a2ee00d8d1da4ebd6a8ae666352bddb0"}
Jun 15 07:20:19.155278 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:20:19.155130    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/stop-feature-test-kserve-7c64ccc5f7-jgr84" event={"ID":"bea31c00-51b2-4b68-a8bc-ce92bfd48224","Type":"ContainerStarted","Data":"b42f22ec69931f1064a80db025abdbb5af52a60dc2fa7f518edb878ff72e7008"}
Jun 15 07:20:50.774844 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:20:50.774811    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/llmisvc-model-qwen2-5-0-5b-rout-4c1ba212-kserve-7c94bd674-cpqpr"]
Jun 15 07:20:58.372326 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:20:58.372289    2566 generic.go:356] "Generic (PLEG): container finished" podID="bea31c00-51b2-4b68-a8bc-ce92bfd48224" containerID="c49f36c027b43f83766747e7290969c4a2ee00d8d1da4ebd6a8ae666352bddb0" exitCode=0
Jun 15 07:20:58.372713 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:20:58.372366    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/stop-feature-test-kserve-7c64ccc5f7-jgr84" event={"ID":"bea31c00-51b2-4b68-a8bc-ce92bfd48224","Type":"ContainerDied","Data":"c49f36c027b43f83766747e7290969c4a2ee00d8d1da4ebd6a8ae666352bddb0"}
Jun 15 07:20:59.379380 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:20:59.379345    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/stop-feature-test-kserve-7c64ccc5f7-jgr84" event={"ID":"bea31c00-51b2-4b68-a8bc-ce92bfd48224","Type":"ContainerStarted","Data":"aaf8509aa53e676a91063c68ac4dc98c41d04185f8d5e9caa60987dda8a3c3af"}
Jun 15 07:20:59.404873 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:20:59.404823    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/stop-feature-test-kserve-7c64ccc5f7-jgr84" podStartSLOduration=2.407801833 podStartE2EDuration="41.404806381s" totalImagesPullingTime="0s" totalInitContainerRuntime="38.997004548s" isStatefulPod=false podCreationTimestamp="2026-06-15 07:20:18 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 07:20:59.403291137 +0000 UTC m=+5542.363048408" watchObservedRunningTime="2026-06-15 07:20:59.404806381 +0000 UTC m=+5542.364563625"
Jun 15 07:21:05.796842 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:21:05.796802    2566 kuberuntime_container.go:872] "Killing container with a grace period" pod="kserve-ci-e2e-test/llmisvc-model-qwen2-5-0-5b-rout-4c1ba212-kserve-7c94bd674-cpqpr" podUID="b705c2db-7ec1-4059-b4e5-1af80dc11a77" containerName="main" containerID="cri-o://2b0e99392313fb6b74abb5ffe5aed49e1f31b52f636cacf3778b561122ad5e0b" gracePeriod=45
Jun 15 07:21:06.054442 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:21:06.054382    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/llmisvc-model-qwen2-5-0-5b-rout-4c1ba212-kserve-7c94bd674-cpqpr"
Jun 15 07:21:06.151644 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:21:06.151608    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b705c2db-7ec1-4059-b4e5-1af80dc11a77-tmp-dir\") pod \"b705c2db-7ec1-4059-b4e5-1af80dc11a77\" (UID: \"b705c2db-7ec1-4059-b4e5-1af80dc11a77\") "
Jun 15 07:21:06.151808 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:21:06.151677    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b705c2db-7ec1-4059-b4e5-1af80dc11a77-home\") pod \"b705c2db-7ec1-4059-b4e5-1af80dc11a77\" (UID: \"b705c2db-7ec1-4059-b4e5-1af80dc11a77\") "
Jun 15 07:21:06.151808 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:21:06.151739    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b705c2db-7ec1-4059-b4e5-1af80dc11a77-model-cache\") pod \"b705c2db-7ec1-4059-b4e5-1af80dc11a77\" (UID: \"b705c2db-7ec1-4059-b4e5-1af80dc11a77\") "
Jun 15 07:21:06.151808 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:21:06.151784    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-l4xz9\" (UniqueName: \"kubernetes.io/projected/b705c2db-7ec1-4059-b4e5-1af80dc11a77-kube-api-access-l4xz9\") pod \"b705c2db-7ec1-4059-b4e5-1af80dc11a77\" (UID: \"b705c2db-7ec1-4059-b4e5-1af80dc11a77\") "
Jun 15 07:21:06.151983 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:21:06.151830    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b705c2db-7ec1-4059-b4e5-1af80dc11a77-tls-certs\") pod \"b705c2db-7ec1-4059-b4e5-1af80dc11a77\" (UID: \"b705c2db-7ec1-4059-b4e5-1af80dc11a77\") "
Jun 15 07:21:06.151983 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:21:06.151888    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b705c2db-7ec1-4059-b4e5-1af80dc11a77-dshm\") pod \"b705c2db-7ec1-4059-b4e5-1af80dc11a77\" (UID: \"b705c2db-7ec1-4059-b4e5-1af80dc11a77\") "
Jun 15 07:21:06.151983 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:21:06.151919    2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b705c2db-7ec1-4059-b4e5-1af80dc11a77-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "b705c2db-7ec1-4059-b4e5-1af80dc11a77" (UID: "b705c2db-7ec1-4059-b4e5-1af80dc11a77"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jun 15 07:21:06.151983 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:21:06.151971    2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b705c2db-7ec1-4059-b4e5-1af80dc11a77-home" (OuterVolumeSpecName: "home") pod "b705c2db-7ec1-4059-b4e5-1af80dc11a77" (UID: "b705c2db-7ec1-4059-b4e5-1af80dc11a77"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jun 15 07:21:06.152217 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:21:06.151993    2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b705c2db-7ec1-4059-b4e5-1af80dc11a77-model-cache" (OuterVolumeSpecName: "model-cache") pod "b705c2db-7ec1-4059-b4e5-1af80dc11a77" (UID: "b705c2db-7ec1-4059-b4e5-1af80dc11a77"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jun 15 07:21:06.152217 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:21:06.152165    2566 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b705c2db-7ec1-4059-b4e5-1af80dc11a77-tmp-dir\") on node \"ip-10-0-128-243.ec2.internal\" DevicePath \"\""
Jun 15 07:21:06.152217 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:21:06.152178    2566 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b705c2db-7ec1-4059-b4e5-1af80dc11a77-home\") on node \"ip-10-0-128-243.ec2.internal\" DevicePath \"\""
Jun 15 07:21:06.152217 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:21:06.152188    2566 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b705c2db-7ec1-4059-b4e5-1af80dc11a77-model-cache\") on node \"ip-10-0-128-243.ec2.internal\" DevicePath \"\""
Jun 15 07:21:06.154450 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:21:06.154414    2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b705c2db-7ec1-4059-b4e5-1af80dc11a77-kube-api-access-l4xz9" (OuterVolumeSpecName: "kube-api-access-l4xz9") pod "b705c2db-7ec1-4059-b4e5-1af80dc11a77" (UID: "b705c2db-7ec1-4059-b4e5-1af80dc11a77"). InnerVolumeSpecName "kube-api-access-l4xz9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jun 15 07:21:06.154641 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:21:06.154626    2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b705c2db-7ec1-4059-b4e5-1af80dc11a77-dshm" (OuterVolumeSpecName: "dshm") pod "b705c2db-7ec1-4059-b4e5-1af80dc11a77" (UID: "b705c2db-7ec1-4059-b4e5-1af80dc11a77"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jun 15 07:21:06.154758 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:21:06.154738    2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b705c2db-7ec1-4059-b4e5-1af80dc11a77-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "b705c2db-7ec1-4059-b4e5-1af80dc11a77" (UID: "b705c2db-7ec1-4059-b4e5-1af80dc11a77"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jun 15 07:21:06.253694 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:21:06.253651    2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-l4xz9\" (UniqueName: \"kubernetes.io/projected/b705c2db-7ec1-4059-b4e5-1af80dc11a77-kube-api-access-l4xz9\") on node \"ip-10-0-128-243.ec2.internal\" DevicePath \"\""
Jun 15 07:21:06.253694 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:21:06.253694    2566 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b705c2db-7ec1-4059-b4e5-1af80dc11a77-tls-certs\") on node \"ip-10-0-128-243.ec2.internal\" DevicePath \"\""
Jun 15 07:21:06.253899 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:21:06.253709    2566 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b705c2db-7ec1-4059-b4e5-1af80dc11a77-dshm\") on node \"ip-10-0-128-243.ec2.internal\" DevicePath \"\""
Jun 15 07:21:06.424981 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:21:06.424892    2566 generic.go:356] "Generic (PLEG): container finished" podID="b705c2db-7ec1-4059-b4e5-1af80dc11a77" containerID="2b0e99392313fb6b74abb5ffe5aed49e1f31b52f636cacf3778b561122ad5e0b" exitCode=0
Jun 15 07:21:06.424981 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:21:06.424932    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/llmisvc-model-qwen2-5-0-5b-rout-4c1ba212-kserve-7c94bd674-cpqpr"
Jun 15 07:21:06.424981 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:21:06.424966    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/llmisvc-model-qwen2-5-0-5b-rout-4c1ba212-kserve-7c94bd674-cpqpr" event={"ID":"b705c2db-7ec1-4059-b4e5-1af80dc11a77","Type":"ContainerDied","Data":"2b0e99392313fb6b74abb5ffe5aed49e1f31b52f636cacf3778b561122ad5e0b"}
Jun 15 07:21:06.425238 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:21:06.425024    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/llmisvc-model-qwen2-5-0-5b-rout-4c1ba212-kserve-7c94bd674-cpqpr" event={"ID":"b705c2db-7ec1-4059-b4e5-1af80dc11a77","Type":"ContainerDied","Data":"5c03ca46edb9ae334619e9c0fcbbfc794b848888a392d9c4c909d0213f423742"}
Jun 15 07:21:06.425238 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:21:06.425046    2566 scope.go:117] "RemoveContainer" containerID="2b0e99392313fb6b74abb5ffe5aed49e1f31b52f636cacf3778b561122ad5e0b"
Jun 15 07:21:06.435064 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:21:06.435040    2566 scope.go:117] "RemoveContainer" containerID="2b0e99392313fb6b74abb5ffe5aed49e1f31b52f636cacf3778b561122ad5e0b"
Jun 15 07:21:06.435314 ip-10-0-128-243 kubenswrapper[2566]: E0615 07:21:06.435292    2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2b0e99392313fb6b74abb5ffe5aed49e1f31b52f636cacf3778b561122ad5e0b\": container with ID starting with 2b0e99392313fb6b74abb5ffe5aed49e1f31b52f636cacf3778b561122ad5e0b not found: ID does not exist" containerID="2b0e99392313fb6b74abb5ffe5aed49e1f31b52f636cacf3778b561122ad5e0b"
Jun 15 07:21:06.435407 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:21:06.435323    2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2b0e99392313fb6b74abb5ffe5aed49e1f31b52f636cacf3778b561122ad5e0b"} err="failed to get container status \"2b0e99392313fb6b74abb5ffe5aed49e1f31b52f636cacf3778b561122ad5e0b\": rpc error: code = NotFound desc = could not find container \"2b0e99392313fb6b74abb5ffe5aed49e1f31b52f636cacf3778b561122ad5e0b\": container with ID starting with 2b0e99392313fb6b74abb5ffe5aed49e1f31b52f636cacf3778b561122ad5e0b not found: ID does not exist"
Jun 15 07:21:06.447986 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:21:06.447953    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/llmisvc-model-qwen2-5-0-5b-rout-4c1ba212-kserve-7c94bd674-cpqpr"]
Jun 15 07:21:06.451846 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:21:06.451821    2566 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/llmisvc-model-qwen2-5-0-5b-rout-4c1ba212-kserve-7c94bd674-cpqpr"]
Jun 15 07:21:07.442342 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:21:07.442305    2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b705c2db-7ec1-4059-b4e5-1af80dc11a77" path="/var/lib/kubelet/pods/b705c2db-7ec1-4059-b4e5-1af80dc11a77/volumes"
Jun 15 07:21:08.378030 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:21:08.377995    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/stop-feature-test-kserve-7c64ccc5f7-jgr84"
Jun 15 07:21:08.378256 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:21:08.378070    2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kserve-ci-e2e-test/stop-feature-test-kserve-7c64ccc5f7-jgr84"
Jun 15 07:21:08.379778 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:21:08.379748    2566 prober.go:120] "Probe failed" probeType="Startup" pod="kserve-ci-e2e-test/stop-feature-test-kserve-7c64ccc5f7-jgr84" podUID="bea31c00-51b2-4b68-a8bc-ce92bfd48224" containerName="main" probeResult="failure" output="Get \"https://10.132.0.53:8000/health\": dial tcp 10.132.0.53:8000: connect: connection refused"
Jun 15 07:21:18.377344 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:21:18.377301    2566 prober.go:120] "Probe failed" probeType="Startup" pod="kserve-ci-e2e-test/stop-feature-test-kserve-7c64ccc5f7-jgr84" podUID="bea31c00-51b2-4b68-a8bc-ce92bfd48224" containerName="main" probeResult="failure" output="Get \"https://10.132.0.53:8000/health\": dial tcp 10.132.0.53:8000: connect: connection refused"
Jun 15 07:21:20.474164 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:21:20.474129    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/scheduler-configmap-ref-test-kserve-67776fd94d-4b46z"]
Jun 15 07:21:20.474661 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:21:20.474640    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b705c2db-7ec1-4059-b4e5-1af80dc11a77" containerName="main"
Jun 15 07:21:20.474743 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:21:20.474665    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="b705c2db-7ec1-4059-b4e5-1af80dc11a77" containerName="main"
Jun 15 07:21:20.474798 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:21:20.474767    2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="b705c2db-7ec1-4059-b4e5-1af80dc11a77" containerName="main"
Jun 15 07:21:20.477295 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:21:20.477272    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/scheduler-configmap-ref-test-kserve-67776fd94d-4b46z"
Jun 15 07:21:20.481166 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:21:20.481146    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"scheduler-configmap-ref-test-kserve-self-signed-certs\""
Jun 15 07:21:20.495326 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:21:20.495296    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/scheduler-configmap-ref-test-kserve-67776fd94d-4b46z"]
Jun 15 07:21:20.579213 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:21:20.579180    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/81c2032f-9560-40d0-b3d7-4e5fbe757fc7-dshm\") pod \"scheduler-configmap-ref-test-kserve-67776fd94d-4b46z\" (UID: \"81c2032f-9560-40d0-b3d7-4e5fbe757fc7\") " pod="kserve-ci-e2e-test/scheduler-configmap-ref-test-kserve-67776fd94d-4b46z"
Jun 15 07:21:20.579375 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:21:20.579227    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/81c2032f-9560-40d0-b3d7-4e5fbe757fc7-tls-certs\") pod \"scheduler-configmap-ref-test-kserve-67776fd94d-4b46z\" (UID: \"81c2032f-9560-40d0-b3d7-4e5fbe757fc7\") " pod="kserve-ci-e2e-test/scheduler-configmap-ref-test-kserve-67776fd94d-4b46z"
Jun 15 07:21:20.579375 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:21:20.579287    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-264jj\" (UniqueName: \"kubernetes.io/projected/81c2032f-9560-40d0-b3d7-4e5fbe757fc7-kube-api-access-264jj\") pod \"scheduler-configmap-ref-test-kserve-67776fd94d-4b46z\" (UID: \"81c2032f-9560-40d0-b3d7-4e5fbe757fc7\") " pod="kserve-ci-e2e-test/scheduler-configmap-ref-test-kserve-67776fd94d-4b46z"
Jun 15 07:21:20.579375 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:21:20.579333    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/81c2032f-9560-40d0-b3d7-4e5fbe757fc7-home\") pod \"scheduler-configmap-ref-test-kserve-67776fd94d-4b46z\" (UID: \"81c2032f-9560-40d0-b3d7-4e5fbe757fc7\") " pod="kserve-ci-e2e-test/scheduler-configmap-ref-test-kserve-67776fd94d-4b46z"
Jun 15 07:21:20.579375 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:21:20.579363    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/81c2032f-9560-40d0-b3d7-4e5fbe757fc7-model-cache\") pod \"scheduler-configmap-ref-test-kserve-67776fd94d-4b46z\" (UID: \"81c2032f-9560-40d0-b3d7-4e5fbe757fc7\") " pod="kserve-ci-e2e-test/scheduler-configmap-ref-test-kserve-67776fd94d-4b46z"
Jun 15 07:21:20.579530 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:21:20.579414    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/81c2032f-9560-40d0-b3d7-4e5fbe757fc7-tmp-dir\") pod \"scheduler-configmap-ref-test-kserve-67776fd94d-4b46z\" (UID: \"81c2032f-9560-40d0-b3d7-4e5fbe757fc7\") " pod="kserve-ci-e2e-test/scheduler-configmap-ref-test-kserve-67776fd94d-4b46z"
Jun 15 07:21:20.680852 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:21:20.680817    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/81c2032f-9560-40d0-b3d7-4e5fbe757fc7-tls-certs\") pod \"scheduler-configmap-ref-test-kserve-67776fd94d-4b46z\" (UID: \"81c2032f-9560-40d0-b3d7-4e5fbe757fc7\") " pod="kserve-ci-e2e-test/scheduler-configmap-ref-test-kserve-67776fd94d-4b46z"
Jun 15 07:21:20.681033 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:21:20.680865    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-264jj\" (UniqueName: \"kubernetes.io/projected/81c2032f-9560-40d0-b3d7-4e5fbe757fc7-kube-api-access-264jj\") pod \"scheduler-configmap-ref-test-kserve-67776fd94d-4b46z\" (UID: \"81c2032f-9560-40d0-b3d7-4e5fbe757fc7\") " pod="kserve-ci-e2e-test/scheduler-configmap-ref-test-kserve-67776fd94d-4b46z"
Jun 15 07:21:20.681033 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:21:20.680905    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/81c2032f-9560-40d0-b3d7-4e5fbe757fc7-home\") pod \"scheduler-configmap-ref-test-kserve-67776fd94d-4b46z\" (UID: \"81c2032f-9560-40d0-b3d7-4e5fbe757fc7\") " pod="kserve-ci-e2e-test/scheduler-configmap-ref-test-kserve-67776fd94d-4b46z"
Jun 15 07:21:20.681033 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:21:20.680926    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/81c2032f-9560-40d0-b3d7-4e5fbe757fc7-model-cache\") pod \"scheduler-configmap-ref-test-kserve-67776fd94d-4b46z\" (UID: \"81c2032f-9560-40d0-b3d7-4e5fbe757fc7\") " pod="kserve-ci-e2e-test/scheduler-configmap-ref-test-kserve-67776fd94d-4b46z"
Jun 15 07:21:20.681033 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:21:20.680974    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/81c2032f-9560-40d0-b3d7-4e5fbe757fc7-tmp-dir\") pod \"scheduler-configmap-ref-test-kserve-67776fd94d-4b46z\" (UID: \"81c2032f-9560-40d0-b3d7-4e5fbe757fc7\") " pod="kserve-ci-e2e-test/scheduler-configmap-ref-test-kserve-67776fd94d-4b46z"
Jun 15 07:21:20.681270 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:21:20.681159    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/81c2032f-9560-40d0-b3d7-4e5fbe757fc7-dshm\") pod \"scheduler-configmap-ref-test-kserve-67776fd94d-4b46z\" (UID: \"81c2032f-9560-40d0-b3d7-4e5fbe757fc7\") " pod="kserve-ci-e2e-test/scheduler-configmap-ref-test-kserve-67776fd94d-4b46z"
Jun 15 07:21:20.681403 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:21:20.681383    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/81c2032f-9560-40d0-b3d7-4e5fbe757fc7-model-cache\") pod \"scheduler-configmap-ref-test-kserve-67776fd94d-4b46z\" (UID: \"81c2032f-9560-40d0-b3d7-4e5fbe757fc7\") " pod="kserve-ci-e2e-test/scheduler-configmap-ref-test-kserve-67776fd94d-4b46z"
Jun 15 07:21:20.681472 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:21:20.681458    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/81c2032f-9560-40d0-b3d7-4e5fbe757fc7-tmp-dir\") pod \"scheduler-configmap-ref-test-kserve-67776fd94d-4b46z\" (UID: \"81c2032f-9560-40d0-b3d7-4e5fbe757fc7\") " pod="kserve-ci-e2e-test/scheduler-configmap-ref-test-kserve-67776fd94d-4b46z"
Jun 15 07:21:20.681532 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:21:20.681504    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/81c2032f-9560-40d0-b3d7-4e5fbe757fc7-home\") pod \"scheduler-configmap-ref-test-kserve-67776fd94d-4b46z\" (UID: \"81c2032f-9560-40d0-b3d7-4e5fbe757fc7\") " pod="kserve-ci-e2e-test/scheduler-configmap-ref-test-kserve-67776fd94d-4b46z"
Jun 15 07:21:20.683534 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:21:20.683502    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/81c2032f-9560-40d0-b3d7-4e5fbe757fc7-dshm\") pod \"scheduler-configmap-ref-test-kserve-67776fd94d-4b46z\" (UID: \"81c2032f-9560-40d0-b3d7-4e5fbe757fc7\") " pod="kserve-ci-e2e-test/scheduler-configmap-ref-test-kserve-67776fd94d-4b46z"
Jun 15 07:21:20.683534 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:21:20.683525    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/81c2032f-9560-40d0-b3d7-4e5fbe757fc7-tls-certs\") pod \"scheduler-configmap-ref-test-kserve-67776fd94d-4b46z\" (UID: \"81c2032f-9560-40d0-b3d7-4e5fbe757fc7\") " pod="kserve-ci-e2e-test/scheduler-configmap-ref-test-kserve-67776fd94d-4b46z"
Jun 15 07:21:20.698319 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:21:20.698297    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-264jj\" (UniqueName: \"kubernetes.io/projected/81c2032f-9560-40d0-b3d7-4e5fbe757fc7-kube-api-access-264jj\") pod \"scheduler-configmap-ref-test-kserve-67776fd94d-4b46z\" (UID: \"81c2032f-9560-40d0-b3d7-4e5fbe757fc7\") " pod="kserve-ci-e2e-test/scheduler-configmap-ref-test-kserve-67776fd94d-4b46z"
Jun 15 07:21:20.788102 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:21:20.788059    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/scheduler-configmap-ref-test-kserve-67776fd94d-4b46z"
Jun 15 07:21:20.937482 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:21:20.937449    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/scheduler-configmap-ref-test-kserve-67776fd94d-4b46z"]
Jun 15 07:21:20.938700 ip-10-0-128-243 kubenswrapper[2566]: W0615 07:21:20.938672    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod81c2032f_9560_40d0_b3d7_4e5fbe757fc7.slice/crio-10f1d161b4d24a96ba7c730d1b6600599e8c9ba7bbe2c587d821fe9546c9d083 WatchSource:0}: Error finding container 10f1d161b4d24a96ba7c730d1b6600599e8c9ba7bbe2c587d821fe9546c9d083: Status 404 returned error can't find the container with id 10f1d161b4d24a96ba7c730d1b6600599e8c9ba7bbe2c587d821fe9546c9d083
Jun 15 07:21:21.509951 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:21:21.509918    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/scheduler-configmap-ref-test-kserve-67776fd94d-4b46z" event={"ID":"81c2032f-9560-40d0-b3d7-4e5fbe757fc7","Type":"ContainerStarted","Data":"97318add4efda13f732e003683caf8fce99b1f20e4281f8aa8bd4907f019a6ae"}
Jun 15 07:21:21.510383 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:21:21.509971    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/scheduler-configmap-ref-test-kserve-67776fd94d-4b46z" event={"ID":"81c2032f-9560-40d0-b3d7-4e5fbe757fc7","Type":"ContainerStarted","Data":"10f1d161b4d24a96ba7c730d1b6600599e8c9ba7bbe2c587d821fe9546c9d083"}
Jun 15 07:21:21.529069 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:21:21.529022    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/scheduler-configmap-ref-test-kserve-67776fd94d-4b46z" podStartSLOduration=1.5290057780000001 podStartE2EDuration="1.529005778s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-15 07:21:20 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 07:21:21.527721445 +0000 UTC m=+5564.487478711" watchObservedRunningTime="2026-06-15 07:21:21.529005778 +0000 UTC m=+5564.488763024"
Jun 15 07:21:28.377605 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:21:28.377510    2566 prober.go:120] "Probe failed" probeType="Startup" pod="kserve-ci-e2e-test/stop-feature-test-kserve-7c64ccc5f7-jgr84" podUID="bea31c00-51b2-4b68-a8bc-ce92bfd48224" containerName="main" probeResult="failure" output="Get \"https://10.132.0.53:8000/health\": dial tcp 10.132.0.53:8000: connect: connection refused"
Jun 15 07:21:30.788484 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:21:30.788438    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/scheduler-configmap-ref-test-kserve-67776fd94d-4b46z"
Jun 15 07:21:30.788946 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:21:30.788567    2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kserve-ci-e2e-test/scheduler-configmap-ref-test-kserve-67776fd94d-4b46z"
Jun 15 07:21:30.801582 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:21:30.801554    2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kserve-ci-e2e-test/scheduler-configmap-ref-test-kserve-67776fd94d-4b46z"
Jun 15 07:21:31.586901 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:21:31.586872    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/scheduler-configmap-ref-test-kserve-67776fd94d-4b46z"
Jun 15 07:21:38.377328 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:21:38.377280    2566 prober.go:120] "Probe failed" probeType="Startup" pod="kserve-ci-e2e-test/stop-feature-test-kserve-7c64ccc5f7-jgr84" podUID="bea31c00-51b2-4b68-a8bc-ce92bfd48224" containerName="main" probeResult="failure" output="Get \"https://10.132.0.53:8000/health\": dial tcp 10.132.0.53:8000: connect: connection refused"
Jun 15 07:21:48.377878 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:21:48.377824    2566 prober.go:120] "Probe failed" probeType="Startup" pod="kserve-ci-e2e-test/stop-feature-test-kserve-7c64ccc5f7-jgr84" podUID="bea31c00-51b2-4b68-a8bc-ce92bfd48224" containerName="main" probeResult="failure" output="Get \"https://10.132.0.53:8000/health\": dial tcp 10.132.0.53:8000: connect: connection refused"
Jun 15 07:21:53.484976 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:21:53.484937    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/scheduler-configmap-ref-test-kserve-67776fd94d-4b46z"]
Jun 15 07:21:58.378191 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:21:58.378145    2566 prober.go:120] "Probe failed" probeType="Startup" pod="kserve-ci-e2e-test/stop-feature-test-kserve-7c64ccc5f7-jgr84" podUID="bea31c00-51b2-4b68-a8bc-ce92bfd48224" containerName="main" probeResult="failure" output="Get \"https://10.132.0.53:8000/health\": dial tcp 10.132.0.53:8000: connect: connection refused"
Jun 15 07:22:08.377829 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:22:08.377781    2566 prober.go:120] "Probe failed" probeType="Startup" pod="kserve-ci-e2e-test/stop-feature-test-kserve-7c64ccc5f7-jgr84" podUID="bea31c00-51b2-4b68-a8bc-ce92bfd48224" containerName="main" probeResult="failure" output="Get \"https://10.132.0.53:8000/health\": dial tcp 10.132.0.53:8000: connect: connection refused"
Jun 15 07:22:08.506248 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:22:08.506205    2566 kuberuntime_container.go:872] "Killing container with a grace period" pod="kserve-ci-e2e-test/scheduler-configmap-ref-test-kserve-67776fd94d-4b46z" podUID="81c2032f-9560-40d0-b3d7-4e5fbe757fc7" containerName="main" containerID="cri-o://97318add4efda13f732e003683caf8fce99b1f20e4281f8aa8bd4907f019a6ae" gracePeriod=45
Jun 15 07:22:08.760004 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:22:08.759978    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/scheduler-configmap-ref-test-kserve-67776fd94d-4b46z"
Jun 15 07:22:08.781477 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:22:08.781420    2566 generic.go:356] "Generic (PLEG): container finished" podID="81c2032f-9560-40d0-b3d7-4e5fbe757fc7" containerID="97318add4efda13f732e003683caf8fce99b1f20e4281f8aa8bd4907f019a6ae" exitCode=0
Jun 15 07:22:08.781477 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:22:08.781469    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/scheduler-configmap-ref-test-kserve-67776fd94d-4b46z"
Jun 15 07:22:08.781720 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:22:08.781526    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/scheduler-configmap-ref-test-kserve-67776fd94d-4b46z" event={"ID":"81c2032f-9560-40d0-b3d7-4e5fbe757fc7","Type":"ContainerDied","Data":"97318add4efda13f732e003683caf8fce99b1f20e4281f8aa8bd4907f019a6ae"}
Jun 15 07:22:08.781720 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:22:08.781595    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/scheduler-configmap-ref-test-kserve-67776fd94d-4b46z" event={"ID":"81c2032f-9560-40d0-b3d7-4e5fbe757fc7","Type":"ContainerDied","Data":"10f1d161b4d24a96ba7c730d1b6600599e8c9ba7bbe2c587d821fe9546c9d083"}
Jun 15 07:22:08.781720 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:22:08.781630    2566 scope.go:117] "RemoveContainer" containerID="97318add4efda13f732e003683caf8fce99b1f20e4281f8aa8bd4907f019a6ae"
Jun 15 07:22:08.793245 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:22:08.793223    2566 scope.go:117] "RemoveContainer" containerID="97318add4efda13f732e003683caf8fce99b1f20e4281f8aa8bd4907f019a6ae"
Jun 15 07:22:08.793534 ip-10-0-128-243 kubenswrapper[2566]: E0615 07:22:08.793511    2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"97318add4efda13f732e003683caf8fce99b1f20e4281f8aa8bd4907f019a6ae\": container with ID starting with 97318add4efda13f732e003683caf8fce99b1f20e4281f8aa8bd4907f019a6ae not found: ID does not exist" containerID="97318add4efda13f732e003683caf8fce99b1f20e4281f8aa8bd4907f019a6ae"
Jun 15 07:22:08.793644 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:22:08.793546    2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"97318add4efda13f732e003683caf8fce99b1f20e4281f8aa8bd4907f019a6ae"} err="failed to get container status \"97318add4efda13f732e003683caf8fce99b1f20e4281f8aa8bd4907f019a6ae\": rpc error: code = NotFound desc = could not find container \"97318add4efda13f732e003683caf8fce99b1f20e4281f8aa8bd4907f019a6ae\": container with ID starting with 97318add4efda13f732e003683caf8fce99b1f20e4281f8aa8bd4907f019a6ae not found: ID does not exist"
Jun 15 07:22:08.828845 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:22:08.828814    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/81c2032f-9560-40d0-b3d7-4e5fbe757fc7-dshm\") pod \"81c2032f-9560-40d0-b3d7-4e5fbe757fc7\" (UID: \"81c2032f-9560-40d0-b3d7-4e5fbe757fc7\") "
Jun 15 07:22:08.829112 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:22:08.828906    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-264jj\" (UniqueName: \"kubernetes.io/projected/81c2032f-9560-40d0-b3d7-4e5fbe757fc7-kube-api-access-264jj\") pod \"81c2032f-9560-40d0-b3d7-4e5fbe757fc7\" (UID: \"81c2032f-9560-40d0-b3d7-4e5fbe757fc7\") "
Jun 15 07:22:08.829112 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:22:08.828926    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/81c2032f-9560-40d0-b3d7-4e5fbe757fc7-tmp-dir\") pod \"81c2032f-9560-40d0-b3d7-4e5fbe757fc7\" (UID: \"81c2032f-9560-40d0-b3d7-4e5fbe757fc7\") "
Jun 15 07:22:08.829112 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:22:08.828946    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/81c2032f-9560-40d0-b3d7-4e5fbe757fc7-tls-certs\") pod \"81c2032f-9560-40d0-b3d7-4e5fbe757fc7\" (UID: \"81c2032f-9560-40d0-b3d7-4e5fbe757fc7\") "
Jun 15 07:22:08.829112 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:22:08.828961    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/81c2032f-9560-40d0-b3d7-4e5fbe757fc7-home\") pod \"81c2032f-9560-40d0-b3d7-4e5fbe757fc7\" (UID: \"81c2032f-9560-40d0-b3d7-4e5fbe757fc7\") "
Jun 15 07:22:08.829112 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:22:08.828991    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/81c2032f-9560-40d0-b3d7-4e5fbe757fc7-model-cache\") pod \"81c2032f-9560-40d0-b3d7-4e5fbe757fc7\" (UID: \"81c2032f-9560-40d0-b3d7-4e5fbe757fc7\") "
Jun 15 07:22:08.829437 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:22:08.829220    2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/81c2032f-9560-40d0-b3d7-4e5fbe757fc7-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "81c2032f-9560-40d0-b3d7-4e5fbe757fc7" (UID: "81c2032f-9560-40d0-b3d7-4e5fbe757fc7"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jun 15 07:22:08.829437 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:22:08.829233    2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/81c2032f-9560-40d0-b3d7-4e5fbe757fc7-home" (OuterVolumeSpecName: "home") pod "81c2032f-9560-40d0-b3d7-4e5fbe757fc7" (UID: "81c2032f-9560-40d0-b3d7-4e5fbe757fc7"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jun 15 07:22:08.829437 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:22:08.829395    2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/81c2032f-9560-40d0-b3d7-4e5fbe757fc7-model-cache" (OuterVolumeSpecName: "model-cache") pod "81c2032f-9560-40d0-b3d7-4e5fbe757fc7" (UID: "81c2032f-9560-40d0-b3d7-4e5fbe757fc7"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jun 15 07:22:08.831068 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:22:08.831035    2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/81c2032f-9560-40d0-b3d7-4e5fbe757fc7-dshm" (OuterVolumeSpecName: "dshm") pod "81c2032f-9560-40d0-b3d7-4e5fbe757fc7" (UID: "81c2032f-9560-40d0-b3d7-4e5fbe757fc7"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jun 15 07:22:08.831203 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:22:08.831073    2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/81c2032f-9560-40d0-b3d7-4e5fbe757fc7-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "81c2032f-9560-40d0-b3d7-4e5fbe757fc7" (UID: "81c2032f-9560-40d0-b3d7-4e5fbe757fc7"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jun 15 07:22:08.831203 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:22:08.831181    2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/81c2032f-9560-40d0-b3d7-4e5fbe757fc7-kube-api-access-264jj" (OuterVolumeSpecName: "kube-api-access-264jj") pod "81c2032f-9560-40d0-b3d7-4e5fbe757fc7" (UID: "81c2032f-9560-40d0-b3d7-4e5fbe757fc7"). InnerVolumeSpecName "kube-api-access-264jj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jun 15 07:22:08.930143 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:22:08.930001    2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-264jj\" (UniqueName: \"kubernetes.io/projected/81c2032f-9560-40d0-b3d7-4e5fbe757fc7-kube-api-access-264jj\") on node \"ip-10-0-128-243.ec2.internal\" DevicePath \"\""
Jun 15 07:22:08.930143 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:22:08.930029    2566 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/81c2032f-9560-40d0-b3d7-4e5fbe757fc7-tmp-dir\") on node \"ip-10-0-128-243.ec2.internal\" DevicePath \"\""
Jun 15 07:22:08.930143 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:22:08.930040    2566 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/81c2032f-9560-40d0-b3d7-4e5fbe757fc7-tls-certs\") on node \"ip-10-0-128-243.ec2.internal\" DevicePath \"\""
Jun 15 07:22:08.930143 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:22:08.930049    2566 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/81c2032f-9560-40d0-b3d7-4e5fbe757fc7-home\") on node \"ip-10-0-128-243.ec2.internal\" DevicePath \"\""
Jun 15 07:22:08.930143 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:22:08.930057    2566 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/81c2032f-9560-40d0-b3d7-4e5fbe757fc7-model-cache\") on node \"ip-10-0-128-243.ec2.internal\" DevicePath \"\""
Jun 15 07:22:08.930143 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:22:08.930064    2566 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/81c2032f-9560-40d0-b3d7-4e5fbe757fc7-dshm\") on node \"ip-10-0-128-243.ec2.internal\" DevicePath \"\""
Jun 15 07:22:09.117846 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:22:09.117814    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/scheduler-configmap-ref-test-kserve-67776fd94d-4b46z"]
Jun 15 07:22:09.124567 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:22:09.124535    2566 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/scheduler-configmap-ref-test-kserve-67776fd94d-4b46z"]
Jun 15 07:22:09.442211 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:22:09.442179    2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="81c2032f-9560-40d0-b3d7-4e5fbe757fc7" path="/var/lib/kubelet/pods/81c2032f-9560-40d0-b3d7-4e5fbe757fc7/volumes"
Jun 15 07:22:18.378241 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:22:18.378200    2566 prober.go:120] "Probe failed" probeType="Startup" pod="kserve-ci-e2e-test/stop-feature-test-kserve-7c64ccc5f7-jgr84" podUID="bea31c00-51b2-4b68-a8bc-ce92bfd48224" containerName="main" probeResult="failure" output="Get \"https://10.132.0.53:8000/health\": dial tcp 10.132.0.53:8000: connect: connection refused"
Jun 15 07:22:28.377823 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:22:28.377770    2566 prober.go:120] "Probe failed" probeType="Startup" pod="kserve-ci-e2e-test/stop-feature-test-kserve-7c64ccc5f7-jgr84" podUID="bea31c00-51b2-4b68-a8bc-ce92bfd48224" containerName="main" probeResult="failure" output="Get \"https://10.132.0.53:8000/health\": dial tcp 10.132.0.53:8000: connect: connection refused"
Jun 15 07:22:38.377320 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:22:38.377277    2566 prober.go:120] "Probe failed" probeType="Startup" pod="kserve-ci-e2e-test/stop-feature-test-kserve-7c64ccc5f7-jgr84" podUID="bea31c00-51b2-4b68-a8bc-ce92bfd48224" containerName="main" probeResult="failure" output="Get \"https://10.132.0.53:8000/health\": dial tcp 10.132.0.53:8000: connect: connection refused"
Jun 15 07:22:48.387627 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:22:48.387597    2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kserve-ci-e2e-test/stop-feature-test-kserve-7c64ccc5f7-jgr84"
Jun 15 07:22:48.395241 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:22:48.395211    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/stop-feature-test-kserve-7c64ccc5f7-jgr84"
Jun 15 07:22:49.311093 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:22:49.311037    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/stop-feature-test-kserve-7c64ccc5f7-jgr84"]
Jun 15 07:23:05.040754 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:23:05.040636    2566 kuberuntime_container.go:872] "Killing container with a grace period" pod="kserve-ci-e2e-test/stop-feature-test-kserve-7c64ccc5f7-jgr84" podUID="bea31c00-51b2-4b68-a8bc-ce92bfd48224" containerName="main" containerID="cri-o://aaf8509aa53e676a91063c68ac4dc98c41d04185f8d5e9caa60987dda8a3c3af" gracePeriod=45
Jun 15 07:23:05.787793 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:23:05.787769    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/stop-feature-test-kserve-7c64ccc5f7-jgr84"
Jun 15 07:23:05.829308 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:23:05.829246    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pcfsh\" (UniqueName: \"kubernetes.io/projected/bea31c00-51b2-4b68-a8bc-ce92bfd48224-kube-api-access-pcfsh\") pod \"bea31c00-51b2-4b68-a8bc-ce92bfd48224\" (UID: \"bea31c00-51b2-4b68-a8bc-ce92bfd48224\") "
Jun 15 07:23:05.829308 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:23:05.829292    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/bea31c00-51b2-4b68-a8bc-ce92bfd48224-kserve-provision-location\") pod \"bea31c00-51b2-4b68-a8bc-ce92bfd48224\" (UID: \"bea31c00-51b2-4b68-a8bc-ce92bfd48224\") "
Jun 15 07:23:05.829485 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:23:05.829323    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/bea31c00-51b2-4b68-a8bc-ce92bfd48224-model-cache\") pod \"bea31c00-51b2-4b68-a8bc-ce92bfd48224\" (UID: \"bea31c00-51b2-4b68-a8bc-ce92bfd48224\") "
Jun 15 07:23:05.829485 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:23:05.829338    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/bea31c00-51b2-4b68-a8bc-ce92bfd48224-home\") pod \"bea31c00-51b2-4b68-a8bc-ce92bfd48224\" (UID: \"bea31c00-51b2-4b68-a8bc-ce92bfd48224\") "
Jun 15 07:23:05.829485 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:23:05.829369    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bea31c00-51b2-4b68-a8bc-ce92bfd48224-tls-certs\") pod \"bea31c00-51b2-4b68-a8bc-ce92bfd48224\" (UID: \"bea31c00-51b2-4b68-a8bc-ce92bfd48224\") "
Jun 15 07:23:05.829654 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:23:05.829627    2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bea31c00-51b2-4b68-a8bc-ce92bfd48224-model-cache" (OuterVolumeSpecName: "model-cache") pod "bea31c00-51b2-4b68-a8bc-ce92bfd48224" (UID: "bea31c00-51b2-4b68-a8bc-ce92bfd48224"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jun 15 07:23:05.830111 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:23:05.830020    2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bea31c00-51b2-4b68-a8bc-ce92bfd48224-home" (OuterVolumeSpecName: "home") pod "bea31c00-51b2-4b68-a8bc-ce92bfd48224" (UID: "bea31c00-51b2-4b68-a8bc-ce92bfd48224"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jun 15 07:23:05.831539 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:23:05.831508    2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bea31c00-51b2-4b68-a8bc-ce92bfd48224-kube-api-access-pcfsh" (OuterVolumeSpecName: "kube-api-access-pcfsh") pod "bea31c00-51b2-4b68-a8bc-ce92bfd48224" (UID: "bea31c00-51b2-4b68-a8bc-ce92bfd48224"). InnerVolumeSpecName "kube-api-access-pcfsh". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jun 15 07:23:05.831686 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:23:05.831661    2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bea31c00-51b2-4b68-a8bc-ce92bfd48224-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "bea31c00-51b2-4b68-a8bc-ce92bfd48224" (UID: "bea31c00-51b2-4b68-a8bc-ce92bfd48224"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jun 15 07:23:05.894516 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:23:05.894458    2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bea31c00-51b2-4b68-a8bc-ce92bfd48224-kserve-provision-location" (OuterVolumeSpecName: "kserve-provision-location") pod "bea31c00-51b2-4b68-a8bc-ce92bfd48224" (UID: "bea31c00-51b2-4b68-a8bc-ce92bfd48224"). InnerVolumeSpecName "kserve-provision-location". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jun 15 07:23:05.930232 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:23:05.930202    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/bea31c00-51b2-4b68-a8bc-ce92bfd48224-dshm\") pod \"bea31c00-51b2-4b68-a8bc-ce92bfd48224\" (UID: \"bea31c00-51b2-4b68-a8bc-ce92bfd48224\") "
Jun 15 07:23:05.930360 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:23:05.930258    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bea31c00-51b2-4b68-a8bc-ce92bfd48224-tmp-dir\") pod \"bea31c00-51b2-4b68-a8bc-ce92bfd48224\" (UID: \"bea31c00-51b2-4b68-a8bc-ce92bfd48224\") "
Jun 15 07:23:05.930421 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:23:05.930409    2566 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bea31c00-51b2-4b68-a8bc-ce92bfd48224-tls-certs\") on node \"ip-10-0-128-243.ec2.internal\" DevicePath \"\""
Jun 15 07:23:05.930455 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:23:05.930424    2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pcfsh\" (UniqueName: \"kubernetes.io/projected/bea31c00-51b2-4b68-a8bc-ce92bfd48224-kube-api-access-pcfsh\") on node \"ip-10-0-128-243.ec2.internal\" DevicePath \"\""
Jun 15 07:23:05.930455 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:23:05.930434    2566 reconciler_common.go:299] "Volume detached for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/bea31c00-51b2-4b68-a8bc-ce92bfd48224-kserve-provision-location\") on node \"ip-10-0-128-243.ec2.internal\" DevicePath \"\""
Jun 15 07:23:05.930455 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:23:05.930442    2566 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/bea31c00-51b2-4b68-a8bc-ce92bfd48224-model-cache\") on node \"ip-10-0-128-243.ec2.internal\" DevicePath \"\""
Jun 15 07:23:05.930455 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:23:05.930449    2566 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/bea31c00-51b2-4b68-a8bc-ce92bfd48224-home\") on node \"ip-10-0-128-243.ec2.internal\" DevicePath \"\""
Jun 15 07:23:05.932321 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:23:05.932300    2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bea31c00-51b2-4b68-a8bc-ce92bfd48224-dshm" (OuterVolumeSpecName: "dshm") pod "bea31c00-51b2-4b68-a8bc-ce92bfd48224" (UID: "bea31c00-51b2-4b68-a8bc-ce92bfd48224"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jun 15 07:23:05.940544 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:23:05.940497    2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bea31c00-51b2-4b68-a8bc-ce92bfd48224-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "bea31c00-51b2-4b68-a8bc-ce92bfd48224" (UID: "bea31c00-51b2-4b68-a8bc-ce92bfd48224"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jun 15 07:23:06.030901 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:23:06.030868    2566 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/bea31c00-51b2-4b68-a8bc-ce92bfd48224-dshm\") on node \"ip-10-0-128-243.ec2.internal\" DevicePath \"\""
Jun 15 07:23:06.030901 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:23:06.030900    2566 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bea31c00-51b2-4b68-a8bc-ce92bfd48224-tmp-dir\") on node \"ip-10-0-128-243.ec2.internal\" DevicePath \"\""
Jun 15 07:23:06.100668 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:23:06.100585    2566 generic.go:356] "Generic (PLEG): container finished" podID="bea31c00-51b2-4b68-a8bc-ce92bfd48224" containerID="aaf8509aa53e676a91063c68ac4dc98c41d04185f8d5e9caa60987dda8a3c3af" exitCode=0
Jun 15 07:23:06.100668 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:23:06.100637    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/stop-feature-test-kserve-7c64ccc5f7-jgr84"
Jun 15 07:23:06.101208 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:23:06.100671    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/stop-feature-test-kserve-7c64ccc5f7-jgr84" event={"ID":"bea31c00-51b2-4b68-a8bc-ce92bfd48224","Type":"ContainerDied","Data":"aaf8509aa53e676a91063c68ac4dc98c41d04185f8d5e9caa60987dda8a3c3af"}
Jun 15 07:23:06.101208 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:23:06.100732    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/stop-feature-test-kserve-7c64ccc5f7-jgr84" event={"ID":"bea31c00-51b2-4b68-a8bc-ce92bfd48224","Type":"ContainerDied","Data":"b42f22ec69931f1064a80db025abdbb5af52a60dc2fa7f518edb878ff72e7008"}
Jun 15 07:23:06.101208 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:23:06.100767    2566 scope.go:117] "RemoveContainer" containerID="aaf8509aa53e676a91063c68ac4dc98c41d04185f8d5e9caa60987dda8a3c3af"
Jun 15 07:23:06.110940 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:23:06.110906    2566 scope.go:117] "RemoveContainer" containerID="c49f36c027b43f83766747e7290969c4a2ee00d8d1da4ebd6a8ae666352bddb0"
Jun 15 07:23:06.119498 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:23:06.119482    2566 scope.go:117] "RemoveContainer" containerID="aaf8509aa53e676a91063c68ac4dc98c41d04185f8d5e9caa60987dda8a3c3af"
Jun 15 07:23:06.119732 ip-10-0-128-243 kubenswrapper[2566]: E0615 07:23:06.119714    2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"aaf8509aa53e676a91063c68ac4dc98c41d04185f8d5e9caa60987dda8a3c3af\": container with ID starting with aaf8509aa53e676a91063c68ac4dc98c41d04185f8d5e9caa60987dda8a3c3af not found: ID does not exist" containerID="aaf8509aa53e676a91063c68ac4dc98c41d04185f8d5e9caa60987dda8a3c3af"
Jun 15 07:23:06.119777 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:23:06.119739    2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"aaf8509aa53e676a91063c68ac4dc98c41d04185f8d5e9caa60987dda8a3c3af"} err="failed to get container status \"aaf8509aa53e676a91063c68ac4dc98c41d04185f8d5e9caa60987dda8a3c3af\": rpc error: code = NotFound desc = could not find container \"aaf8509aa53e676a91063c68ac4dc98c41d04185f8d5e9caa60987dda8a3c3af\": container with ID starting with aaf8509aa53e676a91063c68ac4dc98c41d04185f8d5e9caa60987dda8a3c3af not found: ID does not exist"
Jun 15 07:23:06.119777 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:23:06.119754    2566 scope.go:117] "RemoveContainer" containerID="c49f36c027b43f83766747e7290969c4a2ee00d8d1da4ebd6a8ae666352bddb0"
Jun 15 07:23:06.119964 ip-10-0-128-243 kubenswrapper[2566]: E0615 07:23:06.119946    2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c49f36c027b43f83766747e7290969c4a2ee00d8d1da4ebd6a8ae666352bddb0\": container with ID starting with c49f36c027b43f83766747e7290969c4a2ee00d8d1da4ebd6a8ae666352bddb0 not found: ID does not exist" containerID="c49f36c027b43f83766747e7290969c4a2ee00d8d1da4ebd6a8ae666352bddb0"
Jun 15 07:23:06.120017 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:23:06.119967    2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c49f36c027b43f83766747e7290969c4a2ee00d8d1da4ebd6a8ae666352bddb0"} err="failed to get container status \"c49f36c027b43f83766747e7290969c4a2ee00d8d1da4ebd6a8ae666352bddb0\": rpc error: code = NotFound desc = could not find container \"c49f36c027b43f83766747e7290969c4a2ee00d8d1da4ebd6a8ae666352bddb0\": container with ID starting with c49f36c027b43f83766747e7290969c4a2ee00d8d1da4ebd6a8ae666352bddb0 not found: ID does not exist"
Jun 15 07:23:06.124809 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:23:06.124788    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/stop-feature-test-kserve-7c64ccc5f7-jgr84"]
Jun 15 07:23:06.131467 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:23:06.131446    2566 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/stop-feature-test-kserve-7c64ccc5f7-jgr84"]
Jun 15 07:23:07.442415 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:23:07.442384    2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bea31c00-51b2-4b68-a8bc-ce92bfd48224" path="/var/lib/kubelet/pods/bea31c00-51b2-4b68-a8bc-ce92bfd48224/volumes"
Jun 15 07:23:18.040509 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:23:18.040477    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/lora-single-adapter-test-kserve-6878c54cbb-44tgc"]
Jun 15 07:23:18.040910 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:23:18.040791    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="81c2032f-9560-40d0-b3d7-4e5fbe757fc7" containerName="main"
Jun 15 07:23:18.040910 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:23:18.040801    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="81c2032f-9560-40d0-b3d7-4e5fbe757fc7" containerName="main"
Jun 15 07:23:18.040910 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:23:18.040816    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bea31c00-51b2-4b68-a8bc-ce92bfd48224" containerName="main"
Jun 15 07:23:18.040910 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:23:18.040821    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="bea31c00-51b2-4b68-a8bc-ce92bfd48224" containerName="main"
Jun 15 07:23:18.040910 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:23:18.040840    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bea31c00-51b2-4b68-a8bc-ce92bfd48224" containerName="storage-initializer"
Jun 15 07:23:18.040910 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:23:18.040846    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="bea31c00-51b2-4b68-a8bc-ce92bfd48224" containerName="storage-initializer"
Jun 15 07:23:18.040910 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:23:18.040893    2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="81c2032f-9560-40d0-b3d7-4e5fbe757fc7" containerName="main"
Jun 15 07:23:18.040910 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:23:18.040902    2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="bea31c00-51b2-4b68-a8bc-ce92bfd48224" containerName="main"
Jun 15 07:23:18.045523 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:23:18.045506    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/lora-single-adapter-test-kserve-6878c54cbb-44tgc"
Jun 15 07:23:18.048066 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:23:18.048033    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"seaweedfs-s3-creds\""
Jun 15 07:23:18.048066 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:23:18.048038    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"odh-kserve-custom-ca-bundle\""
Jun 15 07:23:18.048366 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:23:18.048350    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"lora-single-adapter-test-kserve-self-signed-certs\""
Jun 15 07:23:18.058351 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:23:18.058331    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/lora-single-adapter-test-kserve-6878c54cbb-44tgc"]
Jun 15 07:23:18.133723 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:23:18.133691    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c274b100-9197-47ae-b67a-09ba0c0d6aa6-dshm\") pod \"lora-single-adapter-test-kserve-6878c54cbb-44tgc\" (UID: \"c274b100-9197-47ae-b67a-09ba0c0d6aa6\") " pod="kserve-ci-e2e-test/lora-single-adapter-test-kserve-6878c54cbb-44tgc"
Jun 15 07:23:18.133723 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:23:18.133726    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/c274b100-9197-47ae-b67a-09ba0c0d6aa6-kserve-provision-location\") pod \"lora-single-adapter-test-kserve-6878c54cbb-44tgc\" (UID: \"c274b100-9197-47ae-b67a-09ba0c0d6aa6\") " pod="kserve-ci-e2e-test/lora-single-adapter-test-kserve-6878c54cbb-44tgc"
Jun 15 07:23:18.133896 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:23:18.133752    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/c274b100-9197-47ae-b67a-09ba0c0d6aa6-cabundle-cert\") pod \"lora-single-adapter-test-kserve-6878c54cbb-44tgc\" (UID: \"c274b100-9197-47ae-b67a-09ba0c0d6aa6\") " pod="kserve-ci-e2e-test/lora-single-adapter-test-kserve-6878c54cbb-44tgc"
Jun 15 07:23:18.133896 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:23:18.133823    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c274b100-9197-47ae-b67a-09ba0c0d6aa6-model-cache\") pod \"lora-single-adapter-test-kserve-6878c54cbb-44tgc\" (UID: \"c274b100-9197-47ae-b67a-09ba0c0d6aa6\") " pod="kserve-ci-e2e-test/lora-single-adapter-test-kserve-6878c54cbb-44tgc"
Jun 15 07:23:18.133896 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:23:18.133854    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c274b100-9197-47ae-b67a-09ba0c0d6aa6-tmp-dir\") pod \"lora-single-adapter-test-kserve-6878c54cbb-44tgc\" (UID: \"c274b100-9197-47ae-b67a-09ba0c0d6aa6\") " pod="kserve-ci-e2e-test/lora-single-adapter-test-kserve-6878c54cbb-44tgc"
Jun 15 07:23:18.133896 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:23:18.133895    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c274b100-9197-47ae-b67a-09ba0c0d6aa6-home\") pod \"lora-single-adapter-test-kserve-6878c54cbb-44tgc\" (UID: \"c274b100-9197-47ae-b67a-09ba0c0d6aa6\") " pod="kserve-ci-e2e-test/lora-single-adapter-test-kserve-6878c54cbb-44tgc"
Jun 15 07:23:18.134068 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:23:18.133921    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c274b100-9197-47ae-b67a-09ba0c0d6aa6-tls-certs\") pod \"lora-single-adapter-test-kserve-6878c54cbb-44tgc\" (UID: \"c274b100-9197-47ae-b67a-09ba0c0d6aa6\") " pod="kserve-ci-e2e-test/lora-single-adapter-test-kserve-6878c54cbb-44tgc"
Jun 15 07:23:18.134068 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:23:18.133942    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k9llz\" (UniqueName: \"kubernetes.io/projected/c274b100-9197-47ae-b67a-09ba0c0d6aa6-kube-api-access-k9llz\") pod \"lora-single-adapter-test-kserve-6878c54cbb-44tgc\" (UID: \"c274b100-9197-47ae-b67a-09ba0c0d6aa6\") " pod="kserve-ci-e2e-test/lora-single-adapter-test-kserve-6878c54cbb-44tgc"
Jun 15 07:23:18.235070 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:23:18.235023    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c274b100-9197-47ae-b67a-09ba0c0d6aa6-dshm\") pod \"lora-single-adapter-test-kserve-6878c54cbb-44tgc\" (UID: \"c274b100-9197-47ae-b67a-09ba0c0d6aa6\") " pod="kserve-ci-e2e-test/lora-single-adapter-test-kserve-6878c54cbb-44tgc"
Jun 15 07:23:18.235269 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:23:18.235093    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/c274b100-9197-47ae-b67a-09ba0c0d6aa6-kserve-provision-location\") pod \"lora-single-adapter-test-kserve-6878c54cbb-44tgc\" (UID: \"c274b100-9197-47ae-b67a-09ba0c0d6aa6\") " pod="kserve-ci-e2e-test/lora-single-adapter-test-kserve-6878c54cbb-44tgc"
Jun 15 07:23:18.235269 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:23:18.235125    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/c274b100-9197-47ae-b67a-09ba0c0d6aa6-cabundle-cert\") pod \"lora-single-adapter-test-kserve-6878c54cbb-44tgc\" (UID: \"c274b100-9197-47ae-b67a-09ba0c0d6aa6\") " pod="kserve-ci-e2e-test/lora-single-adapter-test-kserve-6878c54cbb-44tgc"
Jun 15 07:23:18.235269 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:23:18.235147    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c274b100-9197-47ae-b67a-09ba0c0d6aa6-model-cache\") pod \"lora-single-adapter-test-kserve-6878c54cbb-44tgc\" (UID: \"c274b100-9197-47ae-b67a-09ba0c0d6aa6\") " pod="kserve-ci-e2e-test/lora-single-adapter-test-kserve-6878c54cbb-44tgc"
Jun 15 07:23:18.235429 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:23:18.235271    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c274b100-9197-47ae-b67a-09ba0c0d6aa6-tmp-dir\") pod \"lora-single-adapter-test-kserve-6878c54cbb-44tgc\" (UID: \"c274b100-9197-47ae-b67a-09ba0c0d6aa6\") " pod="kserve-ci-e2e-test/lora-single-adapter-test-kserve-6878c54cbb-44tgc"
Jun 15 07:23:18.235429 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:23:18.235329    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c274b100-9197-47ae-b67a-09ba0c0d6aa6-home\") pod \"lora-single-adapter-test-kserve-6878c54cbb-44tgc\" (UID: \"c274b100-9197-47ae-b67a-09ba0c0d6aa6\") " pod="kserve-ci-e2e-test/lora-single-adapter-test-kserve-6878c54cbb-44tgc"
Jun 15 07:23:18.235429 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:23:18.235370    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c274b100-9197-47ae-b67a-09ba0c0d6aa6-tls-certs\") pod \"lora-single-adapter-test-kserve-6878c54cbb-44tgc\" (UID: \"c274b100-9197-47ae-b67a-09ba0c0d6aa6\") " pod="kserve-ci-e2e-test/lora-single-adapter-test-kserve-6878c54cbb-44tgc"
Jun 15 07:23:18.235429 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:23:18.235408    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k9llz\" (UniqueName: \"kubernetes.io/projected/c274b100-9197-47ae-b67a-09ba0c0d6aa6-kube-api-access-k9llz\") pod \"lora-single-adapter-test-kserve-6878c54cbb-44tgc\" (UID: \"c274b100-9197-47ae-b67a-09ba0c0d6aa6\") " pod="kserve-ci-e2e-test/lora-single-adapter-test-kserve-6878c54cbb-44tgc"
Jun 15 07:23:18.235692 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:23:18.235665    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c274b100-9197-47ae-b67a-09ba0c0d6aa6-tmp-dir\") pod \"lora-single-adapter-test-kserve-6878c54cbb-44tgc\" (UID: \"c274b100-9197-47ae-b67a-09ba0c0d6aa6\") " pod="kserve-ci-e2e-test/lora-single-adapter-test-kserve-6878c54cbb-44tgc"
Jun 15 07:23:18.235873 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:23:18.235822    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c274b100-9197-47ae-b67a-09ba0c0d6aa6-model-cache\") pod \"lora-single-adapter-test-kserve-6878c54cbb-44tgc\" (UID: \"c274b100-9197-47ae-b67a-09ba0c0d6aa6\") " pod="kserve-ci-e2e-test/lora-single-adapter-test-kserve-6878c54cbb-44tgc"
Jun 15 07:23:18.235873 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:23:18.235849    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c274b100-9197-47ae-b67a-09ba0c0d6aa6-home\") pod \"lora-single-adapter-test-kserve-6878c54cbb-44tgc\" (UID: \"c274b100-9197-47ae-b67a-09ba0c0d6aa6\") " pod="kserve-ci-e2e-test/lora-single-adapter-test-kserve-6878c54cbb-44tgc"
Jun 15 07:23:18.236046 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:23:18.235935    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/c274b100-9197-47ae-b67a-09ba0c0d6aa6-kserve-provision-location\") pod \"lora-single-adapter-test-kserve-6878c54cbb-44tgc\" (UID: \"c274b100-9197-47ae-b67a-09ba0c0d6aa6\") " pod="kserve-ci-e2e-test/lora-single-adapter-test-kserve-6878c54cbb-44tgc"
Jun 15 07:23:18.236140 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:23:18.236118    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/c274b100-9197-47ae-b67a-09ba0c0d6aa6-cabundle-cert\") pod \"lora-single-adapter-test-kserve-6878c54cbb-44tgc\" (UID: \"c274b100-9197-47ae-b67a-09ba0c0d6aa6\") " pod="kserve-ci-e2e-test/lora-single-adapter-test-kserve-6878c54cbb-44tgc"
Jun 15 07:23:18.237534 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:23:18.237516    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c274b100-9197-47ae-b67a-09ba0c0d6aa6-dshm\") pod \"lora-single-adapter-test-kserve-6878c54cbb-44tgc\" (UID: \"c274b100-9197-47ae-b67a-09ba0c0d6aa6\") " pod="kserve-ci-e2e-test/lora-single-adapter-test-kserve-6878c54cbb-44tgc"
Jun 15 07:23:18.237928 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:23:18.237899    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c274b100-9197-47ae-b67a-09ba0c0d6aa6-tls-certs\") pod \"lora-single-adapter-test-kserve-6878c54cbb-44tgc\" (UID: \"c274b100-9197-47ae-b67a-09ba0c0d6aa6\") " pod="kserve-ci-e2e-test/lora-single-adapter-test-kserve-6878c54cbb-44tgc"
Jun 15 07:23:18.244608 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:23:18.244589    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-k9llz\" (UniqueName: \"kubernetes.io/projected/c274b100-9197-47ae-b67a-09ba0c0d6aa6-kube-api-access-k9llz\") pod \"lora-single-adapter-test-kserve-6878c54cbb-44tgc\" (UID: \"c274b100-9197-47ae-b67a-09ba0c0d6aa6\") " pod="kserve-ci-e2e-test/lora-single-adapter-test-kserve-6878c54cbb-44tgc"
Jun 15 07:23:18.356380 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:23:18.356296    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/lora-single-adapter-test-kserve-6878c54cbb-44tgc"
Jun 15 07:23:18.500102 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:23:18.500052    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/lora-single-adapter-test-kserve-6878c54cbb-44tgc"]
Jun 15 07:23:18.500687 ip-10-0-128-243 kubenswrapper[2566]: W0615 07:23:18.500665    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc274b100_9197_47ae_b67a_09ba0c0d6aa6.slice/crio-349d80a528478cb8712b8b1390962e1758a72b3ab48baa5e7e34b4f22173a743 WatchSource:0}: Error finding container 349d80a528478cb8712b8b1390962e1758a72b3ab48baa5e7e34b4f22173a743: Status 404 returned error can't find the container with id 349d80a528478cb8712b8b1390962e1758a72b3ab48baa5e7e34b4f22173a743
Jun 15 07:23:19.171685 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:23:19.171645    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/lora-single-adapter-test-kserve-6878c54cbb-44tgc" event={"ID":"c274b100-9197-47ae-b67a-09ba0c0d6aa6","Type":"ContainerStarted","Data":"9ec301ecaa9674d050072b833c6e48f717260b9b9b99316c27ec84140aa655e7"}
Jun 15 07:23:19.172077 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:23:19.171705    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/lora-single-adapter-test-kserve-6878c54cbb-44tgc" event={"ID":"c274b100-9197-47ae-b67a-09ba0c0d6aa6","Type":"ContainerStarted","Data":"349d80a528478cb8712b8b1390962e1758a72b3ab48baa5e7e34b4f22173a743"}
Jun 15 07:23:24.203910 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:23:24.203875    2566 generic.go:356] "Generic (PLEG): container finished" podID="c274b100-9197-47ae-b67a-09ba0c0d6aa6" containerID="9ec301ecaa9674d050072b833c6e48f717260b9b9b99316c27ec84140aa655e7" exitCode=0
Jun 15 07:23:24.204317 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:23:24.203919    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/lora-single-adapter-test-kserve-6878c54cbb-44tgc" event={"ID":"c274b100-9197-47ae-b67a-09ba0c0d6aa6","Type":"ContainerDied","Data":"9ec301ecaa9674d050072b833c6e48f717260b9b9b99316c27ec84140aa655e7"}
Jun 15 07:23:25.211130 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:23:25.211075    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/lora-single-adapter-test-kserve-6878c54cbb-44tgc" event={"ID":"c274b100-9197-47ae-b67a-09ba0c0d6aa6","Type":"ContainerStarted","Data":"3279e637e6cf87947e521708c187ae889ed4e1f0177214fbe3ee0fd71c47d65e"}
Jun 15 07:23:25.238601 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:23:25.238555    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/lora-single-adapter-test-kserve-6878c54cbb-44tgc" podStartSLOduration=2.134098644 podStartE2EDuration="7.23853942s" totalImagesPullingTime="0s" totalInitContainerRuntime="5.104440776s" isStatefulPod=false podCreationTimestamp="2026-06-15 07:23:18 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 07:23:25.234857287 +0000 UTC m=+5688.194614531" watchObservedRunningTime="2026-06-15 07:23:25.23853942 +0000 UTC m=+5688.198296666"
Jun 15 07:23:28.356468 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:23:28.356427    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/lora-single-adapter-test-kserve-6878c54cbb-44tgc"
Jun 15 07:23:28.357044 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:23:28.356507    2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kserve-ci-e2e-test/lora-single-adapter-test-kserve-6878c54cbb-44tgc"
Jun 15 07:23:28.358051 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:23:28.358024    2566 prober.go:120] "Probe failed" probeType="Startup" pod="kserve-ci-e2e-test/lora-single-adapter-test-kserve-6878c54cbb-44tgc" podUID="c274b100-9197-47ae-b67a-09ba0c0d6aa6" containerName="main" probeResult="failure" output="Get \"https://10.132.0.55:8000/health\": dial tcp 10.132.0.55:8000: connect: connection refused"
Jun 15 07:23:38.032452 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:23:38.032427    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5dbbb5d744-ktjgp_67da60eb-27f9-4bbd-8d12-64275e801143/console-operator/2.log"
Jun 15 07:23:38.038313 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:23:38.038293    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-f4bzh_5a1f8f83-55db-4fc7-872d-6b202daa0a31/ovn-acl-logging/0.log"
Jun 15 07:23:38.073169 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:23:38.073141    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5dbbb5d744-ktjgp_67da60eb-27f9-4bbd-8d12-64275e801143/console-operator/2.log"
Jun 15 07:23:38.078971 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:23:38.078949    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-f4bzh_5a1f8f83-55db-4fc7-872d-6b202daa0a31/ovn-acl-logging/0.log"
Jun 15 07:23:38.357798 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:23:38.357706    2566 prober.go:120] "Probe failed" probeType="Startup" pod="kserve-ci-e2e-test/lora-single-adapter-test-kserve-6878c54cbb-44tgc" podUID="c274b100-9197-47ae-b67a-09ba0c0d6aa6" containerName="main" probeResult="failure" output="Get \"https://10.132.0.55:8000/health\": dial tcp 10.132.0.55:8000: connect: connection refused"
Jun 15 07:23:48.357063 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:23:48.357017    2566 prober.go:120] "Probe failed" probeType="Startup" pod="kserve-ci-e2e-test/lora-single-adapter-test-kserve-6878c54cbb-44tgc" podUID="c274b100-9197-47ae-b67a-09ba0c0d6aa6" containerName="main" probeResult="failure" output="Get \"https://10.132.0.55:8000/health\": dial tcp 10.132.0.55:8000: connect: connection refused"
Jun 15 07:23:58.357561 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:23:58.357516    2566 prober.go:120] "Probe failed" probeType="Startup" pod="kserve-ci-e2e-test/lora-single-adapter-test-kserve-6878c54cbb-44tgc" podUID="c274b100-9197-47ae-b67a-09ba0c0d6aa6" containerName="main" probeResult="failure" output="Get \"https://10.132.0.55:8000/health\": dial tcp 10.132.0.55:8000: connect: connection refused"
Jun 15 07:24:08.357673 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:24:08.357634    2566 prober.go:120] "Probe failed" probeType="Startup" pod="kserve-ci-e2e-test/lora-single-adapter-test-kserve-6878c54cbb-44tgc" podUID="c274b100-9197-47ae-b67a-09ba0c0d6aa6" containerName="main" probeResult="failure" output="Get \"https://10.132.0.55:8000/health\": dial tcp 10.132.0.55:8000: connect: connection refused"
Jun 15 07:24:18.357745 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:24:18.357689    2566 prober.go:120] "Probe failed" probeType="Startup" pod="kserve-ci-e2e-test/lora-single-adapter-test-kserve-6878c54cbb-44tgc" podUID="c274b100-9197-47ae-b67a-09ba0c0d6aa6" containerName="main" probeResult="failure" output="Get \"https://10.132.0.55:8000/health\": dial tcp 10.132.0.55:8000: connect: connection refused"
Jun 15 07:24:28.357677 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:24:28.357586    2566 prober.go:120] "Probe failed" probeType="Startup" pod="kserve-ci-e2e-test/lora-single-adapter-test-kserve-6878c54cbb-44tgc" podUID="c274b100-9197-47ae-b67a-09ba0c0d6aa6" containerName="main" probeResult="failure" output="Get \"https://10.132.0.55:8000/health\": dial tcp 10.132.0.55:8000: connect: connection refused"
Jun 15 07:24:38.367247 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:24:38.367216    2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kserve-ci-e2e-test/lora-single-adapter-test-kserve-6878c54cbb-44tgc"
Jun 15 07:24:38.375613 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:24:38.375590    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/lora-single-adapter-test-kserve-6878c54cbb-44tgc"
Jun 15 07:25:13.350065 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:25:13.350033    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/lora-single-adapter-test-kserve-6878c54cbb-44tgc"]
Jun 15 07:25:28.373640 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:25:28.373596    2566 kuberuntime_container.go:872] "Killing container with a grace period" pod="kserve-ci-e2e-test/lora-single-adapter-test-kserve-6878c54cbb-44tgc" podUID="c274b100-9197-47ae-b67a-09ba0c0d6aa6" containerName="main" containerID="cri-o://3279e637e6cf87947e521708c187ae889ed4e1f0177214fbe3ee0fd71c47d65e" gracePeriod=45
Jun 15 07:25:28.917270 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:25:28.917243    2566 generic.go:356] "Generic (PLEG): container finished" podID="c274b100-9197-47ae-b67a-09ba0c0d6aa6" containerID="3279e637e6cf87947e521708c187ae889ed4e1f0177214fbe3ee0fd71c47d65e" exitCode=0
Jun 15 07:25:28.917408 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:25:28.917324    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/lora-single-adapter-test-kserve-6878c54cbb-44tgc" event={"ID":"c274b100-9197-47ae-b67a-09ba0c0d6aa6","Type":"ContainerDied","Data":"3279e637e6cf87947e521708c187ae889ed4e1f0177214fbe3ee0fd71c47d65e"}
Jun 15 07:25:29.027953 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:25:29.027928    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/lora-single-adapter-test-kserve-6878c54cbb-44tgc"
Jun 15 07:25:29.130360 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:25:29.130281    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c274b100-9197-47ae-b67a-09ba0c0d6aa6-model-cache\") pod \"c274b100-9197-47ae-b67a-09ba0c0d6aa6\" (UID: \"c274b100-9197-47ae-b67a-09ba0c0d6aa6\") "
Jun 15 07:25:29.130360 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:25:29.130313    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-k9llz\" (UniqueName: \"kubernetes.io/projected/c274b100-9197-47ae-b67a-09ba0c0d6aa6-kube-api-access-k9llz\") pod \"c274b100-9197-47ae-b67a-09ba0c0d6aa6\" (UID: \"c274b100-9197-47ae-b67a-09ba0c0d6aa6\") "
Jun 15 07:25:29.130360 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:25:29.130336    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c274b100-9197-47ae-b67a-09ba0c0d6aa6-tls-certs\") pod \"c274b100-9197-47ae-b67a-09ba0c0d6aa6\" (UID: \"c274b100-9197-47ae-b67a-09ba0c0d6aa6\") "
Jun 15 07:25:29.130360 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:25:29.130353    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c274b100-9197-47ae-b67a-09ba0c0d6aa6-dshm\") pod \"c274b100-9197-47ae-b67a-09ba0c0d6aa6\" (UID: \"c274b100-9197-47ae-b67a-09ba0c0d6aa6\") "
Jun 15 07:25:29.130700 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:25:29.130400    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c274b100-9197-47ae-b67a-09ba0c0d6aa6-tmp-dir\") pod \"c274b100-9197-47ae-b67a-09ba0c0d6aa6\" (UID: \"c274b100-9197-47ae-b67a-09ba0c0d6aa6\") "
Jun 15 07:25:29.130700 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:25:29.130444    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/c274b100-9197-47ae-b67a-09ba0c0d6aa6-kserve-provision-location\") pod \"c274b100-9197-47ae-b67a-09ba0c0d6aa6\" (UID: \"c274b100-9197-47ae-b67a-09ba0c0d6aa6\") "
Jun 15 07:25:29.130700 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:25:29.130491    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/c274b100-9197-47ae-b67a-09ba0c0d6aa6-cabundle-cert\") pod \"c274b100-9197-47ae-b67a-09ba0c0d6aa6\" (UID: \"c274b100-9197-47ae-b67a-09ba0c0d6aa6\") "
Jun 15 07:25:29.130700 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:25:29.130518    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c274b100-9197-47ae-b67a-09ba0c0d6aa6-home\") pod \"c274b100-9197-47ae-b67a-09ba0c0d6aa6\" (UID: \"c274b100-9197-47ae-b67a-09ba0c0d6aa6\") "
Jun 15 07:25:29.130700 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:25:29.130581    2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c274b100-9197-47ae-b67a-09ba0c0d6aa6-model-cache" (OuterVolumeSpecName: "model-cache") pod "c274b100-9197-47ae-b67a-09ba0c0d6aa6" (UID: "c274b100-9197-47ae-b67a-09ba0c0d6aa6"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jun 15 07:25:29.130958 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:25:29.130802    2566 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c274b100-9197-47ae-b67a-09ba0c0d6aa6-model-cache\") on node \"ip-10-0-128-243.ec2.internal\" DevicePath \"\""
Jun 15 07:25:29.130958 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:25:29.130907    2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c274b100-9197-47ae-b67a-09ba0c0d6aa6-home" (OuterVolumeSpecName: "home") pod "c274b100-9197-47ae-b67a-09ba0c0d6aa6" (UID: "c274b100-9197-47ae-b67a-09ba0c0d6aa6"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jun 15 07:25:29.131261 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:25:29.130969    2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c274b100-9197-47ae-b67a-09ba0c0d6aa6-cabundle-cert" (OuterVolumeSpecName: "cabundle-cert") pod "c274b100-9197-47ae-b67a-09ba0c0d6aa6" (UID: "c274b100-9197-47ae-b67a-09ba0c0d6aa6"). InnerVolumeSpecName "cabundle-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jun 15 07:25:29.132707 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:25:29.132682    2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c274b100-9197-47ae-b67a-09ba0c0d6aa6-kube-api-access-k9llz" (OuterVolumeSpecName: "kube-api-access-k9llz") pod "c274b100-9197-47ae-b67a-09ba0c0d6aa6" (UID: "c274b100-9197-47ae-b67a-09ba0c0d6aa6"). InnerVolumeSpecName "kube-api-access-k9llz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jun 15 07:25:29.132707 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:25:29.132698    2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c274b100-9197-47ae-b67a-09ba0c0d6aa6-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "c274b100-9197-47ae-b67a-09ba0c0d6aa6" (UID: "c274b100-9197-47ae-b67a-09ba0c0d6aa6"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jun 15 07:25:29.132859 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:25:29.132682    2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c274b100-9197-47ae-b67a-09ba0c0d6aa6-dshm" (OuterVolumeSpecName: "dshm") pod "c274b100-9197-47ae-b67a-09ba0c0d6aa6" (UID: "c274b100-9197-47ae-b67a-09ba0c0d6aa6"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jun 15 07:25:29.147684 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:25:29.147649    2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c274b100-9197-47ae-b67a-09ba0c0d6aa6-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "c274b100-9197-47ae-b67a-09ba0c0d6aa6" (UID: "c274b100-9197-47ae-b67a-09ba0c0d6aa6"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jun 15 07:25:29.202055 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:25:29.202028    2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c274b100-9197-47ae-b67a-09ba0c0d6aa6-kserve-provision-location" (OuterVolumeSpecName: "kserve-provision-location") pod "c274b100-9197-47ae-b67a-09ba0c0d6aa6" (UID: "c274b100-9197-47ae-b67a-09ba0c0d6aa6"). InnerVolumeSpecName "kserve-provision-location". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jun 15 07:25:29.231780 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:25:29.231757    2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-k9llz\" (UniqueName: \"kubernetes.io/projected/c274b100-9197-47ae-b67a-09ba0c0d6aa6-kube-api-access-k9llz\") on node \"ip-10-0-128-243.ec2.internal\" DevicePath \"\""
Jun 15 07:25:29.231780 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:25:29.231778    2566 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c274b100-9197-47ae-b67a-09ba0c0d6aa6-tls-certs\") on node \"ip-10-0-128-243.ec2.internal\" DevicePath \"\""
Jun 15 07:25:29.231922 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:25:29.231787    2566 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c274b100-9197-47ae-b67a-09ba0c0d6aa6-dshm\") on node \"ip-10-0-128-243.ec2.internal\" DevicePath \"\""
Jun 15 07:25:29.231922 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:25:29.231796    2566 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c274b100-9197-47ae-b67a-09ba0c0d6aa6-tmp-dir\") on node \"ip-10-0-128-243.ec2.internal\" DevicePath \"\""
Jun 15 07:25:29.231922 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:25:29.231804    2566 reconciler_common.go:299] "Volume detached for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/c274b100-9197-47ae-b67a-09ba0c0d6aa6-kserve-provision-location\") on node \"ip-10-0-128-243.ec2.internal\" DevicePath \"\""
Jun 15 07:25:29.231922 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:25:29.231812    2566 reconciler_common.go:299] "Volume detached for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/c274b100-9197-47ae-b67a-09ba0c0d6aa6-cabundle-cert\") on node \"ip-10-0-128-243.ec2.internal\" DevicePath \"\""
Jun 15 07:25:29.231922 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:25:29.231820    2566 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c274b100-9197-47ae-b67a-09ba0c0d6aa6-home\") on node \"ip-10-0-128-243.ec2.internal\" DevicePath \"\""
Jun 15 07:25:29.923850 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:25:29.923822    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/lora-single-adapter-test-kserve-6878c54cbb-44tgc"
Jun 15 07:25:29.924285 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:25:29.923846    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/lora-single-adapter-test-kserve-6878c54cbb-44tgc" event={"ID":"c274b100-9197-47ae-b67a-09ba0c0d6aa6","Type":"ContainerDied","Data":"349d80a528478cb8712b8b1390962e1758a72b3ab48baa5e7e34b4f22173a743"}
Jun 15 07:25:29.924285 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:25:29.923908    2566 scope.go:117] "RemoveContainer" containerID="3279e637e6cf87947e521708c187ae889ed4e1f0177214fbe3ee0fd71c47d65e"
Jun 15 07:25:29.933662 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:25:29.933644    2566 scope.go:117] "RemoveContainer" containerID="9ec301ecaa9674d050072b833c6e48f717260b9b9b99316c27ec84140aa655e7"
Jun 15 07:25:29.945926 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:25:29.945902    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/lora-single-adapter-test-kserve-6878c54cbb-44tgc"]
Jun 15 07:25:29.949917 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:25:29.949897    2566 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/lora-single-adapter-test-kserve-6878c54cbb-44tgc"]
Jun 15 07:25:31.442776 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:25:31.442745    2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c274b100-9197-47ae-b67a-09ba0c0d6aa6" path="/var/lib/kubelet/pods/c274b100-9197-47ae-b67a-09ba0c0d6aa6/volumes"
Jun 15 07:25:41.252923 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:25:41.252889    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/lora-multiple-adapters-test-kserve-5879d5bfc-s9g2n"]
Jun 15 07:25:41.253412 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:25:41.253390    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c274b100-9197-47ae-b67a-09ba0c0d6aa6" containerName="main"
Jun 15 07:25:41.253494 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:25:41.253417    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="c274b100-9197-47ae-b67a-09ba0c0d6aa6" containerName="main"
Jun 15 07:25:41.253494 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:25:41.253445    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c274b100-9197-47ae-b67a-09ba0c0d6aa6" containerName="storage-initializer"
Jun 15 07:25:41.253494 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:25:41.253455    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="c274b100-9197-47ae-b67a-09ba0c0d6aa6" containerName="storage-initializer"
Jun 15 07:25:41.253649 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:25:41.253546    2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="c274b100-9197-47ae-b67a-09ba0c0d6aa6" containerName="main"
Jun 15 07:25:41.257763 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:25:41.257743    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/lora-multiple-adapters-test-kserve-5879d5bfc-s9g2n"
Jun 15 07:25:41.260754 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:25:41.260735    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"seaweedfs-s3-creds\""
Jun 15 07:25:41.261197 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:25:41.261180    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"lora-multiple-adapters-test-kserve-self-signed-certs\""
Jun 15 07:25:41.261357 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:25:41.261338    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"odh-kserve-custom-ca-bundle\""
Jun 15 07:25:41.273723 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:25:41.273702    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/lora-multiple-adapters-test-kserve-5879d5bfc-s9g2n"]
Jun 15 07:25:41.335864 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:25:41.335843    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6c60b8dc-352b-43e8-8780-4836191cb776-tmp-dir\") pod \"lora-multiple-adapters-test-kserve-5879d5bfc-s9g2n\" (UID: \"6c60b8dc-352b-43e8-8780-4836191cb776\") " pod="kserve-ci-e2e-test/lora-multiple-adapters-test-kserve-5879d5bfc-s9g2n"
Jun 15 07:25:41.335954 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:25:41.335870    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6c60b8dc-352b-43e8-8780-4836191cb776-dshm\") pod \"lora-multiple-adapters-test-kserve-5879d5bfc-s9g2n\" (UID: \"6c60b8dc-352b-43e8-8780-4836191cb776\") " pod="kserve-ci-e2e-test/lora-multiple-adapters-test-kserve-5879d5bfc-s9g2n"
Jun 15 07:25:41.335954 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:25:41.335890    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/6c60b8dc-352b-43e8-8780-4836191cb776-kserve-provision-location\") pod \"lora-multiple-adapters-test-kserve-5879d5bfc-s9g2n\" (UID: \"6c60b8dc-352b-43e8-8780-4836191cb776\") " pod="kserve-ci-e2e-test/lora-multiple-adapters-test-kserve-5879d5bfc-s9g2n"
Jun 15 07:25:41.336112 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:25:41.336010    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6c60b8dc-352b-43e8-8780-4836191cb776-tls-certs\") pod \"lora-multiple-adapters-test-kserve-5879d5bfc-s9g2n\" (UID: \"6c60b8dc-352b-43e8-8780-4836191cb776\") " pod="kserve-ci-e2e-test/lora-multiple-adapters-test-kserve-5879d5bfc-s9g2n"
Jun 15 07:25:41.336112 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:25:41.336063    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8d7dg\" (UniqueName: \"kubernetes.io/projected/6c60b8dc-352b-43e8-8780-4836191cb776-kube-api-access-8d7dg\") pod \"lora-multiple-adapters-test-kserve-5879d5bfc-s9g2n\" (UID: \"6c60b8dc-352b-43e8-8780-4836191cb776\") " pod="kserve-ci-e2e-test/lora-multiple-adapters-test-kserve-5879d5bfc-s9g2n"
Jun 15 07:25:41.336238 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:25:41.336135    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6c60b8dc-352b-43e8-8780-4836191cb776-model-cache\") pod \"lora-multiple-adapters-test-kserve-5879d5bfc-s9g2n\" (UID: \"6c60b8dc-352b-43e8-8780-4836191cb776\") " pod="kserve-ci-e2e-test/lora-multiple-adapters-test-kserve-5879d5bfc-s9g2n"
Jun 15 07:25:41.336238 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:25:41.336166    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6c60b8dc-352b-43e8-8780-4836191cb776-home\") pod \"lora-multiple-adapters-test-kserve-5879d5bfc-s9g2n\" (UID: \"6c60b8dc-352b-43e8-8780-4836191cb776\") " pod="kserve-ci-e2e-test/lora-multiple-adapters-test-kserve-5879d5bfc-s9g2n"
Jun 15 07:25:41.336238 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:25:41.336192    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/6c60b8dc-352b-43e8-8780-4836191cb776-cabundle-cert\") pod \"lora-multiple-adapters-test-kserve-5879d5bfc-s9g2n\" (UID: \"6c60b8dc-352b-43e8-8780-4836191cb776\") " pod="kserve-ci-e2e-test/lora-multiple-adapters-test-kserve-5879d5bfc-s9g2n"
Jun 15 07:25:41.437068 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:25:41.437035    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6c60b8dc-352b-43e8-8780-4836191cb776-tmp-dir\") pod \"lora-multiple-adapters-test-kserve-5879d5bfc-s9g2n\" (UID: \"6c60b8dc-352b-43e8-8780-4836191cb776\") " pod="kserve-ci-e2e-test/lora-multiple-adapters-test-kserve-5879d5bfc-s9g2n"
Jun 15 07:25:41.437068 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:25:41.437069    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6c60b8dc-352b-43e8-8780-4836191cb776-dshm\") pod \"lora-multiple-adapters-test-kserve-5879d5bfc-s9g2n\" (UID: \"6c60b8dc-352b-43e8-8780-4836191cb776\") " pod="kserve-ci-e2e-test/lora-multiple-adapters-test-kserve-5879d5bfc-s9g2n"
Jun 15 07:25:41.437309 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:25:41.437109    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/6c60b8dc-352b-43e8-8780-4836191cb776-kserve-provision-location\") pod \"lora-multiple-adapters-test-kserve-5879d5bfc-s9g2n\" (UID: \"6c60b8dc-352b-43e8-8780-4836191cb776\") " pod="kserve-ci-e2e-test/lora-multiple-adapters-test-kserve-5879d5bfc-s9g2n"
Jun 15 07:25:41.437309 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:25:41.437162    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6c60b8dc-352b-43e8-8780-4836191cb776-tls-certs\") pod \"lora-multiple-adapters-test-kserve-5879d5bfc-s9g2n\" (UID: \"6c60b8dc-352b-43e8-8780-4836191cb776\") " pod="kserve-ci-e2e-test/lora-multiple-adapters-test-kserve-5879d5bfc-s9g2n"
Jun 15 07:25:41.437309 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:25:41.437191    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8d7dg\" (UniqueName: \"kubernetes.io/projected/6c60b8dc-352b-43e8-8780-4836191cb776-kube-api-access-8d7dg\") pod \"lora-multiple-adapters-test-kserve-5879d5bfc-s9g2n\" (UID: \"6c60b8dc-352b-43e8-8780-4836191cb776\") " pod="kserve-ci-e2e-test/lora-multiple-adapters-test-kserve-5879d5bfc-s9g2n"
Jun 15 07:25:41.437309 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:25:41.437228    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6c60b8dc-352b-43e8-8780-4836191cb776-model-cache\") pod \"lora-multiple-adapters-test-kserve-5879d5bfc-s9g2n\" (UID: \"6c60b8dc-352b-43e8-8780-4836191cb776\") " pod="kserve-ci-e2e-test/lora-multiple-adapters-test-kserve-5879d5bfc-s9g2n"
Jun 15 07:25:41.437309 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:25:41.437256    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6c60b8dc-352b-43e8-8780-4836191cb776-home\") pod \"lora-multiple-adapters-test-kserve-5879d5bfc-s9g2n\" (UID: \"6c60b8dc-352b-43e8-8780-4836191cb776\") " pod="kserve-ci-e2e-test/lora-multiple-adapters-test-kserve-5879d5bfc-s9g2n"
Jun 15 07:25:41.437309 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:25:41.437279    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/6c60b8dc-352b-43e8-8780-4836191cb776-cabundle-cert\") pod \"lora-multiple-adapters-test-kserve-5879d5bfc-s9g2n\" (UID: \"6c60b8dc-352b-43e8-8780-4836191cb776\") " pod="kserve-ci-e2e-test/lora-multiple-adapters-test-kserve-5879d5bfc-s9g2n"
Jun 15 07:25:41.437590 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:25:41.437493    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6c60b8dc-352b-43e8-8780-4836191cb776-tmp-dir\") pod \"lora-multiple-adapters-test-kserve-5879d5bfc-s9g2n\" (UID: \"6c60b8dc-352b-43e8-8780-4836191cb776\") " pod="kserve-ci-e2e-test/lora-multiple-adapters-test-kserve-5879d5bfc-s9g2n"
Jun 15 07:25:41.437590 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:25:41.437578    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/6c60b8dc-352b-43e8-8780-4836191cb776-kserve-provision-location\") pod \"lora-multiple-adapters-test-kserve-5879d5bfc-s9g2n\" (UID: \"6c60b8dc-352b-43e8-8780-4836191cb776\") " pod="kserve-ci-e2e-test/lora-multiple-adapters-test-kserve-5879d5bfc-s9g2n"
Jun 15 07:25:41.437787 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:25:41.437750    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6c60b8dc-352b-43e8-8780-4836191cb776-model-cache\") pod \"lora-multiple-adapters-test-kserve-5879d5bfc-s9g2n\" (UID: \"6c60b8dc-352b-43e8-8780-4836191cb776\") " pod="kserve-ci-e2e-test/lora-multiple-adapters-test-kserve-5879d5bfc-s9g2n"
Jun 15 07:25:41.437866 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:25:41.437843    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6c60b8dc-352b-43e8-8780-4836191cb776-home\") pod \"lora-multiple-adapters-test-kserve-5879d5bfc-s9g2n\" (UID: \"6c60b8dc-352b-43e8-8780-4836191cb776\") " pod="kserve-ci-e2e-test/lora-multiple-adapters-test-kserve-5879d5bfc-s9g2n"
Jun 15 07:25:41.437918 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:25:41.437876    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/6c60b8dc-352b-43e8-8780-4836191cb776-cabundle-cert\") pod \"lora-multiple-adapters-test-kserve-5879d5bfc-s9g2n\" (UID: \"6c60b8dc-352b-43e8-8780-4836191cb776\") " pod="kserve-ci-e2e-test/lora-multiple-adapters-test-kserve-5879d5bfc-s9g2n"
Jun 15 07:25:41.440050 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:25:41.440022    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6c60b8dc-352b-43e8-8780-4836191cb776-dshm\") pod \"lora-multiple-adapters-test-kserve-5879d5bfc-s9g2n\" (UID: \"6c60b8dc-352b-43e8-8780-4836191cb776\") " pod="kserve-ci-e2e-test/lora-multiple-adapters-test-kserve-5879d5bfc-s9g2n"
Jun 15 07:25:41.440303 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:25:41.440287    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6c60b8dc-352b-43e8-8780-4836191cb776-tls-certs\") pod \"lora-multiple-adapters-test-kserve-5879d5bfc-s9g2n\" (UID: \"6c60b8dc-352b-43e8-8780-4836191cb776\") " pod="kserve-ci-e2e-test/lora-multiple-adapters-test-kserve-5879d5bfc-s9g2n"
Jun 15 07:25:41.447871 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:25:41.447854    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8d7dg\" (UniqueName: \"kubernetes.io/projected/6c60b8dc-352b-43e8-8780-4836191cb776-kube-api-access-8d7dg\") pod \"lora-multiple-adapters-test-kserve-5879d5bfc-s9g2n\" (UID: \"6c60b8dc-352b-43e8-8780-4836191cb776\") " pod="kserve-ci-e2e-test/lora-multiple-adapters-test-kserve-5879d5bfc-s9g2n"
Jun 15 07:25:41.567915 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:25:41.567883    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/lora-multiple-adapters-test-kserve-5879d5bfc-s9g2n"
Jun 15 07:25:41.710953 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:25:41.710919    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/lora-multiple-adapters-test-kserve-5879d5bfc-s9g2n"]
Jun 15 07:25:41.711427 ip-10-0-128-243 kubenswrapper[2566]: W0615 07:25:41.711399    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6c60b8dc_352b_43e8_8780_4836191cb776.slice/crio-ea9b47799538939153c0e9e3afdea3397c167add26059b750e51f5e0e1855a62 WatchSource:0}: Error finding container ea9b47799538939153c0e9e3afdea3397c167add26059b750e51f5e0e1855a62: Status 404 returned error can't find the container with id ea9b47799538939153c0e9e3afdea3397c167add26059b750e51f5e0e1855a62
Jun 15 07:25:41.994505 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:25:41.994421    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/lora-multiple-adapters-test-kserve-5879d5bfc-s9g2n" event={"ID":"6c60b8dc-352b-43e8-8780-4836191cb776","Type":"ContainerStarted","Data":"e25a5076e74552effe5e047fbc2b362fbbe56b335fb80c1d5e6160b50d8697d2"}
Jun 15 07:25:41.994505 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:25:41.994482    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/lora-multiple-adapters-test-kserve-5879d5bfc-s9g2n" event={"ID":"6c60b8dc-352b-43e8-8780-4836191cb776","Type":"ContainerStarted","Data":"ea9b47799538939153c0e9e3afdea3397c167add26059b750e51f5e0e1855a62"}
Jun 15 07:25:47.031986 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:25:47.031952    2566 generic.go:356] "Generic (PLEG): container finished" podID="6c60b8dc-352b-43e8-8780-4836191cb776" containerID="e25a5076e74552effe5e047fbc2b362fbbe56b335fb80c1d5e6160b50d8697d2" exitCode=0
Jun 15 07:25:47.032424 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:25:47.032006    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/lora-multiple-adapters-test-kserve-5879d5bfc-s9g2n" event={"ID":"6c60b8dc-352b-43e8-8780-4836191cb776","Type":"ContainerDied","Data":"e25a5076e74552effe5e047fbc2b362fbbe56b335fb80c1d5e6160b50d8697d2"}
Jun 15 07:25:48.039796 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:25:48.039756    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/lora-multiple-adapters-test-kserve-5879d5bfc-s9g2n" event={"ID":"6c60b8dc-352b-43e8-8780-4836191cb776","Type":"ContainerStarted","Data":"0b5831424cb9fa7940a38e090a7e0e6642cd24f2e3b0e33658a1e3344c803672"}
Jun 15 07:25:48.064895 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:25:48.064847    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/lora-multiple-adapters-test-kserve-5879d5bfc-s9g2n" podStartSLOduration=2.710796393 podStartE2EDuration="7.064832728s" totalImagesPullingTime="0s" totalInitContainerRuntime="4.354036335s" isStatefulPod=false podCreationTimestamp="2026-06-15 07:25:41 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 07:25:48.061184653 +0000 UTC m=+5831.020941919" watchObservedRunningTime="2026-06-15 07:25:48.064832728 +0000 UTC m=+5831.024590012"
Jun 15 07:25:51.568730 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:25:51.568683    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/lora-multiple-adapters-test-kserve-5879d5bfc-s9g2n"
Jun 15 07:25:51.569206 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:25:51.568765    2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kserve-ci-e2e-test/lora-multiple-adapters-test-kserve-5879d5bfc-s9g2n"
Jun 15 07:25:51.570355 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:25:51.570326    2566 prober.go:120] "Probe failed" probeType="Startup" pod="kserve-ci-e2e-test/lora-multiple-adapters-test-kserve-5879d5bfc-s9g2n" podUID="6c60b8dc-352b-43e8-8780-4836191cb776" containerName="main" probeResult="failure" output="Get \"https://10.132.0.56:8000/health\": dial tcp 10.132.0.56:8000: connect: connection refused"
Jun 15 07:26:01.569164 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:26:01.569051    2566 prober.go:120] "Probe failed" probeType="Startup" pod="kserve-ci-e2e-test/lora-multiple-adapters-test-kserve-5879d5bfc-s9g2n" podUID="6c60b8dc-352b-43e8-8780-4836191cb776" containerName="main" probeResult="failure" output="Get \"https://10.132.0.56:8000/health\": dial tcp 10.132.0.56:8000: connect: connection refused"
Jun 15 07:26:11.568532 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:26:11.568484    2566 prober.go:120] "Probe failed" probeType="Startup" pod="kserve-ci-e2e-test/lora-multiple-adapters-test-kserve-5879d5bfc-s9g2n" podUID="6c60b8dc-352b-43e8-8780-4836191cb776" containerName="main" probeResult="failure" output="Get \"https://10.132.0.56:8000/health\": dial tcp 10.132.0.56:8000: connect: connection refused"
Jun 15 07:26:21.568417 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:26:21.568372    2566 prober.go:120] "Probe failed" probeType="Startup" pod="kserve-ci-e2e-test/lora-multiple-adapters-test-kserve-5879d5bfc-s9g2n" podUID="6c60b8dc-352b-43e8-8780-4836191cb776" containerName="main" probeResult="failure" output="Get \"https://10.132.0.56:8000/health\": dial tcp 10.132.0.56:8000: connect: connection refused"
Jun 15 07:26:31.573575 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:26:31.573435    2566 prober.go:120] "Probe failed" probeType="Startup" pod="kserve-ci-e2e-test/lora-multiple-adapters-test-kserve-5879d5bfc-s9g2n" podUID="6c60b8dc-352b-43e8-8780-4836191cb776" containerName="main" probeResult="failure" output="Get \"https://10.132.0.56:8000/health\": dial tcp 10.132.0.56:8000: connect: connection refused"
Jun 15 07:26:41.568532 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:26:41.568491    2566 prober.go:120] "Probe failed" probeType="Startup" pod="kserve-ci-e2e-test/lora-multiple-adapters-test-kserve-5879d5bfc-s9g2n" podUID="6c60b8dc-352b-43e8-8780-4836191cb776" containerName="main" probeResult="failure" output="Get \"https://10.132.0.56:8000/health\": dial tcp 10.132.0.56:8000: connect: connection refused"
Jun 15 07:26:51.569299 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:26:51.569257    2566 prober.go:120] "Probe failed" probeType="Startup" pod="kserve-ci-e2e-test/lora-multiple-adapters-test-kserve-5879d5bfc-s9g2n" podUID="6c60b8dc-352b-43e8-8780-4836191cb776" containerName="main" probeResult="failure" output="Get \"https://10.132.0.56:8000/health\": dial tcp 10.132.0.56:8000: connect: connection refused"
Jun 15 07:27:01.578649 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:27:01.578616    2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kserve-ci-e2e-test/lora-multiple-adapters-test-kserve-5879d5bfc-s9g2n"
Jun 15 07:27:01.586292 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:27:01.586269    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/lora-multiple-adapters-test-kserve-5879d5bfc-s9g2n"
Jun 15 07:27:47.452661 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:27:47.452586    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/lora-multiple-adapters-test-kserve-5879d5bfc-s9g2n"]
Jun 15 07:28:02.476056 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:28:02.475988    2566 kuberuntime_container.go:872] "Killing container with a grace period" pod="kserve-ci-e2e-test/lora-multiple-adapters-test-kserve-5879d5bfc-s9g2n" podUID="6c60b8dc-352b-43e8-8780-4836191cb776" containerName="main" containerID="cri-o://0b5831424cb9fa7940a38e090a7e0e6642cd24f2e3b0e33658a1e3344c803672" gracePeriod=45
Jun 15 07:28:03.134487 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:28:03.134464    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/lora-multiple-adapters-test-kserve-5879d5bfc-s9g2n"
Jun 15 07:28:03.215330 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:28:03.215256    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6c60b8dc-352b-43e8-8780-4836191cb776-model-cache\") pod \"6c60b8dc-352b-43e8-8780-4836191cb776\" (UID: \"6c60b8dc-352b-43e8-8780-4836191cb776\") "
Jun 15 07:28:03.215330 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:28:03.215294    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/6c60b8dc-352b-43e8-8780-4836191cb776-cabundle-cert\") pod \"6c60b8dc-352b-43e8-8780-4836191cb776\" (UID: \"6c60b8dc-352b-43e8-8780-4836191cb776\") "
Jun 15 07:28:03.215514 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:28:03.215324    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/6c60b8dc-352b-43e8-8780-4836191cb776-kserve-provision-location\") pod \"6c60b8dc-352b-43e8-8780-4836191cb776\" (UID: \"6c60b8dc-352b-43e8-8780-4836191cb776\") "
Jun 15 07:28:03.215795 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:28:03.215770    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6c60b8dc-352b-43e8-8780-4836191cb776-tls-certs\") pod \"6c60b8dc-352b-43e8-8780-4836191cb776\" (UID: \"6c60b8dc-352b-43e8-8780-4836191cb776\") "
Jun 15 07:28:03.216017 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:28:03.216001    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6c60b8dc-352b-43e8-8780-4836191cb776-dshm\") pod \"6c60b8dc-352b-43e8-8780-4836191cb776\" (UID: \"6c60b8dc-352b-43e8-8780-4836191cb776\") "
Jun 15 07:28:03.216192 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:28:03.216177    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8d7dg\" (UniqueName: \"kubernetes.io/projected/6c60b8dc-352b-43e8-8780-4836191cb776-kube-api-access-8d7dg\") pod \"6c60b8dc-352b-43e8-8780-4836191cb776\" (UID: \"6c60b8dc-352b-43e8-8780-4836191cb776\") "
Jun 15 07:28:03.216317 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:28:03.216303    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6c60b8dc-352b-43e8-8780-4836191cb776-home\") pod \"6c60b8dc-352b-43e8-8780-4836191cb776\" (UID: \"6c60b8dc-352b-43e8-8780-4836191cb776\") "
Jun 15 07:28:03.216483 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:28:03.216467    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6c60b8dc-352b-43e8-8780-4836191cb776-tmp-dir\") pod \"6c60b8dc-352b-43e8-8780-4836191cb776\" (UID: \"6c60b8dc-352b-43e8-8780-4836191cb776\") "
Jun 15 07:28:03.220185 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:28:03.215839    2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6c60b8dc-352b-43e8-8780-4836191cb776-model-cache" (OuterVolumeSpecName: "model-cache") pod "6c60b8dc-352b-43e8-8780-4836191cb776" (UID: "6c60b8dc-352b-43e8-8780-4836191cb776"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jun 15 07:28:03.220185 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:28:03.216064    2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6c60b8dc-352b-43e8-8780-4836191cb776-cabundle-cert" (OuterVolumeSpecName: "cabundle-cert") pod "6c60b8dc-352b-43e8-8780-4836191cb776" (UID: "6c60b8dc-352b-43e8-8780-4836191cb776"). InnerVolumeSpecName "cabundle-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jun 15 07:28:03.220185 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:28:03.218840    2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6c60b8dc-352b-43e8-8780-4836191cb776-home" (OuterVolumeSpecName: "home") pod "6c60b8dc-352b-43e8-8780-4836191cb776" (UID: "6c60b8dc-352b-43e8-8780-4836191cb776"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jun 15 07:28:03.226560 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:28:03.226386    2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6c60b8dc-352b-43e8-8780-4836191cb776-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "6c60b8dc-352b-43e8-8780-4836191cb776" (UID: "6c60b8dc-352b-43e8-8780-4836191cb776"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jun 15 07:28:03.226815 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:28:03.226703    2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6c60b8dc-352b-43e8-8780-4836191cb776-dshm" (OuterVolumeSpecName: "dshm") pod "6c60b8dc-352b-43e8-8780-4836191cb776" (UID: "6c60b8dc-352b-43e8-8780-4836191cb776"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jun 15 07:28:03.226815 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:28:03.226784    2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6c60b8dc-352b-43e8-8780-4836191cb776-kube-api-access-8d7dg" (OuterVolumeSpecName: "kube-api-access-8d7dg") pod "6c60b8dc-352b-43e8-8780-4836191cb776" (UID: "6c60b8dc-352b-43e8-8780-4836191cb776"). InnerVolumeSpecName "kube-api-access-8d7dg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jun 15 07:28:03.231867 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:28:03.231838    2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6c60b8dc-352b-43e8-8780-4836191cb776-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "6c60b8dc-352b-43e8-8780-4836191cb776" (UID: "6c60b8dc-352b-43e8-8780-4836191cb776"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jun 15 07:28:03.289209 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:28:03.289151    2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6c60b8dc-352b-43e8-8780-4836191cb776-kserve-provision-location" (OuterVolumeSpecName: "kserve-provision-location") pod "6c60b8dc-352b-43e8-8780-4836191cb776" (UID: "6c60b8dc-352b-43e8-8780-4836191cb776"). InnerVolumeSpecName "kserve-provision-location". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jun 15 07:28:03.318411 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:28:03.318378    2566 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6c60b8dc-352b-43e8-8780-4836191cb776-tls-certs\") on node \"ip-10-0-128-243.ec2.internal\" DevicePath \"\""
Jun 15 07:28:03.318411 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:28:03.318405    2566 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6c60b8dc-352b-43e8-8780-4836191cb776-dshm\") on node \"ip-10-0-128-243.ec2.internal\" DevicePath \"\""
Jun 15 07:28:03.318560 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:28:03.318415    2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8d7dg\" (UniqueName: \"kubernetes.io/projected/6c60b8dc-352b-43e8-8780-4836191cb776-kube-api-access-8d7dg\") on node \"ip-10-0-128-243.ec2.internal\" DevicePath \"\""
Jun 15 07:28:03.318560 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:28:03.318425    2566 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6c60b8dc-352b-43e8-8780-4836191cb776-home\") on node \"ip-10-0-128-243.ec2.internal\" DevicePath \"\""
Jun 15 07:28:03.318560 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:28:03.318434    2566 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6c60b8dc-352b-43e8-8780-4836191cb776-tmp-dir\") on node \"ip-10-0-128-243.ec2.internal\" DevicePath \"\""
Jun 15 07:28:03.318560 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:28:03.318443    2566 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6c60b8dc-352b-43e8-8780-4836191cb776-model-cache\") on node \"ip-10-0-128-243.ec2.internal\" DevicePath \"\""
Jun 15 07:28:03.318560 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:28:03.318451    2566 reconciler_common.go:299] "Volume detached for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/6c60b8dc-352b-43e8-8780-4836191cb776-cabundle-cert\") on node \"ip-10-0-128-243.ec2.internal\" DevicePath \"\""
Jun 15 07:28:03.318560 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:28:03.318458    2566 reconciler_common.go:299] "Volume detached for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/6c60b8dc-352b-43e8-8780-4836191cb776-kserve-provision-location\") on node \"ip-10-0-128-243.ec2.internal\" DevicePath \"\""
Jun 15 07:28:03.826196 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:28:03.826157    2566 generic.go:356] "Generic (PLEG): container finished" podID="6c60b8dc-352b-43e8-8780-4836191cb776" containerID="0b5831424cb9fa7940a38e090a7e0e6642cd24f2e3b0e33658a1e3344c803672" exitCode=0
Jun 15 07:28:03.826626 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:28:03.826223    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/lora-multiple-adapters-test-kserve-5879d5bfc-s9g2n"
Jun 15 07:28:03.826626 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:28:03.826231    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/lora-multiple-adapters-test-kserve-5879d5bfc-s9g2n" event={"ID":"6c60b8dc-352b-43e8-8780-4836191cb776","Type":"ContainerDied","Data":"0b5831424cb9fa7940a38e090a7e0e6642cd24f2e3b0e33658a1e3344c803672"}
Jun 15 07:28:03.826626 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:28:03.826286    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/lora-multiple-adapters-test-kserve-5879d5bfc-s9g2n" event={"ID":"6c60b8dc-352b-43e8-8780-4836191cb776","Type":"ContainerDied","Data":"ea9b47799538939153c0e9e3afdea3397c167add26059b750e51f5e0e1855a62"}
Jun 15 07:28:03.826626 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:28:03.826309    2566 scope.go:117] "RemoveContainer" containerID="0b5831424cb9fa7940a38e090a7e0e6642cd24f2e3b0e33658a1e3344c803672"
Jun 15 07:28:03.835909 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:28:03.835883    2566 scope.go:117] "RemoveContainer" containerID="e25a5076e74552effe5e047fbc2b362fbbe56b335fb80c1d5e6160b50d8697d2"
Jun 15 07:28:03.845166 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:28:03.845147    2566 scope.go:117] "RemoveContainer" containerID="0b5831424cb9fa7940a38e090a7e0e6642cd24f2e3b0e33658a1e3344c803672"
Jun 15 07:28:03.845474 ip-10-0-128-243 kubenswrapper[2566]: E0615 07:28:03.845450    2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0b5831424cb9fa7940a38e090a7e0e6642cd24f2e3b0e33658a1e3344c803672\": container with ID starting with 0b5831424cb9fa7940a38e090a7e0e6642cd24f2e3b0e33658a1e3344c803672 not found: ID does not exist" containerID="0b5831424cb9fa7940a38e090a7e0e6642cd24f2e3b0e33658a1e3344c803672"
Jun 15 07:28:03.845521 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:28:03.845485    2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0b5831424cb9fa7940a38e090a7e0e6642cd24f2e3b0e33658a1e3344c803672"} err="failed to get container status \"0b5831424cb9fa7940a38e090a7e0e6642cd24f2e3b0e33658a1e3344c803672\": rpc error: code = NotFound desc = could not find container \"0b5831424cb9fa7940a38e090a7e0e6642cd24f2e3b0e33658a1e3344c803672\": container with ID starting with 0b5831424cb9fa7940a38e090a7e0e6642cd24f2e3b0e33658a1e3344c803672 not found: ID does not exist"
Jun 15 07:28:03.845521 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:28:03.845504    2566 scope.go:117] "RemoveContainer" containerID="e25a5076e74552effe5e047fbc2b362fbbe56b335fb80c1d5e6160b50d8697d2"
Jun 15 07:28:03.845764 ip-10-0-128-243 kubenswrapper[2566]: E0615 07:28:03.845749    2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e25a5076e74552effe5e047fbc2b362fbbe56b335fb80c1d5e6160b50d8697d2\": container with ID starting with e25a5076e74552effe5e047fbc2b362fbbe56b335fb80c1d5e6160b50d8697d2 not found: ID does not exist" containerID="e25a5076e74552effe5e047fbc2b362fbbe56b335fb80c1d5e6160b50d8697d2"
Jun 15 07:28:03.845835 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:28:03.845767    2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e25a5076e74552effe5e047fbc2b362fbbe56b335fb80c1d5e6160b50d8697d2"} err="failed to get container status \"e25a5076e74552effe5e047fbc2b362fbbe56b335fb80c1d5e6160b50d8697d2\": rpc error: code = NotFound desc = could not find container \"e25a5076e74552effe5e047fbc2b362fbbe56b335fb80c1d5e6160b50d8697d2\": container with ID starting with e25a5076e74552effe5e047fbc2b362fbbe56b335fb80c1d5e6160b50d8697d2 not found: ID does not exist"
Jun 15 07:28:03.851383 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:28:03.851357    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/lora-multiple-adapters-test-kserve-5879d5bfc-s9g2n"]
Jun 15 07:28:03.863828 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:28:03.863793    2566 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/lora-multiple-adapters-test-kserve-5879d5bfc-s9g2n"]
Jun 15 07:28:05.442157 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:28:05.442124    2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6c60b8dc-352b-43e8-8780-4836191cb776" path="/var/lib/kubelet/pods/6c60b8dc-352b-43e8-8780-4836191cb776/volumes"
Jun 15 07:28:38.072772 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:28:38.072670    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5dbbb5d744-ktjgp_67da60eb-27f9-4bbd-8d12-64275e801143/console-operator/2.log"
Jun 15 07:28:38.077883 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:28:38.077860    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-f4bzh_5a1f8f83-55db-4fc7-872d-6b202daa0a31/ovn-acl-logging/0.log"
Jun 15 07:28:38.107619 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:28:38.107603    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5dbbb5d744-ktjgp_67da60eb-27f9-4bbd-8d12-64275e801143/console-operator/2.log"
Jun 15 07:28:38.112635 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:28:38.112619    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-f4bzh_5a1f8f83-55db-4fc7-872d-6b202daa0a31/ovn-acl-logging/0.log"
Jun 15 07:28:39.843352 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:28:39.843321    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/prestop-hook-test-kserve-6758474485-78tpc"]
Jun 15 07:28:39.843707 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:28:39.843631    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6c60b8dc-352b-43e8-8780-4836191cb776" containerName="storage-initializer"
Jun 15 07:28:39.843707 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:28:39.843642    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="6c60b8dc-352b-43e8-8780-4836191cb776" containerName="storage-initializer"
Jun 15 07:28:39.843707 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:28:39.843668    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6c60b8dc-352b-43e8-8780-4836191cb776" containerName="main"
Jun 15 07:28:39.843707 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:28:39.843673    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="6c60b8dc-352b-43e8-8780-4836191cb776" containerName="main"
Jun 15 07:28:39.843845 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:28:39.843733    2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="6c60b8dc-352b-43e8-8780-4836191cb776" containerName="main"
Jun 15 07:28:39.848200 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:28:39.848179    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/prestop-hook-test-kserve-6758474485-78tpc"
Jun 15 07:28:39.850689 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:28:39.850667    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"seaweedfs-s3-creds\""
Jun 15 07:28:39.850833 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:28:39.850686    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"prestop-hook-test-kserve-self-signed-certs\""
Jun 15 07:28:39.858583 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:28:39.858562    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/prestop-hook-test-kserve-6758474485-78tpc"]
Jun 15 07:28:40.026928 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:28:40.026895    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/492649e2-e975-43ad-bc77-84ea0d5bcda0-model-cache\") pod \"prestop-hook-test-kserve-6758474485-78tpc\" (UID: \"492649e2-e975-43ad-bc77-84ea0d5bcda0\") " pod="kserve-ci-e2e-test/prestop-hook-test-kserve-6758474485-78tpc"
Jun 15 07:28:40.026928 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:28:40.026930    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/492649e2-e975-43ad-bc77-84ea0d5bcda0-tls-certs\") pod \"prestop-hook-test-kserve-6758474485-78tpc\" (UID: \"492649e2-e975-43ad-bc77-84ea0d5bcda0\") " pod="kserve-ci-e2e-test/prestop-hook-test-kserve-6758474485-78tpc"
Jun 15 07:28:40.027171 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:28:40.026959    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/492649e2-e975-43ad-bc77-84ea0d5bcda0-kserve-provision-location\") pod \"prestop-hook-test-kserve-6758474485-78tpc\" (UID: \"492649e2-e975-43ad-bc77-84ea0d5bcda0\") " pod="kserve-ci-e2e-test/prestop-hook-test-kserve-6758474485-78tpc"
Jun 15 07:28:40.027171 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:28:40.027008    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/492649e2-e975-43ad-bc77-84ea0d5bcda0-dshm\") pod \"prestop-hook-test-kserve-6758474485-78tpc\" (UID: \"492649e2-e975-43ad-bc77-84ea0d5bcda0\") " pod="kserve-ci-e2e-test/prestop-hook-test-kserve-6758474485-78tpc"
Jun 15 07:28:40.027171 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:28:40.027037    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/492649e2-e975-43ad-bc77-84ea0d5bcda0-tmp-dir\") pod \"prestop-hook-test-kserve-6758474485-78tpc\" (UID: \"492649e2-e975-43ad-bc77-84ea0d5bcda0\") " pod="kserve-ci-e2e-test/prestop-hook-test-kserve-6758474485-78tpc"
Jun 15 07:28:40.027171 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:28:40.027142    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/492649e2-e975-43ad-bc77-84ea0d5bcda0-home\") pod \"prestop-hook-test-kserve-6758474485-78tpc\" (UID: \"492649e2-e975-43ad-bc77-84ea0d5bcda0\") " pod="kserve-ci-e2e-test/prestop-hook-test-kserve-6758474485-78tpc"
Jun 15 07:28:40.027313 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:28:40.027182    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zv9qk\" (UniqueName: \"kubernetes.io/projected/492649e2-e975-43ad-bc77-84ea0d5bcda0-kube-api-access-zv9qk\") pod \"prestop-hook-test-kserve-6758474485-78tpc\" (UID: \"492649e2-e975-43ad-bc77-84ea0d5bcda0\") " pod="kserve-ci-e2e-test/prestop-hook-test-kserve-6758474485-78tpc"
Jun 15 07:28:40.128438 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:28:40.128358    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/492649e2-e975-43ad-bc77-84ea0d5bcda0-model-cache\") pod \"prestop-hook-test-kserve-6758474485-78tpc\" (UID: \"492649e2-e975-43ad-bc77-84ea0d5bcda0\") " pod="kserve-ci-e2e-test/prestop-hook-test-kserve-6758474485-78tpc"
Jun 15 07:28:40.128438 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:28:40.128395    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/492649e2-e975-43ad-bc77-84ea0d5bcda0-tls-certs\") pod \"prestop-hook-test-kserve-6758474485-78tpc\" (UID: \"492649e2-e975-43ad-bc77-84ea0d5bcda0\") " pod="kserve-ci-e2e-test/prestop-hook-test-kserve-6758474485-78tpc"
Jun 15 07:28:40.128438 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:28:40.128432    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/492649e2-e975-43ad-bc77-84ea0d5bcda0-kserve-provision-location\") pod \"prestop-hook-test-kserve-6758474485-78tpc\" (UID: \"492649e2-e975-43ad-bc77-84ea0d5bcda0\") " pod="kserve-ci-e2e-test/prestop-hook-test-kserve-6758474485-78tpc"
Jun 15 07:28:40.128700 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:28:40.128461    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/492649e2-e975-43ad-bc77-84ea0d5bcda0-dshm\") pod \"prestop-hook-test-kserve-6758474485-78tpc\" (UID: \"492649e2-e975-43ad-bc77-84ea0d5bcda0\") " pod="kserve-ci-e2e-test/prestop-hook-test-kserve-6758474485-78tpc"
Jun 15 07:28:40.128700 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:28:40.128495    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/492649e2-e975-43ad-bc77-84ea0d5bcda0-tmp-dir\") pod \"prestop-hook-test-kserve-6758474485-78tpc\" (UID: \"492649e2-e975-43ad-bc77-84ea0d5bcda0\") " pod="kserve-ci-e2e-test/prestop-hook-test-kserve-6758474485-78tpc"
Jun 15 07:28:40.128700 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:28:40.128554    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/492649e2-e975-43ad-bc77-84ea0d5bcda0-home\") pod \"prestop-hook-test-kserve-6758474485-78tpc\" (UID: \"492649e2-e975-43ad-bc77-84ea0d5bcda0\") " pod="kserve-ci-e2e-test/prestop-hook-test-kserve-6758474485-78tpc"
Jun 15 07:28:40.128837 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:28:40.128691    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zv9qk\" (UniqueName: \"kubernetes.io/projected/492649e2-e975-43ad-bc77-84ea0d5bcda0-kube-api-access-zv9qk\") pod \"prestop-hook-test-kserve-6758474485-78tpc\" (UID: \"492649e2-e975-43ad-bc77-84ea0d5bcda0\") " pod="kserve-ci-e2e-test/prestop-hook-test-kserve-6758474485-78tpc"
Jun 15 07:28:40.128837 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:28:40.128814    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/492649e2-e975-43ad-bc77-84ea0d5bcda0-model-cache\") pod \"prestop-hook-test-kserve-6758474485-78tpc\" (UID: \"492649e2-e975-43ad-bc77-84ea0d5bcda0\") " pod="kserve-ci-e2e-test/prestop-hook-test-kserve-6758474485-78tpc"
Jun 15 07:28:40.129017 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:28:40.128995    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/492649e2-e975-43ad-bc77-84ea0d5bcda0-kserve-provision-location\") pod \"prestop-hook-test-kserve-6758474485-78tpc\" (UID: \"492649e2-e975-43ad-bc77-84ea0d5bcda0\") " pod="kserve-ci-e2e-test/prestop-hook-test-kserve-6758474485-78tpc"
Jun 15 07:28:40.129108 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:28:40.129041    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/492649e2-e975-43ad-bc77-84ea0d5bcda0-home\") pod \"prestop-hook-test-kserve-6758474485-78tpc\" (UID: \"492649e2-e975-43ad-bc77-84ea0d5bcda0\") " pod="kserve-ci-e2e-test/prestop-hook-test-kserve-6758474485-78tpc"
Jun 15 07:28:40.129286 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:28:40.129164    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/492649e2-e975-43ad-bc77-84ea0d5bcda0-tmp-dir\") pod \"prestop-hook-test-kserve-6758474485-78tpc\" (UID: \"492649e2-e975-43ad-bc77-84ea0d5bcda0\") " pod="kserve-ci-e2e-test/prestop-hook-test-kserve-6758474485-78tpc"
Jun 15 07:28:40.130972 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:28:40.130934    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/492649e2-e975-43ad-bc77-84ea0d5bcda0-dshm\") pod \"prestop-hook-test-kserve-6758474485-78tpc\" (UID: \"492649e2-e975-43ad-bc77-84ea0d5bcda0\") " pod="kserve-ci-e2e-test/prestop-hook-test-kserve-6758474485-78tpc"
Jun 15 07:28:40.131184 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:28:40.131163    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/492649e2-e975-43ad-bc77-84ea0d5bcda0-tls-certs\") pod \"prestop-hook-test-kserve-6758474485-78tpc\" (UID: \"492649e2-e975-43ad-bc77-84ea0d5bcda0\") " pod="kserve-ci-e2e-test/prestop-hook-test-kserve-6758474485-78tpc"
Jun 15 07:28:40.142443 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:28:40.142420    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zv9qk\" (UniqueName: \"kubernetes.io/projected/492649e2-e975-43ad-bc77-84ea0d5bcda0-kube-api-access-zv9qk\") pod \"prestop-hook-test-kserve-6758474485-78tpc\" (UID: \"492649e2-e975-43ad-bc77-84ea0d5bcda0\") " pod="kserve-ci-e2e-test/prestop-hook-test-kserve-6758474485-78tpc"
Jun 15 07:28:40.158919 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:28:40.158901    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/prestop-hook-test-kserve-6758474485-78tpc"
Jun 15 07:28:40.303259 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:28:40.303233    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/prestop-hook-test-kserve-6758474485-78tpc"]
Jun 15 07:28:40.304848 ip-10-0-128-243 kubenswrapper[2566]: W0615 07:28:40.304824    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod492649e2_e975_43ad_bc77_84ea0d5bcda0.slice/crio-d8dadda39e2a62b657f35a2a60339198f53b362715d3e8bd9a35bedfc4cbfe8f WatchSource:0}: Error finding container d8dadda39e2a62b657f35a2a60339198f53b362715d3e8bd9a35bedfc4cbfe8f: Status 404 returned error can't find the container with id d8dadda39e2a62b657f35a2a60339198f53b362715d3e8bd9a35bedfc4cbfe8f
Jun 15 07:28:41.018992 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:28:41.018950    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/prestop-hook-test-kserve-6758474485-78tpc" event={"ID":"492649e2-e975-43ad-bc77-84ea0d5bcda0","Type":"ContainerStarted","Data":"f4a272fb656f5c3c78b19023a1c9788cf8de03540787423192b6347b71bb8b86"}
Jun 15 07:28:41.019403 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:28:41.019009    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/prestop-hook-test-kserve-6758474485-78tpc" event={"ID":"492649e2-e975-43ad-bc77-84ea0d5bcda0","Type":"ContainerStarted","Data":"d8dadda39e2a62b657f35a2a60339198f53b362715d3e8bd9a35bedfc4cbfe8f"}
Jun 15 07:28:49.063182 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:28:49.063147    2566 generic.go:356] "Generic (PLEG): container finished" podID="492649e2-e975-43ad-bc77-84ea0d5bcda0" containerID="f4a272fb656f5c3c78b19023a1c9788cf8de03540787423192b6347b71bb8b86" exitCode=0
Jun 15 07:28:49.063602 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:28:49.063222    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/prestop-hook-test-kserve-6758474485-78tpc" event={"ID":"492649e2-e975-43ad-bc77-84ea0d5bcda0","Type":"ContainerDied","Data":"f4a272fb656f5c3c78b19023a1c9788cf8de03540787423192b6347b71bb8b86"}
Jun 15 07:28:50.070854 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:28:50.070822    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/prestop-hook-test-kserve-6758474485-78tpc" event={"ID":"492649e2-e975-43ad-bc77-84ea0d5bcda0","Type":"ContainerStarted","Data":"e356eb224795c987055a46012ecd286e1465718aad5500fa4b8f611cbfcd9ca0"}
Jun 15 07:28:50.127864 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:28:50.127809    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/prestop-hook-test-kserve-6758474485-78tpc" podStartSLOduration=2.567292018 podStartE2EDuration="11.127791106s" totalImagesPullingTime="0s" totalInitContainerRuntime="8.560499088s" isStatefulPod=false podCreationTimestamp="2026-06-15 07:28:39 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 07:28:50.127135199 +0000 UTC m=+6013.086892454" watchObservedRunningTime="2026-06-15 07:28:50.127791106 +0000 UTC m=+6013.087548355"
Jun 15 07:28:50.159905 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:28:50.159869    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/prestop-hook-test-kserve-6758474485-78tpc"
Jun 15 07:28:50.160077 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:28:50.159944    2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kserve-ci-e2e-test/prestop-hook-test-kserve-6758474485-78tpc"
Jun 15 07:28:50.161574 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:28:50.161536    2566 prober.go:120] "Probe failed" probeType="Startup" pod="kserve-ci-e2e-test/prestop-hook-test-kserve-6758474485-78tpc" podUID="492649e2-e975-43ad-bc77-84ea0d5bcda0" containerName="main" probeResult="failure" output="Get \"https://10.132.0.57:8000/health\": dial tcp 10.132.0.57:8000: connect: connection refused"
Jun 15 07:29:00.159681 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:29:00.159589    2566 prober.go:120] "Probe failed" probeType="Startup" pod="kserve-ci-e2e-test/prestop-hook-test-kserve-6758474485-78tpc" podUID="492649e2-e975-43ad-bc77-84ea0d5bcda0" containerName="main" probeResult="failure" output="Get \"https://10.132.0.57:8000/health\": dial tcp 10.132.0.57:8000: connect: connection refused"
Jun 15 07:29:10.159750 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:29:10.159714    2566 prober.go:120] "Probe failed" probeType="Startup" pod="kserve-ci-e2e-test/prestop-hook-test-kserve-6758474485-78tpc" podUID="492649e2-e975-43ad-bc77-84ea0d5bcda0" containerName="main" probeResult="failure" output="Get \"https://10.132.0.57:8000/health\": dial tcp 10.132.0.57:8000: connect: connection refused"
Jun 15 07:29:20.160259 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:29:20.160211    2566 prober.go:120] "Probe failed" probeType="Startup" pod="kserve-ci-e2e-test/prestop-hook-test-kserve-6758474485-78tpc" podUID="492649e2-e975-43ad-bc77-84ea0d5bcda0" containerName="main" probeResult="failure" output="Get \"https://10.132.0.57:8000/health\": dial tcp 10.132.0.57:8000: connect: connection refused"
Jun 15 07:29:30.159841 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:29:30.159776    2566 prober.go:120] "Probe failed" probeType="Startup" pod="kserve-ci-e2e-test/prestop-hook-test-kserve-6758474485-78tpc" podUID="492649e2-e975-43ad-bc77-84ea0d5bcda0" containerName="main" probeResult="failure" output="Get \"https://10.132.0.57:8000/health\": dial tcp 10.132.0.57:8000: connect: connection refused"
Jun 15 07:29:40.159934 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:29:40.159891    2566 prober.go:120] "Probe failed" probeType="Startup" pod="kserve-ci-e2e-test/prestop-hook-test-kserve-6758474485-78tpc" podUID="492649e2-e975-43ad-bc77-84ea0d5bcda0" containerName="main" probeResult="failure" output="Get \"https://10.132.0.57:8000/health\": dial tcp 10.132.0.57:8000: connect: connection refused"
Jun 15 07:29:50.159413 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:29:50.159356    2566 prober.go:120] "Probe failed" probeType="Startup" pod="kserve-ci-e2e-test/prestop-hook-test-kserve-6758474485-78tpc" podUID="492649e2-e975-43ad-bc77-84ea0d5bcda0" containerName="main" probeResult="failure" output="Get \"https://10.132.0.57:8000/health\": dial tcp 10.132.0.57:8000: connect: connection refused"
Jun 15 07:30:00.159402 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:30:00.159358    2566 prober.go:120] "Probe failed" probeType="Startup" pod="kserve-ci-e2e-test/prestop-hook-test-kserve-6758474485-78tpc" podUID="492649e2-e975-43ad-bc77-84ea0d5bcda0" containerName="main" probeResult="failure" output="Get \"https://10.132.0.57:8000/health\": dial tcp 10.132.0.57:8000: connect: connection refused"
Jun 15 07:30:10.160035 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:30:10.159979    2566 prober.go:120] "Probe failed" probeType="Startup" pod="kserve-ci-e2e-test/prestop-hook-test-kserve-6758474485-78tpc" podUID="492649e2-e975-43ad-bc77-84ea0d5bcda0" containerName="main" probeResult="failure" output="Get \"https://10.132.0.57:8000/health\": dial tcp 10.132.0.57:8000: connect: connection refused"
Jun 15 07:30:20.159976 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:30:20.159913    2566 prober.go:120] "Probe failed" probeType="Startup" pod="kserve-ci-e2e-test/prestop-hook-test-kserve-6758474485-78tpc" podUID="492649e2-e975-43ad-bc77-84ea0d5bcda0" containerName="main" probeResult="failure" output="Get \"https://10.132.0.57:8000/health\": dial tcp 10.132.0.57:8000: connect: connection refused"
Jun 15 07:30:30.159780 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:30:30.159680    2566 prober.go:120] "Probe failed" probeType="Startup" pod="kserve-ci-e2e-test/prestop-hook-test-kserve-6758474485-78tpc" podUID="492649e2-e975-43ad-bc77-84ea0d5bcda0" containerName="main" probeResult="failure" output="Get \"https://10.132.0.57:8000/health\": dial tcp 10.132.0.57:8000: connect: connection refused"
Jun 15 07:30:40.169402 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:30:40.169371    2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kserve-ci-e2e-test/prestop-hook-test-kserve-6758474485-78tpc"
Jun 15 07:30:40.177309 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:30:40.177282    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/prestop-hook-test-kserve-6758474485-78tpc"
Jun 15 07:30:44.082814 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:30:44.082783    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/prestop-hook-test-kserve-6758474485-78tpc"]
Jun 15 07:30:44.135981 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:30:44.135943    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/prestop-hook-test-kserve-6758474485-mt9pm"]
Jun 15 07:30:44.138458 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:30:44.138432    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/prestop-hook-test-kserve-6758474485-mt9pm"
Jun 15 07:30:44.159369 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:30:44.159340    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/prestop-hook-test-kserve-6758474485-mt9pm"]
Jun 15 07:30:44.276359 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:30:44.276330    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e4e8d74a-5cbe-4d96-915d-aebb56192e63-home\") pod \"prestop-hook-test-kserve-6758474485-mt9pm\" (UID: \"e4e8d74a-5cbe-4d96-915d-aebb56192e63\") " pod="kserve-ci-e2e-test/prestop-hook-test-kserve-6758474485-mt9pm"
Jun 15 07:30:44.276511 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:30:44.276393    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tpmfv\" (UniqueName: \"kubernetes.io/projected/e4e8d74a-5cbe-4d96-915d-aebb56192e63-kube-api-access-tpmfv\") pod \"prestop-hook-test-kserve-6758474485-mt9pm\" (UID: \"e4e8d74a-5cbe-4d96-915d-aebb56192e63\") " pod="kserve-ci-e2e-test/prestop-hook-test-kserve-6758474485-mt9pm"
Jun 15 07:30:44.276511 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:30:44.276436    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e4e8d74a-5cbe-4d96-915d-aebb56192e63-model-cache\") pod \"prestop-hook-test-kserve-6758474485-mt9pm\" (UID: \"e4e8d74a-5cbe-4d96-915d-aebb56192e63\") " pod="kserve-ci-e2e-test/prestop-hook-test-kserve-6758474485-mt9pm"
Jun 15 07:30:44.276511 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:30:44.276451    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e4e8d74a-5cbe-4d96-915d-aebb56192e63-tls-certs\") pod \"prestop-hook-test-kserve-6758474485-mt9pm\" (UID: \"e4e8d74a-5cbe-4d96-915d-aebb56192e63\") " pod="kserve-ci-e2e-test/prestop-hook-test-kserve-6758474485-mt9pm"
Jun 15 07:30:44.276511 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:30:44.276489    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e4e8d74a-5cbe-4d96-915d-aebb56192e63-dshm\") pod \"prestop-hook-test-kserve-6758474485-mt9pm\" (UID: \"e4e8d74a-5cbe-4d96-915d-aebb56192e63\") " pod="kserve-ci-e2e-test/prestop-hook-test-kserve-6758474485-mt9pm"
Jun 15 07:30:44.276511 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:30:44.276505    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e4e8d74a-5cbe-4d96-915d-aebb56192e63-tmp-dir\") pod \"prestop-hook-test-kserve-6758474485-mt9pm\" (UID: \"e4e8d74a-5cbe-4d96-915d-aebb56192e63\") " pod="kserve-ci-e2e-test/prestop-hook-test-kserve-6758474485-mt9pm"
Jun 15 07:30:44.276693 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:30:44.276520    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/e4e8d74a-5cbe-4d96-915d-aebb56192e63-kserve-provision-location\") pod \"prestop-hook-test-kserve-6758474485-mt9pm\" (UID: \"e4e8d74a-5cbe-4d96-915d-aebb56192e63\") " pod="kserve-ci-e2e-test/prestop-hook-test-kserve-6758474485-mt9pm"
Jun 15 07:30:44.376887 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:30:44.376820    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e4e8d74a-5cbe-4d96-915d-aebb56192e63-home\") pod \"prestop-hook-test-kserve-6758474485-mt9pm\" (UID: \"e4e8d74a-5cbe-4d96-915d-aebb56192e63\") " pod="kserve-ci-e2e-test/prestop-hook-test-kserve-6758474485-mt9pm"
Jun 15 07:30:44.376887 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:30:44.376870    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tpmfv\" (UniqueName: \"kubernetes.io/projected/e4e8d74a-5cbe-4d96-915d-aebb56192e63-kube-api-access-tpmfv\") pod \"prestop-hook-test-kserve-6758474485-mt9pm\" (UID: \"e4e8d74a-5cbe-4d96-915d-aebb56192e63\") " pod="kserve-ci-e2e-test/prestop-hook-test-kserve-6758474485-mt9pm"
Jun 15 07:30:44.377062 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:30:44.376890    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e4e8d74a-5cbe-4d96-915d-aebb56192e63-model-cache\") pod \"prestop-hook-test-kserve-6758474485-mt9pm\" (UID: \"e4e8d74a-5cbe-4d96-915d-aebb56192e63\") " pod="kserve-ci-e2e-test/prestop-hook-test-kserve-6758474485-mt9pm"
Jun 15 07:30:44.377062 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:30:44.376908    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e4e8d74a-5cbe-4d96-915d-aebb56192e63-tls-certs\") pod \"prestop-hook-test-kserve-6758474485-mt9pm\" (UID: \"e4e8d74a-5cbe-4d96-915d-aebb56192e63\") " pod="kserve-ci-e2e-test/prestop-hook-test-kserve-6758474485-mt9pm"
Jun 15 07:30:44.377062 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:30:44.376946    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e4e8d74a-5cbe-4d96-915d-aebb56192e63-dshm\") pod \"prestop-hook-test-kserve-6758474485-mt9pm\" (UID: \"e4e8d74a-5cbe-4d96-915d-aebb56192e63\") " pod="kserve-ci-e2e-test/prestop-hook-test-kserve-6758474485-mt9pm"
Jun 15 07:30:44.377062 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:30:44.376971    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e4e8d74a-5cbe-4d96-915d-aebb56192e63-tmp-dir\") pod \"prestop-hook-test-kserve-6758474485-mt9pm\" (UID: \"e4e8d74a-5cbe-4d96-915d-aebb56192e63\") " pod="kserve-ci-e2e-test/prestop-hook-test-kserve-6758474485-mt9pm"
Jun 15 07:30:44.377062 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:30:44.376990    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/e4e8d74a-5cbe-4d96-915d-aebb56192e63-kserve-provision-location\") pod \"prestop-hook-test-kserve-6758474485-mt9pm\" (UID: \"e4e8d74a-5cbe-4d96-915d-aebb56192e63\") " pod="kserve-ci-e2e-test/prestop-hook-test-kserve-6758474485-mt9pm"
Jun 15 07:30:44.377357 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:30:44.377292    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e4e8d74a-5cbe-4d96-915d-aebb56192e63-home\") pod \"prestop-hook-test-kserve-6758474485-mt9pm\" (UID: \"e4e8d74a-5cbe-4d96-915d-aebb56192e63\") " pod="kserve-ci-e2e-test/prestop-hook-test-kserve-6758474485-mt9pm"
Jun 15 07:30:44.377357 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:30:44.377340    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e4e8d74a-5cbe-4d96-915d-aebb56192e63-model-cache\") pod \"prestop-hook-test-kserve-6758474485-mt9pm\" (UID: \"e4e8d74a-5cbe-4d96-915d-aebb56192e63\") " pod="kserve-ci-e2e-test/prestop-hook-test-kserve-6758474485-mt9pm"
Jun 15 07:30:44.377468 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:30:44.377364    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e4e8d74a-5cbe-4d96-915d-aebb56192e63-tmp-dir\") pod \"prestop-hook-test-kserve-6758474485-mt9pm\" (UID: \"e4e8d74a-5cbe-4d96-915d-aebb56192e63\") " pod="kserve-ci-e2e-test/prestop-hook-test-kserve-6758474485-mt9pm"
Jun 15 07:30:44.377468 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:30:44.377424    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/e4e8d74a-5cbe-4d96-915d-aebb56192e63-kserve-provision-location\") pod \"prestop-hook-test-kserve-6758474485-mt9pm\" (UID: \"e4e8d74a-5cbe-4d96-915d-aebb56192e63\") " pod="kserve-ci-e2e-test/prestop-hook-test-kserve-6758474485-mt9pm"
Jun 15 07:30:44.379328 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:30:44.379308    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e4e8d74a-5cbe-4d96-915d-aebb56192e63-dshm\") pod \"prestop-hook-test-kserve-6758474485-mt9pm\" (UID: \"e4e8d74a-5cbe-4d96-915d-aebb56192e63\") " pod="kserve-ci-e2e-test/prestop-hook-test-kserve-6758474485-mt9pm"
Jun 15 07:30:44.379587 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:30:44.379568    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e4e8d74a-5cbe-4d96-915d-aebb56192e63-tls-certs\") pod \"prestop-hook-test-kserve-6758474485-mt9pm\" (UID: \"e4e8d74a-5cbe-4d96-915d-aebb56192e63\") " pod="kserve-ci-e2e-test/prestop-hook-test-kserve-6758474485-mt9pm"
Jun 15 07:30:44.388400 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:30:44.388379    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tpmfv\" (UniqueName: \"kubernetes.io/projected/e4e8d74a-5cbe-4d96-915d-aebb56192e63-kube-api-access-tpmfv\") pod \"prestop-hook-test-kserve-6758474485-mt9pm\" (UID: \"e4e8d74a-5cbe-4d96-915d-aebb56192e63\") " pod="kserve-ci-e2e-test/prestop-hook-test-kserve-6758474485-mt9pm"
Jun 15 07:30:44.455200 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:30:44.455175    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/prestop-hook-test-kserve-6758474485-mt9pm"
Jun 15 07:30:44.610147 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:30:44.610125    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/prestop-hook-test-kserve-6758474485-mt9pm"]
Jun 15 07:30:44.611872 ip-10-0-128-243 kubenswrapper[2566]: W0615 07:30:44.611843    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode4e8d74a_5cbe_4d96_915d_aebb56192e63.slice/crio-75e49d359a464bb30238accd2fc7359eab8c9501ec1ee99f5016bb6f661a10c5 WatchSource:0}: Error finding container 75e49d359a464bb30238accd2fc7359eab8c9501ec1ee99f5016bb6f661a10c5: Status 404 returned error can't find the container with id 75e49d359a464bb30238accd2fc7359eab8c9501ec1ee99f5016bb6f661a10c5
Jun 15 07:30:44.711899 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:30:44.711862    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/prestop-hook-test-kserve-6758474485-mt9pm" event={"ID":"e4e8d74a-5cbe-4d96-915d-aebb56192e63","Type":"ContainerStarted","Data":"1a87f0537e1a9bb1850679282b7e9c9ce6e113e4e569f9433acd776d5d982be5"}
Jun 15 07:30:44.712075 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:30:44.711922    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/prestop-hook-test-kserve-6758474485-mt9pm" event={"ID":"e4e8d74a-5cbe-4d96-915d-aebb56192e63","Type":"ContainerStarted","Data":"75e49d359a464bb30238accd2fc7359eab8c9501ec1ee99f5016bb6f661a10c5"}
Jun 15 07:30:48.739017 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:30:48.738986    2566 generic.go:356] "Generic (PLEG): container finished" podID="e4e8d74a-5cbe-4d96-915d-aebb56192e63" containerID="1a87f0537e1a9bb1850679282b7e9c9ce6e113e4e569f9433acd776d5d982be5" exitCode=0
Jun 15 07:30:48.739467 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:30:48.739076    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/prestop-hook-test-kserve-6758474485-mt9pm" event={"ID":"e4e8d74a-5cbe-4d96-915d-aebb56192e63","Type":"ContainerDied","Data":"1a87f0537e1a9bb1850679282b7e9c9ce6e113e4e569f9433acd776d5d982be5"}
Jun 15 07:30:49.746936 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:30:49.746894    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/prestop-hook-test-kserve-6758474485-mt9pm" event={"ID":"e4e8d74a-5cbe-4d96-915d-aebb56192e63","Type":"ContainerStarted","Data":"edddc6fb0fd0205cc3187336a8aff9c4953fcc379a676776287995d4710d5161"}
Jun 15 07:30:54.455395 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:30:54.455360    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/prestop-hook-test-kserve-6758474485-mt9pm"
Jun 15 07:30:54.455916 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:30:54.455418    2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kserve-ci-e2e-test/prestop-hook-test-kserve-6758474485-mt9pm"
Jun 15 07:30:54.457286 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:30:54.457259    2566 prober.go:120] "Probe failed" probeType="Startup" pod="kserve-ci-e2e-test/prestop-hook-test-kserve-6758474485-mt9pm" podUID="e4e8d74a-5cbe-4d96-915d-aebb56192e63" containerName="main" probeResult="failure" output="Get \"https://10.132.0.58:8000/health\": dial tcp 10.132.0.58:8000: connect: connection refused"
Jun 15 07:30:59.106619 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:30:59.106574    2566 kuberuntime_container.go:872] "Killing container with a grace period" pod="kserve-ci-e2e-test/prestop-hook-test-kserve-6758474485-78tpc" podUID="492649e2-e975-43ad-bc77-84ea0d5bcda0" containerName="main" containerID="cri-o://e356eb224795c987055a46012ecd286e1465718aad5500fa4b8f611cbfcd9ca0" gracePeriod=45
Jun 15 07:30:59.807822 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:30:59.807786    2566 generic.go:356] "Generic (PLEG): container finished" podID="492649e2-e975-43ad-bc77-84ea0d5bcda0" containerID="e356eb224795c987055a46012ecd286e1465718aad5500fa4b8f611cbfcd9ca0" exitCode=0
Jun 15 07:30:59.807967 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:30:59.807859    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/prestop-hook-test-kserve-6758474485-78tpc" event={"ID":"492649e2-e975-43ad-bc77-84ea0d5bcda0","Type":"ContainerDied","Data":"e356eb224795c987055a46012ecd286e1465718aad5500fa4b8f611cbfcd9ca0"}
Jun 15 07:30:59.807967 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:30:59.807921    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/prestop-hook-test-kserve-6758474485-78tpc" event={"ID":"492649e2-e975-43ad-bc77-84ea0d5bcda0","Type":"ContainerDied","Data":"d8dadda39e2a62b657f35a2a60339198f53b362715d3e8bd9a35bedfc4cbfe8f"}
Jun 15 07:30:59.807967 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:30:59.807942    2566 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="d8dadda39e2a62b657f35a2a60339198f53b362715d3e8bd9a35bedfc4cbfe8f"
Jun 15 07:30:59.835274 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:30:59.835251    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/prestop-hook-test-kserve-6758474485-78tpc"
Jun 15 07:30:59.860377 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:30:59.860288    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/prestop-hook-test-kserve-6758474485-mt9pm" podStartSLOduration=11.920915836 podStartE2EDuration="15.860268984s" totalImagesPullingTime="0s" totalInitContainerRuntime="3.939353148s" isStatefulPod=false podCreationTimestamp="2026-06-15 07:30:44 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 07:30:49.779818893 +0000 UTC m=+6132.739576138" watchObservedRunningTime="2026-06-15 07:30:59.860268984 +0000 UTC m=+6142.820026293"
Jun 15 07:30:59.921152 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:30:59.921117    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/492649e2-e975-43ad-bc77-84ea0d5bcda0-kserve-provision-location\") pod \"492649e2-e975-43ad-bc77-84ea0d5bcda0\" (UID: \"492649e2-e975-43ad-bc77-84ea0d5bcda0\") "
Jun 15 07:30:59.921335 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:30:59.921166    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/492649e2-e975-43ad-bc77-84ea0d5bcda0-dshm\") pod \"492649e2-e975-43ad-bc77-84ea0d5bcda0\" (UID: \"492649e2-e975-43ad-bc77-84ea0d5bcda0\") "
Jun 15 07:30:59.921335 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:30:59.921201    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/492649e2-e975-43ad-bc77-84ea0d5bcda0-tls-certs\") pod \"492649e2-e975-43ad-bc77-84ea0d5bcda0\" (UID: \"492649e2-e975-43ad-bc77-84ea0d5bcda0\") "
Jun 15 07:30:59.921335 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:30:59.921236    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/492649e2-e975-43ad-bc77-84ea0d5bcda0-home\") pod \"492649e2-e975-43ad-bc77-84ea0d5bcda0\" (UID: \"492649e2-e975-43ad-bc77-84ea0d5bcda0\") "
Jun 15 07:30:59.921335 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:30:59.921258    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/492649e2-e975-43ad-bc77-84ea0d5bcda0-model-cache\") pod \"492649e2-e975-43ad-bc77-84ea0d5bcda0\" (UID: \"492649e2-e975-43ad-bc77-84ea0d5bcda0\") "
Jun 15 07:30:59.921335 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:30:59.921295    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zv9qk\" (UniqueName: \"kubernetes.io/projected/492649e2-e975-43ad-bc77-84ea0d5bcda0-kube-api-access-zv9qk\") pod \"492649e2-e975-43ad-bc77-84ea0d5bcda0\" (UID: \"492649e2-e975-43ad-bc77-84ea0d5bcda0\") "
Jun 15 07:30:59.921335 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:30:59.921315    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/492649e2-e975-43ad-bc77-84ea0d5bcda0-tmp-dir\") pod \"492649e2-e975-43ad-bc77-84ea0d5bcda0\" (UID: \"492649e2-e975-43ad-bc77-84ea0d5bcda0\") "
Jun 15 07:30:59.921664 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:30:59.921558    2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/492649e2-e975-43ad-bc77-84ea0d5bcda0-model-cache" (OuterVolumeSpecName: "model-cache") pod "492649e2-e975-43ad-bc77-84ea0d5bcda0" (UID: "492649e2-e975-43ad-bc77-84ea0d5bcda0"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jun 15 07:30:59.922181 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:30:59.922143    2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/492649e2-e975-43ad-bc77-84ea0d5bcda0-home" (OuterVolumeSpecName: "home") pod "492649e2-e975-43ad-bc77-84ea0d5bcda0" (UID: "492649e2-e975-43ad-bc77-84ea0d5bcda0"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jun 15 07:30:59.923614 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:30:59.923583    2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/492649e2-e975-43ad-bc77-84ea0d5bcda0-dshm" (OuterVolumeSpecName: "dshm") pod "492649e2-e975-43ad-bc77-84ea0d5bcda0" (UID: "492649e2-e975-43ad-bc77-84ea0d5bcda0"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jun 15 07:30:59.923939 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:30:59.923912    2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/492649e2-e975-43ad-bc77-84ea0d5bcda0-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "492649e2-e975-43ad-bc77-84ea0d5bcda0" (UID: "492649e2-e975-43ad-bc77-84ea0d5bcda0"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jun 15 07:30:59.924483 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:30:59.924425    2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/492649e2-e975-43ad-bc77-84ea0d5bcda0-kube-api-access-zv9qk" (OuterVolumeSpecName: "kube-api-access-zv9qk") pod "492649e2-e975-43ad-bc77-84ea0d5bcda0" (UID: "492649e2-e975-43ad-bc77-84ea0d5bcda0"). InnerVolumeSpecName "kube-api-access-zv9qk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jun 15 07:30:59.934141 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:30:59.934116    2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/492649e2-e975-43ad-bc77-84ea0d5bcda0-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "492649e2-e975-43ad-bc77-84ea0d5bcda0" (UID: "492649e2-e975-43ad-bc77-84ea0d5bcda0"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jun 15 07:30:59.986205 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:30:59.986171    2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/492649e2-e975-43ad-bc77-84ea0d5bcda0-kserve-provision-location" (OuterVolumeSpecName: "kserve-provision-location") pod "492649e2-e975-43ad-bc77-84ea0d5bcda0" (UID: "492649e2-e975-43ad-bc77-84ea0d5bcda0"). InnerVolumeSpecName "kserve-provision-location". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jun 15 07:31:00.022227 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:31:00.022199    2566 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/492649e2-e975-43ad-bc77-84ea0d5bcda0-home\") on node \"ip-10-0-128-243.ec2.internal\" DevicePath \"\""
Jun 15 07:31:00.022227 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:31:00.022223    2566 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/492649e2-e975-43ad-bc77-84ea0d5bcda0-model-cache\") on node \"ip-10-0-128-243.ec2.internal\" DevicePath \"\""
Jun 15 07:31:00.022374 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:31:00.022234    2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zv9qk\" (UniqueName: \"kubernetes.io/projected/492649e2-e975-43ad-bc77-84ea0d5bcda0-kube-api-access-zv9qk\") on node \"ip-10-0-128-243.ec2.internal\" DevicePath \"\""
Jun 15 07:31:00.022374 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:31:00.022242    2566 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/492649e2-e975-43ad-bc77-84ea0d5bcda0-tmp-dir\") on node \"ip-10-0-128-243.ec2.internal\" DevicePath \"\""
Jun 15 07:31:00.022374 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:31:00.022250    2566 reconciler_common.go:299] "Volume detached for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/492649e2-e975-43ad-bc77-84ea0d5bcda0-kserve-provision-location\") on node \"ip-10-0-128-243.ec2.internal\" DevicePath \"\""
Jun 15 07:31:00.022374 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:31:00.022257    2566 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/492649e2-e975-43ad-bc77-84ea0d5bcda0-dshm\") on node \"ip-10-0-128-243.ec2.internal\" DevicePath \"\""
Jun 15 07:31:00.022374 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:31:00.022265    2566 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/492649e2-e975-43ad-bc77-84ea0d5bcda0-tls-certs\") on node \"ip-10-0-128-243.ec2.internal\" DevicePath \"\""
Jun 15 07:31:00.812936 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:31:00.812894    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/prestop-hook-test-kserve-6758474485-78tpc"
Jun 15 07:31:00.845576 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:31:00.845539    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/prestop-hook-test-kserve-6758474485-78tpc"]
Jun 15 07:31:00.847850 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:31:00.847828    2566 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/prestop-hook-test-kserve-6758474485-78tpc"]
Jun 15 07:31:01.448854 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:31:01.448820    2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="492649e2-e975-43ad-bc77-84ea0d5bcda0" path="/var/lib/kubelet/pods/492649e2-e975-43ad-bc77-84ea0d5bcda0/volumes"
Jun 15 07:31:02.967739 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:31:02.967700    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/prestop-hook-test-kserve-6758474485-mt9pm"]
Jun 15 07:31:17.992050 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:31:17.991986    2566 kuberuntime_container.go:872] "Killing container with a grace period" pod="kserve-ci-e2e-test/prestop-hook-test-kserve-6758474485-mt9pm" podUID="e4e8d74a-5cbe-4d96-915d-aebb56192e63" containerName="main" containerID="cri-o://edddc6fb0fd0205cc3187336a8aff9c4953fcc379a676776287995d4710d5161" gracePeriod=45
Jun 15 07:32:03.167299 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:32:03.167274    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_prestop-hook-test-kserve-6758474485-mt9pm_e4e8d74a-5cbe-4d96-915d-aebb56192e63/main/0.log"
Jun 15 07:32:03.167751 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:32:03.167648    2566 generic.go:356] "Generic (PLEG): container finished" podID="e4e8d74a-5cbe-4d96-915d-aebb56192e63" containerID="edddc6fb0fd0205cc3187336a8aff9c4953fcc379a676776287995d4710d5161" exitCode=137
Jun 15 07:32:03.167751 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:32:03.167720    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/prestop-hook-test-kserve-6758474485-mt9pm" event={"ID":"e4e8d74a-5cbe-4d96-915d-aebb56192e63","Type":"ContainerDied","Data":"edddc6fb0fd0205cc3187336a8aff9c4953fcc379a676776287995d4710d5161"}
Jun 15 07:32:03.639921 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:32:03.639900    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_prestop-hook-test-kserve-6758474485-mt9pm_e4e8d74a-5cbe-4d96-915d-aebb56192e63/main/0.log"
Jun 15 07:32:03.641296 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:32:03.641278    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/prestop-hook-test-kserve-6758474485-mt9pm"
Jun 15 07:32:03.678706 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:32:03.678682    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e4e8d74a-5cbe-4d96-915d-aebb56192e63-model-cache\") pod \"e4e8d74a-5cbe-4d96-915d-aebb56192e63\" (UID: \"e4e8d74a-5cbe-4d96-915d-aebb56192e63\") "
Jun 15 07:32:03.678850 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:32:03.678725    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tpmfv\" (UniqueName: \"kubernetes.io/projected/e4e8d74a-5cbe-4d96-915d-aebb56192e63-kube-api-access-tpmfv\") pod \"e4e8d74a-5cbe-4d96-915d-aebb56192e63\" (UID: \"e4e8d74a-5cbe-4d96-915d-aebb56192e63\") "
Jun 15 07:32:03.678850 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:32:03.678767    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/e4e8d74a-5cbe-4d96-915d-aebb56192e63-kserve-provision-location\") pod \"e4e8d74a-5cbe-4d96-915d-aebb56192e63\" (UID: \"e4e8d74a-5cbe-4d96-915d-aebb56192e63\") "
Jun 15 07:32:03.678850 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:32:03.678815    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e4e8d74a-5cbe-4d96-915d-aebb56192e63-tls-certs\") pod \"e4e8d74a-5cbe-4d96-915d-aebb56192e63\" (UID: \"e4e8d74a-5cbe-4d96-915d-aebb56192e63\") "
Jun 15 07:32:03.679020 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:32:03.678876    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e4e8d74a-5cbe-4d96-915d-aebb56192e63-home\") pod \"e4e8d74a-5cbe-4d96-915d-aebb56192e63\" (UID: \"e4e8d74a-5cbe-4d96-915d-aebb56192e63\") "
Jun 15 07:32:03.679020 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:32:03.678910    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e4e8d74a-5cbe-4d96-915d-aebb56192e63-dshm\") pod \"e4e8d74a-5cbe-4d96-915d-aebb56192e63\" (UID: \"e4e8d74a-5cbe-4d96-915d-aebb56192e63\") "
Jun 15 07:32:03.679020 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:32:03.678932    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e4e8d74a-5cbe-4d96-915d-aebb56192e63-tmp-dir\") pod \"e4e8d74a-5cbe-4d96-915d-aebb56192e63\" (UID: \"e4e8d74a-5cbe-4d96-915d-aebb56192e63\") "
Jun 15 07:32:03.679020 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:32:03.678955    2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e4e8d74a-5cbe-4d96-915d-aebb56192e63-model-cache" (OuterVolumeSpecName: "model-cache") pod "e4e8d74a-5cbe-4d96-915d-aebb56192e63" (UID: "e4e8d74a-5cbe-4d96-915d-aebb56192e63"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jun 15 07:32:03.679278 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:32:03.679225    2566 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e4e8d74a-5cbe-4d96-915d-aebb56192e63-model-cache\") on node \"ip-10-0-128-243.ec2.internal\" DevicePath \"\""
Jun 15 07:32:03.679348 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:32:03.679294    2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e4e8d74a-5cbe-4d96-915d-aebb56192e63-home" (OuterVolumeSpecName: "home") pod "e4e8d74a-5cbe-4d96-915d-aebb56192e63" (UID: "e4e8d74a-5cbe-4d96-915d-aebb56192e63"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jun 15 07:32:03.679744 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:32:03.679679    2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e4e8d74a-5cbe-4d96-915d-aebb56192e63-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "e4e8d74a-5cbe-4d96-915d-aebb56192e63" (UID: "e4e8d74a-5cbe-4d96-915d-aebb56192e63"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jun 15 07:32:03.681191 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:32:03.681170    2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e4e8d74a-5cbe-4d96-915d-aebb56192e63-dshm" (OuterVolumeSpecName: "dshm") pod "e4e8d74a-5cbe-4d96-915d-aebb56192e63" (UID: "e4e8d74a-5cbe-4d96-915d-aebb56192e63"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jun 15 07:32:03.681278 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:32:03.681255    2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e4e8d74a-5cbe-4d96-915d-aebb56192e63-kube-api-access-tpmfv" (OuterVolumeSpecName: "kube-api-access-tpmfv") pod "e4e8d74a-5cbe-4d96-915d-aebb56192e63" (UID: "e4e8d74a-5cbe-4d96-915d-aebb56192e63"). InnerVolumeSpecName "kube-api-access-tpmfv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jun 15 07:32:03.681461 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:32:03.681441    2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e4e8d74a-5cbe-4d96-915d-aebb56192e63-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "e4e8d74a-5cbe-4d96-915d-aebb56192e63" (UID: "e4e8d74a-5cbe-4d96-915d-aebb56192e63"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jun 15 07:32:03.733923 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:32:03.733891    2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e4e8d74a-5cbe-4d96-915d-aebb56192e63-kserve-provision-location" (OuterVolumeSpecName: "kserve-provision-location") pod "e4e8d74a-5cbe-4d96-915d-aebb56192e63" (UID: "e4e8d74a-5cbe-4d96-915d-aebb56192e63"). InnerVolumeSpecName "kserve-provision-location". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jun 15 07:32:03.780409 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:32:03.780343    2566 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e4e8d74a-5cbe-4d96-915d-aebb56192e63-home\") on node \"ip-10-0-128-243.ec2.internal\" DevicePath \"\""
Jun 15 07:32:03.780409 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:32:03.780364    2566 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e4e8d74a-5cbe-4d96-915d-aebb56192e63-dshm\") on node \"ip-10-0-128-243.ec2.internal\" DevicePath \"\""
Jun 15 07:32:03.780409 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:32:03.780372    2566 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e4e8d74a-5cbe-4d96-915d-aebb56192e63-tmp-dir\") on node \"ip-10-0-128-243.ec2.internal\" DevicePath \"\""
Jun 15 07:32:03.780409 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:32:03.780382    2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tpmfv\" (UniqueName: \"kubernetes.io/projected/e4e8d74a-5cbe-4d96-915d-aebb56192e63-kube-api-access-tpmfv\") on node \"ip-10-0-128-243.ec2.internal\" DevicePath \"\""
Jun 15 07:32:03.780409 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:32:03.780390    2566 reconciler_common.go:299] "Volume detached for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/e4e8d74a-5cbe-4d96-915d-aebb56192e63-kserve-provision-location\") on node \"ip-10-0-128-243.ec2.internal\" DevicePath \"\""
Jun 15 07:32:03.780409 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:32:03.780399    2566 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e4e8d74a-5cbe-4d96-915d-aebb56192e63-tls-certs\") on node \"ip-10-0-128-243.ec2.internal\" DevicePath \"\""
Jun 15 07:32:04.175137 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:32:04.175016    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_prestop-hook-test-kserve-6758474485-mt9pm_e4e8d74a-5cbe-4d96-915d-aebb56192e63/main/0.log"
Jun 15 07:32:04.175538 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:32:04.175420    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/prestop-hook-test-kserve-6758474485-mt9pm" event={"ID":"e4e8d74a-5cbe-4d96-915d-aebb56192e63","Type":"ContainerDied","Data":"75e49d359a464bb30238accd2fc7359eab8c9501ec1ee99f5016bb6f661a10c5"}
Jun 15 07:32:04.175538 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:32:04.175455    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/prestop-hook-test-kserve-6758474485-mt9pm"
Jun 15 07:32:04.175538 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:32:04.175490    2566 scope.go:117] "RemoveContainer" containerID="edddc6fb0fd0205cc3187336a8aff9c4953fcc379a676776287995d4710d5161"
Jun 15 07:32:04.188478 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:32:04.188445    2566 scope.go:117] "RemoveContainer" containerID="1a87f0537e1a9bb1850679282b7e9c9ce6e113e4e569f9433acd776d5d982be5"
Jun 15 07:32:04.203874 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:32:04.203845    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/prestop-hook-test-kserve-6758474485-mt9pm"]
Jun 15 07:32:04.207004 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:32:04.206982    2566 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/prestop-hook-test-kserve-6758474485-mt9pm"]
Jun 15 07:32:05.441420 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:32:05.441388    2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e4e8d74a-5cbe-4d96-915d-aebb56192e63" path="/var/lib/kubelet/pods/e4e8d74a-5cbe-4d96-915d-aebb56192e63/volumes"
Jun 15 07:32:11.189598 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:32:11.189561    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve/llmisvc-controller-manager-795c469f5-x2dlk"]
Jun 15 07:32:11.190065 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:32:11.189881    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e4e8d74a-5cbe-4d96-915d-aebb56192e63" containerName="main"
Jun 15 07:32:11.190065 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:32:11.189892    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="e4e8d74a-5cbe-4d96-915d-aebb56192e63" containerName="main"
Jun 15 07:32:11.190065 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:32:11.189910    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="492649e2-e975-43ad-bc77-84ea0d5bcda0" containerName="storage-initializer"
Jun 15 07:32:11.190065 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:32:11.189916    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="492649e2-e975-43ad-bc77-84ea0d5bcda0" containerName="storage-initializer"
Jun 15 07:32:11.190065 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:32:11.189928    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="492649e2-e975-43ad-bc77-84ea0d5bcda0" containerName="main"
Jun 15 07:32:11.190065 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:32:11.189933    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="492649e2-e975-43ad-bc77-84ea0d5bcda0" containerName="main"
Jun 15 07:32:11.190065 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:32:11.189944    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e4e8d74a-5cbe-4d96-915d-aebb56192e63" containerName="storage-initializer"
Jun 15 07:32:11.190065 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:32:11.189949    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="e4e8d74a-5cbe-4d96-915d-aebb56192e63" containerName="storage-initializer"
Jun 15 07:32:11.190065 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:32:11.190005    2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="e4e8d74a-5cbe-4d96-915d-aebb56192e63" containerName="main"
Jun 15 07:32:11.190065 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:32:11.190014    2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="492649e2-e975-43ad-bc77-84ea0d5bcda0" containerName="main"
Jun 15 07:32:11.192929 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:32:11.192911    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/llmisvc-controller-manager-795c469f5-x2dlk"
Jun 15 07:32:11.196349 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:32:11.196327    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"llmisvc-controller-manager-dockercfg-dg796\""
Jun 15 07:32:11.196487 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:32:11.196331    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"llmisvc-webhook-server-cert\""
Jun 15 07:32:11.202907 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:32:11.202884    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/llmisvc-controller-manager-795c469f5-x2dlk"]
Jun 15 07:32:11.247878 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:32:11.247848    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pcmhx\" (UniqueName: \"kubernetes.io/projected/9a72041b-90bb-4524-a293-dc0d3dbd87e2-kube-api-access-pcmhx\") pod \"llmisvc-controller-manager-795c469f5-x2dlk\" (UID: \"9a72041b-90bb-4524-a293-dc0d3dbd87e2\") " pod="kserve/llmisvc-controller-manager-795c469f5-x2dlk"
Jun 15 07:32:11.247995 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:32:11.247908    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/9a72041b-90bb-4524-a293-dc0d3dbd87e2-cert\") pod \"llmisvc-controller-manager-795c469f5-x2dlk\" (UID: \"9a72041b-90bb-4524-a293-dc0d3dbd87e2\") " pod="kserve/llmisvc-controller-manager-795c469f5-x2dlk"
Jun 15 07:32:11.348350 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:32:11.348322    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/9a72041b-90bb-4524-a293-dc0d3dbd87e2-cert\") pod \"llmisvc-controller-manager-795c469f5-x2dlk\" (UID: \"9a72041b-90bb-4524-a293-dc0d3dbd87e2\") " pod="kserve/llmisvc-controller-manager-795c469f5-x2dlk"
Jun 15 07:32:11.348471 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:32:11.348382    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pcmhx\" (UniqueName: \"kubernetes.io/projected/9a72041b-90bb-4524-a293-dc0d3dbd87e2-kube-api-access-pcmhx\") pod \"llmisvc-controller-manager-795c469f5-x2dlk\" (UID: \"9a72041b-90bb-4524-a293-dc0d3dbd87e2\") " pod="kserve/llmisvc-controller-manager-795c469f5-x2dlk"
Jun 15 07:32:11.350771 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:32:11.350747    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/9a72041b-90bb-4524-a293-dc0d3dbd87e2-cert\") pod \"llmisvc-controller-manager-795c469f5-x2dlk\" (UID: \"9a72041b-90bb-4524-a293-dc0d3dbd87e2\") " pod="kserve/llmisvc-controller-manager-795c469f5-x2dlk"
Jun 15 07:32:11.358104 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:32:11.358052    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pcmhx\" (UniqueName: \"kubernetes.io/projected/9a72041b-90bb-4524-a293-dc0d3dbd87e2-kube-api-access-pcmhx\") pod \"llmisvc-controller-manager-795c469f5-x2dlk\" (UID: \"9a72041b-90bb-4524-a293-dc0d3dbd87e2\") " pod="kserve/llmisvc-controller-manager-795c469f5-x2dlk"
Jun 15 07:32:11.503397 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:32:11.503317    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/llmisvc-controller-manager-795c469f5-x2dlk"
Jun 15 07:32:11.637045 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:32:11.637019    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/llmisvc-controller-manager-795c469f5-x2dlk"]
Jun 15 07:32:11.639354 ip-10-0-128-243 kubenswrapper[2566]: W0615 07:32:11.639318    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod9a72041b_90bb_4524_a293_dc0d3dbd87e2.slice/crio-c5c8ee5d7048383e33bbde04c7011370681ab6363cdad8886257e413f4e9228b WatchSource:0}: Error finding container c5c8ee5d7048383e33bbde04c7011370681ab6363cdad8886257e413f4e9228b: Status 404 returned error can't find the container with id c5c8ee5d7048383e33bbde04c7011370681ab6363cdad8886257e413f4e9228b
Jun 15 07:32:11.640707 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:32:11.640690    2566 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jun 15 07:32:12.220380 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:32:12.220350    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/llmisvc-controller-manager-795c469f5-x2dlk" event={"ID":"9a72041b-90bb-4524-a293-dc0d3dbd87e2","Type":"ContainerStarted","Data":"c5c8ee5d7048383e33bbde04c7011370681ab6363cdad8886257e413f4e9228b"}
Jun 15 07:32:15.238472 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:32:15.238442    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/llmisvc-controller-manager-795c469f5-x2dlk" event={"ID":"9a72041b-90bb-4524-a293-dc0d3dbd87e2","Type":"ContainerStarted","Data":"7ac9ec2e659e96c71d9ee2d4e3be032922173f97d1a4950874986a838c35765e"}
Jun 15 07:32:15.238848 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:32:15.238554    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve/llmisvc-controller-manager-795c469f5-x2dlk"
Jun 15 07:32:15.256997 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:32:15.256953    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve/llmisvc-controller-manager-795c469f5-x2dlk" podStartSLOduration=0.82490445 podStartE2EDuration="4.256940149s" totalImagesPullingTime="3.432035699s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-15 07:32:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 07:32:15.254944707 +0000 UTC m=+6218.214701973" watchObservedRunningTime="2026-06-15 07:32:15.256940149 +0000 UTC m=+6218.216697395"
Jun 15 07:32:46.246592 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:32:46.246557    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve/llmisvc-controller-manager-795c469f5-x2dlk"
Jun 15 07:33:37.880415 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:33:37.880380    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-5jmhk/must-gather-xnhfm"]
Jun 15 07:33:37.883672 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:33:37.883655    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-5jmhk/must-gather-xnhfm"
Jun 15 07:33:37.886431 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:33:37.886407    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-5jmhk\"/\"openshift-service-ca.crt\""
Jun 15 07:33:37.886554 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:33:37.886472    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-5jmhk\"/\"kube-root-ca.crt\""
Jun 15 07:33:37.896516 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:33:37.896488    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-5jmhk/must-gather-xnhfm"]
Jun 15 07:33:37.976318 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:33:37.976285    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2kqvv\" (UniqueName: \"kubernetes.io/projected/775af8d8-dabf-423c-a8c8-73b3b187a2f0-kube-api-access-2kqvv\") pod \"must-gather-xnhfm\" (UID: \"775af8d8-dabf-423c-a8c8-73b3b187a2f0\") " pod="openshift-must-gather-5jmhk/must-gather-xnhfm"
Jun 15 07:33:37.976479 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:33:37.976329    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/775af8d8-dabf-423c-a8c8-73b3b187a2f0-must-gather-output\") pod \"must-gather-xnhfm\" (UID: \"775af8d8-dabf-423c-a8c8-73b3b187a2f0\") " pod="openshift-must-gather-5jmhk/must-gather-xnhfm"
Jun 15 07:33:38.076884 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:33:38.076774    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/775af8d8-dabf-423c-a8c8-73b3b187a2f0-must-gather-output\") pod \"must-gather-xnhfm\" (UID: \"775af8d8-dabf-423c-a8c8-73b3b187a2f0\") " pod="openshift-must-gather-5jmhk/must-gather-xnhfm"
Jun 15 07:33:38.076884 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:33:38.076848    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2kqvv\" (UniqueName: \"kubernetes.io/projected/775af8d8-dabf-423c-a8c8-73b3b187a2f0-kube-api-access-2kqvv\") pod \"must-gather-xnhfm\" (UID: \"775af8d8-dabf-423c-a8c8-73b3b187a2f0\") " pod="openshift-must-gather-5jmhk/must-gather-xnhfm"
Jun 15 07:33:38.081958 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:33:38.077131    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/775af8d8-dabf-423c-a8c8-73b3b187a2f0-must-gather-output\") pod \"must-gather-xnhfm\" (UID: \"775af8d8-dabf-423c-a8c8-73b3b187a2f0\") " pod="openshift-must-gather-5jmhk/must-gather-xnhfm"
Jun 15 07:33:38.087076 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:33:38.087047    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2kqvv\" (UniqueName: \"kubernetes.io/projected/775af8d8-dabf-423c-a8c8-73b3b187a2f0-kube-api-access-2kqvv\") pod \"must-gather-xnhfm\" (UID: \"775af8d8-dabf-423c-a8c8-73b3b187a2f0\") " pod="openshift-must-gather-5jmhk/must-gather-xnhfm"
Jun 15 07:33:38.108492 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:33:38.108473    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5dbbb5d744-ktjgp_67da60eb-27f9-4bbd-8d12-64275e801143/console-operator/2.log"
Jun 15 07:33:38.113493 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:33:38.113475    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-f4bzh_5a1f8f83-55db-4fc7-872d-6b202daa0a31/ovn-acl-logging/0.log"
Jun 15 07:33:38.143408 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:33:38.143336    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5dbbb5d744-ktjgp_67da60eb-27f9-4bbd-8d12-64275e801143/console-operator/2.log"
Jun 15 07:33:38.149215 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:33:38.149197    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-f4bzh_5a1f8f83-55db-4fc7-872d-6b202daa0a31/ovn-acl-logging/0.log"
Jun 15 07:33:38.195183 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:33:38.195163    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-5jmhk/must-gather-xnhfm"
Jun 15 07:33:38.334507 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:33:38.334478    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-5jmhk/must-gather-xnhfm"]
Jun 15 07:33:38.336239 ip-10-0-128-243 kubenswrapper[2566]: W0615 07:33:38.336210    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod775af8d8_dabf_423c_a8c8_73b3b187a2f0.slice/crio-6293aeaf72fc9aaba090ceb487a49dfa792551a571d32fd1723ec203f63235e3 WatchSource:0}: Error finding container 6293aeaf72fc9aaba090ceb487a49dfa792551a571d32fd1723ec203f63235e3: Status 404 returned error can't find the container with id 6293aeaf72fc9aaba090ceb487a49dfa792551a571d32fd1723ec203f63235e3
Jun 15 07:33:38.665117 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:33:38.665068    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-5jmhk/must-gather-xnhfm" event={"ID":"775af8d8-dabf-423c-a8c8-73b3b187a2f0","Type":"ContainerStarted","Data":"6293aeaf72fc9aaba090ceb487a49dfa792551a571d32fd1723ec203f63235e3"}
Jun 15 07:33:44.708407 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:33:44.708356    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-5jmhk/must-gather-xnhfm" event={"ID":"775af8d8-dabf-423c-a8c8-73b3b187a2f0","Type":"ContainerStarted","Data":"c9534bfdffa8bbf5b95403c58a6bf5704ee411422435dd6a8ba1963482552ce8"}
Jun 15 07:33:44.708803 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:33:44.708412    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-5jmhk/must-gather-xnhfm" event={"ID":"775af8d8-dabf-423c-a8c8-73b3b187a2f0","Type":"ContainerStarted","Data":"b7ff3d400dac18e4b55ccc9e12ceb6fbf0dc13f4ebcf287bdd989dfe80643a4d"}
Jun 15 07:33:44.728729 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:33:44.728684    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-5jmhk/must-gather-xnhfm" podStartSLOduration=1.64596433 podStartE2EDuration="7.728669208s" totalImagesPullingTime="6.082704878s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-15 07:33:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 07:33:44.728002181 +0000 UTC m=+6307.687759428" watchObservedRunningTime="2026-06-15 07:33:44.728669208 +0000 UTC m=+6307.688426453"
Jun 15 07:33:54.323842 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:33:54.323807    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_llmisvc-router-managed-test-llm-4b931143-kserve-66f88bc44dcnc5x_d0c46224-53bd-4494-b0c7-835a49a21cf7/main/0.log"
Jun 15 07:33:54.358774 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:33:54.358738    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_llmisvc-router-managed-test-llm-5b1e8f15-kserve-7c5bd57d44b7wp8_be8770ba-8db8-4a0c-99b7-a16c4f499392/main/0.log"
Jun 15 07:33:54.482448 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:33:54.482405    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_router-gateway-2-openshift-default-78c98f6f4c-ddrqp_f371b3cf-555f-408b-83c0-9350d5cc73f7/istio-proxy/1.log"
Jun 15 07:33:54.483403 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:33:54.483374    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_router-gateway-2-openshift-default-78c98f6f4c-ddrqp_f371b3cf-555f-408b-83c0-9350d5cc73f7/istio-proxy/0.log"
Jun 15 07:33:56.525106 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:33:56.525055    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_llmisvc-router-managed-test-llm-4b931143-kserve-66f88bc44dcnc5x_d0c46224-53bd-4494-b0c7-835a49a21cf7/main/0.log"
Jun 15 07:33:56.541715 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:33:56.541688    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_llmisvc-router-managed-test-llm-5b1e8f15-kserve-7c5bd57d44b7wp8_be8770ba-8db8-4a0c-99b7-a16c4f499392/main/0.log"
Jun 15 07:33:56.669392 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:33:56.669362    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_router-gateway-2-openshift-default-78c98f6f4c-ddrqp_f371b3cf-555f-408b-83c0-9350d5cc73f7/istio-proxy/1.log"
Jun 15 07:33:56.670270 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:33:56.670250    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_router-gateway-2-openshift-default-78c98f6f4c-ddrqp_f371b3cf-555f-408b-83c0-9350d5cc73f7/istio-proxy/0.log"
Jun 15 07:33:58.775720 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:33:58.775692    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_llmisvc-router-managed-test-llm-4b931143-kserve-66f88bc44dcnc5x_d0c46224-53bd-4494-b0c7-835a49a21cf7/main/0.log"
Jun 15 07:33:58.792666 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:33:58.792631    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_llmisvc-router-managed-test-llm-5b1e8f15-kserve-7c5bd57d44b7wp8_be8770ba-8db8-4a0c-99b7-a16c4f499392/main/0.log"
Jun 15 07:33:58.920801 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:33:58.920763    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_router-gateway-2-openshift-default-78c98f6f4c-ddrqp_f371b3cf-555f-408b-83c0-9350d5cc73f7/istio-proxy/1.log"
Jun 15 07:33:58.921524 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:33:58.921502    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_router-gateway-2-openshift-default-78c98f6f4c-ddrqp_f371b3cf-555f-408b-83c0-9350d5cc73f7/istio-proxy/0.log"
Jun 15 07:34:01.053147 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:34:01.053116    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_llmisvc-router-managed-test-llm-4b931143-kserve-66f88bc44dcnc5x_d0c46224-53bd-4494-b0c7-835a49a21cf7/main/0.log"
Jun 15 07:34:01.069477 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:34:01.069452    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_llmisvc-router-managed-test-llm-5b1e8f15-kserve-7c5bd57d44b7wp8_be8770ba-8db8-4a0c-99b7-a16c4f499392/main/0.log"
Jun 15 07:34:01.201235 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:34:01.201204    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_router-gateway-2-openshift-default-78c98f6f4c-ddrqp_f371b3cf-555f-408b-83c0-9350d5cc73f7/istio-proxy/1.log"
Jun 15 07:34:01.201913 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:34:01.201889    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_router-gateway-2-openshift-default-78c98f6f4c-ddrqp_f371b3cf-555f-408b-83c0-9350d5cc73f7/istio-proxy/0.log"
Jun 15 07:34:03.232239 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:34:03.232206    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_llmisvc-router-managed-test-llm-4b931143-kserve-66f88bc44dcnc5x_d0c46224-53bd-4494-b0c7-835a49a21cf7/main/0.log"
Jun 15 07:34:03.246605 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:34:03.246572    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_llmisvc-router-managed-test-llm-5b1e8f15-kserve-7c5bd57d44b7wp8_be8770ba-8db8-4a0c-99b7-a16c4f499392/main/0.log"
Jun 15 07:34:03.375798 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:34:03.375759    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_router-gateway-2-openshift-default-78c98f6f4c-ddrqp_f371b3cf-555f-408b-83c0-9350d5cc73f7/istio-proxy/1.log"
Jun 15 07:34:03.376534 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:34:03.376509    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_router-gateway-2-openshift-default-78c98f6f4c-ddrqp_f371b3cf-555f-408b-83c0-9350d5cc73f7/istio-proxy/0.log"
Jun 15 07:34:05.682162 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:34:05.682134    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_llmisvc-router-managed-test-llm-4b931143-kserve-66f88bc44dcnc5x_d0c46224-53bd-4494-b0c7-835a49a21cf7/main/0.log"
Jun 15 07:34:05.698985 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:34:05.698952    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_llmisvc-router-managed-test-llm-5b1e8f15-kserve-7c5bd57d44b7wp8_be8770ba-8db8-4a0c-99b7-a16c4f499392/main/0.log"
Jun 15 07:34:05.829351 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:34:05.829321    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_router-gateway-2-openshift-default-78c98f6f4c-ddrqp_f371b3cf-555f-408b-83c0-9350d5cc73f7/istio-proxy/1.log"
Jun 15 07:34:05.830288 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:34:05.830264    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_router-gateway-2-openshift-default-78c98f6f4c-ddrqp_f371b3cf-555f-408b-83c0-9350d5cc73f7/istio-proxy/0.log"
Jun 15 07:34:08.075228 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:34:08.075199    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_llmisvc-router-managed-test-llm-4b931143-kserve-66f88bc44dcnc5x_d0c46224-53bd-4494-b0c7-835a49a21cf7/main/0.log"
Jun 15 07:34:08.110732 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:34:08.110673    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_llmisvc-router-managed-test-llm-5b1e8f15-kserve-7c5bd57d44b7wp8_be8770ba-8db8-4a0c-99b7-a16c4f499392/main/0.log"
Jun 15 07:34:08.268877 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:34:08.268850    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_router-gateway-2-openshift-default-78c98f6f4c-ddrqp_f371b3cf-555f-408b-83c0-9350d5cc73f7/istio-proxy/1.log"
Jun 15 07:34:08.269686 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:34:08.269662    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_router-gateway-2-openshift-default-78c98f6f4c-ddrqp_f371b3cf-555f-408b-83c0-9350d5cc73f7/istio-proxy/0.log"
Jun 15 07:34:10.292757 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:34:10.292707    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_llmisvc-router-managed-test-llm-4b931143-kserve-66f88bc44dcnc5x_d0c46224-53bd-4494-b0c7-835a49a21cf7/main/0.log"
Jun 15 07:34:10.308305 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:34:10.308269    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_llmisvc-router-managed-test-llm-5b1e8f15-kserve-7c5bd57d44b7wp8_be8770ba-8db8-4a0c-99b7-a16c4f499392/main/0.log"
Jun 15 07:34:10.434428 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:34:10.434398    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_router-gateway-2-openshift-default-78c98f6f4c-ddrqp_f371b3cf-555f-408b-83c0-9350d5cc73f7/istio-proxy/1.log"
Jun 15 07:34:10.435382 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:34:10.435346    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_router-gateway-2-openshift-default-78c98f6f4c-ddrqp_f371b3cf-555f-408b-83c0-9350d5cc73f7/istio-proxy/0.log"
Jun 15 07:34:12.529032 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:34:12.529001    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_llmisvc-router-managed-test-llm-4b931143-kserve-66f88bc44dcnc5x_d0c46224-53bd-4494-b0c7-835a49a21cf7/main/0.log"
Jun 15 07:34:12.548063 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:34:12.548037    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_llmisvc-router-managed-test-llm-5b1e8f15-kserve-7c5bd57d44b7wp8_be8770ba-8db8-4a0c-99b7-a16c4f499392/main/0.log"
Jun 15 07:34:12.684058 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:34:12.684028    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_router-gateway-2-openshift-default-78c98f6f4c-ddrqp_f371b3cf-555f-408b-83c0-9350d5cc73f7/istio-proxy/1.log"
Jun 15 07:34:12.684942 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:34:12.684917    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_router-gateway-2-openshift-default-78c98f6f4c-ddrqp_f371b3cf-555f-408b-83c0-9350d5cc73f7/istio-proxy/0.log"
Jun 15 07:34:14.789605 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:34:14.789570    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_llmisvc-router-managed-test-llm-4b931143-kserve-66f88bc44dcnc5x_d0c46224-53bd-4494-b0c7-835a49a21cf7/main/0.log"
Jun 15 07:34:14.818827 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:34:14.818797    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_llmisvc-router-managed-test-llm-5b1e8f15-kserve-7c5bd57d44b7wp8_be8770ba-8db8-4a0c-99b7-a16c4f499392/main/0.log"
Jun 15 07:34:14.965004 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:34:14.964971    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_router-gateway-2-openshift-default-78c98f6f4c-ddrqp_f371b3cf-555f-408b-83c0-9350d5cc73f7/istio-proxy/1.log"
Jun 15 07:34:14.965893 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:34:14.965863    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_router-gateway-2-openshift-default-78c98f6f4c-ddrqp_f371b3cf-555f-408b-83c0-9350d5cc73f7/istio-proxy/0.log"
Jun 15 07:34:17.211660 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:34:17.211629    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_llmisvc-router-managed-test-llm-4b931143-kserve-66f88bc44dcnc5x_d0c46224-53bd-4494-b0c7-835a49a21cf7/main/0.log"
Jun 15 07:34:17.251371 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:34:17.251339    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_llmisvc-router-managed-test-llm-5b1e8f15-kserve-7c5bd57d44b7wp8_be8770ba-8db8-4a0c-99b7-a16c4f499392/main/0.log"
Jun 15 07:34:17.509232 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:34:17.509198    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_router-gateway-2-openshift-default-78c98f6f4c-ddrqp_f371b3cf-555f-408b-83c0-9350d5cc73f7/istio-proxy/1.log"
Jun 15 07:34:17.509815 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:34:17.509787    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_router-gateway-2-openshift-default-78c98f6f4c-ddrqp_f371b3cf-555f-408b-83c0-9350d5cc73f7/istio-proxy/0.log"
Jun 15 07:34:19.552097 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:34:19.552049    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_llmisvc-router-managed-test-llm-4b931143-kserve-66f88bc44dcnc5x_d0c46224-53bd-4494-b0c7-835a49a21cf7/main/0.log"
Jun 15 07:34:19.567511 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:34:19.567486    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_llmisvc-router-managed-test-llm-5b1e8f15-kserve-7c5bd57d44b7wp8_be8770ba-8db8-4a0c-99b7-a16c4f499392/main/0.log"
Jun 15 07:34:19.698445 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:34:19.698401    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_router-gateway-2-openshift-default-78c98f6f4c-ddrqp_f371b3cf-555f-408b-83c0-9350d5cc73f7/istio-proxy/1.log"
Jun 15 07:34:19.699238 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:34:19.699210    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_router-gateway-2-openshift-default-78c98f6f4c-ddrqp_f371b3cf-555f-408b-83c0-9350d5cc73f7/istio-proxy/0.log"
Jun 15 07:34:21.865688 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:34:21.865659    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_llmisvc-router-managed-test-llm-4b931143-kserve-66f88bc44dcnc5x_d0c46224-53bd-4494-b0c7-835a49a21cf7/main/0.log"
Jun 15 07:34:21.882988 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:34:21.882961    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_llmisvc-router-managed-test-llm-5b1e8f15-kserve-7c5bd57d44b7wp8_be8770ba-8db8-4a0c-99b7-a16c4f499392/main/0.log"
Jun 15 07:34:22.012607 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:34:22.012567    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_router-gateway-2-openshift-default-78c98f6f4c-ddrqp_f371b3cf-555f-408b-83c0-9350d5cc73f7/istio-proxy/1.log"
Jun 15 07:34:22.013395 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:34:22.013372    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_router-gateway-2-openshift-default-78c98f6f4c-ddrqp_f371b3cf-555f-408b-83c0-9350d5cc73f7/istio-proxy/0.log"
Jun 15 07:34:24.079404 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:34:24.079375    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_llmisvc-router-managed-test-llm-4b931143-kserve-66f88bc44dcnc5x_d0c46224-53bd-4494-b0c7-835a49a21cf7/main/0.log"
Jun 15 07:34:24.095333 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:34:24.095297    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_llmisvc-router-managed-test-llm-5b1e8f15-kserve-7c5bd57d44b7wp8_be8770ba-8db8-4a0c-99b7-a16c4f499392/main/0.log"
Jun 15 07:34:24.261518 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:34:24.261485    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_router-gateway-2-openshift-default-78c98f6f4c-ddrqp_f371b3cf-555f-408b-83c0-9350d5cc73f7/istio-proxy/1.log"
Jun 15 07:34:24.262163 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:34:24.262131    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_router-gateway-2-openshift-default-78c98f6f4c-ddrqp_f371b3cf-555f-408b-83c0-9350d5cc73f7/istio-proxy/0.log"
Jun 15 07:34:27.109550 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:34:27.109501    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-8bdfdcbd8-4fc26_3b8ee52d-b179-492b-960c-b978e06cd8a7/router/0.log"
Jun 15 07:34:28.312742 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:34:28.312707    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_llmisvc-router-managed-test-llm-4b931143-kserve-66f88bc44dcnc5x_d0c46224-53bd-4494-b0c7-835a49a21cf7/main/0.log"
Jun 15 07:34:28.335381 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:34:28.335354    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_llmisvc-router-managed-test-llm-5b1e8f15-kserve-7c5bd57d44b7wp8_be8770ba-8db8-4a0c-99b7-a16c4f499392/main/0.log"
Jun 15 07:34:28.460979 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:34:28.460944    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_router-gateway-2-openshift-default-78c98f6f4c-ddrqp_f371b3cf-555f-408b-83c0-9350d5cc73f7/istio-proxy/1.log"
Jun 15 07:34:28.461596 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:34:28.461571    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_router-gateway-2-openshift-default-78c98f6f4c-ddrqp_f371b3cf-555f-408b-83c0-9350d5cc73f7/istio-proxy/0.log"
Jun 15 07:34:30.702555 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:34:30.702525    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_llmisvc-router-managed-test-llm-4b931143-kserve-66f88bc44dcnc5x_d0c46224-53bd-4494-b0c7-835a49a21cf7/main/0.log"
Jun 15 07:34:30.718095 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:34:30.718062    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_llmisvc-router-managed-test-llm-5b1e8f15-kserve-7c5bd57d44b7wp8_be8770ba-8db8-4a0c-99b7-a16c4f499392/main/0.log"
Jun 15 07:34:30.866400 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:34:30.866372    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_router-gateway-2-openshift-default-78c98f6f4c-ddrqp_f371b3cf-555f-408b-83c0-9350d5cc73f7/istio-proxy/1.log"
Jun 15 07:34:30.867233 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:34:30.867205    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_router-gateway-2-openshift-default-78c98f6f4c-ddrqp_f371b3cf-555f-408b-83c0-9350d5cc73f7/istio-proxy/0.log"
Jun 15 07:34:32.852401 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:34:32.852366    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_llmisvc-router-managed-test-llm-4b931143-kserve-66f88bc44dcnc5x_d0c46224-53bd-4494-b0c7-835a49a21cf7/main/0.log"
Jun 15 07:34:32.867098 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:34:32.867053    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_llmisvc-router-managed-test-llm-5b1e8f15-kserve-7c5bd57d44b7wp8_be8770ba-8db8-4a0c-99b7-a16c4f499392/main/0.log"
Jun 15 07:34:33.000481 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:34:33.000440    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_router-gateway-2-openshift-default-78c98f6f4c-ddrqp_f371b3cf-555f-408b-83c0-9350d5cc73f7/istio-proxy/1.log"
Jun 15 07:34:33.001328 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:34:33.001304    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_router-gateway-2-openshift-default-78c98f6f4c-ddrqp_f371b3cf-555f-408b-83c0-9350d5cc73f7/istio-proxy/0.log"
Jun 15 07:34:35.010646 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:34:35.010616    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_llmisvc-router-managed-test-llm-4b931143-kserve-66f88bc44dcnc5x_d0c46224-53bd-4494-b0c7-835a49a21cf7/main/0.log"
Jun 15 07:34:35.032132 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:34:35.032104    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_llmisvc-router-managed-test-llm-5b1e8f15-kserve-7c5bd57d44b7wp8_be8770ba-8db8-4a0c-99b7-a16c4f499392/main/0.log"
Jun 15 07:34:35.166249 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:34:35.166224    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_router-gateway-2-openshift-default-78c98f6f4c-ddrqp_f371b3cf-555f-408b-83c0-9350d5cc73f7/istio-proxy/1.log"
Jun 15 07:34:35.166935 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:34:35.166911    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_router-gateway-2-openshift-default-78c98f6f4c-ddrqp_f371b3cf-555f-408b-83c0-9350d5cc73f7/istio-proxy/0.log"
Jun 15 07:34:37.194059 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:34:37.194027    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_llmisvc-router-managed-test-llm-4b931143-kserve-66f88bc44dcnc5x_d0c46224-53bd-4494-b0c7-835a49a21cf7/main/0.log"
Jun 15 07:34:37.226169 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:34:37.226140    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_llmisvc-router-managed-test-llm-5b1e8f15-kserve-7c5bd57d44b7wp8_be8770ba-8db8-4a0c-99b7-a16c4f499392/main/0.log"
Jun 15 07:34:37.365732 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:34:37.365692    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_router-gateway-2-openshift-default-78c98f6f4c-ddrqp_f371b3cf-555f-408b-83c0-9350d5cc73f7/istio-proxy/1.log"
Jun 15 07:34:37.366608 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:34:37.366581    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_router-gateway-2-openshift-default-78c98f6f4c-ddrqp_f371b3cf-555f-408b-83c0-9350d5cc73f7/istio-proxy/0.log"
Jun 15 07:34:39.328714 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:34:39.328678    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_llmisvc-router-managed-test-llm-4b931143-kserve-66f88bc44dcnc5x_d0c46224-53bd-4494-b0c7-835a49a21cf7/main/0.log"
Jun 15 07:34:39.346145 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:34:39.346119    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_llmisvc-router-managed-test-llm-5b1e8f15-kserve-7c5bd57d44b7wp8_be8770ba-8db8-4a0c-99b7-a16c4f499392/main/0.log"
Jun 15 07:34:39.475459 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:34:39.475416    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_router-gateway-2-openshift-default-78c98f6f4c-ddrqp_f371b3cf-555f-408b-83c0-9350d5cc73f7/istio-proxy/1.log"
Jun 15 07:34:39.476197 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:34:39.476174    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_router-gateway-2-openshift-default-78c98f6f4c-ddrqp_f371b3cf-555f-408b-83c0-9350d5cc73f7/istio-proxy/0.log"
Jun 15 07:34:42.196400 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:34:42.196356    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-8bdfdcbd8-4fc26_3b8ee52d-b179-492b-960c-b978e06cd8a7/router/0.log"
Jun 15 07:34:44.004524 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:34:44.004494    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-8bdfdcbd8-4fc26_3b8ee52d-b179-492b-960c-b978e06cd8a7/router/0.log"
Jun 15 07:34:45.886041 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:34:45.886011    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-8bdfdcbd8-4fc26_3b8ee52d-b179-492b-960c-b978e06cd8a7/router/0.log"
Jun 15 07:34:46.812132 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:34:46.812102    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-686db986cb-n5rxl_82db39b0-d5da-43ef-8722-238f3f7cfeed/authorino/0.log"
Jun 15 07:34:46.860032 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:34:46.860002    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-7dbb555447-w6b6b_e1a93313-40c4-40c9-a035-6066ffed7081/kuadrant-console-plugin/0.log"
Jun 15 07:34:48.038112 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:34:48.038064    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-686db986cb-n5rxl_82db39b0-d5da-43ef-8722-238f3f7cfeed/authorino/0.log"
Jun 15 07:34:48.090870 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:34:48.090837    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-7dbb555447-w6b6b_e1a93313-40c4-40c9-a035-6066ffed7081/kuadrant-console-plugin/0.log"
Jun 15 07:34:49.358178 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:34:49.358144    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-686db986cb-n5rxl_82db39b0-d5da-43ef-8722-238f3f7cfeed/authorino/0.log"
Jun 15 07:34:49.407529 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:34:49.407501    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-7dbb555447-w6b6b_e1a93313-40c4-40c9-a035-6066ffed7081/kuadrant-console-plugin/0.log"
Jun 15 07:34:50.572877 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:34:50.572843    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-686db986cb-n5rxl_82db39b0-d5da-43ef-8722-238f3f7cfeed/authorino/0.log"
Jun 15 07:34:50.619795 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:34:50.619767    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-7dbb555447-w6b6b_e1a93313-40c4-40c9-a035-6066ffed7081/kuadrant-console-plugin/0.log"
Jun 15 07:34:51.767970 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:34:51.767934    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-686db986cb-n5rxl_82db39b0-d5da-43ef-8722-238f3f7cfeed/authorino/0.log"
Jun 15 07:34:51.828292 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:34:51.828262    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-7dbb555447-w6b6b_e1a93313-40c4-40c9-a035-6066ffed7081/kuadrant-console-plugin/0.log"
Jun 15 07:34:53.014026 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:34:53.013990    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-686db986cb-n5rxl_82db39b0-d5da-43ef-8722-238f3f7cfeed/authorino/0.log"
Jun 15 07:34:53.056529 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:34:53.056496    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-7dbb555447-w6b6b_e1a93313-40c4-40c9-a035-6066ffed7081/kuadrant-console-plugin/0.log"
Jun 15 07:34:54.283697 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:34:54.283606    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-686db986cb-n5rxl_82db39b0-d5da-43ef-8722-238f3f7cfeed/authorino/0.log"
Jun 15 07:34:54.331665 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:34:54.331638    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-7dbb555447-w6b6b_e1a93313-40c4-40c9-a035-6066ffed7081/kuadrant-console-plugin/0.log"
Jun 15 07:34:55.516814 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:34:55.516785    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-686db986cb-n5rxl_82db39b0-d5da-43ef-8722-238f3f7cfeed/authorino/0.log"
Jun 15 07:34:55.579998 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:34:55.579969    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-7dbb555447-w6b6b_e1a93313-40c4-40c9-a035-6066ffed7081/kuadrant-console-plugin/0.log"
Jun 15 07:34:56.838700 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:34:56.838653    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-686db986cb-n5rxl_82db39b0-d5da-43ef-8722-238f3f7cfeed/authorino/0.log"
Jun 15 07:34:56.893539 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:34:56.893508    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-7dbb555447-w6b6b_e1a93313-40c4-40c9-a035-6066ffed7081/kuadrant-console-plugin/0.log"
Jun 15 07:34:58.098564 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:34:58.098527    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-686db986cb-n5rxl_82db39b0-d5da-43ef-8722-238f3f7cfeed/authorino/0.log"
Jun 15 07:34:58.150121 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:34:58.150076    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-7dbb555447-w6b6b_e1a93313-40c4-40c9-a035-6066ffed7081/kuadrant-console-plugin/0.log"
Jun 15 07:34:59.375594 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:34:59.375561    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-686db986cb-n5rxl_82db39b0-d5da-43ef-8722-238f3f7cfeed/authorino/0.log"
Jun 15 07:34:59.422101 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:34:59.422053    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-7dbb555447-w6b6b_e1a93313-40c4-40c9-a035-6066ffed7081/kuadrant-console-plugin/0.log"
Jun 15 07:35:00.579197 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:35:00.579155    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-686db986cb-n5rxl_82db39b0-d5da-43ef-8722-238f3f7cfeed/authorino/0.log"
Jun 15 07:35:00.634052 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:35:00.634028    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-7dbb555447-w6b6b_e1a93313-40c4-40c9-a035-6066ffed7081/kuadrant-console-plugin/0.log"
Jun 15 07:35:01.795279 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:35:01.795242    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-686db986cb-n5rxl_82db39b0-d5da-43ef-8722-238f3f7cfeed/authorino/0.log"
Jun 15 07:35:01.842311 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:35:01.842284    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-7dbb555447-w6b6b_e1a93313-40c4-40c9-a035-6066ffed7081/kuadrant-console-plugin/0.log"
Jun 15 07:35:02.987460 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:35:02.987422    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-686db986cb-n5rxl_82db39b0-d5da-43ef-8722-238f3f7cfeed/authorino/0.log"
Jun 15 07:35:03.035157 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:35:03.035128    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-7dbb555447-w6b6b_e1a93313-40c4-40c9-a035-6066ffed7081/kuadrant-console-plugin/0.log"
Jun 15 07:35:04.270466 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:35:04.270428    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-686db986cb-n5rxl_82db39b0-d5da-43ef-8722-238f3f7cfeed/authorino/0.log"
Jun 15 07:35:04.327382 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:35:04.327356    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-7dbb555447-w6b6b_e1a93313-40c4-40c9-a035-6066ffed7081/kuadrant-console-plugin/0.log"
Jun 15 07:35:05.541217 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:35:05.541180    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-686db986cb-n5rxl_82db39b0-d5da-43ef-8722-238f3f7cfeed/authorino/0.log"
Jun 15 07:35:05.592511 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:35:05.592485    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-7dbb555447-w6b6b_e1a93313-40c4-40c9-a035-6066ffed7081/kuadrant-console-plugin/0.log"
Jun 15 07:35:06.738287 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:35:06.738257    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-686db986cb-n5rxl_82db39b0-d5da-43ef-8722-238f3f7cfeed/authorino/0.log"
Jun 15 07:35:06.785405 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:35:06.785376    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-7dbb555447-w6b6b_e1a93313-40c4-40c9-a035-6066ffed7081/kuadrant-console-plugin/0.log"
Jun 15 07:35:07.933223 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:35:07.933181    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-686db986cb-n5rxl_82db39b0-d5da-43ef-8722-238f3f7cfeed/authorino/0.log"
Jun 15 07:35:07.979254 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:35:07.979227    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-7dbb555447-w6b6b_e1a93313-40c4-40c9-a035-6066ffed7081/kuadrant-console-plugin/0.log"
Jun 15 07:35:09.183586 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:35:09.183554    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-686db986cb-n5rxl_82db39b0-d5da-43ef-8722-238f3f7cfeed/authorino/0.log"
Jun 15 07:35:09.231053 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:35:09.231023    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-7dbb555447-w6b6b_e1a93313-40c4-40c9-a035-6066ffed7081/kuadrant-console-plugin/0.log"
Jun 15 07:35:10.381512 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:35:10.381472    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-686db986cb-n5rxl_82db39b0-d5da-43ef-8722-238f3f7cfeed/authorino/0.log"
Jun 15 07:35:10.447399 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:35:10.447374    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-7dbb555447-w6b6b_e1a93313-40c4-40c9-a035-6066ffed7081/kuadrant-console-plugin/0.log"
Jun 15 07:35:11.591750 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:35:11.591718    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-686db986cb-n5rxl_82db39b0-d5da-43ef-8722-238f3f7cfeed/authorino/0.log"
Jun 15 07:35:11.641307 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:35:11.641278    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-7dbb555447-w6b6b_e1a93313-40c4-40c9-a035-6066ffed7081/kuadrant-console-plugin/0.log"
Jun 15 07:35:12.793820 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:35:12.793783    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-686db986cb-n5rxl_82db39b0-d5da-43ef-8722-238f3f7cfeed/authorino/0.log"
Jun 15 07:35:12.836055 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:35:12.836025    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-7dbb555447-w6b6b_e1a93313-40c4-40c9-a035-6066ffed7081/kuadrant-console-plugin/0.log"
Jun 15 07:35:14.015832 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:35:14.015798    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-686db986cb-n5rxl_82db39b0-d5da-43ef-8722-238f3f7cfeed/authorino/0.log"
Jun 15 07:35:14.100560 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:35:14.100532    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-7dbb555447-w6b6b_e1a93313-40c4-40c9-a035-6066ffed7081/kuadrant-console-plugin/0.log"
Jun 15 07:35:15.293647 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:35:15.293617    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-686db986cb-n5rxl_82db39b0-d5da-43ef-8722-238f3f7cfeed/authorino/0.log"
Jun 15 07:35:15.365657 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:35:15.365622    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-7dbb555447-w6b6b_e1a93313-40c4-40c9-a035-6066ffed7081/kuadrant-console-plugin/0.log"
Jun 15 07:35:16.530540 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:35:16.530511    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-686db986cb-n5rxl_82db39b0-d5da-43ef-8722-238f3f7cfeed/authorino/0.log"
Jun 15 07:35:16.580269 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:35:16.580240    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-7dbb555447-w6b6b_e1a93313-40c4-40c9-a035-6066ffed7081/kuadrant-console-plugin/0.log"
Jun 15 07:35:17.753498 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:35:17.753459    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-686db986cb-n5rxl_82db39b0-d5da-43ef-8722-238f3f7cfeed/authorino/0.log"
Jun 15 07:35:17.801793 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:35:17.801763    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-7dbb555447-w6b6b_e1a93313-40c4-40c9-a035-6066ffed7081/kuadrant-console-plugin/0.log"
Jun 15 07:35:18.972324 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:35:18.972288    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-686db986cb-n5rxl_82db39b0-d5da-43ef-8722-238f3f7cfeed/authorino/0.log"
Jun 15 07:35:19.023291 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:35:19.023267    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-7dbb555447-w6b6b_e1a93313-40c4-40c9-a035-6066ffed7081/kuadrant-console-plugin/0.log"
Jun 15 07:35:20.206965 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:35:20.206924    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-686db986cb-n5rxl_82db39b0-d5da-43ef-8722-238f3f7cfeed/authorino/0.log"
Jun 15 07:35:20.262539 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:35:20.262509    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-7dbb555447-w6b6b_e1a93313-40c4-40c9-a035-6066ffed7081/kuadrant-console-plugin/0.log"
Jun 15 07:35:21.461539 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:35:21.461505    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-686db986cb-n5rxl_82db39b0-d5da-43ef-8722-238f3f7cfeed/authorino/0.log"
Jun 15 07:35:21.513370 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:35:21.513347    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-7dbb555447-w6b6b_e1a93313-40c4-40c9-a035-6066ffed7081/kuadrant-console-plugin/0.log"
Jun 15 07:35:22.659606 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:35:22.659566    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-686db986cb-n5rxl_82db39b0-d5da-43ef-8722-238f3f7cfeed/authorino/0.log"
Jun 15 07:35:22.713402 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:35:22.713373    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-7dbb555447-w6b6b_e1a93313-40c4-40c9-a035-6066ffed7081/kuadrant-console-plugin/0.log"
Jun 15 07:35:23.888506 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:35:23.888465    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-686db986cb-n5rxl_82db39b0-d5da-43ef-8722-238f3f7cfeed/authorino/0.log"
Jun 15 07:35:23.938391 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:35:23.938354    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-7dbb555447-w6b6b_e1a93313-40c4-40c9-a035-6066ffed7081/kuadrant-console-plugin/0.log"
Jun 15 07:35:25.115522 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:35:25.115493    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-686db986cb-n5rxl_82db39b0-d5da-43ef-8722-238f3f7cfeed/authorino/0.log"
Jun 15 07:35:25.166837 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:35:25.166812    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-7dbb555447-w6b6b_e1a93313-40c4-40c9-a035-6066ffed7081/kuadrant-console-plugin/0.log"
Jun 15 07:35:26.326975 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:35:26.326945    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-686db986cb-n5rxl_82db39b0-d5da-43ef-8722-238f3f7cfeed/authorino/0.log"
Jun 15 07:35:26.374614 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:35:26.374580    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-7dbb555447-w6b6b_e1a93313-40c4-40c9-a035-6066ffed7081/kuadrant-console-plugin/0.log"
Jun 15 07:35:27.540620 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:35:27.540583    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-686db986cb-n5rxl_82db39b0-d5da-43ef-8722-238f3f7cfeed/authorino/0.log"
Jun 15 07:35:27.587935 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:35:27.587909    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-7dbb555447-w6b6b_e1a93313-40c4-40c9-a035-6066ffed7081/kuadrant-console-plugin/0.log"
Jun 15 07:35:28.759222 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:35:28.759188    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-686db986cb-n5rxl_82db39b0-d5da-43ef-8722-238f3f7cfeed/authorino/0.log"
Jun 15 07:35:28.804688 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:35:28.804664    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-7dbb555447-w6b6b_e1a93313-40c4-40c9-a035-6066ffed7081/kuadrant-console-plugin/0.log"
Jun 15 07:35:30.027256 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:35:30.027221    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-686db986cb-n5rxl_82db39b0-d5da-43ef-8722-238f3f7cfeed/authorino/0.log"
Jun 15 07:35:30.074143 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:35:30.074116    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-7dbb555447-w6b6b_e1a93313-40c4-40c9-a035-6066ffed7081/kuadrant-console-plugin/0.log"
Jun 15 07:35:31.289492 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:35:31.289459    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-686db986cb-n5rxl_82db39b0-d5da-43ef-8722-238f3f7cfeed/authorino/0.log"
Jun 15 07:35:31.345366 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:35:31.345325    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-7dbb555447-w6b6b_e1a93313-40c4-40c9-a035-6066ffed7081/kuadrant-console-plugin/0.log"
Jun 15 07:35:32.590019 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:35:32.589981    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-686db986cb-n5rxl_82db39b0-d5da-43ef-8722-238f3f7cfeed/authorino/0.log"
Jun 15 07:35:32.647630 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:35:32.647600    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-7dbb555447-w6b6b_e1a93313-40c4-40c9-a035-6066ffed7081/kuadrant-console-plugin/0.log"
Jun 15 07:35:33.868250 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:35:33.868210    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-686db986cb-n5rxl_82db39b0-d5da-43ef-8722-238f3f7cfeed/authorino/0.log"
Jun 15 07:35:33.915191 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:35:33.915152    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-7dbb555447-w6b6b_e1a93313-40c4-40c9-a035-6066ffed7081/kuadrant-console-plugin/0.log"
Jun 15 07:35:35.086606 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:35:35.086557    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-686db986cb-n5rxl_82db39b0-d5da-43ef-8722-238f3f7cfeed/authorino/0.log"
Jun 15 07:35:35.144377 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:35:35.144343    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-7dbb555447-w6b6b_e1a93313-40c4-40c9-a035-6066ffed7081/kuadrant-console-plugin/0.log"
Jun 15 07:35:36.347759 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:35:36.347723    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-686db986cb-n5rxl_82db39b0-d5da-43ef-8722-238f3f7cfeed/authorino/0.log"
Jun 15 07:35:36.403056 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:35:36.402987    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-7dbb555447-w6b6b_e1a93313-40c4-40c9-a035-6066ffed7081/kuadrant-console-plugin/0.log"
Jun 15 07:35:37.564581 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:35:37.564538    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-686db986cb-n5rxl_82db39b0-d5da-43ef-8722-238f3f7cfeed/authorino/0.log"
Jun 15 07:35:37.614764 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:35:37.614737    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-7dbb555447-w6b6b_e1a93313-40c4-40c9-a035-6066ffed7081/kuadrant-console-plugin/0.log"
Jun 15 07:35:38.293810 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:35:38.293776    2566 scope.go:117] "RemoveContainer" containerID="f4a272fb656f5c3c78b19023a1c9788cf8de03540787423192b6347b71bb8b86"
Jun 15 07:35:38.303377 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:35:38.303352    2566 scope.go:117] "RemoveContainer" containerID="e356eb224795c987055a46012ecd286e1465718aad5500fa4b8f611cbfcd9ca0"
Jun 15 07:35:38.810027 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:35:38.809981    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-686db986cb-n5rxl_82db39b0-d5da-43ef-8722-238f3f7cfeed/authorino/0.log"
Jun 15 07:35:38.905212 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:35:38.905187    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-7dbb555447-w6b6b_e1a93313-40c4-40c9-a035-6066ffed7081/kuadrant-console-plugin/0.log"
Jun 15 07:35:40.108650 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:35:40.108618    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-686db986cb-n5rxl_82db39b0-d5da-43ef-8722-238f3f7cfeed/authorino/0.log"
Jun 15 07:35:40.155207 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:35:40.155181    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-7dbb555447-w6b6b_e1a93313-40c4-40c9-a035-6066ffed7081/kuadrant-console-plugin/0.log"
Jun 15 07:35:41.396984 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:35:41.396948    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-686db986cb-n5rxl_82db39b0-d5da-43ef-8722-238f3f7cfeed/authorino/0.log"
Jun 15 07:35:41.440118 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:35:41.440074    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-7dbb555447-w6b6b_e1a93313-40c4-40c9-a035-6066ffed7081/kuadrant-console-plugin/0.log"
Jun 15 07:35:42.676444 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:35:42.676382    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-686db986cb-n5rxl_82db39b0-d5da-43ef-8722-238f3f7cfeed/authorino/0.log"
Jun 15 07:35:42.726236 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:35:42.726211    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-7dbb555447-w6b6b_e1a93313-40c4-40c9-a035-6066ffed7081/kuadrant-console-plugin/0.log"
Jun 15 07:35:43.890497 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:35:43.890465    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-686db986cb-n5rxl_82db39b0-d5da-43ef-8722-238f3f7cfeed/authorino/0.log"
Jun 15 07:35:43.937446 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:35:43.937418    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-7dbb555447-w6b6b_e1a93313-40c4-40c9-a035-6066ffed7081/kuadrant-console-plugin/0.log"
Jun 15 07:35:45.119093 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:35:45.119048    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-686db986cb-n5rxl_82db39b0-d5da-43ef-8722-238f3f7cfeed/authorino/0.log"
Jun 15 07:35:45.169077 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:35:45.169051    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-7dbb555447-w6b6b_e1a93313-40c4-40c9-a035-6066ffed7081/kuadrant-console-plugin/0.log"
Jun 15 07:35:46.337649 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:35:46.337608    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-686db986cb-n5rxl_82db39b0-d5da-43ef-8722-238f3f7cfeed/authorino/0.log"
Jun 15 07:35:46.397461 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:35:46.397433    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-7dbb555447-w6b6b_e1a93313-40c4-40c9-a035-6066ffed7081/kuadrant-console-plugin/0.log"
Jun 15 07:35:47.432464 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:35:47.432434    2566 generic.go:356] "Generic (PLEG): container finished" podID="775af8d8-dabf-423c-a8c8-73b3b187a2f0" containerID="b7ff3d400dac18e4b55ccc9e12ceb6fbf0dc13f4ebcf287bdd989dfe80643a4d" exitCode=0
Jun 15 07:35:47.432869 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:35:47.432491    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-5jmhk/must-gather-xnhfm" event={"ID":"775af8d8-dabf-423c-a8c8-73b3b187a2f0","Type":"ContainerDied","Data":"b7ff3d400dac18e4b55ccc9e12ceb6fbf0dc13f4ebcf287bdd989dfe80643a4d"}
Jun 15 07:35:47.432869 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:35:47.432790    2566 scope.go:117] "RemoveContainer" containerID="b7ff3d400dac18e4b55ccc9e12ceb6fbf0dc13f4ebcf287bdd989dfe80643a4d"
Jun 15 07:35:48.378161 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:35:48.378131    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-must-gather-5jmhk_must-gather-xnhfm_775af8d8-dabf-423c-a8c8-73b3b187a2f0/gather/0.log"
Jun 15 07:35:49.161603 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:35:49.161565    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-d7tsl/must-gather-hlkzt"]
Jun 15 07:35:49.166283 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:35:49.166262    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-d7tsl/must-gather-hlkzt"
Jun 15 07:35:49.168903 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:35:49.168879    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-d7tsl\"/\"default-dockercfg-vgmh8\""
Jun 15 07:35:49.168903 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:35:49.168894    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-d7tsl\"/\"kube-root-ca.crt\""
Jun 15 07:35:49.169556 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:35:49.169541    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-d7tsl\"/\"openshift-service-ca.crt\""
Jun 15 07:35:49.177069 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:35:49.177050    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-d7tsl/must-gather-hlkzt"]
Jun 15 07:35:49.242433 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:35:49.242407    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pkss7\" (UniqueName: \"kubernetes.io/projected/65b8687a-988c-4d83-9cff-3c5da5117768-kube-api-access-pkss7\") pod \"must-gather-hlkzt\" (UID: \"65b8687a-988c-4d83-9cff-3c5da5117768\") " pod="openshift-must-gather-d7tsl/must-gather-hlkzt"
Jun 15 07:35:49.242598 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:35:49.242462    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/65b8687a-988c-4d83-9cff-3c5da5117768-must-gather-output\") pod \"must-gather-hlkzt\" (UID: \"65b8687a-988c-4d83-9cff-3c5da5117768\") " pod="openshift-must-gather-d7tsl/must-gather-hlkzt"
Jun 15 07:35:49.343477 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:35:49.343433    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/65b8687a-988c-4d83-9cff-3c5da5117768-must-gather-output\") pod \"must-gather-hlkzt\" (UID: \"65b8687a-988c-4d83-9cff-3c5da5117768\") " pod="openshift-must-gather-d7tsl/must-gather-hlkzt"
Jun 15 07:35:49.343622 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:35:49.343532    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pkss7\" (UniqueName: \"kubernetes.io/projected/65b8687a-988c-4d83-9cff-3c5da5117768-kube-api-access-pkss7\") pod \"must-gather-hlkzt\" (UID: \"65b8687a-988c-4d83-9cff-3c5da5117768\") " pod="openshift-must-gather-d7tsl/must-gather-hlkzt"
Jun 15 07:35:49.343761 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:35:49.343744    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/65b8687a-988c-4d83-9cff-3c5da5117768-must-gather-output\") pod \"must-gather-hlkzt\" (UID: \"65b8687a-988c-4d83-9cff-3c5da5117768\") " pod="openshift-must-gather-d7tsl/must-gather-hlkzt"
Jun 15 07:35:49.353484 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:35:49.353462    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pkss7\" (UniqueName: \"kubernetes.io/projected/65b8687a-988c-4d83-9cff-3c5da5117768-kube-api-access-pkss7\") pod \"must-gather-hlkzt\" (UID: \"65b8687a-988c-4d83-9cff-3c5da5117768\") " pod="openshift-must-gather-d7tsl/must-gather-hlkzt"
Jun 15 07:35:49.475975 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:35:49.475914    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-d7tsl/must-gather-hlkzt"
Jun 15 07:35:49.623474 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:35:49.623450    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-d7tsl/must-gather-hlkzt"]
Jun 15 07:35:49.624955 ip-10-0-128-243 kubenswrapper[2566]: W0615 07:35:49.624925    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod65b8687a_988c_4d83_9cff_3c5da5117768.slice/crio-85b0445e5a44b77adf512c459e5ffba88190c6b1a4a2a431bca5f634442da2c0 WatchSource:0}: Error finding container 85b0445e5a44b77adf512c459e5ffba88190c6b1a4a2a431bca5f634442da2c0: Status 404 returned error can't find the container with id 85b0445e5a44b77adf512c459e5ffba88190c6b1a4a2a431bca5f634442da2c0
Jun 15 07:35:50.453661 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:35:50.453582    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-d7tsl/must-gather-hlkzt" event={"ID":"65b8687a-988c-4d83-9cff-3c5da5117768","Type":"ContainerStarted","Data":"bcf0c7cadc9446c2ad866f28cbe28377f55dd475253f1e70694768dcdf4bddb7"}
Jun 15 07:35:50.453661 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:35:50.453636    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-d7tsl/must-gather-hlkzt" event={"ID":"65b8687a-988c-4d83-9cff-3c5da5117768","Type":"ContainerStarted","Data":"85b0445e5a44b77adf512c459e5ffba88190c6b1a4a2a431bca5f634442da2c0"}
Jun 15 07:35:51.463947 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:35:51.463901    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-d7tsl/must-gather-hlkzt" event={"ID":"65b8687a-988c-4d83-9cff-3c5da5117768","Type":"ContainerStarted","Data":"ce1b80d35b4cbbb0f5d8c05176133407f993b02ce3479d18211a1fc39c40d6a3"}
Jun 15 07:35:51.493186 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:35:51.493121    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-d7tsl/must-gather-hlkzt" podStartSLOduration=1.800879033 podStartE2EDuration="2.493098824s" totalImagesPullingTime="692.219791ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-15 07:35:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 07:35:51.492856649 +0000 UTC m=+6434.452613894" watchObservedRunningTime="2026-06-15 07:35:51.493098824 +0000 UTC m=+6434.452856069"
Jun 15 07:35:51.966707 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:35:51.966676    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-hpg5s_7a806cb5-1d94-4558-9a7a-a734123af31b/global-pull-secret-syncer/0.log"
Jun 15 07:35:52.230816 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:35:52.230740    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-xv9fc_9b076565-1f97-4867-a59b-23315d842e4e/konnectivity-agent/0.log"
Jun 15 07:35:52.301745 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:35:52.301714    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-128-243.ec2.internal_c8b2bbb1effaa631bc90559ca49e380a/haproxy/0.log"
Jun 15 07:35:53.998165 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:35:53.998120    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-must-gather-5jmhk/must-gather-xnhfm"]
Jun 15 07:35:53.998707 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:35:53.998361    2566 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-must-gather-5jmhk/must-gather-xnhfm" podUID="775af8d8-dabf-423c-a8c8-73b3b187a2f0" containerName="copy" containerID="cri-o://c9534bfdffa8bbf5b95403c58a6bf5704ee411422435dd6a8ba1963482552ce8" gracePeriod=2
Jun 15 07:35:54.000872 ip-10-0-128-243 kubenswrapper[2566]: E0615 07:35:54.000663    2566 status_manager.go:1018] "Failed to get status for pod" err="pods \"must-gather-xnhfm\" is forbidden: User \"system:node:ip-10-0-128-243.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-must-gather-5jmhk\": no relationship found between node 'ip-10-0-128-243.ec2.internal' and this object" podUID="775af8d8-dabf-423c-a8c8-73b3b187a2f0" pod="openshift-must-gather-5jmhk/must-gather-xnhfm"
Jun 15 07:35:54.004193 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:35:54.002060    2566 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-must-gather-5jmhk/must-gather-xnhfm"]
Jun 15 07:35:54.407599 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:35:54.407565    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-must-gather-5jmhk_must-gather-xnhfm_775af8d8-dabf-423c-a8c8-73b3b187a2f0/copy/0.log"
Jun 15 07:35:54.416204 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:35:54.415822    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-5jmhk/must-gather-xnhfm"
Jun 15 07:35:54.423105 ip-10-0-128-243 kubenswrapper[2566]: E0615 07:35:54.419273    2566 status_manager.go:1018] "Failed to get status for pod" err="pods \"must-gather-xnhfm\" is forbidden: User \"system:node:ip-10-0-128-243.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-must-gather-5jmhk\": no relationship found between node 'ip-10-0-128-243.ec2.internal' and this object" podUID="775af8d8-dabf-423c-a8c8-73b3b187a2f0" pod="openshift-must-gather-5jmhk/must-gather-xnhfm"
Jun 15 07:35:54.488278 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:35:54.488230    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-must-gather-5jmhk_must-gather-xnhfm_775af8d8-dabf-423c-a8c8-73b3b187a2f0/copy/0.log"
Jun 15 07:35:54.488661 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:35:54.488601    2566 generic.go:356] "Generic (PLEG): container finished" podID="775af8d8-dabf-423c-a8c8-73b3b187a2f0" containerID="c9534bfdffa8bbf5b95403c58a6bf5704ee411422435dd6a8ba1963482552ce8" exitCode=143
Jun 15 07:35:54.488778 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:35:54.488725    2566 scope.go:117] "RemoveContainer" containerID="c9534bfdffa8bbf5b95403c58a6bf5704ee411422435dd6a8ba1963482552ce8"
Jun 15 07:35:54.488938 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:35:54.488881    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-5jmhk/must-gather-xnhfm"
Jun 15 07:35:54.492100 ip-10-0-128-243 kubenswrapper[2566]: E0615 07:35:54.492056    2566 status_manager.go:1018] "Failed to get status for pod" err="pods \"must-gather-xnhfm\" is forbidden: User \"system:node:ip-10-0-128-243.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-must-gather-5jmhk\": no relationship found between node 'ip-10-0-128-243.ec2.internal' and this object" podUID="775af8d8-dabf-423c-a8c8-73b3b187a2f0" pod="openshift-must-gather-5jmhk/must-gather-xnhfm"
Jun 15 07:35:54.506479 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:35:54.506386    2566 scope.go:117] "RemoveContainer" containerID="b7ff3d400dac18e4b55ccc9e12ceb6fbf0dc13f4ebcf287bdd989dfe80643a4d"
Jun 15 07:35:54.536989 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:35:54.536956    2566 scope.go:117] "RemoveContainer" containerID="c9534bfdffa8bbf5b95403c58a6bf5704ee411422435dd6a8ba1963482552ce8"
Jun 15 07:35:54.537427 ip-10-0-128-243 kubenswrapper[2566]: E0615 07:35:54.537395    2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c9534bfdffa8bbf5b95403c58a6bf5704ee411422435dd6a8ba1963482552ce8\": container with ID starting with c9534bfdffa8bbf5b95403c58a6bf5704ee411422435dd6a8ba1963482552ce8 not found: ID does not exist" containerID="c9534bfdffa8bbf5b95403c58a6bf5704ee411422435dd6a8ba1963482552ce8"
Jun 15 07:35:54.537540 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:35:54.537441    2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c9534bfdffa8bbf5b95403c58a6bf5704ee411422435dd6a8ba1963482552ce8"} err="failed to get container status \"c9534bfdffa8bbf5b95403c58a6bf5704ee411422435dd6a8ba1963482552ce8\": rpc error: code = NotFound desc = could not find container \"c9534bfdffa8bbf5b95403c58a6bf5704ee411422435dd6a8ba1963482552ce8\": container with ID starting with c9534bfdffa8bbf5b95403c58a6bf5704ee411422435dd6a8ba1963482552ce8 not found: ID does not exist"
Jun 15 07:35:54.537540 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:35:54.537469    2566 scope.go:117] "RemoveContainer" containerID="b7ff3d400dac18e4b55ccc9e12ceb6fbf0dc13f4ebcf287bdd989dfe80643a4d"
Jun 15 07:35:54.538135 ip-10-0-128-243 kubenswrapper[2566]: E0615 07:35:54.538107    2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b7ff3d400dac18e4b55ccc9e12ceb6fbf0dc13f4ebcf287bdd989dfe80643a4d\": container with ID starting with b7ff3d400dac18e4b55ccc9e12ceb6fbf0dc13f4ebcf287bdd989dfe80643a4d not found: ID does not exist" containerID="b7ff3d400dac18e4b55ccc9e12ceb6fbf0dc13f4ebcf287bdd989dfe80643a4d"
Jun 15 07:35:54.538268 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:35:54.538145    2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b7ff3d400dac18e4b55ccc9e12ceb6fbf0dc13f4ebcf287bdd989dfe80643a4d"} err="failed to get container status \"b7ff3d400dac18e4b55ccc9e12ceb6fbf0dc13f4ebcf287bdd989dfe80643a4d\": rpc error: code = NotFound desc = could not find container \"b7ff3d400dac18e4b55ccc9e12ceb6fbf0dc13f4ebcf287bdd989dfe80643a4d\": container with ID starting with b7ff3d400dac18e4b55ccc9e12ceb6fbf0dc13f4ebcf287bdd989dfe80643a4d not found: ID does not exist"
Jun 15 07:35:54.592882 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:35:54.592837    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/775af8d8-dabf-423c-a8c8-73b3b187a2f0-must-gather-output\") pod \"775af8d8-dabf-423c-a8c8-73b3b187a2f0\" (UID: \"775af8d8-dabf-423c-a8c8-73b3b187a2f0\") "
Jun 15 07:35:54.593355 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:35:54.593301    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2kqvv\" (UniqueName: \"kubernetes.io/projected/775af8d8-dabf-423c-a8c8-73b3b187a2f0-kube-api-access-2kqvv\") pod \"775af8d8-dabf-423c-a8c8-73b3b187a2f0\" (UID: \"775af8d8-dabf-423c-a8c8-73b3b187a2f0\") "
Jun 15 07:35:54.608404 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:35:54.608354    2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/775af8d8-dabf-423c-a8c8-73b3b187a2f0-kube-api-access-2kqvv" (OuterVolumeSpecName: "kube-api-access-2kqvv") pod "775af8d8-dabf-423c-a8c8-73b3b187a2f0" (UID: "775af8d8-dabf-423c-a8c8-73b3b187a2f0"). InnerVolumeSpecName "kube-api-access-2kqvv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jun 15 07:35:54.615911 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:35:54.615872    2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/775af8d8-dabf-423c-a8c8-73b3b187a2f0-must-gather-output" (OuterVolumeSpecName: "must-gather-output") pod "775af8d8-dabf-423c-a8c8-73b3b187a2f0" (UID: "775af8d8-dabf-423c-a8c8-73b3b187a2f0"). InnerVolumeSpecName "must-gather-output". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jun 15 07:35:54.694730 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:35:54.694685    2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2kqvv\" (UniqueName: \"kubernetes.io/projected/775af8d8-dabf-423c-a8c8-73b3b187a2f0-kube-api-access-2kqvv\") on node \"ip-10-0-128-243.ec2.internal\" DevicePath \"\""
Jun 15 07:35:54.694983 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:35:54.694956    2566 reconciler_common.go:299] "Volume detached for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/775af8d8-dabf-423c-a8c8-73b3b187a2f0-must-gather-output\") on node \"ip-10-0-128-243.ec2.internal\" DevicePath \"\""
Jun 15 07:35:54.806872 ip-10-0-128-243 kubenswrapper[2566]: E0615 07:35:54.806824    2566 status_manager.go:1018] "Failed to get status for pod" err="pods \"must-gather-xnhfm\" is forbidden: User \"system:node:ip-10-0-128-243.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-must-gather-5jmhk\": no relationship found between node 'ip-10-0-128-243.ec2.internal' and this object" podUID="775af8d8-dabf-423c-a8c8-73b3b187a2f0" pod="openshift-must-gather-5jmhk/must-gather-xnhfm"
Jun 15 07:35:55.444966 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:35:55.444931    2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="775af8d8-dabf-423c-a8c8-73b3b187a2f0" path="/var/lib/kubelet/pods/775af8d8-dabf-423c-a8c8-73b3b187a2f0/volumes"
Jun 15 07:35:56.735234 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:35:56.735199    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-686db986cb-n5rxl_82db39b0-d5da-43ef-8722-238f3f7cfeed/authorino/0.log"
Jun 15 07:35:56.842306 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:35:56.842276    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-7dbb555447-w6b6b_e1a93313-40c4-40c9-a035-6066ffed7081/kuadrant-console-plugin/0.log"
Jun 15 07:35:58.792139 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:35:58.792068    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-f9d7df769-jlxrk_90916cd7-e2d5-4583-b5d6-8b254c9d091d/cluster-monitoring-operator/0.log"
Jun 15 07:35:59.097392 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:35:59.097313    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-kxn65_309faaf7-95ec-4874-864b-96aa5a898a38/node-exporter/0.log"
Jun 15 07:35:59.142066 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:35:59.142020    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-kxn65_309faaf7-95ec-4874-864b-96aa5a898a38/kube-rbac-proxy/0.log"
Jun 15 07:35:59.183824 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:35:59.183713    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-kxn65_309faaf7-95ec-4874-864b-96aa5a898a38/init-textfile/0.log"
Jun 15 07:36:02.121637 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:36:02.121596    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-867b76cb74-qhtzq_18d62d01-84af-4660-af23-86aebdd4f714/networking-console-plugin/0.log"
Jun 15 07:36:02.453753 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:36:02.453661    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-d7tsl/perf-node-gather-daemonset-t225d"]
Jun 15 07:36:02.454218 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:36:02.454193    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="775af8d8-dabf-423c-a8c8-73b3b187a2f0" containerName="gather"
Jun 15 07:36:02.454218 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:36:02.454218    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="775af8d8-dabf-423c-a8c8-73b3b187a2f0" containerName="gather"
Jun 15 07:36:02.454416 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:36:02.454241    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="775af8d8-dabf-423c-a8c8-73b3b187a2f0" containerName="copy"
Jun 15 07:36:02.454416 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:36:02.454249    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="775af8d8-dabf-423c-a8c8-73b3b187a2f0" containerName="copy"
Jun 15 07:36:02.454416 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:36:02.454369    2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="775af8d8-dabf-423c-a8c8-73b3b187a2f0" containerName="copy"
Jun 15 07:36:02.454416 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:36:02.454382    2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="775af8d8-dabf-423c-a8c8-73b3b187a2f0" containerName="gather"
Jun 15 07:36:02.458067 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:36:02.458042    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-d7tsl/perf-node-gather-daemonset-t225d"
Jun 15 07:36:02.472491 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:36:02.472462    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-d7tsl/perf-node-gather-daemonset-t225d"]
Jun 15 07:36:02.571782 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:36:02.571750    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-72rx8\" (UniqueName: \"kubernetes.io/projected/b0e3cee2-c6a7-4ddb-91f2-4882686d3f43-kube-api-access-72rx8\") pod \"perf-node-gather-daemonset-t225d\" (UID: \"b0e3cee2-c6a7-4ddb-91f2-4882686d3f43\") " pod="openshift-must-gather-d7tsl/perf-node-gather-daemonset-t225d"
Jun 15 07:36:02.571968 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:36:02.571795    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/b0e3cee2-c6a7-4ddb-91f2-4882686d3f43-lib-modules\") pod \"perf-node-gather-daemonset-t225d\" (UID: \"b0e3cee2-c6a7-4ddb-91f2-4882686d3f43\") " pod="openshift-must-gather-d7tsl/perf-node-gather-daemonset-t225d"
Jun 15 07:36:02.571968 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:36:02.571855    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/b0e3cee2-c6a7-4ddb-91f2-4882686d3f43-proc\") pod \"perf-node-gather-daemonset-t225d\" (UID: \"b0e3cee2-c6a7-4ddb-91f2-4882686d3f43\") " pod="openshift-must-gather-d7tsl/perf-node-gather-daemonset-t225d"
Jun 15 07:36:02.571968 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:36:02.571885    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/b0e3cee2-c6a7-4ddb-91f2-4882686d3f43-podres\") pod \"perf-node-gather-daemonset-t225d\" (UID: \"b0e3cee2-c6a7-4ddb-91f2-4882686d3f43\") " pod="openshift-must-gather-d7tsl/perf-node-gather-daemonset-t225d"
Jun 15 07:36:02.571968 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:36:02.571927    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b0e3cee2-c6a7-4ddb-91f2-4882686d3f43-sys\") pod \"perf-node-gather-daemonset-t225d\" (UID: \"b0e3cee2-c6a7-4ddb-91f2-4882686d3f43\") " pod="openshift-must-gather-d7tsl/perf-node-gather-daemonset-t225d"
Jun 15 07:36:02.672406 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:36:02.672372    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-72rx8\" (UniqueName: \"kubernetes.io/projected/b0e3cee2-c6a7-4ddb-91f2-4882686d3f43-kube-api-access-72rx8\") pod \"perf-node-gather-daemonset-t225d\" (UID: \"b0e3cee2-c6a7-4ddb-91f2-4882686d3f43\") " pod="openshift-must-gather-d7tsl/perf-node-gather-daemonset-t225d"
Jun 15 07:36:02.672602 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:36:02.672422    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/b0e3cee2-c6a7-4ddb-91f2-4882686d3f43-lib-modules\") pod \"perf-node-gather-daemonset-t225d\" (UID: \"b0e3cee2-c6a7-4ddb-91f2-4882686d3f43\") " pod="openshift-must-gather-d7tsl/perf-node-gather-daemonset-t225d"
Jun 15 07:36:02.672602 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:36:02.672480    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/b0e3cee2-c6a7-4ddb-91f2-4882686d3f43-proc\") pod \"perf-node-gather-daemonset-t225d\" (UID: \"b0e3cee2-c6a7-4ddb-91f2-4882686d3f43\") " pod="openshift-must-gather-d7tsl/perf-node-gather-daemonset-t225d"
Jun 15 07:36:02.672602 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:36:02.672516    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/b0e3cee2-c6a7-4ddb-91f2-4882686d3f43-podres\") pod \"perf-node-gather-daemonset-t225d\" (UID: \"b0e3cee2-c6a7-4ddb-91f2-4882686d3f43\") " pod="openshift-must-gather-d7tsl/perf-node-gather-daemonset-t225d"
Jun 15 07:36:02.672602 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:36:02.672561    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/b0e3cee2-c6a7-4ddb-91f2-4882686d3f43-lib-modules\") pod \"perf-node-gather-daemonset-t225d\" (UID: \"b0e3cee2-c6a7-4ddb-91f2-4882686d3f43\") " pod="openshift-must-gather-d7tsl/perf-node-gather-daemonset-t225d"
Jun 15 07:36:02.672602 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:36:02.672565    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b0e3cee2-c6a7-4ddb-91f2-4882686d3f43-sys\") pod \"perf-node-gather-daemonset-t225d\" (UID: \"b0e3cee2-c6a7-4ddb-91f2-4882686d3f43\") " pod="openshift-must-gather-d7tsl/perf-node-gather-daemonset-t225d"
Jun 15 07:36:02.672602 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:36:02.672590    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/b0e3cee2-c6a7-4ddb-91f2-4882686d3f43-proc\") pod \"perf-node-gather-daemonset-t225d\" (UID: \"b0e3cee2-c6a7-4ddb-91f2-4882686d3f43\") " pod="openshift-must-gather-d7tsl/perf-node-gather-daemonset-t225d"
Jun 15 07:36:02.672942 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:36:02.672611    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b0e3cee2-c6a7-4ddb-91f2-4882686d3f43-sys\") pod \"perf-node-gather-daemonset-t225d\" (UID: \"b0e3cee2-c6a7-4ddb-91f2-4882686d3f43\") " pod="openshift-must-gather-d7tsl/perf-node-gather-daemonset-t225d"
Jun 15 07:36:02.672942 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:36:02.672691    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/b0e3cee2-c6a7-4ddb-91f2-4882686d3f43-podres\") pod \"perf-node-gather-daemonset-t225d\" (UID: \"b0e3cee2-c6a7-4ddb-91f2-4882686d3f43\") " pod="openshift-must-gather-d7tsl/perf-node-gather-daemonset-t225d"
Jun 15 07:36:02.683175 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:36:02.683140    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-72rx8\" (UniqueName: \"kubernetes.io/projected/b0e3cee2-c6a7-4ddb-91f2-4882686d3f43-kube-api-access-72rx8\") pod \"perf-node-gather-daemonset-t225d\" (UID: \"b0e3cee2-c6a7-4ddb-91f2-4882686d3f43\") " pod="openshift-must-gather-d7tsl/perf-node-gather-daemonset-t225d"
Jun 15 07:36:02.735298 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:36:02.735219    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5dbbb5d744-ktjgp_67da60eb-27f9-4bbd-8d12-64275e801143/console-operator/2.log"
Jun 15 07:36:02.742814 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:36:02.742738    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5dbbb5d744-ktjgp_67da60eb-27f9-4bbd-8d12-64275e801143/console-operator/3.log"
Jun 15 07:36:02.772186 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:36:02.771434    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-d7tsl/perf-node-gather-daemonset-t225d"
Jun 15 07:36:02.943603 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:36:02.943556    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-d7tsl/perf-node-gather-daemonset-t225d"]
Jun 15 07:36:02.944649 ip-10-0-128-243 kubenswrapper[2566]: W0615 07:36:02.944616    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podb0e3cee2_c6a7_4ddb_91f2_4882686d3f43.slice/crio-bc92bd0c6b65a9a7e8569cc039abc1be8ea325044fe69140b2e374bc8f715e40 WatchSource:0}: Error finding container bc92bd0c6b65a9a7e8569cc039abc1be8ea325044fe69140b2e374bc8f715e40: Status 404 returned error can't find the container with id bc92bd0c6b65a9a7e8569cc039abc1be8ea325044fe69140b2e374bc8f715e40
Jun 15 07:36:03.560535 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:36:03.560498    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-d7tsl/perf-node-gather-daemonset-t225d" event={"ID":"b0e3cee2-c6a7-4ddb-91f2-4882686d3f43","Type":"ContainerStarted","Data":"c14d9b196be489108dee5fd790e05dcef7d3cc22bb0102ad176f79b48354e156"}
Jun 15 07:36:03.560901 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:36:03.560561    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-d7tsl/perf-node-gather-daemonset-t225d" event={"ID":"b0e3cee2-c6a7-4ddb-91f2-4882686d3f43","Type":"ContainerStarted","Data":"bc92bd0c6b65a9a7e8569cc039abc1be8ea325044fe69140b2e374bc8f715e40"}
Jun 15 07:36:03.560901 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:36:03.560615    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-d7tsl/perf-node-gather-daemonset-t225d"
Jun 15 07:36:03.581846 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:36:03.581788    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-d7tsl/perf-node-gather-daemonset-t225d" podStartSLOduration=1.58176848 podStartE2EDuration="1.58176848s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-15 07:36:02 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 07:36:03.579749845 +0000 UTC m=+6446.539507110" watchObservedRunningTime="2026-06-15 07:36:03.58176848 +0000 UTC m=+6446.541525726"
Jun 15 07:36:04.016641 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:36:04.016608    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-bd4ccd799-2556x_b1bd12ae-f8b5-4d48-bced-c60779b6f7c6/volume-data-source-validator/0.log"
Jun 15 07:36:05.290704 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:36:05.290671    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-smfqb_477f44b3-0328-417c-a5db-442ea835eb70/dns/0.log"
Jun 15 07:36:05.322383 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:36:05.322354    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-smfqb_477f44b3-0328-417c-a5db-442ea835eb70/kube-rbac-proxy/0.log"
Jun 15 07:36:05.498808 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:36:05.498782    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-n8bz5_c1ebb64e-4a47-4507-b619-32502fb528ca/dns-node-resolver/0.log"
Jun 15 07:36:06.244584 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:36:06.244546    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-frzbm_2e630a88-8b65-4dd7-970d-cfd8e5d031c6/node-ca/0.log"
Jun 15 07:36:08.533268 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:36:08.533238    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-8bdfdcbd8-4fc26_3b8ee52d-b179-492b-960c-b978e06cd8a7/router/0.log"
Jun 15 07:36:09.149546 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:36:09.149518    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-9gk6x_dc5c749d-22b4-461f-8c24-9da0f33c52f7/serve-healthcheck-canary/0.log"
Jun 15 07:36:09.581189 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:36:09.581153    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-d7tsl/perf-node-gather-daemonset-t225d"
Jun 15 07:36:09.715674 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:36:09.715638    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-5bbd86d6bd-4bc2h_12ada117-da7b-47e4-bab9-92368a63edf8/insights-operator/0.log"
Jun 15 07:36:09.718313 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:36:09.718270    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-5bbd86d6bd-4bc2h_12ada117-da7b-47e4-bab9-92368a63edf8/insights-operator/1.log"
Jun 15 07:36:10.011400 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:36:10.011368    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-sfxtc_06cb31df-a606-4e81-ae47-a49ee7dd6083/kube-rbac-proxy/0.log"
Jun 15 07:36:10.035719 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:36:10.035689    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-sfxtc_06cb31df-a606-4e81-ae47-a49ee7dd6083/exporter/0.log"
Jun 15 07:36:10.060353 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:36:10.060313    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-sfxtc_06cb31df-a606-4e81-ae47-a49ee7dd6083/extractor/0.log"
Jun 15 07:36:13.331814 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:36:13.331780    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-74f47976d9-pw9bq_3270b170-9c07-47e3-b8fa-3b8cdbfbcf10/manager/0.log"
Jun 15 07:36:13.396230 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:36:13.396198    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_openshift-lws-operator-fd8ccff4c-d9kj2_ed12ca90-c9df-4952-b12f-148a722dbd7b/openshift-lws-operator/0.log"
Jun 15 07:36:14.147041 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:36:14.146936    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve_llmisvc-controller-manager-795c469f5-x2dlk_9a72041b-90bb-4524-a293-dc0d3dbd87e2/manager/0.log"
Jun 15 07:36:14.736979 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:36:14.736950    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve_seaweedfs-64568bcd49-7b68h_9d0c9047-a4e3-4d33-b25d-7bc100346ca9/seaweedfs/0.log"
Jun 15 07:36:18.055406 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:36:18.055372    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-8bdfdcbd8-4fc26_3b8ee52d-b179-492b-960c-b978e06cd8a7/router/0.log"
Jun 15 07:36:20.103530 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:36:20.103493    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-8bdfdcbd8-4fc26_3b8ee52d-b179-492b-960c-b978e06cd8a7/router/0.log"
Jun 15 07:36:20.610925 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:36:20.610889    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-7c578b78fc-pr6nz_0ed3f738-1daf-4d28-8c14-3c7b5139e7dd/kube-storage-version-migrator-operator/1.log"
Jun 15 07:36:20.612796 ip-10-0-128-243 kubenswrapper[2566]: I0615 07:36:20.612723    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-7c578b78fc-pr6nz_0ed3f738-1daf-4d28-8c14-3c7b5139e7dd/kube-storage-version-migrator-operator/0.log"