May 25 11:15:07.139158 ip-10-0-143-46 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory
May 25 11:15:07.139166 ip-10-0-143-46 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory
May 25 11:15:07.139173 ip-10-0-143-46 systemd[1]: kubelet.service: Failed with result 'resources'.
May 25 11:15:07.139376 ip-10-0-143-46 systemd[1]: Failed to start Kubernetes Kubelet.
May 25 11:15:17.293057 ip-10-0-143-46 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found.
May 25 11:15:17.293093 ip-10-0-143-46 systemd[1]: kubelet.service: Failed with result 'resources'.
-- Boot d4635450d8dc4f35a93e00b5a6533b48 --
May 25 11:17:41.015063 ip-10-0-143-46 systemd[1]: Starting Kubernetes Kubelet...
May 25 11:17:41.472618 ip-10-0-143-46 kubenswrapper[2569]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
May 25 11:17:41.472618 ip-10-0-143-46 kubenswrapper[2569]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
May 25 11:17:41.472618 ip-10-0-143-46 kubenswrapper[2569]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
May 25 11:17:41.472618 ip-10-0-143-46 kubenswrapper[2569]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
May 25 11:17:41.472618 ip-10-0-143-46 kubenswrapper[2569]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
May 25 11:17:41.475347 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:17:41.475254    2569 server.go:212] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
May 25 11:17:41.480913 ip-10-0-143-46 kubenswrapper[2569]: W0525 11:17:41.480889    2569 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
May 25 11:17:41.480913 ip-10-0-143-46 kubenswrapper[2569]: W0525 11:17:41.480909    2569 feature_gate.go:328] unrecognized feature gate: InsightsConfig
May 25 11:17:41.480913 ip-10-0-143-46 kubenswrapper[2569]: W0525 11:17:41.480913    2569 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI
May 25 11:17:41.480913 ip-10-0-143-46 kubenswrapper[2569]: W0525 11:17:41.480917    2569 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS
May 25 11:17:41.480913 ip-10-0-143-46 kubenswrapper[2569]: W0525 11:17:41.480920    2569 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
May 25 11:17:41.481110 ip-10-0-143-46 kubenswrapper[2569]: W0525 11:17:41.480923    2569 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
May 25 11:17:41.481110 ip-10-0-143-46 kubenswrapper[2569]: W0525 11:17:41.480927    2569 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
May 25 11:17:41.481110 ip-10-0-143-46 kubenswrapper[2569]: W0525 11:17:41.480931    2569 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
May 25 11:17:41.481110 ip-10-0-143-46 kubenswrapper[2569]: W0525 11:17:41.480933    2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
May 25 11:17:41.481110 ip-10-0-143-46 kubenswrapper[2569]: W0525 11:17:41.480936    2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
May 25 11:17:41.481110 ip-10-0-143-46 kubenswrapper[2569]: W0525 11:17:41.480939    2569 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
May 25 11:17:41.481110 ip-10-0-143-46 kubenswrapper[2569]: W0525 11:17:41.480942    2569 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
May 25 11:17:41.481110 ip-10-0-143-46 kubenswrapper[2569]: W0525 11:17:41.480944    2569 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
May 25 11:17:41.481110 ip-10-0-143-46 kubenswrapper[2569]: W0525 11:17:41.480947    2569 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
May 25 11:17:41.481110 ip-10-0-143-46 kubenswrapper[2569]: W0525 11:17:41.480949    2569 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
May 25 11:17:41.481110 ip-10-0-143-46 kubenswrapper[2569]: W0525 11:17:41.480952    2569 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
May 25 11:17:41.481110 ip-10-0-143-46 kubenswrapper[2569]: W0525 11:17:41.480955    2569 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
May 25 11:17:41.481110 ip-10-0-143-46 kubenswrapper[2569]: W0525 11:17:41.480958    2569 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
May 25 11:17:41.481110 ip-10-0-143-46 kubenswrapper[2569]: W0525 11:17:41.480962    2569 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
May 25 11:17:41.481110 ip-10-0-143-46 kubenswrapper[2569]: W0525 11:17:41.480966    2569 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
May 25 11:17:41.481110 ip-10-0-143-46 kubenswrapper[2569]: W0525 11:17:41.480969    2569 feature_gate.go:328] unrecognized feature gate: NewOLM
May 25 11:17:41.481110 ip-10-0-143-46 kubenswrapper[2569]: W0525 11:17:41.480973    2569 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
May 25 11:17:41.481110 ip-10-0-143-46 kubenswrapper[2569]: W0525 11:17:41.480976    2569 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
May 25 11:17:41.481110 ip-10-0-143-46 kubenswrapper[2569]: W0525 11:17:41.480979    2569 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
May 25 11:17:41.481553 ip-10-0-143-46 kubenswrapper[2569]: W0525 11:17:41.480982    2569 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
May 25 11:17:41.481553 ip-10-0-143-46 kubenswrapper[2569]: W0525 11:17:41.480988    2569 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
May 25 11:17:41.481553 ip-10-0-143-46 kubenswrapper[2569]: W0525 11:17:41.480991    2569 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
May 25 11:17:41.481553 ip-10-0-143-46 kubenswrapper[2569]: W0525 11:17:41.480994    2569 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
May 25 11:17:41.481553 ip-10-0-143-46 kubenswrapper[2569]: W0525 11:17:41.480997    2569 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
May 25 11:17:41.481553 ip-10-0-143-46 kubenswrapper[2569]: W0525 11:17:41.481000    2569 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
May 25 11:17:41.481553 ip-10-0-143-46 kubenswrapper[2569]: W0525 11:17:41.481003    2569 feature_gate.go:328] unrecognized feature gate: SignatureStores
May 25 11:17:41.481553 ip-10-0-143-46 kubenswrapper[2569]: W0525 11:17:41.481006    2569 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
May 25 11:17:41.481553 ip-10-0-143-46 kubenswrapper[2569]: W0525 11:17:41.481009    2569 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
May 25 11:17:41.481553 ip-10-0-143-46 kubenswrapper[2569]: W0525 11:17:41.481012    2569 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
May 25 11:17:41.481553 ip-10-0-143-46 kubenswrapper[2569]: W0525 11:17:41.481016    2569 feature_gate.go:328] unrecognized feature gate: Example2
May 25 11:17:41.481553 ip-10-0-143-46 kubenswrapper[2569]: W0525 11:17:41.481019    2569 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
May 25 11:17:41.481553 ip-10-0-143-46 kubenswrapper[2569]: W0525 11:17:41.481022    2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
May 25 11:17:41.481553 ip-10-0-143-46 kubenswrapper[2569]: W0525 11:17:41.481025    2569 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
May 25 11:17:41.481553 ip-10-0-143-46 kubenswrapper[2569]: W0525 11:17:41.481028    2569 feature_gate.go:328] unrecognized feature gate: GatewayAPI
May 25 11:17:41.481553 ip-10-0-143-46 kubenswrapper[2569]: W0525 11:17:41.481031    2569 feature_gate.go:328] unrecognized feature gate: PinnedImages
May 25 11:17:41.481553 ip-10-0-143-46 kubenswrapper[2569]: W0525 11:17:41.481035    2569 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
May 25 11:17:41.481553 ip-10-0-143-46 kubenswrapper[2569]: W0525 11:17:41.481038    2569 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
May 25 11:17:41.481553 ip-10-0-143-46 kubenswrapper[2569]: W0525 11:17:41.481040    2569 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
May 25 11:17:41.481553 ip-10-0-143-46 kubenswrapper[2569]: W0525 11:17:41.481043    2569 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
May 25 11:17:41.482075 ip-10-0-143-46 kubenswrapper[2569]: W0525 11:17:41.481046    2569 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
May 25 11:17:41.482075 ip-10-0-143-46 kubenswrapper[2569]: W0525 11:17:41.481049    2569 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
May 25 11:17:41.482075 ip-10-0-143-46 kubenswrapper[2569]: W0525 11:17:41.481051    2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
May 25 11:17:41.482075 ip-10-0-143-46 kubenswrapper[2569]: W0525 11:17:41.481054    2569 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations
May 25 11:17:41.482075 ip-10-0-143-46 kubenswrapper[2569]: W0525 11:17:41.481057    2569 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
May 25 11:17:41.482075 ip-10-0-143-46 kubenswrapper[2569]: W0525 11:17:41.481059    2569 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
May 25 11:17:41.482075 ip-10-0-143-46 kubenswrapper[2569]: W0525 11:17:41.481062    2569 feature_gate.go:328] unrecognized feature gate: Example
May 25 11:17:41.482075 ip-10-0-143-46 kubenswrapper[2569]: W0525 11:17:41.481064    2569 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
May 25 11:17:41.482075 ip-10-0-143-46 kubenswrapper[2569]: W0525 11:17:41.481067    2569 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
May 25 11:17:41.482075 ip-10-0-143-46 kubenswrapper[2569]: W0525 11:17:41.481070    2569 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
May 25 11:17:41.482075 ip-10-0-143-46 kubenswrapper[2569]: W0525 11:17:41.481073    2569 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
May 25 11:17:41.482075 ip-10-0-143-46 kubenswrapper[2569]: W0525 11:17:41.481075    2569 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
May 25 11:17:41.482075 ip-10-0-143-46 kubenswrapper[2569]: W0525 11:17:41.481077    2569 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
May 25 11:17:41.482075 ip-10-0-143-46 kubenswrapper[2569]: W0525 11:17:41.481081    2569 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
May 25 11:17:41.482075 ip-10-0-143-46 kubenswrapper[2569]: W0525 11:17:41.481083    2569 feature_gate.go:328] unrecognized feature gate: OVNObservability
May 25 11:17:41.482075 ip-10-0-143-46 kubenswrapper[2569]: W0525 11:17:41.481086    2569 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
May 25 11:17:41.482075 ip-10-0-143-46 kubenswrapper[2569]: W0525 11:17:41.481088    2569 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
May 25 11:17:41.482075 ip-10-0-143-46 kubenswrapper[2569]: W0525 11:17:41.481091    2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
May 25 11:17:41.482075 ip-10-0-143-46 kubenswrapper[2569]: W0525 11:17:41.481093    2569 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
May 25 11:17:41.482075 ip-10-0-143-46 kubenswrapper[2569]: W0525 11:17:41.481096    2569 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
May 25 11:17:41.482555 ip-10-0-143-46 kubenswrapper[2569]: W0525 11:17:41.481098    2569 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
May 25 11:17:41.482555 ip-10-0-143-46 kubenswrapper[2569]: W0525 11:17:41.481101    2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
May 25 11:17:41.482555 ip-10-0-143-46 kubenswrapper[2569]: W0525 11:17:41.481103    2569 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
May 25 11:17:41.482555 ip-10-0-143-46 kubenswrapper[2569]: W0525 11:17:41.481106    2569 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
May 25 11:17:41.482555 ip-10-0-143-46 kubenswrapper[2569]: W0525 11:17:41.481108    2569 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
May 25 11:17:41.482555 ip-10-0-143-46 kubenswrapper[2569]: W0525 11:17:41.481111    2569 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
May 25 11:17:41.482555 ip-10-0-143-46 kubenswrapper[2569]: W0525 11:17:41.481115    2569 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
May 25 11:17:41.482555 ip-10-0-143-46 kubenswrapper[2569]: W0525 11:17:41.481118    2569 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
May 25 11:17:41.482555 ip-10-0-143-46 kubenswrapper[2569]: W0525 11:17:41.481122    2569 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
May 25 11:17:41.482555 ip-10-0-143-46 kubenswrapper[2569]: W0525 11:17:41.481125    2569 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
May 25 11:17:41.482555 ip-10-0-143-46 kubenswrapper[2569]: W0525 11:17:41.481128    2569 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
May 25 11:17:41.482555 ip-10-0-143-46 kubenswrapper[2569]: W0525 11:17:41.481131    2569 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
May 25 11:17:41.482555 ip-10-0-143-46 kubenswrapper[2569]: W0525 11:17:41.481134    2569 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
May 25 11:17:41.482555 ip-10-0-143-46 kubenswrapper[2569]: W0525 11:17:41.481136    2569 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
May 25 11:17:41.482555 ip-10-0-143-46 kubenswrapper[2569]: W0525 11:17:41.481140    2569 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController
May 25 11:17:41.482555 ip-10-0-143-46 kubenswrapper[2569]: W0525 11:17:41.481142    2569 feature_gate.go:328] unrecognized feature gate: DualReplica
May 25 11:17:41.482555 ip-10-0-143-46 kubenswrapper[2569]: W0525 11:17:41.481145    2569 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
May 25 11:17:41.482555 ip-10-0-143-46 kubenswrapper[2569]: W0525 11:17:41.481148    2569 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
May 25 11:17:41.482555 ip-10-0-143-46 kubenswrapper[2569]: W0525 11:17:41.481150    2569 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
May 25 11:17:41.482555 ip-10-0-143-46 kubenswrapper[2569]: W0525 11:17:41.481153    2569 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
May 25 11:17:41.483086 ip-10-0-143-46 kubenswrapper[2569]: W0525 11:17:41.481156    2569 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
May 25 11:17:41.483086 ip-10-0-143-46 kubenswrapper[2569]: W0525 11:17:41.481158    2569 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
May 25 11:17:41.483086 ip-10-0-143-46 kubenswrapper[2569]: W0525 11:17:41.481565    2569 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
May 25 11:17:41.483086 ip-10-0-143-46 kubenswrapper[2569]: W0525 11:17:41.481571    2569 feature_gate.go:328] unrecognized feature gate: OVNObservability
May 25 11:17:41.483086 ip-10-0-143-46 kubenswrapper[2569]: W0525 11:17:41.481573    2569 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
May 25 11:17:41.483086 ip-10-0-143-46 kubenswrapper[2569]: W0525 11:17:41.481577    2569 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
May 25 11:17:41.483086 ip-10-0-143-46 kubenswrapper[2569]: W0525 11:17:41.481579    2569 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
May 25 11:17:41.483086 ip-10-0-143-46 kubenswrapper[2569]: W0525 11:17:41.481582    2569 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
May 25 11:17:41.483086 ip-10-0-143-46 kubenswrapper[2569]: W0525 11:17:41.481585    2569 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
May 25 11:17:41.483086 ip-10-0-143-46 kubenswrapper[2569]: W0525 11:17:41.481588    2569 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
May 25 11:17:41.483086 ip-10-0-143-46 kubenswrapper[2569]: W0525 11:17:41.481590    2569 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
May 25 11:17:41.483086 ip-10-0-143-46 kubenswrapper[2569]: W0525 11:17:41.481593    2569 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
May 25 11:17:41.483086 ip-10-0-143-46 kubenswrapper[2569]: W0525 11:17:41.481596    2569 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
May 25 11:17:41.483086 ip-10-0-143-46 kubenswrapper[2569]: W0525 11:17:41.481598    2569 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
May 25 11:17:41.483086 ip-10-0-143-46 kubenswrapper[2569]: W0525 11:17:41.481601    2569 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
May 25 11:17:41.483086 ip-10-0-143-46 kubenswrapper[2569]: W0525 11:17:41.481603    2569 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
May 25 11:17:41.483086 ip-10-0-143-46 kubenswrapper[2569]: W0525 11:17:41.481606    2569 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
May 25 11:17:41.483086 ip-10-0-143-46 kubenswrapper[2569]: W0525 11:17:41.481608    2569 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
May 25 11:17:41.483086 ip-10-0-143-46 kubenswrapper[2569]: W0525 11:17:41.481612    2569 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
May 25 11:17:41.483544 ip-10-0-143-46 kubenswrapper[2569]: W0525 11:17:41.481615    2569 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
May 25 11:17:41.483544 ip-10-0-143-46 kubenswrapper[2569]: W0525 11:17:41.481618    2569 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
May 25 11:17:41.483544 ip-10-0-143-46 kubenswrapper[2569]: W0525 11:17:41.481621    2569 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
May 25 11:17:41.483544 ip-10-0-143-46 kubenswrapper[2569]: W0525 11:17:41.481623    2569 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
May 25 11:17:41.483544 ip-10-0-143-46 kubenswrapper[2569]: W0525 11:17:41.481626    2569 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
May 25 11:17:41.483544 ip-10-0-143-46 kubenswrapper[2569]: W0525 11:17:41.481628    2569 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
May 25 11:17:41.483544 ip-10-0-143-46 kubenswrapper[2569]: W0525 11:17:41.481631    2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
May 25 11:17:41.483544 ip-10-0-143-46 kubenswrapper[2569]: W0525 11:17:41.481635    2569 feature_gate.go:328] unrecognized feature gate: SignatureStores
May 25 11:17:41.483544 ip-10-0-143-46 kubenswrapper[2569]: W0525 11:17:41.481637    2569 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
May 25 11:17:41.483544 ip-10-0-143-46 kubenswrapper[2569]: W0525 11:17:41.481640    2569 feature_gate.go:328] unrecognized feature gate: GatewayAPI
May 25 11:17:41.483544 ip-10-0-143-46 kubenswrapper[2569]: W0525 11:17:41.481642    2569 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
May 25 11:17:41.483544 ip-10-0-143-46 kubenswrapper[2569]: W0525 11:17:41.481645    2569 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
May 25 11:17:41.483544 ip-10-0-143-46 kubenswrapper[2569]: W0525 11:17:41.481647    2569 feature_gate.go:328] unrecognized feature gate: InsightsConfig
May 25 11:17:41.483544 ip-10-0-143-46 kubenswrapper[2569]: W0525 11:17:41.481650    2569 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
May 25 11:17:41.483544 ip-10-0-143-46 kubenswrapper[2569]: W0525 11:17:41.481653    2569 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
May 25 11:17:41.483544 ip-10-0-143-46 kubenswrapper[2569]: W0525 11:17:41.481655    2569 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
May 25 11:17:41.483544 ip-10-0-143-46 kubenswrapper[2569]: W0525 11:17:41.481657    2569 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
May 25 11:17:41.483544 ip-10-0-143-46 kubenswrapper[2569]: W0525 11:17:41.481660    2569 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
May 25 11:17:41.483544 ip-10-0-143-46 kubenswrapper[2569]: W0525 11:17:41.481663    2569 feature_gate.go:328] unrecognized feature gate: DualReplica
May 25 11:17:41.483544 ip-10-0-143-46 kubenswrapper[2569]: W0525 11:17:41.481666    2569 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
May 25 11:17:41.484040 ip-10-0-143-46 kubenswrapper[2569]: W0525 11:17:41.481668    2569 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
May 25 11:17:41.484040 ip-10-0-143-46 kubenswrapper[2569]: W0525 11:17:41.481671    2569 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations
May 25 11:17:41.484040 ip-10-0-143-46 kubenswrapper[2569]: W0525 11:17:41.481681    2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
May 25 11:17:41.484040 ip-10-0-143-46 kubenswrapper[2569]: W0525 11:17:41.481684    2569 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
May 25 11:17:41.484040 ip-10-0-143-46 kubenswrapper[2569]: W0525 11:17:41.481687    2569 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
May 25 11:17:41.484040 ip-10-0-143-46 kubenswrapper[2569]: W0525 11:17:41.481690    2569 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
May 25 11:17:41.484040 ip-10-0-143-46 kubenswrapper[2569]: W0525 11:17:41.481692    2569 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
May 25 11:17:41.484040 ip-10-0-143-46 kubenswrapper[2569]: W0525 11:17:41.481695    2569 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
May 25 11:17:41.484040 ip-10-0-143-46 kubenswrapper[2569]: W0525 11:17:41.481697    2569 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
May 25 11:17:41.484040 ip-10-0-143-46 kubenswrapper[2569]: W0525 11:17:41.481700    2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
May 25 11:17:41.484040 ip-10-0-143-46 kubenswrapper[2569]: W0525 11:17:41.481704    2569 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
May 25 11:17:41.484040 ip-10-0-143-46 kubenswrapper[2569]: W0525 11:17:41.481708    2569 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
May 25 11:17:41.484040 ip-10-0-143-46 kubenswrapper[2569]: W0525 11:17:41.481713    2569 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
May 25 11:17:41.484040 ip-10-0-143-46 kubenswrapper[2569]: W0525 11:17:41.481717    2569 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
May 25 11:17:41.484040 ip-10-0-143-46 kubenswrapper[2569]: W0525 11:17:41.481721    2569 feature_gate.go:328] unrecognized feature gate: Example2
May 25 11:17:41.484040 ip-10-0-143-46 kubenswrapper[2569]: W0525 11:17:41.481724    2569 feature_gate.go:328] unrecognized feature gate: NewOLM
May 25 11:17:41.484040 ip-10-0-143-46 kubenswrapper[2569]: W0525 11:17:41.481727    2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
May 25 11:17:41.484040 ip-10-0-143-46 kubenswrapper[2569]: W0525 11:17:41.481731    2569 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
May 25 11:17:41.484040 ip-10-0-143-46 kubenswrapper[2569]: W0525 11:17:41.481733    2569 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
May 25 11:17:41.484497 ip-10-0-143-46 kubenswrapper[2569]: W0525 11:17:41.481736    2569 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
May 25 11:17:41.484497 ip-10-0-143-46 kubenswrapper[2569]: W0525 11:17:41.481740    2569 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
May 25 11:17:41.484497 ip-10-0-143-46 kubenswrapper[2569]: W0525 11:17:41.481743    2569 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
May 25 11:17:41.484497 ip-10-0-143-46 kubenswrapper[2569]: W0525 11:17:41.481745    2569 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
May 25 11:17:41.484497 ip-10-0-143-46 kubenswrapper[2569]: W0525 11:17:41.481748    2569 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
May 25 11:17:41.484497 ip-10-0-143-46 kubenswrapper[2569]: W0525 11:17:41.481752    2569 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
May 25 11:17:41.484497 ip-10-0-143-46 kubenswrapper[2569]: W0525 11:17:41.481754    2569 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
May 25 11:17:41.484497 ip-10-0-143-46 kubenswrapper[2569]: W0525 11:17:41.481756    2569 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI
May 25 11:17:41.484497 ip-10-0-143-46 kubenswrapper[2569]: W0525 11:17:41.481759    2569 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
May 25 11:17:41.484497 ip-10-0-143-46 kubenswrapper[2569]: W0525 11:17:41.481762    2569 feature_gate.go:328] unrecognized feature gate: PinnedImages
May 25 11:17:41.484497 ip-10-0-143-46 kubenswrapper[2569]: W0525 11:17:41.481765    2569 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
May 25 11:17:41.484497 ip-10-0-143-46 kubenswrapper[2569]: W0525 11:17:41.481767    2569 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
May 25 11:17:41.484497 ip-10-0-143-46 kubenswrapper[2569]: W0525 11:17:41.481770    2569 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
May 25 11:17:41.484497 ip-10-0-143-46 kubenswrapper[2569]: W0525 11:17:41.481772    2569 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
May 25 11:17:41.484497 ip-10-0-143-46 kubenswrapper[2569]: W0525 11:17:41.481775    2569 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
May 25 11:17:41.484497 ip-10-0-143-46 kubenswrapper[2569]: W0525 11:17:41.481777    2569 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
May 25 11:17:41.484497 ip-10-0-143-46 kubenswrapper[2569]: W0525 11:17:41.481779    2569 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
May 25 11:17:41.484497 ip-10-0-143-46 kubenswrapper[2569]: W0525 11:17:41.481796    2569 feature_gate.go:328] unrecognized feature gate: Example
May 25 11:17:41.484497 ip-10-0-143-46 kubenswrapper[2569]: W0525 11:17:41.481799    2569 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
May 25 11:17:41.484497 ip-10-0-143-46 kubenswrapper[2569]: W0525 11:17:41.481801    2569 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
May 25 11:17:41.485004 ip-10-0-143-46 kubenswrapper[2569]: W0525 11:17:41.481804    2569 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
May 25 11:17:41.485004 ip-10-0-143-46 kubenswrapper[2569]: W0525 11:17:41.481807    2569 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
May 25 11:17:41.485004 ip-10-0-143-46 kubenswrapper[2569]: W0525 11:17:41.481809    2569 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
May 25 11:17:41.485004 ip-10-0-143-46 kubenswrapper[2569]: W0525 11:17:41.481812    2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
May 25 11:17:41.485004 ip-10-0-143-46 kubenswrapper[2569]: W0525 11:17:41.481815    2569 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
May 25 11:17:41.485004 ip-10-0-143-46 kubenswrapper[2569]: W0525 11:17:41.481817    2569 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
May 25 11:17:41.485004 ip-10-0-143-46 kubenswrapper[2569]: W0525 11:17:41.481820    2569 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController
May 25 11:17:41.485004 ip-10-0-143-46 kubenswrapper[2569]: W0525 11:17:41.481822    2569 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS
May 25 11:17:41.485004 ip-10-0-143-46 kubenswrapper[2569]: W0525 11:17:41.481825    2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
May 25 11:17:41.485004 ip-10-0-143-46 kubenswrapper[2569]: W0525 11:17:41.481827    2569 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
May 25 11:17:41.485004 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:17:41.483022    2569 flags.go:64] FLAG: --address="0.0.0.0"
May 25 11:17:41.485004 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:17:41.483032    2569 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
May 25 11:17:41.485004 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:17:41.483040    2569 flags.go:64] FLAG: --anonymous-auth="true"
May 25 11:17:41.485004 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:17:41.483044    2569 flags.go:64] FLAG: --application-metrics-count-limit="100"
May 25 11:17:41.485004 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:17:41.483050    2569 flags.go:64] FLAG: --authentication-token-webhook="false"
May 25 11:17:41.485004 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:17:41.483053    2569 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
May 25 11:17:41.485004 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:17:41.483058    2569 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
May 25 11:17:41.485004 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:17:41.483062    2569 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
May 25 11:17:41.485004 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:17:41.483066    2569 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
May 25 11:17:41.485004 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:17:41.483069    2569 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
May 25 11:17:41.485004 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:17:41.483075    2569 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
May 25 11:17:41.485525 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:17:41.483079    2569 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
May 25 11:17:41.485525 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:17:41.483082    2569 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
May 25 11:17:41.485525 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:17:41.483085    2569 flags.go:64] FLAG: --cgroup-root=""
May 25 11:17:41.485525 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:17:41.483088    2569 flags.go:64] FLAG: --cgroups-per-qos="true"
May 25 11:17:41.485525 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:17:41.483091    2569 flags.go:64] FLAG: --client-ca-file=""
May 25 11:17:41.485525 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:17:41.483094    2569 flags.go:64] FLAG: --cloud-config=""
May 25 11:17:41.485525 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:17:41.483097    2569 flags.go:64] FLAG: --cloud-provider="external"
May 25 11:17:41.485525 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:17:41.483101    2569 flags.go:64] FLAG: --cluster-dns="[]"
May 25 11:17:41.485525 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:17:41.483105    2569 flags.go:64] FLAG: --cluster-domain=""
May 25 11:17:41.485525 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:17:41.483108    2569 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
May 25 11:17:41.485525 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:17:41.483111    2569 flags.go:64] FLAG: --config-dir=""
May 25 11:17:41.485525 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:17:41.483114    2569 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
May 25 11:17:41.485525 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:17:41.483117    2569 flags.go:64] FLAG: --container-log-max-files="5"
May 25 11:17:41.485525 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:17:41.483121    2569 flags.go:64] FLAG: --container-log-max-size="10Mi"
May 25 11:17:41.485525 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:17:41.483124    2569 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
May 25 11:17:41.485525 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:17:41.483127    2569 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
May 25 11:17:41.485525 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:17:41.483131    2569 flags.go:64] FLAG: --containerd-namespace="k8s.io"
May 25 11:17:41.485525 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:17:41.483134    2569 flags.go:64] FLAG: --contention-profiling="false"
May 25 11:17:41.485525 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:17:41.483137    2569 flags.go:64] FLAG: --cpu-cfs-quota="true"
May 25 11:17:41.485525 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:17:41.483140    2569 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
May 25 11:17:41.485525 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:17:41.483143    2569 flags.go:64] FLAG: --cpu-manager-policy="none"
May 25 11:17:41.485525 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:17:41.483146    2569 flags.go:64] FLAG: --cpu-manager-policy-options=""
May 25 11:17:41.485525 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:17:41.483151    2569 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
May 25 11:17:41.485525 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:17:41.483154    2569 flags.go:64] FLAG: --enable-controller-attach-detach="true"
May 25 11:17:41.485525 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:17:41.483157    2569 flags.go:64] FLAG: --enable-debugging-handlers="true"
May 25 11:17:41.486145 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:17:41.483160    2569 flags.go:64] FLAG: --enable-load-reader="false"
May 25 11:17:41.486145 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:17:41.483163    2569 flags.go:64] FLAG: --enable-server="true"
May 25 11:17:41.486145 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:17:41.483166    2569 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
May 25 11:17:41.486145 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:17:41.483172    2569 flags.go:64] FLAG: --event-burst="100"
May 25 11:17:41.486145 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:17:41.483175    2569 flags.go:64] FLAG: --event-qps="50"
May 25 11:17:41.486145 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:17:41.483178    2569 flags.go:64] FLAG: --event-storage-age-limit="default=0"
May 25 11:17:41.486145 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:17:41.483182    2569 flags.go:64] FLAG: --event-storage-event-limit="default=0"
May 25 11:17:41.486145 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:17:41.483189    2569 flags.go:64] FLAG: --eviction-hard=""
May 25 11:17:41.486145 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:17:41.483192    2569 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
May 25 11:17:41.486145 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:17:41.483195    2569 flags.go:64] FLAG: --eviction-minimum-reclaim=""
May 25 11:17:41.486145 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:17:41.483198    2569 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
May 25 11:17:41.486145 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:17:41.483202    2569 flags.go:64] FLAG: --eviction-soft=""
May 25 11:17:41.486145 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:17:41.483205    2569 flags.go:64] FLAG: --eviction-soft-grace-period=""
May 25 11:17:41.486145 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:17:41.483207    2569 flags.go:64] FLAG: --exit-on-lock-contention="false"
May 25 11:17:41.486145 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:17:41.483210    2569 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
May 25 11:17:41.486145 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:17:41.483213    2569 flags.go:64] FLAG: --experimental-mounter-path=""
May 25 11:17:41.486145 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:17:41.483216    2569 flags.go:64] FLAG: --fail-cgroupv1="false"
May 25 11:17:41.486145 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:17:41.483219    2569 flags.go:64] FLAG: --fail-swap-on="true"
May 25 11:17:41.486145 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:17:41.483221    2569 flags.go:64] FLAG: --feature-gates=""
May 25 11:17:41.486145 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:17:41.483225    2569 flags.go:64] FLAG: --file-check-frequency="20s"
May 25 11:17:41.486145 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:17:41.483229    2569 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
May 25 11:17:41.486145 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:17:41.483232    2569 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
May 25 11:17:41.486145 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:17:41.483235    2569 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
May 25 11:17:41.486145 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:17:41.483238    2569 flags.go:64] FLAG: --healthz-port="10248"
May 25 11:17:41.486145 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:17:41.483241    2569 flags.go:64] FLAG: --help="false"
May 25 11:17:41.486749 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:17:41.483244    2569 flags.go:64] FLAG: --hostname-override="ip-10-0-143-46.ec2.internal"
May 25 11:17:41.486749 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:17:41.483247    2569 flags.go:64] FLAG: --housekeeping-interval="10s"
May 25 11:17:41.486749 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:17:41.483250    2569 flags.go:64] FLAG: --http-check-frequency="20s"
May 25 11:17:41.486749 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:17:41.483253    2569 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
May 25 11:17:41.486749 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:17:41.483256    2569 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
May 25 11:17:41.486749 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:17:41.483259    2569 flags.go:64] FLAG: --image-gc-high-threshold="85"
May 25 11:17:41.486749 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:17:41.483262    2569 flags.go:64] FLAG: --image-gc-low-threshold="80"
May 25 11:17:41.486749 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:17:41.483265    2569 flags.go:64] FLAG: --image-service-endpoint=""
May 25 11:17:41.486749 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:17:41.483267    2569 flags.go:64] FLAG: --kernel-memcg-notification="false"
May 25 11:17:41.486749 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:17:41.483271    2569 flags.go:64] FLAG: --kube-api-burst="100"
May 25 11:17:41.486749 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:17:41.483274    2569 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
May 25 11:17:41.486749 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:17:41.483277    2569 flags.go:64] FLAG: --kube-api-qps="50"
May 25 11:17:41.486749 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:17:41.483280    2569 flags.go:64] FLAG: --kube-reserved=""
May 25 11:17:41.486749 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:17:41.483283    2569 flags.go:64] FLAG: --kube-reserved-cgroup=""
May 25 11:17:41.486749 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:17:41.483288    2569 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
May 25 11:17:41.486749 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:17:41.483291    2569 flags.go:64] FLAG: --kubelet-cgroups=""
May 25 11:17:41.486749 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:17:41.483294    2569 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
May 25 11:17:41.486749 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:17:41.483297    2569 flags.go:64] FLAG: --lock-file=""
May 25 11:17:41.486749 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:17:41.483299    2569 flags.go:64] FLAG: --log-cadvisor-usage="false"
May 25 11:17:41.486749 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:17:41.483302    2569 flags.go:64] FLAG: --log-flush-frequency="5s"
May 25 11:17:41.486749 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:17:41.483306    2569 flags.go:64] FLAG: --log-json-info-buffer-size="0"
May 25 11:17:41.486749 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:17:41.483311    2569 flags.go:64] FLAG: --log-json-split-stream="false"
May 25 11:17:41.486749 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:17:41.483313    2569 flags.go:64] FLAG: --log-text-info-buffer-size="0"
May 25 11:17:41.487327 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:17:41.483316    2569 flags.go:64] FLAG: --log-text-split-stream="false"
May 25 11:17:41.487327 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:17:41.483319    2569 flags.go:64] FLAG: --logging-format="text"
May 25 11:17:41.487327 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:17:41.483322    2569 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
May 25 11:17:41.487327 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:17:41.483325    2569 flags.go:64] FLAG: --make-iptables-util-chains="true"
May 25 11:17:41.487327 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:17:41.483328    2569 flags.go:64] FLAG: --manifest-url=""
May 25 11:17:41.487327 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:17:41.483331    2569 flags.go:64] FLAG: --manifest-url-header=""
May 25 11:17:41.487327 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:17:41.483336    2569 flags.go:64] FLAG: --max-housekeeping-interval="15s"
May 25 11:17:41.487327 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:17:41.483338    2569 flags.go:64] FLAG: --max-open-files="1000000"
May 25 11:17:41.487327 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:17:41.483343    2569 flags.go:64] FLAG: --max-pods="110"
May 25 11:17:41.487327 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:17:41.483346    2569 flags.go:64] FLAG: --maximum-dead-containers="-1"
May 25 11:17:41.487327 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:17:41.483349    2569 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
May 25 11:17:41.487327 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:17:41.483352    2569 flags.go:64] FLAG: --memory-manager-policy="None"
May 25 11:17:41.487327 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:17:41.483355    2569 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
May 25 11:17:41.487327 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:17:41.483358    2569 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
May 25 11:17:41.487327 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:17:41.483361    2569 flags.go:64] FLAG: --node-ip="0.0.0.0"
May 25 11:17:41.487327 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:17:41.483364    2569 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
May 25 11:17:41.487327 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:17:41.483371    2569 flags.go:64] FLAG: --node-status-max-images="50"
May 25 11:17:41.487327 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:17:41.483374    2569 flags.go:64] FLAG: --node-status-update-frequency="10s"
May 25 11:17:41.487327 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:17:41.483377    2569 flags.go:64] FLAG: --oom-score-adj="-999"
May 25 11:17:41.487327 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:17:41.483381    2569 flags.go:64] FLAG: --pod-cidr=""
May 25 11:17:41.487327 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:17:41.483384    2569 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:afe88671bf163c42b467d159dc6f0b784dbe28b1ed44e171edc9c06fd99cc6fc"
May 25 11:17:41.487327 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:17:41.483389    2569 flags.go:64] FLAG: --pod-manifest-path=""
May 25 11:17:41.487327 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:17:41.483392    2569 flags.go:64] FLAG: --pod-max-pids="-1"
May 25 11:17:41.487327 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:17:41.483396    2569 flags.go:64] FLAG: --pods-per-core="0"
May 25 11:17:41.487954 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:17:41.483400    2569 flags.go:64] FLAG: --port="10250"
May 25 11:17:41.487954 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:17:41.483403    2569 flags.go:64] FLAG: --protect-kernel-defaults="false"
May 25 11:17:41.487954 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:17:41.483406    2569 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0f132cf527c7bed8d"
May 25 11:17:41.487954 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:17:41.483409    2569 flags.go:64] FLAG: --qos-reserved=""
May 25 11:17:41.487954 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:17:41.483412    2569 flags.go:64] FLAG: --read-only-port="10255"
May 25 11:17:41.487954 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:17:41.483415    2569 flags.go:64] FLAG: --register-node="true"
May 25 11:17:41.487954 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:17:41.483417    2569 flags.go:64] FLAG: --register-schedulable="true"
May 25 11:17:41.487954 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:17:41.483420    2569 flags.go:64] FLAG: --register-with-taints=""
May 25 11:17:41.487954 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:17:41.483424    2569 flags.go:64] FLAG: --registry-burst="10"
May 25 11:17:41.487954 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:17:41.483427    2569 flags.go:64] FLAG: --registry-qps="5"
May 25 11:17:41.487954 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:17:41.483429    2569 flags.go:64] FLAG: --reserved-cpus=""
May 25 11:17:41.487954 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:17:41.483432    2569 flags.go:64] FLAG: --reserved-memory=""
May 25 11:17:41.487954 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:17:41.483436    2569 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
May 25 11:17:41.487954 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:17:41.483439    2569 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
May 25 11:17:41.487954 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:17:41.483442    2569 flags.go:64] FLAG: --rotate-certificates="false"
May 25 11:17:41.487954 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:17:41.483445    2569 flags.go:64] FLAG: --rotate-server-certificates="false"
May 25 11:17:41.487954 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:17:41.483447    2569 flags.go:64] FLAG: --runonce="false"
May 25 11:17:41.487954 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:17:41.483450    2569 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
May 25 11:17:41.487954 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:17:41.483453    2569 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
May 25 11:17:41.487954 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:17:41.483456    2569 flags.go:64] FLAG: --seccomp-default="false"
May 25 11:17:41.487954 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:17:41.483459    2569 flags.go:64] FLAG: --serialize-image-pulls="true"
May 25 11:17:41.487954 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:17:41.483462    2569 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
May 25 11:17:41.487954 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:17:41.483465    2569 flags.go:64] FLAG: --storage-driver-db="cadvisor"
May 25 11:17:41.487954 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:17:41.483468    2569 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
May 25 11:17:41.487954 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:17:41.483471    2569 flags.go:64] FLAG: --storage-driver-password="root"
May 25 11:17:41.487954 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:17:41.483473    2569 flags.go:64] FLAG: --storage-driver-secure="false"
May 25 11:17:41.488569 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:17:41.483476    2569 flags.go:64] FLAG: --storage-driver-table="stats"
May 25 11:17:41.488569 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:17:41.483479    2569 flags.go:64] FLAG: --storage-driver-user="root"
May 25 11:17:41.488569 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:17:41.483482    2569 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
May 25 11:17:41.488569 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:17:41.483485    2569 flags.go:64] FLAG: --sync-frequency="1m0s"
May 25 11:17:41.488569 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:17:41.483488    2569 flags.go:64] FLAG: --system-cgroups=""
May 25 11:17:41.488569 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:17:41.483491    2569 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
May 25 11:17:41.488569 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:17:41.483497    2569 flags.go:64] FLAG: --system-reserved-cgroup=""
May 25 11:17:41.488569 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:17:41.483500    2569 flags.go:64] FLAG: --tls-cert-file=""
May 25 11:17:41.488569 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:17:41.483503    2569 flags.go:64] FLAG: --tls-cipher-suites="[]"
May 25 11:17:41.488569 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:17:41.483507    2569 flags.go:64] FLAG: --tls-min-version=""
May 25 11:17:41.488569 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:17:41.483510    2569 flags.go:64] FLAG: --tls-private-key-file=""
May 25 11:17:41.488569 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:17:41.483512    2569 flags.go:64] FLAG: --topology-manager-policy="none"
May 25 11:17:41.488569 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:17:41.483515    2569 flags.go:64] FLAG: --topology-manager-policy-options=""
May 25 11:17:41.488569 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:17:41.483518    2569 flags.go:64] FLAG: --topology-manager-scope="container"
May 25 11:17:41.488569 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:17:41.483521    2569 flags.go:64] FLAG: --v="2"
May 25 11:17:41.488569 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:17:41.483526    2569 flags.go:64] FLAG: --version="false"
May 25 11:17:41.488569 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:17:41.483530    2569 flags.go:64] FLAG: --vmodule=""
May 25 11:17:41.488569 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:17:41.483534    2569 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
May 25 11:17:41.488569 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:17:41.483537    2569 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
May 25 11:17:41.488569 ip-10-0-143-46 kubenswrapper[2569]: W0525 11:17:41.483647    2569 feature_gate.go:328] unrecognized feature gate: InsightsConfig
May 25 11:17:41.488569 ip-10-0-143-46 kubenswrapper[2569]: W0525 11:17:41.483651    2569 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
May 25 11:17:41.488569 ip-10-0-143-46 kubenswrapper[2569]: W0525 11:17:41.483654    2569 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
May 25 11:17:41.488569 ip-10-0-143-46 kubenswrapper[2569]: W0525 11:17:41.483657    2569 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
May 25 11:17:41.488569 ip-10-0-143-46 kubenswrapper[2569]: W0525 11:17:41.483660    2569 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
May 25 11:17:41.489156 ip-10-0-143-46 kubenswrapper[2569]: W0525 11:17:41.483663    2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
May 25 11:17:41.489156 ip-10-0-143-46 kubenswrapper[2569]: W0525 11:17:41.483666    2569 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
May 25 11:17:41.489156 ip-10-0-143-46 kubenswrapper[2569]: W0525 11:17:41.483669    2569 feature_gate.go:328] unrecognized feature gate: SignatureStores
May 25 11:17:41.489156 ip-10-0-143-46 kubenswrapper[2569]: W0525 11:17:41.483672    2569 feature_gate.go:328] unrecognized feature gate: DualReplica
May 25 11:17:41.489156 ip-10-0-143-46 kubenswrapper[2569]: W0525 11:17:41.483675    2569 feature_gate.go:328] unrecognized feature gate: NewOLM
May 25 11:17:41.489156 ip-10-0-143-46 kubenswrapper[2569]: W0525 11:17:41.483678    2569 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
May 25 11:17:41.489156 ip-10-0-143-46 kubenswrapper[2569]: W0525 11:17:41.483680    2569 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
May 25 11:17:41.489156 ip-10-0-143-46 kubenswrapper[2569]: W0525 11:17:41.483683    2569 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
May 25 11:17:41.489156 ip-10-0-143-46 kubenswrapper[2569]: W0525 11:17:41.483685    2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
May 25 11:17:41.489156 ip-10-0-143-46 kubenswrapper[2569]: W0525 11:17:41.483688    2569 feature_gate.go:328] unrecognized feature gate: OVNObservability
May 25 11:17:41.489156 ip-10-0-143-46 kubenswrapper[2569]: W0525 11:17:41.483691    2569 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
May 25 11:17:41.489156 ip-10-0-143-46 kubenswrapper[2569]: W0525 11:17:41.483694    2569 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
May 25 11:17:41.489156 ip-10-0-143-46 kubenswrapper[2569]: W0525 11:17:41.483698    2569 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
May 25 11:17:41.489156 ip-10-0-143-46 kubenswrapper[2569]: W0525 11:17:41.483701    2569 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
May 25 11:17:41.489156 ip-10-0-143-46 kubenswrapper[2569]: W0525 11:17:41.483705    2569 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
May 25 11:17:41.489156 ip-10-0-143-46 kubenswrapper[2569]: W0525 11:17:41.483707    2569 feature_gate.go:328] unrecognized feature gate: Example2
May 25 11:17:41.489156 ip-10-0-143-46 kubenswrapper[2569]: W0525 11:17:41.483710    2569 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
May 25 11:17:41.489156 ip-10-0-143-46 kubenswrapper[2569]: W0525 11:17:41.483712    2569 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
May 25 11:17:41.489156 ip-10-0-143-46 kubenswrapper[2569]: W0525 11:17:41.483715    2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
May 25 11:17:41.489156 ip-10-0-143-46 kubenswrapper[2569]: W0525 11:17:41.483717    2569 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
May 25 11:17:41.489156 ip-10-0-143-46 kubenswrapper[2569]: W0525 11:17:41.483720    2569 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
May 25 11:17:41.489692 ip-10-0-143-46 kubenswrapper[2569]: W0525 11:17:41.483723    2569 feature_gate.go:328] unrecognized feature gate: Example
May 25 11:17:41.489692 ip-10-0-143-46 kubenswrapper[2569]: W0525 11:17:41.483725    2569 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
May 25 11:17:41.489692 ip-10-0-143-46 kubenswrapper[2569]: W0525 11:17:41.483728    2569 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController
May 25 11:17:41.489692 ip-10-0-143-46 kubenswrapper[2569]: W0525 11:17:41.483730    2569 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
May 25 11:17:41.489692 ip-10-0-143-46 kubenswrapper[2569]: W0525 11:17:41.483733    2569 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
May 25 11:17:41.489692 ip-10-0-143-46 kubenswrapper[2569]: W0525 11:17:41.483735    2569 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
May 25 11:17:41.489692 ip-10-0-143-46 kubenswrapper[2569]: W0525 11:17:41.483738    2569 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
May 25 11:17:41.489692 ip-10-0-143-46 kubenswrapper[2569]: W0525 11:17:41.483740    2569 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
May 25 11:17:41.489692 ip-10-0-143-46 kubenswrapper[2569]: W0525 11:17:41.483743    2569 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
May 25 11:17:41.489692 ip-10-0-143-46 kubenswrapper[2569]: W0525 11:17:41.483745    2569 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
May 25 11:17:41.489692 ip-10-0-143-46 kubenswrapper[2569]: W0525 11:17:41.483748    2569 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
May 25 11:17:41.489692 ip-10-0-143-46 kubenswrapper[2569]: W0525 11:17:41.483751    2569 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
May 25 11:17:41.489692 ip-10-0-143-46 kubenswrapper[2569]: W0525 11:17:41.483753    2569 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
May 25 11:17:41.489692 ip-10-0-143-46 kubenswrapper[2569]: W0525 11:17:41.483756    2569 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
May 25 11:17:41.489692 ip-10-0-143-46 kubenswrapper[2569]: W0525 11:17:41.483758    2569 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
May 25 11:17:41.489692 ip-10-0-143-46 kubenswrapper[2569]: W0525 11:17:41.483761    2569 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI
May 25 11:17:41.489692 ip-10-0-143-46 kubenswrapper[2569]: W0525 11:17:41.483763    2569 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
May 25 11:17:41.489692 ip-10-0-143-46 kubenswrapper[2569]: W0525 11:17:41.483766    2569 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
May 25 11:17:41.489692 ip-10-0-143-46 kubenswrapper[2569]: W0525 11:17:41.483770    2569 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
May 25 11:17:41.490194 ip-10-0-143-46 kubenswrapper[2569]: W0525 11:17:41.483773    2569 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
May 25 11:17:41.490194 ip-10-0-143-46 kubenswrapper[2569]: W0525 11:17:41.483776    2569 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
May 25 11:17:41.490194 ip-10-0-143-46 kubenswrapper[2569]: W0525 11:17:41.483778    2569 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
May 25 11:17:41.490194 ip-10-0-143-46 kubenswrapper[2569]: W0525 11:17:41.483781    2569 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
May 25 11:17:41.490194 ip-10-0-143-46 kubenswrapper[2569]: W0525 11:17:41.483797    2569 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
May 25 11:17:41.490194 ip-10-0-143-46 kubenswrapper[2569]: W0525 11:17:41.483799    2569 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
May 25 11:17:41.490194 ip-10-0-143-46 kubenswrapper[2569]: W0525 11:17:41.483804    2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
May 25 11:17:41.490194 ip-10-0-143-46 kubenswrapper[2569]: W0525 11:17:41.483807    2569 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
May 25 11:17:41.490194 ip-10-0-143-46 kubenswrapper[2569]: W0525 11:17:41.483810    2569 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
May 25 11:17:41.490194 ip-10-0-143-46 kubenswrapper[2569]: W0525 11:17:41.483812    2569 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
May 25 11:17:41.490194 ip-10-0-143-46 kubenswrapper[2569]: W0525 11:17:41.483815    2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
May 25 11:17:41.490194 ip-10-0-143-46 kubenswrapper[2569]: W0525 11:17:41.483818    2569 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
May 25 11:17:41.490194 ip-10-0-143-46 kubenswrapper[2569]: W0525 11:17:41.483820    2569 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
May 25 11:17:41.490194 ip-10-0-143-46 kubenswrapper[2569]: W0525 11:17:41.483823    2569 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
May 25 11:17:41.490194 ip-10-0-143-46 kubenswrapper[2569]: W0525 11:17:41.483825    2569 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
May 25 11:17:41.490194 ip-10-0-143-46 kubenswrapper[2569]: W0525 11:17:41.483828    2569 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
May 25 11:17:41.490194 ip-10-0-143-46 kubenswrapper[2569]: W0525 11:17:41.483830    2569 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
May 25 11:17:41.490194 ip-10-0-143-46 kubenswrapper[2569]: W0525 11:17:41.483833    2569 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
May 25 11:17:41.490194 ip-10-0-143-46 kubenswrapper[2569]: W0525 11:17:41.483836    2569 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
May 25 11:17:41.490668 ip-10-0-143-46 kubenswrapper[2569]: W0525 11:17:41.483838    2569 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
May 25 11:17:41.490668 ip-10-0-143-46 kubenswrapper[2569]: W0525 11:17:41.483841    2569 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
May 25 11:17:41.490668 ip-10-0-143-46 kubenswrapper[2569]: W0525 11:17:41.483844    2569 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
May 25 11:17:41.490668 ip-10-0-143-46 kubenswrapper[2569]: W0525 11:17:41.483846    2569 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
May 25 11:17:41.490668 ip-10-0-143-46 kubenswrapper[2569]: W0525 11:17:41.483849    2569 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations
May 25 11:17:41.490668 ip-10-0-143-46 kubenswrapper[2569]: W0525 11:17:41.483851    2569 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS
May 25 11:17:41.490668 ip-10-0-143-46 kubenswrapper[2569]: W0525 11:17:41.483855    2569 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
May 25 11:17:41.490668 ip-10-0-143-46 kubenswrapper[2569]: W0525 11:17:41.483859    2569 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
May 25 11:17:41.490668 ip-10-0-143-46 kubenswrapper[2569]: W0525 11:17:41.483862    2569 feature_gate.go:328] unrecognized feature gate: PinnedImages
May 25 11:17:41.490668 ip-10-0-143-46 kubenswrapper[2569]: W0525 11:17:41.483865    2569 feature_gate.go:328] unrecognized feature gate: GatewayAPI
May 25 11:17:41.490668 ip-10-0-143-46 kubenswrapper[2569]: W0525 11:17:41.483868    2569 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
May 25 11:17:41.490668 ip-10-0-143-46 kubenswrapper[2569]: W0525 11:17:41.483870    2569 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
May 25 11:17:41.490668 ip-10-0-143-46 kubenswrapper[2569]: W0525 11:17:41.483873    2569 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
May 25 11:17:41.490668 ip-10-0-143-46 kubenswrapper[2569]: W0525 11:17:41.483876    2569 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
May 25 11:17:41.490668 ip-10-0-143-46 kubenswrapper[2569]: W0525 11:17:41.483878    2569 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
May 25 11:17:41.490668 ip-10-0-143-46 kubenswrapper[2569]: W0525 11:17:41.483881    2569 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
May 25 11:17:41.490668 ip-10-0-143-46 kubenswrapper[2569]: W0525 11:17:41.483883    2569 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
May 25 11:17:41.490668 ip-10-0-143-46 kubenswrapper[2569]: W0525 11:17:41.483890    2569 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
May 25 11:17:41.490668 ip-10-0-143-46 kubenswrapper[2569]: W0525 11:17:41.483893    2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
May 25 11:17:41.491179 ip-10-0-143-46 kubenswrapper[2569]: W0525 11:17:41.483897    2569 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
May 25 11:17:41.491179 ip-10-0-143-46 kubenswrapper[2569]: W0525 11:17:41.483900    2569 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
May 25 11:17:41.491179 ip-10-0-143-46 kubenswrapper[2569]: W0525 11:17:41.483903    2569 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
May 25 11:17:41.491179 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:17:41.484455    2569 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]}
May 25 11:17:41.491545 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:17:41.491524    2569 server.go:530] "Kubelet version" kubeletVersion="v1.33.11"
May 25 11:17:41.491577 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:17:41.491547    2569 server.go:532] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
May 25 11:17:41.491607 ip-10-0-143-46 kubenswrapper[2569]: W0525 11:17:41.491595    2569 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
May 25 11:17:41.491607 ip-10-0-143-46 kubenswrapper[2569]: W0525 11:17:41.491600    2569 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
May 25 11:17:41.491607 ip-10-0-143-46 kubenswrapper[2569]: W0525 11:17:41.491604    2569 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
May 25 11:17:41.491607 ip-10-0-143-46 kubenswrapper[2569]: W0525 11:17:41.491607    2569 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
May 25 11:17:41.491919 ip-10-0-143-46 kubenswrapper[2569]: W0525 11:17:41.491611    2569 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
May 25 11:17:41.491919 ip-10-0-143-46 kubenswrapper[2569]: W0525 11:17:41.491615    2569 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
May 25 11:17:41.491919 ip-10-0-143-46 kubenswrapper[2569]: W0525 11:17:41.491618    2569 feature_gate.go:328] unrecognized feature gate: GatewayAPI
May 25 11:17:41.491919 ip-10-0-143-46 kubenswrapper[2569]: W0525 11:17:41.491621    2569 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
May 25 11:17:41.491919 ip-10-0-143-46 kubenswrapper[2569]: W0525 11:17:41.491623    2569 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
May 25 11:17:41.491919 ip-10-0-143-46 kubenswrapper[2569]: W0525 11:17:41.491626    2569 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
May 25 11:17:41.491919 ip-10-0-143-46 kubenswrapper[2569]: W0525 11:17:41.491629    2569 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
May 25 11:17:41.491919 ip-10-0-143-46 kubenswrapper[2569]: W0525 11:17:41.491632    2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
May 25 11:17:41.491919 ip-10-0-143-46 kubenswrapper[2569]: W0525 11:17:41.491635    2569 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
May 25 11:17:41.491919 ip-10-0-143-46 kubenswrapper[2569]: W0525 11:17:41.491637    2569 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
May 25 11:17:41.491919 ip-10-0-143-46 kubenswrapper[2569]: W0525 11:17:41.491640    2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
May 25 11:17:41.491919 ip-10-0-143-46 kubenswrapper[2569]: W0525 11:17:41.491643    2569 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController
May 25 11:17:41.491919 ip-10-0-143-46 kubenswrapper[2569]: W0525 11:17:41.491645    2569 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
May 25 11:17:41.491919 ip-10-0-143-46 kubenswrapper[2569]: W0525 11:17:41.491649    2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
May 25 11:17:41.491919 ip-10-0-143-46 kubenswrapper[2569]: W0525 11:17:41.491651    2569 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
May 25 11:17:41.491919 ip-10-0-143-46 kubenswrapper[2569]: W0525 11:17:41.491655    2569 feature_gate.go:328] unrecognized feature gate: DualReplica
May 25 11:17:41.491919 ip-10-0-143-46 kubenswrapper[2569]: W0525 11:17:41.491659    2569 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
May 25 11:17:41.491919 ip-10-0-143-46 kubenswrapper[2569]: W0525 11:17:41.491663    2569 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
May 25 11:17:41.491919 ip-10-0-143-46 kubenswrapper[2569]: W0525 11:17:41.491666    2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
May 25 11:17:41.492383 ip-10-0-143-46 kubenswrapper[2569]: W0525 11:17:41.491669    2569 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
May 25 11:17:41.492383 ip-10-0-143-46 kubenswrapper[2569]: W0525 11:17:41.491672    2569 feature_gate.go:328] unrecognized feature gate: PinnedImages
May 25 11:17:41.492383 ip-10-0-143-46 kubenswrapper[2569]: W0525 11:17:41.491674    2569 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
May 25 11:17:41.492383 ip-10-0-143-46 kubenswrapper[2569]: W0525 11:17:41.491677    2569 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
May 25 11:17:41.492383 ip-10-0-143-46 kubenswrapper[2569]: W0525 11:17:41.491680    2569 feature_gate.go:328] unrecognized feature gate: SignatureStores
May 25 11:17:41.492383 ip-10-0-143-46 kubenswrapper[2569]: W0525 11:17:41.491682    2569 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
May 25 11:17:41.492383 ip-10-0-143-46 kubenswrapper[2569]: W0525 11:17:41.491685    2569 feature_gate.go:328] unrecognized feature gate: Example2
May 25 11:17:41.492383 ip-10-0-143-46 kubenswrapper[2569]: W0525 11:17:41.491687    2569 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
May 25 11:17:41.492383 ip-10-0-143-46 kubenswrapper[2569]: W0525 11:17:41.491691    2569 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
May 25 11:17:41.492383 ip-10-0-143-46 kubenswrapper[2569]: W0525 11:17:41.491694    2569 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
May 25 11:17:41.492383 ip-10-0-143-46 kubenswrapper[2569]: W0525 11:17:41.491696    2569 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
May 25 11:17:41.492383 ip-10-0-143-46 kubenswrapper[2569]: W0525 11:17:41.491699    2569 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
May 25 11:17:41.492383 ip-10-0-143-46 kubenswrapper[2569]: W0525 11:17:41.491702    2569 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
May 25 11:17:41.492383 ip-10-0-143-46 kubenswrapper[2569]: W0525 11:17:41.491705    2569 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
May 25 11:17:41.492383 ip-10-0-143-46 kubenswrapper[2569]: W0525 11:17:41.491708    2569 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
May 25 11:17:41.492383 ip-10-0-143-46 kubenswrapper[2569]: W0525 11:17:41.491710    2569 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
May 25 11:17:41.492383 ip-10-0-143-46 kubenswrapper[2569]: W0525 11:17:41.491713    2569 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations
May 25 11:17:41.492383 ip-10-0-143-46 kubenswrapper[2569]: W0525 11:17:41.491715    2569 feature_gate.go:328] unrecognized feature gate: NewOLM
May 25 11:17:41.492383 ip-10-0-143-46 kubenswrapper[2569]: W0525 11:17:41.491718    2569 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI
May 25 11:17:41.492383 ip-10-0-143-46 kubenswrapper[2569]: W0525 11:17:41.491721    2569 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
May 25 11:17:41.492881 ip-10-0-143-46 kubenswrapper[2569]: W0525 11:17:41.491723    2569 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
May 25 11:17:41.492881 ip-10-0-143-46 kubenswrapper[2569]: W0525 11:17:41.491726    2569 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
May 25 11:17:41.492881 ip-10-0-143-46 kubenswrapper[2569]: W0525 11:17:41.491729    2569 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
May 25 11:17:41.492881 ip-10-0-143-46 kubenswrapper[2569]: W0525 11:17:41.491731    2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
May 25 11:17:41.492881 ip-10-0-143-46 kubenswrapper[2569]: W0525 11:17:41.491734    2569 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
May 25 11:17:41.492881 ip-10-0-143-46 kubenswrapper[2569]: W0525 11:17:41.491737    2569 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
May 25 11:17:41.492881 ip-10-0-143-46 kubenswrapper[2569]: W0525 11:17:41.491739    2569 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
May 25 11:17:41.492881 ip-10-0-143-46 kubenswrapper[2569]: W0525 11:17:41.491742    2569 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
May 25 11:17:41.492881 ip-10-0-143-46 kubenswrapper[2569]: W0525 11:17:41.491744    2569 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
May 25 11:17:41.492881 ip-10-0-143-46 kubenswrapper[2569]: W0525 11:17:41.491747    2569 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
May 25 11:17:41.492881 ip-10-0-143-46 kubenswrapper[2569]: W0525 11:17:41.491750    2569 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
May 25 11:17:41.492881 ip-10-0-143-46 kubenswrapper[2569]: W0525 11:17:41.491752    2569 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
May 25 11:17:41.492881 ip-10-0-143-46 kubenswrapper[2569]: W0525 11:17:41.491755    2569 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
May 25 11:17:41.492881 ip-10-0-143-46 kubenswrapper[2569]: W0525 11:17:41.491757    2569 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
May 25 11:17:41.492881 ip-10-0-143-46 kubenswrapper[2569]: W0525 11:17:41.491760    2569 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
May 25 11:17:41.492881 ip-10-0-143-46 kubenswrapper[2569]: W0525 11:17:41.491763    2569 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
May 25 11:17:41.492881 ip-10-0-143-46 kubenswrapper[2569]: W0525 11:17:41.491765    2569 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
May 25 11:17:41.492881 ip-10-0-143-46 kubenswrapper[2569]: W0525 11:17:41.491768    2569 feature_gate.go:328] unrecognized feature gate: Example
May 25 11:17:41.492881 ip-10-0-143-46 kubenswrapper[2569]: W0525 11:17:41.491770    2569 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS
May 25 11:17:41.492881 ip-10-0-143-46 kubenswrapper[2569]: W0525 11:17:41.491773    2569 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
May 25 11:17:41.493362 ip-10-0-143-46 kubenswrapper[2569]: W0525 11:17:41.491776    2569 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
May 25 11:17:41.493362 ip-10-0-143-46 kubenswrapper[2569]: W0525 11:17:41.491779    2569 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
May 25 11:17:41.493362 ip-10-0-143-46 kubenswrapper[2569]: W0525 11:17:41.491795    2569 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
May 25 11:17:41.493362 ip-10-0-143-46 kubenswrapper[2569]: W0525 11:17:41.491799    2569 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
May 25 11:17:41.493362 ip-10-0-143-46 kubenswrapper[2569]: W0525 11:17:41.491801    2569 feature_gate.go:328] unrecognized feature gate: OVNObservability
May 25 11:17:41.493362 ip-10-0-143-46 kubenswrapper[2569]: W0525 11:17:41.491804    2569 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
May 25 11:17:41.493362 ip-10-0-143-46 kubenswrapper[2569]: W0525 11:17:41.491807    2569 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
May 25 11:17:41.493362 ip-10-0-143-46 kubenswrapper[2569]: W0525 11:17:41.491810    2569 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
May 25 11:17:41.493362 ip-10-0-143-46 kubenswrapper[2569]: W0525 11:17:41.491814    2569 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
May 25 11:17:41.493362 ip-10-0-143-46 kubenswrapper[2569]: W0525 11:17:41.491817    2569 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
May 25 11:17:41.493362 ip-10-0-143-46 kubenswrapper[2569]: W0525 11:17:41.491820    2569 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
May 25 11:17:41.493362 ip-10-0-143-46 kubenswrapper[2569]: W0525 11:17:41.491822    2569 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
May 25 11:17:41.493362 ip-10-0-143-46 kubenswrapper[2569]: W0525 11:17:41.491825    2569 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
May 25 11:17:41.493362 ip-10-0-143-46 kubenswrapper[2569]: W0525 11:17:41.491827    2569 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
May 25 11:17:41.493362 ip-10-0-143-46 kubenswrapper[2569]: W0525 11:17:41.491830    2569 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
May 25 11:17:41.493362 ip-10-0-143-46 kubenswrapper[2569]: W0525 11:17:41.491832    2569 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
May 25 11:17:41.493362 ip-10-0-143-46 kubenswrapper[2569]: W0525 11:17:41.491835    2569 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
May 25 11:17:41.493362 ip-10-0-143-46 kubenswrapper[2569]: W0525 11:17:41.491837    2569 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
May 25 11:17:41.493362 ip-10-0-143-46 kubenswrapper[2569]: W0525 11:17:41.491840    2569 feature_gate.go:328] unrecognized feature gate: InsightsConfig
May 25 11:17:41.493860 ip-10-0-143-46 kubenswrapper[2569]: W0525 11:17:41.491843    2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
May 25 11:17:41.493860 ip-10-0-143-46 kubenswrapper[2569]: W0525 11:17:41.491845    2569 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
May 25 11:17:41.493860 ip-10-0-143-46 kubenswrapper[2569]: W0525 11:17:41.491848    2569 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
May 25 11:17:41.493860 ip-10-0-143-46 kubenswrapper[2569]: W0525 11:17:41.491850    2569 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
May 25 11:17:41.493860 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:17:41.491855    2569 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]}
May 25 11:17:41.493860 ip-10-0-143-46 kubenswrapper[2569]: W0525 11:17:41.491955    2569 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
May 25 11:17:41.493860 ip-10-0-143-46 kubenswrapper[2569]: W0525 11:17:41.491960    2569 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
May 25 11:17:41.493860 ip-10-0-143-46 kubenswrapper[2569]: W0525 11:17:41.491963    2569 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
May 25 11:17:41.493860 ip-10-0-143-46 kubenswrapper[2569]: W0525 11:17:41.491965    2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
May 25 11:17:41.493860 ip-10-0-143-46 kubenswrapper[2569]: W0525 11:17:41.491968    2569 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
May 25 11:17:41.493860 ip-10-0-143-46 kubenswrapper[2569]: W0525 11:17:41.491971    2569 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
May 25 11:17:41.493860 ip-10-0-143-46 kubenswrapper[2569]: W0525 11:17:41.491973    2569 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
May 25 11:17:41.493860 ip-10-0-143-46 kubenswrapper[2569]: W0525 11:17:41.491976    2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
May 25 11:17:41.493860 ip-10-0-143-46 kubenswrapper[2569]: W0525 11:17:41.491978    2569 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
May 25 11:17:41.493860 ip-10-0-143-46 kubenswrapper[2569]: W0525 11:17:41.491981    2569 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
May 25 11:17:41.494238 ip-10-0-143-46 kubenswrapper[2569]: W0525 11:17:41.491984    2569 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
May 25 11:17:41.494238 ip-10-0-143-46 kubenswrapper[2569]: W0525 11:17:41.491987    2569 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
May 25 11:17:41.494238 ip-10-0-143-46 kubenswrapper[2569]: W0525 11:17:41.491990    2569 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
May 25 11:17:41.494238 ip-10-0-143-46 kubenswrapper[2569]: W0525 11:17:41.491992    2569 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
May 25 11:17:41.494238 ip-10-0-143-46 kubenswrapper[2569]: W0525 11:17:41.491995    2569 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
May 25 11:17:41.494238 ip-10-0-143-46 kubenswrapper[2569]: W0525 11:17:41.491998    2569 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
May 25 11:17:41.494238 ip-10-0-143-46 kubenswrapper[2569]: W0525 11:17:41.492002    2569 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
May 25 11:17:41.494238 ip-10-0-143-46 kubenswrapper[2569]: W0525 11:17:41.492005    2569 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
May 25 11:17:41.494238 ip-10-0-143-46 kubenswrapper[2569]: W0525 11:17:41.492007    2569 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
May 25 11:17:41.494238 ip-10-0-143-46 kubenswrapper[2569]: W0525 11:17:41.492010    2569 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
May 25 11:17:41.494238 ip-10-0-143-46 kubenswrapper[2569]: W0525 11:17:41.492012    2569 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
May 25 11:17:41.494238 ip-10-0-143-46 kubenswrapper[2569]: W0525 11:17:41.492015    2569 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
May 25 11:17:41.494238 ip-10-0-143-46 kubenswrapper[2569]: W0525 11:17:41.492017    2569 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
May 25 11:17:41.494238 ip-10-0-143-46 kubenswrapper[2569]: W0525 11:17:41.492020    2569 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
May 25 11:17:41.494238 ip-10-0-143-46 kubenswrapper[2569]: W0525 11:17:41.492022    2569 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
May 25 11:17:41.494238 ip-10-0-143-46 kubenswrapper[2569]: W0525 11:17:41.492025    2569 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
May 25 11:17:41.494238 ip-10-0-143-46 kubenswrapper[2569]: W0525 11:17:41.492027    2569 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
May 25 11:17:41.494238 ip-10-0-143-46 kubenswrapper[2569]: W0525 11:17:41.492030    2569 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
May 25 11:17:41.494238 ip-10-0-143-46 kubenswrapper[2569]: W0525 11:17:41.492032    2569 feature_gate.go:328] unrecognized feature gate: Example2
May 25 11:17:41.494694 ip-10-0-143-46 kubenswrapper[2569]: W0525 11:17:41.492034    2569 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
May 25 11:17:41.494694 ip-10-0-143-46 kubenswrapper[2569]: W0525 11:17:41.492037    2569 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
May 25 11:17:41.494694 ip-10-0-143-46 kubenswrapper[2569]: W0525 11:17:41.492040    2569 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
May 25 11:17:41.494694 ip-10-0-143-46 kubenswrapper[2569]: W0525 11:17:41.492042    2569 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
May 25 11:17:41.494694 ip-10-0-143-46 kubenswrapper[2569]: W0525 11:17:41.492045    2569 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
May 25 11:17:41.494694 ip-10-0-143-46 kubenswrapper[2569]: W0525 11:17:41.492047    2569 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
May 25 11:17:41.494694 ip-10-0-143-46 kubenswrapper[2569]: W0525 11:17:41.492050    2569 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
May 25 11:17:41.494694 ip-10-0-143-46 kubenswrapper[2569]: W0525 11:17:41.492052    2569 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
May 25 11:17:41.494694 ip-10-0-143-46 kubenswrapper[2569]: W0525 11:17:41.492055    2569 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
May 25 11:17:41.494694 ip-10-0-143-46 kubenswrapper[2569]: W0525 11:17:41.492057    2569 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
May 25 11:17:41.494694 ip-10-0-143-46 kubenswrapper[2569]: W0525 11:17:41.492059    2569 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
May 25 11:17:41.494694 ip-10-0-143-46 kubenswrapper[2569]: W0525 11:17:41.492062    2569 feature_gate.go:328] unrecognized feature gate: PinnedImages
May 25 11:17:41.494694 ip-10-0-143-46 kubenswrapper[2569]: W0525 11:17:41.492064    2569 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
May 25 11:17:41.494694 ip-10-0-143-46 kubenswrapper[2569]: W0525 11:17:41.492067    2569 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
May 25 11:17:41.494694 ip-10-0-143-46 kubenswrapper[2569]: W0525 11:17:41.492073    2569 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
May 25 11:17:41.494694 ip-10-0-143-46 kubenswrapper[2569]: W0525 11:17:41.492076    2569 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
May 25 11:17:41.494694 ip-10-0-143-46 kubenswrapper[2569]: W0525 11:17:41.492078    2569 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
May 25 11:17:41.494694 ip-10-0-143-46 kubenswrapper[2569]: W0525 11:17:41.492081    2569 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
May 25 11:17:41.494694 ip-10-0-143-46 kubenswrapper[2569]: W0525 11:17:41.492084    2569 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
May 25 11:17:41.494694 ip-10-0-143-46 kubenswrapper[2569]: W0525 11:17:41.492086    2569 feature_gate.go:328] unrecognized feature gate: OVNObservability
May 25 11:17:41.495226 ip-10-0-143-46 kubenswrapper[2569]: W0525 11:17:41.492089    2569 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
May 25 11:17:41.495226 ip-10-0-143-46 kubenswrapper[2569]: W0525 11:17:41.492091    2569 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController
May 25 11:17:41.495226 ip-10-0-143-46 kubenswrapper[2569]: W0525 11:17:41.492094    2569 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
May 25 11:17:41.495226 ip-10-0-143-46 kubenswrapper[2569]: W0525 11:17:41.492096    2569 feature_gate.go:328] unrecognized feature gate: NewOLM
May 25 11:17:41.495226 ip-10-0-143-46 kubenswrapper[2569]: W0525 11:17:41.492099    2569 feature_gate.go:328] unrecognized feature gate: DualReplica
May 25 11:17:41.495226 ip-10-0-143-46 kubenswrapper[2569]: W0525 11:17:41.492101    2569 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
May 25 11:17:41.495226 ip-10-0-143-46 kubenswrapper[2569]: W0525 11:17:41.492104    2569 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
May 25 11:17:41.495226 ip-10-0-143-46 kubenswrapper[2569]: W0525 11:17:41.492106    2569 feature_gate.go:328] unrecognized feature gate: Example
May 25 11:17:41.495226 ip-10-0-143-46 kubenswrapper[2569]: W0525 11:17:41.492109    2569 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
May 25 11:17:41.495226 ip-10-0-143-46 kubenswrapper[2569]: W0525 11:17:41.492112    2569 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
May 25 11:17:41.495226 ip-10-0-143-46 kubenswrapper[2569]: W0525 11:17:41.492114    2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
May 25 11:17:41.495226 ip-10-0-143-46 kubenswrapper[2569]: W0525 11:17:41.492117    2569 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
May 25 11:17:41.495226 ip-10-0-143-46 kubenswrapper[2569]: W0525 11:17:41.492119    2569 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
May 25 11:17:41.495226 ip-10-0-143-46 kubenswrapper[2569]: W0525 11:17:41.492122    2569 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
May 25 11:17:41.495226 ip-10-0-143-46 kubenswrapper[2569]: W0525 11:17:41.492124    2569 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
May 25 11:17:41.495226 ip-10-0-143-46 kubenswrapper[2569]: W0525 11:17:41.492126    2569 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
May 25 11:17:41.495226 ip-10-0-143-46 kubenswrapper[2569]: W0525 11:17:41.492129    2569 feature_gate.go:328] unrecognized feature gate: GatewayAPI
May 25 11:17:41.495226 ip-10-0-143-46 kubenswrapper[2569]: W0525 11:17:41.492131    2569 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
May 25 11:17:41.495226 ip-10-0-143-46 kubenswrapper[2569]: W0525 11:17:41.492134    2569 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
May 25 11:17:41.495226 ip-10-0-143-46 kubenswrapper[2569]: W0525 11:17:41.492136    2569 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI
May 25 11:17:41.495722 ip-10-0-143-46 kubenswrapper[2569]: W0525 11:17:41.492138    2569 feature_gate.go:328] unrecognized feature gate: SignatureStores
May 25 11:17:41.495722 ip-10-0-143-46 kubenswrapper[2569]: W0525 11:17:41.492141    2569 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
May 25 11:17:41.495722 ip-10-0-143-46 kubenswrapper[2569]: W0525 11:17:41.492144    2569 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
May 25 11:17:41.495722 ip-10-0-143-46 kubenswrapper[2569]: W0525 11:17:41.492146    2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
May 25 11:17:41.495722 ip-10-0-143-46 kubenswrapper[2569]: W0525 11:17:41.492149    2569 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations
May 25 11:17:41.495722 ip-10-0-143-46 kubenswrapper[2569]: W0525 11:17:41.492151    2569 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
May 25 11:17:41.495722 ip-10-0-143-46 kubenswrapper[2569]: W0525 11:17:41.492154    2569 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
May 25 11:17:41.495722 ip-10-0-143-46 kubenswrapper[2569]: W0525 11:17:41.492157    2569 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
May 25 11:17:41.495722 ip-10-0-143-46 kubenswrapper[2569]: W0525 11:17:41.492160    2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
May 25 11:17:41.495722 ip-10-0-143-46 kubenswrapper[2569]: W0525 11:17:41.492164    2569 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
May 25 11:17:41.495722 ip-10-0-143-46 kubenswrapper[2569]: W0525 11:17:41.492168    2569 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
May 25 11:17:41.495722 ip-10-0-143-46 kubenswrapper[2569]: W0525 11:17:41.492170    2569 feature_gate.go:328] unrecognized feature gate: InsightsConfig
May 25 11:17:41.495722 ip-10-0-143-46 kubenswrapper[2569]: W0525 11:17:41.492173    2569 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
May 25 11:17:41.495722 ip-10-0-143-46 kubenswrapper[2569]: W0525 11:17:41.492176    2569 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
May 25 11:17:41.495722 ip-10-0-143-46 kubenswrapper[2569]: W0525 11:17:41.492179    2569 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
May 25 11:17:41.495722 ip-10-0-143-46 kubenswrapper[2569]: W0525 11:17:41.492181    2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
May 25 11:17:41.495722 ip-10-0-143-46 kubenswrapper[2569]: W0525 11:17:41.492184    2569 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS
May 25 11:17:41.496184 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:17:41.492189    2569 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]}
May 25 11:17:41.496184 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:17:41.492900    2569 server.go:962] "Client rotation is on, will bootstrap in background"
May 25 11:17:41.496184 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:17:41.495696    2569 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
May 25 11:17:41.497374 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:17:41.497362    2569 server.go:1019] "Starting client certificate rotation"
May 25 11:17:41.497477 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:17:41.497461    2569 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
May 25 11:17:41.497511 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:17:41.497501    2569 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
May 25 11:17:41.524438 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:17:41.524420    2569 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
May 25 11:17:41.526293 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:17:41.526277    2569 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
May 25 11:17:41.536917 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:17:41.536902    2569 log.go:25] "Validated CRI v1 runtime API"
May 25 11:17:41.541440 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:17:41.541424    2569 log.go:25] "Validated CRI v1 image API"
May 25 11:17:41.542647 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:17:41.542634    2569 server.go:1452] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
May 25 11:17:41.545706 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:17:41.545678    2569 fs.go:135] Filesystem UUIDs: map[7B77-95E7:/dev/nvme0n1p2 816f41bc-7c1c-4708-93b6-ea44ca0817a5:/dev/nvme0n1p4 ed8aa93a-8e92-40ca-a5c1-71e5d0f73f2a:/dev/nvme0n1p3]
May 25 11:17:41.545706 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:17:41.545697    2569 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
May 25 11:17:41.550084 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:17:41.549966    2569 manager.go:217] Machine: {Timestamp:2026-05-25 11:17:41.549449548 +0000 UTC m=+0.411073923 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3100268 MemoryCapacity:33164496896 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec24748103add39787f4674481c7ea04 SystemUUID:ec247481-03ad-d397-87f4-674481c7ea04 BootID:d4635450-d8dc-4f35-a93e-00b5a6533b48 Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6103040 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:a8:42:9c:b6:f5 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:a8:42:9c:b6:f5 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:6e:3a:25:70:fd:3d Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164496896 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
May 25 11:17:41.550934 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:17:41.550923    2569 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
May 25 11:17:41.551040 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:17:41.551028    2569 manager.go:233] Version: {KernelVersion:5.14.0-570.114.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260512-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
May 25 11:17:41.552477 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:17:41.552457    2569 container_manager_linux.go:270] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
May 25 11:17:41.552615 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:17:41.552479    2569 container_manager_linux.go:275] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-143-46.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
May 25 11:17:41.552657 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:17:41.552624    2569 topology_manager.go:138] "Creating topology manager with none policy"
May 25 11:17:41.552657 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:17:41.552633    2569 container_manager_linux.go:306] "Creating device plugin manager"
May 25 11:17:41.552657 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:17:41.552640    2569 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
May 25 11:17:41.553494 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:17:41.553482    2569 server.go:72] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
May 25 11:17:41.554876 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:17:41.554863    2569 state_mem.go:36] "Initialized new in-memory state store"
May 25 11:17:41.554983 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:17:41.554974    2569 server.go:1267] "Using root directory" path="/var/lib/kubelet"
May 25 11:17:41.557207 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:17:41.557197    2569 kubelet.go:491] "Attempting to sync node with API server"
May 25 11:17:41.557248 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:17:41.557211    2569 kubelet.go:386] "Adding static pod path" path="/etc/kubernetes/manifests"
May 25 11:17:41.557248 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:17:41.557223    2569 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
May 25 11:17:41.557248 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:17:41.557231    2569 kubelet.go:397] "Adding apiserver pod source"
May 25 11:17:41.557248 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:17:41.557240    2569 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
May 25 11:17:41.558344 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:17:41.558321    2569 reflector.go:430] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
May 25 11:17:41.558418 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:17:41.558394    2569 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
May 25 11:17:41.558418 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:17:41.558421    2569 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
May 25 11:17:41.561518 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:17:41.561500    2569 kuberuntime_manager.go:279] "Container runtime initialized" containerRuntime="cri-o" version="1.33.11-2.rhaos4.20.gitb2a8320.el9" apiVersion="v1"
May 25 11:17:41.563522 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:17:41.563510    2569 kubelet.go:953] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
May 25 11:17:41.565312 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:17:41.565297    2569 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
May 25 11:17:41.565382 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:17:41.565319    2569 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
May 25 11:17:41.565382 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:17:41.565325    2569 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
May 25 11:17:41.565382 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:17:41.565331    2569 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
May 25 11:17:41.565382 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:17:41.565340    2569 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
May 25 11:17:41.565382 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:17:41.565346    2569 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/secret"
May 25 11:17:41.565382 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:17:41.565352    2569 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
May 25 11:17:41.565382 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:17:41.565357    2569 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
May 25 11:17:41.565382 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:17:41.565364    2569 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/fc"
May 25 11:17:41.565382 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:17:41.565371    2569 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
May 25 11:17:41.565382 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:17:41.565380    2569 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/projected"
May 25 11:17:41.565382 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:17:41.565388    2569 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
May 25 11:17:41.566269 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:17:41.566260    2569 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/csi"
May 25 11:17:41.566269 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:17:41.566270    2569 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/image"
May 25 11:17:41.569462 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:17:41.569448    2569 watchdog_linux.go:99] "Systemd watchdog is not enabled"
May 25 11:17:41.569508 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:17:41.569492    2569 server.go:1295] "Started kubelet"
May 25 11:17:41.569647 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:17:41.569592    2569 ratelimit.go:55] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
May 25 11:17:41.569706 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:17:41.569660    2569 server_v1.go:47] "podresources" method="list" useActivePods=true
May 25 11:17:41.571982 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:17:41.571960    2569 server.go:255] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
May 25 11:17:41.572312 ip-10-0-143-46 systemd[1]: Started Kubernetes Kubelet.
May 25 11:17:41.572767 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:17:41.572341    2569 csi_plugin.go:988] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-143-46.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
May 25 11:17:41.572767 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:17:41.572477    2569 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
May 25 11:17:41.572767 ip-10-0-143-46 kubenswrapper[2569]: E0525 11:17:41.572560    2569 reflector.go:200] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
May 25 11:17:41.572767 ip-10-0-143-46 kubenswrapper[2569]: E0525 11:17:41.572644    2569 reflector.go:200] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-143-46.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
May 25 11:17:41.576433 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:17:41.576316    2569 server.go:317] "Adding debug handlers to kubelet server"
May 25 11:17:41.580946 ip-10-0-143-46 kubenswrapper[2569]: E0525 11:17:41.579982    2569 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-143-46.ec2.internal.18b2cadeecd166ff  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-143-46.ec2.internal,UID:ip-10-0-143-46.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-143-46.ec2.internal,},FirstTimestamp:2026-05-25 11:17:41.569464063 +0000 UTC m=+0.431088448,LastTimestamp:2026-05-25 11:17:41.569464063 +0000 UTC m=+0.431088448,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-143-46.ec2.internal,}"
May 25 11:17:41.582752 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:17:41.582736    2569 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
May 25 11:17:41.582945 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:17:41.582925    2569 volume_manager.go:295] "The desired_state_of_world populator starts"
May 25 11:17:41.582945 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:17:41.582941    2569 volume_manager.go:297] "Starting Kubelet Volume Manager"
May 25 11:17:41.583097 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:17:41.583036    2569 desired_state_of_world_populator.go:150] "Desired state populator starts to run"
May 25 11:17:41.583097 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:17:41.583081    2569 reconstruct.go:97] "Volume reconstruction finished"
May 25 11:17:41.583097 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:17:41.583089    2569 reconciler.go:26] "Reconciler: start to sync state"
May 25 11:17:41.583403 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:17:41.583130    2569 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
May 25 11:17:41.583657 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:17:41.583630    2569 factory.go:55] Registering systemd factory
May 25 11:17:41.583657 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:17:41.583650    2569 factory.go:223] Registration of the systemd container factory successfully
May 25 11:17:41.583925 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:17:41.583909    2569 factory.go:153] Registering CRI-O factory
May 25 11:17:41.583925 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:17:41.583927    2569 factory.go:223] Registration of the crio container factory successfully
May 25 11:17:41.584042 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:17:41.584007    2569 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
May 25 11:17:41.584042 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:17:41.584026    2569 factory.go:103] Registering Raw factory
May 25 11:17:41.584042 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:17:41.584042    2569 manager.go:1196] Started watching for new ooms in manager
May 25 11:17:41.584193 ip-10-0-143-46 kubenswrapper[2569]: E0525 11:17:41.584171    2569 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-143-46.ec2.internal\" not found"
May 25 11:17:41.584411 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:17:41.584394    2569 manager.go:319] Starting recovery of all containers
May 25 11:17:41.586096 ip-10-0-143-46 kubenswrapper[2569]: E0525 11:17:41.586075    2569 kubelet.go:1618] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
May 25 11:17:41.590309 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:17:41.590291    2569 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-h4g42"
May 25 11:17:41.594212 ip-10-0-143-46 kubenswrapper[2569]: E0525 11:17:41.594184    2569 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-143-46.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
May 25 11:17:41.594294 ip-10-0-143-46 kubenswrapper[2569]: E0525 11:17:41.594225    2569 reflector.go:200] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
May 25 11:17:41.594380 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:17:41.594370    2569 manager.go:324] Recovery completed
May 25 11:17:41.597207 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:17:41.597192    2569 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-h4g42"
May 25 11:17:41.598558 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:17:41.598547    2569 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach"
May 25 11:17:41.600537 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:17:41.600518    2569 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-143-46.ec2.internal" event="NodeHasSufficientMemory"
May 25 11:17:41.600604 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:17:41.600551    2569 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-143-46.ec2.internal" event="NodeHasNoDiskPressure"
May 25 11:17:41.600604 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:17:41.600562    2569 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-143-46.ec2.internal" event="NodeHasSufficientPID"
May 25 11:17:41.601151 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:17:41.601128    2569 cpu_manager.go:222] "Starting CPU manager" policy="none"
May 25 11:17:41.601151 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:17:41.601141    2569 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
May 25 11:17:41.601151 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:17:41.601155    2569 state_mem.go:36] "Initialized new in-memory state store"
May 25 11:17:41.603206 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:17:41.603194    2569 policy_none.go:49] "None policy: Start"
May 25 11:17:41.603254 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:17:41.603215    2569 memory_manager.go:186] "Starting memorymanager" policy="None"
May 25 11:17:41.603254 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:17:41.603226    2569 state_mem.go:35] "Initializing new in-memory state store"
May 25 11:17:41.639362 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:17:41.639348    2569 manager.go:341] "Starting Device Plugin manager"
May 25 11:17:41.651554 ip-10-0-143-46 kubenswrapper[2569]: E0525 11:17:41.639378    2569 manager.go:517] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
May 25 11:17:41.651554 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:17:41.639388    2569 server.go:85] "Starting device plugin registration server"
May 25 11:17:41.651554 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:17:41.639641    2569 eviction_manager.go:189] "Eviction manager: starting control loop"
May 25 11:17:41.651554 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:17:41.639655    2569 container_log_manager.go:189] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
May 25 11:17:41.651554 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:17:41.639841    2569 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
May 25 11:17:41.651554 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:17:41.640362    2569 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
May 25 11:17:41.651554 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:17:41.640378    2569 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
May 25 11:17:41.651554 ip-10-0-143-46 kubenswrapper[2569]: E0525 11:17:41.640989    2569 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
May 25 11:17:41.651554 ip-10-0-143-46 kubenswrapper[2569]: E0525 11:17:41.641029    2569 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-143-46.ec2.internal\" not found"
May 25 11:17:41.723570 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:17:41.723508    2569 kubelet_network_linux.go:49] "Initialized iptables rules." protocol="IPv4"
May 25 11:17:41.724614 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:17:41.724602    2569 kubelet_network_linux.go:49] "Initialized iptables rules." protocol="IPv6"
May 25 11:17:41.724688 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:17:41.724631    2569 status_manager.go:230] "Starting to sync pod status with apiserver"
May 25 11:17:41.724688 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:17:41.724654    2569 watchdog_linux.go:127] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
May 25 11:17:41.724688 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:17:41.724661    2569 kubelet.go:2451] "Starting kubelet main sync loop"
May 25 11:17:41.724813 ip-10-0-143-46 kubenswrapper[2569]: E0525 11:17:41.724692    2569 kubelet.go:2475] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
May 25 11:17:41.727329 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:17:41.727312    2569 reflector.go:430] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
May 25 11:17:41.740383 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:17:41.740361    2569 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach"
May 25 11:17:41.741260 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:17:41.741243    2569 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-143-46.ec2.internal" event="NodeHasSufficientMemory"
May 25 11:17:41.741316 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:17:41.741272    2569 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-143-46.ec2.internal" event="NodeHasNoDiskPressure"
May 25 11:17:41.741316 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:17:41.741283    2569 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-143-46.ec2.internal" event="NodeHasSufficientPID"
May 25 11:17:41.741316 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:17:41.741305    2569 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-143-46.ec2.internal"
May 25 11:17:41.757844 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:17:41.757828    2569 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-143-46.ec2.internal"
May 25 11:17:41.757891 ip-10-0-143-46 kubenswrapper[2569]: E0525 11:17:41.757850    2569 kubelet_node_status.go:597] "Error updating node status, will retry" err="error getting node \"ip-10-0-143-46.ec2.internal\": node \"ip-10-0-143-46.ec2.internal\" not found"
May 25 11:17:41.775774 ip-10-0-143-46 kubenswrapper[2569]: E0525 11:17:41.775755    2569 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-143-46.ec2.internal\" not found"
May 25 11:17:41.825751 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:17:41.825724    2569 kubelet.go:2537] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-46.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-143-46.ec2.internal"]
May 25 11:17:41.825863 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:17:41.825821    2569 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach"
May 25 11:17:41.827472 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:17:41.827456    2569 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-143-46.ec2.internal" event="NodeHasSufficientMemory"
May 25 11:17:41.827549 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:17:41.827485    2569 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-143-46.ec2.internal" event="NodeHasNoDiskPressure"
May 25 11:17:41.827549 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:17:41.827499    2569 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-143-46.ec2.internal" event="NodeHasSufficientPID"
May 25 11:17:41.828599 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:17:41.828587    2569 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach"
May 25 11:17:41.828766 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:17:41.828753    2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-46.ec2.internal"
May 25 11:17:41.828821 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:17:41.828796    2569 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach"
May 25 11:17:41.829555 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:17:41.829542    2569 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-143-46.ec2.internal" event="NodeHasSufficientMemory"
May 25 11:17:41.829596 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:17:41.829569    2569 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-143-46.ec2.internal" event="NodeHasNoDiskPressure"
May 25 11:17:41.829596 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:17:41.829581    2569 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-143-46.ec2.internal" event="NodeHasSufficientPID"
May 25 11:17:41.829596 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:17:41.829542    2569 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-143-46.ec2.internal" event="NodeHasSufficientMemory"
May 25 11:17:41.829694 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:17:41.829611    2569 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-143-46.ec2.internal" event="NodeHasNoDiskPressure"
May 25 11:17:41.829694 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:17:41.829623    2569 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-143-46.ec2.internal" event="NodeHasSufficientPID"
May 25 11:17:41.830801 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:17:41.830768    2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-46.ec2.internal"
May 25 11:17:41.830888 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:17:41.830810    2569 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach"
May 25 11:17:41.831430 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:17:41.831415    2569 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-143-46.ec2.internal" event="NodeHasSufficientMemory"
May 25 11:17:41.831496 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:17:41.831439    2569 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-143-46.ec2.internal" event="NodeHasNoDiskPressure"
May 25 11:17:41.831496 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:17:41.831453    2569 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-143-46.ec2.internal" event="NodeHasSufficientPID"
May 25 11:17:41.868479 ip-10-0-143-46 kubenswrapper[2569]: E0525 11:17:41.868454    2569 kubelet.go:3336] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-143-46.ec2.internal\" not found" node="ip-10-0-143-46.ec2.internal"
May 25 11:17:41.872905 ip-10-0-143-46 kubenswrapper[2569]: E0525 11:17:41.872884    2569 kubelet.go:3336] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-143-46.ec2.internal\" not found" node="ip-10-0-143-46.ec2.internal"
May 25 11:17:41.875831 ip-10-0-143-46 kubenswrapper[2569]: E0525 11:17:41.875817    2569 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-143-46.ec2.internal\" not found"
May 25 11:17:41.885011 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:17:41.884994    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/56519f8fe9fae3cdb88779f3c49e86c7-config\") pod \"kube-apiserver-proxy-ip-10-0-143-46.ec2.internal\" (UID: \"56519f8fe9fae3cdb88779f3c49e86c7\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-143-46.ec2.internal"
May 25 11:17:41.885062 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:17:41.885019    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/fddcfb3fb0e59f1e59d5cacf25dda527-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-143-46.ec2.internal\" (UID: \"fddcfb3fb0e59f1e59d5cacf25dda527\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-46.ec2.internal"
May 25 11:17:41.885062 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:17:41.885038    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/fddcfb3fb0e59f1e59d5cacf25dda527-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-143-46.ec2.internal\" (UID: \"fddcfb3fb0e59f1e59d5cacf25dda527\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-46.ec2.internal"
May 25 11:17:41.976990 ip-10-0-143-46 kubenswrapper[2569]: E0525 11:17:41.976917    2569 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-143-46.ec2.internal\" not found"
May 25 11:17:41.985678 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:17:41.985656    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/fddcfb3fb0e59f1e59d5cacf25dda527-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-143-46.ec2.internal\" (UID: \"fddcfb3fb0e59f1e59d5cacf25dda527\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-46.ec2.internal"
May 25 11:17:41.985777 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:17:41.985681    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/fddcfb3fb0e59f1e59d5cacf25dda527-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-143-46.ec2.internal\" (UID: \"fddcfb3fb0e59f1e59d5cacf25dda527\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-46.ec2.internal"
May 25 11:17:41.985777 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:17:41.985698    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/56519f8fe9fae3cdb88779f3c49e86c7-config\") pod \"kube-apiserver-proxy-ip-10-0-143-46.ec2.internal\" (UID: \"56519f8fe9fae3cdb88779f3c49e86c7\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-143-46.ec2.internal"
May 25 11:17:41.985777 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:17:41.985731    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/56519f8fe9fae3cdb88779f3c49e86c7-config\") pod \"kube-apiserver-proxy-ip-10-0-143-46.ec2.internal\" (UID: \"56519f8fe9fae3cdb88779f3c49e86c7\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-143-46.ec2.internal"
May 25 11:17:41.985777 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:17:41.985740    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/fddcfb3fb0e59f1e59d5cacf25dda527-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-143-46.ec2.internal\" (UID: \"fddcfb3fb0e59f1e59d5cacf25dda527\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-46.ec2.internal"
May 25 11:17:41.985777 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:17:41.985765    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/fddcfb3fb0e59f1e59d5cacf25dda527-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-143-46.ec2.internal\" (UID: \"fddcfb3fb0e59f1e59d5cacf25dda527\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-46.ec2.internal"
May 25 11:17:42.077620 ip-10-0-143-46 kubenswrapper[2569]: E0525 11:17:42.077588    2569 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-143-46.ec2.internal\" not found"
May 25 11:17:42.171110 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:17:42.171070    2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-46.ec2.internal"
May 25 11:17:42.175857 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:17:42.175840    2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-46.ec2.internal"
May 25 11:17:42.177814 ip-10-0-143-46 kubenswrapper[2569]: E0525 11:17:42.177778    2569 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-143-46.ec2.internal\" not found"
May 25 11:17:42.278514 ip-10-0-143-46 kubenswrapper[2569]: E0525 11:17:42.278430    2569 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-143-46.ec2.internal\" not found"
May 25 11:17:42.378969 ip-10-0-143-46 kubenswrapper[2569]: E0525 11:17:42.378930    2569 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-143-46.ec2.internal\" not found"
May 25 11:17:42.479573 ip-10-0-143-46 kubenswrapper[2569]: E0525 11:17:42.479544    2569 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-143-46.ec2.internal\" not found"
May 25 11:17:42.496987 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:17:42.496961    2569 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
May 25 11:17:42.497116 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:17:42.497099    2569 reflector.go:556] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
May 25 11:17:42.579816 ip-10-0-143-46 kubenswrapper[2569]: E0525 11:17:42.579776    2569 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-143-46.ec2.internal\" not found"
May 25 11:17:42.584097 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:17:42.584077    2569 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
May 25 11:17:42.598737 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:17:42.598704    2569 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-05-24 11:12:41 +0000 UTC" deadline="2028-02-10 17:20:37.055553598 +0000 UTC"
May 25 11:17:42.598737 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:17:42.598736    2569 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="15030h2m54.45682061s"
May 25 11:17:42.602052 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:17:42.602034    2569 reflector.go:430] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
May 25 11:17:42.604504 ip-10-0-143-46 kubenswrapper[2569]: W0525 11:17:42.604467    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfddcfb3fb0e59f1e59d5cacf25dda527.slice/crio-e96b52d81092a1c72935aa27290b327343f66fe8da2406ddc5179e0163e5bf2b WatchSource:0}: Error finding container e96b52d81092a1c72935aa27290b327343f66fe8da2406ddc5179e0163e5bf2b: Status 404 returned error can't find the container with id e96b52d81092a1c72935aa27290b327343f66fe8da2406ddc5179e0163e5bf2b
May 25 11:17:42.604666 ip-10-0-143-46 kubenswrapper[2569]: W0525 11:17:42.604648    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod56519f8fe9fae3cdb88779f3c49e86c7.slice/crio-3238a9e8ed020ea9519e7c3d4732bb53ce65cddf585dfa4d85750c5c9f8bdd6b WatchSource:0}: Error finding container 3238a9e8ed020ea9519e7c3d4732bb53ce65cddf585dfa4d85750c5c9f8bdd6b: Status 404 returned error can't find the container with id 3238a9e8ed020ea9519e7c3d4732bb53ce65cddf585dfa4d85750c5c9f8bdd6b
May 25 11:17:42.608410 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:17:42.608387    2569 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
May 25 11:17:42.623515 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:17:42.623499    2569 reflector.go:430] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
May 25 11:17:42.633567 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:17:42.633547    2569 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-46r9w"
May 25 11:17:42.647447 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:17:42.647427    2569 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-46r9w"
May 25 11:17:42.679975 ip-10-0-143-46 kubenswrapper[2569]: E0525 11:17:42.679960    2569 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-143-46.ec2.internal\" not found"
May 25 11:17:42.727004 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:17:42.726949    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-46.ec2.internal" event={"ID":"56519f8fe9fae3cdb88779f3c49e86c7","Type":"ContainerStarted","Data":"3238a9e8ed020ea9519e7c3d4732bb53ce65cddf585dfa4d85750c5c9f8bdd6b"}
May 25 11:17:42.727774 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:17:42.727754    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-46.ec2.internal" event={"ID":"fddcfb3fb0e59f1e59d5cacf25dda527","Type":"ContainerStarted","Data":"e96b52d81092a1c72935aa27290b327343f66fe8da2406ddc5179e0163e5bf2b"}
May 25 11:17:42.780922 ip-10-0-143-46 kubenswrapper[2569]: E0525 11:17:42.780901    2569 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-143-46.ec2.internal\" not found"
May 25 11:17:42.851688 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:17:42.851616    2569 reflector.go:430] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
May 25 11:17:42.883511 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:17:42.883496    2569 kubelet.go:3340] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-46.ec2.internal"
May 25 11:17:42.895659 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:17:42.895637    2569 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
May 25 11:17:42.896580 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:17:42.896558    2569 kubelet.go:3340] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-46.ec2.internal"
May 25 11:17:42.904810 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:17:42.904780    2569 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
May 25 11:17:43.069040 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:17:43.069012    2569 reflector.go:430] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
May 25 11:17:43.473981 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:17:43.473952    2569 reflector.go:430] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
May 25 11:17:43.559293 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:17:43.559257    2569 apiserver.go:52] "Watching apiserver"
May 25 11:17:43.566322 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:17:43.566295    2569 reflector.go:430] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
May 25 11:17:43.567038 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:17:43.567005    2569 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-multus/multus-8khmw","openshift-multus/multus-additional-cni-plugins-64cbl","openshift-multus/network-metrics-daemon-pd47q","openshift-network-diagnostics/network-check-target-7x8z9","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vw42x","openshift-dns/node-resolver-r8nxs","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-46.ec2.internal","openshift-network-operator/iptables-alerter-glmqw","openshift-ovn-kubernetes/ovnkube-node-pvgm2","kube-system/konnectivity-agent-nn7vp","kube-system/kube-apiserver-proxy-ip-10-0-143-46.ec2.internal","openshift-cluster-node-tuning-operator/tuned-tpvk4","openshift-image-registry/node-ca-tq2s9"]
May 25 11:17:43.569752 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:17:43.569733    2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-nn7vp"
May 25 11:17:43.570908 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:17:43.570882    2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-64cbl"
May 25 11:17:43.571892 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:17:43.571872    2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pd47q"
May 25 11:17:43.572009 ip-10-0-143-46 kubenswrapper[2569]: E0525 11:17:43.571950    2569 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pd47q" podUID="9098669d-fa99-44c7-94ad-4e3560412654"
May 25 11:17:43.572009 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:17:43.571969    2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7x8z9"
May 25 11:17:43.572111 ip-10-0-143-46 kubenswrapper[2569]: E0525 11:17:43.572011    2569 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7x8z9" podUID="242d8af2-b5ad-4319-a821-39f484f7ea5c"
May 25 11:17:43.572732 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:17:43.572479    2569 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
May 25 11:17:43.572732 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:17:43.572514    2569 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
May 25 11:17:43.572732 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:17:43.572517    2569 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-kzk9c\""
May 25 11:17:43.573223 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:17:43.573191    2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vw42x"
May 25 11:17:43.573344 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:17:43.573248    2569 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
May 25 11:17:43.573526 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:17:43.573506    2569 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
May 25 11:17:43.573624 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:17:43.573563    2569 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
May 25 11:17:43.573813 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:17:43.573777    2569 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
May 25 11:17:43.573892 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:17:43.573822    2569 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
May 25 11:17:43.573892 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:17:43.573865    2569 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-b9qpb\""
May 25 11:17:43.574271 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:17:43.574253    2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-r8nxs"
May 25 11:17:43.575658 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:17:43.575317    2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-glmqw"
May 25 11:17:43.575753 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:17:43.575722    2569 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
May 25 11:17:43.575911 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:17:43.575895    2569 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
May 25 11:17:43.575984 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:17:43.575943    2569 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
May 25 11:17:43.576174 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:17:43.576159    2569 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-jl6ph\""
May 25 11:17:43.576459 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:17:43.576442    2569 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
May 25 11:17:43.576550 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:17:43.576448    2569 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
May 25 11:17:43.576843 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:17:43.576822    2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-pvgm2"
May 25 11:17:43.576843 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:17:43.576835    2569 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-xnrpf\""
May 25 11:17:43.577779 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:17:43.577663    2569 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
May 25 11:17:43.577779 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:17:43.577683    2569 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-pmns6\""
May 25 11:17:43.578008 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:17:43.577986    2569 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
May 25 11:17:43.578072 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:17:43.578043    2569 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
May 25 11:17:43.579045 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:17:43.579017    2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-tpvk4"
May 25 11:17:43.579620 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:17:43.579153    2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-tq2s9"
May 25 11:17:43.579620 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:17:43.579451    2569 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
May 25 11:17:43.580087 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:17:43.580065    2569 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
May 25 11:17:43.580247 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:17:43.580130    2569 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
May 25 11:17:43.580247 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:17:43.580148    2569 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
May 25 11:17:43.580247 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:17:43.580159    2569 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
May 25 11:17:43.580389 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:17:43.580273    2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-8khmw"
May 25 11:17:43.580389 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:17:43.580359    2569 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-fdwwv\""
May 25 11:17:43.580448 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:17:43.580360    2569 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
May 25 11:17:43.582823 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:17:43.582802    2569 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
May 25 11:17:43.582928 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:17:43.582907    2569 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
May 25 11:17:43.583014 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:17:43.582996    2569 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-df4fj\""
May 25 11:17:43.583327 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:17:43.583180    2569 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
May 25 11:17:43.583327 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:17:43.583225    2569 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-2hp4h\""
May 25 11:17:43.583327 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:17:43.583244    2569 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
May 25 11:17:43.583853 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:17:43.583835    2569 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-l6vpk\""
May 25 11:17:43.583942 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:17:43.583851    2569 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
May 25 11:17:43.583942 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:17:43.583889    2569 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
May 25 11:17:43.584064 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:17:43.584050    2569 desired_state_of_world_populator.go:158] "Finished populating initial desired state of world"
May 25 11:17:43.593289 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:17:43.593270    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/ceeaa8f0-8aae-4758-8813-959a2343178a-host-cni-bin\") pod \"ovnkube-node-pvgm2\" (UID: \"ceeaa8f0-8aae-4758-8813-959a2343178a\") " pod="openshift-ovn-kubernetes/ovnkube-node-pvgm2"
May 25 11:17:43.593383 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:17:43.593300    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/3c766359-4ff0-4cfc-963f-d2653c4ebc9a-lib-modules\") pod \"tuned-tpvk4\" (UID: \"3c766359-4ff0-4cfc-963f-d2653c4ebc9a\") " pod="openshift-cluster-node-tuning-operator/tuned-tpvk4"
May 25 11:17:43.593383 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:17:43.593325    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e9016da7-9735-47a6-b0d7-7416ea5e1a7f-system-cni-dir\") pod \"multus-8khmw\" (UID: \"e9016da7-9735-47a6-b0d7-7416ea5e1a7f\") " pod="openshift-multus/multus-8khmw"
May 25 11:17:43.593383 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:17:43.593347    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/e9016da7-9735-47a6-b0d7-7416ea5e1a7f-os-release\") pod \"multus-8khmw\" (UID: \"e9016da7-9735-47a6-b0d7-7416ea5e1a7f\") " pod="openshift-multus/multus-8khmw"
May 25 11:17:43.593383 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:17:43.593370    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/e9016da7-9735-47a6-b0d7-7416ea5e1a7f-host-run-multus-certs\") pod \"multus-8khmw\" (UID: \"e9016da7-9735-47a6-b0d7-7416ea5e1a7f\") " pod="openshift-multus/multus-8khmw"
May 25 11:17:43.593543 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:17:43.593394    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/ceeaa8f0-8aae-4758-8813-959a2343178a-host-kubelet\") pod \"ovnkube-node-pvgm2\" (UID: \"ceeaa8f0-8aae-4758-8813-959a2343178a\") " pod="openshift-ovn-kubernetes/ovnkube-node-pvgm2"
May 25 11:17:43.593543 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:17:43.593418    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/3c766359-4ff0-4cfc-963f-d2653c4ebc9a-etc-sysconfig\") pod \"tuned-tpvk4\" (UID: \"3c766359-4ff0-4cfc-963f-d2653c4ebc9a\") " pod="openshift-cluster-node-tuning-operator/tuned-tpvk4"
May 25 11:17:43.593543 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:17:43.593463    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3c766359-4ff0-4cfc-963f-d2653c4ebc9a-etc-kubernetes\") pod \"tuned-tpvk4\" (UID: \"3c766359-4ff0-4cfc-963f-d2653c4ebc9a\") " pod="openshift-cluster-node-tuning-operator/tuned-tpvk4"
May 25 11:17:43.593543 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:17:43.593517    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9np84\" (UniqueName: \"kubernetes.io/projected/3c766359-4ff0-4cfc-963f-d2653c4ebc9a-kube-api-access-9np84\") pod \"tuned-tpvk4\" (UID: \"3c766359-4ff0-4cfc-963f-d2653c4ebc9a\") " pod="openshift-cluster-node-tuning-operator/tuned-tpvk4"
May 25 11:17:43.593718 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:17:43.593698    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/05d11822-eeca-4852-b8ce-6b2235d5dbf3-cnibin\") pod \"multus-additional-cni-plugins-64cbl\" (UID: \"05d11822-eeca-4852-b8ce-6b2235d5dbf3\") " pod="openshift-multus/multus-additional-cni-plugins-64cbl"
May 25 11:17:43.593831 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:17:43.593779    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/e9016da7-9735-47a6-b0d7-7416ea5e1a7f-hostroot\") pod \"multus-8khmw\" (UID: \"e9016da7-9735-47a6-b0d7-7416ea5e1a7f\") " pod="openshift-multus/multus-8khmw"
May 25 11:17:43.593988 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:17:43.593964    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/defe3e45-8839-4bbc-a8e1-5641dd6b3b33-agent-certs\") pod \"konnectivity-agent-nn7vp\" (UID: \"defe3e45-8839-4bbc-a8e1-5641dd6b3b33\") " pod="kube-system/konnectivity-agent-nn7vp"
May 25 11:17:43.594068 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:17:43.594048    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/ddc0dd0a-fe9e-43cc-8a9b-2459ebd2c6e7-etc-selinux\") pod \"aws-ebs-csi-driver-node-vw42x\" (UID: \"ddc0dd0a-fe9e-43cc-8a9b-2459ebd2c6e7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vw42x"
May 25 11:17:43.594117 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:17:43.594099    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/03cfb2ba-daef-4ac9-b9b5-7c52f9199154-host-slash\") pod \"iptables-alerter-glmqw\" (UID: \"03cfb2ba-daef-4ac9-b9b5-7c52f9199154\") " pod="openshift-network-operator/iptables-alerter-glmqw"
May 25 11:17:43.594162 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:17:43.594141    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/3cf3c515-4ccb-4fcd-b5d3-205cb581a363-serviceca\") pod \"node-ca-tq2s9\" (UID: \"3cf3c515-4ccb-4fcd-b5d3-205cb581a363\") " pod="openshift-image-registry/node-ca-tq2s9"
May 25 11:17:43.594245 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:17:43.594225    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/05d11822-eeca-4852-b8ce-6b2235d5dbf3-os-release\") pod \"multus-additional-cni-plugins-64cbl\" (UID: \"05d11822-eeca-4852-b8ce-6b2235d5dbf3\") " pod="openshift-multus/multus-additional-cni-plugins-64cbl"
May 25 11:17:43.594326 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:17:43.594288    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e9016da7-9735-47a6-b0d7-7416ea5e1a7f-host-var-lib-kubelet\") pod \"multus-8khmw\" (UID: \"e9016da7-9735-47a6-b0d7-7416ea5e1a7f\") " pod="openshift-multus/multus-8khmw"
May 25 11:17:43.594433 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:17:43.594345    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/defe3e45-8839-4bbc-a8e1-5641dd6b3b33-konnectivity-ca\") pod \"konnectivity-agent-nn7vp\" (UID: \"defe3e45-8839-4bbc-a8e1-5641dd6b3b33\") " pod="kube-system/konnectivity-agent-nn7vp"
May 25 11:17:43.594433 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:17:43.594391    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/03cfb2ba-daef-4ac9-b9b5-7c52f9199154-iptables-alerter-script\") pod \"iptables-alerter-glmqw\" (UID: \"03cfb2ba-daef-4ac9-b9b5-7c52f9199154\") " pod="openshift-network-operator/iptables-alerter-glmqw"
May 25 11:17:43.594433 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:17:43.594428    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/ceeaa8f0-8aae-4758-8813-959a2343178a-host-slash\") pod \"ovnkube-node-pvgm2\" (UID: \"ceeaa8f0-8aae-4758-8813-959a2343178a\") " pod="openshift-ovn-kubernetes/ovnkube-node-pvgm2"
May 25 11:17:43.594594 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:17:43.594462    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-flwbm\" (UniqueName: \"kubernetes.io/projected/ceeaa8f0-8aae-4758-8813-959a2343178a-kube-api-access-flwbm\") pod \"ovnkube-node-pvgm2\" (UID: \"ceeaa8f0-8aae-4758-8813-959a2343178a\") " pod="openshift-ovn-kubernetes/ovnkube-node-pvgm2"
May 25 11:17:43.596848 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:17:43.594755    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/3c766359-4ff0-4cfc-963f-d2653c4ebc9a-etc-systemd\") pod \"tuned-tpvk4\" (UID: \"3c766359-4ff0-4cfc-963f-d2653c4ebc9a\") " pod="openshift-cluster-node-tuning-operator/tuned-tpvk4"
May 25 11:17:43.596848 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:17:43.594812    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e9016da7-9735-47a6-b0d7-7416ea5e1a7f-multus-cni-dir\") pod \"multus-8khmw\" (UID: \"e9016da7-9735-47a6-b0d7-7416ea5e1a7f\") " pod="openshift-multus/multus-8khmw"
May 25 11:17:43.596848 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:17:43.594840    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/e9016da7-9735-47a6-b0d7-7416ea5e1a7f-cni-binary-copy\") pod \"multus-8khmw\" (UID: \"e9016da7-9735-47a6-b0d7-7416ea5e1a7f\") " pod="openshift-multus/multus-8khmw"
May 25 11:17:43.596848 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:17:43.594983    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/ddc0dd0a-fe9e-43cc-8a9b-2459ebd2c6e7-registration-dir\") pod \"aws-ebs-csi-driver-node-vw42x\" (UID: \"ddc0dd0a-fe9e-43cc-8a9b-2459ebd2c6e7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vw42x"
May 25 11:17:43.596848 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:17:43.595021    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/f0bab5fa-9ff8-4d17-9108-5a985f7bc43b-hosts-file\") pod \"node-resolver-r8nxs\" (UID: \"f0bab5fa-9ff8-4d17-9108-5a985f7bc43b\") " pod="openshift-dns/node-resolver-r8nxs"
May 25 11:17:43.596848 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:17:43.595078    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f0bab5fa-9ff8-4d17-9108-5a985f7bc43b-tmp-dir\") pod \"node-resolver-r8nxs\" (UID: \"f0bab5fa-9ff8-4d17-9108-5a985f7bc43b\") " pod="openshift-dns/node-resolver-r8nxs"
May 25 11:17:43.596848 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:17:43.595116    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ceeaa8f0-8aae-4758-8813-959a2343178a-host-run-ovn-kubernetes\") pod \"ovnkube-node-pvgm2\" (UID: \"ceeaa8f0-8aae-4758-8813-959a2343178a\") " pod="openshift-ovn-kubernetes/ovnkube-node-pvgm2"
May 25 11:17:43.596848 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:17:43.595154    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/ceeaa8f0-8aae-4758-8813-959a2343178a-host-cni-netd\") pod \"ovnkube-node-pvgm2\" (UID: \"ceeaa8f0-8aae-4758-8813-959a2343178a\") " pod="openshift-ovn-kubernetes/ovnkube-node-pvgm2"
May 25 11:17:43.596848 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:17:43.595412    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/05d11822-eeca-4852-b8ce-6b2235d5dbf3-tuning-conf-dir\") pod \"multus-additional-cni-plugins-64cbl\" (UID: \"05d11822-eeca-4852-b8ce-6b2235d5dbf3\") " pod="openshift-multus/multus-additional-cni-plugins-64cbl"
May 25 11:17:43.596848 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:17:43.595454    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/ddc0dd0a-fe9e-43cc-8a9b-2459ebd2c6e7-device-dir\") pod \"aws-ebs-csi-driver-node-vw42x\" (UID: \"ddc0dd0a-fe9e-43cc-8a9b-2459ebd2c6e7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vw42x"
May 25 11:17:43.596848 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:17:43.595530    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/ceeaa8f0-8aae-4758-8813-959a2343178a-host-run-netns\") pod \"ovnkube-node-pvgm2\" (UID: \"ceeaa8f0-8aae-4758-8813-959a2343178a\") " pod="openshift-ovn-kubernetes/ovnkube-node-pvgm2"
May 25 11:17:43.596848 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:17:43.595561    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/e9016da7-9735-47a6-b0d7-7416ea5e1a7f-multus-socket-dir-parent\") pod \"multus-8khmw\" (UID: \"e9016da7-9735-47a6-b0d7-7416ea5e1a7f\") " pod="openshift-multus/multus-8khmw"
May 25 11:17:43.596848 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:17:43.595597    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/3c766359-4ff0-4cfc-963f-d2653c4ebc9a-etc-sysctl-d\") pod \"tuned-tpvk4\" (UID: \"3c766359-4ff0-4cfc-963f-d2653c4ebc9a\") " pod="openshift-cluster-node-tuning-operator/tuned-tpvk4"
May 25 11:17:43.596848 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:17:43.595632    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/3c766359-4ff0-4cfc-963f-d2653c4ebc9a-run\") pod \"tuned-tpvk4\" (UID: \"3c766359-4ff0-4cfc-963f-d2653c4ebc9a\") " pod="openshift-cluster-node-tuning-operator/tuned-tpvk4"
May 25 11:17:43.596848 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:17:43.595752    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/e9016da7-9735-47a6-b0d7-7416ea5e1a7f-multus-daemon-config\") pod \"multus-8khmw\" (UID: \"e9016da7-9735-47a6-b0d7-7416ea5e1a7f\") " pod="openshift-multus/multus-8khmw"
May 25 11:17:43.596848 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:17:43.595818    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/ddc0dd0a-fe9e-43cc-8a9b-2459ebd2c6e7-kubelet-dir\") pod \"aws-ebs-csi-driver-node-vw42x\" (UID: \"ddc0dd0a-fe9e-43cc-8a9b-2459ebd2c6e7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vw42x"
May 25 11:17:43.597564 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:17:43.595859    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k9sqm\" (UniqueName: \"kubernetes.io/projected/ddc0dd0a-fe9e-43cc-8a9b-2459ebd2c6e7-kube-api-access-k9sqm\") pod \"aws-ebs-csi-driver-node-vw42x\" (UID: \"ddc0dd0a-fe9e-43cc-8a9b-2459ebd2c6e7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vw42x"
May 25 11:17:43.597564 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:17:43.595891    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rsk2b\" (UniqueName: \"kubernetes.io/projected/03cfb2ba-daef-4ac9-b9b5-7c52f9199154-kube-api-access-rsk2b\") pod \"iptables-alerter-glmqw\" (UID: \"03cfb2ba-daef-4ac9-b9b5-7c52f9199154\") " pod="openshift-network-operator/iptables-alerter-glmqw"
May 25 11:17:43.597564 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:17:43.595927    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ceeaa8f0-8aae-4758-8813-959a2343178a-run-openvswitch\") pod \"ovnkube-node-pvgm2\" (UID: \"ceeaa8f0-8aae-4758-8813-959a2343178a\") " pod="openshift-ovn-kubernetes/ovnkube-node-pvgm2"
May 25 11:17:43.597564 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:17:43.596036    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/3c766359-4ff0-4cfc-963f-d2653c4ebc9a-etc-modprobe-d\") pod \"tuned-tpvk4\" (UID: \"3c766359-4ff0-4cfc-963f-d2653c4ebc9a\") " pod="openshift-cluster-node-tuning-operator/tuned-tpvk4"
May 25 11:17:43.597564 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:17:43.596068    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/3c766359-4ff0-4cfc-963f-d2653c4ebc9a-sys\") pod \"tuned-tpvk4\" (UID: \"3c766359-4ff0-4cfc-963f-d2653c4ebc9a\") " pod="openshift-cluster-node-tuning-operator/tuned-tpvk4"
May 25 11:17:43.597564 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:17:43.596097    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ceeaa8f0-8aae-4758-8813-959a2343178a-etc-openvswitch\") pod \"ovnkube-node-pvgm2\" (UID: \"ceeaa8f0-8aae-4758-8813-959a2343178a\") " pod="openshift-ovn-kubernetes/ovnkube-node-pvgm2"
May 25 11:17:43.597564 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:17:43.596131    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/05d11822-eeca-4852-b8ce-6b2235d5dbf3-cni-binary-copy\") pod \"multus-additional-cni-plugins-64cbl\" (UID: \"05d11822-eeca-4852-b8ce-6b2235d5dbf3\") " pod="openshift-multus/multus-additional-cni-plugins-64cbl"
May 25 11:17:43.597564 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:17:43.596231    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-47jzh\" (UniqueName: \"kubernetes.io/projected/05d11822-eeca-4852-b8ce-6b2235d5dbf3-kube-api-access-47jzh\") pod \"multus-additional-cni-plugins-64cbl\" (UID: \"05d11822-eeca-4852-b8ce-6b2235d5dbf3\") " pod="openshift-multus/multus-additional-cni-plugins-64cbl"
May 25 11:17:43.597564 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:17:43.596323    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/ceeaa8f0-8aae-4758-8813-959a2343178a-run-systemd\") pod \"ovnkube-node-pvgm2\" (UID: \"ceeaa8f0-8aae-4758-8813-959a2343178a\") " pod="openshift-ovn-kubernetes/ovnkube-node-pvgm2"
May 25 11:17:43.597564 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:17:43.596852    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/ceeaa8f0-8aae-4758-8813-959a2343178a-log-socket\") pod \"ovnkube-node-pvgm2\" (UID: \"ceeaa8f0-8aae-4758-8813-959a2343178a\") " pod="openshift-ovn-kubernetes/ovnkube-node-pvgm2"
May 25 11:17:43.597564 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:17:43.596914    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/3c766359-4ff0-4cfc-963f-d2653c4ebc9a-etc-sysctl-conf\") pod \"tuned-tpvk4\" (UID: \"3c766359-4ff0-4cfc-963f-d2653c4ebc9a\") " pod="openshift-cluster-node-tuning-operator/tuned-tpvk4"
May 25 11:17:43.597564 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:17:43.596966    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/3cf3c515-4ccb-4fcd-b5d3-205cb581a363-host\") pod \"node-ca-tq2s9\" (UID: \"3cf3c515-4ccb-4fcd-b5d3-205cb581a363\") " pod="openshift-image-registry/node-ca-tq2s9"
May 25 11:17:43.597564 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:17:43.597140    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9098669d-fa99-44c7-94ad-4e3560412654-metrics-certs\") pod \"network-metrics-daemon-pd47q\" (UID: \"9098669d-fa99-44c7-94ad-4e3560412654\") " pod="openshift-multus/network-metrics-daemon-pd47q"
May 25 11:17:43.597564 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:17:43.597190    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/e9016da7-9735-47a6-b0d7-7416ea5e1a7f-host-var-lib-cni-multus\") pod \"multus-8khmw\" (UID: \"e9016da7-9735-47a6-b0d7-7416ea5e1a7f\") " pod="openshift-multus/multus-8khmw"
May 25 11:17:43.597564 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:17:43.597225    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/e9016da7-9735-47a6-b0d7-7416ea5e1a7f-multus-conf-dir\") pod \"multus-8khmw\" (UID: \"e9016da7-9735-47a6-b0d7-7416ea5e1a7f\") " pod="openshift-multus/multus-8khmw"
May 25 11:17:43.598276 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:17:43.597672    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3c766359-4ff0-4cfc-963f-d2653c4ebc9a-tmp\") pod \"tuned-tpvk4\" (UID: \"3c766359-4ff0-4cfc-963f-d2653c4ebc9a\") " pod="openshift-cluster-node-tuning-operator/tuned-tpvk4"
May 25 11:17:43.598276 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:17:43.597710    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-65mrf\" (UniqueName: \"kubernetes.io/projected/9098669d-fa99-44c7-94ad-4e3560412654-kube-api-access-65mrf\") pod \"network-metrics-daemon-pd47q\" (UID: \"9098669d-fa99-44c7-94ad-4e3560412654\") " pod="openshift-multus/network-metrics-daemon-pd47q"
May 25 11:17:43.598276 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:17:43.597747    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/ceeaa8f0-8aae-4758-8813-959a2343178a-ovn-node-metrics-cert\") pod \"ovnkube-node-pvgm2\" (UID: \"ceeaa8f0-8aae-4758-8813-959a2343178a\") " pod="openshift-ovn-kubernetes/ovnkube-node-pvgm2"
May 25 11:17:43.598276 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:17:43.597765    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/05d11822-eeca-4852-b8ce-6b2235d5dbf3-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-64cbl\" (UID: \"05d11822-eeca-4852-b8ce-6b2235d5dbf3\") " pod="openshift-multus/multus-additional-cni-plugins-64cbl"
May 25 11:17:43.598276 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:17:43.597803    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/e9016da7-9735-47a6-b0d7-7416ea5e1a7f-host-run-k8s-cni-cncf-io\") pod \"multus-8khmw\" (UID: \"e9016da7-9735-47a6-b0d7-7416ea5e1a7f\") " pod="openshift-multus/multus-8khmw"
May 25 11:17:43.598276 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:17:43.597832    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/e9016da7-9735-47a6-b0d7-7416ea5e1a7f-host-run-netns\") pod \"multus-8khmw\" (UID: \"e9016da7-9735-47a6-b0d7-7416ea5e1a7f\") " pod="openshift-multus/multus-8khmw"
May 25 11:17:43.598276 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:17:43.597854    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/05d11822-eeca-4852-b8ce-6b2235d5dbf3-system-cni-dir\") pod \"multus-additional-cni-plugins-64cbl\" (UID: \"05d11822-eeca-4852-b8ce-6b2235d5dbf3\") " pod="openshift-multus/multus-additional-cni-plugins-64cbl"
May 25 11:17:43.598276 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:17:43.597874    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/ceeaa8f0-8aae-4758-8813-959a2343178a-systemd-units\") pod \"ovnkube-node-pvgm2\" (UID: \"ceeaa8f0-8aae-4758-8813-959a2343178a\") " pod="openshift-ovn-kubernetes/ovnkube-node-pvgm2"
May 25 11:17:43.598276 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:17:43.597889    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ceeaa8f0-8aae-4758-8813-959a2343178a-var-lib-openvswitch\") pod \"ovnkube-node-pvgm2\" (UID: \"ceeaa8f0-8aae-4758-8813-959a2343178a\") " pod="openshift-ovn-kubernetes/ovnkube-node-pvgm2"
May 25 11:17:43.598276 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:17:43.597910    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/3c766359-4ff0-4cfc-963f-d2653c4ebc9a-etc-tuned\") pod \"tuned-tpvk4\" (UID: \"3c766359-4ff0-4cfc-963f-d2653c4ebc9a\") " pod="openshift-cluster-node-tuning-operator/tuned-tpvk4"
May 25 11:17:43.598276 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:17:43.597949    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cjf5z\" (UniqueName: \"kubernetes.io/projected/242d8af2-b5ad-4319-a821-39f484f7ea5c-kube-api-access-cjf5z\") pod \"network-check-target-7x8z9\" (UID: \"242d8af2-b5ad-4319-a821-39f484f7ea5c\") " pod="openshift-network-diagnostics/network-check-target-7x8z9"
May 25 11:17:43.598276 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:17:43.597991    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k49cf\" (UniqueName: \"kubernetes.io/projected/f0bab5fa-9ff8-4d17-9108-5a985f7bc43b-kube-api-access-k49cf\") pod \"node-resolver-r8nxs\" (UID: \"f0bab5fa-9ff8-4d17-9108-5a985f7bc43b\") " pod="openshift-dns/node-resolver-r8nxs"
May 25 11:17:43.598276 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:17:43.598050    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/ceeaa8f0-8aae-4758-8813-959a2343178a-node-log\") pod \"ovnkube-node-pvgm2\" (UID: \"ceeaa8f0-8aae-4758-8813-959a2343178a\") " pod="openshift-ovn-kubernetes/ovnkube-node-pvgm2"
May 25 11:17:43.598276 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:17:43.598096    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/ceeaa8f0-8aae-4758-8813-959a2343178a-ovnkube-config\") pod \"ovnkube-node-pvgm2\" (UID: \"ceeaa8f0-8aae-4758-8813-959a2343178a\") " pod="openshift-ovn-kubernetes/ovnkube-node-pvgm2"
May 25 11:17:43.598276 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:17:43.598185    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/ceeaa8f0-8aae-4758-8813-959a2343178a-ovnkube-script-lib\") pod \"ovnkube-node-pvgm2\" (UID: \"ceeaa8f0-8aae-4758-8813-959a2343178a\") " pod="openshift-ovn-kubernetes/ovnkube-node-pvgm2"
May 25 11:17:43.598276 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:17:43.598228    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dgrjf\" (UniqueName: \"kubernetes.io/projected/3cf3c515-4ccb-4fcd-b5d3-205cb581a363-kube-api-access-dgrjf\") pod \"node-ca-tq2s9\" (UID: \"3cf3c515-4ccb-4fcd-b5d3-205cb581a363\") " pod="openshift-image-registry/node-ca-tq2s9"
May 25 11:17:43.598953 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:17:43.598254    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e9016da7-9735-47a6-b0d7-7416ea5e1a7f-etc-kubernetes\") pod \"multus-8khmw\" (UID: \"e9016da7-9735-47a6-b0d7-7416ea5e1a7f\") " pod="openshift-multus/multus-8khmw"
May 25 11:17:43.598953 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:17:43.598285    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fxh6g\" (UniqueName: \"kubernetes.io/projected/e9016da7-9735-47a6-b0d7-7416ea5e1a7f-kube-api-access-fxh6g\") pod \"multus-8khmw\" (UID: \"e9016da7-9735-47a6-b0d7-7416ea5e1a7f\") " pod="openshift-multus/multus-8khmw"
May 25 11:17:43.598953 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:17:43.598308    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/ddc0dd0a-fe9e-43cc-8a9b-2459ebd2c6e7-socket-dir\") pod \"aws-ebs-csi-driver-node-vw42x\" (UID: \"ddc0dd0a-fe9e-43cc-8a9b-2459ebd2c6e7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vw42x"
May 25 11:17:43.598953 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:17:43.598342    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ceeaa8f0-8aae-4758-8813-959a2343178a-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-pvgm2\" (UID: \"ceeaa8f0-8aae-4758-8813-959a2343178a\") " pod="openshift-ovn-kubernetes/ovnkube-node-pvgm2"
May 25 11:17:43.598953 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:17:43.598372    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/3c766359-4ff0-4cfc-963f-d2653c4ebc9a-var-lib-kubelet\") pod \"tuned-tpvk4\" (UID: \"3c766359-4ff0-4cfc-963f-d2653c4ebc9a\") " pod="openshift-cluster-node-tuning-operator/tuned-tpvk4"
May 25 11:17:43.598953 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:17:43.598398    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/3c766359-4ff0-4cfc-963f-d2653c4ebc9a-host\") pod \"tuned-tpvk4\" (UID: \"3c766359-4ff0-4cfc-963f-d2653c4ebc9a\") " pod="openshift-cluster-node-tuning-operator/tuned-tpvk4"
May 25 11:17:43.598953 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:17:43.598443    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/05d11822-eeca-4852-b8ce-6b2235d5dbf3-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-64cbl\" (UID: \"05d11822-eeca-4852-b8ce-6b2235d5dbf3\") " pod="openshift-multus/multus-additional-cni-plugins-64cbl"
May 25 11:17:43.598953 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:17:43.598481    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/e9016da7-9735-47a6-b0d7-7416ea5e1a7f-cnibin\") pod \"multus-8khmw\" (UID: \"e9016da7-9735-47a6-b0d7-7416ea5e1a7f\") " pod="openshift-multus/multus-8khmw"
May 25 11:17:43.598953 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:17:43.598512    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/ddc0dd0a-fe9e-43cc-8a9b-2459ebd2c6e7-sys-fs\") pod \"aws-ebs-csi-driver-node-vw42x\" (UID: \"ddc0dd0a-fe9e-43cc-8a9b-2459ebd2c6e7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vw42x"
May 25 11:17:43.598953 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:17:43.598533    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/ceeaa8f0-8aae-4758-8813-959a2343178a-run-ovn\") pod \"ovnkube-node-pvgm2\" (UID: \"ceeaa8f0-8aae-4758-8813-959a2343178a\") " pod="openshift-ovn-kubernetes/ovnkube-node-pvgm2"
May 25 11:17:43.598953 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:17:43.598554    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/ceeaa8f0-8aae-4758-8813-959a2343178a-env-overrides\") pod \"ovnkube-node-pvgm2\" (UID: \"ceeaa8f0-8aae-4758-8813-959a2343178a\") " pod="openshift-ovn-kubernetes/ovnkube-node-pvgm2"
May 25 11:17:43.598953 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:17:43.598574    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/e9016da7-9735-47a6-b0d7-7416ea5e1a7f-host-var-lib-cni-bin\") pod \"multus-8khmw\" (UID: \"e9016da7-9735-47a6-b0d7-7416ea5e1a7f\") " pod="openshift-multus/multus-8khmw"
May 25 11:17:43.648704 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:17:43.648673    2569 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-05-24 11:12:42 +0000 UTC" deadline="2027-11-19 08:28:23.24260271 +0000 UTC"
May 25 11:17:43.648704 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:17:43.648703    2569 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13029h10m39.593902445s"
May 25 11:17:43.699607 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:17:43.699567    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/e9016da7-9735-47a6-b0d7-7416ea5e1a7f-host-var-lib-cni-multus\") pod \"multus-8khmw\" (UID: \"e9016da7-9735-47a6-b0d7-7416ea5e1a7f\") " pod="openshift-multus/multus-8khmw"
May 25 11:17:43.699607 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:17:43.699602    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/e9016da7-9735-47a6-b0d7-7416ea5e1a7f-multus-conf-dir\") pod \"multus-8khmw\" (UID: \"e9016da7-9735-47a6-b0d7-7416ea5e1a7f\") " pod="openshift-multus/multus-8khmw"
May 25 11:17:43.699859 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:17:43.699630    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3c766359-4ff0-4cfc-963f-d2653c4ebc9a-tmp\") pod \"tuned-tpvk4\" (UID: \"3c766359-4ff0-4cfc-963f-d2653c4ebc9a\") " pod="openshift-cluster-node-tuning-operator/tuned-tpvk4"
May 25 11:17:43.699859 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:17:43.699668    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/e9016da7-9735-47a6-b0d7-7416ea5e1a7f-host-var-lib-cni-multus\") pod \"multus-8khmw\" (UID: \"e9016da7-9735-47a6-b0d7-7416ea5e1a7f\") " pod="openshift-multus/multus-8khmw"
May 25 11:17:43.699859 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:17:43.699691    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/e9016da7-9735-47a6-b0d7-7416ea5e1a7f-multus-conf-dir\") pod \"multus-8khmw\" (UID: \"e9016da7-9735-47a6-b0d7-7416ea5e1a7f\") " pod="openshift-multus/multus-8khmw"
May 25 11:17:43.699859 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:17:43.699737    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-65mrf\" (UniqueName: \"kubernetes.io/projected/9098669d-fa99-44c7-94ad-4e3560412654-kube-api-access-65mrf\") pod \"network-metrics-daemon-pd47q\" (UID: \"9098669d-fa99-44c7-94ad-4e3560412654\") " pod="openshift-multus/network-metrics-daemon-pd47q"
May 25 11:17:43.699859 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:17:43.699799    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/ceeaa8f0-8aae-4758-8813-959a2343178a-ovn-node-metrics-cert\") pod \"ovnkube-node-pvgm2\" (UID: \"ceeaa8f0-8aae-4758-8813-959a2343178a\") " pod="openshift-ovn-kubernetes/ovnkube-node-pvgm2"
May 25 11:17:43.699859 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:17:43.699828    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/05d11822-eeca-4852-b8ce-6b2235d5dbf3-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-64cbl\" (UID: \"05d11822-eeca-4852-b8ce-6b2235d5dbf3\") " pod="openshift-multus/multus-additional-cni-plugins-64cbl"
May 25 11:17:43.699859 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:17:43.699854    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/e9016da7-9735-47a6-b0d7-7416ea5e1a7f-host-run-k8s-cni-cncf-io\") pod \"multus-8khmw\" (UID: \"e9016da7-9735-47a6-b0d7-7416ea5e1a7f\") " pod="openshift-multus/multus-8khmw"
May 25 11:17:43.700232 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:17:43.699878    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/e9016da7-9735-47a6-b0d7-7416ea5e1a7f-host-run-netns\") pod \"multus-8khmw\" (UID: \"e9016da7-9735-47a6-b0d7-7416ea5e1a7f\") " pod="openshift-multus/multus-8khmw"
May 25 11:17:43.700232 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:17:43.699903    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/05d11822-eeca-4852-b8ce-6b2235d5dbf3-system-cni-dir\") pod \"multus-additional-cni-plugins-64cbl\" (UID: \"05d11822-eeca-4852-b8ce-6b2235d5dbf3\") " pod="openshift-multus/multus-additional-cni-plugins-64cbl"
May 25 11:17:43.700232 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:17:43.699942    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/ceeaa8f0-8aae-4758-8813-959a2343178a-systemd-units\") pod \"ovnkube-node-pvgm2\" (UID: \"ceeaa8f0-8aae-4758-8813-959a2343178a\") " pod="openshift-ovn-kubernetes/ovnkube-node-pvgm2"
May 25 11:17:43.700232 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:17:43.699985    2569 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
May 25 11:17:43.700232 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:17:43.700013    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/e9016da7-9735-47a6-b0d7-7416ea5e1a7f-host-run-netns\") pod \"multus-8khmw\" (UID: \"e9016da7-9735-47a6-b0d7-7416ea5e1a7f\") " pod="openshift-multus/multus-8khmw"
May 25 11:17:43.700232 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:17:43.700012    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/e9016da7-9735-47a6-b0d7-7416ea5e1a7f-host-run-k8s-cni-cncf-io\") pod \"multus-8khmw\" (UID: \"e9016da7-9735-47a6-b0d7-7416ea5e1a7f\") " pod="openshift-multus/multus-8khmw"
May 25 11:17:43.700232 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:17:43.700054    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/ceeaa8f0-8aae-4758-8813-959a2343178a-systemd-units\") pod \"ovnkube-node-pvgm2\" (UID: \"ceeaa8f0-8aae-4758-8813-959a2343178a\") " pod="openshift-ovn-kubernetes/ovnkube-node-pvgm2"
May 25 11:17:43.700232 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:17:43.700071    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/05d11822-eeca-4852-b8ce-6b2235d5dbf3-system-cni-dir\") pod \"multus-additional-cni-plugins-64cbl\" (UID: \"05d11822-eeca-4852-b8ce-6b2235d5dbf3\") " pod="openshift-multus/multus-additional-cni-plugins-64cbl"
May 25 11:17:43.700232 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:17:43.700099    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ceeaa8f0-8aae-4758-8813-959a2343178a-var-lib-openvswitch\") pod \"ovnkube-node-pvgm2\" (UID: \"ceeaa8f0-8aae-4758-8813-959a2343178a\") " pod="openshift-ovn-kubernetes/ovnkube-node-pvgm2"
May 25 11:17:43.700232 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:17:43.700130    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/3c766359-4ff0-4cfc-963f-d2653c4ebc9a-etc-tuned\") pod \"tuned-tpvk4\" (UID: \"3c766359-4ff0-4cfc-963f-d2653c4ebc9a\") " pod="openshift-cluster-node-tuning-operator/tuned-tpvk4"
May 25 11:17:43.700232 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:17:43.700152    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-cjf5z\" (UniqueName: \"kubernetes.io/projected/242d8af2-b5ad-4319-a821-39f484f7ea5c-kube-api-access-cjf5z\") pod \"network-check-target-7x8z9\" (UID: \"242d8af2-b5ad-4319-a821-39f484f7ea5c\") " pod="openshift-network-diagnostics/network-check-target-7x8z9"
May 25 11:17:43.700232 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:17:43.700207    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-k49cf\" (UniqueName: \"kubernetes.io/projected/f0bab5fa-9ff8-4d17-9108-5a985f7bc43b-kube-api-access-k49cf\") pod \"node-resolver-r8nxs\" (UID: \"f0bab5fa-9ff8-4d17-9108-5a985f7bc43b\") " pod="openshift-dns/node-resolver-r8nxs"
May 25 11:17:43.700762 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:17:43.700244    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/ceeaa8f0-8aae-4758-8813-959a2343178a-node-log\") pod \"ovnkube-node-pvgm2\" (UID: \"ceeaa8f0-8aae-4758-8813-959a2343178a\") " pod="openshift-ovn-kubernetes/ovnkube-node-pvgm2"
May 25 11:17:43.700762 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:17:43.700270    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/ceeaa8f0-8aae-4758-8813-959a2343178a-ovnkube-config\") pod \"ovnkube-node-pvgm2\" (UID: \"ceeaa8f0-8aae-4758-8813-959a2343178a\") " pod="openshift-ovn-kubernetes/ovnkube-node-pvgm2"
May 25 11:17:43.700762 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:17:43.700285    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ceeaa8f0-8aae-4758-8813-959a2343178a-var-lib-openvswitch\") pod \"ovnkube-node-pvgm2\" (UID: \"ceeaa8f0-8aae-4758-8813-959a2343178a\") " pod="openshift-ovn-kubernetes/ovnkube-node-pvgm2"
May 25 11:17:43.700762 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:17:43.700299    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/ceeaa8f0-8aae-4758-8813-959a2343178a-ovnkube-script-lib\") pod \"ovnkube-node-pvgm2\" (UID: \"ceeaa8f0-8aae-4758-8813-959a2343178a\") " pod="openshift-ovn-kubernetes/ovnkube-node-pvgm2"
May 25 11:17:43.700762 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:17:43.700344    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-dgrjf\" (UniqueName: \"kubernetes.io/projected/3cf3c515-4ccb-4fcd-b5d3-205cb581a363-kube-api-access-dgrjf\") pod \"node-ca-tq2s9\" (UID: \"3cf3c515-4ccb-4fcd-b5d3-205cb581a363\") " pod="openshift-image-registry/node-ca-tq2s9"
May 25 11:17:43.700762 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:17:43.700348    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/ceeaa8f0-8aae-4758-8813-959a2343178a-node-log\") pod \"ovnkube-node-pvgm2\" (UID: \"ceeaa8f0-8aae-4758-8813-959a2343178a\") " pod="openshift-ovn-kubernetes/ovnkube-node-pvgm2"
May 25 11:17:43.700762 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:17:43.700369    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e9016da7-9735-47a6-b0d7-7416ea5e1a7f-etc-kubernetes\") pod \"multus-8khmw\" (UID: \"e9016da7-9735-47a6-b0d7-7416ea5e1a7f\") " pod="openshift-multus/multus-8khmw"
May 25 11:17:43.700762 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:17:43.700641    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/05d11822-eeca-4852-b8ce-6b2235d5dbf3-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-64cbl\" (UID: \"05d11822-eeca-4852-b8ce-6b2235d5dbf3\") " pod="openshift-multus/multus-additional-cni-plugins-64cbl"
May 25 11:17:43.700762 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:17:43.700639    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-fxh6g\" (UniqueName: \"kubernetes.io/projected/e9016da7-9735-47a6-b0d7-7416ea5e1a7f-kube-api-access-fxh6g\") pod \"multus-8khmw\" (UID: \"e9016da7-9735-47a6-b0d7-7416ea5e1a7f\") " pod="openshift-multus/multus-8khmw"
May 25 11:17:43.700762 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:17:43.700685    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/ddc0dd0a-fe9e-43cc-8a9b-2459ebd2c6e7-socket-dir\") pod \"aws-ebs-csi-driver-node-vw42x\" (UID: \"ddc0dd0a-fe9e-43cc-8a9b-2459ebd2c6e7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vw42x"
May 25 11:17:43.700762 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:17:43.700711    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ceeaa8f0-8aae-4758-8813-959a2343178a-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-pvgm2\" (UID: \"ceeaa8f0-8aae-4758-8813-959a2343178a\") " pod="openshift-ovn-kubernetes/ovnkube-node-pvgm2"
May 25 11:17:43.700762 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:17:43.700739    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/3c766359-4ff0-4cfc-963f-d2653c4ebc9a-var-lib-kubelet\") pod \"tuned-tpvk4\" (UID: \"3c766359-4ff0-4cfc-963f-d2653c4ebc9a\") " pod="openshift-cluster-node-tuning-operator/tuned-tpvk4"
May 25 11:17:43.700762 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:17:43.700763    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/3c766359-4ff0-4cfc-963f-d2653c4ebc9a-host\") pod \"tuned-tpvk4\" (UID: \"3c766359-4ff0-4cfc-963f-d2653c4ebc9a\") " pod="openshift-cluster-node-tuning-operator/tuned-tpvk4"
May 25 11:17:43.701366 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:17:43.700806    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/05d11822-eeca-4852-b8ce-6b2235d5dbf3-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-64cbl\" (UID: \"05d11822-eeca-4852-b8ce-6b2235d5dbf3\") " pod="openshift-multus/multus-additional-cni-plugins-64cbl"
May 25 11:17:43.701366 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:17:43.700834    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/e9016da7-9735-47a6-b0d7-7416ea5e1a7f-cnibin\") pod \"multus-8khmw\" (UID: \"e9016da7-9735-47a6-b0d7-7416ea5e1a7f\") " pod="openshift-multus/multus-8khmw"
May 25 11:17:43.701366 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:17:43.700860    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/ddc0dd0a-fe9e-43cc-8a9b-2459ebd2c6e7-sys-fs\") pod \"aws-ebs-csi-driver-node-vw42x\" (UID: \"ddc0dd0a-fe9e-43cc-8a9b-2459ebd2c6e7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vw42x"
May 25 11:17:43.701366 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:17:43.700884    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/ceeaa8f0-8aae-4758-8813-959a2343178a-run-ovn\") pod \"ovnkube-node-pvgm2\" (UID: \"ceeaa8f0-8aae-4758-8813-959a2343178a\") " pod="openshift-ovn-kubernetes/ovnkube-node-pvgm2"
May 25 11:17:43.701366 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:17:43.700912    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/ceeaa8f0-8aae-4758-8813-959a2343178a-env-overrides\") pod \"ovnkube-node-pvgm2\" (UID: \"ceeaa8f0-8aae-4758-8813-959a2343178a\") " pod="openshift-ovn-kubernetes/ovnkube-node-pvgm2"
May 25 11:17:43.701366 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:17:43.700916    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/ceeaa8f0-8aae-4758-8813-959a2343178a-ovnkube-script-lib\") pod \"ovnkube-node-pvgm2\" (UID: \"ceeaa8f0-8aae-4758-8813-959a2343178a\") " pod="openshift-ovn-kubernetes/ovnkube-node-pvgm2"
May 25 11:17:43.701366 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:17:43.700936    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/e9016da7-9735-47a6-b0d7-7416ea5e1a7f-host-var-lib-cni-bin\") pod \"multus-8khmw\" (UID: \"e9016da7-9735-47a6-b0d7-7416ea5e1a7f\") " pod="openshift-multus/multus-8khmw"
May 25 11:17:43.701366 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:17:43.700951    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/3c766359-4ff0-4cfc-963f-d2653c4ebc9a-host\") pod \"tuned-tpvk4\" (UID: \"3c766359-4ff0-4cfc-963f-d2653c4ebc9a\") " pod="openshift-cluster-node-tuning-operator/tuned-tpvk4"
May 25 11:17:43.701366 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:17:43.700965    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/ceeaa8f0-8aae-4758-8813-959a2343178a-host-cni-bin\") pod \"ovnkube-node-pvgm2\" (UID: \"ceeaa8f0-8aae-4758-8813-959a2343178a\") " pod="openshift-ovn-kubernetes/ovnkube-node-pvgm2"
May 25 11:17:43.701366 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:17:43.700971    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e9016da7-9735-47a6-b0d7-7416ea5e1a7f-etc-kubernetes\") pod \"multus-8khmw\" (UID: \"e9016da7-9735-47a6-b0d7-7416ea5e1a7f\") " pod="openshift-multus/multus-8khmw"
May 25 11:17:43.701366 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:17:43.700949    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/3c766359-4ff0-4cfc-963f-d2653c4ebc9a-var-lib-kubelet\") pod \"tuned-tpvk4\" (UID: \"3c766359-4ff0-4cfc-963f-d2653c4ebc9a\") " pod="openshift-cluster-node-tuning-operator/tuned-tpvk4"
May 25 11:17:43.701366 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:17:43.701003    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ceeaa8f0-8aae-4758-8813-959a2343178a-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-pvgm2\" (UID: \"ceeaa8f0-8aae-4758-8813-959a2343178a\") " pod="openshift-ovn-kubernetes/ovnkube-node-pvgm2"
May 25 11:17:43.701366 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:17:43.701030    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/3c766359-4ff0-4cfc-963f-d2653c4ebc9a-lib-modules\") pod \"tuned-tpvk4\" (UID: \"3c766359-4ff0-4cfc-963f-d2653c4ebc9a\") " pod="openshift-cluster-node-tuning-operator/tuned-tpvk4"
May 25 11:17:43.701366 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:17:43.701052    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/ceeaa8f0-8aae-4758-8813-959a2343178a-ovnkube-config\") pod \"ovnkube-node-pvgm2\" (UID: \"ceeaa8f0-8aae-4758-8813-959a2343178a\") " pod="openshift-ovn-kubernetes/ovnkube-node-pvgm2"
May 25 11:17:43.701366 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:17:43.701059    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/ddc0dd0a-fe9e-43cc-8a9b-2459ebd2c6e7-socket-dir\") pod \"aws-ebs-csi-driver-node-vw42x\" (UID: \"ddc0dd0a-fe9e-43cc-8a9b-2459ebd2c6e7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vw42x"
May 25 11:17:43.701366 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:17:43.701057    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e9016da7-9735-47a6-b0d7-7416ea5e1a7f-system-cni-dir\") pod \"multus-8khmw\" (UID: \"e9016da7-9735-47a6-b0d7-7416ea5e1a7f\") " pod="openshift-multus/multus-8khmw"
May 25 11:17:43.701366 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:17:43.701093    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e9016da7-9735-47a6-b0d7-7416ea5e1a7f-system-cni-dir\") pod \"multus-8khmw\" (UID: \"e9016da7-9735-47a6-b0d7-7416ea5e1a7f\") " pod="openshift-multus/multus-8khmw"
May 25 11:17:43.701366 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:17:43.701107    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/e9016da7-9735-47a6-b0d7-7416ea5e1a7f-os-release\") pod \"multus-8khmw\" (UID: \"e9016da7-9735-47a6-b0d7-7416ea5e1a7f\") " pod="openshift-multus/multus-8khmw"
May 25 11:17:43.702210 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:17:43.701141    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/e9016da7-9735-47a6-b0d7-7416ea5e1a7f-host-var-lib-cni-bin\") pod \"multus-8khmw\" (UID: \"e9016da7-9735-47a6-b0d7-7416ea5e1a7f\") " pod="openshift-multus/multus-8khmw"
May 25 11:17:43.702210 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:17:43.701147    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/e9016da7-9735-47a6-b0d7-7416ea5e1a7f-host-run-multus-certs\") pod \"multus-8khmw\" (UID: \"e9016da7-9735-47a6-b0d7-7416ea5e1a7f\") " pod="openshift-multus/multus-8khmw"
May 25 11:17:43.702210 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:17:43.701171    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/ceeaa8f0-8aae-4758-8813-959a2343178a-host-kubelet\") pod \"ovnkube-node-pvgm2\" (UID: \"ceeaa8f0-8aae-4758-8813-959a2343178a\") " pod="openshift-ovn-kubernetes/ovnkube-node-pvgm2"
May 25 11:17:43.702210 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:17:43.701185    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/ceeaa8f0-8aae-4758-8813-959a2343178a-host-cni-bin\") pod \"ovnkube-node-pvgm2\" (UID: \"ceeaa8f0-8aae-4758-8813-959a2343178a\") " pod="openshift-ovn-kubernetes/ovnkube-node-pvgm2"
May 25 11:17:43.702210 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:17:43.701187    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/3c766359-4ff0-4cfc-963f-d2653c4ebc9a-lib-modules\") pod \"tuned-tpvk4\" (UID: \"3c766359-4ff0-4cfc-963f-d2653c4ebc9a\") " pod="openshift-cluster-node-tuning-operator/tuned-tpvk4"
May 25 11:17:43.702210 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:17:43.701224    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/e9016da7-9735-47a6-b0d7-7416ea5e1a7f-host-run-multus-certs\") pod \"multus-8khmw\" (UID: \"e9016da7-9735-47a6-b0d7-7416ea5e1a7f\") " pod="openshift-multus/multus-8khmw"
May 25 11:17:43.702210 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:17:43.701236    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/ceeaa8f0-8aae-4758-8813-959a2343178a-host-kubelet\") pod \"ovnkube-node-pvgm2\" (UID: \"ceeaa8f0-8aae-4758-8813-959a2343178a\") " pod="openshift-ovn-kubernetes/ovnkube-node-pvgm2"
May 25 11:17:43.702210 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:17:43.701196    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/3c766359-4ff0-4cfc-963f-d2653c4ebc9a-etc-sysconfig\") pod \"tuned-tpvk4\" (UID: \"3c766359-4ff0-4cfc-963f-d2653c4ebc9a\") " pod="openshift-cluster-node-tuning-operator/tuned-tpvk4"
May 25 11:17:43.702210 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:17:43.701239    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/3c766359-4ff0-4cfc-963f-d2653c4ebc9a-etc-sysconfig\") pod \"tuned-tpvk4\" (UID: \"3c766359-4ff0-4cfc-963f-d2653c4ebc9a\") " pod="openshift-cluster-node-tuning-operator/tuned-tpvk4"
May 25 11:17:43.702210 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:17:43.701279    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/e9016da7-9735-47a6-b0d7-7416ea5e1a7f-os-release\") pod \"multus-8khmw\" (UID: \"e9016da7-9735-47a6-b0d7-7416ea5e1a7f\") " pod="openshift-multus/multus-8khmw"
May 25 11:17:43.702210 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:17:43.701290    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/ddc0dd0a-fe9e-43cc-8a9b-2459ebd2c6e7-sys-fs\") pod \"aws-ebs-csi-driver-node-vw42x\" (UID: \"ddc0dd0a-fe9e-43cc-8a9b-2459ebd2c6e7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vw42x"
May 25 11:17:43.702210 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:17:43.701304    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/ceeaa8f0-8aae-4758-8813-959a2343178a-run-ovn\") pod \"ovnkube-node-pvgm2\" (UID: \"ceeaa8f0-8aae-4758-8813-959a2343178a\") " pod="openshift-ovn-kubernetes/ovnkube-node-pvgm2"
May 25 11:17:43.702210 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:17:43.701318    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3c766359-4ff0-4cfc-963f-d2653c4ebc9a-etc-kubernetes\") pod \"tuned-tpvk4\" (UID: \"3c766359-4ff0-4cfc-963f-d2653c4ebc9a\") " pod="openshift-cluster-node-tuning-operator/tuned-tpvk4"
May 25 11:17:43.702210 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:17:43.701333    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/ceeaa8f0-8aae-4758-8813-959a2343178a-env-overrides\") pod \"ovnkube-node-pvgm2\" (UID: \"ceeaa8f0-8aae-4758-8813-959a2343178a\") " pod="openshift-ovn-kubernetes/ovnkube-node-pvgm2"
May 25 11:17:43.702210 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:17:43.701348    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-9np84\" (UniqueName: \"kubernetes.io/projected/3c766359-4ff0-4cfc-963f-d2653c4ebc9a-kube-api-access-9np84\") pod \"tuned-tpvk4\" (UID: \"3c766359-4ff0-4cfc-963f-d2653c4ebc9a\") " pod="openshift-cluster-node-tuning-operator/tuned-tpvk4"
May 25 11:17:43.702210 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:17:43.701360    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/e9016da7-9735-47a6-b0d7-7416ea5e1a7f-cnibin\") pod \"multus-8khmw\" (UID: \"e9016da7-9735-47a6-b0d7-7416ea5e1a7f\") " pod="openshift-multus/multus-8khmw"
May 25 11:17:43.702210 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:17:43.701374    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/05d11822-eeca-4852-b8ce-6b2235d5dbf3-cnibin\") pod \"multus-additional-cni-plugins-64cbl\" (UID: \"05d11822-eeca-4852-b8ce-6b2235d5dbf3\") " pod="openshift-multus/multus-additional-cni-plugins-64cbl"
May 25 11:17:43.702210 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:17:43.701383    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3c766359-4ff0-4cfc-963f-d2653c4ebc9a-etc-kubernetes\") pod \"tuned-tpvk4\" (UID: \"3c766359-4ff0-4cfc-963f-d2653c4ebc9a\") " pod="openshift-cluster-node-tuning-operator/tuned-tpvk4"
May 25 11:17:43.703031 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:17:43.701400    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/e9016da7-9735-47a6-b0d7-7416ea5e1a7f-hostroot\") pod \"multus-8khmw\" (UID: \"e9016da7-9735-47a6-b0d7-7416ea5e1a7f\") " pod="openshift-multus/multus-8khmw"
May 25 11:17:43.703031 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:17:43.701426    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/05d11822-eeca-4852-b8ce-6b2235d5dbf3-cnibin\") pod \"multus-additional-cni-plugins-64cbl\" (UID: \"05d11822-eeca-4852-b8ce-6b2235d5dbf3\") " pod="openshift-multus/multus-additional-cni-plugins-64cbl"
May 25 11:17:43.703031 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:17:43.701441    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/e9016da7-9735-47a6-b0d7-7416ea5e1a7f-hostroot\") pod \"multus-8khmw\" (UID: \"e9016da7-9735-47a6-b0d7-7416ea5e1a7f\") " pod="openshift-multus/multus-8khmw"
May 25 11:17:43.703031 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:17:43.701425    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/defe3e45-8839-4bbc-a8e1-5641dd6b3b33-agent-certs\") pod \"konnectivity-agent-nn7vp\" (UID: \"defe3e45-8839-4bbc-a8e1-5641dd6b3b33\") " pod="kube-system/konnectivity-agent-nn7vp"
May 25 11:17:43.703031 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:17:43.701481    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/ddc0dd0a-fe9e-43cc-8a9b-2459ebd2c6e7-etc-selinux\") pod \"aws-ebs-csi-driver-node-vw42x\" (UID: \"ddc0dd0a-fe9e-43cc-8a9b-2459ebd2c6e7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vw42x"
May 25 11:17:43.703031 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:17:43.701513    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/03cfb2ba-daef-4ac9-b9b5-7c52f9199154-host-slash\") pod \"iptables-alerter-glmqw\" (UID: \"03cfb2ba-daef-4ac9-b9b5-7c52f9199154\") " pod="openshift-network-operator/iptables-alerter-glmqw"
May 25 11:17:43.703031 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:17:43.701530    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/3cf3c515-4ccb-4fcd-b5d3-205cb581a363-serviceca\") pod \"node-ca-tq2s9\" (UID: \"3cf3c515-4ccb-4fcd-b5d3-205cb581a363\") " pod="openshift-image-registry/node-ca-tq2s9"
May 25 11:17:43.703031 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:17:43.701544    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/05d11822-eeca-4852-b8ce-6b2235d5dbf3-os-release\") pod \"multus-additional-cni-plugins-64cbl\" (UID: \"05d11822-eeca-4852-b8ce-6b2235d5dbf3\") " pod="openshift-multus/multus-additional-cni-plugins-64cbl"
May 25 11:17:43.703031 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:17:43.701559    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e9016da7-9735-47a6-b0d7-7416ea5e1a7f-host-var-lib-kubelet\") pod \"multus-8khmw\" (UID: \"e9016da7-9735-47a6-b0d7-7416ea5e1a7f\") " pod="openshift-multus/multus-8khmw"
May 25 11:17:43.703031 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:17:43.701575    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/defe3e45-8839-4bbc-a8e1-5641dd6b3b33-konnectivity-ca\") pod \"konnectivity-agent-nn7vp\" (UID: \"defe3e45-8839-4bbc-a8e1-5641dd6b3b33\") " pod="kube-system/konnectivity-agent-nn7vp"
May 25 11:17:43.703031 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:17:43.701598    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/03cfb2ba-daef-4ac9-b9b5-7c52f9199154-iptables-alerter-script\") pod \"iptables-alerter-glmqw\" (UID: \"03cfb2ba-daef-4ac9-b9b5-7c52f9199154\") " pod="openshift-network-operator/iptables-alerter-glmqw"
May 25 11:17:43.703031 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:17:43.701624    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/ceeaa8f0-8aae-4758-8813-959a2343178a-host-slash\") pod \"ovnkube-node-pvgm2\" (UID: \"ceeaa8f0-8aae-4758-8813-959a2343178a\") " pod="openshift-ovn-kubernetes/ovnkube-node-pvgm2"
May 25 11:17:43.703031 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:17:43.701657    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-flwbm\" (UniqueName: \"kubernetes.io/projected/ceeaa8f0-8aae-4758-8813-959a2343178a-kube-api-access-flwbm\") pod \"ovnkube-node-pvgm2\" (UID: \"ceeaa8f0-8aae-4758-8813-959a2343178a\") " pod="openshift-ovn-kubernetes/ovnkube-node-pvgm2"
May 25 11:17:43.703031 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:17:43.701683    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/3c766359-4ff0-4cfc-963f-d2653c4ebc9a-etc-systemd\") pod \"tuned-tpvk4\" (UID: \"3c766359-4ff0-4cfc-963f-d2653c4ebc9a\") " pod="openshift-cluster-node-tuning-operator/tuned-tpvk4"
May 25 11:17:43.703031 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:17:43.701724    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e9016da7-9735-47a6-b0d7-7416ea5e1a7f-multus-cni-dir\") pod \"multus-8khmw\" (UID: \"e9016da7-9735-47a6-b0d7-7416ea5e1a7f\") " pod="openshift-multus/multus-8khmw"
May 25 11:17:43.703031 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:17:43.701751    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/e9016da7-9735-47a6-b0d7-7416ea5e1a7f-cni-binary-copy\") pod \"multus-8khmw\" (UID: \"e9016da7-9735-47a6-b0d7-7416ea5e1a7f\") " pod="openshift-multus/multus-8khmw"
May 25 11:17:43.703031 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:17:43.701778    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/ddc0dd0a-fe9e-43cc-8a9b-2459ebd2c6e7-registration-dir\") pod \"aws-ebs-csi-driver-node-vw42x\" (UID: \"ddc0dd0a-fe9e-43cc-8a9b-2459ebd2c6e7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vw42x"
May 25 11:17:43.703031 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:17:43.701828    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/f0bab5fa-9ff8-4d17-9108-5a985f7bc43b-hosts-file\") pod \"node-resolver-r8nxs\" (UID: \"f0bab5fa-9ff8-4d17-9108-5a985f7bc43b\") " pod="openshift-dns/node-resolver-r8nxs"
May 25 11:17:43.703762 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:17:43.701859    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f0bab5fa-9ff8-4d17-9108-5a985f7bc43b-tmp-dir\") pod \"node-resolver-r8nxs\" (UID: \"f0bab5fa-9ff8-4d17-9108-5a985f7bc43b\") " pod="openshift-dns/node-resolver-r8nxs"
May 25 11:17:43.703762 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:17:43.701886    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ceeaa8f0-8aae-4758-8813-959a2343178a-host-run-ovn-kubernetes\") pod \"ovnkube-node-pvgm2\" (UID: \"ceeaa8f0-8aae-4758-8813-959a2343178a\") " pod="openshift-ovn-kubernetes/ovnkube-node-pvgm2"
May 25 11:17:43.703762 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:17:43.701913    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/ceeaa8f0-8aae-4758-8813-959a2343178a-host-cni-netd\") pod \"ovnkube-node-pvgm2\" (UID: \"ceeaa8f0-8aae-4758-8813-959a2343178a\") " pod="openshift-ovn-kubernetes/ovnkube-node-pvgm2"
May 25 11:17:43.703762 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:17:43.701929    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/05d11822-eeca-4852-b8ce-6b2235d5dbf3-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-64cbl\" (UID: \"05d11822-eeca-4852-b8ce-6b2235d5dbf3\") " pod="openshift-multus/multus-additional-cni-plugins-64cbl"
May 25 11:17:43.703762 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:17:43.701938    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/05d11822-eeca-4852-b8ce-6b2235d5dbf3-tuning-conf-dir\") pod \"multus-additional-cni-plugins-64cbl\" (UID: \"05d11822-eeca-4852-b8ce-6b2235d5dbf3\") " pod="openshift-multus/multus-additional-cni-plugins-64cbl"
May 25 11:17:43.703762 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:17:43.701972    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/ddc0dd0a-fe9e-43cc-8a9b-2459ebd2c6e7-device-dir\") pod \"aws-ebs-csi-driver-node-vw42x\" (UID: \"ddc0dd0a-fe9e-43cc-8a9b-2459ebd2c6e7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vw42x"
May 25 11:17:43.703762 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:17:43.701998    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/ceeaa8f0-8aae-4758-8813-959a2343178a-host-run-netns\") pod \"ovnkube-node-pvgm2\" (UID: \"ceeaa8f0-8aae-4758-8813-959a2343178a\") " pod="openshift-ovn-kubernetes/ovnkube-node-pvgm2"
May 25 11:17:43.703762 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:17:43.702023    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/e9016da7-9735-47a6-b0d7-7416ea5e1a7f-multus-socket-dir-parent\") pod \"multus-8khmw\" (UID: \"e9016da7-9735-47a6-b0d7-7416ea5e1a7f\") " pod="openshift-multus/multus-8khmw"
May 25 11:17:43.703762 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:17:43.702047    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/3c766359-4ff0-4cfc-963f-d2653c4ebc9a-etc-sysctl-d\") pod \"tuned-tpvk4\" (UID: \"3c766359-4ff0-4cfc-963f-d2653c4ebc9a\") " pod="openshift-cluster-node-tuning-operator/tuned-tpvk4"
May 25 11:17:43.703762 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:17:43.702057    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/05d11822-eeca-4852-b8ce-6b2235d5dbf3-tuning-conf-dir\") pod \"multus-additional-cni-plugins-64cbl\" (UID: \"05d11822-eeca-4852-b8ce-6b2235d5dbf3\") " pod="openshift-multus/multus-additional-cni-plugins-64cbl"
May 25 11:17:43.703762 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:17:43.702066    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/3cf3c515-4ccb-4fcd-b5d3-205cb581a363-serviceca\") pod \"node-ca-tq2s9\" (UID: \"3cf3c515-4ccb-4fcd-b5d3-205cb581a363\") " pod="openshift-image-registry/node-ca-tq2s9"
May 25 11:17:43.703762 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:17:43.702109    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/ceeaa8f0-8aae-4758-8813-959a2343178a-host-run-netns\") pod \"ovnkube-node-pvgm2\" (UID: \"ceeaa8f0-8aae-4758-8813-959a2343178a\") " pod="openshift-ovn-kubernetes/ovnkube-node-pvgm2"
May 25 11:17:43.703762 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:17:43.702114    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/05d11822-eeca-4852-b8ce-6b2235d5dbf3-os-release\") pod \"multus-additional-cni-plugins-64cbl\" (UID: \"05d11822-eeca-4852-b8ce-6b2235d5dbf3\") " pod="openshift-multus/multus-additional-cni-plugins-64cbl"
May 25 11:17:43.703762 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:17:43.702131    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/3c766359-4ff0-4cfc-963f-d2653c4ebc9a-run\") pod \"tuned-tpvk4\" (UID: \"3c766359-4ff0-4cfc-963f-d2653c4ebc9a\") " pod="openshift-cluster-node-tuning-operator/tuned-tpvk4"
May 25 11:17:43.703762 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:17:43.702160    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/e9016da7-9735-47a6-b0d7-7416ea5e1a7f-multus-socket-dir-parent\") pod \"multus-8khmw\" (UID: \"e9016da7-9735-47a6-b0d7-7416ea5e1a7f\") " pod="openshift-multus/multus-8khmw"
May 25 11:17:43.703762 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:17:43.702175    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/ddc0dd0a-fe9e-43cc-8a9b-2459ebd2c6e7-device-dir\") pod \"aws-ebs-csi-driver-node-vw42x\" (UID: \"ddc0dd0a-fe9e-43cc-8a9b-2459ebd2c6e7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vw42x"
May 25 11:17:43.703762 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:17:43.702195    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e9016da7-9735-47a6-b0d7-7416ea5e1a7f-host-var-lib-kubelet\") pod \"multus-8khmw\" (UID: \"e9016da7-9735-47a6-b0d7-7416ea5e1a7f\") " pod="openshift-multus/multus-8khmw"
May 25 11:17:43.704484 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:17:43.702226    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/ddc0dd0a-fe9e-43cc-8a9b-2459ebd2c6e7-etc-selinux\") pod \"aws-ebs-csi-driver-node-vw42x\" (UID: \"ddc0dd0a-fe9e-43cc-8a9b-2459ebd2c6e7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vw42x"
May 25 11:17:43.704484 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:17:43.702228    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/3c766359-4ff0-4cfc-963f-d2653c4ebc9a-etc-sysctl-d\") pod \"tuned-tpvk4\" (UID: \"3c766359-4ff0-4cfc-963f-d2653c4ebc9a\") " pod="openshift-cluster-node-tuning-operator/tuned-tpvk4"
May 25 11:17:43.704484 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:17:43.702071    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/3c766359-4ff0-4cfc-963f-d2653c4ebc9a-run\") pod \"tuned-tpvk4\" (UID: \"3c766359-4ff0-4cfc-963f-d2653c4ebc9a\") " pod="openshift-cluster-node-tuning-operator/tuned-tpvk4"
May 25 11:17:43.704484 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:17:43.702261    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/03cfb2ba-daef-4ac9-b9b5-7c52f9199154-host-slash\") pod \"iptables-alerter-glmqw\" (UID: \"03cfb2ba-daef-4ac9-b9b5-7c52f9199154\") " pod="openshift-network-operator/iptables-alerter-glmqw"
May 25 11:17:43.704484 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:17:43.702278    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/e9016da7-9735-47a6-b0d7-7416ea5e1a7f-multus-daemon-config\") pod \"multus-8khmw\" (UID: \"e9016da7-9735-47a6-b0d7-7416ea5e1a7f\") " pod="openshift-multus/multus-8khmw"
May 25 11:17:43.704484 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:17:43.702306    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/ddc0dd0a-fe9e-43cc-8a9b-2459ebd2c6e7-kubelet-dir\") pod \"aws-ebs-csi-driver-node-vw42x\" (UID: \"ddc0dd0a-fe9e-43cc-8a9b-2459ebd2c6e7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vw42x"
May 25 11:17:43.704484 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:17:43.702335    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-k9sqm\" (UniqueName: \"kubernetes.io/projected/ddc0dd0a-fe9e-43cc-8a9b-2459ebd2c6e7-kube-api-access-k9sqm\") pod \"aws-ebs-csi-driver-node-vw42x\" (UID: \"ddc0dd0a-fe9e-43cc-8a9b-2459ebd2c6e7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vw42x"
May 25 11:17:43.704484 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:17:43.702363    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-rsk2b\" (UniqueName: \"kubernetes.io/projected/03cfb2ba-daef-4ac9-b9b5-7c52f9199154-kube-api-access-rsk2b\") pod \"iptables-alerter-glmqw\" (UID: \"03cfb2ba-daef-4ac9-b9b5-7c52f9199154\") " pod="openshift-network-operator/iptables-alerter-glmqw"
May 25 11:17:43.704484 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:17:43.702388    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ceeaa8f0-8aae-4758-8813-959a2343178a-run-openvswitch\") pod \"ovnkube-node-pvgm2\" (UID: \"ceeaa8f0-8aae-4758-8813-959a2343178a\") " pod="openshift-ovn-kubernetes/ovnkube-node-pvgm2"
May 25 11:17:43.704484 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:17:43.702415    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/3c766359-4ff0-4cfc-963f-d2653c4ebc9a-etc-modprobe-d\") pod \"tuned-tpvk4\" (UID: \"3c766359-4ff0-4cfc-963f-d2653c4ebc9a\") " pod="openshift-cluster-node-tuning-operator/tuned-tpvk4"
May 25 11:17:43.704484 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:17:43.702440    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/3c766359-4ff0-4cfc-963f-d2653c4ebc9a-sys\") pod \"tuned-tpvk4\" (UID: \"3c766359-4ff0-4cfc-963f-d2653c4ebc9a\") " pod="openshift-cluster-node-tuning-operator/tuned-tpvk4"
May 25 11:17:43.704484 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:17:43.702466    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ceeaa8f0-8aae-4758-8813-959a2343178a-etc-openvswitch\") pod \"ovnkube-node-pvgm2\" (UID: \"ceeaa8f0-8aae-4758-8813-959a2343178a\") " pod="openshift-ovn-kubernetes/ovnkube-node-pvgm2"
May 25 11:17:43.704484 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:17:43.702490    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/05d11822-eeca-4852-b8ce-6b2235d5dbf3-cni-binary-copy\") pod \"multus-additional-cni-plugins-64cbl\" (UID: \"05d11822-eeca-4852-b8ce-6b2235d5dbf3\") " pod="openshift-multus/multus-additional-cni-plugins-64cbl"
May 25 11:17:43.704484 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:17:43.702515    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-47jzh\" (UniqueName: \"kubernetes.io/projected/05d11822-eeca-4852-b8ce-6b2235d5dbf3-kube-api-access-47jzh\") pod \"multus-additional-cni-plugins-64cbl\" (UID: \"05d11822-eeca-4852-b8ce-6b2235d5dbf3\") " pod="openshift-multus/multus-additional-cni-plugins-64cbl"
May 25 11:17:43.704484 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:17:43.702542    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/ceeaa8f0-8aae-4758-8813-959a2343178a-run-systemd\") pod \"ovnkube-node-pvgm2\" (UID: \"ceeaa8f0-8aae-4758-8813-959a2343178a\") " pod="openshift-ovn-kubernetes/ovnkube-node-pvgm2"
May 25 11:17:43.704484 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:17:43.702565    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/ceeaa8f0-8aae-4758-8813-959a2343178a-log-socket\") pod \"ovnkube-node-pvgm2\" (UID: \"ceeaa8f0-8aae-4758-8813-959a2343178a\") " pod="openshift-ovn-kubernetes/ovnkube-node-pvgm2"
May 25 11:17:43.704484 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:17:43.702588    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/3c766359-4ff0-4cfc-963f-d2653c4ebc9a-etc-sysctl-conf\") pod \"tuned-tpvk4\" (UID: \"3c766359-4ff0-4cfc-963f-d2653c4ebc9a\") " pod="openshift-cluster-node-tuning-operator/tuned-tpvk4"
May 25 11:17:43.705158 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:17:43.702612    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/3cf3c515-4ccb-4fcd-b5d3-205cb581a363-host\") pod \"node-ca-tq2s9\" (UID: \"3cf3c515-4ccb-4fcd-b5d3-205cb581a363\") " pod="openshift-image-registry/node-ca-tq2s9"
May 25 11:17:43.705158 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:17:43.702637    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9098669d-fa99-44c7-94ad-4e3560412654-metrics-certs\") pod \"network-metrics-daemon-pd47q\" (UID: \"9098669d-fa99-44c7-94ad-4e3560412654\") " pod="openshift-multus/network-metrics-daemon-pd47q"
May 25 11:17:43.705158 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:17:43.702651    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f0bab5fa-9ff8-4d17-9108-5a985f7bc43b-tmp-dir\") pod \"node-resolver-r8nxs\" (UID: \"f0bab5fa-9ff8-4d17-9108-5a985f7bc43b\") " pod="openshift-dns/node-resolver-r8nxs"
May 25 11:17:43.705158 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:17:43.702735    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/e9016da7-9735-47a6-b0d7-7416ea5e1a7f-cni-binary-copy\") pod \"multus-8khmw\" (UID: \"e9016da7-9735-47a6-b0d7-7416ea5e1a7f\") " pod="openshift-multus/multus-8khmw"
May 25 11:17:43.705158 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:17:43.702746    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/ddc0dd0a-fe9e-43cc-8a9b-2459ebd2c6e7-registration-dir\") pod \"aws-ebs-csi-driver-node-vw42x\" (UID: \"ddc0dd0a-fe9e-43cc-8a9b-2459ebd2c6e7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vw42x"
May 25 11:17:43.705158 ip-10-0-143-46 kubenswrapper[2569]: E0525 11:17:43.702774    2569 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
May 25 11:17:43.705158 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:17:43.702812    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/f0bab5fa-9ff8-4d17-9108-5a985f7bc43b-hosts-file\") pod \"node-resolver-r8nxs\" (UID: \"f0bab5fa-9ff8-4d17-9108-5a985f7bc43b\") " pod="openshift-dns/node-resolver-r8nxs"
May 25 11:17:43.705158 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:17:43.702860    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/3c766359-4ff0-4cfc-963f-d2653c4ebc9a-sys\") pod \"tuned-tpvk4\" (UID: \"3c766359-4ff0-4cfc-963f-d2653c4ebc9a\") " pod="openshift-cluster-node-tuning-operator/tuned-tpvk4"
May 25 11:17:43.705158 ip-10-0-143-46 kubenswrapper[2569]: E0525 11:17:43.702870    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9098669d-fa99-44c7-94ad-4e3560412654-metrics-certs podName:9098669d-fa99-44c7-94ad-4e3560412654 nodeName:}" failed. No retries permitted until 2026-05-25 11:17:44.20284056 +0000 UTC m=+3.064464953 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/9098669d-fa99-44c7-94ad-4e3560412654-metrics-certs") pod "network-metrics-daemon-pd47q" (UID: "9098669d-fa99-44c7-94ad-4e3560412654") : object "openshift-multus"/"metrics-daemon-secret" not registered
May 25 11:17:43.705158 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:17:43.702910    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ceeaa8f0-8aae-4758-8813-959a2343178a-etc-openvswitch\") pod \"ovnkube-node-pvgm2\" (UID: \"ceeaa8f0-8aae-4758-8813-959a2343178a\") " pod="openshift-ovn-kubernetes/ovnkube-node-pvgm2"
May 25 11:17:43.705158 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:17:43.703230    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/03cfb2ba-daef-4ac9-b9b5-7c52f9199154-iptables-alerter-script\") pod \"iptables-alerter-glmqw\" (UID: \"03cfb2ba-daef-4ac9-b9b5-7c52f9199154\") " pod="openshift-network-operator/iptables-alerter-glmqw"
May 25 11:17:43.705158 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:17:43.703286    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/ceeaa8f0-8aae-4758-8813-959a2343178a-host-slash\") pod \"ovnkube-node-pvgm2\" (UID: \"ceeaa8f0-8aae-4758-8813-959a2343178a\") " pod="openshift-ovn-kubernetes/ovnkube-node-pvgm2"
May 25 11:17:43.705158 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:17:43.703311    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/05d11822-eeca-4852-b8ce-6b2235d5dbf3-cni-binary-copy\") pod \"multus-additional-cni-plugins-64cbl\" (UID: \"05d11822-eeca-4852-b8ce-6b2235d5dbf3\") " pod="openshift-multus/multus-additional-cni-plugins-64cbl"
May 25 11:17:43.705158 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:17:43.703330    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/e9016da7-9735-47a6-b0d7-7416ea5e1a7f-multus-daemon-config\") pod \"multus-8khmw\" (UID: \"e9016da7-9735-47a6-b0d7-7416ea5e1a7f\") " pod="openshift-multus/multus-8khmw"
May 25 11:17:43.705158 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:17:43.703380    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/ddc0dd0a-fe9e-43cc-8a9b-2459ebd2c6e7-kubelet-dir\") pod \"aws-ebs-csi-driver-node-vw42x\" (UID: \"ddc0dd0a-fe9e-43cc-8a9b-2459ebd2c6e7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vw42x"
May 25 11:17:43.705158 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:17:43.703390    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/3c766359-4ff0-4cfc-963f-d2653c4ebc9a-etc-tuned\") pod \"tuned-tpvk4\" (UID: \"3c766359-4ff0-4cfc-963f-d2653c4ebc9a\") " pod="openshift-cluster-node-tuning-operator/tuned-tpvk4"
May 25 11:17:43.705158 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:17:43.703453    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ceeaa8f0-8aae-4758-8813-959a2343178a-run-openvswitch\") pod \"ovnkube-node-pvgm2\" (UID: \"ceeaa8f0-8aae-4758-8813-959a2343178a\") " pod="openshift-ovn-kubernetes/ovnkube-node-pvgm2"
May 25 11:17:43.705894 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:17:43.703477    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/ceeaa8f0-8aae-4758-8813-959a2343178a-run-systemd\") pod \"ovnkube-node-pvgm2\" (UID: \"ceeaa8f0-8aae-4758-8813-959a2343178a\") " pod="openshift-ovn-kubernetes/ovnkube-node-pvgm2"
May 25 11:17:43.705894 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:17:43.703475    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/ceeaa8f0-8aae-4758-8813-959a2343178a-ovn-node-metrics-cert\") pod \"ovnkube-node-pvgm2\" (UID: \"ceeaa8f0-8aae-4758-8813-959a2343178a\") " pod="openshift-ovn-kubernetes/ovnkube-node-pvgm2"
May 25 11:17:43.705894 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:17:43.703524    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/ceeaa8f0-8aae-4758-8813-959a2343178a-log-socket\") pod \"ovnkube-node-pvgm2\" (UID: \"ceeaa8f0-8aae-4758-8813-959a2343178a\") " pod="openshift-ovn-kubernetes/ovnkube-node-pvgm2"
May 25 11:17:43.705894 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:17:43.703547    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/3cf3c515-4ccb-4fcd-b5d3-205cb581a363-host\") pod \"node-ca-tq2s9\" (UID: \"3cf3c515-4ccb-4fcd-b5d3-205cb581a363\") " pod="openshift-image-registry/node-ca-tq2s9"
May 25 11:17:43.705894 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:17:43.703561    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/3c766359-4ff0-4cfc-963f-d2653c4ebc9a-etc-modprobe-d\") pod \"tuned-tpvk4\" (UID: \"3c766359-4ff0-4cfc-963f-d2653c4ebc9a\") " pod="openshift-cluster-node-tuning-operator/tuned-tpvk4"
May 25 11:17:43.705894 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:17:43.703572    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ceeaa8f0-8aae-4758-8813-959a2343178a-host-run-ovn-kubernetes\") pod \"ovnkube-node-pvgm2\" (UID: \"ceeaa8f0-8aae-4758-8813-959a2343178a\") " pod="openshift-ovn-kubernetes/ovnkube-node-pvgm2"
May 25 11:17:43.705894 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:17:43.703619    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/ceeaa8f0-8aae-4758-8813-959a2343178a-host-cni-netd\") pod \"ovnkube-node-pvgm2\" (UID: \"ceeaa8f0-8aae-4758-8813-959a2343178a\") " pod="openshift-ovn-kubernetes/ovnkube-node-pvgm2"
May 25 11:17:43.705894 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:17:43.703628    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e9016da7-9735-47a6-b0d7-7416ea5e1a7f-multus-cni-dir\") pod \"multus-8khmw\" (UID: \"e9016da7-9735-47a6-b0d7-7416ea5e1a7f\") " pod="openshift-multus/multus-8khmw"
May 25 11:17:43.705894 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:17:43.703660    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/3c766359-4ff0-4cfc-963f-d2653c4ebc9a-etc-sysctl-conf\") pod \"tuned-tpvk4\" (UID: \"3c766359-4ff0-4cfc-963f-d2653c4ebc9a\") " pod="openshift-cluster-node-tuning-operator/tuned-tpvk4"
May 25 11:17:43.705894 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:17:43.703692    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/3c766359-4ff0-4cfc-963f-d2653c4ebc9a-etc-systemd\") pod \"tuned-tpvk4\" (UID: \"3c766359-4ff0-4cfc-963f-d2653c4ebc9a\") " pod="openshift-cluster-node-tuning-operator/tuned-tpvk4"
May 25 11:17:43.705894 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:17:43.704022    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/defe3e45-8839-4bbc-a8e1-5641dd6b3b33-konnectivity-ca\") pod \"konnectivity-agent-nn7vp\" (UID: \"defe3e45-8839-4bbc-a8e1-5641dd6b3b33\") " pod="kube-system/konnectivity-agent-nn7vp"
May 25 11:17:43.705894 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:17:43.704094    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3c766359-4ff0-4cfc-963f-d2653c4ebc9a-tmp\") pod \"tuned-tpvk4\" (UID: \"3c766359-4ff0-4cfc-963f-d2653c4ebc9a\") " pod="openshift-cluster-node-tuning-operator/tuned-tpvk4"
May 25 11:17:43.705894 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:17:43.704542    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/defe3e45-8839-4bbc-a8e1-5641dd6b3b33-agent-certs\") pod \"konnectivity-agent-nn7vp\" (UID: \"defe3e45-8839-4bbc-a8e1-5641dd6b3b33\") " pod="kube-system/konnectivity-agent-nn7vp"
May 25 11:17:43.710301 ip-10-0-143-46 kubenswrapper[2569]: E0525 11:17:43.710282    2569 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
May 25 11:17:43.710301 ip-10-0-143-46 kubenswrapper[2569]: E0525 11:17:43.710303    2569 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
May 25 11:17:43.710480 ip-10-0-143-46 kubenswrapper[2569]: E0525 11:17:43.710315    2569 projected.go:194] Error preparing data for projected volume kube-api-access-cjf5z for pod openshift-network-diagnostics/network-check-target-7x8z9: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 25 11:17:43.710480 ip-10-0-143-46 kubenswrapper[2569]: E0525 11:17:43.710369    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/242d8af2-b5ad-4319-a821-39f484f7ea5c-kube-api-access-cjf5z podName:242d8af2-b5ad-4319-a821-39f484f7ea5c nodeName:}" failed. No retries permitted until 2026-05-25 11:17:44.21035326 +0000 UTC m=+3.071977639 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-cjf5z" (UniqueName: "kubernetes.io/projected/242d8af2-b5ad-4319-a821-39f484f7ea5c-kube-api-access-cjf5z") pod "network-check-target-7x8z9" (UID: "242d8af2-b5ad-4319-a821-39f484f7ea5c") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 25 11:17:43.716876 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:17:43.713190    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dgrjf\" (UniqueName: \"kubernetes.io/projected/3cf3c515-4ccb-4fcd-b5d3-205cb581a363-kube-api-access-dgrjf\") pod \"node-ca-tq2s9\" (UID: \"3cf3c515-4ccb-4fcd-b5d3-205cb581a363\") " pod="openshift-image-registry/node-ca-tq2s9"
May 25 11:17:43.716876 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:17:43.713750    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-65mrf\" (UniqueName: \"kubernetes.io/projected/9098669d-fa99-44c7-94ad-4e3560412654-kube-api-access-65mrf\") pod \"network-metrics-daemon-pd47q\" (UID: \"9098669d-fa99-44c7-94ad-4e3560412654\") " pod="openshift-multus/network-metrics-daemon-pd47q"
May 25 11:17:43.716876 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:17:43.714650    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9np84\" (UniqueName: \"kubernetes.io/projected/3c766359-4ff0-4cfc-963f-d2653c4ebc9a-kube-api-access-9np84\") pod \"tuned-tpvk4\" (UID: \"3c766359-4ff0-4cfc-963f-d2653c4ebc9a\") " pod="openshift-cluster-node-tuning-operator/tuned-tpvk4"
May 25 11:17:43.716876 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:17:43.715378    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-flwbm\" (UniqueName: \"kubernetes.io/projected/ceeaa8f0-8aae-4758-8813-959a2343178a-kube-api-access-flwbm\") pod \"ovnkube-node-pvgm2\" (UID: \"ceeaa8f0-8aae-4758-8813-959a2343178a\") " pod="openshift-ovn-kubernetes/ovnkube-node-pvgm2"
May 25 11:17:43.716876 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:17:43.715404    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-k9sqm\" (UniqueName: \"kubernetes.io/projected/ddc0dd0a-fe9e-43cc-8a9b-2459ebd2c6e7-kube-api-access-k9sqm\") pod \"aws-ebs-csi-driver-node-vw42x\" (UID: \"ddc0dd0a-fe9e-43cc-8a9b-2459ebd2c6e7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vw42x"
May 25 11:17:43.716876 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:17:43.716090    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-k49cf\" (UniqueName: \"kubernetes.io/projected/f0bab5fa-9ff8-4d17-9108-5a985f7bc43b-kube-api-access-k49cf\") pod \"node-resolver-r8nxs\" (UID: \"f0bab5fa-9ff8-4d17-9108-5a985f7bc43b\") " pod="openshift-dns/node-resolver-r8nxs"
May 25 11:17:43.716876 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:17:43.716263    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fxh6g\" (UniqueName: \"kubernetes.io/projected/e9016da7-9735-47a6-b0d7-7416ea5e1a7f-kube-api-access-fxh6g\") pod \"multus-8khmw\" (UID: \"e9016da7-9735-47a6-b0d7-7416ea5e1a7f\") " pod="openshift-multus/multus-8khmw"
May 25 11:17:43.718542 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:17:43.718519    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-47jzh\" (UniqueName: \"kubernetes.io/projected/05d11822-eeca-4852-b8ce-6b2235d5dbf3-kube-api-access-47jzh\") pod \"multus-additional-cni-plugins-64cbl\" (UID: \"05d11822-eeca-4852-b8ce-6b2235d5dbf3\") " pod="openshift-multus/multus-additional-cni-plugins-64cbl"
May 25 11:17:43.719603 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:17:43.719582    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rsk2b\" (UniqueName: \"kubernetes.io/projected/03cfb2ba-daef-4ac9-b9b5-7c52f9199154-kube-api-access-rsk2b\") pod \"iptables-alerter-glmqw\" (UID: \"03cfb2ba-daef-4ac9-b9b5-7c52f9199154\") " pod="openshift-network-operator/iptables-alerter-glmqw"
May 25 11:17:43.881463 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:17:43.881428    2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-nn7vp"
May 25 11:17:43.888273 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:17:43.888248    2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-64cbl"
May 25 11:17:43.896881 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:17:43.896859    2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vw42x"
May 25 11:17:43.902775 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:17:43.902752    2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-r8nxs"
May 25 11:17:43.909371 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:17:43.909348    2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-glmqw"
May 25 11:17:43.916990 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:17:43.916971    2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-pvgm2"
May 25 11:17:43.924568 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:17:43.924552    2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-tpvk4"
May 25 11:17:43.931034 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:17:43.931015    2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-tq2s9"
May 25 11:17:43.936586 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:17:43.936568    2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-8khmw"
May 25 11:17:44.099820 ip-10-0-143-46 kubenswrapper[2569]: W0525 11:17:44.099773    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod03cfb2ba_daef_4ac9_b9b5_7c52f9199154.slice/crio-b3a1614cd37982951bb75ffaeb3afa106e4204d0eb969d3ab64e967235f12d9a WatchSource:0}: Error finding container b3a1614cd37982951bb75ffaeb3afa106e4204d0eb969d3ab64e967235f12d9a: Status 404 returned error can't find the container with id b3a1614cd37982951bb75ffaeb3afa106e4204d0eb969d3ab64e967235f12d9a
May 25 11:17:44.100897 ip-10-0-143-46 kubenswrapper[2569]: W0525 11:17:44.100868    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf0bab5fa_9ff8_4d17_9108_5a985f7bc43b.slice/crio-cdf86d4807c44781e5348f467431fd46ea9177be71b60f46aa25b4cef98240ad WatchSource:0}: Error finding container cdf86d4807c44781e5348f467431fd46ea9177be71b60f46aa25b4cef98240ad: Status 404 returned error can't find the container with id cdf86d4807c44781e5348f467431fd46ea9177be71b60f46aa25b4cef98240ad
May 25 11:17:44.101687 ip-10-0-143-46 kubenswrapper[2569]: W0525 11:17:44.101663    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3cf3c515_4ccb_4fcd_b5d3_205cb581a363.slice/crio-4f9e3f72242bd8a8a2b360f649f60e4c7c2a33fb62cfbe9644feb6da61a1554d WatchSource:0}: Error finding container 4f9e3f72242bd8a8a2b360f649f60e4c7c2a33fb62cfbe9644feb6da61a1554d: Status 404 returned error can't find the container with id 4f9e3f72242bd8a8a2b360f649f60e4c7c2a33fb62cfbe9644feb6da61a1554d
May 25 11:17:44.104468 ip-10-0-143-46 kubenswrapper[2569]: W0525 11:17:44.104287    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode9016da7_9735_47a6_b0d7_7416ea5e1a7f.slice/crio-5c6a91b12a8ef09f9e1f2263e92c62026c2bc66e8ed31567eeb0ded39bdf0d24 WatchSource:0}: Error finding container 5c6a91b12a8ef09f9e1f2263e92c62026c2bc66e8ed31567eeb0ded39bdf0d24: Status 404 returned error can't find the container with id 5c6a91b12a8ef09f9e1f2263e92c62026c2bc66e8ed31567eeb0ded39bdf0d24
May 25 11:17:44.109688 ip-10-0-143-46 kubenswrapper[2569]: W0525 11:17:44.109462    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podddc0dd0a_fe9e_43cc_8a9b_2459ebd2c6e7.slice/crio-3d035da001599d0c8361a45232d5fe8d6d3af823219e74c7e84e94bf2959b2f6 WatchSource:0}: Error finding container 3d035da001599d0c8361a45232d5fe8d6d3af823219e74c7e84e94bf2959b2f6: Status 404 returned error can't find the container with id 3d035da001599d0c8361a45232d5fe8d6d3af823219e74c7e84e94bf2959b2f6
May 25 11:17:44.110860 ip-10-0-143-46 kubenswrapper[2569]: W0525 11:17:44.110778    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3c766359_4ff0_4cfc_963f_d2653c4ebc9a.slice/crio-e9f8270a91120718b39bd7a65fdedb78e25e3ce46cdc1bae0910a749d26926f3 WatchSource:0}: Error finding container e9f8270a91120718b39bd7a65fdedb78e25e3ce46cdc1bae0910a749d26926f3: Status 404 returned error can't find the container with id e9f8270a91120718b39bd7a65fdedb78e25e3ce46cdc1bae0910a749d26926f3
May 25 11:17:44.112197 ip-10-0-143-46 kubenswrapper[2569]: W0525 11:17:44.112153    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod05d11822_eeca_4852_b8ce_6b2235d5dbf3.slice/crio-e5f2c6a08d3798e6a892a68caacee027d980ad6964bf121e9e7afa65207d30f9 WatchSource:0}: Error finding container e5f2c6a08d3798e6a892a68caacee027d980ad6964bf121e9e7afa65207d30f9: Status 404 returned error can't find the container with id e5f2c6a08d3798e6a892a68caacee027d980ad6964bf121e9e7afa65207d30f9
May 25 11:17:44.206695 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:17:44.206558    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9098669d-fa99-44c7-94ad-4e3560412654-metrics-certs\") pod \"network-metrics-daemon-pd47q\" (UID: \"9098669d-fa99-44c7-94ad-4e3560412654\") " pod="openshift-multus/network-metrics-daemon-pd47q"
May 25 11:17:44.206695 ip-10-0-143-46 kubenswrapper[2569]: E0525 11:17:44.206687    2569 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
May 25 11:17:44.206886 ip-10-0-143-46 kubenswrapper[2569]: E0525 11:17:44.206746    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9098669d-fa99-44c7-94ad-4e3560412654-metrics-certs podName:9098669d-fa99-44c7-94ad-4e3560412654 nodeName:}" failed. No retries permitted until 2026-05-25 11:17:45.206727724 +0000 UTC m=+4.068352087 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/9098669d-fa99-44c7-94ad-4e3560412654-metrics-certs") pod "network-metrics-daemon-pd47q" (UID: "9098669d-fa99-44c7-94ad-4e3560412654") : object "openshift-multus"/"metrics-daemon-secret" not registered
May 25 11:17:44.307904 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:17:44.307874    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-cjf5z\" (UniqueName: \"kubernetes.io/projected/242d8af2-b5ad-4319-a821-39f484f7ea5c-kube-api-access-cjf5z\") pod \"network-check-target-7x8z9\" (UID: \"242d8af2-b5ad-4319-a821-39f484f7ea5c\") " pod="openshift-network-diagnostics/network-check-target-7x8z9"
May 25 11:17:44.308066 ip-10-0-143-46 kubenswrapper[2569]: E0525 11:17:44.307997    2569 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
May 25 11:17:44.308066 ip-10-0-143-46 kubenswrapper[2569]: E0525 11:17:44.308015    2569 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
May 25 11:17:44.308066 ip-10-0-143-46 kubenswrapper[2569]: E0525 11:17:44.308025    2569 projected.go:194] Error preparing data for projected volume kube-api-access-cjf5z for pod openshift-network-diagnostics/network-check-target-7x8z9: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 25 11:17:44.308222 ip-10-0-143-46 kubenswrapper[2569]: E0525 11:17:44.308086    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/242d8af2-b5ad-4319-a821-39f484f7ea5c-kube-api-access-cjf5z podName:242d8af2-b5ad-4319-a821-39f484f7ea5c nodeName:}" failed. No retries permitted until 2026-05-25 11:17:45.308065608 +0000 UTC m=+4.169689990 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-cjf5z" (UniqueName: "kubernetes.io/projected/242d8af2-b5ad-4319-a821-39f484f7ea5c-kube-api-access-cjf5z") pod "network-check-target-7x8z9" (UID: "242d8af2-b5ad-4319-a821-39f484f7ea5c") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 25 11:17:44.649832 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:17:44.649752    2569 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-05-24 11:12:42 +0000 UTC" deadline="2027-12-01 07:43:47.152608331 +0000 UTC"
May 25 11:17:44.649832 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:17:44.649806    2569 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13316h26m2.502806991s"
May 25 11:17:44.757988 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:17:44.757301    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-46.ec2.internal" event={"ID":"56519f8fe9fae3cdb88779f3c49e86c7","Type":"ContainerStarted","Data":"8573f26008893c5027f29c7f3cb5ca44c0dfe251e2251d3eb172ea584424d35e"}
May 25 11:17:44.762550 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:17:44.762521    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-nn7vp" event={"ID":"defe3e45-8839-4bbc-a8e1-5641dd6b3b33","Type":"ContainerStarted","Data":"74615e6f26e80a42294571e0c291fb3d73c45ae0a2492d4967a22aabee89c8fa"}
May 25 11:17:44.764364 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:17:44.764339    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-64cbl" event={"ID":"05d11822-eeca-4852-b8ce-6b2235d5dbf3","Type":"ContainerStarted","Data":"e5f2c6a08d3798e6a892a68caacee027d980ad6964bf121e9e7afa65207d30f9"}
May 25 11:17:44.779923 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:17:44.777596    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-tpvk4" event={"ID":"3c766359-4ff0-4cfc-963f-d2653c4ebc9a","Type":"ContainerStarted","Data":"e9f8270a91120718b39bd7a65fdedb78e25e3ce46cdc1bae0910a749d26926f3"}
May 25 11:17:44.780268 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:17:44.780123    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vw42x" event={"ID":"ddc0dd0a-fe9e-43cc-8a9b-2459ebd2c6e7","Type":"ContainerStarted","Data":"3d035da001599d0c8361a45232d5fe8d6d3af823219e74c7e84e94bf2959b2f6"}
May 25 11:17:44.783340 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:17:44.783307    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-pvgm2" event={"ID":"ceeaa8f0-8aae-4758-8813-959a2343178a","Type":"ContainerStarted","Data":"6e18a19cd90d9e057e02a1c4cd51c4c18c4b996f0c884d12b6316fb483291a5d"}
May 25 11:17:44.790396 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:17:44.789942    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-8khmw" event={"ID":"e9016da7-9735-47a6-b0d7-7416ea5e1a7f","Type":"ContainerStarted","Data":"5c6a91b12a8ef09f9e1f2263e92c62026c2bc66e8ed31567eeb0ded39bdf0d24"}
May 25 11:17:44.794973 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:17:44.794925    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-r8nxs" event={"ID":"f0bab5fa-9ff8-4d17-9108-5a985f7bc43b","Type":"ContainerStarted","Data":"cdf86d4807c44781e5348f467431fd46ea9177be71b60f46aa25b4cef98240ad"}
May 25 11:17:44.799165 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:17:44.799139    2569 generic.go:358] "Generic (PLEG): container finished" podID="fddcfb3fb0e59f1e59d5cacf25dda527" containerID="e47b6744d1507dbf114a459216330cc3e529c8b85b72ebcb6a6204ac17603971" exitCode=0
May 25 11:17:44.799593 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:17:44.799538    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-46.ec2.internal" event={"ID":"fddcfb3fb0e59f1e59d5cacf25dda527","Type":"ContainerDied","Data":"e47b6744d1507dbf114a459216330cc3e529c8b85b72ebcb6a6204ac17603971"}
May 25 11:17:44.808114 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:17:44.805073    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-tq2s9" event={"ID":"3cf3c515-4ccb-4fcd-b5d3-205cb581a363","Type":"ContainerStarted","Data":"4f9e3f72242bd8a8a2b360f649f60e4c7c2a33fb62cfbe9644feb6da61a1554d"}
May 25 11:17:44.809257 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:17:44.808737    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-glmqw" event={"ID":"03cfb2ba-daef-4ac9-b9b5-7c52f9199154","Type":"ContainerStarted","Data":"b3a1614cd37982951bb75ffaeb3afa106e4204d0eb969d3ab64e967235f12d9a"}
May 25 11:17:44.817869 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:17:44.817777    2569 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-46.ec2.internal" podStartSLOduration=2.817761095 podStartE2EDuration="2.817761095s" podCreationTimestamp="2026-05-25 11:17:42 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-25 11:17:44.772881334 +0000 UTC m=+3.634505720" watchObservedRunningTime="2026-05-25 11:17:44.817761095 +0000 UTC m=+3.679385480"
May 25 11:17:45.215100 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:17:45.215009    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9098669d-fa99-44c7-94ad-4e3560412654-metrics-certs\") pod \"network-metrics-daemon-pd47q\" (UID: \"9098669d-fa99-44c7-94ad-4e3560412654\") " pod="openshift-multus/network-metrics-daemon-pd47q"
May 25 11:17:45.215257 ip-10-0-143-46 kubenswrapper[2569]: E0525 11:17:45.215168    2569 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
May 25 11:17:45.215257 ip-10-0-143-46 kubenswrapper[2569]: E0525 11:17:45.215228    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9098669d-fa99-44c7-94ad-4e3560412654-metrics-certs podName:9098669d-fa99-44c7-94ad-4e3560412654 nodeName:}" failed. No retries permitted until 2026-05-25 11:17:47.215210083 +0000 UTC m=+6.076834458 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/9098669d-fa99-44c7-94ad-4e3560412654-metrics-certs") pod "network-metrics-daemon-pd47q" (UID: "9098669d-fa99-44c7-94ad-4e3560412654") : object "openshift-multus"/"metrics-daemon-secret" not registered
May 25 11:17:45.316429 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:17:45.316384    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-cjf5z\" (UniqueName: \"kubernetes.io/projected/242d8af2-b5ad-4319-a821-39f484f7ea5c-kube-api-access-cjf5z\") pod \"network-check-target-7x8z9\" (UID: \"242d8af2-b5ad-4319-a821-39f484f7ea5c\") " pod="openshift-network-diagnostics/network-check-target-7x8z9"
May 25 11:17:45.316602 ip-10-0-143-46 kubenswrapper[2569]: E0525 11:17:45.316563    2569 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
May 25 11:17:45.316602 ip-10-0-143-46 kubenswrapper[2569]: E0525 11:17:45.316585    2569 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
May 25 11:17:45.316602 ip-10-0-143-46 kubenswrapper[2569]: E0525 11:17:45.316598    2569 projected.go:194] Error preparing data for projected volume kube-api-access-cjf5z for pod openshift-network-diagnostics/network-check-target-7x8z9: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 25 11:17:45.316756 ip-10-0-143-46 kubenswrapper[2569]: E0525 11:17:45.316657    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/242d8af2-b5ad-4319-a821-39f484f7ea5c-kube-api-access-cjf5z podName:242d8af2-b5ad-4319-a821-39f484f7ea5c nodeName:}" failed. No retries permitted until 2026-05-25 11:17:47.316639245 +0000 UTC m=+6.178263611 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-cjf5z" (UniqueName: "kubernetes.io/projected/242d8af2-b5ad-4319-a821-39f484f7ea5c-kube-api-access-cjf5z") pod "network-check-target-7x8z9" (UID: "242d8af2-b5ad-4319-a821-39f484f7ea5c") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 25 11:17:45.726488 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:17:45.725964    2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pd47q"
May 25 11:17:45.726488 ip-10-0-143-46 kubenswrapper[2569]: E0525 11:17:45.726099    2569 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pd47q" podUID="9098669d-fa99-44c7-94ad-4e3560412654"
May 25 11:17:45.727262 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:17:45.727117    2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7x8z9"
May 25 11:17:45.727262 ip-10-0-143-46 kubenswrapper[2569]: E0525 11:17:45.727211    2569 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7x8z9" podUID="242d8af2-b5ad-4319-a821-39f484f7ea5c"
May 25 11:17:45.830934 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:17:45.830833    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-46.ec2.internal" event={"ID":"fddcfb3fb0e59f1e59d5cacf25dda527","Type":"ContainerStarted","Data":"68f86ca821c1dbe90bf917adb4db6dac8e9bd11733b717769eaa0d64823c03d9"}
May 25 11:17:47.231667 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:17:47.231517    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9098669d-fa99-44c7-94ad-4e3560412654-metrics-certs\") pod \"network-metrics-daemon-pd47q\" (UID: \"9098669d-fa99-44c7-94ad-4e3560412654\") " pod="openshift-multus/network-metrics-daemon-pd47q"
May 25 11:17:47.232177 ip-10-0-143-46 kubenswrapper[2569]: E0525 11:17:47.231675    2569 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
May 25 11:17:47.232177 ip-10-0-143-46 kubenswrapper[2569]: E0525 11:17:47.231743    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9098669d-fa99-44c7-94ad-4e3560412654-metrics-certs podName:9098669d-fa99-44c7-94ad-4e3560412654 nodeName:}" failed. No retries permitted until 2026-05-25 11:17:51.231725449 +0000 UTC m=+10.093349811 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/9098669d-fa99-44c7-94ad-4e3560412654-metrics-certs") pod "network-metrics-daemon-pd47q" (UID: "9098669d-fa99-44c7-94ad-4e3560412654") : object "openshift-multus"/"metrics-daemon-secret" not registered
May 25 11:17:47.332645 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:17:47.332597    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-cjf5z\" (UniqueName: \"kubernetes.io/projected/242d8af2-b5ad-4319-a821-39f484f7ea5c-kube-api-access-cjf5z\") pod \"network-check-target-7x8z9\" (UID: \"242d8af2-b5ad-4319-a821-39f484f7ea5c\") " pod="openshift-network-diagnostics/network-check-target-7x8z9"
May 25 11:17:47.332843 ip-10-0-143-46 kubenswrapper[2569]: E0525 11:17:47.332753    2569 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
May 25 11:17:47.332843 ip-10-0-143-46 kubenswrapper[2569]: E0525 11:17:47.332769    2569 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
May 25 11:17:47.332843 ip-10-0-143-46 kubenswrapper[2569]: E0525 11:17:47.332778    2569 projected.go:194] Error preparing data for projected volume kube-api-access-cjf5z for pod openshift-network-diagnostics/network-check-target-7x8z9: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 25 11:17:47.333021 ip-10-0-143-46 kubenswrapper[2569]: E0525 11:17:47.332846    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/242d8af2-b5ad-4319-a821-39f484f7ea5c-kube-api-access-cjf5z podName:242d8af2-b5ad-4319-a821-39f484f7ea5c nodeName:}" failed. No retries permitted until 2026-05-25 11:17:51.332829212 +0000 UTC m=+10.194453579 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-cjf5z" (UniqueName: "kubernetes.io/projected/242d8af2-b5ad-4319-a821-39f484f7ea5c-kube-api-access-cjf5z") pod "network-check-target-7x8z9" (UID: "242d8af2-b5ad-4319-a821-39f484f7ea5c") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 25 11:17:47.725117 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:17:47.725078    2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pd47q"
May 25 11:17:47.725117 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:17:47.725113    2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7x8z9"
May 25 11:17:47.725355 ip-10-0-143-46 kubenswrapper[2569]: E0525 11:17:47.725232    2569 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pd47q" podUID="9098669d-fa99-44c7-94ad-4e3560412654"
May 25 11:17:47.725421 ip-10-0-143-46 kubenswrapper[2569]: E0525 11:17:47.725350    2569 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7x8z9" podUID="242d8af2-b5ad-4319-a821-39f484f7ea5c"
May 25 11:17:49.726165 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:17:49.725594    2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pd47q"
May 25 11:17:49.726165 ip-10-0-143-46 kubenswrapper[2569]: E0525 11:17:49.725772    2569 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pd47q" podUID="9098669d-fa99-44c7-94ad-4e3560412654"
May 25 11:17:49.726165 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:17:49.725822    2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7x8z9"
May 25 11:17:49.726165 ip-10-0-143-46 kubenswrapper[2569]: E0525 11:17:49.725931    2569 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7x8z9" podUID="242d8af2-b5ad-4319-a821-39f484f7ea5c"
May 25 11:17:51.265458 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:17:51.265402    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9098669d-fa99-44c7-94ad-4e3560412654-metrics-certs\") pod \"network-metrics-daemon-pd47q\" (UID: \"9098669d-fa99-44c7-94ad-4e3560412654\") " pod="openshift-multus/network-metrics-daemon-pd47q"
May 25 11:17:51.265969 ip-10-0-143-46 kubenswrapper[2569]: E0525 11:17:51.265585    2569 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
May 25 11:17:51.265969 ip-10-0-143-46 kubenswrapper[2569]: E0525 11:17:51.265671    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9098669d-fa99-44c7-94ad-4e3560412654-metrics-certs podName:9098669d-fa99-44c7-94ad-4e3560412654 nodeName:}" failed. No retries permitted until 2026-05-25 11:17:59.26564939 +0000 UTC m=+18.127273767 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/9098669d-fa99-44c7-94ad-4e3560412654-metrics-certs") pod "network-metrics-daemon-pd47q" (UID: "9098669d-fa99-44c7-94ad-4e3560412654") : object "openshift-multus"/"metrics-daemon-secret" not registered
May 25 11:17:51.366372 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:17:51.366331    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-cjf5z\" (UniqueName: \"kubernetes.io/projected/242d8af2-b5ad-4319-a821-39f484f7ea5c-kube-api-access-cjf5z\") pod \"network-check-target-7x8z9\" (UID: \"242d8af2-b5ad-4319-a821-39f484f7ea5c\") " pod="openshift-network-diagnostics/network-check-target-7x8z9"
May 25 11:17:51.366532 ip-10-0-143-46 kubenswrapper[2569]: E0525 11:17:51.366479    2569 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
May 25 11:17:51.366532 ip-10-0-143-46 kubenswrapper[2569]: E0525 11:17:51.366504    2569 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
May 25 11:17:51.366532 ip-10-0-143-46 kubenswrapper[2569]: E0525 11:17:51.366516    2569 projected.go:194] Error preparing data for projected volume kube-api-access-cjf5z for pod openshift-network-diagnostics/network-check-target-7x8z9: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 25 11:17:51.366697 ip-10-0-143-46 kubenswrapper[2569]: E0525 11:17:51.366618    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/242d8af2-b5ad-4319-a821-39f484f7ea5c-kube-api-access-cjf5z podName:242d8af2-b5ad-4319-a821-39f484f7ea5c nodeName:}" failed. No retries permitted until 2026-05-25 11:17:59.366560629 +0000 UTC m=+18.228184997 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-cjf5z" (UniqueName: "kubernetes.io/projected/242d8af2-b5ad-4319-a821-39f484f7ea5c-kube-api-access-cjf5z") pod "network-check-target-7x8z9" (UID: "242d8af2-b5ad-4319-a821-39f484f7ea5c") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 25 11:17:51.725198 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:17:51.725164    2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7x8z9"
May 25 11:17:51.725392 ip-10-0-143-46 kubenswrapper[2569]: E0525 11:17:51.725288    2569 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7x8z9" podUID="242d8af2-b5ad-4319-a821-39f484f7ea5c"
May 25 11:17:51.726866 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:17:51.725696    2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pd47q"
May 25 11:17:51.726866 ip-10-0-143-46 kubenswrapper[2569]: E0525 11:17:51.726814    2569 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pd47q" podUID="9098669d-fa99-44c7-94ad-4e3560412654"
May 25 11:17:53.725797 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:17:53.725755    2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pd47q"
May 25 11:17:53.725797 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:17:53.725767    2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7x8z9"
May 25 11:17:53.726210 ip-10-0-143-46 kubenswrapper[2569]: E0525 11:17:53.725879    2569 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pd47q" podUID="9098669d-fa99-44c7-94ad-4e3560412654"
May 25 11:17:53.726210 ip-10-0-143-46 kubenswrapper[2569]: E0525 11:17:53.726014    2569 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7x8z9" podUID="242d8af2-b5ad-4319-a821-39f484f7ea5c"
May 25 11:17:55.725841 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:17:55.725802    2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pd47q"
May 25 11:17:55.726281 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:17:55.725802    2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7x8z9"
May 25 11:17:55.726281 ip-10-0-143-46 kubenswrapper[2569]: E0525 11:17:55.725946    2569 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pd47q" podUID="9098669d-fa99-44c7-94ad-4e3560412654"
May 25 11:17:55.726281 ip-10-0-143-46 kubenswrapper[2569]: E0525 11:17:55.725997    2569 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7x8z9" podUID="242d8af2-b5ad-4319-a821-39f484f7ea5c"
May 25 11:17:57.725461 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:17:57.725430    2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pd47q"
May 25 11:17:57.725461 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:17:57.725462    2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7x8z9"
May 25 11:17:57.725888 ip-10-0-143-46 kubenswrapper[2569]: E0525 11:17:57.725561    2569 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pd47q" podUID="9098669d-fa99-44c7-94ad-4e3560412654"
May 25 11:17:57.725888 ip-10-0-143-46 kubenswrapper[2569]: E0525 11:17:57.725685    2569 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7x8z9" podUID="242d8af2-b5ad-4319-a821-39f484f7ea5c"
May 25 11:17:59.328073 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:17:59.328037    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9098669d-fa99-44c7-94ad-4e3560412654-metrics-certs\") pod \"network-metrics-daemon-pd47q\" (UID: \"9098669d-fa99-44c7-94ad-4e3560412654\") " pod="openshift-multus/network-metrics-daemon-pd47q"
May 25 11:17:59.328533 ip-10-0-143-46 kubenswrapper[2569]: E0525 11:17:59.328200    2569 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
May 25 11:17:59.328533 ip-10-0-143-46 kubenswrapper[2569]: E0525 11:17:59.328277    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9098669d-fa99-44c7-94ad-4e3560412654-metrics-certs podName:9098669d-fa99-44c7-94ad-4e3560412654 nodeName:}" failed. No retries permitted until 2026-05-25 11:18:15.328259373 +0000 UTC m=+34.189883743 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/9098669d-fa99-44c7-94ad-4e3560412654-metrics-certs") pod "network-metrics-daemon-pd47q" (UID: "9098669d-fa99-44c7-94ad-4e3560412654") : object "openshift-multus"/"metrics-daemon-secret" not registered
May 25 11:17:59.429385 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:17:59.429352    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-cjf5z\" (UniqueName: \"kubernetes.io/projected/242d8af2-b5ad-4319-a821-39f484f7ea5c-kube-api-access-cjf5z\") pod \"network-check-target-7x8z9\" (UID: \"242d8af2-b5ad-4319-a821-39f484f7ea5c\") " pod="openshift-network-diagnostics/network-check-target-7x8z9"
May 25 11:17:59.429531 ip-10-0-143-46 kubenswrapper[2569]: E0525 11:17:59.429514    2569 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
May 25 11:17:59.429586 ip-10-0-143-46 kubenswrapper[2569]: E0525 11:17:59.429536    2569 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
May 25 11:17:59.429586 ip-10-0-143-46 kubenswrapper[2569]: E0525 11:17:59.429546    2569 projected.go:194] Error preparing data for projected volume kube-api-access-cjf5z for pod openshift-network-diagnostics/network-check-target-7x8z9: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 25 11:17:59.429678 ip-10-0-143-46 kubenswrapper[2569]: E0525 11:17:59.429597    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/242d8af2-b5ad-4319-a821-39f484f7ea5c-kube-api-access-cjf5z podName:242d8af2-b5ad-4319-a821-39f484f7ea5c nodeName:}" failed. No retries permitted until 2026-05-25 11:18:15.429580485 +0000 UTC m=+34.291204852 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-cjf5z" (UniqueName: "kubernetes.io/projected/242d8af2-b5ad-4319-a821-39f484f7ea5c-kube-api-access-cjf5z") pod "network-check-target-7x8z9" (UID: "242d8af2-b5ad-4319-a821-39f484f7ea5c") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 25 11:17:59.725541 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:17:59.725453    2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pd47q"
May 25 11:17:59.725541 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:17:59.725482    2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7x8z9"
May 25 11:17:59.725774 ip-10-0-143-46 kubenswrapper[2569]: E0525 11:17:59.725581    2569 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pd47q" podUID="9098669d-fa99-44c7-94ad-4e3560412654"
May 25 11:17:59.725774 ip-10-0-143-46 kubenswrapper[2569]: E0525 11:17:59.725733    2569 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7x8z9" podUID="242d8af2-b5ad-4319-a821-39f484f7ea5c"
May 25 11:18:01.726720 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:18:01.726684    2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7x8z9"
May 25 11:18:01.727250 ip-10-0-143-46 kubenswrapper[2569]: E0525 11:18:01.726812    2569 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7x8z9" podUID="242d8af2-b5ad-4319-a821-39f484f7ea5c"
May 25 11:18:01.727250 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:18:01.727200    2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pd47q"
May 25 11:18:01.727351 ip-10-0-143-46 kubenswrapper[2569]: E0525 11:18:01.727309    2569 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pd47q" podUID="9098669d-fa99-44c7-94ad-4e3560412654"
May 25 11:18:02.860146 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:18:02.859967    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-tpvk4" event={"ID":"3c766359-4ff0-4cfc-963f-d2653c4ebc9a","Type":"ContainerStarted","Data":"6826584dba14da6c017b01696b3d45c235ce3c286b1d76a1f2de336cc2f41fcc"}
May 25 11:18:02.863649 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:18:02.863430    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vw42x" event={"ID":"ddc0dd0a-fe9e-43cc-8a9b-2459ebd2c6e7","Type":"ContainerStarted","Data":"44e1b4dbc97b2e8205fabf543086d40aabc0f006a20d21c192a2dcd1197762cb"}
May 25 11:18:02.865267 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:18:02.865118    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-pvgm2" event={"ID":"ceeaa8f0-8aae-4758-8813-959a2343178a","Type":"ContainerStarted","Data":"fd3c3fd75a58543c45e9b4dca61ce3d977a0eec3abe626f90b8e835e9727fd12"}
May 25 11:18:02.867259 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:18:02.867174    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-8khmw" event={"ID":"e9016da7-9735-47a6-b0d7-7416ea5e1a7f","Type":"ContainerStarted","Data":"78f816f58d6ad3aa2ca24e9be7e74ae2c79d3ff44e832d0669eabd98f8e37b91"}
May 25 11:18:02.870688 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:18:02.870654    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-r8nxs" event={"ID":"f0bab5fa-9ff8-4d17-9108-5a985f7bc43b","Type":"ContainerStarted","Data":"b87b150cf55fb216f19ad6a5c1787ef92fdd40b46d97672dc915ca459816fdf7"}
May 25 11:18:02.872516 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:18:02.872173    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-tq2s9" event={"ID":"3cf3c515-4ccb-4fcd-b5d3-205cb581a363","Type":"ContainerStarted","Data":"bcd9a2a82bdd4956d922b8b53b601518e5e2223665f936ba0ff4921efb8c21f8"}
May 25 11:18:02.874711 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:18:02.874111    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-nn7vp" event={"ID":"defe3e45-8839-4bbc-a8e1-5641dd6b3b33","Type":"ContainerStarted","Data":"a762a57a966d1ab31ebe38b17f81e1c9a929bd1dbbe48a98e3b7a901bef1c382"}
May 25 11:18:02.875585 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:18:02.875559    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-64cbl" event={"ID":"05d11822-eeca-4852-b8ce-6b2235d5dbf3","Type":"ContainerStarted","Data":"0253a5f6912ff1712bff083be14bfbf87becb5cab2dadb7e12745a4f479d20c0"}
May 25 11:18:02.890101 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:18:02.890061    2569 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-46.ec2.internal" podStartSLOduration=20.890033255 podStartE2EDuration="20.890033255s" podCreationTimestamp="2026-05-25 11:17:42 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-25 11:17:45.850711144 +0000 UTC m=+4.712335531" watchObservedRunningTime="2026-05-25 11:18:02.890033255 +0000 UTC m=+21.751657621"
May 25 11:18:02.928274 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:18:02.928235    2569 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-tpvk4" podStartSLOduration=3.67504259 podStartE2EDuration="21.92822039s" podCreationTimestamp="2026-05-25 11:17:41 +0000 UTC" firstStartedPulling="2026-05-25 11:17:44.114668034 +0000 UTC m=+2.976292396" lastFinishedPulling="2026-05-25 11:18:02.367845823 +0000 UTC m=+21.229470196" observedRunningTime="2026-05-25 11:18:02.890634218 +0000 UTC m=+21.752258602" watchObservedRunningTime="2026-05-25 11:18:02.92822039 +0000 UTC m=+21.789844775"
May 25 11:18:02.928388 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:18:02.928363    2569 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/multus-8khmw" podStartSLOduration=2.347990418 podStartE2EDuration="20.928357861s" podCreationTimestamp="2026-05-25 11:17:42 +0000 UTC" firstStartedPulling="2026-05-25 11:17:44.106064011 +0000 UTC m=+2.967688374" lastFinishedPulling="2026-05-25 11:18:02.686431455 +0000 UTC m=+21.548055817" observedRunningTime="2026-05-25 11:18:02.928291914 +0000 UTC m=+21.789916311" watchObservedRunningTime="2026-05-25 11:18:02.928357861 +0000 UTC m=+21.789982244"
May 25 11:18:02.953673 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:18:02.953629    2569 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/konnectivity-agent-nn7vp" podStartSLOduration=3.766873458 podStartE2EDuration="21.953606267s" podCreationTimestamp="2026-05-25 11:17:41 +0000 UTC" firstStartedPulling="2026-05-25 11:17:44.111994478 +0000 UTC m=+2.973618841" lastFinishedPulling="2026-05-25 11:18:02.298727285 +0000 UTC m=+21.160351650" observedRunningTime="2026-05-25 11:18:02.951657067 +0000 UTC m=+21.813281450" watchObservedRunningTime="2026-05-25 11:18:02.953606267 +0000 UTC m=+21.815230651"
May 25 11:18:03.004204 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:18:03.004147    2569 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-dns/node-resolver-r8nxs" podStartSLOduration=3.733522211 podStartE2EDuration="22.004129013s" podCreationTimestamp="2026-05-25 11:17:41 +0000 UTC" firstStartedPulling="2026-05-25 11:17:44.103064645 +0000 UTC m=+2.964689018" lastFinishedPulling="2026-05-25 11:18:02.373671454 +0000 UTC m=+21.235295820" observedRunningTime="2026-05-25 11:18:03.004113345 +0000 UTC m=+21.865737728" watchObservedRunningTime="2026-05-25 11:18:03.004129013 +0000 UTC m=+21.865753398"
May 25 11:18:03.024723 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:18:03.024624    2569 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-image-registry/node-ca-tq2s9" podStartSLOduration=3.759850837 podStartE2EDuration="22.024613346s" podCreationTimestamp="2026-05-25 11:17:41 +0000 UTC" firstStartedPulling="2026-05-25 11:17:44.104687099 +0000 UTC m=+2.966311470" lastFinishedPulling="2026-05-25 11:18:02.369449601 +0000 UTC m=+21.231073979" observedRunningTime="2026-05-25 11:18:03.024310706 +0000 UTC m=+21.885935081" watchObservedRunningTime="2026-05-25 11:18:03.024613346 +0000 UTC m=+21.886237729"
May 25 11:18:03.653868 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:18:03.653836    2569 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
May 25 11:18:03.725209 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:18:03.725188    2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7x8z9"
May 25 11:18:03.725323 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:18:03.725234    2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pd47q"
May 25 11:18:03.725383 ip-10-0-143-46 kubenswrapper[2569]: E0525 11:18:03.725318    2569 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pd47q" podUID="9098669d-fa99-44c7-94ad-4e3560412654"
May 25 11:18:03.725457 ip-10-0-143-46 kubenswrapper[2569]: E0525 11:18:03.725435    2569 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7x8z9" podUID="242d8af2-b5ad-4319-a821-39f484f7ea5c"
May 25 11:18:03.878859 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:18:03.878777    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-glmqw" event={"ID":"03cfb2ba-daef-4ac9-b9b5-7c52f9199154","Type":"ContainerStarted","Data":"fdb722211d908ad78c1bcdeebcece145b0dcb728bf549fed626deeb1f2741cbd"}
May 25 11:18:03.880121 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:18:03.880101    2569 generic.go:358] "Generic (PLEG): container finished" podID="05d11822-eeca-4852-b8ce-6b2235d5dbf3" containerID="0253a5f6912ff1712bff083be14bfbf87becb5cab2dadb7e12745a4f479d20c0" exitCode=0
May 25 11:18:03.880186 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:18:03.880162    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-64cbl" event={"ID":"05d11822-eeca-4852-b8ce-6b2235d5dbf3","Type":"ContainerDied","Data":"0253a5f6912ff1712bff083be14bfbf87becb5cab2dadb7e12745a4f479d20c0"}
May 25 11:18:03.881666 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:18:03.881641    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vw42x" event={"ID":"ddc0dd0a-fe9e-43cc-8a9b-2459ebd2c6e7","Type":"ContainerStarted","Data":"40c853fc8ebbeeccdd064754b1f9dde9d1f1fc139538a5f4806578c68daf5501"}
May 25 11:18:03.884234 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:18:03.884212    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-pvgm2" event={"ID":"ceeaa8f0-8aae-4758-8813-959a2343178a","Type":"ContainerStarted","Data":"7c711efaa22fb057077ebcaae5b582fc364401d8819595587320cdc3740338cd"}
May 25 11:18:03.884341 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:18:03.884245    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-pvgm2" event={"ID":"ceeaa8f0-8aae-4758-8813-959a2343178a","Type":"ContainerStarted","Data":"a536d8a3c23a1dec2360e2539cda2445a7c16d8100b8864b2d74434d82165a7e"}
May 25 11:18:03.884341 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:18:03.884259    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-pvgm2" event={"ID":"ceeaa8f0-8aae-4758-8813-959a2343178a","Type":"ContainerStarted","Data":"a1d56b7adddd5624e6c7820cb442f2578c09608952acde5b2454ae3c81576a67"}
May 25 11:18:03.884341 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:18:03.884271    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-pvgm2" event={"ID":"ceeaa8f0-8aae-4758-8813-959a2343178a","Type":"ContainerStarted","Data":"55953b5aec9e83960f81c745f14b5eb4801e0798d25a64ae26ef4db5d0e6cb0f"}
May 25 11:18:03.884341 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:18:03.884291    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-pvgm2" event={"ID":"ceeaa8f0-8aae-4758-8813-959a2343178a","Type":"ContainerStarted","Data":"397d2974c1647c08c8ff995872bb6e2774ec4c7272d4ff62f1eceaae7ef1b495"}
May 25 11:18:03.894611 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:18:03.894578    2569 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-glmqw" podStartSLOduration=4.697581451 podStartE2EDuration="22.894567927s" podCreationTimestamp="2026-05-25 11:17:41 +0000 UTC" firstStartedPulling="2026-05-25 11:17:44.101749503 +0000 UTC m=+2.963373869" lastFinishedPulling="2026-05-25 11:18:02.298735969 +0000 UTC m=+21.160360345" observedRunningTime="2026-05-25 11:18:03.89419267 +0000 UTC m=+22.755817055" watchObservedRunningTime="2026-05-25 11:18:03.894567927 +0000 UTC m=+22.756192311"
May 25 11:18:04.654369 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:18:04.654004    2569 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-05-25T11:18:03.653853106Z","UUID":"4b94dcfd-69f2-42a9-8166-b9cc138b0ed7","Handler":null,"Name":"","Endpoint":""}
May 25 11:18:04.657088 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:18:04.657065    2569 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
May 25 11:18:04.657204 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:18:04.657094    2569 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
May 25 11:18:04.888438 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:18:04.888406    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vw42x" event={"ID":"ddc0dd0a-fe9e-43cc-8a9b-2459ebd2c6e7","Type":"ContainerStarted","Data":"333296b19eab21bf6af394ac568591c3a469f43ab8fee5b76632e9ba02cd4705"}
May 25 11:18:04.906123 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:18:04.906033    2569 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vw42x" podStartSLOduration=3.66560401 podStartE2EDuration="23.906014585s" podCreationTimestamp="2026-05-25 11:17:41 +0000 UTC" firstStartedPulling="2026-05-25 11:17:44.11470574 +0000 UTC m=+2.976330102" lastFinishedPulling="2026-05-25 11:18:04.355116312 +0000 UTC m=+23.216740677" observedRunningTime="2026-05-25 11:18:04.905438322 +0000 UTC m=+23.767062708" watchObservedRunningTime="2026-05-25 11:18:04.906014585 +0000 UTC m=+23.767638971"
May 25 11:18:05.725525 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:18:05.725491    2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pd47q"
May 25 11:18:05.725694 ip-10-0-143-46 kubenswrapper[2569]: E0525 11:18:05.725627    2569 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pd47q" podUID="9098669d-fa99-44c7-94ad-4e3560412654"
May 25 11:18:05.725694 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:18:05.725648    2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7x8z9"
May 25 11:18:05.725837 ip-10-0-143-46 kubenswrapper[2569]: E0525 11:18:05.725744    2569 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7x8z9" podUID="242d8af2-b5ad-4319-a821-39f484f7ea5c"
May 25 11:18:05.893846 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:18:05.893813    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-pvgm2" event={"ID":"ceeaa8f0-8aae-4758-8813-959a2343178a","Type":"ContainerStarted","Data":"121f028507bf7ef6435903df1543c5c3fb2cf1aeeba3c1d9d7ebfd65e0f6a6f7"}
May 25 11:18:07.262534 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:18:07.262500    2569 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-nn7vp"
May 25 11:18:07.263366 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:18:07.263347    2569 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-nn7vp"
May 25 11:18:07.725909 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:18:07.725867    2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pd47q"
May 25 11:18:07.726093 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:18:07.725867    2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7x8z9"
May 25 11:18:07.726093 ip-10-0-143-46 kubenswrapper[2569]: E0525 11:18:07.726002    2569 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pd47q" podUID="9098669d-fa99-44c7-94ad-4e3560412654"
May 25 11:18:07.726093 ip-10-0-143-46 kubenswrapper[2569]: E0525 11:18:07.726082    2569 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7x8z9" podUID="242d8af2-b5ad-4319-a821-39f484f7ea5c"
May 25 11:18:07.897148 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:18:07.897114    2569 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-nn7vp"
May 25 11:18:07.897598 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:18:07.897581    2569 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-nn7vp"
May 25 11:18:08.899880 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:18:08.899678    2569 generic.go:358] "Generic (PLEG): container finished" podID="05d11822-eeca-4852-b8ce-6b2235d5dbf3" containerID="c5ac49209999c39111ec95409010aabc9c27fd59b32d5c2dfabd3caee5b03872" exitCode=0
May 25 11:18:08.900404 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:18:08.899755    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-64cbl" event={"ID":"05d11822-eeca-4852-b8ce-6b2235d5dbf3","Type":"ContainerDied","Data":"c5ac49209999c39111ec95409010aabc9c27fd59b32d5c2dfabd3caee5b03872"}
May 25 11:18:08.903157 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:18:08.903137    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-pvgm2" event={"ID":"ceeaa8f0-8aae-4758-8813-959a2343178a","Type":"ContainerStarted","Data":"2d4a41926eeeff014ddbc4d61c624149fa5133ce07b2b8f7aec7c2f648634262"}
May 25 11:18:08.903444 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:18:08.903426    2569 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-pvgm2"
May 25 11:18:08.918927 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:18:08.918911    2569 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-pvgm2"
May 25 11:18:08.984648 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:18:08.984611    2569 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-pvgm2" podStartSLOduration=9.422193392 podStartE2EDuration="27.984598674s" podCreationTimestamp="2026-05-25 11:17:41 +0000 UTC" firstStartedPulling="2026-05-25 11:17:44.108569645 +0000 UTC m=+2.970194008" lastFinishedPulling="2026-05-25 11:18:02.670974913 +0000 UTC m=+21.532599290" observedRunningTime="2026-05-25 11:18:08.984500288 +0000 UTC m=+27.846124674" watchObservedRunningTime="2026-05-25 11:18:08.984598674 +0000 UTC m=+27.846223057"
May 25 11:18:09.725894 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:18:09.725863    2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pd47q"
May 25 11:18:09.726026 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:18:09.725869    2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7x8z9"
May 25 11:18:09.726026 ip-10-0-143-46 kubenswrapper[2569]: E0525 11:18:09.725995    2569 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pd47q" podUID="9098669d-fa99-44c7-94ad-4e3560412654"
May 25 11:18:09.726147 ip-10-0-143-46 kubenswrapper[2569]: E0525 11:18:09.726061    2569 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7x8z9" podUID="242d8af2-b5ad-4319-a821-39f484f7ea5c"
May 25 11:18:09.906604 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:18:09.906456    2569 generic.go:358] "Generic (PLEG): container finished" podID="05d11822-eeca-4852-b8ce-6b2235d5dbf3" containerID="cbba22f8f808330a26ce621c155d26d3ee606481d538350a8c0cd1c041e5020b" exitCode=0
May 25 11:18:09.906989 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:18:09.906504    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-64cbl" event={"ID":"05d11822-eeca-4852-b8ce-6b2235d5dbf3","Type":"ContainerDied","Data":"cbba22f8f808330a26ce621c155d26d3ee606481d538350a8c0cd1c041e5020b"}
May 25 11:18:09.906989 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:18:09.906883    2569 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-pvgm2"
May 25 11:18:09.907205 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:18:09.907178    2569 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-pvgm2"
May 25 11:18:09.921414 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:18:09.921395    2569 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-pvgm2"
May 25 11:18:09.973251 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:18:09.973230    2569 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-pd47q"]
May 25 11:18:09.973348 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:18:09.973305    2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pd47q"
May 25 11:18:09.973397 ip-10-0-143-46 kubenswrapper[2569]: E0525 11:18:09.973378    2569 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pd47q" podUID="9098669d-fa99-44c7-94ad-4e3560412654"
May 25 11:18:09.975898 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:18:09.975878    2569 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-7x8z9"]
May 25 11:18:09.975978 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:18:09.975945    2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7x8z9"
May 25 11:18:09.976038 ip-10-0-143-46 kubenswrapper[2569]: E0525 11:18:09.976015    2569 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7x8z9" podUID="242d8af2-b5ad-4319-a821-39f484f7ea5c"
May 25 11:18:10.910925 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:18:10.910892    2569 generic.go:358] "Generic (PLEG): container finished" podID="05d11822-eeca-4852-b8ce-6b2235d5dbf3" containerID="fb16ae140f46465ade45243ec88182592fe1f751cd7043f2d125ed508b12d094" exitCode=0
May 25 11:18:10.911294 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:18:10.910966    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-64cbl" event={"ID":"05d11822-eeca-4852-b8ce-6b2235d5dbf3","Type":"ContainerDied","Data":"fb16ae140f46465ade45243ec88182592fe1f751cd7043f2d125ed508b12d094"}
May 25 11:18:11.726329 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:18:11.726250    2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pd47q"
May 25 11:18:11.726476 ip-10-0-143-46 kubenswrapper[2569]: E0525 11:18:11.726354    2569 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pd47q" podUID="9098669d-fa99-44c7-94ad-4e3560412654"
May 25 11:18:11.726476 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:18:11.726431    2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7x8z9"
May 25 11:18:11.726591 ip-10-0-143-46 kubenswrapper[2569]: E0525 11:18:11.726526    2569 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7x8z9" podUID="242d8af2-b5ad-4319-a821-39f484f7ea5c"
May 25 11:18:13.725840 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:18:13.725808    2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7x8z9"
May 25 11:18:13.726630 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:18:13.725854    2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pd47q"
May 25 11:18:13.726630 ip-10-0-143-46 kubenswrapper[2569]: E0525 11:18:13.725937    2569 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7x8z9" podUID="242d8af2-b5ad-4319-a821-39f484f7ea5c"
May 25 11:18:13.726630 ip-10-0-143-46 kubenswrapper[2569]: E0525 11:18:13.726100    2569 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pd47q" podUID="9098669d-fa99-44c7-94ad-4e3560412654"
May 25 11:18:15.369394 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:18:15.369350    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9098669d-fa99-44c7-94ad-4e3560412654-metrics-certs\") pod \"network-metrics-daemon-pd47q\" (UID: \"9098669d-fa99-44c7-94ad-4e3560412654\") " pod="openshift-multus/network-metrics-daemon-pd47q"
May 25 11:18:15.369992 ip-10-0-143-46 kubenswrapper[2569]: E0525 11:18:15.369497    2569 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
May 25 11:18:15.369992 ip-10-0-143-46 kubenswrapper[2569]: E0525 11:18:15.369564    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9098669d-fa99-44c7-94ad-4e3560412654-metrics-certs podName:9098669d-fa99-44c7-94ad-4e3560412654 nodeName:}" failed. No retries permitted until 2026-05-25 11:18:47.369543674 +0000 UTC m=+66.231168041 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/9098669d-fa99-44c7-94ad-4e3560412654-metrics-certs") pod "network-metrics-daemon-pd47q" (UID: "9098669d-fa99-44c7-94ad-4e3560412654") : object "openshift-multus"/"metrics-daemon-secret" not registered
May 25 11:18:15.470312 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:18:15.470234    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-cjf5z\" (UniqueName: \"kubernetes.io/projected/242d8af2-b5ad-4319-a821-39f484f7ea5c-kube-api-access-cjf5z\") pod \"network-check-target-7x8z9\" (UID: \"242d8af2-b5ad-4319-a821-39f484f7ea5c\") " pod="openshift-network-diagnostics/network-check-target-7x8z9"
May 25 11:18:15.470473 ip-10-0-143-46 kubenswrapper[2569]: E0525 11:18:15.470366    2569 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
May 25 11:18:15.470473 ip-10-0-143-46 kubenswrapper[2569]: E0525 11:18:15.470386    2569 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
May 25 11:18:15.470473 ip-10-0-143-46 kubenswrapper[2569]: E0525 11:18:15.470400    2569 projected.go:194] Error preparing data for projected volume kube-api-access-cjf5z for pod openshift-network-diagnostics/network-check-target-7x8z9: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 25 11:18:15.470473 ip-10-0-143-46 kubenswrapper[2569]: E0525 11:18:15.470451    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/242d8af2-b5ad-4319-a821-39f484f7ea5c-kube-api-access-cjf5z podName:242d8af2-b5ad-4319-a821-39f484f7ea5c nodeName:}" failed. No retries permitted until 2026-05-25 11:18:47.470437557 +0000 UTC m=+66.332061919 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-cjf5z" (UniqueName: "kubernetes.io/projected/242d8af2-b5ad-4319-a821-39f484f7ea5c-kube-api-access-cjf5z") pod "network-check-target-7x8z9" (UID: "242d8af2-b5ad-4319-a821-39f484f7ea5c") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 25 11:18:15.483670 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:18:15.483646    2569 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-143-46.ec2.internal" event="NodeReady"
May 25 11:18:15.483823 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:18:15.483799    2569 kubelet_node_status.go:550] "Fast updating node status as it just became ready"
May 25 11:18:15.534441 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:18:15.534409    2569 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-dmhrg"]
May 25 11:18:15.572160 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:18:15.572131    2569 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-lpwk8"]
May 25 11:18:15.572329 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:18:15.572313    2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-dmhrg"
May 25 11:18:15.576049 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:18:15.575904    2569 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-t8nfn\""
May 25 11:18:15.576249 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:18:15.576228    2569 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
May 25 11:18:15.576325 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:18:15.576298    2569 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
May 25 11:18:15.588040 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:18:15.588019    2569 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-dmhrg"]
May 25 11:18:15.588160 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:18:15.588046    2569 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-lpwk8"]
May 25 11:18:15.588160 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:18:15.588137    2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-lpwk8"
May 25 11:18:15.590953 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:18:15.590922    2569 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-mjf4k\""
May 25 11:18:15.591060 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:18:15.591012    2569 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
May 25 11:18:15.591133 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:18:15.591115    2569 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
May 25 11:18:15.591380 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:18:15.591358    2569 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
May 25 11:18:15.671940 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:18:15.671914    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e1dc225a-b479-4666-98ba-b923a7e1e6b4-metrics-tls\") pod \"dns-default-dmhrg\" (UID: \"e1dc225a-b479-4666-98ba-b923a7e1e6b4\") " pod="openshift-dns/dns-default-dmhrg"
May 25 11:18:15.672093 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:18:15.671974    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/e1dc225a-b479-4666-98ba-b923a7e1e6b4-config-volume\") pod \"dns-default-dmhrg\" (UID: \"e1dc225a-b479-4666-98ba-b923a7e1e6b4\") " pod="openshift-dns/dns-default-dmhrg"
May 25 11:18:15.672093 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:18:15.672002    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ncwms\" (UniqueName: \"kubernetes.io/projected/e1dc225a-b479-4666-98ba-b923a7e1e6b4-kube-api-access-ncwms\") pod \"dns-default-dmhrg\" (UID: \"e1dc225a-b479-4666-98ba-b923a7e1e6b4\") " pod="openshift-dns/dns-default-dmhrg"
May 25 11:18:15.672093 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:18:15.672035    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e1dc225a-b479-4666-98ba-b923a7e1e6b4-tmp-dir\") pod \"dns-default-dmhrg\" (UID: \"e1dc225a-b479-4666-98ba-b923a7e1e6b4\") " pod="openshift-dns/dns-default-dmhrg"
May 25 11:18:15.728943 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:18:15.728876    2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7x8z9"
May 25 11:18:15.729072 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:18:15.728876    2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pd47q"
May 25 11:18:15.735196 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:18:15.735174    2569 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-bl7fp\""
May 25 11:18:15.735324 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:18:15.735288    2569 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
May 25 11:18:15.735380 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:18:15.735366    2569 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-j5m5s\""
May 25 11:18:15.735430 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:18:15.735391    2569 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
May 25 11:18:15.735540 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:18:15.735522    2569 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
May 25 11:18:15.772553 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:18:15.772528    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2zz54\" (UniqueName: \"kubernetes.io/projected/62c29731-ce45-4236-be62-f08e78a0fc27-kube-api-access-2zz54\") pod \"ingress-canary-lpwk8\" (UID: \"62c29731-ce45-4236-be62-f08e78a0fc27\") " pod="openshift-ingress-canary/ingress-canary-lpwk8"
May 25 11:18:15.772653 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:18:15.772565    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e1dc225a-b479-4666-98ba-b923a7e1e6b4-tmp-dir\") pod \"dns-default-dmhrg\" (UID: \"e1dc225a-b479-4666-98ba-b923a7e1e6b4\") " pod="openshift-dns/dns-default-dmhrg"
May 25 11:18:15.772653 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:18:15.772640    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e1dc225a-b479-4666-98ba-b923a7e1e6b4-metrics-tls\") pod \"dns-default-dmhrg\" (UID: \"e1dc225a-b479-4666-98ba-b923a7e1e6b4\") " pod="openshift-dns/dns-default-dmhrg"
May 25 11:18:15.772738 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:18:15.772664    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/62c29731-ce45-4236-be62-f08e78a0fc27-cert\") pod \"ingress-canary-lpwk8\" (UID: \"62c29731-ce45-4236-be62-f08e78a0fc27\") " pod="openshift-ingress-canary/ingress-canary-lpwk8"
May 25 11:18:15.772738 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:18:15.772709    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/e1dc225a-b479-4666-98ba-b923a7e1e6b4-config-volume\") pod \"dns-default-dmhrg\" (UID: \"e1dc225a-b479-4666-98ba-b923a7e1e6b4\") " pod="openshift-dns/dns-default-dmhrg"
May 25 11:18:15.772855 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:18:15.772734    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-ncwms\" (UniqueName: \"kubernetes.io/projected/e1dc225a-b479-4666-98ba-b923a7e1e6b4-kube-api-access-ncwms\") pod \"dns-default-dmhrg\" (UID: \"e1dc225a-b479-4666-98ba-b923a7e1e6b4\") " pod="openshift-dns/dns-default-dmhrg"
May 25 11:18:15.772855 ip-10-0-143-46 kubenswrapper[2569]: E0525 11:18:15.772823    2569 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
May 25 11:18:15.772927 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:18:15.772904    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e1dc225a-b479-4666-98ba-b923a7e1e6b4-tmp-dir\") pod \"dns-default-dmhrg\" (UID: \"e1dc225a-b479-4666-98ba-b923a7e1e6b4\") " pod="openshift-dns/dns-default-dmhrg"
May 25 11:18:15.772927 ip-10-0-143-46 kubenswrapper[2569]: E0525 11:18:15.772918    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e1dc225a-b479-4666-98ba-b923a7e1e6b4-metrics-tls podName:e1dc225a-b479-4666-98ba-b923a7e1e6b4 nodeName:}" failed. No retries permitted until 2026-05-25 11:18:16.272896905 +0000 UTC m=+35.134521271 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/e1dc225a-b479-4666-98ba-b923a7e1e6b4-metrics-tls") pod "dns-default-dmhrg" (UID: "e1dc225a-b479-4666-98ba-b923a7e1e6b4") : secret "dns-default-metrics-tls" not found
May 25 11:18:15.773211 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:18:15.773188    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/e1dc225a-b479-4666-98ba-b923a7e1e6b4-config-volume\") pod \"dns-default-dmhrg\" (UID: \"e1dc225a-b479-4666-98ba-b923a7e1e6b4\") " pod="openshift-dns/dns-default-dmhrg"
May 25 11:18:15.788664 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:18:15.788630    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ncwms\" (UniqueName: \"kubernetes.io/projected/e1dc225a-b479-4666-98ba-b923a7e1e6b4-kube-api-access-ncwms\") pod \"dns-default-dmhrg\" (UID: \"e1dc225a-b479-4666-98ba-b923a7e1e6b4\") " pod="openshift-dns/dns-default-dmhrg"
May 25 11:18:15.873499 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:18:15.873473    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-2zz54\" (UniqueName: \"kubernetes.io/projected/62c29731-ce45-4236-be62-f08e78a0fc27-kube-api-access-2zz54\") pod \"ingress-canary-lpwk8\" (UID: \"62c29731-ce45-4236-be62-f08e78a0fc27\") " pod="openshift-ingress-canary/ingress-canary-lpwk8"
May 25 11:18:15.873662 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:18:15.873552    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/62c29731-ce45-4236-be62-f08e78a0fc27-cert\") pod \"ingress-canary-lpwk8\" (UID: \"62c29731-ce45-4236-be62-f08e78a0fc27\") " pod="openshift-ingress-canary/ingress-canary-lpwk8"
May 25 11:18:15.873662 ip-10-0-143-46 kubenswrapper[2569]: E0525 11:18:15.873653    2569 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
May 25 11:18:15.873773 ip-10-0-143-46 kubenswrapper[2569]: E0525 11:18:15.873709    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/62c29731-ce45-4236-be62-f08e78a0fc27-cert podName:62c29731-ce45-4236-be62-f08e78a0fc27 nodeName:}" failed. No retries permitted until 2026-05-25 11:18:16.3736922 +0000 UTC m=+35.235316569 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/62c29731-ce45-4236-be62-f08e78a0fc27-cert") pod "ingress-canary-lpwk8" (UID: "62c29731-ce45-4236-be62-f08e78a0fc27") : secret "canary-serving-cert" not found
May 25 11:18:15.883837 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:18:15.883815    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2zz54\" (UniqueName: \"kubernetes.io/projected/62c29731-ce45-4236-be62-f08e78a0fc27-kube-api-access-2zz54\") pod \"ingress-canary-lpwk8\" (UID: \"62c29731-ce45-4236-be62-f08e78a0fc27\") " pod="openshift-ingress-canary/ingress-canary-lpwk8"
May 25 11:18:16.276981 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:18:16.276940    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e1dc225a-b479-4666-98ba-b923a7e1e6b4-metrics-tls\") pod \"dns-default-dmhrg\" (UID: \"e1dc225a-b479-4666-98ba-b923a7e1e6b4\") " pod="openshift-dns/dns-default-dmhrg"
May 25 11:18:16.277177 ip-10-0-143-46 kubenswrapper[2569]: E0525 11:18:16.277087    2569 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
May 25 11:18:16.277177 ip-10-0-143-46 kubenswrapper[2569]: E0525 11:18:16.277167    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e1dc225a-b479-4666-98ba-b923a7e1e6b4-metrics-tls podName:e1dc225a-b479-4666-98ba-b923a7e1e6b4 nodeName:}" failed. No retries permitted until 2026-05-25 11:18:17.277146169 +0000 UTC m=+36.138770545 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/e1dc225a-b479-4666-98ba-b923a7e1e6b4-metrics-tls") pod "dns-default-dmhrg" (UID: "e1dc225a-b479-4666-98ba-b923a7e1e6b4") : secret "dns-default-metrics-tls" not found
May 25 11:18:16.378086 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:18:16.378046    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/62c29731-ce45-4236-be62-f08e78a0fc27-cert\") pod \"ingress-canary-lpwk8\" (UID: \"62c29731-ce45-4236-be62-f08e78a0fc27\") " pod="openshift-ingress-canary/ingress-canary-lpwk8"
May 25 11:18:16.378422 ip-10-0-143-46 kubenswrapper[2569]: E0525 11:18:16.378182    2569 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
May 25 11:18:16.378422 ip-10-0-143-46 kubenswrapper[2569]: E0525 11:18:16.378240    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/62c29731-ce45-4236-be62-f08e78a0fc27-cert podName:62c29731-ce45-4236-be62-f08e78a0fc27 nodeName:}" failed. No retries permitted until 2026-05-25 11:18:17.378223955 +0000 UTC m=+36.239848320 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/62c29731-ce45-4236-be62-f08e78a0fc27-cert") pod "ingress-canary-lpwk8" (UID: "62c29731-ce45-4236-be62-f08e78a0fc27") : secret "canary-serving-cert" not found
May 25 11:18:16.924859 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:18:16.924609    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-64cbl" event={"ID":"05d11822-eeca-4852-b8ce-6b2235d5dbf3","Type":"ContainerStarted","Data":"175a785203dfcc8bb17623d5bbeffef1669b4201d85c06d6e11a0c190d54ab5d"}
May 25 11:18:17.283331 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:18:17.283307    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e1dc225a-b479-4666-98ba-b923a7e1e6b4-metrics-tls\") pod \"dns-default-dmhrg\" (UID: \"e1dc225a-b479-4666-98ba-b923a7e1e6b4\") " pod="openshift-dns/dns-default-dmhrg"
May 25 11:18:17.283463 ip-10-0-143-46 kubenswrapper[2569]: E0525 11:18:17.283433    2569 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
May 25 11:18:17.283500 ip-10-0-143-46 kubenswrapper[2569]: E0525 11:18:17.283494    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e1dc225a-b479-4666-98ba-b923a7e1e6b4-metrics-tls podName:e1dc225a-b479-4666-98ba-b923a7e1e6b4 nodeName:}" failed. No retries permitted until 2026-05-25 11:18:19.28347935 +0000 UTC m=+38.145103711 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/e1dc225a-b479-4666-98ba-b923a7e1e6b4-metrics-tls") pod "dns-default-dmhrg" (UID: "e1dc225a-b479-4666-98ba-b923a7e1e6b4") : secret "dns-default-metrics-tls" not found
May 25 11:18:17.383602 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:18:17.383574    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/62c29731-ce45-4236-be62-f08e78a0fc27-cert\") pod \"ingress-canary-lpwk8\" (UID: \"62c29731-ce45-4236-be62-f08e78a0fc27\") " pod="openshift-ingress-canary/ingress-canary-lpwk8"
May 25 11:18:17.383955 ip-10-0-143-46 kubenswrapper[2569]: E0525 11:18:17.383664    2569 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
May 25 11:18:17.383955 ip-10-0-143-46 kubenswrapper[2569]: E0525 11:18:17.383711    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/62c29731-ce45-4236-be62-f08e78a0fc27-cert podName:62c29731-ce45-4236-be62-f08e78a0fc27 nodeName:}" failed. No retries permitted until 2026-05-25 11:18:19.383697977 +0000 UTC m=+38.245322339 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/62c29731-ce45-4236-be62-f08e78a0fc27-cert") pod "ingress-canary-lpwk8" (UID: "62c29731-ce45-4236-be62-f08e78a0fc27") : secret "canary-serving-cert" not found
May 25 11:18:17.928843 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:18:17.928813    2569 generic.go:358] "Generic (PLEG): container finished" podID="05d11822-eeca-4852-b8ce-6b2235d5dbf3" containerID="175a785203dfcc8bb17623d5bbeffef1669b4201d85c06d6e11a0c190d54ab5d" exitCode=0
May 25 11:18:17.929003 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:18:17.928871    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-64cbl" event={"ID":"05d11822-eeca-4852-b8ce-6b2235d5dbf3","Type":"ContainerDied","Data":"175a785203dfcc8bb17623d5bbeffef1669b4201d85c06d6e11a0c190d54ab5d"}
May 25 11:18:18.932986 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:18:18.932950    2569 generic.go:358] "Generic (PLEG): container finished" podID="05d11822-eeca-4852-b8ce-6b2235d5dbf3" containerID="1d3bca7e96337a7f2e48f07344c44007dd1efd07b923253ebc8adefbd59c2f85" exitCode=0
May 25 11:18:18.933431 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:18:18.933020    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-64cbl" event={"ID":"05d11822-eeca-4852-b8ce-6b2235d5dbf3","Type":"ContainerDied","Data":"1d3bca7e96337a7f2e48f07344c44007dd1efd07b923253ebc8adefbd59c2f85"}
May 25 11:18:19.296081 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:18:19.296047    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e1dc225a-b479-4666-98ba-b923a7e1e6b4-metrics-tls\") pod \"dns-default-dmhrg\" (UID: \"e1dc225a-b479-4666-98ba-b923a7e1e6b4\") " pod="openshift-dns/dns-default-dmhrg"
May 25 11:18:19.296235 ip-10-0-143-46 kubenswrapper[2569]: E0525 11:18:19.296177    2569 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
May 25 11:18:19.296278 ip-10-0-143-46 kubenswrapper[2569]: E0525 11:18:19.296235    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e1dc225a-b479-4666-98ba-b923a7e1e6b4-metrics-tls podName:e1dc225a-b479-4666-98ba-b923a7e1e6b4 nodeName:}" failed. No retries permitted until 2026-05-25 11:18:23.296219472 +0000 UTC m=+42.157843833 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/e1dc225a-b479-4666-98ba-b923a7e1e6b4-metrics-tls") pod "dns-default-dmhrg" (UID: "e1dc225a-b479-4666-98ba-b923a7e1e6b4") : secret "dns-default-metrics-tls" not found
May 25 11:18:19.396624 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:18:19.396589    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/62c29731-ce45-4236-be62-f08e78a0fc27-cert\") pod \"ingress-canary-lpwk8\" (UID: \"62c29731-ce45-4236-be62-f08e78a0fc27\") " pod="openshift-ingress-canary/ingress-canary-lpwk8"
May 25 11:18:19.396756 ip-10-0-143-46 kubenswrapper[2569]: E0525 11:18:19.396736    2569 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
May 25 11:18:19.396820 ip-10-0-143-46 kubenswrapper[2569]: E0525 11:18:19.396809    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/62c29731-ce45-4236-be62-f08e78a0fc27-cert podName:62c29731-ce45-4236-be62-f08e78a0fc27 nodeName:}" failed. No retries permitted until 2026-05-25 11:18:23.396792967 +0000 UTC m=+42.258417342 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/62c29731-ce45-4236-be62-f08e78a0fc27-cert") pod "ingress-canary-lpwk8" (UID: "62c29731-ce45-4236-be62-f08e78a0fc27") : secret "canary-serving-cert" not found
May 25 11:18:19.937628 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:18:19.937591    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-64cbl" event={"ID":"05d11822-eeca-4852-b8ce-6b2235d5dbf3","Type":"ContainerStarted","Data":"18dbc132fc7af505ed48d79692db1cc31b335abdb090d61e7a4bfae6ec14a3c7"}
May 25 11:18:19.973072 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:18:19.973033    2569 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-64cbl" podStartSLOduration=6.324874114 podStartE2EDuration="38.973020306s" podCreationTimestamp="2026-05-25 11:17:41 +0000 UTC" firstStartedPulling="2026-05-25 11:17:44.114671429 +0000 UTC m=+2.976295791" lastFinishedPulling="2026-05-25 11:18:16.76281761 +0000 UTC m=+35.624441983" observedRunningTime="2026-05-25 11:18:19.971326892 +0000 UTC m=+38.832951298" watchObservedRunningTime="2026-05-25 11:18:19.973020306 +0000 UTC m=+38.834644690"
May 25 11:18:23.320525 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:18:23.320492    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e1dc225a-b479-4666-98ba-b923a7e1e6b4-metrics-tls\") pod \"dns-default-dmhrg\" (UID: \"e1dc225a-b479-4666-98ba-b923a7e1e6b4\") " pod="openshift-dns/dns-default-dmhrg"
May 25 11:18:23.320910 ip-10-0-143-46 kubenswrapper[2569]: E0525 11:18:23.320604    2569 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
May 25 11:18:23.320910 ip-10-0-143-46 kubenswrapper[2569]: E0525 11:18:23.320663    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e1dc225a-b479-4666-98ba-b923a7e1e6b4-metrics-tls podName:e1dc225a-b479-4666-98ba-b923a7e1e6b4 nodeName:}" failed. No retries permitted until 2026-05-25 11:18:31.320649425 +0000 UTC m=+50.182273787 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/e1dc225a-b479-4666-98ba-b923a7e1e6b4-metrics-tls") pod "dns-default-dmhrg" (UID: "e1dc225a-b479-4666-98ba-b923a7e1e6b4") : secret "dns-default-metrics-tls" not found
May 25 11:18:23.421504 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:18:23.421467    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/62c29731-ce45-4236-be62-f08e78a0fc27-cert\") pod \"ingress-canary-lpwk8\" (UID: \"62c29731-ce45-4236-be62-f08e78a0fc27\") " pod="openshift-ingress-canary/ingress-canary-lpwk8"
May 25 11:18:23.421669 ip-10-0-143-46 kubenswrapper[2569]: E0525 11:18:23.421586    2569 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
May 25 11:18:23.421669 ip-10-0-143-46 kubenswrapper[2569]: E0525 11:18:23.421647    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/62c29731-ce45-4236-be62-f08e78a0fc27-cert podName:62c29731-ce45-4236-be62-f08e78a0fc27 nodeName:}" failed. No retries permitted until 2026-05-25 11:18:31.421633041 +0000 UTC m=+50.283257402 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/62c29731-ce45-4236-be62-f08e78a0fc27-cert") pod "ingress-canary-lpwk8" (UID: "62c29731-ce45-4236-be62-f08e78a0fc27") : secret "canary-serving-cert" not found
May 25 11:18:31.370183 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:18:31.370148    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e1dc225a-b479-4666-98ba-b923a7e1e6b4-metrics-tls\") pod \"dns-default-dmhrg\" (UID: \"e1dc225a-b479-4666-98ba-b923a7e1e6b4\") " pod="openshift-dns/dns-default-dmhrg"
May 25 11:18:31.370617 ip-10-0-143-46 kubenswrapper[2569]: E0525 11:18:31.370265    2569 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
May 25 11:18:31.370617 ip-10-0-143-46 kubenswrapper[2569]: E0525 11:18:31.370321    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e1dc225a-b479-4666-98ba-b923a7e1e6b4-metrics-tls podName:e1dc225a-b479-4666-98ba-b923a7e1e6b4 nodeName:}" failed. No retries permitted until 2026-05-25 11:18:47.370306237 +0000 UTC m=+66.231930598 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/e1dc225a-b479-4666-98ba-b923a7e1e6b4-metrics-tls") pod "dns-default-dmhrg" (UID: "e1dc225a-b479-4666-98ba-b923a7e1e6b4") : secret "dns-default-metrics-tls" not found
May 25 11:18:31.471288 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:18:31.471255    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/62c29731-ce45-4236-be62-f08e78a0fc27-cert\") pod \"ingress-canary-lpwk8\" (UID: \"62c29731-ce45-4236-be62-f08e78a0fc27\") " pod="openshift-ingress-canary/ingress-canary-lpwk8"
May 25 11:18:31.471453 ip-10-0-143-46 kubenswrapper[2569]: E0525 11:18:31.471408    2569 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
May 25 11:18:31.471499 ip-10-0-143-46 kubenswrapper[2569]: E0525 11:18:31.471489    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/62c29731-ce45-4236-be62-f08e78a0fc27-cert podName:62c29731-ce45-4236-be62-f08e78a0fc27 nodeName:}" failed. No retries permitted until 2026-05-25 11:18:47.471472482 +0000 UTC m=+66.333096844 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/62c29731-ce45-4236-be62-f08e78a0fc27-cert") pod "ingress-canary-lpwk8" (UID: "62c29731-ce45-4236-be62-f08e78a0fc27") : secret "canary-serving-cert" not found
May 25 11:18:41.924107 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:18:41.924080    2569 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-pvgm2"
May 25 11:18:47.374794 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:18:47.374759    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9098669d-fa99-44c7-94ad-4e3560412654-metrics-certs\") pod \"network-metrics-daemon-pd47q\" (UID: \"9098669d-fa99-44c7-94ad-4e3560412654\") " pod="openshift-multus/network-metrics-daemon-pd47q"
May 25 11:18:47.375243 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:18:47.374822    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e1dc225a-b479-4666-98ba-b923a7e1e6b4-metrics-tls\") pod \"dns-default-dmhrg\" (UID: \"e1dc225a-b479-4666-98ba-b923a7e1e6b4\") " pod="openshift-dns/dns-default-dmhrg"
May 25 11:18:47.375243 ip-10-0-143-46 kubenswrapper[2569]: E0525 11:18:47.374931    2569 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
May 25 11:18:47.375243 ip-10-0-143-46 kubenswrapper[2569]: E0525 11:18:47.375023    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e1dc225a-b479-4666-98ba-b923a7e1e6b4-metrics-tls podName:e1dc225a-b479-4666-98ba-b923a7e1e6b4 nodeName:}" failed. No retries permitted until 2026-05-25 11:19:19.375001181 +0000 UTC m=+98.236625548 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/e1dc225a-b479-4666-98ba-b923a7e1e6b4-metrics-tls") pod "dns-default-dmhrg" (UID: "e1dc225a-b479-4666-98ba-b923a7e1e6b4") : secret "dns-default-metrics-tls" not found
May 25 11:18:47.377394 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:18:47.377377    2569 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
May 25 11:18:47.385384 ip-10-0-143-46 kubenswrapper[2569]: E0525 11:18:47.385368    2569 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
May 25 11:18:47.385450 ip-10-0-143-46 kubenswrapper[2569]: E0525 11:18:47.385411    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9098669d-fa99-44c7-94ad-4e3560412654-metrics-certs podName:9098669d-fa99-44c7-94ad-4e3560412654 nodeName:}" failed. No retries permitted until 2026-05-25 11:19:51.385399048 +0000 UTC m=+130.247023410 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/9098669d-fa99-44c7-94ad-4e3560412654-metrics-certs") pod "network-metrics-daemon-pd47q" (UID: "9098669d-fa99-44c7-94ad-4e3560412654") : secret "metrics-daemon-secret" not found
May 25 11:18:47.475864 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:18:47.475843    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-cjf5z\" (UniqueName: \"kubernetes.io/projected/242d8af2-b5ad-4319-a821-39f484f7ea5c-kube-api-access-cjf5z\") pod \"network-check-target-7x8z9\" (UID: \"242d8af2-b5ad-4319-a821-39f484f7ea5c\") " pod="openshift-network-diagnostics/network-check-target-7x8z9"
May 25 11:18:47.475943 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:18:47.475879    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/62c29731-ce45-4236-be62-f08e78a0fc27-cert\") pod \"ingress-canary-lpwk8\" (UID: \"62c29731-ce45-4236-be62-f08e78a0fc27\") " pod="openshift-ingress-canary/ingress-canary-lpwk8"
May 25 11:18:47.475989 ip-10-0-143-46 kubenswrapper[2569]: E0525 11:18:47.475954    2569 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
May 25 11:18:47.475989 ip-10-0-143-46 kubenswrapper[2569]: E0525 11:18:47.475987    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/62c29731-ce45-4236-be62-f08e78a0fc27-cert podName:62c29731-ce45-4236-be62-f08e78a0fc27 nodeName:}" failed. No retries permitted until 2026-05-25 11:19:19.475975231 +0000 UTC m=+98.337599594 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/62c29731-ce45-4236-be62-f08e78a0fc27-cert") pod "ingress-canary-lpwk8" (UID: "62c29731-ce45-4236-be62-f08e78a0fc27") : secret "canary-serving-cert" not found
May 25 11:18:47.478691 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:18:47.478673    2569 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
May 25 11:18:47.490770 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:18:47.490749    2569 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
May 25 11:18:47.500174 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:18:47.500150    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cjf5z\" (UniqueName: \"kubernetes.io/projected/242d8af2-b5ad-4319-a821-39f484f7ea5c-kube-api-access-cjf5z\") pod \"network-check-target-7x8z9\" (UID: \"242d8af2-b5ad-4319-a821-39f484f7ea5c\") " pod="openshift-network-diagnostics/network-check-target-7x8z9"
May 25 11:18:47.542923 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:18:47.542903    2569 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-j5m5s\""
May 25 11:18:47.550233 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:18:47.550216    2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7x8z9"
May 25 11:18:47.740009 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:18:47.739983    2569 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-7x8z9"]
May 25 11:18:47.743840 ip-10-0-143-46 kubenswrapper[2569]: W0525 11:18:47.743815    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod242d8af2_b5ad_4319_a821_39f484f7ea5c.slice/crio-16fac1b205f0f4e5f8b1ccf79c3b405cdb080a3e58113dd23ddf91e8b0b0e275 WatchSource:0}: Error finding container 16fac1b205f0f4e5f8b1ccf79c3b405cdb080a3e58113dd23ddf91e8b0b0e275: Status 404 returned error can't find the container with id 16fac1b205f0f4e5f8b1ccf79c3b405cdb080a3e58113dd23ddf91e8b0b0e275
May 25 11:18:47.986710 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:18:47.986644    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-7x8z9" event={"ID":"242d8af2-b5ad-4319-a821-39f484f7ea5c","Type":"ContainerStarted","Data":"16fac1b205f0f4e5f8b1ccf79c3b405cdb080a3e58113dd23ddf91e8b0b0e275"}
May 25 11:18:50.993096 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:18:50.993057    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-7x8z9" event={"ID":"242d8af2-b5ad-4319-a821-39f484f7ea5c","Type":"ContainerStarted","Data":"8195240d09b066fbe27db027b4035f28c6b91f76440dcb5374dc5aa73d0bb57b"}
May 25 11:18:50.993454 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:18:50.993214    2569 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-7x8z9"
May 25 11:18:51.011700 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:18:51.011663    2569 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-7x8z9" podStartSLOduration=66.985551714 podStartE2EDuration="1m10.011652512s" podCreationTimestamp="2026-05-25 11:17:41 +0000 UTC" firstStartedPulling="2026-05-25 11:18:47.745485704 +0000 UTC m=+66.607110066" lastFinishedPulling="2026-05-25 11:18:50.771586493 +0000 UTC m=+69.633210864" observedRunningTime="2026-05-25 11:18:51.011044068 +0000 UTC m=+69.872668452" watchObservedRunningTime="2026-05-25 11:18:51.011652512 +0000 UTC m=+69.873276896"
May 25 11:19:19.391187 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:19:19.391068    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e1dc225a-b479-4666-98ba-b923a7e1e6b4-metrics-tls\") pod \"dns-default-dmhrg\" (UID: \"e1dc225a-b479-4666-98ba-b923a7e1e6b4\") " pod="openshift-dns/dns-default-dmhrg"
May 25 11:19:19.391187 ip-10-0-143-46 kubenswrapper[2569]: E0525 11:19:19.391179    2569 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
May 25 11:19:19.391664 ip-10-0-143-46 kubenswrapper[2569]: E0525 11:19:19.391250    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e1dc225a-b479-4666-98ba-b923a7e1e6b4-metrics-tls podName:e1dc225a-b479-4666-98ba-b923a7e1e6b4 nodeName:}" failed. No retries permitted until 2026-05-25 11:20:23.391232693 +0000 UTC m=+162.252857057 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/e1dc225a-b479-4666-98ba-b923a7e1e6b4-metrics-tls") pod "dns-default-dmhrg" (UID: "e1dc225a-b479-4666-98ba-b923a7e1e6b4") : secret "dns-default-metrics-tls" not found
May 25 11:19:19.491567 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:19:19.491538    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/62c29731-ce45-4236-be62-f08e78a0fc27-cert\") pod \"ingress-canary-lpwk8\" (UID: \"62c29731-ce45-4236-be62-f08e78a0fc27\") " pod="openshift-ingress-canary/ingress-canary-lpwk8"
May 25 11:19:19.491689 ip-10-0-143-46 kubenswrapper[2569]: E0525 11:19:19.491666    2569 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
May 25 11:19:19.491741 ip-10-0-143-46 kubenswrapper[2569]: E0525 11:19:19.491730    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/62c29731-ce45-4236-be62-f08e78a0fc27-cert podName:62c29731-ce45-4236-be62-f08e78a0fc27 nodeName:}" failed. No retries permitted until 2026-05-25 11:20:23.491715471 +0000 UTC m=+162.353339833 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/62c29731-ce45-4236-be62-f08e78a0fc27-cert") pod "ingress-canary-lpwk8" (UID: "62c29731-ce45-4236-be62-f08e78a0fc27") : secret "canary-serving-cert" not found
May 25 11:19:21.956331 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:19:21.956297    2569 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-5cf8c89d64-gxrtm"]
May 25 11:19:21.959405 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:19:21.959389    2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-5cf8c89d64-gxrtm"
May 25 11:19:21.962039 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:19:21.962018    2569 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\""
May 25 11:19:21.963254 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:19:21.963233    2569 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-4cppx\""
May 25 11:19:21.963625 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:19:21.963603    2569 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\""
May 25 11:19:21.964081 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:19:21.964067    2569 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-78bdfb888c-rhbmv"]
May 25 11:19:21.966235 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:19:21.966212    2569 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-6c75959455-98ftr"]
May 25 11:19:21.966332 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:19:21.966301    2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-78bdfb888c-rhbmv"
May 25 11:19:21.968336 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:19:21.968309    2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-98ftr"
May 25 11:19:21.968774 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:19:21.968754    2569 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\""
May 25 11:19:21.968889 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:19:21.968798    2569 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\""
May 25 11:19:21.968889 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:19:21.968812    2569 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-ktcbg\""
May 25 11:19:21.968889 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:19:21.968884    2569 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
May 25 11:19:21.969268 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:19:21.969255    2569 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
May 25 11:19:21.970849 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:19:21.970833    2569 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\""
May 25 11:19:21.971761 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:19:21.971740    2569 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-5cf8c89d64-gxrtm"]
May 25 11:19:21.973903 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:19:21.973883    2569 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\""
May 25 11:19:21.974061 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:19:21.973901    2569 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-4qlwd\""
May 25 11:19:21.974163 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:19:21.973974    2569 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
May 25 11:19:21.974699 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:19:21.974678    2569 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
May 25 11:19:21.977290 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:19:21.977239    2569 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\""
May 25 11:19:21.978557 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:19:21.978536    2569 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-6c75959455-98ftr"]
May 25 11:19:21.979584 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:19:21.979562    2569 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-78bdfb888c-rhbmv"]
May 25 11:19:21.997226 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:19:21.997211    2569 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-7x8z9"
May 25 11:19:22.008225 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:19:22.008201    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/d3b548de-36b2-48d6-b8f6-d35134a661af-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6c75959455-98ftr\" (UID: \"d3b548de-36b2-48d6-b8f6-d35134a661af\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-98ftr"
May 25 11:19:22.008329 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:19:22.008228    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4qx45\" (UniqueName: \"kubernetes.io/projected/742a0027-4655-4bb6-92ed-fa17bdeab56d-kube-api-access-4qx45\") pod \"insights-operator-78bdfb888c-rhbmv\" (UID: \"742a0027-4655-4bb6-92ed-fa17bdeab56d\") " pod="openshift-insights/insights-operator-78bdfb888c-rhbmv"
May 25 11:19:22.008405 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:19:22.008329    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qx858\" (UniqueName: \"kubernetes.io/projected/d3b548de-36b2-48d6-b8f6-d35134a661af-kube-api-access-qx858\") pod \"cluster-monitoring-operator-6c75959455-98ftr\" (UID: \"d3b548de-36b2-48d6-b8f6-d35134a661af\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-98ftr"
May 25 11:19:22.008405 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:19:22.008367    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8jw72\" (UniqueName: \"kubernetes.io/projected/385f208f-3756-46d9-bc95-92b1a254d5ae-kube-api-access-8jw72\") pod \"volume-data-source-validator-5cf8c89d64-gxrtm\" (UID: \"385f208f-3756-46d9-bc95-92b1a254d5ae\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-5cf8c89d64-gxrtm"
May 25 11:19:22.008506 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:19:22.008401    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/742a0027-4655-4bb6-92ed-fa17bdeab56d-service-ca-bundle\") pod \"insights-operator-78bdfb888c-rhbmv\" (UID: \"742a0027-4655-4bb6-92ed-fa17bdeab56d\") " pod="openshift-insights/insights-operator-78bdfb888c-rhbmv"
May 25 11:19:22.008506 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:19:22.008432    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/742a0027-4655-4bb6-92ed-fa17bdeab56d-trusted-ca-bundle\") pod \"insights-operator-78bdfb888c-rhbmv\" (UID: \"742a0027-4655-4bb6-92ed-fa17bdeab56d\") " pod="openshift-insights/insights-operator-78bdfb888c-rhbmv"
May 25 11:19:22.008506 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:19:22.008495    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/d3b548de-36b2-48d6-b8f6-d35134a661af-telemetry-config\") pod \"cluster-monitoring-operator-6c75959455-98ftr\" (UID: \"d3b548de-36b2-48d6-b8f6-d35134a661af\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-98ftr"
May 25 11:19:22.008654 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:19:22.008531    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/742a0027-4655-4bb6-92ed-fa17bdeab56d-tmp\") pod \"insights-operator-78bdfb888c-rhbmv\" (UID: \"742a0027-4655-4bb6-92ed-fa17bdeab56d\") " pod="openshift-insights/insights-operator-78bdfb888c-rhbmv"
May 25 11:19:22.008654 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:19:22.008564    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/742a0027-4655-4bb6-92ed-fa17bdeab56d-snapshots\") pod \"insights-operator-78bdfb888c-rhbmv\" (UID: \"742a0027-4655-4bb6-92ed-fa17bdeab56d\") " pod="openshift-insights/insights-operator-78bdfb888c-rhbmv"
May 25 11:19:22.008654 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:19:22.008611    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/742a0027-4655-4bb6-92ed-fa17bdeab56d-serving-cert\") pod \"insights-operator-78bdfb888c-rhbmv\" (UID: \"742a0027-4655-4bb6-92ed-fa17bdeab56d\") " pod="openshift-insights/insights-operator-78bdfb888c-rhbmv"
May 25 11:19:22.076766 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:19:22.076743    2569 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-697587599-25rfp"]
May 25 11:19:22.078453 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:19:22.078436    2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-25rfp"
May 25 11:19:22.081712 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:19:22.081691    2569 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\""
May 25 11:19:22.083902 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:19:22.083881    2569 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-57b5b68b8-fqd6q"]
May 25 11:19:22.084079 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:19:22.084058    2569 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\""
May 25 11:19:22.084491 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:19:22.084068    2569 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-shw8v\""
May 25 11:19:22.084491 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:19:22.084135    2569 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\""
May 25 11:19:22.086021 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:19:22.085998    2569 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-76dff48d59-cvhbj"]
May 25 11:19:22.086139 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:19:22.086120    2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-fqd6q"
May 25 11:19:22.087539 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:19:22.087523    2569 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-gqxzv"]
May 25 11:19:22.087675 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:19:22.087657    2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-76dff48d59-cvhbj"
May 25 11:19:22.088655 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:19:22.088638    2569 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\""
May 25 11:19:22.089406 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:19:22.089385    2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-gqxzv"
May 25 11:19:22.089585 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:19:22.089566    2569 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\""
May 25 11:19:22.089728 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:19:22.089706    2569 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\""
May 25 11:19:22.089937 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:19:22.089923    2569 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-wfzmh\""
May 25 11:19:22.090199 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:19:22.090183    2569 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\""
May 25 11:19:22.090756 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:19:22.090740    2569 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\""
May 25 11:19:22.090878 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:19:22.090861    2569 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\""
May 25 11:19:22.091951 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:19:22.091933    2569 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\""
May 25 11:19:22.092253 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:19:22.092221    2569 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\""
May 25 11:19:22.092355 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:19:22.092226    2569 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\""
May 25 11:19:22.093076 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:19:22.093051    2569 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-t89fw\""
May 25 11:19:22.093904 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:19:22.093884    2569 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\""
May 25 11:19:22.094224 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:19:22.094204    2569 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\""
May 25 11:19:22.094954 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:19:22.094930    2569 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-4qt8t\""
May 25 11:19:22.095823 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:19:22.095776    2569 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\""
May 25 11:19:22.101484 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:19:22.101465    2569 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\""
May 25 11:19:22.104708 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:19:22.104687    2569 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-697587599-25rfp"]
May 25 11:19:22.105535 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:19:22.105519    2569 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-57b5b68b8-fqd6q"]
May 25 11:19:22.106166 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:19:22.106150    2569 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-gqxzv"]
May 25 11:19:22.108973 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:19:22.108920    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/d3b548de-36b2-48d6-b8f6-d35134a661af-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6c75959455-98ftr\" (UID: \"d3b548de-36b2-48d6-b8f6-d35134a661af\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-98ftr"
May 25 11:19:22.108973 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:19:22.108952    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-4qx45\" (UniqueName: \"kubernetes.io/projected/742a0027-4655-4bb6-92ed-fa17bdeab56d-kube-api-access-4qx45\") pod \"insights-operator-78bdfb888c-rhbmv\" (UID: \"742a0027-4655-4bb6-92ed-fa17bdeab56d\") " pod="openshift-insights/insights-operator-78bdfb888c-rhbmv"
May 25 11:19:22.109141 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:19:22.108999    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-qx858\" (UniqueName: \"kubernetes.io/projected/d3b548de-36b2-48d6-b8f6-d35134a661af-kube-api-access-qx858\") pod \"cluster-monitoring-operator-6c75959455-98ftr\" (UID: \"d3b548de-36b2-48d6-b8f6-d35134a661af\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-98ftr"
May 25 11:19:22.109141 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:19:22.109032    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-8jw72\" (UniqueName: \"kubernetes.io/projected/385f208f-3756-46d9-bc95-92b1a254d5ae-kube-api-access-8jw72\") pod \"volume-data-source-validator-5cf8c89d64-gxrtm\" (UID: \"385f208f-3756-46d9-bc95-92b1a254d5ae\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-5cf8c89d64-gxrtm"
May 25 11:19:22.109141 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:19:22.109064    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/742a0027-4655-4bb6-92ed-fa17bdeab56d-service-ca-bundle\") pod \"insights-operator-78bdfb888c-rhbmv\" (UID: \"742a0027-4655-4bb6-92ed-fa17bdeab56d\") " pod="openshift-insights/insights-operator-78bdfb888c-rhbmv"
May 25 11:19:22.109141 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:19:22.109095    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/742a0027-4655-4bb6-92ed-fa17bdeab56d-trusted-ca-bundle\") pod \"insights-operator-78bdfb888c-rhbmv\" (UID: \"742a0027-4655-4bb6-92ed-fa17bdeab56d\") " pod="openshift-insights/insights-operator-78bdfb888c-rhbmv"
May 25 11:19:22.109141 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:19:22.109131    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/d3b548de-36b2-48d6-b8f6-d35134a661af-telemetry-config\") pod \"cluster-monitoring-operator-6c75959455-98ftr\" (UID: \"d3b548de-36b2-48d6-b8f6-d35134a661af\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-98ftr"
May 25 11:19:22.109421 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:19:22.109157    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/742a0027-4655-4bb6-92ed-fa17bdeab56d-tmp\") pod \"insights-operator-78bdfb888c-rhbmv\" (UID: \"742a0027-4655-4bb6-92ed-fa17bdeab56d\") " pod="openshift-insights/insights-operator-78bdfb888c-rhbmv"
May 25 11:19:22.109421 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:19:22.109190    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/742a0027-4655-4bb6-92ed-fa17bdeab56d-snapshots\") pod \"insights-operator-78bdfb888c-rhbmv\" (UID: \"742a0027-4655-4bb6-92ed-fa17bdeab56d\") " pod="openshift-insights/insights-operator-78bdfb888c-rhbmv"
May 25 11:19:22.109421 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:19:22.109230    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/742a0027-4655-4bb6-92ed-fa17bdeab56d-serving-cert\") pod \"insights-operator-78bdfb888c-rhbmv\" (UID: \"742a0027-4655-4bb6-92ed-fa17bdeab56d\") " pod="openshift-insights/insights-operator-78bdfb888c-rhbmv"
May 25 11:19:22.109574 ip-10-0-143-46 kubenswrapper[2569]: E0525 11:19:22.109548    2569 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
May 25 11:19:22.109645 ip-10-0-143-46 kubenswrapper[2569]: E0525 11:19:22.109634    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d3b548de-36b2-48d6-b8f6-d35134a661af-cluster-monitoring-operator-tls podName:d3b548de-36b2-48d6-b8f6-d35134a661af nodeName:}" failed. No retries permitted until 2026-05-25 11:19:22.609605593 +0000 UTC m=+101.471229973 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/d3b548de-36b2-48d6-b8f6-d35134a661af-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6c75959455-98ftr" (UID: "d3b548de-36b2-48d6-b8f6-d35134a661af") : secret "cluster-monitoring-operator-tls" not found
May 25 11:19:22.110556 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:19:22.110087    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/742a0027-4655-4bb6-92ed-fa17bdeab56d-tmp\") pod \"insights-operator-78bdfb888c-rhbmv\" (UID: \"742a0027-4655-4bb6-92ed-fa17bdeab56d\") " pod="openshift-insights/insights-operator-78bdfb888c-rhbmv"
May 25 11:19:22.110556 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:19:22.110365    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/742a0027-4655-4bb6-92ed-fa17bdeab56d-service-ca-bundle\") pod \"insights-operator-78bdfb888c-rhbmv\" (UID: \"742a0027-4655-4bb6-92ed-fa17bdeab56d\") " pod="openshift-insights/insights-operator-78bdfb888c-rhbmv"
May 25 11:19:22.110556 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:19:22.110457    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/d3b548de-36b2-48d6-b8f6-d35134a661af-telemetry-config\") pod \"cluster-monitoring-operator-6c75959455-98ftr\" (UID: \"d3b548de-36b2-48d6-b8f6-d35134a661af\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-98ftr"
May 25 11:19:22.110749 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:19:22.110705    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/742a0027-4655-4bb6-92ed-fa17bdeab56d-snapshots\") pod \"insights-operator-78bdfb888c-rhbmv\" (UID: \"742a0027-4655-4bb6-92ed-fa17bdeab56d\") " pod="openshift-insights/insights-operator-78bdfb888c-rhbmv"
May 25 11:19:22.110945 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:19:22.110923    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/742a0027-4655-4bb6-92ed-fa17bdeab56d-trusted-ca-bundle\") pod \"insights-operator-78bdfb888c-rhbmv\" (UID: \"742a0027-4655-4bb6-92ed-fa17bdeab56d\") " pod="openshift-insights/insights-operator-78bdfb888c-rhbmv"
May 25 11:19:22.112021 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:19:22.111997    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/742a0027-4655-4bb6-92ed-fa17bdeab56d-serving-cert\") pod \"insights-operator-78bdfb888c-rhbmv\" (UID: \"742a0027-4655-4bb6-92ed-fa17bdeab56d\") " pod="openshift-insights/insights-operator-78bdfb888c-rhbmv"
May 25 11:19:22.119214 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:19:22.119192    2569 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-76dff48d59-cvhbj"]
May 25 11:19:22.128538 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:19:22.128510    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4qx45\" (UniqueName: \"kubernetes.io/projected/742a0027-4655-4bb6-92ed-fa17bdeab56d-kube-api-access-4qx45\") pod \"insights-operator-78bdfb888c-rhbmv\" (UID: \"742a0027-4655-4bb6-92ed-fa17bdeab56d\") " pod="openshift-insights/insights-operator-78bdfb888c-rhbmv"
May 25 11:19:22.128653 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:19:22.128636    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8jw72\" (UniqueName: \"kubernetes.io/projected/385f208f-3756-46d9-bc95-92b1a254d5ae-kube-api-access-8jw72\") pod \"volume-data-source-validator-5cf8c89d64-gxrtm\" (UID: \"385f208f-3756-46d9-bc95-92b1a254d5ae\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-5cf8c89d64-gxrtm"
May 25 11:19:22.128943 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:19:22.128924    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qx858\" (UniqueName: \"kubernetes.io/projected/d3b548de-36b2-48d6-b8f6-d35134a661af-kube-api-access-qx858\") pod \"cluster-monitoring-operator-6c75959455-98ftr\" (UID: \"d3b548de-36b2-48d6-b8f6-d35134a661af\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-98ftr"
May 25 11:19:22.209631 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:19:22.209562    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/7483e72a-ce49-4f15-86a3-3516346588fb-samples-operator-tls\") pod \"cluster-samples-operator-697587599-25rfp\" (UID: \"7483e72a-ce49-4f15-86a3-3516346588fb\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-25rfp"
May 25 11:19:22.209631 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:19:22.209595    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/a9e3fc1b-f6e0-4021-9ee1-5602272d25c5-serving-cert\") pod \"service-ca-operator-57b5b68b8-fqd6q\" (UID: \"a9e3fc1b-f6e0-4021-9ee1-5602272d25c5\") " pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-fqd6q"
May 25 11:19:22.209751 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:19:22.209630    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/959d0443-ecc0-476d-ab71-5a24bc308dee-config\") pod \"kube-storage-version-migrator-operator-565644f49-gqxzv\" (UID: \"959d0443-ecc0-476d-ab71-5a24bc308dee\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-gqxzv"
May 25 11:19:22.209751 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:19:22.209693    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v7zs7\" (UniqueName: \"kubernetes.io/projected/a9e3fc1b-f6e0-4021-9ee1-5602272d25c5-kube-api-access-v7zs7\") pod \"service-ca-operator-57b5b68b8-fqd6q\" (UID: \"a9e3fc1b-f6e0-4021-9ee1-5602272d25c5\") " pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-fqd6q"
May 25 11:19:22.209751 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:19:22.209722    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/959d0443-ecc0-476d-ab71-5a24bc308dee-serving-cert\") pod \"kube-storage-version-migrator-operator-565644f49-gqxzv\" (UID: \"959d0443-ecc0-476d-ab71-5a24bc308dee\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-gqxzv"
May 25 11:19:22.209898 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:19:22.209771    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/a9e3fc1b-f6e0-4021-9ee1-5602272d25c5-config\") pod \"service-ca-operator-57b5b68b8-fqd6q\" (UID: \"a9e3fc1b-f6e0-4021-9ee1-5602272d25c5\") " pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-fqd6q"
May 25 11:19:22.209898 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:19:22.209819    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rb5sq\" (UniqueName: \"kubernetes.io/projected/959d0443-ecc0-476d-ab71-5a24bc308dee-kube-api-access-rb5sq\") pod \"kube-storage-version-migrator-operator-565644f49-gqxzv\" (UID: \"959d0443-ecc0-476d-ab71-5a24bc308dee\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-gqxzv"
May 25 11:19:22.209898 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:19:22.209840    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/9ff9f77a-ac83-4250-8c40-d14a2db84c1e-config\") pod \"console-operator-76dff48d59-cvhbj\" (UID: \"9ff9f77a-ac83-4250-8c40-d14a2db84c1e\") " pod="openshift-console-operator/console-operator-76dff48d59-cvhbj"
May 25 11:19:22.209898 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:19:22.209862    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c4z5n\" (UniqueName: \"kubernetes.io/projected/9ff9f77a-ac83-4250-8c40-d14a2db84c1e-kube-api-access-c4z5n\") pod \"console-operator-76dff48d59-cvhbj\" (UID: \"9ff9f77a-ac83-4250-8c40-d14a2db84c1e\") " pod="openshift-console-operator/console-operator-76dff48d59-cvhbj"
May 25 11:19:22.209898 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:19:22.209881    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/9ff9f77a-ac83-4250-8c40-d14a2db84c1e-serving-cert\") pod \"console-operator-76dff48d59-cvhbj\" (UID: \"9ff9f77a-ac83-4250-8c40-d14a2db84c1e\") " pod="openshift-console-operator/console-operator-76dff48d59-cvhbj"
May 25 11:19:22.209898 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:19:22.209897    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/9ff9f77a-ac83-4250-8c40-d14a2db84c1e-trusted-ca\") pod \"console-operator-76dff48d59-cvhbj\" (UID: \"9ff9f77a-ac83-4250-8c40-d14a2db84c1e\") " pod="openshift-console-operator/console-operator-76dff48d59-cvhbj"
May 25 11:19:22.210086 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:19:22.209929    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6zfpx\" (UniqueName: \"kubernetes.io/projected/7483e72a-ce49-4f15-86a3-3516346588fb-kube-api-access-6zfpx\") pod \"cluster-samples-operator-697587599-25rfp\" (UID: \"7483e72a-ce49-4f15-86a3-3516346588fb\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-25rfp"
May 25 11:19:22.268156 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:19:22.268130    2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-5cf8c89d64-gxrtm"
May 25 11:19:22.278808 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:19:22.278772    2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-78bdfb888c-rhbmv"
May 25 11:19:22.310674 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:19:22.310639    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-rb5sq\" (UniqueName: \"kubernetes.io/projected/959d0443-ecc0-476d-ab71-5a24bc308dee-kube-api-access-rb5sq\") pod \"kube-storage-version-migrator-operator-565644f49-gqxzv\" (UID: \"959d0443-ecc0-476d-ab71-5a24bc308dee\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-gqxzv"
May 25 11:19:22.310852 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:19:22.310683    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/9ff9f77a-ac83-4250-8c40-d14a2db84c1e-config\") pod \"console-operator-76dff48d59-cvhbj\" (UID: \"9ff9f77a-ac83-4250-8c40-d14a2db84c1e\") " pod="openshift-console-operator/console-operator-76dff48d59-cvhbj"
May 25 11:19:22.310852 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:19:22.310707    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-c4z5n\" (UniqueName: \"kubernetes.io/projected/9ff9f77a-ac83-4250-8c40-d14a2db84c1e-kube-api-access-c4z5n\") pod \"console-operator-76dff48d59-cvhbj\" (UID: \"9ff9f77a-ac83-4250-8c40-d14a2db84c1e\") " pod="openshift-console-operator/console-operator-76dff48d59-cvhbj"
May 25 11:19:22.310852 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:19:22.310734    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/9ff9f77a-ac83-4250-8c40-d14a2db84c1e-serving-cert\") pod \"console-operator-76dff48d59-cvhbj\" (UID: \"9ff9f77a-ac83-4250-8c40-d14a2db84c1e\") " pod="openshift-console-operator/console-operator-76dff48d59-cvhbj"
May 25 11:19:22.310852 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:19:22.310758    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/9ff9f77a-ac83-4250-8c40-d14a2db84c1e-trusted-ca\") pod \"console-operator-76dff48d59-cvhbj\" (UID: \"9ff9f77a-ac83-4250-8c40-d14a2db84c1e\") " pod="openshift-console-operator/console-operator-76dff48d59-cvhbj"
May 25 11:19:22.310852 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:19:22.310804    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-6zfpx\" (UniqueName: \"kubernetes.io/projected/7483e72a-ce49-4f15-86a3-3516346588fb-kube-api-access-6zfpx\") pod \"cluster-samples-operator-697587599-25rfp\" (UID: \"7483e72a-ce49-4f15-86a3-3516346588fb\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-25rfp"
May 25 11:19:22.310852 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:19:22.310840    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/7483e72a-ce49-4f15-86a3-3516346588fb-samples-operator-tls\") pod \"cluster-samples-operator-697587599-25rfp\" (UID: \"7483e72a-ce49-4f15-86a3-3516346588fb\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-25rfp"
May 25 11:19:22.311154 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:19:22.310864    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/a9e3fc1b-f6e0-4021-9ee1-5602272d25c5-serving-cert\") pod \"service-ca-operator-57b5b68b8-fqd6q\" (UID: \"a9e3fc1b-f6e0-4021-9ee1-5602272d25c5\") " pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-fqd6q"
May 25 11:19:22.311154 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:19:22.310891    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/959d0443-ecc0-476d-ab71-5a24bc308dee-config\") pod \"kube-storage-version-migrator-operator-565644f49-gqxzv\" (UID: \"959d0443-ecc0-476d-ab71-5a24bc308dee\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-gqxzv"
May 25 11:19:22.311154 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:19:22.310945    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-v7zs7\" (UniqueName: \"kubernetes.io/projected/a9e3fc1b-f6e0-4021-9ee1-5602272d25c5-kube-api-access-v7zs7\") pod \"service-ca-operator-57b5b68b8-fqd6q\" (UID: \"a9e3fc1b-f6e0-4021-9ee1-5602272d25c5\") " pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-fqd6q"
May 25 11:19:22.311154 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:19:22.310971    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/959d0443-ecc0-476d-ab71-5a24bc308dee-serving-cert\") pod \"kube-storage-version-migrator-operator-565644f49-gqxzv\" (UID: \"959d0443-ecc0-476d-ab71-5a24bc308dee\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-gqxzv"
May 25 11:19:22.311154 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:19:22.311046    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/a9e3fc1b-f6e0-4021-9ee1-5602272d25c5-config\") pod \"service-ca-operator-57b5b68b8-fqd6q\" (UID: \"a9e3fc1b-f6e0-4021-9ee1-5602272d25c5\") " pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-fqd6q"
May 25 11:19:22.311154 ip-10-0-143-46 kubenswrapper[2569]: E0525 11:19:22.311139    2569 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
May 25 11:19:22.311419 ip-10-0-143-46 kubenswrapper[2569]: E0525 11:19:22.311197    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7483e72a-ce49-4f15-86a3-3516346588fb-samples-operator-tls podName:7483e72a-ce49-4f15-86a3-3516346588fb nodeName:}" failed. No retries permitted until 2026-05-25 11:19:22.811179543 +0000 UTC m=+101.672803913 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/7483e72a-ce49-4f15-86a3-3516346588fb-samples-operator-tls") pod "cluster-samples-operator-697587599-25rfp" (UID: "7483e72a-ce49-4f15-86a3-3516346588fb") : secret "samples-operator-tls" not found
May 25 11:19:22.311685 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:19:22.311616    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/a9e3fc1b-f6e0-4021-9ee1-5602272d25c5-config\") pod \"service-ca-operator-57b5b68b8-fqd6q\" (UID: \"a9e3fc1b-f6e0-4021-9ee1-5602272d25c5\") " pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-fqd6q"
May 25 11:19:22.311826 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:19:22.311805    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/9ff9f77a-ac83-4250-8c40-d14a2db84c1e-config\") pod \"console-operator-76dff48d59-cvhbj\" (UID: \"9ff9f77a-ac83-4250-8c40-d14a2db84c1e\") " pod="openshift-console-operator/console-operator-76dff48d59-cvhbj"
May 25 11:19:22.314018 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:19:22.312998    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/959d0443-ecc0-476d-ab71-5a24bc308dee-config\") pod \"kube-storage-version-migrator-operator-565644f49-gqxzv\" (UID: \"959d0443-ecc0-476d-ab71-5a24bc308dee\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-gqxzv"
May 25 11:19:22.314018 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:19:22.313026    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/9ff9f77a-ac83-4250-8c40-d14a2db84c1e-trusted-ca\") pod \"console-operator-76dff48d59-cvhbj\" (UID: \"9ff9f77a-ac83-4250-8c40-d14a2db84c1e\") " pod="openshift-console-operator/console-operator-76dff48d59-cvhbj"
May 25 11:19:22.316121 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:19:22.316076    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/9ff9f77a-ac83-4250-8c40-d14a2db84c1e-serving-cert\") pod \"console-operator-76dff48d59-cvhbj\" (UID: \"9ff9f77a-ac83-4250-8c40-d14a2db84c1e\") " pod="openshift-console-operator/console-operator-76dff48d59-cvhbj"
May 25 11:19:22.316747 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:19:22.316573    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/959d0443-ecc0-476d-ab71-5a24bc308dee-serving-cert\") pod \"kube-storage-version-migrator-operator-565644f49-gqxzv\" (UID: \"959d0443-ecc0-476d-ab71-5a24bc308dee\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-gqxzv"
May 25 11:19:22.316914 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:19:22.316893    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/a9e3fc1b-f6e0-4021-9ee1-5602272d25c5-serving-cert\") pod \"service-ca-operator-57b5b68b8-fqd6q\" (UID: \"a9e3fc1b-f6e0-4021-9ee1-5602272d25c5\") " pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-fqd6q"
May 25 11:19:22.320272 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:19:22.320245    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-c4z5n\" (UniqueName: \"kubernetes.io/projected/9ff9f77a-ac83-4250-8c40-d14a2db84c1e-kube-api-access-c4z5n\") pod \"console-operator-76dff48d59-cvhbj\" (UID: \"9ff9f77a-ac83-4250-8c40-d14a2db84c1e\") " pod="openshift-console-operator/console-operator-76dff48d59-cvhbj"
May 25 11:19:22.321405 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:19:22.321378    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-v7zs7\" (UniqueName: \"kubernetes.io/projected/a9e3fc1b-f6e0-4021-9ee1-5602272d25c5-kube-api-access-v7zs7\") pod \"service-ca-operator-57b5b68b8-fqd6q\" (UID: \"a9e3fc1b-f6e0-4021-9ee1-5602272d25c5\") " pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-fqd6q"
May 25 11:19:22.322664 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:19:22.322622    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rb5sq\" (UniqueName: \"kubernetes.io/projected/959d0443-ecc0-476d-ab71-5a24bc308dee-kube-api-access-rb5sq\") pod \"kube-storage-version-migrator-operator-565644f49-gqxzv\" (UID: \"959d0443-ecc0-476d-ab71-5a24bc308dee\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-gqxzv"
May 25 11:19:22.322664 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:19:22.322648    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6zfpx\" (UniqueName: \"kubernetes.io/projected/7483e72a-ce49-4f15-86a3-3516346588fb-kube-api-access-6zfpx\") pod \"cluster-samples-operator-697587599-25rfp\" (UID: \"7483e72a-ce49-4f15-86a3-3516346588fb\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-25rfp"
May 25 11:19:22.394214 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:19:22.394180    2569 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-5cf8c89d64-gxrtm"]
May 25 11:19:22.397873 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:19:22.397851    2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-fqd6q"
May 25 11:19:22.398363 ip-10-0-143-46 kubenswrapper[2569]: W0525 11:19:22.398298    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod385f208f_3756_46d9_bc95_92b1a254d5ae.slice/crio-a8dcc321d26e84a17fd7758838c0d47f5a89a3ce8246ff720eadf0782bfa2a31 WatchSource:0}: Error finding container a8dcc321d26e84a17fd7758838c0d47f5a89a3ce8246ff720eadf0782bfa2a31: Status 404 returned error can't find the container with id a8dcc321d26e84a17fd7758838c0d47f5a89a3ce8246ff720eadf0782bfa2a31
May 25 11:19:22.405706 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:19:22.405688    2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-76dff48d59-cvhbj"
May 25 11:19:22.413689 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:19:22.413668    2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-gqxzv"
May 25 11:19:22.415077 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:19:22.415054    2569 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-78bdfb888c-rhbmv"]
May 25 11:19:22.419467 ip-10-0-143-46 kubenswrapper[2569]: W0525 11:19:22.419441    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod742a0027_4655_4bb6_92ed_fa17bdeab56d.slice/crio-80a6c1d9e0a916b9ec3022a190abe325f584acef03c98316b303135d288a0ad2 WatchSource:0}: Error finding container 80a6c1d9e0a916b9ec3022a190abe325f584acef03c98316b303135d288a0ad2: Status 404 returned error can't find the container with id 80a6c1d9e0a916b9ec3022a190abe325f584acef03c98316b303135d288a0ad2
May 25 11:19:22.550601 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:19:22.550573    2569 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-76dff48d59-cvhbj"]
May 25 11:19:22.553465 ip-10-0-143-46 kubenswrapper[2569]: W0525 11:19:22.553438    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9ff9f77a_ac83_4250_8c40_d14a2db84c1e.slice/crio-a5cfcfd45087f4ff5b8d54cfa9c09b8e4bb79f803574764e54e0600b66434546 WatchSource:0}: Error finding container a5cfcfd45087f4ff5b8d54cfa9c09b8e4bb79f803574764e54e0600b66434546: Status 404 returned error can't find the container with id a5cfcfd45087f4ff5b8d54cfa9c09b8e4bb79f803574764e54e0600b66434546
May 25 11:19:22.614473 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:19:22.614446    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/d3b548de-36b2-48d6-b8f6-d35134a661af-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6c75959455-98ftr\" (UID: \"d3b548de-36b2-48d6-b8f6-d35134a661af\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-98ftr"
May 25 11:19:22.614601 ip-10-0-143-46 kubenswrapper[2569]: E0525 11:19:22.614583    2569 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
May 25 11:19:22.614653 ip-10-0-143-46 kubenswrapper[2569]: E0525 11:19:22.614643    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d3b548de-36b2-48d6-b8f6-d35134a661af-cluster-monitoring-operator-tls podName:d3b548de-36b2-48d6-b8f6-d35134a661af nodeName:}" failed. No retries permitted until 2026-05-25 11:19:23.614628235 +0000 UTC m=+102.476252598 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/d3b548de-36b2-48d6-b8f6-d35134a661af-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6c75959455-98ftr" (UID: "d3b548de-36b2-48d6-b8f6-d35134a661af") : secret "cluster-monitoring-operator-tls" not found
May 25 11:19:22.758387 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:19:22.758327    2569 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-57b5b68b8-fqd6q"]
May 25 11:19:22.761067 ip-10-0-143-46 kubenswrapper[2569]: W0525 11:19:22.761043    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda9e3fc1b_f6e0_4021_9ee1_5602272d25c5.slice/crio-bf556503c1047dd27c0ca5131684dc572dc0f2ca2b043f468b5cbc45302b8bfd WatchSource:0}: Error finding container bf556503c1047dd27c0ca5131684dc572dc0f2ca2b043f468b5cbc45302b8bfd: Status 404 returned error can't find the container with id bf556503c1047dd27c0ca5131684dc572dc0f2ca2b043f468b5cbc45302b8bfd
May 25 11:19:22.767596 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:19:22.767574    2569 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-gqxzv"]
May 25 11:19:22.771053 ip-10-0-143-46 kubenswrapper[2569]: W0525 11:19:22.771033    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod959d0443_ecc0_476d_ab71_5a24bc308dee.slice/crio-ce9d360a0345da2b59a809700b5e094b4911c4b2b33593d277ce2d06dcc48909 WatchSource:0}: Error finding container ce9d360a0345da2b59a809700b5e094b4911c4b2b33593d277ce2d06dcc48909: Status 404 returned error can't find the container with id ce9d360a0345da2b59a809700b5e094b4911c4b2b33593d277ce2d06dcc48909
May 25 11:19:22.815881 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:19:22.815862    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/7483e72a-ce49-4f15-86a3-3516346588fb-samples-operator-tls\") pod \"cluster-samples-operator-697587599-25rfp\" (UID: \"7483e72a-ce49-4f15-86a3-3516346588fb\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-25rfp"
May 25 11:19:22.816005 ip-10-0-143-46 kubenswrapper[2569]: E0525 11:19:22.815991    2569 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
May 25 11:19:22.816068 ip-10-0-143-46 kubenswrapper[2569]: E0525 11:19:22.816054    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7483e72a-ce49-4f15-86a3-3516346588fb-samples-operator-tls podName:7483e72a-ce49-4f15-86a3-3516346588fb nodeName:}" failed. No retries permitted until 2026-05-25 11:19:23.816035767 +0000 UTC m=+102.677660148 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/7483e72a-ce49-4f15-86a3-3516346588fb-samples-operator-tls") pod "cluster-samples-operator-697587599-25rfp" (UID: "7483e72a-ce49-4f15-86a3-3516346588fb") : secret "samples-operator-tls" not found
May 25 11:19:23.053691 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:19:23.053653    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-76dff48d59-cvhbj" event={"ID":"9ff9f77a-ac83-4250-8c40-d14a2db84c1e","Type":"ContainerStarted","Data":"a5cfcfd45087f4ff5b8d54cfa9c09b8e4bb79f803574764e54e0600b66434546"}
May 25 11:19:23.054914 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:19:23.054881    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-fqd6q" event={"ID":"a9e3fc1b-f6e0-4021-9ee1-5602272d25c5","Type":"ContainerStarted","Data":"bf556503c1047dd27c0ca5131684dc572dc0f2ca2b043f468b5cbc45302b8bfd"}
May 25 11:19:23.055920 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:19:23.055892    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-78bdfb888c-rhbmv" event={"ID":"742a0027-4655-4bb6-92ed-fa17bdeab56d","Type":"ContainerStarted","Data":"80a6c1d9e0a916b9ec3022a190abe325f584acef03c98316b303135d288a0ad2"}
May 25 11:19:23.056986 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:19:23.056965    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-gqxzv" event={"ID":"959d0443-ecc0-476d-ab71-5a24bc308dee","Type":"ContainerStarted","Data":"ce9d360a0345da2b59a809700b5e094b4911c4b2b33593d277ce2d06dcc48909"}
May 25 11:19:23.058149 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:19:23.058123    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-5cf8c89d64-gxrtm" event={"ID":"385f208f-3756-46d9-bc95-92b1a254d5ae","Type":"ContainerStarted","Data":"a8dcc321d26e84a17fd7758838c0d47f5a89a3ce8246ff720eadf0782bfa2a31"}
May 25 11:19:23.623255 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:19:23.623212    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/d3b548de-36b2-48d6-b8f6-d35134a661af-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6c75959455-98ftr\" (UID: \"d3b548de-36b2-48d6-b8f6-d35134a661af\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-98ftr"
May 25 11:19:23.623418 ip-10-0-143-46 kubenswrapper[2569]: E0525 11:19:23.623385    2569 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
May 25 11:19:23.623491 ip-10-0-143-46 kubenswrapper[2569]: E0525 11:19:23.623451    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d3b548de-36b2-48d6-b8f6-d35134a661af-cluster-monitoring-operator-tls podName:d3b548de-36b2-48d6-b8f6-d35134a661af nodeName:}" failed. No retries permitted until 2026-05-25 11:19:25.623433022 +0000 UTC m=+104.485057391 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/d3b548de-36b2-48d6-b8f6-d35134a661af-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6c75959455-98ftr" (UID: "d3b548de-36b2-48d6-b8f6-d35134a661af") : secret "cluster-monitoring-operator-tls" not found
May 25 11:19:23.824544 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:19:23.824506    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/7483e72a-ce49-4f15-86a3-3516346588fb-samples-operator-tls\") pod \"cluster-samples-operator-697587599-25rfp\" (UID: \"7483e72a-ce49-4f15-86a3-3516346588fb\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-25rfp"
May 25 11:19:23.824722 ip-10-0-143-46 kubenswrapper[2569]: E0525 11:19:23.824684    2569 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
May 25 11:19:23.824863 ip-10-0-143-46 kubenswrapper[2569]: E0525 11:19:23.824767    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7483e72a-ce49-4f15-86a3-3516346588fb-samples-operator-tls podName:7483e72a-ce49-4f15-86a3-3516346588fb nodeName:}" failed. No retries permitted until 2026-05-25 11:19:25.824746919 +0000 UTC m=+104.686371282 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/7483e72a-ce49-4f15-86a3-3516346588fb-samples-operator-tls") pod "cluster-samples-operator-697587599-25rfp" (UID: "7483e72a-ce49-4f15-86a3-3516346588fb") : secret "samples-operator-tls" not found
May 25 11:19:24.064658 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:19:24.064550    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-5cf8c89d64-gxrtm" event={"ID":"385f208f-3756-46d9-bc95-92b1a254d5ae","Type":"ContainerStarted","Data":"e66b3553a276de487416f7ce7f024fa723b2d668fb66724b1fb20d4d5fb220f6"}
May 25 11:19:25.639612 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:19:25.639570    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/d3b548de-36b2-48d6-b8f6-d35134a661af-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6c75959455-98ftr\" (UID: \"d3b548de-36b2-48d6-b8f6-d35134a661af\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-98ftr"
May 25 11:19:25.640112 ip-10-0-143-46 kubenswrapper[2569]: E0525 11:19:25.639720    2569 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
May 25 11:19:25.640112 ip-10-0-143-46 kubenswrapper[2569]: E0525 11:19:25.639824    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d3b548de-36b2-48d6-b8f6-d35134a661af-cluster-monitoring-operator-tls podName:d3b548de-36b2-48d6-b8f6-d35134a661af nodeName:}" failed. No retries permitted until 2026-05-25 11:19:29.639801507 +0000 UTC m=+108.501425892 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/d3b548de-36b2-48d6-b8f6-d35134a661af-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6c75959455-98ftr" (UID: "d3b548de-36b2-48d6-b8f6-d35134a661af") : secret "cluster-monitoring-operator-tls" not found
May 25 11:19:25.841330 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:19:25.841295    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/7483e72a-ce49-4f15-86a3-3516346588fb-samples-operator-tls\") pod \"cluster-samples-operator-697587599-25rfp\" (UID: \"7483e72a-ce49-4f15-86a3-3516346588fb\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-25rfp"
May 25 11:19:25.841490 ip-10-0-143-46 kubenswrapper[2569]: E0525 11:19:25.841433    2569 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
May 25 11:19:25.841536 ip-10-0-143-46 kubenswrapper[2569]: E0525 11:19:25.841504    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7483e72a-ce49-4f15-86a3-3516346588fb-samples-operator-tls podName:7483e72a-ce49-4f15-86a3-3516346588fb nodeName:}" failed. No retries permitted until 2026-05-25 11:19:29.841483961 +0000 UTC m=+108.703108346 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/7483e72a-ce49-4f15-86a3-3516346588fb-samples-operator-tls") pod "cluster-samples-operator-697587599-25rfp" (UID: "7483e72a-ce49-4f15-86a3-3516346588fb") : secret "samples-operator-tls" not found
May 25 11:19:27.073367 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:19:27.073335    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-cvhbj_9ff9f77a-ac83-4250-8c40-d14a2db84c1e/console-operator/0.log"
May 25 11:19:27.073811 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:19:27.073385    2569 generic.go:358] "Generic (PLEG): container finished" podID="9ff9f77a-ac83-4250-8c40-d14a2db84c1e" containerID="65e10aa73f4463f5724eeed5ed3cd11501bdcde35b2310d2ec7d82658b4d76fc" exitCode=255
May 25 11:19:27.073811 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:19:27.073636    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-76dff48d59-cvhbj" event={"ID":"9ff9f77a-ac83-4250-8c40-d14a2db84c1e","Type":"ContainerDied","Data":"65e10aa73f4463f5724eeed5ed3cd11501bdcde35b2310d2ec7d82658b4d76fc"}
May 25 11:19:27.073811 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:19:27.073681    2569 scope.go:117] "RemoveContainer" containerID="65e10aa73f4463f5724eeed5ed3cd11501bdcde35b2310d2ec7d82658b4d76fc"
May 25 11:19:27.075241 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:19:27.075213    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-fqd6q" event={"ID":"a9e3fc1b-f6e0-4021-9ee1-5602272d25c5","Type":"ContainerStarted","Data":"78f47f12fc5aa870c4154d6ade7b30a94adc6e28db6ed9326de1421bb63d93a8"}
May 25 11:19:27.076936 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:19:27.076913    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-78bdfb888c-rhbmv" event={"ID":"742a0027-4655-4bb6-92ed-fa17bdeab56d","Type":"ContainerStarted","Data":"c86d3e74400e12a5e226ee11018f945311e7a17add7432b641ab966cc6032747"}
May 25 11:19:27.078440 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:19:27.078421    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-gqxzv" event={"ID":"959d0443-ecc0-476d-ab71-5a24bc308dee","Type":"ContainerStarted","Data":"cc58bc001423ab0ecff3b140efc1ed4575ca5777f7c864ff84b04d22cab6ce92"}
May 25 11:19:27.094354 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:19:27.094286    2569 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-5cf8c89d64-gxrtm" podStartSLOduration=4.587190569 podStartE2EDuration="6.094271978s" podCreationTimestamp="2026-05-25 11:19:21 +0000 UTC" firstStartedPulling="2026-05-25 11:19:22.40127871 +0000 UTC m=+101.262903075" lastFinishedPulling="2026-05-25 11:19:23.908360105 +0000 UTC m=+102.769984484" observedRunningTime="2026-05-25 11:19:24.079930987 +0000 UTC m=+102.941555372" watchObservedRunningTime="2026-05-25 11:19:27.094271978 +0000 UTC m=+105.955896366"
May 25 11:19:27.110914 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:19:27.110826    2569 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-fqd6q" podStartSLOduration=1.5846882789999999 podStartE2EDuration="5.110812948s" podCreationTimestamp="2026-05-25 11:19:22 +0000 UTC" firstStartedPulling="2026-05-25 11:19:22.762710808 +0000 UTC m=+101.624335170" lastFinishedPulling="2026-05-25 11:19:26.288835475 +0000 UTC m=+105.150459839" observedRunningTime="2026-05-25 11:19:27.109964508 +0000 UTC m=+105.971588893" watchObservedRunningTime="2026-05-25 11:19:27.110812948 +0000 UTC m=+105.972437330"
May 25 11:19:27.129178 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:19:27.129133    2569 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-insights/insights-operator-78bdfb888c-rhbmv" podStartSLOduration=2.267765072 podStartE2EDuration="6.129117755s" podCreationTimestamp="2026-05-25 11:19:21 +0000 UTC" firstStartedPulling="2026-05-25 11:19:22.421691481 +0000 UTC m=+101.283315846" lastFinishedPulling="2026-05-25 11:19:26.283044167 +0000 UTC m=+105.144668529" observedRunningTime="2026-05-25 11:19:27.127727865 +0000 UTC m=+105.989352250" watchObservedRunningTime="2026-05-25 11:19:27.129117755 +0000 UTC m=+105.990742140"
May 25 11:19:27.148606 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:19:27.146617    2569 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-gqxzv" podStartSLOduration=1.6333250540000002 podStartE2EDuration="5.146600414s" podCreationTimestamp="2026-05-25 11:19:22 +0000 UTC" firstStartedPulling="2026-05-25 11:19:22.772670029 +0000 UTC m=+101.634294390" lastFinishedPulling="2026-05-25 11:19:26.285945377 +0000 UTC m=+105.147569750" observedRunningTime="2026-05-25 11:19:27.145146574 +0000 UTC m=+106.006770959" watchObservedRunningTime="2026-05-25 11:19:27.146600414 +0000 UTC m=+106.008224800"
May 25 11:19:27.910210 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:19:27.910176    2569 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-b985f5d89-qgn59"]
May 25 11:19:27.913243 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:19:27.913219    2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-b985f5d89-qgn59"
May 25 11:19:27.915936 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:19:27.915914    2569 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\""
May 25 11:19:27.916751 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:19:27.916733    2569 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\""
May 25 11:19:27.916855 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:19:27.916732    2569 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-bqlh8\""
May 25 11:19:27.924633 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:19:27.924590    2569 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-b985f5d89-qgn59"]
May 25 11:19:27.961802 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:19:27.961756    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dhn9w\" (UniqueName: \"kubernetes.io/projected/f697138d-df82-4c2c-a859-2d6bdc255fd0-kube-api-access-dhn9w\") pod \"migrator-b985f5d89-qgn59\" (UID: \"f697138d-df82-4c2c-a859-2d6bdc255fd0\") " pod="openshift-kube-storage-version-migrator/migrator-b985f5d89-qgn59"
May 25 11:19:28.062371 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:19:28.062323    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-dhn9w\" (UniqueName: \"kubernetes.io/projected/f697138d-df82-4c2c-a859-2d6bdc255fd0-kube-api-access-dhn9w\") pod \"migrator-b985f5d89-qgn59\" (UID: \"f697138d-df82-4c2c-a859-2d6bdc255fd0\") " pod="openshift-kube-storage-version-migrator/migrator-b985f5d89-qgn59"
May 25 11:19:28.074025 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:19:28.073968    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dhn9w\" (UniqueName: \"kubernetes.io/projected/f697138d-df82-4c2c-a859-2d6bdc255fd0-kube-api-access-dhn9w\") pod \"migrator-b985f5d89-qgn59\" (UID: \"f697138d-df82-4c2c-a859-2d6bdc255fd0\") " pod="openshift-kube-storage-version-migrator/migrator-b985f5d89-qgn59"
May 25 11:19:28.082705 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:19:28.082679    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-cvhbj_9ff9f77a-ac83-4250-8c40-d14a2db84c1e/console-operator/1.log"
May 25 11:19:28.083150 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:19:28.083128    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-cvhbj_9ff9f77a-ac83-4250-8c40-d14a2db84c1e/console-operator/0.log"
May 25 11:19:28.083275 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:19:28.083167    2569 generic.go:358] "Generic (PLEG): container finished" podID="9ff9f77a-ac83-4250-8c40-d14a2db84c1e" containerID="ad41427340218d831e08cfe40b1e405c436ded0dfee133a9ce93de13a313ec32" exitCode=255
May 25 11:19:28.083275 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:19:28.083229    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-76dff48d59-cvhbj" event={"ID":"9ff9f77a-ac83-4250-8c40-d14a2db84c1e","Type":"ContainerDied","Data":"ad41427340218d831e08cfe40b1e405c436ded0dfee133a9ce93de13a313ec32"}
May 25 11:19:28.083583 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:19:28.083283    2569 scope.go:117] "RemoveContainer" containerID="65e10aa73f4463f5724eeed5ed3cd11501bdcde35b2310d2ec7d82658b4d76fc"
May 25 11:19:28.083712 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:19:28.083665    2569 scope.go:117] "RemoveContainer" containerID="ad41427340218d831e08cfe40b1e405c436ded0dfee133a9ce93de13a313ec32"
May 25 11:19:28.083972 ip-10-0-143-46 kubenswrapper[2569]: E0525 11:19:28.083921    2569 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-76dff48d59-cvhbj_openshift-console-operator(9ff9f77a-ac83-4250-8c40-d14a2db84c1e)\"" pod="openshift-console-operator/console-operator-76dff48d59-cvhbj" podUID="9ff9f77a-ac83-4250-8c40-d14a2db84c1e"
May 25 11:19:28.222378 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:19:28.222308    2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-b985f5d89-qgn59"
May 25 11:19:28.355351 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:19:28.355324    2569 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-b985f5d89-qgn59"]
May 25 11:19:28.357511 ip-10-0-143-46 kubenswrapper[2569]: W0525 11:19:28.357485    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf697138d_df82_4c2c_a859_2d6bdc255fd0.slice/crio-1ab0ee2ae2fa86f63f8fa28bfbcf9560d1feb81250c6e88fde3d50cbcdaa5210 WatchSource:0}: Error finding container 1ab0ee2ae2fa86f63f8fa28bfbcf9560d1feb81250c6e88fde3d50cbcdaa5210: Status 404 returned error can't find the container with id 1ab0ee2ae2fa86f63f8fa28bfbcf9560d1feb81250c6e88fde3d50cbcdaa5210
May 25 11:19:29.087715 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:19:29.087690    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-cvhbj_9ff9f77a-ac83-4250-8c40-d14a2db84c1e/console-operator/1.log"
May 25 11:19:29.088151 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:19:29.088088    2569 scope.go:117] "RemoveContainer" containerID="ad41427340218d831e08cfe40b1e405c436ded0dfee133a9ce93de13a313ec32"
May 25 11:19:29.088316 ip-10-0-143-46 kubenswrapper[2569]: E0525 11:19:29.088295    2569 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-76dff48d59-cvhbj_openshift-console-operator(9ff9f77a-ac83-4250-8c40-d14a2db84c1e)\"" pod="openshift-console-operator/console-operator-76dff48d59-cvhbj" podUID="9ff9f77a-ac83-4250-8c40-d14a2db84c1e"
May 25 11:19:29.088982 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:19:29.088962    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-b985f5d89-qgn59" event={"ID":"f697138d-df82-4c2c-a859-2d6bdc255fd0","Type":"ContainerStarted","Data":"1ab0ee2ae2fa86f63f8fa28bfbcf9560d1feb81250c6e88fde3d50cbcdaa5210"}
May 25 11:19:29.674663 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:19:29.674590    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/d3b548de-36b2-48d6-b8f6-d35134a661af-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6c75959455-98ftr\" (UID: \"d3b548de-36b2-48d6-b8f6-d35134a661af\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-98ftr"
May 25 11:19:29.674836 ip-10-0-143-46 kubenswrapper[2569]: E0525 11:19:29.674762    2569 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
May 25 11:19:29.674900 ip-10-0-143-46 kubenswrapper[2569]: E0525 11:19:29.674871    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d3b548de-36b2-48d6-b8f6-d35134a661af-cluster-monitoring-operator-tls podName:d3b548de-36b2-48d6-b8f6-d35134a661af nodeName:}" failed. No retries permitted until 2026-05-25 11:19:37.674849708 +0000 UTC m=+116.536474085 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/d3b548de-36b2-48d6-b8f6-d35134a661af-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6c75959455-98ftr" (UID: "d3b548de-36b2-48d6-b8f6-d35134a661af") : secret "cluster-monitoring-operator-tls" not found
May 25 11:19:29.875846 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:19:29.875814    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/7483e72a-ce49-4f15-86a3-3516346588fb-samples-operator-tls\") pod \"cluster-samples-operator-697587599-25rfp\" (UID: \"7483e72a-ce49-4f15-86a3-3516346588fb\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-25rfp"
May 25 11:19:29.875987 ip-10-0-143-46 kubenswrapper[2569]: E0525 11:19:29.875930    2569 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
May 25 11:19:29.875987 ip-10-0-143-46 kubenswrapper[2569]: E0525 11:19:29.875976    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7483e72a-ce49-4f15-86a3-3516346588fb-samples-operator-tls podName:7483e72a-ce49-4f15-86a3-3516346588fb nodeName:}" failed. No retries permitted until 2026-05-25 11:19:37.875962667 +0000 UTC m=+116.737587029 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/7483e72a-ce49-4f15-86a3-3516346588fb-samples-operator-tls") pod "cluster-samples-operator-697587599-25rfp" (UID: "7483e72a-ce49-4f15-86a3-3516346588fb") : secret "samples-operator-tls" not found
May 25 11:19:30.094690 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:19:30.094660    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-b985f5d89-qgn59" event={"ID":"f697138d-df82-4c2c-a859-2d6bdc255fd0","Type":"ContainerStarted","Data":"99e530b0c57f0e75de6f574925129d60a1f32d515bf3d9b43c4578109b3be6ed"}
May 25 11:19:30.095070 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:19:30.094696    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-b985f5d89-qgn59" event={"ID":"f697138d-df82-4c2c-a859-2d6bdc255fd0","Type":"ContainerStarted","Data":"50cab4670c26773d48eb4ea0c3bcf936605420f5f22639f66518f90acd254d5a"}
May 25 11:19:30.111519 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:19:30.111479    2569 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-b985f5d89-qgn59" podStartSLOduration=2.110702727 podStartE2EDuration="3.111466973s" podCreationTimestamp="2026-05-25 11:19:27 +0000 UTC" firstStartedPulling="2026-05-25 11:19:28.359288215 +0000 UTC m=+107.220912578" lastFinishedPulling="2026-05-25 11:19:29.360052462 +0000 UTC m=+108.221676824" observedRunningTime="2026-05-25 11:19:30.111406212 +0000 UTC m=+108.973030596" watchObservedRunningTime="2026-05-25 11:19:30.111466973 +0000 UTC m=+108.973091356"
May 25 11:19:30.246004 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:19:30.245974    2569 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-67d667c7d-lv5bj"]
May 25 11:19:30.248885 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:19:30.248869    2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-67d667c7d-lv5bj"
May 25 11:19:30.251416 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:19:30.251390    2569 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\""
May 25 11:19:30.251530 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:19:30.251393    2569 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\""
May 25 11:19:30.251684 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:19:30.251668    2569 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-6s2qs\""
May 25 11:19:30.251728 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:19:30.251668    2569 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\""
May 25 11:19:30.251728 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:19:30.251712    2569 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\""
May 25 11:19:30.258755 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:19:30.258735    2569 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-67d667c7d-lv5bj"]
May 25 11:19:30.379124 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:19:30.379061    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/10a9dd5a-ffb3-4d63-8251-4ea3ea6923c7-signing-cabundle\") pod \"service-ca-67d667c7d-lv5bj\" (UID: \"10a9dd5a-ffb3-4d63-8251-4ea3ea6923c7\") " pod="openshift-service-ca/service-ca-67d667c7d-lv5bj"
May 25 11:19:30.379124 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:19:30.379117    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/10a9dd5a-ffb3-4d63-8251-4ea3ea6923c7-signing-key\") pod \"service-ca-67d667c7d-lv5bj\" (UID: \"10a9dd5a-ffb3-4d63-8251-4ea3ea6923c7\") " pod="openshift-service-ca/service-ca-67d667c7d-lv5bj"
May 25 11:19:30.379266 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:19:30.379135    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-64tlv\" (UniqueName: \"kubernetes.io/projected/10a9dd5a-ffb3-4d63-8251-4ea3ea6923c7-kube-api-access-64tlv\") pod \"service-ca-67d667c7d-lv5bj\" (UID: \"10a9dd5a-ffb3-4d63-8251-4ea3ea6923c7\") " pod="openshift-service-ca/service-ca-67d667c7d-lv5bj"
May 25 11:19:30.480349 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:19:30.480324    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/10a9dd5a-ffb3-4d63-8251-4ea3ea6923c7-signing-cabundle\") pod \"service-ca-67d667c7d-lv5bj\" (UID: \"10a9dd5a-ffb3-4d63-8251-4ea3ea6923c7\") " pod="openshift-service-ca/service-ca-67d667c7d-lv5bj"
May 25 11:19:30.480479 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:19:30.480382    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/10a9dd5a-ffb3-4d63-8251-4ea3ea6923c7-signing-key\") pod \"service-ca-67d667c7d-lv5bj\" (UID: \"10a9dd5a-ffb3-4d63-8251-4ea3ea6923c7\") " pod="openshift-service-ca/service-ca-67d667c7d-lv5bj"
May 25 11:19:30.480479 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:19:30.480399    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-64tlv\" (UniqueName: \"kubernetes.io/projected/10a9dd5a-ffb3-4d63-8251-4ea3ea6923c7-kube-api-access-64tlv\") pod \"service-ca-67d667c7d-lv5bj\" (UID: \"10a9dd5a-ffb3-4d63-8251-4ea3ea6923c7\") " pod="openshift-service-ca/service-ca-67d667c7d-lv5bj"
May 25 11:19:30.481057 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:19:30.481037    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/10a9dd5a-ffb3-4d63-8251-4ea3ea6923c7-signing-cabundle\") pod \"service-ca-67d667c7d-lv5bj\" (UID: \"10a9dd5a-ffb3-4d63-8251-4ea3ea6923c7\") " pod="openshift-service-ca/service-ca-67d667c7d-lv5bj"
May 25 11:19:30.482767 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:19:30.482747    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/10a9dd5a-ffb3-4d63-8251-4ea3ea6923c7-signing-key\") pod \"service-ca-67d667c7d-lv5bj\" (UID: \"10a9dd5a-ffb3-4d63-8251-4ea3ea6923c7\") " pod="openshift-service-ca/service-ca-67d667c7d-lv5bj"
May 25 11:19:30.489276 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:19:30.489248    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-64tlv\" (UniqueName: \"kubernetes.io/projected/10a9dd5a-ffb3-4d63-8251-4ea3ea6923c7-kube-api-access-64tlv\") pod \"service-ca-67d667c7d-lv5bj\" (UID: \"10a9dd5a-ffb3-4d63-8251-4ea3ea6923c7\") " pod="openshift-service-ca/service-ca-67d667c7d-lv5bj"
May 25 11:19:30.557677 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:19:30.557652    2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-67d667c7d-lv5bj"
May 25 11:19:30.673564 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:19:30.673538    2569 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-67d667c7d-lv5bj"]
May 25 11:19:30.676303 ip-10-0-143-46 kubenswrapper[2569]: W0525 11:19:30.676270    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod10a9dd5a_ffb3_4d63_8251_4ea3ea6923c7.slice/crio-89e8a704b177686739556d706d7e39090c6cb9fc2b29e0cf2bb0d2c20baf0858 WatchSource:0}: Error finding container 89e8a704b177686739556d706d7e39090c6cb9fc2b29e0cf2bb0d2c20baf0858: Status 404 returned error can't find the container with id 89e8a704b177686739556d706d7e39090c6cb9fc2b29e0cf2bb0d2c20baf0858
May 25 11:19:30.867761 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:19:30.867739    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-r8nxs_f0bab5fa-9ff8-4d17-9108-5a985f7bc43b/dns-node-resolver/0.log"
May 25 11:19:31.098640 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:19:31.098610    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-67d667c7d-lv5bj" event={"ID":"10a9dd5a-ffb3-4d63-8251-4ea3ea6923c7","Type":"ContainerStarted","Data":"b7af9c3faedd0113f0e9f772545076eb7d39cfeb317e739a5e177c50c9889cb6"}
May 25 11:19:31.099004 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:19:31.098645    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-67d667c7d-lv5bj" event={"ID":"10a9dd5a-ffb3-4d63-8251-4ea3ea6923c7","Type":"ContainerStarted","Data":"89e8a704b177686739556d706d7e39090c6cb9fc2b29e0cf2bb0d2c20baf0858"}
May 25 11:19:31.116290 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:19:31.116253    2569 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-service-ca/service-ca-67d667c7d-lv5bj" podStartSLOduration=1.11624061 podStartE2EDuration="1.11624061s" podCreationTimestamp="2026-05-25 11:19:30 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-25 11:19:31.115579421 +0000 UTC m=+109.977203808" watchObservedRunningTime="2026-05-25 11:19:31.11624061 +0000 UTC m=+109.977864994"
May 25 11:19:31.867964 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:19:31.867938    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-tq2s9_3cf3c515-4ccb-4fcd-b5d3-205cb581a363/node-ca/0.log"
May 25 11:19:32.406729 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:19:32.406694    2569 kubelet.go:2658] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-76dff48d59-cvhbj"
May 25 11:19:32.406729 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:19:32.406729    2569 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-76dff48d59-cvhbj"
May 25 11:19:32.407234 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:19:32.407044    2569 scope.go:117] "RemoveContainer" containerID="ad41427340218d831e08cfe40b1e405c436ded0dfee133a9ce93de13a313ec32"
May 25 11:19:32.407234 ip-10-0-143-46 kubenswrapper[2569]: E0525 11:19:32.407190    2569 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-76dff48d59-cvhbj_openshift-console-operator(9ff9f77a-ac83-4250-8c40-d14a2db84c1e)\"" pod="openshift-console-operator/console-operator-76dff48d59-cvhbj" podUID="9ff9f77a-ac83-4250-8c40-d14a2db84c1e"
May 25 11:19:33.072171 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:19:33.072135    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-b985f5d89-qgn59_f697138d-df82-4c2c-a859-2d6bdc255fd0/migrator/0.log"
May 25 11:19:33.267947 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:19:33.267919    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-b985f5d89-qgn59_f697138d-df82-4c2c-a859-2d6bdc255fd0/graceful-termination/0.log"
May 25 11:19:33.468235 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:19:33.468145    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-565644f49-gqxzv_959d0443-ecc0-476d-ab71-5a24bc308dee/kube-storage-version-migrator-operator/0.log"
May 25 11:19:37.735288 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:19:37.735261    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/d3b548de-36b2-48d6-b8f6-d35134a661af-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6c75959455-98ftr\" (UID: \"d3b548de-36b2-48d6-b8f6-d35134a661af\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-98ftr"
May 25 11:19:37.735740 ip-10-0-143-46 kubenswrapper[2569]: E0525 11:19:37.735427    2569 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
May 25 11:19:37.735740 ip-10-0-143-46 kubenswrapper[2569]: E0525 11:19:37.735503    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d3b548de-36b2-48d6-b8f6-d35134a661af-cluster-monitoring-operator-tls podName:d3b548de-36b2-48d6-b8f6-d35134a661af nodeName:}" failed. No retries permitted until 2026-05-25 11:19:53.735483373 +0000 UTC m=+132.597107735 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/d3b548de-36b2-48d6-b8f6-d35134a661af-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6c75959455-98ftr" (UID: "d3b548de-36b2-48d6-b8f6-d35134a661af") : secret "cluster-monitoring-operator-tls" not found
May 25 11:19:37.937167 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:19:37.937128    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/7483e72a-ce49-4f15-86a3-3516346588fb-samples-operator-tls\") pod \"cluster-samples-operator-697587599-25rfp\" (UID: \"7483e72a-ce49-4f15-86a3-3516346588fb\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-25rfp"
May 25 11:19:37.939523 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:19:37.939495    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/7483e72a-ce49-4f15-86a3-3516346588fb-samples-operator-tls\") pod \"cluster-samples-operator-697587599-25rfp\" (UID: \"7483e72a-ce49-4f15-86a3-3516346588fb\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-25rfp"
May 25 11:19:37.988621 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:19:37.988557    2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-25rfp"
May 25 11:19:38.117137 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:19:38.117108    2569 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-697587599-25rfp"]
May 25 11:19:39.120244 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:19:39.120207    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-25rfp" event={"ID":"7483e72a-ce49-4f15-86a3-3516346588fb","Type":"ContainerStarted","Data":"af9e5fadb00a9906d7c5b627276cb32eb1d124ecba1e7fea0a81a3ff9aa744a4"}
May 25 11:19:40.123737 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:19:40.123703    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-25rfp" event={"ID":"7483e72a-ce49-4f15-86a3-3516346588fb","Type":"ContainerStarted","Data":"b0284c81a14deee85acd92092f011a22d7424ea607a990537d8d5f230c197868"}
May 25 11:19:40.123737 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:19:40.123737    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-25rfp" event={"ID":"7483e72a-ce49-4f15-86a3-3516346588fb","Type":"ContainerStarted","Data":"7e814a89136449419061f2fa428107c8f8f13f89bb8b3330056edb24c7fd23f0"}
May 25 11:19:40.142421 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:19:40.142380    2569 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-25rfp" podStartSLOduration=16.616004494 podStartE2EDuration="18.142367186s" podCreationTimestamp="2026-05-25 11:19:22 +0000 UTC" firstStartedPulling="2026-05-25 11:19:38.159754547 +0000 UTC m=+117.021378910" lastFinishedPulling="2026-05-25 11:19:39.686117228 +0000 UTC m=+118.547741602" observedRunningTime="2026-05-25 11:19:40.142082483 +0000 UTC m=+119.003706868" watchObservedRunningTime="2026-05-25 11:19:40.142367186 +0000 UTC m=+119.003991569"
May 25 11:19:43.725927 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:19:43.725897    2569 scope.go:117] "RemoveContainer" containerID="ad41427340218d831e08cfe40b1e405c436ded0dfee133a9ce93de13a313ec32"
May 25 11:19:44.133654 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:19:44.133625    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-cvhbj_9ff9f77a-ac83-4250-8c40-d14a2db84c1e/console-operator/2.log"
May 25 11:19:44.134061 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:19:44.134046    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-cvhbj_9ff9f77a-ac83-4250-8c40-d14a2db84c1e/console-operator/1.log"
May 25 11:19:44.134152 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:19:44.134077    2569 generic.go:358] "Generic (PLEG): container finished" podID="9ff9f77a-ac83-4250-8c40-d14a2db84c1e" containerID="838e4303306651f1756e3a876aeefc4d9337bbfd80de93ba14b8174159aae3e9" exitCode=255
May 25 11:19:44.134152 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:19:44.134123    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-76dff48d59-cvhbj" event={"ID":"9ff9f77a-ac83-4250-8c40-d14a2db84c1e","Type":"ContainerDied","Data":"838e4303306651f1756e3a876aeefc4d9337bbfd80de93ba14b8174159aae3e9"}
May 25 11:19:44.134255 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:19:44.134151    2569 scope.go:117] "RemoveContainer" containerID="ad41427340218d831e08cfe40b1e405c436ded0dfee133a9ce93de13a313ec32"
May 25 11:19:44.134484 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:19:44.134466    2569 scope.go:117] "RemoveContainer" containerID="838e4303306651f1756e3a876aeefc4d9337bbfd80de93ba14b8174159aae3e9"
May 25 11:19:44.134687 ip-10-0-143-46 kubenswrapper[2569]: E0525 11:19:44.134670    2569 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 20s restarting failed container=console-operator pod=console-operator-76dff48d59-cvhbj_openshift-console-operator(9ff9f77a-ac83-4250-8c40-d14a2db84c1e)\"" pod="openshift-console-operator/console-operator-76dff48d59-cvhbj" podUID="9ff9f77a-ac83-4250-8c40-d14a2db84c1e"
May 25 11:19:45.137527 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:19:45.137498    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-cvhbj_9ff9f77a-ac83-4250-8c40-d14a2db84c1e/console-operator/2.log"
May 25 11:19:50.320359 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:19:50.320322    2569 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-cc2gk"]
May 25 11:19:50.324765 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:19:50.324741    2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-cc2gk"
May 25 11:19:50.327629 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:19:50.327605    2569 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-rgvrv\""
May 25 11:19:50.328624 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:19:50.328604    2569 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
May 25 11:19:50.328727 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:19:50.328611    2569 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
May 25 11:19:50.337959 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:19:50.337938    2569 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-cc2gk"]
May 25 11:19:50.401127 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:19:50.401034    2569 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-d4d8f94f9-gkfsm"]
May 25 11:19:50.404565 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:19:50.404548    2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-d4d8f94f9-gkfsm"
May 25 11:19:50.416667 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:19:50.416651    2569 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\""
May 25 11:19:50.416742 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:19:50.416693    2569 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-m54sm\""
May 25 11:19:50.416879 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:19:50.416862    2569 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\""
May 25 11:19:50.428181 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:19:50.428156    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/5fbcbf92-e3f3-4a12-b7db-2c1e8fc9cbac-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-cc2gk\" (UID: \"5fbcbf92-e3f3-4a12-b7db-2c1e8fc9cbac\") " pod="openshift-insights/insights-runtime-extractor-cc2gk"
May 25 11:19:50.428280 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:19:50.428197    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/5fbcbf92-e3f3-4a12-b7db-2c1e8fc9cbac-crio-socket\") pod \"insights-runtime-extractor-cc2gk\" (UID: \"5fbcbf92-e3f3-4a12-b7db-2c1e8fc9cbac\") " pod="openshift-insights/insights-runtime-extractor-cc2gk"
May 25 11:19:50.428280 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:19:50.428244    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d5rlz\" (UniqueName: \"kubernetes.io/projected/5fbcbf92-e3f3-4a12-b7db-2c1e8fc9cbac-kube-api-access-d5rlz\") pod \"insights-runtime-extractor-cc2gk\" (UID: \"5fbcbf92-e3f3-4a12-b7db-2c1e8fc9cbac\") " pod="openshift-insights/insights-runtime-extractor-cc2gk"
May 25 11:19:50.428280 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:19:50.428270    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/5fbcbf92-e3f3-4a12-b7db-2c1e8fc9cbac-data-volume\") pod \"insights-runtime-extractor-cc2gk\" (UID: \"5fbcbf92-e3f3-4a12-b7db-2c1e8fc9cbac\") " pod="openshift-insights/insights-runtime-extractor-cc2gk"
May 25 11:19:50.428397 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:19:50.428288    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/5fbcbf92-e3f3-4a12-b7db-2c1e8fc9cbac-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-cc2gk\" (UID: \"5fbcbf92-e3f3-4a12-b7db-2c1e8fc9cbac\") " pod="openshift-insights/insights-runtime-extractor-cc2gk"
May 25 11:19:50.446560 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:19:50.446536    2569 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-d4d8f94f9-gkfsm"]
May 25 11:19:50.528780 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:19:50.528754    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/5fbcbf92-e3f3-4a12-b7db-2c1e8fc9cbac-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-cc2gk\" (UID: \"5fbcbf92-e3f3-4a12-b7db-2c1e8fc9cbac\") " pod="openshift-insights/insights-runtime-extractor-cc2gk"
May 25 11:19:50.528922 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:19:50.528805    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/d7d63093-61fa-4aba-9243-0a5da6e67128-nginx-conf\") pod \"networking-console-plugin-d4d8f94f9-gkfsm\" (UID: \"d7d63093-61fa-4aba-9243-0a5da6e67128\") " pod="openshift-network-console/networking-console-plugin-d4d8f94f9-gkfsm"
May 25 11:19:50.528922 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:19:50.528853    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/5fbcbf92-e3f3-4a12-b7db-2c1e8fc9cbac-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-cc2gk\" (UID: \"5fbcbf92-e3f3-4a12-b7db-2c1e8fc9cbac\") " pod="openshift-insights/insights-runtime-extractor-cc2gk"
May 25 11:19:50.528922 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:19:50.528905    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/5fbcbf92-e3f3-4a12-b7db-2c1e8fc9cbac-crio-socket\") pod \"insights-runtime-extractor-cc2gk\" (UID: \"5fbcbf92-e3f3-4a12-b7db-2c1e8fc9cbac\") " pod="openshift-insights/insights-runtime-extractor-cc2gk"
May 25 11:19:50.529042 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:19:50.528964    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/5fbcbf92-e3f3-4a12-b7db-2c1e8fc9cbac-crio-socket\") pod \"insights-runtime-extractor-cc2gk\" (UID: \"5fbcbf92-e3f3-4a12-b7db-2c1e8fc9cbac\") " pod="openshift-insights/insights-runtime-extractor-cc2gk"
May 25 11:19:50.529042 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:19:50.528964    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/d7d63093-61fa-4aba-9243-0a5da6e67128-networking-console-plugin-cert\") pod \"networking-console-plugin-d4d8f94f9-gkfsm\" (UID: \"d7d63093-61fa-4aba-9243-0a5da6e67128\") " pod="openshift-network-console/networking-console-plugin-d4d8f94f9-gkfsm"
May 25 11:19:50.529042 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:19:50.529013    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-d5rlz\" (UniqueName: \"kubernetes.io/projected/5fbcbf92-e3f3-4a12-b7db-2c1e8fc9cbac-kube-api-access-d5rlz\") pod \"insights-runtime-extractor-cc2gk\" (UID: \"5fbcbf92-e3f3-4a12-b7db-2c1e8fc9cbac\") " pod="openshift-insights/insights-runtime-extractor-cc2gk"
May 25 11:19:50.529137 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:19:50.529062    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/5fbcbf92-e3f3-4a12-b7db-2c1e8fc9cbac-data-volume\") pod \"insights-runtime-extractor-cc2gk\" (UID: \"5fbcbf92-e3f3-4a12-b7db-2c1e8fc9cbac\") " pod="openshift-insights/insights-runtime-extractor-cc2gk"
May 25 11:19:50.529355 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:19:50.529330    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/5fbcbf92-e3f3-4a12-b7db-2c1e8fc9cbac-data-volume\") pod \"insights-runtime-extractor-cc2gk\" (UID: \"5fbcbf92-e3f3-4a12-b7db-2c1e8fc9cbac\") " pod="openshift-insights/insights-runtime-extractor-cc2gk"
May 25 11:19:50.529424 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:19:50.529378    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/5fbcbf92-e3f3-4a12-b7db-2c1e8fc9cbac-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-cc2gk\" (UID: \"5fbcbf92-e3f3-4a12-b7db-2c1e8fc9cbac\") " pod="openshift-insights/insights-runtime-extractor-cc2gk"
May 25 11:19:50.531142 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:19:50.531120    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/5fbcbf92-e3f3-4a12-b7db-2c1e8fc9cbac-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-cc2gk\" (UID: \"5fbcbf92-e3f3-4a12-b7db-2c1e8fc9cbac\") " pod="openshift-insights/insights-runtime-extractor-cc2gk"
May 25 11:19:50.556463 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:19:50.556439    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-d5rlz\" (UniqueName: \"kubernetes.io/projected/5fbcbf92-e3f3-4a12-b7db-2c1e8fc9cbac-kube-api-access-d5rlz\") pod \"insights-runtime-extractor-cc2gk\" (UID: \"5fbcbf92-e3f3-4a12-b7db-2c1e8fc9cbac\") " pod="openshift-insights/insights-runtime-extractor-cc2gk"
May 25 11:19:50.629817 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:19:50.629744    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/d7d63093-61fa-4aba-9243-0a5da6e67128-nginx-conf\") pod \"networking-console-plugin-d4d8f94f9-gkfsm\" (UID: \"d7d63093-61fa-4aba-9243-0a5da6e67128\") " pod="openshift-network-console/networking-console-plugin-d4d8f94f9-gkfsm"
May 25 11:19:50.629907 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:19:50.629837    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/d7d63093-61fa-4aba-9243-0a5da6e67128-networking-console-plugin-cert\") pod \"networking-console-plugin-d4d8f94f9-gkfsm\" (UID: \"d7d63093-61fa-4aba-9243-0a5da6e67128\") " pod="openshift-network-console/networking-console-plugin-d4d8f94f9-gkfsm"
May 25 11:19:50.630302 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:19:50.630273    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/d7d63093-61fa-4aba-9243-0a5da6e67128-nginx-conf\") pod \"networking-console-plugin-d4d8f94f9-gkfsm\" (UID: \"d7d63093-61fa-4aba-9243-0a5da6e67128\") " pod="openshift-network-console/networking-console-plugin-d4d8f94f9-gkfsm"
May 25 11:19:50.632054 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:19:50.632034    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/d7d63093-61fa-4aba-9243-0a5da6e67128-networking-console-plugin-cert\") pod \"networking-console-plugin-d4d8f94f9-gkfsm\" (UID: \"d7d63093-61fa-4aba-9243-0a5da6e67128\") " pod="openshift-network-console/networking-console-plugin-d4d8f94f9-gkfsm"
May 25 11:19:50.634847 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:19:50.634829    2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-cc2gk"
May 25 11:19:50.713057 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:19:50.713032    2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-d4d8f94f9-gkfsm"
May 25 11:19:50.760854 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:19:50.760811    2569 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-cc2gk"]
May 25 11:19:50.763027 ip-10-0-143-46 kubenswrapper[2569]: W0525 11:19:50.762994    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5fbcbf92_e3f3_4a12_b7db_2c1e8fc9cbac.slice/crio-1acafcbddd6f8b49f3ecd250691c2aa09c4fbe9c0af321ed22eddeb38f8c07a2 WatchSource:0}: Error finding container 1acafcbddd6f8b49f3ecd250691c2aa09c4fbe9c0af321ed22eddeb38f8c07a2: Status 404 returned error can't find the container with id 1acafcbddd6f8b49f3ecd250691c2aa09c4fbe9c0af321ed22eddeb38f8c07a2
May 25 11:19:50.837759 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:19:50.837730    2569 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-d4d8f94f9-gkfsm"]
May 25 11:19:50.841187 ip-10-0-143-46 kubenswrapper[2569]: W0525 11:19:50.841156    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd7d63093_61fa_4aba_9243_0a5da6e67128.slice/crio-a376f0dc701b8397de712c044339335db0be578cdfdc9e6a1f0782774fca4e59 WatchSource:0}: Error finding container a376f0dc701b8397de712c044339335db0be578cdfdc9e6a1f0782774fca4e59: Status 404 returned error can't find the container with id a376f0dc701b8397de712c044339335db0be578cdfdc9e6a1f0782774fca4e59
May 25 11:19:51.151800 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:19:51.151759    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-cc2gk" event={"ID":"5fbcbf92-e3f3-4a12-b7db-2c1e8fc9cbac","Type":"ContainerStarted","Data":"b824b3940c27ecf65834aad865752f2261edbe9183ec74c8240cd984c39afcf2"}
May 25 11:19:51.151933 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:19:51.151814    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-cc2gk" event={"ID":"5fbcbf92-e3f3-4a12-b7db-2c1e8fc9cbac","Type":"ContainerStarted","Data":"1acafcbddd6f8b49f3ecd250691c2aa09c4fbe9c0af321ed22eddeb38f8c07a2"}
May 25 11:19:51.152691 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:19:51.152664    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-d4d8f94f9-gkfsm" event={"ID":"d7d63093-61fa-4aba-9243-0a5da6e67128","Type":"ContainerStarted","Data":"a376f0dc701b8397de712c044339335db0be578cdfdc9e6a1f0782774fca4e59"}
May 25 11:19:51.436345 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:19:51.436266    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9098669d-fa99-44c7-94ad-4e3560412654-metrics-certs\") pod \"network-metrics-daemon-pd47q\" (UID: \"9098669d-fa99-44c7-94ad-4e3560412654\") " pod="openshift-multus/network-metrics-daemon-pd47q"
May 25 11:19:51.438614 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:19:51.438586    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9098669d-fa99-44c7-94ad-4e3560412654-metrics-certs\") pod \"network-metrics-daemon-pd47q\" (UID: \"9098669d-fa99-44c7-94ad-4e3560412654\") " pod="openshift-multus/network-metrics-daemon-pd47q"
May 25 11:19:51.448173 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:19:51.448150    2569 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-bl7fp\""
May 25 11:19:51.456523 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:19:51.456495    2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pd47q"
May 25 11:19:51.600820 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:19:51.600756    2569 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-pd47q"]
May 25 11:19:51.605355 ip-10-0-143-46 kubenswrapper[2569]: W0525 11:19:51.605007    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9098669d_fa99_44c7_94ad_4e3560412654.slice/crio-819d47d7117f152ea59cc13df64da7a4836e202e441e35b862d7de45a6739312 WatchSource:0}: Error finding container 819d47d7117f152ea59cc13df64da7a4836e202e441e35b862d7de45a6739312: Status 404 returned error can't find the container with id 819d47d7117f152ea59cc13df64da7a4836e202e441e35b862d7de45a6739312
May 25 11:19:52.158344 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:19:52.158297    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-cc2gk" event={"ID":"5fbcbf92-e3f3-4a12-b7db-2c1e8fc9cbac","Type":"ContainerStarted","Data":"594eb7c7ba6276991f99b09e5ee4d87f08baaf2f32991464b246c58f8a433339"}
May 25 11:19:52.160323 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:19:52.160296    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-d4d8f94f9-gkfsm" event={"ID":"d7d63093-61fa-4aba-9243-0a5da6e67128","Type":"ContainerStarted","Data":"89ca7dc45993b67daacaafdfe1cff138ce5c0c6640dc09b038c78c3302f9d980"}
May 25 11:19:52.162184 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:19:52.162160    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-pd47q" event={"ID":"9098669d-fa99-44c7-94ad-4e3560412654","Type":"ContainerStarted","Data":"819d47d7117f152ea59cc13df64da7a4836e202e441e35b862d7de45a6739312"}
May 25 11:19:52.180619 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:19:52.180575    2569 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-console/networking-console-plugin-d4d8f94f9-gkfsm" podStartSLOduration=1.003648288 podStartE2EDuration="2.180562573s" podCreationTimestamp="2026-05-25 11:19:50 +0000 UTC" firstStartedPulling="2026-05-25 11:19:50.845189121 +0000 UTC m=+129.706813492" lastFinishedPulling="2026-05-25 11:19:52.022103415 +0000 UTC m=+130.883727777" observedRunningTime="2026-05-25 11:19:52.178917583 +0000 UTC m=+131.040541993" watchObservedRunningTime="2026-05-25 11:19:52.180562573 +0000 UTC m=+131.042186957"
May 25 11:19:52.406323 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:19:52.406263    2569 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-76dff48d59-cvhbj"
May 25 11:19:52.406323 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:19:52.406314    2569 kubelet.go:2658] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-76dff48d59-cvhbj"
May 25 11:19:52.406756 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:19:52.406730    2569 scope.go:117] "RemoveContainer" containerID="838e4303306651f1756e3a876aeefc4d9337bbfd80de93ba14b8174159aae3e9"
May 25 11:19:52.407016 ip-10-0-143-46 kubenswrapper[2569]: E0525 11:19:52.406991    2569 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 20s restarting failed container=console-operator pod=console-operator-76dff48d59-cvhbj_openshift-console-operator(9ff9f77a-ac83-4250-8c40-d14a2db84c1e)\"" pod="openshift-console-operator/console-operator-76dff48d59-cvhbj" podUID="9ff9f77a-ac83-4250-8c40-d14a2db84c1e"
May 25 11:19:53.758347 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:19:53.758313    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/d3b548de-36b2-48d6-b8f6-d35134a661af-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6c75959455-98ftr\" (UID: \"d3b548de-36b2-48d6-b8f6-d35134a661af\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-98ftr"
May 25 11:19:53.760639 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:19:53.760617    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/d3b548de-36b2-48d6-b8f6-d35134a661af-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6c75959455-98ftr\" (UID: \"d3b548de-36b2-48d6-b8f6-d35134a661af\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-98ftr"
May 25 11:19:53.786605 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:19:53.786580    2569 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-4qlwd\""
May 25 11:19:53.794667 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:19:53.794643    2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-98ftr"
May 25 11:19:53.916344 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:19:53.916317    2569 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-6c75959455-98ftr"]
May 25 11:19:53.918565 ip-10-0-143-46 kubenswrapper[2569]: W0525 11:19:53.918538    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd3b548de_36b2_48d6_b8f6_d35134a661af.slice/crio-3226b0d0e78c112ef9d3506b21a322fca7d24a67b4c3eea66942b305e9665dcf WatchSource:0}: Error finding container 3226b0d0e78c112ef9d3506b21a322fca7d24a67b4c3eea66942b305e9665dcf: Status 404 returned error can't find the container with id 3226b0d0e78c112ef9d3506b21a322fca7d24a67b4c3eea66942b305e9665dcf
May 25 11:19:54.171536 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:19:54.171500    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-pd47q" event={"ID":"9098669d-fa99-44c7-94ad-4e3560412654","Type":"ContainerStarted","Data":"a47edb5d8c486bd9c5702ba197b73a235da99f04688f9320f002a32cd928865f"}
May 25 11:19:54.171536 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:19:54.171540    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-pd47q" event={"ID":"9098669d-fa99-44c7-94ad-4e3560412654","Type":"ContainerStarted","Data":"d546ceaecc00835df1ec0951d1d216e2f151318ee848733b0d2c80a102a95cf1"}
May 25 11:19:54.172532 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:19:54.172507    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-98ftr" event={"ID":"d3b548de-36b2-48d6-b8f6-d35134a661af","Type":"ContainerStarted","Data":"3226b0d0e78c112ef9d3506b21a322fca7d24a67b4c3eea66942b305e9665dcf"}
May 25 11:19:54.174063 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:19:54.174043    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-cc2gk" event={"ID":"5fbcbf92-e3f3-4a12-b7db-2c1e8fc9cbac","Type":"ContainerStarted","Data":"944cf88607d4e607883b6b7d6acc8fd0b9aa25c5724632a84714f55a098bdabf"}
May 25 11:19:54.190698 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:19:54.190653    2569 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-pd47q" podStartSLOduration=131.65442411 podStartE2EDuration="2m13.190640228s" podCreationTimestamp="2026-05-25 11:17:41 +0000 UTC" firstStartedPulling="2026-05-25 11:19:51.60693771 +0000 UTC m=+130.468562081" lastFinishedPulling="2026-05-25 11:19:53.143153837 +0000 UTC m=+132.004778199" observedRunningTime="2026-05-25 11:19:54.190081783 +0000 UTC m=+133.051706166" watchObservedRunningTime="2026-05-25 11:19:54.190640228 +0000 UTC m=+133.052264612"
May 25 11:19:54.209354 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:19:54.209316    2569 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-cc2gk" podStartSLOduration=1.880920196 podStartE2EDuration="4.209305432s" podCreationTimestamp="2026-05-25 11:19:50 +0000 UTC" firstStartedPulling="2026-05-25 11:19:50.817935671 +0000 UTC m=+129.679560035" lastFinishedPulling="2026-05-25 11:19:53.146320905 +0000 UTC m=+132.007945271" observedRunningTime="2026-05-25 11:19:54.208350325 +0000 UTC m=+133.069974710" watchObservedRunningTime="2026-05-25 11:19:54.209305432 +0000 UTC m=+133.070929816"
May 25 11:19:56.004438 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:19:56.004370    2569 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-d59kr"]
May 25 11:19:56.011362 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:19:56.011337    2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-d59kr"
May 25 11:19:56.014350 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:19:56.014327    2569 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-64hht\""
May 25 11:19:56.014513 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:19:56.014329    2569 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\""
May 25 11:19:56.014702 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:19:56.014682    2569 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-d59kr"]
May 25 11:19:56.177075 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:19:56.177033    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/176c28f9-9945-4f69-9c84-7fcef32f9c18-tls-certificates\") pod \"prometheus-operator-admission-webhook-6c4bbc67b7-d59kr\" (UID: \"176c28f9-9945-4f69-9c84-7fcef32f9c18\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-d59kr"
May 25 11:19:56.181236 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:19:56.181204    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-98ftr" event={"ID":"d3b548de-36b2-48d6-b8f6-d35134a661af","Type":"ContainerStarted","Data":"c6cca9b297714fa8dddfc63be3232ef3e822e1c701fdd34a66838f5edcac522e"}
May 25 11:19:56.196797 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:19:56.196745    2569 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-98ftr" podStartSLOduration=33.582258875 podStartE2EDuration="35.196729287s" podCreationTimestamp="2026-05-25 11:19:21 +0000 UTC" firstStartedPulling="2026-05-25 11:19:53.920309575 +0000 UTC m=+132.781933937" lastFinishedPulling="2026-05-25 11:19:55.534779987 +0000 UTC m=+134.396404349" observedRunningTime="2026-05-25 11:19:56.195700868 +0000 UTC m=+135.057325254" watchObservedRunningTime="2026-05-25 11:19:56.196729287 +0000 UTC m=+135.058353676"
May 25 11:19:56.278430 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:19:56.278377    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/176c28f9-9945-4f69-9c84-7fcef32f9c18-tls-certificates\") pod \"prometheus-operator-admission-webhook-6c4bbc67b7-d59kr\" (UID: \"176c28f9-9945-4f69-9c84-7fcef32f9c18\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-d59kr"
May 25 11:19:56.278506 ip-10-0-143-46 kubenswrapper[2569]: E0525 11:19:56.278496    2569 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-admission-webhook-tls: secret "prometheus-operator-admission-webhook-tls" not found
May 25 11:19:56.278555 ip-10-0-143-46 kubenswrapper[2569]: E0525 11:19:56.278545    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/176c28f9-9945-4f69-9c84-7fcef32f9c18-tls-certificates podName:176c28f9-9945-4f69-9c84-7fcef32f9c18 nodeName:}" failed. No retries permitted until 2026-05-25 11:19:56.778531148 +0000 UTC m=+135.640155509 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certificates" (UniqueName: "kubernetes.io/secret/176c28f9-9945-4f69-9c84-7fcef32f9c18-tls-certificates") pod "prometheus-operator-admission-webhook-6c4bbc67b7-d59kr" (UID: "176c28f9-9945-4f69-9c84-7fcef32f9c18") : secret "prometheus-operator-admission-webhook-tls" not found
May 25 11:19:56.782960 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:19:56.782931    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/176c28f9-9945-4f69-9c84-7fcef32f9c18-tls-certificates\") pod \"prometheus-operator-admission-webhook-6c4bbc67b7-d59kr\" (UID: \"176c28f9-9945-4f69-9c84-7fcef32f9c18\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-d59kr"
May 25 11:19:56.785213 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:19:56.785186    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/176c28f9-9945-4f69-9c84-7fcef32f9c18-tls-certificates\") pod \"prometheus-operator-admission-webhook-6c4bbc67b7-d59kr\" (UID: \"176c28f9-9945-4f69-9c84-7fcef32f9c18\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-d59kr"
May 25 11:19:56.921470 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:19:56.921436    2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-d59kr"
May 25 11:19:57.046962 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:19:57.046898    2569 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-d59kr"]
May 25 11:19:57.049868 ip-10-0-143-46 kubenswrapper[2569]: W0525 11:19:57.049842    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod176c28f9_9945_4f69_9c84_7fcef32f9c18.slice/crio-7af1abf9c0e17a0a404cbace7d4c457078702b57669da86f75e0d32efef0aae8 WatchSource:0}: Error finding container 7af1abf9c0e17a0a404cbace7d4c457078702b57669da86f75e0d32efef0aae8: Status 404 returned error can't find the container with id 7af1abf9c0e17a0a404cbace7d4c457078702b57669da86f75e0d32efef0aae8
May 25 11:19:57.185561 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:19:57.185526    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-d59kr" event={"ID":"176c28f9-9945-4f69-9c84-7fcef32f9c18","Type":"ContainerStarted","Data":"7af1abf9c0e17a0a404cbace7d4c457078702b57669da86f75e0d32efef0aae8"}
May 25 11:19:58.189391 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:19:58.189356    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-d59kr" event={"ID":"176c28f9-9945-4f69-9c84-7fcef32f9c18","Type":"ContainerStarted","Data":"557401b6ff5aa350f29144e1e849c314621b946f5246badaa45a0e6322175708"}
May 25 11:19:58.189759 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:19:58.189555    2569 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-d59kr"
May 25 11:19:58.194104 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:19:58.194082    2569 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-d59kr"
May 25 11:19:58.211085 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:19:58.211045    2569 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-d59kr" podStartSLOduration=2.235713576 podStartE2EDuration="3.211032376s" podCreationTimestamp="2026-05-25 11:19:55 +0000 UTC" firstStartedPulling="2026-05-25 11:19:57.051658773 +0000 UTC m=+135.913283135" lastFinishedPulling="2026-05-25 11:19:58.026977573 +0000 UTC m=+136.888601935" observedRunningTime="2026-05-25 11:19:58.210109742 +0000 UTC m=+137.071734128" watchObservedRunningTime="2026-05-25 11:19:58.211032376 +0000 UTC m=+137.072656760"
May 25 11:19:59.091942 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:19:59.091907    2569 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-7779bbdd78-5mztr"]
May 25 11:19:59.106238 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:19:59.106169    2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-7779bbdd78-5mztr"
May 25 11:19:59.107320 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:19:59.107295    2569 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-7779bbdd78-5mztr"]
May 25 11:19:59.109822 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:19:59.109767    2569 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\""
May 25 11:19:59.109926 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:19:59.109900    2569 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-t76v2\""
May 25 11:19:59.110940 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:19:59.110921    2569 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\""
May 25 11:19:59.110940 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:19:59.110941    2569 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
May 25 11:19:59.201626 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:19:59.201601    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c293e578-b120-4fcf-b794-c2d3f325a88d-metrics-client-ca\") pod \"prometheus-operator-7779bbdd78-5mztr\" (UID: \"c293e578-b120-4fcf-b794-c2d3f325a88d\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-5mztr"
May 25 11:19:59.202083 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:19:59.201650    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zdcsk\" (UniqueName: \"kubernetes.io/projected/c293e578-b120-4fcf-b794-c2d3f325a88d-kube-api-access-zdcsk\") pod \"prometheus-operator-7779bbdd78-5mztr\" (UID: \"c293e578-b120-4fcf-b794-c2d3f325a88d\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-5mztr"
May 25 11:19:59.202083 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:19:59.201769    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/c293e578-b120-4fcf-b794-c2d3f325a88d-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-7779bbdd78-5mztr\" (UID: \"c293e578-b120-4fcf-b794-c2d3f325a88d\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-5mztr"
May 25 11:19:59.202083 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:19:59.201836    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/c293e578-b120-4fcf-b794-c2d3f325a88d-prometheus-operator-tls\") pod \"prometheus-operator-7779bbdd78-5mztr\" (UID: \"c293e578-b120-4fcf-b794-c2d3f325a88d\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-5mztr"
May 25 11:19:59.302983 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:19:59.302948    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-zdcsk\" (UniqueName: \"kubernetes.io/projected/c293e578-b120-4fcf-b794-c2d3f325a88d-kube-api-access-zdcsk\") pod \"prometheus-operator-7779bbdd78-5mztr\" (UID: \"c293e578-b120-4fcf-b794-c2d3f325a88d\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-5mztr"
May 25 11:19:59.303131 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:19:59.303014    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/c293e578-b120-4fcf-b794-c2d3f325a88d-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-7779bbdd78-5mztr\" (UID: \"c293e578-b120-4fcf-b794-c2d3f325a88d\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-5mztr"
May 25 11:19:59.303190 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:19:59.303124    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/c293e578-b120-4fcf-b794-c2d3f325a88d-prometheus-operator-tls\") pod \"prometheus-operator-7779bbdd78-5mztr\" (UID: \"c293e578-b120-4fcf-b794-c2d3f325a88d\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-5mztr"
May 25 11:19:59.303190 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:19:59.303187    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c293e578-b120-4fcf-b794-c2d3f325a88d-metrics-client-ca\") pod \"prometheus-operator-7779bbdd78-5mztr\" (UID: \"c293e578-b120-4fcf-b794-c2d3f325a88d\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-5mztr"
May 25 11:19:59.303740 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:19:59.303721    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c293e578-b120-4fcf-b794-c2d3f325a88d-metrics-client-ca\") pod \"prometheus-operator-7779bbdd78-5mztr\" (UID: \"c293e578-b120-4fcf-b794-c2d3f325a88d\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-5mztr"
May 25 11:19:59.305345 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:19:59.305302    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/c293e578-b120-4fcf-b794-c2d3f325a88d-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-7779bbdd78-5mztr\" (UID: \"c293e578-b120-4fcf-b794-c2d3f325a88d\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-5mztr"
May 25 11:19:59.305431 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:19:59.305394    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/c293e578-b120-4fcf-b794-c2d3f325a88d-prometheus-operator-tls\") pod \"prometheus-operator-7779bbdd78-5mztr\" (UID: \"c293e578-b120-4fcf-b794-c2d3f325a88d\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-5mztr"
May 25 11:19:59.312895 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:19:59.312868    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zdcsk\" (UniqueName: \"kubernetes.io/projected/c293e578-b120-4fcf-b794-c2d3f325a88d-kube-api-access-zdcsk\") pod \"prometheus-operator-7779bbdd78-5mztr\" (UID: \"c293e578-b120-4fcf-b794-c2d3f325a88d\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-5mztr"
May 25 11:19:59.417184 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:19:59.417106    2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-7779bbdd78-5mztr"
May 25 11:19:59.538058 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:19:59.538029    2569 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-7779bbdd78-5mztr"]
May 25 11:19:59.540644 ip-10-0-143-46 kubenswrapper[2569]: W0525 11:19:59.540619    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc293e578_b120_4fcf_b794_c2d3f325a88d.slice/crio-3cdeedbf15233368b773a4b4c66d3cf4f59af68af029658a204085c9e0e7bf60 WatchSource:0}: Error finding container 3cdeedbf15233368b773a4b4c66d3cf4f59af68af029658a204085c9e0e7bf60: Status 404 returned error can't find the container with id 3cdeedbf15233368b773a4b4c66d3cf4f59af68af029658a204085c9e0e7bf60
May 25 11:20:00.196232 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:20:00.196193    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-7779bbdd78-5mztr" event={"ID":"c293e578-b120-4fcf-b794-c2d3f325a88d","Type":"ContainerStarted","Data":"3cdeedbf15233368b773a4b4c66d3cf4f59af68af029658a204085c9e0e7bf60"}
May 25 11:20:02.202899 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:20:02.202853    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-7779bbdd78-5mztr" event={"ID":"c293e578-b120-4fcf-b794-c2d3f325a88d","Type":"ContainerStarted","Data":"dcbc15cf88377abe8d41412c66191f3a001388e68fdd06863b03e350be76c588"}
May 25 11:20:02.202899 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:20:02.202900    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-7779bbdd78-5mztr" event={"ID":"c293e578-b120-4fcf-b794-c2d3f325a88d","Type":"ContainerStarted","Data":"67b024161b894e070e6ab177c454738fc10afc339f9d5727586ade21da3e832f"}
May 25 11:20:02.220911 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:20:02.220871    2569 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-7779bbdd78-5mztr" podStartSLOduration=1.613577593 podStartE2EDuration="3.220857197s" podCreationTimestamp="2026-05-25 11:19:59 +0000 UTC" firstStartedPulling="2026-05-25 11:19:59.542342651 +0000 UTC m=+138.403967012" lastFinishedPulling="2026-05-25 11:20:01.149622242 +0000 UTC m=+140.011246616" observedRunningTime="2026-05-25 11:20:02.219831493 +0000 UTC m=+141.081455879" watchObservedRunningTime="2026-05-25 11:20:02.220857197 +0000 UTC m=+141.082481579"
May 25 11:20:03.729558 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:20:03.729530    2569 scope.go:117] "RemoveContainer" containerID="838e4303306651f1756e3a876aeefc4d9337bbfd80de93ba14b8174159aae3e9"
May 25 11:20:03.729943 ip-10-0-143-46 kubenswrapper[2569]: E0525 11:20:03.729712    2569 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 20s restarting failed container=console-operator pod=console-operator-76dff48d59-cvhbj_openshift-console-operator(9ff9f77a-ac83-4250-8c40-d14a2db84c1e)\"" pod="openshift-console-operator/console-operator-76dff48d59-cvhbj" podUID="9ff9f77a-ac83-4250-8c40-d14a2db84c1e"
May 25 11:20:04.446290 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:20:04.446258    2569 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-54fd6bc5c4-94hs5"]
May 25 11:20:04.448962 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:20:04.448946    2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-94hs5"
May 25 11:20:04.451888 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:20:04.451859    2569 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\""
May 25 11:20:04.453605 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:20:04.453582    2569 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\""
May 25 11:20:04.454735 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:20:04.454714    2569 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-s5rl2\""
May 25 11:20:04.455824 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:20:04.455802    2569 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\""
May 25 11:20:04.502682 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:20:04.502650    2569 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-ts85m"]
May 25 11:20:04.505543 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:20:04.505523    2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-ts85m"
May 25 11:20:04.508399 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:20:04.508383    2569 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
May 25 11:20:04.508520 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:20:04.508498    2569 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
May 25 11:20:04.508614 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:20:04.508409    2569 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-jfmc7\""
May 25 11:20:04.509064 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:20:04.509049    2569 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
May 25 11:20:04.516457 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:20:04.516437    2569 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-54fd6bc5c4-94hs5"]
May 25 11:20:04.544680 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:20:04.544660    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/6973719b-4aa7-46c2-bff7-b54006c9ffa8-kube-state-metrics-tls\") pod \"kube-state-metrics-54fd6bc5c4-94hs5\" (UID: \"6973719b-4aa7-46c2-bff7-b54006c9ffa8\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-94hs5"
May 25 11:20:04.544777 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:20:04.544689    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6973719b-4aa7-46c2-bff7-b54006c9ffa8-metrics-client-ca\") pod \"kube-state-metrics-54fd6bc5c4-94hs5\" (UID: \"6973719b-4aa7-46c2-bff7-b54006c9ffa8\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-94hs5"
May 25 11:20:04.544777 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:20:04.544710    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/6973719b-4aa7-46c2-bff7-b54006c9ffa8-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-54fd6bc5c4-94hs5\" (UID: \"6973719b-4aa7-46c2-bff7-b54006c9ffa8\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-94hs5"
May 25 11:20:04.544914 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:20:04.544827    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/6973719b-4aa7-46c2-bff7-b54006c9ffa8-volume-directive-shadow\") pod \"kube-state-metrics-54fd6bc5c4-94hs5\" (UID: \"6973719b-4aa7-46c2-bff7-b54006c9ffa8\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-94hs5"
May 25 11:20:04.544914 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:20:04.544878    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/6973719b-4aa7-46c2-bff7-b54006c9ffa8-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-54fd6bc5c4-94hs5\" (UID: \"6973719b-4aa7-46c2-bff7-b54006c9ffa8\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-94hs5"
May 25 11:20:04.545010 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:20:04.544937    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4cx22\" (UniqueName: \"kubernetes.io/projected/6973719b-4aa7-46c2-bff7-b54006c9ffa8-kube-api-access-4cx22\") pod \"kube-state-metrics-54fd6bc5c4-94hs5\" (UID: \"6973719b-4aa7-46c2-bff7-b54006c9ffa8\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-94hs5"
May 25 11:20:04.646173 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:20:04.646143    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/c06afa60-0531-46fc-87c8-1da08c1379a4-node-exporter-accelerators-collector-config\") pod \"node-exporter-ts85m\" (UID: \"c06afa60-0531-46fc-87c8-1da08c1379a4\") " pod="openshift-monitoring/node-exporter-ts85m"
May 25 11:20:04.646299 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:20:04.646189    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/6973719b-4aa7-46c2-bff7-b54006c9ffa8-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-54fd6bc5c4-94hs5\" (UID: \"6973719b-4aa7-46c2-bff7-b54006c9ffa8\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-94hs5"
May 25 11:20:04.646299 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:20:04.646263    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c06afa60-0531-46fc-87c8-1da08c1379a4-sys\") pod \"node-exporter-ts85m\" (UID: \"c06afa60-0531-46fc-87c8-1da08c1379a4\") " pod="openshift-monitoring/node-exporter-ts85m"
May 25 11:20:04.646414 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:20:04.646325    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jtnd4\" (UniqueName: \"kubernetes.io/projected/c06afa60-0531-46fc-87c8-1da08c1379a4-kube-api-access-jtnd4\") pod \"node-exporter-ts85m\" (UID: \"c06afa60-0531-46fc-87c8-1da08c1379a4\") " pod="openshift-monitoring/node-exporter-ts85m"
May 25 11:20:04.646414 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:20:04.646358    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/6973719b-4aa7-46c2-bff7-b54006c9ffa8-volume-directive-shadow\") pod \"kube-state-metrics-54fd6bc5c4-94hs5\" (UID: \"6973719b-4aa7-46c2-bff7-b54006c9ffa8\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-94hs5"
May 25 11:20:04.646414 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:20:04.646398    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/c06afa60-0531-46fc-87c8-1da08c1379a4-node-exporter-textfile\") pod \"node-exporter-ts85m\" (UID: \"c06afa60-0531-46fc-87c8-1da08c1379a4\") " pod="openshift-monitoring/node-exporter-ts85m"
May 25 11:20:04.646565 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:20:04.646423    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/c06afa60-0531-46fc-87c8-1da08c1379a4-node-exporter-tls\") pod \"node-exporter-ts85m\" (UID: \"c06afa60-0531-46fc-87c8-1da08c1379a4\") " pod="openshift-monitoring/node-exporter-ts85m"
May 25 11:20:04.646565 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:20:04.646477    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/6973719b-4aa7-46c2-bff7-b54006c9ffa8-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-54fd6bc5c4-94hs5\" (UID: \"6973719b-4aa7-46c2-bff7-b54006c9ffa8\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-94hs5"
May 25 11:20:04.646565 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:20:04.646538    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/c06afa60-0531-46fc-87c8-1da08c1379a4-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-ts85m\" (UID: \"c06afa60-0531-46fc-87c8-1da08c1379a4\") " pod="openshift-monitoring/node-exporter-ts85m"
May 25 11:20:04.646708 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:20:04.646566    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c06afa60-0531-46fc-87c8-1da08c1379a4-metrics-client-ca\") pod \"node-exporter-ts85m\" (UID: \"c06afa60-0531-46fc-87c8-1da08c1379a4\") " pod="openshift-monitoring/node-exporter-ts85m"
May 25 11:20:04.646708 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:20:04.646599    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/c06afa60-0531-46fc-87c8-1da08c1379a4-node-exporter-wtmp\") pod \"node-exporter-ts85m\" (UID: \"c06afa60-0531-46fc-87c8-1da08c1379a4\") " pod="openshift-monitoring/node-exporter-ts85m"
May 25 11:20:04.646708 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:20:04.646641    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-4cx22\" (UniqueName: \"kubernetes.io/projected/6973719b-4aa7-46c2-bff7-b54006c9ffa8-kube-api-access-4cx22\") pod \"kube-state-metrics-54fd6bc5c4-94hs5\" (UID: \"6973719b-4aa7-46c2-bff7-b54006c9ffa8\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-94hs5"
May 25 11:20:04.646708 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:20:04.646686    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/c06afa60-0531-46fc-87c8-1da08c1379a4-root\") pod \"node-exporter-ts85m\" (UID: \"c06afa60-0531-46fc-87c8-1da08c1379a4\") " pod="openshift-monitoring/node-exporter-ts85m"
May 25 11:20:04.646928 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:20:04.646721    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/6973719b-4aa7-46c2-bff7-b54006c9ffa8-kube-state-metrics-tls\") pod \"kube-state-metrics-54fd6bc5c4-94hs5\" (UID: \"6973719b-4aa7-46c2-bff7-b54006c9ffa8\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-94hs5"
May 25 11:20:04.646928 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:20:04.646751    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6973719b-4aa7-46c2-bff7-b54006c9ffa8-metrics-client-ca\") pod \"kube-state-metrics-54fd6bc5c4-94hs5\" (UID: \"6973719b-4aa7-46c2-bff7-b54006c9ffa8\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-94hs5"
May 25 11:20:04.647218 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:20:04.647194    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/6973719b-4aa7-46c2-bff7-b54006c9ffa8-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-54fd6bc5c4-94hs5\" (UID: \"6973719b-4aa7-46c2-bff7-b54006c9ffa8\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-94hs5"
May 25 11:20:04.647400 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:20:04.647375    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6973719b-4aa7-46c2-bff7-b54006c9ffa8-metrics-client-ca\") pod \"kube-state-metrics-54fd6bc5c4-94hs5\" (UID: \"6973719b-4aa7-46c2-bff7-b54006c9ffa8\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-94hs5"
May 25 11:20:04.647561 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:20:04.647535    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/6973719b-4aa7-46c2-bff7-b54006c9ffa8-volume-directive-shadow\") pod \"kube-state-metrics-54fd6bc5c4-94hs5\" (UID: \"6973719b-4aa7-46c2-bff7-b54006c9ffa8\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-94hs5"
May 25 11:20:04.648858 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:20:04.648842    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/6973719b-4aa7-46c2-bff7-b54006c9ffa8-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-54fd6bc5c4-94hs5\" (UID: \"6973719b-4aa7-46c2-bff7-b54006c9ffa8\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-94hs5"
May 25 11:20:04.649512 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:20:04.649495    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/6973719b-4aa7-46c2-bff7-b54006c9ffa8-kube-state-metrics-tls\") pod \"kube-state-metrics-54fd6bc5c4-94hs5\" (UID: \"6973719b-4aa7-46c2-bff7-b54006c9ffa8\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-94hs5"
May 25 11:20:04.656612 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:20:04.656587    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4cx22\" (UniqueName: \"kubernetes.io/projected/6973719b-4aa7-46c2-bff7-b54006c9ffa8-kube-api-access-4cx22\") pod \"kube-state-metrics-54fd6bc5c4-94hs5\" (UID: \"6973719b-4aa7-46c2-bff7-b54006c9ffa8\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-94hs5"
May 25 11:20:04.747991 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:20:04.747936    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/c06afa60-0531-46fc-87c8-1da08c1379a4-node-exporter-accelerators-collector-config\") pod \"node-exporter-ts85m\" (UID: \"c06afa60-0531-46fc-87c8-1da08c1379a4\") " pod="openshift-monitoring/node-exporter-ts85m"
May 25 11:20:04.747991 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:20:04.747981    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c06afa60-0531-46fc-87c8-1da08c1379a4-sys\") pod \"node-exporter-ts85m\" (UID: \"c06afa60-0531-46fc-87c8-1da08c1379a4\") " pod="openshift-monitoring/node-exporter-ts85m"
May 25 11:20:04.748389 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:20:04.748025    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-jtnd4\" (UniqueName: \"kubernetes.io/projected/c06afa60-0531-46fc-87c8-1da08c1379a4-kube-api-access-jtnd4\") pod \"node-exporter-ts85m\" (UID: \"c06afa60-0531-46fc-87c8-1da08c1379a4\") " pod="openshift-monitoring/node-exporter-ts85m"
May 25 11:20:04.748389 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:20:04.748062    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/c06afa60-0531-46fc-87c8-1da08c1379a4-node-exporter-textfile\") pod \"node-exporter-ts85m\" (UID: \"c06afa60-0531-46fc-87c8-1da08c1379a4\") " pod="openshift-monitoring/node-exporter-ts85m"
May 25 11:20:04.748389 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:20:04.748087    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/c06afa60-0531-46fc-87c8-1da08c1379a4-node-exporter-tls\") pod \"node-exporter-ts85m\" (UID: \"c06afa60-0531-46fc-87c8-1da08c1379a4\") " pod="openshift-monitoring/node-exporter-ts85m"
May 25 11:20:04.748389 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:20:04.748106    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c06afa60-0531-46fc-87c8-1da08c1379a4-sys\") pod \"node-exporter-ts85m\" (UID: \"c06afa60-0531-46fc-87c8-1da08c1379a4\") " pod="openshift-monitoring/node-exporter-ts85m"
May 25 11:20:04.748389 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:20:04.748122    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/c06afa60-0531-46fc-87c8-1da08c1379a4-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-ts85m\" (UID: \"c06afa60-0531-46fc-87c8-1da08c1379a4\") " pod="openshift-monitoring/node-exporter-ts85m"
May 25 11:20:04.748389 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:20:04.748151    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c06afa60-0531-46fc-87c8-1da08c1379a4-metrics-client-ca\") pod \"node-exporter-ts85m\" (UID: \"c06afa60-0531-46fc-87c8-1da08c1379a4\") " pod="openshift-monitoring/node-exporter-ts85m"
May 25 11:20:04.748389 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:20:04.748183    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/c06afa60-0531-46fc-87c8-1da08c1379a4-node-exporter-wtmp\") pod \"node-exporter-ts85m\" (UID: \"c06afa60-0531-46fc-87c8-1da08c1379a4\") " pod="openshift-monitoring/node-exporter-ts85m"
May 25 11:20:04.748389 ip-10-0-143-46 kubenswrapper[2569]: E0525 11:20:04.748207    2569 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found
May 25 11:20:04.748389 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:20:04.748236    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/c06afa60-0531-46fc-87c8-1da08c1379a4-root\") pod \"node-exporter-ts85m\" (UID: \"c06afa60-0531-46fc-87c8-1da08c1379a4\") " pod="openshift-monitoring/node-exporter-ts85m"
May 25 11:20:04.748389 ip-10-0-143-46 kubenswrapper[2569]: E0525 11:20:04.748258    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c06afa60-0531-46fc-87c8-1da08c1379a4-node-exporter-tls podName:c06afa60-0531-46fc-87c8-1da08c1379a4 nodeName:}" failed. No retries permitted until 2026-05-25 11:20:05.248240623 +0000 UTC m=+144.109864991 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/c06afa60-0531-46fc-87c8-1da08c1379a4-node-exporter-tls") pod "node-exporter-ts85m" (UID: "c06afa60-0531-46fc-87c8-1da08c1379a4") : secret "node-exporter-tls" not found
May 25 11:20:04.748389 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:20:04.748283    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/c06afa60-0531-46fc-87c8-1da08c1379a4-root\") pod \"node-exporter-ts85m\" (UID: \"c06afa60-0531-46fc-87c8-1da08c1379a4\") " pod="openshift-monitoring/node-exporter-ts85m"
May 25 11:20:04.748389 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:20:04.748352    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/c06afa60-0531-46fc-87c8-1da08c1379a4-node-exporter-textfile\") pod \"node-exporter-ts85m\" (UID: \"c06afa60-0531-46fc-87c8-1da08c1379a4\") " pod="openshift-monitoring/node-exporter-ts85m"
May 25 11:20:04.748898 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:20:04.748496    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/c06afa60-0531-46fc-87c8-1da08c1379a4-node-exporter-wtmp\") pod \"node-exporter-ts85m\" (UID: \"c06afa60-0531-46fc-87c8-1da08c1379a4\") " pod="openshift-monitoring/node-exporter-ts85m"
May 25 11:20:04.748898 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:20:04.748511    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/c06afa60-0531-46fc-87c8-1da08c1379a4-node-exporter-accelerators-collector-config\") pod \"node-exporter-ts85m\" (UID: \"c06afa60-0531-46fc-87c8-1da08c1379a4\") " pod="openshift-monitoring/node-exporter-ts85m"
May 25 11:20:04.748898 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:20:04.748726    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c06afa60-0531-46fc-87c8-1da08c1379a4-metrics-client-ca\") pod \"node-exporter-ts85m\" (UID: \"c06afa60-0531-46fc-87c8-1da08c1379a4\") " pod="openshift-monitoring/node-exporter-ts85m"
May 25 11:20:04.750622 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:20:04.750585    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/c06afa60-0531-46fc-87c8-1da08c1379a4-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-ts85m\" (UID: \"c06afa60-0531-46fc-87c8-1da08c1379a4\") " pod="openshift-monitoring/node-exporter-ts85m"
May 25 11:20:04.760300 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:20:04.760282    2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-94hs5"
May 25 11:20:04.760870 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:20:04.760852    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jtnd4\" (UniqueName: \"kubernetes.io/projected/c06afa60-0531-46fc-87c8-1da08c1379a4-kube-api-access-jtnd4\") pod \"node-exporter-ts85m\" (UID: \"c06afa60-0531-46fc-87c8-1da08c1379a4\") " pod="openshift-monitoring/node-exporter-ts85m"
May 25 11:20:04.913235 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:20:04.913211    2569 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-54fd6bc5c4-94hs5"]
May 25 11:20:04.915495 ip-10-0-143-46 kubenswrapper[2569]: W0525 11:20:04.915465    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6973719b_4aa7_46c2_bff7_b54006c9ffa8.slice/crio-78b994b765e5a95a4004e7d596f8765bf78fdb12bf288fa7057a557e122e0c80 WatchSource:0}: Error finding container 78b994b765e5a95a4004e7d596f8765bf78fdb12bf288fa7057a557e122e0c80: Status 404 returned error can't find the container with id 78b994b765e5a95a4004e7d596f8765bf78fdb12bf288fa7057a557e122e0c80
May 25 11:20:05.212613 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:20:05.212579    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-94hs5" event={"ID":"6973719b-4aa7-46c2-bff7-b54006c9ffa8","Type":"ContainerStarted","Data":"78b994b765e5a95a4004e7d596f8765bf78fdb12bf288fa7057a557e122e0c80"}
May 25 11:20:05.252591 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:20:05.252565    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/c06afa60-0531-46fc-87c8-1da08c1379a4-node-exporter-tls\") pod \"node-exporter-ts85m\" (UID: \"c06afa60-0531-46fc-87c8-1da08c1379a4\") " pod="openshift-monitoring/node-exporter-ts85m"
May 25 11:20:05.254777 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:20:05.254752    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/c06afa60-0531-46fc-87c8-1da08c1379a4-node-exporter-tls\") pod \"node-exporter-ts85m\" (UID: \"c06afa60-0531-46fc-87c8-1da08c1379a4\") " pod="openshift-monitoring/node-exporter-ts85m"
May 25 11:20:05.416187 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:20:05.416162    2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-ts85m"
May 25 11:20:05.426025 ip-10-0-143-46 kubenswrapper[2569]: W0525 11:20:05.425995    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc06afa60_0531_46fc_87c8_1da08c1379a4.slice/crio-dacf3dc4d715869b6002ac5a136590d731ebf7a7888bf9e91d58411ecc468fc7 WatchSource:0}: Error finding container dacf3dc4d715869b6002ac5a136590d731ebf7a7888bf9e91d58411ecc468fc7: Status 404 returned error can't find the container with id dacf3dc4d715869b6002ac5a136590d731ebf7a7888bf9e91d58411ecc468fc7
May 25 11:20:06.222209 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:20:06.220578    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-ts85m" event={"ID":"c06afa60-0531-46fc-87c8-1da08c1379a4","Type":"ContainerStarted","Data":"dacf3dc4d715869b6002ac5a136590d731ebf7a7888bf9e91d58411ecc468fc7"}
May 25 11:20:06.223874 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:20:06.223813    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-94hs5" event={"ID":"6973719b-4aa7-46c2-bff7-b54006c9ffa8","Type":"ContainerStarted","Data":"7efda16839008f2264f8700be77816ce4cc2a69e6c54176dc94b91c5fd71a0c5"}
May 25 11:20:06.223874 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:20:06.223851    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-94hs5" event={"ID":"6973719b-4aa7-46c2-bff7-b54006c9ffa8","Type":"ContainerStarted","Data":"9cc6a3fe328cea75fc3bdc5262e06688131de388dcd4455ae3b91c7091680379"}
May 25 11:20:07.230016 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:20:07.229982    2569 generic.go:358] "Generic (PLEG): container finished" podID="c06afa60-0531-46fc-87c8-1da08c1379a4" containerID="cc7b6dfdba9d7c85adc96e12b8c0d610118d649da1a376527b11fcaa1cfab0e3" exitCode=0
May 25 11:20:07.230434 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:20:07.230072    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-ts85m" event={"ID":"c06afa60-0531-46fc-87c8-1da08c1379a4","Type":"ContainerDied","Data":"cc7b6dfdba9d7c85adc96e12b8c0d610118d649da1a376527b11fcaa1cfab0e3"}
May 25 11:20:07.231970 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:20:07.231947    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-94hs5" event={"ID":"6973719b-4aa7-46c2-bff7-b54006c9ffa8","Type":"ContainerStarted","Data":"e302a5fba735439dcbd70f65efae20fbb71ae4ad00067413a3b004ffda955e12"}
May 25 11:20:07.267909 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:20:07.267857    2569 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-94hs5" podStartSLOduration=2.151241247 podStartE2EDuration="3.267843375s" podCreationTimestamp="2026-05-25 11:20:04 +0000 UTC" firstStartedPulling="2026-05-25 11:20:04.917328561 +0000 UTC m=+143.778952923" lastFinishedPulling="2026-05-25 11:20:06.033930689 +0000 UTC m=+144.895555051" observedRunningTime="2026-05-25 11:20:07.267431793 +0000 UTC m=+146.129056177" watchObservedRunningTime="2026-05-25 11:20:07.267843375 +0000 UTC m=+146.129467758"
May 25 11:20:08.236576 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:20:08.236541    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-ts85m" event={"ID":"c06afa60-0531-46fc-87c8-1da08c1379a4","Type":"ContainerStarted","Data":"2249203d47e012d296be36f998280cedcb6a2edd2a53c0072c0b9d5e142fa1b3"}
May 25 11:20:08.236576 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:20:08.236578    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-ts85m" event={"ID":"c06afa60-0531-46fc-87c8-1da08c1379a4","Type":"ContainerStarted","Data":"0bd18f7ca6d8daf018a70e287cf652c0b6a13107105839ef1971d451ad7ef76f"}
May 25 11:20:08.258388 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:20:08.258348    2569 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-ts85m" podStartSLOduration=3.070501046 podStartE2EDuration="4.258336086s" podCreationTimestamp="2026-05-25 11:20:04 +0000 UTC" firstStartedPulling="2026-05-25 11:20:05.427718837 +0000 UTC m=+144.289343199" lastFinishedPulling="2026-05-25 11:20:06.615553863 +0000 UTC m=+145.477178239" observedRunningTime="2026-05-25 11:20:08.25807455 +0000 UTC m=+147.119698935" watchObservedRunningTime="2026-05-25 11:20:08.258336086 +0000 UTC m=+147.119960469"
May 25 11:20:09.693913 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:20:09.693881    2569 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-bf6d4b856-zhsqz"]
May 25 11:20:09.696204 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:20:09.696184    2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-bf6d4b856-zhsqz"
May 25 11:20:09.698879 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:20:09.698860    2569 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\""
May 25 11:20:09.698987 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:20:09.698933    2569 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\""
May 25 11:20:09.698987 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:20:09.698966    2569 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-mpl4q\""
May 25 11:20:09.699225 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:20:09.699212    2569 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\""
May 25 11:20:09.699392 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:20:09.699374    2569 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\""
May 25 11:20:09.700120 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:20:09.700105    2569 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\""
May 25 11:20:09.710180 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:20:09.710157    2569 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\""
May 25 11:20:09.711556 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:20:09.711532    2569 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-bf6d4b856-zhsqz"]
May 25 11:20:09.792632 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:20:09.792606    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8ee7c498-105f-4afd-8af8-c8fd6bc00a05-serving-certs-ca-bundle\") pod \"telemeter-client-bf6d4b856-zhsqz\" (UID: \"8ee7c498-105f-4afd-8af8-c8fd6bc00a05\") " pod="openshift-monitoring/telemeter-client-bf6d4b856-zhsqz"
May 25 11:20:09.792632 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:20:09.792634    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/8ee7c498-105f-4afd-8af8-c8fd6bc00a05-telemeter-client-tls\") pod \"telemeter-client-bf6d4b856-zhsqz\" (UID: \"8ee7c498-105f-4afd-8af8-c8fd6bc00a05\") " pod="openshift-monitoring/telemeter-client-bf6d4b856-zhsqz"
May 25 11:20:09.792811 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:20:09.792658    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/8ee7c498-105f-4afd-8af8-c8fd6bc00a05-secret-telemeter-client\") pod \"telemeter-client-bf6d4b856-zhsqz\" (UID: \"8ee7c498-105f-4afd-8af8-c8fd6bc00a05\") " pod="openshift-monitoring/telemeter-client-bf6d4b856-zhsqz"
May 25 11:20:09.792811 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:20:09.792698    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/8ee7c498-105f-4afd-8af8-c8fd6bc00a05-federate-client-tls\") pod \"telemeter-client-bf6d4b856-zhsqz\" (UID: \"8ee7c498-105f-4afd-8af8-c8fd6bc00a05\") " pod="openshift-monitoring/telemeter-client-bf6d4b856-zhsqz"
May 25 11:20:09.792811 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:20:09.792760    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8ee7c498-105f-4afd-8af8-c8fd6bc00a05-metrics-client-ca\") pod \"telemeter-client-bf6d4b856-zhsqz\" (UID: \"8ee7c498-105f-4afd-8af8-c8fd6bc00a05\") " pod="openshift-monitoring/telemeter-client-bf6d4b856-zhsqz"
May 25 11:20:09.792917 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:20:09.792850    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/8ee7c498-105f-4afd-8af8-c8fd6bc00a05-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-bf6d4b856-zhsqz\" (UID: \"8ee7c498-105f-4afd-8af8-c8fd6bc00a05\") " pod="openshift-monitoring/telemeter-client-bf6d4b856-zhsqz"
May 25 11:20:09.792917 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:20:09.792872    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8ee7c498-105f-4afd-8af8-c8fd6bc00a05-telemeter-trusted-ca-bundle\") pod \"telemeter-client-bf6d4b856-zhsqz\" (UID: \"8ee7c498-105f-4afd-8af8-c8fd6bc00a05\") " pod="openshift-monitoring/telemeter-client-bf6d4b856-zhsqz"
May 25 11:20:09.792917 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:20:09.792901    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k7vxt\" (UniqueName: \"kubernetes.io/projected/8ee7c498-105f-4afd-8af8-c8fd6bc00a05-kube-api-access-k7vxt\") pod \"telemeter-client-bf6d4b856-zhsqz\" (UID: \"8ee7c498-105f-4afd-8af8-c8fd6bc00a05\") " pod="openshift-monitoring/telemeter-client-bf6d4b856-zhsqz"
May 25 11:20:09.893981 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:20:09.893957    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/8ee7c498-105f-4afd-8af8-c8fd6bc00a05-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-bf6d4b856-zhsqz\" (UID: \"8ee7c498-105f-4afd-8af8-c8fd6bc00a05\") " pod="openshift-monitoring/telemeter-client-bf6d4b856-zhsqz"
May 25 11:20:09.894103 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:20:09.893988    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8ee7c498-105f-4afd-8af8-c8fd6bc00a05-telemeter-trusted-ca-bundle\") pod \"telemeter-client-bf6d4b856-zhsqz\" (UID: \"8ee7c498-105f-4afd-8af8-c8fd6bc00a05\") " pod="openshift-monitoring/telemeter-client-bf6d4b856-zhsqz"
May 25 11:20:09.894103 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:20:09.894025    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-k7vxt\" (UniqueName: \"kubernetes.io/projected/8ee7c498-105f-4afd-8af8-c8fd6bc00a05-kube-api-access-k7vxt\") pod \"telemeter-client-bf6d4b856-zhsqz\" (UID: \"8ee7c498-105f-4afd-8af8-c8fd6bc00a05\") " pod="openshift-monitoring/telemeter-client-bf6d4b856-zhsqz"
May 25 11:20:09.894103 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:20:09.894056    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8ee7c498-105f-4afd-8af8-c8fd6bc00a05-serving-certs-ca-bundle\") pod \"telemeter-client-bf6d4b856-zhsqz\" (UID: \"8ee7c498-105f-4afd-8af8-c8fd6bc00a05\") " pod="openshift-monitoring/telemeter-client-bf6d4b856-zhsqz"
May 25 11:20:09.894263 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:20:09.894184    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/8ee7c498-105f-4afd-8af8-c8fd6bc00a05-telemeter-client-tls\") pod \"telemeter-client-bf6d4b856-zhsqz\" (UID: \"8ee7c498-105f-4afd-8af8-c8fd6bc00a05\") " pod="openshift-monitoring/telemeter-client-bf6d4b856-zhsqz"
May 25 11:20:09.894263 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:20:09.894235    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/8ee7c498-105f-4afd-8af8-c8fd6bc00a05-secret-telemeter-client\") pod \"telemeter-client-bf6d4b856-zhsqz\" (UID: \"8ee7c498-105f-4afd-8af8-c8fd6bc00a05\") " pod="openshift-monitoring/telemeter-client-bf6d4b856-zhsqz"
May 25 11:20:09.894363 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:20:09.894268    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/8ee7c498-105f-4afd-8af8-c8fd6bc00a05-federate-client-tls\") pod \"telemeter-client-bf6d4b856-zhsqz\" (UID: \"8ee7c498-105f-4afd-8af8-c8fd6bc00a05\") " pod="openshift-monitoring/telemeter-client-bf6d4b856-zhsqz"
May 25 11:20:09.894363 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:20:09.894304    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8ee7c498-105f-4afd-8af8-c8fd6bc00a05-metrics-client-ca\") pod \"telemeter-client-bf6d4b856-zhsqz\" (UID: \"8ee7c498-105f-4afd-8af8-c8fd6bc00a05\") " pod="openshift-monitoring/telemeter-client-bf6d4b856-zhsqz"
May 25 11:20:09.894716 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:20:09.894691    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8ee7c498-105f-4afd-8af8-c8fd6bc00a05-serving-certs-ca-bundle\") pod \"telemeter-client-bf6d4b856-zhsqz\" (UID: \"8ee7c498-105f-4afd-8af8-c8fd6bc00a05\") " pod="openshift-monitoring/telemeter-client-bf6d4b856-zhsqz"
May 25 11:20:09.894904 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:20:09.894884    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8ee7c498-105f-4afd-8af8-c8fd6bc00a05-telemeter-trusted-ca-bundle\") pod \"telemeter-client-bf6d4b856-zhsqz\" (UID: \"8ee7c498-105f-4afd-8af8-c8fd6bc00a05\") " pod="openshift-monitoring/telemeter-client-bf6d4b856-zhsqz"
May 25 11:20:09.895044 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:20:09.895026    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8ee7c498-105f-4afd-8af8-c8fd6bc00a05-metrics-client-ca\") pod \"telemeter-client-bf6d4b856-zhsqz\" (UID: \"8ee7c498-105f-4afd-8af8-c8fd6bc00a05\") " pod="openshift-monitoring/telemeter-client-bf6d4b856-zhsqz"
May 25 11:20:09.896679 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:20:09.896657    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/8ee7c498-105f-4afd-8af8-c8fd6bc00a05-telemeter-client-tls\") pod \"telemeter-client-bf6d4b856-zhsqz\" (UID: \"8ee7c498-105f-4afd-8af8-c8fd6bc00a05\") " pod="openshift-monitoring/telemeter-client-bf6d4b856-zhsqz"
May 25 11:20:09.896913 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:20:09.896888    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/8ee7c498-105f-4afd-8af8-c8fd6bc00a05-secret-telemeter-client\") pod \"telemeter-client-bf6d4b856-zhsqz\" (UID: \"8ee7c498-105f-4afd-8af8-c8fd6bc00a05\") " pod="openshift-monitoring/telemeter-client-bf6d4b856-zhsqz"
May 25 11:20:09.897003 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:20:09.896990    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/8ee7c498-105f-4afd-8af8-c8fd6bc00a05-federate-client-tls\") pod \"telemeter-client-bf6d4b856-zhsqz\" (UID: \"8ee7c498-105f-4afd-8af8-c8fd6bc00a05\") " pod="openshift-monitoring/telemeter-client-bf6d4b856-zhsqz"
May 25 11:20:09.897070 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:20:09.897050    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/8ee7c498-105f-4afd-8af8-c8fd6bc00a05-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-bf6d4b856-zhsqz\" (UID: \"8ee7c498-105f-4afd-8af8-c8fd6bc00a05\") " pod="openshift-monitoring/telemeter-client-bf6d4b856-zhsqz"
May 25 11:20:09.902670 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:20:09.902650    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-k7vxt\" (UniqueName: \"kubernetes.io/projected/8ee7c498-105f-4afd-8af8-c8fd6bc00a05-kube-api-access-k7vxt\") pod \"telemeter-client-bf6d4b856-zhsqz\" (UID: \"8ee7c498-105f-4afd-8af8-c8fd6bc00a05\") " pod="openshift-monitoring/telemeter-client-bf6d4b856-zhsqz"
May 25 11:20:10.007375 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:20:10.007313    2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-bf6d4b856-zhsqz"
May 25 11:20:10.132593 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:20:10.132565    2569 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-bf6d4b856-zhsqz"]
May 25 11:20:10.135657 ip-10-0-143-46 kubenswrapper[2569]: W0525 11:20:10.135628    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8ee7c498_105f_4afd_8af8_c8fd6bc00a05.slice/crio-01bffc5ba00001b7c29a6ac633bdd869c76bfe74568df253757c826f8bf41a11 WatchSource:0}: Error finding container 01bffc5ba00001b7c29a6ac633bdd869c76bfe74568df253757c826f8bf41a11: Status 404 returned error can't find the container with id 01bffc5ba00001b7c29a6ac633bdd869c76bfe74568df253757c826f8bf41a11
May 25 11:20:10.242407 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:20:10.242375    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-bf6d4b856-zhsqz" event={"ID":"8ee7c498-105f-4afd-8af8-c8fd6bc00a05","Type":"ContainerStarted","Data":"01bffc5ba00001b7c29a6ac633bdd869c76bfe74568df253757c826f8bf41a11"}
May 25 11:20:12.249232 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:20:12.249157    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-bf6d4b856-zhsqz" event={"ID":"8ee7c498-105f-4afd-8af8-c8fd6bc00a05","Type":"ContainerStarted","Data":"915b7fbee75fb5a90f8ccdbc77fe1d75b9fe8428153e13bce6b5eb280e8378e5"}
May 25 11:20:13.253214 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:20:13.253139    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-bf6d4b856-zhsqz" event={"ID":"8ee7c498-105f-4afd-8af8-c8fd6bc00a05","Type":"ContainerStarted","Data":"3732102896fcf04b1f2f181de30bbbb7f3a3c7fe979fff7328089c666ae156be"}
May 25 11:20:13.253214 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:20:13.253174    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-bf6d4b856-zhsqz" event={"ID":"8ee7c498-105f-4afd-8af8-c8fd6bc00a05","Type":"ContainerStarted","Data":"711cf3488b1e97e4bd9a7ed451df39dcee5c31100da0218f9e91cce414901a87"}
May 25 11:20:13.276330 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:20:13.276275    2569 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-bf6d4b856-zhsqz" podStartSLOduration=1.624899084 podStartE2EDuration="4.276258029s" podCreationTimestamp="2026-05-25 11:20:09 +0000 UTC" firstStartedPulling="2026-05-25 11:20:10.137599142 +0000 UTC m=+148.999223519" lastFinishedPulling="2026-05-25 11:20:12.788958098 +0000 UTC m=+151.650582464" observedRunningTime="2026-05-25 11:20:13.27449515 +0000 UTC m=+152.136119557" watchObservedRunningTime="2026-05-25 11:20:13.276258029 +0000 UTC m=+152.137882415"
May 25 11:20:14.725457 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:20:14.725427    2569 scope.go:117] "RemoveContainer" containerID="838e4303306651f1756e3a876aeefc4d9337bbfd80de93ba14b8174159aae3e9"
May 25 11:20:15.260482 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:20:15.260454    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-cvhbj_9ff9f77a-ac83-4250-8c40-d14a2db84c1e/console-operator/2.log"
May 25 11:20:15.260648 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:20:15.260539    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-76dff48d59-cvhbj" event={"ID":"9ff9f77a-ac83-4250-8c40-d14a2db84c1e","Type":"ContainerStarted","Data":"e7bc8c4071f0fd09c9dcf0acea0c85f22da1e65d90177702b13905495e738e5e"}
May 25 11:20:15.260857 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:20:15.260829    2569 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-76dff48d59-cvhbj"
May 25 11:20:15.284297 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:20:15.284254    2569 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-console-operator/console-operator-76dff48d59-cvhbj" podStartSLOduration=49.556424787 podStartE2EDuration="53.284239241s" podCreationTimestamp="2026-05-25 11:19:22 +0000 UTC" firstStartedPulling="2026-05-25 11:19:22.555226644 +0000 UTC m=+101.416851009" lastFinishedPulling="2026-05-25 11:19:26.2830411 +0000 UTC m=+105.144665463" observedRunningTime="2026-05-25 11:20:15.282452036 +0000 UTC m=+154.144076431" watchObservedRunningTime="2026-05-25 11:20:15.284239241 +0000 UTC m=+154.145863625"
May 25 11:20:15.417406 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:20:15.417377    2569 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-76dff48d59-cvhbj"
May 25 11:20:15.620396 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:20:15.620362    2569 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-57bd96b888-z45lk"]
May 25 11:20:15.622373 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:20:15.622356    2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-57bd96b888-z45lk"
May 25 11:20:15.625365 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:20:15.625330    2569 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-2hz5m\""
May 25 11:20:15.625756 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:20:15.625728    2569 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
May 25 11:20:15.625756 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:20:15.625750    2569 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
May 25 11:20:15.637800 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:20:15.637768    2569 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-57bd96b888-z45lk"]
May 25 11:20:15.643324 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:20:15.643300    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tlhpz\" (UniqueName: \"kubernetes.io/projected/30832a1d-20d2-4e9d-9cca-0e3f5f04f033-kube-api-access-tlhpz\") pod \"downloads-57bd96b888-z45lk\" (UID: \"30832a1d-20d2-4e9d-9cca-0e3f5f04f033\") " pod="openshift-console/downloads-57bd96b888-z45lk"
May 25 11:20:15.743943 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:20:15.743910    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-tlhpz\" (UniqueName: \"kubernetes.io/projected/30832a1d-20d2-4e9d-9cca-0e3f5f04f033-kube-api-access-tlhpz\") pod \"downloads-57bd96b888-z45lk\" (UID: \"30832a1d-20d2-4e9d-9cca-0e3f5f04f033\") " pod="openshift-console/downloads-57bd96b888-z45lk"
May 25 11:20:15.756741 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:20:15.756709    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tlhpz\" (UniqueName: \"kubernetes.io/projected/30832a1d-20d2-4e9d-9cca-0e3f5f04f033-kube-api-access-tlhpz\") pod \"downloads-57bd96b888-z45lk\" (UID: \"30832a1d-20d2-4e9d-9cca-0e3f5f04f033\") " pod="openshift-console/downloads-57bd96b888-z45lk"
May 25 11:20:15.932337 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:20:15.932255    2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-57bd96b888-z45lk"
May 25 11:20:16.055868 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:20:16.055768    2569 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-57bd96b888-z45lk"]
May 25 11:20:16.058486 ip-10-0-143-46 kubenswrapper[2569]: W0525 11:20:16.058447    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod30832a1d_20d2_4e9d_9cca_0e3f5f04f033.slice/crio-0d0f369a39225bd96b0cf413a343fa57c4dd89dc3d89f12f37a2381e5cb6a5fa WatchSource:0}: Error finding container 0d0f369a39225bd96b0cf413a343fa57c4dd89dc3d89f12f37a2381e5cb6a5fa: Status 404 returned error can't find the container with id 0d0f369a39225bd96b0cf413a343fa57c4dd89dc3d89f12f37a2381e5cb6a5fa
May 25 11:20:16.264838 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:20:16.264750    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-57bd96b888-z45lk" event={"ID":"30832a1d-20d2-4e9d-9cca-0e3f5f04f033","Type":"ContainerStarted","Data":"0d0f369a39225bd96b0cf413a343fa57c4dd89dc3d89f12f37a2381e5cb6a5fa"}
May 25 11:20:18.584901 ip-10-0-143-46 kubenswrapper[2569]: E0525 11:20:18.584865    2569 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-dmhrg" podUID="e1dc225a-b479-4666-98ba-b923a7e1e6b4"
May 25 11:20:18.599071 ip-10-0-143-46 kubenswrapper[2569]: E0525 11:20:18.599031    2569 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[cert], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-ingress-canary/ingress-canary-lpwk8" podUID="62c29731-ce45-4236-be62-f08e78a0fc27"
May 25 11:20:19.274175 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:20:19.274144    2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-dmhrg"
May 25 11:20:23.410801 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:20:23.410738    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e1dc225a-b479-4666-98ba-b923a7e1e6b4-metrics-tls\") pod \"dns-default-dmhrg\" (UID: \"e1dc225a-b479-4666-98ba-b923a7e1e6b4\") " pod="openshift-dns/dns-default-dmhrg"
May 25 11:20:23.413740 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:20:23.413710    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e1dc225a-b479-4666-98ba-b923a7e1e6b4-metrics-tls\") pod \"dns-default-dmhrg\" (UID: \"e1dc225a-b479-4666-98ba-b923a7e1e6b4\") " pod="openshift-dns/dns-default-dmhrg"
May 25 11:20:23.477299 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:20:23.477265    2569 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-t8nfn\""
May 25 11:20:23.485343 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:20:23.485315    2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-dmhrg"
May 25 11:20:23.511684 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:20:23.511619    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/62c29731-ce45-4236-be62-f08e78a0fc27-cert\") pod \"ingress-canary-lpwk8\" (UID: \"62c29731-ce45-4236-be62-f08e78a0fc27\") " pod="openshift-ingress-canary/ingress-canary-lpwk8"
May 25 11:20:23.514489 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:20:23.514465    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/62c29731-ce45-4236-be62-f08e78a0fc27-cert\") pod \"ingress-canary-lpwk8\" (UID: \"62c29731-ce45-4236-be62-f08e78a0fc27\") " pod="openshift-ingress-canary/ingress-canary-lpwk8"
May 25 11:20:23.627171 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:20:23.627140    2569 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-dmhrg"]
May 25 11:20:23.630065 ip-10-0-143-46 kubenswrapper[2569]: W0525 11:20:23.630025    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode1dc225a_b479_4666_98ba_b923a7e1e6b4.slice/crio-60307d3e309bdc3949b471b55c34abdc976d2beceabb284e6176aa26d9cc895a WatchSource:0}: Error finding container 60307d3e309bdc3949b471b55c34abdc976d2beceabb284e6176aa26d9cc895a: Status 404 returned error can't find the container with id 60307d3e309bdc3949b471b55c34abdc976d2beceabb284e6176aa26d9cc895a
May 25 11:20:24.290964 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:20:24.290929    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-dmhrg" event={"ID":"e1dc225a-b479-4666-98ba-b923a7e1e6b4","Type":"ContainerStarted","Data":"60307d3e309bdc3949b471b55c34abdc976d2beceabb284e6176aa26d9cc895a"}
May 25 11:20:25.240124 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:20:25.240003    2569 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-console/console-7c545bd686-l85mg"]
May 25 11:20:25.243242 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:20:25.243220    2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7c545bd686-l85mg"
May 25 11:20:25.246987 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:20:25.246873    2569 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
May 25 11:20:25.247099 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:20:25.247083    2569 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
May 25 11:20:25.247161 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:20:25.247135    2569 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
May 25 11:20:25.247424 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:20:25.247404    2569 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
May 25 11:20:25.247558 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:20:25.247536    2569 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
May 25 11:20:25.247963 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:20:25.247679    2569 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-6dlp6\""
May 25 11:20:25.254806 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:20:25.253659    2569 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7c545bd686-l85mg"]
May 25 11:20:25.295019 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:20:25.294989    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-dmhrg" event={"ID":"e1dc225a-b479-4666-98ba-b923a7e1e6b4","Type":"ContainerStarted","Data":"0790819dd80a5fe35a05650ed13d3af7992a2aa39774ef3b558d73ced616ea1e"}
May 25 11:20:25.328593 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:20:25.328562    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f5097a12-0f06-43e8-9dbb-3f5fa7e19321-service-ca\") pod \"console-7c545bd686-l85mg\" (UID: \"f5097a12-0f06-43e8-9dbb-3f5fa7e19321\") " pod="openshift-console/console-7c545bd686-l85mg"
May 25 11:20:25.328709 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:20:25.328622    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-prr9m\" (UniqueName: \"kubernetes.io/projected/f5097a12-0f06-43e8-9dbb-3f5fa7e19321-kube-api-access-prr9m\") pod \"console-7c545bd686-l85mg\" (UID: \"f5097a12-0f06-43e8-9dbb-3f5fa7e19321\") " pod="openshift-console/console-7c545bd686-l85mg"
May 25 11:20:25.328709 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:20:25.328700    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f5097a12-0f06-43e8-9dbb-3f5fa7e19321-oauth-serving-cert\") pod \"console-7c545bd686-l85mg\" (UID: \"f5097a12-0f06-43e8-9dbb-3f5fa7e19321\") " pod="openshift-console/console-7c545bd686-l85mg"
May 25 11:20:25.328839 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:20:25.328743    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f5097a12-0f06-43e8-9dbb-3f5fa7e19321-console-config\") pod \"console-7c545bd686-l85mg\" (UID: \"f5097a12-0f06-43e8-9dbb-3f5fa7e19321\") " pod="openshift-console/console-7c545bd686-l85mg"
May 25 11:20:25.328879 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:20:25.328844    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f5097a12-0f06-43e8-9dbb-3f5fa7e19321-console-serving-cert\") pod \"console-7c545bd686-l85mg\" (UID: \"f5097a12-0f06-43e8-9dbb-3f5fa7e19321\") " pod="openshift-console/console-7c545bd686-l85mg"
May 25 11:20:25.328932 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:20:25.328892    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f5097a12-0f06-43e8-9dbb-3f5fa7e19321-console-oauth-config\") pod \"console-7c545bd686-l85mg\" (UID: \"f5097a12-0f06-43e8-9dbb-3f5fa7e19321\") " pod="openshift-console/console-7c545bd686-l85mg"
May 25 11:20:25.429623 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:20:25.429542    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f5097a12-0f06-43e8-9dbb-3f5fa7e19321-console-config\") pod \"console-7c545bd686-l85mg\" (UID: \"f5097a12-0f06-43e8-9dbb-3f5fa7e19321\") " pod="openshift-console/console-7c545bd686-l85mg"
May 25 11:20:25.429623 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:20:25.429587    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f5097a12-0f06-43e8-9dbb-3f5fa7e19321-console-serving-cert\") pod \"console-7c545bd686-l85mg\" (UID: \"f5097a12-0f06-43e8-9dbb-3f5fa7e19321\") " pod="openshift-console/console-7c545bd686-l85mg"
May 25 11:20:25.429623 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:20:25.429620    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f5097a12-0f06-43e8-9dbb-3f5fa7e19321-console-oauth-config\") pod \"console-7c545bd686-l85mg\" (UID: \"f5097a12-0f06-43e8-9dbb-3f5fa7e19321\") " pod="openshift-console/console-7c545bd686-l85mg"
May 25 11:20:25.429923 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:20:25.429685    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f5097a12-0f06-43e8-9dbb-3f5fa7e19321-service-ca\") pod \"console-7c545bd686-l85mg\" (UID: \"f5097a12-0f06-43e8-9dbb-3f5fa7e19321\") " pod="openshift-console/console-7c545bd686-l85mg"
May 25 11:20:25.429923 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:20:25.429718    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-prr9m\" (UniqueName: \"kubernetes.io/projected/f5097a12-0f06-43e8-9dbb-3f5fa7e19321-kube-api-access-prr9m\") pod \"console-7c545bd686-l85mg\" (UID: \"f5097a12-0f06-43e8-9dbb-3f5fa7e19321\") " pod="openshift-console/console-7c545bd686-l85mg"
May 25 11:20:25.429923 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:20:25.429769    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f5097a12-0f06-43e8-9dbb-3f5fa7e19321-oauth-serving-cert\") pod \"console-7c545bd686-l85mg\" (UID: \"f5097a12-0f06-43e8-9dbb-3f5fa7e19321\") " pod="openshift-console/console-7c545bd686-l85mg"
May 25 11:20:25.430439 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:20:25.430322    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f5097a12-0f06-43e8-9dbb-3f5fa7e19321-console-config\") pod \"console-7c545bd686-l85mg\" (UID: \"f5097a12-0f06-43e8-9dbb-3f5fa7e19321\") " pod="openshift-console/console-7c545bd686-l85mg"
May 25 11:20:25.430439 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:20:25.430422    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f5097a12-0f06-43e8-9dbb-3f5fa7e19321-service-ca\") pod \"console-7c545bd686-l85mg\" (UID: \"f5097a12-0f06-43e8-9dbb-3f5fa7e19321\") " pod="openshift-console/console-7c545bd686-l85mg"
May 25 11:20:25.430602 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:20:25.430582    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f5097a12-0f06-43e8-9dbb-3f5fa7e19321-oauth-serving-cert\") pod \"console-7c545bd686-l85mg\" (UID: \"f5097a12-0f06-43e8-9dbb-3f5fa7e19321\") " pod="openshift-console/console-7c545bd686-l85mg"
May 25 11:20:25.432386 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:20:25.432362    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f5097a12-0f06-43e8-9dbb-3f5fa7e19321-console-serving-cert\") pod \"console-7c545bd686-l85mg\" (UID: \"f5097a12-0f06-43e8-9dbb-3f5fa7e19321\") " pod="openshift-console/console-7c545bd686-l85mg"
May 25 11:20:25.432477 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:20:25.432432    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f5097a12-0f06-43e8-9dbb-3f5fa7e19321-console-oauth-config\") pod \"console-7c545bd686-l85mg\" (UID: \"f5097a12-0f06-43e8-9dbb-3f5fa7e19321\") " pod="openshift-console/console-7c545bd686-l85mg"
May 25 11:20:25.437823 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:20:25.437804    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-prr9m\" (UniqueName: \"kubernetes.io/projected/f5097a12-0f06-43e8-9dbb-3f5fa7e19321-kube-api-access-prr9m\") pod \"console-7c545bd686-l85mg\" (UID: \"f5097a12-0f06-43e8-9dbb-3f5fa7e19321\") " pod="openshift-console/console-7c545bd686-l85mg"
May 25 11:20:25.563974 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:20:25.563937    2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7c545bd686-l85mg"
May 25 11:20:25.701940 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:20:25.701882    2569 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7c545bd686-l85mg"]
May 25 11:20:25.704117 ip-10-0-143-46 kubenswrapper[2569]: W0525 11:20:25.704087    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf5097a12_0f06_43e8_9dbb_3f5fa7e19321.slice/crio-ae16a2bc28018767a2d7dacae6440d5a1114fca1214a06048a037c8bf3392910 WatchSource:0}: Error finding container ae16a2bc28018767a2d7dacae6440d5a1114fca1214a06048a037c8bf3392910: Status 404 returned error can't find the container with id ae16a2bc28018767a2d7dacae6440d5a1114fca1214a06048a037c8bf3392910
May 25 11:20:26.299382 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:20:26.299340    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7c545bd686-l85mg" event={"ID":"f5097a12-0f06-43e8-9dbb-3f5fa7e19321","Type":"ContainerStarted","Data":"ae16a2bc28018767a2d7dacae6440d5a1114fca1214a06048a037c8bf3392910"}
May 25 11:20:26.301424 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:20:26.301390    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-dmhrg" event={"ID":"e1dc225a-b479-4666-98ba-b923a7e1e6b4","Type":"ContainerStarted","Data":"5152ec1e6500ed05eda405e71ad4f8a06200c6b5e0f2bd5100bead5136ce7457"}
May 25 11:20:26.301567 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:20:26.301543    2569 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-dmhrg"
May 25 11:20:26.329319 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:20:26.329237    2569 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-dns/dns-default-dmhrg" podStartSLOduration=129.84924797 podStartE2EDuration="2m11.329217523s" podCreationTimestamp="2026-05-25 11:18:15 +0000 UTC" firstStartedPulling="2026-05-25 11:20:23.632348222 +0000 UTC m=+162.493972591" lastFinishedPulling="2026-05-25 11:20:25.112317782 +0000 UTC m=+163.973942144" observedRunningTime="2026-05-25 11:20:26.326913996 +0000 UTC m=+165.188538383" watchObservedRunningTime="2026-05-25 11:20:26.329217523 +0000 UTC m=+165.190841910"
May 25 11:20:30.725469 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:20:30.725376    2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-lpwk8"
May 25 11:20:30.728213 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:20:30.728187    2569 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-mjf4k\""
May 25 11:20:30.736727 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:20:30.736702    2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-lpwk8"
May 25 11:20:33.711942 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:20:33.711908    2569 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-console/console-5fcf5c8fb4-hnjs2"]
May 25 11:20:33.717472 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:20:33.717444    2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5fcf5c8fb4-hnjs2"
May 25 11:20:33.726636 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:20:33.726279    2569 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\""
May 25 11:20:33.730773 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:20:33.730751    2569 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5fcf5c8fb4-hnjs2"]
May 25 11:20:33.811604 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:20:33.811572    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8d1a3110-8ae8-441c-808a-e2f23d831022-trusted-ca-bundle\") pod \"console-5fcf5c8fb4-hnjs2\" (UID: \"8d1a3110-8ae8-441c-808a-e2f23d831022\") " pod="openshift-console/console-5fcf5c8fb4-hnjs2"
May 25 11:20:33.811781 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:20:33.811638    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/8d1a3110-8ae8-441c-808a-e2f23d831022-oauth-serving-cert\") pod \"console-5fcf5c8fb4-hnjs2\" (UID: \"8d1a3110-8ae8-441c-808a-e2f23d831022\") " pod="openshift-console/console-5fcf5c8fb4-hnjs2"
May 25 11:20:33.811781 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:20:33.811672    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5rc4w\" (UniqueName: \"kubernetes.io/projected/8d1a3110-8ae8-441c-808a-e2f23d831022-kube-api-access-5rc4w\") pod \"console-5fcf5c8fb4-hnjs2\" (UID: \"8d1a3110-8ae8-441c-808a-e2f23d831022\") " pod="openshift-console/console-5fcf5c8fb4-hnjs2"
May 25 11:20:33.811781 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:20:33.811716    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/8d1a3110-8ae8-441c-808a-e2f23d831022-service-ca\") pod \"console-5fcf5c8fb4-hnjs2\" (UID: \"8d1a3110-8ae8-441c-808a-e2f23d831022\") " pod="openshift-console/console-5fcf5c8fb4-hnjs2"
May 25 11:20:33.811781 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:20:33.811780    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/8d1a3110-8ae8-441c-808a-e2f23d831022-console-config\") pod \"console-5fcf5c8fb4-hnjs2\" (UID: \"8d1a3110-8ae8-441c-808a-e2f23d831022\") " pod="openshift-console/console-5fcf5c8fb4-hnjs2"
May 25 11:20:33.812005 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:20:33.811851    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/8d1a3110-8ae8-441c-808a-e2f23d831022-console-oauth-config\") pod \"console-5fcf5c8fb4-hnjs2\" (UID: \"8d1a3110-8ae8-441c-808a-e2f23d831022\") " pod="openshift-console/console-5fcf5c8fb4-hnjs2"
May 25 11:20:33.812005 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:20:33.811882    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/8d1a3110-8ae8-441c-808a-e2f23d831022-console-serving-cert\") pod \"console-5fcf5c8fb4-hnjs2\" (UID: \"8d1a3110-8ae8-441c-808a-e2f23d831022\") " pod="openshift-console/console-5fcf5c8fb4-hnjs2"
May 25 11:20:33.912851 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:20:33.912815    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/8d1a3110-8ae8-441c-808a-e2f23d831022-oauth-serving-cert\") pod \"console-5fcf5c8fb4-hnjs2\" (UID: \"8d1a3110-8ae8-441c-808a-e2f23d831022\") " pod="openshift-console/console-5fcf5c8fb4-hnjs2"
May 25 11:20:33.912851 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:20:33.912856    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-5rc4w\" (UniqueName: \"kubernetes.io/projected/8d1a3110-8ae8-441c-808a-e2f23d831022-kube-api-access-5rc4w\") pod \"console-5fcf5c8fb4-hnjs2\" (UID: \"8d1a3110-8ae8-441c-808a-e2f23d831022\") " pod="openshift-console/console-5fcf5c8fb4-hnjs2"
May 25 11:20:33.913089 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:20:33.912890    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/8d1a3110-8ae8-441c-808a-e2f23d831022-service-ca\") pod \"console-5fcf5c8fb4-hnjs2\" (UID: \"8d1a3110-8ae8-441c-808a-e2f23d831022\") " pod="openshift-console/console-5fcf5c8fb4-hnjs2"
May 25 11:20:33.913089 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:20:33.912936    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/8d1a3110-8ae8-441c-808a-e2f23d831022-console-config\") pod \"console-5fcf5c8fb4-hnjs2\" (UID: \"8d1a3110-8ae8-441c-808a-e2f23d831022\") " pod="openshift-console/console-5fcf5c8fb4-hnjs2"
May 25 11:20:33.913089 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:20:33.912967    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/8d1a3110-8ae8-441c-808a-e2f23d831022-console-oauth-config\") pod \"console-5fcf5c8fb4-hnjs2\" (UID: \"8d1a3110-8ae8-441c-808a-e2f23d831022\") " pod="openshift-console/console-5fcf5c8fb4-hnjs2"
May 25 11:20:33.913089 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:20:33.912993    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/8d1a3110-8ae8-441c-808a-e2f23d831022-console-serving-cert\") pod \"console-5fcf5c8fb4-hnjs2\" (UID: \"8d1a3110-8ae8-441c-808a-e2f23d831022\") " pod="openshift-console/console-5fcf5c8fb4-hnjs2"
May 25 11:20:33.913089 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:20:33.913036    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8d1a3110-8ae8-441c-808a-e2f23d831022-trusted-ca-bundle\") pod \"console-5fcf5c8fb4-hnjs2\" (UID: \"8d1a3110-8ae8-441c-808a-e2f23d831022\") " pod="openshift-console/console-5fcf5c8fb4-hnjs2"
May 25 11:20:33.913662 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:20:33.913634    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/8d1a3110-8ae8-441c-808a-e2f23d831022-oauth-serving-cert\") pod \"console-5fcf5c8fb4-hnjs2\" (UID: \"8d1a3110-8ae8-441c-808a-e2f23d831022\") " pod="openshift-console/console-5fcf5c8fb4-hnjs2"
May 25 11:20:33.914044 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:20:33.914012    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/8d1a3110-8ae8-441c-808a-e2f23d831022-service-ca\") pod \"console-5fcf5c8fb4-hnjs2\" (UID: \"8d1a3110-8ae8-441c-808a-e2f23d831022\") " pod="openshift-console/console-5fcf5c8fb4-hnjs2"
May 25 11:20:33.914171 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:20:33.914069    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/8d1a3110-8ae8-441c-808a-e2f23d831022-console-config\") pod \"console-5fcf5c8fb4-hnjs2\" (UID: \"8d1a3110-8ae8-441c-808a-e2f23d831022\") " pod="openshift-console/console-5fcf5c8fb4-hnjs2"
May 25 11:20:33.914365 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:20:33.914344    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8d1a3110-8ae8-441c-808a-e2f23d831022-trusted-ca-bundle\") pod \"console-5fcf5c8fb4-hnjs2\" (UID: \"8d1a3110-8ae8-441c-808a-e2f23d831022\") " pod="openshift-console/console-5fcf5c8fb4-hnjs2"
May 25 11:20:33.915907 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:20:33.915883    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/8d1a3110-8ae8-441c-808a-e2f23d831022-console-serving-cert\") pod \"console-5fcf5c8fb4-hnjs2\" (UID: \"8d1a3110-8ae8-441c-808a-e2f23d831022\") " pod="openshift-console/console-5fcf5c8fb4-hnjs2"
May 25 11:20:33.916011 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:20:33.915905    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/8d1a3110-8ae8-441c-808a-e2f23d831022-console-oauth-config\") pod \"console-5fcf5c8fb4-hnjs2\" (UID: \"8d1a3110-8ae8-441c-808a-e2f23d831022\") " pod="openshift-console/console-5fcf5c8fb4-hnjs2"
May 25 11:20:33.921995 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:20:33.921973    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5rc4w\" (UniqueName: \"kubernetes.io/projected/8d1a3110-8ae8-441c-808a-e2f23d831022-kube-api-access-5rc4w\") pod \"console-5fcf5c8fb4-hnjs2\" (UID: \"8d1a3110-8ae8-441c-808a-e2f23d831022\") " pod="openshift-console/console-5fcf5c8fb4-hnjs2"
May 25 11:20:34.029656 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:20:34.029610    2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5fcf5c8fb4-hnjs2"
May 25 11:20:35.668561 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:20:35.668536    2569 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5fcf5c8fb4-hnjs2"]
May 25 11:20:35.671031 ip-10-0-143-46 kubenswrapper[2569]: W0525 11:20:35.671000    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8d1a3110_8ae8_441c_808a_e2f23d831022.slice/crio-0dbfe4d536f5165e0205510a9885e469334e39e818c703070fc4fb8a80a05411 WatchSource:0}: Error finding container 0dbfe4d536f5165e0205510a9885e469334e39e818c703070fc4fb8a80a05411: Status 404 returned error can't find the container with id 0dbfe4d536f5165e0205510a9885e469334e39e818c703070fc4fb8a80a05411
May 25 11:20:35.684506 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:20:35.684398    2569 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-lpwk8"]
May 25 11:20:35.688021 ip-10-0-143-46 kubenswrapper[2569]: W0525 11:20:35.687999    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod62c29731_ce45_4236_be62_f08e78a0fc27.slice/crio-6cd8ed070cafe942fba79bc0800109482f264fd4d7fc9d15fa0f6c214b628788 WatchSource:0}: Error finding container 6cd8ed070cafe942fba79bc0800109482f264fd4d7fc9d15fa0f6c214b628788: Status 404 returned error can't find the container with id 6cd8ed070cafe942fba79bc0800109482f264fd4d7fc9d15fa0f6c214b628788
May 25 11:20:36.312225 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:20:36.312129    2569 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-dmhrg"
May 25 11:20:36.342100 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:20:36.341719    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-57bd96b888-z45lk" event={"ID":"30832a1d-20d2-4e9d-9cca-0e3f5f04f033","Type":"ContainerStarted","Data":"97db2f5e9ceab30d69a82a0c9f211dd7fba68cf484ed3dda80536601142baef7"}
May 25 11:20:36.342100 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:20:36.342063    2569 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-57bd96b888-z45lk"
May 25 11:20:36.344272 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:20:36.344229    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-lpwk8" event={"ID":"62c29731-ce45-4236-be62-f08e78a0fc27","Type":"ContainerStarted","Data":"6cd8ed070cafe942fba79bc0800109482f264fd4d7fc9d15fa0f6c214b628788"}
May 25 11:20:36.346343 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:20:36.346303    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7c545bd686-l85mg" event={"ID":"f5097a12-0f06-43e8-9dbb-3f5fa7e19321","Type":"ContainerStarted","Data":"5504d28e89b3997e8af935477f595758b856208c46aaee6d0f3cadae288591c2"}
May 25 11:20:36.348577 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:20:36.348115    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5fcf5c8fb4-hnjs2" event={"ID":"8d1a3110-8ae8-441c-808a-e2f23d831022","Type":"ContainerStarted","Data":"a0ecf4bd633231b7e488962f854d8bef44837711722b09fdfa6208d863f61041"}
May 25 11:20:36.348577 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:20:36.348143    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5fcf5c8fb4-hnjs2" event={"ID":"8d1a3110-8ae8-441c-808a-e2f23d831022","Type":"ContainerStarted","Data":"0dbfe4d536f5165e0205510a9885e469334e39e818c703070fc4fb8a80a05411"}
May 25 11:20:36.354093 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:20:36.353986    2569 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-57bd96b888-z45lk"
May 25 11:20:36.369821 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:20:36.366385    2569 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-console/downloads-57bd96b888-z45lk" podStartSLOduration=1.851014487 podStartE2EDuration="21.366369123s" podCreationTimestamp="2026-05-25 11:20:15 +0000 UTC" firstStartedPulling="2026-05-25 11:20:16.060412371 +0000 UTC m=+154.922036732" lastFinishedPulling="2026-05-25 11:20:35.575766991 +0000 UTC m=+174.437391368" observedRunningTime="2026-05-25 11:20:36.364224993 +0000 UTC m=+175.225849378" watchObservedRunningTime="2026-05-25 11:20:36.366369123 +0000 UTC m=+175.227993507"
May 25 11:20:36.387486 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:20:36.385712    2569 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-console/console-5fcf5c8fb4-hnjs2" podStartSLOduration=3.385694236 podStartE2EDuration="3.385694236s" podCreationTimestamp="2026-05-25 11:20:33 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-25 11:20:36.383293377 +0000 UTC m=+175.244917762" watchObservedRunningTime="2026-05-25 11:20:36.385694236 +0000 UTC m=+175.247318623"
May 25 11:20:36.405043 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:20:36.404992    2569 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-console/console-7c545bd686-l85mg" podStartSLOduration=1.595869409 podStartE2EDuration="11.404974839s" podCreationTimestamp="2026-05-25 11:20:25 +0000 UTC" firstStartedPulling="2026-05-25 11:20:25.706384266 +0000 UTC m=+164.568008628" lastFinishedPulling="2026-05-25 11:20:35.515489696 +0000 UTC m=+174.377114058" observedRunningTime="2026-05-25 11:20:36.402750491 +0000 UTC m=+175.264374877" watchObservedRunningTime="2026-05-25 11:20:36.404974839 +0000 UTC m=+175.266599225"
May 25 11:20:38.358325 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:20:38.358272    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-lpwk8" event={"ID":"62c29731-ce45-4236-be62-f08e78a0fc27","Type":"ContainerStarted","Data":"e563df5ce5e3c3deaa62b6289f5654860681710c3a6d1d77db15b1921dfd247d"}
May 25 11:20:38.378678 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:20:38.378622    2569 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-lpwk8" podStartSLOduration=141.101773497 podStartE2EDuration="2m23.378604387s" podCreationTimestamp="2026-05-25 11:18:15 +0000 UTC" firstStartedPulling="2026-05-25 11:20:35.689849628 +0000 UTC m=+174.551474004" lastFinishedPulling="2026-05-25 11:20:37.966680516 +0000 UTC m=+176.828304894" observedRunningTime="2026-05-25 11:20:38.375841526 +0000 UTC m=+177.237465912" watchObservedRunningTime="2026-05-25 11:20:38.378604387 +0000 UTC m=+177.240228771"
May 25 11:20:42.372671 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:20:42.372633    2569 generic.go:358] "Generic (PLEG): container finished" podID="a9e3fc1b-f6e0-4021-9ee1-5602272d25c5" containerID="78f47f12fc5aa870c4154d6ade7b30a94adc6e28db6ed9326de1421bb63d93a8" exitCode=0
May 25 11:20:42.373211 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:20:42.372703    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-fqd6q" event={"ID":"a9e3fc1b-f6e0-4021-9ee1-5602272d25c5","Type":"ContainerDied","Data":"78f47f12fc5aa870c4154d6ade7b30a94adc6e28db6ed9326de1421bb63d93a8"}
May 25 11:20:42.373211 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:20:42.373109    2569 scope.go:117] "RemoveContainer" containerID="78f47f12fc5aa870c4154d6ade7b30a94adc6e28db6ed9326de1421bb63d93a8"
May 25 11:20:43.378752 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:20:43.378713    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-fqd6q" event={"ID":"a9e3fc1b-f6e0-4021-9ee1-5602272d25c5","Type":"ContainerStarted","Data":"32b2968a88bd7b3924d21a5cbb969bbfc5d33d0e25e5543baf91e559f38609e5"}
May 25 11:20:44.029875 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:20:44.029842    2569 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-5fcf5c8fb4-hnjs2"
May 25 11:20:44.030065 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:20:44.029891    2569 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-5fcf5c8fb4-hnjs2"
May 25 11:20:44.035461 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:20:44.035432    2569 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-5fcf5c8fb4-hnjs2"
May 25 11:20:44.386322 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:20:44.386244    2569 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-5fcf5c8fb4-hnjs2"
May 25 11:20:44.445906 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:20:44.445865    2569 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7c545bd686-l85mg"]
May 25 11:20:45.564038 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:20:45.564007    2569 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-7c545bd686-l85mg"
May 25 11:20:53.407691 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:20:53.407653    2569 generic.go:358] "Generic (PLEG): container finished" podID="742a0027-4655-4bb6-92ed-fa17bdeab56d" containerID="c86d3e74400e12a5e226ee11018f945311e7a17add7432b641ab966cc6032747" exitCode=0
May 25 11:20:53.408170 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:20:53.407730    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-78bdfb888c-rhbmv" event={"ID":"742a0027-4655-4bb6-92ed-fa17bdeab56d","Type":"ContainerDied","Data":"c86d3e74400e12a5e226ee11018f945311e7a17add7432b641ab966cc6032747"}
May 25 11:20:53.408170 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:20:53.408090    2569 scope.go:117] "RemoveContainer" containerID="c86d3e74400e12a5e226ee11018f945311e7a17add7432b641ab966cc6032747"
May 25 11:20:54.412993 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:20:54.412956    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-78bdfb888c-rhbmv" event={"ID":"742a0027-4655-4bb6-92ed-fa17bdeab56d","Type":"ContainerStarted","Data":"6e08c6a3a9fa606c25f35188fed74705cf2875a703e42f50d1bdd99576f14436"}
May 25 11:20:57.422796 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:20:57.422761    2569 generic.go:358] "Generic (PLEG): container finished" podID="959d0443-ecc0-476d-ab71-5a24bc308dee" containerID="cc58bc001423ab0ecff3b140efc1ed4575ca5777f7c864ff84b04d22cab6ce92" exitCode=0
May 25 11:20:57.423152 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:20:57.422836    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-gqxzv" event={"ID":"959d0443-ecc0-476d-ab71-5a24bc308dee","Type":"ContainerDied","Data":"cc58bc001423ab0ecff3b140efc1ed4575ca5777f7c864ff84b04d22cab6ce92"}
May 25 11:20:57.423152 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:20:57.423120    2569 scope.go:117] "RemoveContainer" containerID="cc58bc001423ab0ecff3b140efc1ed4575ca5777f7c864ff84b04d22cab6ce92"
May 25 11:20:58.427185 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:20:58.427156    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-gqxzv" event={"ID":"959d0443-ecc0-476d-ab71-5a24bc308dee","Type":"ContainerStarted","Data":"9cc655139dc9f1d24904b4956e1fcbe81fa648230bf5fb877fbfea71d36f299b"}
May 25 11:21:09.469018 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:21:09.468974    2569 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-console/console-7c545bd686-l85mg" podUID="f5097a12-0f06-43e8-9dbb-3f5fa7e19321" containerName="console" containerID="cri-o://5504d28e89b3997e8af935477f595758b856208c46aaee6d0f3cadae288591c2" gracePeriod=15
May 25 11:21:09.739873 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:21:09.739846    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-7c545bd686-l85mg_f5097a12-0f06-43e8-9dbb-3f5fa7e19321/console/0.log"
May 25 11:21:09.739978 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:21:09.739917    2569 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7c545bd686-l85mg"
May 25 11:21:09.817018 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:21:09.816994    2569 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f5097a12-0f06-43e8-9dbb-3f5fa7e19321-service-ca\") pod \"f5097a12-0f06-43e8-9dbb-3f5fa7e19321\" (UID: \"f5097a12-0f06-43e8-9dbb-3f5fa7e19321\") "
May 25 11:21:09.817159 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:21:09.817025    2569 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f5097a12-0f06-43e8-9dbb-3f5fa7e19321-oauth-serving-cert\") pod \"f5097a12-0f06-43e8-9dbb-3f5fa7e19321\" (UID: \"f5097a12-0f06-43e8-9dbb-3f5fa7e19321\") "
May 25 11:21:09.817159 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:21:09.817049    2569 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-prr9m\" (UniqueName: \"kubernetes.io/projected/f5097a12-0f06-43e8-9dbb-3f5fa7e19321-kube-api-access-prr9m\") pod \"f5097a12-0f06-43e8-9dbb-3f5fa7e19321\" (UID: \"f5097a12-0f06-43e8-9dbb-3f5fa7e19321\") "
May 25 11:21:09.817159 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:21:09.817081    2569 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f5097a12-0f06-43e8-9dbb-3f5fa7e19321-console-oauth-config\") pod \"f5097a12-0f06-43e8-9dbb-3f5fa7e19321\" (UID: \"f5097a12-0f06-43e8-9dbb-3f5fa7e19321\") "
May 25 11:21:09.817159 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:21:09.817106    2569 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f5097a12-0f06-43e8-9dbb-3f5fa7e19321-console-config\") pod \"f5097a12-0f06-43e8-9dbb-3f5fa7e19321\" (UID: \"f5097a12-0f06-43e8-9dbb-3f5fa7e19321\") "
May 25 11:21:09.817159 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:21:09.817157    2569 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f5097a12-0f06-43e8-9dbb-3f5fa7e19321-console-serving-cert\") pod \"f5097a12-0f06-43e8-9dbb-3f5fa7e19321\" (UID: \"f5097a12-0f06-43e8-9dbb-3f5fa7e19321\") "
May 25 11:21:09.817411 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:21:09.817388    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f5097a12-0f06-43e8-9dbb-3f5fa7e19321-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "f5097a12-0f06-43e8-9dbb-3f5fa7e19321" (UID: "f5097a12-0f06-43e8-9dbb-3f5fa7e19321"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 25 11:21:09.817466 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:21:09.817396    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f5097a12-0f06-43e8-9dbb-3f5fa7e19321-service-ca" (OuterVolumeSpecName: "service-ca") pod "f5097a12-0f06-43e8-9dbb-3f5fa7e19321" (UID: "f5097a12-0f06-43e8-9dbb-3f5fa7e19321"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 25 11:21:09.817615 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:21:09.817590    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f5097a12-0f06-43e8-9dbb-3f5fa7e19321-console-config" (OuterVolumeSpecName: "console-config") pod "f5097a12-0f06-43e8-9dbb-3f5fa7e19321" (UID: "f5097a12-0f06-43e8-9dbb-3f5fa7e19321"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 25 11:21:09.819329 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:21:09.819302    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f5097a12-0f06-43e8-9dbb-3f5fa7e19321-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "f5097a12-0f06-43e8-9dbb-3f5fa7e19321" (UID: "f5097a12-0f06-43e8-9dbb-3f5fa7e19321"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 25 11:21:09.819429 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:21:09.819346    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f5097a12-0f06-43e8-9dbb-3f5fa7e19321-kube-api-access-prr9m" (OuterVolumeSpecName: "kube-api-access-prr9m") pod "f5097a12-0f06-43e8-9dbb-3f5fa7e19321" (UID: "f5097a12-0f06-43e8-9dbb-3f5fa7e19321"). InnerVolumeSpecName "kube-api-access-prr9m". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 25 11:21:09.819429 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:21:09.819373    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f5097a12-0f06-43e8-9dbb-3f5fa7e19321-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "f5097a12-0f06-43e8-9dbb-3f5fa7e19321" (UID: "f5097a12-0f06-43e8-9dbb-3f5fa7e19321"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 25 11:21:09.918763 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:21:09.918734    2569 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f5097a12-0f06-43e8-9dbb-3f5fa7e19321-console-serving-cert\") on node \"ip-10-0-143-46.ec2.internal\" DevicePath \"\""
May 25 11:21:09.918763 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:21:09.918767    2569 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f5097a12-0f06-43e8-9dbb-3f5fa7e19321-service-ca\") on node \"ip-10-0-143-46.ec2.internal\" DevicePath \"\""
May 25 11:21:09.918919 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:21:09.918800    2569 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f5097a12-0f06-43e8-9dbb-3f5fa7e19321-oauth-serving-cert\") on node \"ip-10-0-143-46.ec2.internal\" DevicePath \"\""
May 25 11:21:09.918919 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:21:09.918819    2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-prr9m\" (UniqueName: \"kubernetes.io/projected/f5097a12-0f06-43e8-9dbb-3f5fa7e19321-kube-api-access-prr9m\") on node \"ip-10-0-143-46.ec2.internal\" DevicePath \"\""
May 25 11:21:09.918919 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:21:09.918835    2569 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f5097a12-0f06-43e8-9dbb-3f5fa7e19321-console-oauth-config\") on node \"ip-10-0-143-46.ec2.internal\" DevicePath \"\""
May 25 11:21:09.918919 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:21:09.918849    2569 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f5097a12-0f06-43e8-9dbb-3f5fa7e19321-console-config\") on node \"ip-10-0-143-46.ec2.internal\" DevicePath \"\""
May 25 11:21:10.467180 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:21:10.467154    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-7c545bd686-l85mg_f5097a12-0f06-43e8-9dbb-3f5fa7e19321/console/0.log"
May 25 11:21:10.467355 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:21:10.467190    2569 generic.go:358] "Generic (PLEG): container finished" podID="f5097a12-0f06-43e8-9dbb-3f5fa7e19321" containerID="5504d28e89b3997e8af935477f595758b856208c46aaee6d0f3cadae288591c2" exitCode=2
May 25 11:21:10.467355 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:21:10.467225    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7c545bd686-l85mg" event={"ID":"f5097a12-0f06-43e8-9dbb-3f5fa7e19321","Type":"ContainerDied","Data":"5504d28e89b3997e8af935477f595758b856208c46aaee6d0f3cadae288591c2"}
May 25 11:21:10.467355 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:21:10.467249    2569 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7c545bd686-l85mg"
May 25 11:21:10.467355 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:21:10.467271    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7c545bd686-l85mg" event={"ID":"f5097a12-0f06-43e8-9dbb-3f5fa7e19321","Type":"ContainerDied","Data":"ae16a2bc28018767a2d7dacae6440d5a1114fca1214a06048a037c8bf3392910"}
May 25 11:21:10.467355 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:21:10.467292    2569 scope.go:117] "RemoveContainer" containerID="5504d28e89b3997e8af935477f595758b856208c46aaee6d0f3cadae288591c2"
May 25 11:21:10.478739 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:21:10.478279    2569 scope.go:117] "RemoveContainer" containerID="5504d28e89b3997e8af935477f595758b856208c46aaee6d0f3cadae288591c2"
May 25 11:21:10.478991 ip-10-0-143-46 kubenswrapper[2569]: E0525 11:21:10.478870    2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5504d28e89b3997e8af935477f595758b856208c46aaee6d0f3cadae288591c2\": container with ID starting with 5504d28e89b3997e8af935477f595758b856208c46aaee6d0f3cadae288591c2 not found: ID does not exist" containerID="5504d28e89b3997e8af935477f595758b856208c46aaee6d0f3cadae288591c2"
May 25 11:21:10.478991 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:21:10.478898    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5504d28e89b3997e8af935477f595758b856208c46aaee6d0f3cadae288591c2"} err="failed to get container status \"5504d28e89b3997e8af935477f595758b856208c46aaee6d0f3cadae288591c2\": rpc error: code = NotFound desc = could not find container \"5504d28e89b3997e8af935477f595758b856208c46aaee6d0f3cadae288591c2\": container with ID starting with 5504d28e89b3997e8af935477f595758b856208c46aaee6d0f3cadae288591c2 not found: ID does not exist"
May 25 11:21:10.490907 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:21:10.490886    2569 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7c545bd686-l85mg"]
May 25 11:21:10.497206 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:21:10.497187    2569 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-7c545bd686-l85mg"]
May 25 11:21:11.729042 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:21:11.729008    2569 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f5097a12-0f06-43e8-9dbb-3f5fa7e19321" path="/var/lib/kubelet/pods/f5097a12-0f06-43e8-9dbb-3f5fa7e19321/volumes"
May 25 11:21:26.550551 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:21:26.550516    2569 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-console/console-6969d9c8bc-8x4mh"]
May 25 11:21:26.551347 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:21:26.551326    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f5097a12-0f06-43e8-9dbb-3f5fa7e19321" containerName="console"
May 25 11:21:26.551347 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:21:26.551349    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="f5097a12-0f06-43e8-9dbb-3f5fa7e19321" containerName="console"
May 25 11:21:26.551514 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:21:26.551423    2569 memory_manager.go:356] "RemoveStaleState removing state" podUID="f5097a12-0f06-43e8-9dbb-3f5fa7e19321" containerName="console"
May 25 11:21:26.554938 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:21:26.554912    2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6969d9c8bc-8x4mh"
May 25 11:21:26.567081 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:21:26.567052    2569 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6969d9c8bc-8x4mh"]
May 25 11:21:26.659895 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:21:26.659861    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/76b3d6de-9b17-4f76-966d-4b616c0294a9-console-serving-cert\") pod \"console-6969d9c8bc-8x4mh\" (UID: \"76b3d6de-9b17-4f76-966d-4b616c0294a9\") " pod="openshift-console/console-6969d9c8bc-8x4mh"
May 25 11:21:26.660050 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:21:26.659902    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/76b3d6de-9b17-4f76-966d-4b616c0294a9-console-oauth-config\") pod \"console-6969d9c8bc-8x4mh\" (UID: \"76b3d6de-9b17-4f76-966d-4b616c0294a9\") " pod="openshift-console/console-6969d9c8bc-8x4mh"
May 25 11:21:26.660050 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:21:26.659925    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/76b3d6de-9b17-4f76-966d-4b616c0294a9-trusted-ca-bundle\") pod \"console-6969d9c8bc-8x4mh\" (UID: \"76b3d6de-9b17-4f76-966d-4b616c0294a9\") " pod="openshift-console/console-6969d9c8bc-8x4mh"
May 25 11:21:26.660050 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:21:26.660023    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/76b3d6de-9b17-4f76-966d-4b616c0294a9-service-ca\") pod \"console-6969d9c8bc-8x4mh\" (UID: \"76b3d6de-9b17-4f76-966d-4b616c0294a9\") " pod="openshift-console/console-6969d9c8bc-8x4mh"
May 25 11:21:26.660199 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:21:26.660062    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/76b3d6de-9b17-4f76-966d-4b616c0294a9-console-config\") pod \"console-6969d9c8bc-8x4mh\" (UID: \"76b3d6de-9b17-4f76-966d-4b616c0294a9\") " pod="openshift-console/console-6969d9c8bc-8x4mh"
May 25 11:21:26.660199 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:21:26.660107    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7ktzt\" (UniqueName: \"kubernetes.io/projected/76b3d6de-9b17-4f76-966d-4b616c0294a9-kube-api-access-7ktzt\") pod \"console-6969d9c8bc-8x4mh\" (UID: \"76b3d6de-9b17-4f76-966d-4b616c0294a9\") " pod="openshift-console/console-6969d9c8bc-8x4mh"
May 25 11:21:26.660199 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:21:26.660140    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/76b3d6de-9b17-4f76-966d-4b616c0294a9-oauth-serving-cert\") pod \"console-6969d9c8bc-8x4mh\" (UID: \"76b3d6de-9b17-4f76-966d-4b616c0294a9\") " pod="openshift-console/console-6969d9c8bc-8x4mh"
May 25 11:21:26.761502 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:21:26.761471    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/76b3d6de-9b17-4f76-966d-4b616c0294a9-oauth-serving-cert\") pod \"console-6969d9c8bc-8x4mh\" (UID: \"76b3d6de-9b17-4f76-966d-4b616c0294a9\") " pod="openshift-console/console-6969d9c8bc-8x4mh"
May 25 11:21:26.761647 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:21:26.761513    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/76b3d6de-9b17-4f76-966d-4b616c0294a9-console-serving-cert\") pod \"console-6969d9c8bc-8x4mh\" (UID: \"76b3d6de-9b17-4f76-966d-4b616c0294a9\") " pod="openshift-console/console-6969d9c8bc-8x4mh"
May 25 11:21:26.761647 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:21:26.761631    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/76b3d6de-9b17-4f76-966d-4b616c0294a9-console-oauth-config\") pod \"console-6969d9c8bc-8x4mh\" (UID: \"76b3d6de-9b17-4f76-966d-4b616c0294a9\") " pod="openshift-console/console-6969d9c8bc-8x4mh"
May 25 11:21:26.761724 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:21:26.761667    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/76b3d6de-9b17-4f76-966d-4b616c0294a9-trusted-ca-bundle\") pod \"console-6969d9c8bc-8x4mh\" (UID: \"76b3d6de-9b17-4f76-966d-4b616c0294a9\") " pod="openshift-console/console-6969d9c8bc-8x4mh"
May 25 11:21:26.761724 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:21:26.761712    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/76b3d6de-9b17-4f76-966d-4b616c0294a9-service-ca\") pod \"console-6969d9c8bc-8x4mh\" (UID: \"76b3d6de-9b17-4f76-966d-4b616c0294a9\") " pod="openshift-console/console-6969d9c8bc-8x4mh"
May 25 11:21:26.761846 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:21:26.761734    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/76b3d6de-9b17-4f76-966d-4b616c0294a9-console-config\") pod \"console-6969d9c8bc-8x4mh\" (UID: \"76b3d6de-9b17-4f76-966d-4b616c0294a9\") " pod="openshift-console/console-6969d9c8bc-8x4mh"
May 25 11:21:26.761846 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:21:26.761777    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-7ktzt\" (UniqueName: \"kubernetes.io/projected/76b3d6de-9b17-4f76-966d-4b616c0294a9-kube-api-access-7ktzt\") pod \"console-6969d9c8bc-8x4mh\" (UID: \"76b3d6de-9b17-4f76-966d-4b616c0294a9\") " pod="openshift-console/console-6969d9c8bc-8x4mh"
May 25 11:21:26.762384 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:21:26.762353    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/76b3d6de-9b17-4f76-966d-4b616c0294a9-oauth-serving-cert\") pod \"console-6969d9c8bc-8x4mh\" (UID: \"76b3d6de-9b17-4f76-966d-4b616c0294a9\") " pod="openshift-console/console-6969d9c8bc-8x4mh"
May 25 11:21:26.762537 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:21:26.762500    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/76b3d6de-9b17-4f76-966d-4b616c0294a9-service-ca\") pod \"console-6969d9c8bc-8x4mh\" (UID: \"76b3d6de-9b17-4f76-966d-4b616c0294a9\") " pod="openshift-console/console-6969d9c8bc-8x4mh"
May 25 11:21:26.762614 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:21:26.762511    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/76b3d6de-9b17-4f76-966d-4b616c0294a9-console-config\") pod \"console-6969d9c8bc-8x4mh\" (UID: \"76b3d6de-9b17-4f76-966d-4b616c0294a9\") " pod="openshift-console/console-6969d9c8bc-8x4mh"
May 25 11:21:26.762675 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:21:26.762655    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/76b3d6de-9b17-4f76-966d-4b616c0294a9-trusted-ca-bundle\") pod \"console-6969d9c8bc-8x4mh\" (UID: \"76b3d6de-9b17-4f76-966d-4b616c0294a9\") " pod="openshift-console/console-6969d9c8bc-8x4mh"
May 25 11:21:26.764119 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:21:26.764089    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/76b3d6de-9b17-4f76-966d-4b616c0294a9-console-serving-cert\") pod \"console-6969d9c8bc-8x4mh\" (UID: \"76b3d6de-9b17-4f76-966d-4b616c0294a9\") " pod="openshift-console/console-6969d9c8bc-8x4mh"
May 25 11:21:26.764211 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:21:26.764164    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/76b3d6de-9b17-4f76-966d-4b616c0294a9-console-oauth-config\") pod \"console-6969d9c8bc-8x4mh\" (UID: \"76b3d6de-9b17-4f76-966d-4b616c0294a9\") " pod="openshift-console/console-6969d9c8bc-8x4mh"
May 25 11:21:26.770123 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:21:26.770106    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7ktzt\" (UniqueName: \"kubernetes.io/projected/76b3d6de-9b17-4f76-966d-4b616c0294a9-kube-api-access-7ktzt\") pod \"console-6969d9c8bc-8x4mh\" (UID: \"76b3d6de-9b17-4f76-966d-4b616c0294a9\") " pod="openshift-console/console-6969d9c8bc-8x4mh"
May 25 11:21:26.863866 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:21:26.863805    2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6969d9c8bc-8x4mh"
May 25 11:21:26.994700 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:21:26.994596    2569 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6969d9c8bc-8x4mh"]
May 25 11:21:26.997287 ip-10-0-143-46 kubenswrapper[2569]: W0525 11:21:26.997260    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod76b3d6de_9b17_4f76_966d_4b616c0294a9.slice/crio-a31b40b461c959f42fb34d166bd67932b742c7f1a8127a7923d32d7e6bd949ca WatchSource:0}: Error finding container a31b40b461c959f42fb34d166bd67932b742c7f1a8127a7923d32d7e6bd949ca: Status 404 returned error can't find the container with id a31b40b461c959f42fb34d166bd67932b742c7f1a8127a7923d32d7e6bd949ca
May 25 11:21:27.523895 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:21:27.523861    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6969d9c8bc-8x4mh" event={"ID":"76b3d6de-9b17-4f76-966d-4b616c0294a9","Type":"ContainerStarted","Data":"55e319117aa71c745f947e2d48f87927d6b5bb531004674bc36fea25c507ca5c"}
May 25 11:21:27.523895 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:21:27.523893    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6969d9c8bc-8x4mh" event={"ID":"76b3d6de-9b17-4f76-966d-4b616c0294a9","Type":"ContainerStarted","Data":"a31b40b461c959f42fb34d166bd67932b742c7f1a8127a7923d32d7e6bd949ca"}
May 25 11:21:27.542476 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:21:27.542428    2569 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-console/console-6969d9c8bc-8x4mh" podStartSLOduration=1.54241389 podStartE2EDuration="1.54241389s" podCreationTimestamp="2026-05-25 11:21:26 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-25 11:21:27.541274331 +0000 UTC m=+226.402898734" watchObservedRunningTime="2026-05-25 11:21:27.54241389 +0000 UTC m=+226.404038273"
May 25 11:21:36.864909 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:21:36.864877    2569 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-6969d9c8bc-8x4mh"
May 25 11:21:36.865339 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:21:36.864919    2569 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-6969d9c8bc-8x4mh"
May 25 11:21:36.869415 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:21:36.869393    2569 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-6969d9c8bc-8x4mh"
May 25 11:21:37.558298 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:21:37.558273    2569 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-6969d9c8bc-8x4mh"
May 25 11:21:37.608444 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:21:37.608415    2569 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5fcf5c8fb4-hnjs2"]
May 25 11:22:02.628940 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:22:02.628843    2569 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-console/console-5fcf5c8fb4-hnjs2" podUID="8d1a3110-8ae8-441c-808a-e2f23d831022" containerName="console" containerID="cri-o://a0ecf4bd633231b7e488962f854d8bef44837711722b09fdfa6208d863f61041" gracePeriod=15
May 25 11:22:02.870052 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:22:02.870030    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-5fcf5c8fb4-hnjs2_8d1a3110-8ae8-441c-808a-e2f23d831022/console/0.log"
May 25 11:22:02.870170 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:22:02.870092    2569 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5fcf5c8fb4-hnjs2"
May 25 11:22:02.940236 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:22:02.940174    2569 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/8d1a3110-8ae8-441c-808a-e2f23d831022-oauth-serving-cert\") pod \"8d1a3110-8ae8-441c-808a-e2f23d831022\" (UID: \"8d1a3110-8ae8-441c-808a-e2f23d831022\") "
May 25 11:22:02.940236 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:22:02.940220    2569 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/8d1a3110-8ae8-441c-808a-e2f23d831022-console-serving-cert\") pod \"8d1a3110-8ae8-441c-808a-e2f23d831022\" (UID: \"8d1a3110-8ae8-441c-808a-e2f23d831022\") "
May 25 11:22:02.940388 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:22:02.940348    2569 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8d1a3110-8ae8-441c-808a-e2f23d831022-trusted-ca-bundle\") pod \"8d1a3110-8ae8-441c-808a-e2f23d831022\" (UID: \"8d1a3110-8ae8-441c-808a-e2f23d831022\") "
May 25 11:22:02.940429 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:22:02.940402    2569 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/8d1a3110-8ae8-441c-808a-e2f23d831022-console-config\") pod \"8d1a3110-8ae8-441c-808a-e2f23d831022\" (UID: \"8d1a3110-8ae8-441c-808a-e2f23d831022\") "
May 25 11:22:02.940473 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:22:02.940445    2569 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/8d1a3110-8ae8-441c-808a-e2f23d831022-console-oauth-config\") pod \"8d1a3110-8ae8-441c-808a-e2f23d831022\" (UID: \"8d1a3110-8ae8-441c-808a-e2f23d831022\") "
May 25 11:22:02.940514 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:22:02.940478    2569 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/8d1a3110-8ae8-441c-808a-e2f23d831022-service-ca\") pod \"8d1a3110-8ae8-441c-808a-e2f23d831022\" (UID: \"8d1a3110-8ae8-441c-808a-e2f23d831022\") "
May 25 11:22:02.940567 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:22:02.940518    2569 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5rc4w\" (UniqueName: \"kubernetes.io/projected/8d1a3110-8ae8-441c-808a-e2f23d831022-kube-api-access-5rc4w\") pod \"8d1a3110-8ae8-441c-808a-e2f23d831022\" (UID: \"8d1a3110-8ae8-441c-808a-e2f23d831022\") "
May 25 11:22:02.940679 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:22:02.940656    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8d1a3110-8ae8-441c-808a-e2f23d831022-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "8d1a3110-8ae8-441c-808a-e2f23d831022" (UID: "8d1a3110-8ae8-441c-808a-e2f23d831022"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 25 11:22:02.940757 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:22:02.940727    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8d1a3110-8ae8-441c-808a-e2f23d831022-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "8d1a3110-8ae8-441c-808a-e2f23d831022" (UID: "8d1a3110-8ae8-441c-808a-e2f23d831022"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 25 11:22:02.940842 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:22:02.940801    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8d1a3110-8ae8-441c-808a-e2f23d831022-console-config" (OuterVolumeSpecName: "console-config") pod "8d1a3110-8ae8-441c-808a-e2f23d831022" (UID: "8d1a3110-8ae8-441c-808a-e2f23d831022"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 25 11:22:02.940894 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:22:02.940860    2569 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/8d1a3110-8ae8-441c-808a-e2f23d831022-oauth-serving-cert\") on node \"ip-10-0-143-46.ec2.internal\" DevicePath \"\""
May 25 11:22:02.940894 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:22:02.940881    2569 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8d1a3110-8ae8-441c-808a-e2f23d831022-trusted-ca-bundle\") on node \"ip-10-0-143-46.ec2.internal\" DevicePath \"\""
May 25 11:22:02.940894 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:22:02.940883    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8d1a3110-8ae8-441c-808a-e2f23d831022-service-ca" (OuterVolumeSpecName: "service-ca") pod "8d1a3110-8ae8-441c-808a-e2f23d831022" (UID: "8d1a3110-8ae8-441c-808a-e2f23d831022"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 25 11:22:02.942565 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:22:02.942533    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8d1a3110-8ae8-441c-808a-e2f23d831022-kube-api-access-5rc4w" (OuterVolumeSpecName: "kube-api-access-5rc4w") pod "8d1a3110-8ae8-441c-808a-e2f23d831022" (UID: "8d1a3110-8ae8-441c-808a-e2f23d831022"). InnerVolumeSpecName "kube-api-access-5rc4w". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 25 11:22:02.942908 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:22:02.942888    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8d1a3110-8ae8-441c-808a-e2f23d831022-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "8d1a3110-8ae8-441c-808a-e2f23d831022" (UID: "8d1a3110-8ae8-441c-808a-e2f23d831022"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 25 11:22:02.943053 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:22:02.943032    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8d1a3110-8ae8-441c-808a-e2f23d831022-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "8d1a3110-8ae8-441c-808a-e2f23d831022" (UID: "8d1a3110-8ae8-441c-808a-e2f23d831022"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 25 11:22:03.042235 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:22:03.042207    2569 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/8d1a3110-8ae8-441c-808a-e2f23d831022-console-oauth-config\") on node \"ip-10-0-143-46.ec2.internal\" DevicePath \"\""
May 25 11:22:03.042235 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:22:03.042233    2569 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/8d1a3110-8ae8-441c-808a-e2f23d831022-service-ca\") on node \"ip-10-0-143-46.ec2.internal\" DevicePath \"\""
May 25 11:22:03.042235 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:22:03.042243    2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5rc4w\" (UniqueName: \"kubernetes.io/projected/8d1a3110-8ae8-441c-808a-e2f23d831022-kube-api-access-5rc4w\") on node \"ip-10-0-143-46.ec2.internal\" DevicePath \"\""
May 25 11:22:03.042409 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:22:03.042252    2569 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/8d1a3110-8ae8-441c-808a-e2f23d831022-console-serving-cert\") on node \"ip-10-0-143-46.ec2.internal\" DevicePath \"\""
May 25 11:22:03.042409 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:22:03.042262    2569 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/8d1a3110-8ae8-441c-808a-e2f23d831022-console-config\") on node \"ip-10-0-143-46.ec2.internal\" DevicePath \"\""
May 25 11:22:03.629225 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:22:03.629201    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-5fcf5c8fb4-hnjs2_8d1a3110-8ae8-441c-808a-e2f23d831022/console/0.log"
May 25 11:22:03.629684 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:22:03.629238    2569 generic.go:358] "Generic (PLEG): container finished" podID="8d1a3110-8ae8-441c-808a-e2f23d831022" containerID="a0ecf4bd633231b7e488962f854d8bef44837711722b09fdfa6208d863f61041" exitCode=2
May 25 11:22:03.629684 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:22:03.629275    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5fcf5c8fb4-hnjs2" event={"ID":"8d1a3110-8ae8-441c-808a-e2f23d831022","Type":"ContainerDied","Data":"a0ecf4bd633231b7e488962f854d8bef44837711722b09fdfa6208d863f61041"}
May 25 11:22:03.629684 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:22:03.629298    2569 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5fcf5c8fb4-hnjs2"
May 25 11:22:03.629684 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:22:03.629320    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5fcf5c8fb4-hnjs2" event={"ID":"8d1a3110-8ae8-441c-808a-e2f23d831022","Type":"ContainerDied","Data":"0dbfe4d536f5165e0205510a9885e469334e39e818c703070fc4fb8a80a05411"}
May 25 11:22:03.629684 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:22:03.629342    2569 scope.go:117] "RemoveContainer" containerID="a0ecf4bd633231b7e488962f854d8bef44837711722b09fdfa6208d863f61041"
May 25 11:22:03.637415 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:22:03.637398    2569 scope.go:117] "RemoveContainer" containerID="a0ecf4bd633231b7e488962f854d8bef44837711722b09fdfa6208d863f61041"
May 25 11:22:03.637680 ip-10-0-143-46 kubenswrapper[2569]: E0525 11:22:03.637660    2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a0ecf4bd633231b7e488962f854d8bef44837711722b09fdfa6208d863f61041\": container with ID starting with a0ecf4bd633231b7e488962f854d8bef44837711722b09fdfa6208d863f61041 not found: ID does not exist" containerID="a0ecf4bd633231b7e488962f854d8bef44837711722b09fdfa6208d863f61041"
May 25 11:22:03.637730 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:22:03.637688    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a0ecf4bd633231b7e488962f854d8bef44837711722b09fdfa6208d863f61041"} err="failed to get container status \"a0ecf4bd633231b7e488962f854d8bef44837711722b09fdfa6208d863f61041\": rpc error: code = NotFound desc = could not find container \"a0ecf4bd633231b7e488962f854d8bef44837711722b09fdfa6208d863f61041\": container with ID starting with a0ecf4bd633231b7e488962f854d8bef44837711722b09fdfa6208d863f61041 not found: ID does not exist"
May 25 11:22:03.651049 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:22:03.651025    2569 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5fcf5c8fb4-hnjs2"]
May 25 11:22:03.659726 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:22:03.659707    2569 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-5fcf5c8fb4-hnjs2"]
May 25 11:22:03.729326 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:22:03.729303    2569 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8d1a3110-8ae8-441c-808a-e2f23d831022" path="/var/lib/kubelet/pods/8d1a3110-8ae8-441c-808a-e2f23d831022/volumes"
May 25 11:22:09.625125 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:22:09.625090    2569 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kube-system/global-pull-secret-syncer-6dhqr"]
May 25 11:22:09.625570 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:22:09.625529    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8d1a3110-8ae8-441c-808a-e2f23d831022" containerName="console"
May 25 11:22:09.625570 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:22:09.625547    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="8d1a3110-8ae8-441c-808a-e2f23d831022" containerName="console"
May 25 11:22:09.625687 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:22:09.625660    2569 memory_manager.go:356] "RemoveStaleState removing state" podUID="8d1a3110-8ae8-441c-808a-e2f23d831022" containerName="console"
May 25 11:22:09.627367 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:22:09.627347    2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6dhqr"
May 25 11:22:09.629840 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:22:09.629819    2569 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
May 25 11:22:09.635672 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:22:09.635641    2569 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-6dhqr"]
May 25 11:22:09.693749 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:22:09.693726    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/7a749caf-71aa-4d7e-a3c4-93908241e5df-kubelet-config\") pod \"global-pull-secret-syncer-6dhqr\" (UID: \"7a749caf-71aa-4d7e-a3c4-93908241e5df\") " pod="kube-system/global-pull-secret-syncer-6dhqr"
May 25 11:22:09.693893 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:22:09.693817    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/7a749caf-71aa-4d7e-a3c4-93908241e5df-dbus\") pod \"global-pull-secret-syncer-6dhqr\" (UID: \"7a749caf-71aa-4d7e-a3c4-93908241e5df\") " pod="kube-system/global-pull-secret-syncer-6dhqr"
May 25 11:22:09.693893 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:22:09.693848    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7a749caf-71aa-4d7e-a3c4-93908241e5df-original-pull-secret\") pod \"global-pull-secret-syncer-6dhqr\" (UID: \"7a749caf-71aa-4d7e-a3c4-93908241e5df\") " pod="kube-system/global-pull-secret-syncer-6dhqr"
May 25 11:22:09.795056 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:22:09.795030    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/7a749caf-71aa-4d7e-a3c4-93908241e5df-dbus\") pod \"global-pull-secret-syncer-6dhqr\" (UID: \"7a749caf-71aa-4d7e-a3c4-93908241e5df\") " pod="kube-system/global-pull-secret-syncer-6dhqr"
May 25 11:22:09.795179 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:22:09.795088    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7a749caf-71aa-4d7e-a3c4-93908241e5df-original-pull-secret\") pod \"global-pull-secret-syncer-6dhqr\" (UID: \"7a749caf-71aa-4d7e-a3c4-93908241e5df\") " pod="kube-system/global-pull-secret-syncer-6dhqr"
May 25 11:22:09.795257 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:22:09.795171    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/7a749caf-71aa-4d7e-a3c4-93908241e5df-kubelet-config\") pod \"global-pull-secret-syncer-6dhqr\" (UID: \"7a749caf-71aa-4d7e-a3c4-93908241e5df\") " pod="kube-system/global-pull-secret-syncer-6dhqr"
May 25 11:22:09.795257 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:22:09.795236    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/7a749caf-71aa-4d7e-a3c4-93908241e5df-dbus\") pod \"global-pull-secret-syncer-6dhqr\" (UID: \"7a749caf-71aa-4d7e-a3c4-93908241e5df\") " pod="kube-system/global-pull-secret-syncer-6dhqr"
May 25 11:22:09.795360 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:22:09.795289    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/7a749caf-71aa-4d7e-a3c4-93908241e5df-kubelet-config\") pod \"global-pull-secret-syncer-6dhqr\" (UID: \"7a749caf-71aa-4d7e-a3c4-93908241e5df\") " pod="kube-system/global-pull-secret-syncer-6dhqr"
May 25 11:22:09.797310 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:22:09.797290    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7a749caf-71aa-4d7e-a3c4-93908241e5df-original-pull-secret\") pod \"global-pull-secret-syncer-6dhqr\" (UID: \"7a749caf-71aa-4d7e-a3c4-93908241e5df\") " pod="kube-system/global-pull-secret-syncer-6dhqr"
May 25 11:22:09.936672 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:22:09.936612    2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6dhqr"
May 25 11:22:10.063002 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:22:10.062852    2569 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-6dhqr"]
May 25 11:22:10.065116 ip-10-0-143-46 kubenswrapper[2569]: W0525 11:22:10.065085    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7a749caf_71aa_4d7e_a3c4_93908241e5df.slice/crio-4cb65d637d6fb1999f1e2076ffdb5db2aaea180a289bbbd5af524158d31b5715 WatchSource:0}: Error finding container 4cb65d637d6fb1999f1e2076ffdb5db2aaea180a289bbbd5af524158d31b5715: Status 404 returned error can't find the container with id 4cb65d637d6fb1999f1e2076ffdb5db2aaea180a289bbbd5af524158d31b5715
May 25 11:22:10.653248 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:22:10.653208    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-6dhqr" event={"ID":"7a749caf-71aa-4d7e-a3c4-93908241e5df","Type":"ContainerStarted","Data":"4cb65d637d6fb1999f1e2076ffdb5db2aaea180a289bbbd5af524158d31b5715"}
May 25 11:22:14.667091 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:22:14.667054    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-6dhqr" event={"ID":"7a749caf-71aa-4d7e-a3c4-93908241e5df","Type":"ContainerStarted","Data":"a677c55cf95519f82c913f4d1871a8aae9f192f96a2b8ebc59481e9d10c7f9a0"}
May 25 11:22:14.684485 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:22:14.684433    2569 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-6dhqr" podStartSLOduration=1.899696665 podStartE2EDuration="5.684415399s" podCreationTimestamp="2026-05-25 11:22:09 +0000 UTC" firstStartedPulling="2026-05-25 11:22:10.066843865 +0000 UTC m=+268.928468228" lastFinishedPulling="2026-05-25 11:22:13.8515626 +0000 UTC m=+272.713186962" observedRunningTime="2026-05-25 11:22:14.683083721 +0000 UTC m=+273.544708105" watchObservedRunningTime="2026-05-25 11:22:14.684415399 +0000 UTC m=+273.546039783"
May 25 11:22:41.606325 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:22:41.606291    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-cvhbj_9ff9f77a-ac83-4250-8c40-d14a2db84c1e/console-operator/2.log"
May 25 11:22:41.606853 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:22:41.606560    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-cvhbj_9ff9f77a-ac83-4250-8c40-d14a2db84c1e/console-operator/2.log"
May 25 11:22:41.618935 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:22:41.618917    2569 kubelet.go:1628] "Image garbage collection succeeded"
May 25 11:22:57.438778 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:22:57.438744    2569 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-keda/custom-metrics-autoscaler-operator-bbf89fd5d-2m6sr"]
May 25 11:22:57.440608 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:22:57.440595    2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-keda/custom-metrics-autoscaler-operator-bbf89fd5d-2m6sr"
May 25 11:22:57.443589 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:22:57.443563    2569 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-keda\"/\"kedaorg-certs\""
May 25 11:22:57.443716 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:22:57.443647    2569 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-keda\"/\"kube-root-ca.crt\""
May 25 11:22:57.443716 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:22:57.443635    2569 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-keda\"/\"custom-metrics-autoscaler-operator-dockercfg-2j8lb\""
May 25 11:22:57.444019 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:22:57.444004    2569 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-keda\"/\"openshift-service-ca.crt\""
May 25 11:22:57.453501 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:22:57.453481    2569 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-keda/custom-metrics-autoscaler-operator-bbf89fd5d-2m6sr"]
May 25 11:22:57.453798 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:22:57.453762    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-shp6r\" (UniqueName: \"kubernetes.io/projected/4b5a3610-e3a1-479b-933c-9a30d4cdb589-kube-api-access-shp6r\") pod \"custom-metrics-autoscaler-operator-bbf89fd5d-2m6sr\" (UID: \"4b5a3610-e3a1-479b-933c-9a30d4cdb589\") " pod="openshift-keda/custom-metrics-autoscaler-operator-bbf89fd5d-2m6sr"
May 25 11:22:57.453866 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:22:57.453838    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/secret/4b5a3610-e3a1-479b-933c-9a30d4cdb589-certificates\") pod \"custom-metrics-autoscaler-operator-bbf89fd5d-2m6sr\" (UID: \"4b5a3610-e3a1-479b-933c-9a30d4cdb589\") " pod="openshift-keda/custom-metrics-autoscaler-operator-bbf89fd5d-2m6sr"
May 25 11:22:57.554144 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:22:57.554116    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-shp6r\" (UniqueName: \"kubernetes.io/projected/4b5a3610-e3a1-479b-933c-9a30d4cdb589-kube-api-access-shp6r\") pod \"custom-metrics-autoscaler-operator-bbf89fd5d-2m6sr\" (UID: \"4b5a3610-e3a1-479b-933c-9a30d4cdb589\") " pod="openshift-keda/custom-metrics-autoscaler-operator-bbf89fd5d-2m6sr"
May 25 11:22:57.554264 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:22:57.554160    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/secret/4b5a3610-e3a1-479b-933c-9a30d4cdb589-certificates\") pod \"custom-metrics-autoscaler-operator-bbf89fd5d-2m6sr\" (UID: \"4b5a3610-e3a1-479b-933c-9a30d4cdb589\") " pod="openshift-keda/custom-metrics-autoscaler-operator-bbf89fd5d-2m6sr"
May 25 11:22:57.556616 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:22:57.556591    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"certificates\" (UniqueName: \"kubernetes.io/secret/4b5a3610-e3a1-479b-933c-9a30d4cdb589-certificates\") pod \"custom-metrics-autoscaler-operator-bbf89fd5d-2m6sr\" (UID: \"4b5a3610-e3a1-479b-933c-9a30d4cdb589\") " pod="openshift-keda/custom-metrics-autoscaler-operator-bbf89fd5d-2m6sr"
May 25 11:22:57.564663 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:22:57.564642    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-shp6r\" (UniqueName: \"kubernetes.io/projected/4b5a3610-e3a1-479b-933c-9a30d4cdb589-kube-api-access-shp6r\") pod \"custom-metrics-autoscaler-operator-bbf89fd5d-2m6sr\" (UID: \"4b5a3610-e3a1-479b-933c-9a30d4cdb589\") " pod="openshift-keda/custom-metrics-autoscaler-operator-bbf89fd5d-2m6sr"
May 25 11:22:57.750865 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:22:57.750806    2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-keda/custom-metrics-autoscaler-operator-bbf89fd5d-2m6sr"
May 25 11:22:57.877972 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:22:57.877922    2569 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-keda/custom-metrics-autoscaler-operator-bbf89fd5d-2m6sr"]
May 25 11:22:57.882505 ip-10-0-143-46 kubenswrapper[2569]: W0525 11:22:57.882483    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4b5a3610_e3a1_479b_933c_9a30d4cdb589.slice/crio-ee1cdf7402c419219e68ba7d906114e3abb75e5aa125fcf8d1f0fab273c3ae90 WatchSource:0}: Error finding container ee1cdf7402c419219e68ba7d906114e3abb75e5aa125fcf8d1f0fab273c3ae90: Status 404 returned error can't find the container with id ee1cdf7402c419219e68ba7d906114e3abb75e5aa125fcf8d1f0fab273c3ae90
May 25 11:22:57.884841 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:22:57.884822    2569 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
May 25 11:22:58.791174 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:22:58.791116    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-keda/custom-metrics-autoscaler-operator-bbf89fd5d-2m6sr" event={"ID":"4b5a3610-e3a1-479b-933c-9a30d4cdb589","Type":"ContainerStarted","Data":"ee1cdf7402c419219e68ba7d906114e3abb75e5aa125fcf8d1f0fab273c3ae90"}
May 25 11:23:01.804566 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:23:01.804532    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-keda/custom-metrics-autoscaler-operator-bbf89fd5d-2m6sr" event={"ID":"4b5a3610-e3a1-479b-933c-9a30d4cdb589","Type":"ContainerStarted","Data":"32dcf4554893df7d7e8e7048ee204fff1195943ce6c80341c790536537f4aadd"}
May 25 11:23:01.804950 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:23:01.804662    2569 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-keda/custom-metrics-autoscaler-operator-bbf89fd5d-2m6sr"
May 25 11:23:01.826362 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:23:01.826318    2569 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-keda/custom-metrics-autoscaler-operator-bbf89fd5d-2m6sr" podStartSLOduration=1.291216335 podStartE2EDuration="4.826308017s" podCreationTimestamp="2026-05-25 11:22:57 +0000 UTC" firstStartedPulling="2026-05-25 11:22:57.884985543 +0000 UTC m=+316.746609905" lastFinishedPulling="2026-05-25 11:23:01.420077211 +0000 UTC m=+320.281701587" observedRunningTime="2026-05-25 11:23:01.825587635 +0000 UTC m=+320.687212019" watchObservedRunningTime="2026-05-25 11:23:01.826308017 +0000 UTC m=+320.687932401"
May 25 11:23:02.205686 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:23:02.205597    2569 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-keda/keda-operator-ffbb595cb-69252"]
May 25 11:23:02.208868 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:23:02.208852    2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-keda/keda-operator-ffbb595cb-69252"
May 25 11:23:02.211994 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:23:02.211965    2569 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-keda\"/\"keda-operator-certs\""
May 25 11:23:02.218527 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:23:02.218510    2569 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-keda\"/\"keda-ocp-cabundle\""
May 25 11:23:02.218740 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:23:02.218726    2569 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-keda\"/\"keda-operator-dockercfg-mxfqp\""
May 25 11:23:02.248825 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:23:02.248780    2569 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-keda/keda-operator-ffbb595cb-69252"]
May 25 11:23:02.297160 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:23:02.297133    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mlhfn\" (UniqueName: \"kubernetes.io/projected/c5254776-19e3-4290-8552-587cc03e267b-kube-api-access-mlhfn\") pod \"keda-operator-ffbb595cb-69252\" (UID: \"c5254776-19e3-4290-8552-587cc03e267b\") " pod="openshift-keda/keda-operator-ffbb595cb-69252"
May 25 11:23:02.297265 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:23:02.297189    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/c5254776-19e3-4290-8552-587cc03e267b-certificates\") pod \"keda-operator-ffbb595cb-69252\" (UID: \"c5254776-19e3-4290-8552-587cc03e267b\") " pod="openshift-keda/keda-operator-ffbb595cb-69252"
May 25 11:23:02.297318 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:23:02.297286    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cabundle0\" (UniqueName: \"kubernetes.io/configmap/c5254776-19e3-4290-8552-587cc03e267b-cabundle0\") pod \"keda-operator-ffbb595cb-69252\" (UID: \"c5254776-19e3-4290-8552-587cc03e267b\") " pod="openshift-keda/keda-operator-ffbb595cb-69252"
May 25 11:23:02.398477 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:23:02.398446    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cabundle0\" (UniqueName: \"kubernetes.io/configmap/c5254776-19e3-4290-8552-587cc03e267b-cabundle0\") pod \"keda-operator-ffbb595cb-69252\" (UID: \"c5254776-19e3-4290-8552-587cc03e267b\") " pod="openshift-keda/keda-operator-ffbb595cb-69252"
May 25 11:23:02.398595 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:23:02.398491    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-mlhfn\" (UniqueName: \"kubernetes.io/projected/c5254776-19e3-4290-8552-587cc03e267b-kube-api-access-mlhfn\") pod \"keda-operator-ffbb595cb-69252\" (UID: \"c5254776-19e3-4290-8552-587cc03e267b\") " pod="openshift-keda/keda-operator-ffbb595cb-69252"
May 25 11:23:02.398595 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:23:02.398541    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/c5254776-19e3-4290-8552-587cc03e267b-certificates\") pod \"keda-operator-ffbb595cb-69252\" (UID: \"c5254776-19e3-4290-8552-587cc03e267b\") " pod="openshift-keda/keda-operator-ffbb595cb-69252"
May 25 11:23:02.398710 ip-10-0-143-46 kubenswrapper[2569]: E0525 11:23:02.398695    2569 projected.go:264] Couldn't get secret openshift-keda/keda-operator-certs: secret "keda-operator-certs" not found
May 25 11:23:02.398768 ip-10-0-143-46 kubenswrapper[2569]: E0525 11:23:02.398714    2569 secret.go:281] references non-existent secret key: ca.crt
May 25 11:23:02.398768 ip-10-0-143-46 kubenswrapper[2569]: E0525 11:23:02.398724    2569 projected.go:277] Couldn't get secret payload openshift-keda/kedaorg-certs: references non-existent secret key: ca.crt
May 25 11:23:02.398768 ip-10-0-143-46 kubenswrapper[2569]: E0525 11:23:02.398740    2569 projected.go:194] Error preparing data for projected volume certificates for pod openshift-keda/keda-operator-ffbb595cb-69252: [secret "keda-operator-certs" not found, references non-existent secret key: ca.crt]
May 25 11:23:02.398938 ip-10-0-143-46 kubenswrapper[2569]: E0525 11:23:02.398828    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c5254776-19e3-4290-8552-587cc03e267b-certificates podName:c5254776-19e3-4290-8552-587cc03e267b nodeName:}" failed. No retries permitted until 2026-05-25 11:23:02.898807592 +0000 UTC m=+321.760431971 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "certificates" (UniqueName: "kubernetes.io/projected/c5254776-19e3-4290-8552-587cc03e267b-certificates") pod "keda-operator-ffbb595cb-69252" (UID: "c5254776-19e3-4290-8552-587cc03e267b") : [secret "keda-operator-certs" not found, references non-existent secret key: ca.crt]
May 25 11:23:02.399378 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:23:02.399358    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cabundle0\" (UniqueName: \"kubernetes.io/configmap/c5254776-19e3-4290-8552-587cc03e267b-cabundle0\") pod \"keda-operator-ffbb595cb-69252\" (UID: \"c5254776-19e3-4290-8552-587cc03e267b\") " pod="openshift-keda/keda-operator-ffbb595cb-69252"
May 25 11:23:02.416771 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:23:02.416750    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mlhfn\" (UniqueName: \"kubernetes.io/projected/c5254776-19e3-4290-8552-587cc03e267b-kube-api-access-mlhfn\") pod \"keda-operator-ffbb595cb-69252\" (UID: \"c5254776-19e3-4290-8552-587cc03e267b\") " pod="openshift-keda/keda-operator-ffbb595cb-69252"
May 25 11:23:02.903125 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:23:02.903090    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/c5254776-19e3-4290-8552-587cc03e267b-certificates\") pod \"keda-operator-ffbb595cb-69252\" (UID: \"c5254776-19e3-4290-8552-587cc03e267b\") " pod="openshift-keda/keda-operator-ffbb595cb-69252"
May 25 11:23:02.903472 ip-10-0-143-46 kubenswrapper[2569]: E0525 11:23:02.903239    2569 secret.go:281] references non-existent secret key: ca.crt
May 25 11:23:02.903472 ip-10-0-143-46 kubenswrapper[2569]: E0525 11:23:02.903265    2569 projected.go:277] Couldn't get secret payload openshift-keda/kedaorg-certs: references non-existent secret key: ca.crt
May 25 11:23:02.903472 ip-10-0-143-46 kubenswrapper[2569]: E0525 11:23:02.903278    2569 projected.go:194] Error preparing data for projected volume certificates for pod openshift-keda/keda-operator-ffbb595cb-69252: references non-existent secret key: ca.crt
May 25 11:23:02.903472 ip-10-0-143-46 kubenswrapper[2569]: E0525 11:23:02.903342    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c5254776-19e3-4290-8552-587cc03e267b-certificates podName:c5254776-19e3-4290-8552-587cc03e267b nodeName:}" failed. No retries permitted until 2026-05-25 11:23:03.903323142 +0000 UTC m=+322.764947504 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "certificates" (UniqueName: "kubernetes.io/projected/c5254776-19e3-4290-8552-587cc03e267b-certificates") pod "keda-operator-ffbb595cb-69252" (UID: "c5254776-19e3-4290-8552-587cc03e267b") : references non-existent secret key: ca.crt
May 25 11:23:03.912341 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:23:03.912307    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/c5254776-19e3-4290-8552-587cc03e267b-certificates\") pod \"keda-operator-ffbb595cb-69252\" (UID: \"c5254776-19e3-4290-8552-587cc03e267b\") " pod="openshift-keda/keda-operator-ffbb595cb-69252"
May 25 11:23:03.914638 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:23:03.914617    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/c5254776-19e3-4290-8552-587cc03e267b-certificates\") pod \"keda-operator-ffbb595cb-69252\" (UID: \"c5254776-19e3-4290-8552-587cc03e267b\") " pod="openshift-keda/keda-operator-ffbb595cb-69252"
May 25 11:23:04.019071 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:23:04.019041    2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-keda/keda-operator-ffbb595cb-69252"
May 25 11:23:04.162748 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:23:04.162677    2569 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-keda/keda-operator-ffbb595cb-69252"]
May 25 11:23:04.165521 ip-10-0-143-46 kubenswrapper[2569]: W0525 11:23:04.165493    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc5254776_19e3_4290_8552_587cc03e267b.slice/crio-72436cdf0d422a3b336f4b3083ad9ccb65eda70ebbda11692225e05bff4fa7bd WatchSource:0}: Error finding container 72436cdf0d422a3b336f4b3083ad9ccb65eda70ebbda11692225e05bff4fa7bd: Status 404 returned error can't find the container with id 72436cdf0d422a3b336f4b3083ad9ccb65eda70ebbda11692225e05bff4fa7bd
May 25 11:23:04.818597 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:23:04.818552    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-keda/keda-operator-ffbb595cb-69252" event={"ID":"c5254776-19e3-4290-8552-587cc03e267b","Type":"ContainerStarted","Data":"72436cdf0d422a3b336f4b3083ad9ccb65eda70ebbda11692225e05bff4fa7bd"}
May 25 11:23:07.829438 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:23:07.829403    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-keda/keda-operator-ffbb595cb-69252" event={"ID":"c5254776-19e3-4290-8552-587cc03e267b","Type":"ContainerStarted","Data":"326bf9764df8f5951ddedb49bc7546b4931ff7a39353d6d723b8a7f40a1470f8"}
May 25 11:23:07.829833 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:23:07.829523    2569 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-keda/keda-operator-ffbb595cb-69252"
May 25 11:23:07.847251 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:23:07.847211    2569 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-keda/keda-operator-ffbb595cb-69252" podStartSLOduration=2.744579282 podStartE2EDuration="5.847197999s" podCreationTimestamp="2026-05-25 11:23:02 +0000 UTC" firstStartedPulling="2026-05-25 11:23:04.166736452 +0000 UTC m=+323.028360815" lastFinishedPulling="2026-05-25 11:23:07.269355155 +0000 UTC m=+326.130979532" observedRunningTime="2026-05-25 11:23:07.846080248 +0000 UTC m=+326.707704633" watchObservedRunningTime="2026-05-25 11:23:07.847197999 +0000 UTC m=+326.708822382"
May 25 11:23:22.814493 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:23:22.814466    2569 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-keda/custom-metrics-autoscaler-operator-bbf89fd5d-2m6sr"
May 25 11:23:28.835145 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:23:28.835111    2569 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-keda/keda-operator-ffbb595cb-69252"
May 25 11:24:09.159385 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:24:09.159351    2569 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-hv5bx"]
May 25 11:24:09.161491 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:24:09.161475    2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-hv5bx"
May 25 11:24:09.164641 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:24:09.164623    2569 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager-operator\"/\"cert-manager-operator-controller-manager-dockercfg-fxr74\""
May 25 11:24:09.165015 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:24:09.164998    2569 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"openshift-service-ca.crt\""
May 25 11:24:09.168569 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:24:09.168344    2569 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"kube-root-ca.crt\""
May 25 11:24:09.195004 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:24:09.194970    2569 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-hv5bx"]
May 25 11:24:09.221724 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:24:09.221689    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b16d26a0-5979-46fc-b6d6-b3eccdc8c245-tmp\") pod \"cert-manager-operator-controller-manager-54b9655956-hv5bx\" (UID: \"b16d26a0-5979-46fc-b6d6-b3eccdc8c245\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-hv5bx"
May 25 11:24:09.221891 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:24:09.221837    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nxdnz\" (UniqueName: \"kubernetes.io/projected/b16d26a0-5979-46fc-b6d6-b3eccdc8c245-kube-api-access-nxdnz\") pod \"cert-manager-operator-controller-manager-54b9655956-hv5bx\" (UID: \"b16d26a0-5979-46fc-b6d6-b3eccdc8c245\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-hv5bx"
May 25 11:24:09.322217 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:24:09.322184    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-nxdnz\" (UniqueName: \"kubernetes.io/projected/b16d26a0-5979-46fc-b6d6-b3eccdc8c245-kube-api-access-nxdnz\") pod \"cert-manager-operator-controller-manager-54b9655956-hv5bx\" (UID: \"b16d26a0-5979-46fc-b6d6-b3eccdc8c245\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-hv5bx"
May 25 11:24:09.322370 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:24:09.322222    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b16d26a0-5979-46fc-b6d6-b3eccdc8c245-tmp\") pod \"cert-manager-operator-controller-manager-54b9655956-hv5bx\" (UID: \"b16d26a0-5979-46fc-b6d6-b3eccdc8c245\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-hv5bx"
May 25 11:24:09.322570 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:24:09.322554    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b16d26a0-5979-46fc-b6d6-b3eccdc8c245-tmp\") pod \"cert-manager-operator-controller-manager-54b9655956-hv5bx\" (UID: \"b16d26a0-5979-46fc-b6d6-b3eccdc8c245\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-hv5bx"
May 25 11:24:09.334499 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:24:09.334475    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nxdnz\" (UniqueName: \"kubernetes.io/projected/b16d26a0-5979-46fc-b6d6-b3eccdc8c245-kube-api-access-nxdnz\") pod \"cert-manager-operator-controller-manager-54b9655956-hv5bx\" (UID: \"b16d26a0-5979-46fc-b6d6-b3eccdc8c245\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-hv5bx"
May 25 11:24:09.471561 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:24:09.471489    2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-hv5bx"
May 25 11:24:09.608743 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:24:09.608705    2569 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-hv5bx"]
May 25 11:24:09.612497 ip-10-0-143-46 kubenswrapper[2569]: W0525 11:24:09.612472    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb16d26a0_5979_46fc_b6d6_b3eccdc8c245.slice/crio-04bdeca87976c0cdca13ed242ddf1729da89b1a9f22e5bbb3f8c173ec283b91c WatchSource:0}: Error finding container 04bdeca87976c0cdca13ed242ddf1729da89b1a9f22e5bbb3f8c173ec283b91c: Status 404 returned error can't find the container with id 04bdeca87976c0cdca13ed242ddf1729da89b1a9f22e5bbb3f8c173ec283b91c
May 25 11:24:10.036549 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:24:10.036511    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-hv5bx" event={"ID":"b16d26a0-5979-46fc-b6d6-b3eccdc8c245","Type":"ContainerStarted","Data":"04bdeca87976c0cdca13ed242ddf1729da89b1a9f22e5bbb3f8c173ec283b91c"}
May 25 11:24:13.049217 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:24:13.049183    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-hv5bx" event={"ID":"b16d26a0-5979-46fc-b6d6-b3eccdc8c245","Type":"ContainerStarted","Data":"19ce54f8ad83196cf51b2f9b8af6efae99e72a8f03e8008873ef878d9f7afb64"}
May 25 11:24:13.074716 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:24:13.074663    2569 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-hv5bx" podStartSLOduration=1.067502423 podStartE2EDuration="4.07464506s" podCreationTimestamp="2026-05-25 11:24:09 +0000 UTC" firstStartedPulling="2026-05-25 11:24:09.615490144 +0000 UTC m=+388.477114510" lastFinishedPulling="2026-05-25 11:24:12.622632785 +0000 UTC m=+391.484257147" observedRunningTime="2026-05-25 11:24:13.071417017 +0000 UTC m=+391.933041401" watchObservedRunningTime="2026-05-25 11:24:13.07464506 +0000 UTC m=+391.936269446"
May 25 11:24:18.511713 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:24:18.511682    2569 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-webhook-587ccfb98-jtmlk"]
May 25 11:24:18.515040 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:24:18.515021    2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-587ccfb98-jtmlk"
May 25 11:24:18.518142 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:24:18.518124    2569 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\""
May 25 11:24:18.519041 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:24:18.519024    2569 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\""
May 25 11:24:18.519147 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:24:18.519061    2569 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-webhook-dockercfg-sjvgl\""
May 25 11:24:18.525140 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:24:18.525122    2569 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-587ccfb98-jtmlk"]
May 25 11:24:18.595859 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:24:18.595832    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cb7nc\" (UniqueName: \"kubernetes.io/projected/2377bb00-3679-4ae5-90d2-99d75fd9013e-kube-api-access-cb7nc\") pod \"cert-manager-webhook-587ccfb98-jtmlk\" (UID: \"2377bb00-3679-4ae5-90d2-99d75fd9013e\") " pod="cert-manager/cert-manager-webhook-587ccfb98-jtmlk"
May 25 11:24:18.595993 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:24:18.595946    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/2377bb00-3679-4ae5-90d2-99d75fd9013e-bound-sa-token\") pod \"cert-manager-webhook-587ccfb98-jtmlk\" (UID: \"2377bb00-3679-4ae5-90d2-99d75fd9013e\") " pod="cert-manager/cert-manager-webhook-587ccfb98-jtmlk"
May 25 11:24:18.697167 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:24:18.697141    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/2377bb00-3679-4ae5-90d2-99d75fd9013e-bound-sa-token\") pod \"cert-manager-webhook-587ccfb98-jtmlk\" (UID: \"2377bb00-3679-4ae5-90d2-99d75fd9013e\") " pod="cert-manager/cert-manager-webhook-587ccfb98-jtmlk"
May 25 11:24:18.697278 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:24:18.697178    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-cb7nc\" (UniqueName: \"kubernetes.io/projected/2377bb00-3679-4ae5-90d2-99d75fd9013e-kube-api-access-cb7nc\") pod \"cert-manager-webhook-587ccfb98-jtmlk\" (UID: \"2377bb00-3679-4ae5-90d2-99d75fd9013e\") " pod="cert-manager/cert-manager-webhook-587ccfb98-jtmlk"
May 25 11:24:18.705671 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:24:18.705646    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/2377bb00-3679-4ae5-90d2-99d75fd9013e-bound-sa-token\") pod \"cert-manager-webhook-587ccfb98-jtmlk\" (UID: \"2377bb00-3679-4ae5-90d2-99d75fd9013e\") " pod="cert-manager/cert-manager-webhook-587ccfb98-jtmlk"
May 25 11:24:18.706315 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:24:18.706298    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cb7nc\" (UniqueName: \"kubernetes.io/projected/2377bb00-3679-4ae5-90d2-99d75fd9013e-kube-api-access-cb7nc\") pod \"cert-manager-webhook-587ccfb98-jtmlk\" (UID: \"2377bb00-3679-4ae5-90d2-99d75fd9013e\") " pod="cert-manager/cert-manager-webhook-587ccfb98-jtmlk"
May 25 11:24:18.837146 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:24:18.837125    2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-587ccfb98-jtmlk"
May 25 11:24:18.965602 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:24:18.965521    2569 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-587ccfb98-jtmlk"]
May 25 11:24:18.967889 ip-10-0-143-46 kubenswrapper[2569]: W0525 11:24:18.967850    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod2377bb00_3679_4ae5_90d2_99d75fd9013e.slice/crio-580401c20936462dc6f0eac5637e33fbe0bd4c7caebadd7098bb497b92f2d570 WatchSource:0}: Error finding container 580401c20936462dc6f0eac5637e33fbe0bd4c7caebadd7098bb497b92f2d570: Status 404 returned error can't find the container with id 580401c20936462dc6f0eac5637e33fbe0bd4c7caebadd7098bb497b92f2d570
May 25 11:24:19.070555 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:24:19.070518    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-587ccfb98-jtmlk" event={"ID":"2377bb00-3679-4ae5-90d2-99d75fd9013e","Type":"ContainerStarted","Data":"580401c20936462dc6f0eac5637e33fbe0bd4c7caebadd7098bb497b92f2d570"}
May 25 11:24:25.092535 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:24:25.092498    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-587ccfb98-jtmlk" event={"ID":"2377bb00-3679-4ae5-90d2-99d75fd9013e","Type":"ContainerStarted","Data":"fcc53b4ad07a127c45f1ddba40a909889ce9bbfcb49d8e146c316db34183937c"}
May 25 11:24:25.092932 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:24:25.092577    2569 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="cert-manager/cert-manager-webhook-587ccfb98-jtmlk"
May 25 11:24:25.132892 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:24:25.132847    2569 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="cert-manager/cert-manager-webhook-587ccfb98-jtmlk" podStartSLOduration=1.4410830319999999 podStartE2EDuration="7.132832321s" podCreationTimestamp="2026-05-25 11:24:18 +0000 UTC" firstStartedPulling="2026-05-25 11:24:18.969884984 +0000 UTC m=+397.831509362" lastFinishedPulling="2026-05-25 11:24:24.661634288 +0000 UTC m=+403.523258651" observedRunningTime="2026-05-25 11:24:25.131554846 +0000 UTC m=+403.993179230" watchObservedRunningTime="2026-05-25 11:24:25.132832321 +0000 UTC m=+403.994456705"
May 25 11:24:31.100517 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:24:31.100485    2569 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="cert-manager/cert-manager-webhook-587ccfb98-jtmlk"
May 25 11:24:31.252538 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:24:31.252507    2569 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/openshift-lws-operator-bfc7f696d-khnvf"]
May 25 11:24:31.255731 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:24:31.255712    2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-khnvf"
May 25 11:24:31.258258 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:24:31.258239    2569 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\""
May 25 11:24:31.258258 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:24:31.258249    2569 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\""
May 25 11:24:31.258402 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:24:31.258354    2569 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"openshift-lws-operator-dockercfg-x64tl\""
May 25 11:24:31.266028 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:24:31.266011    2569 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-bfc7f696d-khnvf"]
May 25 11:24:31.308547 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:24:31.308520    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4bnm4\" (UniqueName: \"kubernetes.io/projected/39629c97-8c0d-42fb-b5c7-669495f9fbc5-kube-api-access-4bnm4\") pod \"openshift-lws-operator-bfc7f696d-khnvf\" (UID: \"39629c97-8c0d-42fb-b5c7-669495f9fbc5\") " pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-khnvf"
May 25 11:24:31.308646 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:24:31.308550    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/39629c97-8c0d-42fb-b5c7-669495f9fbc5-tmp\") pod \"openshift-lws-operator-bfc7f696d-khnvf\" (UID: \"39629c97-8c0d-42fb-b5c7-669495f9fbc5\") " pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-khnvf"
May 25 11:24:31.409921 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:24:31.409836    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-4bnm4\" (UniqueName: \"kubernetes.io/projected/39629c97-8c0d-42fb-b5c7-669495f9fbc5-kube-api-access-4bnm4\") pod \"openshift-lws-operator-bfc7f696d-khnvf\" (UID: \"39629c97-8c0d-42fb-b5c7-669495f9fbc5\") " pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-khnvf"
May 25 11:24:31.409921 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:24:31.409890    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/39629c97-8c0d-42fb-b5c7-669495f9fbc5-tmp\") pod \"openshift-lws-operator-bfc7f696d-khnvf\" (UID: \"39629c97-8c0d-42fb-b5c7-669495f9fbc5\") " pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-khnvf"
May 25 11:24:31.410304 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:24:31.410284    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/39629c97-8c0d-42fb-b5c7-669495f9fbc5-tmp\") pod \"openshift-lws-operator-bfc7f696d-khnvf\" (UID: \"39629c97-8c0d-42fb-b5c7-669495f9fbc5\") " pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-khnvf"
May 25 11:24:31.419685 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:24:31.419657    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4bnm4\" (UniqueName: \"kubernetes.io/projected/39629c97-8c0d-42fb-b5c7-669495f9fbc5-kube-api-access-4bnm4\") pod \"openshift-lws-operator-bfc7f696d-khnvf\" (UID: \"39629c97-8c0d-42fb-b5c7-669495f9fbc5\") " pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-khnvf"
May 25 11:24:31.564151 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:24:31.564107    2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-khnvf"
May 25 11:24:31.687518 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:24:31.687482    2569 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-bfc7f696d-khnvf"]
May 25 11:24:31.690232 ip-10-0-143-46 kubenswrapper[2569]: W0525 11:24:31.690207    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod39629c97_8c0d_42fb_b5c7_669495f9fbc5.slice/crio-9ce1c019cc812543b5eb3649ef8a95921e84a1e849ef0ccc2c3c45845f2aa00b WatchSource:0}: Error finding container 9ce1c019cc812543b5eb3649ef8a95921e84a1e849ef0ccc2c3c45845f2aa00b: Status 404 returned error can't find the container with id 9ce1c019cc812543b5eb3649ef8a95921e84a1e849ef0ccc2c3c45845f2aa00b
May 25 11:24:32.118086 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:24:32.118048    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-khnvf" event={"ID":"39629c97-8c0d-42fb-b5c7-669495f9fbc5","Type":"ContainerStarted","Data":"9ce1c019cc812543b5eb3649ef8a95921e84a1e849ef0ccc2c3c45845f2aa00b"}
May 25 11:24:35.130244 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:24:35.130210    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-khnvf" event={"ID":"39629c97-8c0d-42fb-b5c7-669495f9fbc5","Type":"ContainerStarted","Data":"7b50da00f777f0cfc7220b245eed91bcd0ac0d307bd9443fb7eb77384450f841"}
May 25 11:24:35.149526 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:24:35.149483    2569 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-khnvf" podStartSLOduration=1.325169241 podStartE2EDuration="4.14946788s" podCreationTimestamp="2026-05-25 11:24:31 +0000 UTC" firstStartedPulling="2026-05-25 11:24:31.6920073 +0000 UTC m=+410.553631663" lastFinishedPulling="2026-05-25 11:24:34.516305937 +0000 UTC m=+413.377930302" observedRunningTime="2026-05-25 11:24:35.148416581 +0000 UTC m=+414.010040966" watchObservedRunningTime="2026-05-25 11:24:35.14946788 +0000 UTC m=+414.011092285"
May 25 11:25:07.401807 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:25:07.401700    2569 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-757cd88c59-dxhb2"]
May 25 11:25:07.455024 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:25:07.454984    2569 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-757cd88c59-dxhb2"]
May 25 11:25:07.455265 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:25:07.455036    2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-757cd88c59-dxhb2"
May 25 11:25:07.458668 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:25:07.458648    2569 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\""
May 25 11:25:07.459436 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:25:07.459416    2569 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\""
May 25 11:25:07.459436 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:25:07.459432    2569 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\""
May 25 11:25:07.459586 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:25:07.459562    2569 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-2qp7b\""
May 25 11:25:07.499849 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:25:07.499826    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ndw6l\" (UniqueName: \"kubernetes.io/projected/e3b1472a-d35e-4e01-b31d-662f8efc124f-kube-api-access-ndw6l\") pod \"lws-controller-manager-757cd88c59-dxhb2\" (UID: \"e3b1472a-d35e-4e01-b31d-662f8efc124f\") " pod="openshift-lws-operator/lws-controller-manager-757cd88c59-dxhb2"
May 25 11:25:07.499952 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:25:07.499876    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e3b1472a-d35e-4e01-b31d-662f8efc124f-cert\") pod \"lws-controller-manager-757cd88c59-dxhb2\" (UID: \"e3b1472a-d35e-4e01-b31d-662f8efc124f\") " pod="openshift-lws-operator/lws-controller-manager-757cd88c59-dxhb2"
May 25 11:25:07.500015 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:25:07.499952    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/e3b1472a-d35e-4e01-b31d-662f8efc124f-metrics-cert\") pod \"lws-controller-manager-757cd88c59-dxhb2\" (UID: \"e3b1472a-d35e-4e01-b31d-662f8efc124f\") " pod="openshift-lws-operator/lws-controller-manager-757cd88c59-dxhb2"
May 25 11:25:07.500015 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:25:07.500006    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/e3b1472a-d35e-4e01-b31d-662f8efc124f-manager-config\") pod \"lws-controller-manager-757cd88c59-dxhb2\" (UID: \"e3b1472a-d35e-4e01-b31d-662f8efc124f\") " pod="openshift-lws-operator/lws-controller-manager-757cd88c59-dxhb2"
May 25 11:25:07.601081 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:25:07.601057    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/e3b1472a-d35e-4e01-b31d-662f8efc124f-metrics-cert\") pod \"lws-controller-manager-757cd88c59-dxhb2\" (UID: \"e3b1472a-d35e-4e01-b31d-662f8efc124f\") " pod="openshift-lws-operator/lws-controller-manager-757cd88c59-dxhb2"
May 25 11:25:07.601184 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:25:07.601092    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/e3b1472a-d35e-4e01-b31d-662f8efc124f-manager-config\") pod \"lws-controller-manager-757cd88c59-dxhb2\" (UID: \"e3b1472a-d35e-4e01-b31d-662f8efc124f\") " pod="openshift-lws-operator/lws-controller-manager-757cd88c59-dxhb2"
May 25 11:25:07.601184 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:25:07.601131    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-ndw6l\" (UniqueName: \"kubernetes.io/projected/e3b1472a-d35e-4e01-b31d-662f8efc124f-kube-api-access-ndw6l\") pod \"lws-controller-manager-757cd88c59-dxhb2\" (UID: \"e3b1472a-d35e-4e01-b31d-662f8efc124f\") " pod="openshift-lws-operator/lws-controller-manager-757cd88c59-dxhb2"
May 25 11:25:07.601184 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:25:07.601157    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e3b1472a-d35e-4e01-b31d-662f8efc124f-cert\") pod \"lws-controller-manager-757cd88c59-dxhb2\" (UID: \"e3b1472a-d35e-4e01-b31d-662f8efc124f\") " pod="openshift-lws-operator/lws-controller-manager-757cd88c59-dxhb2"
May 25 11:25:07.601808 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:25:07.601764    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/e3b1472a-d35e-4e01-b31d-662f8efc124f-manager-config\") pod \"lws-controller-manager-757cd88c59-dxhb2\" (UID: \"e3b1472a-d35e-4e01-b31d-662f8efc124f\") " pod="openshift-lws-operator/lws-controller-manager-757cd88c59-dxhb2"
May 25 11:25:07.603539 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:25:07.603520    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/e3b1472a-d35e-4e01-b31d-662f8efc124f-metrics-cert\") pod \"lws-controller-manager-757cd88c59-dxhb2\" (UID: \"e3b1472a-d35e-4e01-b31d-662f8efc124f\") " pod="openshift-lws-operator/lws-controller-manager-757cd88c59-dxhb2"
May 25 11:25:07.603618 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:25:07.603580    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e3b1472a-d35e-4e01-b31d-662f8efc124f-cert\") pod \"lws-controller-manager-757cd88c59-dxhb2\" (UID: \"e3b1472a-d35e-4e01-b31d-662f8efc124f\") " pod="openshift-lws-operator/lws-controller-manager-757cd88c59-dxhb2"
May 25 11:25:07.612353 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:25:07.612324    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ndw6l\" (UniqueName: \"kubernetes.io/projected/e3b1472a-d35e-4e01-b31d-662f8efc124f-kube-api-access-ndw6l\") pod \"lws-controller-manager-757cd88c59-dxhb2\" (UID: \"e3b1472a-d35e-4e01-b31d-662f8efc124f\") " pod="openshift-lws-operator/lws-controller-manager-757cd88c59-dxhb2"
May 25 11:25:07.765178 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:25:07.765119    2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-757cd88c59-dxhb2"
May 25 11:25:07.893670 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:25:07.893560    2569 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-757cd88c59-dxhb2"]
May 25 11:25:07.896385 ip-10-0-143-46 kubenswrapper[2569]: W0525 11:25:07.896360    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode3b1472a_d35e_4e01_b31d_662f8efc124f.slice/crio-4b31d0935cf8e0d7e0a667a85124dfbf2de836ce99b2d5b60c799efdbf61b9e9 WatchSource:0}: Error finding container 4b31d0935cf8e0d7e0a667a85124dfbf2de836ce99b2d5b60c799efdbf61b9e9: Status 404 returned error can't find the container with id 4b31d0935cf8e0d7e0a667a85124dfbf2de836ce99b2d5b60c799efdbf61b9e9
May 25 11:25:08.242262 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:25:08.242228    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-757cd88c59-dxhb2" event={"ID":"e3b1472a-d35e-4e01-b31d-662f8efc124f","Type":"ContainerStarted","Data":"4b31d0935cf8e0d7e0a667a85124dfbf2de836ce99b2d5b60c799efdbf61b9e9"}
May 25 11:25:10.251745 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:25:10.251711    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-757cd88c59-dxhb2" event={"ID":"e3b1472a-d35e-4e01-b31d-662f8efc124f","Type":"ContainerStarted","Data":"dbdc76cd8f54dbbc03782054680a0234e9f095348ecaccfc7cbc312eb2102ca8"}
May 25 11:25:10.252124 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:25:10.251834    2569 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-757cd88c59-dxhb2"
May 25 11:25:10.274684 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:25:10.274642    2569 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-757cd88c59-dxhb2" podStartSLOduration=1.630034846 podStartE2EDuration="3.274626769s" podCreationTimestamp="2026-05-25 11:25:07 +0000 UTC" firstStartedPulling="2026-05-25 11:25:07.89828536 +0000 UTC m=+446.759909723" lastFinishedPulling="2026-05-25 11:25:09.542877284 +0000 UTC m=+448.404501646" observedRunningTime="2026-05-25 11:25:10.273354407 +0000 UTC m=+449.134978791" watchObservedRunningTime="2026-05-25 11:25:10.274626769 +0000 UTC m=+449.136251154"
May 25 11:25:21.256630 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:25:21.256598    2569 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-757cd88c59-dxhb2"
May 25 11:25:32.610457 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:25:32.610415    2569 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-console/console-89695997b-xr9sx"]
May 25 11:25:32.613937 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:25:32.613906    2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-89695997b-xr9sx"
May 25 11:25:32.627001 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:25:32.626977    2569 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-89695997b-xr9sx"]
May 25 11:25:32.693035 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:25:32.693007    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/3233cf1a-6830-4a7c-aab9-3fa97ae24696-console-config\") pod \"console-89695997b-xr9sx\" (UID: \"3233cf1a-6830-4a7c-aab9-3fa97ae24696\") " pod="openshift-console/console-89695997b-xr9sx"
May 25 11:25:32.693162 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:25:32.693043    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/3233cf1a-6830-4a7c-aab9-3fa97ae24696-service-ca\") pod \"console-89695997b-xr9sx\" (UID: \"3233cf1a-6830-4a7c-aab9-3fa97ae24696\") " pod="openshift-console/console-89695997b-xr9sx"
May 25 11:25:32.693162 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:25:32.693121    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mc7tf\" (UniqueName: \"kubernetes.io/projected/3233cf1a-6830-4a7c-aab9-3fa97ae24696-kube-api-access-mc7tf\") pod \"console-89695997b-xr9sx\" (UID: \"3233cf1a-6830-4a7c-aab9-3fa97ae24696\") " pod="openshift-console/console-89695997b-xr9sx"
May 25 11:25:32.693162 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:25:32.693156    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/3233cf1a-6830-4a7c-aab9-3fa97ae24696-console-serving-cert\") pod \"console-89695997b-xr9sx\" (UID: \"3233cf1a-6830-4a7c-aab9-3fa97ae24696\") " pod="openshift-console/console-89695997b-xr9sx"
May 25 11:25:32.693316 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:25:32.693179    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3233cf1a-6830-4a7c-aab9-3fa97ae24696-trusted-ca-bundle\") pod \"console-89695997b-xr9sx\" (UID: \"3233cf1a-6830-4a7c-aab9-3fa97ae24696\") " pod="openshift-console/console-89695997b-xr9sx"
May 25 11:25:32.693316 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:25:32.693207    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/3233cf1a-6830-4a7c-aab9-3fa97ae24696-console-oauth-config\") pod \"console-89695997b-xr9sx\" (UID: \"3233cf1a-6830-4a7c-aab9-3fa97ae24696\") " pod="openshift-console/console-89695997b-xr9sx"
May 25 11:25:32.693316 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:25:32.693261    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/3233cf1a-6830-4a7c-aab9-3fa97ae24696-oauth-serving-cert\") pod \"console-89695997b-xr9sx\" (UID: \"3233cf1a-6830-4a7c-aab9-3fa97ae24696\") " pod="openshift-console/console-89695997b-xr9sx"
May 25 11:25:32.794259 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:25:32.794229    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/3233cf1a-6830-4a7c-aab9-3fa97ae24696-service-ca\") pod \"console-89695997b-xr9sx\" (UID: \"3233cf1a-6830-4a7c-aab9-3fa97ae24696\") " pod="openshift-console/console-89695997b-xr9sx"
May 25 11:25:32.794427 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:25:32.794282    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-mc7tf\" (UniqueName: \"kubernetes.io/projected/3233cf1a-6830-4a7c-aab9-3fa97ae24696-kube-api-access-mc7tf\") pod \"console-89695997b-xr9sx\" (UID: \"3233cf1a-6830-4a7c-aab9-3fa97ae24696\") " pod="openshift-console/console-89695997b-xr9sx"
May 25 11:25:32.794427 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:25:32.794400    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/3233cf1a-6830-4a7c-aab9-3fa97ae24696-console-serving-cert\") pod \"console-89695997b-xr9sx\" (UID: \"3233cf1a-6830-4a7c-aab9-3fa97ae24696\") " pod="openshift-console/console-89695997b-xr9sx"
May 25 11:25:32.794550 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:25:32.794440    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3233cf1a-6830-4a7c-aab9-3fa97ae24696-trusted-ca-bundle\") pod \"console-89695997b-xr9sx\" (UID: \"3233cf1a-6830-4a7c-aab9-3fa97ae24696\") " pod="openshift-console/console-89695997b-xr9sx"
May 25 11:25:32.794550 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:25:32.794483    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/3233cf1a-6830-4a7c-aab9-3fa97ae24696-console-oauth-config\") pod \"console-89695997b-xr9sx\" (UID: \"3233cf1a-6830-4a7c-aab9-3fa97ae24696\") " pod="openshift-console/console-89695997b-xr9sx"
May 25 11:25:32.794550 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:25:32.794517    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/3233cf1a-6830-4a7c-aab9-3fa97ae24696-oauth-serving-cert\") pod \"console-89695997b-xr9sx\" (UID: \"3233cf1a-6830-4a7c-aab9-3fa97ae24696\") " pod="openshift-console/console-89695997b-xr9sx"
May 25 11:25:32.794694 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:25:32.794611    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/3233cf1a-6830-4a7c-aab9-3fa97ae24696-console-config\") pod \"console-89695997b-xr9sx\" (UID: \"3233cf1a-6830-4a7c-aab9-3fa97ae24696\") " pod="openshift-console/console-89695997b-xr9sx"
May 25 11:25:32.795131 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:25:32.795103    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/3233cf1a-6830-4a7c-aab9-3fa97ae24696-service-ca\") pod \"console-89695997b-xr9sx\" (UID: \"3233cf1a-6830-4a7c-aab9-3fa97ae24696\") " pod="openshift-console/console-89695997b-xr9sx"
May 25 11:25:32.795270 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:25:32.795257    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3233cf1a-6830-4a7c-aab9-3fa97ae24696-trusted-ca-bundle\") pod \"console-89695997b-xr9sx\" (UID: \"3233cf1a-6830-4a7c-aab9-3fa97ae24696\") " pod="openshift-console/console-89695997b-xr9sx"
May 25 11:25:32.795335 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:25:32.795267    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/3233cf1a-6830-4a7c-aab9-3fa97ae24696-oauth-serving-cert\") pod \"console-89695997b-xr9sx\" (UID: \"3233cf1a-6830-4a7c-aab9-3fa97ae24696\") " pod="openshift-console/console-89695997b-xr9sx"
May 25 11:25:32.795376 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:25:32.795353    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/3233cf1a-6830-4a7c-aab9-3fa97ae24696-console-config\") pod \"console-89695997b-xr9sx\" (UID: \"3233cf1a-6830-4a7c-aab9-3fa97ae24696\") " pod="openshift-console/console-89695997b-xr9sx"
May 25 11:25:32.796929 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:25:32.796911    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/3233cf1a-6830-4a7c-aab9-3fa97ae24696-console-serving-cert\") pod \"console-89695997b-xr9sx\" (UID: \"3233cf1a-6830-4a7c-aab9-3fa97ae24696\") " pod="openshift-console/console-89695997b-xr9sx"
May 25 11:25:32.797006 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:25:32.796989    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/3233cf1a-6830-4a7c-aab9-3fa97ae24696-console-oauth-config\") pod \"console-89695997b-xr9sx\" (UID: \"3233cf1a-6830-4a7c-aab9-3fa97ae24696\") " pod="openshift-console/console-89695997b-xr9sx"
May 25 11:25:32.803383 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:25:32.803360    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mc7tf\" (UniqueName: \"kubernetes.io/projected/3233cf1a-6830-4a7c-aab9-3fa97ae24696-kube-api-access-mc7tf\") pod \"console-89695997b-xr9sx\" (UID: \"3233cf1a-6830-4a7c-aab9-3fa97ae24696\") " pod="openshift-console/console-89695997b-xr9sx"
May 25 11:25:32.924457 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:25:32.924380    2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-89695997b-xr9sx"
May 25 11:25:33.050505 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:25:33.050332    2569 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-89695997b-xr9sx"]
May 25 11:25:33.054584 ip-10-0-143-46 kubenswrapper[2569]: W0525 11:25:33.054557    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3233cf1a_6830_4a7c_aab9_3fa97ae24696.slice/crio-f45fea9eca9ebbe1dc31104dfbc16ac69bc6086878837a3c3c4d337bf19ebaf2 WatchSource:0}: Error finding container f45fea9eca9ebbe1dc31104dfbc16ac69bc6086878837a3c3c4d337bf19ebaf2: Status 404 returned error can't find the container with id f45fea9eca9ebbe1dc31104dfbc16ac69bc6086878837a3c3c4d337bf19ebaf2
May 25 11:25:33.329344 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:25:33.329311    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-89695997b-xr9sx" event={"ID":"3233cf1a-6830-4a7c-aab9-3fa97ae24696","Type":"ContainerStarted","Data":"d0a1bbea32a1572313af81f8a6f6068561bb4384178050fcc782a58bf14f178f"}
May 25 11:25:33.329506 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:25:33.329348    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-89695997b-xr9sx" event={"ID":"3233cf1a-6830-4a7c-aab9-3fa97ae24696","Type":"ContainerStarted","Data":"f45fea9eca9ebbe1dc31104dfbc16ac69bc6086878837a3c3c4d337bf19ebaf2"}
May 25 11:25:33.349155 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:25:33.349107    2569 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-console/console-89695997b-xr9sx" podStartSLOduration=1.349095087 podStartE2EDuration="1.349095087s" podCreationTimestamp="2026-05-25 11:25:32 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-25 11:25:33.347928898 +0000 UTC m=+472.209553283" watchObservedRunningTime="2026-05-25 11:25:33.349095087 +0000 UTC m=+472.210719472"
May 25 11:25:42.925300 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:25:42.925271    2569 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-89695997b-xr9sx"
May 25 11:25:42.925300 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:25:42.925308    2569 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-89695997b-xr9sx"
May 25 11:25:42.930191 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:25:42.930164    2569 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-89695997b-xr9sx"
May 25 11:25:43.378992 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:25:43.378964    2569 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-89695997b-xr9sx"
May 25 11:25:43.439216 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:25:43.439183    2569 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6969d9c8bc-8x4mh"]
May 25 11:25:47.168909 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:25:47.168872    2569 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-operator-7587b89b76-wwj25"]
May 25 11:25:47.175189 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:25:47.175166    2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-7587b89b76-wwj25"
May 25 11:25:47.186229 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:25:47.186207    2569 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
May 25 11:25:47.186342 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:25:47.186247    2569 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
May 25 11:25:47.187113 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:25:47.187098    2569 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-operator-dockercfg-rwpdx\""
May 25 11:25:47.299423 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:25:47.299397    2569 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-7587b89b76-wwj25"]
May 25 11:25:47.310608 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:25:47.310584    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ckk9l\" (UniqueName: \"kubernetes.io/projected/61afad2c-a455-49ec-89f5-d78339d9b5b4-kube-api-access-ckk9l\") pod \"authorino-operator-7587b89b76-wwj25\" (UID: \"61afad2c-a455-49ec-89f5-d78339d9b5b4\") " pod="kuadrant-system/authorino-operator-7587b89b76-wwj25"
May 25 11:25:47.411387 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:25:47.411358    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-ckk9l\" (UniqueName: \"kubernetes.io/projected/61afad2c-a455-49ec-89f5-d78339d9b5b4-kube-api-access-ckk9l\") pod \"authorino-operator-7587b89b76-wwj25\" (UID: \"61afad2c-a455-49ec-89f5-d78339d9b5b4\") " pod="kuadrant-system/authorino-operator-7587b89b76-wwj25"
May 25 11:25:47.425600 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:25:47.425545    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ckk9l\" (UniqueName: \"kubernetes.io/projected/61afad2c-a455-49ec-89f5-d78339d9b5b4-kube-api-access-ckk9l\") pod \"authorino-operator-7587b89b76-wwj25\" (UID: \"61afad2c-a455-49ec-89f5-d78339d9b5b4\") " pod="kuadrant-system/authorino-operator-7587b89b76-wwj25"
May 25 11:25:47.484912 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:25:47.484887    2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-7587b89b76-wwj25"
May 25 11:25:47.622269 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:25:47.622245    2569 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-7587b89b76-wwj25"]
May 25 11:25:47.624491 ip-10-0-143-46 kubenswrapper[2569]: W0525 11:25:47.624454    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod61afad2c_a455_49ec_89f5_d78339d9b5b4.slice/crio-84b154d3b9c05d06f6a26879929bf73e19d4c0a818a93e98de7b475504356333 WatchSource:0}: Error finding container 84b154d3b9c05d06f6a26879929bf73e19d4c0a818a93e98de7b475504356333: Status 404 returned error can't find the container with id 84b154d3b9c05d06f6a26879929bf73e19d4c0a818a93e98de7b475504356333
May 25 11:25:48.396599 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:25:48.396561    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-7587b89b76-wwj25" event={"ID":"61afad2c-a455-49ec-89f5-d78339d9b5b4","Type":"ContainerStarted","Data":"84b154d3b9c05d06f6a26879929bf73e19d4c0a818a93e98de7b475504356333"}
May 25 11:25:50.405841 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:25:50.405762    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-7587b89b76-wwj25" event={"ID":"61afad2c-a455-49ec-89f5-d78339d9b5b4","Type":"ContainerStarted","Data":"e608f5b07b4e705effaa261cc994dd10c0855a4f01fc5cfa8edbe562745087e0"}
May 25 11:25:50.405841 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:25:50.405833    2569 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/authorino-operator-7587b89b76-wwj25"
May 25 11:25:50.427928 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:25:50.427869    2569 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/authorino-operator-7587b89b76-wwj25" podStartSLOduration=0.926969251 podStartE2EDuration="3.427853995s" podCreationTimestamp="2026-05-25 11:25:47 +0000 UTC" firstStartedPulling="2026-05-25 11:25:47.626607639 +0000 UTC m=+486.488232001" lastFinishedPulling="2026-05-25 11:25:50.127492384 +0000 UTC m=+488.989116745" observedRunningTime="2026-05-25 11:25:50.426428311 +0000 UTC m=+489.288052697" watchObservedRunningTime="2026-05-25 11:25:50.427853995 +0000 UTC m=+489.289478379"
May 25 11:26:01.411745 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:26:01.411718    2569 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/authorino-operator-7587b89b76-wwj25"
May 25 11:26:08.460409 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:26:08.460350    2569 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-console/console-6969d9c8bc-8x4mh" podUID="76b3d6de-9b17-4f76-966d-4b616c0294a9" containerName="console" containerID="cri-o://55e319117aa71c745f947e2d48f87927d6b5bb531004674bc36fea25c507ca5c" gracePeriod=15
May 25 11:26:08.712258 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:26:08.712208    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-6969d9c8bc-8x4mh_76b3d6de-9b17-4f76-966d-4b616c0294a9/console/0.log"
May 25 11:26:08.712356 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:26:08.712270    2569 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6969d9c8bc-8x4mh"
May 25 11:26:08.893475 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:26:08.893442    2569 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/76b3d6de-9b17-4f76-966d-4b616c0294a9-trusted-ca-bundle\") pod \"76b3d6de-9b17-4f76-966d-4b616c0294a9\" (UID: \"76b3d6de-9b17-4f76-966d-4b616c0294a9\") "
May 25 11:26:08.893637 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:26:08.893497    2569 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/76b3d6de-9b17-4f76-966d-4b616c0294a9-console-config\") pod \"76b3d6de-9b17-4f76-966d-4b616c0294a9\" (UID: \"76b3d6de-9b17-4f76-966d-4b616c0294a9\") "
May 25 11:26:08.893637 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:26:08.893537    2569 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/76b3d6de-9b17-4f76-966d-4b616c0294a9-console-serving-cert\") pod \"76b3d6de-9b17-4f76-966d-4b616c0294a9\" (UID: \"76b3d6de-9b17-4f76-966d-4b616c0294a9\") "
May 25 11:26:08.893729 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:26:08.893696    2569 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/76b3d6de-9b17-4f76-966d-4b616c0294a9-service-ca\") pod \"76b3d6de-9b17-4f76-966d-4b616c0294a9\" (UID: \"76b3d6de-9b17-4f76-966d-4b616c0294a9\") "
May 25 11:26:08.893772 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:26:08.893728    2569 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/76b3d6de-9b17-4f76-966d-4b616c0294a9-oauth-serving-cert\") pod \"76b3d6de-9b17-4f76-966d-4b616c0294a9\" (UID: \"76b3d6de-9b17-4f76-966d-4b616c0294a9\") "
May 25 11:26:08.893853 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:26:08.893839    2569 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7ktzt\" (UniqueName: \"kubernetes.io/projected/76b3d6de-9b17-4f76-966d-4b616c0294a9-kube-api-access-7ktzt\") pod \"76b3d6de-9b17-4f76-966d-4b616c0294a9\" (UID: \"76b3d6de-9b17-4f76-966d-4b616c0294a9\") "
May 25 11:26:08.893892 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:26:08.893877    2569 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/76b3d6de-9b17-4f76-966d-4b616c0294a9-console-oauth-config\") pod \"76b3d6de-9b17-4f76-966d-4b616c0294a9\" (UID: \"76b3d6de-9b17-4f76-966d-4b616c0294a9\") "
May 25 11:26:08.893971 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:26:08.893947    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/76b3d6de-9b17-4f76-966d-4b616c0294a9-console-config" (OuterVolumeSpecName: "console-config") pod "76b3d6de-9b17-4f76-966d-4b616c0294a9" (UID: "76b3d6de-9b17-4f76-966d-4b616c0294a9"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 25 11:26:08.894026 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:26:08.893996    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/76b3d6de-9b17-4f76-966d-4b616c0294a9-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "76b3d6de-9b17-4f76-966d-4b616c0294a9" (UID: "76b3d6de-9b17-4f76-966d-4b616c0294a9"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 25 11:26:08.894133 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:26:08.894106    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/76b3d6de-9b17-4f76-966d-4b616c0294a9-service-ca" (OuterVolumeSpecName: "service-ca") pod "76b3d6de-9b17-4f76-966d-4b616c0294a9" (UID: "76b3d6de-9b17-4f76-966d-4b616c0294a9"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 25 11:26:08.894277 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:26:08.894256    2569 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/76b3d6de-9b17-4f76-966d-4b616c0294a9-trusted-ca-bundle\") on node \"ip-10-0-143-46.ec2.internal\" DevicePath \"\""
May 25 11:26:08.894352 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:26:08.894280    2569 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/76b3d6de-9b17-4f76-966d-4b616c0294a9-console-config\") on node \"ip-10-0-143-46.ec2.internal\" DevicePath \"\""
May 25 11:26:08.894352 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:26:08.894294    2569 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/76b3d6de-9b17-4f76-966d-4b616c0294a9-service-ca\") on node \"ip-10-0-143-46.ec2.internal\" DevicePath \"\""
May 25 11:26:08.894352 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:26:08.894227    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/76b3d6de-9b17-4f76-966d-4b616c0294a9-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "76b3d6de-9b17-4f76-966d-4b616c0294a9" (UID: "76b3d6de-9b17-4f76-966d-4b616c0294a9"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 25 11:26:08.896082 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:26:08.896056    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/76b3d6de-9b17-4f76-966d-4b616c0294a9-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "76b3d6de-9b17-4f76-966d-4b616c0294a9" (UID: "76b3d6de-9b17-4f76-966d-4b616c0294a9"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 25 11:26:08.896216 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:26:08.896054    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/76b3d6de-9b17-4f76-966d-4b616c0294a9-kube-api-access-7ktzt" (OuterVolumeSpecName: "kube-api-access-7ktzt") pod "76b3d6de-9b17-4f76-966d-4b616c0294a9" (UID: "76b3d6de-9b17-4f76-966d-4b616c0294a9"). InnerVolumeSpecName "kube-api-access-7ktzt". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 25 11:26:08.896216 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:26:08.896108    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/76b3d6de-9b17-4f76-966d-4b616c0294a9-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "76b3d6de-9b17-4f76-966d-4b616c0294a9" (UID: "76b3d6de-9b17-4f76-966d-4b616c0294a9"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 25 11:26:08.994869 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:26:08.994802    2569 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/76b3d6de-9b17-4f76-966d-4b616c0294a9-console-serving-cert\") on node \"ip-10-0-143-46.ec2.internal\" DevicePath \"\""
May 25 11:26:08.994869 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:26:08.994824    2569 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/76b3d6de-9b17-4f76-966d-4b616c0294a9-oauth-serving-cert\") on node \"ip-10-0-143-46.ec2.internal\" DevicePath \"\""
May 25 11:26:08.994869 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:26:08.994834    2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7ktzt\" (UniqueName: \"kubernetes.io/projected/76b3d6de-9b17-4f76-966d-4b616c0294a9-kube-api-access-7ktzt\") on node \"ip-10-0-143-46.ec2.internal\" DevicePath \"\""
May 25 11:26:08.994869 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:26:08.994844    2569 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/76b3d6de-9b17-4f76-966d-4b616c0294a9-console-oauth-config\") on node \"ip-10-0-143-46.ec2.internal\" DevicePath \"\""
May 25 11:26:09.472452 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:26:09.472427    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-6969d9c8bc-8x4mh_76b3d6de-9b17-4f76-966d-4b616c0294a9/console/0.log"
May 25 11:26:09.472911 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:26:09.472470    2569 generic.go:358] "Generic (PLEG): container finished" podID="76b3d6de-9b17-4f76-966d-4b616c0294a9" containerID="55e319117aa71c745f947e2d48f87927d6b5bb531004674bc36fea25c507ca5c" exitCode=2
May 25 11:26:09.472911 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:26:09.472514    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6969d9c8bc-8x4mh" event={"ID":"76b3d6de-9b17-4f76-966d-4b616c0294a9","Type":"ContainerDied","Data":"55e319117aa71c745f947e2d48f87927d6b5bb531004674bc36fea25c507ca5c"}
May 25 11:26:09.472911 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:26:09.472531    2569 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6969d9c8bc-8x4mh"
May 25 11:26:09.472911 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:26:09.472544    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6969d9c8bc-8x4mh" event={"ID":"76b3d6de-9b17-4f76-966d-4b616c0294a9","Type":"ContainerDied","Data":"a31b40b461c959f42fb34d166bd67932b742c7f1a8127a7923d32d7e6bd949ca"}
May 25 11:26:09.472911 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:26:09.472564    2569 scope.go:117] "RemoveContainer" containerID="55e319117aa71c745f947e2d48f87927d6b5bb531004674bc36fea25c507ca5c"
May 25 11:26:09.481826 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:26:09.481809    2569 scope.go:117] "RemoveContainer" containerID="55e319117aa71c745f947e2d48f87927d6b5bb531004674bc36fea25c507ca5c"
May 25 11:26:09.482063 ip-10-0-143-46 kubenswrapper[2569]: E0525 11:26:09.482045    2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"55e319117aa71c745f947e2d48f87927d6b5bb531004674bc36fea25c507ca5c\": container with ID starting with 55e319117aa71c745f947e2d48f87927d6b5bb531004674bc36fea25c507ca5c not found: ID does not exist" containerID="55e319117aa71c745f947e2d48f87927d6b5bb531004674bc36fea25c507ca5c"
May 25 11:26:09.482110 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:26:09.482070    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"55e319117aa71c745f947e2d48f87927d6b5bb531004674bc36fea25c507ca5c"} err="failed to get container status \"55e319117aa71c745f947e2d48f87927d6b5bb531004674bc36fea25c507ca5c\": rpc error: code = NotFound desc = could not find container \"55e319117aa71c745f947e2d48f87927d6b5bb531004674bc36fea25c507ca5c\": container with ID starting with 55e319117aa71c745f947e2d48f87927d6b5bb531004674bc36fea25c507ca5c not found: ID does not exist"
May 25 11:26:09.495864 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:26:09.495843    2569 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6969d9c8bc-8x4mh"]
May 25 11:26:09.505019 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:26:09.504997    2569 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-6969d9c8bc-8x4mh"]
May 25 11:26:09.729676 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:26:09.729587    2569 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="76b3d6de-9b17-4f76-966d-4b616c0294a9" path="/var/lib/kubelet/pods/76b3d6de-9b17-4f76-966d-4b616c0294a9/volumes"
May 25 11:26:39.232677 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:26:39.232641    2569 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-674b59b84c-mw64w"]
May 25 11:26:39.233153 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:26:39.233037    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="76b3d6de-9b17-4f76-966d-4b616c0294a9" containerName="console"
May 25 11:26:39.233153 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:26:39.233050    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="76b3d6de-9b17-4f76-966d-4b616c0294a9" containerName="console"
May 25 11:26:39.233153 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:26:39.233128    2569 memory_manager.go:356] "RemoveStaleState removing state" podUID="76b3d6de-9b17-4f76-966d-4b616c0294a9" containerName="console"
May 25 11:26:39.236120 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:26:39.236105    2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-674b59b84c-mw64w"
May 25 11:26:39.238633 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:26:39.238607    2569 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-sw2nc\""
May 25 11:26:39.243991 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:26:39.243967    2569 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-674b59b84c-mw64w"]
May 25 11:26:39.339209 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:26:39.339179    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zfsr5\" (UniqueName: \"kubernetes.io/projected/7f3e2ff7-15d5-47f0-a73f-e753078e4484-kube-api-access-zfsr5\") pod \"authorino-674b59b84c-mw64w\" (UID: \"7f3e2ff7-15d5-47f0-a73f-e753078e4484\") " pod="kuadrant-system/authorino-674b59b84c-mw64w"
May 25 11:26:39.440389 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:26:39.440347    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-zfsr5\" (UniqueName: \"kubernetes.io/projected/7f3e2ff7-15d5-47f0-a73f-e753078e4484-kube-api-access-zfsr5\") pod \"authorino-674b59b84c-mw64w\" (UID: \"7f3e2ff7-15d5-47f0-a73f-e753078e4484\") " pod="kuadrant-system/authorino-674b59b84c-mw64w"
May 25 11:26:39.448206 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:26:39.448177    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zfsr5\" (UniqueName: \"kubernetes.io/projected/7f3e2ff7-15d5-47f0-a73f-e753078e4484-kube-api-access-zfsr5\") pod \"authorino-674b59b84c-mw64w\" (UID: \"7f3e2ff7-15d5-47f0-a73f-e753078e4484\") " pod="kuadrant-system/authorino-674b59b84c-mw64w"
May 25 11:26:39.546773 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:26:39.546748    2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-674b59b84c-mw64w"
May 25 11:26:39.671063 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:26:39.671033    2569 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-674b59b84c-mw64w"]
May 25 11:26:39.673825 ip-10-0-143-46 kubenswrapper[2569]: W0525 11:26:39.673778    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod7f3e2ff7_15d5_47f0_a73f_e753078e4484.slice/crio-00390b81d08889bbe91a8bb8c68941c9ae82b1e8201fb79898fa90e38f2f3c4f WatchSource:0}: Error finding container 00390b81d08889bbe91a8bb8c68941c9ae82b1e8201fb79898fa90e38f2f3c4f: Status 404 returned error can't find the container with id 00390b81d08889bbe91a8bb8c68941c9ae82b1e8201fb79898fa90e38f2f3c4f
May 25 11:26:40.583490 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:26:40.583456    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-674b59b84c-mw64w" event={"ID":"7f3e2ff7-15d5-47f0-a73f-e753078e4484","Type":"ContainerStarted","Data":"00390b81d08889bbe91a8bb8c68941c9ae82b1e8201fb79898fa90e38f2f3c4f"}
May 25 11:26:43.823053 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:26:43.823008    2569 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-674b59b84c-mw64w"]
May 25 11:26:45.603243 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:26:45.603208    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-674b59b84c-mw64w" event={"ID":"7f3e2ff7-15d5-47f0-a73f-e753078e4484","Type":"ContainerStarted","Data":"ee54da3acd8a5303e5f0a6012dc9fe596d20ffca36323b763835b37e7c9d2b35"}
May 25 11:26:45.603665 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:26:45.603322    2569 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/authorino-674b59b84c-mw64w" podUID="7f3e2ff7-15d5-47f0-a73f-e753078e4484" containerName="authorino" containerID="cri-o://ee54da3acd8a5303e5f0a6012dc9fe596d20ffca36323b763835b37e7c9d2b35" gracePeriod=30
May 25 11:26:45.617628 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:26:45.617353    2569 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/authorino-674b59b84c-mw64w" podStartSLOduration=1.340767509 podStartE2EDuration="6.617338312s" podCreationTimestamp="2026-05-25 11:26:39 +0000 UTC" firstStartedPulling="2026-05-25 11:26:39.674984393 +0000 UTC m=+538.536608756" lastFinishedPulling="2026-05-25 11:26:44.951555196 +0000 UTC m=+543.813179559" observedRunningTime="2026-05-25 11:26:45.617025495 +0000 UTC m=+544.478649879" watchObservedRunningTime="2026-05-25 11:26:45.617338312 +0000 UTC m=+544.478962696"
May 25 11:26:45.851895 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:26:45.851875    2569 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-674b59b84c-mw64w"
May 25 11:26:45.898632 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:26:45.898569    2569 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zfsr5\" (UniqueName: \"kubernetes.io/projected/7f3e2ff7-15d5-47f0-a73f-e753078e4484-kube-api-access-zfsr5\") pod \"7f3e2ff7-15d5-47f0-a73f-e753078e4484\" (UID: \"7f3e2ff7-15d5-47f0-a73f-e753078e4484\") "
May 25 11:26:45.900663 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:26:45.900630    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7f3e2ff7-15d5-47f0-a73f-e753078e4484-kube-api-access-zfsr5" (OuterVolumeSpecName: "kube-api-access-zfsr5") pod "7f3e2ff7-15d5-47f0-a73f-e753078e4484" (UID: "7f3e2ff7-15d5-47f0-a73f-e753078e4484"). InnerVolumeSpecName "kube-api-access-zfsr5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 25 11:26:45.999267 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:26:45.999241    2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zfsr5\" (UniqueName: \"kubernetes.io/projected/7f3e2ff7-15d5-47f0-a73f-e753078e4484-kube-api-access-zfsr5\") on node \"ip-10-0-143-46.ec2.internal\" DevicePath \"\""
May 25 11:26:46.608056 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:26:46.608022    2569 generic.go:358] "Generic (PLEG): container finished" podID="7f3e2ff7-15d5-47f0-a73f-e753078e4484" containerID="ee54da3acd8a5303e5f0a6012dc9fe596d20ffca36323b763835b37e7c9d2b35" exitCode=0
May 25 11:26:46.608440 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:26:46.608069    2569 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-674b59b84c-mw64w"
May 25 11:26:46.608440 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:26:46.608108    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-674b59b84c-mw64w" event={"ID":"7f3e2ff7-15d5-47f0-a73f-e753078e4484","Type":"ContainerDied","Data":"ee54da3acd8a5303e5f0a6012dc9fe596d20ffca36323b763835b37e7c9d2b35"}
May 25 11:26:46.608440 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:26:46.608148    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-674b59b84c-mw64w" event={"ID":"7f3e2ff7-15d5-47f0-a73f-e753078e4484","Type":"ContainerDied","Data":"00390b81d08889bbe91a8bb8c68941c9ae82b1e8201fb79898fa90e38f2f3c4f"}
May 25 11:26:46.608440 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:26:46.608165    2569 scope.go:117] "RemoveContainer" containerID="ee54da3acd8a5303e5f0a6012dc9fe596d20ffca36323b763835b37e7c9d2b35"
May 25 11:26:46.618709 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:26:46.618690    2569 scope.go:117] "RemoveContainer" containerID="ee54da3acd8a5303e5f0a6012dc9fe596d20ffca36323b763835b37e7c9d2b35"
May 25 11:26:46.619224 ip-10-0-143-46 kubenswrapper[2569]: E0525 11:26:46.619197    2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ee54da3acd8a5303e5f0a6012dc9fe596d20ffca36323b763835b37e7c9d2b35\": container with ID starting with ee54da3acd8a5303e5f0a6012dc9fe596d20ffca36323b763835b37e7c9d2b35 not found: ID does not exist" containerID="ee54da3acd8a5303e5f0a6012dc9fe596d20ffca36323b763835b37e7c9d2b35"
May 25 11:26:46.619359 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:26:46.619223    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ee54da3acd8a5303e5f0a6012dc9fe596d20ffca36323b763835b37e7c9d2b35"} err="failed to get container status \"ee54da3acd8a5303e5f0a6012dc9fe596d20ffca36323b763835b37e7c9d2b35\": rpc error: code = NotFound desc = could not find container \"ee54da3acd8a5303e5f0a6012dc9fe596d20ffca36323b763835b37e7c9d2b35\": container with ID starting with ee54da3acd8a5303e5f0a6012dc9fe596d20ffca36323b763835b37e7c9d2b35 not found: ID does not exist"
May 25 11:26:46.632247 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:26:46.632154    2569 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-674b59b84c-mw64w"]
May 25 11:26:46.634022 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:26:46.634003    2569 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-674b59b84c-mw64w"]
May 25 11:26:47.729661 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:26:47.729630    2569 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7f3e2ff7-15d5-47f0-a73f-e753078e4484" path="/var/lib/kubelet/pods/7f3e2ff7-15d5-47f0-a73f-e753078e4484/volumes"
May 25 11:27:03.918009 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:27:03.917973    2569 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-68bd676465-bjc5n"]
May 25 11:27:03.918431 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:27:03.918321    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7f3e2ff7-15d5-47f0-a73f-e753078e4484" containerName="authorino"
May 25 11:27:03.918431 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:27:03.918332    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="7f3e2ff7-15d5-47f0-a73f-e753078e4484" containerName="authorino"
May 25 11:27:03.918431 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:27:03.918390    2569 memory_manager.go:356] "RemoveStaleState removing state" podUID="7f3e2ff7-15d5-47f0-a73f-e753078e4484" containerName="authorino"
May 25 11:27:03.921228 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:27:03.921211    2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-68bd676465-bjc5n"
May 25 11:27:03.933610 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:27:03.933591    2569 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-sw2nc\""
May 25 11:27:03.936189 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:27:03.936172    2569 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\""
May 25 11:27:03.946078 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:27:03.946054    2569 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-68bd676465-bjc5n"]
May 25 11:27:04.044529 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:27:04.044500    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/c3ad09a6-a470-4b05-8757-2c1c0a42605e-tls-cert\") pod \"authorino-68bd676465-bjc5n\" (UID: \"c3ad09a6-a470-4b05-8757-2c1c0a42605e\") " pod="kuadrant-system/authorino-68bd676465-bjc5n"
May 25 11:27:04.044658 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:27:04.044544    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7d22t\" (UniqueName: \"kubernetes.io/projected/c3ad09a6-a470-4b05-8757-2c1c0a42605e-kube-api-access-7d22t\") pod \"authorino-68bd676465-bjc5n\" (UID: \"c3ad09a6-a470-4b05-8757-2c1c0a42605e\") " pod="kuadrant-system/authorino-68bd676465-bjc5n"
May 25 11:27:04.145982 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:27:04.145940    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/c3ad09a6-a470-4b05-8757-2c1c0a42605e-tls-cert\") pod \"authorino-68bd676465-bjc5n\" (UID: \"c3ad09a6-a470-4b05-8757-2c1c0a42605e\") " pod="kuadrant-system/authorino-68bd676465-bjc5n"
May 25 11:27:04.146113 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:27:04.145995    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-7d22t\" (UniqueName: \"kubernetes.io/projected/c3ad09a6-a470-4b05-8757-2c1c0a42605e-kube-api-access-7d22t\") pod \"authorino-68bd676465-bjc5n\" (UID: \"c3ad09a6-a470-4b05-8757-2c1c0a42605e\") " pod="kuadrant-system/authorino-68bd676465-bjc5n"
May 25 11:27:04.148401 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:27:04.148371    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/c3ad09a6-a470-4b05-8757-2c1c0a42605e-tls-cert\") pod \"authorino-68bd676465-bjc5n\" (UID: \"c3ad09a6-a470-4b05-8757-2c1c0a42605e\") " pod="kuadrant-system/authorino-68bd676465-bjc5n"
May 25 11:27:04.154255 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:27:04.154233    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7d22t\" (UniqueName: \"kubernetes.io/projected/c3ad09a6-a470-4b05-8757-2c1c0a42605e-kube-api-access-7d22t\") pod \"authorino-68bd676465-bjc5n\" (UID: \"c3ad09a6-a470-4b05-8757-2c1c0a42605e\") " pod="kuadrant-system/authorino-68bd676465-bjc5n"
May 25 11:27:04.229736 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:27:04.229681    2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-68bd676465-bjc5n"
May 25 11:27:04.352314 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:27:04.352289    2569 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-68bd676465-bjc5n"]
May 25 11:27:04.354500 ip-10-0-143-46 kubenswrapper[2569]: W0525 11:27:04.354477    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podc3ad09a6_a470_4b05_8757_2c1c0a42605e.slice/crio-9332885e4aef9adbe6d8c87dd939a7a0bc01c6f0cb79867cc79cae65dab50147 WatchSource:0}: Error finding container 9332885e4aef9adbe6d8c87dd939a7a0bc01c6f0cb79867cc79cae65dab50147: Status 404 returned error can't find the container with id 9332885e4aef9adbe6d8c87dd939a7a0bc01c6f0cb79867cc79cae65dab50147
May 25 11:27:04.675773 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:27:04.675740    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-68bd676465-bjc5n" event={"ID":"c3ad09a6-a470-4b05-8757-2c1c0a42605e","Type":"ContainerStarted","Data":"9332885e4aef9adbe6d8c87dd939a7a0bc01c6f0cb79867cc79cae65dab50147"}
May 25 11:27:05.680644 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:27:05.680608    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-68bd676465-bjc5n" event={"ID":"c3ad09a6-a470-4b05-8757-2c1c0a42605e","Type":"ContainerStarted","Data":"6748cd7a118963a555d06653a0878c1a7103d503bba8c06001d4811fa5b5e956"}
May 25 11:27:05.696312 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:27:05.696267    2569 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/authorino-68bd676465-bjc5n" podStartSLOduration=1.934006187 podStartE2EDuration="2.696255197s" podCreationTimestamp="2026-05-25 11:27:03 +0000 UTC" firstStartedPulling="2026-05-25 11:27:04.355712725 +0000 UTC m=+563.217337088" lastFinishedPulling="2026-05-25 11:27:05.117961737 +0000 UTC m=+563.979586098" observedRunningTime="2026-05-25 11:27:05.694837417 +0000 UTC m=+564.556461798" watchObservedRunningTime="2026-05-25 11:27:05.696255197 +0000 UTC m=+564.557879580"
May 25 11:27:41.634066 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:27:41.634038    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-cvhbj_9ff9f77a-ac83-4250-8c40-d14a2db84c1e/console-operator/2.log"
May 25 11:27:41.634477 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:27:41.634087    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-cvhbj_9ff9f77a-ac83-4250-8c40-d14a2db84c1e/console-operator/2.log"
May 25 11:29:20.387391 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:29:20.387360    2569 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/scheduler-inline-config-test-kserve-5f7d7864f7-xgfnz"]
May 25 11:29:20.391162 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:29:20.391137    2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/scheduler-inline-config-test-kserve-5f7d7864f7-xgfnz"
May 25 11:29:20.394551 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:29:20.394530    2569 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"kube-root-ca.crt\""
May 25 11:29:20.395603 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:29:20.395576    2569 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"openshift-service-ca.crt\""
May 25 11:29:20.395717 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:29:20.395621    2569 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"default-dockercfg-5cxfn\""
May 25 11:29:20.395717 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:29:20.395662    2569 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"scheduler-inline-config-test-kserve-self-signed-certs\""
May 25 11:29:20.408527 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:29:20.408500    2569 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/scheduler-inline-config-test-kserve-5f7d7864f7-xgfnz"]
May 25 11:29:20.442559 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:29:20.442532    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/cc1be96e-d3c8-4268-9b4b-74c0df966c8a-dshm\") pod \"scheduler-inline-config-test-kserve-5f7d7864f7-xgfnz\" (UID: \"cc1be96e-d3c8-4268-9b4b-74c0df966c8a\") " pod="kserve-ci-e2e-test/scheduler-inline-config-test-kserve-5f7d7864f7-xgfnz"
May 25 11:29:20.442688 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:29:20.442561    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/cc1be96e-d3c8-4268-9b4b-74c0df966c8a-kserve-provision-location\") pod \"scheduler-inline-config-test-kserve-5f7d7864f7-xgfnz\" (UID: \"cc1be96e-d3c8-4268-9b4b-74c0df966c8a\") " pod="kserve-ci-e2e-test/scheduler-inline-config-test-kserve-5f7d7864f7-xgfnz"
May 25 11:29:20.442688 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:29:20.442622    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/cc1be96e-d3c8-4268-9b4b-74c0df966c8a-model-cache\") pod \"scheduler-inline-config-test-kserve-5f7d7864f7-xgfnz\" (UID: \"cc1be96e-d3c8-4268-9b4b-74c0df966c8a\") " pod="kserve-ci-e2e-test/scheduler-inline-config-test-kserve-5f7d7864f7-xgfnz"
May 25 11:29:20.442688 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:29:20.442672    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/cc1be96e-d3c8-4268-9b4b-74c0df966c8a-tmp-dir\") pod \"scheduler-inline-config-test-kserve-5f7d7864f7-xgfnz\" (UID: \"cc1be96e-d3c8-4268-9b4b-74c0df966c8a\") " pod="kserve-ci-e2e-test/scheduler-inline-config-test-kserve-5f7d7864f7-xgfnz"
May 25 11:29:20.442858 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:29:20.442690    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/cc1be96e-d3c8-4268-9b4b-74c0df966c8a-tls-certs\") pod \"scheduler-inline-config-test-kserve-5f7d7864f7-xgfnz\" (UID: \"cc1be96e-d3c8-4268-9b4b-74c0df966c8a\") " pod="kserve-ci-e2e-test/scheduler-inline-config-test-kserve-5f7d7864f7-xgfnz"
May 25 11:29:20.442858 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:29:20.442710    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/cc1be96e-d3c8-4268-9b4b-74c0df966c8a-home\") pod \"scheduler-inline-config-test-kserve-5f7d7864f7-xgfnz\" (UID: \"cc1be96e-d3c8-4268-9b4b-74c0df966c8a\") " pod="kserve-ci-e2e-test/scheduler-inline-config-test-kserve-5f7d7864f7-xgfnz"
May 25 11:29:20.442858 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:29:20.442764    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vg2hb\" (UniqueName: \"kubernetes.io/projected/cc1be96e-d3c8-4268-9b4b-74c0df966c8a-kube-api-access-vg2hb\") pod \"scheduler-inline-config-test-kserve-5f7d7864f7-xgfnz\" (UID: \"cc1be96e-d3c8-4268-9b4b-74c0df966c8a\") " pod="kserve-ci-e2e-test/scheduler-inline-config-test-kserve-5f7d7864f7-xgfnz"
May 25 11:29:20.543918 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:29:20.543883    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/cc1be96e-d3c8-4268-9b4b-74c0df966c8a-model-cache\") pod \"scheduler-inline-config-test-kserve-5f7d7864f7-xgfnz\" (UID: \"cc1be96e-d3c8-4268-9b4b-74c0df966c8a\") " pod="kserve-ci-e2e-test/scheduler-inline-config-test-kserve-5f7d7864f7-xgfnz"
May 25 11:29:20.544088 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:29:20.543938    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/cc1be96e-d3c8-4268-9b4b-74c0df966c8a-tmp-dir\") pod \"scheduler-inline-config-test-kserve-5f7d7864f7-xgfnz\" (UID: \"cc1be96e-d3c8-4268-9b4b-74c0df966c8a\") " pod="kserve-ci-e2e-test/scheduler-inline-config-test-kserve-5f7d7864f7-xgfnz"
May 25 11:29:20.544088 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:29:20.544049    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/cc1be96e-d3c8-4268-9b4b-74c0df966c8a-tls-certs\") pod \"scheduler-inline-config-test-kserve-5f7d7864f7-xgfnz\" (UID: \"cc1be96e-d3c8-4268-9b4b-74c0df966c8a\") " pod="kserve-ci-e2e-test/scheduler-inline-config-test-kserve-5f7d7864f7-xgfnz"
May 25 11:29:20.544088 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:29:20.544083    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/cc1be96e-d3c8-4268-9b4b-74c0df966c8a-home\") pod \"scheduler-inline-config-test-kserve-5f7d7864f7-xgfnz\" (UID: \"cc1be96e-d3c8-4268-9b4b-74c0df966c8a\") " pod="kserve-ci-e2e-test/scheduler-inline-config-test-kserve-5f7d7864f7-xgfnz"
May 25 11:29:20.544239 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:29:20.544123    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-vg2hb\" (UniqueName: \"kubernetes.io/projected/cc1be96e-d3c8-4268-9b4b-74c0df966c8a-kube-api-access-vg2hb\") pod \"scheduler-inline-config-test-kserve-5f7d7864f7-xgfnz\" (UID: \"cc1be96e-d3c8-4268-9b4b-74c0df966c8a\") " pod="kserve-ci-e2e-test/scheduler-inline-config-test-kserve-5f7d7864f7-xgfnz"
May 25 11:29:20.544239 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:29:20.544152    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/cc1be96e-d3c8-4268-9b4b-74c0df966c8a-dshm\") pod \"scheduler-inline-config-test-kserve-5f7d7864f7-xgfnz\" (UID: \"cc1be96e-d3c8-4268-9b4b-74c0df966c8a\") " pod="kserve-ci-e2e-test/scheduler-inline-config-test-kserve-5f7d7864f7-xgfnz"
May 25 11:29:20.544239 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:29:20.544171    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/cc1be96e-d3c8-4268-9b4b-74c0df966c8a-kserve-provision-location\") pod \"scheduler-inline-config-test-kserve-5f7d7864f7-xgfnz\" (UID: \"cc1be96e-d3c8-4268-9b4b-74c0df966c8a\") " pod="kserve-ci-e2e-test/scheduler-inline-config-test-kserve-5f7d7864f7-xgfnz"
May 25 11:29:20.544373 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:29:20.544304    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/cc1be96e-d3c8-4268-9b4b-74c0df966c8a-tmp-dir\") pod \"scheduler-inline-config-test-kserve-5f7d7864f7-xgfnz\" (UID: \"cc1be96e-d3c8-4268-9b4b-74c0df966c8a\") " pod="kserve-ci-e2e-test/scheduler-inline-config-test-kserve-5f7d7864f7-xgfnz"
May 25 11:29:20.544428 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:29:20.544347    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/cc1be96e-d3c8-4268-9b4b-74c0df966c8a-model-cache\") pod \"scheduler-inline-config-test-kserve-5f7d7864f7-xgfnz\" (UID: \"cc1be96e-d3c8-4268-9b4b-74c0df966c8a\") " pod="kserve-ci-e2e-test/scheduler-inline-config-test-kserve-5f7d7864f7-xgfnz"
May 25 11:29:20.544428 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:29:20.544387    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/cc1be96e-d3c8-4268-9b4b-74c0df966c8a-home\") pod \"scheduler-inline-config-test-kserve-5f7d7864f7-xgfnz\" (UID: \"cc1be96e-d3c8-4268-9b4b-74c0df966c8a\") " pod="kserve-ci-e2e-test/scheduler-inline-config-test-kserve-5f7d7864f7-xgfnz"
May 25 11:29:20.544531 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:29:20.544505    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/cc1be96e-d3c8-4268-9b4b-74c0df966c8a-kserve-provision-location\") pod \"scheduler-inline-config-test-kserve-5f7d7864f7-xgfnz\" (UID: \"cc1be96e-d3c8-4268-9b4b-74c0df966c8a\") " pod="kserve-ci-e2e-test/scheduler-inline-config-test-kserve-5f7d7864f7-xgfnz"
May 25 11:29:20.546356 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:29:20.546335    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/cc1be96e-d3c8-4268-9b4b-74c0df966c8a-dshm\") pod \"scheduler-inline-config-test-kserve-5f7d7864f7-xgfnz\" (UID: \"cc1be96e-d3c8-4268-9b4b-74c0df966c8a\") " pod="kserve-ci-e2e-test/scheduler-inline-config-test-kserve-5f7d7864f7-xgfnz"
May 25 11:29:20.546611 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:29:20.546595    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/cc1be96e-d3c8-4268-9b4b-74c0df966c8a-tls-certs\") pod \"scheduler-inline-config-test-kserve-5f7d7864f7-xgfnz\" (UID: \"cc1be96e-d3c8-4268-9b4b-74c0df966c8a\") " pod="kserve-ci-e2e-test/scheduler-inline-config-test-kserve-5f7d7864f7-xgfnz"
May 25 11:29:20.557071 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:29:20.557049    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vg2hb\" (UniqueName: \"kubernetes.io/projected/cc1be96e-d3c8-4268-9b4b-74c0df966c8a-kube-api-access-vg2hb\") pod \"scheduler-inline-config-test-kserve-5f7d7864f7-xgfnz\" (UID: \"cc1be96e-d3c8-4268-9b4b-74c0df966c8a\") " pod="kserve-ci-e2e-test/scheduler-inline-config-test-kserve-5f7d7864f7-xgfnz"
May 25 11:29:20.703039 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:29:20.702957    2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/scheduler-inline-config-test-kserve-5f7d7864f7-xgfnz"
May 25 11:29:20.829506 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:29:20.829480    2569 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/scheduler-inline-config-test-kserve-5f7d7864f7-xgfnz"]
May 25 11:29:20.831593 ip-10-0-143-46 kubenswrapper[2569]: W0525 11:29:20.831565    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcc1be96e_d3c8_4268_9b4b_74c0df966c8a.slice/crio-26663a850b1f352f24a37a4b5a6d6bc5db96ab3f8f7c26d96091dde9e4bc688e WatchSource:0}: Error finding container 26663a850b1f352f24a37a4b5a6d6bc5db96ab3f8f7c26d96091dde9e4bc688e: Status 404 returned error can't find the container with id 26663a850b1f352f24a37a4b5a6d6bc5db96ab3f8f7c26d96091dde9e4bc688e
May 25 11:29:20.833207 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:29:20.833186    2569 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
May 25 11:29:21.147170 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:29:21.147090    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/scheduler-inline-config-test-kserve-5f7d7864f7-xgfnz" event={"ID":"cc1be96e-d3c8-4268-9b4b-74c0df966c8a","Type":"ContainerStarted","Data":"26663a850b1f352f24a37a4b5a6d6bc5db96ab3f8f7c26d96091dde9e4bc688e"}
May 25 11:29:25.163345 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:29:25.163306    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/scheduler-inline-config-test-kserve-5f7d7864f7-xgfnz" event={"ID":"cc1be96e-d3c8-4268-9b4b-74c0df966c8a","Type":"ContainerStarted","Data":"9bcbaf16b6563e2fa62b62406e294157897bacd78662ea7994d5d4df1c8ae5e2"}
May 25 11:30:00.106623 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:30:00.106593    2569 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/gw-section-name-router-with-gat-f1d92d0f-kserve-79c4b5c88f7tgp7"]
May 25 11:30:00.119688 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:30:00.119659    2569 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/gw-section-name-router-with-gat-f1d92d0f-kserve-79c4b5c88f7tgp7"]
May 25 11:30:00.119830 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:30:00.119772    2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/gw-section-name-router-with-gat-f1d92d0f-kserve-79c4b5c88f7tgp7"
May 25 11:30:00.122467 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:30:00.122443    2569 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"gw-sec2774c263d49959f50d9eebc552e13bf9-kserve-self-signed-certs\""
May 25 11:30:00.283682 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:30:00.283651    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/ab4322f0-28a4-485f-a6db-851640508b77-kserve-provision-location\") pod \"gw-section-name-router-with-gat-f1d92d0f-kserve-79c4b5c88f7tgp7\" (UID: \"ab4322f0-28a4-485f-a6db-851640508b77\") " pod="kserve-ci-e2e-test/gw-section-name-router-with-gat-f1d92d0f-kserve-79c4b5c88f7tgp7"
May 25 11:30:00.283897 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:30:00.283704    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ab4322f0-28a4-485f-a6db-851640508b77-dshm\") pod \"gw-section-name-router-with-gat-f1d92d0f-kserve-79c4b5c88f7tgp7\" (UID: \"ab4322f0-28a4-485f-a6db-851640508b77\") " pod="kserve-ci-e2e-test/gw-section-name-router-with-gat-f1d92d0f-kserve-79c4b5c88f7tgp7"
May 25 11:30:00.283897 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:30:00.283732    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ab4322f0-28a4-485f-a6db-851640508b77-tmp-dir\") pod \"gw-section-name-router-with-gat-f1d92d0f-kserve-79c4b5c88f7tgp7\" (UID: \"ab4322f0-28a4-485f-a6db-851640508b77\") " pod="kserve-ci-e2e-test/gw-section-name-router-with-gat-f1d92d0f-kserve-79c4b5c88f7tgp7"
May 25 11:30:00.283897 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:30:00.283807    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ab4322f0-28a4-485f-a6db-851640508b77-home\") pod \"gw-section-name-router-with-gat-f1d92d0f-kserve-79c4b5c88f7tgp7\" (UID: \"ab4322f0-28a4-485f-a6db-851640508b77\") " pod="kserve-ci-e2e-test/gw-section-name-router-with-gat-f1d92d0f-kserve-79c4b5c88f7tgp7"
May 25 11:30:00.283897 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:30:00.283881    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ab4322f0-28a4-485f-a6db-851640508b77-tls-certs\") pod \"gw-section-name-router-with-gat-f1d92d0f-kserve-79c4b5c88f7tgp7\" (UID: \"ab4322f0-28a4-485f-a6db-851640508b77\") " pod="kserve-ci-e2e-test/gw-section-name-router-with-gat-f1d92d0f-kserve-79c4b5c88f7tgp7"
May 25 11:30:00.284055 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:30:00.283914    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ab4322f0-28a4-485f-a6db-851640508b77-model-cache\") pod \"gw-section-name-router-with-gat-f1d92d0f-kserve-79c4b5c88f7tgp7\" (UID: \"ab4322f0-28a4-485f-a6db-851640508b77\") " pod="kserve-ci-e2e-test/gw-section-name-router-with-gat-f1d92d0f-kserve-79c4b5c88f7tgp7"
May 25 11:30:00.284055 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:30:00.283932    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-45ssb\" (UniqueName: \"kubernetes.io/projected/ab4322f0-28a4-485f-a6db-851640508b77-kube-api-access-45ssb\") pod \"gw-section-name-router-with-gat-f1d92d0f-kserve-79c4b5c88f7tgp7\" (UID: \"ab4322f0-28a4-485f-a6db-851640508b77\") " pod="kserve-ci-e2e-test/gw-section-name-router-with-gat-f1d92d0f-kserve-79c4b5c88f7tgp7"
May 25 11:30:00.384629 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:30:00.384558    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/ab4322f0-28a4-485f-a6db-851640508b77-kserve-provision-location\") pod \"gw-section-name-router-with-gat-f1d92d0f-kserve-79c4b5c88f7tgp7\" (UID: \"ab4322f0-28a4-485f-a6db-851640508b77\") " pod="kserve-ci-e2e-test/gw-section-name-router-with-gat-f1d92d0f-kserve-79c4b5c88f7tgp7"
May 25 11:30:00.384629 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:30:00.384599    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ab4322f0-28a4-485f-a6db-851640508b77-dshm\") pod \"gw-section-name-router-with-gat-f1d92d0f-kserve-79c4b5c88f7tgp7\" (UID: \"ab4322f0-28a4-485f-a6db-851640508b77\") " pod="kserve-ci-e2e-test/gw-section-name-router-with-gat-f1d92d0f-kserve-79c4b5c88f7tgp7"
May 25 11:30:00.384629 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:30:00.384618    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ab4322f0-28a4-485f-a6db-851640508b77-tmp-dir\") pod \"gw-section-name-router-with-gat-f1d92d0f-kserve-79c4b5c88f7tgp7\" (UID: \"ab4322f0-28a4-485f-a6db-851640508b77\") " pod="kserve-ci-e2e-test/gw-section-name-router-with-gat-f1d92d0f-kserve-79c4b5c88f7tgp7"
May 25 11:30:00.384907 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:30:00.384649    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ab4322f0-28a4-485f-a6db-851640508b77-home\") pod \"gw-section-name-router-with-gat-f1d92d0f-kserve-79c4b5c88f7tgp7\" (UID: \"ab4322f0-28a4-485f-a6db-851640508b77\") " pod="kserve-ci-e2e-test/gw-section-name-router-with-gat-f1d92d0f-kserve-79c4b5c88f7tgp7"
May 25 11:30:00.384907 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:30:00.384708    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ab4322f0-28a4-485f-a6db-851640508b77-tls-certs\") pod \"gw-section-name-router-with-gat-f1d92d0f-kserve-79c4b5c88f7tgp7\" (UID: \"ab4322f0-28a4-485f-a6db-851640508b77\") " pod="kserve-ci-e2e-test/gw-section-name-router-with-gat-f1d92d0f-kserve-79c4b5c88f7tgp7"
May 25 11:30:00.384907 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:30:00.384756    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ab4322f0-28a4-485f-a6db-851640508b77-model-cache\") pod \"gw-section-name-router-with-gat-f1d92d0f-kserve-79c4b5c88f7tgp7\" (UID: \"ab4322f0-28a4-485f-a6db-851640508b77\") " pod="kserve-ci-e2e-test/gw-section-name-router-with-gat-f1d92d0f-kserve-79c4b5c88f7tgp7"
May 25 11:30:00.384907 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:30:00.384779    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-45ssb\" (UniqueName: \"kubernetes.io/projected/ab4322f0-28a4-485f-a6db-851640508b77-kube-api-access-45ssb\") pod \"gw-section-name-router-with-gat-f1d92d0f-kserve-79c4b5c88f7tgp7\" (UID: \"ab4322f0-28a4-485f-a6db-851640508b77\") " pod="kserve-ci-e2e-test/gw-section-name-router-with-gat-f1d92d0f-kserve-79c4b5c88f7tgp7"
May 25 11:30:00.385108 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:30:00.384966    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/ab4322f0-28a4-485f-a6db-851640508b77-kserve-provision-location\") pod \"gw-section-name-router-with-gat-f1d92d0f-kserve-79c4b5c88f7tgp7\" (UID: \"ab4322f0-28a4-485f-a6db-851640508b77\") " pod="kserve-ci-e2e-test/gw-section-name-router-with-gat-f1d92d0f-kserve-79c4b5c88f7tgp7"
May 25 11:30:00.385108 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:30:00.385079    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ab4322f0-28a4-485f-a6db-851640508b77-tmp-dir\") pod \"gw-section-name-router-with-gat-f1d92d0f-kserve-79c4b5c88f7tgp7\" (UID: \"ab4322f0-28a4-485f-a6db-851640508b77\") " pod="kserve-ci-e2e-test/gw-section-name-router-with-gat-f1d92d0f-kserve-79c4b5c88f7tgp7"
May 25 11:30:00.385185 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:30:00.385146    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ab4322f0-28a4-485f-a6db-851640508b77-home\") pod \"gw-section-name-router-with-gat-f1d92d0f-kserve-79c4b5c88f7tgp7\" (UID: \"ab4322f0-28a4-485f-a6db-851640508b77\") " pod="kserve-ci-e2e-test/gw-section-name-router-with-gat-f1d92d0f-kserve-79c4b5c88f7tgp7"
May 25 11:30:00.385233 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:30:00.385214    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ab4322f0-28a4-485f-a6db-851640508b77-model-cache\") pod \"gw-section-name-router-with-gat-f1d92d0f-kserve-79c4b5c88f7tgp7\" (UID: \"ab4322f0-28a4-485f-a6db-851640508b77\") " pod="kserve-ci-e2e-test/gw-section-name-router-with-gat-f1d92d0f-kserve-79c4b5c88f7tgp7"
May 25 11:30:00.386947 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:30:00.386928    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ab4322f0-28a4-485f-a6db-851640508b77-dshm\") pod \"gw-section-name-router-with-gat-f1d92d0f-kserve-79c4b5c88f7tgp7\" (UID: \"ab4322f0-28a4-485f-a6db-851640508b77\") " pod="kserve-ci-e2e-test/gw-section-name-router-with-gat-f1d92d0f-kserve-79c4b5c88f7tgp7"
May 25 11:30:00.387202 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:30:00.387184    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ab4322f0-28a4-485f-a6db-851640508b77-tls-certs\") pod \"gw-section-name-router-with-gat-f1d92d0f-kserve-79c4b5c88f7tgp7\" (UID: \"ab4322f0-28a4-485f-a6db-851640508b77\") " pod="kserve-ci-e2e-test/gw-section-name-router-with-gat-f1d92d0f-kserve-79c4b5c88f7tgp7"
May 25 11:30:00.392765 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:30:00.392747    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-45ssb\" (UniqueName: \"kubernetes.io/projected/ab4322f0-28a4-485f-a6db-851640508b77-kube-api-access-45ssb\") pod \"gw-section-name-router-with-gat-f1d92d0f-kserve-79c4b5c88f7tgp7\" (UID: \"ab4322f0-28a4-485f-a6db-851640508b77\") " pod="kserve-ci-e2e-test/gw-section-name-router-with-gat-f1d92d0f-kserve-79c4b5c88f7tgp7"
May 25 11:30:00.430770 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:30:00.430735    2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/gw-section-name-router-with-gat-f1d92d0f-kserve-79c4b5c88f7tgp7"
May 25 11:30:00.568405 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:30:00.568264    2569 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/gw-section-name-router-with-gat-f1d92d0f-kserve-79c4b5c88f7tgp7"]
May 25 11:30:00.572005 ip-10-0-143-46 kubenswrapper[2569]: W0525 11:30:00.571420    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podab4322f0_28a4_485f_a6db_851640508b77.slice/crio-c02909784c4bc89d60642595f9b2a184359624a78f3c6f202e58fb93e8f612fc WatchSource:0}: Error finding container c02909784c4bc89d60642595f9b2a184359624a78f3c6f202e58fb93e8f612fc: Status 404 returned error can't find the container with id c02909784c4bc89d60642595f9b2a184359624a78f3c6f202e58fb93e8f612fc
May 25 11:30:01.287615 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:30:01.287574    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/gw-section-name-router-with-gat-f1d92d0f-kserve-79c4b5c88f7tgp7" event={"ID":"ab4322f0-28a4-485f-a6db-851640508b77","Type":"ContainerStarted","Data":"66d258c781c2d94637b8bd35dbbea07a940a444907310d59915754b7006fc828"}
May 25 11:30:01.287994 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:30:01.287621    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/gw-section-name-router-with-gat-f1d92d0f-kserve-79c4b5c88f7tgp7" event={"ID":"ab4322f0-28a4-485f-a6db-851640508b77","Type":"ContainerStarted","Data":"c02909784c4bc89d60642595f9b2a184359624a78f3c6f202e58fb93e8f612fc"}
May 25 11:30:03.278224 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:30:03.278191    2569 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/gw-section-name-router-with-gat-f1d92d0f-kserve-79c4b5c88f7tgp7"]
May 25 11:30:03.296308 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:30:03.296262    2569 kuberuntime_container.go:864] "Killing container with a grace period" pod="kserve-ci-e2e-test/gw-section-name-router-with-gat-f1d92d0f-kserve-79c4b5c88f7tgp7" podUID="ab4322f0-28a4-485f-a6db-851640508b77" containerName="storage-initializer" containerID="cri-o://66d258c781c2d94637b8bd35dbbea07a940a444907310d59915754b7006fc828" gracePeriod=30
May 25 11:30:33.397303 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:30:33.397276    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_gw-section-name-router-with-gat-f1d92d0f-kserve-79c4b5c88f7tgp7_ab4322f0-28a4-485f-a6db-851640508b77/storage-initializer/0.log"
May 25 11:30:33.397662 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:30:33.397313    2569 generic.go:358] "Generic (PLEG): container finished" podID="ab4322f0-28a4-485f-a6db-851640508b77" containerID="66d258c781c2d94637b8bd35dbbea07a940a444907310d59915754b7006fc828" exitCode=137
May 25 11:30:33.397662 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:30:33.397394    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/gw-section-name-router-with-gat-f1d92d0f-kserve-79c4b5c88f7tgp7" event={"ID":"ab4322f0-28a4-485f-a6db-851640508b77","Type":"ContainerDied","Data":"66d258c781c2d94637b8bd35dbbea07a940a444907310d59915754b7006fc828"}
May 25 11:30:33.489542 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:30:33.489518    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_gw-section-name-router-with-gat-f1d92d0f-kserve-79c4b5c88f7tgp7_ab4322f0-28a4-485f-a6db-851640508b77/storage-initializer/0.log"
May 25 11:30:33.489657 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:30:33.489593    2569 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/gw-section-name-router-with-gat-f1d92d0f-kserve-79c4b5c88f7tgp7"
May 25 11:30:33.538681 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:30:33.538657    2569 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ab4322f0-28a4-485f-a6db-851640508b77-home\") pod \"ab4322f0-28a4-485f-a6db-851640508b77\" (UID: \"ab4322f0-28a4-485f-a6db-851640508b77\") "
May 25 11:30:33.538864 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:30:33.538694    2569 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ab4322f0-28a4-485f-a6db-851640508b77-tmp-dir\") pod \"ab4322f0-28a4-485f-a6db-851640508b77\" (UID: \"ab4322f0-28a4-485f-a6db-851640508b77\") "
May 25 11:30:33.538864 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:30:33.538723    2569 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-45ssb\" (UniqueName: \"kubernetes.io/projected/ab4322f0-28a4-485f-a6db-851640508b77-kube-api-access-45ssb\") pod \"ab4322f0-28a4-485f-a6db-851640508b77\" (UID: \"ab4322f0-28a4-485f-a6db-851640508b77\") "
May 25 11:30:33.538864 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:30:33.538749    2569 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ab4322f0-28a4-485f-a6db-851640508b77-dshm\") pod \"ab4322f0-28a4-485f-a6db-851640508b77\" (UID: \"ab4322f0-28a4-485f-a6db-851640508b77\") "
May 25 11:30:33.538864 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:30:33.538768    2569 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ab4322f0-28a4-485f-a6db-851640508b77-model-cache\") pod \"ab4322f0-28a4-485f-a6db-851640508b77\" (UID: \"ab4322f0-28a4-485f-a6db-851640508b77\") "
May 25 11:30:33.539081 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:30:33.538975    2569 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ab4322f0-28a4-485f-a6db-851640508b77-tls-certs\") pod \"ab4322f0-28a4-485f-a6db-851640508b77\" (UID: \"ab4322f0-28a4-485f-a6db-851640508b77\") "
May 25 11:30:33.539081 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:30:33.539013    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ab4322f0-28a4-485f-a6db-851640508b77-home" (OuterVolumeSpecName: "home") pod "ab4322f0-28a4-485f-a6db-851640508b77" (UID: "ab4322f0-28a4-485f-a6db-851640508b77"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 25 11:30:33.539081 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:30:33.539031    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ab4322f0-28a4-485f-a6db-851640508b77-model-cache" (OuterVolumeSpecName: "model-cache") pod "ab4322f0-28a4-485f-a6db-851640508b77" (UID: "ab4322f0-28a4-485f-a6db-851640508b77"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 25 11:30:33.539081 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:30:33.539041    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ab4322f0-28a4-485f-a6db-851640508b77-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "ab4322f0-28a4-485f-a6db-851640508b77" (UID: "ab4322f0-28a4-485f-a6db-851640508b77"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 25 11:30:33.539081 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:30:33.539052    2569 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/ab4322f0-28a4-485f-a6db-851640508b77-kserve-provision-location\") pod \"ab4322f0-28a4-485f-a6db-851640508b77\" (UID: \"ab4322f0-28a4-485f-a6db-851640508b77\") "
May 25 11:30:33.539357 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:30:33.539335    2569 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ab4322f0-28a4-485f-a6db-851640508b77-home\") on node \"ip-10-0-143-46.ec2.internal\" DevicePath \"\""
May 25 11:30:33.539464 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:30:33.539361    2569 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ab4322f0-28a4-485f-a6db-851640508b77-tmp-dir\") on node \"ip-10-0-143-46.ec2.internal\" DevicePath \"\""
May 25 11:30:33.539464 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:30:33.539377    2569 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ab4322f0-28a4-485f-a6db-851640508b77-model-cache\") on node \"ip-10-0-143-46.ec2.internal\" DevicePath \"\""
May 25 11:30:33.540905 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:30:33.540884    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ab4322f0-28a4-485f-a6db-851640508b77-dshm" (OuterVolumeSpecName: "dshm") pod "ab4322f0-28a4-485f-a6db-851640508b77" (UID: "ab4322f0-28a4-485f-a6db-851640508b77"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 25 11:30:33.540992 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:30:33.540975    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ab4322f0-28a4-485f-a6db-851640508b77-kube-api-access-45ssb" (OuterVolumeSpecName: "kube-api-access-45ssb") pod "ab4322f0-28a4-485f-a6db-851640508b77" (UID: "ab4322f0-28a4-485f-a6db-851640508b77"). InnerVolumeSpecName "kube-api-access-45ssb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 25 11:30:33.541292 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:30:33.541265    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ab4322f0-28a4-485f-a6db-851640508b77-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "ab4322f0-28a4-485f-a6db-851640508b77" (UID: "ab4322f0-28a4-485f-a6db-851640508b77"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 25 11:30:33.575605 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:30:33.575548    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ab4322f0-28a4-485f-a6db-851640508b77-kserve-provision-location" (OuterVolumeSpecName: "kserve-provision-location") pod "ab4322f0-28a4-485f-a6db-851640508b77" (UID: "ab4322f0-28a4-485f-a6db-851640508b77"). InnerVolumeSpecName "kserve-provision-location". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 25 11:30:33.639948 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:30:33.639927    2569 reconciler_common.go:299] "Volume detached for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/ab4322f0-28a4-485f-a6db-851640508b77-kserve-provision-location\") on node \"ip-10-0-143-46.ec2.internal\" DevicePath \"\""
May 25 11:30:33.639948 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:30:33.639946    2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-45ssb\" (UniqueName: \"kubernetes.io/projected/ab4322f0-28a4-485f-a6db-851640508b77-kube-api-access-45ssb\") on node \"ip-10-0-143-46.ec2.internal\" DevicePath \"\""
May 25 11:30:33.640069 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:30:33.639957    2569 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ab4322f0-28a4-485f-a6db-851640508b77-dshm\") on node \"ip-10-0-143-46.ec2.internal\" DevicePath \"\""
May 25 11:30:33.640069 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:30:33.639966    2569 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ab4322f0-28a4-485f-a6db-851640508b77-tls-certs\") on node \"ip-10-0-143-46.ec2.internal\" DevicePath \"\""
May 25 11:30:34.401871 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:30:34.401844    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_gw-section-name-router-with-gat-f1d92d0f-kserve-79c4b5c88f7tgp7_ab4322f0-28a4-485f-a6db-851640508b77/storage-initializer/0.log"
May 25 11:30:34.402275 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:30:34.401961    2569 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/gw-section-name-router-with-gat-f1d92d0f-kserve-79c4b5c88f7tgp7"
May 25 11:30:34.402275 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:30:34.401976    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/gw-section-name-router-with-gat-f1d92d0f-kserve-79c4b5c88f7tgp7" event={"ID":"ab4322f0-28a4-485f-a6db-851640508b77","Type":"ContainerDied","Data":"c02909784c4bc89d60642595f9b2a184359624a78f3c6f202e58fb93e8f612fc"}
May 25 11:30:34.402275 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:30:34.402021    2569 scope.go:117] "RemoveContainer" containerID="66d258c781c2d94637b8bd35dbbea07a940a444907310d59915754b7006fc828"
May 25 11:30:34.435248 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:30:34.435218    2569 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/gw-section-name-router-with-gat-f1d92d0f-kserve-79c4b5c88f7tgp7"]
May 25 11:30:34.437833 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:30:34.437804    2569 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/gw-section-name-router-with-gat-f1d92d0f-kserve-79c4b5c88f7tgp7"]
May 25 11:30:35.729644 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:30:35.729611    2569 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ab4322f0-28a4-485f-a6db-851640508b77" path="/var/lib/kubelet/pods/ab4322f0-28a4-485f-a6db-851640508b77/volumes"
May 25 11:32:41.657285 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:32:41.657256    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-cvhbj_9ff9f77a-ac83-4250-8c40-d14a2db84c1e/console-operator/2.log"
May 25 11:32:41.660112 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:32:41.660086    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-cvhbj_9ff9f77a-ac83-4250-8c40-d14a2db84c1e/console-operator/2.log"
May 25 11:37:41.682009 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:37:41.681980    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-cvhbj_9ff9f77a-ac83-4250-8c40-d14a2db84c1e/console-operator/2.log"
May 25 11:37:41.684653 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:37:41.684633    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-cvhbj_9ff9f77a-ac83-4250-8c40-d14a2db84c1e/console-operator/2.log"
May 25 11:42:41.713391 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:42:41.713359    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-cvhbj_9ff9f77a-ac83-4250-8c40-d14a2db84c1e/console-operator/2.log"
May 25 11:42:41.718750 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:42:41.718726    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-cvhbj_9ff9f77a-ac83-4250-8c40-d14a2db84c1e/console-operator/2.log"
May 25 11:42:51.608696 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:42:51.608662    2569 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/router-gateway-2-openshift-default-7bb57db77b-rf2sq"]
May 25 11:42:51.609340 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:42:51.609316    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ab4322f0-28a4-485f-a6db-851640508b77" containerName="storage-initializer"
May 25 11:42:51.609340 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:42:51.609341    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="ab4322f0-28a4-485f-a6db-851640508b77" containerName="storage-initializer"
May 25 11:42:51.609474 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:42:51.609437    2569 memory_manager.go:356] "RemoveStaleState removing state" podUID="ab4322f0-28a4-485f-a6db-851640508b77" containerName="storage-initializer"
May 25 11:42:51.611327 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:42:51.611308    2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/router-gateway-2-openshift-default-7bb57db77b-rf2sq"
May 25 11:42:51.614063 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:42:51.614040    2569 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"openshift-gw-ca-root-cert\""
May 25 11:42:51.614171 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:42:51.614044    2569 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"router-gateway-2-openshift-default-dockercfg-dsn9k\""
May 25 11:42:51.628183 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:42:51.628158    2569 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/router-gateway-2-openshift-default-7bb57db77b-rf2sq"]
May 25 11:42:51.726471 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:42:51.726433    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9c2bb4c5-570c-45cd-bff1-c86ed015c05b-istiod-ca-cert\") pod \"router-gateway-2-openshift-default-7bb57db77b-rf2sq\" (UID: \"9c2bb4c5-570c-45cd-bff1-c86ed015c05b\") " pod="kserve-ci-e2e-test/router-gateway-2-openshift-default-7bb57db77b-rf2sq"
May 25 11:42:51.726631 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:42:51.726477    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9c2bb4c5-570c-45cd-bff1-c86ed015c05b-credential-socket\") pod \"router-gateway-2-openshift-default-7bb57db77b-rf2sq\" (UID: \"9c2bb4c5-570c-45cd-bff1-c86ed015c05b\") " pod="kserve-ci-e2e-test/router-gateway-2-openshift-default-7bb57db77b-rf2sq"
May 25 11:42:51.726631 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:42:51.726536    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9c2bb4c5-570c-45cd-bff1-c86ed015c05b-istio-podinfo\") pod \"router-gateway-2-openshift-default-7bb57db77b-rf2sq\" (UID: \"9c2bb4c5-570c-45cd-bff1-c86ed015c05b\") " pod="kserve-ci-e2e-test/router-gateway-2-openshift-default-7bb57db77b-rf2sq"
May 25 11:42:51.726631 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:42:51.726576    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9c2bb4c5-570c-45cd-bff1-c86ed015c05b-workload-certs\") pod \"router-gateway-2-openshift-default-7bb57db77b-rf2sq\" (UID: \"9c2bb4c5-570c-45cd-bff1-c86ed015c05b\") " pod="kserve-ci-e2e-test/router-gateway-2-openshift-default-7bb57db77b-rf2sq"
May 25 11:42:51.726631 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:42:51.726602    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9c2bb4c5-570c-45cd-bff1-c86ed015c05b-istio-data\") pod \"router-gateway-2-openshift-default-7bb57db77b-rf2sq\" (UID: \"9c2bb4c5-570c-45cd-bff1-c86ed015c05b\") " pod="kserve-ci-e2e-test/router-gateway-2-openshift-default-7bb57db77b-rf2sq"
May 25 11:42:51.726631 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:42:51.726620    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9c2bb4c5-570c-45cd-bff1-c86ed015c05b-istio-token\") pod \"router-gateway-2-openshift-default-7bb57db77b-rf2sq\" (UID: \"9c2bb4c5-570c-45cd-bff1-c86ed015c05b\") " pod="kserve-ci-e2e-test/router-gateway-2-openshift-default-7bb57db77b-rf2sq"
May 25 11:42:51.726931 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:42:51.726664    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-78b4j\" (UniqueName: \"kubernetes.io/projected/9c2bb4c5-570c-45cd-bff1-c86ed015c05b-kube-api-access-78b4j\") pod \"router-gateway-2-openshift-default-7bb57db77b-rf2sq\" (UID: \"9c2bb4c5-570c-45cd-bff1-c86ed015c05b\") " pod="kserve-ci-e2e-test/router-gateway-2-openshift-default-7bb57db77b-rf2sq"
May 25 11:42:51.726931 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:42:51.726692    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9c2bb4c5-570c-45cd-bff1-c86ed015c05b-istio-envoy\") pod \"router-gateway-2-openshift-default-7bb57db77b-rf2sq\" (UID: \"9c2bb4c5-570c-45cd-bff1-c86ed015c05b\") " pod="kserve-ci-e2e-test/router-gateway-2-openshift-default-7bb57db77b-rf2sq"
May 25 11:42:51.726931 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:42:51.726721    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9c2bb4c5-570c-45cd-bff1-c86ed015c05b-workload-socket\") pod \"router-gateway-2-openshift-default-7bb57db77b-rf2sq\" (UID: \"9c2bb4c5-570c-45cd-bff1-c86ed015c05b\") " pod="kserve-ci-e2e-test/router-gateway-2-openshift-default-7bb57db77b-rf2sq"
May 25 11:42:51.828048 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:42:51.828020    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9c2bb4c5-570c-45cd-bff1-c86ed015c05b-istio-podinfo\") pod \"router-gateway-2-openshift-default-7bb57db77b-rf2sq\" (UID: \"9c2bb4c5-570c-45cd-bff1-c86ed015c05b\") " pod="kserve-ci-e2e-test/router-gateway-2-openshift-default-7bb57db77b-rf2sq"
May 25 11:42:51.828173 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:42:51.828073    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9c2bb4c5-570c-45cd-bff1-c86ed015c05b-workload-certs\") pod \"router-gateway-2-openshift-default-7bb57db77b-rf2sq\" (UID: \"9c2bb4c5-570c-45cd-bff1-c86ed015c05b\") " pod="kserve-ci-e2e-test/router-gateway-2-openshift-default-7bb57db77b-rf2sq"
May 25 11:42:51.828173 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:42:51.828098    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9c2bb4c5-570c-45cd-bff1-c86ed015c05b-istio-data\") pod \"router-gateway-2-openshift-default-7bb57db77b-rf2sq\" (UID: \"9c2bb4c5-570c-45cd-bff1-c86ed015c05b\") " pod="kserve-ci-e2e-test/router-gateway-2-openshift-default-7bb57db77b-rf2sq"
May 25 11:42:51.828173 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:42:51.828115    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9c2bb4c5-570c-45cd-bff1-c86ed015c05b-istio-token\") pod \"router-gateway-2-openshift-default-7bb57db77b-rf2sq\" (UID: \"9c2bb4c5-570c-45cd-bff1-c86ed015c05b\") " pod="kserve-ci-e2e-test/router-gateway-2-openshift-default-7bb57db77b-rf2sq"
May 25 11:42:51.828173 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:42:51.828142    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-78b4j\" (UniqueName: \"kubernetes.io/projected/9c2bb4c5-570c-45cd-bff1-c86ed015c05b-kube-api-access-78b4j\") pod \"router-gateway-2-openshift-default-7bb57db77b-rf2sq\" (UID: \"9c2bb4c5-570c-45cd-bff1-c86ed015c05b\") " pod="kserve-ci-e2e-test/router-gateway-2-openshift-default-7bb57db77b-rf2sq"
May 25 11:42:51.828370 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:42:51.828237    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9c2bb4c5-570c-45cd-bff1-c86ed015c05b-istio-envoy\") pod \"router-gateway-2-openshift-default-7bb57db77b-rf2sq\" (UID: \"9c2bb4c5-570c-45cd-bff1-c86ed015c05b\") " pod="kserve-ci-e2e-test/router-gateway-2-openshift-default-7bb57db77b-rf2sq"
May 25 11:42:51.828370 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:42:51.828303    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9c2bb4c5-570c-45cd-bff1-c86ed015c05b-workload-socket\") pod \"router-gateway-2-openshift-default-7bb57db77b-rf2sq\" (UID: \"9c2bb4c5-570c-45cd-bff1-c86ed015c05b\") " pod="kserve-ci-e2e-test/router-gateway-2-openshift-default-7bb57db77b-rf2sq"
May 25 11:42:51.828469 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:42:51.828379    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9c2bb4c5-570c-45cd-bff1-c86ed015c05b-istiod-ca-cert\") pod \"router-gateway-2-openshift-default-7bb57db77b-rf2sq\" (UID: \"9c2bb4c5-570c-45cd-bff1-c86ed015c05b\") " pod="kserve-ci-e2e-test/router-gateway-2-openshift-default-7bb57db77b-rf2sq"
May 25 11:42:51.828469 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:42:51.828414    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9c2bb4c5-570c-45cd-bff1-c86ed015c05b-credential-socket\") pod \"router-gateway-2-openshift-default-7bb57db77b-rf2sq\" (UID: \"9c2bb4c5-570c-45cd-bff1-c86ed015c05b\") " pod="kserve-ci-e2e-test/router-gateway-2-openshift-default-7bb57db77b-rf2sq"
May 25 11:42:51.828605 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:42:51.828579    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9c2bb4c5-570c-45cd-bff1-c86ed015c05b-istio-data\") pod \"router-gateway-2-openshift-default-7bb57db77b-rf2sq\" (UID: \"9c2bb4c5-570c-45cd-bff1-c86ed015c05b\") " pod="kserve-ci-e2e-test/router-gateway-2-openshift-default-7bb57db77b-rf2sq"
May 25 11:42:51.828807 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:42:51.828624    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9c2bb4c5-570c-45cd-bff1-c86ed015c05b-workload-certs\") pod \"router-gateway-2-openshift-default-7bb57db77b-rf2sq\" (UID: \"9c2bb4c5-570c-45cd-bff1-c86ed015c05b\") " pod="kserve-ci-e2e-test/router-gateway-2-openshift-default-7bb57db77b-rf2sq"
May 25 11:42:51.828885 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:42:51.828807    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9c2bb4c5-570c-45cd-bff1-c86ed015c05b-credential-socket\") pod \"router-gateway-2-openshift-default-7bb57db77b-rf2sq\" (UID: \"9c2bb4c5-570c-45cd-bff1-c86ed015c05b\") " pod="kserve-ci-e2e-test/router-gateway-2-openshift-default-7bb57db77b-rf2sq"
May 25 11:42:51.828885 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:42:51.828703    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9c2bb4c5-570c-45cd-bff1-c86ed015c05b-workload-socket\") pod \"router-gateway-2-openshift-default-7bb57db77b-rf2sq\" (UID: \"9c2bb4c5-570c-45cd-bff1-c86ed015c05b\") " pod="kserve-ci-e2e-test/router-gateway-2-openshift-default-7bb57db77b-rf2sq"
May 25 11:42:51.829135 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:42:51.829119    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9c2bb4c5-570c-45cd-bff1-c86ed015c05b-istiod-ca-cert\") pod \"router-gateway-2-openshift-default-7bb57db77b-rf2sq\" (UID: \"9c2bb4c5-570c-45cd-bff1-c86ed015c05b\") " pod="kserve-ci-e2e-test/router-gateway-2-openshift-default-7bb57db77b-rf2sq"
May 25 11:42:51.830573 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:42:51.830555    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9c2bb4c5-570c-45cd-bff1-c86ed015c05b-istio-envoy\") pod \"router-gateway-2-openshift-default-7bb57db77b-rf2sq\" (UID: \"9c2bb4c5-570c-45cd-bff1-c86ed015c05b\") " pod="kserve-ci-e2e-test/router-gateway-2-openshift-default-7bb57db77b-rf2sq"
May 25 11:42:51.830722 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:42:51.830701    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9c2bb4c5-570c-45cd-bff1-c86ed015c05b-istio-podinfo\") pod \"router-gateway-2-openshift-default-7bb57db77b-rf2sq\" (UID: \"9c2bb4c5-570c-45cd-bff1-c86ed015c05b\") " pod="kserve-ci-e2e-test/router-gateway-2-openshift-default-7bb57db77b-rf2sq"
May 25 11:42:51.837573 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:42:51.837554    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9c2bb4c5-570c-45cd-bff1-c86ed015c05b-istio-token\") pod \"router-gateway-2-openshift-default-7bb57db77b-rf2sq\" (UID: \"9c2bb4c5-570c-45cd-bff1-c86ed015c05b\") " pod="kserve-ci-e2e-test/router-gateway-2-openshift-default-7bb57db77b-rf2sq"
May 25 11:42:51.837737 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:42:51.837720    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-78b4j\" (UniqueName: \"kubernetes.io/projected/9c2bb4c5-570c-45cd-bff1-c86ed015c05b-kube-api-access-78b4j\") pod \"router-gateway-2-openshift-default-7bb57db77b-rf2sq\" (UID: \"9c2bb4c5-570c-45cd-bff1-c86ed015c05b\") " pod="kserve-ci-e2e-test/router-gateway-2-openshift-default-7bb57db77b-rf2sq"
May 25 11:42:51.921644 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:42:51.921588    2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/router-gateway-2-openshift-default-7bb57db77b-rf2sq"
May 25 11:42:52.053891 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:42:52.053867    2569 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/router-gateway-2-openshift-default-7bb57db77b-rf2sq"]
May 25 11:42:52.055822 ip-10-0-143-46 kubenswrapper[2569]: W0525 11:42:52.055778    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9c2bb4c5_570c_45cd_bff1_c86ed015c05b.slice/crio-89943002d1e2166c5b65f18e1b51d3f0ff96db3106f4d80b8e9a79fa19736dc3 WatchSource:0}: Error finding container 89943002d1e2166c5b65f18e1b51d3f0ff96db3106f4d80b8e9a79fa19736dc3: Status 404 returned error can't find the container with id 89943002d1e2166c5b65f18e1b51d3f0ff96db3106f4d80b8e9a79fa19736dc3
May 25 11:42:52.057573 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:42:52.057555    2569 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
May 25 11:42:52.898425 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:42:52.898382    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/router-gateway-2-openshift-default-7bb57db77b-rf2sq" event={"ID":"9c2bb4c5-570c-45cd-bff1-c86ed015c05b","Type":"ContainerStarted","Data":"89943002d1e2166c5b65f18e1b51d3f0ff96db3106f4d80b8e9a79fa19736dc3"}
May 25 11:42:54.302276 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:42:54.302230    2569 kubelet_resources.go:45] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
May 25 11:42:54.302551 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:42:54.302309    2569 kubelet_resources.go:45] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
May 25 11:42:54.302551 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:42:54.302345    2569 kubelet_resources.go:45] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
May 25 11:42:54.906115 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:42:54.906074    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/router-gateway-2-openshift-default-7bb57db77b-rf2sq" event={"ID":"9c2bb4c5-570c-45cd-bff1-c86ed015c05b","Type":"ContainerStarted","Data":"c6acb84a40a29ea441ce3693df8490e8e4f0c2c686d2faaa5797979abd64d34f"}
May 25 11:42:54.921710 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:42:54.921687    2569 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kserve-ci-e2e-test/router-gateway-2-openshift-default-7bb57db77b-rf2sq"
May 25 11:42:54.929670 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:42:54.929623    2569 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kserve-ci-e2e-test/router-gateway-2-openshift-default-7bb57db77b-rf2sq" podStartSLOduration=1.685323017 podStartE2EDuration="3.929610046s" podCreationTimestamp="2026-05-25 11:42:51 +0000 UTC" firstStartedPulling="2026-05-25 11:42:52.057693736 +0000 UTC m=+1510.919318098" lastFinishedPulling="2026-05-25 11:42:54.301980762 +0000 UTC m=+1513.163605127" observedRunningTime="2026-05-25 11:42:54.927951881 +0000 UTC m=+1513.789576264" watchObservedRunningTime="2026-05-25 11:42:54.929610046 +0000 UTC m=+1513.791234430"
May 25 11:42:55.923711 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:42:55.923612    2569 prober.go:120] "Probe failed" probeType="Startup" pod="kserve-ci-e2e-test/router-gateway-2-openshift-default-7bb57db77b-rf2sq" podUID="9c2bb4c5-570c-45cd-bff1-c86ed015c05b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.39:15021/healthz/ready\": dial tcp 10.134.0.39:15021: connect: connection refused"
May 25 11:42:56.922182 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:42:56.922144    2569 prober.go:120] "Probe failed" probeType="Startup" pod="kserve-ci-e2e-test/router-gateway-2-openshift-default-7bb57db77b-rf2sq" podUID="9c2bb4c5-570c-45cd-bff1-c86ed015c05b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.39:15021/healthz/ready\": dial tcp 10.134.0.39:15021: connect: connection refused"
May 25 11:42:57.926306 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:42:57.926273    2569 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="kserve-ci-e2e-test/router-gateway-2-openshift-default-7bb57db77b-rf2sq"
May 25 11:42:57.926739 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:42:57.926536    2569 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/router-gateway-2-openshift-default-7bb57db77b-rf2sq"
May 25 11:42:57.927368 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:42:57.927351    2569 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/router-gateway-2-openshift-default-7bb57db77b-rf2sq"
May 25 11:44:16.488666 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:44:16.488629    2569 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/scheduler-inline-config-test-kserve-5f7d7864f7-xgfnz"]
May 25 11:44:16.489206 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:44:16.488919    2569 kuberuntime_container.go:864] "Killing container with a grace period" pod="kserve-ci-e2e-test/scheduler-inline-config-test-kserve-5f7d7864f7-xgfnz" podUID="cc1be96e-d3c8-4268-9b4b-74c0df966c8a" containerName="storage-initializer" containerID="cri-o://9bcbaf16b6563e2fa62b62406e294157897bacd78662ea7994d5d4df1c8ae5e2" gracePeriod=30
May 25 11:44:28.077442 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:44:28.077409    2569 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/scheduler-configmap-ref-test-kserve-9fb79786f-dn8wb"]
May 25 11:44:28.079718 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:44:28.079702    2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/scheduler-configmap-ref-test-kserve-9fb79786f-dn8wb"
May 25 11:44:28.083435 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:44:28.083415    2569 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"scheduler-configmap-ref-test-kserve-self-signed-certs\""
May 25 11:44:28.093426 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:44:28.093401    2569 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/scheduler-configmap-ref-test-kserve-9fb79786f-dn8wb"]
May 25 11:44:28.116715 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:44:28.116692    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-49hlv\" (UniqueName: \"kubernetes.io/projected/94f01b2d-9552-49c8-8b8d-1d5db747bfb9-kube-api-access-49hlv\") pod \"scheduler-configmap-ref-test-kserve-9fb79786f-dn8wb\" (UID: \"94f01b2d-9552-49c8-8b8d-1d5db747bfb9\") " pod="kserve-ci-e2e-test/scheduler-configmap-ref-test-kserve-9fb79786f-dn8wb"
May 25 11:44:28.116840 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:44:28.116740    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/94f01b2d-9552-49c8-8b8d-1d5db747bfb9-home\") pod \"scheduler-configmap-ref-test-kserve-9fb79786f-dn8wb\" (UID: \"94f01b2d-9552-49c8-8b8d-1d5db747bfb9\") " pod="kserve-ci-e2e-test/scheduler-configmap-ref-test-kserve-9fb79786f-dn8wb"
May 25 11:44:28.116840 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:44:28.116759    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/94f01b2d-9552-49c8-8b8d-1d5db747bfb9-model-cache\") pod \"scheduler-configmap-ref-test-kserve-9fb79786f-dn8wb\" (UID: \"94f01b2d-9552-49c8-8b8d-1d5db747bfb9\") " pod="kserve-ci-e2e-test/scheduler-configmap-ref-test-kserve-9fb79786f-dn8wb"
May 25 11:44:28.116840 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:44:28.116780    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/94f01b2d-9552-49c8-8b8d-1d5db747bfb9-tls-certs\") pod \"scheduler-configmap-ref-test-kserve-9fb79786f-dn8wb\" (UID: \"94f01b2d-9552-49c8-8b8d-1d5db747bfb9\") " pod="kserve-ci-e2e-test/scheduler-configmap-ref-test-kserve-9fb79786f-dn8wb"
May 25 11:44:28.116840 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:44:28.116815    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/94f01b2d-9552-49c8-8b8d-1d5db747bfb9-tmp-dir\") pod \"scheduler-configmap-ref-test-kserve-9fb79786f-dn8wb\" (UID: \"94f01b2d-9552-49c8-8b8d-1d5db747bfb9\") " pod="kserve-ci-e2e-test/scheduler-configmap-ref-test-kserve-9fb79786f-dn8wb"
May 25 11:44:28.117042 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:44:28.116922    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/94f01b2d-9552-49c8-8b8d-1d5db747bfb9-dshm\") pod \"scheduler-configmap-ref-test-kserve-9fb79786f-dn8wb\" (UID: \"94f01b2d-9552-49c8-8b8d-1d5db747bfb9\") " pod="kserve-ci-e2e-test/scheduler-configmap-ref-test-kserve-9fb79786f-dn8wb"
May 25 11:44:28.117042 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:44:28.116966    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/94f01b2d-9552-49c8-8b8d-1d5db747bfb9-kserve-provision-location\") pod \"scheduler-configmap-ref-test-kserve-9fb79786f-dn8wb\" (UID: \"94f01b2d-9552-49c8-8b8d-1d5db747bfb9\") " pod="kserve-ci-e2e-test/scheduler-configmap-ref-test-kserve-9fb79786f-dn8wb"
May 25 11:44:28.217362 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:44:28.217336    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/94f01b2d-9552-49c8-8b8d-1d5db747bfb9-home\") pod \"scheduler-configmap-ref-test-kserve-9fb79786f-dn8wb\" (UID: \"94f01b2d-9552-49c8-8b8d-1d5db747bfb9\") " pod="kserve-ci-e2e-test/scheduler-configmap-ref-test-kserve-9fb79786f-dn8wb"
May 25 11:44:28.217466 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:44:28.217366    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/94f01b2d-9552-49c8-8b8d-1d5db747bfb9-model-cache\") pod \"scheduler-configmap-ref-test-kserve-9fb79786f-dn8wb\" (UID: \"94f01b2d-9552-49c8-8b8d-1d5db747bfb9\") " pod="kserve-ci-e2e-test/scheduler-configmap-ref-test-kserve-9fb79786f-dn8wb"
May 25 11:44:28.217466 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:44:28.217391    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/94f01b2d-9552-49c8-8b8d-1d5db747bfb9-tls-certs\") pod \"scheduler-configmap-ref-test-kserve-9fb79786f-dn8wb\" (UID: \"94f01b2d-9552-49c8-8b8d-1d5db747bfb9\") " pod="kserve-ci-e2e-test/scheduler-configmap-ref-test-kserve-9fb79786f-dn8wb"
May 25 11:44:28.217466 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:44:28.217443    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/94f01b2d-9552-49c8-8b8d-1d5db747bfb9-tmp-dir\") pod \"scheduler-configmap-ref-test-kserve-9fb79786f-dn8wb\" (UID: \"94f01b2d-9552-49c8-8b8d-1d5db747bfb9\") " pod="kserve-ci-e2e-test/scheduler-configmap-ref-test-kserve-9fb79786f-dn8wb"
May 25 11:44:28.217569 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:44:28.217522    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/94f01b2d-9552-49c8-8b8d-1d5db747bfb9-dshm\") pod \"scheduler-configmap-ref-test-kserve-9fb79786f-dn8wb\" (UID: \"94f01b2d-9552-49c8-8b8d-1d5db747bfb9\") " pod="kserve-ci-e2e-test/scheduler-configmap-ref-test-kserve-9fb79786f-dn8wb"
May 25 11:44:28.217692 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:44:28.217644    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/94f01b2d-9552-49c8-8b8d-1d5db747bfb9-kserve-provision-location\") pod \"scheduler-configmap-ref-test-kserve-9fb79786f-dn8wb\" (UID: \"94f01b2d-9552-49c8-8b8d-1d5db747bfb9\") " pod="kserve-ci-e2e-test/scheduler-configmap-ref-test-kserve-9fb79786f-dn8wb"
May 25 11:44:28.217762 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:44:28.217718    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-49hlv\" (UniqueName: \"kubernetes.io/projected/94f01b2d-9552-49c8-8b8d-1d5db747bfb9-kube-api-access-49hlv\") pod \"scheduler-configmap-ref-test-kserve-9fb79786f-dn8wb\" (UID: \"94f01b2d-9552-49c8-8b8d-1d5db747bfb9\") " pod="kserve-ci-e2e-test/scheduler-configmap-ref-test-kserve-9fb79786f-dn8wb"
May 25 11:44:28.217851 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:44:28.217777    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/94f01b2d-9552-49c8-8b8d-1d5db747bfb9-model-cache\") pod \"scheduler-configmap-ref-test-kserve-9fb79786f-dn8wb\" (UID: \"94f01b2d-9552-49c8-8b8d-1d5db747bfb9\") " pod="kserve-ci-e2e-test/scheduler-configmap-ref-test-kserve-9fb79786f-dn8wb"
May 25 11:44:28.217911 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:44:28.217848    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/94f01b2d-9552-49c8-8b8d-1d5db747bfb9-home\") pod \"scheduler-configmap-ref-test-kserve-9fb79786f-dn8wb\" (UID: \"94f01b2d-9552-49c8-8b8d-1d5db747bfb9\") " pod="kserve-ci-e2e-test/scheduler-configmap-ref-test-kserve-9fb79786f-dn8wb"
May 25 11:44:28.217971 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:44:28.217940    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/94f01b2d-9552-49c8-8b8d-1d5db747bfb9-tmp-dir\") pod \"scheduler-configmap-ref-test-kserve-9fb79786f-dn8wb\" (UID: \"94f01b2d-9552-49c8-8b8d-1d5db747bfb9\") " pod="kserve-ci-e2e-test/scheduler-configmap-ref-test-kserve-9fb79786f-dn8wb"
May 25 11:44:28.218058 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:44:28.218037    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/94f01b2d-9552-49c8-8b8d-1d5db747bfb9-kserve-provision-location\") pod \"scheduler-configmap-ref-test-kserve-9fb79786f-dn8wb\" (UID: \"94f01b2d-9552-49c8-8b8d-1d5db747bfb9\") " pod="kserve-ci-e2e-test/scheduler-configmap-ref-test-kserve-9fb79786f-dn8wb"
May 25 11:44:28.219614 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:44:28.219594    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/94f01b2d-9552-49c8-8b8d-1d5db747bfb9-dshm\") pod \"scheduler-configmap-ref-test-kserve-9fb79786f-dn8wb\" (UID: \"94f01b2d-9552-49c8-8b8d-1d5db747bfb9\") " pod="kserve-ci-e2e-test/scheduler-configmap-ref-test-kserve-9fb79786f-dn8wb"
May 25 11:44:28.220108 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:44:28.220087    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/94f01b2d-9552-49c8-8b8d-1d5db747bfb9-tls-certs\") pod \"scheduler-configmap-ref-test-kserve-9fb79786f-dn8wb\" (UID: \"94f01b2d-9552-49c8-8b8d-1d5db747bfb9\") " pod="kserve-ci-e2e-test/scheduler-configmap-ref-test-kserve-9fb79786f-dn8wb"
May 25 11:44:28.230146 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:44:28.230114    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-49hlv\" (UniqueName: \"kubernetes.io/projected/94f01b2d-9552-49c8-8b8d-1d5db747bfb9-kube-api-access-49hlv\") pod \"scheduler-configmap-ref-test-kserve-9fb79786f-dn8wb\" (UID: \"94f01b2d-9552-49c8-8b8d-1d5db747bfb9\") " pod="kserve-ci-e2e-test/scheduler-configmap-ref-test-kserve-9fb79786f-dn8wb"
May 25 11:44:28.389807 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:44:28.389711    2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/scheduler-configmap-ref-test-kserve-9fb79786f-dn8wb"
May 25 11:44:28.529906 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:44:28.529881    2569 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/scheduler-configmap-ref-test-kserve-9fb79786f-dn8wb"]
May 25 11:44:28.531595 ip-10-0-143-46 kubenswrapper[2569]: W0525 11:44:28.531570    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod94f01b2d_9552_49c8_8b8d_1d5db747bfb9.slice/crio-ea5dc09d35d732d98605aca1b2474c925fb1ad68ff9acf33c8b0d80d88ca2ee3 WatchSource:0}: Error finding container ea5dc09d35d732d98605aca1b2474c925fb1ad68ff9acf33c8b0d80d88ca2ee3: Status 404 returned error can't find the container with id ea5dc09d35d732d98605aca1b2474c925fb1ad68ff9acf33c8b0d80d88ca2ee3
May 25 11:44:29.227108 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:44:29.227022    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/scheduler-configmap-ref-test-kserve-9fb79786f-dn8wb" event={"ID":"94f01b2d-9552-49c8-8b8d-1d5db747bfb9","Type":"ContainerStarted","Data":"d3bd48976cc15d703cc25b41c04a115557f0674ee0661bc30bd746b4e7962a32"}
May 25 11:44:29.227108 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:44:29.227071    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/scheduler-configmap-ref-test-kserve-9fb79786f-dn8wb" event={"ID":"94f01b2d-9552-49c8-8b8d-1d5db747bfb9","Type":"ContainerStarted","Data":"ea5dc09d35d732d98605aca1b2474c925fb1ad68ff9acf33c8b0d80d88ca2ee3"}
May 25 11:44:33.241984 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:44:33.241956    2569 generic.go:358] "Generic (PLEG): container finished" podID="94f01b2d-9552-49c8-8b8d-1d5db747bfb9" containerID="d3bd48976cc15d703cc25b41c04a115557f0674ee0661bc30bd746b4e7962a32" exitCode=0
May 25 11:44:33.242289 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:44:33.242026    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/scheduler-configmap-ref-test-kserve-9fb79786f-dn8wb" event={"ID":"94f01b2d-9552-49c8-8b8d-1d5db747bfb9","Type":"ContainerDied","Data":"d3bd48976cc15d703cc25b41c04a115557f0674ee0661bc30bd746b4e7962a32"}
May 25 11:44:35.250661 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:44:35.250631    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/scheduler-configmap-ref-test-kserve-9fb79786f-dn8wb" event={"ID":"94f01b2d-9552-49c8-8b8d-1d5db747bfb9","Type":"ContainerStarted","Data":"b68afa81a493a78bf28fd50d3724c6346a96d6c7956f1296093fbd3785634ca5"}
May 25 11:44:35.273569 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:44:35.273524    2569 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kserve-ci-e2e-test/scheduler-configmap-ref-test-kserve-9fb79786f-dn8wb" podStartSLOduration=6.246934934 podStartE2EDuration="7.273508576s" podCreationTimestamp="2026-05-25 11:44:28 +0000 UTC" firstStartedPulling="2026-05-25 11:44:33.243157158 +0000 UTC m=+1612.104781520" lastFinishedPulling="2026-05-25 11:44:34.269730796 +0000 UTC m=+1613.131355162" observedRunningTime="2026-05-25 11:44:35.272911552 +0000 UTC m=+1614.134535947" watchObservedRunningTime="2026-05-25 11:44:35.273508576 +0000 UTC m=+1614.135132961"
May 25 11:44:38.390068 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:44:38.390026    2569 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/scheduler-configmap-ref-test-kserve-9fb79786f-dn8wb"
May 25 11:44:38.390068 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:44:38.390070    2569 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kserve-ci-e2e-test/scheduler-configmap-ref-test-kserve-9fb79786f-dn8wb"
May 25 11:44:38.402694 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:44:38.402665    2569 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="kserve-ci-e2e-test/scheduler-configmap-ref-test-kserve-9fb79786f-dn8wb"
May 25 11:44:39.275057 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:44:39.275025    2569 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/scheduler-configmap-ref-test-kserve-9fb79786f-dn8wb"
May 25 11:44:46.717498 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:44:46.717472    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_scheduler-inline-config-test-kserve-5f7d7864f7-xgfnz_cc1be96e-d3c8-4268-9b4b-74c0df966c8a/storage-initializer/0.log"
May 25 11:44:46.717841 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:44:46.717535    2569 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/scheduler-inline-config-test-kserve-5f7d7864f7-xgfnz"
May 25 11:44:46.791066 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:44:46.791040    2569 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/cc1be96e-d3c8-4268-9b4b-74c0df966c8a-model-cache\") pod \"cc1be96e-d3c8-4268-9b4b-74c0df966c8a\" (UID: \"cc1be96e-d3c8-4268-9b4b-74c0df966c8a\") "
May 25 11:44:46.791183 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:44:46.791084    2569 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/cc1be96e-d3c8-4268-9b4b-74c0df966c8a-dshm\") pod \"cc1be96e-d3c8-4268-9b4b-74c0df966c8a\" (UID: \"cc1be96e-d3c8-4268-9b4b-74c0df966c8a\") "
May 25 11:44:46.791183 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:44:46.791125    2569 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/cc1be96e-d3c8-4268-9b4b-74c0df966c8a-kserve-provision-location\") pod \"cc1be96e-d3c8-4268-9b4b-74c0df966c8a\" (UID: \"cc1be96e-d3c8-4268-9b4b-74c0df966c8a\") "
May 25 11:44:46.791183 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:44:46.791153    2569 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/cc1be96e-d3c8-4268-9b4b-74c0df966c8a-home\") pod \"cc1be96e-d3c8-4268-9b4b-74c0df966c8a\" (UID: \"cc1be96e-d3c8-4268-9b4b-74c0df966c8a\") "
May 25 11:44:46.791183 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:44:46.791172    2569 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/cc1be96e-d3c8-4268-9b4b-74c0df966c8a-tmp-dir\") pod \"cc1be96e-d3c8-4268-9b4b-74c0df966c8a\" (UID: \"cc1be96e-d3c8-4268-9b4b-74c0df966c8a\") "
May 25 11:44:46.791366 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:44:46.791210    2569 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/cc1be96e-d3c8-4268-9b4b-74c0df966c8a-tls-certs\") pod \"cc1be96e-d3c8-4268-9b4b-74c0df966c8a\" (UID: \"cc1be96e-d3c8-4268-9b4b-74c0df966c8a\") "
May 25 11:44:46.791366 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:44:46.791233    2569 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vg2hb\" (UniqueName: \"kubernetes.io/projected/cc1be96e-d3c8-4268-9b4b-74c0df966c8a-kube-api-access-vg2hb\") pod \"cc1be96e-d3c8-4268-9b4b-74c0df966c8a\" (UID: \"cc1be96e-d3c8-4268-9b4b-74c0df966c8a\") "
May 25 11:44:46.791366 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:44:46.791315    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cc1be96e-d3c8-4268-9b4b-74c0df966c8a-model-cache" (OuterVolumeSpecName: "model-cache") pod "cc1be96e-d3c8-4268-9b4b-74c0df966c8a" (UID: "cc1be96e-d3c8-4268-9b4b-74c0df966c8a"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 25 11:44:46.791515 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:44:46.791399    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cc1be96e-d3c8-4268-9b4b-74c0df966c8a-home" (OuterVolumeSpecName: "home") pod "cc1be96e-d3c8-4268-9b4b-74c0df966c8a" (UID: "cc1be96e-d3c8-4268-9b4b-74c0df966c8a"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 25 11:44:46.791515 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:44:46.791472    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cc1be96e-d3c8-4268-9b4b-74c0df966c8a-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "cc1be96e-d3c8-4268-9b4b-74c0df966c8a" (UID: "cc1be96e-d3c8-4268-9b4b-74c0df966c8a"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 25 11:44:46.791618 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:44:46.791569    2569 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/cc1be96e-d3c8-4268-9b4b-74c0df966c8a-model-cache\") on node \"ip-10-0-143-46.ec2.internal\" DevicePath \"\""
May 25 11:44:46.791618 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:44:46.791587    2569 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/cc1be96e-d3c8-4268-9b4b-74c0df966c8a-home\") on node \"ip-10-0-143-46.ec2.internal\" DevicePath \"\""
May 25 11:44:46.791618 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:44:46.791599    2569 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/cc1be96e-d3c8-4268-9b4b-74c0df966c8a-tmp-dir\") on node \"ip-10-0-143-46.ec2.internal\" DevicePath \"\""
May 25 11:44:46.793207 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:44:46.793181    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cc1be96e-d3c8-4268-9b4b-74c0df966c8a-dshm" (OuterVolumeSpecName: "dshm") pod "cc1be96e-d3c8-4268-9b4b-74c0df966c8a" (UID: "cc1be96e-d3c8-4268-9b4b-74c0df966c8a"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 25 11:44:46.793368 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:44:46.793343    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cc1be96e-d3c8-4268-9b4b-74c0df966c8a-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "cc1be96e-d3c8-4268-9b4b-74c0df966c8a" (UID: "cc1be96e-d3c8-4268-9b4b-74c0df966c8a"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 25 11:44:46.793452 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:44:46.793390    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cc1be96e-d3c8-4268-9b4b-74c0df966c8a-kube-api-access-vg2hb" (OuterVolumeSpecName: "kube-api-access-vg2hb") pod "cc1be96e-d3c8-4268-9b4b-74c0df966c8a" (UID: "cc1be96e-d3c8-4268-9b4b-74c0df966c8a"). InnerVolumeSpecName "kube-api-access-vg2hb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 25 11:44:46.835449 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:44:46.835424    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cc1be96e-d3c8-4268-9b4b-74c0df966c8a-kserve-provision-location" (OuterVolumeSpecName: "kserve-provision-location") pod "cc1be96e-d3c8-4268-9b4b-74c0df966c8a" (UID: "cc1be96e-d3c8-4268-9b4b-74c0df966c8a"). InnerVolumeSpecName "kserve-provision-location". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 25 11:44:46.893105 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:44:46.893077    2569 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/cc1be96e-d3c8-4268-9b4b-74c0df966c8a-dshm\") on node \"ip-10-0-143-46.ec2.internal\" DevicePath \"\""
May 25 11:44:46.893215 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:44:46.893120    2569 reconciler_common.go:299] "Volume detached for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/cc1be96e-d3c8-4268-9b4b-74c0df966c8a-kserve-provision-location\") on node \"ip-10-0-143-46.ec2.internal\" DevicePath \"\""
May 25 11:44:46.893215 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:44:46.893141    2569 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/cc1be96e-d3c8-4268-9b4b-74c0df966c8a-tls-certs\") on node \"ip-10-0-143-46.ec2.internal\" DevicePath \"\""
May 25 11:44:46.893215 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:44:46.893158    2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vg2hb\" (UniqueName: \"kubernetes.io/projected/cc1be96e-d3c8-4268-9b4b-74c0df966c8a-kube-api-access-vg2hb\") on node \"ip-10-0-143-46.ec2.internal\" DevicePath \"\""
May 25 11:44:47.292079 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:44:47.292050    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_scheduler-inline-config-test-kserve-5f7d7864f7-xgfnz_cc1be96e-d3c8-4268-9b4b-74c0df966c8a/storage-initializer/0.log"
May 25 11:44:47.292229 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:44:47.292090    2569 generic.go:358] "Generic (PLEG): container finished" podID="cc1be96e-d3c8-4268-9b4b-74c0df966c8a" containerID="9bcbaf16b6563e2fa62b62406e294157897bacd78662ea7994d5d4df1c8ae5e2" exitCode=137
May 25 11:44:47.292229 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:44:47.292123    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/scheduler-inline-config-test-kserve-5f7d7864f7-xgfnz" event={"ID":"cc1be96e-d3c8-4268-9b4b-74c0df966c8a","Type":"ContainerDied","Data":"9bcbaf16b6563e2fa62b62406e294157897bacd78662ea7994d5d4df1c8ae5e2"}
May 25 11:44:47.292229 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:44:47.292169    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/scheduler-inline-config-test-kserve-5f7d7864f7-xgfnz" event={"ID":"cc1be96e-d3c8-4268-9b4b-74c0df966c8a","Type":"ContainerDied","Data":"26663a850b1f352f24a37a4b5a6d6bc5db96ab3f8f7c26d96091dde9e4bc688e"}
May 25 11:44:47.292229 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:44:47.292190    2569 scope.go:117] "RemoveContainer" containerID="9bcbaf16b6563e2fa62b62406e294157897bacd78662ea7994d5d4df1c8ae5e2"
May 25 11:44:47.292229 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:44:47.292196    2569 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/scheduler-inline-config-test-kserve-5f7d7864f7-xgfnz"
May 25 11:44:47.322514 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:44:47.322493    2569 scope.go:117] "RemoveContainer" containerID="9bcbaf16b6563e2fa62b62406e294157897bacd78662ea7994d5d4df1c8ae5e2"
May 25 11:44:47.322848 ip-10-0-143-46 kubenswrapper[2569]: E0525 11:44:47.322823    2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9bcbaf16b6563e2fa62b62406e294157897bacd78662ea7994d5d4df1c8ae5e2\": container with ID starting with 9bcbaf16b6563e2fa62b62406e294157897bacd78662ea7994d5d4df1c8ae5e2 not found: ID does not exist" containerID="9bcbaf16b6563e2fa62b62406e294157897bacd78662ea7994d5d4df1c8ae5e2"
May 25 11:44:47.322920 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:44:47.322860    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9bcbaf16b6563e2fa62b62406e294157897bacd78662ea7994d5d4df1c8ae5e2"} err="failed to get container status \"9bcbaf16b6563e2fa62b62406e294157897bacd78662ea7994d5d4df1c8ae5e2\": rpc error: code = NotFound desc = could not find container \"9bcbaf16b6563e2fa62b62406e294157897bacd78662ea7994d5d4df1c8ae5e2\": container with ID starting with 9bcbaf16b6563e2fa62b62406e294157897bacd78662ea7994d5d4df1c8ae5e2 not found: ID does not exist"
May 25 11:44:47.375633 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:44:47.375596    2569 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/scheduler-inline-config-test-kserve-5f7d7864f7-xgfnz"]
May 25 11:44:47.385393 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:44:47.385365    2569 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/scheduler-inline-config-test-kserve-5f7d7864f7-xgfnz"]
May 25 11:44:47.730352 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:44:47.730278    2569 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cc1be96e-d3c8-4268-9b4b-74c0df966c8a" path="/var/lib/kubelet/pods/cc1be96e-d3c8-4268-9b4b-74c0df966c8a/volumes"
May 25 11:45:01.889499 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:45:01.889466    2569 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/scheduler-configmap-ref-test-kserve-9fb79786f-dn8wb"]
May 25 11:45:01.890029 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:45:01.889870    2569 kuberuntime_container.go:864] "Killing container with a grace period" pod="kserve-ci-e2e-test/scheduler-configmap-ref-test-kserve-9fb79786f-dn8wb" podUID="94f01b2d-9552-49c8-8b8d-1d5db747bfb9" containerName="main" containerID="cri-o://b68afa81a493a78bf28fd50d3724c6346a96d6c7956f1296093fbd3785634ca5" gracePeriod=30
May 25 11:45:02.140457 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:45:02.140392    2569 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/scheduler-configmap-ref-test-kserve-9fb79786f-dn8wb"
May 25 11:45:02.229922 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:45:02.229886    2569 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/94f01b2d-9552-49c8-8b8d-1d5db747bfb9-model-cache\") pod \"94f01b2d-9552-49c8-8b8d-1d5db747bfb9\" (UID: \"94f01b2d-9552-49c8-8b8d-1d5db747bfb9\") "
May 25 11:45:02.229922 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:45:02.229925    2569 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/94f01b2d-9552-49c8-8b8d-1d5db747bfb9-tmp-dir\") pod \"94f01b2d-9552-49c8-8b8d-1d5db747bfb9\" (UID: \"94f01b2d-9552-49c8-8b8d-1d5db747bfb9\") "
May 25 11:45:02.230108 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:45:02.229946    2569 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/94f01b2d-9552-49c8-8b8d-1d5db747bfb9-dshm\") pod \"94f01b2d-9552-49c8-8b8d-1d5db747bfb9\" (UID: \"94f01b2d-9552-49c8-8b8d-1d5db747bfb9\") "
May 25 11:45:02.230108 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:45:02.229995    2569 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/94f01b2d-9552-49c8-8b8d-1d5db747bfb9-kserve-provision-location\") pod \"94f01b2d-9552-49c8-8b8d-1d5db747bfb9\" (UID: \"94f01b2d-9552-49c8-8b8d-1d5db747bfb9\") "
May 25 11:45:02.230108 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:45:02.230099    2569 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-49hlv\" (UniqueName: \"kubernetes.io/projected/94f01b2d-9552-49c8-8b8d-1d5db747bfb9-kube-api-access-49hlv\") pod \"94f01b2d-9552-49c8-8b8d-1d5db747bfb9\" (UID: \"94f01b2d-9552-49c8-8b8d-1d5db747bfb9\") "
May 25 11:45:02.230244 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:45:02.230131    2569 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/94f01b2d-9552-49c8-8b8d-1d5db747bfb9-home\") pod \"94f01b2d-9552-49c8-8b8d-1d5db747bfb9\" (UID: \"94f01b2d-9552-49c8-8b8d-1d5db747bfb9\") "
May 25 11:45:02.230244 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:45:02.230154    2569 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/94f01b2d-9552-49c8-8b8d-1d5db747bfb9-tls-certs\") pod \"94f01b2d-9552-49c8-8b8d-1d5db747bfb9\" (UID: \"94f01b2d-9552-49c8-8b8d-1d5db747bfb9\") "
May 25 11:45:02.230244 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:45:02.230196    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/94f01b2d-9552-49c8-8b8d-1d5db747bfb9-model-cache" (OuterVolumeSpecName: "model-cache") pod "94f01b2d-9552-49c8-8b8d-1d5db747bfb9" (UID: "94f01b2d-9552-49c8-8b8d-1d5db747bfb9"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 25 11:45:02.230244 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:45:02.230207    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/94f01b2d-9552-49c8-8b8d-1d5db747bfb9-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "94f01b2d-9552-49c8-8b8d-1d5db747bfb9" (UID: "94f01b2d-9552-49c8-8b8d-1d5db747bfb9"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 25 11:45:02.230443 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:45:02.230415    2569 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/94f01b2d-9552-49c8-8b8d-1d5db747bfb9-model-cache\") on node \"ip-10-0-143-46.ec2.internal\" DevicePath \"\""
May 25 11:45:02.230502 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:45:02.230442    2569 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/94f01b2d-9552-49c8-8b8d-1d5db747bfb9-tmp-dir\") on node \"ip-10-0-143-46.ec2.internal\" DevicePath \"\""
May 25 11:45:02.230502 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:45:02.230419    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/94f01b2d-9552-49c8-8b8d-1d5db747bfb9-home" (OuterVolumeSpecName: "home") pod "94f01b2d-9552-49c8-8b8d-1d5db747bfb9" (UID: "94f01b2d-9552-49c8-8b8d-1d5db747bfb9"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 25 11:45:02.232122 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:45:02.232090    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/94f01b2d-9552-49c8-8b8d-1d5db747bfb9-dshm" (OuterVolumeSpecName: "dshm") pod "94f01b2d-9552-49c8-8b8d-1d5db747bfb9" (UID: "94f01b2d-9552-49c8-8b8d-1d5db747bfb9"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 25 11:45:02.232241 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:45:02.232180    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/94f01b2d-9552-49c8-8b8d-1d5db747bfb9-kube-api-access-49hlv" (OuterVolumeSpecName: "kube-api-access-49hlv") pod "94f01b2d-9552-49c8-8b8d-1d5db747bfb9" (UID: "94f01b2d-9552-49c8-8b8d-1d5db747bfb9"). InnerVolumeSpecName "kube-api-access-49hlv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 25 11:45:02.232241 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:45:02.232236    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/94f01b2d-9552-49c8-8b8d-1d5db747bfb9-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "94f01b2d-9552-49c8-8b8d-1d5db747bfb9" (UID: "94f01b2d-9552-49c8-8b8d-1d5db747bfb9"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 25 11:45:02.285033 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:45:02.285000    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/94f01b2d-9552-49c8-8b8d-1d5db747bfb9-kserve-provision-location" (OuterVolumeSpecName: "kserve-provision-location") pod "94f01b2d-9552-49c8-8b8d-1d5db747bfb9" (UID: "94f01b2d-9552-49c8-8b8d-1d5db747bfb9"). InnerVolumeSpecName "kserve-provision-location". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 25 11:45:02.330930 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:45:02.330906    2569 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/94f01b2d-9552-49c8-8b8d-1d5db747bfb9-home\") on node \"ip-10-0-143-46.ec2.internal\" DevicePath \"\""
May 25 11:45:02.330930 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:45:02.330928    2569 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/94f01b2d-9552-49c8-8b8d-1d5db747bfb9-tls-certs\") on node \"ip-10-0-143-46.ec2.internal\" DevicePath \"\""
May 25 11:45:02.331099 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:45:02.330939    2569 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/94f01b2d-9552-49c8-8b8d-1d5db747bfb9-dshm\") on node \"ip-10-0-143-46.ec2.internal\" DevicePath \"\""
May 25 11:45:02.331099 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:45:02.330948    2569 reconciler_common.go:299] "Volume detached for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/94f01b2d-9552-49c8-8b8d-1d5db747bfb9-kserve-provision-location\") on node \"ip-10-0-143-46.ec2.internal\" DevicePath \"\""
May 25 11:45:02.331099 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:45:02.330957    2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-49hlv\" (UniqueName: \"kubernetes.io/projected/94f01b2d-9552-49c8-8b8d-1d5db747bfb9-kube-api-access-49hlv\") on node \"ip-10-0-143-46.ec2.internal\" DevicePath \"\""
May 25 11:45:02.348350 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:45:02.348322    2569 generic.go:358] "Generic (PLEG): container finished" podID="94f01b2d-9552-49c8-8b8d-1d5db747bfb9" containerID="b68afa81a493a78bf28fd50d3724c6346a96d6c7956f1296093fbd3785634ca5" exitCode=0
May 25 11:45:02.348484 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:45:02.348381    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/scheduler-configmap-ref-test-kserve-9fb79786f-dn8wb" event={"ID":"94f01b2d-9552-49c8-8b8d-1d5db747bfb9","Type":"ContainerDied","Data":"b68afa81a493a78bf28fd50d3724c6346a96d6c7956f1296093fbd3785634ca5"}
May 25 11:45:02.348484 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:45:02.348405    2569 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/scheduler-configmap-ref-test-kserve-9fb79786f-dn8wb"
May 25 11:45:02.348484 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:45:02.348422    2569 scope.go:117] "RemoveContainer" containerID="b68afa81a493a78bf28fd50d3724c6346a96d6c7956f1296093fbd3785634ca5"
May 25 11:45:02.348637 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:45:02.348412    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/scheduler-configmap-ref-test-kserve-9fb79786f-dn8wb" event={"ID":"94f01b2d-9552-49c8-8b8d-1d5db747bfb9","Type":"ContainerDied","Data":"ea5dc09d35d732d98605aca1b2474c925fb1ad68ff9acf33c8b0d80d88ca2ee3"}
May 25 11:45:02.357652 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:45:02.357634    2569 scope.go:117] "RemoveContainer" containerID="d3bd48976cc15d703cc25b41c04a115557f0674ee0661bc30bd746b4e7962a32"
May 25 11:45:02.366724 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:45:02.366706    2569 scope.go:117] "RemoveContainer" containerID="b68afa81a493a78bf28fd50d3724c6346a96d6c7956f1296093fbd3785634ca5"
May 25 11:45:02.366981 ip-10-0-143-46 kubenswrapper[2569]: E0525 11:45:02.366962    2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b68afa81a493a78bf28fd50d3724c6346a96d6c7956f1296093fbd3785634ca5\": container with ID starting with b68afa81a493a78bf28fd50d3724c6346a96d6c7956f1296093fbd3785634ca5 not found: ID does not exist" containerID="b68afa81a493a78bf28fd50d3724c6346a96d6c7956f1296093fbd3785634ca5"
May 25 11:45:02.367041 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:45:02.366988    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b68afa81a493a78bf28fd50d3724c6346a96d6c7956f1296093fbd3785634ca5"} err="failed to get container status \"b68afa81a493a78bf28fd50d3724c6346a96d6c7956f1296093fbd3785634ca5\": rpc error: code = NotFound desc = could not find container \"b68afa81a493a78bf28fd50d3724c6346a96d6c7956f1296093fbd3785634ca5\": container with ID starting with b68afa81a493a78bf28fd50d3724c6346a96d6c7956f1296093fbd3785634ca5 not found: ID does not exist"
May 25 11:45:02.367041 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:45:02.367004    2569 scope.go:117] "RemoveContainer" containerID="d3bd48976cc15d703cc25b41c04a115557f0674ee0661bc30bd746b4e7962a32"
May 25 11:45:02.367217 ip-10-0-143-46 kubenswrapper[2569]: E0525 11:45:02.367199    2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d3bd48976cc15d703cc25b41c04a115557f0674ee0661bc30bd746b4e7962a32\": container with ID starting with d3bd48976cc15d703cc25b41c04a115557f0674ee0661bc30bd746b4e7962a32 not found: ID does not exist" containerID="d3bd48976cc15d703cc25b41c04a115557f0674ee0661bc30bd746b4e7962a32"
May 25 11:45:02.367257 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:45:02.367221    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d3bd48976cc15d703cc25b41c04a115557f0674ee0661bc30bd746b4e7962a32"} err="failed to get container status \"d3bd48976cc15d703cc25b41c04a115557f0674ee0661bc30bd746b4e7962a32\": rpc error: code = NotFound desc = could not find container \"d3bd48976cc15d703cc25b41c04a115557f0674ee0661bc30bd746b4e7962a32\": container with ID starting with d3bd48976cc15d703cc25b41c04a115557f0674ee0661bc30bd746b4e7962a32 not found: ID does not exist"
May 25 11:45:02.372063 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:45:02.372039    2569 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/scheduler-configmap-ref-test-kserve-9fb79786f-dn8wb"]
May 25 11:45:02.374990 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:45:02.374972    2569 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/scheduler-configmap-ref-test-kserve-9fb79786f-dn8wb"]
May 25 11:45:03.730463 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:45:03.730429    2569 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="94f01b2d-9552-49c8-8b8d-1d5db747bfb9" path="/var/lib/kubelet/pods/94f01b2d-9552-49c8-8b8d-1d5db747bfb9/volumes"
May 25 11:45:06.312502 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:45:06.312467    2569 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/scheduler-ha-replicas-test-kserve-7d7687797c-nnfgv"]
May 25 11:45:06.312874 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:45:06.312864    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cc1be96e-d3c8-4268-9b4b-74c0df966c8a" containerName="storage-initializer"
May 25 11:45:06.312916 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:45:06.312877    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="cc1be96e-d3c8-4268-9b4b-74c0df966c8a" containerName="storage-initializer"
May 25 11:45:06.312916 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:45:06.312886    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="94f01b2d-9552-49c8-8b8d-1d5db747bfb9" containerName="storage-initializer"
May 25 11:45:06.312916 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:45:06.312892    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="94f01b2d-9552-49c8-8b8d-1d5db747bfb9" containerName="storage-initializer"
May 25 11:45:06.312916 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:45:06.312906    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="94f01b2d-9552-49c8-8b8d-1d5db747bfb9" containerName="main"
May 25 11:45:06.312916 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:45:06.312912    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="94f01b2d-9552-49c8-8b8d-1d5db747bfb9" containerName="main"
May 25 11:45:06.313063 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:45:06.312968    2569 memory_manager.go:356] "RemoveStaleState removing state" podUID="cc1be96e-d3c8-4268-9b4b-74c0df966c8a" containerName="storage-initializer"
May 25 11:45:06.313063 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:45:06.312978    2569 memory_manager.go:356] "RemoveStaleState removing state" podUID="94f01b2d-9552-49c8-8b8d-1d5db747bfb9" containerName="main"
May 25 11:45:06.316283 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:45:06.316262    2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/scheduler-ha-replicas-test-kserve-7d7687797c-nnfgv"
May 25 11:45:06.321204 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:45:06.321181    2569 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"default-dockercfg-5cxfn\""
May 25 11:45:06.321290 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:45:06.321183    2569 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"scheduler-ha-replicas-test-kserve-self-signed-certs\""
May 25 11:45:06.330040 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:45:06.330018    2569 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/scheduler-ha-replicas-test-kserve-7d7687797c-nnfgv"]
May 25 11:45:06.360014 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:45:06.359985    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c1bfa2c2-59b2-46b4-b340-a50068d3c3d9-dshm\") pod \"scheduler-ha-replicas-test-kserve-7d7687797c-nnfgv\" (UID: \"c1bfa2c2-59b2-46b4-b340-a50068d3c3d9\") " pod="kserve-ci-e2e-test/scheduler-ha-replicas-test-kserve-7d7687797c-nnfgv"
May 25 11:45:06.360014 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:45:06.360015    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c1bfa2c2-59b2-46b4-b340-a50068d3c3d9-tls-certs\") pod \"scheduler-ha-replicas-test-kserve-7d7687797c-nnfgv\" (UID: \"c1bfa2c2-59b2-46b4-b340-a50068d3c3d9\") " pod="kserve-ci-e2e-test/scheduler-ha-replicas-test-kserve-7d7687797c-nnfgv"
May 25 11:45:06.360192 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:45:06.360044    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c1bfa2c2-59b2-46b4-b340-a50068d3c3d9-model-cache\") pod \"scheduler-ha-replicas-test-kserve-7d7687797c-nnfgv\" (UID: \"c1bfa2c2-59b2-46b4-b340-a50068d3c3d9\") " pod="kserve-ci-e2e-test/scheduler-ha-replicas-test-kserve-7d7687797c-nnfgv"
May 25 11:45:06.360192 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:45:06.360107    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c1bfa2c2-59b2-46b4-b340-a50068d3c3d9-home\") pod \"scheduler-ha-replicas-test-kserve-7d7687797c-nnfgv\" (UID: \"c1bfa2c2-59b2-46b4-b340-a50068d3c3d9\") " pod="kserve-ci-e2e-test/scheduler-ha-replicas-test-kserve-7d7687797c-nnfgv"
May 25 11:45:06.360287 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:45:06.360194    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/c1bfa2c2-59b2-46b4-b340-a50068d3c3d9-kserve-provision-location\") pod \"scheduler-ha-replicas-test-kserve-7d7687797c-nnfgv\" (UID: \"c1bfa2c2-59b2-46b4-b340-a50068d3c3d9\") " pod="kserve-ci-e2e-test/scheduler-ha-replicas-test-kserve-7d7687797c-nnfgv"
May 25 11:45:06.360287 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:45:06.360250    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c8dqf\" (UniqueName: \"kubernetes.io/projected/c1bfa2c2-59b2-46b4-b340-a50068d3c3d9-kube-api-access-c8dqf\") pod \"scheduler-ha-replicas-test-kserve-7d7687797c-nnfgv\" (UID: \"c1bfa2c2-59b2-46b4-b340-a50068d3c3d9\") " pod="kserve-ci-e2e-test/scheduler-ha-replicas-test-kserve-7d7687797c-nnfgv"
May 25 11:45:06.360363 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:45:06.360312    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c1bfa2c2-59b2-46b4-b340-a50068d3c3d9-tmp-dir\") pod \"scheduler-ha-replicas-test-kserve-7d7687797c-nnfgv\" (UID: \"c1bfa2c2-59b2-46b4-b340-a50068d3c3d9\") " pod="kserve-ci-e2e-test/scheduler-ha-replicas-test-kserve-7d7687797c-nnfgv"
May 25 11:45:06.460941 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:45:06.460915    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c1bfa2c2-59b2-46b4-b340-a50068d3c3d9-tmp-dir\") pod \"scheduler-ha-replicas-test-kserve-7d7687797c-nnfgv\" (UID: \"c1bfa2c2-59b2-46b4-b340-a50068d3c3d9\") " pod="kserve-ci-e2e-test/scheduler-ha-replicas-test-kserve-7d7687797c-nnfgv"
May 25 11:45:06.461138 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:45:06.460966    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c1bfa2c2-59b2-46b4-b340-a50068d3c3d9-dshm\") pod \"scheduler-ha-replicas-test-kserve-7d7687797c-nnfgv\" (UID: \"c1bfa2c2-59b2-46b4-b340-a50068d3c3d9\") " pod="kserve-ci-e2e-test/scheduler-ha-replicas-test-kserve-7d7687797c-nnfgv"
May 25 11:45:06.461138 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:45:06.460993    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c1bfa2c2-59b2-46b4-b340-a50068d3c3d9-tls-certs\") pod \"scheduler-ha-replicas-test-kserve-7d7687797c-nnfgv\" (UID: \"c1bfa2c2-59b2-46b4-b340-a50068d3c3d9\") " pod="kserve-ci-e2e-test/scheduler-ha-replicas-test-kserve-7d7687797c-nnfgv"
May 25 11:45:06.461138 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:45:06.461018    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c1bfa2c2-59b2-46b4-b340-a50068d3c3d9-model-cache\") pod \"scheduler-ha-replicas-test-kserve-7d7687797c-nnfgv\" (UID: \"c1bfa2c2-59b2-46b4-b340-a50068d3c3d9\") " pod="kserve-ci-e2e-test/scheduler-ha-replicas-test-kserve-7d7687797c-nnfgv"
May 25 11:45:06.461138 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:45:06.461044    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c1bfa2c2-59b2-46b4-b340-a50068d3c3d9-home\") pod \"scheduler-ha-replicas-test-kserve-7d7687797c-nnfgv\" (UID: \"c1bfa2c2-59b2-46b4-b340-a50068d3c3d9\") " pod="kserve-ci-e2e-test/scheduler-ha-replicas-test-kserve-7d7687797c-nnfgv"
May 25 11:45:06.461138 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:45:06.461065    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/c1bfa2c2-59b2-46b4-b340-a50068d3c3d9-kserve-provision-location\") pod \"scheduler-ha-replicas-test-kserve-7d7687797c-nnfgv\" (UID: \"c1bfa2c2-59b2-46b4-b340-a50068d3c3d9\") " pod="kserve-ci-e2e-test/scheduler-ha-replicas-test-kserve-7d7687797c-nnfgv"
May 25 11:45:06.461138 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:45:06.461094    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-c8dqf\" (UniqueName: \"kubernetes.io/projected/c1bfa2c2-59b2-46b4-b340-a50068d3c3d9-kube-api-access-c8dqf\") pod \"scheduler-ha-replicas-test-kserve-7d7687797c-nnfgv\" (UID: \"c1bfa2c2-59b2-46b4-b340-a50068d3c3d9\") " pod="kserve-ci-e2e-test/scheduler-ha-replicas-test-kserve-7d7687797c-nnfgv"
May 25 11:45:06.461426 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:45:06.461366    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c1bfa2c2-59b2-46b4-b340-a50068d3c3d9-tmp-dir\") pod \"scheduler-ha-replicas-test-kserve-7d7687797c-nnfgv\" (UID: \"c1bfa2c2-59b2-46b4-b340-a50068d3c3d9\") " pod="kserve-ci-e2e-test/scheduler-ha-replicas-test-kserve-7d7687797c-nnfgv"
May 25 11:45:06.461489 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:45:06.461454    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/c1bfa2c2-59b2-46b4-b340-a50068d3c3d9-kserve-provision-location\") pod \"scheduler-ha-replicas-test-kserve-7d7687797c-nnfgv\" (UID: \"c1bfa2c2-59b2-46b4-b340-a50068d3c3d9\") " pod="kserve-ci-e2e-test/scheduler-ha-replicas-test-kserve-7d7687797c-nnfgv"
May 25 11:45:06.461539 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:45:06.461498    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c1bfa2c2-59b2-46b4-b340-a50068d3c3d9-home\") pod \"scheduler-ha-replicas-test-kserve-7d7687797c-nnfgv\" (UID: \"c1bfa2c2-59b2-46b4-b340-a50068d3c3d9\") " pod="kserve-ci-e2e-test/scheduler-ha-replicas-test-kserve-7d7687797c-nnfgv"
May 25 11:45:06.461586 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:45:06.461552    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c1bfa2c2-59b2-46b4-b340-a50068d3c3d9-model-cache\") pod \"scheduler-ha-replicas-test-kserve-7d7687797c-nnfgv\" (UID: \"c1bfa2c2-59b2-46b4-b340-a50068d3c3d9\") " pod="kserve-ci-e2e-test/scheduler-ha-replicas-test-kserve-7d7687797c-nnfgv"
May 25 11:45:06.463241 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:45:06.463213    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c1bfa2c2-59b2-46b4-b340-a50068d3c3d9-dshm\") pod \"scheduler-ha-replicas-test-kserve-7d7687797c-nnfgv\" (UID: \"c1bfa2c2-59b2-46b4-b340-a50068d3c3d9\") " pod="kserve-ci-e2e-test/scheduler-ha-replicas-test-kserve-7d7687797c-nnfgv"
May 25 11:45:06.463517 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:45:06.463498    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c1bfa2c2-59b2-46b4-b340-a50068d3c3d9-tls-certs\") pod \"scheduler-ha-replicas-test-kserve-7d7687797c-nnfgv\" (UID: \"c1bfa2c2-59b2-46b4-b340-a50068d3c3d9\") " pod="kserve-ci-e2e-test/scheduler-ha-replicas-test-kserve-7d7687797c-nnfgv"
May 25 11:45:06.470277 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:45:06.470250    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-c8dqf\" (UniqueName: \"kubernetes.io/projected/c1bfa2c2-59b2-46b4-b340-a50068d3c3d9-kube-api-access-c8dqf\") pod \"scheduler-ha-replicas-test-kserve-7d7687797c-nnfgv\" (UID: \"c1bfa2c2-59b2-46b4-b340-a50068d3c3d9\") " pod="kserve-ci-e2e-test/scheduler-ha-replicas-test-kserve-7d7687797c-nnfgv"
May 25 11:45:06.605255 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:45:06.605181    2569 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/scheduler-ha-replicas-test-kserve-router-scheduler-5fd8546ddjd4"]
May 25 11:45:06.608135 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:45:06.608112    2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/scheduler-ha-replicas-test-kserve-router-scheduler-5fd8546ddjd4"
May 25 11:45:06.610717 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:45:06.610698    2569 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"scheduler-ha-replicas-test-epp-sa-dockercfg-d4dmc\""
May 25 11:45:06.622560 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:45:06.622536    2569 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/scheduler-ha-replicas-test-kserve-router-scheduler-5fd8546ddjd4"]
May 25 11:45:06.626692 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:45:06.626675    2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/scheduler-ha-replicas-test-kserve-7d7687797c-nnfgv"
May 25 11:45:06.663165 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:45:06.663132    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tokenizer-uds\" (UniqueName: \"kubernetes.io/empty-dir/e09d3a74-fbbe-4f66-9015-a66fbdcb3593-tokenizer-uds\") pod \"scheduler-ha-replicas-test-kserve-router-scheduler-5fd8546ddjd4\" (UID: \"e09d3a74-fbbe-4f66-9015-a66fbdcb3593\") " pod="kserve-ci-e2e-test/scheduler-ha-replicas-test-kserve-router-scheduler-5fd8546ddjd4"
May 25 11:45:06.663339 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:45:06.663170    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wjscd\" (UniqueName: \"kubernetes.io/projected/e09d3a74-fbbe-4f66-9015-a66fbdcb3593-kube-api-access-wjscd\") pod \"scheduler-ha-replicas-test-kserve-router-scheduler-5fd8546ddjd4\" (UID: \"e09d3a74-fbbe-4f66-9015-a66fbdcb3593\") " pod="kserve-ci-e2e-test/scheduler-ha-replicas-test-kserve-router-scheduler-5fd8546ddjd4"
May 25 11:45:06.663339 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:45:06.663203    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/e09d3a74-fbbe-4f66-9015-a66fbdcb3593-kserve-provision-location\") pod \"scheduler-ha-replicas-test-kserve-router-scheduler-5fd8546ddjd4\" (UID: \"e09d3a74-fbbe-4f66-9015-a66fbdcb3593\") " pod="kserve-ci-e2e-test/scheduler-ha-replicas-test-kserve-router-scheduler-5fd8546ddjd4"
May 25 11:45:06.663339 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:45:06.663302    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tokenizer-tmp\" (UniqueName: \"kubernetes.io/empty-dir/e09d3a74-fbbe-4f66-9015-a66fbdcb3593-tokenizer-tmp\") pod \"scheduler-ha-replicas-test-kserve-router-scheduler-5fd8546ddjd4\" (UID: \"e09d3a74-fbbe-4f66-9015-a66fbdcb3593\") " pod="kserve-ci-e2e-test/scheduler-ha-replicas-test-kserve-router-scheduler-5fd8546ddjd4"
May 25 11:45:06.663499 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:45:06.663390    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e09d3a74-fbbe-4f66-9015-a66fbdcb3593-tls-certs\") pod \"scheduler-ha-replicas-test-kserve-router-scheduler-5fd8546ddjd4\" (UID: \"e09d3a74-fbbe-4f66-9015-a66fbdcb3593\") " pod="kserve-ci-e2e-test/scheduler-ha-replicas-test-kserve-router-scheduler-5fd8546ddjd4"
May 25 11:45:06.663499 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:45:06.663450    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tokenizer-cache\" (UniqueName: \"kubernetes.io/empty-dir/e09d3a74-fbbe-4f66-9015-a66fbdcb3593-tokenizer-cache\") pod \"scheduler-ha-replicas-test-kserve-router-scheduler-5fd8546ddjd4\" (UID: \"e09d3a74-fbbe-4f66-9015-a66fbdcb3593\") " pod="kserve-ci-e2e-test/scheduler-ha-replicas-test-kserve-router-scheduler-5fd8546ddjd4"
May 25 11:45:06.757742 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:45:06.757716    2569 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/scheduler-ha-replicas-test-kserve-7d7687797c-nnfgv"]
May 25 11:45:06.759554 ip-10-0-143-46 kubenswrapper[2569]: W0525 11:45:06.759514    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc1bfa2c2_59b2_46b4_b340_a50068d3c3d9.slice/crio-49af85119761b7d6174c0f3c33ba193807308e55108fc389985bd66fb2b872b5 WatchSource:0}: Error finding container 49af85119761b7d6174c0f3c33ba193807308e55108fc389985bd66fb2b872b5: Status 404 returned error can't find the container with id 49af85119761b7d6174c0f3c33ba193807308e55108fc389985bd66fb2b872b5
May 25 11:45:06.764745 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:45:06.764725    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e09d3a74-fbbe-4f66-9015-a66fbdcb3593-tls-certs\") pod \"scheduler-ha-replicas-test-kserve-router-scheduler-5fd8546ddjd4\" (UID: \"e09d3a74-fbbe-4f66-9015-a66fbdcb3593\") " pod="kserve-ci-e2e-test/scheduler-ha-replicas-test-kserve-router-scheduler-5fd8546ddjd4"
May 25 11:45:06.764842 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:45:06.764780    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tokenizer-cache\" (UniqueName: \"kubernetes.io/empty-dir/e09d3a74-fbbe-4f66-9015-a66fbdcb3593-tokenizer-cache\") pod \"scheduler-ha-replicas-test-kserve-router-scheduler-5fd8546ddjd4\" (UID: \"e09d3a74-fbbe-4f66-9015-a66fbdcb3593\") " pod="kserve-ci-e2e-test/scheduler-ha-replicas-test-kserve-router-scheduler-5fd8546ddjd4"
May 25 11:45:06.764842 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:45:06.764833    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tokenizer-uds\" (UniqueName: \"kubernetes.io/empty-dir/e09d3a74-fbbe-4f66-9015-a66fbdcb3593-tokenizer-uds\") pod \"scheduler-ha-replicas-test-kserve-router-scheduler-5fd8546ddjd4\" (UID: \"e09d3a74-fbbe-4f66-9015-a66fbdcb3593\") " pod="kserve-ci-e2e-test/scheduler-ha-replicas-test-kserve-router-scheduler-5fd8546ddjd4"
May 25 11:45:06.765023 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:45:06.764866    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-wjscd\" (UniqueName: \"kubernetes.io/projected/e09d3a74-fbbe-4f66-9015-a66fbdcb3593-kube-api-access-wjscd\") pod \"scheduler-ha-replicas-test-kserve-router-scheduler-5fd8546ddjd4\" (UID: \"e09d3a74-fbbe-4f66-9015-a66fbdcb3593\") " pod="kserve-ci-e2e-test/scheduler-ha-replicas-test-kserve-router-scheduler-5fd8546ddjd4"
May 25 11:45:06.765023 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:45:06.764920    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/e09d3a74-fbbe-4f66-9015-a66fbdcb3593-kserve-provision-location\") pod \"scheduler-ha-replicas-test-kserve-router-scheduler-5fd8546ddjd4\" (UID: \"e09d3a74-fbbe-4f66-9015-a66fbdcb3593\") " pod="kserve-ci-e2e-test/scheduler-ha-replicas-test-kserve-router-scheduler-5fd8546ddjd4"
May 25 11:45:06.765023 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:45:06.764953    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tokenizer-tmp\" (UniqueName: \"kubernetes.io/empty-dir/e09d3a74-fbbe-4f66-9015-a66fbdcb3593-tokenizer-tmp\") pod \"scheduler-ha-replicas-test-kserve-router-scheduler-5fd8546ddjd4\" (UID: \"e09d3a74-fbbe-4f66-9015-a66fbdcb3593\") " pod="kserve-ci-e2e-test/scheduler-ha-replicas-test-kserve-router-scheduler-5fd8546ddjd4"
May 25 11:45:06.765290 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:45:06.765245    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tokenizer-cache\" (UniqueName: \"kubernetes.io/empty-dir/e09d3a74-fbbe-4f66-9015-a66fbdcb3593-tokenizer-cache\") pod \"scheduler-ha-replicas-test-kserve-router-scheduler-5fd8546ddjd4\" (UID: \"e09d3a74-fbbe-4f66-9015-a66fbdcb3593\") " pod="kserve-ci-e2e-test/scheduler-ha-replicas-test-kserve-router-scheduler-5fd8546ddjd4"
May 25 11:45:06.765390 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:45:06.765328    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tokenizer-tmp\" (UniqueName: \"kubernetes.io/empty-dir/e09d3a74-fbbe-4f66-9015-a66fbdcb3593-tokenizer-tmp\") pod \"scheduler-ha-replicas-test-kserve-router-scheduler-5fd8546ddjd4\" (UID: \"e09d3a74-fbbe-4f66-9015-a66fbdcb3593\") " pod="kserve-ci-e2e-test/scheduler-ha-replicas-test-kserve-router-scheduler-5fd8546ddjd4"
May 25 11:45:06.765390 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:45:06.765342    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tokenizer-uds\" (UniqueName: \"kubernetes.io/empty-dir/e09d3a74-fbbe-4f66-9015-a66fbdcb3593-tokenizer-uds\") pod \"scheduler-ha-replicas-test-kserve-router-scheduler-5fd8546ddjd4\" (UID: \"e09d3a74-fbbe-4f66-9015-a66fbdcb3593\") " pod="kserve-ci-e2e-test/scheduler-ha-replicas-test-kserve-router-scheduler-5fd8546ddjd4"
May 25 11:45:06.765599 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:45:06.765580    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/e09d3a74-fbbe-4f66-9015-a66fbdcb3593-kserve-provision-location\") pod \"scheduler-ha-replicas-test-kserve-router-scheduler-5fd8546ddjd4\" (UID: \"e09d3a74-fbbe-4f66-9015-a66fbdcb3593\") " pod="kserve-ci-e2e-test/scheduler-ha-replicas-test-kserve-router-scheduler-5fd8546ddjd4"
May 25 11:45:06.767406 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:45:06.767383    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e09d3a74-fbbe-4f66-9015-a66fbdcb3593-tls-certs\") pod \"scheduler-ha-replicas-test-kserve-router-scheduler-5fd8546ddjd4\" (UID: \"e09d3a74-fbbe-4f66-9015-a66fbdcb3593\") " pod="kserve-ci-e2e-test/scheduler-ha-replicas-test-kserve-router-scheduler-5fd8546ddjd4"
May 25 11:45:06.773435 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:45:06.773408    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wjscd\" (UniqueName: \"kubernetes.io/projected/e09d3a74-fbbe-4f66-9015-a66fbdcb3593-kube-api-access-wjscd\") pod \"scheduler-ha-replicas-test-kserve-router-scheduler-5fd8546ddjd4\" (UID: \"e09d3a74-fbbe-4f66-9015-a66fbdcb3593\") " pod="kserve-ci-e2e-test/scheduler-ha-replicas-test-kserve-router-scheduler-5fd8546ddjd4"
May 25 11:45:06.918023 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:45:06.917939    2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/scheduler-ha-replicas-test-kserve-router-scheduler-5fd8546ddjd4"
May 25 11:45:07.092476 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:45:07.092449    2569 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/scheduler-ha-replicas-test-kserve-router-scheduler-5fd8546ddjd4"]
May 25 11:45:07.094699 ip-10-0-143-46 kubenswrapper[2569]: W0525 11:45:07.094652    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode09d3a74_fbbe_4f66_9015_a66fbdcb3593.slice/crio-86276a98022ba8270338c1f8370cc2c488ec9b8a468a69e0013b0d2811ad9885 WatchSource:0}: Error finding container 86276a98022ba8270338c1f8370cc2c488ec9b8a468a69e0013b0d2811ad9885: Status 404 returned error can't find the container with id 86276a98022ba8270338c1f8370cc2c488ec9b8a468a69e0013b0d2811ad9885
May 25 11:45:07.369865 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:45:07.369824    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/scheduler-ha-replicas-test-kserve-router-scheduler-5fd8546ddjd4" event={"ID":"e09d3a74-fbbe-4f66-9015-a66fbdcb3593","Type":"ContainerStarted","Data":"a88699f3f0c6979735d8ab246e724ef7a1bae17436143be632ac2ed28bf85686"}
May 25 11:45:07.370316 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:45:07.369873    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/scheduler-ha-replicas-test-kserve-router-scheduler-5fd8546ddjd4" event={"ID":"e09d3a74-fbbe-4f66-9015-a66fbdcb3593","Type":"ContainerStarted","Data":"86276a98022ba8270338c1f8370cc2c488ec9b8a468a69e0013b0d2811ad9885"}
May 25 11:45:07.371306 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:45:07.371279    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/scheduler-ha-replicas-test-kserve-7d7687797c-nnfgv" event={"ID":"c1bfa2c2-59b2-46b4-b340-a50068d3c3d9","Type":"ContainerStarted","Data":"8ce4b4f65124f9c6db86163f561341186afabe89e5b03496b0782a3d4e6024ee"}
May 25 11:45:07.371414 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:45:07.371315    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/scheduler-ha-replicas-test-kserve-7d7687797c-nnfgv" event={"ID":"c1bfa2c2-59b2-46b4-b340-a50068d3c3d9","Type":"ContainerStarted","Data":"49af85119761b7d6174c0f3c33ba193807308e55108fc389985bd66fb2b872b5"}
May 25 11:45:08.376923 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:45:08.376888    2569 generic.go:358] "Generic (PLEG): container finished" podID="e09d3a74-fbbe-4f66-9015-a66fbdcb3593" containerID="a88699f3f0c6979735d8ab246e724ef7a1bae17436143be632ac2ed28bf85686" exitCode=0
May 25 11:45:08.377410 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:45:08.376979    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/scheduler-ha-replicas-test-kserve-router-scheduler-5fd8546ddjd4" event={"ID":"e09d3a74-fbbe-4f66-9015-a66fbdcb3593","Type":"ContainerDied","Data":"a88699f3f0c6979735d8ab246e724ef7a1bae17436143be632ac2ed28bf85686"}
May 25 11:45:11.389803 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:45:11.389746    2569 generic.go:358] "Generic (PLEG): container finished" podID="c1bfa2c2-59b2-46b4-b340-a50068d3c3d9" containerID="8ce4b4f65124f9c6db86163f561341186afabe89e5b03496b0782a3d4e6024ee" exitCode=0
May 25 11:45:11.390271 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:45:11.389827    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/scheduler-ha-replicas-test-kserve-7d7687797c-nnfgv" event={"ID":"c1bfa2c2-59b2-46b4-b340-a50068d3c3d9","Type":"ContainerDied","Data":"8ce4b4f65124f9c6db86163f561341186afabe89e5b03496b0782a3d4e6024ee"}
May 25 11:45:12.395143 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:45:12.395107    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/scheduler-ha-replicas-test-kserve-7d7687797c-nnfgv" event={"ID":"c1bfa2c2-59b2-46b4-b340-a50068d3c3d9","Type":"ContainerStarted","Data":"c5e41c47b9e05edc0576b93e6bf98bd9d66e01bdd187c87263aefa1beec62385"}
May 25 11:45:12.418175 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:45:12.418131    2569 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kserve-ci-e2e-test/scheduler-ha-replicas-test-kserve-7d7687797c-nnfgv" podStartSLOduration=6.418115728 podStartE2EDuration="6.418115728s" podCreationTimestamp="2026-05-25 11:45:06 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-25 11:45:12.416451011 +0000 UTC m=+1651.278075394" watchObservedRunningTime="2026-05-25 11:45:12.418115728 +0000 UTC m=+1651.279740111"
May 25 11:45:16.626942 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:45:16.626911    2569 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kserve-ci-e2e-test/scheduler-ha-replicas-test-kserve-7d7687797c-nnfgv"
May 25 11:45:16.627318 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:45:16.626953    2569 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/scheduler-ha-replicas-test-kserve-7d7687797c-nnfgv"
May 25 11:45:16.638920 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:45:16.638894    2569 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="kserve-ci-e2e-test/scheduler-ha-replicas-test-kserve-7d7687797c-nnfgv"
May 25 11:45:17.431708 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:45:17.431680    2569 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/scheduler-ha-replicas-test-kserve-7d7687797c-nnfgv"
May 25 11:45:26.452740 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:45:26.452699    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/scheduler-ha-replicas-test-kserve-router-scheduler-5fd8546ddjd4" event={"ID":"e09d3a74-fbbe-4f66-9015-a66fbdcb3593","Type":"ContainerStarted","Data":"8e0fd1a8c65fe40fccba1dfe1fd1ac6ee828614a030142bcbb49d48cc49a289d"}
May 25 11:45:40.372391 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:45:40.372309    2569 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/scheduler-ha-replicas-test-kserve-7d7687797c-nnfgv"]
May 25 11:45:40.372886 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:45:40.372749    2569 kuberuntime_container.go:864] "Killing container with a grace period" pod="kserve-ci-e2e-test/scheduler-ha-replicas-test-kserve-7d7687797c-nnfgv" podUID="c1bfa2c2-59b2-46b4-b340-a50068d3c3d9" containerName="main" containerID="cri-o://c5e41c47b9e05edc0576b93e6bf98bd9d66e01bdd187c87263aefa1beec62385" gracePeriod=30
May 25 11:45:40.374577 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:45:40.374550    2569 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/scheduler-ha-replicas-test-kserve-router-scheduler-5fd8546ddjd4"]
May 25 11:45:47.421016 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:45:47.420975    2569 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/scheduler-ha-replicas-test-kserve-7d7687797c-nnfgv" podUID="c1bfa2c2-59b2-46b4-b340-a50068d3c3d9" containerName="main" probeResult="failure" output="Get \"https://10.134.0.41:8000/health\": dial tcp 10.134.0.41:8000: connect: connection refused"
May 25 11:45:47.784864 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:45:47.784828    2569 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/precise-prefix-cache-test-kserve-58dc66bdf5-bmmrh"]
May 25 11:45:47.826700 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:45:47.826658    2569 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/precise-prefix-cache-test-kserve-58dc66bdf5-bmmrh"]
May 25 11:45:47.826875 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:45:47.826822    2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/precise-prefix-cache-test-kserve-58dc66bdf5-bmmrh"
May 25 11:45:47.839294 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:45:47.839265    2569 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"precise-prefix-cache-test-kserve-self-signed-certs\""
May 25 11:45:47.850491 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:45:47.850460    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0b47ce49-7420-4bc1-bb75-b20998d7b5a8-tls-certs\") pod \"precise-prefix-cache-test-kserve-58dc66bdf5-bmmrh\" (UID: \"0b47ce49-7420-4bc1-bb75-b20998d7b5a8\") " pod="kserve-ci-e2e-test/precise-prefix-cache-test-kserve-58dc66bdf5-bmmrh"
May 25 11:45:47.850639 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:45:47.850508    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0b47ce49-7420-4bc1-bb75-b20998d7b5a8-model-cache\") pod \"precise-prefix-cache-test-kserve-58dc66bdf5-bmmrh\" (UID: \"0b47ce49-7420-4bc1-bb75-b20998d7b5a8\") " pod="kserve-ci-e2e-test/precise-prefix-cache-test-kserve-58dc66bdf5-bmmrh"
May 25 11:45:47.850639 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:45:47.850597    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0b47ce49-7420-4bc1-bb75-b20998d7b5a8-dshm\") pod \"precise-prefix-cache-test-kserve-58dc66bdf5-bmmrh\" (UID: \"0b47ce49-7420-4bc1-bb75-b20998d7b5a8\") " pod="kserve-ci-e2e-test/precise-prefix-cache-test-kserve-58dc66bdf5-bmmrh"
May 25 11:45:47.850639 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:45:47.850635    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0b47ce49-7420-4bc1-bb75-b20998d7b5a8-tmp-dir\") pod \"precise-prefix-cache-test-kserve-58dc66bdf5-bmmrh\" (UID: \"0b47ce49-7420-4bc1-bb75-b20998d7b5a8\") " pod="kserve-ci-e2e-test/precise-prefix-cache-test-kserve-58dc66bdf5-bmmrh"
May 25 11:45:47.850922 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:45:47.850771    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0b47ce49-7420-4bc1-bb75-b20998d7b5a8-home\") pod \"precise-prefix-cache-test-kserve-58dc66bdf5-bmmrh\" (UID: \"0b47ce49-7420-4bc1-bb75-b20998d7b5a8\") " pod="kserve-ci-e2e-test/precise-prefix-cache-test-kserve-58dc66bdf5-bmmrh"
May 25 11:45:47.850922 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:45:47.850904    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/0b47ce49-7420-4bc1-bb75-b20998d7b5a8-kserve-provision-location\") pod \"precise-prefix-cache-test-kserve-58dc66bdf5-bmmrh\" (UID: \"0b47ce49-7420-4bc1-bb75-b20998d7b5a8\") " pod="kserve-ci-e2e-test/precise-prefix-cache-test-kserve-58dc66bdf5-bmmrh"
May 25 11:45:47.851012 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:45:47.850937    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zd2c7\" (UniqueName: \"kubernetes.io/projected/0b47ce49-7420-4bc1-bb75-b20998d7b5a8-kube-api-access-zd2c7\") pod \"precise-prefix-cache-test-kserve-58dc66bdf5-bmmrh\" (UID: \"0b47ce49-7420-4bc1-bb75-b20998d7b5a8\") " pod="kserve-ci-e2e-test/precise-prefix-cache-test-kserve-58dc66bdf5-bmmrh"
May 25 11:45:47.951769 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:45:47.951728    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0b47ce49-7420-4bc1-bb75-b20998d7b5a8-home\") pod \"precise-prefix-cache-test-kserve-58dc66bdf5-bmmrh\" (UID: \"0b47ce49-7420-4bc1-bb75-b20998d7b5a8\") " pod="kserve-ci-e2e-test/precise-prefix-cache-test-kserve-58dc66bdf5-bmmrh"
May 25 11:45:47.951983 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:45:47.951847    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/0b47ce49-7420-4bc1-bb75-b20998d7b5a8-kserve-provision-location\") pod \"precise-prefix-cache-test-kserve-58dc66bdf5-bmmrh\" (UID: \"0b47ce49-7420-4bc1-bb75-b20998d7b5a8\") " pod="kserve-ci-e2e-test/precise-prefix-cache-test-kserve-58dc66bdf5-bmmrh"
May 25 11:45:47.951983 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:45:47.951880    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-zd2c7\" (UniqueName: \"kubernetes.io/projected/0b47ce49-7420-4bc1-bb75-b20998d7b5a8-kube-api-access-zd2c7\") pod \"precise-prefix-cache-test-kserve-58dc66bdf5-bmmrh\" (UID: \"0b47ce49-7420-4bc1-bb75-b20998d7b5a8\") " pod="kserve-ci-e2e-test/precise-prefix-cache-test-kserve-58dc66bdf5-bmmrh"
May 25 11:45:47.951983 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:45:47.951929    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0b47ce49-7420-4bc1-bb75-b20998d7b5a8-tls-certs\") pod \"precise-prefix-cache-test-kserve-58dc66bdf5-bmmrh\" (UID: \"0b47ce49-7420-4bc1-bb75-b20998d7b5a8\") " pod="kserve-ci-e2e-test/precise-prefix-cache-test-kserve-58dc66bdf5-bmmrh"
May 25 11:45:47.951983 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:45:47.951959    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0b47ce49-7420-4bc1-bb75-b20998d7b5a8-model-cache\") pod \"precise-prefix-cache-test-kserve-58dc66bdf5-bmmrh\" (UID: \"0b47ce49-7420-4bc1-bb75-b20998d7b5a8\") " pod="kserve-ci-e2e-test/precise-prefix-cache-test-kserve-58dc66bdf5-bmmrh"
May 25 11:45:47.952208 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:45:47.951998    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0b47ce49-7420-4bc1-bb75-b20998d7b5a8-dshm\") pod \"precise-prefix-cache-test-kserve-58dc66bdf5-bmmrh\" (UID: \"0b47ce49-7420-4bc1-bb75-b20998d7b5a8\") " pod="kserve-ci-e2e-test/precise-prefix-cache-test-kserve-58dc66bdf5-bmmrh"
May 25 11:45:47.952208 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:45:47.952020    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0b47ce49-7420-4bc1-bb75-b20998d7b5a8-tmp-dir\") pod \"precise-prefix-cache-test-kserve-58dc66bdf5-bmmrh\" (UID: \"0b47ce49-7420-4bc1-bb75-b20998d7b5a8\") " pod="kserve-ci-e2e-test/precise-prefix-cache-test-kserve-58dc66bdf5-bmmrh"
May 25 11:45:47.952319 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:45:47.952248    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0b47ce49-7420-4bc1-bb75-b20998d7b5a8-home\") pod \"precise-prefix-cache-test-kserve-58dc66bdf5-bmmrh\" (UID: \"0b47ce49-7420-4bc1-bb75-b20998d7b5a8\") " pod="kserve-ci-e2e-test/precise-prefix-cache-test-kserve-58dc66bdf5-bmmrh"
May 25 11:45:47.952319 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:45:47.952291    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/0b47ce49-7420-4bc1-bb75-b20998d7b5a8-kserve-provision-location\") pod \"precise-prefix-cache-test-kserve-58dc66bdf5-bmmrh\" (UID: \"0b47ce49-7420-4bc1-bb75-b20998d7b5a8\") " pod="kserve-ci-e2e-test/precise-prefix-cache-test-kserve-58dc66bdf5-bmmrh"
May 25 11:45:47.952631 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:45:47.952606    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0b47ce49-7420-4bc1-bb75-b20998d7b5a8-tmp-dir\") pod \"precise-prefix-cache-test-kserve-58dc66bdf5-bmmrh\" (UID: \"0b47ce49-7420-4bc1-bb75-b20998d7b5a8\") " pod="kserve-ci-e2e-test/precise-prefix-cache-test-kserve-58dc66bdf5-bmmrh"
May 25 11:45:47.952631 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:45:47.952621    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0b47ce49-7420-4bc1-bb75-b20998d7b5a8-model-cache\") pod \"precise-prefix-cache-test-kserve-58dc66bdf5-bmmrh\" (UID: \"0b47ce49-7420-4bc1-bb75-b20998d7b5a8\") " pod="kserve-ci-e2e-test/precise-prefix-cache-test-kserve-58dc66bdf5-bmmrh"
May 25 11:45:47.954734 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:45:47.954713    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0b47ce49-7420-4bc1-bb75-b20998d7b5a8-dshm\") pod \"precise-prefix-cache-test-kserve-58dc66bdf5-bmmrh\" (UID: \"0b47ce49-7420-4bc1-bb75-b20998d7b5a8\") " pod="kserve-ci-e2e-test/precise-prefix-cache-test-kserve-58dc66bdf5-bmmrh"
May 25 11:45:47.955466 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:45:47.955444    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0b47ce49-7420-4bc1-bb75-b20998d7b5a8-tls-certs\") pod \"precise-prefix-cache-test-kserve-58dc66bdf5-bmmrh\" (UID: \"0b47ce49-7420-4bc1-bb75-b20998d7b5a8\") " pod="kserve-ci-e2e-test/precise-prefix-cache-test-kserve-58dc66bdf5-bmmrh"
May 25 11:45:47.962873 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:45:47.962849    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zd2c7\" (UniqueName: \"kubernetes.io/projected/0b47ce49-7420-4bc1-bb75-b20998d7b5a8-kube-api-access-zd2c7\") pod \"precise-prefix-cache-test-kserve-58dc66bdf5-bmmrh\" (UID: \"0b47ce49-7420-4bc1-bb75-b20998d7b5a8\") " pod="kserve-ci-e2e-test/precise-prefix-cache-test-kserve-58dc66bdf5-bmmrh"
May 25 11:45:48.139212 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:45:48.139129    2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/precise-prefix-cache-test-kserve-58dc66bdf5-bmmrh"
May 25 11:45:54.570087 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:45:54.570053    2569 generic.go:358] "Generic (PLEG): container finished" podID="c1bfa2c2-59b2-46b4-b340-a50068d3c3d9" containerID="c5e41c47b9e05edc0576b93e6bf98bd9d66e01bdd187c87263aefa1beec62385" exitCode=0
May 25 11:45:54.570433 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:45:54.570129    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/scheduler-ha-replicas-test-kserve-7d7687797c-nnfgv" event={"ID":"c1bfa2c2-59b2-46b4-b340-a50068d3c3d9","Type":"ContainerDied","Data":"c5e41c47b9e05edc0576b93e6bf98bd9d66e01bdd187c87263aefa1beec62385"}
May 25 11:45:54.646365 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:45:54.646343    2569 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/scheduler-ha-replicas-test-kserve-7d7687797c-nnfgv"
May 25 11:45:54.724392 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:45:54.724316    2569 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c1bfa2c2-59b2-46b4-b340-a50068d3c3d9-home\") pod \"c1bfa2c2-59b2-46b4-b340-a50068d3c3d9\" (UID: \"c1bfa2c2-59b2-46b4-b340-a50068d3c3d9\") "
May 25 11:45:54.724392 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:45:54.724384    2569 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-c8dqf\" (UniqueName: \"kubernetes.io/projected/c1bfa2c2-59b2-46b4-b340-a50068d3c3d9-kube-api-access-c8dqf\") pod \"c1bfa2c2-59b2-46b4-b340-a50068d3c3d9\" (UID: \"c1bfa2c2-59b2-46b4-b340-a50068d3c3d9\") "
May 25 11:45:54.724638 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:45:54.724450    2569 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c1bfa2c2-59b2-46b4-b340-a50068d3c3d9-dshm\") pod \"c1bfa2c2-59b2-46b4-b340-a50068d3c3d9\" (UID: \"c1bfa2c2-59b2-46b4-b340-a50068d3c3d9\") "
May 25 11:45:54.724638 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:45:54.724513    2569 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c1bfa2c2-59b2-46b4-b340-a50068d3c3d9-tmp-dir\") pod \"c1bfa2c2-59b2-46b4-b340-a50068d3c3d9\" (UID: \"c1bfa2c2-59b2-46b4-b340-a50068d3c3d9\") "
May 25 11:45:54.724638 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:45:54.724554    2569 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c1bfa2c2-59b2-46b4-b340-a50068d3c3d9-tls-certs\") pod \"c1bfa2c2-59b2-46b4-b340-a50068d3c3d9\" (UID: \"c1bfa2c2-59b2-46b4-b340-a50068d3c3d9\") "
May 25 11:45:54.724638 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:45:54.724587    2569 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c1bfa2c2-59b2-46b4-b340-a50068d3c3d9-model-cache\") pod \"c1bfa2c2-59b2-46b4-b340-a50068d3c3d9\" (UID: \"c1bfa2c2-59b2-46b4-b340-a50068d3c3d9\") "
May 25 11:45:54.724638 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:45:54.724612    2569 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/c1bfa2c2-59b2-46b4-b340-a50068d3c3d9-kserve-provision-location\") pod \"c1bfa2c2-59b2-46b4-b340-a50068d3c3d9\" (UID: \"c1bfa2c2-59b2-46b4-b340-a50068d3c3d9\") "
May 25 11:45:54.724638 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:45:54.724613    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c1bfa2c2-59b2-46b4-b340-a50068d3c3d9-home" (OuterVolumeSpecName: "home") pod "c1bfa2c2-59b2-46b4-b340-a50068d3c3d9" (UID: "c1bfa2c2-59b2-46b4-b340-a50068d3c3d9"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 25 11:45:54.724969 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:45:54.724846    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c1bfa2c2-59b2-46b4-b340-a50068d3c3d9-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "c1bfa2c2-59b2-46b4-b340-a50068d3c3d9" (UID: "c1bfa2c2-59b2-46b4-b340-a50068d3c3d9"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 25 11:45:54.724969 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:45:54.724947    2569 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c1bfa2c2-59b2-46b4-b340-a50068d3c3d9-home\") on node \"ip-10-0-143-46.ec2.internal\" DevicePath \"\""
May 25 11:45:54.724969 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:45:54.724966    2569 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c1bfa2c2-59b2-46b4-b340-a50068d3c3d9-tmp-dir\") on node \"ip-10-0-143-46.ec2.internal\" DevicePath \"\""
May 25 11:45:54.725307 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:45:54.725245    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c1bfa2c2-59b2-46b4-b340-a50068d3c3d9-model-cache" (OuterVolumeSpecName: "model-cache") pod "c1bfa2c2-59b2-46b4-b340-a50068d3c3d9" (UID: "c1bfa2c2-59b2-46b4-b340-a50068d3c3d9"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 25 11:45:54.727438 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:45:54.727408    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c1bfa2c2-59b2-46b4-b340-a50068d3c3d9-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "c1bfa2c2-59b2-46b4-b340-a50068d3c3d9" (UID: "c1bfa2c2-59b2-46b4-b340-a50068d3c3d9"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 25 11:45:54.727699 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:45:54.727663    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c1bfa2c2-59b2-46b4-b340-a50068d3c3d9-dshm" (OuterVolumeSpecName: "dshm") pod "c1bfa2c2-59b2-46b4-b340-a50068d3c3d9" (UID: "c1bfa2c2-59b2-46b4-b340-a50068d3c3d9"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 25 11:45:54.734549 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:45:54.734239    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c1bfa2c2-59b2-46b4-b340-a50068d3c3d9-kube-api-access-c8dqf" (OuterVolumeSpecName: "kube-api-access-c8dqf") pod "c1bfa2c2-59b2-46b4-b340-a50068d3c3d9" (UID: "c1bfa2c2-59b2-46b4-b340-a50068d3c3d9"). InnerVolumeSpecName "kube-api-access-c8dqf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 25 11:45:54.770076 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:45:54.770048    2569 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/precise-prefix-cache-test-kserve-58dc66bdf5-bmmrh"]
May 25 11:45:54.795043 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:45:54.795004    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c1bfa2c2-59b2-46b4-b340-a50068d3c3d9-kserve-provision-location" (OuterVolumeSpecName: "kserve-provision-location") pod "c1bfa2c2-59b2-46b4-b340-a50068d3c3d9" (UID: "c1bfa2c2-59b2-46b4-b340-a50068d3c3d9"). InnerVolumeSpecName "kserve-provision-location". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 25 11:45:54.819540 ip-10-0-143-46 kubenswrapper[2569]: W0525 11:45:54.819508    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0b47ce49_7420_4bc1_bb75_b20998d7b5a8.slice/crio-38b4b1aea4e6c23f60967dad932218db7f828c815a566990d3ac0fdf4d02e303 WatchSource:0}: Error finding container 38b4b1aea4e6c23f60967dad932218db7f828c815a566990d3ac0fdf4d02e303: Status 404 returned error can't find the container with id 38b4b1aea4e6c23f60967dad932218db7f828c815a566990d3ac0fdf4d02e303
May 25 11:45:54.826267 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:45:54.826234    2569 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c1bfa2c2-59b2-46b4-b340-a50068d3c3d9-dshm\") on node \"ip-10-0-143-46.ec2.internal\" DevicePath \"\""
May 25 11:45:54.826267 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:45:54.826268    2569 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c1bfa2c2-59b2-46b4-b340-a50068d3c3d9-tls-certs\") on node \"ip-10-0-143-46.ec2.internal\" DevicePath \"\""
May 25 11:45:54.826267 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:45:54.826279    2569 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c1bfa2c2-59b2-46b4-b340-a50068d3c3d9-model-cache\") on node \"ip-10-0-143-46.ec2.internal\" DevicePath \"\""
May 25 11:45:54.826441 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:45:54.826288    2569 reconciler_common.go:299] "Volume detached for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/c1bfa2c2-59b2-46b4-b340-a50068d3c3d9-kserve-provision-location\") on node \"ip-10-0-143-46.ec2.internal\" DevicePath \"\""
May 25 11:45:54.826441 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:45:54.826301    2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-c8dqf\" (UniqueName: \"kubernetes.io/projected/c1bfa2c2-59b2-46b4-b340-a50068d3c3d9-kube-api-access-c8dqf\") on node \"ip-10-0-143-46.ec2.internal\" DevicePath \"\""
May 25 11:45:55.575690 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:45:55.575662    2569 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/scheduler-ha-replicas-test-kserve-7d7687797c-nnfgv"
May 25 11:45:55.575690 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:45:55.575671    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/scheduler-ha-replicas-test-kserve-7d7687797c-nnfgv" event={"ID":"c1bfa2c2-59b2-46b4-b340-a50068d3c3d9","Type":"ContainerDied","Data":"49af85119761b7d6174c0f3c33ba193807308e55108fc389985bd66fb2b872b5"}
May 25 11:45:55.576241 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:45:55.575816    2569 scope.go:117] "RemoveContainer" containerID="c5e41c47b9e05edc0576b93e6bf98bd9d66e01bdd187c87263aefa1beec62385"
May 25 11:45:55.577402 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:45:55.577375    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/precise-prefix-cache-test-kserve-58dc66bdf5-bmmrh" event={"ID":"0b47ce49-7420-4bc1-bb75-b20998d7b5a8","Type":"ContainerStarted","Data":"f926e45cf5b825f0bb49e0d8d857aa8f91d7ef55d5b4e819180922a03d9a0242"}
May 25 11:45:55.577402 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:45:55.577409    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/precise-prefix-cache-test-kserve-58dc66bdf5-bmmrh" event={"ID":"0b47ce49-7420-4bc1-bb75-b20998d7b5a8","Type":"ContainerStarted","Data":"38b4b1aea4e6c23f60967dad932218db7f828c815a566990d3ac0fdf4d02e303"}
May 25 11:45:55.579767 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:45:55.579672    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/scheduler-ha-replicas-test-kserve-router-scheduler-5fd8546ddjd4" event={"ID":"e09d3a74-fbbe-4f66-9015-a66fbdcb3593","Type":"ContainerStarted","Data":"58303d59e87ac14b96d8d84a8d57ee55896e29024610ce6c199f9546cd33a57a"}
May 25 11:45:55.579915 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:45:55.579866    2569 kuberuntime_container.go:864] "Killing container with a grace period" pod="kserve-ci-e2e-test/scheduler-ha-replicas-test-kserve-router-scheduler-5fd8546ddjd4" podUID="e09d3a74-fbbe-4f66-9015-a66fbdcb3593" containerName="main" containerID="cri-o://8e0fd1a8c65fe40fccba1dfe1fd1ac6ee828614a030142bcbb49d48cc49a289d" gracePeriod=30
May 25 11:45:55.579988 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:45:55.579891    2569 kuberuntime_container.go:864] "Killing container with a grace period" pod="kserve-ci-e2e-test/scheduler-ha-replicas-test-kserve-router-scheduler-5fd8546ddjd4" podUID="e09d3a74-fbbe-4f66-9015-a66fbdcb3593" containerName="tokenizer" containerID="cri-o://58303d59e87ac14b96d8d84a8d57ee55896e29024610ce6c199f9546cd33a57a" gracePeriod=30
May 25 11:45:55.580044 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:45:55.579986    2569 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/scheduler-ha-replicas-test-kserve-router-scheduler-5fd8546ddjd4"
May 25 11:45:55.582825 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:45:55.582777    2569 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/scheduler-ha-replicas-test-kserve-router-scheduler-5fd8546ddjd4" podUID="e09d3a74-fbbe-4f66-9015-a66fbdcb3593" containerName="main" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
May 25 11:45:55.586635 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:45:55.586615    2569 scope.go:117] "RemoveContainer" containerID="8ce4b4f65124f9c6db86163f561341186afabe89e5b03496b0782a3d4e6024ee"
May 25 11:45:55.602053 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:45:55.601982    2569 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kserve-ci-e2e-test/scheduler-ha-replicas-test-kserve-router-scheduler-5fd8546ddjd4" podStartSLOduration=2.840374417 podStartE2EDuration="49.601963321s" podCreationTimestamp="2026-05-25 11:45:06 +0000 UTC" firstStartedPulling="2026-05-25 11:45:08.378429082 +0000 UTC m=+1647.240053451" lastFinishedPulling="2026-05-25 11:45:55.140017987 +0000 UTC m=+1694.001642355" observedRunningTime="2026-05-25 11:45:55.600742835 +0000 UTC m=+1694.462367219" watchObservedRunningTime="2026-05-25 11:45:55.601963321 +0000 UTC m=+1694.463587706"
May 25 11:45:55.640184 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:45:55.640152    2569 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/scheduler-ha-replicas-test-kserve-7d7687797c-nnfgv"]
May 25 11:45:55.644477 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:45:55.644445    2569 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/scheduler-ha-replicas-test-kserve-7d7687797c-nnfgv"]
May 25 11:45:55.731308 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:45:55.731278    2569 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c1bfa2c2-59b2-46b4-b340-a50068d3c3d9" path="/var/lib/kubelet/pods/c1bfa2c2-59b2-46b4-b340-a50068d3c3d9/volumes"
May 25 11:45:56.586621 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:45:56.586588    2569 generic.go:358] "Generic (PLEG): container finished" podID="e09d3a74-fbbe-4f66-9015-a66fbdcb3593" containerID="8e0fd1a8c65fe40fccba1dfe1fd1ac6ee828614a030142bcbb49d48cc49a289d" exitCode=0
May 25 11:45:56.587029 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:45:56.586663    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/scheduler-ha-replicas-test-kserve-router-scheduler-5fd8546ddjd4" event={"ID":"e09d3a74-fbbe-4f66-9015-a66fbdcb3593","Type":"ContainerDied","Data":"8e0fd1a8c65fe40fccba1dfe1fd1ac6ee828614a030142bcbb49d48cc49a289d"}
May 25 11:45:56.918933 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:45:56.918861    2569 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/scheduler-ha-replicas-test-kserve-router-scheduler-5fd8546ddjd4"
May 25 11:45:59.613412 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:45:59.613379    2569 generic.go:358] "Generic (PLEG): container finished" podID="0b47ce49-7420-4bc1-bb75-b20998d7b5a8" containerID="f926e45cf5b825f0bb49e0d8d857aa8f91d7ef55d5b4e819180922a03d9a0242" exitCode=0
May 25 11:45:59.613906 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:45:59.613423    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/precise-prefix-cache-test-kserve-58dc66bdf5-bmmrh" event={"ID":"0b47ce49-7420-4bc1-bb75-b20998d7b5a8","Type":"ContainerDied","Data":"f926e45cf5b825f0bb49e0d8d857aa8f91d7ef55d5b4e819180922a03d9a0242"}
May 25 11:46:00.618609 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:46:00.618578    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/precise-prefix-cache-test-kserve-58dc66bdf5-bmmrh" event={"ID":"0b47ce49-7420-4bc1-bb75-b20998d7b5a8","Type":"ContainerStarted","Data":"27df87f0e28d14240bab4226374c5edf287ba75400f3c423769205f9b918cf07"}
May 25 11:46:00.637912 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:46:00.637851    2569 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kserve-ci-e2e-test/precise-prefix-cache-test-kserve-58dc66bdf5-bmmrh" podStartSLOduration=13.637831981 podStartE2EDuration="13.637831981s" podCreationTimestamp="2026-05-25 11:45:47 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-25 11:46:00.636991438 +0000 UTC m=+1699.498615820" watchObservedRunningTime="2026-05-25 11:46:00.637831981 +0000 UTC m=+1699.499456366"
May 25 11:46:05.581360 ip-10-0-143-46 kubenswrapper[2569]: W0525 11:46:05.581329    2569 logging.go:55] [core] [Channel #20 SubChannel #21]grpc: addrConn.createTransport failed to connect to {Addr: "10.134.0.42:9003", ServerName: "10.134.0.42:9003", }. Err: connection error: desc = "transport: Error while dialing: dial tcp 10.134.0.42:9003: connect: connection refused"
May 25 11:46:06.581289 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:46:06.581241    2569 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/scheduler-ha-replicas-test-kserve-router-scheduler-5fd8546ddjd4" podUID="e09d3a74-fbbe-4f66-9015-a66fbdcb3593" containerName="main" probeResult="failure" output="timeout: failed to connect service \"10.134.0.42:9003\" within 1s: context deadline exceeded"
May 25 11:46:08.139877 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:46:08.139835    2569 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/precise-prefix-cache-test-kserve-58dc66bdf5-bmmrh"
May 25 11:46:08.140310 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:46:08.139927    2569 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kserve-ci-e2e-test/precise-prefix-cache-test-kserve-58dc66bdf5-bmmrh"
May 25 11:46:08.152283 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:46:08.152258    2569 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="kserve-ci-e2e-test/precise-prefix-cache-test-kserve-58dc66bdf5-bmmrh"
May 25 11:46:08.663832 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:46:08.663775    2569 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/precise-prefix-cache-test-kserve-58dc66bdf5-bmmrh"
May 25 11:46:15.580921 ip-10-0-143-46 kubenswrapper[2569]: W0525 11:46:15.580893    2569 logging.go:55] [core] [Channel #22 SubChannel #23]grpc: addrConn.createTransport failed to connect to {Addr: "10.134.0.42:9003", ServerName: "10.134.0.42:9003", }. Err: connection error: desc = "transport: Error while dialing: dial tcp 10.134.0.42:9003: connect: connection refused"
May 25 11:46:16.580888 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:46:16.580847    2569 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/scheduler-ha-replicas-test-kserve-router-scheduler-5fd8546ddjd4" podUID="e09d3a74-fbbe-4f66-9015-a66fbdcb3593" containerName="main" probeResult="failure" output="timeout: failed to connect service \"10.134.0.42:9003\" within 1s: context deadline exceeded"
May 25 11:46:25.580916 ip-10-0-143-46 kubenswrapper[2569]: W0525 11:46:25.580886    2569 logging.go:55] [core] [Channel #24 SubChannel #25]grpc: addrConn.createTransport failed to connect to {Addr: "10.134.0.42:9003", ServerName: "10.134.0.42:9003", }. Err: connection error: desc = "transport: Error while dialing: dial tcp 10.134.0.42:9003: connect: connection refused"
May 25 11:46:25.709899 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:46:25.709875    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_scheduler-ha-replicas-test-kserve-router-scheduler-5fd8546ddjd4_e09d3a74-fbbe-4f66-9015-a66fbdcb3593/tokenizer/0.log"
May 25 11:46:25.710515 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:46:25.710488    2569 generic.go:358] "Generic (PLEG): container finished" podID="e09d3a74-fbbe-4f66-9015-a66fbdcb3593" containerID="58303d59e87ac14b96d8d84a8d57ee55896e29024610ce6c199f9546cd33a57a" exitCode=137
May 25 11:46:25.710610 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:46:25.710561    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/scheduler-ha-replicas-test-kserve-router-scheduler-5fd8546ddjd4" event={"ID":"e09d3a74-fbbe-4f66-9015-a66fbdcb3593","Type":"ContainerDied","Data":"58303d59e87ac14b96d8d84a8d57ee55896e29024610ce6c199f9546cd33a57a"}
May 25 11:46:26.298838 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:46:26.298816    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_scheduler-ha-replicas-test-kserve-router-scheduler-5fd8546ddjd4_e09d3a74-fbbe-4f66-9015-a66fbdcb3593/tokenizer/0.log"
May 25 11:46:26.299481 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:46:26.299463    2569 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/scheduler-ha-replicas-test-kserve-router-scheduler-5fd8546ddjd4"
May 25 11:46:26.314653 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:46:26.314627    2569 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/e09d3a74-fbbe-4f66-9015-a66fbdcb3593-kserve-provision-location\") pod \"e09d3a74-fbbe-4f66-9015-a66fbdcb3593\" (UID: \"e09d3a74-fbbe-4f66-9015-a66fbdcb3593\") "
May 25 11:46:26.314755 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:46:26.314683    2569 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e09d3a74-fbbe-4f66-9015-a66fbdcb3593-tls-certs\") pod \"e09d3a74-fbbe-4f66-9015-a66fbdcb3593\" (UID: \"e09d3a74-fbbe-4f66-9015-a66fbdcb3593\") "
May 25 11:46:26.314755 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:46:26.314716    2569 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"tokenizer-tmp\" (UniqueName: \"kubernetes.io/empty-dir/e09d3a74-fbbe-4f66-9015-a66fbdcb3593-tokenizer-tmp\") pod \"e09d3a74-fbbe-4f66-9015-a66fbdcb3593\" (UID: \"e09d3a74-fbbe-4f66-9015-a66fbdcb3593\") "
May 25 11:46:26.314755 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:46:26.314742    2569 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wjscd\" (UniqueName: \"kubernetes.io/projected/e09d3a74-fbbe-4f66-9015-a66fbdcb3593-kube-api-access-wjscd\") pod \"e09d3a74-fbbe-4f66-9015-a66fbdcb3593\" (UID: \"e09d3a74-fbbe-4f66-9015-a66fbdcb3593\") "
May 25 11:46:26.314905 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:46:26.314817    2569 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"tokenizer-cache\" (UniqueName: \"kubernetes.io/empty-dir/e09d3a74-fbbe-4f66-9015-a66fbdcb3593-tokenizer-cache\") pod \"e09d3a74-fbbe-4f66-9015-a66fbdcb3593\" (UID: \"e09d3a74-fbbe-4f66-9015-a66fbdcb3593\") "
May 25 11:46:26.314905 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:46:26.314846    2569 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"tokenizer-uds\" (UniqueName: \"kubernetes.io/empty-dir/e09d3a74-fbbe-4f66-9015-a66fbdcb3593-tokenizer-uds\") pod \"e09d3a74-fbbe-4f66-9015-a66fbdcb3593\" (UID: \"e09d3a74-fbbe-4f66-9015-a66fbdcb3593\") "
May 25 11:46:26.315112 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:46:26.315084    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e09d3a74-fbbe-4f66-9015-a66fbdcb3593-tokenizer-tmp" (OuterVolumeSpecName: "tokenizer-tmp") pod "e09d3a74-fbbe-4f66-9015-a66fbdcb3593" (UID: "e09d3a74-fbbe-4f66-9015-a66fbdcb3593"). InnerVolumeSpecName "tokenizer-tmp". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 25 11:46:26.315177 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:46:26.315117    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e09d3a74-fbbe-4f66-9015-a66fbdcb3593-tokenizer-cache" (OuterVolumeSpecName: "tokenizer-cache") pod "e09d3a74-fbbe-4f66-9015-a66fbdcb3593" (UID: "e09d3a74-fbbe-4f66-9015-a66fbdcb3593"). InnerVolumeSpecName "tokenizer-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 25 11:46:26.315327 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:46:26.315301    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e09d3a74-fbbe-4f66-9015-a66fbdcb3593-tokenizer-uds" (OuterVolumeSpecName: "tokenizer-uds") pod "e09d3a74-fbbe-4f66-9015-a66fbdcb3593" (UID: "e09d3a74-fbbe-4f66-9015-a66fbdcb3593"). InnerVolumeSpecName "tokenizer-uds". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 25 11:46:26.315506 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:46:26.315487    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e09d3a74-fbbe-4f66-9015-a66fbdcb3593-kserve-provision-location" (OuterVolumeSpecName: "kserve-provision-location") pod "e09d3a74-fbbe-4f66-9015-a66fbdcb3593" (UID: "e09d3a74-fbbe-4f66-9015-a66fbdcb3593"). InnerVolumeSpecName "kserve-provision-location". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 25 11:46:26.316771 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:46:26.316748    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e09d3a74-fbbe-4f66-9015-a66fbdcb3593-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "e09d3a74-fbbe-4f66-9015-a66fbdcb3593" (UID: "e09d3a74-fbbe-4f66-9015-a66fbdcb3593"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 25 11:46:26.316880 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:46:26.316821    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e09d3a74-fbbe-4f66-9015-a66fbdcb3593-kube-api-access-wjscd" (OuterVolumeSpecName: "kube-api-access-wjscd") pod "e09d3a74-fbbe-4f66-9015-a66fbdcb3593" (UID: "e09d3a74-fbbe-4f66-9015-a66fbdcb3593"). InnerVolumeSpecName "kube-api-access-wjscd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 25 11:46:26.415913 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:46:26.415853    2569 reconciler_common.go:299] "Volume detached for volume \"tokenizer-cache\" (UniqueName: \"kubernetes.io/empty-dir/e09d3a74-fbbe-4f66-9015-a66fbdcb3593-tokenizer-cache\") on node \"ip-10-0-143-46.ec2.internal\" DevicePath \"\""
May 25 11:46:26.415913 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:46:26.415880    2569 reconciler_common.go:299] "Volume detached for volume \"tokenizer-uds\" (UniqueName: \"kubernetes.io/empty-dir/e09d3a74-fbbe-4f66-9015-a66fbdcb3593-tokenizer-uds\") on node \"ip-10-0-143-46.ec2.internal\" DevicePath \"\""
May 25 11:46:26.415913 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:46:26.415891    2569 reconciler_common.go:299] "Volume detached for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/e09d3a74-fbbe-4f66-9015-a66fbdcb3593-kserve-provision-location\") on node \"ip-10-0-143-46.ec2.internal\" DevicePath \"\""
May 25 11:46:26.415913 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:46:26.415902    2569 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e09d3a74-fbbe-4f66-9015-a66fbdcb3593-tls-certs\") on node \"ip-10-0-143-46.ec2.internal\" DevicePath \"\""
May 25 11:46:26.415913 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:46:26.415912    2569 reconciler_common.go:299] "Volume detached for volume \"tokenizer-tmp\" (UniqueName: \"kubernetes.io/empty-dir/e09d3a74-fbbe-4f66-9015-a66fbdcb3593-tokenizer-tmp\") on node \"ip-10-0-143-46.ec2.internal\" DevicePath \"\""
May 25 11:46:26.416130 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:46:26.415921    2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wjscd\" (UniqueName: \"kubernetes.io/projected/e09d3a74-fbbe-4f66-9015-a66fbdcb3593-kube-api-access-wjscd\") on node \"ip-10-0-143-46.ec2.internal\" DevicePath \"\""
May 25 11:46:26.581554 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:46:26.581518    2569 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/scheduler-ha-replicas-test-kserve-router-scheduler-5fd8546ddjd4" podUID="e09d3a74-fbbe-4f66-9015-a66fbdcb3593" containerName="main" probeResult="failure" output="timeout: failed to connect service \"10.134.0.42:9003\" within 1s: context deadline exceeded"
May 25 11:46:26.715908 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:46:26.715845    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_scheduler-ha-replicas-test-kserve-router-scheduler-5fd8546ddjd4_e09d3a74-fbbe-4f66-9015-a66fbdcb3593/tokenizer/0.log"
May 25 11:46:26.716525 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:46:26.716501    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/scheduler-ha-replicas-test-kserve-router-scheduler-5fd8546ddjd4" event={"ID":"e09d3a74-fbbe-4f66-9015-a66fbdcb3593","Type":"ContainerDied","Data":"86276a98022ba8270338c1f8370cc2c488ec9b8a468a69e0013b0d2811ad9885"}
May 25 11:46:26.716612 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:46:26.716544    2569 scope.go:117] "RemoveContainer" containerID="58303d59e87ac14b96d8d84a8d57ee55896e29024610ce6c199f9546cd33a57a"
May 25 11:46:26.716612 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:46:26.716514    2569 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/scheduler-ha-replicas-test-kserve-router-scheduler-5fd8546ddjd4"
May 25 11:46:26.725327 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:46:26.725310    2569 scope.go:117] "RemoveContainer" containerID="8e0fd1a8c65fe40fccba1dfe1fd1ac6ee828614a030142bcbb49d48cc49a289d"
May 25 11:46:26.732639 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:46:26.732612    2569 scope.go:117] "RemoveContainer" containerID="a88699f3f0c6979735d8ab246e724ef7a1bae17436143be632ac2ed28bf85686"
May 25 11:46:26.739603 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:46:26.739581    2569 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/scheduler-ha-replicas-test-kserve-router-scheduler-5fd8546ddjd4"]
May 25 11:46:26.743323 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:46:26.743304    2569 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/scheduler-ha-replicas-test-kserve-router-scheduler-5fd8546ddjd4"]
May 25 11:46:27.729692 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:46:27.729654    2569 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e09d3a74-fbbe-4f66-9015-a66fbdcb3593" path="/var/lib/kubelet/pods/e09d3a74-fbbe-4f66-9015-a66fbdcb3593/volumes"
May 25 11:46:49.535112 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:46:49.535076    2569 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/precise-prefix-cache-test-kserve-58dc66bdf5-bmmrh"]
May 25 11:46:49.535523 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:46:49.535439    2569 kuberuntime_container.go:864] "Killing container with a grace period" pod="kserve-ci-e2e-test/precise-prefix-cache-test-kserve-58dc66bdf5-bmmrh" podUID="0b47ce49-7420-4bc1-bb75-b20998d7b5a8" containerName="main" containerID="cri-o://27df87f0e28d14240bab4226374c5edf287ba75400f3c423769205f9b918cf07" gracePeriod=30
May 25 11:46:49.786779 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:46:49.786721    2569 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/precise-prefix-cache-test-kserve-58dc66bdf5-bmmrh"
May 25 11:46:49.797978 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:46:49.797949    2569 generic.go:358] "Generic (PLEG): container finished" podID="0b47ce49-7420-4bc1-bb75-b20998d7b5a8" containerID="27df87f0e28d14240bab4226374c5edf287ba75400f3c423769205f9b918cf07" exitCode=0
May 25 11:46:49.798096 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:46:49.798014    2569 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/precise-prefix-cache-test-kserve-58dc66bdf5-bmmrh"
May 25 11:46:49.798096 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:46:49.798030    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/precise-prefix-cache-test-kserve-58dc66bdf5-bmmrh" event={"ID":"0b47ce49-7420-4bc1-bb75-b20998d7b5a8","Type":"ContainerDied","Data":"27df87f0e28d14240bab4226374c5edf287ba75400f3c423769205f9b918cf07"}
May 25 11:46:49.798096 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:46:49.798068    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/precise-prefix-cache-test-kserve-58dc66bdf5-bmmrh" event={"ID":"0b47ce49-7420-4bc1-bb75-b20998d7b5a8","Type":"ContainerDied","Data":"38b4b1aea4e6c23f60967dad932218db7f828c815a566990d3ac0fdf4d02e303"}
May 25 11:46:49.798096 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:46:49.798083    2569 scope.go:117] "RemoveContainer" containerID="27df87f0e28d14240bab4226374c5edf287ba75400f3c423769205f9b918cf07"
May 25 11:46:49.805848 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:46:49.805831    2569 scope.go:117] "RemoveContainer" containerID="f926e45cf5b825f0bb49e0d8d857aa8f91d7ef55d5b4e819180922a03d9a0242"
May 25 11:46:49.876066 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:46:49.876042    2569 scope.go:117] "RemoveContainer" containerID="27df87f0e28d14240bab4226374c5edf287ba75400f3c423769205f9b918cf07"
May 25 11:46:49.876356 ip-10-0-143-46 kubenswrapper[2569]: E0525 11:46:49.876334    2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"27df87f0e28d14240bab4226374c5edf287ba75400f3c423769205f9b918cf07\": container with ID starting with 27df87f0e28d14240bab4226374c5edf287ba75400f3c423769205f9b918cf07 not found: ID does not exist" containerID="27df87f0e28d14240bab4226374c5edf287ba75400f3c423769205f9b918cf07"
May 25 11:46:49.876439 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:46:49.876369    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"27df87f0e28d14240bab4226374c5edf287ba75400f3c423769205f9b918cf07"} err="failed to get container status \"27df87f0e28d14240bab4226374c5edf287ba75400f3c423769205f9b918cf07\": rpc error: code = NotFound desc = could not find container \"27df87f0e28d14240bab4226374c5edf287ba75400f3c423769205f9b918cf07\": container with ID starting with 27df87f0e28d14240bab4226374c5edf287ba75400f3c423769205f9b918cf07 not found: ID does not exist"
May 25 11:46:49.876439 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:46:49.876394    2569 scope.go:117] "RemoveContainer" containerID="f926e45cf5b825f0bb49e0d8d857aa8f91d7ef55d5b4e819180922a03d9a0242"
May 25 11:46:49.876672 ip-10-0-143-46 kubenswrapper[2569]: E0525 11:46:49.876652    2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f926e45cf5b825f0bb49e0d8d857aa8f91d7ef55d5b4e819180922a03d9a0242\": container with ID starting with f926e45cf5b825f0bb49e0d8d857aa8f91d7ef55d5b4e819180922a03d9a0242 not found: ID does not exist" containerID="f926e45cf5b825f0bb49e0d8d857aa8f91d7ef55d5b4e819180922a03d9a0242"
May 25 11:46:49.876711 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:46:49.876679    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f926e45cf5b825f0bb49e0d8d857aa8f91d7ef55d5b4e819180922a03d9a0242"} err="failed to get container status \"f926e45cf5b825f0bb49e0d8d857aa8f91d7ef55d5b4e819180922a03d9a0242\": rpc error: code = NotFound desc = could not find container \"f926e45cf5b825f0bb49e0d8d857aa8f91d7ef55d5b4e819180922a03d9a0242\": container with ID starting with f926e45cf5b825f0bb49e0d8d857aa8f91d7ef55d5b4e819180922a03d9a0242 not found: ID does not exist"
May 25 11:46:49.913264 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:46:49.913234    2569 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0b47ce49-7420-4bc1-bb75-b20998d7b5a8-home\") pod \"0b47ce49-7420-4bc1-bb75-b20998d7b5a8\" (UID: \"0b47ce49-7420-4bc1-bb75-b20998d7b5a8\") "
May 25 11:46:49.913380 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:46:49.913273    2569 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0b47ce49-7420-4bc1-bb75-b20998d7b5a8-dshm\") pod \"0b47ce49-7420-4bc1-bb75-b20998d7b5a8\" (UID: \"0b47ce49-7420-4bc1-bb75-b20998d7b5a8\") "
May 25 11:46:49.913380 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:46:49.913324    2569 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/0b47ce49-7420-4bc1-bb75-b20998d7b5a8-kserve-provision-location\") pod \"0b47ce49-7420-4bc1-bb75-b20998d7b5a8\" (UID: \"0b47ce49-7420-4bc1-bb75-b20998d7b5a8\") "
May 25 11:46:49.913380 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:46:49.913351    2569 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zd2c7\" (UniqueName: \"kubernetes.io/projected/0b47ce49-7420-4bc1-bb75-b20998d7b5a8-kube-api-access-zd2c7\") pod \"0b47ce49-7420-4bc1-bb75-b20998d7b5a8\" (UID: \"0b47ce49-7420-4bc1-bb75-b20998d7b5a8\") "
May 25 11:46:49.913536 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:46:49.913424    2569 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0b47ce49-7420-4bc1-bb75-b20998d7b5a8-model-cache\") pod \"0b47ce49-7420-4bc1-bb75-b20998d7b5a8\" (UID: \"0b47ce49-7420-4bc1-bb75-b20998d7b5a8\") "
May 25 11:46:49.913536 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:46:49.913464    2569 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0b47ce49-7420-4bc1-bb75-b20998d7b5a8-tmp-dir\") pod \"0b47ce49-7420-4bc1-bb75-b20998d7b5a8\" (UID: \"0b47ce49-7420-4bc1-bb75-b20998d7b5a8\") "
May 25 11:46:49.913536 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:46:49.913470    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0b47ce49-7420-4bc1-bb75-b20998d7b5a8-home" (OuterVolumeSpecName: "home") pod "0b47ce49-7420-4bc1-bb75-b20998d7b5a8" (UID: "0b47ce49-7420-4bc1-bb75-b20998d7b5a8"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 25 11:46:49.913673 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:46:49.913546    2569 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0b47ce49-7420-4bc1-bb75-b20998d7b5a8-tls-certs\") pod \"0b47ce49-7420-4bc1-bb75-b20998d7b5a8\" (UID: \"0b47ce49-7420-4bc1-bb75-b20998d7b5a8\") "
May 25 11:46:49.913735 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:46:49.913673    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0b47ce49-7420-4bc1-bb75-b20998d7b5a8-model-cache" (OuterVolumeSpecName: "model-cache") pod "0b47ce49-7420-4bc1-bb75-b20998d7b5a8" (UID: "0b47ce49-7420-4bc1-bb75-b20998d7b5a8"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 25 11:46:49.913778 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:46:49.913740    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0b47ce49-7420-4bc1-bb75-b20998d7b5a8-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "0b47ce49-7420-4bc1-bb75-b20998d7b5a8" (UID: "0b47ce49-7420-4bc1-bb75-b20998d7b5a8"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 25 11:46:49.913884 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:46:49.913863    2569 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0b47ce49-7420-4bc1-bb75-b20998d7b5a8-model-cache\") on node \"ip-10-0-143-46.ec2.internal\" DevicePath \"\""
May 25 11:46:49.913958 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:46:49.913889    2569 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0b47ce49-7420-4bc1-bb75-b20998d7b5a8-tmp-dir\") on node \"ip-10-0-143-46.ec2.internal\" DevicePath \"\""
May 25 11:46:49.913958 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:46:49.913902    2569 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0b47ce49-7420-4bc1-bb75-b20998d7b5a8-home\") on node \"ip-10-0-143-46.ec2.internal\" DevicePath \"\""
May 25 11:46:49.915585 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:46:49.915560    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0b47ce49-7420-4bc1-bb75-b20998d7b5a8-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "0b47ce49-7420-4bc1-bb75-b20998d7b5a8" (UID: "0b47ce49-7420-4bc1-bb75-b20998d7b5a8"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 25 11:46:49.915926 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:46:49.915904    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0b47ce49-7420-4bc1-bb75-b20998d7b5a8-dshm" (OuterVolumeSpecName: "dshm") pod "0b47ce49-7420-4bc1-bb75-b20998d7b5a8" (UID: "0b47ce49-7420-4bc1-bb75-b20998d7b5a8"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 25 11:46:49.916025 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:46:49.915937    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0b47ce49-7420-4bc1-bb75-b20998d7b5a8-kube-api-access-zd2c7" (OuterVolumeSpecName: "kube-api-access-zd2c7") pod "0b47ce49-7420-4bc1-bb75-b20998d7b5a8" (UID: "0b47ce49-7420-4bc1-bb75-b20998d7b5a8"). InnerVolumeSpecName "kube-api-access-zd2c7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 25 11:46:49.971091 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:46:49.971066    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0b47ce49-7420-4bc1-bb75-b20998d7b5a8-kserve-provision-location" (OuterVolumeSpecName: "kserve-provision-location") pod "0b47ce49-7420-4bc1-bb75-b20998d7b5a8" (UID: "0b47ce49-7420-4bc1-bb75-b20998d7b5a8"). InnerVolumeSpecName "kserve-provision-location". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 25 11:46:50.015112 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:46:50.015087    2569 reconciler_common.go:299] "Volume detached for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/0b47ce49-7420-4bc1-bb75-b20998d7b5a8-kserve-provision-location\") on node \"ip-10-0-143-46.ec2.internal\" DevicePath \"\""
May 25 11:46:50.015112 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:46:50.015111    2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zd2c7\" (UniqueName: \"kubernetes.io/projected/0b47ce49-7420-4bc1-bb75-b20998d7b5a8-kube-api-access-zd2c7\") on node \"ip-10-0-143-46.ec2.internal\" DevicePath \"\""
May 25 11:46:50.015245 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:46:50.015122    2569 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0b47ce49-7420-4bc1-bb75-b20998d7b5a8-tls-certs\") on node \"ip-10-0-143-46.ec2.internal\" DevicePath \"\""
May 25 11:46:50.015245 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:46:50.015133    2569 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0b47ce49-7420-4bc1-bb75-b20998d7b5a8-dshm\") on node \"ip-10-0-143-46.ec2.internal\" DevicePath \"\""
May 25 11:46:50.128813 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:46:50.127826    2569 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/precise-prefix-cache-test-kserve-58dc66bdf5-bmmrh"]
May 25 11:46:50.139627 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:46:50.139604    2569 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/precise-prefix-cache-test-kserve-58dc66bdf5-bmmrh"]
May 25 11:46:51.732580 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:46:51.732466    2569 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0b47ce49-7420-4bc1-bb75-b20998d7b5a8" path="/var/lib/kubelet/pods/0b47ce49-7420-4bc1-bb75-b20998d7b5a8/volumes"
May 25 11:47:17.635148 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:47:17.635115    2569 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/stop-feature-test-kserve-router-scheduler-f99b6c6cb-dqm2b"]
May 25 11:47:17.635684 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:47:17.635666    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e09d3a74-fbbe-4f66-9015-a66fbdcb3593" containerName="storage-initializer"
May 25 11:47:17.635731 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:47:17.635688    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="e09d3a74-fbbe-4f66-9015-a66fbdcb3593" containerName="storage-initializer"
May 25 11:47:17.635731 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:47:17.635708    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c1bfa2c2-59b2-46b4-b340-a50068d3c3d9" containerName="storage-initializer"
May 25 11:47:17.635731 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:47:17.635716    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="c1bfa2c2-59b2-46b4-b340-a50068d3c3d9" containerName="storage-initializer"
May 25 11:47:17.635731 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:47:17.635727    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c1bfa2c2-59b2-46b4-b340-a50068d3c3d9" containerName="main"
May 25 11:47:17.635876 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:47:17.635736    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="c1bfa2c2-59b2-46b4-b340-a50068d3c3d9" containerName="main"
May 25 11:47:17.635876 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:47:17.635751    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e09d3a74-fbbe-4f66-9015-a66fbdcb3593" containerName="main"
May 25 11:47:17.635876 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:47:17.635759    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="e09d3a74-fbbe-4f66-9015-a66fbdcb3593" containerName="main"
May 25 11:47:17.635876 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:47:17.635772    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e09d3a74-fbbe-4f66-9015-a66fbdcb3593" containerName="tokenizer"
May 25 11:47:17.635876 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:47:17.635780    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="e09d3a74-fbbe-4f66-9015-a66fbdcb3593" containerName="tokenizer"
May 25 11:47:17.635876 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:47:17.635814    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0b47ce49-7420-4bc1-bb75-b20998d7b5a8" containerName="storage-initializer"
May 25 11:47:17.635876 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:47:17.635822    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="0b47ce49-7420-4bc1-bb75-b20998d7b5a8" containerName="storage-initializer"
May 25 11:47:17.635876 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:47:17.635844    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0b47ce49-7420-4bc1-bb75-b20998d7b5a8" containerName="main"
May 25 11:47:17.635876 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:47:17.635852    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="0b47ce49-7420-4bc1-bb75-b20998d7b5a8" containerName="main"
May 25 11:47:17.636175 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:47:17.635948    2569 memory_manager.go:356] "RemoveStaleState removing state" podUID="e09d3a74-fbbe-4f66-9015-a66fbdcb3593" containerName="tokenizer"
May 25 11:47:17.636175 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:47:17.635963    2569 memory_manager.go:356] "RemoveStaleState removing state" podUID="0b47ce49-7420-4bc1-bb75-b20998d7b5a8" containerName="main"
May 25 11:47:17.636175 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:47:17.635972    2569 memory_manager.go:356] "RemoveStaleState removing state" podUID="c1bfa2c2-59b2-46b4-b340-a50068d3c3d9" containerName="main"
May 25 11:47:17.636175 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:47:17.635985    2569 memory_manager.go:356] "RemoveStaleState removing state" podUID="e09d3a74-fbbe-4f66-9015-a66fbdcb3593" containerName="main"
May 25 11:47:17.638640 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:47:17.638616    2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/stop-feature-test-kserve-router-scheduler-f99b6c6cb-dqm2b"
May 25 11:47:17.641405 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:47:17.641375    2569 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"default-dockercfg-5cxfn\""
May 25 11:47:17.642409 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:47:17.642390    2569 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"stop-feature-test-kserve-self-signed-certs\""
May 25 11:47:17.642525 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:47:17.642446    2569 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"stop-feature-test-epp-sa-dockercfg-dc6q5\""
May 25 11:47:17.654770 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:47:17.654747    2569 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/stop-feature-test-kserve-router-scheduler-f99b6c6cb-dqm2b"]
May 25 11:47:17.737363 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:47:17.737332    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kngmf\" (UniqueName: \"kubernetes.io/projected/749dcb9b-2b00-4353-9890-5b330007fbc0-kube-api-access-kngmf\") pod \"stop-feature-test-kserve-router-scheduler-f99b6c6cb-dqm2b\" (UID: \"749dcb9b-2b00-4353-9890-5b330007fbc0\") " pod="kserve-ci-e2e-test/stop-feature-test-kserve-router-scheduler-f99b6c6cb-dqm2b"
May 25 11:47:17.737477 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:47:17.737374    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/749dcb9b-2b00-4353-9890-5b330007fbc0-kserve-provision-location\") pod \"stop-feature-test-kserve-router-scheduler-f99b6c6cb-dqm2b\" (UID: \"749dcb9b-2b00-4353-9890-5b330007fbc0\") " pod="kserve-ci-e2e-test/stop-feature-test-kserve-router-scheduler-f99b6c6cb-dqm2b"
May 25 11:47:17.737477 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:47:17.737397    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/749dcb9b-2b00-4353-9890-5b330007fbc0-tls-certs\") pod \"stop-feature-test-kserve-router-scheduler-f99b6c6cb-dqm2b\" (UID: \"749dcb9b-2b00-4353-9890-5b330007fbc0\") " pod="kserve-ci-e2e-test/stop-feature-test-kserve-router-scheduler-f99b6c6cb-dqm2b"
May 25 11:47:17.737477 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:47:17.737461    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tokenizer-cache\" (UniqueName: \"kubernetes.io/empty-dir/749dcb9b-2b00-4353-9890-5b330007fbc0-tokenizer-cache\") pod \"stop-feature-test-kserve-router-scheduler-f99b6c6cb-dqm2b\" (UID: \"749dcb9b-2b00-4353-9890-5b330007fbc0\") " pod="kserve-ci-e2e-test/stop-feature-test-kserve-router-scheduler-f99b6c6cb-dqm2b"
May 25 11:47:17.737579 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:47:17.737520    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tokenizer-uds\" (UniqueName: \"kubernetes.io/empty-dir/749dcb9b-2b00-4353-9890-5b330007fbc0-tokenizer-uds\") pod \"stop-feature-test-kserve-router-scheduler-f99b6c6cb-dqm2b\" (UID: \"749dcb9b-2b00-4353-9890-5b330007fbc0\") " pod="kserve-ci-e2e-test/stop-feature-test-kserve-router-scheduler-f99b6c6cb-dqm2b"
May 25 11:47:17.737579 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:47:17.737548    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tokenizer-tmp\" (UniqueName: \"kubernetes.io/empty-dir/749dcb9b-2b00-4353-9890-5b330007fbc0-tokenizer-tmp\") pod \"stop-feature-test-kserve-router-scheduler-f99b6c6cb-dqm2b\" (UID: \"749dcb9b-2b00-4353-9890-5b330007fbc0\") " pod="kserve-ci-e2e-test/stop-feature-test-kserve-router-scheduler-f99b6c6cb-dqm2b"
May 25 11:47:17.838540 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:47:17.838511    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tokenizer-tmp\" (UniqueName: \"kubernetes.io/empty-dir/749dcb9b-2b00-4353-9890-5b330007fbc0-tokenizer-tmp\") pod \"stop-feature-test-kserve-router-scheduler-f99b6c6cb-dqm2b\" (UID: \"749dcb9b-2b00-4353-9890-5b330007fbc0\") " pod="kserve-ci-e2e-test/stop-feature-test-kserve-router-scheduler-f99b6c6cb-dqm2b"
May 25 11:47:17.838730 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:47:17.838560    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-kngmf\" (UniqueName: \"kubernetes.io/projected/749dcb9b-2b00-4353-9890-5b330007fbc0-kube-api-access-kngmf\") pod \"stop-feature-test-kserve-router-scheduler-f99b6c6cb-dqm2b\" (UID: \"749dcb9b-2b00-4353-9890-5b330007fbc0\") " pod="kserve-ci-e2e-test/stop-feature-test-kserve-router-scheduler-f99b6c6cb-dqm2b"
May 25 11:47:17.838730 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:47:17.838608    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/749dcb9b-2b00-4353-9890-5b330007fbc0-kserve-provision-location\") pod \"stop-feature-test-kserve-router-scheduler-f99b6c6cb-dqm2b\" (UID: \"749dcb9b-2b00-4353-9890-5b330007fbc0\") " pod="kserve-ci-e2e-test/stop-feature-test-kserve-router-scheduler-f99b6c6cb-dqm2b"
May 25 11:47:17.838730 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:47:17.838639    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/749dcb9b-2b00-4353-9890-5b330007fbc0-tls-certs\") pod \"stop-feature-test-kserve-router-scheduler-f99b6c6cb-dqm2b\" (UID: \"749dcb9b-2b00-4353-9890-5b330007fbc0\") " pod="kserve-ci-e2e-test/stop-feature-test-kserve-router-scheduler-f99b6c6cb-dqm2b"
May 25 11:47:17.838730 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:47:17.838720    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tokenizer-cache\" (UniqueName: \"kubernetes.io/empty-dir/749dcb9b-2b00-4353-9890-5b330007fbc0-tokenizer-cache\") pod \"stop-feature-test-kserve-router-scheduler-f99b6c6cb-dqm2b\" (UID: \"749dcb9b-2b00-4353-9890-5b330007fbc0\") " pod="kserve-ci-e2e-test/stop-feature-test-kserve-router-scheduler-f99b6c6cb-dqm2b"
May 25 11:47:17.838985 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:47:17.838780    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tokenizer-uds\" (UniqueName: \"kubernetes.io/empty-dir/749dcb9b-2b00-4353-9890-5b330007fbc0-tokenizer-uds\") pod \"stop-feature-test-kserve-router-scheduler-f99b6c6cb-dqm2b\" (UID: \"749dcb9b-2b00-4353-9890-5b330007fbc0\") " pod="kserve-ci-e2e-test/stop-feature-test-kserve-router-scheduler-f99b6c6cb-dqm2b"
May 25 11:47:17.838985 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:47:17.838930    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tokenizer-tmp\" (UniqueName: \"kubernetes.io/empty-dir/749dcb9b-2b00-4353-9890-5b330007fbc0-tokenizer-tmp\") pod \"stop-feature-test-kserve-router-scheduler-f99b6c6cb-dqm2b\" (UID: \"749dcb9b-2b00-4353-9890-5b330007fbc0\") " pod="kserve-ci-e2e-test/stop-feature-test-kserve-router-scheduler-f99b6c6cb-dqm2b"
May 25 11:47:17.839089 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:47:17.839004    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/749dcb9b-2b00-4353-9890-5b330007fbc0-kserve-provision-location\") pod \"stop-feature-test-kserve-router-scheduler-f99b6c6cb-dqm2b\" (UID: \"749dcb9b-2b00-4353-9890-5b330007fbc0\") " pod="kserve-ci-e2e-test/stop-feature-test-kserve-router-scheduler-f99b6c6cb-dqm2b"
May 25 11:47:17.839149 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:47:17.839116    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tokenizer-cache\" (UniqueName: \"kubernetes.io/empty-dir/749dcb9b-2b00-4353-9890-5b330007fbc0-tokenizer-cache\") pod \"stop-feature-test-kserve-router-scheduler-f99b6c6cb-dqm2b\" (UID: \"749dcb9b-2b00-4353-9890-5b330007fbc0\") " pod="kserve-ci-e2e-test/stop-feature-test-kserve-router-scheduler-f99b6c6cb-dqm2b"
May 25 11:47:17.839200 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:47:17.839155    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tokenizer-uds\" (UniqueName: \"kubernetes.io/empty-dir/749dcb9b-2b00-4353-9890-5b330007fbc0-tokenizer-uds\") pod \"stop-feature-test-kserve-router-scheduler-f99b6c6cb-dqm2b\" (UID: \"749dcb9b-2b00-4353-9890-5b330007fbc0\") " pod="kserve-ci-e2e-test/stop-feature-test-kserve-router-scheduler-f99b6c6cb-dqm2b"
May 25 11:47:17.841140 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:47:17.841113    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/749dcb9b-2b00-4353-9890-5b330007fbc0-tls-certs\") pod \"stop-feature-test-kserve-router-scheduler-f99b6c6cb-dqm2b\" (UID: \"749dcb9b-2b00-4353-9890-5b330007fbc0\") " pod="kserve-ci-e2e-test/stop-feature-test-kserve-router-scheduler-f99b6c6cb-dqm2b"
May 25 11:47:17.854233 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:47:17.854210    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kngmf\" (UniqueName: \"kubernetes.io/projected/749dcb9b-2b00-4353-9890-5b330007fbc0-kube-api-access-kngmf\") pod \"stop-feature-test-kserve-router-scheduler-f99b6c6cb-dqm2b\" (UID: \"749dcb9b-2b00-4353-9890-5b330007fbc0\") " pod="kserve-ci-e2e-test/stop-feature-test-kserve-router-scheduler-f99b6c6cb-dqm2b"
May 25 11:47:17.949089 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:47:17.949005    2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/stop-feature-test-kserve-router-scheduler-f99b6c6cb-dqm2b"
May 25 11:47:18.087512 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:47:18.087483    2569 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/stop-feature-test-kserve-router-scheduler-f99b6c6cb-dqm2b"]
May 25 11:47:18.089574 ip-10-0-143-46 kubenswrapper[2569]: W0525 11:47:18.089534    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod749dcb9b_2b00_4353_9890_5b330007fbc0.slice/crio-a23e7ecec068d0ea465c7715a8b9b7e3fb0fecb12ffa28b587449d3b54d34dba WatchSource:0}: Error finding container a23e7ecec068d0ea465c7715a8b9b7e3fb0fecb12ffa28b587449d3b54d34dba: Status 404 returned error can't find the container with id a23e7ecec068d0ea465c7715a8b9b7e3fb0fecb12ffa28b587449d3b54d34dba
May 25 11:47:18.897628 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:47:18.897598    2569 generic.go:358] "Generic (PLEG): container finished" podID="749dcb9b-2b00-4353-9890-5b330007fbc0" containerID="032afb36866da0af73eb022722bf5a7cd9e0572005a2456fc82f3fb72b264715" exitCode=0
May 25 11:47:18.897946 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:47:18.897644    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/stop-feature-test-kserve-router-scheduler-f99b6c6cb-dqm2b" event={"ID":"749dcb9b-2b00-4353-9890-5b330007fbc0","Type":"ContainerDied","Data":"032afb36866da0af73eb022722bf5a7cd9e0572005a2456fc82f3fb72b264715"}
May 25 11:47:18.897946 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:47:18.897686    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/stop-feature-test-kserve-router-scheduler-f99b6c6cb-dqm2b" event={"ID":"749dcb9b-2b00-4353-9890-5b330007fbc0","Type":"ContainerStarted","Data":"a23e7ecec068d0ea465c7715a8b9b7e3fb0fecb12ffa28b587449d3b54d34dba"}
May 25 11:47:19.904114 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:47:19.904076    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/stop-feature-test-kserve-router-scheduler-f99b6c6cb-dqm2b" event={"ID":"749dcb9b-2b00-4353-9890-5b330007fbc0","Type":"ContainerStarted","Data":"38faf64c68f30df0e875e7558c63f3eeafb4b843f9426318c97e3ef09790f5e6"}
May 25 11:47:19.904114 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:47:19.904118    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/stop-feature-test-kserve-router-scheduler-f99b6c6cb-dqm2b" event={"ID":"749dcb9b-2b00-4353-9890-5b330007fbc0","Type":"ContainerStarted","Data":"a50269df01d89fa4eebeaec11aef1e0be760cb6cce7bb6d7b93e1bb46ed18d3a"}
May 25 11:47:19.904649 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:47:19.904218    2569 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/stop-feature-test-kserve-router-scheduler-f99b6c6cb-dqm2b"
May 25 11:47:19.927743 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:47:19.927699    2569 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kserve-ci-e2e-test/stop-feature-test-kserve-router-scheduler-f99b6c6cb-dqm2b" podStartSLOduration=2.927685102 podStartE2EDuration="2.927685102s" podCreationTimestamp="2026-05-25 11:47:17 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-25 11:47:19.925070742 +0000 UTC m=+1778.786695126" watchObservedRunningTime="2026-05-25 11:47:19.927685102 +0000 UTC m=+1778.789309519"
May 25 11:47:27.949270 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:47:27.949238    2569 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kserve-ci-e2e-test/stop-feature-test-kserve-router-scheduler-f99b6c6cb-dqm2b"
May 25 11:47:27.949762 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:47:27.949279    2569 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/stop-feature-test-kserve-router-scheduler-f99b6c6cb-dqm2b"
May 25 11:47:27.951672 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:47:27.951650    2569 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="kserve-ci-e2e-test/stop-feature-test-kserve-router-scheduler-f99b6c6cb-dqm2b"
May 25 11:47:28.943979 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:47:28.943952    2569 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/stop-feature-test-kserve-router-scheduler-f99b6c6cb-dqm2b"
May 25 11:47:41.738978 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:47:41.738954    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-cvhbj_9ff9f77a-ac83-4250-8c40-d14a2db84c1e/console-operator/2.log"
May 25 11:47:41.747702 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:47:41.747680    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-cvhbj_9ff9f77a-ac83-4250-8c40-d14a2db84c1e/console-operator/2.log"
May 25 11:47:49.947839 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:47:49.947802    2569 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/stop-feature-test-kserve-router-scheduler-f99b6c6cb-dqm2b"
May 25 11:50:08.858192 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:50:08.858157    2569 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/stop-feature-test-kserve-router-scheduler-f99b6c6cb-dqm2b"]
May 25 11:50:08.858650 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:50:08.858553    2569 kuberuntime_container.go:864] "Killing container with a grace period" pod="kserve-ci-e2e-test/stop-feature-test-kserve-router-scheduler-f99b6c6cb-dqm2b" podUID="749dcb9b-2b00-4353-9890-5b330007fbc0" containerName="main" containerID="cri-o://a50269df01d89fa4eebeaec11aef1e0be760cb6cce7bb6d7b93e1bb46ed18d3a" gracePeriod=30
May 25 11:50:08.858716 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:50:08.858642    2569 kuberuntime_container.go:864] "Killing container with a grace period" pod="kserve-ci-e2e-test/stop-feature-test-kserve-router-scheduler-f99b6c6cb-dqm2b" podUID="749dcb9b-2b00-4353-9890-5b330007fbc0" containerName="tokenizer" containerID="cri-o://38faf64c68f30df0e875e7558c63f3eeafb4b843f9426318c97e3ef09790f5e6" gracePeriod=30
May 25 11:50:08.943534 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:50:08.943496    2569 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/stop-feature-test-kserve-router-scheduler-f99b6c6cb-dqm2b" podUID="749dcb9b-2b00-4353-9890-5b330007fbc0" containerName="tokenizer" probeResult="failure" output="Get \"http://10.134.0.44:8082/healthz\": dial tcp 10.134.0.44:8082: connect: connection refused"
May 25 11:50:09.519728 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:50:09.519692    2569 generic.go:358] "Generic (PLEG): container finished" podID="749dcb9b-2b00-4353-9890-5b330007fbc0" containerID="a50269df01d89fa4eebeaec11aef1e0be760cb6cce7bb6d7b93e1bb46ed18d3a" exitCode=0
May 25 11:50:09.519728 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:50:09.519718    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/stop-feature-test-kserve-router-scheduler-f99b6c6cb-dqm2b" event={"ID":"749dcb9b-2b00-4353-9890-5b330007fbc0","Type":"ContainerDied","Data":"a50269df01d89fa4eebeaec11aef1e0be760cb6cce7bb6d7b93e1bb46ed18d3a"}
May 25 11:50:10.012066 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:50:10.012046    2569 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/stop-feature-test-kserve-router-scheduler-f99b6c6cb-dqm2b"
May 25 11:50:10.141015 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:50:10.140943    2569 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/749dcb9b-2b00-4353-9890-5b330007fbc0-kserve-provision-location\") pod \"749dcb9b-2b00-4353-9890-5b330007fbc0\" (UID: \"749dcb9b-2b00-4353-9890-5b330007fbc0\") "
May 25 11:50:10.141015 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:50:10.140984    2569 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/749dcb9b-2b00-4353-9890-5b330007fbc0-tls-certs\") pod \"749dcb9b-2b00-4353-9890-5b330007fbc0\" (UID: \"749dcb9b-2b00-4353-9890-5b330007fbc0\") "
May 25 11:50:10.141015 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:50:10.141005    2569 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"tokenizer-cache\" (UniqueName: \"kubernetes.io/empty-dir/749dcb9b-2b00-4353-9890-5b330007fbc0-tokenizer-cache\") pod \"749dcb9b-2b00-4353-9890-5b330007fbc0\" (UID: \"749dcb9b-2b00-4353-9890-5b330007fbc0\") "
May 25 11:50:10.141210 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:50:10.141140    2569 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"tokenizer-tmp\" (UniqueName: \"kubernetes.io/empty-dir/749dcb9b-2b00-4353-9890-5b330007fbc0-tokenizer-tmp\") pod \"749dcb9b-2b00-4353-9890-5b330007fbc0\" (UID: \"749dcb9b-2b00-4353-9890-5b330007fbc0\") "
May 25 11:50:10.141210 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:50:10.141182    2569 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kngmf\" (UniqueName: \"kubernetes.io/projected/749dcb9b-2b00-4353-9890-5b330007fbc0-kube-api-access-kngmf\") pod \"749dcb9b-2b00-4353-9890-5b330007fbc0\" (UID: \"749dcb9b-2b00-4353-9890-5b330007fbc0\") "
May 25 11:50:10.141274 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:50:10.141225    2569 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"tokenizer-uds\" (UniqueName: \"kubernetes.io/empty-dir/749dcb9b-2b00-4353-9890-5b330007fbc0-tokenizer-uds\") pod \"749dcb9b-2b00-4353-9890-5b330007fbc0\" (UID: \"749dcb9b-2b00-4353-9890-5b330007fbc0\") "
May 25 11:50:10.141274 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:50:10.141253    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/749dcb9b-2b00-4353-9890-5b330007fbc0-tokenizer-cache" (OuterVolumeSpecName: "tokenizer-cache") pod "749dcb9b-2b00-4353-9890-5b330007fbc0" (UID: "749dcb9b-2b00-4353-9890-5b330007fbc0"). InnerVolumeSpecName "tokenizer-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 25 11:50:10.141466 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:50:10.141441    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/749dcb9b-2b00-4353-9890-5b330007fbc0-tokenizer-tmp" (OuterVolumeSpecName: "tokenizer-tmp") pod "749dcb9b-2b00-4353-9890-5b330007fbc0" (UID: "749dcb9b-2b00-4353-9890-5b330007fbc0"). InnerVolumeSpecName "tokenizer-tmp". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 25 11:50:10.141600 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:50:10.141547    2569 reconciler_common.go:299] "Volume detached for volume \"tokenizer-tmp\" (UniqueName: \"kubernetes.io/empty-dir/749dcb9b-2b00-4353-9890-5b330007fbc0-tokenizer-tmp\") on node \"ip-10-0-143-46.ec2.internal\" DevicePath \"\""
May 25 11:50:10.141600 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:50:10.141565    2569 reconciler_common.go:299] "Volume detached for volume \"tokenizer-cache\" (UniqueName: \"kubernetes.io/empty-dir/749dcb9b-2b00-4353-9890-5b330007fbc0-tokenizer-cache\") on node \"ip-10-0-143-46.ec2.internal\" DevicePath \"\""
May 25 11:50:10.141600 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:50:10.141575    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/749dcb9b-2b00-4353-9890-5b330007fbc0-tokenizer-uds" (OuterVolumeSpecName: "tokenizer-uds") pod "749dcb9b-2b00-4353-9890-5b330007fbc0" (UID: "749dcb9b-2b00-4353-9890-5b330007fbc0"). InnerVolumeSpecName "tokenizer-uds". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 25 11:50:10.141849 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:50:10.141829    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/749dcb9b-2b00-4353-9890-5b330007fbc0-kserve-provision-location" (OuterVolumeSpecName: "kserve-provision-location") pod "749dcb9b-2b00-4353-9890-5b330007fbc0" (UID: "749dcb9b-2b00-4353-9890-5b330007fbc0"). InnerVolumeSpecName "kserve-provision-location". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 25 11:50:10.143193 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:50:10.143175    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/749dcb9b-2b00-4353-9890-5b330007fbc0-kube-api-access-kngmf" (OuterVolumeSpecName: "kube-api-access-kngmf") pod "749dcb9b-2b00-4353-9890-5b330007fbc0" (UID: "749dcb9b-2b00-4353-9890-5b330007fbc0"). InnerVolumeSpecName "kube-api-access-kngmf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 25 11:50:10.143243 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:50:10.143210    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/749dcb9b-2b00-4353-9890-5b330007fbc0-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "749dcb9b-2b00-4353-9890-5b330007fbc0" (UID: "749dcb9b-2b00-4353-9890-5b330007fbc0"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 25 11:50:10.242266 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:50:10.242240    2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kngmf\" (UniqueName: \"kubernetes.io/projected/749dcb9b-2b00-4353-9890-5b330007fbc0-kube-api-access-kngmf\") on node \"ip-10-0-143-46.ec2.internal\" DevicePath \"\""
May 25 11:50:10.242266 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:50:10.242264    2569 reconciler_common.go:299] "Volume detached for volume \"tokenizer-uds\" (UniqueName: \"kubernetes.io/empty-dir/749dcb9b-2b00-4353-9890-5b330007fbc0-tokenizer-uds\") on node \"ip-10-0-143-46.ec2.internal\" DevicePath \"\""
May 25 11:50:10.242414 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:50:10.242274    2569 reconciler_common.go:299] "Volume detached for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/749dcb9b-2b00-4353-9890-5b330007fbc0-kserve-provision-location\") on node \"ip-10-0-143-46.ec2.internal\" DevicePath \"\""
May 25 11:50:10.242414 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:50:10.242284    2569 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/749dcb9b-2b00-4353-9890-5b330007fbc0-tls-certs\") on node \"ip-10-0-143-46.ec2.internal\" DevicePath \"\""
May 25 11:50:10.524875 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:50:10.524776    2569 generic.go:358] "Generic (PLEG): container finished" podID="749dcb9b-2b00-4353-9890-5b330007fbc0" containerID="38faf64c68f30df0e875e7558c63f3eeafb4b843f9426318c97e3ef09790f5e6" exitCode=0
May 25 11:50:10.524875 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:50:10.524822    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/stop-feature-test-kserve-router-scheduler-f99b6c6cb-dqm2b" event={"ID":"749dcb9b-2b00-4353-9890-5b330007fbc0","Type":"ContainerDied","Data":"38faf64c68f30df0e875e7558c63f3eeafb4b843f9426318c97e3ef09790f5e6"}
May 25 11:50:10.524875 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:50:10.524867    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/stop-feature-test-kserve-router-scheduler-f99b6c6cb-dqm2b" event={"ID":"749dcb9b-2b00-4353-9890-5b330007fbc0","Type":"ContainerDied","Data":"a23e7ecec068d0ea465c7715a8b9b7e3fb0fecb12ffa28b587449d3b54d34dba"}
May 25 11:50:10.524875 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:50:10.524869    2569 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/stop-feature-test-kserve-router-scheduler-f99b6c6cb-dqm2b"
May 25 11:50:10.525147 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:50:10.524935    2569 scope.go:117] "RemoveContainer" containerID="38faf64c68f30df0e875e7558c63f3eeafb4b843f9426318c97e3ef09790f5e6"
May 25 11:50:10.533709 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:50:10.533678    2569 scope.go:117] "RemoveContainer" containerID="a50269df01d89fa4eebeaec11aef1e0be760cb6cce7bb6d7b93e1bb46ed18d3a"
May 25 11:50:10.540717 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:50:10.540696    2569 scope.go:117] "RemoveContainer" containerID="032afb36866da0af73eb022722bf5a7cd9e0572005a2456fc82f3fb72b264715"
May 25 11:50:10.548070 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:50:10.548050    2569 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/stop-feature-test-kserve-router-scheduler-f99b6c6cb-dqm2b"]
May 25 11:50:10.548245 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:50:10.548231    2569 scope.go:117] "RemoveContainer" containerID="38faf64c68f30df0e875e7558c63f3eeafb4b843f9426318c97e3ef09790f5e6"
May 25 11:50:10.548492 ip-10-0-143-46 kubenswrapper[2569]: E0525 11:50:10.548474    2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"38faf64c68f30df0e875e7558c63f3eeafb4b843f9426318c97e3ef09790f5e6\": container with ID starting with 38faf64c68f30df0e875e7558c63f3eeafb4b843f9426318c97e3ef09790f5e6 not found: ID does not exist" containerID="38faf64c68f30df0e875e7558c63f3eeafb4b843f9426318c97e3ef09790f5e6"
May 25 11:50:10.548571 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:50:10.548503    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"38faf64c68f30df0e875e7558c63f3eeafb4b843f9426318c97e3ef09790f5e6"} err="failed to get container status \"38faf64c68f30df0e875e7558c63f3eeafb4b843f9426318c97e3ef09790f5e6\": rpc error: code = NotFound desc = could not find container \"38faf64c68f30df0e875e7558c63f3eeafb4b843f9426318c97e3ef09790f5e6\": container with ID starting with 38faf64c68f30df0e875e7558c63f3eeafb4b843f9426318c97e3ef09790f5e6 not found: ID does not exist"
May 25 11:50:10.548571 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:50:10.548526    2569 scope.go:117] "RemoveContainer" containerID="a50269df01d89fa4eebeaec11aef1e0be760cb6cce7bb6d7b93e1bb46ed18d3a"
May 25 11:50:10.548855 ip-10-0-143-46 kubenswrapper[2569]: E0525 11:50:10.548770    2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a50269df01d89fa4eebeaec11aef1e0be760cb6cce7bb6d7b93e1bb46ed18d3a\": container with ID starting with a50269df01d89fa4eebeaec11aef1e0be760cb6cce7bb6d7b93e1bb46ed18d3a not found: ID does not exist" containerID="a50269df01d89fa4eebeaec11aef1e0be760cb6cce7bb6d7b93e1bb46ed18d3a"
May 25 11:50:10.548855 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:50:10.548815    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a50269df01d89fa4eebeaec11aef1e0be760cb6cce7bb6d7b93e1bb46ed18d3a"} err="failed to get container status \"a50269df01d89fa4eebeaec11aef1e0be760cb6cce7bb6d7b93e1bb46ed18d3a\": rpc error: code = NotFound desc = could not find container \"a50269df01d89fa4eebeaec11aef1e0be760cb6cce7bb6d7b93e1bb46ed18d3a\": container with ID starting with a50269df01d89fa4eebeaec11aef1e0be760cb6cce7bb6d7b93e1bb46ed18d3a not found: ID does not exist"
May 25 11:50:10.548855 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:50:10.548836    2569 scope.go:117] "RemoveContainer" containerID="032afb36866da0af73eb022722bf5a7cd9e0572005a2456fc82f3fb72b264715"
May 25 11:50:10.549119 ip-10-0-143-46 kubenswrapper[2569]: E0525 11:50:10.549096    2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"032afb36866da0af73eb022722bf5a7cd9e0572005a2456fc82f3fb72b264715\": container with ID starting with 032afb36866da0af73eb022722bf5a7cd9e0572005a2456fc82f3fb72b264715 not found: ID does not exist" containerID="032afb36866da0af73eb022722bf5a7cd9e0572005a2456fc82f3fb72b264715"
May 25 11:50:10.549241 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:50:10.549124    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"032afb36866da0af73eb022722bf5a7cd9e0572005a2456fc82f3fb72b264715"} err="failed to get container status \"032afb36866da0af73eb022722bf5a7cd9e0572005a2456fc82f3fb72b264715\": rpc error: code = NotFound desc = could not find container \"032afb36866da0af73eb022722bf5a7cd9e0572005a2456fc82f3fb72b264715\": container with ID starting with 032afb36866da0af73eb022722bf5a7cd9e0572005a2456fc82f3fb72b264715 not found: ID does not exist"
May 25 11:50:10.551273 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:50:10.551253    2569 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/stop-feature-test-kserve-router-scheduler-f99b6c6cb-dqm2b"]
May 25 11:50:10.948115 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:50:10.948074    2569 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/stop-feature-test-kserve-router-scheduler-f99b6c6cb-dqm2b" podUID="749dcb9b-2b00-4353-9890-5b330007fbc0" containerName="main" probeResult="failure" output="timeout: failed to connect service \"10.134.0.44:9003\" within 1s: context deadline exceeded"
May 25 11:50:10.948278 ip-10-0-143-46 kubenswrapper[2569]: W0525 11:50:10.948143    2569 logging.go:55] [core] [Channel #119 SubChannel #120]grpc: addrConn.createTransport failed to connect to {Addr: "10.134.0.44:9003", ServerName: "10.134.0.44:9003", }. Err: connection error: desc = "transport: Error while dialing: dial tcp 10.134.0.44:9003: operation was canceled"
May 25 11:50:11.730096 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:50:11.730060    2569 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="749dcb9b-2b00-4353-9890-5b330007fbc0" path="/var/lib/kubelet/pods/749dcb9b-2b00-4353-9890-5b330007fbc0/volumes"
May 25 11:50:18.822895 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:50:18.822866    2569 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/stop-feature-test-kserve-router-scheduler-f99b6c6cb-9c2fq"]
May 25 11:50:18.823269 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:50:18.823239    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="749dcb9b-2b00-4353-9890-5b330007fbc0" containerName="storage-initializer"
May 25 11:50:18.823269 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:50:18.823252    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="749dcb9b-2b00-4353-9890-5b330007fbc0" containerName="storage-initializer"
May 25 11:50:18.823339 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:50:18.823273    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="749dcb9b-2b00-4353-9890-5b330007fbc0" containerName="main"
May 25 11:50:18.823339 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:50:18.823283    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="749dcb9b-2b00-4353-9890-5b330007fbc0" containerName="main"
May 25 11:50:18.823339 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:50:18.823291    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="749dcb9b-2b00-4353-9890-5b330007fbc0" containerName="tokenizer"
May 25 11:50:18.823339 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:50:18.823296    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="749dcb9b-2b00-4353-9890-5b330007fbc0" containerName="tokenizer"
May 25 11:50:18.823454 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:50:18.823357    2569 memory_manager.go:356] "RemoveStaleState removing state" podUID="749dcb9b-2b00-4353-9890-5b330007fbc0" containerName="main"
May 25 11:50:18.823454 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:50:18.823367    2569 memory_manager.go:356] "RemoveStaleState removing state" podUID="749dcb9b-2b00-4353-9890-5b330007fbc0" containerName="tokenizer"
May 25 11:50:18.826920 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:50:18.826900    2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/stop-feature-test-kserve-router-scheduler-f99b6c6cb-9c2fq"
May 25 11:50:18.831774 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:50:18.831746    2569 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"default-dockercfg-5cxfn\""
May 25 11:50:18.831774 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:50:18.831746    2569 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"stop-feature-test-epp-sa-dockercfg-6t8gj\""
May 25 11:50:18.832728 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:50:18.832709    2569 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"stop-feature-test-kserve-self-signed-certs\""
May 25 11:50:18.839647 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:50:18.839625    2569 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/stop-feature-test-kserve-router-scheduler-f99b6c6cb-9c2fq"]
May 25 11:50:18.917393 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:50:18.917367    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tokenizer-tmp\" (UniqueName: \"kubernetes.io/empty-dir/d7213419-6653-4e19-bfa6-86011a18fb49-tokenizer-tmp\") pod \"stop-feature-test-kserve-router-scheduler-f99b6c6cb-9c2fq\" (UID: \"d7213419-6653-4e19-bfa6-86011a18fb49\") " pod="kserve-ci-e2e-test/stop-feature-test-kserve-router-scheduler-f99b6c6cb-9c2fq"
May 25 11:50:18.917512 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:50:18.917403    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tokenizer-cache\" (UniqueName: \"kubernetes.io/empty-dir/d7213419-6653-4e19-bfa6-86011a18fb49-tokenizer-cache\") pod \"stop-feature-test-kserve-router-scheduler-f99b6c6cb-9c2fq\" (UID: \"d7213419-6653-4e19-bfa6-86011a18fb49\") " pod="kserve-ci-e2e-test/stop-feature-test-kserve-router-scheduler-f99b6c6cb-9c2fq"
May 25 11:50:18.917512 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:50:18.917507    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d7213419-6653-4e19-bfa6-86011a18fb49-tls-certs\") pod \"stop-feature-test-kserve-router-scheduler-f99b6c6cb-9c2fq\" (UID: \"d7213419-6653-4e19-bfa6-86011a18fb49\") " pod="kserve-ci-e2e-test/stop-feature-test-kserve-router-scheduler-f99b6c6cb-9c2fq"
May 25 11:50:18.917583 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:50:18.917530    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/d7213419-6653-4e19-bfa6-86011a18fb49-kserve-provision-location\") pod \"stop-feature-test-kserve-router-scheduler-f99b6c6cb-9c2fq\" (UID: \"d7213419-6653-4e19-bfa6-86011a18fb49\") " pod="kserve-ci-e2e-test/stop-feature-test-kserve-router-scheduler-f99b6c6cb-9c2fq"
May 25 11:50:18.917653 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:50:18.917633    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bb7kx\" (UniqueName: \"kubernetes.io/projected/d7213419-6653-4e19-bfa6-86011a18fb49-kube-api-access-bb7kx\") pod \"stop-feature-test-kserve-router-scheduler-f99b6c6cb-9c2fq\" (UID: \"d7213419-6653-4e19-bfa6-86011a18fb49\") " pod="kserve-ci-e2e-test/stop-feature-test-kserve-router-scheduler-f99b6c6cb-9c2fq"
May 25 11:50:18.917692 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:50:18.917674    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tokenizer-uds\" (UniqueName: \"kubernetes.io/empty-dir/d7213419-6653-4e19-bfa6-86011a18fb49-tokenizer-uds\") pod \"stop-feature-test-kserve-router-scheduler-f99b6c6cb-9c2fq\" (UID: \"d7213419-6653-4e19-bfa6-86011a18fb49\") " pod="kserve-ci-e2e-test/stop-feature-test-kserve-router-scheduler-f99b6c6cb-9c2fq"
May 25 11:50:19.018819 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:50:19.018773    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-bb7kx\" (UniqueName: \"kubernetes.io/projected/d7213419-6653-4e19-bfa6-86011a18fb49-kube-api-access-bb7kx\") pod \"stop-feature-test-kserve-router-scheduler-f99b6c6cb-9c2fq\" (UID: \"d7213419-6653-4e19-bfa6-86011a18fb49\") " pod="kserve-ci-e2e-test/stop-feature-test-kserve-router-scheduler-f99b6c6cb-9c2fq"
May 25 11:50:19.018950 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:50:19.018843    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tokenizer-uds\" (UniqueName: \"kubernetes.io/empty-dir/d7213419-6653-4e19-bfa6-86011a18fb49-tokenizer-uds\") pod \"stop-feature-test-kserve-router-scheduler-f99b6c6cb-9c2fq\" (UID: \"d7213419-6653-4e19-bfa6-86011a18fb49\") " pod="kserve-ci-e2e-test/stop-feature-test-kserve-router-scheduler-f99b6c6cb-9c2fq"
May 25 11:50:19.018950 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:50:19.018878    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tokenizer-tmp\" (UniqueName: \"kubernetes.io/empty-dir/d7213419-6653-4e19-bfa6-86011a18fb49-tokenizer-tmp\") pod \"stop-feature-test-kserve-router-scheduler-f99b6c6cb-9c2fq\" (UID: \"d7213419-6653-4e19-bfa6-86011a18fb49\") " pod="kserve-ci-e2e-test/stop-feature-test-kserve-router-scheduler-f99b6c6cb-9c2fq"
May 25 11:50:19.018950 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:50:19.018906    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tokenizer-cache\" (UniqueName: \"kubernetes.io/empty-dir/d7213419-6653-4e19-bfa6-86011a18fb49-tokenizer-cache\") pod \"stop-feature-test-kserve-router-scheduler-f99b6c6cb-9c2fq\" (UID: \"d7213419-6653-4e19-bfa6-86011a18fb49\") " pod="kserve-ci-e2e-test/stop-feature-test-kserve-router-scheduler-f99b6c6cb-9c2fq"
May 25 11:50:19.019109 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:50:19.018961    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d7213419-6653-4e19-bfa6-86011a18fb49-tls-certs\") pod \"stop-feature-test-kserve-router-scheduler-f99b6c6cb-9c2fq\" (UID: \"d7213419-6653-4e19-bfa6-86011a18fb49\") " pod="kserve-ci-e2e-test/stop-feature-test-kserve-router-scheduler-f99b6c6cb-9c2fq"
May 25 11:50:19.019109 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:50:19.018988    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/d7213419-6653-4e19-bfa6-86011a18fb49-kserve-provision-location\") pod \"stop-feature-test-kserve-router-scheduler-f99b6c6cb-9c2fq\" (UID: \"d7213419-6653-4e19-bfa6-86011a18fb49\") " pod="kserve-ci-e2e-test/stop-feature-test-kserve-router-scheduler-f99b6c6cb-9c2fq"
May 25 11:50:19.019323 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:50:19.019296    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tokenizer-uds\" (UniqueName: \"kubernetes.io/empty-dir/d7213419-6653-4e19-bfa6-86011a18fb49-tokenizer-uds\") pod \"stop-feature-test-kserve-router-scheduler-f99b6c6cb-9c2fq\" (UID: \"d7213419-6653-4e19-bfa6-86011a18fb49\") " pod="kserve-ci-e2e-test/stop-feature-test-kserve-router-scheduler-f99b6c6cb-9c2fq"
May 25 11:50:19.019419 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:50:19.019322    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tokenizer-tmp\" (UniqueName: \"kubernetes.io/empty-dir/d7213419-6653-4e19-bfa6-86011a18fb49-tokenizer-tmp\") pod \"stop-feature-test-kserve-router-scheduler-f99b6c6cb-9c2fq\" (UID: \"d7213419-6653-4e19-bfa6-86011a18fb49\") " pod="kserve-ci-e2e-test/stop-feature-test-kserve-router-scheduler-f99b6c6cb-9c2fq"
May 25 11:50:19.019419 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:50:19.019366    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tokenizer-cache\" (UniqueName: \"kubernetes.io/empty-dir/d7213419-6653-4e19-bfa6-86011a18fb49-tokenizer-cache\") pod \"stop-feature-test-kserve-router-scheduler-f99b6c6cb-9c2fq\" (UID: \"d7213419-6653-4e19-bfa6-86011a18fb49\") " pod="kserve-ci-e2e-test/stop-feature-test-kserve-router-scheduler-f99b6c6cb-9c2fq"
May 25 11:50:19.019419 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:50:19.019395    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/d7213419-6653-4e19-bfa6-86011a18fb49-kserve-provision-location\") pod \"stop-feature-test-kserve-router-scheduler-f99b6c6cb-9c2fq\" (UID: \"d7213419-6653-4e19-bfa6-86011a18fb49\") " pod="kserve-ci-e2e-test/stop-feature-test-kserve-router-scheduler-f99b6c6cb-9c2fq"
May 25 11:50:19.021341 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:50:19.021321    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d7213419-6653-4e19-bfa6-86011a18fb49-tls-certs\") pod \"stop-feature-test-kserve-router-scheduler-f99b6c6cb-9c2fq\" (UID: \"d7213419-6653-4e19-bfa6-86011a18fb49\") " pod="kserve-ci-e2e-test/stop-feature-test-kserve-router-scheduler-f99b6c6cb-9c2fq"
May 25 11:50:19.027163 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:50:19.027141    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bb7kx\" (UniqueName: \"kubernetes.io/projected/d7213419-6653-4e19-bfa6-86011a18fb49-kube-api-access-bb7kx\") pod \"stop-feature-test-kserve-router-scheduler-f99b6c6cb-9c2fq\" (UID: \"d7213419-6653-4e19-bfa6-86011a18fb49\") " pod="kserve-ci-e2e-test/stop-feature-test-kserve-router-scheduler-f99b6c6cb-9c2fq"
May 25 11:50:19.136681 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:50:19.136614    2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/stop-feature-test-kserve-router-scheduler-f99b6c6cb-9c2fq"
May 25 11:50:19.269120 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:50:19.269095    2569 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/stop-feature-test-kserve-router-scheduler-f99b6c6cb-9c2fq"]
May 25 11:50:19.271981 ip-10-0-143-46 kubenswrapper[2569]: W0525 11:50:19.271940    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd7213419_6653_4e19_bfa6_86011a18fb49.slice/crio-f5a99d5b91bc7d4b9ea0a89fc52e6aa7607f150ab6b68c7b9bbb0686deafc618 WatchSource:0}: Error finding container f5a99d5b91bc7d4b9ea0a89fc52e6aa7607f150ab6b68c7b9bbb0686deafc618: Status 404 returned error can't find the container with id f5a99d5b91bc7d4b9ea0a89fc52e6aa7607f150ab6b68c7b9bbb0686deafc618
May 25 11:50:19.274236 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:50:19.274217    2569 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
May 25 11:50:19.557433 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:50:19.557400    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/stop-feature-test-kserve-router-scheduler-f99b6c6cb-9c2fq" event={"ID":"d7213419-6653-4e19-bfa6-86011a18fb49","Type":"ContainerStarted","Data":"4f6bb500944050cf663f33c7a194219b5eafb87783f2bcce21a914ada5a6a0b6"}
May 25 11:50:19.557624 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:50:19.557443    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/stop-feature-test-kserve-router-scheduler-f99b6c6cb-9c2fq" event={"ID":"d7213419-6653-4e19-bfa6-86011a18fb49","Type":"ContainerStarted","Data":"f5a99d5b91bc7d4b9ea0a89fc52e6aa7607f150ab6b68c7b9bbb0686deafc618"}
May 25 11:50:20.562454 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:50:20.562418    2569 generic.go:358] "Generic (PLEG): container finished" podID="d7213419-6653-4e19-bfa6-86011a18fb49" containerID="4f6bb500944050cf663f33c7a194219b5eafb87783f2bcce21a914ada5a6a0b6" exitCode=0
May 25 11:50:20.562877 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:50:20.562515    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/stop-feature-test-kserve-router-scheduler-f99b6c6cb-9c2fq" event={"ID":"d7213419-6653-4e19-bfa6-86011a18fb49","Type":"ContainerDied","Data":"4f6bb500944050cf663f33c7a194219b5eafb87783f2bcce21a914ada5a6a0b6"}
May 25 11:50:21.567726 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:50:21.567696    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/stop-feature-test-kserve-router-scheduler-f99b6c6cb-9c2fq" event={"ID":"d7213419-6653-4e19-bfa6-86011a18fb49","Type":"ContainerStarted","Data":"60cac1537122af1d5adcf4a061681f090be689e659c5c90282e3cbd32f53ae09"}
May 25 11:50:21.567726 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:50:21.567732    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/stop-feature-test-kserve-router-scheduler-f99b6c6cb-9c2fq" event={"ID":"d7213419-6653-4e19-bfa6-86011a18fb49","Type":"ContainerStarted","Data":"e4b20f739d6d20474da875b83f91f6a2a2b275ae130b9f49615f0e4ca78b3683"}
May 25 11:50:21.568196 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:50:21.567908    2569 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/stop-feature-test-kserve-router-scheduler-f99b6c6cb-9c2fq"
May 25 11:50:21.590266 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:50:21.590224    2569 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kserve-ci-e2e-test/stop-feature-test-kserve-router-scheduler-f99b6c6cb-9c2fq" podStartSLOduration=3.59020715 podStartE2EDuration="3.59020715s" podCreationTimestamp="2026-05-25 11:50:18 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-25 11:50:21.588720831 +0000 UTC m=+1960.450345216" watchObservedRunningTime="2026-05-25 11:50:21.59020715 +0000 UTC m=+1960.451831533"
May 25 11:50:29.137556 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:50:29.137475    2569 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kserve-ci-e2e-test/stop-feature-test-kserve-router-scheduler-f99b6c6cb-9c2fq"
May 25 11:50:29.137556 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:50:29.137519    2569 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/stop-feature-test-kserve-router-scheduler-f99b6c6cb-9c2fq"
May 25 11:50:29.139907 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:50:29.139882    2569 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="kserve-ci-e2e-test/stop-feature-test-kserve-router-scheduler-f99b6c6cb-9c2fq"
May 25 11:50:29.595584 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:50:29.595557    2569 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/stop-feature-test-kserve-router-scheduler-f99b6c6cb-9c2fq"
May 25 11:50:50.599345 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:50:50.599314    2569 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/stop-feature-test-kserve-router-scheduler-f99b6c6cb-9c2fq"
May 25 11:52:41.765926 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:52:41.765886    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-cvhbj_9ff9f77a-ac83-4250-8c40-d14a2db84c1e/console-operator/2.log"
May 25 11:52:41.772741 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:52:41.772720    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-cvhbj_9ff9f77a-ac83-4250-8c40-d14a2db84c1e/console-operator/2.log"
May 25 11:53:09.953087 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:53:09.953054    2569 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/stop-feature-test-kserve-router-scheduler-f99b6c6cb-9c2fq"]
May 25 11:53:09.953560 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:53:09.953465    2569 kuberuntime_container.go:864] "Killing container with a grace period" pod="kserve-ci-e2e-test/stop-feature-test-kserve-router-scheduler-f99b6c6cb-9c2fq" podUID="d7213419-6653-4e19-bfa6-86011a18fb49" containerName="main" containerID="cri-o://e4b20f739d6d20474da875b83f91f6a2a2b275ae130b9f49615f0e4ca78b3683" gracePeriod=30
May 25 11:53:09.953560 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:53:09.953502    2569 kuberuntime_container.go:864] "Killing container with a grace period" pod="kserve-ci-e2e-test/stop-feature-test-kserve-router-scheduler-f99b6c6cb-9c2fq" podUID="d7213419-6653-4e19-bfa6-86011a18fb49" containerName="tokenizer" containerID="cri-o://60cac1537122af1d5adcf4a061681f090be689e659c5c90282e3cbd32f53ae09" gracePeriod=30
May 25 11:53:10.151605 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:53:10.151571    2569 generic.go:358] "Generic (PLEG): container finished" podID="d7213419-6653-4e19-bfa6-86011a18fb49" containerID="e4b20f739d6d20474da875b83f91f6a2a2b275ae130b9f49615f0e4ca78b3683" exitCode=0
May 25 11:53:10.151755 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:53:10.151641    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/stop-feature-test-kserve-router-scheduler-f99b6c6cb-9c2fq" event={"ID":"d7213419-6653-4e19-bfa6-86011a18fb49","Type":"ContainerDied","Data":"e4b20f739d6d20474da875b83f91f6a2a2b275ae130b9f49615f0e4ca78b3683"}
May 25 11:53:10.598852 ip-10-0-143-46 kubenswrapper[2569]: W0525 11:53:10.598779    2569 logging.go:55] [core] [Channel #214 SubChannel #215]grpc: addrConn.createTransport failed to connect to {Addr: "10.134.0.45:9003", ServerName: "10.134.0.45:9003", }. Err: connection error: desc = "transport: Error while dialing: dial tcp 10.134.0.45:9003: connect: connection refused"
May 25 11:53:11.107490 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:53:11.107471    2569 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/stop-feature-test-kserve-router-scheduler-f99b6c6cb-9c2fq"
May 25 11:53:11.156741 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:53:11.156710    2569 generic.go:358] "Generic (PLEG): container finished" podID="d7213419-6653-4e19-bfa6-86011a18fb49" containerID="60cac1537122af1d5adcf4a061681f090be689e659c5c90282e3cbd32f53ae09" exitCode=0
May 25 11:53:11.156900 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:53:11.156809    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/stop-feature-test-kserve-router-scheduler-f99b6c6cb-9c2fq" event={"ID":"d7213419-6653-4e19-bfa6-86011a18fb49","Type":"ContainerDied","Data":"60cac1537122af1d5adcf4a061681f090be689e659c5c90282e3cbd32f53ae09"}
May 25 11:53:11.156900 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:53:11.156835    2569 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/stop-feature-test-kserve-router-scheduler-f99b6c6cb-9c2fq"
May 25 11:53:11.156900 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:53:11.156854    2569 scope.go:117] "RemoveContainer" containerID="60cac1537122af1d5adcf4a061681f090be689e659c5c90282e3cbd32f53ae09"
May 25 11:53:11.157114 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:53:11.156844    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/stop-feature-test-kserve-router-scheduler-f99b6c6cb-9c2fq" event={"ID":"d7213419-6653-4e19-bfa6-86011a18fb49","Type":"ContainerDied","Data":"f5a99d5b91bc7d4b9ea0a89fc52e6aa7607f150ab6b68c7b9bbb0686deafc618"}
May 25 11:53:11.164700 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:53:11.164682    2569 scope.go:117] "RemoveContainer" containerID="e4b20f739d6d20474da875b83f91f6a2a2b275ae130b9f49615f0e4ca78b3683"
May 25 11:53:11.171684 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:53:11.171668    2569 scope.go:117] "RemoveContainer" containerID="4f6bb500944050cf663f33c7a194219b5eafb87783f2bcce21a914ada5a6a0b6"
May 25 11:53:11.178466 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:53:11.178449    2569 scope.go:117] "RemoveContainer" containerID="60cac1537122af1d5adcf4a061681f090be689e659c5c90282e3cbd32f53ae09"
May 25 11:53:11.178702 ip-10-0-143-46 kubenswrapper[2569]: E0525 11:53:11.178685    2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"60cac1537122af1d5adcf4a061681f090be689e659c5c90282e3cbd32f53ae09\": container with ID starting with 60cac1537122af1d5adcf4a061681f090be689e659c5c90282e3cbd32f53ae09 not found: ID does not exist" containerID="60cac1537122af1d5adcf4a061681f090be689e659c5c90282e3cbd32f53ae09"
May 25 11:53:11.178752 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:53:11.178707    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"60cac1537122af1d5adcf4a061681f090be689e659c5c90282e3cbd32f53ae09"} err="failed to get container status \"60cac1537122af1d5adcf4a061681f090be689e659c5c90282e3cbd32f53ae09\": rpc error: code = NotFound desc = could not find container \"60cac1537122af1d5adcf4a061681f090be689e659c5c90282e3cbd32f53ae09\": container with ID starting with 60cac1537122af1d5adcf4a061681f090be689e659c5c90282e3cbd32f53ae09 not found: ID does not exist"
May 25 11:53:11.178752 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:53:11.178722    2569 scope.go:117] "RemoveContainer" containerID="e4b20f739d6d20474da875b83f91f6a2a2b275ae130b9f49615f0e4ca78b3683"
May 25 11:53:11.178961 ip-10-0-143-46 kubenswrapper[2569]: E0525 11:53:11.178941    2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e4b20f739d6d20474da875b83f91f6a2a2b275ae130b9f49615f0e4ca78b3683\": container with ID starting with e4b20f739d6d20474da875b83f91f6a2a2b275ae130b9f49615f0e4ca78b3683 not found: ID does not exist" containerID="e4b20f739d6d20474da875b83f91f6a2a2b275ae130b9f49615f0e4ca78b3683"
May 25 11:53:11.179008 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:53:11.178969    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e4b20f739d6d20474da875b83f91f6a2a2b275ae130b9f49615f0e4ca78b3683"} err="failed to get container status \"e4b20f739d6d20474da875b83f91f6a2a2b275ae130b9f49615f0e4ca78b3683\": rpc error: code = NotFound desc = could not find container \"e4b20f739d6d20474da875b83f91f6a2a2b275ae130b9f49615f0e4ca78b3683\": container with ID starting with e4b20f739d6d20474da875b83f91f6a2a2b275ae130b9f49615f0e4ca78b3683 not found: ID does not exist"
May 25 11:53:11.179008 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:53:11.178986    2569 scope.go:117] "RemoveContainer" containerID="4f6bb500944050cf663f33c7a194219b5eafb87783f2bcce21a914ada5a6a0b6"
May 25 11:53:11.179194 ip-10-0-143-46 kubenswrapper[2569]: E0525 11:53:11.179176    2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4f6bb500944050cf663f33c7a194219b5eafb87783f2bcce21a914ada5a6a0b6\": container with ID starting with 4f6bb500944050cf663f33c7a194219b5eafb87783f2bcce21a914ada5a6a0b6 not found: ID does not exist" containerID="4f6bb500944050cf663f33c7a194219b5eafb87783f2bcce21a914ada5a6a0b6"
May 25 11:53:11.179247 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:53:11.179205    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4f6bb500944050cf663f33c7a194219b5eafb87783f2bcce21a914ada5a6a0b6"} err="failed to get container status \"4f6bb500944050cf663f33c7a194219b5eafb87783f2bcce21a914ada5a6a0b6\": rpc error: code = NotFound desc = could not find container \"4f6bb500944050cf663f33c7a194219b5eafb87783f2bcce21a914ada5a6a0b6\": container with ID starting with 4f6bb500944050cf663f33c7a194219b5eafb87783f2bcce21a914ada5a6a0b6 not found: ID does not exist"
May 25 11:53:11.257883 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:53:11.257862    2569 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d7213419-6653-4e19-bfa6-86011a18fb49-tls-certs\") pod \"d7213419-6653-4e19-bfa6-86011a18fb49\" (UID: \"d7213419-6653-4e19-bfa6-86011a18fb49\") "
May 25 11:53:11.257979 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:53:11.257950    2569 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"tokenizer-uds\" (UniqueName: \"kubernetes.io/empty-dir/d7213419-6653-4e19-bfa6-86011a18fb49-tokenizer-uds\") pod \"d7213419-6653-4e19-bfa6-86011a18fb49\" (UID: \"d7213419-6653-4e19-bfa6-86011a18fb49\") "
May 25 11:53:11.258032 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:53:11.257975    2569 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"tokenizer-cache\" (UniqueName: \"kubernetes.io/empty-dir/d7213419-6653-4e19-bfa6-86011a18fb49-tokenizer-cache\") pod \"d7213419-6653-4e19-bfa6-86011a18fb49\" (UID: \"d7213419-6653-4e19-bfa6-86011a18fb49\") "
May 25 11:53:11.258032 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:53:11.258003    2569 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bb7kx\" (UniqueName: \"kubernetes.io/projected/d7213419-6653-4e19-bfa6-86011a18fb49-kube-api-access-bb7kx\") pod \"d7213419-6653-4e19-bfa6-86011a18fb49\" (UID: \"d7213419-6653-4e19-bfa6-86011a18fb49\") "
May 25 11:53:11.258032 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:53:11.258023    2569 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"tokenizer-tmp\" (UniqueName: \"kubernetes.io/empty-dir/d7213419-6653-4e19-bfa6-86011a18fb49-tokenizer-tmp\") pod \"d7213419-6653-4e19-bfa6-86011a18fb49\" (UID: \"d7213419-6653-4e19-bfa6-86011a18fb49\") "
May 25 11:53:11.258189 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:53:11.258055    2569 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/d7213419-6653-4e19-bfa6-86011a18fb49-kserve-provision-location\") pod \"d7213419-6653-4e19-bfa6-86011a18fb49\" (UID: \"d7213419-6653-4e19-bfa6-86011a18fb49\") "
May 25 11:53:11.258358 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:53:11.258334    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d7213419-6653-4e19-bfa6-86011a18fb49-tokenizer-cache" (OuterVolumeSpecName: "tokenizer-cache") pod "d7213419-6653-4e19-bfa6-86011a18fb49" (UID: "d7213419-6653-4e19-bfa6-86011a18fb49"). InnerVolumeSpecName "tokenizer-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 25 11:53:11.258358 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:53:11.258319    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d7213419-6653-4e19-bfa6-86011a18fb49-tokenizer-uds" (OuterVolumeSpecName: "tokenizer-uds") pod "d7213419-6653-4e19-bfa6-86011a18fb49" (UID: "d7213419-6653-4e19-bfa6-86011a18fb49"). InnerVolumeSpecName "tokenizer-uds". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 25 11:53:11.258494 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:53:11.258457    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d7213419-6653-4e19-bfa6-86011a18fb49-tokenizer-tmp" (OuterVolumeSpecName: "tokenizer-tmp") pod "d7213419-6653-4e19-bfa6-86011a18fb49" (UID: "d7213419-6653-4e19-bfa6-86011a18fb49"). InnerVolumeSpecName "tokenizer-tmp". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 25 11:53:11.259039 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:53:11.259012    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d7213419-6653-4e19-bfa6-86011a18fb49-kserve-provision-location" (OuterVolumeSpecName: "kserve-provision-location") pod "d7213419-6653-4e19-bfa6-86011a18fb49" (UID: "d7213419-6653-4e19-bfa6-86011a18fb49"). InnerVolumeSpecName "kserve-provision-location". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 25 11:53:11.259819 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:53:11.259777    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d7213419-6653-4e19-bfa6-86011a18fb49-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "d7213419-6653-4e19-bfa6-86011a18fb49" (UID: "d7213419-6653-4e19-bfa6-86011a18fb49"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 25 11:53:11.260180 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:53:11.260160    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d7213419-6653-4e19-bfa6-86011a18fb49-kube-api-access-bb7kx" (OuterVolumeSpecName: "kube-api-access-bb7kx") pod "d7213419-6653-4e19-bfa6-86011a18fb49" (UID: "d7213419-6653-4e19-bfa6-86011a18fb49"). InnerVolumeSpecName "kube-api-access-bb7kx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 25 11:53:11.359321 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:53:11.359291    2569 reconciler_common.go:299] "Volume detached for volume \"tokenizer-uds\" (UniqueName: \"kubernetes.io/empty-dir/d7213419-6653-4e19-bfa6-86011a18fb49-tokenizer-uds\") on node \"ip-10-0-143-46.ec2.internal\" DevicePath \"\""
May 25 11:53:11.359321 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:53:11.359317    2569 reconciler_common.go:299] "Volume detached for volume \"tokenizer-cache\" (UniqueName: \"kubernetes.io/empty-dir/d7213419-6653-4e19-bfa6-86011a18fb49-tokenizer-cache\") on node \"ip-10-0-143-46.ec2.internal\" DevicePath \"\""
May 25 11:53:11.359482 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:53:11.359327    2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bb7kx\" (UniqueName: \"kubernetes.io/projected/d7213419-6653-4e19-bfa6-86011a18fb49-kube-api-access-bb7kx\") on node \"ip-10-0-143-46.ec2.internal\" DevicePath \"\""
May 25 11:53:11.359482 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:53:11.359339    2569 reconciler_common.go:299] "Volume detached for volume \"tokenizer-tmp\" (UniqueName: \"kubernetes.io/empty-dir/d7213419-6653-4e19-bfa6-86011a18fb49-tokenizer-tmp\") on node \"ip-10-0-143-46.ec2.internal\" DevicePath \"\""
May 25 11:53:11.359482 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:53:11.359348    2569 reconciler_common.go:299] "Volume detached for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/d7213419-6653-4e19-bfa6-86011a18fb49-kserve-provision-location\") on node \"ip-10-0-143-46.ec2.internal\" DevicePath \"\""
May 25 11:53:11.359482 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:53:11.359357    2569 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d7213419-6653-4e19-bfa6-86011a18fb49-tls-certs\") on node \"ip-10-0-143-46.ec2.internal\" DevicePath \"\""
May 25 11:53:11.481056 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:53:11.481022    2569 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/stop-feature-test-kserve-router-scheduler-f99b6c6cb-9c2fq"]
May 25 11:53:11.490974 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:53:11.490944    2569 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/stop-feature-test-kserve-router-scheduler-f99b6c6cb-9c2fq"]
May 25 11:53:11.599112 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:53:11.599081    2569 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/stop-feature-test-kserve-router-scheduler-f99b6c6cb-9c2fq" podUID="d7213419-6653-4e19-bfa6-86011a18fb49" containerName="main" probeResult="failure" output="timeout: failed to connect service \"10.134.0.45:9003\" within 1s: context deadline exceeded"
May 25 11:53:11.735702 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:53:11.731499    2569 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d7213419-6653-4e19-bfa6-86011a18fb49" path="/var/lib/kubelet/pods/d7213419-6653-4e19-bfa6-86011a18fb49/volumes"
May 25 11:54:26.480585 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:54:26.480554    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_router-gateway-2-openshift-default-7bb57db77b-rf2sq_9c2bb4c5-570c-45cd-bff1-c86ed015c05b/istio-proxy/0.log"
May 25 11:54:27.459465 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:54:27.459432    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_router-gateway-2-openshift-default-7bb57db77b-rf2sq_9c2bb4c5-570c-45cd-bff1-c86ed015c05b/istio-proxy/0.log"
May 25 11:54:28.390159 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:54:28.390131    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_router-gateway-2-openshift-default-7bb57db77b-rf2sq_9c2bb4c5-570c-45cd-bff1-c86ed015c05b/istio-proxy/0.log"
May 25 11:54:29.310463 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:54:29.310432    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_router-gateway-2-openshift-default-7bb57db77b-rf2sq_9c2bb4c5-570c-45cd-bff1-c86ed015c05b/istio-proxy/0.log"
May 25 11:54:30.241707 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:54:30.241675    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_router-gateway-2-openshift-default-7bb57db77b-rf2sq_9c2bb4c5-570c-45cd-bff1-c86ed015c05b/istio-proxy/0.log"
May 25 11:54:31.186561 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:54:31.186521    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_router-gateway-2-openshift-default-7bb57db77b-rf2sq_9c2bb4c5-570c-45cd-bff1-c86ed015c05b/istio-proxy/0.log"
May 25 11:54:32.126841 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:54:32.126811    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_router-gateway-2-openshift-default-7bb57db77b-rf2sq_9c2bb4c5-570c-45cd-bff1-c86ed015c05b/istio-proxy/0.log"
May 25 11:54:33.055920 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:54:33.055892    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_router-gateway-2-openshift-default-7bb57db77b-rf2sq_9c2bb4c5-570c-45cd-bff1-c86ed015c05b/istio-proxy/0.log"
May 25 11:54:33.987738 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:54:33.987703    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_router-gateway-2-openshift-default-7bb57db77b-rf2sq_9c2bb4c5-570c-45cd-bff1-c86ed015c05b/istio-proxy/0.log"
May 25 11:54:34.902892 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:54:34.902861    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_router-gateway-2-openshift-default-7bb57db77b-rf2sq_9c2bb4c5-570c-45cd-bff1-c86ed015c05b/istio-proxy/0.log"
May 25 11:54:35.819275 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:54:35.819245    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_router-gateway-2-openshift-default-7bb57db77b-rf2sq_9c2bb4c5-570c-45cd-bff1-c86ed015c05b/istio-proxy/0.log"
May 25 11:54:36.768748 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:54:36.768701    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_router-gateway-2-openshift-default-7bb57db77b-rf2sq_9c2bb4c5-570c-45cd-bff1-c86ed015c05b/istio-proxy/0.log"
May 25 11:54:37.754588 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:54:37.754544    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_router-gateway-2-openshift-default-7bb57db77b-rf2sq_9c2bb4c5-570c-45cd-bff1-c86ed015c05b/istio-proxy/0.log"
May 25 11:54:38.765438 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:54:38.765404    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_router-gateway-2-openshift-default-7bb57db77b-rf2sq_9c2bb4c5-570c-45cd-bff1-c86ed015c05b/istio-proxy/0.log"
May 25 11:54:41.450776 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:54:41.450735    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-68bd676465-bjc5n_c3ad09a6-a470-4b05-8757-2c1c0a42605e/authorino/0.log"
May 25 11:54:41.465048 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:54:41.465027    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-7587b89b76-wwj25_61afad2c-a455-49ec-89f5-d78339d9b5b4/manager/0.log"
May 25 11:54:46.674700 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:54:46.674668    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-6dhqr_7a749caf-71aa-4d7e-a3c4-93908241e5df/global-pull-secret-syncer/0.log"
May 25 11:54:46.828200 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:54:46.828168    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-nn7vp_defe3e45-8839-4bbc-a8e1-5641dd6b3b33/konnectivity-agent/0.log"
May 25 11:54:46.882510 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:54:46.882485    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-143-46.ec2.internal_56519f8fe9fae3cdb88779f3c49e86c7/haproxy/0.log"
May 25 11:54:51.206320 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:54:51.206289    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-68bd676465-bjc5n_c3ad09a6-a470-4b05-8757-2c1c0a42605e/authorino/0.log"
May 25 11:54:51.240433 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:54:51.240404    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-7587b89b76-wwj25_61afad2c-a455-49ec-89f5-d78339d9b5b4/manager/0.log"
May 25 11:54:52.497258 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:54:52.497229    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-6c75959455-98ftr_d3b548de-36b2-48d6-b8f6-d35134a661af/cluster-monitoring-operator/0.log"
May 25 11:54:52.525247 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:54:52.525212    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-54fd6bc5c4-94hs5_6973719b-4aa7-46c2-bff7-b54006c9ffa8/kube-state-metrics/0.log"
May 25 11:54:52.547951 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:54:52.547930    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-54fd6bc5c4-94hs5_6973719b-4aa7-46c2-bff7-b54006c9ffa8/kube-rbac-proxy-main/0.log"
May 25 11:54:52.572968 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:54:52.572947    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-54fd6bc5c4-94hs5_6973719b-4aa7-46c2-bff7-b54006c9ffa8/kube-rbac-proxy-self/0.log"
May 25 11:54:52.845113 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:54:52.845075    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-ts85m_c06afa60-0531-46fc-87c8-1da08c1379a4/node-exporter/0.log"
May 25 11:54:52.866881 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:54:52.866857    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-ts85m_c06afa60-0531-46fc-87c8-1da08c1379a4/kube-rbac-proxy/0.log"
May 25 11:54:52.896225 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:54:52.896204    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-ts85m_c06afa60-0531-46fc-87c8-1da08c1379a4/init-textfile/0.log"
May 25 11:54:53.196384 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:54:53.196298    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-7779bbdd78-5mztr_c293e578-b120-4fcf-b794-c2d3f325a88d/prometheus-operator/0.log"
May 25 11:54:53.218649 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:54:53.218624    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-7779bbdd78-5mztr_c293e578-b120-4fcf-b794-c2d3f325a88d/kube-rbac-proxy/0.log"
May 25 11:54:53.243587 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:54:53.243565    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-6c4bbc67b7-d59kr_176c28f9-9945-4f69-9c84-7fcef32f9c18/prometheus-operator-admission-webhook/0.log"
May 25 11:54:53.275040 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:54:53.275019    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-bf6d4b856-zhsqz_8ee7c498-105f-4afd-8af8-c8fd6bc00a05/telemeter-client/0.log"
May 25 11:54:53.298417 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:54:53.298393    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-bf6d4b856-zhsqz_8ee7c498-105f-4afd-8af8-c8fd6bc00a05/reload/0.log"
May 25 11:54:53.322135 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:54:53.322114    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-bf6d4b856-zhsqz_8ee7c498-105f-4afd-8af8-c8fd6bc00a05/kube-rbac-proxy/0.log"
May 25 11:54:54.533763 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:54:54.533722    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-d4d8f94f9-gkfsm_d7d63093-61fa-4aba-9243-0a5da6e67128/networking-console-plugin/0.log"
May 25 11:54:55.024620 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:54:55.024533    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-cvhbj_9ff9f77a-ac83-4250-8c40-d14a2db84c1e/console-operator/2.log"
May 25 11:54:55.028659 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:54:55.028631    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-cvhbj_9ff9f77a-ac83-4250-8c40-d14a2db84c1e/console-operator/3.log"
May 25 11:54:55.444052 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:54:55.444013    2569 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-must-gather-qcmnf/perf-node-gather-daemonset-dl45h"]
May 25 11:54:55.444375 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:54:55.444362    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d7213419-6653-4e19-bfa6-86011a18fb49" containerName="main"
May 25 11:54:55.444375 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:54:55.444376    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="d7213419-6653-4e19-bfa6-86011a18fb49" containerName="main"
May 25 11:54:55.444463 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:54:55.444386    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d7213419-6653-4e19-bfa6-86011a18fb49" containerName="tokenizer"
May 25 11:54:55.444463 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:54:55.444391    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="d7213419-6653-4e19-bfa6-86011a18fb49" containerName="tokenizer"
May 25 11:54:55.444463 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:54:55.444414    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d7213419-6653-4e19-bfa6-86011a18fb49" containerName="storage-initializer"
May 25 11:54:55.444463 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:54:55.444419    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="d7213419-6653-4e19-bfa6-86011a18fb49" containerName="storage-initializer"
May 25 11:54:55.444706 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:54:55.444478    2569 memory_manager.go:356] "RemoveStaleState removing state" podUID="d7213419-6653-4e19-bfa6-86011a18fb49" containerName="tokenizer"
May 25 11:54:55.444706 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:54:55.444491    2569 memory_manager.go:356] "RemoveStaleState removing state" podUID="d7213419-6653-4e19-bfa6-86011a18fb49" containerName="main"
May 25 11:54:55.447542 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:54:55.447525    2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-qcmnf/perf-node-gather-daemonset-dl45h"
May 25 11:54:55.450284 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:54:55.450256    2569 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-qcmnf\"/\"openshift-service-ca.crt\""
May 25 11:54:55.451057 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:54:55.451039    2569 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-qcmnf\"/\"kube-root-ca.crt\""
May 25 11:54:55.451160 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:54:55.451079    2569 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-qcmnf\"/\"default-dockercfg-22mcc\""
May 25 11:54:55.454518 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:54:55.454495    2569 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-qcmnf/perf-node-gather-daemonset-dl45h"]
May 25 11:54:55.480808 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:54:55.480764    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c3c19051-ba79-4f48-a8e2-3d168c941734-sys\") pod \"perf-node-gather-daemonset-dl45h\" (UID: \"c3c19051-ba79-4f48-a8e2-3d168c941734\") " pod="openshift-must-gather-qcmnf/perf-node-gather-daemonset-dl45h"
May 25 11:54:55.480990 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:54:55.480848    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/c3c19051-ba79-4f48-a8e2-3d168c941734-proc\") pod \"perf-node-gather-daemonset-dl45h\" (UID: \"c3c19051-ba79-4f48-a8e2-3d168c941734\") " pod="openshift-must-gather-qcmnf/perf-node-gather-daemonset-dl45h"
May 25 11:54:55.480990 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:54:55.480893    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/c3c19051-ba79-4f48-a8e2-3d168c941734-lib-modules\") pod \"perf-node-gather-daemonset-dl45h\" (UID: \"c3c19051-ba79-4f48-a8e2-3d168c941734\") " pod="openshift-must-gather-qcmnf/perf-node-gather-daemonset-dl45h"
May 25 11:54:55.480990 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:54:55.480917    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7rhrz\" (UniqueName: \"kubernetes.io/projected/c3c19051-ba79-4f48-a8e2-3d168c941734-kube-api-access-7rhrz\") pod \"perf-node-gather-daemonset-dl45h\" (UID: \"c3c19051-ba79-4f48-a8e2-3d168c941734\") " pod="openshift-must-gather-qcmnf/perf-node-gather-daemonset-dl45h"
May 25 11:54:55.480990 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:54:55.480946    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/c3c19051-ba79-4f48-a8e2-3d168c941734-podres\") pod \"perf-node-gather-daemonset-dl45h\" (UID: \"c3c19051-ba79-4f48-a8e2-3d168c941734\") " pod="openshift-must-gather-qcmnf/perf-node-gather-daemonset-dl45h"
May 25 11:54:55.514317 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:54:55.514291    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-89695997b-xr9sx_3233cf1a-6830-4a7c-aab9-3fa97ae24696/console/0.log"
May 25 11:54:55.544536 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:54:55.544505    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-57bd96b888-z45lk_30832a1d-20d2-4e9d-9cca-0e3f5f04f033/download-server/0.log"
May 25 11:54:55.581925 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:54:55.581899    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c3c19051-ba79-4f48-a8e2-3d168c941734-sys\") pod \"perf-node-gather-daemonset-dl45h\" (UID: \"c3c19051-ba79-4f48-a8e2-3d168c941734\") " pod="openshift-must-gather-qcmnf/perf-node-gather-daemonset-dl45h"
May 25 11:54:55.582060 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:54:55.581944    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/c3c19051-ba79-4f48-a8e2-3d168c941734-proc\") pod \"perf-node-gather-daemonset-dl45h\" (UID: \"c3c19051-ba79-4f48-a8e2-3d168c941734\") " pod="openshift-must-gather-qcmnf/perf-node-gather-daemonset-dl45h"
May 25 11:54:55.582060 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:54:55.581989    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/c3c19051-ba79-4f48-a8e2-3d168c941734-lib-modules\") pod \"perf-node-gather-daemonset-dl45h\" (UID: \"c3c19051-ba79-4f48-a8e2-3d168c941734\") " pod="openshift-must-gather-qcmnf/perf-node-gather-daemonset-dl45h"
May 25 11:54:55.582060 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:54:55.582015    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c3c19051-ba79-4f48-a8e2-3d168c941734-sys\") pod \"perf-node-gather-daemonset-dl45h\" (UID: \"c3c19051-ba79-4f48-a8e2-3d168c941734\") " pod="openshift-must-gather-qcmnf/perf-node-gather-daemonset-dl45h"
May 25 11:54:55.582060 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:54:55.582019    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-7rhrz\" (UniqueName: \"kubernetes.io/projected/c3c19051-ba79-4f48-a8e2-3d168c941734-kube-api-access-7rhrz\") pod \"perf-node-gather-daemonset-dl45h\" (UID: \"c3c19051-ba79-4f48-a8e2-3d168c941734\") " pod="openshift-must-gather-qcmnf/perf-node-gather-daemonset-dl45h"
May 25 11:54:55.582252 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:54:55.582065    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/c3c19051-ba79-4f48-a8e2-3d168c941734-podres\") pod \"perf-node-gather-daemonset-dl45h\" (UID: \"c3c19051-ba79-4f48-a8e2-3d168c941734\") " pod="openshift-must-gather-qcmnf/perf-node-gather-daemonset-dl45h"
May 25 11:54:55.582252 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:54:55.582082    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/c3c19051-ba79-4f48-a8e2-3d168c941734-proc\") pod \"perf-node-gather-daemonset-dl45h\" (UID: \"c3c19051-ba79-4f48-a8e2-3d168c941734\") " pod="openshift-must-gather-qcmnf/perf-node-gather-daemonset-dl45h"
May 25 11:54:55.582252 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:54:55.582142    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/c3c19051-ba79-4f48-a8e2-3d168c941734-lib-modules\") pod \"perf-node-gather-daemonset-dl45h\" (UID: \"c3c19051-ba79-4f48-a8e2-3d168c941734\") " pod="openshift-must-gather-qcmnf/perf-node-gather-daemonset-dl45h"
May 25 11:54:55.582252 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:54:55.582160    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/c3c19051-ba79-4f48-a8e2-3d168c941734-podres\") pod \"perf-node-gather-daemonset-dl45h\" (UID: \"c3c19051-ba79-4f48-a8e2-3d168c941734\") " pod="openshift-must-gather-qcmnf/perf-node-gather-daemonset-dl45h"
May 25 11:54:55.590418 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:54:55.590390    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7rhrz\" (UniqueName: \"kubernetes.io/projected/c3c19051-ba79-4f48-a8e2-3d168c941734-kube-api-access-7rhrz\") pod \"perf-node-gather-daemonset-dl45h\" (UID: \"c3c19051-ba79-4f48-a8e2-3d168c941734\") " pod="openshift-must-gather-qcmnf/perf-node-gather-daemonset-dl45h"
May 25 11:54:55.759239 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:54:55.759142    2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-qcmnf/perf-node-gather-daemonset-dl45h"
May 25 11:54:55.889132 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:54:55.889106    2569 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-qcmnf/perf-node-gather-daemonset-dl45h"]
May 25 11:54:55.891669 ip-10-0-143-46 kubenswrapper[2569]: W0525 11:54:55.891642    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podc3c19051_ba79_4f48_a8e2_3d168c941734.slice/crio-1de915b65d2f0ecab409db7a671934135b013a96b4cb9b3dbe0521fa04bbb9e3 WatchSource:0}: Error finding container 1de915b65d2f0ecab409db7a671934135b013a96b4cb9b3dbe0521fa04bbb9e3: Status 404 returned error can't find the container with id 1de915b65d2f0ecab409db7a671934135b013a96b4cb9b3dbe0521fa04bbb9e3
May 25 11:54:55.986742 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:54:55.986718    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-5cf8c89d64-gxrtm_385f208f-3756-46d9-bc95-92b1a254d5ae/volume-data-source-validator/0.log"
May 25 11:54:56.509299 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:54:56.509264    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-qcmnf/perf-node-gather-daemonset-dl45h" event={"ID":"c3c19051-ba79-4f48-a8e2-3d168c941734","Type":"ContainerStarted","Data":"e260349e059ee9dd0be0b369b85d4f2c765e33aa332f1b41d4707954129f163a"}
May 25 11:54:56.509299 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:54:56.509299    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-qcmnf/perf-node-gather-daemonset-dl45h" event={"ID":"c3c19051-ba79-4f48-a8e2-3d168c941734","Type":"ContainerStarted","Data":"1de915b65d2f0ecab409db7a671934135b013a96b4cb9b3dbe0521fa04bbb9e3"}
May 25 11:54:56.509651 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:54:56.509410    2569 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-qcmnf/perf-node-gather-daemonset-dl45h"
May 25 11:54:56.529876 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:54:56.529833    2569 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-must-gather-qcmnf/perf-node-gather-daemonset-dl45h" podStartSLOduration=1.529818776 podStartE2EDuration="1.529818776s" podCreationTimestamp="2026-05-25 11:54:55 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-25 11:54:56.528737812 +0000 UTC m=+2235.390362197" watchObservedRunningTime="2026-05-25 11:54:56.529818776 +0000 UTC m=+2235.391443160"
May 25 11:54:56.855833 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:54:56.855803    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-dmhrg_e1dc225a-b479-4666-98ba-b923a7e1e6b4/dns/0.log"
May 25 11:54:56.878519 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:54:56.878494    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-dmhrg_e1dc225a-b479-4666-98ba-b923a7e1e6b4/kube-rbac-proxy/0.log"
May 25 11:54:56.928966 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:54:56.928936    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-r8nxs_f0bab5fa-9ff8-4d17-9108-5a985f7bc43b/dns-node-resolver/0.log"
May 25 11:54:57.434455 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:54:57.434424    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-tq2s9_3cf3c515-4ccb-4fcd-b5d3-205cb581a363/node-ca/0.log"
May 25 11:54:58.919750 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:54:58.919714    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-lpwk8_62c29731-ce45-4236-be62-f08e78a0fc27/serve-healthcheck-canary/0.log"
May 25 11:54:59.375934 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:54:59.375901    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-78bdfb888c-rhbmv_742a0027-4655-4bb6-92ed-fa17bdeab56d/insights-operator/0.log"
May 25 11:54:59.376128 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:54:59.375993    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-78bdfb888c-rhbmv_742a0027-4655-4bb6-92ed-fa17bdeab56d/insights-operator/1.log"
May 25 11:54:59.465746 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:54:59.465712    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-cc2gk_5fbcbf92-e3f3-4a12-b7db-2c1e8fc9cbac/kube-rbac-proxy/0.log"
May 25 11:54:59.487265 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:54:59.487237    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-cc2gk_5fbcbf92-e3f3-4a12-b7db-2c1e8fc9cbac/exporter/0.log"
May 25 11:54:59.508275 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:54:59.508256    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-cc2gk_5fbcbf92-e3f3-4a12-b7db-2c1e8fc9cbac/extractor/0.log"
May 25 11:55:02.100133 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:55:02.100104    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-757cd88c59-dxhb2_e3b1472a-d35e-4e01-b31d-662f8efc124f/manager/0.log"
May 25 11:55:02.149133 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:55:02.149107    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_openshift-lws-operator-bfc7f696d-khnvf_39629c97-8c0d-42fb-b5c7-669495f9fbc5/openshift-lws-operator/0.log"
May 25 11:55:02.521944 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:55:02.521874    2569 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-qcmnf/perf-node-gather-daemonset-dl45h"
May 25 11:55:07.913278 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:55:07.913248    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-b985f5d89-qgn59_f697138d-df82-4c2c-a859-2d6bdc255fd0/migrator/0.log"
May 25 11:55:07.934167 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:55:07.934145    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-b985f5d89-qgn59_f697138d-df82-4c2c-a859-2d6bdc255fd0/graceful-termination/0.log"
May 25 11:55:08.294059 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:55:08.294031    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-565644f49-gqxzv_959d0443-ecc0-476d-ab71-5a24bc308dee/kube-storage-version-migrator-operator/1.log"
May 25 11:55:08.294826 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:55:08.294800    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-565644f49-gqxzv_959d0443-ecc0-476d-ab71-5a24bc308dee/kube-storage-version-migrator-operator/0.log"
May 25 11:55:09.288924 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:55:09.288892    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-8khmw_e9016da7-9735-47a6-b0d7-7416ea5e1a7f/kube-multus/0.log"
May 25 11:55:09.533007 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:55:09.532980    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-64cbl_05d11822-eeca-4852-b8ce-6b2235d5dbf3/kube-multus-additional-cni-plugins/0.log"
May 25 11:55:09.556087 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:55:09.556020    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-64cbl_05d11822-eeca-4852-b8ce-6b2235d5dbf3/egress-router-binary-copy/0.log"
May 25 11:55:09.578052 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:55:09.578030    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-64cbl_05d11822-eeca-4852-b8ce-6b2235d5dbf3/cni-plugins/0.log"
May 25 11:55:09.600646 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:55:09.600624    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-64cbl_05d11822-eeca-4852-b8ce-6b2235d5dbf3/bond-cni-plugin/0.log"
May 25 11:55:09.633766 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:55:09.633747    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-64cbl_05d11822-eeca-4852-b8ce-6b2235d5dbf3/routeoverride-cni/0.log"
May 25 11:55:09.656539 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:55:09.656514    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-64cbl_05d11822-eeca-4852-b8ce-6b2235d5dbf3/whereabouts-cni-bincopy/0.log"
May 25 11:55:09.679227 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:55:09.679206    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-64cbl_05d11822-eeca-4852-b8ce-6b2235d5dbf3/whereabouts-cni/0.log"
May 25 11:55:10.031496 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:55:10.031471    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-pd47q_9098669d-fa99-44c7-94ad-4e3560412654/network-metrics-daemon/0.log"
May 25 11:55:10.051603 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:55:10.051578    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-pd47q_9098669d-fa99-44c7-94ad-4e3560412654/kube-rbac-proxy/0.log"
May 25 11:55:11.619278 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:55:11.619251    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-pvgm2_ceeaa8f0-8aae-4758-8813-959a2343178a/ovn-controller/0.log"
May 25 11:55:11.649298 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:55:11.649274    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-pvgm2_ceeaa8f0-8aae-4758-8813-959a2343178a/ovn-acl-logging/0.log"
May 25 11:55:11.668501 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:55:11.668434    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-pvgm2_ceeaa8f0-8aae-4758-8813-959a2343178a/kube-rbac-proxy-node/0.log"
May 25 11:55:11.690505 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:55:11.690483    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-pvgm2_ceeaa8f0-8aae-4758-8813-959a2343178a/kube-rbac-proxy-ovn-metrics/0.log"
May 25 11:55:11.712918 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:55:11.712899    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-pvgm2_ceeaa8f0-8aae-4758-8813-959a2343178a/northd/0.log"
May 25 11:55:11.736649 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:55:11.736631    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-pvgm2_ceeaa8f0-8aae-4758-8813-959a2343178a/nbdb/0.log"
May 25 11:55:11.759922 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:55:11.759900    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-pvgm2_ceeaa8f0-8aae-4758-8813-959a2343178a/sbdb/0.log"
May 25 11:55:11.852338 ip-10-0-143-46 kubenswrapper[2569]: I0525 11:55:11.852311    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-pvgm2_ceeaa8f0-8aae-4758-8813-959a2343178a/ovnkube-controller/0.log"