May 25 11:20:50.605808 ip-10-0-128-206 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory
May 25 11:20:50.605818 ip-10-0-128-206 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory
May 25 11:20:50.605825 ip-10-0-128-206 systemd[1]: kubelet.service: Failed with result 'resources'.
May 25 11:20:50.606040 ip-10-0-128-206 systemd[1]: Failed to start Kubernetes Kubelet.
May 25 11:21:00.701195 ip-10-0-128-206 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found.
May 25 11:21:00.701212 ip-10-0-128-206 systemd[1]: kubelet.service: Failed with result 'resources'.
-- Boot a6572a9c305a43d58e94967f90bf3ca4 --
May 25 11:23:28.122376 ip-10-0-128-206 systemd[1]: Starting Kubernetes Kubelet...
May 25 11:23:28.531170 ip-10-0-128-206 kubenswrapper[2545]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
May 25 11:23:28.531170 ip-10-0-128-206 kubenswrapper[2545]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
May 25 11:23:28.531170 ip-10-0-128-206 kubenswrapper[2545]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
May 25 11:23:28.531170 ip-10-0-128-206 kubenswrapper[2545]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
May 25 11:23:28.531170 ip-10-0-128-206 kubenswrapper[2545]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
May 25 11:23:28.532083 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:23:28.531245    2545 server.go:212] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
May 25 11:23:28.535122 ip-10-0-128-206 kubenswrapper[2545]: W0525 11:23:28.535095    2545 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
May 25 11:23:28.535122 ip-10-0-128-206 kubenswrapper[2545]: W0525 11:23:28.535117    2545 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI
May 25 11:23:28.535122 ip-10-0-128-206 kubenswrapper[2545]: W0525 11:23:28.535122    2545 feature_gate.go:328] unrecognized feature gate: InsightsConfig
May 25 11:23:28.535122 ip-10-0-128-206 kubenswrapper[2545]: W0525 11:23:28.535127    2545 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
May 25 11:23:28.535385 ip-10-0-128-206 kubenswrapper[2545]: W0525 11:23:28.535132    2545 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
May 25 11:23:28.535385 ip-10-0-128-206 kubenswrapper[2545]: W0525 11:23:28.535137    2545 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
May 25 11:23:28.535385 ip-10-0-128-206 kubenswrapper[2545]: W0525 11:23:28.535140    2545 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
May 25 11:23:28.535385 ip-10-0-128-206 kubenswrapper[2545]: W0525 11:23:28.535144    2545 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
May 25 11:23:28.535385 ip-10-0-128-206 kubenswrapper[2545]: W0525 11:23:28.535156    2545 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
May 25 11:23:28.535385 ip-10-0-128-206 kubenswrapper[2545]: W0525 11:23:28.535160    2545 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS
May 25 11:23:28.535385 ip-10-0-128-206 kubenswrapper[2545]: W0525 11:23:28.535164    2545 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
May 25 11:23:28.535385 ip-10-0-128-206 kubenswrapper[2545]: W0525 11:23:28.535168    2545 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
May 25 11:23:28.535385 ip-10-0-128-206 kubenswrapper[2545]: W0525 11:23:28.535171    2545 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
May 25 11:23:28.535385 ip-10-0-128-206 kubenswrapper[2545]: W0525 11:23:28.535175    2545 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
May 25 11:23:28.535385 ip-10-0-128-206 kubenswrapper[2545]: W0525 11:23:28.535179    2545 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
May 25 11:23:28.535385 ip-10-0-128-206 kubenswrapper[2545]: W0525 11:23:28.535183    2545 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
May 25 11:23:28.535385 ip-10-0-128-206 kubenswrapper[2545]: W0525 11:23:28.535187    2545 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
May 25 11:23:28.535385 ip-10-0-128-206 kubenswrapper[2545]: W0525 11:23:28.535190    2545 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
May 25 11:23:28.535385 ip-10-0-128-206 kubenswrapper[2545]: W0525 11:23:28.535194    2545 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
May 25 11:23:28.535385 ip-10-0-128-206 kubenswrapper[2545]: W0525 11:23:28.535198    2545 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
May 25 11:23:28.535385 ip-10-0-128-206 kubenswrapper[2545]: W0525 11:23:28.535202    2545 feature_gate.go:328] unrecognized feature gate: DualReplica
May 25 11:23:28.535385 ip-10-0-128-206 kubenswrapper[2545]: W0525 11:23:28.535206    2545 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
May 25 11:23:28.535385 ip-10-0-128-206 kubenswrapper[2545]: W0525 11:23:28.535211    2545 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
May 25 11:23:28.535385 ip-10-0-128-206 kubenswrapper[2545]: W0525 11:23:28.535215    2545 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
May 25 11:23:28.536170 ip-10-0-128-206 kubenswrapper[2545]: W0525 11:23:28.535218    2545 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
May 25 11:23:28.536170 ip-10-0-128-206 kubenswrapper[2545]: W0525 11:23:28.535223    2545 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
May 25 11:23:28.536170 ip-10-0-128-206 kubenswrapper[2545]: W0525 11:23:28.535226    2545 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
May 25 11:23:28.536170 ip-10-0-128-206 kubenswrapper[2545]: W0525 11:23:28.535230    2545 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
May 25 11:23:28.536170 ip-10-0-128-206 kubenswrapper[2545]: W0525 11:23:28.535234    2545 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
May 25 11:23:28.536170 ip-10-0-128-206 kubenswrapper[2545]: W0525 11:23:28.535238    2545 feature_gate.go:328] unrecognized feature gate: Example2
May 25 11:23:28.536170 ip-10-0-128-206 kubenswrapper[2545]: W0525 11:23:28.535242    2545 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
May 25 11:23:28.536170 ip-10-0-128-206 kubenswrapper[2545]: W0525 11:23:28.535247    2545 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController
May 25 11:23:28.536170 ip-10-0-128-206 kubenswrapper[2545]: W0525 11:23:28.535251    2545 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
May 25 11:23:28.536170 ip-10-0-128-206 kubenswrapper[2545]: W0525 11:23:28.535255    2545 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
May 25 11:23:28.536170 ip-10-0-128-206 kubenswrapper[2545]: W0525 11:23:28.535258    2545 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
May 25 11:23:28.536170 ip-10-0-128-206 kubenswrapper[2545]: W0525 11:23:28.535263    2545 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
May 25 11:23:28.536170 ip-10-0-128-206 kubenswrapper[2545]: W0525 11:23:28.535267    2545 feature_gate.go:328] unrecognized feature gate: SignatureStores
May 25 11:23:28.536170 ip-10-0-128-206 kubenswrapper[2545]: W0525 11:23:28.535273    2545 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
May 25 11:23:28.536170 ip-10-0-128-206 kubenswrapper[2545]: W0525 11:23:28.535282    2545 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
May 25 11:23:28.536170 ip-10-0-128-206 kubenswrapper[2545]: W0525 11:23:28.535288    2545 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
May 25 11:23:28.536170 ip-10-0-128-206 kubenswrapper[2545]: W0525 11:23:28.535293    2545 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
May 25 11:23:28.536170 ip-10-0-128-206 kubenswrapper[2545]: W0525 11:23:28.535304    2545 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
May 25 11:23:28.536170 ip-10-0-128-206 kubenswrapper[2545]: W0525 11:23:28.535309    2545 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
May 25 11:23:28.536993 ip-10-0-128-206 kubenswrapper[2545]: W0525 11:23:28.535317    2545 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
May 25 11:23:28.536993 ip-10-0-128-206 kubenswrapper[2545]: W0525 11:23:28.535322    2545 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
May 25 11:23:28.536993 ip-10-0-128-206 kubenswrapper[2545]: W0525 11:23:28.535327    2545 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
May 25 11:23:28.536993 ip-10-0-128-206 kubenswrapper[2545]: W0525 11:23:28.535331    2545 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
May 25 11:23:28.536993 ip-10-0-128-206 kubenswrapper[2545]: W0525 11:23:28.535335    2545 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
May 25 11:23:28.536993 ip-10-0-128-206 kubenswrapper[2545]: W0525 11:23:28.535340    2545 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
May 25 11:23:28.536993 ip-10-0-128-206 kubenswrapper[2545]: W0525 11:23:28.535344    2545 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
May 25 11:23:28.536993 ip-10-0-128-206 kubenswrapper[2545]: W0525 11:23:28.535348    2545 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
May 25 11:23:28.536993 ip-10-0-128-206 kubenswrapper[2545]: W0525 11:23:28.535353    2545 feature_gate.go:328] unrecognized feature gate: PinnedImages
May 25 11:23:28.536993 ip-10-0-128-206 kubenswrapper[2545]: W0525 11:23:28.535357    2545 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
May 25 11:23:28.536993 ip-10-0-128-206 kubenswrapper[2545]: W0525 11:23:28.535361    2545 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations
May 25 11:23:28.536993 ip-10-0-128-206 kubenswrapper[2545]: W0525 11:23:28.535365    2545 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
May 25 11:23:28.536993 ip-10-0-128-206 kubenswrapper[2545]: W0525 11:23:28.535369    2545 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
May 25 11:23:28.536993 ip-10-0-128-206 kubenswrapper[2545]: W0525 11:23:28.535375    2545 feature_gate.go:328] unrecognized feature gate: OVNObservability
May 25 11:23:28.536993 ip-10-0-128-206 kubenswrapper[2545]: W0525 11:23:28.535380    2545 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
May 25 11:23:28.536993 ip-10-0-128-206 kubenswrapper[2545]: W0525 11:23:28.535383    2545 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
May 25 11:23:28.536993 ip-10-0-128-206 kubenswrapper[2545]: W0525 11:23:28.535387    2545 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
May 25 11:23:28.536993 ip-10-0-128-206 kubenswrapper[2545]: W0525 11:23:28.535391    2545 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
May 25 11:23:28.536993 ip-10-0-128-206 kubenswrapper[2545]: W0525 11:23:28.535395    2545 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
May 25 11:23:28.537772 ip-10-0-128-206 kubenswrapper[2545]: W0525 11:23:28.535400    2545 feature_gate.go:328] unrecognized feature gate: Example
May 25 11:23:28.537772 ip-10-0-128-206 kubenswrapper[2545]: W0525 11:23:28.535404    2545 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
May 25 11:23:28.537772 ip-10-0-128-206 kubenswrapper[2545]: W0525 11:23:28.535408    2545 feature_gate.go:328] unrecognized feature gate: NewOLM
May 25 11:23:28.537772 ip-10-0-128-206 kubenswrapper[2545]: W0525 11:23:28.535412    2545 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
May 25 11:23:28.537772 ip-10-0-128-206 kubenswrapper[2545]: W0525 11:23:28.535416    2545 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
May 25 11:23:28.537772 ip-10-0-128-206 kubenswrapper[2545]: W0525 11:23:28.535420    2545 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
May 25 11:23:28.537772 ip-10-0-128-206 kubenswrapper[2545]: W0525 11:23:28.535424    2545 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
May 25 11:23:28.537772 ip-10-0-128-206 kubenswrapper[2545]: W0525 11:23:28.535430    2545 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
May 25 11:23:28.537772 ip-10-0-128-206 kubenswrapper[2545]: W0525 11:23:28.535434    2545 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
May 25 11:23:28.537772 ip-10-0-128-206 kubenswrapper[2545]: W0525 11:23:28.535438    2545 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
May 25 11:23:28.537772 ip-10-0-128-206 kubenswrapper[2545]: W0525 11:23:28.535443    2545 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
May 25 11:23:28.537772 ip-10-0-128-206 kubenswrapper[2545]: W0525 11:23:28.535447    2545 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
May 25 11:23:28.537772 ip-10-0-128-206 kubenswrapper[2545]: W0525 11:23:28.535452    2545 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
May 25 11:23:28.537772 ip-10-0-128-206 kubenswrapper[2545]: W0525 11:23:28.535456    2545 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
May 25 11:23:28.537772 ip-10-0-128-206 kubenswrapper[2545]: W0525 11:23:28.535461    2545 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
May 25 11:23:28.537772 ip-10-0-128-206 kubenswrapper[2545]: W0525 11:23:28.535465    2545 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
May 25 11:23:28.537772 ip-10-0-128-206 kubenswrapper[2545]: W0525 11:23:28.535469    2545 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
May 25 11:23:28.537772 ip-10-0-128-206 kubenswrapper[2545]: W0525 11:23:28.535473    2545 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
May 25 11:23:28.537772 ip-10-0-128-206 kubenswrapper[2545]: W0525 11:23:28.535477    2545 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
May 25 11:23:28.537772 ip-10-0-128-206 kubenswrapper[2545]: W0525 11:23:28.535481    2545 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
May 25 11:23:28.538581 ip-10-0-128-206 kubenswrapper[2545]: W0525 11:23:28.535485    2545 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
May 25 11:23:28.538581 ip-10-0-128-206 kubenswrapper[2545]: W0525 11:23:28.535489    2545 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
May 25 11:23:28.538581 ip-10-0-128-206 kubenswrapper[2545]: W0525 11:23:28.535493    2545 feature_gate.go:328] unrecognized feature gate: GatewayAPI
May 25 11:23:28.538581 ip-10-0-128-206 kubenswrapper[2545]: W0525 11:23:28.535497    2545 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
May 25 11:23:28.538581 ip-10-0-128-206 kubenswrapper[2545]: W0525 11:23:28.536188    2545 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
May 25 11:23:28.538581 ip-10-0-128-206 kubenswrapper[2545]: W0525 11:23:28.536199    2545 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
May 25 11:23:28.538581 ip-10-0-128-206 kubenswrapper[2545]: W0525 11:23:28.536203    2545 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
May 25 11:23:28.538581 ip-10-0-128-206 kubenswrapper[2545]: W0525 11:23:28.536208    2545 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
May 25 11:23:28.538581 ip-10-0-128-206 kubenswrapper[2545]: W0525 11:23:28.536212    2545 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
May 25 11:23:28.538581 ip-10-0-128-206 kubenswrapper[2545]: W0525 11:23:28.536216    2545 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
May 25 11:23:28.538581 ip-10-0-128-206 kubenswrapper[2545]: W0525 11:23:28.536221    2545 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
May 25 11:23:28.538581 ip-10-0-128-206 kubenswrapper[2545]: W0525 11:23:28.536225    2545 feature_gate.go:328] unrecognized feature gate: DualReplica
May 25 11:23:28.538581 ip-10-0-128-206 kubenswrapper[2545]: W0525 11:23:28.536229    2545 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
May 25 11:23:28.538581 ip-10-0-128-206 kubenswrapper[2545]: W0525 11:23:28.536235    2545 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
May 25 11:23:28.538581 ip-10-0-128-206 kubenswrapper[2545]: W0525 11:23:28.536239    2545 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
May 25 11:23:28.538581 ip-10-0-128-206 kubenswrapper[2545]: W0525 11:23:28.536243    2545 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
May 25 11:23:28.538581 ip-10-0-128-206 kubenswrapper[2545]: W0525 11:23:28.536247    2545 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
May 25 11:23:28.538581 ip-10-0-128-206 kubenswrapper[2545]: W0525 11:23:28.536252    2545 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
May 25 11:23:28.538581 ip-10-0-128-206 kubenswrapper[2545]: W0525 11:23:28.536256    2545 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
May 25 11:23:28.538581 ip-10-0-128-206 kubenswrapper[2545]: W0525 11:23:28.536262    2545 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
May 25 11:23:28.539158 ip-10-0-128-206 kubenswrapper[2545]: W0525 11:23:28.536267    2545 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
May 25 11:23:28.539158 ip-10-0-128-206 kubenswrapper[2545]: W0525 11:23:28.536271    2545 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
May 25 11:23:28.539158 ip-10-0-128-206 kubenswrapper[2545]: W0525 11:23:28.536275    2545 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
May 25 11:23:28.539158 ip-10-0-128-206 kubenswrapper[2545]: W0525 11:23:28.536279    2545 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
May 25 11:23:28.539158 ip-10-0-128-206 kubenswrapper[2545]: W0525 11:23:28.536285    2545 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
May 25 11:23:28.539158 ip-10-0-128-206 kubenswrapper[2545]: W0525 11:23:28.536289    2545 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
May 25 11:23:28.539158 ip-10-0-128-206 kubenswrapper[2545]: W0525 11:23:28.536293    2545 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController
May 25 11:23:28.539158 ip-10-0-128-206 kubenswrapper[2545]: W0525 11:23:28.536298    2545 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
May 25 11:23:28.539158 ip-10-0-128-206 kubenswrapper[2545]: W0525 11:23:28.536302    2545 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
May 25 11:23:28.539158 ip-10-0-128-206 kubenswrapper[2545]: W0525 11:23:28.536306    2545 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
May 25 11:23:28.539158 ip-10-0-128-206 kubenswrapper[2545]: W0525 11:23:28.536310    2545 feature_gate.go:328] unrecognized feature gate: GatewayAPI
May 25 11:23:28.539158 ip-10-0-128-206 kubenswrapper[2545]: W0525 11:23:28.536314    2545 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
May 25 11:23:28.539158 ip-10-0-128-206 kubenswrapper[2545]: W0525 11:23:28.536319    2545 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
May 25 11:23:28.539158 ip-10-0-128-206 kubenswrapper[2545]: W0525 11:23:28.536323    2545 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
May 25 11:23:28.539158 ip-10-0-128-206 kubenswrapper[2545]: W0525 11:23:28.536327    2545 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
May 25 11:23:28.539158 ip-10-0-128-206 kubenswrapper[2545]: W0525 11:23:28.536332    2545 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
May 25 11:23:28.539158 ip-10-0-128-206 kubenswrapper[2545]: W0525 11:23:28.536336    2545 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
May 25 11:23:28.539158 ip-10-0-128-206 kubenswrapper[2545]: W0525 11:23:28.536341    2545 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
May 25 11:23:28.539158 ip-10-0-128-206 kubenswrapper[2545]: W0525 11:23:28.536345    2545 feature_gate.go:328] unrecognized feature gate: NewOLM
May 25 11:23:28.539628 ip-10-0-128-206 kubenswrapper[2545]: W0525 11:23:28.536350    2545 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
May 25 11:23:28.539628 ip-10-0-128-206 kubenswrapper[2545]: W0525 11:23:28.536354    2545 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
May 25 11:23:28.539628 ip-10-0-128-206 kubenswrapper[2545]: W0525 11:23:28.536358    2545 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
May 25 11:23:28.539628 ip-10-0-128-206 kubenswrapper[2545]: W0525 11:23:28.536362    2545 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS
May 25 11:23:28.539628 ip-10-0-128-206 kubenswrapper[2545]: W0525 11:23:28.536366    2545 feature_gate.go:328] unrecognized feature gate: OVNObservability
May 25 11:23:28.539628 ip-10-0-128-206 kubenswrapper[2545]: W0525 11:23:28.536370    2545 feature_gate.go:328] unrecognized feature gate: Example
May 25 11:23:28.539628 ip-10-0-128-206 kubenswrapper[2545]: W0525 11:23:28.536375    2545 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
May 25 11:23:28.539628 ip-10-0-128-206 kubenswrapper[2545]: W0525 11:23:28.536379    2545 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
May 25 11:23:28.539628 ip-10-0-128-206 kubenswrapper[2545]: W0525 11:23:28.536383    2545 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
May 25 11:23:28.539628 ip-10-0-128-206 kubenswrapper[2545]: W0525 11:23:28.536387    2545 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
May 25 11:23:28.539628 ip-10-0-128-206 kubenswrapper[2545]: W0525 11:23:28.536391    2545 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
May 25 11:23:28.539628 ip-10-0-128-206 kubenswrapper[2545]: W0525 11:23:28.536395    2545 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
May 25 11:23:28.539628 ip-10-0-128-206 kubenswrapper[2545]: W0525 11:23:28.536400    2545 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
May 25 11:23:28.539628 ip-10-0-128-206 kubenswrapper[2545]: W0525 11:23:28.536404    2545 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
May 25 11:23:28.539628 ip-10-0-128-206 kubenswrapper[2545]: W0525 11:23:28.536408    2545 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
May 25 11:23:28.539628 ip-10-0-128-206 kubenswrapper[2545]: W0525 11:23:28.536413    2545 feature_gate.go:328] unrecognized feature gate: SignatureStores
May 25 11:23:28.539628 ip-10-0-128-206 kubenswrapper[2545]: W0525 11:23:28.536417    2545 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
May 25 11:23:28.539628 ip-10-0-128-206 kubenswrapper[2545]: W0525 11:23:28.536422    2545 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
May 25 11:23:28.539628 ip-10-0-128-206 kubenswrapper[2545]: W0525 11:23:28.536432    2545 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
May 25 11:23:28.539628 ip-10-0-128-206 kubenswrapper[2545]: W0525 11:23:28.536436    2545 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
May 25 11:23:28.540130 ip-10-0-128-206 kubenswrapper[2545]: W0525 11:23:28.536441    2545 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
May 25 11:23:28.540130 ip-10-0-128-206 kubenswrapper[2545]: W0525 11:23:28.536445    2545 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
May 25 11:23:28.540130 ip-10-0-128-206 kubenswrapper[2545]: W0525 11:23:28.536449    2545 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
May 25 11:23:28.540130 ip-10-0-128-206 kubenswrapper[2545]: W0525 11:23:28.536453    2545 feature_gate.go:328] unrecognized feature gate: InsightsConfig
May 25 11:23:28.540130 ip-10-0-128-206 kubenswrapper[2545]: W0525 11:23:28.536457    2545 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
May 25 11:23:28.540130 ip-10-0-128-206 kubenswrapper[2545]: W0525 11:23:28.536461    2545 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
May 25 11:23:28.540130 ip-10-0-128-206 kubenswrapper[2545]: W0525 11:23:28.536465    2545 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
May 25 11:23:28.540130 ip-10-0-128-206 kubenswrapper[2545]: W0525 11:23:28.536469    2545 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
May 25 11:23:28.540130 ip-10-0-128-206 kubenswrapper[2545]: W0525 11:23:28.536474    2545 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
May 25 11:23:28.540130 ip-10-0-128-206 kubenswrapper[2545]: W0525 11:23:28.536479    2545 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI
May 25 11:23:28.540130 ip-10-0-128-206 kubenswrapper[2545]: W0525 11:23:28.536483    2545 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
May 25 11:23:28.540130 ip-10-0-128-206 kubenswrapper[2545]: W0525 11:23:28.536487    2545 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
May 25 11:23:28.540130 ip-10-0-128-206 kubenswrapper[2545]: W0525 11:23:28.536492    2545 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
May 25 11:23:28.540130 ip-10-0-128-206 kubenswrapper[2545]: W0525 11:23:28.536496    2545 feature_gate.go:328] unrecognized feature gate: Example2
May 25 11:23:28.540130 ip-10-0-128-206 kubenswrapper[2545]: W0525 11:23:28.536501    2545 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
May 25 11:23:28.540130 ip-10-0-128-206 kubenswrapper[2545]: W0525 11:23:28.536505    2545 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
May 25 11:23:28.540130 ip-10-0-128-206 kubenswrapper[2545]: W0525 11:23:28.536510    2545 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations
May 25 11:23:28.540130 ip-10-0-128-206 kubenswrapper[2545]: W0525 11:23:28.536514    2545 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
May 25 11:23:28.540130 ip-10-0-128-206 kubenswrapper[2545]: W0525 11:23:28.536518    2545 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
May 25 11:23:28.540130 ip-10-0-128-206 kubenswrapper[2545]: W0525 11:23:28.536522    2545 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
May 25 11:23:28.540731 ip-10-0-128-206 kubenswrapper[2545]: W0525 11:23:28.536527    2545 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
May 25 11:23:28.540731 ip-10-0-128-206 kubenswrapper[2545]: W0525 11:23:28.536531    2545 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
May 25 11:23:28.540731 ip-10-0-128-206 kubenswrapper[2545]: W0525 11:23:28.536537    2545 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
May 25 11:23:28.540731 ip-10-0-128-206 kubenswrapper[2545]: W0525 11:23:28.536542    2545 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
May 25 11:23:28.540731 ip-10-0-128-206 kubenswrapper[2545]: W0525 11:23:28.536546    2545 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
May 25 11:23:28.540731 ip-10-0-128-206 kubenswrapper[2545]: W0525 11:23:28.536550    2545 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
May 25 11:23:28.540731 ip-10-0-128-206 kubenswrapper[2545]: W0525 11:23:28.536554    2545 feature_gate.go:328] unrecognized feature gate: PinnedImages
May 25 11:23:28.540731 ip-10-0-128-206 kubenswrapper[2545]: W0525 11:23:28.536558    2545 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
May 25 11:23:28.540731 ip-10-0-128-206 kubenswrapper[2545]: W0525 11:23:28.536563    2545 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
May 25 11:23:28.540731 ip-10-0-128-206 kubenswrapper[2545]: W0525 11:23:28.536567    2545 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
May 25 11:23:28.540731 ip-10-0-128-206 kubenswrapper[2545]: W0525 11:23:28.536574    2545 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
May 25 11:23:28.540731 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:23:28.536687    2545 flags.go:64] FLAG: --address="0.0.0.0"
May 25 11:23:28.540731 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:23:28.536700    2545 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
May 25 11:23:28.540731 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:23:28.536710    2545 flags.go:64] FLAG: --anonymous-auth="true"
May 25 11:23:28.540731 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:23:28.536717    2545 flags.go:64] FLAG: --application-metrics-count-limit="100"
May 25 11:23:28.540731 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:23:28.536725    2545 flags.go:64] FLAG: --authentication-token-webhook="false"
May 25 11:23:28.540731 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:23:28.536730    2545 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
May 25 11:23:28.540731 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:23:28.536738    2545 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
May 25 11:23:28.540731 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:23:28.536745    2545 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
May 25 11:23:28.540731 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:23:28.536750    2545 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
May 25 11:23:28.540731 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:23:28.536755    2545 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
May 25 11:23:28.541278 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:23:28.536761    2545 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
May 25 11:23:28.541278 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:23:28.536767    2545 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
May 25 11:23:28.541278 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:23:28.536772    2545 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
May 25 11:23:28.541278 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:23:28.536778    2545 flags.go:64] FLAG: --cgroup-root=""
May 25 11:23:28.541278 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:23:28.536783    2545 flags.go:64] FLAG: --cgroups-per-qos="true"
May 25 11:23:28.541278 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:23:28.536788    2545 flags.go:64] FLAG: --client-ca-file=""
May 25 11:23:28.541278 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:23:28.536793    2545 flags.go:64] FLAG: --cloud-config=""
May 25 11:23:28.541278 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:23:28.536798    2545 flags.go:64] FLAG: --cloud-provider="external"
May 25 11:23:28.541278 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:23:28.536802    2545 flags.go:64] FLAG: --cluster-dns="[]"
May 25 11:23:28.541278 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:23:28.536809    2545 flags.go:64] FLAG: --cluster-domain=""
May 25 11:23:28.541278 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:23:28.536814    2545 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
May 25 11:23:28.541278 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:23:28.536820    2545 flags.go:64] FLAG: --config-dir=""
May 25 11:23:28.541278 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:23:28.536825    2545 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
May 25 11:23:28.541278 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:23:28.536830    2545 flags.go:64] FLAG: --container-log-max-files="5"
May 25 11:23:28.541278 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:23:28.536844    2545 flags.go:64] FLAG: --container-log-max-size="10Mi"
May 25 11:23:28.541278 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:23:28.536849    2545 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
May 25 11:23:28.541278 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:23:28.536854    2545 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
May 25 11:23:28.541278 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:23:28.536860    2545 flags.go:64] FLAG: --containerd-namespace="k8s.io"
May 25 11:23:28.541278 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:23:28.536864    2545 flags.go:64] FLAG: --contention-profiling="false"
May 25 11:23:28.541278 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:23:28.536870    2545 flags.go:64] FLAG: --cpu-cfs-quota="true"
May 25 11:23:28.541278 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:23:28.536875    2545 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
May 25 11:23:28.541278 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:23:28.536880    2545 flags.go:64] FLAG: --cpu-manager-policy="none"
May 25 11:23:28.541278 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:23:28.536885    2545 flags.go:64] FLAG: --cpu-manager-policy-options=""
May 25 11:23:28.541278 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:23:28.536892    2545 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
May 25 11:23:28.541278 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:23:28.536897    2545 flags.go:64] FLAG: --enable-controller-attach-detach="true"
May 25 11:23:28.541898 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:23:28.536902    2545 flags.go:64] FLAG: --enable-debugging-handlers="true"
May 25 11:23:28.541898 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:23:28.536907    2545 flags.go:64] FLAG: --enable-load-reader="false"
May 25 11:23:28.541898 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:23:28.536913    2545 flags.go:64] FLAG: --enable-server="true"
May 25 11:23:28.541898 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:23:28.536918    2545 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
May 25 11:23:28.541898 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:23:28.536925    2545 flags.go:64] FLAG: --event-burst="100"
May 25 11:23:28.541898 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:23:28.536930    2545 flags.go:64] FLAG: --event-qps="50"
May 25 11:23:28.541898 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:23:28.536935    2545 flags.go:64] FLAG: --event-storage-age-limit="default=0"
May 25 11:23:28.541898 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:23:28.536940    2545 flags.go:64] FLAG: --event-storage-event-limit="default=0"
May 25 11:23:28.541898 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:23:28.536946    2545 flags.go:64] FLAG: --eviction-hard=""
May 25 11:23:28.541898 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:23:28.536952    2545 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
May 25 11:23:28.541898 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:23:28.536977    2545 flags.go:64] FLAG: --eviction-minimum-reclaim=""
May 25 11:23:28.541898 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:23:28.536982    2545 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
May 25 11:23:28.541898 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:23:28.536987    2545 flags.go:64] FLAG: --eviction-soft=""
May 25 11:23:28.541898 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:23:28.536992    2545 flags.go:64] FLAG: --eviction-soft-grace-period=""
May 25 11:23:28.541898 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:23:28.536997    2545 flags.go:64] FLAG: --exit-on-lock-contention="false"
May 25 11:23:28.541898 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:23:28.537002    2545 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
May 25 11:23:28.541898 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:23:28.537007    2545 flags.go:64] FLAG: --experimental-mounter-path=""
May 25 11:23:28.541898 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:23:28.537012    2545 flags.go:64] FLAG: --fail-cgroupv1="false"
May 25 11:23:28.541898 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:23:28.537017    2545 flags.go:64] FLAG: --fail-swap-on="true"
May 25 11:23:28.541898 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:23:28.537021    2545 flags.go:64] FLAG: --feature-gates=""
May 25 11:23:28.541898 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:23:28.537028    2545 flags.go:64] FLAG: --file-check-frequency="20s"
May 25 11:23:28.541898 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:23:28.537033    2545 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
May 25 11:23:28.541898 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:23:28.537038    2545 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
May 25 11:23:28.541898 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:23:28.537043    2545 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
May 25 11:23:28.541898 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:23:28.537048    2545 flags.go:64] FLAG: --healthz-port="10248"
May 25 11:23:28.541898 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:23:28.537053    2545 flags.go:64] FLAG: --help="false"
May 25 11:23:28.542611 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:23:28.537058    2545 flags.go:64] FLAG: --hostname-override="ip-10-0-128-206.ec2.internal"
May 25 11:23:28.542611 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:23:28.537064    2545 flags.go:64] FLAG: --housekeeping-interval="10s"
May 25 11:23:28.542611 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:23:28.537069    2545 flags.go:64] FLAG: --http-check-frequency="20s"
May 25 11:23:28.542611 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:23:28.537074    2545 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
May 25 11:23:28.542611 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:23:28.537080    2545 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
May 25 11:23:28.542611 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:23:28.537087    2545 flags.go:64] FLAG: --image-gc-high-threshold="85"
May 25 11:23:28.542611 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:23:28.537091    2545 flags.go:64] FLAG: --image-gc-low-threshold="80"
May 25 11:23:28.542611 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:23:28.537097    2545 flags.go:64] FLAG: --image-service-endpoint=""
May 25 11:23:28.542611 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:23:28.537101    2545 flags.go:64] FLAG: --kernel-memcg-notification="false"
May 25 11:23:28.542611 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:23:28.537106    2545 flags.go:64] FLAG: --kube-api-burst="100"
May 25 11:23:28.542611 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:23:28.537111    2545 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
May 25 11:23:28.542611 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:23:28.537116    2545 flags.go:64] FLAG: --kube-api-qps="50"
May 25 11:23:28.542611 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:23:28.537121    2545 flags.go:64] FLAG: --kube-reserved=""
May 25 11:23:28.542611 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:23:28.537127    2545 flags.go:64] FLAG: --kube-reserved-cgroup=""
May 25 11:23:28.542611 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:23:28.537131    2545 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
May 25 11:23:28.542611 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:23:28.537136    2545 flags.go:64] FLAG: --kubelet-cgroups=""
May 25 11:23:28.542611 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:23:28.537141    2545 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
May 25 11:23:28.542611 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:23:28.537150    2545 flags.go:64] FLAG: --lock-file=""
May 25 11:23:28.542611 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:23:28.537155    2545 flags.go:64] FLAG: --log-cadvisor-usage="false"
May 25 11:23:28.542611 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:23:28.537160    2545 flags.go:64] FLAG: --log-flush-frequency="5s"
May 25 11:23:28.542611 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:23:28.537165    2545 flags.go:64] FLAG: --log-json-info-buffer-size="0"
May 25 11:23:28.542611 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:23:28.537174    2545 flags.go:64] FLAG: --log-json-split-stream="false"
May 25 11:23:28.542611 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:23:28.537179    2545 flags.go:64] FLAG: --log-text-info-buffer-size="0"
May 25 11:23:28.543197 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:23:28.537184    2545 flags.go:64] FLAG: --log-text-split-stream="false"
May 25 11:23:28.543197 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:23:28.537189    2545 flags.go:64] FLAG: --logging-format="text"
May 25 11:23:28.543197 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:23:28.537194    2545 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
May 25 11:23:28.543197 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:23:28.537201    2545 flags.go:64] FLAG: --make-iptables-util-chains="true"
May 25 11:23:28.543197 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:23:28.537205    2545 flags.go:64] FLAG: --manifest-url=""
May 25 11:23:28.543197 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:23:28.537210    2545 flags.go:64] FLAG: --manifest-url-header=""
May 25 11:23:28.543197 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:23:28.537217    2545 flags.go:64] FLAG: --max-housekeeping-interval="15s"
May 25 11:23:28.543197 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:23:28.537223    2545 flags.go:64] FLAG: --max-open-files="1000000"
May 25 11:23:28.543197 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:23:28.537229    2545 flags.go:64] FLAG: --max-pods="110"
May 25 11:23:28.543197 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:23:28.537235    2545 flags.go:64] FLAG: --maximum-dead-containers="-1"
May 25 11:23:28.543197 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:23:28.537240    2545 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
May 25 11:23:28.543197 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:23:28.537245    2545 flags.go:64] FLAG: --memory-manager-policy="None"
May 25 11:23:28.543197 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:23:28.537250    2545 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
May 25 11:23:28.543197 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:23:28.537255    2545 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
May 25 11:23:28.543197 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:23:28.537261    2545 flags.go:64] FLAG: --node-ip="0.0.0.0"
May 25 11:23:28.543197 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:23:28.537267    2545 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
May 25 11:23:28.543197 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:23:28.537281    2545 flags.go:64] FLAG: --node-status-max-images="50"
May 25 11:23:28.543197 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:23:28.537286    2545 flags.go:64] FLAG: --node-status-update-frequency="10s"
May 25 11:23:28.543197 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:23:28.537292    2545 flags.go:64] FLAG: --oom-score-adj="-999"
May 25 11:23:28.543197 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:23:28.537297    2545 flags.go:64] FLAG: --pod-cidr=""
May 25 11:23:28.543197 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:23:28.537302    2545 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:afe88671bf163c42b467d159dc6f0b784dbe28b1ed44e171edc9c06fd99cc6fc"
May 25 11:23:28.543197 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:23:28.537310    2545 flags.go:64] FLAG: --pod-manifest-path=""
May 25 11:23:28.543197 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:23:28.537315    2545 flags.go:64] FLAG: --pod-max-pids="-1"
May 25 11:23:28.543197 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:23:28.537533    2545 flags.go:64] FLAG: --pods-per-core="0"
May 25 11:23:28.543811 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:23:28.537547    2545 flags.go:64] FLAG: --port="10250"
May 25 11:23:28.543811 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:23:28.537554    2545 flags.go:64] FLAG: --protect-kernel-defaults="false"
May 25 11:23:28.543811 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:23:28.537562    2545 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-09176bc6df520073d"
May 25 11:23:28.543811 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:23:28.537568    2545 flags.go:64] FLAG: --qos-reserved=""
May 25 11:23:28.543811 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:23:28.537574    2545 flags.go:64] FLAG: --read-only-port="10255"
May 25 11:23:28.543811 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:23:28.537580    2545 flags.go:64] FLAG: --register-node="true"
May 25 11:23:28.543811 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:23:28.537586    2545 flags.go:64] FLAG: --register-schedulable="true"
May 25 11:23:28.543811 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:23:28.537592    2545 flags.go:64] FLAG: --register-with-taints=""
May 25 11:23:28.543811 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:23:28.537627    2545 flags.go:64] FLAG: --registry-burst="10"
May 25 11:23:28.543811 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:23:28.537632    2545 flags.go:64] FLAG: --registry-qps="5"
May 25 11:23:28.543811 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:23:28.537638    2545 flags.go:64] FLAG: --reserved-cpus=""
May 25 11:23:28.543811 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:23:28.537643    2545 flags.go:64] FLAG: --reserved-memory=""
May 25 11:23:28.543811 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:23:28.537649    2545 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
May 25 11:23:28.543811 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:23:28.537655    2545 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
May 25 11:23:28.543811 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:23:28.537660    2545 flags.go:64] FLAG: --rotate-certificates="false"
May 25 11:23:28.543811 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:23:28.537666    2545 flags.go:64] FLAG: --rotate-server-certificates="false"
May 25 11:23:28.543811 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:23:28.537675    2545 flags.go:64] FLAG: --runonce="false"
May 25 11:23:28.543811 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:23:28.537681    2545 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
May 25 11:23:28.543811 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:23:28.537686    2545 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
May 25 11:23:28.543811 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:23:28.537692    2545 flags.go:64] FLAG: --seccomp-default="false"
May 25 11:23:28.543811 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:23:28.537697    2545 flags.go:64] FLAG: --serialize-image-pulls="true"
May 25 11:23:28.543811 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:23:28.537702    2545 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
May 25 11:23:28.543811 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:23:28.537709    2545 flags.go:64] FLAG: --storage-driver-db="cadvisor"
May 25 11:23:28.543811 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:23:28.537714    2545 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
May 25 11:23:28.543811 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:23:28.537733    2545 flags.go:64] FLAG: --storage-driver-password="root"
May 25 11:23:28.543811 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:23:28.537745    2545 flags.go:64] FLAG: --storage-driver-secure="false"
May 25 11:23:28.544486 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:23:28.537751    2545 flags.go:64] FLAG: --storage-driver-table="stats"
May 25 11:23:28.544486 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:23:28.537756    2545 flags.go:64] FLAG: --storage-driver-user="root"
May 25 11:23:28.544486 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:23:28.537761    2545 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
May 25 11:23:28.544486 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:23:28.537766    2545 flags.go:64] FLAG: --sync-frequency="1m0s"
May 25 11:23:28.544486 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:23:28.537771    2545 flags.go:64] FLAG: --system-cgroups=""
May 25 11:23:28.544486 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:23:28.537776    2545 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
May 25 11:23:28.544486 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:23:28.537793    2545 flags.go:64] FLAG: --system-reserved-cgroup=""
May 25 11:23:28.544486 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:23:28.537798    2545 flags.go:64] FLAG: --tls-cert-file=""
May 25 11:23:28.544486 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:23:28.537803    2545 flags.go:64] FLAG: --tls-cipher-suites="[]"
May 25 11:23:28.544486 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:23:28.537811    2545 flags.go:64] FLAG: --tls-min-version=""
May 25 11:23:28.544486 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:23:28.537816    2545 flags.go:64] FLAG: --tls-private-key-file=""
May 25 11:23:28.544486 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:23:28.537822    2545 flags.go:64] FLAG: --topology-manager-policy="none"
May 25 11:23:28.544486 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:23:28.537827    2545 flags.go:64] FLAG: --topology-manager-policy-options=""
May 25 11:23:28.544486 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:23:28.537833    2545 flags.go:64] FLAG: --topology-manager-scope="container"
May 25 11:23:28.544486 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:23:28.537843    2545 flags.go:64] FLAG: --v="2"
May 25 11:23:28.544486 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:23:28.537850    2545 flags.go:64] FLAG: --version="false"
May 25 11:23:28.544486 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:23:28.537857    2545 flags.go:64] FLAG: --vmodule=""
May 25 11:23:28.544486 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:23:28.537864    2545 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
May 25 11:23:28.544486 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:23:28.537870    2545 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
May 25 11:23:28.544486 ip-10-0-128-206 kubenswrapper[2545]: W0525 11:23:28.538223    2545 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
May 25 11:23:28.544486 ip-10-0-128-206 kubenswrapper[2545]: W0525 11:23:28.538236    2545 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
May 25 11:23:28.544486 ip-10-0-128-206 kubenswrapper[2545]: W0525 11:23:28.538241    2545 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
May 25 11:23:28.544486 ip-10-0-128-206 kubenswrapper[2545]: W0525 11:23:28.538247    2545 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
May 25 11:23:28.544486 ip-10-0-128-206 kubenswrapper[2545]: W0525 11:23:28.538253    2545 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
May 25 11:23:28.545087 ip-10-0-128-206 kubenswrapper[2545]: W0525 11:23:28.538258    2545 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
May 25 11:23:28.545087 ip-10-0-128-206 kubenswrapper[2545]: W0525 11:23:28.538262    2545 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
May 25 11:23:28.545087 ip-10-0-128-206 kubenswrapper[2545]: W0525 11:23:28.538267    2545 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI
May 25 11:23:28.545087 ip-10-0-128-206 kubenswrapper[2545]: W0525 11:23:28.538273    2545 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations
May 25 11:23:28.545087 ip-10-0-128-206 kubenswrapper[2545]: W0525 11:23:28.538277    2545 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
May 25 11:23:28.545087 ip-10-0-128-206 kubenswrapper[2545]: W0525 11:23:28.538282    2545 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
May 25 11:23:28.545087 ip-10-0-128-206 kubenswrapper[2545]: W0525 11:23:28.538289    2545 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
May 25 11:23:28.545087 ip-10-0-128-206 kubenswrapper[2545]: W0525 11:23:28.538294    2545 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
May 25 11:23:28.545087 ip-10-0-128-206 kubenswrapper[2545]: W0525 11:23:28.538299    2545 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
May 25 11:23:28.545087 ip-10-0-128-206 kubenswrapper[2545]: W0525 11:23:28.538309    2545 feature_gate.go:328] unrecognized feature gate: SignatureStores
May 25 11:23:28.545087 ip-10-0-128-206 kubenswrapper[2545]: W0525 11:23:28.538314    2545 feature_gate.go:328] unrecognized feature gate: DualReplica
May 25 11:23:28.545087 ip-10-0-128-206 kubenswrapper[2545]: W0525 11:23:28.538319    2545 feature_gate.go:328] unrecognized feature gate: NewOLM
May 25 11:23:28.545087 ip-10-0-128-206 kubenswrapper[2545]: W0525 11:23:28.538323    2545 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
May 25 11:23:28.545087 ip-10-0-128-206 kubenswrapper[2545]: W0525 11:23:28.538327    2545 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
May 25 11:23:28.545087 ip-10-0-128-206 kubenswrapper[2545]: W0525 11:23:28.538332    2545 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
May 25 11:23:28.545087 ip-10-0-128-206 kubenswrapper[2545]: W0525 11:23:28.538388    2545 feature_gate.go:328] unrecognized feature gate: GatewayAPI
May 25 11:23:28.545087 ip-10-0-128-206 kubenswrapper[2545]: W0525 11:23:28.538415    2545 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
May 25 11:23:28.545087 ip-10-0-128-206 kubenswrapper[2545]: W0525 11:23:28.538424    2545 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
May 25 11:23:28.545087 ip-10-0-128-206 kubenswrapper[2545]: W0525 11:23:28.538444    2545 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
May 25 11:23:28.545087 ip-10-0-128-206 kubenswrapper[2545]: W0525 11:23:28.538448    2545 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
May 25 11:23:28.545584 ip-10-0-128-206 kubenswrapper[2545]: W0525 11:23:28.538558    2545 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
May 25 11:23:28.545584 ip-10-0-128-206 kubenswrapper[2545]: W0525 11:23:28.538563    2545 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
May 25 11:23:28.545584 ip-10-0-128-206 kubenswrapper[2545]: W0525 11:23:28.538567    2545 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
May 25 11:23:28.545584 ip-10-0-128-206 kubenswrapper[2545]: W0525 11:23:28.538570    2545 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
May 25 11:23:28.545584 ip-10-0-128-206 kubenswrapper[2545]: W0525 11:23:28.538573    2545 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
May 25 11:23:28.545584 ip-10-0-128-206 kubenswrapper[2545]: W0525 11:23:28.538576    2545 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
May 25 11:23:28.545584 ip-10-0-128-206 kubenswrapper[2545]: W0525 11:23:28.538579    2545 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
May 25 11:23:28.545584 ip-10-0-128-206 kubenswrapper[2545]: W0525 11:23:28.538582    2545 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
May 25 11:23:28.545584 ip-10-0-128-206 kubenswrapper[2545]: W0525 11:23:28.538585    2545 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
May 25 11:23:28.545584 ip-10-0-128-206 kubenswrapper[2545]: W0525 11:23:28.538590    2545 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
May 25 11:23:28.545584 ip-10-0-128-206 kubenswrapper[2545]: W0525 11:23:28.538594    2545 feature_gate.go:328] unrecognized feature gate: InsightsConfig
May 25 11:23:28.545584 ip-10-0-128-206 kubenswrapper[2545]: W0525 11:23:28.538597    2545 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
May 25 11:23:28.545584 ip-10-0-128-206 kubenswrapper[2545]: W0525 11:23:28.538601    2545 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
May 25 11:23:28.545584 ip-10-0-128-206 kubenswrapper[2545]: W0525 11:23:28.538604    2545 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
May 25 11:23:28.545584 ip-10-0-128-206 kubenswrapper[2545]: W0525 11:23:28.538607    2545 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
May 25 11:23:28.545584 ip-10-0-128-206 kubenswrapper[2545]: W0525 11:23:28.538610    2545 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
May 25 11:23:28.545584 ip-10-0-128-206 kubenswrapper[2545]: W0525 11:23:28.538613    2545 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
May 25 11:23:28.545584 ip-10-0-128-206 kubenswrapper[2545]: W0525 11:23:28.538616    2545 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
May 25 11:23:28.545584 ip-10-0-128-206 kubenswrapper[2545]: W0525 11:23:28.538618    2545 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
May 25 11:23:28.546059 ip-10-0-128-206 kubenswrapper[2545]: W0525 11:23:28.538621    2545 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
May 25 11:23:28.546059 ip-10-0-128-206 kubenswrapper[2545]: W0525 11:23:28.538624    2545 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
May 25 11:23:28.546059 ip-10-0-128-206 kubenswrapper[2545]: W0525 11:23:28.538627    2545 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
May 25 11:23:28.546059 ip-10-0-128-206 kubenswrapper[2545]: W0525 11:23:28.538630    2545 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
May 25 11:23:28.546059 ip-10-0-128-206 kubenswrapper[2545]: W0525 11:23:28.538633    2545 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS
May 25 11:23:28.546059 ip-10-0-128-206 kubenswrapper[2545]: W0525 11:23:28.538642    2545 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
May 25 11:23:28.546059 ip-10-0-128-206 kubenswrapper[2545]: W0525 11:23:28.538645    2545 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
May 25 11:23:28.546059 ip-10-0-128-206 kubenswrapper[2545]: W0525 11:23:28.538649    2545 feature_gate.go:328] unrecognized feature gate: PinnedImages
May 25 11:23:28.546059 ip-10-0-128-206 kubenswrapper[2545]: W0525 11:23:28.538651    2545 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
May 25 11:23:28.546059 ip-10-0-128-206 kubenswrapper[2545]: W0525 11:23:28.538654    2545 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
May 25 11:23:28.546059 ip-10-0-128-206 kubenswrapper[2545]: W0525 11:23:28.538658    2545 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
May 25 11:23:28.546059 ip-10-0-128-206 kubenswrapper[2545]: W0525 11:23:28.538661    2545 feature_gate.go:328] unrecognized feature gate: Example
May 25 11:23:28.546059 ip-10-0-128-206 kubenswrapper[2545]: W0525 11:23:28.538663    2545 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
May 25 11:23:28.546059 ip-10-0-128-206 kubenswrapper[2545]: W0525 11:23:28.538666    2545 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
May 25 11:23:28.546059 ip-10-0-128-206 kubenswrapper[2545]: W0525 11:23:28.538669    2545 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
May 25 11:23:28.546059 ip-10-0-128-206 kubenswrapper[2545]: W0525 11:23:28.538672    2545 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
May 25 11:23:28.546059 ip-10-0-128-206 kubenswrapper[2545]: W0525 11:23:28.538674    2545 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
May 25 11:23:28.546059 ip-10-0-128-206 kubenswrapper[2545]: W0525 11:23:28.538677    2545 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
May 25 11:23:28.546059 ip-10-0-128-206 kubenswrapper[2545]: W0525 11:23:28.538680    2545 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
May 25 11:23:28.546526 ip-10-0-128-206 kubenswrapper[2545]: W0525 11:23:28.538685    2545 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
May 25 11:23:28.546526 ip-10-0-128-206 kubenswrapper[2545]: W0525 11:23:28.538690    2545 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
May 25 11:23:28.546526 ip-10-0-128-206 kubenswrapper[2545]: W0525 11:23:28.538694    2545 feature_gate.go:328] unrecognized feature gate: Example2
May 25 11:23:28.546526 ip-10-0-128-206 kubenswrapper[2545]: W0525 11:23:28.538696    2545 feature_gate.go:328] unrecognized feature gate: OVNObservability
May 25 11:23:28.546526 ip-10-0-128-206 kubenswrapper[2545]: W0525 11:23:28.538699    2545 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
May 25 11:23:28.546526 ip-10-0-128-206 kubenswrapper[2545]: W0525 11:23:28.538702    2545 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
May 25 11:23:28.546526 ip-10-0-128-206 kubenswrapper[2545]: W0525 11:23:28.538705    2545 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
May 25 11:23:28.546526 ip-10-0-128-206 kubenswrapper[2545]: W0525 11:23:28.538708    2545 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
May 25 11:23:28.546526 ip-10-0-128-206 kubenswrapper[2545]: W0525 11:23:28.538710    2545 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
May 25 11:23:28.546526 ip-10-0-128-206 kubenswrapper[2545]: W0525 11:23:28.538713    2545 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
May 25 11:23:28.546526 ip-10-0-128-206 kubenswrapper[2545]: W0525 11:23:28.538716    2545 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController
May 25 11:23:28.546526 ip-10-0-128-206 kubenswrapper[2545]: W0525 11:23:28.538720    2545 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
May 25 11:23:28.546526 ip-10-0-128-206 kubenswrapper[2545]: W0525 11:23:28.538722    2545 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
May 25 11:23:28.546526 ip-10-0-128-206 kubenswrapper[2545]: W0525 11:23:28.538726    2545 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
May 25 11:23:28.546526 ip-10-0-128-206 kubenswrapper[2545]: W0525 11:23:28.538728    2545 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
May 25 11:23:28.546526 ip-10-0-128-206 kubenswrapper[2545]: W0525 11:23:28.538731    2545 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
May 25 11:23:28.546526 ip-10-0-128-206 kubenswrapper[2545]: W0525 11:23:28.538733    2545 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
May 25 11:23:28.546526 ip-10-0-128-206 kubenswrapper[2545]: W0525 11:23:28.538736    2545 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
May 25 11:23:28.546526 ip-10-0-128-206 kubenswrapper[2545]: W0525 11:23:28.538739    2545 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
May 25 11:23:28.546526 ip-10-0-128-206 kubenswrapper[2545]: W0525 11:23:28.538741    2545 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
May 25 11:23:28.547116 ip-10-0-128-206 kubenswrapper[2545]: W0525 11:23:28.538744    2545 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
May 25 11:23:28.547116 ip-10-0-128-206 kubenswrapper[2545]: W0525 11:23:28.538747    2545 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
May 25 11:23:28.547116 ip-10-0-128-206 kubenswrapper[2545]: W0525 11:23:28.538750    2545 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
May 25 11:23:28.547116 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:23:28.539384    2545 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]}
May 25 11:23:28.547116 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:23:28.545737    2545 server.go:530] "Kubelet version" kubeletVersion="v1.33.11"
May 25 11:23:28.547116 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:23:28.545757    2545 server.go:532] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
May 25 11:23:28.547116 ip-10-0-128-206 kubenswrapper[2545]: W0525 11:23:28.545809    2545 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
May 25 11:23:28.547116 ip-10-0-128-206 kubenswrapper[2545]: W0525 11:23:28.545814    2545 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
May 25 11:23:28.547116 ip-10-0-128-206 kubenswrapper[2545]: W0525 11:23:28.545818    2545 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
May 25 11:23:28.547116 ip-10-0-128-206 kubenswrapper[2545]: W0525 11:23:28.545821    2545 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
May 25 11:23:28.547116 ip-10-0-128-206 kubenswrapper[2545]: W0525 11:23:28.545825    2545 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
May 25 11:23:28.547116 ip-10-0-128-206 kubenswrapper[2545]: W0525 11:23:28.545828    2545 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
May 25 11:23:28.547116 ip-10-0-128-206 kubenswrapper[2545]: W0525 11:23:28.545831    2545 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
May 25 11:23:28.547116 ip-10-0-128-206 kubenswrapper[2545]: W0525 11:23:28.545834    2545 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
May 25 11:23:28.547116 ip-10-0-128-206 kubenswrapper[2545]: W0525 11:23:28.545837    2545 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
May 25 11:23:28.547116 ip-10-0-128-206 kubenswrapper[2545]: W0525 11:23:28.545839    2545 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
May 25 11:23:28.547568 ip-10-0-128-206 kubenswrapper[2545]: W0525 11:23:28.545842    2545 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
May 25 11:23:28.547568 ip-10-0-128-206 kubenswrapper[2545]: W0525 11:23:28.545845    2545 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
May 25 11:23:28.547568 ip-10-0-128-206 kubenswrapper[2545]: W0525 11:23:28.545848    2545 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
May 25 11:23:28.547568 ip-10-0-128-206 kubenswrapper[2545]: W0525 11:23:28.545850    2545 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
May 25 11:23:28.547568 ip-10-0-128-206 kubenswrapper[2545]: W0525 11:23:28.545853    2545 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
May 25 11:23:28.547568 ip-10-0-128-206 kubenswrapper[2545]: W0525 11:23:28.545856    2545 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
May 25 11:23:28.547568 ip-10-0-128-206 kubenswrapper[2545]: W0525 11:23:28.545858    2545 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
May 25 11:23:28.547568 ip-10-0-128-206 kubenswrapper[2545]: W0525 11:23:28.545861    2545 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
May 25 11:23:28.547568 ip-10-0-128-206 kubenswrapper[2545]: W0525 11:23:28.545863    2545 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
May 25 11:23:28.547568 ip-10-0-128-206 kubenswrapper[2545]: W0525 11:23:28.545866    2545 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
May 25 11:23:28.547568 ip-10-0-128-206 kubenswrapper[2545]: W0525 11:23:28.545869    2545 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
May 25 11:23:28.547568 ip-10-0-128-206 kubenswrapper[2545]: W0525 11:23:28.545872    2545 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
May 25 11:23:28.547568 ip-10-0-128-206 kubenswrapper[2545]: W0525 11:23:28.545875    2545 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
May 25 11:23:28.547568 ip-10-0-128-206 kubenswrapper[2545]: W0525 11:23:28.545877    2545 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS
May 25 11:23:28.547568 ip-10-0-128-206 kubenswrapper[2545]: W0525 11:23:28.545880    2545 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
May 25 11:23:28.547568 ip-10-0-128-206 kubenswrapper[2545]: W0525 11:23:28.545883    2545 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
May 25 11:23:28.547568 ip-10-0-128-206 kubenswrapper[2545]: W0525 11:23:28.545885    2545 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
May 25 11:23:28.547568 ip-10-0-128-206 kubenswrapper[2545]: W0525 11:23:28.545888    2545 feature_gate.go:328] unrecognized feature gate: Example2
May 25 11:23:28.547568 ip-10-0-128-206 kubenswrapper[2545]: W0525 11:23:28.545891    2545 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations
May 25 11:23:28.547568 ip-10-0-128-206 kubenswrapper[2545]: W0525 11:23:28.545893    2545 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
May 25 11:23:28.548070 ip-10-0-128-206 kubenswrapper[2545]: W0525 11:23:28.545896    2545 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
May 25 11:23:28.548070 ip-10-0-128-206 kubenswrapper[2545]: W0525 11:23:28.545900    2545 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
May 25 11:23:28.548070 ip-10-0-128-206 kubenswrapper[2545]: W0525 11:23:28.545903    2545 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
May 25 11:23:28.548070 ip-10-0-128-206 kubenswrapper[2545]: W0525 11:23:28.545906    2545 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
May 25 11:23:28.548070 ip-10-0-128-206 kubenswrapper[2545]: W0525 11:23:28.545909    2545 feature_gate.go:328] unrecognized feature gate: Example
May 25 11:23:28.548070 ip-10-0-128-206 kubenswrapper[2545]: W0525 11:23:28.545912    2545 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
May 25 11:23:28.548070 ip-10-0-128-206 kubenswrapper[2545]: W0525 11:23:28.545914    2545 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
May 25 11:23:28.548070 ip-10-0-128-206 kubenswrapper[2545]: W0525 11:23:28.545917    2545 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
May 25 11:23:28.548070 ip-10-0-128-206 kubenswrapper[2545]: W0525 11:23:28.545920    2545 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
May 25 11:23:28.548070 ip-10-0-128-206 kubenswrapper[2545]: W0525 11:23:28.545922    2545 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
May 25 11:23:28.548070 ip-10-0-128-206 kubenswrapper[2545]: W0525 11:23:28.545925    2545 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
May 25 11:23:28.548070 ip-10-0-128-206 kubenswrapper[2545]: W0525 11:23:28.545927    2545 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
May 25 11:23:28.548070 ip-10-0-128-206 kubenswrapper[2545]: W0525 11:23:28.545930    2545 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
May 25 11:23:28.548070 ip-10-0-128-206 kubenswrapper[2545]: W0525 11:23:28.545932    2545 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
May 25 11:23:28.548070 ip-10-0-128-206 kubenswrapper[2545]: W0525 11:23:28.545935    2545 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
May 25 11:23:28.548070 ip-10-0-128-206 kubenswrapper[2545]: W0525 11:23:28.545937    2545 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
May 25 11:23:28.548070 ip-10-0-128-206 kubenswrapper[2545]: W0525 11:23:28.545940    2545 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
May 25 11:23:28.548070 ip-10-0-128-206 kubenswrapper[2545]: W0525 11:23:28.545943    2545 feature_gate.go:328] unrecognized feature gate: OVNObservability
May 25 11:23:28.548070 ip-10-0-128-206 kubenswrapper[2545]: W0525 11:23:28.545945    2545 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
May 25 11:23:28.548070 ip-10-0-128-206 kubenswrapper[2545]: W0525 11:23:28.545948    2545 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
May 25 11:23:28.548558 ip-10-0-128-206 kubenswrapper[2545]: W0525 11:23:28.545950    2545 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
May 25 11:23:28.548558 ip-10-0-128-206 kubenswrapper[2545]: W0525 11:23:28.545970    2545 feature_gate.go:328] unrecognized feature gate: GatewayAPI
May 25 11:23:28.548558 ip-10-0-128-206 kubenswrapper[2545]: W0525 11:23:28.545973    2545 feature_gate.go:328] unrecognized feature gate: NewOLM
May 25 11:23:28.548558 ip-10-0-128-206 kubenswrapper[2545]: W0525 11:23:28.545976    2545 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
May 25 11:23:28.548558 ip-10-0-128-206 kubenswrapper[2545]: W0525 11:23:28.545978    2545 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
May 25 11:23:28.548558 ip-10-0-128-206 kubenswrapper[2545]: W0525 11:23:28.545981    2545 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
May 25 11:23:28.548558 ip-10-0-128-206 kubenswrapper[2545]: W0525 11:23:28.545984    2545 feature_gate.go:328] unrecognized feature gate: DualReplica
May 25 11:23:28.548558 ip-10-0-128-206 kubenswrapper[2545]: W0525 11:23:28.545987    2545 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
May 25 11:23:28.548558 ip-10-0-128-206 kubenswrapper[2545]: W0525 11:23:28.545990    2545 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
May 25 11:23:28.548558 ip-10-0-128-206 kubenswrapper[2545]: W0525 11:23:28.545992    2545 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController
May 25 11:23:28.548558 ip-10-0-128-206 kubenswrapper[2545]: W0525 11:23:28.545995    2545 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
May 25 11:23:28.548558 ip-10-0-128-206 kubenswrapper[2545]: W0525 11:23:28.545998    2545 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
May 25 11:23:28.548558 ip-10-0-128-206 kubenswrapper[2545]: W0525 11:23:28.546001    2545 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
May 25 11:23:28.548558 ip-10-0-128-206 kubenswrapper[2545]: W0525 11:23:28.546005    2545 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
May 25 11:23:28.548558 ip-10-0-128-206 kubenswrapper[2545]: W0525 11:23:28.546008    2545 feature_gate.go:328] unrecognized feature gate: SignatureStores
May 25 11:23:28.548558 ip-10-0-128-206 kubenswrapper[2545]: W0525 11:23:28.546012    2545 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
May 25 11:23:28.548558 ip-10-0-128-206 kubenswrapper[2545]: W0525 11:23:28.546017    2545 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
May 25 11:23:28.548558 ip-10-0-128-206 kubenswrapper[2545]: W0525 11:23:28.546019    2545 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
May 25 11:23:28.548558 ip-10-0-128-206 kubenswrapper[2545]: W0525 11:23:28.546022    2545 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
May 25 11:23:28.548558 ip-10-0-128-206 kubenswrapper[2545]: W0525 11:23:28.546025    2545 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
May 25 11:23:28.549068 ip-10-0-128-206 kubenswrapper[2545]: W0525 11:23:28.546028    2545 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
May 25 11:23:28.549068 ip-10-0-128-206 kubenswrapper[2545]: W0525 11:23:28.546031    2545 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
May 25 11:23:28.549068 ip-10-0-128-206 kubenswrapper[2545]: W0525 11:23:28.546034    2545 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
May 25 11:23:28.549068 ip-10-0-128-206 kubenswrapper[2545]: W0525 11:23:28.546036    2545 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
May 25 11:23:28.549068 ip-10-0-128-206 kubenswrapper[2545]: W0525 11:23:28.546039    2545 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
May 25 11:23:28.549068 ip-10-0-128-206 kubenswrapper[2545]: W0525 11:23:28.546042    2545 feature_gate.go:328] unrecognized feature gate: InsightsConfig
May 25 11:23:28.549068 ip-10-0-128-206 kubenswrapper[2545]: W0525 11:23:28.546045    2545 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI
May 25 11:23:28.549068 ip-10-0-128-206 kubenswrapper[2545]: W0525 11:23:28.546048    2545 feature_gate.go:328] unrecognized feature gate: PinnedImages
May 25 11:23:28.549068 ip-10-0-128-206 kubenswrapper[2545]: W0525 11:23:28.546050    2545 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
May 25 11:23:28.549068 ip-10-0-128-206 kubenswrapper[2545]: W0525 11:23:28.546053    2545 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
May 25 11:23:28.549068 ip-10-0-128-206 kubenswrapper[2545]: W0525 11:23:28.546056    2545 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
May 25 11:23:28.549068 ip-10-0-128-206 kubenswrapper[2545]: W0525 11:23:28.546058    2545 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
May 25 11:23:28.549068 ip-10-0-128-206 kubenswrapper[2545]: W0525 11:23:28.546061    2545 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
May 25 11:23:28.549068 ip-10-0-128-206 kubenswrapper[2545]: W0525 11:23:28.546064    2545 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
May 25 11:23:28.549068 ip-10-0-128-206 kubenswrapper[2545]: W0525 11:23:28.546067    2545 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
May 25 11:23:28.549068 ip-10-0-128-206 kubenswrapper[2545]: W0525 11:23:28.546071    2545 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
May 25 11:23:28.549476 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:23:28.546077    2545 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]}
May 25 11:23:28.549476 ip-10-0-128-206 kubenswrapper[2545]: W0525 11:23:28.546177    2545 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
May 25 11:23:28.549476 ip-10-0-128-206 kubenswrapper[2545]: W0525 11:23:28.546181    2545 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations
May 25 11:23:28.549476 ip-10-0-128-206 kubenswrapper[2545]: W0525 11:23:28.546185    2545 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
May 25 11:23:28.549476 ip-10-0-128-206 kubenswrapper[2545]: W0525 11:23:28.546188    2545 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
May 25 11:23:28.549476 ip-10-0-128-206 kubenswrapper[2545]: W0525 11:23:28.546191    2545 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
May 25 11:23:28.549476 ip-10-0-128-206 kubenswrapper[2545]: W0525 11:23:28.546194    2545 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
May 25 11:23:28.549476 ip-10-0-128-206 kubenswrapper[2545]: W0525 11:23:28.546197    2545 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
May 25 11:23:28.549476 ip-10-0-128-206 kubenswrapper[2545]: W0525 11:23:28.546201    2545 feature_gate.go:328] unrecognized feature gate: NewOLM
May 25 11:23:28.549476 ip-10-0-128-206 kubenswrapper[2545]: W0525 11:23:28.546204    2545 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
May 25 11:23:28.549476 ip-10-0-128-206 kubenswrapper[2545]: W0525 11:23:28.546207    2545 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS
May 25 11:23:28.549476 ip-10-0-128-206 kubenswrapper[2545]: W0525 11:23:28.546209    2545 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
May 25 11:23:28.549476 ip-10-0-128-206 kubenswrapper[2545]: W0525 11:23:28.546212    2545 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
May 25 11:23:28.549476 ip-10-0-128-206 kubenswrapper[2545]: W0525 11:23:28.546215    2545 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
May 25 11:23:28.549476 ip-10-0-128-206 kubenswrapper[2545]: W0525 11:23:28.546217    2545 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
May 25 11:23:28.549857 ip-10-0-128-206 kubenswrapper[2545]: W0525 11:23:28.546220    2545 feature_gate.go:328] unrecognized feature gate: PinnedImages
May 25 11:23:28.549857 ip-10-0-128-206 kubenswrapper[2545]: W0525 11:23:28.546223    2545 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
May 25 11:23:28.549857 ip-10-0-128-206 kubenswrapper[2545]: W0525 11:23:28.546226    2545 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
May 25 11:23:28.549857 ip-10-0-128-206 kubenswrapper[2545]: W0525 11:23:28.546229    2545 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
May 25 11:23:28.549857 ip-10-0-128-206 kubenswrapper[2545]: W0525 11:23:28.546231    2545 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
May 25 11:23:28.549857 ip-10-0-128-206 kubenswrapper[2545]: W0525 11:23:28.546234    2545 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
May 25 11:23:28.549857 ip-10-0-128-206 kubenswrapper[2545]: W0525 11:23:28.546236    2545 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
May 25 11:23:28.549857 ip-10-0-128-206 kubenswrapper[2545]: W0525 11:23:28.546239    2545 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
May 25 11:23:28.549857 ip-10-0-128-206 kubenswrapper[2545]: W0525 11:23:28.546241    2545 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
May 25 11:23:28.549857 ip-10-0-128-206 kubenswrapper[2545]: W0525 11:23:28.546244    2545 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
May 25 11:23:28.549857 ip-10-0-128-206 kubenswrapper[2545]: W0525 11:23:28.546247    2545 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
May 25 11:23:28.549857 ip-10-0-128-206 kubenswrapper[2545]: W0525 11:23:28.546249    2545 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
May 25 11:23:28.549857 ip-10-0-128-206 kubenswrapper[2545]: W0525 11:23:28.546252    2545 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
May 25 11:23:28.549857 ip-10-0-128-206 kubenswrapper[2545]: W0525 11:23:28.546254    2545 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
May 25 11:23:28.549857 ip-10-0-128-206 kubenswrapper[2545]: W0525 11:23:28.546257    2545 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
May 25 11:23:28.549857 ip-10-0-128-206 kubenswrapper[2545]: W0525 11:23:28.546260    2545 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
May 25 11:23:28.549857 ip-10-0-128-206 kubenswrapper[2545]: W0525 11:23:28.546262    2545 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
May 25 11:23:28.549857 ip-10-0-128-206 kubenswrapper[2545]: W0525 11:23:28.546265    2545 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
May 25 11:23:28.549857 ip-10-0-128-206 kubenswrapper[2545]: W0525 11:23:28.546267    2545 feature_gate.go:328] unrecognized feature gate: InsightsConfig
May 25 11:23:28.549857 ip-10-0-128-206 kubenswrapper[2545]: W0525 11:23:28.546270    2545 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
May 25 11:23:28.550363 ip-10-0-128-206 kubenswrapper[2545]: W0525 11:23:28.546272    2545 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
May 25 11:23:28.550363 ip-10-0-128-206 kubenswrapper[2545]: W0525 11:23:28.546275    2545 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI
May 25 11:23:28.550363 ip-10-0-128-206 kubenswrapper[2545]: W0525 11:23:28.546277    2545 feature_gate.go:328] unrecognized feature gate: DualReplica
May 25 11:23:28.550363 ip-10-0-128-206 kubenswrapper[2545]: W0525 11:23:28.546280    2545 feature_gate.go:328] unrecognized feature gate: GatewayAPI
May 25 11:23:28.550363 ip-10-0-128-206 kubenswrapper[2545]: W0525 11:23:28.546283    2545 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
May 25 11:23:28.550363 ip-10-0-128-206 kubenswrapper[2545]: W0525 11:23:28.546286    2545 feature_gate.go:328] unrecognized feature gate: SignatureStores
May 25 11:23:28.550363 ip-10-0-128-206 kubenswrapper[2545]: W0525 11:23:28.546289    2545 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
May 25 11:23:28.550363 ip-10-0-128-206 kubenswrapper[2545]: W0525 11:23:28.546292    2545 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
May 25 11:23:28.550363 ip-10-0-128-206 kubenswrapper[2545]: W0525 11:23:28.546294    2545 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
May 25 11:23:28.550363 ip-10-0-128-206 kubenswrapper[2545]: W0525 11:23:28.546297    2545 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController
May 25 11:23:28.550363 ip-10-0-128-206 kubenswrapper[2545]: W0525 11:23:28.546299    2545 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
May 25 11:23:28.550363 ip-10-0-128-206 kubenswrapper[2545]: W0525 11:23:28.546302    2545 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
May 25 11:23:28.550363 ip-10-0-128-206 kubenswrapper[2545]: W0525 11:23:28.546304    2545 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
May 25 11:23:28.550363 ip-10-0-128-206 kubenswrapper[2545]: W0525 11:23:28.546307    2545 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
May 25 11:23:28.550363 ip-10-0-128-206 kubenswrapper[2545]: W0525 11:23:28.546309    2545 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
May 25 11:23:28.550363 ip-10-0-128-206 kubenswrapper[2545]: W0525 11:23:28.546312    2545 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
May 25 11:23:28.550363 ip-10-0-128-206 kubenswrapper[2545]: W0525 11:23:28.546314    2545 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
May 25 11:23:28.550363 ip-10-0-128-206 kubenswrapper[2545]: W0525 11:23:28.546317    2545 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
May 25 11:23:28.550363 ip-10-0-128-206 kubenswrapper[2545]: W0525 11:23:28.546319    2545 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
May 25 11:23:28.550860 ip-10-0-128-206 kubenswrapper[2545]: W0525 11:23:28.546323    2545 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
May 25 11:23:28.550860 ip-10-0-128-206 kubenswrapper[2545]: W0525 11:23:28.546326    2545 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
May 25 11:23:28.550860 ip-10-0-128-206 kubenswrapper[2545]: W0525 11:23:28.546329    2545 feature_gate.go:328] unrecognized feature gate: Example
May 25 11:23:28.550860 ip-10-0-128-206 kubenswrapper[2545]: W0525 11:23:28.546331    2545 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
May 25 11:23:28.550860 ip-10-0-128-206 kubenswrapper[2545]: W0525 11:23:28.546334    2545 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
May 25 11:23:28.550860 ip-10-0-128-206 kubenswrapper[2545]: W0525 11:23:28.546337    2545 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
May 25 11:23:28.550860 ip-10-0-128-206 kubenswrapper[2545]: W0525 11:23:28.546339    2545 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
May 25 11:23:28.550860 ip-10-0-128-206 kubenswrapper[2545]: W0525 11:23:28.546342    2545 feature_gate.go:328] unrecognized feature gate: Example2
May 25 11:23:28.550860 ip-10-0-128-206 kubenswrapper[2545]: W0525 11:23:28.546344    2545 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
May 25 11:23:28.550860 ip-10-0-128-206 kubenswrapper[2545]: W0525 11:23:28.546348    2545 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
May 25 11:23:28.550860 ip-10-0-128-206 kubenswrapper[2545]: W0525 11:23:28.546351    2545 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
May 25 11:23:28.550860 ip-10-0-128-206 kubenswrapper[2545]: W0525 11:23:28.546354    2545 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
May 25 11:23:28.550860 ip-10-0-128-206 kubenswrapper[2545]: W0525 11:23:28.546356    2545 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
May 25 11:23:28.550860 ip-10-0-128-206 kubenswrapper[2545]: W0525 11:23:28.546359    2545 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
May 25 11:23:28.550860 ip-10-0-128-206 kubenswrapper[2545]: W0525 11:23:28.546361    2545 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
May 25 11:23:28.550860 ip-10-0-128-206 kubenswrapper[2545]: W0525 11:23:28.546364    2545 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
May 25 11:23:28.550860 ip-10-0-128-206 kubenswrapper[2545]: W0525 11:23:28.546367    2545 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
May 25 11:23:28.550860 ip-10-0-128-206 kubenswrapper[2545]: W0525 11:23:28.546369    2545 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
May 25 11:23:28.550860 ip-10-0-128-206 kubenswrapper[2545]: W0525 11:23:28.546372    2545 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
May 25 11:23:28.551424 ip-10-0-128-206 kubenswrapper[2545]: W0525 11:23:28.546375    2545 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
May 25 11:23:28.551424 ip-10-0-128-206 kubenswrapper[2545]: W0525 11:23:28.546378    2545 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
May 25 11:23:28.551424 ip-10-0-128-206 kubenswrapper[2545]: W0525 11:23:28.546380    2545 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
May 25 11:23:28.551424 ip-10-0-128-206 kubenswrapper[2545]: W0525 11:23:28.546383    2545 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
May 25 11:23:28.551424 ip-10-0-128-206 kubenswrapper[2545]: W0525 11:23:28.546385    2545 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
May 25 11:23:28.551424 ip-10-0-128-206 kubenswrapper[2545]: W0525 11:23:28.546388    2545 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
May 25 11:23:28.551424 ip-10-0-128-206 kubenswrapper[2545]: W0525 11:23:28.546390    2545 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
May 25 11:23:28.551424 ip-10-0-128-206 kubenswrapper[2545]: W0525 11:23:28.546393    2545 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
May 25 11:23:28.551424 ip-10-0-128-206 kubenswrapper[2545]: W0525 11:23:28.546395    2545 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
May 25 11:23:28.551424 ip-10-0-128-206 kubenswrapper[2545]: W0525 11:23:28.546398    2545 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
May 25 11:23:28.551424 ip-10-0-128-206 kubenswrapper[2545]: W0525 11:23:28.546400    2545 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
May 25 11:23:28.551424 ip-10-0-128-206 kubenswrapper[2545]: W0525 11:23:28.546403    2545 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
May 25 11:23:28.551424 ip-10-0-128-206 kubenswrapper[2545]: W0525 11:23:28.546405    2545 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
May 25 11:23:28.551424 ip-10-0-128-206 kubenswrapper[2545]: W0525 11:23:28.546408    2545 feature_gate.go:328] unrecognized feature gate: OVNObservability
May 25 11:23:28.551424 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:23:28.546413    2545 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]}
May 25 11:23:28.551424 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:23:28.546545    2545 server.go:962] "Client rotation is on, will bootstrap in background"
May 25 11:23:28.551840 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:23:28.551544    2545 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
May 25 11:23:28.552364 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:23:28.552352    2545 server.go:1019] "Starting client certificate rotation"
May 25 11:23:28.552471 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:23:28.552455    2545 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
May 25 11:23:28.552508 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:23:28.552498    2545 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
May 25 11:23:28.574098 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:23:28.574073    2545 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
May 25 11:23:28.577899 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:23:28.577872    2545 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
May 25 11:23:28.589425 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:23:28.589400    2545 log.go:25] "Validated CRI v1 runtime API"
May 25 11:23:28.594861 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:23:28.594841    2545 log.go:25] "Validated CRI v1 image API"
May 25 11:23:28.596260 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:23:28.596242    2545 server.go:1452] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
May 25 11:23:28.602191 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:23:28.602166    2545 fs.go:135] Filesystem UUIDs: map[027e7340-557d-47e4-adc3-8440f106bc9c:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2 eb2f6afb-b09f-40f7-9b32-10dc1cbd79cd:/dev/nvme0n1p4]
May 25 11:23:28.602297 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:23:28.602189    2545 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
May 25 11:23:28.605149 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:23:28.605125    2545 reflector.go:430] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
May 25 11:23:28.606626 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:23:28.606502    2545 manager.go:217] Machine: {Timestamp:2026-05-25 11:23:28.605980557 +0000 UTC m=+0.372265495 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3099900 MemoryCapacity:33164496896 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2af1ab1e79501388df6b358fd4e577 SystemUUID:ec2af1ab-1e79-5013-88df-6b358fd4e577 BootID:a6572a9c-305a-43d5-8e94-967f90bf3ca4 Filesystems:[{Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6103040 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:46:31:d3:ea:c1 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:46:31:d3:ea:c1 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:e2:ec:e7:29:c5:12 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164496896 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
May 25 11:23:28.607369 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:23:28.607355    2545 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
May 25 11:23:28.607485 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:23:28.607469    2545 manager.go:233] Version: {KernelVersion:5.14.0-570.114.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260512-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
May 25 11:23:28.609512 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:23:28.609481    2545 container_manager_linux.go:270] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
May 25 11:23:28.609685 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:23:28.609515    2545 container_manager_linux.go:275] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-128-206.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
May 25 11:23:28.609762 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:23:28.609699    2545 topology_manager.go:138] "Creating topology manager with none policy"
May 25 11:23:28.609762 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:23:28.609712    2545 container_manager_linux.go:306] "Creating device plugin manager"
May 25 11:23:28.609762 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:23:28.609723    2545 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
May 25 11:23:28.610358 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:23:28.610345    2545 server.go:72] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
May 25 11:23:28.611969 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:23:28.611946    2545 state_mem.go:36] "Initialized new in-memory state store"
May 25 11:23:28.612102 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:23:28.612092    2545 server.go:1267] "Using root directory" path="/var/lib/kubelet"
May 25 11:23:28.614923 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:23:28.614910    2545 kubelet.go:491] "Attempting to sync node with API server"
May 25 11:23:28.615011 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:23:28.614931    2545 kubelet.go:386] "Adding static pod path" path="/etc/kubernetes/manifests"
May 25 11:23:28.615062 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:23:28.615056    2545 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
May 25 11:23:28.615110 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:23:28.615080    2545 kubelet.go:397] "Adding apiserver pod source"
May 25 11:23:28.615110 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:23:28.615094    2545 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
May 25 11:23:28.616182 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:23:28.616169    2545 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
May 25 11:23:28.616259 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:23:28.616192    2545 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
May 25 11:23:28.618693 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:23:28.618675    2545 kuberuntime_manager.go:279] "Container runtime initialized" containerRuntime="cri-o" version="1.33.11-2.rhaos4.20.gitb2a8320.el9" apiVersion="v1"
May 25 11:23:28.621039 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:23:28.621024    2545 kubelet.go:953] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
May 25 11:23:28.621891 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:23:28.621876    2545 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
May 25 11:23:28.621939 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:23:28.621900    2545 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
May 25 11:23:28.621939 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:23:28.621908    2545 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
May 25 11:23:28.621939 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:23:28.621917    2545 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
May 25 11:23:28.621939 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:23:28.621929    2545 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
May 25 11:23:28.621939 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:23:28.621938    2545 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/secret"
May 25 11:23:28.622087 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:23:28.621947    2545 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
May 25 11:23:28.622087 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:23:28.621974    2545 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
May 25 11:23:28.622087 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:23:28.621985    2545 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/fc"
May 25 11:23:28.622087 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:23:28.621993    2545 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
May 25 11:23:28.622087 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:23:28.622004    2545 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/projected"
May 25 11:23:28.622217 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:23:28.622110    2545 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
May 25 11:23:28.622803 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:23:28.622792    2545 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/csi"
May 25 11:23:28.622832 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:23:28.622805    2545 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/image"
May 25 11:23:28.626079 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:23:28.626062    2545 csi_plugin.go:988] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-128-206.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
May 25 11:23:28.626139 ip-10-0-128-206 kubenswrapper[2545]: E0525 11:23:28.626086    2545 reflector.go:200] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-128-206.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
May 25 11:23:28.626139 ip-10-0-128-206 kubenswrapper[2545]: E0525 11:23:28.626095    2545 reflector.go:200] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
May 25 11:23:28.626205 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:23:28.626172    2545 watchdog_linux.go:99] "Systemd watchdog is not enabled"
May 25 11:23:28.626233 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:23:28.626207    2545 server.go:1295] "Started kubelet"
May 25 11:23:28.626316 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:23:28.626268    2545 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
May 25 11:23:28.626372 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:23:28.626308    2545 ratelimit.go:55] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
May 25 11:23:28.626372 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:23:28.626354    2545 server_v1.go:47] "podresources" method="list" useActivePods=true
May 25 11:23:28.627248 ip-10-0-128-206 systemd[1]: Started Kubernetes Kubelet.
May 25 11:23:28.627809 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:23:28.627354    2545 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-jpqsp"
May 25 11:23:28.627809 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:23:28.627618    2545 server.go:255] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
May 25 11:23:28.632806 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:23:28.632677    2545 server.go:317] "Adding debug handlers to kubelet server"
May 25 11:23:28.635973 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:23:28.635936    2545 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-jpqsp"
May 25 11:23:28.637795 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:23:28.637774    2545 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
May 25 11:23:28.637795 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:23:28.637776    2545 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
May 25 11:23:28.637972 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:23:28.637846    2545 volume_manager.go:295] "The desired_state_of_world populator starts"
May 25 11:23:28.637972 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:23:28.637856    2545 volume_manager.go:297] "Starting Kubelet Volume Manager"
May 25 11:23:28.638079 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:23:28.638018    2545 desired_state_of_world_populator.go:150] "Desired state populator starts to run"
May 25 11:23:28.638079 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:23:28.638062    2545 reconstruct.go:97] "Volume reconstruction finished"
May 25 11:23:28.638079 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:23:28.638068    2545 reconciler.go:26] "Reconciler: start to sync state"
May 25 11:23:28.638462 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:23:28.638438    2545 factory.go:55] Registering systemd factory
May 25 11:23:28.638528 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:23:28.638495    2545 factory.go:223] Registration of the systemd container factory successfully
May 25 11:23:28.638567 ip-10-0-128-206 kubenswrapper[2545]: E0525 11:23:28.638536    2545 kubelet.go:1618] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
May 25 11:23:28.638946 ip-10-0-128-206 kubenswrapper[2545]: E0525 11:23:28.638921    2545 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-128-206.ec2.internal\" not found"
May 25 11:23:28.639199 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:23:28.639181    2545 factory.go:153] Registering CRI-O factory
May 25 11:23:28.639271 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:23:28.639201    2545 factory.go:223] Registration of the crio container factory successfully
May 25 11:23:28.639271 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:23:28.639258    2545 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
May 25 11:23:28.639360 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:23:28.639278    2545 factory.go:103] Registering Raw factory
May 25 11:23:28.639360 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:23:28.639294    2545 manager.go:1196] Started watching for new ooms in manager
May 25 11:23:28.639872 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:23:28.639855    2545 manager.go:319] Starting recovery of all containers
May 25 11:23:28.639872 ip-10-0-128-206 kubenswrapper[2545]: E0525 11:23:28.638903    2545 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-128-206.ec2.internal.18b2cb2fbb02a30a  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-128-206.ec2.internal,UID:ip-10-0-128-206.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-128-206.ec2.internal,},FirstTimestamp:2026-05-25 11:23:28.626180874 +0000 UTC m=+0.392465811,LastTimestamp:2026-05-25 11:23:28.626180874 +0000 UTC m=+0.392465811,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-128-206.ec2.internal,}"
May 25 11:23:28.641743 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:23:28.641715    2545 reflector.go:430] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
May 25 11:23:28.643528 ip-10-0-128-206 kubenswrapper[2545]: E0525 11:23:28.643504    2545 nodelease.go:49] "Failed to get node when trying to set owner ref to the node lease" err="nodes \"ip-10-0-128-206.ec2.internal\" not found" node="ip-10-0-128-206.ec2.internal"
May 25 11:23:28.650666 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:23:28.650524    2545 manager.go:324] Recovery completed
May 25 11:23:28.654965 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:23:28.654940    2545 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach"
May 25 11:23:28.656707 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:23:28.656693    2545 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-128-206.ec2.internal" event="NodeHasSufficientMemory"
May 25 11:23:28.656765 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:23:28.656722    2545 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-128-206.ec2.internal" event="NodeHasNoDiskPressure"
May 25 11:23:28.656765 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:23:28.656736    2545 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-128-206.ec2.internal" event="NodeHasSufficientPID"
May 25 11:23:28.657283 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:23:28.657268    2545 cpu_manager.go:222] "Starting CPU manager" policy="none"
May 25 11:23:28.657323 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:23:28.657282    2545 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
May 25 11:23:28.657323 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:23:28.657299    2545 state_mem.go:36] "Initialized new in-memory state store"
May 25 11:23:28.661236 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:23:28.661222    2545 policy_none.go:49] "None policy: Start"
May 25 11:23:28.661297 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:23:28.661249    2545 memory_manager.go:186] "Starting memorymanager" policy="None"
May 25 11:23:28.661297 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:23:28.661261    2545 state_mem.go:35] "Initializing new in-memory state store"
May 25 11:23:28.715061 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:23:28.695546    2545 manager.go:341] "Starting Device Plugin manager"
May 25 11:23:28.715061 ip-10-0-128-206 kubenswrapper[2545]: E0525 11:23:28.695584    2545 manager.go:517] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
May 25 11:23:28.715061 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:23:28.695593    2545 server.go:85] "Starting device plugin registration server"
May 25 11:23:28.715061 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:23:28.695866    2545 eviction_manager.go:189] "Eviction manager: starting control loop"
May 25 11:23:28.715061 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:23:28.695880    2545 container_log_manager.go:189] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
May 25 11:23:28.715061 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:23:28.696007    2545 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
May 25 11:23:28.715061 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:23:28.696107    2545 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
May 25 11:23:28.715061 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:23:28.696117    2545 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
May 25 11:23:28.715061 ip-10-0-128-206 kubenswrapper[2545]: E0525 11:23:28.696550    2545 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
May 25 11:23:28.715061 ip-10-0-128-206 kubenswrapper[2545]: E0525 11:23:28.696588    2545 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-128-206.ec2.internal\" not found"
May 25 11:23:28.768277 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:23:28.768234    2545 kubelet_network_linux.go:49] "Initialized iptables rules." protocol="IPv4"
May 25 11:23:28.769520 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:23:28.769503    2545 kubelet_network_linux.go:49] "Initialized iptables rules." protocol="IPv6"
May 25 11:23:28.769581 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:23:28.769532    2545 status_manager.go:230] "Starting to sync pod status with apiserver"
May 25 11:23:28.769581 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:23:28.769554    2545 watchdog_linux.go:127] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
May 25 11:23:28.769581 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:23:28.769562    2545 kubelet.go:2451] "Starting kubelet main sync loop"
May 25 11:23:28.769682 ip-10-0-128-206 kubenswrapper[2545]: E0525 11:23:28.769602    2545 kubelet.go:2475] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
May 25 11:23:28.775351 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:23:28.775322    2545 reflector.go:430] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
May 25 11:23:28.796775 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:23:28.796701    2545 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach"
May 25 11:23:28.797712 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:23:28.797693    2545 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-128-206.ec2.internal" event="NodeHasSufficientMemory"
May 25 11:23:28.797819 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:23:28.797726    2545 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-128-206.ec2.internal" event="NodeHasNoDiskPressure"
May 25 11:23:28.797819 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:23:28.797742    2545 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-128-206.ec2.internal" event="NodeHasSufficientPID"
May 25 11:23:28.797819 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:23:28.797766    2545 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-128-206.ec2.internal"
May 25 11:23:28.805789 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:23:28.805771    2545 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-128-206.ec2.internal"
May 25 11:23:28.805850 ip-10-0-128-206 kubenswrapper[2545]: E0525 11:23:28.805796    2545 kubelet_node_status.go:597] "Error updating node status, will retry" err="error getting node \"ip-10-0-128-206.ec2.internal\": node \"ip-10-0-128-206.ec2.internal\" not found"
May 25 11:23:28.824922 ip-10-0-128-206 kubenswrapper[2545]: E0525 11:23:28.824896    2545 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-128-206.ec2.internal\" not found"
May 25 11:23:28.870682 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:23:28.870636    2545 kubelet.go:2537] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-206.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-128-206.ec2.internal"]
May 25 11:23:28.870750 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:23:28.870735    2545 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach"
May 25 11:23:28.871681 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:23:28.871664    2545 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-128-206.ec2.internal" event="NodeHasSufficientMemory"
May 25 11:23:28.871777 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:23:28.871691    2545 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-128-206.ec2.internal" event="NodeHasNoDiskPressure"
May 25 11:23:28.871777 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:23:28.871702    2545 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-128-206.ec2.internal" event="NodeHasSufficientPID"
May 25 11:23:28.873942 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:23:28.873927    2545 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach"
May 25 11:23:28.874115 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:23:28.874099    2545 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-206.ec2.internal"
May 25 11:23:28.874179 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:23:28.874139    2545 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach"
May 25 11:23:28.874678 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:23:28.874662    2545 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-128-206.ec2.internal" event="NodeHasSufficientMemory"
May 25 11:23:28.874749 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:23:28.874688    2545 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-128-206.ec2.internal" event="NodeHasNoDiskPressure"
May 25 11:23:28.874749 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:23:28.874700    2545 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-128-206.ec2.internal" event="NodeHasSufficientPID"
May 25 11:23:28.874749 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:23:28.874716    2545 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-128-206.ec2.internal" event="NodeHasSufficientMemory"
May 25 11:23:28.874749 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:23:28.874739    2545 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-128-206.ec2.internal" event="NodeHasNoDiskPressure"
May 25 11:23:28.874951 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:23:28.874752    2545 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-128-206.ec2.internal" event="NodeHasSufficientPID"
May 25 11:23:28.876818 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:23:28.876798    2545 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-206.ec2.internal"
May 25 11:23:28.876873 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:23:28.876830    2545 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach"
May 25 11:23:28.877486 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:23:28.877472    2545 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-128-206.ec2.internal" event="NodeHasSufficientMemory"
May 25 11:23:28.877543 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:23:28.877497    2545 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-128-206.ec2.internal" event="NodeHasNoDiskPressure"
May 25 11:23:28.877543 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:23:28.877511    2545 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-128-206.ec2.internal" event="NodeHasSufficientPID"
May 25 11:23:28.894695 ip-10-0-128-206 kubenswrapper[2545]: E0525 11:23:28.894669    2545 kubelet.go:3336] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-128-206.ec2.internal\" not found" node="ip-10-0-128-206.ec2.internal"
May 25 11:23:28.898929 ip-10-0-128-206 kubenswrapper[2545]: E0525 11:23:28.898912    2545 kubelet.go:3336] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-128-206.ec2.internal\" not found" node="ip-10-0-128-206.ec2.internal"
May 25 11:23:28.925693 ip-10-0-128-206 kubenswrapper[2545]: E0525 11:23:28.925670    2545 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-128-206.ec2.internal\" not found"
May 25 11:23:28.940015 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:23:28.939993    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/a6772c4d9844f0928036a579dcf5d882-config\") pod \"kube-apiserver-proxy-ip-10-0-128-206.ec2.internal\" (UID: \"a6772c4d9844f0928036a579dcf5d882\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-128-206.ec2.internal"
May 25 11:23:28.940140 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:23:28.940021    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/dafcffec46e93c961979dd9c978f3fcd-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-128-206.ec2.internal\" (UID: \"dafcffec46e93c961979dd9c978f3fcd\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-206.ec2.internal"
May 25 11:23:28.940140 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:23:28.940039    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/dafcffec46e93c961979dd9c978f3fcd-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-128-206.ec2.internal\" (UID: \"dafcffec46e93c961979dd9c978f3fcd\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-206.ec2.internal"
May 25 11:23:29.026757 ip-10-0-128-206 kubenswrapper[2545]: E0525 11:23:29.026714    2545 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-128-206.ec2.internal\" not found"
May 25 11:23:29.041081 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:23:29.041061    2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/dafcffec46e93c961979dd9c978f3fcd-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-128-206.ec2.internal\" (UID: \"dafcffec46e93c961979dd9c978f3fcd\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-206.ec2.internal"
May 25 11:23:29.041150 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:23:29.041089    2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/dafcffec46e93c961979dd9c978f3fcd-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-128-206.ec2.internal\" (UID: \"dafcffec46e93c961979dd9c978f3fcd\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-206.ec2.internal"
May 25 11:23:29.041150 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:23:29.041107    2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/a6772c4d9844f0928036a579dcf5d882-config\") pod \"kube-apiserver-proxy-ip-10-0-128-206.ec2.internal\" (UID: \"a6772c4d9844f0928036a579dcf5d882\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-128-206.ec2.internal"
May 25 11:23:29.041224 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:23:29.041147    2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/a6772c4d9844f0928036a579dcf5d882-config\") pod \"kube-apiserver-proxy-ip-10-0-128-206.ec2.internal\" (UID: \"a6772c4d9844f0928036a579dcf5d882\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-128-206.ec2.internal"
May 25 11:23:29.041224 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:23:29.041178    2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/dafcffec46e93c961979dd9c978f3fcd-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-128-206.ec2.internal\" (UID: \"dafcffec46e93c961979dd9c978f3fcd\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-206.ec2.internal"
May 25 11:23:29.041224 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:23:29.041178    2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/dafcffec46e93c961979dd9c978f3fcd-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-128-206.ec2.internal\" (UID: \"dafcffec46e93c961979dd9c978f3fcd\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-206.ec2.internal"
May 25 11:23:29.127589 ip-10-0-128-206 kubenswrapper[2545]: E0525 11:23:29.127498    2545 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-128-206.ec2.internal\" not found"
May 25 11:23:29.197997 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:23:29.197981    2545 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-206.ec2.internal"
May 25 11:23:29.201634 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:23:29.201603    2545 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-206.ec2.internal"
May 25 11:23:29.227758 ip-10-0-128-206 kubenswrapper[2545]: E0525 11:23:29.227729    2545 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-128-206.ec2.internal\" not found"
May 25 11:23:29.328243 ip-10-0-128-206 kubenswrapper[2545]: E0525 11:23:29.328197    2545 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-128-206.ec2.internal\" not found"
May 25 11:23:29.428750 ip-10-0-128-206 kubenswrapper[2545]: E0525 11:23:29.428680    2545 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-128-206.ec2.internal\" not found"
May 25 11:23:29.529252 ip-10-0-128-206 kubenswrapper[2545]: E0525 11:23:29.529217    2545 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-128-206.ec2.internal\" not found"
May 25 11:23:29.552696 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:23:29.552667    2545 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
May 25 11:23:29.553217 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:23:29.552844    2545 reflector.go:556] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
May 25 11:23:29.553217 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:23:29.552866    2545 reflector.go:556] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
May 25 11:23:29.629751 ip-10-0-128-206 kubenswrapper[2545]: E0525 11:23:29.629719    2545 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-128-206.ec2.internal\" not found"
May 25 11:23:29.637747 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:23:29.637708    2545 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-05-24 11:18:28 +0000 UTC" deadline="2027-11-10 08:54:29.021422212 +0000 UTC"
May 25 11:23:29.637747 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:23:29.637743    2545 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="12813h30m59.38368316s"
May 25 11:23:29.637932 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:23:29.637915    2545 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
May 25 11:23:29.649915 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:23:29.649888    2545 reflector.go:430] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
May 25 11:23:29.683285 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:23:29.683201    2545 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-8jxjg"
May 25 11:23:29.690972 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:23:29.690939    2545 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-8jxjg"
May 25 11:23:29.728814 ip-10-0-128-206 kubenswrapper[2545]: W0525 11:23:29.728768    2545 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda6772c4d9844f0928036a579dcf5d882.slice/crio-b7066b555f9b57785dd64cb5acc35d13044eceae6d8ecf17693dac36724f7b3e WatchSource:0}: Error finding container b7066b555f9b57785dd64cb5acc35d13044eceae6d8ecf17693dac36724f7b3e: Status 404 returned error can't find the container with id b7066b555f9b57785dd64cb5acc35d13044eceae6d8ecf17693dac36724f7b3e
May 25 11:23:29.729851 ip-10-0-128-206 kubenswrapper[2545]: E0525 11:23:29.729828    2545 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-128-206.ec2.internal\" not found"
May 25 11:23:29.733872 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:23:29.733858    2545 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
May 25 11:23:29.753513 ip-10-0-128-206 kubenswrapper[2545]: W0525 11:23:29.753486    2545 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddafcffec46e93c961979dd9c978f3fcd.slice/crio-d9588327a9a164bd3ff076976bdea786a349c09ee955128fb0bec35e0dd54292 WatchSource:0}: Error finding container d9588327a9a164bd3ff076976bdea786a349c09ee955128fb0bec35e0dd54292: Status 404 returned error can't find the container with id d9588327a9a164bd3ff076976bdea786a349c09ee955128fb0bec35e0dd54292
May 25 11:23:29.772902 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:23:29.772850    2545 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-206.ec2.internal" event={"ID":"dafcffec46e93c961979dd9c978f3fcd","Type":"ContainerStarted","Data":"d9588327a9a164bd3ff076976bdea786a349c09ee955128fb0bec35e0dd54292"}
May 25 11:23:29.773715 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:23:29.773692    2545 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-206.ec2.internal" event={"ID":"a6772c4d9844f0928036a579dcf5d882","Type":"ContainerStarted","Data":"b7066b555f9b57785dd64cb5acc35d13044eceae6d8ecf17693dac36724f7b3e"}
May 25 11:23:29.830926 ip-10-0-128-206 kubenswrapper[2545]: E0525 11:23:29.830878    2545 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-128-206.ec2.internal\" not found"
May 25 11:23:29.931367 ip-10-0-128-206 kubenswrapper[2545]: E0525 11:23:29.931324    2545 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-128-206.ec2.internal\" not found"
May 25 11:23:30.031913 ip-10-0-128-206 kubenswrapper[2545]: E0525 11:23:30.031822    2545 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-128-206.ec2.internal\" not found"
May 25 11:23:30.131996 ip-10-0-128-206 kubenswrapper[2545]: E0525 11:23:30.131952    2545 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-128-206.ec2.internal\" not found"
May 25 11:23:30.135188 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:23:30.135163    2545 reflector.go:430] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
May 25 11:23:30.172191 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:23:30.172160    2545 reflector.go:430] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
May 25 11:23:30.238901 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:23:30.238874    2545 kubelet.go:3340] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-206.ec2.internal"
May 25 11:23:30.254001 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:23:30.253968    2545 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
May 25 11:23:30.254941 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:23:30.254912    2545 kubelet.go:3340] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-206.ec2.internal"
May 25 11:23:30.263774 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:23:30.263744    2545 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
May 25 11:23:30.616337 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:23:30.616303    2545 apiserver.go:52] "Watching apiserver"
May 25 11:23:30.624686 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:23:30.624660    2545 reflector.go:430] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
May 25 11:23:30.626897 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:23:30.626869    2545 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ktzgh","openshift-dns/node-resolver-nkmp2","openshift-image-registry/node-ca-296nq","openshift-multus/multus-additional-cni-plugins-cgxtl","openshift-multus/network-metrics-daemon-cvfxv","openshift-network-diagnostics/network-check-target-vnft7","openshift-network-operator/iptables-alerter-znjmm","kube-system/kube-apiserver-proxy-ip-10-0-128-206.ec2.internal","openshift-cluster-node-tuning-operator/tuned-qsdv7","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-206.ec2.internal","openshift-multus/multus-mppq2","openshift-ovn-kubernetes/ovnkube-node-krfmt","kube-system/konnectivity-agent-k89nm"]
May 25 11:23:30.629526 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:23:30.629504    2545 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vnft7"
May 25 11:23:30.629622 ip-10-0-128-206 kubenswrapper[2545]: E0525 11:23:30.629593    2545 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vnft7" podUID="36dcd564-65d2-4f2e-82d7-8c8af53ca015"
May 25 11:23:30.632223 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:23:30.632155    2545 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-krfmt"
May 25 11:23:30.634895 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:23:30.634610    2545 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-znjmm"
May 25 11:23:30.635010 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:23:30.634993    2545 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
May 25 11:23:30.635058 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:23:30.635017    2545 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-8d5hd\""
May 25 11:23:30.636194 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:23:30.636166    2545 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
May 25 11:23:30.636194 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:23:30.636169    2545 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
May 25 11:23:30.636330 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:23:30.636217    2545 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
May 25 11:23:30.636330 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:23:30.636225    2545 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
May 25 11:23:30.636419 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:23:30.636326    2545 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
May 25 11:23:30.636822 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:23:30.636802    2545 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
May 25 11:23:30.637073 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:23:30.637043    2545 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
May 25 11:23:30.637459 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:23:30.637342    2545 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-dkbgs\""
May 25 11:23:30.637459 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:23:30.637368    2545 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
May 25 11:23:30.637590 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:23:30.637563    2545 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-cgxtl"
May 25 11:23:30.640053 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:23:30.640002    2545 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
May 25 11:23:30.640053 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:23:30.640035    2545 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-4nhb9\""
May 25 11:23:30.640053 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:23:30.640046    2545 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
May 25 11:23:30.640245 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:23:30.640093    2545 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
May 25 11:23:30.640245 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:23:30.640106    2545 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
May 25 11:23:30.640245 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:23:30.640219    2545 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
May 25 11:23:30.640627 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:23:30.640606    2545 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cvfxv"
May 25 11:23:30.640706 ip-10-0-128-206 kubenswrapper[2545]: E0525 11:23:30.640671    2545 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cvfxv" podUID="3872d4b9-e2c4-40ab-8fee-706d08118a88"
May 25 11:23:30.642967 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:23:30.642932    2545 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ktzgh"
May 25 11:23:30.645340 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:23:30.645308    2545 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-296nq"
May 25 11:23:30.645470 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:23:30.645429    2545 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
May 25 11:23:30.645564 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:23:30.645547    2545 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
May 25 11:23:30.645646 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:23:30.645618    2545 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-p4pbr\""
May 25 11:23:30.645697 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:23:30.645675    2545 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
May 25 11:23:30.647871 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:23:30.647720    2545 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-qsdv7"
May 25 11:23:30.647871 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:23:30.647790    2545 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
May 25 11:23:30.647871 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:23:30.647816    2545 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-p9qdl\""
May 25 11:23:30.648268 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:23:30.648245    2545 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
May 25 11:23:30.648365 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:23:30.648308    2545 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
May 25 11:23:30.649203 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:23:30.649180    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/0e95b3fe-d141-4227-80df-1b6f63fc89db-system-cni-dir\") pod \"multus-additional-cni-plugins-cgxtl\" (UID: \"0e95b3fe-d141-4227-80df-1b6f63fc89db\") " pod="openshift-multus/multus-additional-cni-plugins-cgxtl"
May 25 11:23:30.649304 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:23:30.649219    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/4e27bcd6-c257-422b-a332-0df274cf6fcc-etc-openvswitch\") pod \"ovnkube-node-krfmt\" (UID: \"4e27bcd6-c257-422b-a332-0df274cf6fcc\") " pod="openshift-ovn-kubernetes/ovnkube-node-krfmt"
May 25 11:23:30.649304 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:23:30.649248    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/4e27bcd6-c257-422b-a332-0df274cf6fcc-host-cni-netd\") pod \"ovnkube-node-krfmt\" (UID: \"4e27bcd6-c257-422b-a332-0df274cf6fcc\") " pod="openshift-ovn-kubernetes/ovnkube-node-krfmt"
May 25 11:23:30.649304 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:23:30.649275    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/0e95b3fe-d141-4227-80df-1b6f63fc89db-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-cgxtl\" (UID: \"0e95b3fe-d141-4227-80df-1b6f63fc89db\") " pod="openshift-multus/multus-additional-cni-plugins-cgxtl"
May 25 11:23:30.649458 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:23:30.649303    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/4e27bcd6-c257-422b-a332-0df274cf6fcc-host-kubelet\") pod \"ovnkube-node-krfmt\" (UID: \"4e27bcd6-c257-422b-a332-0df274cf6fcc\") " pod="openshift-ovn-kubernetes/ovnkube-node-krfmt"
May 25 11:23:30.649458 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:23:30.649326    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/4e27bcd6-c257-422b-a332-0df274cf6fcc-run-openvswitch\") pod \"ovnkube-node-krfmt\" (UID: \"4e27bcd6-c257-422b-a332-0df274cf6fcc\") " pod="openshift-ovn-kubernetes/ovnkube-node-krfmt"
May 25 11:23:30.649458 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:23:30.649382    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/4e27bcd6-c257-422b-a332-0df274cf6fcc-run-ovn\") pod \"ovnkube-node-krfmt\" (UID: \"4e27bcd6-c257-422b-a332-0df274cf6fcc\") " pod="openshift-ovn-kubernetes/ovnkube-node-krfmt"
May 25 11:23:30.649458 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:23:30.649414    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/4e27bcd6-c257-422b-a332-0df274cf6fcc-ovnkube-config\") pod \"ovnkube-node-krfmt\" (UID: \"4e27bcd6-c257-422b-a332-0df274cf6fcc\") " pod="openshift-ovn-kubernetes/ovnkube-node-krfmt"
May 25 11:23:30.649622 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:23:30.649460    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/4e27bcd6-c257-422b-a332-0df274cf6fcc-ovn-node-metrics-cert\") pod \"ovnkube-node-krfmt\" (UID: \"4e27bcd6-c257-422b-a332-0df274cf6fcc\") " pod="openshift-ovn-kubernetes/ovnkube-node-krfmt"
May 25 11:23:30.649622 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:23:30.649480    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/4e27bcd6-c257-422b-a332-0df274cf6fcc-systemd-units\") pod \"ovnkube-node-krfmt\" (UID: \"4e27bcd6-c257-422b-a332-0df274cf6fcc\") " pod="openshift-ovn-kubernetes/ovnkube-node-krfmt"
May 25 11:23:30.649622 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:23:30.649501    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/4e27bcd6-c257-422b-a332-0df274cf6fcc-env-overrides\") pod \"ovnkube-node-krfmt\" (UID: \"4e27bcd6-c257-422b-a332-0df274cf6fcc\") " pod="openshift-ovn-kubernetes/ovnkube-node-krfmt"
May 25 11:23:30.649622 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:23:30.649538    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2rldh\" (UniqueName: \"kubernetes.io/projected/52b29f60-937d-4e7d-bd19-e645004caeba-kube-api-access-2rldh\") pod \"iptables-alerter-znjmm\" (UID: \"52b29f60-937d-4e7d-bd19-e645004caeba\") " pod="openshift-network-operator/iptables-alerter-znjmm"
May 25 11:23:30.649622 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:23:30.649562    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zmf2x\" (UniqueName: \"kubernetes.io/projected/0e95b3fe-d141-4227-80df-1b6f63fc89db-kube-api-access-zmf2x\") pod \"multus-additional-cni-plugins-cgxtl\" (UID: \"0e95b3fe-d141-4227-80df-1b6f63fc89db\") " pod="openshift-multus/multus-additional-cni-plugins-cgxtl"
May 25 11:23:30.649622 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:23:30.649586    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-476cp\" (UniqueName: \"kubernetes.io/projected/36dcd564-65d2-4f2e-82d7-8c8af53ca015-kube-api-access-476cp\") pod \"network-check-target-vnft7\" (UID: \"36dcd564-65d2-4f2e-82d7-8c8af53ca015\") " pod="openshift-network-diagnostics/network-check-target-vnft7"
May 25 11:23:30.649622 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:23:30.649610    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/4e27bcd6-c257-422b-a332-0df274cf6fcc-node-log\") pod \"ovnkube-node-krfmt\" (UID: \"4e27bcd6-c257-422b-a332-0df274cf6fcc\") " pod="openshift-ovn-kubernetes/ovnkube-node-krfmt"
May 25 11:23:30.650083 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:23:30.649632    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/52b29f60-937d-4e7d-bd19-e645004caeba-iptables-alerter-script\") pod \"iptables-alerter-znjmm\" (UID: \"52b29f60-937d-4e7d-bd19-e645004caeba\") " pod="openshift-network-operator/iptables-alerter-znjmm"
May 25 11:23:30.650083 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:23:30.649748    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/52b29f60-937d-4e7d-bd19-e645004caeba-host-slash\") pod \"iptables-alerter-znjmm\" (UID: \"52b29f60-937d-4e7d-bd19-e645004caeba\") " pod="openshift-network-operator/iptables-alerter-znjmm"
May 25 11:23:30.650083 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:23:30.649790    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/0e95b3fe-d141-4227-80df-1b6f63fc89db-cni-binary-copy\") pod \"multus-additional-cni-plugins-cgxtl\" (UID: \"0e95b3fe-d141-4227-80df-1b6f63fc89db\") " pod="openshift-multus/multus-additional-cni-plugins-cgxtl"
May 25 11:23:30.650083 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:23:30.649819    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3872d4b9-e2c4-40ab-8fee-706d08118a88-metrics-certs\") pod \"network-metrics-daemon-cvfxv\" (UID: \"3872d4b9-e2c4-40ab-8fee-706d08118a88\") " pod="openshift-multus/network-metrics-daemon-cvfxv"
May 25 11:23:30.650083 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:23:30.649855    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bqvgs\" (UniqueName: \"kubernetes.io/projected/3872d4b9-e2c4-40ab-8fee-706d08118a88-kube-api-access-bqvgs\") pod \"network-metrics-daemon-cvfxv\" (UID: \"3872d4b9-e2c4-40ab-8fee-706d08118a88\") " pod="openshift-multus/network-metrics-daemon-cvfxv"
May 25 11:23:30.650083 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:23:30.649880    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/4e27bcd6-c257-422b-a332-0df274cf6fcc-host-run-netns\") pod \"ovnkube-node-krfmt\" (UID: \"4e27bcd6-c257-422b-a332-0df274cf6fcc\") " pod="openshift-ovn-kubernetes/ovnkube-node-krfmt"
May 25 11:23:30.650083 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:23:30.649935    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4e27bcd6-c257-422b-a332-0df274cf6fcc-host-run-ovn-kubernetes\") pod \"ovnkube-node-krfmt\" (UID: \"4e27bcd6-c257-422b-a332-0df274cf6fcc\") " pod="openshift-ovn-kubernetes/ovnkube-node-krfmt"
May 25 11:23:30.650083 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:23:30.650008    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vxnk7\" (UniqueName: \"kubernetes.io/projected/4e27bcd6-c257-422b-a332-0df274cf6fcc-kube-api-access-vxnk7\") pod \"ovnkube-node-krfmt\" (UID: \"4e27bcd6-c257-422b-a332-0df274cf6fcc\") " pod="openshift-ovn-kubernetes/ovnkube-node-krfmt"
May 25 11:23:30.650083 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:23:30.650033    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/0e95b3fe-d141-4227-80df-1b6f63fc89db-os-release\") pod \"multus-additional-cni-plugins-cgxtl\" (UID: \"0e95b3fe-d141-4227-80df-1b6f63fc89db\") " pod="openshift-multus/multus-additional-cni-plugins-cgxtl"
May 25 11:23:30.650083 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:23:30.650058    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/0e95b3fe-d141-4227-80df-1b6f63fc89db-tuning-conf-dir\") pod \"multus-additional-cni-plugins-cgxtl\" (UID: \"0e95b3fe-d141-4227-80df-1b6f63fc89db\") " pod="openshift-multus/multus-additional-cni-plugins-cgxtl"
May 25 11:23:30.650509 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:23:30.650087    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/0e95b3fe-d141-4227-80df-1b6f63fc89db-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-cgxtl\" (UID: \"0e95b3fe-d141-4227-80df-1b6f63fc89db\") " pod="openshift-multus/multus-additional-cni-plugins-cgxtl"
May 25 11:23:30.650509 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:23:30.650133    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/4e27bcd6-c257-422b-a332-0df274cf6fcc-host-slash\") pod \"ovnkube-node-krfmt\" (UID: \"4e27bcd6-c257-422b-a332-0df274cf6fcc\") " pod="openshift-ovn-kubernetes/ovnkube-node-krfmt"
May 25 11:23:30.650509 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:23:30.650191    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/4e27bcd6-c257-422b-a332-0df274cf6fcc-run-systemd\") pod \"ovnkube-node-krfmt\" (UID: \"4e27bcd6-c257-422b-a332-0df274cf6fcc\") " pod="openshift-ovn-kubernetes/ovnkube-node-krfmt"
May 25 11:23:30.650509 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:23:30.650239    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/4e27bcd6-c257-422b-a332-0df274cf6fcc-log-socket\") pod \"ovnkube-node-krfmt\" (UID: \"4e27bcd6-c257-422b-a332-0df274cf6fcc\") " pod="openshift-ovn-kubernetes/ovnkube-node-krfmt"
May 25 11:23:30.650509 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:23:30.650267    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/4e27bcd6-c257-422b-a332-0df274cf6fcc-var-lib-openvswitch\") pod \"ovnkube-node-krfmt\" (UID: \"4e27bcd6-c257-422b-a332-0df274cf6fcc\") " pod="openshift-ovn-kubernetes/ovnkube-node-krfmt"
May 25 11:23:30.650509 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:23:30.650293    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/4e27bcd6-c257-422b-a332-0df274cf6fcc-host-cni-bin\") pod \"ovnkube-node-krfmt\" (UID: \"4e27bcd6-c257-422b-a332-0df274cf6fcc\") " pod="openshift-ovn-kubernetes/ovnkube-node-krfmt"
May 25 11:23:30.650509 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:23:30.650318    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4e27bcd6-c257-422b-a332-0df274cf6fcc-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-krfmt\" (UID: \"4e27bcd6-c257-422b-a332-0df274cf6fcc\") " pod="openshift-ovn-kubernetes/ovnkube-node-krfmt"
May 25 11:23:30.650509 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:23:30.650361    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/4e27bcd6-c257-422b-a332-0df274cf6fcc-ovnkube-script-lib\") pod \"ovnkube-node-krfmt\" (UID: \"4e27bcd6-c257-422b-a332-0df274cf6fcc\") " pod="openshift-ovn-kubernetes/ovnkube-node-krfmt"
May 25 11:23:30.650509 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:23:30.650407    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/0e95b3fe-d141-4227-80df-1b6f63fc89db-cnibin\") pod \"multus-additional-cni-plugins-cgxtl\" (UID: \"0e95b3fe-d141-4227-80df-1b6f63fc89db\") " pod="openshift-multus/multus-additional-cni-plugins-cgxtl"
May 25 11:23:30.651049 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:23:30.651018    2545 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-mppq2"
May 25 11:23:30.651856 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:23:30.651807    2545 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
May 25 11:23:30.651979 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:23:30.651890    2545 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-khzbd\""
May 25 11:23:30.651979 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:23:30.651922    2545 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
May 25 11:23:30.653391 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:23:30.653373    2545 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-nkmp2"
May 25 11:23:30.653560 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:23:30.653498    2545 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
May 25 11:23:30.654017 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:23:30.654000    2545 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-szzdw\""
May 25 11:23:30.655880 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:23:30.655824    2545 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
May 25 11:23:30.656049 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:23:30.656021    2545 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-k89nm"
May 25 11:23:30.656422 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:23:30.656296    2545 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-6bphw\""
May 25 11:23:30.656530 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:23:30.656451    2545 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
May 25 11:23:30.658306 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:23:30.658289    2545 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
May 25 11:23:30.659213 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:23:30.659195    2545 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-cj8f4\""
May 25 11:23:30.659288 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:23:30.659269    2545 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
May 25 11:23:30.692131 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:23:30.692106    2545 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-05-24 11:18:29 +0000 UTC" deadline="2028-02-24 21:46:12.171771044 +0000 UTC"
May 25 11:23:30.692131 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:23:30.692131    2545 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15370h22m41.47964326s"
May 25 11:23:30.738850 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:23:30.738816    2545 desired_state_of_world_populator.go:158] "Finished populating initial desired state of world"
May 25 11:23:30.751005 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:23:30.750973    2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/0e95b3fe-d141-4227-80df-1b6f63fc89db-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-cgxtl\" (UID: \"0e95b3fe-d141-4227-80df-1b6f63fc89db\") " pod="openshift-multus/multus-additional-cni-plugins-cgxtl"
May 25 11:23:30.751171 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:23:30.751017    2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/4e27bcd6-c257-422b-a332-0df274cf6fcc-host-kubelet\") pod \"ovnkube-node-krfmt\" (UID: \"4e27bcd6-c257-422b-a332-0df274cf6fcc\") " pod="openshift-ovn-kubernetes/ovnkube-node-krfmt"
May 25 11:23:30.751171 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:23:30.751044    2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/4e27bcd6-c257-422b-a332-0df274cf6fcc-run-openvswitch\") pod \"ovnkube-node-krfmt\" (UID: \"4e27bcd6-c257-422b-a332-0df274cf6fcc\") " pod="openshift-ovn-kubernetes/ovnkube-node-krfmt"
May 25 11:23:30.751171 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:23:30.751065    2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/4e27bcd6-c257-422b-a332-0df274cf6fcc-ovnkube-config\") pod \"ovnkube-node-krfmt\" (UID: \"4e27bcd6-c257-422b-a332-0df274cf6fcc\") " pod="openshift-ovn-kubernetes/ovnkube-node-krfmt"
May 25 11:23:30.751171 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:23:30.751090    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/8025c487-c204-4901-97bc-f40fb251d4ba-etc-tuned\") pod \"tuned-qsdv7\" (UID: \"8025c487-c204-4901-97bc-f40fb251d4ba\") " pod="openshift-cluster-node-tuning-operator/tuned-qsdv7"
May 25 11:23:30.751171 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:23:30.751114    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/8d3be6d2-efff-4793-9082-593746afd78c-host-run-netns\") pod \"multus-mppq2\" (UID: \"8d3be6d2-efff-4793-9082-593746afd78c\") " pod="openshift-multus/multus-mppq2"
May 25 11:23:30.751171 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:23:30.751136    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/8d3be6d2-efff-4793-9082-593746afd78c-host-var-lib-cni-bin\") pod \"multus-mppq2\" (UID: \"8d3be6d2-efff-4793-9082-593746afd78c\") " pod="openshift-multus/multus-mppq2"
May 25 11:23:30.751171 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:23:30.751149    2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/4e27bcd6-c257-422b-a332-0df274cf6fcc-run-openvswitch\") pod \"ovnkube-node-krfmt\" (UID: \"4e27bcd6-c257-422b-a332-0df274cf6fcc\") " pod="openshift-ovn-kubernetes/ovnkube-node-krfmt"
May 25 11:23:30.751547 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:23:30.751112    2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/4e27bcd6-c257-422b-a332-0df274cf6fcc-host-kubelet\") pod \"ovnkube-node-krfmt\" (UID: \"4e27bcd6-c257-422b-a332-0df274cf6fcc\") " pod="openshift-ovn-kubernetes/ovnkube-node-krfmt"
May 25 11:23:30.751547 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:23:30.751240    2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/4e27bcd6-c257-422b-a332-0df274cf6fcc-systemd-units\") pod \"ovnkube-node-krfmt\" (UID: \"4e27bcd6-c257-422b-a332-0df274cf6fcc\") " pod="openshift-ovn-kubernetes/ovnkube-node-krfmt"
May 25 11:23:30.751547 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:23:30.751272    2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/4e27bcd6-c257-422b-a332-0df274cf6fcc-systemd-units\") pod \"ovnkube-node-krfmt\" (UID: \"4e27bcd6-c257-422b-a332-0df274cf6fcc\") " pod="openshift-ovn-kubernetes/ovnkube-node-krfmt"
May 25 11:23:30.751547 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:23:30.751286    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8025c487-c204-4901-97bc-f40fb251d4ba-tmp\") pod \"tuned-qsdv7\" (UID: \"8025c487-c204-4901-97bc-f40fb251d4ba\") " pod="openshift-cluster-node-tuning-operator/tuned-qsdv7"
May 25 11:23:30.751547 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:23:30.751313    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/8d3be6d2-efff-4793-9082-593746afd78c-hostroot\") pod \"multus-mppq2\" (UID: \"8d3be6d2-efff-4793-9082-593746afd78c\") " pod="openshift-multus/multus-mppq2"
May 25 11:23:30.751547 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:23:30.751347    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/8d3be6d2-efff-4793-9082-593746afd78c-multus-cni-dir\") pod \"multus-mppq2\" (UID: \"8d3be6d2-efff-4793-9082-593746afd78c\") " pod="openshift-multus/multus-mppq2"
May 25 11:23:30.751547 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:23:30.751392    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/8d3be6d2-efff-4793-9082-593746afd78c-cnibin\") pod \"multus-mppq2\" (UID: \"8d3be6d2-efff-4793-9082-593746afd78c\") " pod="openshift-multus/multus-mppq2"
May 25 11:23:30.751547 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:23:30.751427    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/8d3be6d2-efff-4793-9082-593746afd78c-os-release\") pod \"multus-mppq2\" (UID: \"8d3be6d2-efff-4793-9082-593746afd78c\") " pod="openshift-multus/multus-mppq2"
May 25 11:23:30.751547 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:23:30.751455    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/8d3be6d2-efff-4793-9082-593746afd78c-multus-daemon-config\") pod \"multus-mppq2\" (UID: \"8d3be6d2-efff-4793-9082-593746afd78c\") " pod="openshift-multus/multus-mppq2"
May 25 11:23:30.751547 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:23:30.751480    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/8025c487-c204-4901-97bc-f40fb251d4ba-sys\") pod \"tuned-qsdv7\" (UID: \"8025c487-c204-4901-97bc-f40fb251d4ba\") " pod="openshift-cluster-node-tuning-operator/tuned-qsdv7"
May 25 11:23:30.751547 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:23:30.751504    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/8025c487-c204-4901-97bc-f40fb251d4ba-host\") pod \"tuned-qsdv7\" (UID: \"8025c487-c204-4901-97bc-f40fb251d4ba\") " pod="openshift-cluster-node-tuning-operator/tuned-qsdv7"
May 25 11:23:30.751547 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:23:30.751528    2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/52b29f60-937d-4e7d-bd19-e645004caeba-host-slash\") pod \"iptables-alerter-znjmm\" (UID: \"52b29f60-937d-4e7d-bd19-e645004caeba\") " pod="openshift-network-operator/iptables-alerter-znjmm"
May 25 11:23:30.751547 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:23:30.751546    2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/0e95b3fe-d141-4227-80df-1b6f63fc89db-cni-binary-copy\") pod \"multus-additional-cni-plugins-cgxtl\" (UID: \"0e95b3fe-d141-4227-80df-1b6f63fc89db\") " pod="openshift-multus/multus-additional-cni-plugins-cgxtl"
May 25 11:23:30.752108 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:23:30.751563    2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-bqvgs\" (UniqueName: \"kubernetes.io/projected/3872d4b9-e2c4-40ab-8fee-706d08118a88-kube-api-access-bqvgs\") pod \"network-metrics-daemon-cvfxv\" (UID: \"3872d4b9-e2c4-40ab-8fee-706d08118a88\") " pod="openshift-multus/network-metrics-daemon-cvfxv"
May 25 11:23:30.752108 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:23:30.751586    2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/4e27bcd6-c257-422b-a332-0df274cf6fcc-host-run-netns\") pod \"ovnkube-node-krfmt\" (UID: \"4e27bcd6-c257-422b-a332-0df274cf6fcc\") " pod="openshift-ovn-kubernetes/ovnkube-node-krfmt"
May 25 11:23:30.752108 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:23:30.751599    2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/0e95b3fe-d141-4227-80df-1b6f63fc89db-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-cgxtl\" (UID: \"0e95b3fe-d141-4227-80df-1b6f63fc89db\") " pod="openshift-multus/multus-additional-cni-plugins-cgxtl"
May 25 11:23:30.752108 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:23:30.751611    2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4e27bcd6-c257-422b-a332-0df274cf6fcc-host-run-ovn-kubernetes\") pod \"ovnkube-node-krfmt\" (UID: \"4e27bcd6-c257-422b-a332-0df274cf6fcc\") " pod="openshift-ovn-kubernetes/ovnkube-node-krfmt"
May 25 11:23:30.752108 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:23:30.751635    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/f692c3e7-6b4e-443a-a334-88792f73d9d6-hosts-file\") pod \"node-resolver-nkmp2\" (UID: \"f692c3e7-6b4e-443a-a334-88792f73d9d6\") " pod="openshift-dns/node-resolver-nkmp2"
May 25 11:23:30.752108 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:23:30.751652    2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/0e95b3fe-d141-4227-80df-1b6f63fc89db-tuning-conf-dir\") pod \"multus-additional-cni-plugins-cgxtl\" (UID: \"0e95b3fe-d141-4227-80df-1b6f63fc89db\") " pod="openshift-multus/multus-additional-cni-plugins-cgxtl"
May 25 11:23:30.752108 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:23:30.751657    2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/4e27bcd6-c257-422b-a332-0df274cf6fcc-ovnkube-config\") pod \"ovnkube-node-krfmt\" (UID: \"4e27bcd6-c257-422b-a332-0df274cf6fcc\") " pod="openshift-ovn-kubernetes/ovnkube-node-krfmt"
May 25 11:23:30.752108 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:23:30.751668    2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/4e27bcd6-c257-422b-a332-0df274cf6fcc-host-slash\") pod \"ovnkube-node-krfmt\" (UID: \"4e27bcd6-c257-422b-a332-0df274cf6fcc\") " pod="openshift-ovn-kubernetes/ovnkube-node-krfmt"
May 25 11:23:30.752108 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:23:30.751678    2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/52b29f60-937d-4e7d-bd19-e645004caeba-host-slash\") pod \"iptables-alerter-znjmm\" (UID: \"52b29f60-937d-4e7d-bd19-e645004caeba\") " pod="openshift-network-operator/iptables-alerter-znjmm"
May 25 11:23:30.752108 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:23:30.751664    2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/4e27bcd6-c257-422b-a332-0df274cf6fcc-host-run-netns\") pod \"ovnkube-node-krfmt\" (UID: \"4e27bcd6-c257-422b-a332-0df274cf6fcc\") " pod="openshift-ovn-kubernetes/ovnkube-node-krfmt"
May 25 11:23:30.752108 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:23:30.751692    2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/4e27bcd6-c257-422b-a332-0df274cf6fcc-log-socket\") pod \"ovnkube-node-krfmt\" (UID: \"4e27bcd6-c257-422b-a332-0df274cf6fcc\") " pod="openshift-ovn-kubernetes/ovnkube-node-krfmt"
May 25 11:23:30.752108 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:23:30.751721    2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4e27bcd6-c257-422b-a332-0df274cf6fcc-host-run-ovn-kubernetes\") pod \"ovnkube-node-krfmt\" (UID: \"4e27bcd6-c257-422b-a332-0df274cf6fcc\") " pod="openshift-ovn-kubernetes/ovnkube-node-krfmt"
May 25 11:23:30.752108 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:23:30.751774    2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/4e27bcd6-c257-422b-a332-0df274cf6fcc-host-slash\") pod \"ovnkube-node-krfmt\" (UID: \"4e27bcd6-c257-422b-a332-0df274cf6fcc\") " pod="openshift-ovn-kubernetes/ovnkube-node-krfmt"
May 25 11:23:30.752108 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:23:30.751731    2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/4e27bcd6-c257-422b-a332-0df274cf6fcc-log-socket\") pod \"ovnkube-node-krfmt\" (UID: \"4e27bcd6-c257-422b-a332-0df274cf6fcc\") " pod="openshift-ovn-kubernetes/ovnkube-node-krfmt"
May 25 11:23:30.752108 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:23:30.751728    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/2299c072-4192-4fb8-a074-4ec0564cc016-kubelet-dir\") pod \"aws-ebs-csi-driver-node-ktzgh\" (UID: \"2299c072-4192-4fb8-a074-4ec0564cc016\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ktzgh"
May 25 11:23:30.752108 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:23:30.751796    2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/0e95b3fe-d141-4227-80df-1b6f63fc89db-tuning-conf-dir\") pod \"multus-additional-cni-plugins-cgxtl\" (UID: \"0e95b3fe-d141-4227-80df-1b6f63fc89db\") " pod="openshift-multus/multus-additional-cni-plugins-cgxtl"
May 25 11:23:30.752108 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:23:30.751822    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/2299c072-4192-4fb8-a074-4ec0564cc016-socket-dir\") pod \"aws-ebs-csi-driver-node-ktzgh\" (UID: \"2299c072-4192-4fb8-a074-4ec0564cc016\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ktzgh"
May 25 11:23:30.752766 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:23:30.751848    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/2299c072-4192-4fb8-a074-4ec0564cc016-registration-dir\") pod \"aws-ebs-csi-driver-node-ktzgh\" (UID: \"2299c072-4192-4fb8-a074-4ec0564cc016\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ktzgh"
May 25 11:23:30.752766 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:23:30.751873    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/2299c072-4192-4fb8-a074-4ec0564cc016-device-dir\") pod \"aws-ebs-csi-driver-node-ktzgh\" (UID: \"2299c072-4192-4fb8-a074-4ec0564cc016\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ktzgh"
May 25 11:23:30.752766 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:23:30.751896    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x2jbp\" (UniqueName: \"kubernetes.io/projected/8025c487-c204-4901-97bc-f40fb251d4ba-kube-api-access-x2jbp\") pod \"tuned-qsdv7\" (UID: \"8025c487-c204-4901-97bc-f40fb251d4ba\") " pod="openshift-cluster-node-tuning-operator/tuned-qsdv7"
May 25 11:23:30.752766 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:23:30.751936    2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/4e27bcd6-c257-422b-a332-0df274cf6fcc-var-lib-openvswitch\") pod \"ovnkube-node-krfmt\" (UID: \"4e27bcd6-c257-422b-a332-0df274cf6fcc\") " pod="openshift-ovn-kubernetes/ovnkube-node-krfmt"
May 25 11:23:30.752766 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:23:30.752071    2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/4e27bcd6-c257-422b-a332-0df274cf6fcc-host-cni-bin\") pod \"ovnkube-node-krfmt\" (UID: \"4e27bcd6-c257-422b-a332-0df274cf6fcc\") " pod="openshift-ovn-kubernetes/ovnkube-node-krfmt"
May 25 11:23:30.752766 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:23:30.752092    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/8025c487-c204-4901-97bc-f40fb251d4ba-etc-modprobe-d\") pod \"tuned-qsdv7\" (UID: \"8025c487-c204-4901-97bc-f40fb251d4ba\") " pod="openshift-cluster-node-tuning-operator/tuned-qsdv7"
May 25 11:23:30.752766 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:23:30.752105    2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/4e27bcd6-c257-422b-a332-0df274cf6fcc-host-cni-bin\") pod \"ovnkube-node-krfmt\" (UID: \"4e27bcd6-c257-422b-a332-0df274cf6fcc\") " pod="openshift-ovn-kubernetes/ovnkube-node-krfmt"
May 25 11:23:30.752766 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:23:30.752109    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/8025c487-c204-4901-97bc-f40fb251d4ba-etc-sysctl-d\") pod \"tuned-qsdv7\" (UID: \"8025c487-c204-4901-97bc-f40fb251d4ba\") " pod="openshift-cluster-node-tuning-operator/tuned-qsdv7"
May 25 11:23:30.752766 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:23:30.752069    2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/4e27bcd6-c257-422b-a332-0df274cf6fcc-var-lib-openvswitch\") pod \"ovnkube-node-krfmt\" (UID: \"4e27bcd6-c257-422b-a332-0df274cf6fcc\") " pod="openshift-ovn-kubernetes/ovnkube-node-krfmt"
May 25 11:23:30.752766 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:23:30.752136    2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/0e95b3fe-d141-4227-80df-1b6f63fc89db-cnibin\") pod \"multus-additional-cni-plugins-cgxtl\" (UID: \"0e95b3fe-d141-4227-80df-1b6f63fc89db\") " pod="openshift-multus/multus-additional-cni-plugins-cgxtl"
May 25 11:23:30.752766 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:23:30.752157    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/cc9f9059-2f19-464a-86c2-c8ec5ed6c010-konnectivity-ca\") pod \"konnectivity-agent-k89nm\" (UID: \"cc9f9059-2f19-464a-86c2-c8ec5ed6c010\") " pod="kube-system/konnectivity-agent-k89nm"
May 25 11:23:30.752766 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:23:30.752172    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/8d3be6d2-efff-4793-9082-593746afd78c-host-run-k8s-cni-cncf-io\") pod \"multus-mppq2\" (UID: \"8d3be6d2-efff-4793-9082-593746afd78c\") " pod="openshift-multus/multus-mppq2"
May 25 11:23:30.752766 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:23:30.752188    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-87788\" (UniqueName: \"kubernetes.io/projected/8d3be6d2-efff-4793-9082-593746afd78c-kube-api-access-87788\") pod \"multus-mppq2\" (UID: \"8d3be6d2-efff-4793-9082-593746afd78c\") " pod="openshift-multus/multus-mppq2"
May 25 11:23:30.752766 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:23:30.752211    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f692c3e7-6b4e-443a-a334-88792f73d9d6-tmp-dir\") pod \"node-resolver-nkmp2\" (UID: \"f692c3e7-6b4e-443a-a334-88792f73d9d6\") " pod="openshift-dns/node-resolver-nkmp2"
May 25 11:23:30.752766 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:23:30.752234    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9t46v\" (UniqueName: \"kubernetes.io/projected/f692c3e7-6b4e-443a-a334-88792f73d9d6-kube-api-access-9t46v\") pod \"node-resolver-nkmp2\" (UID: \"f692c3e7-6b4e-443a-a334-88792f73d9d6\") " pod="openshift-dns/node-resolver-nkmp2"
May 25 11:23:30.752766 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:23:30.752250    2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/0e95b3fe-d141-4227-80df-1b6f63fc89db-cnibin\") pod \"multus-additional-cni-plugins-cgxtl\" (UID: \"0e95b3fe-d141-4227-80df-1b6f63fc89db\") " pod="openshift-multus/multus-additional-cni-plugins-cgxtl"
May 25 11:23:30.752766 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:23:30.752284    2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/0e95b3fe-d141-4227-80df-1b6f63fc89db-system-cni-dir\") pod \"multus-additional-cni-plugins-cgxtl\" (UID: \"0e95b3fe-d141-4227-80df-1b6f63fc89db\") " pod="openshift-multus/multus-additional-cni-plugins-cgxtl"
May 25 11:23:30.753422 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:23:30.752331    2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/4e27bcd6-c257-422b-a332-0df274cf6fcc-etc-openvswitch\") pod \"ovnkube-node-krfmt\" (UID: \"4e27bcd6-c257-422b-a332-0df274cf6fcc\") " pod="openshift-ovn-kubernetes/ovnkube-node-krfmt"
May 25 11:23:30.753422 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:23:30.752361    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q2vl5\" (UniqueName: \"kubernetes.io/projected/803d9bd1-2b5f-451c-a4da-817e22be6c56-kube-api-access-q2vl5\") pod \"node-ca-296nq\" (UID: \"803d9bd1-2b5f-451c-a4da-817e22be6c56\") " pod="openshift-image-registry/node-ca-296nq"
May 25 11:23:30.753422 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:23:30.752402    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/8d3be6d2-efff-4793-9082-593746afd78c-system-cni-dir\") pod \"multus-mppq2\" (UID: \"8d3be6d2-efff-4793-9082-593746afd78c\") " pod="openshift-multus/multus-mppq2"
May 25 11:23:30.753422 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:23:30.752415    2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/0e95b3fe-d141-4227-80df-1b6f63fc89db-system-cni-dir\") pod \"multus-additional-cni-plugins-cgxtl\" (UID: \"0e95b3fe-d141-4227-80df-1b6f63fc89db\") " pod="openshift-multus/multus-additional-cni-plugins-cgxtl"
May 25 11:23:30.753422 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:23:30.752436    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/8d3be6d2-efff-4793-9082-593746afd78c-host-run-multus-certs\") pod \"multus-mppq2\" (UID: \"8d3be6d2-efff-4793-9082-593746afd78c\") " pod="openshift-multus/multus-mppq2"
May 25 11:23:30.753422 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:23:30.752443    2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/4e27bcd6-c257-422b-a332-0df274cf6fcc-etc-openvswitch\") pod \"ovnkube-node-krfmt\" (UID: \"4e27bcd6-c257-422b-a332-0df274cf6fcc\") " pod="openshift-ovn-kubernetes/ovnkube-node-krfmt"
May 25 11:23:30.753422 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:23:30.752471    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8d3be6d2-efff-4793-9082-593746afd78c-etc-kubernetes\") pod \"multus-mppq2\" (UID: \"8d3be6d2-efff-4793-9082-593746afd78c\") " pod="openshift-multus/multus-mppq2"
May 25 11:23:30.753422 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:23:30.752508    2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/4e27bcd6-c257-422b-a332-0df274cf6fcc-run-ovn\") pod \"ovnkube-node-krfmt\" (UID: \"4e27bcd6-c257-422b-a332-0df274cf6fcc\") " pod="openshift-ovn-kubernetes/ovnkube-node-krfmt"
May 25 11:23:30.753422 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:23:30.752513    2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/0e95b3fe-d141-4227-80df-1b6f63fc89db-cni-binary-copy\") pod \"multus-additional-cni-plugins-cgxtl\" (UID: \"0e95b3fe-d141-4227-80df-1b6f63fc89db\") " pod="openshift-multus/multus-additional-cni-plugins-cgxtl"
May 25 11:23:30.753422 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:23:30.752538    2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/4e27bcd6-c257-422b-a332-0df274cf6fcc-ovn-node-metrics-cert\") pod \"ovnkube-node-krfmt\" (UID: \"4e27bcd6-c257-422b-a332-0df274cf6fcc\") " pod="openshift-ovn-kubernetes/ovnkube-node-krfmt"
May 25 11:23:30.753422 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:23:30.752545    2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/4e27bcd6-c257-422b-a332-0df274cf6fcc-run-ovn\") pod \"ovnkube-node-krfmt\" (UID: \"4e27bcd6-c257-422b-a332-0df274cf6fcc\") " pod="openshift-ovn-kubernetes/ovnkube-node-krfmt"
May 25 11:23:30.753422 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:23:30.752562    2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/4e27bcd6-c257-422b-a332-0df274cf6fcc-env-overrides\") pod \"ovnkube-node-krfmt\" (UID: \"4e27bcd6-c257-422b-a332-0df274cf6fcc\") " pod="openshift-ovn-kubernetes/ovnkube-node-krfmt"
May 25 11:23:30.753422 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:23:30.752582    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/8025c487-c204-4901-97bc-f40fb251d4ba-etc-sysconfig\") pod \"tuned-qsdv7\" (UID: \"8025c487-c204-4901-97bc-f40fb251d4ba\") " pod="openshift-cluster-node-tuning-operator/tuned-qsdv7"
May 25 11:23:30.753422 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:23:30.752602    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8025c487-c204-4901-97bc-f40fb251d4ba-etc-kubernetes\") pod \"tuned-qsdv7\" (UID: \"8025c487-c204-4901-97bc-f40fb251d4ba\") " pod="openshift-cluster-node-tuning-operator/tuned-qsdv7"
May 25 11:23:30.753422 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:23:30.752695    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/8025c487-c204-4901-97bc-f40fb251d4ba-etc-sysctl-conf\") pod \"tuned-qsdv7\" (UID: \"8025c487-c204-4901-97bc-f40fb251d4ba\") " pod="openshift-cluster-node-tuning-operator/tuned-qsdv7"
May 25 11:23:30.753422 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:23:30.752768    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/8025c487-c204-4901-97bc-f40fb251d4ba-etc-systemd\") pod \"tuned-qsdv7\" (UID: \"8025c487-c204-4901-97bc-f40fb251d4ba\") " pod="openshift-cluster-node-tuning-operator/tuned-qsdv7"
May 25 11:23:30.753422 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:23:30.752795    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/8025c487-c204-4901-97bc-f40fb251d4ba-var-lib-kubelet\") pod \"tuned-qsdv7\" (UID: \"8025c487-c204-4901-97bc-f40fb251d4ba\") " pod="openshift-cluster-node-tuning-operator/tuned-qsdv7"
May 25 11:23:30.754130 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:23:30.752818    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/cc9f9059-2f19-464a-86c2-c8ec5ed6c010-agent-certs\") pod \"konnectivity-agent-k89nm\" (UID: \"cc9f9059-2f19-464a-86c2-c8ec5ed6c010\") " pod="kube-system/konnectivity-agent-k89nm"
May 25 11:23:30.754130 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:23:30.752862    2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-2rldh\" (UniqueName: \"kubernetes.io/projected/52b29f60-937d-4e7d-bd19-e645004caeba-kube-api-access-2rldh\") pod \"iptables-alerter-znjmm\" (UID: \"52b29f60-937d-4e7d-bd19-e645004caeba\") " pod="openshift-network-operator/iptables-alerter-znjmm"
May 25 11:23:30.754130 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:23:30.752911    2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-zmf2x\" (UniqueName: \"kubernetes.io/projected/0e95b3fe-d141-4227-80df-1b6f63fc89db-kube-api-access-zmf2x\") pod \"multus-additional-cni-plugins-cgxtl\" (UID: \"0e95b3fe-d141-4227-80df-1b6f63fc89db\") " pod="openshift-multus/multus-additional-cni-plugins-cgxtl"
May 25 11:23:30.754130 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:23:30.752940    2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-476cp\" (UniqueName: \"kubernetes.io/projected/36dcd564-65d2-4f2e-82d7-8c8af53ca015-kube-api-access-476cp\") pod \"network-check-target-vnft7\" (UID: \"36dcd564-65d2-4f2e-82d7-8c8af53ca015\") " pod="openshift-network-diagnostics/network-check-target-vnft7"
May 25 11:23:30.754130 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:23:30.752936    2545 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
May 25 11:23:30.754130 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:23:30.752983    2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/4e27bcd6-c257-422b-a332-0df274cf6fcc-node-log\") pod \"ovnkube-node-krfmt\" (UID: \"4e27bcd6-c257-422b-a332-0df274cf6fcc\") " pod="openshift-ovn-kubernetes/ovnkube-node-krfmt"
May 25 11:23:30.754130 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:23:30.753010    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/2299c072-4192-4fb8-a074-4ec0564cc016-etc-selinux\") pod \"aws-ebs-csi-driver-node-ktzgh\" (UID: \"2299c072-4192-4fb8-a074-4ec0564cc016\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ktzgh"
May 25 11:23:30.754130 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:23:30.753033    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/803d9bd1-2b5f-451c-a4da-817e22be6c56-host\") pod \"node-ca-296nq\" (UID: \"803d9bd1-2b5f-451c-a4da-817e22be6c56\") " pod="openshift-image-registry/node-ca-296nq"
May 25 11:23:30.754130 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:23:30.753045    2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/4e27bcd6-c257-422b-a332-0df274cf6fcc-env-overrides\") pod \"ovnkube-node-krfmt\" (UID: \"4e27bcd6-c257-422b-a332-0df274cf6fcc\") " pod="openshift-ovn-kubernetes/ovnkube-node-krfmt"
May 25 11:23:30.754130 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:23:30.753055    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dzlts\" (UniqueName: \"kubernetes.io/projected/2299c072-4192-4fb8-a074-4ec0564cc016-kube-api-access-dzlts\") pod \"aws-ebs-csi-driver-node-ktzgh\" (UID: \"2299c072-4192-4fb8-a074-4ec0564cc016\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ktzgh"
May 25 11:23:30.754130 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:23:30.753075    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/8025c487-c204-4901-97bc-f40fb251d4ba-run\") pod \"tuned-qsdv7\" (UID: \"8025c487-c204-4901-97bc-f40fb251d4ba\") " pod="openshift-cluster-node-tuning-operator/tuned-qsdv7"
May 25 11:23:30.754130 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:23:30.753097    2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/52b29f60-937d-4e7d-bd19-e645004caeba-iptables-alerter-script\") pod \"iptables-alerter-znjmm\" (UID: \"52b29f60-937d-4e7d-bd19-e645004caeba\") " pod="openshift-network-operator/iptables-alerter-znjmm"
May 25 11:23:30.754130 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:23:30.753121    2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3872d4b9-e2c4-40ab-8fee-706d08118a88-metrics-certs\") pod \"network-metrics-daemon-cvfxv\" (UID: \"3872d4b9-e2c4-40ab-8fee-706d08118a88\") " pod="openshift-multus/network-metrics-daemon-cvfxv"
May 25 11:23:30.754130 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:23:30.753134    2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/4e27bcd6-c257-422b-a332-0df274cf6fcc-node-log\") pod \"ovnkube-node-krfmt\" (UID: \"4e27bcd6-c257-422b-a332-0df274cf6fcc\") " pod="openshift-ovn-kubernetes/ovnkube-node-krfmt"
May 25 11:23:30.754130 ip-10-0-128-206 kubenswrapper[2545]: E0525 11:23:30.753295    2545 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
May 25 11:23:30.754130 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:23:30.753319    2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-vxnk7\" (UniqueName: \"kubernetes.io/projected/4e27bcd6-c257-422b-a332-0df274cf6fcc-kube-api-access-vxnk7\") pod \"ovnkube-node-krfmt\" (UID: \"4e27bcd6-c257-422b-a332-0df274cf6fcc\") " pod="openshift-ovn-kubernetes/ovnkube-node-krfmt"
May 25 11:23:30.754130 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:23:30.753352    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/8d3be6d2-efff-4793-9082-593746afd78c-multus-socket-dir-parent\") pod \"multus-mppq2\" (UID: \"8d3be6d2-efff-4793-9082-593746afd78c\") " pod="openshift-multus/multus-mppq2"
May 25 11:23:30.754695 ip-10-0-128-206 kubenswrapper[2545]: E0525 11:23:30.753417    2545 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3872d4b9-e2c4-40ab-8fee-706d08118a88-metrics-certs podName:3872d4b9-e2c4-40ab-8fee-706d08118a88 nodeName:}" failed. No retries permitted until 2026-05-25 11:23:31.253362089 +0000 UTC m=+3.019647024 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3872d4b9-e2c4-40ab-8fee-706d08118a88-metrics-certs") pod "network-metrics-daemon-cvfxv" (UID: "3872d4b9-e2c4-40ab-8fee-706d08118a88") : object "openshift-multus"/"metrics-daemon-secret" not registered
May 25 11:23:30.754695 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:23:30.753479    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/8025c487-c204-4901-97bc-f40fb251d4ba-lib-modules\") pod \"tuned-qsdv7\" (UID: \"8025c487-c204-4901-97bc-f40fb251d4ba\") " pod="openshift-cluster-node-tuning-operator/tuned-qsdv7"
May 25 11:23:30.754695 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:23:30.753510    2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/0e95b3fe-d141-4227-80df-1b6f63fc89db-os-release\") pod \"multus-additional-cni-plugins-cgxtl\" (UID: \"0e95b3fe-d141-4227-80df-1b6f63fc89db\") " pod="openshift-multus/multus-additional-cni-plugins-cgxtl"
May 25 11:23:30.754695 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:23:30.753545    2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/0e95b3fe-d141-4227-80df-1b6f63fc89db-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-cgxtl\" (UID: \"0e95b3fe-d141-4227-80df-1b6f63fc89db\") " pod="openshift-multus/multus-additional-cni-plugins-cgxtl"
May 25 11:23:30.754695 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:23:30.753630    2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/0e95b3fe-d141-4227-80df-1b6f63fc89db-os-release\") pod \"multus-additional-cni-plugins-cgxtl\" (UID: \"0e95b3fe-d141-4227-80df-1b6f63fc89db\") " pod="openshift-multus/multus-additional-cni-plugins-cgxtl"
May 25 11:23:30.754695 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:23:30.753669    2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/52b29f60-937d-4e7d-bd19-e645004caeba-iptables-alerter-script\") pod \"iptables-alerter-znjmm\" (UID: \"52b29f60-937d-4e7d-bd19-e645004caeba\") " pod="openshift-network-operator/iptables-alerter-znjmm"
May 25 11:23:30.754695 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:23:30.753678    2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/4e27bcd6-c257-422b-a332-0df274cf6fcc-run-systemd\") pod \"ovnkube-node-krfmt\" (UID: \"4e27bcd6-c257-422b-a332-0df274cf6fcc\") " pod="openshift-ovn-kubernetes/ovnkube-node-krfmt"
May 25 11:23:30.754695 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:23:30.753698    2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/4e27bcd6-c257-422b-a332-0df274cf6fcc-run-systemd\") pod \"ovnkube-node-krfmt\" (UID: \"4e27bcd6-c257-422b-a332-0df274cf6fcc\") " pod="openshift-ovn-kubernetes/ovnkube-node-krfmt"
May 25 11:23:30.754695 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:23:30.753722    2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4e27bcd6-c257-422b-a332-0df274cf6fcc-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-krfmt\" (UID: \"4e27bcd6-c257-422b-a332-0df274cf6fcc\") " pod="openshift-ovn-kubernetes/ovnkube-node-krfmt"
May 25 11:23:30.754695 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:23:30.753754    2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/4e27bcd6-c257-422b-a332-0df274cf6fcc-ovnkube-script-lib\") pod \"ovnkube-node-krfmt\" (UID: \"4e27bcd6-c257-422b-a332-0df274cf6fcc\") " pod="openshift-ovn-kubernetes/ovnkube-node-krfmt"
May 25 11:23:30.754695 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:23:30.753781    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/803d9bd1-2b5f-451c-a4da-817e22be6c56-serviceca\") pod \"node-ca-296nq\" (UID: \"803d9bd1-2b5f-451c-a4da-817e22be6c56\") " pod="openshift-image-registry/node-ca-296nq"
May 25 11:23:30.754695 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:23:30.753794    2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4e27bcd6-c257-422b-a332-0df274cf6fcc-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-krfmt\" (UID: \"4e27bcd6-c257-422b-a332-0df274cf6fcc\") " pod="openshift-ovn-kubernetes/ovnkube-node-krfmt"
May 25 11:23:30.754695 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:23:30.753807    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/8d3be6d2-efff-4793-9082-593746afd78c-host-var-lib-kubelet\") pod \"multus-mppq2\" (UID: \"8d3be6d2-efff-4793-9082-593746afd78c\") " pod="openshift-multus/multus-mppq2"
May 25 11:23:30.754695 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:23:30.753836    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/2299c072-4192-4fb8-a074-4ec0564cc016-sys-fs\") pod \"aws-ebs-csi-driver-node-ktzgh\" (UID: \"2299c072-4192-4fb8-a074-4ec0564cc016\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ktzgh"
May 25 11:23:30.754695 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:23:30.753875    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/8d3be6d2-efff-4793-9082-593746afd78c-cni-binary-copy\") pod \"multus-mppq2\" (UID: \"8d3be6d2-efff-4793-9082-593746afd78c\") " pod="openshift-multus/multus-mppq2"
May 25 11:23:30.754695 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:23:30.753912    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/8d3be6d2-efff-4793-9082-593746afd78c-host-var-lib-cni-multus\") pod \"multus-mppq2\" (UID: \"8d3be6d2-efff-4793-9082-593746afd78c\") " pod="openshift-multus/multus-mppq2"
May 25 11:23:30.755224 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:23:30.753933    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/8d3be6d2-efff-4793-9082-593746afd78c-multus-conf-dir\") pod \"multus-mppq2\" (UID: \"8d3be6d2-efff-4793-9082-593746afd78c\") " pod="openshift-multus/multus-mppq2"
May 25 11:23:30.755224 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:23:30.753990    2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/4e27bcd6-c257-422b-a332-0df274cf6fcc-host-cni-netd\") pod \"ovnkube-node-krfmt\" (UID: \"4e27bcd6-c257-422b-a332-0df274cf6fcc\") " pod="openshift-ovn-kubernetes/ovnkube-node-krfmt"
May 25 11:23:30.755224 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:23:30.754049    2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/0e95b3fe-d141-4227-80df-1b6f63fc89db-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-cgxtl\" (UID: \"0e95b3fe-d141-4227-80df-1b6f63fc89db\") " pod="openshift-multus/multus-additional-cni-plugins-cgxtl"
May 25 11:23:30.755224 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:23:30.754075    2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/4e27bcd6-c257-422b-a332-0df274cf6fcc-host-cni-netd\") pod \"ovnkube-node-krfmt\" (UID: \"4e27bcd6-c257-422b-a332-0df274cf6fcc\") " pod="openshift-ovn-kubernetes/ovnkube-node-krfmt"
May 25 11:23:30.755224 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:23:30.754284    2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/4e27bcd6-c257-422b-a332-0df274cf6fcc-ovnkube-script-lib\") pod \"ovnkube-node-krfmt\" (UID: \"4e27bcd6-c257-422b-a332-0df274cf6fcc\") " pod="openshift-ovn-kubernetes/ovnkube-node-krfmt"
May 25 11:23:30.756235 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:23:30.756214    2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/4e27bcd6-c257-422b-a332-0df274cf6fcc-ovn-node-metrics-cert\") pod \"ovnkube-node-krfmt\" (UID: \"4e27bcd6-c257-422b-a332-0df274cf6fcc\") " pod="openshift-ovn-kubernetes/ovnkube-node-krfmt"
May 25 11:23:30.760437 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:23:30.760413    2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bqvgs\" (UniqueName: \"kubernetes.io/projected/3872d4b9-e2c4-40ab-8fee-706d08118a88-kube-api-access-bqvgs\") pod \"network-metrics-daemon-cvfxv\" (UID: \"3872d4b9-e2c4-40ab-8fee-706d08118a88\") " pod="openshift-multus/network-metrics-daemon-cvfxv"
May 25 11:23:30.764261 ip-10-0-128-206 kubenswrapper[2545]: E0525 11:23:30.763945    2545 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
May 25 11:23:30.764261 ip-10-0-128-206 kubenswrapper[2545]: E0525 11:23:30.763983    2545 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
May 25 11:23:30.764261 ip-10-0-128-206 kubenswrapper[2545]: E0525 11:23:30.763997    2545 projected.go:194] Error preparing data for projected volume kube-api-access-476cp for pod openshift-network-diagnostics/network-check-target-vnft7: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 25 11:23:30.764261 ip-10-0-128-206 kubenswrapper[2545]: E0525 11:23:30.764071    2545 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/36dcd564-65d2-4f2e-82d7-8c8af53ca015-kube-api-access-476cp podName:36dcd564-65d2-4f2e-82d7-8c8af53ca015 nodeName:}" failed. No retries permitted until 2026-05-25 11:23:31.26405317 +0000 UTC m=+3.030338110 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-476cp" (UniqueName: "kubernetes.io/projected/36dcd564-65d2-4f2e-82d7-8c8af53ca015-kube-api-access-476cp") pod "network-check-target-vnft7" (UID: "36dcd564-65d2-4f2e-82d7-8c8af53ca015") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 25 11:23:30.764779 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:23:30.764757    2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2rldh\" (UniqueName: \"kubernetes.io/projected/52b29f60-937d-4e7d-bd19-e645004caeba-kube-api-access-2rldh\") pod \"iptables-alerter-znjmm\" (UID: \"52b29f60-937d-4e7d-bd19-e645004caeba\") " pod="openshift-network-operator/iptables-alerter-znjmm"
May 25 11:23:30.766176 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:23:30.766156    2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vxnk7\" (UniqueName: \"kubernetes.io/projected/4e27bcd6-c257-422b-a332-0df274cf6fcc-kube-api-access-vxnk7\") pod \"ovnkube-node-krfmt\" (UID: \"4e27bcd6-c257-422b-a332-0df274cf6fcc\") " pod="openshift-ovn-kubernetes/ovnkube-node-krfmt"
May 25 11:23:30.766514 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:23:30.766498    2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zmf2x\" (UniqueName: \"kubernetes.io/projected/0e95b3fe-d141-4227-80df-1b6f63fc89db-kube-api-access-zmf2x\") pod \"multus-additional-cni-plugins-cgxtl\" (UID: \"0e95b3fe-d141-4227-80df-1b6f63fc89db\") " pod="openshift-multus/multus-additional-cni-plugins-cgxtl"
May 25 11:23:30.855200 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:23:30.855168    2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/cc9f9059-2f19-464a-86c2-c8ec5ed6c010-konnectivity-ca\") pod \"konnectivity-agent-k89nm\" (UID: \"cc9f9059-2f19-464a-86c2-c8ec5ed6c010\") " pod="kube-system/konnectivity-agent-k89nm"
May 25 11:23:30.855200 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:23:30.855203    2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/8d3be6d2-efff-4793-9082-593746afd78c-host-run-k8s-cni-cncf-io\") pod \"multus-mppq2\" (UID: \"8d3be6d2-efff-4793-9082-593746afd78c\") " pod="openshift-multus/multus-mppq2"
May 25 11:23:30.855427 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:23:30.855221    2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-87788\" (UniqueName: \"kubernetes.io/projected/8d3be6d2-efff-4793-9082-593746afd78c-kube-api-access-87788\") pod \"multus-mppq2\" (UID: \"8d3be6d2-efff-4793-9082-593746afd78c\") " pod="openshift-multus/multus-mppq2"
May 25 11:23:30.855427 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:23:30.855245    2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f692c3e7-6b4e-443a-a334-88792f73d9d6-tmp-dir\") pod \"node-resolver-nkmp2\" (UID: \"f692c3e7-6b4e-443a-a334-88792f73d9d6\") " pod="openshift-dns/node-resolver-nkmp2"
May 25 11:23:30.855427 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:23:30.855274    2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-9t46v\" (UniqueName: \"kubernetes.io/projected/f692c3e7-6b4e-443a-a334-88792f73d9d6-kube-api-access-9t46v\") pod \"node-resolver-nkmp2\" (UID: \"f692c3e7-6b4e-443a-a334-88792f73d9d6\") " pod="openshift-dns/node-resolver-nkmp2"
May 25 11:23:30.855427 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:23:30.855287    2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/8d3be6d2-efff-4793-9082-593746afd78c-host-run-k8s-cni-cncf-io\") pod \"multus-mppq2\" (UID: \"8d3be6d2-efff-4793-9082-593746afd78c\") " pod="openshift-multus/multus-mppq2"
May 25 11:23:30.855646 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:23:30.855443    2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-q2vl5\" (UniqueName: \"kubernetes.io/projected/803d9bd1-2b5f-451c-a4da-817e22be6c56-kube-api-access-q2vl5\") pod \"node-ca-296nq\" (UID: \"803d9bd1-2b5f-451c-a4da-817e22be6c56\") " pod="openshift-image-registry/node-ca-296nq"
May 25 11:23:30.855646 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:23:30.855484    2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/8d3be6d2-efff-4793-9082-593746afd78c-system-cni-dir\") pod \"multus-mppq2\" (UID: \"8d3be6d2-efff-4793-9082-593746afd78c\") " pod="openshift-multus/multus-mppq2"
May 25 11:23:30.855646 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:23:30.855511    2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/8d3be6d2-efff-4793-9082-593746afd78c-host-run-multus-certs\") pod \"multus-mppq2\" (UID: \"8d3be6d2-efff-4793-9082-593746afd78c\") " pod="openshift-multus/multus-mppq2"
May 25 11:23:30.855646 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:23:30.855535    2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8d3be6d2-efff-4793-9082-593746afd78c-etc-kubernetes\") pod \"multus-mppq2\" (UID: \"8d3be6d2-efff-4793-9082-593746afd78c\") " pod="openshift-multus/multus-mppq2"
May 25 11:23:30.855646 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:23:30.855558    2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/8d3be6d2-efff-4793-9082-593746afd78c-system-cni-dir\") pod \"multus-mppq2\" (UID: \"8d3be6d2-efff-4793-9082-593746afd78c\") " pod="openshift-multus/multus-mppq2"
May 25 11:23:30.855646 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:23:30.855564    2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f692c3e7-6b4e-443a-a334-88792f73d9d6-tmp-dir\") pod \"node-resolver-nkmp2\" (UID: \"f692c3e7-6b4e-443a-a334-88792f73d9d6\") " pod="openshift-dns/node-resolver-nkmp2"
May 25 11:23:30.855646 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:23:30.855562    2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/8025c487-c204-4901-97bc-f40fb251d4ba-etc-sysconfig\") pod \"tuned-qsdv7\" (UID: \"8025c487-c204-4901-97bc-f40fb251d4ba\") " pod="openshift-cluster-node-tuning-operator/tuned-qsdv7"
May 25 11:23:30.855646 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:23:30.855610    2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8025c487-c204-4901-97bc-f40fb251d4ba-etc-kubernetes\") pod \"tuned-qsdv7\" (UID: \"8025c487-c204-4901-97bc-f40fb251d4ba\") " pod="openshift-cluster-node-tuning-operator/tuned-qsdv7"
May 25 11:23:30.855646 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:23:30.855610    2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/8d3be6d2-efff-4793-9082-593746afd78c-host-run-multus-certs\") pod \"multus-mppq2\" (UID: \"8d3be6d2-efff-4793-9082-593746afd78c\") " pod="openshift-multus/multus-mppq2"
May 25 11:23:30.855646 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:23:30.855649    2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/8025c487-c204-4901-97bc-f40fb251d4ba-etc-sysconfig\") pod \"tuned-qsdv7\" (UID: \"8025c487-c204-4901-97bc-f40fb251d4ba\") " pod="openshift-cluster-node-tuning-operator/tuned-qsdv7"
May 25 11:23:30.856101 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:23:30.855655    2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8025c487-c204-4901-97bc-f40fb251d4ba-etc-kubernetes\") pod \"tuned-qsdv7\" (UID: \"8025c487-c204-4901-97bc-f40fb251d4ba\") " pod="openshift-cluster-node-tuning-operator/tuned-qsdv7"
May 25 11:23:30.856101 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:23:30.855675    2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/8025c487-c204-4901-97bc-f40fb251d4ba-etc-sysctl-conf\") pod \"tuned-qsdv7\" (UID: \"8025c487-c204-4901-97bc-f40fb251d4ba\") " pod="openshift-cluster-node-tuning-operator/tuned-qsdv7"
May 25 11:23:30.856101 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:23:30.855693    2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8d3be6d2-efff-4793-9082-593746afd78c-etc-kubernetes\") pod \"multus-mppq2\" (UID: \"8d3be6d2-efff-4793-9082-593746afd78c\") " pod="openshift-multus/multus-mppq2"
May 25 11:23:30.856101 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:23:30.855694    2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/8025c487-c204-4901-97bc-f40fb251d4ba-etc-systemd\") pod \"tuned-qsdv7\" (UID: \"8025c487-c204-4901-97bc-f40fb251d4ba\") " pod="openshift-cluster-node-tuning-operator/tuned-qsdv7"
May 25 11:23:30.856101 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:23:30.855726    2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/8025c487-c204-4901-97bc-f40fb251d4ba-etc-systemd\") pod \"tuned-qsdv7\" (UID: \"8025c487-c204-4901-97bc-f40fb251d4ba\") " pod="openshift-cluster-node-tuning-operator/tuned-qsdv7"
May 25 11:23:30.856101 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:23:30.855728    2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/8025c487-c204-4901-97bc-f40fb251d4ba-var-lib-kubelet\") pod \"tuned-qsdv7\" (UID: \"8025c487-c204-4901-97bc-f40fb251d4ba\") " pod="openshift-cluster-node-tuning-operator/tuned-qsdv7"
May 25 11:23:30.856101 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:23:30.855747    2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/cc9f9059-2f19-464a-86c2-c8ec5ed6c010-konnectivity-ca\") pod \"konnectivity-agent-k89nm\" (UID: \"cc9f9059-2f19-464a-86c2-c8ec5ed6c010\") " pod="kube-system/konnectivity-agent-k89nm"
May 25 11:23:30.856101 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:23:30.855782    2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/cc9f9059-2f19-464a-86c2-c8ec5ed6c010-agent-certs\") pod \"konnectivity-agent-k89nm\" (UID: \"cc9f9059-2f19-464a-86c2-c8ec5ed6c010\") " pod="kube-system/konnectivity-agent-k89nm"
May 25 11:23:30.856101 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:23:30.855808    2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/8025c487-c204-4901-97bc-f40fb251d4ba-etc-sysctl-conf\") pod \"tuned-qsdv7\" (UID: \"8025c487-c204-4901-97bc-f40fb251d4ba\") " pod="openshift-cluster-node-tuning-operator/tuned-qsdv7"
May 25 11:23:30.856101 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:23:30.855826    2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/2299c072-4192-4fb8-a074-4ec0564cc016-etc-selinux\") pod \"aws-ebs-csi-driver-node-ktzgh\" (UID: \"2299c072-4192-4fb8-a074-4ec0564cc016\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ktzgh"
May 25 11:23:30.856101 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:23:30.855839    2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/8025c487-c204-4901-97bc-f40fb251d4ba-var-lib-kubelet\") pod \"tuned-qsdv7\" (UID: \"8025c487-c204-4901-97bc-f40fb251d4ba\") " pod="openshift-cluster-node-tuning-operator/tuned-qsdv7"
May 25 11:23:30.856101 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:23:30.855852    2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/803d9bd1-2b5f-451c-a4da-817e22be6c56-host\") pod \"node-ca-296nq\" (UID: \"803d9bd1-2b5f-451c-a4da-817e22be6c56\") " pod="openshift-image-registry/node-ca-296nq"
May 25 11:23:30.856101 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:23:30.855879    2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/803d9bd1-2b5f-451c-a4da-817e22be6c56-host\") pod \"node-ca-296nq\" (UID: \"803d9bd1-2b5f-451c-a4da-817e22be6c56\") " pod="openshift-image-registry/node-ca-296nq"
May 25 11:23:30.856101 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:23:30.855881    2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-dzlts\" (UniqueName: \"kubernetes.io/projected/2299c072-4192-4fb8-a074-4ec0564cc016-kube-api-access-dzlts\") pod \"aws-ebs-csi-driver-node-ktzgh\" (UID: \"2299c072-4192-4fb8-a074-4ec0564cc016\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ktzgh"
May 25 11:23:30.856101 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:23:30.855909    2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/8025c487-c204-4901-97bc-f40fb251d4ba-run\") pod \"tuned-qsdv7\" (UID: \"8025c487-c204-4901-97bc-f40fb251d4ba\") " pod="openshift-cluster-node-tuning-operator/tuned-qsdv7"
May 25 11:23:30.856101 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:23:30.855910    2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/2299c072-4192-4fb8-a074-4ec0564cc016-etc-selinux\") pod \"aws-ebs-csi-driver-node-ktzgh\" (UID: \"2299c072-4192-4fb8-a074-4ec0564cc016\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ktzgh"
May 25 11:23:30.856101 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:23:30.855948    2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/8d3be6d2-efff-4793-9082-593746afd78c-multus-socket-dir-parent\") pod \"multus-mppq2\" (UID: \"8d3be6d2-efff-4793-9082-593746afd78c\") " pod="openshift-multus/multus-mppq2"
May 25 11:23:30.856101 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:23:30.855986    2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/8025c487-c204-4901-97bc-f40fb251d4ba-run\") pod \"tuned-qsdv7\" (UID: \"8025c487-c204-4901-97bc-f40fb251d4ba\") " pod="openshift-cluster-node-tuning-operator/tuned-qsdv7"
May 25 11:23:30.856888 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:23:30.855987    2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/8025c487-c204-4901-97bc-f40fb251d4ba-lib-modules\") pod \"tuned-qsdv7\" (UID: \"8025c487-c204-4901-97bc-f40fb251d4ba\") " pod="openshift-cluster-node-tuning-operator/tuned-qsdv7"
May 25 11:23:30.856888 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:23:30.856019    2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/803d9bd1-2b5f-451c-a4da-817e22be6c56-serviceca\") pod \"node-ca-296nq\" (UID: \"803d9bd1-2b5f-451c-a4da-817e22be6c56\") " pod="openshift-image-registry/node-ca-296nq"
May 25 11:23:30.856888 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:23:30.856044    2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/8d3be6d2-efff-4793-9082-593746afd78c-host-var-lib-kubelet\") pod \"multus-mppq2\" (UID: \"8d3be6d2-efff-4793-9082-593746afd78c\") " pod="openshift-multus/multus-mppq2"
May 25 11:23:30.856888 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:23:30.856073    2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/8d3be6d2-efff-4793-9082-593746afd78c-multus-socket-dir-parent\") pod \"multus-mppq2\" (UID: \"8d3be6d2-efff-4793-9082-593746afd78c\") " pod="openshift-multus/multus-mppq2"
May 25 11:23:30.856888 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:23:30.856083    2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/8d3be6d2-efff-4793-9082-593746afd78c-host-var-lib-kubelet\") pod \"multus-mppq2\" (UID: \"8d3be6d2-efff-4793-9082-593746afd78c\") " pod="openshift-multus/multus-mppq2"
May 25 11:23:30.856888 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:23:30.856124    2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/8025c487-c204-4901-97bc-f40fb251d4ba-lib-modules\") pod \"tuned-qsdv7\" (UID: \"8025c487-c204-4901-97bc-f40fb251d4ba\") " pod="openshift-cluster-node-tuning-operator/tuned-qsdv7"
May 25 11:23:30.856888 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:23:30.856134    2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/2299c072-4192-4fb8-a074-4ec0564cc016-sys-fs\") pod \"aws-ebs-csi-driver-node-ktzgh\" (UID: \"2299c072-4192-4fb8-a074-4ec0564cc016\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ktzgh"
May 25 11:23:30.856888 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:23:30.856161    2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/8d3be6d2-efff-4793-9082-593746afd78c-cni-binary-copy\") pod \"multus-mppq2\" (UID: \"8d3be6d2-efff-4793-9082-593746afd78c\") " pod="openshift-multus/multus-mppq2"
May 25 11:23:30.856888 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:23:30.856178    2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/2299c072-4192-4fb8-a074-4ec0564cc016-sys-fs\") pod \"aws-ebs-csi-driver-node-ktzgh\" (UID: \"2299c072-4192-4fb8-a074-4ec0564cc016\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ktzgh"
May 25 11:23:30.856888 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:23:30.856187    2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/8d3be6d2-efff-4793-9082-593746afd78c-host-var-lib-cni-multus\") pod \"multus-mppq2\" (UID: \"8d3be6d2-efff-4793-9082-593746afd78c\") " pod="openshift-multus/multus-mppq2"
May 25 11:23:30.856888 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:23:30.856212    2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/8d3be6d2-efff-4793-9082-593746afd78c-multus-conf-dir\") pod \"multus-mppq2\" (UID: \"8d3be6d2-efff-4793-9082-593746afd78c\") " pod="openshift-multus/multus-mppq2"
May 25 11:23:30.856888 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:23:30.856244    2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/8025c487-c204-4901-97bc-f40fb251d4ba-etc-tuned\") pod \"tuned-qsdv7\" (UID: \"8025c487-c204-4901-97bc-f40fb251d4ba\") " pod="openshift-cluster-node-tuning-operator/tuned-qsdv7"
May 25 11:23:30.856888 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:23:30.856264    2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/8d3be6d2-efff-4793-9082-593746afd78c-host-var-lib-cni-multus\") pod \"multus-mppq2\" (UID: \"8d3be6d2-efff-4793-9082-593746afd78c\") " pod="openshift-multus/multus-mppq2"
May 25 11:23:30.856888 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:23:30.856267    2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/8d3be6d2-efff-4793-9082-593746afd78c-host-run-netns\") pod \"multus-mppq2\" (UID: \"8d3be6d2-efff-4793-9082-593746afd78c\") " pod="openshift-multus/multus-mppq2"
May 25 11:23:30.856888 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:23:30.856299    2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/8d3be6d2-efff-4793-9082-593746afd78c-host-run-netns\") pod \"multus-mppq2\" (UID: \"8d3be6d2-efff-4793-9082-593746afd78c\") " pod="openshift-multus/multus-mppq2"
May 25 11:23:30.856888 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:23:30.856309    2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/8d3be6d2-efff-4793-9082-593746afd78c-host-var-lib-cni-bin\") pod \"multus-mppq2\" (UID: \"8d3be6d2-efff-4793-9082-593746afd78c\") " pod="openshift-multus/multus-mppq2"
May 25 11:23:30.856888 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:23:30.856333    2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8025c487-c204-4901-97bc-f40fb251d4ba-tmp\") pod \"tuned-qsdv7\" (UID: \"8025c487-c204-4901-97bc-f40fb251d4ba\") " pod="openshift-cluster-node-tuning-operator/tuned-qsdv7"
May 25 11:23:30.856888 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:23:30.856340    2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/8d3be6d2-efff-4793-9082-593746afd78c-host-var-lib-cni-bin\") pod \"multus-mppq2\" (UID: \"8d3be6d2-efff-4793-9082-593746afd78c\") " pod="openshift-multus/multus-mppq2"
May 25 11:23:30.857672 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:23:30.856298    2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/8d3be6d2-efff-4793-9082-593746afd78c-multus-conf-dir\") pod \"multus-mppq2\" (UID: \"8d3be6d2-efff-4793-9082-593746afd78c\") " pod="openshift-multus/multus-mppq2"
May 25 11:23:30.857672 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:23:30.856354    2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/8d3be6d2-efff-4793-9082-593746afd78c-hostroot\") pod \"multus-mppq2\" (UID: \"8d3be6d2-efff-4793-9082-593746afd78c\") " pod="openshift-multus/multus-mppq2"
May 25 11:23:30.857672 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:23:30.856378    2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/8d3be6d2-efff-4793-9082-593746afd78c-multus-cni-dir\") pod \"multus-mppq2\" (UID: \"8d3be6d2-efff-4793-9082-593746afd78c\") " pod="openshift-multus/multus-mppq2"
May 25 11:23:30.857672 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:23:30.856409    2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/8d3be6d2-efff-4793-9082-593746afd78c-cnibin\") pod \"multus-mppq2\" (UID: \"8d3be6d2-efff-4793-9082-593746afd78c\") " pod="openshift-multus/multus-mppq2"
May 25 11:23:30.857672 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:23:30.856432    2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/8d3be6d2-efff-4793-9082-593746afd78c-os-release\") pod \"multus-mppq2\" (UID: \"8d3be6d2-efff-4793-9082-593746afd78c\") " pod="openshift-multus/multus-mppq2"
May 25 11:23:30.857672 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:23:30.856447    2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/803d9bd1-2b5f-451c-a4da-817e22be6c56-serviceca\") pod \"node-ca-296nq\" (UID: \"803d9bd1-2b5f-451c-a4da-817e22be6c56\") " pod="openshift-image-registry/node-ca-296nq"
May 25 11:23:30.857672 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:23:30.856458    2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/8d3be6d2-efff-4793-9082-593746afd78c-multus-daemon-config\") pod \"multus-mppq2\" (UID: \"8d3be6d2-efff-4793-9082-593746afd78c\") " pod="openshift-multus/multus-mppq2"
May 25 11:23:30.857672 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:23:30.856475    2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/8d3be6d2-efff-4793-9082-593746afd78c-multus-cni-dir\") pod \"multus-mppq2\" (UID: \"8d3be6d2-efff-4793-9082-593746afd78c\") " pod="openshift-multus/multus-mppq2"
May 25 11:23:30.857672 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:23:30.856483    2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/8025c487-c204-4901-97bc-f40fb251d4ba-sys\") pod \"tuned-qsdv7\" (UID: \"8025c487-c204-4901-97bc-f40fb251d4ba\") " pod="openshift-cluster-node-tuning-operator/tuned-qsdv7"
May 25 11:23:30.857672 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:23:30.856511    2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/8d3be6d2-efff-4793-9082-593746afd78c-cnibin\") pod \"multus-mppq2\" (UID: \"8d3be6d2-efff-4793-9082-593746afd78c\") " pod="openshift-multus/multus-mppq2"
May 25 11:23:30.857672 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:23:30.856515    2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/8025c487-c204-4901-97bc-f40fb251d4ba-host\") pod \"tuned-qsdv7\" (UID: \"8025c487-c204-4901-97bc-f40fb251d4ba\") " pod="openshift-cluster-node-tuning-operator/tuned-qsdv7"
May 25 11:23:30.857672 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:23:30.856526    2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/8d3be6d2-efff-4793-9082-593746afd78c-hostroot\") pod \"multus-mppq2\" (UID: \"8d3be6d2-efff-4793-9082-593746afd78c\") " pod="openshift-multus/multus-mppq2"
May 25 11:23:30.857672 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:23:30.856552    2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/f692c3e7-6b4e-443a-a334-88792f73d9d6-hosts-file\") pod \"node-resolver-nkmp2\" (UID: \"f692c3e7-6b4e-443a-a334-88792f73d9d6\") " pod="openshift-dns/node-resolver-nkmp2"
May 25 11:23:30.857672 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:23:30.856576    2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/8025c487-c204-4901-97bc-f40fb251d4ba-sys\") pod \"tuned-qsdv7\" (UID: \"8025c487-c204-4901-97bc-f40fb251d4ba\") " pod="openshift-cluster-node-tuning-operator/tuned-qsdv7"
May 25 11:23:30.857672 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:23:30.856580    2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/2299c072-4192-4fb8-a074-4ec0564cc016-kubelet-dir\") pod \"aws-ebs-csi-driver-node-ktzgh\" (UID: \"2299c072-4192-4fb8-a074-4ec0564cc016\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ktzgh"
May 25 11:23:30.857672 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:23:30.856588    2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/8d3be6d2-efff-4793-9082-593746afd78c-os-release\") pod \"multus-mppq2\" (UID: \"8d3be6d2-efff-4793-9082-593746afd78c\") " pod="openshift-multus/multus-mppq2"
May 25 11:23:30.857672 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:23:30.856604    2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/2299c072-4192-4fb8-a074-4ec0564cc016-socket-dir\") pod \"aws-ebs-csi-driver-node-ktzgh\" (UID: \"2299c072-4192-4fb8-a074-4ec0564cc016\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ktzgh"
May 25 11:23:30.857672 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:23:30.856631    2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/2299c072-4192-4fb8-a074-4ec0564cc016-registration-dir\") pod \"aws-ebs-csi-driver-node-ktzgh\" (UID: \"2299c072-4192-4fb8-a074-4ec0564cc016\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ktzgh"
May 25 11:23:30.858215 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:23:30.856645    2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/8025c487-c204-4901-97bc-f40fb251d4ba-host\") pod \"tuned-qsdv7\" (UID: \"8025c487-c204-4901-97bc-f40fb251d4ba\") " pod="openshift-cluster-node-tuning-operator/tuned-qsdv7"
May 25 11:23:30.858215 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:23:30.856658    2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/2299c072-4192-4fb8-a074-4ec0564cc016-device-dir\") pod \"aws-ebs-csi-driver-node-ktzgh\" (UID: \"2299c072-4192-4fb8-a074-4ec0564cc016\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ktzgh"
May 25 11:23:30.858215 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:23:30.856684    2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/8d3be6d2-efff-4793-9082-593746afd78c-cni-binary-copy\") pod \"multus-mppq2\" (UID: \"8d3be6d2-efff-4793-9082-593746afd78c\") " pod="openshift-multus/multus-mppq2"
May 25 11:23:30.858215 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:23:30.856687    2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-x2jbp\" (UniqueName: \"kubernetes.io/projected/8025c487-c204-4901-97bc-f40fb251d4ba-kube-api-access-x2jbp\") pod \"tuned-qsdv7\" (UID: \"8025c487-c204-4901-97bc-f40fb251d4ba\") " pod="openshift-cluster-node-tuning-operator/tuned-qsdv7"
May 25 11:23:30.858215 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:23:30.856737    2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/f692c3e7-6b4e-443a-a334-88792f73d9d6-hosts-file\") pod \"node-resolver-nkmp2\" (UID: \"f692c3e7-6b4e-443a-a334-88792f73d9d6\") " pod="openshift-dns/node-resolver-nkmp2"
May 25 11:23:30.858215 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:23:30.856754    2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/8025c487-c204-4901-97bc-f40fb251d4ba-etc-modprobe-d\") pod \"tuned-qsdv7\" (UID: \"8025c487-c204-4901-97bc-f40fb251d4ba\") " pod="openshift-cluster-node-tuning-operator/tuned-qsdv7"
May 25 11:23:30.858215 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:23:30.856782    2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/8025c487-c204-4901-97bc-f40fb251d4ba-etc-sysctl-d\") pod \"tuned-qsdv7\" (UID: \"8025c487-c204-4901-97bc-f40fb251d4ba\") " pod="openshift-cluster-node-tuning-operator/tuned-qsdv7"
May 25 11:23:30.858215 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:23:30.856875    2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/2299c072-4192-4fb8-a074-4ec0564cc016-socket-dir\") pod \"aws-ebs-csi-driver-node-ktzgh\" (UID: \"2299c072-4192-4fb8-a074-4ec0564cc016\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ktzgh"
May 25 11:23:30.858215 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:23:30.856923    2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/8025c487-c204-4901-97bc-f40fb251d4ba-etc-sysctl-d\") pod \"tuned-qsdv7\" (UID: \"8025c487-c204-4901-97bc-f40fb251d4ba\") " pod="openshift-cluster-node-tuning-operator/tuned-qsdv7"
May 25 11:23:30.858215 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:23:30.856692    2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/2299c072-4192-4fb8-a074-4ec0564cc016-kubelet-dir\") pod \"aws-ebs-csi-driver-node-ktzgh\" (UID: \"2299c072-4192-4fb8-a074-4ec0564cc016\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ktzgh"
May 25 11:23:30.858215 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:23:30.856941    2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/2299c072-4192-4fb8-a074-4ec0564cc016-registration-dir\") pod \"aws-ebs-csi-driver-node-ktzgh\" (UID: \"2299c072-4192-4fb8-a074-4ec0564cc016\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ktzgh"
May 25 11:23:30.858215 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:23:30.857014    2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/2299c072-4192-4fb8-a074-4ec0564cc016-device-dir\") pod \"aws-ebs-csi-driver-node-ktzgh\" (UID: \"2299c072-4192-4fb8-a074-4ec0564cc016\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ktzgh"
May 25 11:23:30.858215 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:23:30.857016    2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/8025c487-c204-4901-97bc-f40fb251d4ba-etc-modprobe-d\") pod \"tuned-qsdv7\" (UID: \"8025c487-c204-4901-97bc-f40fb251d4ba\") " pod="openshift-cluster-node-tuning-operator/tuned-qsdv7"
May 25 11:23:30.858215 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:23:30.857030    2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/8d3be6d2-efff-4793-9082-593746afd78c-multus-daemon-config\") pod \"multus-mppq2\" (UID: \"8d3be6d2-efff-4793-9082-593746afd78c\") " pod="openshift-multus/multus-mppq2"
May 25 11:23:30.858646 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:23:30.858371    2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/cc9f9059-2f19-464a-86c2-c8ec5ed6c010-agent-certs\") pod \"konnectivity-agent-k89nm\" (UID: \"cc9f9059-2f19-464a-86c2-c8ec5ed6c010\") " pod="kube-system/konnectivity-agent-k89nm"
May 25 11:23:30.858646 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:23:30.858500    2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8025c487-c204-4901-97bc-f40fb251d4ba-tmp\") pod \"tuned-qsdv7\" (UID: \"8025c487-c204-4901-97bc-f40fb251d4ba\") " pod="openshift-cluster-node-tuning-operator/tuned-qsdv7"
May 25 11:23:30.858646 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:23:30.858540    2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/8025c487-c204-4901-97bc-f40fb251d4ba-etc-tuned\") pod \"tuned-qsdv7\" (UID: \"8025c487-c204-4901-97bc-f40fb251d4ba\") " pod="openshift-cluster-node-tuning-operator/tuned-qsdv7"
May 25 11:23:30.864487 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:23:30.864465    2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-q2vl5\" (UniqueName: \"kubernetes.io/projected/803d9bd1-2b5f-451c-a4da-817e22be6c56-kube-api-access-q2vl5\") pod \"node-ca-296nq\" (UID: \"803d9bd1-2b5f-451c-a4da-817e22be6c56\") " pod="openshift-image-registry/node-ca-296nq"
May 25 11:23:30.864688 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:23:30.864668    2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-87788\" (UniqueName: \"kubernetes.io/projected/8d3be6d2-efff-4793-9082-593746afd78c-kube-api-access-87788\") pod \"multus-mppq2\" (UID: \"8d3be6d2-efff-4793-9082-593746afd78c\") " pod="openshift-multus/multus-mppq2"
May 25 11:23:30.864930 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:23:30.864915    2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-x2jbp\" (UniqueName: \"kubernetes.io/projected/8025c487-c204-4901-97bc-f40fb251d4ba-kube-api-access-x2jbp\") pod \"tuned-qsdv7\" (UID: \"8025c487-c204-4901-97bc-f40fb251d4ba\") " pod="openshift-cluster-node-tuning-operator/tuned-qsdv7"
May 25 11:23:30.865511 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:23:30.865489    2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9t46v\" (UniqueName: \"kubernetes.io/projected/f692c3e7-6b4e-443a-a334-88792f73d9d6-kube-api-access-9t46v\") pod \"node-resolver-nkmp2\" (UID: \"f692c3e7-6b4e-443a-a334-88792f73d9d6\") " pod="openshift-dns/node-resolver-nkmp2"
May 25 11:23:30.865677 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:23:30.865659    2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dzlts\" (UniqueName: \"kubernetes.io/projected/2299c072-4192-4fb8-a074-4ec0564cc016-kube-api-access-dzlts\") pod \"aws-ebs-csi-driver-node-ktzgh\" (UID: \"2299c072-4192-4fb8-a074-4ec0564cc016\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ktzgh"
May 25 11:23:30.944695 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:23:30.944601    2545 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-krfmt"
May 25 11:23:30.953361 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:23:30.953331    2545 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-znjmm"
May 25 11:23:30.961915 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:23:30.961890    2545 reflector.go:430] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
May 25 11:23:30.962070 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:23:30.961950    2545 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-cgxtl"
May 25 11:23:30.966387 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:23:30.966366    2545 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ktzgh"
May 25 11:23:30.975047 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:23:30.975023    2545 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-296nq"
May 25 11:23:30.981677 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:23:30.981653    2545 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-qsdv7"
May 25 11:23:30.988406 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:23:30.988381    2545 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-mppq2"
May 25 11:23:30.994025 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:23:30.993999    2545 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-nkmp2"
May 25 11:23:30.999631 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:23:30.999609    2545 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-k89nm"
May 25 11:23:31.075268 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:23:31.075237    2545 reflector.go:430] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
May 25 11:23:31.260283 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:23:31.260209    2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3872d4b9-e2c4-40ab-8fee-706d08118a88-metrics-certs\") pod \"network-metrics-daemon-cvfxv\" (UID: \"3872d4b9-e2c4-40ab-8fee-706d08118a88\") " pod="openshift-multus/network-metrics-daemon-cvfxv"
May 25 11:23:31.260452 ip-10-0-128-206 kubenswrapper[2545]: E0525 11:23:31.260336    2545 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
May 25 11:23:31.260452 ip-10-0-128-206 kubenswrapper[2545]: E0525 11:23:31.260416    2545 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3872d4b9-e2c4-40ab-8fee-706d08118a88-metrics-certs podName:3872d4b9-e2c4-40ab-8fee-706d08118a88 nodeName:}" failed. No retries permitted until 2026-05-25 11:23:32.260395374 +0000 UTC m=+4.026680302 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3872d4b9-e2c4-40ab-8fee-706d08118a88-metrics-certs") pod "network-metrics-daemon-cvfxv" (UID: "3872d4b9-e2c4-40ab-8fee-706d08118a88") : object "openshift-multus"/"metrics-daemon-secret" not registered
May 25 11:23:31.346196 ip-10-0-128-206 kubenswrapper[2545]: W0525 11:23:31.346170    2545 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0e95b3fe_d141_4227_80df_1b6f63fc89db.slice/crio-f0a0575878c707b5aef33392371d0316468a8c37ffb094c68d23fb7dfdd4bed9 WatchSource:0}: Error finding container f0a0575878c707b5aef33392371d0316468a8c37ffb094c68d23fb7dfdd4bed9: Status 404 returned error can't find the container with id f0a0575878c707b5aef33392371d0316468a8c37ffb094c68d23fb7dfdd4bed9
May 25 11:23:31.347234 ip-10-0-128-206 kubenswrapper[2545]: W0525 11:23:31.347209    2545 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8d3be6d2_efff_4793_9082_593746afd78c.slice/crio-2224de548bfb2356bc3bc51b1099e269e281412594289f2f2134ca7147b308e9 WatchSource:0}: Error finding container 2224de548bfb2356bc3bc51b1099e269e281412594289f2f2134ca7147b308e9: Status 404 returned error can't find the container with id 2224de548bfb2356bc3bc51b1099e269e281412594289f2f2134ca7147b308e9
May 25 11:23:31.349744 ip-10-0-128-206 kubenswrapper[2545]: W0525 11:23:31.349705    2545 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcc9f9059_2f19_464a_86c2_c8ec5ed6c010.slice/crio-1570838b1611c2a8929a3c97193fa66d7632234a93d5dc30356469727229a710 WatchSource:0}: Error finding container 1570838b1611c2a8929a3c97193fa66d7632234a93d5dc30356469727229a710: Status 404 returned error can't find the container with id 1570838b1611c2a8929a3c97193fa66d7632234a93d5dc30356469727229a710
May 25 11:23:31.352438 ip-10-0-128-206 kubenswrapper[2545]: W0525 11:23:31.352415    2545 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8025c487_c204_4901_97bc_f40fb251d4ba.slice/crio-96899636a5761e8f688e2b4520c20ea55767df827de25e6344225807351e2f4f WatchSource:0}: Error finding container 96899636a5761e8f688e2b4520c20ea55767df827de25e6344225807351e2f4f: Status 404 returned error can't find the container with id 96899636a5761e8f688e2b4520c20ea55767df827de25e6344225807351e2f4f
May 25 11:23:31.353262 ip-10-0-128-206 kubenswrapper[2545]: W0525 11:23:31.353240    2545 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod803d9bd1_2b5f_451c_a4da_817e22be6c56.slice/crio-8afa4f2fbc6de6ca530b4c7b76c49718ff9edce2075fa6b8b90c90ba9f20bb92 WatchSource:0}: Error finding container 8afa4f2fbc6de6ca530b4c7b76c49718ff9edce2075fa6b8b90c90ba9f20bb92: Status 404 returned error can't find the container with id 8afa4f2fbc6de6ca530b4c7b76c49718ff9edce2075fa6b8b90c90ba9f20bb92
May 25 11:23:31.354979 ip-10-0-128-206 kubenswrapper[2545]: W0525 11:23:31.354944    2545 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod52b29f60_937d_4e7d_bd19_e645004caeba.slice/crio-e55bcecc15f175b784a177e72dade276e65184d8e7031868116defbd23a9d697 WatchSource:0}: Error finding container e55bcecc15f175b784a177e72dade276e65184d8e7031868116defbd23a9d697: Status 404 returned error can't find the container with id e55bcecc15f175b784a177e72dade276e65184d8e7031868116defbd23a9d697
May 25 11:23:31.361200 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:23:31.361179    2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-476cp\" (UniqueName: \"kubernetes.io/projected/36dcd564-65d2-4f2e-82d7-8c8af53ca015-kube-api-access-476cp\") pod \"network-check-target-vnft7\" (UID: \"36dcd564-65d2-4f2e-82d7-8c8af53ca015\") " pod="openshift-network-diagnostics/network-check-target-vnft7"
May 25 11:23:31.361327 ip-10-0-128-206 kubenswrapper[2545]: E0525 11:23:31.361313    2545 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
May 25 11:23:31.361366 ip-10-0-128-206 kubenswrapper[2545]: E0525 11:23:31.361332    2545 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
May 25 11:23:31.361366 ip-10-0-128-206 kubenswrapper[2545]: E0525 11:23:31.361342    2545 projected.go:194] Error preparing data for projected volume kube-api-access-476cp for pod openshift-network-diagnostics/network-check-target-vnft7: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 25 11:23:31.361426 ip-10-0-128-206 kubenswrapper[2545]: E0525 11:23:31.361392    2545 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/36dcd564-65d2-4f2e-82d7-8c8af53ca015-kube-api-access-476cp podName:36dcd564-65d2-4f2e-82d7-8c8af53ca015 nodeName:}" failed. No retries permitted until 2026-05-25 11:23:32.361368628 +0000 UTC m=+4.127653556 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-476cp" (UniqueName: "kubernetes.io/projected/36dcd564-65d2-4f2e-82d7-8c8af53ca015-kube-api-access-476cp") pod "network-check-target-vnft7" (UID: "36dcd564-65d2-4f2e-82d7-8c8af53ca015") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 25 11:23:31.376371 ip-10-0-128-206 kubenswrapper[2545]: W0525 11:23:31.376339    2545 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2299c072_4192_4fb8_a074_4ec0564cc016.slice/crio-779e19e447fff8c2c1981a065618410dde45725fb6eac1a9e870cd118becea49 WatchSource:0}: Error finding container 779e19e447fff8c2c1981a065618410dde45725fb6eac1a9e870cd118becea49: Status 404 returned error can't find the container with id 779e19e447fff8c2c1981a065618410dde45725fb6eac1a9e870cd118becea49
May 25 11:23:31.377171 ip-10-0-128-206 kubenswrapper[2545]: W0525 11:23:31.377146    2545 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4e27bcd6_c257_422b_a332_0df274cf6fcc.slice/crio-e9b49d59380a092cc9f02d66fa45d62fc964082b5e7b9819895265610f8d1515 WatchSource:0}: Error finding container e9b49d59380a092cc9f02d66fa45d62fc964082b5e7b9819895265610f8d1515: Status 404 returned error can't find the container with id e9b49d59380a092cc9f02d66fa45d62fc964082b5e7b9819895265610f8d1515
May 25 11:23:31.378907 ip-10-0-128-206 kubenswrapper[2545]: W0525 11:23:31.378886    2545 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf692c3e7_6b4e_443a_a334_88792f73d9d6.slice/crio-76b882dda3242e52a71b9463d332a3518a952552d4a7866080915cb63dd1debe WatchSource:0}: Error finding container 76b882dda3242e52a71b9463d332a3518a952552d4a7866080915cb63dd1debe: Status 404 returned error can't find the container with id 76b882dda3242e52a71b9463d332a3518a952552d4a7866080915cb63dd1debe
May 25 11:23:31.692835 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:23:31.692580    2545 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-05-24 11:18:29 +0000 UTC" deadline="2028-01-19 13:16:10.464300695 +0000 UTC"
May 25 11:23:31.692835 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:23:31.692836    2545 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14497h52m38.771472842s"
May 25 11:23:31.785885 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:23:31.785835    2545 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-znjmm" event={"ID":"52b29f60-937d-4e7d-bd19-e645004caeba","Type":"ContainerStarted","Data":"e55bcecc15f175b784a177e72dade276e65184d8e7031868116defbd23a9d697"}
May 25 11:23:31.788788 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:23:31.788751    2545 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-mppq2" event={"ID":"8d3be6d2-efff-4793-9082-593746afd78c","Type":"ContainerStarted","Data":"2224de548bfb2356bc3bc51b1099e269e281412594289f2f2134ca7147b308e9"}
May 25 11:23:31.793899 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:23:31.793868    2545 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ktzgh" event={"ID":"2299c072-4192-4fb8-a074-4ec0564cc016","Type":"ContainerStarted","Data":"779e19e447fff8c2c1981a065618410dde45725fb6eac1a9e870cd118becea49"}
May 25 11:23:31.795791 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:23:31.795763    2545 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-nkmp2" event={"ID":"f692c3e7-6b4e-443a-a334-88792f73d9d6","Type":"ContainerStarted","Data":"76b882dda3242e52a71b9463d332a3518a952552d4a7866080915cb63dd1debe"}
May 25 11:23:31.798601 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:23:31.798575    2545 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-296nq" event={"ID":"803d9bd1-2b5f-451c-a4da-817e22be6c56","Type":"ContainerStarted","Data":"8afa4f2fbc6de6ca530b4c7b76c49718ff9edce2075fa6b8b90c90ba9f20bb92"}
May 25 11:23:31.800708 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:23:31.800684    2545 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-qsdv7" event={"ID":"8025c487-c204-4901-97bc-f40fb251d4ba","Type":"ContainerStarted","Data":"96899636a5761e8f688e2b4520c20ea55767df827de25e6344225807351e2f4f"}
May 25 11:23:31.809846 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:23:31.809762    2545 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-k89nm" event={"ID":"cc9f9059-2f19-464a-86c2-c8ec5ed6c010","Type":"ContainerStarted","Data":"1570838b1611c2a8929a3c97193fa66d7632234a93d5dc30356469727229a710"}
May 25 11:23:31.816159 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:23:31.814856    2545 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-cgxtl" event={"ID":"0e95b3fe-d141-4227-80df-1b6f63fc89db","Type":"ContainerStarted","Data":"f0a0575878c707b5aef33392371d0316468a8c37ffb094c68d23fb7dfdd4bed9"}
May 25 11:23:31.824382 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:23:31.824340    2545 generic.go:358] "Generic (PLEG): container finished" podID="dafcffec46e93c961979dd9c978f3fcd" containerID="3447c4ae67dc09b68873c05249e2e9572fe5e4b8047c23cf73ee6f0123c925f1" exitCode=0
May 25 11:23:31.824520 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:23:31.824428    2545 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-206.ec2.internal" event={"ID":"dafcffec46e93c961979dd9c978f3fcd","Type":"ContainerDied","Data":"3447c4ae67dc09b68873c05249e2e9572fe5e4b8047c23cf73ee6f0123c925f1"}
May 25 11:23:31.832246 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:23:31.831784    2545 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-206.ec2.internal" event={"ID":"a6772c4d9844f0928036a579dcf5d882","Type":"ContainerStarted","Data":"2affbdb150511cf0783d8b12d73124f48bbc60b3514728e66b34a82b8d7fd282"}
May 25 11:23:31.838211 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:23:31.838052    2545 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-krfmt" event={"ID":"4e27bcd6-c257-422b-a332-0df274cf6fcc","Type":"ContainerStarted","Data":"e9b49d59380a092cc9f02d66fa45d62fc964082b5e7b9819895265610f8d1515"}
May 25 11:23:32.268324 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:23:32.268143    2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3872d4b9-e2c4-40ab-8fee-706d08118a88-metrics-certs\") pod \"network-metrics-daemon-cvfxv\" (UID: \"3872d4b9-e2c4-40ab-8fee-706d08118a88\") " pod="openshift-multus/network-metrics-daemon-cvfxv"
May 25 11:23:32.268324 ip-10-0-128-206 kubenswrapper[2545]: E0525 11:23:32.268305    2545 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
May 25 11:23:32.268550 ip-10-0-128-206 kubenswrapper[2545]: E0525 11:23:32.268369    2545 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3872d4b9-e2c4-40ab-8fee-706d08118a88-metrics-certs podName:3872d4b9-e2c4-40ab-8fee-706d08118a88 nodeName:}" failed. No retries permitted until 2026-05-25 11:23:34.268350047 +0000 UTC m=+6.034634984 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3872d4b9-e2c4-40ab-8fee-706d08118a88-metrics-certs") pod "network-metrics-daemon-cvfxv" (UID: "3872d4b9-e2c4-40ab-8fee-706d08118a88") : object "openshift-multus"/"metrics-daemon-secret" not registered
May 25 11:23:32.369060 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:23:32.369020    2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-476cp\" (UniqueName: \"kubernetes.io/projected/36dcd564-65d2-4f2e-82d7-8c8af53ca015-kube-api-access-476cp\") pod \"network-check-target-vnft7\" (UID: \"36dcd564-65d2-4f2e-82d7-8c8af53ca015\") " pod="openshift-network-diagnostics/network-check-target-vnft7"
May 25 11:23:32.369241 ip-10-0-128-206 kubenswrapper[2545]: E0525 11:23:32.369222    2545 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
May 25 11:23:32.369297 ip-10-0-128-206 kubenswrapper[2545]: E0525 11:23:32.369242    2545 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
May 25 11:23:32.369297 ip-10-0-128-206 kubenswrapper[2545]: E0525 11:23:32.369255    2545 projected.go:194] Error preparing data for projected volume kube-api-access-476cp for pod openshift-network-diagnostics/network-check-target-vnft7: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 25 11:23:32.369386 ip-10-0-128-206 kubenswrapper[2545]: E0525 11:23:32.369314    2545 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/36dcd564-65d2-4f2e-82d7-8c8af53ca015-kube-api-access-476cp podName:36dcd564-65d2-4f2e-82d7-8c8af53ca015 nodeName:}" failed. No retries permitted until 2026-05-25 11:23:34.369293942 +0000 UTC m=+6.135578881 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-476cp" (UniqueName: "kubernetes.io/projected/36dcd564-65d2-4f2e-82d7-8c8af53ca015-kube-api-access-476cp") pod "network-check-target-vnft7" (UID: "36dcd564-65d2-4f2e-82d7-8c8af53ca015") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 25 11:23:32.770827 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:23:32.770081    2545 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vnft7"
May 25 11:23:32.770827 ip-10-0-128-206 kubenswrapper[2545]: E0525 11:23:32.770209    2545 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vnft7" podUID="36dcd564-65d2-4f2e-82d7-8c8af53ca015"
May 25 11:23:32.770827 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:23:32.770641    2545 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cvfxv"
May 25 11:23:32.770827 ip-10-0-128-206 kubenswrapper[2545]: E0525 11:23:32.770779    2545 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cvfxv" podUID="3872d4b9-e2c4-40ab-8fee-706d08118a88"
May 25 11:23:32.874256 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:23:32.874177    2545 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-206.ec2.internal" event={"ID":"dafcffec46e93c961979dd9c978f3fcd","Type":"ContainerStarted","Data":"407188e27c4d963e9626effde56c6ba4ff6381568686aa685b59930b8ed81161"}
May 25 11:23:32.894518 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:23:32.894459    2545 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-206.ec2.internal" podStartSLOduration=2.894439219 podStartE2EDuration="2.894439219s" podCreationTimestamp="2026-05-25 11:23:30 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-25 11:23:31.85866838 +0000 UTC m=+3.624953327" watchObservedRunningTime="2026-05-25 11:23:32.894439219 +0000 UTC m=+4.660724167"
May 25 11:23:32.894691 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:23:32.894638    2545 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-206.ec2.internal" podStartSLOduration=2.894630059 podStartE2EDuration="2.894630059s" podCreationTimestamp="2026-05-25 11:23:30 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-25 11:23:32.893519556 +0000 UTC m=+4.659804503" watchObservedRunningTime="2026-05-25 11:23:32.894630059 +0000 UTC m=+4.660915008"
May 25 11:23:34.288148 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:23:34.288101    2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3872d4b9-e2c4-40ab-8fee-706d08118a88-metrics-certs\") pod \"network-metrics-daemon-cvfxv\" (UID: \"3872d4b9-e2c4-40ab-8fee-706d08118a88\") " pod="openshift-multus/network-metrics-daemon-cvfxv"
May 25 11:23:34.288616 ip-10-0-128-206 kubenswrapper[2545]: E0525 11:23:34.288258    2545 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
May 25 11:23:34.288616 ip-10-0-128-206 kubenswrapper[2545]: E0525 11:23:34.288329    2545 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3872d4b9-e2c4-40ab-8fee-706d08118a88-metrics-certs podName:3872d4b9-e2c4-40ab-8fee-706d08118a88 nodeName:}" failed. No retries permitted until 2026-05-25 11:23:38.288309787 +0000 UTC m=+10.054594714 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3872d4b9-e2c4-40ab-8fee-706d08118a88-metrics-certs") pod "network-metrics-daemon-cvfxv" (UID: "3872d4b9-e2c4-40ab-8fee-706d08118a88") : object "openshift-multus"/"metrics-daemon-secret" not registered
May 25 11:23:34.388770 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:23:34.388712    2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-476cp\" (UniqueName: \"kubernetes.io/projected/36dcd564-65d2-4f2e-82d7-8c8af53ca015-kube-api-access-476cp\") pod \"network-check-target-vnft7\" (UID: \"36dcd564-65d2-4f2e-82d7-8c8af53ca015\") " pod="openshift-network-diagnostics/network-check-target-vnft7"
May 25 11:23:34.388991 ip-10-0-128-206 kubenswrapper[2545]: E0525 11:23:34.388937    2545 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
May 25 11:23:34.389071 ip-10-0-128-206 kubenswrapper[2545]: E0525 11:23:34.388993    2545 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
May 25 11:23:34.389071 ip-10-0-128-206 kubenswrapper[2545]: E0525 11:23:34.389008    2545 projected.go:194] Error preparing data for projected volume kube-api-access-476cp for pod openshift-network-diagnostics/network-check-target-vnft7: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 25 11:23:34.389172 ip-10-0-128-206 kubenswrapper[2545]: E0525 11:23:34.389085    2545 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/36dcd564-65d2-4f2e-82d7-8c8af53ca015-kube-api-access-476cp podName:36dcd564-65d2-4f2e-82d7-8c8af53ca015 nodeName:}" failed. No retries permitted until 2026-05-25 11:23:38.389064718 +0000 UTC m=+10.155349642 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-476cp" (UniqueName: "kubernetes.io/projected/36dcd564-65d2-4f2e-82d7-8c8af53ca015-kube-api-access-476cp") pod "network-check-target-vnft7" (UID: "36dcd564-65d2-4f2e-82d7-8c8af53ca015") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 25 11:23:34.770329 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:23:34.770299    2545 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cvfxv"
May 25 11:23:34.770512 ip-10-0-128-206 kubenswrapper[2545]: E0525 11:23:34.770437    2545 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cvfxv" podUID="3872d4b9-e2c4-40ab-8fee-706d08118a88"
May 25 11:23:34.770585 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:23:34.770511    2545 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vnft7"
May 25 11:23:34.770641 ip-10-0-128-206 kubenswrapper[2545]: E0525 11:23:34.770605    2545 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vnft7" podUID="36dcd564-65d2-4f2e-82d7-8c8af53ca015"
May 25 11:23:36.770188 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:23:36.770147    2545 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vnft7"
May 25 11:23:36.770615 ip-10-0-128-206 kubenswrapper[2545]: E0525 11:23:36.770288    2545 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vnft7" podUID="36dcd564-65d2-4f2e-82d7-8c8af53ca015"
May 25 11:23:36.770615 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:23:36.770354    2545 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cvfxv"
May 25 11:23:36.770615 ip-10-0-128-206 kubenswrapper[2545]: E0525 11:23:36.770478    2545 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cvfxv" podUID="3872d4b9-e2c4-40ab-8fee-706d08118a88"
May 25 11:23:38.321940 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:23:38.321434    2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3872d4b9-e2c4-40ab-8fee-706d08118a88-metrics-certs\") pod \"network-metrics-daemon-cvfxv\" (UID: \"3872d4b9-e2c4-40ab-8fee-706d08118a88\") " pod="openshift-multus/network-metrics-daemon-cvfxv"
May 25 11:23:38.321940 ip-10-0-128-206 kubenswrapper[2545]: E0525 11:23:38.321592    2545 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
May 25 11:23:38.321940 ip-10-0-128-206 kubenswrapper[2545]: E0525 11:23:38.321660    2545 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3872d4b9-e2c4-40ab-8fee-706d08118a88-metrics-certs podName:3872d4b9-e2c4-40ab-8fee-706d08118a88 nodeName:}" failed. No retries permitted until 2026-05-25 11:23:46.321639572 +0000 UTC m=+18.087924498 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3872d4b9-e2c4-40ab-8fee-706d08118a88-metrics-certs") pod "network-metrics-daemon-cvfxv" (UID: "3872d4b9-e2c4-40ab-8fee-706d08118a88") : object "openshift-multus"/"metrics-daemon-secret" not registered
May 25 11:23:38.422618 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:23:38.422576    2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-476cp\" (UniqueName: \"kubernetes.io/projected/36dcd564-65d2-4f2e-82d7-8c8af53ca015-kube-api-access-476cp\") pod \"network-check-target-vnft7\" (UID: \"36dcd564-65d2-4f2e-82d7-8c8af53ca015\") " pod="openshift-network-diagnostics/network-check-target-vnft7"
May 25 11:23:38.422828 ip-10-0-128-206 kubenswrapper[2545]: E0525 11:23:38.422801    2545 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
May 25 11:23:38.422900 ip-10-0-128-206 kubenswrapper[2545]: E0525 11:23:38.422837    2545 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
May 25 11:23:38.422900 ip-10-0-128-206 kubenswrapper[2545]: E0525 11:23:38.422852    2545 projected.go:194] Error preparing data for projected volume kube-api-access-476cp for pod openshift-network-diagnostics/network-check-target-vnft7: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 25 11:23:38.423426 ip-10-0-128-206 kubenswrapper[2545]: E0525 11:23:38.422975    2545 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/36dcd564-65d2-4f2e-82d7-8c8af53ca015-kube-api-access-476cp podName:36dcd564-65d2-4f2e-82d7-8c8af53ca015 nodeName:}" failed. No retries permitted until 2026-05-25 11:23:46.422927557 +0000 UTC m=+18.189212498 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-476cp" (UniqueName: "kubernetes.io/projected/36dcd564-65d2-4f2e-82d7-8c8af53ca015-kube-api-access-476cp") pod "network-check-target-vnft7" (UID: "36dcd564-65d2-4f2e-82d7-8c8af53ca015") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 25 11:23:38.770892 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:23:38.770419    2545 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vnft7"
May 25 11:23:38.770892 ip-10-0-128-206 kubenswrapper[2545]: E0525 11:23:38.770547    2545 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vnft7" podUID="36dcd564-65d2-4f2e-82d7-8c8af53ca015"
May 25 11:23:38.770892 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:23:38.770700    2545 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cvfxv"
May 25 11:23:38.770892 ip-10-0-128-206 kubenswrapper[2545]: E0525 11:23:38.770797    2545 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cvfxv" podUID="3872d4b9-e2c4-40ab-8fee-706d08118a88"
May 25 11:23:40.770408 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:23:40.770368    2545 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cvfxv"
May 25 11:23:40.770858 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:23:40.770425    2545 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vnft7"
May 25 11:23:40.770858 ip-10-0-128-206 kubenswrapper[2545]: E0525 11:23:40.770523    2545 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cvfxv" podUID="3872d4b9-e2c4-40ab-8fee-706d08118a88"
May 25 11:23:40.770858 ip-10-0-128-206 kubenswrapper[2545]: E0525 11:23:40.770654    2545 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vnft7" podUID="36dcd564-65d2-4f2e-82d7-8c8af53ca015"
May 25 11:23:42.769783 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:23:42.769742    2545 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vnft7"
May 25 11:23:42.770272 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:23:42.769754    2545 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cvfxv"
May 25 11:23:42.770272 ip-10-0-128-206 kubenswrapper[2545]: E0525 11:23:42.769882    2545 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vnft7" podUID="36dcd564-65d2-4f2e-82d7-8c8af53ca015"
May 25 11:23:42.770272 ip-10-0-128-206 kubenswrapper[2545]: E0525 11:23:42.769976    2545 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cvfxv" podUID="3872d4b9-e2c4-40ab-8fee-706d08118a88"
May 25 11:23:44.769859 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:23:44.769822    2545 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cvfxv"
May 25 11:23:44.770414 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:23:44.769824    2545 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vnft7"
May 25 11:23:44.770414 ip-10-0-128-206 kubenswrapper[2545]: E0525 11:23:44.769969    2545 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cvfxv" podUID="3872d4b9-e2c4-40ab-8fee-706d08118a88"
May 25 11:23:44.770414 ip-10-0-128-206 kubenswrapper[2545]: E0525 11:23:44.770030    2545 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vnft7" podUID="36dcd564-65d2-4f2e-82d7-8c8af53ca015"
May 25 11:23:46.381062 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:23:46.381027    2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3872d4b9-e2c4-40ab-8fee-706d08118a88-metrics-certs\") pod \"network-metrics-daemon-cvfxv\" (UID: \"3872d4b9-e2c4-40ab-8fee-706d08118a88\") " pod="openshift-multus/network-metrics-daemon-cvfxv"
May 25 11:23:46.381532 ip-10-0-128-206 kubenswrapper[2545]: E0525 11:23:46.381162    2545 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
May 25 11:23:46.381532 ip-10-0-128-206 kubenswrapper[2545]: E0525 11:23:46.381222    2545 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3872d4b9-e2c4-40ab-8fee-706d08118a88-metrics-certs podName:3872d4b9-e2c4-40ab-8fee-706d08118a88 nodeName:}" failed. No retries permitted until 2026-05-25 11:24:02.381206334 +0000 UTC m=+34.147491265 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3872d4b9-e2c4-40ab-8fee-706d08118a88-metrics-certs") pod "network-metrics-daemon-cvfxv" (UID: "3872d4b9-e2c4-40ab-8fee-706d08118a88") : object "openshift-multus"/"metrics-daemon-secret" not registered
May 25 11:23:46.481645 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:23:46.481608    2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-476cp\" (UniqueName: \"kubernetes.io/projected/36dcd564-65d2-4f2e-82d7-8c8af53ca015-kube-api-access-476cp\") pod \"network-check-target-vnft7\" (UID: \"36dcd564-65d2-4f2e-82d7-8c8af53ca015\") " pod="openshift-network-diagnostics/network-check-target-vnft7"
May 25 11:23:46.481815 ip-10-0-128-206 kubenswrapper[2545]: E0525 11:23:46.481772    2545 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
May 25 11:23:46.481815 ip-10-0-128-206 kubenswrapper[2545]: E0525 11:23:46.481789    2545 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
May 25 11:23:46.481815 ip-10-0-128-206 kubenswrapper[2545]: E0525 11:23:46.481799    2545 projected.go:194] Error preparing data for projected volume kube-api-access-476cp for pod openshift-network-diagnostics/network-check-target-vnft7: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 25 11:23:46.481944 ip-10-0-128-206 kubenswrapper[2545]: E0525 11:23:46.481858    2545 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/36dcd564-65d2-4f2e-82d7-8c8af53ca015-kube-api-access-476cp podName:36dcd564-65d2-4f2e-82d7-8c8af53ca015 nodeName:}" failed. No retries permitted until 2026-05-25 11:24:02.481842095 +0000 UTC m=+34.248127022 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-476cp" (UniqueName: "kubernetes.io/projected/36dcd564-65d2-4f2e-82d7-8c8af53ca015-kube-api-access-476cp") pod "network-check-target-vnft7" (UID: "36dcd564-65d2-4f2e-82d7-8c8af53ca015") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 25 11:23:46.770561 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:23:46.770526    2545 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vnft7"
May 25 11:23:46.770751 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:23:46.770677    2545 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cvfxv"
May 25 11:23:46.770798 ip-10-0-128-206 kubenswrapper[2545]: E0525 11:23:46.770776    2545 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cvfxv" podUID="3872d4b9-e2c4-40ab-8fee-706d08118a88"
May 25 11:23:46.770857 ip-10-0-128-206 kubenswrapper[2545]: E0525 11:23:46.770668    2545 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vnft7" podUID="36dcd564-65d2-4f2e-82d7-8c8af53ca015"
May 25 11:23:48.771322 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:23:48.771275    2545 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vnft7"
May 25 11:23:48.771718 ip-10-0-128-206 kubenswrapper[2545]: E0525 11:23:48.771368    2545 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vnft7" podUID="36dcd564-65d2-4f2e-82d7-8c8af53ca015"
May 25 11:23:48.771718 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:23:48.771452    2545 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cvfxv"
May 25 11:23:48.771718 ip-10-0-128-206 kubenswrapper[2545]: E0525 11:23:48.771545    2545 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cvfxv" podUID="3872d4b9-e2c4-40ab-8fee-706d08118a88"
May 25 11:23:49.906373 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:23:49.906340    2545 generic.go:358] "Generic (PLEG): container finished" podID="0e95b3fe-d141-4227-80df-1b6f63fc89db" containerID="856c13ab3962eef62868f06183b2d918ab8bb4b327c1ee9587c9b81a1083bcb4" exitCode=0
May 25 11:23:49.907030 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:23:49.906436    2545 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-cgxtl" event={"ID":"0e95b3fe-d141-4227-80df-1b6f63fc89db","Type":"ContainerDied","Data":"856c13ab3962eef62868f06183b2d918ab8bb4b327c1ee9587c9b81a1083bcb4"}
May 25 11:23:49.908700 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:23:49.908680    2545 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-krfmt_4e27bcd6-c257-422b-a332-0df274cf6fcc/ovn-acl-logging/0.log"
May 25 11:23:49.909074 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:23:49.909050    2545 generic.go:358] "Generic (PLEG): container finished" podID="4e27bcd6-c257-422b-a332-0df274cf6fcc" containerID="8ddb5193a94685cccac44bb20f6b3fa0f2e872b68ee978bff72e32a0b845e81d" exitCode=1
May 25 11:23:49.909167 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:23:49.909126    2545 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-krfmt" event={"ID":"4e27bcd6-c257-422b-a332-0df274cf6fcc","Type":"ContainerStarted","Data":"ad0b5fb3d2c628025dc64a77f71ba8d4732cebca7eb38243c4e6b37467c64b51"}
May 25 11:23:49.909167 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:23:49.909152    2545 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-krfmt" event={"ID":"4e27bcd6-c257-422b-a332-0df274cf6fcc","Type":"ContainerDied","Data":"8ddb5193a94685cccac44bb20f6b3fa0f2e872b68ee978bff72e32a0b845e81d"}
May 25 11:23:49.909265 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:23:49.909168    2545 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-krfmt" event={"ID":"4e27bcd6-c257-422b-a332-0df274cf6fcc","Type":"ContainerStarted","Data":"1e0dde607af9a82ab66eca5fe597991304539e7e01b41770b58f0c35735ad9c3"}
May 25 11:23:49.910517 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:23:49.910475    2545 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-mppq2" event={"ID":"8d3be6d2-efff-4793-9082-593746afd78c","Type":"ContainerStarted","Data":"7997f6082b836a3431ca7d50534ab69dc5aa3fe62eccb5605cea8d495e8b150b"}
May 25 11:23:49.911727 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:23:49.911699    2545 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ktzgh" event={"ID":"2299c072-4192-4fb8-a074-4ec0564cc016","Type":"ContainerStarted","Data":"ff6e5fdd981c74c1023a7e51ce605c7db2e1b3c69bc2638abe27ba89824483bd"}
May 25 11:23:49.912991 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:23:49.912940    2545 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-nkmp2" event={"ID":"f692c3e7-6b4e-443a-a334-88792f73d9d6","Type":"ContainerStarted","Data":"410844405c2d5dc30d679dd056f2e241e2400aedd919de47dac1d40c91f36a7b"}
May 25 11:23:49.914591 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:23:49.914563    2545 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-296nq" event={"ID":"803d9bd1-2b5f-451c-a4da-817e22be6c56","Type":"ContainerStarted","Data":"130a425daadb5850230cd3d4523e28095472b654f791aafdc29baf65dccf6418"}
May 25 11:23:49.915689 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:23:49.915670    2545 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-qsdv7" event={"ID":"8025c487-c204-4901-97bc-f40fb251d4ba","Type":"ContainerStarted","Data":"2811e5ccd111d6965b0e5d3b57fd950c042d15e76335711a5643789976160ccc"}
May 25 11:23:49.916691 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:23:49.916672    2545 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-k89nm" event={"ID":"cc9f9059-2f19-464a-86c2-c8ec5ed6c010","Type":"ContainerStarted","Data":"54d9a5166eb53710bb03abf650e22c1a76b4c75868e15e3218968fa9ef9cf37f"}
May 25 11:23:49.944765 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:23:49.944714    2545 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-image-registry/node-ca-296nq" podStartSLOduration=6.895362895 podStartE2EDuration="20.944701155s" podCreationTimestamp="2026-05-25 11:23:29 +0000 UTC" firstStartedPulling="2026-05-25 11:23:31.375081509 +0000 UTC m=+3.141366444" lastFinishedPulling="2026-05-25 11:23:45.42441978 +0000 UTC m=+17.190704704" observedRunningTime="2026-05-25 11:23:49.944506344 +0000 UTC m=+21.710791290" watchObservedRunningTime="2026-05-25 11:23:49.944701155 +0000 UTC m=+21.710986100"
May 25 11:23:49.965259 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:23:49.965216    2545 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/multus-mppq2" podStartSLOduration=2.959698147 podStartE2EDuration="20.96520444s" podCreationTimestamp="2026-05-25 11:23:29 +0000 UTC" firstStartedPulling="2026-05-25 11:23:31.349502124 +0000 UTC m=+3.115787066" lastFinishedPulling="2026-05-25 11:23:49.355008423 +0000 UTC m=+21.121293359" observedRunningTime="2026-05-25 11:23:49.962039082 +0000 UTC m=+21.728324029" watchObservedRunningTime="2026-05-25 11:23:49.96520444 +0000 UTC m=+21.731489386"
May 25 11:23:49.984388 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:23:49.984340    2545 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-qsdv7" podStartSLOduration=3.024706927 podStartE2EDuration="20.98432366s" podCreationTimestamp="2026-05-25 11:23:29 +0000 UTC" firstStartedPulling="2026-05-25 11:23:31.354598769 +0000 UTC m=+3.120883694" lastFinishedPulling="2026-05-25 11:23:49.314215495 +0000 UTC m=+21.080500427" observedRunningTime="2026-05-25 11:23:49.984248292 +0000 UTC m=+21.750533239" watchObservedRunningTime="2026-05-25 11:23:49.98432366 +0000 UTC m=+21.750608605"
May 25 11:23:49.998329 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:23:49.998280    2545 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-dns/node-resolver-nkmp2" podStartSLOduration=3.068193337 podStartE2EDuration="20.998265822s" podCreationTimestamp="2026-05-25 11:23:29 +0000 UTC" firstStartedPulling="2026-05-25 11:23:31.382456935 +0000 UTC m=+3.148741859" lastFinishedPulling="2026-05-25 11:23:49.312529401 +0000 UTC m=+21.078814344" observedRunningTime="2026-05-25 11:23:49.998175623 +0000 UTC m=+21.764460569" watchObservedRunningTime="2026-05-25 11:23:49.998265822 +0000 UTC m=+21.764550768"
May 25 11:23:50.014835 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:23:50.014797    2545 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/konnectivity-agent-k89nm" podStartSLOduration=3.053836239 podStartE2EDuration="21.014780535s" podCreationTimestamp="2026-05-25 11:23:29 +0000 UTC" firstStartedPulling="2026-05-25 11:23:31.351537556 +0000 UTC m=+3.117822481" lastFinishedPulling="2026-05-25 11:23:49.312481844 +0000 UTC m=+21.078766777" observedRunningTime="2026-05-25 11:23:50.01451256 +0000 UTC m=+21.780797503" watchObservedRunningTime="2026-05-25 11:23:50.014780535 +0000 UTC m=+21.781065480"
May 25 11:23:50.770795 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:23:50.770638    2545 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cvfxv"
May 25 11:23:50.770795 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:23:50.770680    2545 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vnft7"
May 25 11:23:50.770795 ip-10-0-128-206 kubenswrapper[2545]: E0525 11:23:50.770783    2545 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cvfxv" podUID="3872d4b9-e2c4-40ab-8fee-706d08118a88"
May 25 11:23:50.771138 ip-10-0-128-206 kubenswrapper[2545]: E0525 11:23:50.770912    2545 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vnft7" podUID="36dcd564-65d2-4f2e-82d7-8c8af53ca015"
May 25 11:23:50.920618 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:23:50.920587    2545 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-znjmm" event={"ID":"52b29f60-937d-4e7d-bd19-e645004caeba","Type":"ContainerStarted","Data":"dbe86b11396adff48cab78624b28ba987e7dbcdd1f17763442ee911096262fcd"}
May 25 11:23:50.925943 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:23:50.925918    2545 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-krfmt_4e27bcd6-c257-422b-a332-0df274cf6fcc/ovn-acl-logging/0.log"
May 25 11:23:50.926794 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:23:50.926762    2545 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-krfmt" event={"ID":"4e27bcd6-c257-422b-a332-0df274cf6fcc","Type":"ContainerStarted","Data":"2a3776a96ae18f2cd0ca9c2a59588a7935ecc6ed8811213aeb5b196dd81cb344"}
May 25 11:23:50.926885 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:23:50.926802    2545 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-krfmt" event={"ID":"4e27bcd6-c257-422b-a332-0df274cf6fcc","Type":"ContainerStarted","Data":"1e58e34c10bfd59d64f444b535c62c56aa81493a35a01e8c7b947c0e9e8bb84d"}
May 25 11:23:50.926885 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:23:50.926817    2545 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-krfmt" event={"ID":"4e27bcd6-c257-422b-a332-0df274cf6fcc","Type":"ContainerStarted","Data":"0dd255f63040fe37c62061a48638b88405655edbdf7f4029cd304df5523a3b92"}
May 25 11:23:50.930836 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:23:50.930804    2545 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
May 25 11:23:51.276859 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:23:51.276829    2545 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-k89nm"
May 25 11:23:51.277489 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:23:51.277466    2545 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-k89nm"
May 25 11:23:51.294611 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:23:51.294559    2545 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-znjmm" podStartSLOduration=5.356979073 podStartE2EDuration="23.294540272s" podCreationTimestamp="2026-05-25 11:23:28 +0000 UTC" firstStartedPulling="2026-05-25 11:23:31.375007305 +0000 UTC m=+3.141292232" lastFinishedPulling="2026-05-25 11:23:49.312568499 +0000 UTC m=+21.078853431" observedRunningTime="2026-05-25 11:23:50.93579899 +0000 UTC m=+22.702083937" watchObservedRunningTime="2026-05-25 11:23:51.294540272 +0000 UTC m=+23.060825219"
May 25 11:23:51.708749 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:23:51.708561    2545 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-05-25T11:23:50.930817347Z","UUID":"896107b6-05b8-4ef9-bb7f-7969d73a0c52","Handler":null,"Name":"","Endpoint":""}
May 25 11:23:51.710616 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:23:51.710564    2545 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
May 25 11:23:51.710616 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:23:51.710595    2545 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
May 25 11:23:51.930422 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:23:51.930377    2545 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ktzgh" event={"ID":"2299c072-4192-4fb8-a074-4ec0564cc016","Type":"ContainerStarted","Data":"ebe3c83d1079efbcb4482cc67c3455c317101b1e2a7d8220336b8f1bd6a31c6c"}
May 25 11:23:51.931012 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:23:51.930769    2545 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-k89nm"
May 25 11:23:51.931248 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:23:51.931227    2545 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-k89nm"
May 25 11:23:52.770568 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:23:52.770528    2545 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vnft7"
May 25 11:23:52.770736 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:23:52.770578    2545 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cvfxv"
May 25 11:23:52.770736 ip-10-0-128-206 kubenswrapper[2545]: E0525 11:23:52.770662    2545 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vnft7" podUID="36dcd564-65d2-4f2e-82d7-8c8af53ca015"
May 25 11:23:52.770862 ip-10-0-128-206 kubenswrapper[2545]: E0525 11:23:52.770773    2545 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cvfxv" podUID="3872d4b9-e2c4-40ab-8fee-706d08118a88"
May 25 11:23:52.935894 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:23:52.935863    2545 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-krfmt_4e27bcd6-c257-422b-a332-0df274cf6fcc/ovn-acl-logging/0.log"
May 25 11:23:52.936394 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:23:52.936273    2545 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-krfmt" event={"ID":"4e27bcd6-c257-422b-a332-0df274cf6fcc","Type":"ContainerStarted","Data":"d8afc8424cc6efec01c158931dd4c836c04e52720a6d1aa419bb05a373fefc13"}
May 25 11:23:52.938281 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:23:52.938248    2545 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ktzgh" event={"ID":"2299c072-4192-4fb8-a074-4ec0564cc016","Type":"ContainerStarted","Data":"5efb4b5571bdc79dc240c08e9d398ddcc539a073cbc21dcb43a465b0992f22d8"}
May 25 11:23:52.956284 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:23:52.956226    2545 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ktzgh" podStartSLOduration=3.328425302 podStartE2EDuration="23.956206449s" podCreationTimestamp="2026-05-25 11:23:29 +0000 UTC" firstStartedPulling="2026-05-25 11:23:31.378229056 +0000 UTC m=+3.144513991" lastFinishedPulling="2026-05-25 11:23:52.006010213 +0000 UTC m=+23.772295138" observedRunningTime="2026-05-25 11:23:52.95577453 +0000 UTC m=+24.722059496" watchObservedRunningTime="2026-05-25 11:23:52.956206449 +0000 UTC m=+24.722491392"
May 25 11:23:54.770717 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:23:54.770678    2545 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cvfxv"
May 25 11:23:54.771372 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:23:54.770679    2545 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vnft7"
May 25 11:23:54.771372 ip-10-0-128-206 kubenswrapper[2545]: E0525 11:23:54.770796    2545 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cvfxv" podUID="3872d4b9-e2c4-40ab-8fee-706d08118a88"
May 25 11:23:54.771372 ip-10-0-128-206 kubenswrapper[2545]: E0525 11:23:54.770880    2545 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vnft7" podUID="36dcd564-65d2-4f2e-82d7-8c8af53ca015"
May 25 11:23:54.946148 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:23:54.946115    2545 generic.go:358] "Generic (PLEG): container finished" podID="0e95b3fe-d141-4227-80df-1b6f63fc89db" containerID="4d474fc95dc527eb4f0d47a29326f247768518b8bdd5f1ad32dc95da7558c848" exitCode=0
May 25 11:23:54.946298 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:23:54.946165    2545 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-cgxtl" event={"ID":"0e95b3fe-d141-4227-80df-1b6f63fc89db","Type":"ContainerDied","Data":"4d474fc95dc527eb4f0d47a29326f247768518b8bdd5f1ad32dc95da7558c848"}
May 25 11:23:54.949267 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:23:54.949249    2545 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-krfmt_4e27bcd6-c257-422b-a332-0df274cf6fcc/ovn-acl-logging/0.log"
May 25 11:23:54.949562 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:23:54.949543    2545 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-krfmt" event={"ID":"4e27bcd6-c257-422b-a332-0df274cf6fcc","Type":"ContainerStarted","Data":"48f6a878f14de880129554db8a1ae1fffd515d5bb833e0aa6a0069366f72c08b"}
May 25 11:23:54.949893 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:23:54.949869    2545 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-krfmt"
May 25 11:23:54.950011 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:23:54.949995    2545 scope.go:117] "RemoveContainer" containerID="8ddb5193a94685cccac44bb20f6b3fa0f2e872b68ee978bff72e32a0b845e81d"
May 25 11:23:54.966037 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:23:54.965947    2545 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-krfmt"
May 25 11:23:55.953507 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:23:55.953269    2545 generic.go:358] "Generic (PLEG): container finished" podID="0e95b3fe-d141-4227-80df-1b6f63fc89db" containerID="055cf12f1ddbc81e13523ebdb9d27df89d687141e617711c5353ed8b00921c5d" exitCode=0
May 25 11:23:55.954034 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:23:55.953336    2545 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-cgxtl" event={"ID":"0e95b3fe-d141-4227-80df-1b6f63fc89db","Type":"ContainerDied","Data":"055cf12f1ddbc81e13523ebdb9d27df89d687141e617711c5353ed8b00921c5d"}
May 25 11:23:55.957049 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:23:55.957031    2545 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-krfmt_4e27bcd6-c257-422b-a332-0df274cf6fcc/ovn-acl-logging/0.log"
May 25 11:23:55.957368 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:23:55.957345    2545 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-krfmt" event={"ID":"4e27bcd6-c257-422b-a332-0df274cf6fcc","Type":"ContainerStarted","Data":"84371b1276eb99b749ce1887ea7d79084767d179485b4d89b1930973a3606b32"}
May 25 11:23:55.957652 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:23:55.957635    2545 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-krfmt"
May 25 11:23:55.957725 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:23:55.957661    2545 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-krfmt"
May 25 11:23:55.973118 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:23:55.973094    2545 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-krfmt"
May 25 11:23:56.007635 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:23:56.007591    2545 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-krfmt" podStartSLOduration=10.050075716 podStartE2EDuration="28.007574305s" podCreationTimestamp="2026-05-25 11:23:28 +0000 UTC" firstStartedPulling="2026-05-25 11:23:31.382448126 +0000 UTC m=+3.148733067" lastFinishedPulling="2026-05-25 11:23:49.339946715 +0000 UTC m=+21.106231656" observedRunningTime="2026-05-25 11:23:56.005750036 +0000 UTC m=+27.772034982" watchObservedRunningTime="2026-05-25 11:23:56.007574305 +0000 UTC m=+27.773859254"
May 25 11:23:56.243086 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:23:56.243047    2545 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-vnft7"]
May 25 11:23:56.243304 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:23:56.243098    2545 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-cvfxv"]
May 25 11:23:56.243304 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:23:56.243238    2545 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cvfxv"
May 25 11:23:56.243417 ip-10-0-128-206 kubenswrapper[2545]: E0525 11:23:56.243391    2545 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cvfxv" podUID="3872d4b9-e2c4-40ab-8fee-706d08118a88"
May 25 11:23:56.243896 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:23:56.243872    2545 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vnft7"
May 25 11:23:56.244242 ip-10-0-128-206 kubenswrapper[2545]: E0525 11:23:56.244009    2545 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vnft7" podUID="36dcd564-65d2-4f2e-82d7-8c8af53ca015"
May 25 11:23:56.960577 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:23:56.960480    2545 generic.go:358] "Generic (PLEG): container finished" podID="0e95b3fe-d141-4227-80df-1b6f63fc89db" containerID="d3c99f7b0e406255d3219f85eb7e38813eeac76f6b42fcf97df9d389deee7279" exitCode=0
May 25 11:23:56.960988 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:23:56.960569    2545 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-cgxtl" event={"ID":"0e95b3fe-d141-4227-80df-1b6f63fc89db","Type":"ContainerDied","Data":"d3c99f7b0e406255d3219f85eb7e38813eeac76f6b42fcf97df9d389deee7279"}
May 25 11:23:57.770580 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:23:57.770546    2545 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vnft7"
May 25 11:23:57.770754 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:23:57.770546    2545 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cvfxv"
May 25 11:23:57.770754 ip-10-0-128-206 kubenswrapper[2545]: E0525 11:23:57.770669    2545 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vnft7" podUID="36dcd564-65d2-4f2e-82d7-8c8af53ca015"
May 25 11:23:57.770754 ip-10-0-128-206 kubenswrapper[2545]: E0525 11:23:57.770721    2545 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cvfxv" podUID="3872d4b9-e2c4-40ab-8fee-706d08118a88"
May 25 11:23:59.770828 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:23:59.770787    2545 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vnft7"
May 25 11:23:59.771338 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:23:59.770799    2545 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cvfxv"
May 25 11:23:59.771338 ip-10-0-128-206 kubenswrapper[2545]: E0525 11:23:59.770916    2545 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vnft7" podUID="36dcd564-65d2-4f2e-82d7-8c8af53ca015"
May 25 11:23:59.771338 ip-10-0-128-206 kubenswrapper[2545]: E0525 11:23:59.771040    2545 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cvfxv" podUID="3872d4b9-e2c4-40ab-8fee-706d08118a88"
May 25 11:24:01.770685 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:24:01.770500    2545 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cvfxv"
May 25 11:24:01.771147 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:24:01.770536    2545 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vnft7"
May 25 11:24:01.771147 ip-10-0-128-206 kubenswrapper[2545]: E0525 11:24:01.770787    2545 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cvfxv" podUID="3872d4b9-e2c4-40ab-8fee-706d08118a88"
May 25 11:24:01.771147 ip-10-0-128-206 kubenswrapper[2545]: E0525 11:24:01.770875    2545 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vnft7" podUID="36dcd564-65d2-4f2e-82d7-8c8af53ca015"
May 25 11:24:02.039468 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:24:02.039392    2545 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-128-206.ec2.internal" event="NodeReady"
May 25 11:24:02.039619 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:24:02.039555    2545 kubelet_node_status.go:550] "Fast updating node status as it just became ready"
May 25 11:24:02.088413 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:24:02.088377    2545 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-hzp8b"]
May 25 11:24:02.135007 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:24:02.134949    2545 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-54rns"]
May 25 11:24:02.135184 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:24:02.135145    2545 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-hzp8b"
May 25 11:24:02.138133 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:24:02.138071    2545 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
May 25 11:24:02.138133 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:24:02.138091    2545 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-mbq6k\""
May 25 11:24:02.138336 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:24:02.138215    2545 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
May 25 11:24:02.149338 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:24:02.149314    2545 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-hzp8b"]
May 25 11:24:02.149453 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:24:02.149348    2545 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-54rns"]
May 25 11:24:02.149500 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:24:02.149467    2545 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-54rns"
May 25 11:24:02.152177 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:24:02.152156    2545 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
May 25 11:24:02.152177 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:24:02.152165    2545 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
May 25 11:24:02.152364 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:24:02.152246    2545 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-n7v95\""
May 25 11:24:02.152489 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:24:02.152470    2545 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
May 25 11:24:02.300204 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:24:02.300123    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tmpgq\" (UniqueName: \"kubernetes.io/projected/52c3a045-c0fc-41d6-b253-f96682889610-kube-api-access-tmpgq\") pod \"ingress-canary-54rns\" (UID: \"52c3a045-c0fc-41d6-b253-f96682889610\") " pod="openshift-ingress-canary/ingress-canary-54rns"
May 25 11:24:02.300204 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:24:02.300170    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/52c3a045-c0fc-41d6-b253-f96682889610-cert\") pod \"ingress-canary-54rns\" (UID: \"52c3a045-c0fc-41d6-b253-f96682889610\") " pod="openshift-ingress-canary/ingress-canary-54rns"
May 25 11:24:02.300204 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:24:02.300197    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/06d7f51c-471c-4691-a24a-2c5729f0560a-config-volume\") pod \"dns-default-hzp8b\" (UID: \"06d7f51c-471c-4691-a24a-2c5729f0560a\") " pod="openshift-dns/dns-default-hzp8b"
May 25 11:24:02.300486 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:24:02.300327    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/06d7f51c-471c-4691-a24a-2c5729f0560a-tmp-dir\") pod \"dns-default-hzp8b\" (UID: \"06d7f51c-471c-4691-a24a-2c5729f0560a\") " pod="openshift-dns/dns-default-hzp8b"
May 25 11:24:02.300486 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:24:02.300415    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/06d7f51c-471c-4691-a24a-2c5729f0560a-metrics-tls\") pod \"dns-default-hzp8b\" (UID: \"06d7f51c-471c-4691-a24a-2c5729f0560a\") " pod="openshift-dns/dns-default-hzp8b"
May 25 11:24:02.300486 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:24:02.300435    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dffbb\" (UniqueName: \"kubernetes.io/projected/06d7f51c-471c-4691-a24a-2c5729f0560a-kube-api-access-dffbb\") pod \"dns-default-hzp8b\" (UID: \"06d7f51c-471c-4691-a24a-2c5729f0560a\") " pod="openshift-dns/dns-default-hzp8b"
May 25 11:24:02.401560 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:24:02.401521    2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/06d7f51c-471c-4691-a24a-2c5729f0560a-tmp-dir\") pod \"dns-default-hzp8b\" (UID: \"06d7f51c-471c-4691-a24a-2c5729f0560a\") " pod="openshift-dns/dns-default-hzp8b"
May 25 11:24:02.401719 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:24:02.401589    2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3872d4b9-e2c4-40ab-8fee-706d08118a88-metrics-certs\") pod \"network-metrics-daemon-cvfxv\" (UID: \"3872d4b9-e2c4-40ab-8fee-706d08118a88\") " pod="openshift-multus/network-metrics-daemon-cvfxv"
May 25 11:24:02.401719 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:24:02.401617    2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/06d7f51c-471c-4691-a24a-2c5729f0560a-metrics-tls\") pod \"dns-default-hzp8b\" (UID: \"06d7f51c-471c-4691-a24a-2c5729f0560a\") " pod="openshift-dns/dns-default-hzp8b"
May 25 11:24:02.401719 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:24:02.401639    2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-dffbb\" (UniqueName: \"kubernetes.io/projected/06d7f51c-471c-4691-a24a-2c5729f0560a-kube-api-access-dffbb\") pod \"dns-default-hzp8b\" (UID: \"06d7f51c-471c-4691-a24a-2c5729f0560a\") " pod="openshift-dns/dns-default-hzp8b"
May 25 11:24:02.401719 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:24:02.401670    2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-tmpgq\" (UniqueName: \"kubernetes.io/projected/52c3a045-c0fc-41d6-b253-f96682889610-kube-api-access-tmpgq\") pod \"ingress-canary-54rns\" (UID: \"52c3a045-c0fc-41d6-b253-f96682889610\") " pod="openshift-ingress-canary/ingress-canary-54rns"
May 25 11:24:02.401719 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:24:02.401695    2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/52c3a045-c0fc-41d6-b253-f96682889610-cert\") pod \"ingress-canary-54rns\" (UID: \"52c3a045-c0fc-41d6-b253-f96682889610\") " pod="openshift-ingress-canary/ingress-canary-54rns"
May 25 11:24:02.401719 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:24:02.401715    2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/06d7f51c-471c-4691-a24a-2c5729f0560a-config-volume\") pod \"dns-default-hzp8b\" (UID: \"06d7f51c-471c-4691-a24a-2c5729f0560a\") " pod="openshift-dns/dns-default-hzp8b"
May 25 11:24:02.402065 ip-10-0-128-206 kubenswrapper[2545]: E0525 11:24:02.401768    2545 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
May 25 11:24:02.402065 ip-10-0-128-206 kubenswrapper[2545]: E0525 11:24:02.401812    2545 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
May 25 11:24:02.402065 ip-10-0-128-206 kubenswrapper[2545]: E0525 11:24:02.401834    2545 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/06d7f51c-471c-4691-a24a-2c5729f0560a-metrics-tls podName:06d7f51c-471c-4691-a24a-2c5729f0560a nodeName:}" failed. No retries permitted until 2026-05-25 11:24:02.901818332 +0000 UTC m=+34.668103262 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/06d7f51c-471c-4691-a24a-2c5729f0560a-metrics-tls") pod "dns-default-hzp8b" (UID: "06d7f51c-471c-4691-a24a-2c5729f0560a") : secret "dns-default-metrics-tls" not found
May 25 11:24:02.402065 ip-10-0-128-206 kubenswrapper[2545]: E0525 11:24:02.401768    2545 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
May 25 11:24:02.402065 ip-10-0-128-206 kubenswrapper[2545]: E0525 11:24:02.401881    2545 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/52c3a045-c0fc-41d6-b253-f96682889610-cert podName:52c3a045-c0fc-41d6-b253-f96682889610 nodeName:}" failed. No retries permitted until 2026-05-25 11:24:02.901862909 +0000 UTC m=+34.668147839 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/52c3a045-c0fc-41d6-b253-f96682889610-cert") pod "ingress-canary-54rns" (UID: "52c3a045-c0fc-41d6-b253-f96682889610") : secret "canary-serving-cert" not found
May 25 11:24:02.402065 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:24:02.401878    2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/06d7f51c-471c-4691-a24a-2c5729f0560a-tmp-dir\") pod \"dns-default-hzp8b\" (UID: \"06d7f51c-471c-4691-a24a-2c5729f0560a\") " pod="openshift-dns/dns-default-hzp8b"
May 25 11:24:02.402065 ip-10-0-128-206 kubenswrapper[2545]: E0525 11:24:02.401919    2545 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3872d4b9-e2c4-40ab-8fee-706d08118a88-metrics-certs podName:3872d4b9-e2c4-40ab-8fee-706d08118a88 nodeName:}" failed. No retries permitted until 2026-05-25 11:24:34.401903947 +0000 UTC m=+66.168188887 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3872d4b9-e2c4-40ab-8fee-706d08118a88-metrics-certs") pod "network-metrics-daemon-cvfxv" (UID: "3872d4b9-e2c4-40ab-8fee-706d08118a88") : object "openshift-multus"/"metrics-daemon-secret" not registered
May 25 11:24:02.402373 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:24:02.402273    2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/06d7f51c-471c-4691-a24a-2c5729f0560a-config-volume\") pod \"dns-default-hzp8b\" (UID: \"06d7f51c-471c-4691-a24a-2c5729f0560a\") " pod="openshift-dns/dns-default-hzp8b"
May 25 11:24:02.414136 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:24:02.414111    2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dffbb\" (UniqueName: \"kubernetes.io/projected/06d7f51c-471c-4691-a24a-2c5729f0560a-kube-api-access-dffbb\") pod \"dns-default-hzp8b\" (UID: \"06d7f51c-471c-4691-a24a-2c5729f0560a\") " pod="openshift-dns/dns-default-hzp8b"
May 25 11:24:02.414283 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:24:02.414195    2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tmpgq\" (UniqueName: \"kubernetes.io/projected/52c3a045-c0fc-41d6-b253-f96682889610-kube-api-access-tmpgq\") pod \"ingress-canary-54rns\" (UID: \"52c3a045-c0fc-41d6-b253-f96682889610\") " pod="openshift-ingress-canary/ingress-canary-54rns"
May 25 11:24:02.503028 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:24:02.502985    2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-476cp\" (UniqueName: \"kubernetes.io/projected/36dcd564-65d2-4f2e-82d7-8c8af53ca015-kube-api-access-476cp\") pod \"network-check-target-vnft7\" (UID: \"36dcd564-65d2-4f2e-82d7-8c8af53ca015\") " pod="openshift-network-diagnostics/network-check-target-vnft7"
May 25 11:24:02.503189 ip-10-0-128-206 kubenswrapper[2545]: E0525 11:24:02.503141    2545 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
May 25 11:24:02.503189 ip-10-0-128-206 kubenswrapper[2545]: E0525 11:24:02.503161    2545 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
May 25 11:24:02.503189 ip-10-0-128-206 kubenswrapper[2545]: E0525 11:24:02.503171    2545 projected.go:194] Error preparing data for projected volume kube-api-access-476cp for pod openshift-network-diagnostics/network-check-target-vnft7: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 25 11:24:02.503305 ip-10-0-128-206 kubenswrapper[2545]: E0525 11:24:02.503232    2545 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/36dcd564-65d2-4f2e-82d7-8c8af53ca015-kube-api-access-476cp podName:36dcd564-65d2-4f2e-82d7-8c8af53ca015 nodeName:}" failed. No retries permitted until 2026-05-25 11:24:34.503219383 +0000 UTC m=+66.269504311 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-476cp" (UniqueName: "kubernetes.io/projected/36dcd564-65d2-4f2e-82d7-8c8af53ca015-kube-api-access-476cp") pod "network-check-target-vnft7" (UID: "36dcd564-65d2-4f2e-82d7-8c8af53ca015") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 25 11:24:02.905273 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:24:02.905243    2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/06d7f51c-471c-4691-a24a-2c5729f0560a-metrics-tls\") pod \"dns-default-hzp8b\" (UID: \"06d7f51c-471c-4691-a24a-2c5729f0560a\") " pod="openshift-dns/dns-default-hzp8b"
May 25 11:24:02.905734 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:24:02.905302    2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/52c3a045-c0fc-41d6-b253-f96682889610-cert\") pod \"ingress-canary-54rns\" (UID: \"52c3a045-c0fc-41d6-b253-f96682889610\") " pod="openshift-ingress-canary/ingress-canary-54rns"
May 25 11:24:02.905734 ip-10-0-128-206 kubenswrapper[2545]: E0525 11:24:02.905371    2545 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
May 25 11:24:02.905734 ip-10-0-128-206 kubenswrapper[2545]: E0525 11:24:02.905433    2545 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/06d7f51c-471c-4691-a24a-2c5729f0560a-metrics-tls podName:06d7f51c-471c-4691-a24a-2c5729f0560a nodeName:}" failed. No retries permitted until 2026-05-25 11:24:03.905417265 +0000 UTC m=+35.671702189 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/06d7f51c-471c-4691-a24a-2c5729f0560a-metrics-tls") pod "dns-default-hzp8b" (UID: "06d7f51c-471c-4691-a24a-2c5729f0560a") : secret "dns-default-metrics-tls" not found
May 25 11:24:02.905734 ip-10-0-128-206 kubenswrapper[2545]: E0525 11:24:02.905454    2545 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
May 25 11:24:02.905734 ip-10-0-128-206 kubenswrapper[2545]: E0525 11:24:02.905507    2545 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/52c3a045-c0fc-41d6-b253-f96682889610-cert podName:52c3a045-c0fc-41d6-b253-f96682889610 nodeName:}" failed. No retries permitted until 2026-05-25 11:24:03.905491224 +0000 UTC m=+35.671776148 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/52c3a045-c0fc-41d6-b253-f96682889610-cert") pod "ingress-canary-54rns" (UID: "52c3a045-c0fc-41d6-b253-f96682889610") : secret "canary-serving-cert" not found
May 25 11:24:02.976334 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:24:02.976301    2545 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-cgxtl" event={"ID":"0e95b3fe-d141-4227-80df-1b6f63fc89db","Type":"ContainerStarted","Data":"6b331499dd948c234703e0888c9bf7b7a6c6f4047cd64b09dcbd9d1dafa40227"}
May 25 11:24:03.770249 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:24:03.770211    2545 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vnft7"
May 25 11:24:03.770434 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:24:03.770385    2545 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cvfxv"
May 25 11:24:03.774312 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:24:03.774286    2545 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
May 25 11:24:03.774421 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:24:03.774313    2545 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
May 25 11:24:03.774421 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:24:03.774294    2545 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
May 25 11:24:03.774421 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:24:03.774294    2545 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-x4v4p\""
May 25 11:24:03.774421 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:24:03.774323    2545 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-brg2t\""
May 25 11:24:03.913324 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:24:03.913286    2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/06d7f51c-471c-4691-a24a-2c5729f0560a-metrics-tls\") pod \"dns-default-hzp8b\" (UID: \"06d7f51c-471c-4691-a24a-2c5729f0560a\") " pod="openshift-dns/dns-default-hzp8b"
May 25 11:24:03.913324 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:24:03.913330    2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/52c3a045-c0fc-41d6-b253-f96682889610-cert\") pod \"ingress-canary-54rns\" (UID: \"52c3a045-c0fc-41d6-b253-f96682889610\") " pod="openshift-ingress-canary/ingress-canary-54rns"
May 25 11:24:03.913910 ip-10-0-128-206 kubenswrapper[2545]: E0525 11:24:03.913384    2545 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
May 25 11:24:03.913910 ip-10-0-128-206 kubenswrapper[2545]: E0525 11:24:03.913400    2545 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
May 25 11:24:03.913910 ip-10-0-128-206 kubenswrapper[2545]: E0525 11:24:03.913441    2545 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/52c3a045-c0fc-41d6-b253-f96682889610-cert podName:52c3a045-c0fc-41d6-b253-f96682889610 nodeName:}" failed. No retries permitted until 2026-05-25 11:24:05.913428621 +0000 UTC m=+37.679713545 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/52c3a045-c0fc-41d6-b253-f96682889610-cert") pod "ingress-canary-54rns" (UID: "52c3a045-c0fc-41d6-b253-f96682889610") : secret "canary-serving-cert" not found
May 25 11:24:03.913910 ip-10-0-128-206 kubenswrapper[2545]: E0525 11:24:03.913476    2545 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/06d7f51c-471c-4691-a24a-2c5729f0560a-metrics-tls podName:06d7f51c-471c-4691-a24a-2c5729f0560a nodeName:}" failed. No retries permitted until 2026-05-25 11:24:05.913447591 +0000 UTC m=+37.679732514 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/06d7f51c-471c-4691-a24a-2c5729f0560a-metrics-tls") pod "dns-default-hzp8b" (UID: "06d7f51c-471c-4691-a24a-2c5729f0560a") : secret "dns-default-metrics-tls" not found
May 25 11:24:03.980680 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:24:03.980648    2545 generic.go:358] "Generic (PLEG): container finished" podID="0e95b3fe-d141-4227-80df-1b6f63fc89db" containerID="6b331499dd948c234703e0888c9bf7b7a6c6f4047cd64b09dcbd9d1dafa40227" exitCode=0
May 25 11:24:03.980840 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:24:03.980698    2545 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-cgxtl" event={"ID":"0e95b3fe-d141-4227-80df-1b6f63fc89db","Type":"ContainerDied","Data":"6b331499dd948c234703e0888c9bf7b7a6c6f4047cd64b09dcbd9d1dafa40227"}
May 25 11:24:04.988014 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:24:04.987982    2545 generic.go:358] "Generic (PLEG): container finished" podID="0e95b3fe-d141-4227-80df-1b6f63fc89db" containerID="0d08cafbdd8762ae00aab116672bf62a8ac90449c660d849cd8dcf71b61a3121" exitCode=0
May 25 11:24:04.988465 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:24:04.988041    2545 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-cgxtl" event={"ID":"0e95b3fe-d141-4227-80df-1b6f63fc89db","Type":"ContainerDied","Data":"0d08cafbdd8762ae00aab116672bf62a8ac90449c660d849cd8dcf71b61a3121"}
May 25 11:24:05.927095 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:24:05.927047    2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/52c3a045-c0fc-41d6-b253-f96682889610-cert\") pod \"ingress-canary-54rns\" (UID: \"52c3a045-c0fc-41d6-b253-f96682889610\") " pod="openshift-ingress-canary/ingress-canary-54rns"
May 25 11:24:05.927243 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:24:05.927143    2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/06d7f51c-471c-4691-a24a-2c5729f0560a-metrics-tls\") pod \"dns-default-hzp8b\" (UID: \"06d7f51c-471c-4691-a24a-2c5729f0560a\") " pod="openshift-dns/dns-default-hzp8b"
May 25 11:24:05.927243 ip-10-0-128-206 kubenswrapper[2545]: E0525 11:24:05.927204    2545 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
May 25 11:24:05.927243 ip-10-0-128-206 kubenswrapper[2545]: E0525 11:24:05.927221    2545 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
May 25 11:24:05.927388 ip-10-0-128-206 kubenswrapper[2545]: E0525 11:24:05.927281    2545 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/52c3a045-c0fc-41d6-b253-f96682889610-cert podName:52c3a045-c0fc-41d6-b253-f96682889610 nodeName:}" failed. No retries permitted until 2026-05-25 11:24:09.927256354 +0000 UTC m=+41.693541278 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/52c3a045-c0fc-41d6-b253-f96682889610-cert") pod "ingress-canary-54rns" (UID: "52c3a045-c0fc-41d6-b253-f96682889610") : secret "canary-serving-cert" not found
May 25 11:24:05.927388 ip-10-0-128-206 kubenswrapper[2545]: E0525 11:24:05.927296    2545 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/06d7f51c-471c-4691-a24a-2c5729f0560a-metrics-tls podName:06d7f51c-471c-4691-a24a-2c5729f0560a nodeName:}" failed. No retries permitted until 2026-05-25 11:24:09.927290606 +0000 UTC m=+41.693575530 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/06d7f51c-471c-4691-a24a-2c5729f0560a-metrics-tls") pod "dns-default-hzp8b" (UID: "06d7f51c-471c-4691-a24a-2c5729f0560a") : secret "dns-default-metrics-tls" not found
May 25 11:24:05.992469 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:24:05.992436    2545 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-cgxtl" event={"ID":"0e95b3fe-d141-4227-80df-1b6f63fc89db","Type":"ContainerStarted","Data":"035d1dddadbac8531bfc0363b1207c066bbadae26e2c2be6abbdc838d707c713"}
May 25 11:24:06.033100 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:24:06.019789    2545 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-cgxtl" podStartSLOduration=5.5524669840000005 podStartE2EDuration="37.019774982s" podCreationTimestamp="2026-05-25 11:23:29 +0000 UTC" firstStartedPulling="2026-05-25 11:23:31.347944228 +0000 UTC m=+3.114229152" lastFinishedPulling="2026-05-25 11:24:02.815252226 +0000 UTC m=+34.581537150" observedRunningTime="2026-05-25 11:24:06.018100854 +0000 UTC m=+37.784385801" watchObservedRunningTime="2026-05-25 11:24:06.019774982 +0000 UTC m=+37.786059956"
May 25 11:24:09.955899 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:24:09.955863    2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/52c3a045-c0fc-41d6-b253-f96682889610-cert\") pod \"ingress-canary-54rns\" (UID: \"52c3a045-c0fc-41d6-b253-f96682889610\") " pod="openshift-ingress-canary/ingress-canary-54rns"
May 25 11:24:09.956261 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:24:09.955970    2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/06d7f51c-471c-4691-a24a-2c5729f0560a-metrics-tls\") pod \"dns-default-hzp8b\" (UID: \"06d7f51c-471c-4691-a24a-2c5729f0560a\") " pod="openshift-dns/dns-default-hzp8b"
May 25 11:24:09.956261 ip-10-0-128-206 kubenswrapper[2545]: E0525 11:24:09.956038    2545 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
May 25 11:24:09.956261 ip-10-0-128-206 kubenswrapper[2545]: E0525 11:24:09.956045    2545 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
May 25 11:24:09.956261 ip-10-0-128-206 kubenswrapper[2545]: E0525 11:24:09.956107    2545 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/06d7f51c-471c-4691-a24a-2c5729f0560a-metrics-tls podName:06d7f51c-471c-4691-a24a-2c5729f0560a nodeName:}" failed. No retries permitted until 2026-05-25 11:24:17.956087778 +0000 UTC m=+49.722372704 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/06d7f51c-471c-4691-a24a-2c5729f0560a-metrics-tls") pod "dns-default-hzp8b" (UID: "06d7f51c-471c-4691-a24a-2c5729f0560a") : secret "dns-default-metrics-tls" not found
May 25 11:24:09.956261 ip-10-0-128-206 kubenswrapper[2545]: E0525 11:24:09.956121    2545 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/52c3a045-c0fc-41d6-b253-f96682889610-cert podName:52c3a045-c0fc-41d6-b253-f96682889610 nodeName:}" failed. No retries permitted until 2026-05-25 11:24:17.956115184 +0000 UTC m=+49.722400108 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/52c3a045-c0fc-41d6-b253-f96682889610-cert") pod "ingress-canary-54rns" (UID: "52c3a045-c0fc-41d6-b253-f96682889610") : secret "canary-serving-cert" not found
May 25 11:24:18.014808 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:24:18.014602    2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/06d7f51c-471c-4691-a24a-2c5729f0560a-metrics-tls\") pod \"dns-default-hzp8b\" (UID: \"06d7f51c-471c-4691-a24a-2c5729f0560a\") " pod="openshift-dns/dns-default-hzp8b"
May 25 11:24:18.015305 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:24:18.014837    2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/52c3a045-c0fc-41d6-b253-f96682889610-cert\") pod \"ingress-canary-54rns\" (UID: \"52c3a045-c0fc-41d6-b253-f96682889610\") " pod="openshift-ingress-canary/ingress-canary-54rns"
May 25 11:24:18.015305 ip-10-0-128-206 kubenswrapper[2545]: E0525 11:24:18.014759    2545 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
May 25 11:24:18.015305 ip-10-0-128-206 kubenswrapper[2545]: E0525 11:24:18.014933    2545 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
May 25 11:24:18.015305 ip-10-0-128-206 kubenswrapper[2545]: E0525 11:24:18.014942    2545 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/06d7f51c-471c-4691-a24a-2c5729f0560a-metrics-tls podName:06d7f51c-471c-4691-a24a-2c5729f0560a nodeName:}" failed. No retries permitted until 2026-05-25 11:24:34.014922418 +0000 UTC m=+65.781207356 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/06d7f51c-471c-4691-a24a-2c5729f0560a-metrics-tls") pod "dns-default-hzp8b" (UID: "06d7f51c-471c-4691-a24a-2c5729f0560a") : secret "dns-default-metrics-tls" not found
May 25 11:24:18.015305 ip-10-0-128-206 kubenswrapper[2545]: E0525 11:24:18.014999    2545 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/52c3a045-c0fc-41d6-b253-f96682889610-cert podName:52c3a045-c0fc-41d6-b253-f96682889610 nodeName:}" failed. No retries permitted until 2026-05-25 11:24:34.014987937 +0000 UTC m=+65.781272861 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/52c3a045-c0fc-41d6-b253-f96682889610-cert") pod "ingress-canary-54rns" (UID: "52c3a045-c0fc-41d6-b253-f96682889610") : secret "canary-serving-cert" not found
May 25 11:24:24.804230 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:24:24.804196    2545 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-6c75959455-zg7q8"]
May 25 11:24:24.837614 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:24:24.837577    2545 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-6c75959455-zg7q8"]
May 25 11:24:24.837781 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:24:24.837705    2545 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-zg7q8"
May 25 11:24:24.843231 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:24:24.843194    2545 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\""
May 25 11:24:24.843231 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:24:24.843225    2545 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-nc2cv\""
May 25 11:24:24.843436 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:24:24.843202    2545 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
May 25 11:24:24.843527 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:24:24.843514    2545 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
May 25 11:24:24.843594 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:24:24.843576    2545 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\""
May 25 11:24:24.910811 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:24:24.910777    2545 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-78bdfb888c-xd89p"]
May 25 11:24:24.931194 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:24:24.931168    2545 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-78bdfb888c-xd89p"
May 25 11:24:24.934775 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:24:24.934750    2545 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
May 25 11:24:24.934898 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:24:24.934809    2545 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
May 25 11:24:24.935189 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:24:24.935172    2545 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-5h2q9\""
May 25 11:24:24.936085 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:24:24.936064    2545 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\""
May 25 11:24:24.936200 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:24:24.936116    2545 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\""
May 25 11:24:24.939904 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:24:24.939882    2545 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-78bdfb888c-xd89p"]
May 25 11:24:24.965392 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:24:24.965360    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/65aceb42-dd6c-4b1f-8eab-c38f414063dd-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6c75959455-zg7q8\" (UID: \"65aceb42-dd6c-4b1f-8eab-c38f414063dd\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-zg7q8"
May 25 11:24:24.965534 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:24:24.965465    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wt7nd\" (UniqueName: \"kubernetes.io/projected/65aceb42-dd6c-4b1f-8eab-c38f414063dd-kube-api-access-wt7nd\") pod \"cluster-monitoring-operator-6c75959455-zg7q8\" (UID: \"65aceb42-dd6c-4b1f-8eab-c38f414063dd\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-zg7q8"
May 25 11:24:24.965579 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:24:24.965556    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/65aceb42-dd6c-4b1f-8eab-c38f414063dd-telemetry-config\") pod \"cluster-monitoring-operator-6c75959455-zg7q8\" (UID: \"65aceb42-dd6c-4b1f-8eab-c38f414063dd\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-zg7q8"
May 25 11:24:24.974550 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:24:24.974529    2545 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\""
May 25 11:24:25.066690 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:24:25.066598    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/516a1b71-e17b-4035-987c-116abe33a4f8-tmp\") pod \"insights-operator-78bdfb888c-xd89p\" (UID: \"516a1b71-e17b-4035-987c-116abe33a4f8\") " pod="openshift-insights/insights-operator-78bdfb888c-xd89p"
May 25 11:24:25.066690 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:24:25.066648    2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/65aceb42-dd6c-4b1f-8eab-c38f414063dd-telemetry-config\") pod \"cluster-monitoring-operator-6c75959455-zg7q8\" (UID: \"65aceb42-dd6c-4b1f-8eab-c38f414063dd\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-zg7q8"
May 25 11:24:25.066909 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:24:25.066719    2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/65aceb42-dd6c-4b1f-8eab-c38f414063dd-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6c75959455-zg7q8\" (UID: \"65aceb42-dd6c-4b1f-8eab-c38f414063dd\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-zg7q8"
May 25 11:24:25.066909 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:24:25.066790    2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-wt7nd\" (UniqueName: \"kubernetes.io/projected/65aceb42-dd6c-4b1f-8eab-c38f414063dd-kube-api-access-wt7nd\") pod \"cluster-monitoring-operator-6c75959455-zg7q8\" (UID: \"65aceb42-dd6c-4b1f-8eab-c38f414063dd\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-zg7q8"
May 25 11:24:25.066909 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:24:25.066814    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8f8n4\" (UniqueName: \"kubernetes.io/projected/516a1b71-e17b-4035-987c-116abe33a4f8-kube-api-access-8f8n4\") pod \"insights-operator-78bdfb888c-xd89p\" (UID: \"516a1b71-e17b-4035-987c-116abe33a4f8\") " pod="openshift-insights/insights-operator-78bdfb888c-xd89p"
May 25 11:24:25.066909 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:24:25.066853    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/516a1b71-e17b-4035-987c-116abe33a4f8-snapshots\") pod \"insights-operator-78bdfb888c-xd89p\" (UID: \"516a1b71-e17b-4035-987c-116abe33a4f8\") " pod="openshift-insights/insights-operator-78bdfb888c-xd89p"
May 25 11:24:25.066909 ip-10-0-128-206 kubenswrapper[2545]: E0525 11:24:25.066867    2545 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
May 25 11:24:25.066909 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:24:25.066873    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/516a1b71-e17b-4035-987c-116abe33a4f8-trusted-ca-bundle\") pod \"insights-operator-78bdfb888c-xd89p\" (UID: \"516a1b71-e17b-4035-987c-116abe33a4f8\") " pod="openshift-insights/insights-operator-78bdfb888c-xd89p"
May 25 11:24:25.066909 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:24:25.066889    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/516a1b71-e17b-4035-987c-116abe33a4f8-service-ca-bundle\") pod \"insights-operator-78bdfb888c-xd89p\" (UID: \"516a1b71-e17b-4035-987c-116abe33a4f8\") " pod="openshift-insights/insights-operator-78bdfb888c-xd89p"
May 25 11:24:25.066909 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:24:25.066913    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/516a1b71-e17b-4035-987c-116abe33a4f8-serving-cert\") pod \"insights-operator-78bdfb888c-xd89p\" (UID: \"516a1b71-e17b-4035-987c-116abe33a4f8\") " pod="openshift-insights/insights-operator-78bdfb888c-xd89p"
May 25 11:24:25.067347 ip-10-0-128-206 kubenswrapper[2545]: E0525 11:24:25.066934    2545 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/65aceb42-dd6c-4b1f-8eab-c38f414063dd-cluster-monitoring-operator-tls podName:65aceb42-dd6c-4b1f-8eab-c38f414063dd nodeName:}" failed. No retries permitted until 2026-05-25 11:24:25.566913214 +0000 UTC m=+57.333198139 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/65aceb42-dd6c-4b1f-8eab-c38f414063dd-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6c75959455-zg7q8" (UID: "65aceb42-dd6c-4b1f-8eab-c38f414063dd") : secret "cluster-monitoring-operator-tls" not found
May 25 11:24:25.067503 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:24:25.067482    2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/65aceb42-dd6c-4b1f-8eab-c38f414063dd-telemetry-config\") pod \"cluster-monitoring-operator-6c75959455-zg7q8\" (UID: \"65aceb42-dd6c-4b1f-8eab-c38f414063dd\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-zg7q8"
May 25 11:24:25.097023 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:24:25.096987    2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wt7nd\" (UniqueName: \"kubernetes.io/projected/65aceb42-dd6c-4b1f-8eab-c38f414063dd-kube-api-access-wt7nd\") pod \"cluster-monitoring-operator-6c75959455-zg7q8\" (UID: \"65aceb42-dd6c-4b1f-8eab-c38f414063dd\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-zg7q8"
May 25 11:24:25.168033 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:24:25.167994    2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/516a1b71-e17b-4035-987c-116abe33a4f8-serving-cert\") pod \"insights-operator-78bdfb888c-xd89p\" (UID: \"516a1b71-e17b-4035-987c-116abe33a4f8\") " pod="openshift-insights/insights-operator-78bdfb888c-xd89p"
May 25 11:24:25.168033 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:24:25.168040    2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/516a1b71-e17b-4035-987c-116abe33a4f8-tmp\") pod \"insights-operator-78bdfb888c-xd89p\" (UID: \"516a1b71-e17b-4035-987c-116abe33a4f8\") " pod="openshift-insights/insights-operator-78bdfb888c-xd89p"
May 25 11:24:25.168264 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:24:25.168107    2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-8f8n4\" (UniqueName: \"kubernetes.io/projected/516a1b71-e17b-4035-987c-116abe33a4f8-kube-api-access-8f8n4\") pod \"insights-operator-78bdfb888c-xd89p\" (UID: \"516a1b71-e17b-4035-987c-116abe33a4f8\") " pod="openshift-insights/insights-operator-78bdfb888c-xd89p"
May 25 11:24:25.168264 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:24:25.168136    2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/516a1b71-e17b-4035-987c-116abe33a4f8-snapshots\") pod \"insights-operator-78bdfb888c-xd89p\" (UID: \"516a1b71-e17b-4035-987c-116abe33a4f8\") " pod="openshift-insights/insights-operator-78bdfb888c-xd89p"
May 25 11:24:25.168264 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:24:25.168200    2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/516a1b71-e17b-4035-987c-116abe33a4f8-trusted-ca-bundle\") pod \"insights-operator-78bdfb888c-xd89p\" (UID: \"516a1b71-e17b-4035-987c-116abe33a4f8\") " pod="openshift-insights/insights-operator-78bdfb888c-xd89p"
May 25 11:24:25.168264 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:24:25.168232    2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/516a1b71-e17b-4035-987c-116abe33a4f8-service-ca-bundle\") pod \"insights-operator-78bdfb888c-xd89p\" (UID: \"516a1b71-e17b-4035-987c-116abe33a4f8\") " pod="openshift-insights/insights-operator-78bdfb888c-xd89p"
May 25 11:24:25.168533 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:24:25.168509    2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/516a1b71-e17b-4035-987c-116abe33a4f8-tmp\") pod \"insights-operator-78bdfb888c-xd89p\" (UID: \"516a1b71-e17b-4035-987c-116abe33a4f8\") " pod="openshift-insights/insights-operator-78bdfb888c-xd89p"
May 25 11:24:25.168804 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:24:25.168783    2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/516a1b71-e17b-4035-987c-116abe33a4f8-snapshots\") pod \"insights-operator-78bdfb888c-xd89p\" (UID: \"516a1b71-e17b-4035-987c-116abe33a4f8\") " pod="openshift-insights/insights-operator-78bdfb888c-xd89p"
May 25 11:24:25.168804 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:24:25.168799    2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/516a1b71-e17b-4035-987c-116abe33a4f8-service-ca-bundle\") pod \"insights-operator-78bdfb888c-xd89p\" (UID: \"516a1b71-e17b-4035-987c-116abe33a4f8\") " pod="openshift-insights/insights-operator-78bdfb888c-xd89p"
May 25 11:24:25.169034 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:24:25.169018    2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/516a1b71-e17b-4035-987c-116abe33a4f8-trusted-ca-bundle\") pod \"insights-operator-78bdfb888c-xd89p\" (UID: \"516a1b71-e17b-4035-987c-116abe33a4f8\") " pod="openshift-insights/insights-operator-78bdfb888c-xd89p"
May 25 11:24:25.170415 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:24:25.170392    2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/516a1b71-e17b-4035-987c-116abe33a4f8-serving-cert\") pod \"insights-operator-78bdfb888c-xd89p\" (UID: \"516a1b71-e17b-4035-987c-116abe33a4f8\") " pod="openshift-insights/insights-operator-78bdfb888c-xd89p"
May 25 11:24:25.177559 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:24:25.177539    2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8f8n4\" (UniqueName: \"kubernetes.io/projected/516a1b71-e17b-4035-987c-116abe33a4f8-kube-api-access-8f8n4\") pod \"insights-operator-78bdfb888c-xd89p\" (UID: \"516a1b71-e17b-4035-987c-116abe33a4f8\") " pod="openshift-insights/insights-operator-78bdfb888c-xd89p"
May 25 11:24:25.239484 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:24:25.239441    2545 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-78bdfb888c-xd89p"
May 25 11:24:25.434207 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:24:25.434165    2545 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-78bdfb888c-xd89p"]
May 25 11:24:25.437863 ip-10-0-128-206 kubenswrapper[2545]: W0525 11:24:25.437839    2545 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod516a1b71_e17b_4035_987c_116abe33a4f8.slice/crio-2d8cf54952bf6304ba422bbcb3a4b7e3888bc3ad297d802d564ac746e28c0b26 WatchSource:0}: Error finding container 2d8cf54952bf6304ba422bbcb3a4b7e3888bc3ad297d802d564ac746e28c0b26: Status 404 returned error can't find the container with id 2d8cf54952bf6304ba422bbcb3a4b7e3888bc3ad297d802d564ac746e28c0b26
May 25 11:24:25.570630 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:24:25.570599    2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/65aceb42-dd6c-4b1f-8eab-c38f414063dd-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6c75959455-zg7q8\" (UID: \"65aceb42-dd6c-4b1f-8eab-c38f414063dd\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-zg7q8"
May 25 11:24:25.570822 ip-10-0-128-206 kubenswrapper[2545]: E0525 11:24:25.570759    2545 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
May 25 11:24:25.570890 ip-10-0-128-206 kubenswrapper[2545]: E0525 11:24:25.570844    2545 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/65aceb42-dd6c-4b1f-8eab-c38f414063dd-cluster-monitoring-operator-tls podName:65aceb42-dd6c-4b1f-8eab-c38f414063dd nodeName:}" failed. No retries permitted until 2026-05-25 11:24:26.570823017 +0000 UTC m=+58.337107941 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/65aceb42-dd6c-4b1f-8eab-c38f414063dd-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6c75959455-zg7q8" (UID: "65aceb42-dd6c-4b1f-8eab-c38f414063dd") : secret "cluster-monitoring-operator-tls" not found
May 25 11:24:26.027312 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:24:26.027277    2545 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-78bdfb888c-xd89p" event={"ID":"516a1b71-e17b-4035-987c-116abe33a4f8","Type":"ContainerStarted","Data":"2d8cf54952bf6304ba422bbcb3a4b7e3888bc3ad297d802d564ac746e28c0b26"}
May 25 11:24:26.578124 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:24:26.578088    2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/65aceb42-dd6c-4b1f-8eab-c38f414063dd-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6c75959455-zg7q8\" (UID: \"65aceb42-dd6c-4b1f-8eab-c38f414063dd\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-zg7q8"
May 25 11:24:26.578292 ip-10-0-128-206 kubenswrapper[2545]: E0525 11:24:26.578227    2545 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
May 25 11:24:26.578333 ip-10-0-128-206 kubenswrapper[2545]: E0525 11:24:26.578295    2545 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/65aceb42-dd6c-4b1f-8eab-c38f414063dd-cluster-monitoring-operator-tls podName:65aceb42-dd6c-4b1f-8eab-c38f414063dd nodeName:}" failed. No retries permitted until 2026-05-25 11:24:28.578277674 +0000 UTC m=+60.344562603 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/65aceb42-dd6c-4b1f-8eab-c38f414063dd-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6c75959455-zg7q8" (UID: "65aceb42-dd6c-4b1f-8eab-c38f414063dd") : secret "cluster-monitoring-operator-tls" not found
May 25 11:24:27.720560 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:24:27.720480    2545 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-5cf8c89d64-8ht7l"]
May 25 11:24:27.722120 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:24:27.722103    2545 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-5cf8c89d64-8ht7l"
May 25 11:24:27.725028 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:24:27.724996    2545 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\""
May 25 11:24:27.725028 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:24:27.725015    2545 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-b89th\""
May 25 11:24:27.725028 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:24:27.725001    2545 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\""
May 25 11:24:27.733375 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:24:27.733355    2545 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-5cf8c89d64-8ht7l"]
May 25 11:24:27.833290 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:24:27.833261    2545 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-697587599-z8wnj"]
May 25 11:24:27.835169 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:24:27.835154    2545 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-z8wnj"
May 25 11:24:27.838258 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:24:27.838239    2545 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-qk9j2\""
May 25 11:24:27.838526 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:24:27.838506    2545 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\""
May 25 11:24:27.838526 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:24:27.838530    2545 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\""
May 25 11:24:27.838802 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:24:27.838788    2545 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\""
May 25 11:24:27.850444 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:24:27.850413    2545 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-697587599-z8wnj"]
May 25 11:24:27.888246 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:24:27.888207    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-875km\" (UniqueName: \"kubernetes.io/projected/a4aca2db-3982-449b-9179-425094d3501d-kube-api-access-875km\") pod \"volume-data-source-validator-5cf8c89d64-8ht7l\" (UID: \"a4aca2db-3982-449b-9179-425094d3501d\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-5cf8c89d64-8ht7l"
May 25 11:24:27.973772 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:24:27.973697    2545 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-krfmt"
May 25 11:24:27.988790 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:24:27.988762    2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-875km\" (UniqueName: \"kubernetes.io/projected/a4aca2db-3982-449b-9179-425094d3501d-kube-api-access-875km\") pod \"volume-data-source-validator-5cf8c89d64-8ht7l\" (UID: \"a4aca2db-3982-449b-9179-425094d3501d\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-5cf8c89d64-8ht7l"
May 25 11:24:27.988976 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:24:27.988823    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/6240708b-ccdc-4633-9d75-6c25378e7402-samples-operator-tls\") pod \"cluster-samples-operator-697587599-z8wnj\" (UID: \"6240708b-ccdc-4633-9d75-6c25378e7402\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-z8wnj"
May 25 11:24:27.988976 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:24:27.988873    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5nr9k\" (UniqueName: \"kubernetes.io/projected/6240708b-ccdc-4633-9d75-6c25378e7402-kube-api-access-5nr9k\") pod \"cluster-samples-operator-697587599-z8wnj\" (UID: \"6240708b-ccdc-4633-9d75-6c25378e7402\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-z8wnj"
May 25 11:24:27.998010 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:24:27.997981    2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-875km\" (UniqueName: \"kubernetes.io/projected/a4aca2db-3982-449b-9179-425094d3501d-kube-api-access-875km\") pod \"volume-data-source-validator-5cf8c89d64-8ht7l\" (UID: \"a4aca2db-3982-449b-9179-425094d3501d\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-5cf8c89d64-8ht7l"
May 25 11:24:28.030791 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:24:28.030763    2545 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-5cf8c89d64-8ht7l"
May 25 11:24:28.032952 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:24:28.032923    2545 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-78bdfb888c-xd89p" event={"ID":"516a1b71-e17b-4035-987c-116abe33a4f8","Type":"ContainerStarted","Data":"28e8b6915538d2df86fa20091ebd3842366ccfc0dbadac9a1a550dc69839b264"}
May 25 11:24:28.054140 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:24:28.054089    2545 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-insights/insights-operator-78bdfb888c-xd89p" podStartSLOduration=2.207058206 podStartE2EDuration="4.054074505s" podCreationTimestamp="2026-05-25 11:24:24 +0000 UTC" firstStartedPulling="2026-05-25 11:24:25.439626135 +0000 UTC m=+57.205911062" lastFinishedPulling="2026-05-25 11:24:27.286642433 +0000 UTC m=+59.052927361" observedRunningTime="2026-05-25 11:24:28.053094103 +0000 UTC m=+59.819379050" watchObservedRunningTime="2026-05-25 11:24:28.054074505 +0000 UTC m=+59.820359478"
May 25 11:24:28.089358 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:24:28.089322    2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-5nr9k\" (UniqueName: \"kubernetes.io/projected/6240708b-ccdc-4633-9d75-6c25378e7402-kube-api-access-5nr9k\") pod \"cluster-samples-operator-697587599-z8wnj\" (UID: \"6240708b-ccdc-4633-9d75-6c25378e7402\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-z8wnj"
May 25 11:24:28.090082 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:24:28.089568    2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/6240708b-ccdc-4633-9d75-6c25378e7402-samples-operator-tls\") pod \"cluster-samples-operator-697587599-z8wnj\" (UID: \"6240708b-ccdc-4633-9d75-6c25378e7402\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-z8wnj"
May 25 11:24:28.090082 ip-10-0-128-206 kubenswrapper[2545]: E0525 11:24:28.089948    2545 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
May 25 11:24:28.090082 ip-10-0-128-206 kubenswrapper[2545]: E0525 11:24:28.090042    2545 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6240708b-ccdc-4633-9d75-6c25378e7402-samples-operator-tls podName:6240708b-ccdc-4633-9d75-6c25378e7402 nodeName:}" failed. No retries permitted until 2026-05-25 11:24:28.590022177 +0000 UTC m=+60.356307124 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/6240708b-ccdc-4633-9d75-6c25378e7402-samples-operator-tls") pod "cluster-samples-operator-697587599-z8wnj" (UID: "6240708b-ccdc-4633-9d75-6c25378e7402") : secret "samples-operator-tls" not found
May 25 11:24:28.098524 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:24:28.098495    2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5nr9k\" (UniqueName: \"kubernetes.io/projected/6240708b-ccdc-4633-9d75-6c25378e7402-kube-api-access-5nr9k\") pod \"cluster-samples-operator-697587599-z8wnj\" (UID: \"6240708b-ccdc-4633-9d75-6c25378e7402\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-z8wnj"
May 25 11:24:28.169921 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:24:28.169891    2545 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-5cf8c89d64-8ht7l"]
May 25 11:24:28.173643 ip-10-0-128-206 kubenswrapper[2545]: W0525 11:24:28.173616    2545 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda4aca2db_3982_449b_9179_425094d3501d.slice/crio-e00a10bc55165b868cb8f29eefcd08b00ae091b3fc337a36cdff8be2c9af6aef WatchSource:0}: Error finding container e00a10bc55165b868cb8f29eefcd08b00ae091b3fc337a36cdff8be2c9af6aef: Status 404 returned error can't find the container with id e00a10bc55165b868cb8f29eefcd08b00ae091b3fc337a36cdff8be2c9af6aef
May 25 11:24:28.595361 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:24:28.595304    2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/65aceb42-dd6c-4b1f-8eab-c38f414063dd-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6c75959455-zg7q8\" (UID: \"65aceb42-dd6c-4b1f-8eab-c38f414063dd\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-zg7q8"
May 25 11:24:28.595633 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:24:28.595416    2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/6240708b-ccdc-4633-9d75-6c25378e7402-samples-operator-tls\") pod \"cluster-samples-operator-697587599-z8wnj\" (UID: \"6240708b-ccdc-4633-9d75-6c25378e7402\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-z8wnj"
May 25 11:24:28.595633 ip-10-0-128-206 kubenswrapper[2545]: E0525 11:24:28.595475    2545 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
May 25 11:24:28.595633 ip-10-0-128-206 kubenswrapper[2545]: E0525 11:24:28.595537    2545 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
May 25 11:24:28.595633 ip-10-0-128-206 kubenswrapper[2545]: E0525 11:24:28.595577    2545 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/65aceb42-dd6c-4b1f-8eab-c38f414063dd-cluster-monitoring-operator-tls podName:65aceb42-dd6c-4b1f-8eab-c38f414063dd nodeName:}" failed. No retries permitted until 2026-05-25 11:24:32.595554697 +0000 UTC m=+64.361839637 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/65aceb42-dd6c-4b1f-8eab-c38f414063dd-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6c75959455-zg7q8" (UID: "65aceb42-dd6c-4b1f-8eab-c38f414063dd") : secret "cluster-monitoring-operator-tls" not found
May 25 11:24:28.595633 ip-10-0-128-206 kubenswrapper[2545]: E0525 11:24:28.595594    2545 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6240708b-ccdc-4633-9d75-6c25378e7402-samples-operator-tls podName:6240708b-ccdc-4633-9d75-6c25378e7402 nodeName:}" failed. No retries permitted until 2026-05-25 11:24:29.595586991 +0000 UTC m=+61.361871914 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/6240708b-ccdc-4633-9d75-6c25378e7402-samples-operator-tls") pod "cluster-samples-operator-697587599-z8wnj" (UID: "6240708b-ccdc-4633-9d75-6c25378e7402") : secret "samples-operator-tls" not found
May 25 11:24:29.036047 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:24:29.036006    2545 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-5cf8c89d64-8ht7l" event={"ID":"a4aca2db-3982-449b-9179-425094d3501d","Type":"ContainerStarted","Data":"e00a10bc55165b868cb8f29eefcd08b00ae091b3fc337a36cdff8be2c9af6aef"}
May 25 11:24:29.604793 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:24:29.604754    2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/6240708b-ccdc-4633-9d75-6c25378e7402-samples-operator-tls\") pod \"cluster-samples-operator-697587599-z8wnj\" (UID: \"6240708b-ccdc-4633-9d75-6c25378e7402\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-z8wnj"
May 25 11:24:29.605041 ip-10-0-128-206 kubenswrapper[2545]: E0525 11:24:29.604904    2545 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
May 25 11:24:29.605041 ip-10-0-128-206 kubenswrapper[2545]: E0525 11:24:29.604993    2545 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6240708b-ccdc-4633-9d75-6c25378e7402-samples-operator-tls podName:6240708b-ccdc-4633-9d75-6c25378e7402 nodeName:}" failed. No retries permitted until 2026-05-25 11:24:31.604976886 +0000 UTC m=+63.371261823 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/6240708b-ccdc-4633-9d75-6c25378e7402-samples-operator-tls") pod "cluster-samples-operator-697587599-z8wnj" (UID: "6240708b-ccdc-4633-9d75-6c25378e7402") : secret "samples-operator-tls" not found
May 25 11:24:30.038652 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:24:30.038620    2545 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-5cf8c89d64-8ht7l" event={"ID":"a4aca2db-3982-449b-9179-425094d3501d","Type":"ContainerStarted","Data":"4b0e1838e9e835b827014758f0a460819c92ea4a2ae9e6876cb43e162d0f12a8"}
May 25 11:24:30.054706 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:24:30.054656    2545 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-5cf8c89d64-8ht7l" podStartSLOduration=1.8706138540000001 podStartE2EDuration="3.05464033s" podCreationTimestamp="2026-05-25 11:24:27 +0000 UTC" firstStartedPulling="2026-05-25 11:24:28.175497975 +0000 UTC m=+59.941782899" lastFinishedPulling="2026-05-25 11:24:29.35952444 +0000 UTC m=+61.125809375" observedRunningTime="2026-05-25 11:24:30.053977483 +0000 UTC m=+61.820262430" watchObservedRunningTime="2026-05-25 11:24:30.05464033 +0000 UTC m=+61.820925276"
May 25 11:24:30.113487 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:24:30.113461    2545 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-nkmp2_f692c3e7-6b4e-443a-a334-88792f73d9d6/dns-node-resolver/0.log"
May 25 11:24:30.193423 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:24:30.193395    2545 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-64b679b875-7wj65"]
May 25 11:24:30.195646 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:24:30.195628    2545 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-64b679b875-7wj65"
May 25 11:24:30.198264 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:24:30.198244    2545 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-w59mk\""
May 25 11:24:30.198264 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:24:30.198252    2545 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
May 25 11:24:30.198485 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:24:30.198471    2545 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
May 25 11:24:30.198534 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:24:30.198471    2545 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
May 25 11:24:30.204508 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:24:30.204489    2545 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
May 25 11:24:30.212079 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:24:30.212052    2545 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-64b679b875-7wj65"]
May 25 11:24:30.312168 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:24:30.312071    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-62kqk\" (UniqueName: \"kubernetes.io/projected/918141d8-d07a-4526-aafe-3ba8eeceafd4-kube-api-access-62kqk\") pod \"image-registry-64b679b875-7wj65\" (UID: \"918141d8-d07a-4526-aafe-3ba8eeceafd4\") " pod="openshift-image-registry/image-registry-64b679b875-7wj65"
May 25 11:24:30.312168 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:24:30.312146    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/918141d8-d07a-4526-aafe-3ba8eeceafd4-image-registry-private-configuration\") pod \"image-registry-64b679b875-7wj65\" (UID: \"918141d8-d07a-4526-aafe-3ba8eeceafd4\") " pod="openshift-image-registry/image-registry-64b679b875-7wj65"
May 25 11:24:30.312402 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:24:30.312178    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/918141d8-d07a-4526-aafe-3ba8eeceafd4-registry-certificates\") pod \"image-registry-64b679b875-7wj65\" (UID: \"918141d8-d07a-4526-aafe-3ba8eeceafd4\") " pod="openshift-image-registry/image-registry-64b679b875-7wj65"
May 25 11:24:30.312402 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:24:30.312227    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/918141d8-d07a-4526-aafe-3ba8eeceafd4-trusted-ca\") pod \"image-registry-64b679b875-7wj65\" (UID: \"918141d8-d07a-4526-aafe-3ba8eeceafd4\") " pod="openshift-image-registry/image-registry-64b679b875-7wj65"
May 25 11:24:30.312402 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:24:30.312248    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/918141d8-d07a-4526-aafe-3ba8eeceafd4-bound-sa-token\") pod \"image-registry-64b679b875-7wj65\" (UID: \"918141d8-d07a-4526-aafe-3ba8eeceafd4\") " pod="openshift-image-registry/image-registry-64b679b875-7wj65"
May 25 11:24:30.312402 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:24:30.312348    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/918141d8-d07a-4526-aafe-3ba8eeceafd4-ca-trust-extracted\") pod \"image-registry-64b679b875-7wj65\" (UID: \"918141d8-d07a-4526-aafe-3ba8eeceafd4\") " pod="openshift-image-registry/image-registry-64b679b875-7wj65"
May 25 11:24:30.312402 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:24:30.312376    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/918141d8-d07a-4526-aafe-3ba8eeceafd4-registry-tls\") pod \"image-registry-64b679b875-7wj65\" (UID: \"918141d8-d07a-4526-aafe-3ba8eeceafd4\") " pod="openshift-image-registry/image-registry-64b679b875-7wj65"
May 25 11:24:30.312590 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:24:30.312426    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/918141d8-d07a-4526-aafe-3ba8eeceafd4-installation-pull-secrets\") pod \"image-registry-64b679b875-7wj65\" (UID: \"918141d8-d07a-4526-aafe-3ba8eeceafd4\") " pod="openshift-image-registry/image-registry-64b679b875-7wj65"
May 25 11:24:30.413719 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:24:30.413678    2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/918141d8-d07a-4526-aafe-3ba8eeceafd4-installation-pull-secrets\") pod \"image-registry-64b679b875-7wj65\" (UID: \"918141d8-d07a-4526-aafe-3ba8eeceafd4\") " pod="openshift-image-registry/image-registry-64b679b875-7wj65"
May 25 11:24:30.413719 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:24:30.413721    2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-62kqk\" (UniqueName: \"kubernetes.io/projected/918141d8-d07a-4526-aafe-3ba8eeceafd4-kube-api-access-62kqk\") pod \"image-registry-64b679b875-7wj65\" (UID: \"918141d8-d07a-4526-aafe-3ba8eeceafd4\") " pod="openshift-image-registry/image-registry-64b679b875-7wj65"
May 25 11:24:30.413911 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:24:30.413854    2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/918141d8-d07a-4526-aafe-3ba8eeceafd4-image-registry-private-configuration\") pod \"image-registry-64b679b875-7wj65\" (UID: \"918141d8-d07a-4526-aafe-3ba8eeceafd4\") " pod="openshift-image-registry/image-registry-64b679b875-7wj65"
May 25 11:24:30.413911 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:24:30.413891    2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/918141d8-d07a-4526-aafe-3ba8eeceafd4-registry-certificates\") pod \"image-registry-64b679b875-7wj65\" (UID: \"918141d8-d07a-4526-aafe-3ba8eeceafd4\") " pod="openshift-image-registry/image-registry-64b679b875-7wj65"
May 25 11:24:30.414062 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:24:30.413942    2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/918141d8-d07a-4526-aafe-3ba8eeceafd4-trusted-ca\") pod \"image-registry-64b679b875-7wj65\" (UID: \"918141d8-d07a-4526-aafe-3ba8eeceafd4\") " pod="openshift-image-registry/image-registry-64b679b875-7wj65"
May 25 11:24:30.414062 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:24:30.413986    2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/918141d8-d07a-4526-aafe-3ba8eeceafd4-bound-sa-token\") pod \"image-registry-64b679b875-7wj65\" (UID: \"918141d8-d07a-4526-aafe-3ba8eeceafd4\") " pod="openshift-image-registry/image-registry-64b679b875-7wj65"
May 25 11:24:30.414177 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:24:30.414154    2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/918141d8-d07a-4526-aafe-3ba8eeceafd4-ca-trust-extracted\") pod \"image-registry-64b679b875-7wj65\" (UID: \"918141d8-d07a-4526-aafe-3ba8eeceafd4\") " pod="openshift-image-registry/image-registry-64b679b875-7wj65"
May 25 11:24:30.414233 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:24:30.414201    2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/918141d8-d07a-4526-aafe-3ba8eeceafd4-registry-tls\") pod \"image-registry-64b679b875-7wj65\" (UID: \"918141d8-d07a-4526-aafe-3ba8eeceafd4\") " pod="openshift-image-registry/image-registry-64b679b875-7wj65"
May 25 11:24:30.414338 ip-10-0-128-206 kubenswrapper[2545]: E0525 11:24:30.414323    2545 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
May 25 11:24:30.414394 ip-10-0-128-206 kubenswrapper[2545]: E0525 11:24:30.414340    2545 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-64b679b875-7wj65: secret "image-registry-tls" not found
May 25 11:24:30.414440 ip-10-0-128-206 kubenswrapper[2545]: E0525 11:24:30.414396    2545 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/918141d8-d07a-4526-aafe-3ba8eeceafd4-registry-tls podName:918141d8-d07a-4526-aafe-3ba8eeceafd4 nodeName:}" failed. No retries permitted until 2026-05-25 11:24:30.914378896 +0000 UTC m=+62.680663822 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/918141d8-d07a-4526-aafe-3ba8eeceafd4-registry-tls") pod "image-registry-64b679b875-7wj65" (UID: "918141d8-d07a-4526-aafe-3ba8eeceafd4") : secret "image-registry-tls" not found
May 25 11:24:30.414573 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:24:30.414550    2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/918141d8-d07a-4526-aafe-3ba8eeceafd4-ca-trust-extracted\") pod \"image-registry-64b679b875-7wj65\" (UID: \"918141d8-d07a-4526-aafe-3ba8eeceafd4\") " pod="openshift-image-registry/image-registry-64b679b875-7wj65"
May 25 11:24:30.414713 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:24:30.414688    2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/918141d8-d07a-4526-aafe-3ba8eeceafd4-registry-certificates\") pod \"image-registry-64b679b875-7wj65\" (UID: \"918141d8-d07a-4526-aafe-3ba8eeceafd4\") " pod="openshift-image-registry/image-registry-64b679b875-7wj65"
May 25 11:24:30.415083 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:24:30.415061    2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/918141d8-d07a-4526-aafe-3ba8eeceafd4-trusted-ca\") pod \"image-registry-64b679b875-7wj65\" (UID: \"918141d8-d07a-4526-aafe-3ba8eeceafd4\") " pod="openshift-image-registry/image-registry-64b679b875-7wj65"
May 25 11:24:30.416562 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:24:30.416536    2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/918141d8-d07a-4526-aafe-3ba8eeceafd4-image-registry-private-configuration\") pod \"image-registry-64b679b875-7wj65\" (UID: \"918141d8-d07a-4526-aafe-3ba8eeceafd4\") " pod="openshift-image-registry/image-registry-64b679b875-7wj65"
May 25 11:24:30.416663 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:24:30.416643    2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/918141d8-d07a-4526-aafe-3ba8eeceafd4-installation-pull-secrets\") pod \"image-registry-64b679b875-7wj65\" (UID: \"918141d8-d07a-4526-aafe-3ba8eeceafd4\") " pod="openshift-image-registry/image-registry-64b679b875-7wj65"
May 25 11:24:30.422554 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:24:30.422532    2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-62kqk\" (UniqueName: \"kubernetes.io/projected/918141d8-d07a-4526-aafe-3ba8eeceafd4-kube-api-access-62kqk\") pod \"image-registry-64b679b875-7wj65\" (UID: \"918141d8-d07a-4526-aafe-3ba8eeceafd4\") " pod="openshift-image-registry/image-registry-64b679b875-7wj65"
May 25 11:24:30.422747 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:24:30.422730    2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/918141d8-d07a-4526-aafe-3ba8eeceafd4-bound-sa-token\") pod \"image-registry-64b679b875-7wj65\" (UID: \"918141d8-d07a-4526-aafe-3ba8eeceafd4\") " pod="openshift-image-registry/image-registry-64b679b875-7wj65"
May 25 11:24:30.912676 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:24:30.912645    2545 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-296nq_803d9bd1-2b5f-451c-a4da-817e22be6c56/node-ca/0.log"
May 25 11:24:30.919028 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:24:30.918996    2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/918141d8-d07a-4526-aafe-3ba8eeceafd4-registry-tls\") pod \"image-registry-64b679b875-7wj65\" (UID: \"918141d8-d07a-4526-aafe-3ba8eeceafd4\") " pod="openshift-image-registry/image-registry-64b679b875-7wj65"
May 25 11:24:30.919160 ip-10-0-128-206 kubenswrapper[2545]: E0525 11:24:30.919146    2545 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
May 25 11:24:30.919199 ip-10-0-128-206 kubenswrapper[2545]: E0525 11:24:30.919162    2545 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-64b679b875-7wj65: secret "image-registry-tls" not found
May 25 11:24:30.919229 ip-10-0-128-206 kubenswrapper[2545]: E0525 11:24:30.919212    2545 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/918141d8-d07a-4526-aafe-3ba8eeceafd4-registry-tls podName:918141d8-d07a-4526-aafe-3ba8eeceafd4 nodeName:}" failed. No retries permitted until 2026-05-25 11:24:31.919197478 +0000 UTC m=+63.685482401 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/918141d8-d07a-4526-aafe-3ba8eeceafd4-registry-tls") pod "image-registry-64b679b875-7wj65" (UID: "918141d8-d07a-4526-aafe-3ba8eeceafd4") : secret "image-registry-tls" not found
May 25 11:24:31.625240 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:24:31.625203    2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/6240708b-ccdc-4633-9d75-6c25378e7402-samples-operator-tls\") pod \"cluster-samples-operator-697587599-z8wnj\" (UID: \"6240708b-ccdc-4633-9d75-6c25378e7402\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-z8wnj"
May 25 11:24:31.625615 ip-10-0-128-206 kubenswrapper[2545]: E0525 11:24:31.625326    2545 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
May 25 11:24:31.625615 ip-10-0-128-206 kubenswrapper[2545]: E0525 11:24:31.625378    2545 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6240708b-ccdc-4633-9d75-6c25378e7402-samples-operator-tls podName:6240708b-ccdc-4633-9d75-6c25378e7402 nodeName:}" failed. No retries permitted until 2026-05-25 11:24:35.625364455 +0000 UTC m=+67.391649379 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/6240708b-ccdc-4633-9d75-6c25378e7402-samples-operator-tls") pod "cluster-samples-operator-697587599-z8wnj" (UID: "6240708b-ccdc-4633-9d75-6c25378e7402") : secret "samples-operator-tls" not found
May 25 11:24:31.928016 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:24:31.927933    2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/918141d8-d07a-4526-aafe-3ba8eeceafd4-registry-tls\") pod \"image-registry-64b679b875-7wj65\" (UID: \"918141d8-d07a-4526-aafe-3ba8eeceafd4\") " pod="openshift-image-registry/image-registry-64b679b875-7wj65"
May 25 11:24:31.928157 ip-10-0-128-206 kubenswrapper[2545]: E0525 11:24:31.928089    2545 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
May 25 11:24:31.928157 ip-10-0-128-206 kubenswrapper[2545]: E0525 11:24:31.928110    2545 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-64b679b875-7wj65: secret "image-registry-tls" not found
May 25 11:24:31.928229 ip-10-0-128-206 kubenswrapper[2545]: E0525 11:24:31.928164    2545 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/918141d8-d07a-4526-aafe-3ba8eeceafd4-registry-tls podName:918141d8-d07a-4526-aafe-3ba8eeceafd4 nodeName:}" failed. No retries permitted until 2026-05-25 11:24:33.928149198 +0000 UTC m=+65.694434147 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/918141d8-d07a-4526-aafe-3ba8eeceafd4-registry-tls") pod "image-registry-64b679b875-7wj65" (UID: "918141d8-d07a-4526-aafe-3ba8eeceafd4") : secret "image-registry-tls" not found
May 25 11:24:32.634016 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:24:32.633946    2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/65aceb42-dd6c-4b1f-8eab-c38f414063dd-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6c75959455-zg7q8\" (UID: \"65aceb42-dd6c-4b1f-8eab-c38f414063dd\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-zg7q8"
May 25 11:24:32.634397 ip-10-0-128-206 kubenswrapper[2545]: E0525 11:24:32.634083    2545 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
May 25 11:24:32.634397 ip-10-0-128-206 kubenswrapper[2545]: E0525 11:24:32.634158    2545 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/65aceb42-dd6c-4b1f-8eab-c38f414063dd-cluster-monitoring-operator-tls podName:65aceb42-dd6c-4b1f-8eab-c38f414063dd nodeName:}" failed. No retries permitted until 2026-05-25 11:24:40.634142463 +0000 UTC m=+72.400427387 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/65aceb42-dd6c-4b1f-8eab-c38f414063dd-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6c75959455-zg7q8" (UID: "65aceb42-dd6c-4b1f-8eab-c38f414063dd") : secret "cluster-monitoring-operator-tls" not found
May 25 11:24:33.944709 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:24:33.944667    2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/918141d8-d07a-4526-aafe-3ba8eeceafd4-registry-tls\") pod \"image-registry-64b679b875-7wj65\" (UID: \"918141d8-d07a-4526-aafe-3ba8eeceafd4\") " pod="openshift-image-registry/image-registry-64b679b875-7wj65"
May 25 11:24:33.945249 ip-10-0-128-206 kubenswrapper[2545]: E0525 11:24:33.944852    2545 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
May 25 11:24:33.945249 ip-10-0-128-206 kubenswrapper[2545]: E0525 11:24:33.944877    2545 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-64b679b875-7wj65: secret "image-registry-tls" not found
May 25 11:24:33.945249 ip-10-0-128-206 kubenswrapper[2545]: E0525 11:24:33.944978    2545 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/918141d8-d07a-4526-aafe-3ba8eeceafd4-registry-tls podName:918141d8-d07a-4526-aafe-3ba8eeceafd4 nodeName:}" failed. No retries permitted until 2026-05-25 11:24:37.944933834 +0000 UTC m=+69.711218786 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/918141d8-d07a-4526-aafe-3ba8eeceafd4-registry-tls") pod "image-registry-64b679b875-7wj65" (UID: "918141d8-d07a-4526-aafe-3ba8eeceafd4") : secret "image-registry-tls" not found
May 25 11:24:34.045218 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:24:34.045175    2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/52c3a045-c0fc-41d6-b253-f96682889610-cert\") pod \"ingress-canary-54rns\" (UID: \"52c3a045-c0fc-41d6-b253-f96682889610\") " pod="openshift-ingress-canary/ingress-canary-54rns"
May 25 11:24:34.045345 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:24:34.045288    2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/06d7f51c-471c-4691-a24a-2c5729f0560a-metrics-tls\") pod \"dns-default-hzp8b\" (UID: \"06d7f51c-471c-4691-a24a-2c5729f0560a\") " pod="openshift-dns/dns-default-hzp8b"
May 25 11:24:34.045345 ip-10-0-128-206 kubenswrapper[2545]: E0525 11:24:34.045311    2545 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
May 25 11:24:34.045430 ip-10-0-128-206 kubenswrapper[2545]: E0525 11:24:34.045363    2545 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/52c3a045-c0fc-41d6-b253-f96682889610-cert podName:52c3a045-c0fc-41d6-b253-f96682889610 nodeName:}" failed. No retries permitted until 2026-05-25 11:25:06.045348202 +0000 UTC m=+97.811633125 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/52c3a045-c0fc-41d6-b253-f96682889610-cert") pod "ingress-canary-54rns" (UID: "52c3a045-c0fc-41d6-b253-f96682889610") : secret "canary-serving-cert" not found
May 25 11:24:34.045430 ip-10-0-128-206 kubenswrapper[2545]: E0525 11:24:34.045382    2545 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
May 25 11:24:34.045506 ip-10-0-128-206 kubenswrapper[2545]: E0525 11:24:34.045441    2545 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/06d7f51c-471c-4691-a24a-2c5729f0560a-metrics-tls podName:06d7f51c-471c-4691-a24a-2c5729f0560a nodeName:}" failed. No retries permitted until 2026-05-25 11:25:06.045425545 +0000 UTC m=+97.811710469 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/06d7f51c-471c-4691-a24a-2c5729f0560a-metrics-tls") pod "dns-default-hzp8b" (UID: "06d7f51c-471c-4691-a24a-2c5729f0560a") : secret "dns-default-metrics-tls" not found
May 25 11:24:34.448692 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:24:34.448649    2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3872d4b9-e2c4-40ab-8fee-706d08118a88-metrics-certs\") pod \"network-metrics-daemon-cvfxv\" (UID: \"3872d4b9-e2c4-40ab-8fee-706d08118a88\") " pod="openshift-multus/network-metrics-daemon-cvfxv"
May 25 11:24:34.451738 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:24:34.451716    2545 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
May 25 11:24:34.459285 ip-10-0-128-206 kubenswrapper[2545]: E0525 11:24:34.459264    2545 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
May 25 11:24:34.459346 ip-10-0-128-206 kubenswrapper[2545]: E0525 11:24:34.459334    2545 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3872d4b9-e2c4-40ab-8fee-706d08118a88-metrics-certs podName:3872d4b9-e2c4-40ab-8fee-706d08118a88 nodeName:}" failed. No retries permitted until 2026-05-25 11:25:38.459312933 +0000 UTC m=+130.225597858 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3872d4b9-e2c4-40ab-8fee-706d08118a88-metrics-certs") pod "network-metrics-daemon-cvfxv" (UID: "3872d4b9-e2c4-40ab-8fee-706d08118a88") : secret "metrics-daemon-secret" not found
May 25 11:24:34.549737 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:24:34.549700    2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-476cp\" (UniqueName: \"kubernetes.io/projected/36dcd564-65d2-4f2e-82d7-8c8af53ca015-kube-api-access-476cp\") pod \"network-check-target-vnft7\" (UID: \"36dcd564-65d2-4f2e-82d7-8c8af53ca015\") " pod="openshift-network-diagnostics/network-check-target-vnft7"
May 25 11:24:34.552560 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:24:34.552542    2545 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
May 25 11:24:34.562493 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:24:34.562472    2545 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
May 25 11:24:34.573088 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:24:34.573063    2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-476cp\" (UniqueName: \"kubernetes.io/projected/36dcd564-65d2-4f2e-82d7-8c8af53ca015-kube-api-access-476cp\") pod \"network-check-target-vnft7\" (UID: \"36dcd564-65d2-4f2e-82d7-8c8af53ca015\") " pod="openshift-network-diagnostics/network-check-target-vnft7"
May 25 11:24:34.682566 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:24:34.682531    2545 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-x4v4p\""
May 25 11:24:34.690848 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:24:34.690819    2545 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vnft7"
May 25 11:24:34.814779 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:24:34.814747    2545 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-vnft7"]
May 25 11:24:34.818149 ip-10-0-128-206 kubenswrapper[2545]: W0525 11:24:34.818111    2545 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod36dcd564_65d2_4f2e_82d7_8c8af53ca015.slice/crio-44452712fde6074cb80010dcd675e1fe31adfd14223ada9eea4274b8122c92a1 WatchSource:0}: Error finding container 44452712fde6074cb80010dcd675e1fe31adfd14223ada9eea4274b8122c92a1: Status 404 returned error can't find the container with id 44452712fde6074cb80010dcd675e1fe31adfd14223ada9eea4274b8122c92a1
May 25 11:24:35.051215 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:24:35.051135    2545 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-vnft7" event={"ID":"36dcd564-65d2-4f2e-82d7-8c8af53ca015","Type":"ContainerStarted","Data":"44452712fde6074cb80010dcd675e1fe31adfd14223ada9eea4274b8122c92a1"}
May 25 11:24:35.659829 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:24:35.659790    2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/6240708b-ccdc-4633-9d75-6c25378e7402-samples-operator-tls\") pod \"cluster-samples-operator-697587599-z8wnj\" (UID: \"6240708b-ccdc-4633-9d75-6c25378e7402\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-z8wnj"
May 25 11:24:35.660113 ip-10-0-128-206 kubenswrapper[2545]: E0525 11:24:35.659979    2545 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
May 25 11:24:35.660113 ip-10-0-128-206 kubenswrapper[2545]: E0525 11:24:35.660066    2545 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6240708b-ccdc-4633-9d75-6c25378e7402-samples-operator-tls podName:6240708b-ccdc-4633-9d75-6c25378e7402 nodeName:}" failed. No retries permitted until 2026-05-25 11:24:43.660042944 +0000 UTC m=+75.426327873 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/6240708b-ccdc-4633-9d75-6c25378e7402-samples-operator-tls") pod "cluster-samples-operator-697587599-z8wnj" (UID: "6240708b-ccdc-4633-9d75-6c25378e7402") : secret "samples-operator-tls" not found
May 25 11:24:37.473691 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:24:37.473652    2545 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-b985f5d89-l7hq8"]
May 25 11:24:37.475858 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:24:37.475476    2545 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-b985f5d89-l7hq8"
May 25 11:24:37.478298 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:24:37.478278    2545 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\""
May 25 11:24:37.478385 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:24:37.478283    2545 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\""
May 25 11:24:37.478443 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:24:37.478284    2545 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-v8dh6\""
May 25 11:24:37.486601 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:24:37.486577    2545 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-b985f5d89-l7hq8"]
May 25 11:24:37.576852 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:24:37.576815    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rghhz\" (UniqueName: \"kubernetes.io/projected/e96f7c44-a3a2-4ef6-bd44-7049837dc7cd-kube-api-access-rghhz\") pod \"migrator-b985f5d89-l7hq8\" (UID: \"e96f7c44-a3a2-4ef6-bd44-7049837dc7cd\") " pod="openshift-kube-storage-version-migrator/migrator-b985f5d89-l7hq8"
May 25 11:24:37.677182 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:24:37.677153    2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-rghhz\" (UniqueName: \"kubernetes.io/projected/e96f7c44-a3a2-4ef6-bd44-7049837dc7cd-kube-api-access-rghhz\") pod \"migrator-b985f5d89-l7hq8\" (UID: \"e96f7c44-a3a2-4ef6-bd44-7049837dc7cd\") " pod="openshift-kube-storage-version-migrator/migrator-b985f5d89-l7hq8"
May 25 11:24:37.685876 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:24:37.685844    2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rghhz\" (UniqueName: \"kubernetes.io/projected/e96f7c44-a3a2-4ef6-bd44-7049837dc7cd-kube-api-access-rghhz\") pod \"migrator-b985f5d89-l7hq8\" (UID: \"e96f7c44-a3a2-4ef6-bd44-7049837dc7cd\") " pod="openshift-kube-storage-version-migrator/migrator-b985f5d89-l7hq8"
May 25 11:24:37.785731 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:24:37.785696    2545 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-b985f5d89-l7hq8"
May 25 11:24:37.905866 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:24:37.905835    2545 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-b985f5d89-l7hq8"]
May 25 11:24:37.909005 ip-10-0-128-206 kubenswrapper[2545]: W0525 11:24:37.908977    2545 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode96f7c44_a3a2_4ef6_bd44_7049837dc7cd.slice/crio-36cf44e8faf6c93853f624bae9a969a41559f83d92913aac07827c3c3cd7b77a WatchSource:0}: Error finding container 36cf44e8faf6c93853f624bae9a969a41559f83d92913aac07827c3c3cd7b77a: Status 404 returned error can't find the container with id 36cf44e8faf6c93853f624bae9a969a41559f83d92913aac07827c3c3cd7b77a
May 25 11:24:37.979489 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:24:37.979450    2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/918141d8-d07a-4526-aafe-3ba8eeceafd4-registry-tls\") pod \"image-registry-64b679b875-7wj65\" (UID: \"918141d8-d07a-4526-aafe-3ba8eeceafd4\") " pod="openshift-image-registry/image-registry-64b679b875-7wj65"
May 25 11:24:37.979690 ip-10-0-128-206 kubenswrapper[2545]: E0525 11:24:37.979617    2545 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
May 25 11:24:37.979690 ip-10-0-128-206 kubenswrapper[2545]: E0525 11:24:37.979639    2545 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-64b679b875-7wj65: secret "image-registry-tls" not found
May 25 11:24:37.979795 ip-10-0-128-206 kubenswrapper[2545]: E0525 11:24:37.979713    2545 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/918141d8-d07a-4526-aafe-3ba8eeceafd4-registry-tls podName:918141d8-d07a-4526-aafe-3ba8eeceafd4 nodeName:}" failed. No retries permitted until 2026-05-25 11:24:45.979688305 +0000 UTC m=+77.745973229 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/918141d8-d07a-4526-aafe-3ba8eeceafd4-registry-tls") pod "image-registry-64b679b875-7wj65" (UID: "918141d8-d07a-4526-aafe-3ba8eeceafd4") : secret "image-registry-tls" not found
May 25 11:24:38.057999 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:24:38.057904    2545 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-b985f5d89-l7hq8" event={"ID":"e96f7c44-a3a2-4ef6-bd44-7049837dc7cd","Type":"ContainerStarted","Data":"36cf44e8faf6c93853f624bae9a969a41559f83d92913aac07827c3c3cd7b77a"}
May 25 11:24:38.059193 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:24:38.059173    2545 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-vnft7" event={"ID":"36dcd564-65d2-4f2e-82d7-8c8af53ca015","Type":"ContainerStarted","Data":"5f15428cb1e8ec84a42d514ba0d7e0069c9f65a5120270b30aec27188a1b9140"}
May 25 11:24:38.059339 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:24:38.059322    2545 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-vnft7"
May 25 11:24:38.075952 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:24:38.075908    2545 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-vnft7" podStartSLOduration=67.418474644 podStartE2EDuration="1m10.075892822s" podCreationTimestamp="2026-05-25 11:23:28 +0000 UTC" firstStartedPulling="2026-05-25 11:24:34.820136969 +0000 UTC m=+66.586421893" lastFinishedPulling="2026-05-25 11:24:37.477555129 +0000 UTC m=+69.243840071" observedRunningTime="2026-05-25 11:24:38.075421627 +0000 UTC m=+69.841706587" watchObservedRunningTime="2026-05-25 11:24:38.075892822 +0000 UTC m=+69.842177770"
May 25 11:24:40.068833 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:24:40.068800    2545 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-b985f5d89-l7hq8" event={"ID":"e96f7c44-a3a2-4ef6-bd44-7049837dc7cd","Type":"ContainerStarted","Data":"3fc0a30933381f9d88acaeb6762e409c25779001d373a16727dd01f3d003516c"}
May 25 11:24:40.068833 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:24:40.068837    2545 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-b985f5d89-l7hq8" event={"ID":"e96f7c44-a3a2-4ef6-bd44-7049837dc7cd","Type":"ContainerStarted","Data":"f880f92e896000764edb7230e816dad78ef4a73d9fefc0aa31141f310a24f43e"}
May 25 11:24:40.088524 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:24:40.088479    2545 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-b985f5d89-l7hq8" podStartSLOduration=1.91517844 podStartE2EDuration="3.088466655s" podCreationTimestamp="2026-05-25 11:24:37 +0000 UTC" firstStartedPulling="2026-05-25 11:24:37.910860026 +0000 UTC m=+69.677144950" lastFinishedPulling="2026-05-25 11:24:39.084148226 +0000 UTC m=+70.850433165" observedRunningTime="2026-05-25 11:24:40.087200103 +0000 UTC m=+71.853485050" watchObservedRunningTime="2026-05-25 11:24:40.088466655 +0000 UTC m=+71.854751600"
May 25 11:24:40.703224 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:24:40.703181    2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/65aceb42-dd6c-4b1f-8eab-c38f414063dd-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6c75959455-zg7q8\" (UID: \"65aceb42-dd6c-4b1f-8eab-c38f414063dd\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-zg7q8"
May 25 11:24:40.703391 ip-10-0-128-206 kubenswrapper[2545]: E0525 11:24:40.703322    2545 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
May 25 11:24:40.703391 ip-10-0-128-206 kubenswrapper[2545]: E0525 11:24:40.703389    2545 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/65aceb42-dd6c-4b1f-8eab-c38f414063dd-cluster-monitoring-operator-tls podName:65aceb42-dd6c-4b1f-8eab-c38f414063dd nodeName:}" failed. No retries permitted until 2026-05-25 11:24:56.703372536 +0000 UTC m=+88.469657479 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/65aceb42-dd6c-4b1f-8eab-c38f414063dd-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6c75959455-zg7q8" (UID: "65aceb42-dd6c-4b1f-8eab-c38f414063dd") : secret "cluster-monitoring-operator-tls" not found
May 25 11:24:43.727688 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:24:43.727570    2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/6240708b-ccdc-4633-9d75-6c25378e7402-samples-operator-tls\") pod \"cluster-samples-operator-697587599-z8wnj\" (UID: \"6240708b-ccdc-4633-9d75-6c25378e7402\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-z8wnj"
May 25 11:24:43.729995 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:24:43.729974    2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/6240708b-ccdc-4633-9d75-6c25378e7402-samples-operator-tls\") pod \"cluster-samples-operator-697587599-z8wnj\" (UID: \"6240708b-ccdc-4633-9d75-6c25378e7402\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-z8wnj"
May 25 11:24:43.746790 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:24:43.746769    2545 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-qk9j2\""
May 25 11:24:43.754392 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:24:43.754377    2545 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-z8wnj"
May 25 11:24:43.871425 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:24:43.871397    2545 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-697587599-z8wnj"]
May 25 11:24:44.078180 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:24:44.078143    2545 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-z8wnj" event={"ID":"6240708b-ccdc-4633-9d75-6c25378e7402","Type":"ContainerStarted","Data":"19043f706ab94a6bf6f8e8245ea4aa8ee89514ee76a705739824f9cb29affe65"}
May 25 11:24:46.045245 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:24:46.045208    2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/918141d8-d07a-4526-aafe-3ba8eeceafd4-registry-tls\") pod \"image-registry-64b679b875-7wj65\" (UID: \"918141d8-d07a-4526-aafe-3ba8eeceafd4\") " pod="openshift-image-registry/image-registry-64b679b875-7wj65"
May 25 11:24:46.045604 ip-10-0-128-206 kubenswrapper[2545]: E0525 11:24:46.045350    2545 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
May 25 11:24:46.045604 ip-10-0-128-206 kubenswrapper[2545]: E0525 11:24:46.045370    2545 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-64b679b875-7wj65: secret "image-registry-tls" not found
May 25 11:24:46.045604 ip-10-0-128-206 kubenswrapper[2545]: E0525 11:24:46.045422    2545 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/918141d8-d07a-4526-aafe-3ba8eeceafd4-registry-tls podName:918141d8-d07a-4526-aafe-3ba8eeceafd4 nodeName:}" failed. No retries permitted until 2026-05-25 11:25:02.045406976 +0000 UTC m=+93.811691901 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/918141d8-d07a-4526-aafe-3ba8eeceafd4-registry-tls") pod "image-registry-64b679b875-7wj65" (UID: "918141d8-d07a-4526-aafe-3ba8eeceafd4") : secret "image-registry-tls" not found
May 25 11:24:46.085355 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:24:46.085327    2545 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-z8wnj" event={"ID":"6240708b-ccdc-4633-9d75-6c25378e7402","Type":"ContainerStarted","Data":"37d6f7938ed2e9a0b32f4fc9b6f601904ceaac34b288e81bdbe704e34d172ef2"}
May 25 11:24:46.085477 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:24:46.085361    2545 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-z8wnj" event={"ID":"6240708b-ccdc-4633-9d75-6c25378e7402","Type":"ContainerStarted","Data":"aa27ccd627158fb0d32d3e357c18565be163c267c04d2fe611714fb0ac3c5be6"}
May 25 11:24:46.103880 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:24:46.103832    2545 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-z8wnj" podStartSLOduration=17.517581403 podStartE2EDuration="19.103819369s" podCreationTimestamp="2026-05-25 11:24:27 +0000 UTC" firstStartedPulling="2026-05-25 11:24:43.913945686 +0000 UTC m=+75.680230610" lastFinishedPulling="2026-05-25 11:24:45.500183651 +0000 UTC m=+77.266468576" observedRunningTime="2026-05-25 11:24:46.102204509 +0000 UTC m=+77.868489458" watchObservedRunningTime="2026-05-25 11:24:46.103819369 +0000 UTC m=+77.870104315"
May 25 11:24:56.724594 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:24:56.724551    2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/65aceb42-dd6c-4b1f-8eab-c38f414063dd-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6c75959455-zg7q8\" (UID: \"65aceb42-dd6c-4b1f-8eab-c38f414063dd\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-zg7q8"
May 25 11:24:56.727143 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:24:56.727115    2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/65aceb42-dd6c-4b1f-8eab-c38f414063dd-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6c75959455-zg7q8\" (UID: \"65aceb42-dd6c-4b1f-8eab-c38f414063dd\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-zg7q8"
May 25 11:24:56.950559 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:24:56.950525    2545 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-nc2cv\""
May 25 11:24:56.957842 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:24:56.957821    2545 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-zg7q8"
May 25 11:24:57.082694 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:24:57.082663    2545 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-6c75959455-zg7q8"]
May 25 11:24:57.086000 ip-10-0-128-206 kubenswrapper[2545]: W0525 11:24:57.085969    2545 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod65aceb42_dd6c_4b1f_8eab_c38f414063dd.slice/crio-969b41b686eb3781e16e7e01b4e4bb55b923df2b426be187f75f309d07faacde WatchSource:0}: Error finding container 969b41b686eb3781e16e7e01b4e4bb55b923df2b426be187f75f309d07faacde: Status 404 returned error can't find the container with id 969b41b686eb3781e16e7e01b4e4bb55b923df2b426be187f75f309d07faacde
May 25 11:24:57.115220 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:24:57.115178    2545 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-zg7q8" event={"ID":"65aceb42-dd6c-4b1f-8eab-c38f414063dd","Type":"ContainerStarted","Data":"969b41b686eb3781e16e7e01b4e4bb55b923df2b426be187f75f309d07faacde"}
May 25 11:24:59.121924 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:24:59.121837    2545 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-zg7q8" event={"ID":"65aceb42-dd6c-4b1f-8eab-c38f414063dd","Type":"ContainerStarted","Data":"5ac376c7ec6bb5c21de6909d0555876b8ee986561efa7e1f0413c38fc1181489"}
May 25 11:24:59.138584 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:24:59.138539    2545 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-zg7q8" podStartSLOduration=33.416289664 podStartE2EDuration="35.1385253s" podCreationTimestamp="2026-05-25 11:24:24 +0000 UTC" firstStartedPulling="2026-05-25 11:24:57.087682479 +0000 UTC m=+88.853967403" lastFinishedPulling="2026-05-25 11:24:58.809918104 +0000 UTC m=+90.576203039" observedRunningTime="2026-05-25 11:24:59.137721336 +0000 UTC m=+90.904006283" watchObservedRunningTime="2026-05-25 11:24:59.1385253 +0000 UTC m=+90.904810240"
May 25 11:25:02.068172 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:25:02.068134    2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/918141d8-d07a-4526-aafe-3ba8eeceafd4-registry-tls\") pod \"image-registry-64b679b875-7wj65\" (UID: \"918141d8-d07a-4526-aafe-3ba8eeceafd4\") " pod="openshift-image-registry/image-registry-64b679b875-7wj65"
May 25 11:25:02.070672 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:25:02.070642    2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/918141d8-d07a-4526-aafe-3ba8eeceafd4-registry-tls\") pod \"image-registry-64b679b875-7wj65\" (UID: \"918141d8-d07a-4526-aafe-3ba8eeceafd4\") " pod="openshift-image-registry/image-registry-64b679b875-7wj65"
May 25 11:25:02.304544 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:25:02.304508    2545 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-64b679b875-7wj65"
May 25 11:25:02.427136 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:25:02.427120    2545 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-64b679b875-7wj65"]
May 25 11:25:02.429702 ip-10-0-128-206 kubenswrapper[2545]: W0525 11:25:02.429671    2545 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod918141d8_d07a_4526_aafe_3ba8eeceafd4.slice/crio-9b82411c8b5e245fe6edf92bd4d872caa9e6b549140e9047402dd4c6ff22fdf5 WatchSource:0}: Error finding container 9b82411c8b5e245fe6edf92bd4d872caa9e6b549140e9047402dd4c6ff22fdf5: Status 404 returned error can't find the container with id 9b82411c8b5e245fe6edf92bd4d872caa9e6b549140e9047402dd4c6ff22fdf5
May 25 11:25:03.133767 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:25:03.133731    2545 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-64b679b875-7wj65" event={"ID":"918141d8-d07a-4526-aafe-3ba8eeceafd4","Type":"ContainerStarted","Data":"89e2d20d0a8a1289ab8c66ff5aa8f8f59a18f514c314467c45e9e315dd1f3c40"}
May 25 11:25:03.133767 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:25:03.133768    2545 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-64b679b875-7wj65" event={"ID":"918141d8-d07a-4526-aafe-3ba8eeceafd4","Type":"ContainerStarted","Data":"9b82411c8b5e245fe6edf92bd4d872caa9e6b549140e9047402dd4c6ff22fdf5"}
May 25 11:25:03.134256 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:25:03.133859    2545 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-64b679b875-7wj65"
May 25 11:25:03.164603 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:25:03.164559    2545 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-image-registry/image-registry-64b679b875-7wj65" podStartSLOduration=33.164545334 podStartE2EDuration="33.164545334s" podCreationTimestamp="2026-05-25 11:24:30 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-25 11:25:03.162594233 +0000 UTC m=+94.928879178" watchObservedRunningTime="2026-05-25 11:25:03.164545334 +0000 UTC m=+94.930830280"
May 25 11:25:03.290639 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:25:03.290609    2545 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-d4d8f94f9-9j55l"]
May 25 11:25:03.293290 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:25:03.293272    2545 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-d4d8f94f9-9j55l"
May 25 11:25:03.296459 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:25:03.296432    2545 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-r8pqg\""
May 25 11:25:03.296567 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:25:03.296481    2545 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\""
May 25 11:25:03.296567 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:25:03.296497    2545 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\""
May 25 11:25:03.302633 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:25:03.302602    2545 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-d4d8f94f9-9j55l"]
May 25 11:25:03.319649 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:25:03.319625    2545 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-64b679b875-7wj65"]
May 25 11:25:03.379017 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:25:03.378986    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/80a7105d-5b9e-4230-8a58-4f0802e6d8a8-nginx-conf\") pod \"networking-console-plugin-d4d8f94f9-9j55l\" (UID: \"80a7105d-5b9e-4230-8a58-4f0802e6d8a8\") " pod="openshift-network-console/networking-console-plugin-d4d8f94f9-9j55l"
May 25 11:25:03.379017 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:25:03.379019    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/80a7105d-5b9e-4230-8a58-4f0802e6d8a8-networking-console-plugin-cert\") pod \"networking-console-plugin-d4d8f94f9-9j55l\" (UID: \"80a7105d-5b9e-4230-8a58-4f0802e6d8a8\") " pod="openshift-network-console/networking-console-plugin-d4d8f94f9-9j55l"
May 25 11:25:03.399644 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:25:03.399568    2545 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-b6j58"]
May 25 11:25:03.401623 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:25:03.401608    2545 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-b6j58"
May 25 11:25:03.404523 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:25:03.404499    2545 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-s56fk\""
May 25 11:25:03.404646 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:25:03.404546    2545 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
May 25 11:25:03.406923 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:25:03.406905    2545 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
May 25 11:25:03.418750 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:25:03.418728    2545 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-b6j58"]
May 25 11:25:03.480304 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:25:03.480276    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dkfl7\" (UniqueName: \"kubernetes.io/projected/3103b499-c1d8-4b1f-be59-285c04f3098a-kube-api-access-dkfl7\") pod \"insights-runtime-extractor-b6j58\" (UID: \"3103b499-c1d8-4b1f-be59-285c04f3098a\") " pod="openshift-insights/insights-runtime-extractor-b6j58"
May 25 11:25:03.480435 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:25:03.480324    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/3103b499-c1d8-4b1f-be59-285c04f3098a-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-b6j58\" (UID: \"3103b499-c1d8-4b1f-be59-285c04f3098a\") " pod="openshift-insights/insights-runtime-extractor-b6j58"
May 25 11:25:03.480435 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:25:03.480357    2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/80a7105d-5b9e-4230-8a58-4f0802e6d8a8-nginx-conf\") pod \"networking-console-plugin-d4d8f94f9-9j55l\" (UID: \"80a7105d-5b9e-4230-8a58-4f0802e6d8a8\") " pod="openshift-network-console/networking-console-plugin-d4d8f94f9-9j55l"
May 25 11:25:03.480435 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:25:03.480401    2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/80a7105d-5b9e-4230-8a58-4f0802e6d8a8-networking-console-plugin-cert\") pod \"networking-console-plugin-d4d8f94f9-9j55l\" (UID: \"80a7105d-5b9e-4230-8a58-4f0802e6d8a8\") " pod="openshift-network-console/networking-console-plugin-d4d8f94f9-9j55l"
May 25 11:25:03.480603 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:25:03.480481    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/3103b499-c1d8-4b1f-be59-285c04f3098a-data-volume\") pod \"insights-runtime-extractor-b6j58\" (UID: \"3103b499-c1d8-4b1f-be59-285c04f3098a\") " pod="openshift-insights/insights-runtime-extractor-b6j58"
May 25 11:25:03.480603 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:25:03.480519    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/3103b499-c1d8-4b1f-be59-285c04f3098a-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-b6j58\" (UID: \"3103b499-c1d8-4b1f-be59-285c04f3098a\") " pod="openshift-insights/insights-runtime-extractor-b6j58"
May 25 11:25:03.480603 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:25:03.480550    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/3103b499-c1d8-4b1f-be59-285c04f3098a-crio-socket\") pod \"insights-runtime-extractor-b6j58\" (UID: \"3103b499-c1d8-4b1f-be59-285c04f3098a\") " pod="openshift-insights/insights-runtime-extractor-b6j58"
May 25 11:25:03.480899 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:25:03.480876    2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/80a7105d-5b9e-4230-8a58-4f0802e6d8a8-nginx-conf\") pod \"networking-console-plugin-d4d8f94f9-9j55l\" (UID: \"80a7105d-5b9e-4230-8a58-4f0802e6d8a8\") " pod="openshift-network-console/networking-console-plugin-d4d8f94f9-9j55l"
May 25 11:25:03.482831 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:25:03.482805    2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/80a7105d-5b9e-4230-8a58-4f0802e6d8a8-networking-console-plugin-cert\") pod \"networking-console-plugin-d4d8f94f9-9j55l\" (UID: \"80a7105d-5b9e-4230-8a58-4f0802e6d8a8\") " pod="openshift-network-console/networking-console-plugin-d4d8f94f9-9j55l"
May 25 11:25:03.581258 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:25:03.581228    2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/3103b499-c1d8-4b1f-be59-285c04f3098a-data-volume\") pod \"insights-runtime-extractor-b6j58\" (UID: \"3103b499-c1d8-4b1f-be59-285c04f3098a\") " pod="openshift-insights/insights-runtime-extractor-b6j58"
May 25 11:25:03.581258 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:25:03.581266    2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/3103b499-c1d8-4b1f-be59-285c04f3098a-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-b6j58\" (UID: \"3103b499-c1d8-4b1f-be59-285c04f3098a\") " pod="openshift-insights/insights-runtime-extractor-b6j58"
May 25 11:25:03.581473 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:25:03.581285    2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/3103b499-c1d8-4b1f-be59-285c04f3098a-crio-socket\") pod \"insights-runtime-extractor-b6j58\" (UID: \"3103b499-c1d8-4b1f-be59-285c04f3098a\") " pod="openshift-insights/insights-runtime-extractor-b6j58"
May 25 11:25:03.581473 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:25:03.581320    2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-dkfl7\" (UniqueName: \"kubernetes.io/projected/3103b499-c1d8-4b1f-be59-285c04f3098a-kube-api-access-dkfl7\") pod \"insights-runtime-extractor-b6j58\" (UID: \"3103b499-c1d8-4b1f-be59-285c04f3098a\") " pod="openshift-insights/insights-runtime-extractor-b6j58"
May 25 11:25:03.581473 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:25:03.581356    2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/3103b499-c1d8-4b1f-be59-285c04f3098a-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-b6j58\" (UID: \"3103b499-c1d8-4b1f-be59-285c04f3098a\") " pod="openshift-insights/insights-runtime-extractor-b6j58"
May 25 11:25:03.581473 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:25:03.581438    2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/3103b499-c1d8-4b1f-be59-285c04f3098a-crio-socket\") pod \"insights-runtime-extractor-b6j58\" (UID: \"3103b499-c1d8-4b1f-be59-285c04f3098a\") " pod="openshift-insights/insights-runtime-extractor-b6j58"
May 25 11:25:03.581661 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:25:03.581539    2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/3103b499-c1d8-4b1f-be59-285c04f3098a-data-volume\") pod \"insights-runtime-extractor-b6j58\" (UID: \"3103b499-c1d8-4b1f-be59-285c04f3098a\") " pod="openshift-insights/insights-runtime-extractor-b6j58"
May 25 11:25:03.581779 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:25:03.581751    2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/3103b499-c1d8-4b1f-be59-285c04f3098a-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-b6j58\" (UID: \"3103b499-c1d8-4b1f-be59-285c04f3098a\") " pod="openshift-insights/insights-runtime-extractor-b6j58"
May 25 11:25:03.583584 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:25:03.583568    2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/3103b499-c1d8-4b1f-be59-285c04f3098a-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-b6j58\" (UID: \"3103b499-c1d8-4b1f-be59-285c04f3098a\") " pod="openshift-insights/insights-runtime-extractor-b6j58"
May 25 11:25:03.592974 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:25:03.592941    2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dkfl7\" (UniqueName: \"kubernetes.io/projected/3103b499-c1d8-4b1f-be59-285c04f3098a-kube-api-access-dkfl7\") pod \"insights-runtime-extractor-b6j58\" (UID: \"3103b499-c1d8-4b1f-be59-285c04f3098a\") " pod="openshift-insights/insights-runtime-extractor-b6j58"
May 25 11:25:03.601854 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:25:03.601832    2545 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-d4d8f94f9-9j55l"
May 25 11:25:03.710122 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:25:03.710093    2545 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-b6j58"
May 25 11:25:03.715290 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:25:03.715254    2545 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-d4d8f94f9-9j55l"]
May 25 11:25:03.718674 ip-10-0-128-206 kubenswrapper[2545]: W0525 11:25:03.718650    2545 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod80a7105d_5b9e_4230_8a58_4f0802e6d8a8.slice/crio-23255d9a06a65a6a4244117d2184faf33c064b4ce3ee2a9d15c6a36306e630f3 WatchSource:0}: Error finding container 23255d9a06a65a6a4244117d2184faf33c064b4ce3ee2a9d15c6a36306e630f3: Status 404 returned error can't find the container with id 23255d9a06a65a6a4244117d2184faf33c064b4ce3ee2a9d15c6a36306e630f3
May 25 11:25:03.830291 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:25:03.830256    2545 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-b6j58"]
May 25 11:25:03.833099 ip-10-0-128-206 kubenswrapper[2545]: W0525 11:25:03.833075    2545 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3103b499_c1d8_4b1f_be59_285c04f3098a.slice/crio-3a97a555d70cf17af0a326f0a3a5842e4df103238b386f4ab8f800c4b2b6ee2c WatchSource:0}: Error finding container 3a97a555d70cf17af0a326f0a3a5842e4df103238b386f4ab8f800c4b2b6ee2c: Status 404 returned error can't find the container with id 3a97a555d70cf17af0a326f0a3a5842e4df103238b386f4ab8f800c4b2b6ee2c
May 25 11:25:04.137160 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:25:04.137119    2545 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-d4d8f94f9-9j55l" event={"ID":"80a7105d-5b9e-4230-8a58-4f0802e6d8a8","Type":"ContainerStarted","Data":"23255d9a06a65a6a4244117d2184faf33c064b4ce3ee2a9d15c6a36306e630f3"}
May 25 11:25:04.138415 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:25:04.138389    2545 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-b6j58" event={"ID":"3103b499-c1d8-4b1f-be59-285c04f3098a","Type":"ContainerStarted","Data":"07fe013aef7a0ee93e496a0427ef312a375524671fe52e4046aa87c0328079ae"}
May 25 11:25:04.138513 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:25:04.138421    2545 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-b6j58" event={"ID":"3103b499-c1d8-4b1f-be59-285c04f3098a","Type":"ContainerStarted","Data":"3a97a555d70cf17af0a326f0a3a5842e4df103238b386f4ab8f800c4b2b6ee2c"}
May 25 11:25:05.142107 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:25:05.142070    2545 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-d4d8f94f9-9j55l" event={"ID":"80a7105d-5b9e-4230-8a58-4f0802e6d8a8","Type":"ContainerStarted","Data":"f41d00f2a2153918bd4a50eccddd8dc33e2a756b8543a4d3efee8efd9cd9b17c"}
May 25 11:25:05.143619 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:25:05.143590    2545 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-b6j58" event={"ID":"3103b499-c1d8-4b1f-be59-285c04f3098a","Type":"ContainerStarted","Data":"8152485b8c2642cd8af499639f455c65ed3d2855cb01acd2421f024690a389c6"}
May 25 11:25:05.157423 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:25:05.157381    2545 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-console/networking-console-plugin-d4d8f94f9-9j55l" podStartSLOduration=0.930421315 podStartE2EDuration="2.157367655s" podCreationTimestamp="2026-05-25 11:25:03 +0000 UTC" firstStartedPulling="2026-05-25 11:25:03.720335749 +0000 UTC m=+95.486620673" lastFinishedPulling="2026-05-25 11:25:04.947282084 +0000 UTC m=+96.713567013" observedRunningTime="2026-05-25 11:25:05.156409737 +0000 UTC m=+96.922694683" watchObservedRunningTime="2026-05-25 11:25:05.157367655 +0000 UTC m=+96.923652601"
May 25 11:25:06.101377 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:25:06.101355    2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/06d7f51c-471c-4691-a24a-2c5729f0560a-metrics-tls\") pod \"dns-default-hzp8b\" (UID: \"06d7f51c-471c-4691-a24a-2c5729f0560a\") " pod="openshift-dns/dns-default-hzp8b"
May 25 11:25:06.101468 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:25:06.101400    2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/52c3a045-c0fc-41d6-b253-f96682889610-cert\") pod \"ingress-canary-54rns\" (UID: \"52c3a045-c0fc-41d6-b253-f96682889610\") " pod="openshift-ingress-canary/ingress-canary-54rns"
May 25 11:25:06.103665 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:25:06.103637    2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/06d7f51c-471c-4691-a24a-2c5729f0560a-metrics-tls\") pod \"dns-default-hzp8b\" (UID: \"06d7f51c-471c-4691-a24a-2c5729f0560a\") " pod="openshift-dns/dns-default-hzp8b"
May 25 11:25:06.103665 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:25:06.103662    2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/52c3a045-c0fc-41d6-b253-f96682889610-cert\") pod \"ingress-canary-54rns\" (UID: \"52c3a045-c0fc-41d6-b253-f96682889610\") " pod="openshift-ingress-canary/ingress-canary-54rns"
May 25 11:25:06.150930 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:25:06.150894    2545 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-b6j58" event={"ID":"3103b499-c1d8-4b1f-be59-285c04f3098a","Type":"ContainerStarted","Data":"c77c45ca21e7023e44782a20f64a6259a25a9a70f341015801fb409471aeafac"}
May 25 11:25:06.177887 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:25:06.177843    2545 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-b6j58" podStartSLOduration=1.010216448 podStartE2EDuration="3.177829109s" podCreationTimestamp="2026-05-25 11:25:03 +0000 UTC" firstStartedPulling="2026-05-25 11:25:03.883371714 +0000 UTC m=+95.649656638" lastFinishedPulling="2026-05-25 11:25:06.050984367 +0000 UTC m=+97.817269299" observedRunningTime="2026-05-25 11:25:06.176625626 +0000 UTC m=+97.942910572" watchObservedRunningTime="2026-05-25 11:25:06.177829109 +0000 UTC m=+97.944114054"
May 25 11:25:06.348183 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:25:06.348099    2545 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-mbq6k\""
May 25 11:25:06.356368 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:25:06.356340    2545 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-hzp8b"
May 25 11:25:06.361580 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:25:06.361558    2545 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-n7v95\""
May 25 11:25:06.369904 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:25:06.369884    2545 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-54rns"
May 25 11:25:06.492051 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:25:06.491925    2545 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-hzp8b"]
May 25 11:25:06.495830 ip-10-0-128-206 kubenswrapper[2545]: W0525 11:25:06.495803    2545 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod06d7f51c_471c_4691_a24a_2c5729f0560a.slice/crio-baab99449a9838cbef9caa751e611e17d19b5023d1eb80db89cb0a605e2289d9 WatchSource:0}: Error finding container baab99449a9838cbef9caa751e611e17d19b5023d1eb80db89cb0a605e2289d9: Status 404 returned error can't find the container with id baab99449a9838cbef9caa751e611e17d19b5023d1eb80db89cb0a605e2289d9
May 25 11:25:06.512076 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:25:06.512051    2545 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-54rns"]
May 25 11:25:06.514803 ip-10-0-128-206 kubenswrapper[2545]: W0525 11:25:06.514778    2545 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod52c3a045_c0fc_41d6_b253_f96682889610.slice/crio-34849d5b1c5da17b6e135fb3e25442577532d55f1f788b36e11d32aaac4ac92a WatchSource:0}: Error finding container 34849d5b1c5da17b6e135fb3e25442577532d55f1f788b36e11d32aaac4ac92a: Status 404 returned error can't find the container with id 34849d5b1c5da17b6e135fb3e25442577532d55f1f788b36e11d32aaac4ac92a
May 25 11:25:07.154775 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:25:07.154728    2545 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-hzp8b" event={"ID":"06d7f51c-471c-4691-a24a-2c5729f0560a","Type":"ContainerStarted","Data":"baab99449a9838cbef9caa751e611e17d19b5023d1eb80db89cb0a605e2289d9"}
May 25 11:25:07.156604 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:25:07.156568    2545 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-54rns" event={"ID":"52c3a045-c0fc-41d6-b253-f96682889610","Type":"ContainerStarted","Data":"34849d5b1c5da17b6e135fb3e25442577532d55f1f788b36e11d32aaac4ac92a"}
May 25 11:25:09.063562 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:25:09.063531    2545 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-vnft7"
May 25 11:25:09.161588 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:25:09.161552    2545 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-54rns" event={"ID":"52c3a045-c0fc-41d6-b253-f96682889610","Type":"ContainerStarted","Data":"b2452843400749e49701ea19826c4d1e28d5d3f1f0e724327002f9e26353adba"}
May 25 11:25:09.162864 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:25:09.162837    2545 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-hzp8b" event={"ID":"06d7f51c-471c-4691-a24a-2c5729f0560a","Type":"ContainerStarted","Data":"b65213238d5f1cbee18b24ef1890042f61c20abc8613d3b883dcbcf772c6527b"}
May 25 11:25:09.163017 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:25:09.162868    2545 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-hzp8b" event={"ID":"06d7f51c-471c-4691-a24a-2c5729f0560a","Type":"ContainerStarted","Data":"7e83d788098280c675bf45559ccf87c8f102b1034ff8d0abe0a35f6afa595ac9"}
May 25 11:25:09.163083 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:25:09.163049    2545 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-hzp8b"
May 25 11:25:09.177376 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:25:09.177313    2545 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-54rns" podStartSLOduration=65.521989281 podStartE2EDuration="1m7.177301131s" podCreationTimestamp="2026-05-25 11:24:02 +0000 UTC" firstStartedPulling="2026-05-25 11:25:06.516900225 +0000 UTC m=+98.283185149" lastFinishedPulling="2026-05-25 11:25:08.172212072 +0000 UTC m=+99.938496999" observedRunningTime="2026-05-25 11:25:09.176628866 +0000 UTC m=+100.942913826" watchObservedRunningTime="2026-05-25 11:25:09.177301131 +0000 UTC m=+100.943586074"
May 25 11:25:09.194066 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:25:09.194025    2545 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-dns/dns-default-hzp8b" podStartSLOduration=65.521671385 podStartE2EDuration="1m7.194011206s" podCreationTimestamp="2026-05-25 11:24:02 +0000 UTC" firstStartedPulling="2026-05-25 11:25:06.497708706 +0000 UTC m=+98.263993630" lastFinishedPulling="2026-05-25 11:25:08.170048524 +0000 UTC m=+99.936333451" observedRunningTime="2026-05-25 11:25:09.193251171 +0000 UTC m=+100.959536131" watchObservedRunningTime="2026-05-25 11:25:09.194011206 +0000 UTC m=+100.960296158"
May 25 11:25:09.681208 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:25:09.681178    2545 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-xm9xm"]
May 25 11:25:09.683350 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:25:09.683333    2545 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-9c959559f-9rfsh"]
May 25 11:25:09.683506 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:25:09.683487    2545 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-xm9xm"
May 25 11:25:09.685383 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:25:09.685365    2545 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-9c959559f-9rfsh"
May 25 11:25:09.686279 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:25:09.686259    2545 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
May 25 11:25:09.686360 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:25:09.686285    2545 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
May 25 11:25:09.686521 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:25:09.686505    2545 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-s6tg8\""
May 25 11:25:09.686589 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:25:09.686574    2545 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
May 25 11:25:09.686822 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:25:09.686805    2545 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
May 25 11:25:09.687578 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:25:09.687561    2545 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\""
May 25 11:25:09.687886 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:25:09.687873    2545 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\""
May 25 11:25:09.688005 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:25:09.687989    2545 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-j95zd\""
May 25 11:25:09.694265 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:25:09.694245    2545 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-9c959559f-9rfsh"]
May 25 11:25:09.700642 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:25:09.700623    2545 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-54fd6bc5c4-nw692"]
May 25 11:25:09.702906 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:25:09.702889    2545 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-nw692"
May 25 11:25:09.705445 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:25:09.705428    2545 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\""
May 25 11:25:09.705542 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:25:09.705514    2545 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\""
May 25 11:25:09.705607 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:25:09.705554    2545 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-9whwz\""
May 25 11:25:09.706550 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:25:09.706536    2545 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\""
May 25 11:25:09.716571 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:25:09.716548    2545 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-54fd6bc5c4-nw692"]
May 25 11:25:09.828545 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:25:09.828510    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/29d23f19-1174-4990-a3d9-37d0b761beab-node-exporter-accelerators-collector-config\") pod \"node-exporter-xm9xm\" (UID: \"29d23f19-1174-4990-a3d9-37d0b761beab\") " pod="openshift-monitoring/node-exporter-xm9xm"
May 25 11:25:09.828701 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:25:09.828562    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/29d23f19-1174-4990-a3d9-37d0b761beab-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-xm9xm\" (UID: \"29d23f19-1174-4990-a3d9-37d0b761beab\") " pod="openshift-monitoring/node-exporter-xm9xm"
May 25 11:25:09.828701 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:25:09.828589    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-586km\" (UniqueName: \"kubernetes.io/projected/29d23f19-1174-4990-a3d9-37d0b761beab-kube-api-access-586km\") pod \"node-exporter-xm9xm\" (UID: \"29d23f19-1174-4990-a3d9-37d0b761beab\") " pod="openshift-monitoring/node-exporter-xm9xm"
May 25 11:25:09.828701 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:25:09.828625    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3d4a2ede-835d-41bb-b345-66f853f58ad7-metrics-client-ca\") pod \"openshift-state-metrics-9c959559f-9rfsh\" (UID: \"3d4a2ede-835d-41bb-b345-66f853f58ad7\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-9rfsh"
May 25 11:25:09.828701 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:25:09.828683    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/055f66f3-871f-4b06-aacb-a6eddb624423-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-54fd6bc5c4-nw692\" (UID: \"055f66f3-871f-4b06-aacb-a6eddb624423\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-nw692"
May 25 11:25:09.828910 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:25:09.828712    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/055f66f3-871f-4b06-aacb-a6eddb624423-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-54fd6bc5c4-nw692\" (UID: \"055f66f3-871f-4b06-aacb-a6eddb624423\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-nw692"
May 25 11:25:09.828910 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:25:09.828738    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/3d4a2ede-835d-41bb-b345-66f853f58ad7-openshift-state-metrics-tls\") pod \"openshift-state-metrics-9c959559f-9rfsh\" (UID: \"3d4a2ede-835d-41bb-b345-66f853f58ad7\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-9rfsh"
May 25 11:25:09.828910 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:25:09.828770    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/29d23f19-1174-4990-a3d9-37d0b761beab-sys\") pod \"node-exporter-xm9xm\" (UID: \"29d23f19-1174-4990-a3d9-37d0b761beab\") " pod="openshift-monitoring/node-exporter-xm9xm"
May 25 11:25:09.828910 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:25:09.828808    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/29d23f19-1174-4990-a3d9-37d0b761beab-node-exporter-textfile\") pod \"node-exporter-xm9xm\" (UID: \"29d23f19-1174-4990-a3d9-37d0b761beab\") " pod="openshift-monitoring/node-exporter-xm9xm"
May 25 11:25:09.828910 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:25:09.828848    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/29d23f19-1174-4990-a3d9-37d0b761beab-metrics-client-ca\") pod \"node-exporter-xm9xm\" (UID: \"29d23f19-1174-4990-a3d9-37d0b761beab\") " pod="openshift-monitoring/node-exporter-xm9xm"
May 25 11:25:09.828910 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:25:09.828899    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d222t\" (UniqueName: \"kubernetes.io/projected/055f66f3-871f-4b06-aacb-a6eddb624423-kube-api-access-d222t\") pod \"kube-state-metrics-54fd6bc5c4-nw692\" (UID: \"055f66f3-871f-4b06-aacb-a6eddb624423\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-nw692"
May 25 11:25:09.829160 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:25:09.828932    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/29d23f19-1174-4990-a3d9-37d0b761beab-root\") pod \"node-exporter-xm9xm\" (UID: \"29d23f19-1174-4990-a3d9-37d0b761beab\") " pod="openshift-monitoring/node-exporter-xm9xm"
May 25 11:25:09.829160 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:25:09.828953    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/055f66f3-871f-4b06-aacb-a6eddb624423-metrics-client-ca\") pod \"kube-state-metrics-54fd6bc5c4-nw692\" (UID: \"055f66f3-871f-4b06-aacb-a6eddb624423\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-nw692"
May 25 11:25:09.829160 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:25:09.828995    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/29d23f19-1174-4990-a3d9-37d0b761beab-node-exporter-wtmp\") pod \"node-exporter-xm9xm\" (UID: \"29d23f19-1174-4990-a3d9-37d0b761beab\") " pod="openshift-monitoring/node-exporter-xm9xm"
May 25 11:25:09.829160 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:25:09.829023    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tprzj\" (UniqueName: \"kubernetes.io/projected/3d4a2ede-835d-41bb-b345-66f853f58ad7-kube-api-access-tprzj\") pod \"openshift-state-metrics-9c959559f-9rfsh\" (UID: \"3d4a2ede-835d-41bb-b345-66f853f58ad7\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-9rfsh"
May 25 11:25:09.829160 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:25:09.829048    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/055f66f3-871f-4b06-aacb-a6eddb624423-volume-directive-shadow\") pod \"kube-state-metrics-54fd6bc5c4-nw692\" (UID: \"055f66f3-871f-4b06-aacb-a6eddb624423\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-nw692"
May 25 11:25:09.829160 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:25:09.829067    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/055f66f3-871f-4b06-aacb-a6eddb624423-kube-state-metrics-tls\") pod \"kube-state-metrics-54fd6bc5c4-nw692\" (UID: \"055f66f3-871f-4b06-aacb-a6eddb624423\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-nw692"
May 25 11:25:09.829160 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:25:09.829149    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/29d23f19-1174-4990-a3d9-37d0b761beab-node-exporter-tls\") pod \"node-exporter-xm9xm\" (UID: \"29d23f19-1174-4990-a3d9-37d0b761beab\") " pod="openshift-monitoring/node-exporter-xm9xm"
May 25 11:25:09.829397 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:25:09.829187    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/3d4a2ede-835d-41bb-b345-66f853f58ad7-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-9c959559f-9rfsh\" (UID: \"3d4a2ede-835d-41bb-b345-66f853f58ad7\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-9rfsh"
May 25 11:25:09.930273 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:25:09.930246    2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/29d23f19-1174-4990-a3d9-37d0b761beab-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-xm9xm\" (UID: \"29d23f19-1174-4990-a3d9-37d0b761beab\") " pod="openshift-monitoring/node-exporter-xm9xm"
May 25 11:25:09.930427 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:25:09.930278    2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-586km\" (UniqueName: \"kubernetes.io/projected/29d23f19-1174-4990-a3d9-37d0b761beab-kube-api-access-586km\") pod \"node-exporter-xm9xm\" (UID: \"29d23f19-1174-4990-a3d9-37d0b761beab\") " pod="openshift-monitoring/node-exporter-xm9xm"
May 25 11:25:09.930427 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:25:09.930305    2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3d4a2ede-835d-41bb-b345-66f853f58ad7-metrics-client-ca\") pod \"openshift-state-metrics-9c959559f-9rfsh\" (UID: \"3d4a2ede-835d-41bb-b345-66f853f58ad7\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-9rfsh"
May 25 11:25:09.930427 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:25:09.930334    2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/055f66f3-871f-4b06-aacb-a6eddb624423-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-54fd6bc5c4-nw692\" (UID: \"055f66f3-871f-4b06-aacb-a6eddb624423\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-nw692"
May 25 11:25:09.930580 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:25:09.930487    2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/055f66f3-871f-4b06-aacb-a6eddb624423-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-54fd6bc5c4-nw692\" (UID: \"055f66f3-871f-4b06-aacb-a6eddb624423\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-nw692"
May 25 11:25:09.930580 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:25:09.930534    2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/3d4a2ede-835d-41bb-b345-66f853f58ad7-openshift-state-metrics-tls\") pod \"openshift-state-metrics-9c959559f-9rfsh\" (UID: \"3d4a2ede-835d-41bb-b345-66f853f58ad7\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-9rfsh"
May 25 11:25:09.930580 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:25:09.930573    2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/29d23f19-1174-4990-a3d9-37d0b761beab-sys\") pod \"node-exporter-xm9xm\" (UID: \"29d23f19-1174-4990-a3d9-37d0b761beab\") " pod="openshift-monitoring/node-exporter-xm9xm"
May 25 11:25:09.930728 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:25:09.930608    2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/29d23f19-1174-4990-a3d9-37d0b761beab-node-exporter-textfile\") pod \"node-exporter-xm9xm\" (UID: \"29d23f19-1174-4990-a3d9-37d0b761beab\") " pod="openshift-monitoring/node-exporter-xm9xm"
May 25 11:25:09.930728 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:25:09.930638    2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/29d23f19-1174-4990-a3d9-37d0b761beab-metrics-client-ca\") pod \"node-exporter-xm9xm\" (UID: \"29d23f19-1174-4990-a3d9-37d0b761beab\") " pod="openshift-monitoring/node-exporter-xm9xm"
May 25 11:25:09.930826 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:25:09.930793    2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/29d23f19-1174-4990-a3d9-37d0b761beab-sys\") pod \"node-exporter-xm9xm\" (UID: \"29d23f19-1174-4990-a3d9-37d0b761beab\") " pod="openshift-monitoring/node-exporter-xm9xm"
May 25 11:25:09.931145 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:25:09.931108    2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/29d23f19-1174-4990-a3d9-37d0b761beab-node-exporter-textfile\") pod \"node-exporter-xm9xm\" (UID: \"29d23f19-1174-4990-a3d9-37d0b761beab\") " pod="openshift-monitoring/node-exporter-xm9xm"
May 25 11:25:09.931281 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:25:09.931145    2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3d4a2ede-835d-41bb-b345-66f853f58ad7-metrics-client-ca\") pod \"openshift-state-metrics-9c959559f-9rfsh\" (UID: \"3d4a2ede-835d-41bb-b345-66f853f58ad7\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-9rfsh"
May 25 11:25:09.931281 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:25:09.931175    2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-d222t\" (UniqueName: \"kubernetes.io/projected/055f66f3-871f-4b06-aacb-a6eddb624423-kube-api-access-d222t\") pod \"kube-state-metrics-54fd6bc5c4-nw692\" (UID: \"055f66f3-871f-4b06-aacb-a6eddb624423\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-nw692"
May 25 11:25:09.931281 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:25:09.931226    2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/29d23f19-1174-4990-a3d9-37d0b761beab-root\") pod \"node-exporter-xm9xm\" (UID: \"29d23f19-1174-4990-a3d9-37d0b761beab\") " pod="openshift-monitoring/node-exporter-xm9xm"
May 25 11:25:09.931281 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:25:09.931259    2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/055f66f3-871f-4b06-aacb-a6eddb624423-metrics-client-ca\") pod \"kube-state-metrics-54fd6bc5c4-nw692\" (UID: \"055f66f3-871f-4b06-aacb-a6eddb624423\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-nw692"
May 25 11:25:09.931493 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:25:09.931319    2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/29d23f19-1174-4990-a3d9-37d0b761beab-metrics-client-ca\") pod \"node-exporter-xm9xm\" (UID: \"29d23f19-1174-4990-a3d9-37d0b761beab\") " pod="openshift-monitoring/node-exporter-xm9xm"
May 25 11:25:09.931493 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:25:09.931331    2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/055f66f3-871f-4b06-aacb-a6eddb624423-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-54fd6bc5c4-nw692\" (UID: \"055f66f3-871f-4b06-aacb-a6eddb624423\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-nw692"
May 25 11:25:09.931493 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:25:09.931387    2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/29d23f19-1174-4990-a3d9-37d0b761beab-root\") pod \"node-exporter-xm9xm\" (UID: \"29d23f19-1174-4990-a3d9-37d0b761beab\") " pod="openshift-monitoring/node-exporter-xm9xm"
May 25 11:25:09.931493 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:25:09.931437    2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/29d23f19-1174-4990-a3d9-37d0b761beab-node-exporter-wtmp\") pod \"node-exporter-xm9xm\" (UID: \"29d23f19-1174-4990-a3d9-37d0b761beab\") " pod="openshift-monitoring/node-exporter-xm9xm"
May 25 11:25:09.931493 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:25:09.931468    2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-tprzj\" (UniqueName: \"kubernetes.io/projected/3d4a2ede-835d-41bb-b345-66f853f58ad7-kube-api-access-tprzj\") pod \"openshift-state-metrics-9c959559f-9rfsh\" (UID: \"3d4a2ede-835d-41bb-b345-66f853f58ad7\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-9rfsh"
May 25 11:25:09.931723 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:25:09.931510    2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/055f66f3-871f-4b06-aacb-a6eddb624423-volume-directive-shadow\") pod \"kube-state-metrics-54fd6bc5c4-nw692\" (UID: \"055f66f3-871f-4b06-aacb-a6eddb624423\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-nw692"
May 25 11:25:09.931723 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:25:09.931536    2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/055f66f3-871f-4b06-aacb-a6eddb624423-kube-state-metrics-tls\") pod \"kube-state-metrics-54fd6bc5c4-nw692\" (UID: \"055f66f3-871f-4b06-aacb-a6eddb624423\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-nw692"
May 25 11:25:09.931723 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:25:09.931577    2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/29d23f19-1174-4990-a3d9-37d0b761beab-node-exporter-wtmp\") pod \"node-exporter-xm9xm\" (UID: \"29d23f19-1174-4990-a3d9-37d0b761beab\") " pod="openshift-monitoring/node-exporter-xm9xm"
May 25 11:25:09.931723 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:25:09.931582    2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/29d23f19-1174-4990-a3d9-37d0b761beab-node-exporter-tls\") pod \"node-exporter-xm9xm\" (UID: \"29d23f19-1174-4990-a3d9-37d0b761beab\") " pod="openshift-monitoring/node-exporter-xm9xm"
May 25 11:25:09.931723 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:25:09.931639    2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/3d4a2ede-835d-41bb-b345-66f853f58ad7-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-9c959559f-9rfsh\" (UID: \"3d4a2ede-835d-41bb-b345-66f853f58ad7\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-9rfsh"
May 25 11:25:09.931723 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:25:09.931675    2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/29d23f19-1174-4990-a3d9-37d0b761beab-node-exporter-accelerators-collector-config\") pod \"node-exporter-xm9xm\" (UID: \"29d23f19-1174-4990-a3d9-37d0b761beab\") " pod="openshift-monitoring/node-exporter-xm9xm"
May 25 11:25:09.932058 ip-10-0-128-206 kubenswrapper[2545]: E0525 11:25:09.931796    2545 secret.go:189] Couldn't get secret openshift-monitoring/kube-state-metrics-tls: secret "kube-state-metrics-tls" not found
May 25 11:25:09.932058 ip-10-0-128-206 kubenswrapper[2545]: E0525 11:25:09.931917    2545 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/055f66f3-871f-4b06-aacb-a6eddb624423-kube-state-metrics-tls podName:055f66f3-871f-4b06-aacb-a6eddb624423 nodeName:}" failed. No retries permitted until 2026-05-25 11:25:10.431894021 +0000 UTC m=+102.198178959 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-state-metrics-tls" (UniqueName: "kubernetes.io/secret/055f66f3-871f-4b06-aacb-a6eddb624423-kube-state-metrics-tls") pod "kube-state-metrics-54fd6bc5c4-nw692" (UID: "055f66f3-871f-4b06-aacb-a6eddb624423") : secret "kube-state-metrics-tls" not found
May 25 11:25:09.932058 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:25:09.932009    2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/055f66f3-871f-4b06-aacb-a6eddb624423-metrics-client-ca\") pod \"kube-state-metrics-54fd6bc5c4-nw692\" (UID: \"055f66f3-871f-4b06-aacb-a6eddb624423\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-nw692"
May 25 11:25:09.932058 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:25:09.932024    2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/055f66f3-871f-4b06-aacb-a6eddb624423-volume-directive-shadow\") pod \"kube-state-metrics-54fd6bc5c4-nw692\" (UID: \"055f66f3-871f-4b06-aacb-a6eddb624423\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-nw692"
May 25 11:25:09.932315 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:25:09.932290    2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/29d23f19-1174-4990-a3d9-37d0b761beab-node-exporter-accelerators-collector-config\") pod \"node-exporter-xm9xm\" (UID: \"29d23f19-1174-4990-a3d9-37d0b761beab\") " pod="openshift-monitoring/node-exporter-xm9xm"
May 25 11:25:09.933303 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:25:09.933271    2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/055f66f3-871f-4b06-aacb-a6eddb624423-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-54fd6bc5c4-nw692\" (UID: \"055f66f3-871f-4b06-aacb-a6eddb624423\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-nw692"
May 25 11:25:09.934124 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:25:09.934096    2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/29d23f19-1174-4990-a3d9-37d0b761beab-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-xm9xm\" (UID: \"29d23f19-1174-4990-a3d9-37d0b761beab\") " pod="openshift-monitoring/node-exporter-xm9xm"
May 25 11:25:09.934315 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:25:09.934295    2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/3d4a2ede-835d-41bb-b345-66f853f58ad7-openshift-state-metrics-tls\") pod \"openshift-state-metrics-9c959559f-9rfsh\" (UID: \"3d4a2ede-835d-41bb-b345-66f853f58ad7\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-9rfsh"
May 25 11:25:09.934360 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:25:09.934308    2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/29d23f19-1174-4990-a3d9-37d0b761beab-node-exporter-tls\") pod \"node-exporter-xm9xm\" (UID: \"29d23f19-1174-4990-a3d9-37d0b761beab\") " pod="openshift-monitoring/node-exporter-xm9xm"
May 25 11:25:09.934400 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:25:09.934383    2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/3d4a2ede-835d-41bb-b345-66f853f58ad7-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-9c959559f-9rfsh\" (UID: \"3d4a2ede-835d-41bb-b345-66f853f58ad7\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-9rfsh"
May 25 11:25:09.938654 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:25:09.938624    2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-586km\" (UniqueName: \"kubernetes.io/projected/29d23f19-1174-4990-a3d9-37d0b761beab-kube-api-access-586km\") pod \"node-exporter-xm9xm\" (UID: \"29d23f19-1174-4990-a3d9-37d0b761beab\") " pod="openshift-monitoring/node-exporter-xm9xm"
May 25 11:25:09.939026 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:25:09.939009    2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tprzj\" (UniqueName: \"kubernetes.io/projected/3d4a2ede-835d-41bb-b345-66f853f58ad7-kube-api-access-tprzj\") pod \"openshift-state-metrics-9c959559f-9rfsh\" (UID: \"3d4a2ede-835d-41bb-b345-66f853f58ad7\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-9rfsh"
May 25 11:25:09.940459 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:25:09.940442    2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-d222t\" (UniqueName: \"kubernetes.io/projected/055f66f3-871f-4b06-aacb-a6eddb624423-kube-api-access-d222t\") pod \"kube-state-metrics-54fd6bc5c4-nw692\" (UID: \"055f66f3-871f-4b06-aacb-a6eddb624423\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-nw692"
May 25 11:25:09.994201 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:25:09.994168    2545 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-xm9xm"
May 25 11:25:09.998967 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:25:09.998930    2545 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-9c959559f-9rfsh"
May 25 11:25:10.003929 ip-10-0-128-206 kubenswrapper[2545]: W0525 11:25:10.003905    2545 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod29d23f19_1174_4990_a3d9_37d0b761beab.slice/crio-7865f7f307611abdff5d167de5618aee1eb02a917cf7ac12214d534d272ca0b4 WatchSource:0}: Error finding container 7865f7f307611abdff5d167de5618aee1eb02a917cf7ac12214d534d272ca0b4: Status 404 returned error can't find the container with id 7865f7f307611abdff5d167de5618aee1eb02a917cf7ac12214d534d272ca0b4
May 25 11:25:10.123100 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:25:10.123064    2545 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-9c959559f-9rfsh"]
May 25 11:25:10.125759 ip-10-0-128-206 kubenswrapper[2545]: W0525 11:25:10.125725    2545 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3d4a2ede_835d_41bb_b345_66f853f58ad7.slice/crio-973ee07c9fc902bcddacec81e58e418a1dad105e3fec999dcd1e5517f724d86f WatchSource:0}: Error finding container 973ee07c9fc902bcddacec81e58e418a1dad105e3fec999dcd1e5517f724d86f: Status 404 returned error can't find the container with id 973ee07c9fc902bcddacec81e58e418a1dad105e3fec999dcd1e5517f724d86f
May 25 11:25:10.168641 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:25:10.168613    2545 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-xm9xm" event={"ID":"29d23f19-1174-4990-a3d9-37d0b761beab","Type":"ContainerStarted","Data":"7865f7f307611abdff5d167de5618aee1eb02a917cf7ac12214d534d272ca0b4"}
May 25 11:25:10.169546 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:25:10.169520    2545 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-9c959559f-9rfsh" event={"ID":"3d4a2ede-835d-41bb-b345-66f853f58ad7","Type":"ContainerStarted","Data":"973ee07c9fc902bcddacec81e58e418a1dad105e3fec999dcd1e5517f724d86f"}
May 25 11:25:10.436217 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:25:10.436176    2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/055f66f3-871f-4b06-aacb-a6eddb624423-kube-state-metrics-tls\") pod \"kube-state-metrics-54fd6bc5c4-nw692\" (UID: \"055f66f3-871f-4b06-aacb-a6eddb624423\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-nw692"
May 25 11:25:10.438497 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:25:10.438443    2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/055f66f3-871f-4b06-aacb-a6eddb624423-kube-state-metrics-tls\") pod \"kube-state-metrics-54fd6bc5c4-nw692\" (UID: \"055f66f3-871f-4b06-aacb-a6eddb624423\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-nw692"
May 25 11:25:10.611507 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:25:10.611467    2545 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-nw692"
May 25 11:25:10.757268 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:25:10.757214    2545 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-54fd6bc5c4-nw692"]
May 25 11:25:10.956111 ip-10-0-128-206 kubenswrapper[2545]: W0525 11:25:10.956035    2545 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod055f66f3_871f_4b06_aacb_a6eddb624423.slice/crio-ac51652de419a701248c9c10987b88ea3c1dfa5024e368c54649e514c4e9e184 WatchSource:0}: Error finding container ac51652de419a701248c9c10987b88ea3c1dfa5024e368c54649e514c4e9e184: Status 404 returned error can't find the container with id ac51652de419a701248c9c10987b88ea3c1dfa5024e368c54649e514c4e9e184
May 25 11:25:11.174147 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:25:11.174092    2545 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-xm9xm" event={"ID":"29d23f19-1174-4990-a3d9-37d0b761beab","Type":"ContainerStarted","Data":"9277a3e023b167e32fe780e1d5bd2c70d42d855471ca480ce4d7d77f92be5ac4"}
May 25 11:25:11.176020 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:25:11.175985    2545 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-9c959559f-9rfsh" event={"ID":"3d4a2ede-835d-41bb-b345-66f853f58ad7","Type":"ContainerStarted","Data":"03fe954d49c19d45d7a0b5415220c8f04aa9e8b17b1aeecde012d8bb7951a038"}
May 25 11:25:11.176141 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:25:11.176028    2545 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-9c959559f-9rfsh" event={"ID":"3d4a2ede-835d-41bb-b345-66f853f58ad7","Type":"ContainerStarted","Data":"d5a3e295d8ec9f06f6d80d9c16ee09fd193521bb0042711265652cfee19f7af0"}
May 25 11:25:11.177077 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:25:11.177051    2545 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-nw692" event={"ID":"055f66f3-871f-4b06-aacb-a6eddb624423","Type":"ContainerStarted","Data":"ac51652de419a701248c9c10987b88ea3c1dfa5024e368c54649e514c4e9e184"}
May 25 11:25:12.181216 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:25:12.181175    2545 generic.go:358] "Generic (PLEG): container finished" podID="29d23f19-1174-4990-a3d9-37d0b761beab" containerID="9277a3e023b167e32fe780e1d5bd2c70d42d855471ca480ce4d7d77f92be5ac4" exitCode=0
May 25 11:25:12.181627 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:25:12.181268    2545 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-xm9xm" event={"ID":"29d23f19-1174-4990-a3d9-37d0b761beab","Type":"ContainerDied","Data":"9277a3e023b167e32fe780e1d5bd2c70d42d855471ca480ce4d7d77f92be5ac4"}
May 25 11:25:12.183090 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:25:12.183064    2545 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-9c959559f-9rfsh" event={"ID":"3d4a2ede-835d-41bb-b345-66f853f58ad7","Type":"ContainerStarted","Data":"ff68fdb354f43b9685cc7feadbb217fc9bb4978d540f406348ebd4cada12286c"}
May 25 11:25:12.228406 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:25:12.228367    2545 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-9c959559f-9rfsh" podStartSLOduration=2.17248861 podStartE2EDuration="3.228351588s" podCreationTimestamp="2026-05-25 11:25:09 +0000 UTC" firstStartedPulling="2026-05-25 11:25:10.239220968 +0000 UTC m=+102.005505893" lastFinishedPulling="2026-05-25 11:25:11.295083948 +0000 UTC m=+103.061368871" observedRunningTime="2026-05-25 11:25:12.227453802 +0000 UTC m=+103.993738747" watchObservedRunningTime="2026-05-25 11:25:12.228351588 +0000 UTC m=+103.994636530"
May 25 11:25:12.704081 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:25:12.704012    2545 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-557d9f868-8t7zm"]
May 25 11:25:12.739580 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:25:12.739558    2545 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-557d9f868-8t7zm"]
May 25 11:25:12.739699 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:25:12.739689    2545 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-557d9f868-8t7zm"
May 25 11:25:12.743759 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:25:12.742795    2545 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-85m2e4nalov4l\""
May 25 11:25:12.743759 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:25:12.742907    2545 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-pq4hx\""
May 25 11:25:12.743759 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:25:12.743181    2545 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\""
May 25 11:25:12.743759 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:25:12.743407    2545 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\""
May 25 11:25:12.743759 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:25:12.743730    2545 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\""
May 25 11:25:12.744068 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:25:12.743989    2545 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\""
May 25 11:25:12.747188 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:25:12.745293    2545 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\""
May 25 11:25:12.858879 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:25:12.858850    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/17182e04-8c7b-42af-bf81-6388aae24602-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-557d9f868-8t7zm\" (UID: \"17182e04-8c7b-42af-bf81-6388aae24602\") " pod="openshift-monitoring/thanos-querier-557d9f868-8t7zm"
May 25 11:25:12.859014 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:25:12.858898    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/17182e04-8c7b-42af-bf81-6388aae24602-secret-thanos-querier-tls\") pod \"thanos-querier-557d9f868-8t7zm\" (UID: \"17182e04-8c7b-42af-bf81-6388aae24602\") " pod="openshift-monitoring/thanos-querier-557d9f868-8t7zm"
May 25 11:25:12.859014 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:25:12.858989    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/17182e04-8c7b-42af-bf81-6388aae24602-metrics-client-ca\") pod \"thanos-querier-557d9f868-8t7zm\" (UID: \"17182e04-8c7b-42af-bf81-6388aae24602\") " pod="openshift-monitoring/thanos-querier-557d9f868-8t7zm"
May 25 11:25:12.859117 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:25:12.859037    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/17182e04-8c7b-42af-bf81-6388aae24602-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-557d9f868-8t7zm\" (UID: \"17182e04-8c7b-42af-bf81-6388aae24602\") " pod="openshift-monitoring/thanos-querier-557d9f868-8t7zm"
May 25 11:25:12.859117 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:25:12.859078    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/17182e04-8c7b-42af-bf81-6388aae24602-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-557d9f868-8t7zm\" (UID: \"17182e04-8c7b-42af-bf81-6388aae24602\") " pod="openshift-monitoring/thanos-querier-557d9f868-8t7zm"
May 25 11:25:12.859196 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:25:12.859127    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/17182e04-8c7b-42af-bf81-6388aae24602-secret-grpc-tls\") pod \"thanos-querier-557d9f868-8t7zm\" (UID: \"17182e04-8c7b-42af-bf81-6388aae24602\") " pod="openshift-monitoring/thanos-querier-557d9f868-8t7zm"
May 25 11:25:12.859196 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:25:12.859167    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pjgrd\" (UniqueName: \"kubernetes.io/projected/17182e04-8c7b-42af-bf81-6388aae24602-kube-api-access-pjgrd\") pod \"thanos-querier-557d9f868-8t7zm\" (UID: \"17182e04-8c7b-42af-bf81-6388aae24602\") " pod="openshift-monitoring/thanos-querier-557d9f868-8t7zm"
May 25 11:25:12.859273 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:25:12.859207    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/17182e04-8c7b-42af-bf81-6388aae24602-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-557d9f868-8t7zm\" (UID: \"17182e04-8c7b-42af-bf81-6388aae24602\") " pod="openshift-monitoring/thanos-querier-557d9f868-8t7zm"
May 25 11:25:12.960687 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:25:12.960601    2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-pjgrd\" (UniqueName: \"kubernetes.io/projected/17182e04-8c7b-42af-bf81-6388aae24602-kube-api-access-pjgrd\") pod \"thanos-querier-557d9f868-8t7zm\" (UID: \"17182e04-8c7b-42af-bf81-6388aae24602\") " pod="openshift-monitoring/thanos-querier-557d9f868-8t7zm"
May 25 11:25:12.960687 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:25:12.960644    2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/17182e04-8c7b-42af-bf81-6388aae24602-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-557d9f868-8t7zm\" (UID: \"17182e04-8c7b-42af-bf81-6388aae24602\") " pod="openshift-monitoring/thanos-querier-557d9f868-8t7zm"
May 25 11:25:12.960687 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:25:12.960684    2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/17182e04-8c7b-42af-bf81-6388aae24602-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-557d9f868-8t7zm\" (UID: \"17182e04-8c7b-42af-bf81-6388aae24602\") " pod="openshift-monitoring/thanos-querier-557d9f868-8t7zm"
May 25 11:25:12.961003 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:25:12.960704    2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/17182e04-8c7b-42af-bf81-6388aae24602-secret-thanos-querier-tls\") pod \"thanos-querier-557d9f868-8t7zm\" (UID: \"17182e04-8c7b-42af-bf81-6388aae24602\") " pod="openshift-monitoring/thanos-querier-557d9f868-8t7zm"
May 25 11:25:12.961003 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:25:12.960729    2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/17182e04-8c7b-42af-bf81-6388aae24602-metrics-client-ca\") pod \"thanos-querier-557d9f868-8t7zm\" (UID: \"17182e04-8c7b-42af-bf81-6388aae24602\") " pod="openshift-monitoring/thanos-querier-557d9f868-8t7zm"
May 25 11:25:12.961003 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:25:12.960752    2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/17182e04-8c7b-42af-bf81-6388aae24602-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-557d9f868-8t7zm\" (UID: \"17182e04-8c7b-42af-bf81-6388aae24602\") " pod="openshift-monitoring/thanos-querier-557d9f868-8t7zm"
May 25 11:25:12.961003 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:25:12.960770    2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/17182e04-8c7b-42af-bf81-6388aae24602-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-557d9f868-8t7zm\" (UID: \"17182e04-8c7b-42af-bf81-6388aae24602\") " pod="openshift-monitoring/thanos-querier-557d9f868-8t7zm"
May 25 11:25:12.961003 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:25:12.960819    2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/17182e04-8c7b-42af-bf81-6388aae24602-secret-grpc-tls\") pod \"thanos-querier-557d9f868-8t7zm\" (UID: \"17182e04-8c7b-42af-bf81-6388aae24602\") " pod="openshift-monitoring/thanos-querier-557d9f868-8t7zm"
May 25 11:25:12.961715 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:25:12.961634    2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/17182e04-8c7b-42af-bf81-6388aae24602-metrics-client-ca\") pod \"thanos-querier-557d9f868-8t7zm\" (UID: \"17182e04-8c7b-42af-bf81-6388aae24602\") " pod="openshift-monitoring/thanos-querier-557d9f868-8t7zm"
May 25 11:25:12.963465 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:25:12.963436    2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/17182e04-8c7b-42af-bf81-6388aae24602-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-557d9f868-8t7zm\" (UID: \"17182e04-8c7b-42af-bf81-6388aae24602\") " pod="openshift-monitoring/thanos-querier-557d9f868-8t7zm"
May 25 11:25:12.963801 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:25:12.963773    2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/17182e04-8c7b-42af-bf81-6388aae24602-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-557d9f868-8t7zm\" (UID: \"17182e04-8c7b-42af-bf81-6388aae24602\") " pod="openshift-monitoring/thanos-querier-557d9f868-8t7zm"
May 25 11:25:12.963889 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:25:12.963855    2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/17182e04-8c7b-42af-bf81-6388aae24602-secret-thanos-querier-tls\") pod \"thanos-querier-557d9f868-8t7zm\" (UID: \"17182e04-8c7b-42af-bf81-6388aae24602\") " pod="openshift-monitoring/thanos-querier-557d9f868-8t7zm"
May 25 11:25:12.963889 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:25:12.963867    2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/17182e04-8c7b-42af-bf81-6388aae24602-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-557d9f868-8t7zm\" (UID: \"17182e04-8c7b-42af-bf81-6388aae24602\") " pod="openshift-monitoring/thanos-querier-557d9f868-8t7zm"
May 25 11:25:12.964041 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:25:12.964000    2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/17182e04-8c7b-42af-bf81-6388aae24602-secret-grpc-tls\") pod \"thanos-querier-557d9f868-8t7zm\" (UID: \"17182e04-8c7b-42af-bf81-6388aae24602\") " pod="openshift-monitoring/thanos-querier-557d9f868-8t7zm"
May 25 11:25:12.964284 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:25:12.964268    2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/17182e04-8c7b-42af-bf81-6388aae24602-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-557d9f868-8t7zm\" (UID: \"17182e04-8c7b-42af-bf81-6388aae24602\") " pod="openshift-monitoring/thanos-querier-557d9f868-8t7zm"
May 25 11:25:12.968251 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:25:12.968234    2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pjgrd\" (UniqueName: \"kubernetes.io/projected/17182e04-8c7b-42af-bf81-6388aae24602-kube-api-access-pjgrd\") pod \"thanos-querier-557d9f868-8t7zm\" (UID: \"17182e04-8c7b-42af-bf81-6388aae24602\") " pod="openshift-monitoring/thanos-querier-557d9f868-8t7zm"
May 25 11:25:13.054389 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:25:13.054357    2545 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-557d9f868-8t7zm"
May 25 11:25:13.181264 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:25:13.181206    2545 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-557d9f868-8t7zm"]
May 25 11:25:13.185998 ip-10-0-128-206 kubenswrapper[2545]: W0525 11:25:13.185933    2545 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod17182e04_8c7b_42af_bf81_6388aae24602.slice/crio-af4218f2a1a9699287616c3500dbacae5f7ee962256d245c530ae356c3200166 WatchSource:0}: Error finding container af4218f2a1a9699287616c3500dbacae5f7ee962256d245c530ae356c3200166: Status 404 returned error can't find the container with id af4218f2a1a9699287616c3500dbacae5f7ee962256d245c530ae356c3200166
May 25 11:25:13.188456 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:25:13.188430    2545 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-xm9xm" event={"ID":"29d23f19-1174-4990-a3d9-37d0b761beab","Type":"ContainerStarted","Data":"f95afda7d63473bdefc065774336717452b5bcf9bfe4a6ea4489ef552a2a148e"}
May 25 11:25:13.188549 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:25:13.188463    2545 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-xm9xm" event={"ID":"29d23f19-1174-4990-a3d9-37d0b761beab","Type":"ContainerStarted","Data":"830103f219b707a43de363497e27345f937c64e56baa2cd7f82dabfecd5a0b6a"}
May 25 11:25:13.190330 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:25:13.190302    2545 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-nw692" event={"ID":"055f66f3-871f-4b06-aacb-a6eddb624423","Type":"ContainerStarted","Data":"7a3851ffa6f1be1955d8fa0ffb836c1bc739753a32f957b25d2742b6bf4dbea2"}
May 25 11:25:13.190330 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:25:13.190330    2545 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-nw692" event={"ID":"055f66f3-871f-4b06-aacb-a6eddb624423","Type":"ContainerStarted","Data":"da6a758abd80d4f9604933137ee3b2f7f2c2d2aa1b146221802d38e5c2d4a722"}
May 25 11:25:13.190449 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:25:13.190340    2545 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-nw692" event={"ID":"055f66f3-871f-4b06-aacb-a6eddb624423","Type":"ContainerStarted","Data":"dc5072546f18d26281669991dc9651d67b7bfe7c0fcb7411d165e7c73798787a"}
May 25 11:25:13.207326 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:25:13.207286    2545 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-xm9xm" podStartSLOduration=3.232156403 podStartE2EDuration="4.207270474s" podCreationTimestamp="2026-05-25 11:25:09 +0000 UTC" firstStartedPulling="2026-05-25 11:25:10.006247507 +0000 UTC m=+101.772532433" lastFinishedPulling="2026-05-25 11:25:10.981361568 +0000 UTC m=+102.747646504" observedRunningTime="2026-05-25 11:25:13.206450318 +0000 UTC m=+104.972735265" watchObservedRunningTime="2026-05-25 11:25:13.207270474 +0000 UTC m=+104.973555423"
May 25 11:25:13.224485 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:25:13.224395    2545 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-nw692" podStartSLOduration=2.719144821 podStartE2EDuration="4.224383025s" podCreationTimestamp="2026-05-25 11:25:09 +0000 UTC" firstStartedPulling="2026-05-25 11:25:10.958474901 +0000 UTC m=+102.724759827" lastFinishedPulling="2026-05-25 11:25:12.463713104 +0000 UTC m=+104.229998031" observedRunningTime="2026-05-25 11:25:13.223773372 +0000 UTC m=+104.990058317" watchObservedRunningTime="2026-05-25 11:25:13.224383025 +0000 UTC m=+104.990667970"
May 25 11:25:13.988691 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:25:13.988655    2545 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-78dd8f8c95-dz85t"]
May 25 11:25:13.990975 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:25:13.990932    2545 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-78dd8f8c95-dz85t"
May 25 11:25:13.995281 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:25:13.995119    2545 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\""
May 25 11:25:13.995281 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:25:13.995185    2545 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-qqvgx\""
May 25 11:25:13.995281 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:25:13.995250    2545 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\""
May 25 11:25:13.995563 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:25:13.995488    2545 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\""
May 25 11:25:13.995563 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:25:13.995529    2545 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\""
May 25 11:25:13.995563 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:25:13.995538    2545 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-ias4ouffn5tc\""
May 25 11:25:14.000798 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:25:14.000765    2545 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-78dd8f8c95-dz85t"]
May 25 11:25:14.070610 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:25:14.070576    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/15ef2bca-b153-42db-bdb7-b063d94f451f-client-ca-bundle\") pod \"metrics-server-78dd8f8c95-dz85t\" (UID: \"15ef2bca-b153-42db-bdb7-b063d94f451f\") " pod="openshift-monitoring/metrics-server-78dd8f8c95-dz85t"
May 25 11:25:14.070770 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:25:14.070624    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-svgl2\" (UniqueName: \"kubernetes.io/projected/15ef2bca-b153-42db-bdb7-b063d94f451f-kube-api-access-svgl2\") pod \"metrics-server-78dd8f8c95-dz85t\" (UID: \"15ef2bca-b153-42db-bdb7-b063d94f451f\") " pod="openshift-monitoring/metrics-server-78dd8f8c95-dz85t"
May 25 11:25:14.070770 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:25:14.070680    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/15ef2bca-b153-42db-bdb7-b063d94f451f-secret-metrics-server-client-certs\") pod \"metrics-server-78dd8f8c95-dz85t\" (UID: \"15ef2bca-b153-42db-bdb7-b063d94f451f\") " pod="openshift-monitoring/metrics-server-78dd8f8c95-dz85t"
May 25 11:25:14.070770 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:25:14.070719    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/15ef2bca-b153-42db-bdb7-b063d94f451f-secret-metrics-server-tls\") pod \"metrics-server-78dd8f8c95-dz85t\" (UID: \"15ef2bca-b153-42db-bdb7-b063d94f451f\") " pod="openshift-monitoring/metrics-server-78dd8f8c95-dz85t"
May 25 11:25:14.070913 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:25:14.070774    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/15ef2bca-b153-42db-bdb7-b063d94f451f-metrics-server-audit-profiles\") pod \"metrics-server-78dd8f8c95-dz85t\" (UID: \"15ef2bca-b153-42db-bdb7-b063d94f451f\") " pod="openshift-monitoring/metrics-server-78dd8f8c95-dz85t"
May 25 11:25:14.070913 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:25:14.070807    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/15ef2bca-b153-42db-bdb7-b063d94f451f-audit-log\") pod \"metrics-server-78dd8f8c95-dz85t\" (UID: \"15ef2bca-b153-42db-bdb7-b063d94f451f\") " pod="openshift-monitoring/metrics-server-78dd8f8c95-dz85t"
May 25 11:25:14.070913 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:25:14.070846    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/15ef2bca-b153-42db-bdb7-b063d94f451f-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-78dd8f8c95-dz85t\" (UID: \"15ef2bca-b153-42db-bdb7-b063d94f451f\") " pod="openshift-monitoring/metrics-server-78dd8f8c95-dz85t"
May 25 11:25:14.172266 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:25:14.172230    2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/15ef2bca-b153-42db-bdb7-b063d94f451f-metrics-server-audit-profiles\") pod \"metrics-server-78dd8f8c95-dz85t\" (UID: \"15ef2bca-b153-42db-bdb7-b063d94f451f\") " pod="openshift-monitoring/metrics-server-78dd8f8c95-dz85t"
May 25 11:25:14.172413 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:25:14.172281    2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/15ef2bca-b153-42db-bdb7-b063d94f451f-audit-log\") pod \"metrics-server-78dd8f8c95-dz85t\" (UID: \"15ef2bca-b153-42db-bdb7-b063d94f451f\") " pod="openshift-monitoring/metrics-server-78dd8f8c95-dz85t"
May 25 11:25:14.172413 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:25:14.172389    2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/15ef2bca-b153-42db-bdb7-b063d94f451f-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-78dd8f8c95-dz85t\" (UID: \"15ef2bca-b153-42db-bdb7-b063d94f451f\") " pod="openshift-monitoring/metrics-server-78dd8f8c95-dz85t"
May 25 11:25:14.172514 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:25:14.172426    2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/15ef2bca-b153-42db-bdb7-b063d94f451f-client-ca-bundle\") pod \"metrics-server-78dd8f8c95-dz85t\" (UID: \"15ef2bca-b153-42db-bdb7-b063d94f451f\") " pod="openshift-monitoring/metrics-server-78dd8f8c95-dz85t"
May 25 11:25:14.172514 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:25:14.172470    2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-svgl2\" (UniqueName: \"kubernetes.io/projected/15ef2bca-b153-42db-bdb7-b063d94f451f-kube-api-access-svgl2\") pod \"metrics-server-78dd8f8c95-dz85t\" (UID: \"15ef2bca-b153-42db-bdb7-b063d94f451f\") " pod="openshift-monitoring/metrics-server-78dd8f8c95-dz85t"
May 25 11:25:14.172608 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:25:14.172519    2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/15ef2bca-b153-42db-bdb7-b063d94f451f-secret-metrics-server-client-certs\") pod \"metrics-server-78dd8f8c95-dz85t\" (UID: \"15ef2bca-b153-42db-bdb7-b063d94f451f\") " pod="openshift-monitoring/metrics-server-78dd8f8c95-dz85t"
May 25 11:25:14.172608 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:25:14.172571    2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/15ef2bca-b153-42db-bdb7-b063d94f451f-secret-metrics-server-tls\") pod \"metrics-server-78dd8f8c95-dz85t\" (UID: \"15ef2bca-b153-42db-bdb7-b063d94f451f\") " pod="openshift-monitoring/metrics-server-78dd8f8c95-dz85t"
May 25 11:25:14.172990 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:25:14.172716    2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/15ef2bca-b153-42db-bdb7-b063d94f451f-audit-log\") pod \"metrics-server-78dd8f8c95-dz85t\" (UID: \"15ef2bca-b153-42db-bdb7-b063d94f451f\") " pod="openshift-monitoring/metrics-server-78dd8f8c95-dz85t"
May 25 11:25:14.173204 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:25:14.173181    2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/15ef2bca-b153-42db-bdb7-b063d94f451f-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-78dd8f8c95-dz85t\" (UID: \"15ef2bca-b153-42db-bdb7-b063d94f451f\") " pod="openshift-monitoring/metrics-server-78dd8f8c95-dz85t"
May 25 11:25:14.173435 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:25:14.173394    2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/15ef2bca-b153-42db-bdb7-b063d94f451f-metrics-server-audit-profiles\") pod \"metrics-server-78dd8f8c95-dz85t\" (UID: \"15ef2bca-b153-42db-bdb7-b063d94f451f\") " pod="openshift-monitoring/metrics-server-78dd8f8c95-dz85t"
May 25 11:25:14.175718 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:25:14.175692    2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/15ef2bca-b153-42db-bdb7-b063d94f451f-secret-metrics-server-client-certs\") pod \"metrics-server-78dd8f8c95-dz85t\" (UID: \"15ef2bca-b153-42db-bdb7-b063d94f451f\") " pod="openshift-monitoring/metrics-server-78dd8f8c95-dz85t"
May 25 11:25:14.175812 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:25:14.175699    2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/15ef2bca-b153-42db-bdb7-b063d94f451f-secret-metrics-server-tls\") pod \"metrics-server-78dd8f8c95-dz85t\" (UID: \"15ef2bca-b153-42db-bdb7-b063d94f451f\") " pod="openshift-monitoring/metrics-server-78dd8f8c95-dz85t"
May 25 11:25:14.175812 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:25:14.175778    2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/15ef2bca-b153-42db-bdb7-b063d94f451f-client-ca-bundle\") pod \"metrics-server-78dd8f8c95-dz85t\" (UID: \"15ef2bca-b153-42db-bdb7-b063d94f451f\") " pod="openshift-monitoring/metrics-server-78dd8f8c95-dz85t"
May 25 11:25:14.181773 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:25:14.181744    2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-svgl2\" (UniqueName: \"kubernetes.io/projected/15ef2bca-b153-42db-bdb7-b063d94f451f-kube-api-access-svgl2\") pod \"metrics-server-78dd8f8c95-dz85t\" (UID: \"15ef2bca-b153-42db-bdb7-b063d94f451f\") " pod="openshift-monitoring/metrics-server-78dd8f8c95-dz85t"
May 25 11:25:14.195207 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:25:14.195171    2545 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-557d9f868-8t7zm" event={"ID":"17182e04-8c7b-42af-bf81-6388aae24602","Type":"ContainerStarted","Data":"af4218f2a1a9699287616c3500dbacae5f7ee962256d245c530ae356c3200166"}
May 25 11:25:14.302390 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:25:14.302319    2545 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-78dd8f8c95-dz85t"
May 25 11:25:14.439442 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:25:14.439402    2545 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-78dd8f8c95-dz85t"]
May 25 11:25:14.474864 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:25:14.474831    2545 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-665c9c8584-zw2xk"]
May 25 11:25:14.477203 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:25:14.477182    2545 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-665c9c8584-zw2xk"
May 25 11:25:14.480051 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:25:14.480022    2545 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"default-dockercfg-kp7fb\""
May 25 11:25:14.480051 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:25:14.480035    2545 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\""
May 25 11:25:14.488037 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:25:14.488019    2545 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-665c9c8584-zw2xk"]
May 25 11:25:14.580832 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:25:14.577695    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/3a4ac090-6c16-4c7c-8fc4-63f07c1f3695-monitoring-plugin-cert\") pod \"monitoring-plugin-665c9c8584-zw2xk\" (UID: \"3a4ac090-6c16-4c7c-8fc4-63f07c1f3695\") " pod="openshift-monitoring/monitoring-plugin-665c9c8584-zw2xk"
May 25 11:25:14.678514 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:25:14.678474    2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/3a4ac090-6c16-4c7c-8fc4-63f07c1f3695-monitoring-plugin-cert\") pod \"monitoring-plugin-665c9c8584-zw2xk\" (UID: \"3a4ac090-6c16-4c7c-8fc4-63f07c1f3695\") " pod="openshift-monitoring/monitoring-plugin-665c9c8584-zw2xk"
May 25 11:25:14.678660 ip-10-0-128-206 kubenswrapper[2545]: E0525 11:25:14.678628    2545 secret.go:189] Couldn't get secret openshift-monitoring/monitoring-plugin-cert: secret "monitoring-plugin-cert" not found
May 25 11:25:14.678719 ip-10-0-128-206 kubenswrapper[2545]: E0525 11:25:14.678705    2545 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3a4ac090-6c16-4c7c-8fc4-63f07c1f3695-monitoring-plugin-cert podName:3a4ac090-6c16-4c7c-8fc4-63f07c1f3695 nodeName:}" failed. No retries permitted until 2026-05-25 11:25:15.17868427 +0000 UTC m=+106.944969193 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "monitoring-plugin-cert" (UniqueName: "kubernetes.io/secret/3a4ac090-6c16-4c7c-8fc4-63f07c1f3695-monitoring-plugin-cert") pod "monitoring-plugin-665c9c8584-zw2xk" (UID: "3a4ac090-6c16-4c7c-8fc4-63f07c1f3695") : secret "monitoring-plugin-cert" not found
May 25 11:25:14.934156 ip-10-0-128-206 kubenswrapper[2545]: W0525 11:25:14.934087    2545 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod15ef2bca_b153_42db_bdb7_b063d94f451f.slice/crio-f28da6ee9182d4cbd72352b3d1aded039b7d93864e877f060838cff6f1ffbe93 WatchSource:0}: Error finding container f28da6ee9182d4cbd72352b3d1aded039b7d93864e877f060838cff6f1ffbe93: Status 404 returned error can't find the container with id f28da6ee9182d4cbd72352b3d1aded039b7d93864e877f060838cff6f1ffbe93
May 25 11:25:15.182629 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:25:15.182595    2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/3a4ac090-6c16-4c7c-8fc4-63f07c1f3695-monitoring-plugin-cert\") pod \"monitoring-plugin-665c9c8584-zw2xk\" (UID: \"3a4ac090-6c16-4c7c-8fc4-63f07c1f3695\") " pod="openshift-monitoring/monitoring-plugin-665c9c8584-zw2xk"
May 25 11:25:15.184890 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:25:15.184837    2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/3a4ac090-6c16-4c7c-8fc4-63f07c1f3695-monitoring-plugin-cert\") pod \"monitoring-plugin-665c9c8584-zw2xk\" (UID: \"3a4ac090-6c16-4c7c-8fc4-63f07c1f3695\") " pod="openshift-monitoring/monitoring-plugin-665c9c8584-zw2xk"
May 25 11:25:15.199649 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:25:15.199615    2545 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-557d9f868-8t7zm" event={"ID":"17182e04-8c7b-42af-bf81-6388aae24602","Type":"ContainerStarted","Data":"c90c83b40d344ec0870bff600db8bb8fe25f48d7939304e2056bea2779514ac7"}
May 25 11:25:15.199649 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:25:15.199648    2545 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-557d9f868-8t7zm" event={"ID":"17182e04-8c7b-42af-bf81-6388aae24602","Type":"ContainerStarted","Data":"1084bbb1c5214e468f1997bf38e88654ddc69fb4084afb45dcb8ff2ae62de00d"}
May 25 11:25:15.199797 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:25:15.199659    2545 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-557d9f868-8t7zm" event={"ID":"17182e04-8c7b-42af-bf81-6388aae24602","Type":"ContainerStarted","Data":"bf861c4198b203b7ed20474808b2c3570707ee4310790d4bbd574b506600e6ce"}
May 25 11:25:15.200654 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:25:15.200628    2545 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-78dd8f8c95-dz85t" event={"ID":"15ef2bca-b153-42db-bdb7-b063d94f451f","Type":"ContainerStarted","Data":"f28da6ee9182d4cbd72352b3d1aded039b7d93864e877f060838cff6f1ffbe93"}
May 25 11:25:15.387913 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:25:15.387868    2545 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-665c9c8584-zw2xk"
May 25 11:25:15.519004 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:25:15.518945    2545 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-665c9c8584-zw2xk"]
May 25 11:25:15.522037 ip-10-0-128-206 kubenswrapper[2545]: W0525 11:25:15.522003    2545 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3a4ac090_6c16_4c7c_8fc4_63f07c1f3695.slice/crio-34fad92abb64188e1c4f888d24d4b6451fb5e76ba96eec0e6a9c44d9265fb6f7 WatchSource:0}: Error finding container 34fad92abb64188e1c4f888d24d4b6451fb5e76ba96eec0e6a9c44d9265fb6f7: Status 404 returned error can't find the container with id 34fad92abb64188e1c4f888d24d4b6451fb5e76ba96eec0e6a9c44d9265fb6f7
May 25 11:25:15.873061 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:25:15.873026    2545 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
May 25 11:25:15.876283 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:25:15.876263    2545 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
May 25 11:25:15.879209 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:25:15.879095    2545 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-d6dv3co18a7sr\""
May 25 11:25:15.879434 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:25:15.879416    2545 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\""
May 25 11:25:15.879676 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:25:15.879661    2545 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\""
May 25 11:25:15.879859 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:25:15.879838    2545 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\""
May 25 11:25:15.880055 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:25:15.880041    2545 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-hwswd\""
May 25 11:25:15.880479 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:25:15.880449    2545 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\""
May 25 11:25:15.880674 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:25:15.880651    2545 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\""
May 25 11:25:15.880898 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:25:15.880874    2545 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\""
May 25 11:25:15.881066 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:25:15.880874    2545 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\""
May 25 11:25:15.881154 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:25:15.881104    2545 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\""
May 25 11:25:15.881154 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:25:15.881135    2545 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\""
May 25 11:25:15.881347 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:25:15.881332    2545 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\""
May 25 11:25:15.881447 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:25:15.881408    2545 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\""
May 25 11:25:15.883206 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:25:15.883185    2545 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\""
May 25 11:25:15.890668 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:25:15.890644    2545 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
May 25 11:25:15.990723 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:25:15.990689    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6ce930cd-ee46-4495-9bfc-b326ded02436-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"6ce930cd-ee46-4495-9bfc-b326ded02436\") " pod="openshift-monitoring/prometheus-k8s-0"
May 25 11:25:15.990723 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:25:15.990728    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6ce930cd-ee46-4495-9bfc-b326ded02436-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"6ce930cd-ee46-4495-9bfc-b326ded02436\") " pod="openshift-monitoring/prometheus-k8s-0"
May 25 11:25:15.990928 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:25:15.990772    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/6ce930cd-ee46-4495-9bfc-b326ded02436-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"6ce930cd-ee46-4495-9bfc-b326ded02436\") " pod="openshift-monitoring/prometheus-k8s-0"
May 25 11:25:15.990928 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:25:15.990791    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/6ce930cd-ee46-4495-9bfc-b326ded02436-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"6ce930cd-ee46-4495-9bfc-b326ded02436\") " pod="openshift-monitoring/prometheus-k8s-0"
May 25 11:25:15.990928 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:25:15.990839    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/6ce930cd-ee46-4495-9bfc-b326ded02436-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"6ce930cd-ee46-4495-9bfc-b326ded02436\") " pod="openshift-monitoring/prometheus-k8s-0"
May 25 11:25:15.990928 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:25:15.990872    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/6ce930cd-ee46-4495-9bfc-b326ded02436-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"6ce930cd-ee46-4495-9bfc-b326ded02436\") " pod="openshift-monitoring/prometheus-k8s-0"
May 25 11:25:15.991124 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:25:15.990946    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6ce930cd-ee46-4495-9bfc-b326ded02436-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"6ce930cd-ee46-4495-9bfc-b326ded02436\") " pod="openshift-monitoring/prometheus-k8s-0"
May 25 11:25:15.991124 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:25:15.991006    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/6ce930cd-ee46-4495-9bfc-b326ded02436-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"6ce930cd-ee46-4495-9bfc-b326ded02436\") " pod="openshift-monitoring/prometheus-k8s-0"
May 25 11:25:15.991124 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:25:15.991022    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vg6wt\" (UniqueName: \"kubernetes.io/projected/6ce930cd-ee46-4495-9bfc-b326ded02436-kube-api-access-vg6wt\") pod \"prometheus-k8s-0\" (UID: \"6ce930cd-ee46-4495-9bfc-b326ded02436\") " pod="openshift-monitoring/prometheus-k8s-0"
May 25 11:25:15.991124 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:25:15.991045    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/6ce930cd-ee46-4495-9bfc-b326ded02436-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"6ce930cd-ee46-4495-9bfc-b326ded02436\") " pod="openshift-monitoring/prometheus-k8s-0"
May 25 11:25:15.991124 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:25:15.991077    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/6ce930cd-ee46-4495-9bfc-b326ded02436-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"6ce930cd-ee46-4495-9bfc-b326ded02436\") " pod="openshift-monitoring/prometheus-k8s-0"
May 25 11:25:15.991361 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:25:15.991138    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/6ce930cd-ee46-4495-9bfc-b326ded02436-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"6ce930cd-ee46-4495-9bfc-b326ded02436\") " pod="openshift-monitoring/prometheus-k8s-0"
May 25 11:25:15.991361 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:25:15.991209    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/6ce930cd-ee46-4495-9bfc-b326ded02436-config-out\") pod \"prometheus-k8s-0\" (UID: \"6ce930cd-ee46-4495-9bfc-b326ded02436\") " pod="openshift-monitoring/prometheus-k8s-0"
May 25 11:25:15.991361 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:25:15.991246    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6ce930cd-ee46-4495-9bfc-b326ded02436-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"6ce930cd-ee46-4495-9bfc-b326ded02436\") " pod="openshift-monitoring/prometheus-k8s-0"
May 25 11:25:15.991361 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:25:15.991272    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/6ce930cd-ee46-4495-9bfc-b326ded02436-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"6ce930cd-ee46-4495-9bfc-b326ded02436\") " pod="openshift-monitoring/prometheus-k8s-0"
May 25 11:25:15.991361 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:25:15.991297    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/6ce930cd-ee46-4495-9bfc-b326ded02436-web-config\") pod \"prometheus-k8s-0\" (UID: \"6ce930cd-ee46-4495-9bfc-b326ded02436\") " pod="openshift-monitoring/prometheus-k8s-0"
May 25 11:25:15.991361 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:25:15.991349    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/6ce930cd-ee46-4495-9bfc-b326ded02436-config\") pod \"prometheus-k8s-0\" (UID: \"6ce930cd-ee46-4495-9bfc-b326ded02436\") " pod="openshift-monitoring/prometheus-k8s-0"
May 25 11:25:15.991610 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:25:15.991372    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/6ce930cd-ee46-4495-9bfc-b326ded02436-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"6ce930cd-ee46-4495-9bfc-b326ded02436\") " pod="openshift-monitoring/prometheus-k8s-0"
May 25 11:25:16.092419 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:25:16.092379    2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/6ce930cd-ee46-4495-9bfc-b326ded02436-config\") pod \"prometheus-k8s-0\" (UID: \"6ce930cd-ee46-4495-9bfc-b326ded02436\") " pod="openshift-monitoring/prometheus-k8s-0"
May 25 11:25:16.092587 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:25:16.092428    2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/6ce930cd-ee46-4495-9bfc-b326ded02436-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"6ce930cd-ee46-4495-9bfc-b326ded02436\") " pod="openshift-monitoring/prometheus-k8s-0"
May 25 11:25:16.092587 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:25:16.092461    2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6ce930cd-ee46-4495-9bfc-b326ded02436-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"6ce930cd-ee46-4495-9bfc-b326ded02436\") " pod="openshift-monitoring/prometheus-k8s-0"
May 25 11:25:16.092587 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:25:16.092483    2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6ce930cd-ee46-4495-9bfc-b326ded02436-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"6ce930cd-ee46-4495-9bfc-b326ded02436\") " pod="openshift-monitoring/prometheus-k8s-0"
May 25 11:25:16.092587 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:25:16.092527    2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/6ce930cd-ee46-4495-9bfc-b326ded02436-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"6ce930cd-ee46-4495-9bfc-b326ded02436\") " pod="openshift-monitoring/prometheus-k8s-0"
May 25 11:25:16.093057 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:25:16.092951    2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/6ce930cd-ee46-4495-9bfc-b326ded02436-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"6ce930cd-ee46-4495-9bfc-b326ded02436\") " pod="openshift-monitoring/prometheus-k8s-0"
May 25 11:25:16.093057 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:25:16.092996    2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/6ce930cd-ee46-4495-9bfc-b326ded02436-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"6ce930cd-ee46-4495-9bfc-b326ded02436\") " pod="openshift-monitoring/prometheus-k8s-0"
May 25 11:25:16.093057 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:25:16.093028    2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/6ce930cd-ee46-4495-9bfc-b326ded02436-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"6ce930cd-ee46-4495-9bfc-b326ded02436\") " pod="openshift-monitoring/prometheus-k8s-0"
May 25 11:25:16.093264 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:25:16.093067    2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/6ce930cd-ee46-4495-9bfc-b326ded02436-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"6ce930cd-ee46-4495-9bfc-b326ded02436\") " pod="openshift-monitoring/prometheus-k8s-0"
May 25 11:25:16.093264 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:25:16.093118    2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6ce930cd-ee46-4495-9bfc-b326ded02436-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"6ce930cd-ee46-4495-9bfc-b326ded02436\") " pod="openshift-monitoring/prometheus-k8s-0"
May 25 11:25:16.093264 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:25:16.093160    2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/6ce930cd-ee46-4495-9bfc-b326ded02436-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"6ce930cd-ee46-4495-9bfc-b326ded02436\") " pod="openshift-monitoring/prometheus-k8s-0"
May 25 11:25:16.093264 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:25:16.093182    2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-vg6wt\" (UniqueName: \"kubernetes.io/projected/6ce930cd-ee46-4495-9bfc-b326ded02436-kube-api-access-vg6wt\") pod \"prometheus-k8s-0\" (UID: \"6ce930cd-ee46-4495-9bfc-b326ded02436\") " pod="openshift-monitoring/prometheus-k8s-0"
May 25 11:25:16.093264 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:25:16.093210    2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/6ce930cd-ee46-4495-9bfc-b326ded02436-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"6ce930cd-ee46-4495-9bfc-b326ded02436\") " pod="openshift-monitoring/prometheus-k8s-0"
May 25 11:25:16.093264 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:25:16.093249    2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/6ce930cd-ee46-4495-9bfc-b326ded02436-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"6ce930cd-ee46-4495-9bfc-b326ded02436\") " pod="openshift-monitoring/prometheus-k8s-0"
May 25 11:25:16.093550 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:25:16.093295    2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/6ce930cd-ee46-4495-9bfc-b326ded02436-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"6ce930cd-ee46-4495-9bfc-b326ded02436\") " pod="openshift-monitoring/prometheus-k8s-0"
May 25 11:25:16.093550 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:25:16.093329    2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/6ce930cd-ee46-4495-9bfc-b326ded02436-config-out\") pod \"prometheus-k8s-0\" (UID: \"6ce930cd-ee46-4495-9bfc-b326ded02436\") " pod="openshift-monitoring/prometheus-k8s-0"
May 25 11:25:16.093550 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:25:16.093366    2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6ce930cd-ee46-4495-9bfc-b326ded02436-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"6ce930cd-ee46-4495-9bfc-b326ded02436\") " pod="openshift-monitoring/prometheus-k8s-0"
May 25 11:25:16.093550 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:25:16.093381    2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6ce930cd-ee46-4495-9bfc-b326ded02436-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"6ce930cd-ee46-4495-9bfc-b326ded02436\") " pod="openshift-monitoring/prometheus-k8s-0"
May 25 11:25:16.093550 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:25:16.093392    2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/6ce930cd-ee46-4495-9bfc-b326ded02436-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"6ce930cd-ee46-4495-9bfc-b326ded02436\") " pod="openshift-monitoring/prometheus-k8s-0"
May 25 11:25:16.093550 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:25:16.093419    2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/6ce930cd-ee46-4495-9bfc-b326ded02436-web-config\") pod \"prometheus-k8s-0\" (UID: \"6ce930cd-ee46-4495-9bfc-b326ded02436\") " pod="openshift-monitoring/prometheus-k8s-0"
May 25 11:25:16.094661 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:25:16.094062    2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6ce930cd-ee46-4495-9bfc-b326ded02436-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"6ce930cd-ee46-4495-9bfc-b326ded02436\") " pod="openshift-monitoring/prometheus-k8s-0"
May 25 11:25:16.094661 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:25:16.094478    2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6ce930cd-ee46-4495-9bfc-b326ded02436-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"6ce930cd-ee46-4495-9bfc-b326ded02436\") " pod="openshift-monitoring/prometheus-k8s-0"
May 25 11:25:16.094986 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:25:16.094944    2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6ce930cd-ee46-4495-9bfc-b326ded02436-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"6ce930cd-ee46-4495-9bfc-b326ded02436\") " pod="openshift-monitoring/prometheus-k8s-0"
May 25 11:25:16.095738 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:25:16.095709    2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/6ce930cd-ee46-4495-9bfc-b326ded02436-config\") pod \"prometheus-k8s-0\" (UID: \"6ce930cd-ee46-4495-9bfc-b326ded02436\") " pod="openshift-monitoring/prometheus-k8s-0"
May 25 11:25:16.095844 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:25:16.095804    2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/6ce930cd-ee46-4495-9bfc-b326ded02436-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"6ce930cd-ee46-4495-9bfc-b326ded02436\") " pod="openshift-monitoring/prometheus-k8s-0"
May 25 11:25:16.096616 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:25:16.096508    2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/6ce930cd-ee46-4495-9bfc-b326ded02436-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"6ce930cd-ee46-4495-9bfc-b326ded02436\") " pod="openshift-monitoring/prometheus-k8s-0"
May 25 11:25:16.097130 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:25:16.097101    2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/6ce930cd-ee46-4495-9bfc-b326ded02436-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"6ce930cd-ee46-4495-9bfc-b326ded02436\") " pod="openshift-monitoring/prometheus-k8s-0"
May 25 11:25:16.097230 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:25:16.097140    2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/6ce930cd-ee46-4495-9bfc-b326ded02436-web-config\") pod \"prometheus-k8s-0\" (UID: \"6ce930cd-ee46-4495-9bfc-b326ded02436\") " pod="openshift-monitoring/prometheus-k8s-0"
May 25 11:25:16.098057 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:25:16.098034    2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/6ce930cd-ee46-4495-9bfc-b326ded02436-config-out\") pod \"prometheus-k8s-0\" (UID: \"6ce930cd-ee46-4495-9bfc-b326ded02436\") " pod="openshift-monitoring/prometheus-k8s-0"
May 25 11:25:16.098314 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:25:16.098263    2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/6ce930cd-ee46-4495-9bfc-b326ded02436-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"6ce930cd-ee46-4495-9bfc-b326ded02436\") " pod="openshift-monitoring/prometheus-k8s-0"
May 25 11:25:16.098551 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:25:16.098529    2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/6ce930cd-ee46-4495-9bfc-b326ded02436-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"6ce930cd-ee46-4495-9bfc-b326ded02436\") " pod="openshift-monitoring/prometheus-k8s-0"
May 25 11:25:16.098637 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:25:16.098603    2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/6ce930cd-ee46-4495-9bfc-b326ded02436-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"6ce930cd-ee46-4495-9bfc-b326ded02436\") " pod="openshift-monitoring/prometheus-k8s-0"
May 25 11:25:16.098934 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:25:16.098915    2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/6ce930cd-ee46-4495-9bfc-b326ded02436-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"6ce930cd-ee46-4495-9bfc-b326ded02436\") " pod="openshift-monitoring/prometheus-k8s-0"
May 25 11:25:16.099025 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:25:16.098914    2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/6ce930cd-ee46-4495-9bfc-b326ded02436-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"6ce930cd-ee46-4495-9bfc-b326ded02436\") " pod="openshift-monitoring/prometheus-k8s-0"
May 25 11:25:16.099512 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:25:16.099493    2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/6ce930cd-ee46-4495-9bfc-b326ded02436-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"6ce930cd-ee46-4495-9bfc-b326ded02436\") " pod="openshift-monitoring/prometheus-k8s-0"
May 25 11:25:16.103806 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:25:16.103789    2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vg6wt\" (UniqueName: \"kubernetes.io/projected/6ce930cd-ee46-4495-9bfc-b326ded02436-kube-api-access-vg6wt\") pod \"prometheus-k8s-0\" (UID: \"6ce930cd-ee46-4495-9bfc-b326ded02436\") " pod="openshift-monitoring/prometheus-k8s-0"
May 25 11:25:16.190433 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:25:16.190211    2545 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
May 25 11:25:16.206100 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:25:16.206062    2545 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-665c9c8584-zw2xk" event={"ID":"3a4ac090-6c16-4c7c-8fc4-63f07c1f3695","Type":"ContainerStarted","Data":"34fad92abb64188e1c4f888d24d4b6451fb5e76ba96eec0e6a9c44d9265fb6f7"}
May 25 11:25:16.534989 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:25:16.534932    2545 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
May 25 11:25:16.866646 ip-10-0-128-206 kubenswrapper[2545]: W0525 11:25:16.866617    2545 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6ce930cd_ee46_4495_9bfc_b326ded02436.slice/crio-dc242d7f0bdb5e943f463d8169c30a484b8f9c6ea81f225e408b9299fec139cf WatchSource:0}: Error finding container dc242d7f0bdb5e943f463d8169c30a484b8f9c6ea81f225e408b9299fec139cf: Status 404 returned error can't find the container with id dc242d7f0bdb5e943f463d8169c30a484b8f9c6ea81f225e408b9299fec139cf
May 25 11:25:17.211086 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:25:17.210991    2545 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-557d9f868-8t7zm" event={"ID":"17182e04-8c7b-42af-bf81-6388aae24602","Type":"ContainerStarted","Data":"4f26d28977eecfff51f0eac80c083de69454b15fa2ce1e857b91dc70ba5f466a"}
May 25 11:25:17.211086 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:25:17.211027    2545 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-557d9f868-8t7zm" event={"ID":"17182e04-8c7b-42af-bf81-6388aae24602","Type":"ContainerStarted","Data":"cb022ec8815bef2a73d03166da8c1ca409d25660c10205dce3e286b61131ce6e"}
May 25 11:25:17.211086 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:25:17.211038    2545 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-557d9f868-8t7zm" event={"ID":"17182e04-8c7b-42af-bf81-6388aae24602","Type":"ContainerStarted","Data":"52fccaea481c2465489f29f53d227e0fcf7a2917eb97cd15899dc60b495ad352"}
May 25 11:25:17.211608 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:25:17.211148    2545 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-557d9f868-8t7zm"
May 25 11:25:17.212316 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:25:17.212293    2545 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-78dd8f8c95-dz85t" event={"ID":"15ef2bca-b153-42db-bdb7-b063d94f451f","Type":"ContainerStarted","Data":"13fb99f912aab4aff4e625154d30377d8a55dfb22478d0f5e544ffe3d2d407cc"}
May 25 11:25:17.216311 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:25:17.216288    2545 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-665c9c8584-zw2xk" event={"ID":"3a4ac090-6c16-4c7c-8fc4-63f07c1f3695","Type":"ContainerStarted","Data":"d09623a82fe9e88ddb723cec17091691f3845e081feab2c7b76834aeedbc6319"}
May 25 11:25:17.216447 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:25:17.216417    2545 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-665c9c8584-zw2xk"
May 25 11:25:17.217440 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:25:17.217419    2545 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"6ce930cd-ee46-4495-9bfc-b326ded02436","Type":"ContainerStarted","Data":"dc242d7f0bdb5e943f463d8169c30a484b8f9c6ea81f225e408b9299fec139cf"}
May 25 11:25:17.221035 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:25:17.221018    2545 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-665c9c8584-zw2xk"
May 25 11:25:17.238549 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:25:17.238507    2545 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-557d9f868-8t7zm" podStartSLOduration=2.055334894 podStartE2EDuration="5.238495302s" podCreationTimestamp="2026-05-25 11:25:12 +0000 UTC" firstStartedPulling="2026-05-25 11:25:13.187839057 +0000 UTC m=+104.954123980" lastFinishedPulling="2026-05-25 11:25:16.37099945 +0000 UTC m=+108.137284388" observedRunningTime="2026-05-25 11:25:17.237539148 +0000 UTC m=+109.003824095" watchObservedRunningTime="2026-05-25 11:25:17.238495302 +0000 UTC m=+109.004780287"
May 25 11:25:17.272716 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:25:17.272666    2545 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-665c9c8584-zw2xk" podStartSLOduration=1.901045604 podStartE2EDuration="3.272649654s" podCreationTimestamp="2026-05-25 11:25:14 +0000 UTC" firstStartedPulling="2026-05-25 11:25:15.524560956 +0000 UTC m=+107.290845883" lastFinishedPulling="2026-05-25 11:25:16.896165005 +0000 UTC m=+108.662449933" observedRunningTime="2026-05-25 11:25:17.271994803 +0000 UTC m=+109.038279751" watchObservedRunningTime="2026-05-25 11:25:17.272649654 +0000 UTC m=+109.038934604"
May 25 11:25:17.273749 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:25:17.273708    2545 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-78dd8f8c95-dz85t" podStartSLOduration=2.836685095 podStartE2EDuration="4.273698282s" podCreationTimestamp="2026-05-25 11:25:13 +0000 UTC" firstStartedPulling="2026-05-25 11:25:14.936022728 +0000 UTC m=+106.702307653" lastFinishedPulling="2026-05-25 11:25:16.373035913 +0000 UTC m=+108.139320840" observedRunningTime="2026-05-25 11:25:17.256056896 +0000 UTC m=+109.022341855" watchObservedRunningTime="2026-05-25 11:25:17.273698282 +0000 UTC m=+109.039983229"
May 25 11:25:18.222108 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:25:18.222016    2545 generic.go:358] "Generic (PLEG): container finished" podID="6ce930cd-ee46-4495-9bfc-b326ded02436" containerID="9c528e59f2d8fe5a69c0f022e898e003743212c1443af2bc56cccb71c59c6813" exitCode=0
May 25 11:25:18.222476 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:25:18.222139    2545 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"6ce930cd-ee46-4495-9bfc-b326ded02436","Type":"ContainerDied","Data":"9c528e59f2d8fe5a69c0f022e898e003743212c1443af2bc56cccb71c59c6813"}
May 25 11:25:19.172472 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:25:19.172442    2545 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-hzp8b"
May 25 11:25:21.240595 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:25:21.240559    2545 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"6ce930cd-ee46-4495-9bfc-b326ded02436","Type":"ContainerStarted","Data":"2c80b1cf5e35d0cf01154e992efbb88cb8fe94eaa11bfc487f38e772beffcdee"}
May 25 11:25:21.241026 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:25:21.240600    2545 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"6ce930cd-ee46-4495-9bfc-b326ded02436","Type":"ContainerStarted","Data":"d356b1c9372d58cf9a70f2a7aabc32bfa4d4431ca1888391533c26c4f508bf99"}
May 25 11:25:21.241026 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:25:21.240613    2545 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"6ce930cd-ee46-4495-9bfc-b326ded02436","Type":"ContainerStarted","Data":"27ddc99cc23629f47211a7e379e50ad5155bfe5e821ebeb842b1ba13a1de3b4c"}
May 25 11:25:22.246213 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:25:22.246181    2545 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"6ce930cd-ee46-4495-9bfc-b326ded02436","Type":"ContainerStarted","Data":"31ff27f16f606207ac345d9848f1ae3cacabb6f0763802df2a5356b1c0606ff0"}
May 25 11:25:22.246213 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:25:22.246214    2545 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"6ce930cd-ee46-4495-9bfc-b326ded02436","Type":"ContainerStarted","Data":"49e3f78ba3681ba54f723234556a5b5a409110c111bf8212dc774c023a94a6e6"}
May 25 11:25:22.246606 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:25:22.246224    2545 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"6ce930cd-ee46-4495-9bfc-b326ded02436","Type":"ContainerStarted","Data":"735b07ee353a99691a142ec1835e1c337c8c3f344b346444836d18503486bb10"}
May 25 11:25:22.279024 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:25:22.278978    2545 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=3.181446415 podStartE2EDuration="7.27894302s" podCreationTimestamp="2026-05-25 11:25:15 +0000 UTC" firstStartedPulling="2026-05-25 11:25:16.868425979 +0000 UTC m=+108.634710902" lastFinishedPulling="2026-05-25 11:25:20.965922566 +0000 UTC m=+112.732207507" observedRunningTime="2026-05-25 11:25:22.277403135 +0000 UTC m=+114.043688106" watchObservedRunningTime="2026-05-25 11:25:22.27894302 +0000 UTC m=+114.045227966"
May 25 11:25:23.228392 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:25:23.228361    2545 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-557d9f868-8t7zm"
May 25 11:25:25.149644 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:25:25.149617    2545 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-64b679b875-7wj65"
May 25 11:25:26.191435 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:25:26.191388    2545 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0"
May 25 11:25:30.162069 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:25:30.162014    2545 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-image-registry/image-registry-64b679b875-7wj65" podUID="918141d8-d07a-4526-aafe-3ba8eeceafd4" containerName="registry" containerID="cri-o://89e2d20d0a8a1289ab8c66ff5aa8f8f59a18f514c314467c45e9e315dd1f3c40" gracePeriod=30
May 25 11:25:30.400892 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:25:30.400871    2545 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-64b679b875-7wj65"
May 25 11:25:30.414148 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:25:30.414094    2545 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/918141d8-d07a-4526-aafe-3ba8eeceafd4-trusted-ca\") pod \"918141d8-d07a-4526-aafe-3ba8eeceafd4\" (UID: \"918141d8-d07a-4526-aafe-3ba8eeceafd4\") "
May 25 11:25:30.414148 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:25:30.414131    2545 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/918141d8-d07a-4526-aafe-3ba8eeceafd4-ca-trust-extracted\") pod \"918141d8-d07a-4526-aafe-3ba8eeceafd4\" (UID: \"918141d8-d07a-4526-aafe-3ba8eeceafd4\") "
May 25 11:25:30.414273 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:25:30.414152    2545 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/918141d8-d07a-4526-aafe-3ba8eeceafd4-registry-certificates\") pod \"918141d8-d07a-4526-aafe-3ba8eeceafd4\" (UID: \"918141d8-d07a-4526-aafe-3ba8eeceafd4\") "
May 25 11:25:30.414273 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:25:30.414178    2545 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/918141d8-d07a-4526-aafe-3ba8eeceafd4-installation-pull-secrets\") pod \"918141d8-d07a-4526-aafe-3ba8eeceafd4\" (UID: \"918141d8-d07a-4526-aafe-3ba8eeceafd4\") "
May 25 11:25:30.414273 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:25:30.414244    2545 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-62kqk\" (UniqueName: \"kubernetes.io/projected/918141d8-d07a-4526-aafe-3ba8eeceafd4-kube-api-access-62kqk\") pod \"918141d8-d07a-4526-aafe-3ba8eeceafd4\" (UID: \"918141d8-d07a-4526-aafe-3ba8eeceafd4\") "
May 25 11:25:30.414404 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:25:30.414276    2545 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/918141d8-d07a-4526-aafe-3ba8eeceafd4-bound-sa-token\") pod \"918141d8-d07a-4526-aafe-3ba8eeceafd4\" (UID: \"918141d8-d07a-4526-aafe-3ba8eeceafd4\") "
May 25 11:25:30.414404 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:25:30.414322    2545 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/918141d8-d07a-4526-aafe-3ba8eeceafd4-image-registry-private-configuration\") pod \"918141d8-d07a-4526-aafe-3ba8eeceafd4\" (UID: \"918141d8-d07a-4526-aafe-3ba8eeceafd4\") "
May 25 11:25:30.414404 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:25:30.414346    2545 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/918141d8-d07a-4526-aafe-3ba8eeceafd4-registry-tls\") pod \"918141d8-d07a-4526-aafe-3ba8eeceafd4\" (UID: \"918141d8-d07a-4526-aafe-3ba8eeceafd4\") "
May 25 11:25:30.414560 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:25:30.414539    2545 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/918141d8-d07a-4526-aafe-3ba8eeceafd4-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "918141d8-d07a-4526-aafe-3ba8eeceafd4" (UID: "918141d8-d07a-4526-aafe-3ba8eeceafd4"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 25 11:25:30.414645 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:25:30.414536    2545 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/918141d8-d07a-4526-aafe-3ba8eeceafd4-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "918141d8-d07a-4526-aafe-3ba8eeceafd4" (UID: "918141d8-d07a-4526-aafe-3ba8eeceafd4"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 25 11:25:30.414645 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:25:30.414630    2545 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/918141d8-d07a-4526-aafe-3ba8eeceafd4-registry-certificates\") on node \"ip-10-0-128-206.ec2.internal\" DevicePath \"\""
May 25 11:25:30.416594 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:25:30.416548    2545 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/918141d8-d07a-4526-aafe-3ba8eeceafd4-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "918141d8-d07a-4526-aafe-3ba8eeceafd4" (UID: "918141d8-d07a-4526-aafe-3ba8eeceafd4"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 25 11:25:30.416886 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:25:30.416861    2545 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/918141d8-d07a-4526-aafe-3ba8eeceafd4-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "918141d8-d07a-4526-aafe-3ba8eeceafd4" (UID: "918141d8-d07a-4526-aafe-3ba8eeceafd4"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 25 11:25:30.416988 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:25:30.416905    2545 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/918141d8-d07a-4526-aafe-3ba8eeceafd4-kube-api-access-62kqk" (OuterVolumeSpecName: "kube-api-access-62kqk") pod "918141d8-d07a-4526-aafe-3ba8eeceafd4" (UID: "918141d8-d07a-4526-aafe-3ba8eeceafd4"). InnerVolumeSpecName "kube-api-access-62kqk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 25 11:25:30.416988 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:25:30.416909    2545 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/918141d8-d07a-4526-aafe-3ba8eeceafd4-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "918141d8-d07a-4526-aafe-3ba8eeceafd4" (UID: "918141d8-d07a-4526-aafe-3ba8eeceafd4"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 25 11:25:30.417075 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:25:30.417041    2545 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/918141d8-d07a-4526-aafe-3ba8eeceafd4-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "918141d8-d07a-4526-aafe-3ba8eeceafd4" (UID: "918141d8-d07a-4526-aafe-3ba8eeceafd4"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 25 11:25:30.425415 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:25:30.425392    2545 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/918141d8-d07a-4526-aafe-3ba8eeceafd4-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "918141d8-d07a-4526-aafe-3ba8eeceafd4" (UID: "918141d8-d07a-4526-aafe-3ba8eeceafd4"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 25 11:25:30.515486 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:25:30.515447    2545 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-62kqk\" (UniqueName: \"kubernetes.io/projected/918141d8-d07a-4526-aafe-3ba8eeceafd4-kube-api-access-62kqk\") on node \"ip-10-0-128-206.ec2.internal\" DevicePath \"\""
May 25 11:25:30.515486 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:25:30.515478    2545 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/918141d8-d07a-4526-aafe-3ba8eeceafd4-bound-sa-token\") on node \"ip-10-0-128-206.ec2.internal\" DevicePath \"\""
May 25 11:25:30.515486 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:25:30.515488    2545 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/918141d8-d07a-4526-aafe-3ba8eeceafd4-image-registry-private-configuration\") on node \"ip-10-0-128-206.ec2.internal\" DevicePath \"\""
May 25 11:25:30.515710 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:25:30.515498    2545 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/918141d8-d07a-4526-aafe-3ba8eeceafd4-registry-tls\") on node \"ip-10-0-128-206.ec2.internal\" DevicePath \"\""
May 25 11:25:30.515710 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:25:30.515508    2545 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/918141d8-d07a-4526-aafe-3ba8eeceafd4-trusted-ca\") on node \"ip-10-0-128-206.ec2.internal\" DevicePath \"\""
May 25 11:25:30.515710 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:25:30.515516    2545 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/918141d8-d07a-4526-aafe-3ba8eeceafd4-ca-trust-extracted\") on node \"ip-10-0-128-206.ec2.internal\" DevicePath \"\""
May 25 11:25:30.515710 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:25:30.515526    2545 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/918141d8-d07a-4526-aafe-3ba8eeceafd4-installation-pull-secrets\") on node \"ip-10-0-128-206.ec2.internal\" DevicePath \"\""
May 25 11:25:31.275874 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:25:31.275837    2545 generic.go:358] "Generic (PLEG): container finished" podID="918141d8-d07a-4526-aafe-3ba8eeceafd4" containerID="89e2d20d0a8a1289ab8c66ff5aa8f8f59a18f514c314467c45e9e315dd1f3c40" exitCode=0
May 25 11:25:31.276340 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:25:31.275903    2545 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-64b679b875-7wj65"
May 25 11:25:31.276340 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:25:31.275925    2545 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-64b679b875-7wj65" event={"ID":"918141d8-d07a-4526-aafe-3ba8eeceafd4","Type":"ContainerDied","Data":"89e2d20d0a8a1289ab8c66ff5aa8f8f59a18f514c314467c45e9e315dd1f3c40"}
May 25 11:25:31.276340 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:25:31.275993    2545 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-64b679b875-7wj65" event={"ID":"918141d8-d07a-4526-aafe-3ba8eeceafd4","Type":"ContainerDied","Data":"9b82411c8b5e245fe6edf92bd4d872caa9e6b549140e9047402dd4c6ff22fdf5"}
May 25 11:25:31.276340 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:25:31.276016    2545 scope.go:117] "RemoveContainer" containerID="89e2d20d0a8a1289ab8c66ff5aa8f8f59a18f514c314467c45e9e315dd1f3c40"
May 25 11:25:31.284511 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:25:31.284493    2545 scope.go:117] "RemoveContainer" containerID="89e2d20d0a8a1289ab8c66ff5aa8f8f59a18f514c314467c45e9e315dd1f3c40"
May 25 11:25:31.284752 ip-10-0-128-206 kubenswrapper[2545]: E0525 11:25:31.284728    2545 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"89e2d20d0a8a1289ab8c66ff5aa8f8f59a18f514c314467c45e9e315dd1f3c40\": container with ID starting with 89e2d20d0a8a1289ab8c66ff5aa8f8f59a18f514c314467c45e9e315dd1f3c40 not found: ID does not exist" containerID="89e2d20d0a8a1289ab8c66ff5aa8f8f59a18f514c314467c45e9e315dd1f3c40"
May 25 11:25:31.284813 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:25:31.284760    2545 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"89e2d20d0a8a1289ab8c66ff5aa8f8f59a18f514c314467c45e9e315dd1f3c40"} err="failed to get container status \"89e2d20d0a8a1289ab8c66ff5aa8f8f59a18f514c314467c45e9e315dd1f3c40\": rpc error: code = NotFound desc = could not find container \"89e2d20d0a8a1289ab8c66ff5aa8f8f59a18f514c314467c45e9e315dd1f3c40\": container with ID starting with 89e2d20d0a8a1289ab8c66ff5aa8f8f59a18f514c314467c45e9e315dd1f3c40 not found: ID does not exist"
May 25 11:25:31.293714 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:25:31.293689    2545 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-64b679b875-7wj65"]
May 25 11:25:31.297354 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:25:31.297333    2545 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-64b679b875-7wj65"]
May 25 11:25:32.774880 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:25:32.774846    2545 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="918141d8-d07a-4526-aafe-3ba8eeceafd4" path="/var/lib/kubelet/pods/918141d8-d07a-4526-aafe-3ba8eeceafd4/volumes"
May 25 11:25:34.303002 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:25:34.302940    2545 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-78dd8f8c95-dz85t"
May 25 11:25:34.303379 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:25:34.303094    2545 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-78dd8f8c95-dz85t"
May 25 11:25:38.481868 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:25:38.481830    2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3872d4b9-e2c4-40ab-8fee-706d08118a88-metrics-certs\") pod \"network-metrics-daemon-cvfxv\" (UID: \"3872d4b9-e2c4-40ab-8fee-706d08118a88\") " pod="openshift-multus/network-metrics-daemon-cvfxv"
May 25 11:25:38.484264 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:25:38.484240    2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3872d4b9-e2c4-40ab-8fee-706d08118a88-metrics-certs\") pod \"network-metrics-daemon-cvfxv\" (UID: \"3872d4b9-e2c4-40ab-8fee-706d08118a88\") " pod="openshift-multus/network-metrics-daemon-cvfxv"
May 25 11:25:38.587223 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:25:38.587193    2545 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-brg2t\""
May 25 11:25:38.594606 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:25:38.594582    2545 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cvfxv"
May 25 11:25:38.719846 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:25:38.719822    2545 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-cvfxv"]
May 25 11:25:38.722666 ip-10-0-128-206 kubenswrapper[2545]: W0525 11:25:38.722625    2545 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3872d4b9_e2c4_40ab_8fee_706d08118a88.slice/crio-0ec56509586d0bba19c6253362dbac4492eba76b6dbf7587a0b68ba5fb1c6100 WatchSource:0}: Error finding container 0ec56509586d0bba19c6253362dbac4492eba76b6dbf7587a0b68ba5fb1c6100: Status 404 returned error can't find the container with id 0ec56509586d0bba19c6253362dbac4492eba76b6dbf7587a0b68ba5fb1c6100
May 25 11:25:39.303260 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:25:39.303220    2545 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-cvfxv" event={"ID":"3872d4b9-e2c4-40ab-8fee-706d08118a88","Type":"ContainerStarted","Data":"0ec56509586d0bba19c6253362dbac4492eba76b6dbf7587a0b68ba5fb1c6100"}
May 25 11:25:40.307024 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:25:40.306989    2545 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-cvfxv" event={"ID":"3872d4b9-e2c4-40ab-8fee-706d08118a88","Type":"ContainerStarted","Data":"b48c601b399b36129f052ff031864159692b25199a3335c52685306f4d11e8be"}
May 25 11:25:41.311028 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:25:41.310991    2545 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-cvfxv" event={"ID":"3872d4b9-e2c4-40ab-8fee-706d08118a88","Type":"ContainerStarted","Data":"f7335867c314fa2a8e30addface0d9afc99b6206b6371d1135f74e17a77ab9bb"}
May 25 11:25:41.331160 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:25:41.331110    2545 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-cvfxv" podStartSLOduration=130.992076874 podStartE2EDuration="2m12.33109481s" podCreationTimestamp="2026-05-25 11:23:29 +0000 UTC" firstStartedPulling="2026-05-25 11:25:38.724618165 +0000 UTC m=+130.490903089" lastFinishedPulling="2026-05-25 11:25:40.063636098 +0000 UTC m=+131.829921025" observedRunningTime="2026-05-25 11:25:41.328848391 +0000 UTC m=+133.095133359" watchObservedRunningTime="2026-05-25 11:25:41.33109481 +0000 UTC m=+133.097379756"
May 25 11:25:54.308059 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:25:54.308025    2545 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-78dd8f8c95-dz85t"
May 25 11:25:54.312056 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:25:54.312034    2545 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-78dd8f8c95-dz85t"
May 25 11:25:58.362129 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:25:58.362093    2545 generic.go:358] "Generic (PLEG): container finished" podID="516a1b71-e17b-4035-987c-116abe33a4f8" containerID="28e8b6915538d2df86fa20091ebd3842366ccfc0dbadac9a1a550dc69839b264" exitCode=0
May 25 11:25:58.362493 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:25:58.362141    2545 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-78bdfb888c-xd89p" event={"ID":"516a1b71-e17b-4035-987c-116abe33a4f8","Type":"ContainerDied","Data":"28e8b6915538d2df86fa20091ebd3842366ccfc0dbadac9a1a550dc69839b264"}
May 25 11:25:58.362493 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:25:58.362435    2545 scope.go:117] "RemoveContainer" containerID="28e8b6915538d2df86fa20091ebd3842366ccfc0dbadac9a1a550dc69839b264"
May 25 11:25:59.366469 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:25:59.366435    2545 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-78bdfb888c-xd89p" event={"ID":"516a1b71-e17b-4035-987c-116abe33a4f8","Type":"ContainerStarted","Data":"2e55bf31afeb9f3f1b829bafa14ecd3ab73b58a74cbac2678d4fd49d54d6e5f3"}
May 25 11:26:16.191274 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:26:16.191192    2545 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0"
May 25 11:26:16.209493 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:26:16.209462    2545 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0"
May 25 11:26:16.430821 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:26:16.430794    2545 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0"
May 25 11:26:34.234665 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:26:34.234629    2545 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
May 25 11:26:34.235102 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:26:34.235051    2545 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="6ce930cd-ee46-4495-9bfc-b326ded02436" containerName="prometheus" containerID="cri-o://27ddc99cc23629f47211a7e379e50ad5155bfe5e821ebeb842b1ba13a1de3b4c" gracePeriod=600
May 25 11:26:34.235192 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:26:34.235081    2545 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="6ce930cd-ee46-4495-9bfc-b326ded02436" containerName="kube-rbac-proxy" containerID="cri-o://49e3f78ba3681ba54f723234556a5b5a409110c111bf8212dc774c023a94a6e6" gracePeriod=600
May 25 11:26:34.235192 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:26:34.235113    2545 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="6ce930cd-ee46-4495-9bfc-b326ded02436" containerName="thanos-sidecar" containerID="cri-o://2c80b1cf5e35d0cf01154e992efbb88cb8fe94eaa11bfc487f38e772beffcdee" gracePeriod=600
May 25 11:26:34.235192 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:26:34.235134    2545 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="6ce930cd-ee46-4495-9bfc-b326ded02436" containerName="kube-rbac-proxy-web" containerID="cri-o://735b07ee353a99691a142ec1835e1c337c8c3f344b346444836d18503486bb10" gracePeriod=600
May 25 11:26:34.235192 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:26:34.235133    2545 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="6ce930cd-ee46-4495-9bfc-b326ded02436" containerName="config-reloader" containerID="cri-o://d356b1c9372d58cf9a70f2a7aabc32bfa4d4431ca1888391533c26c4f508bf99" gracePeriod=600
May 25 11:26:34.235389 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:26:34.235109    2545 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="6ce930cd-ee46-4495-9bfc-b326ded02436" containerName="kube-rbac-proxy-thanos" containerID="cri-o://31ff27f16f606207ac345d9848f1ae3cacabb6f0763802df2a5356b1c0606ff0" gracePeriod=600
May 25 11:26:34.470522 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:26:34.470494    2545 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
May 25 11:26:34.471132 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:26:34.471112    2545 generic.go:358] "Generic (PLEG): container finished" podID="6ce930cd-ee46-4495-9bfc-b326ded02436" containerID="31ff27f16f606207ac345d9848f1ae3cacabb6f0763802df2a5356b1c0606ff0" exitCode=0
May 25 11:26:34.471132 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:26:34.471132    2545 generic.go:358] "Generic (PLEG): container finished" podID="6ce930cd-ee46-4495-9bfc-b326ded02436" containerID="49e3f78ba3681ba54f723234556a5b5a409110c111bf8212dc774c023a94a6e6" exitCode=0
May 25 11:26:34.471239 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:26:34.471138    2545 generic.go:358] "Generic (PLEG): container finished" podID="6ce930cd-ee46-4495-9bfc-b326ded02436" containerID="735b07ee353a99691a142ec1835e1c337c8c3f344b346444836d18503486bb10" exitCode=0
May 25 11:26:34.471239 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:26:34.471144    2545 generic.go:358] "Generic (PLEG): container finished" podID="6ce930cd-ee46-4495-9bfc-b326ded02436" containerID="2c80b1cf5e35d0cf01154e992efbb88cb8fe94eaa11bfc487f38e772beffcdee" exitCode=0
May 25 11:26:34.471239 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:26:34.471151    2545 generic.go:358] "Generic (PLEG): container finished" podID="6ce930cd-ee46-4495-9bfc-b326ded02436" containerID="d356b1c9372d58cf9a70f2a7aabc32bfa4d4431ca1888391533c26c4f508bf99" exitCode=0
May 25 11:26:34.471239 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:26:34.471159    2545 generic.go:358] "Generic (PLEG): container finished" podID="6ce930cd-ee46-4495-9bfc-b326ded02436" containerID="27ddc99cc23629f47211a7e379e50ad5155bfe5e821ebeb842b1ba13a1de3b4c" exitCode=0
May 25 11:26:34.471239 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:26:34.471182    2545 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"6ce930cd-ee46-4495-9bfc-b326ded02436","Type":"ContainerDied","Data":"31ff27f16f606207ac345d9848f1ae3cacabb6f0763802df2a5356b1c0606ff0"}
May 25 11:26:34.471239 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:26:34.471221    2545 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"6ce930cd-ee46-4495-9bfc-b326ded02436","Type":"ContainerDied","Data":"49e3f78ba3681ba54f723234556a5b5a409110c111bf8212dc774c023a94a6e6"}
May 25 11:26:34.471239 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:26:34.471233    2545 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"6ce930cd-ee46-4495-9bfc-b326ded02436","Type":"ContainerDied","Data":"735b07ee353a99691a142ec1835e1c337c8c3f344b346444836d18503486bb10"}
May 25 11:26:34.471239 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:26:34.471242    2545 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"6ce930cd-ee46-4495-9bfc-b326ded02436","Type":"ContainerDied","Data":"2c80b1cf5e35d0cf01154e992efbb88cb8fe94eaa11bfc487f38e772beffcdee"}
May 25 11:26:34.471490 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:26:34.471253    2545 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"6ce930cd-ee46-4495-9bfc-b326ded02436","Type":"ContainerDied","Data":"d356b1c9372d58cf9a70f2a7aabc32bfa4d4431ca1888391533c26c4f508bf99"}
May 25 11:26:34.471490 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:26:34.471263    2545 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"6ce930cd-ee46-4495-9bfc-b326ded02436","Type":"ContainerDied","Data":"27ddc99cc23629f47211a7e379e50ad5155bfe5e821ebeb842b1ba13a1de3b4c"}
May 25 11:26:34.471490 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:26:34.471276    2545 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"6ce930cd-ee46-4495-9bfc-b326ded02436","Type":"ContainerDied","Data":"dc242d7f0bdb5e943f463d8169c30a484b8f9c6ea81f225e408b9299fec139cf"}
May 25 11:26:34.471490 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:26:34.471285    2545 scope.go:117] "RemoveContainer" containerID="31ff27f16f606207ac345d9848f1ae3cacabb6f0763802df2a5356b1c0606ff0"
May 25 11:26:34.478685 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:26:34.478672    2545 scope.go:117] "RemoveContainer" containerID="49e3f78ba3681ba54f723234556a5b5a409110c111bf8212dc774c023a94a6e6"
May 25 11:26:34.486499 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:26:34.486470    2545 scope.go:117] "RemoveContainer" containerID="735b07ee353a99691a142ec1835e1c337c8c3f344b346444836d18503486bb10"
May 25 11:26:34.493098 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:26:34.493082    2545 scope.go:117] "RemoveContainer" containerID="2c80b1cf5e35d0cf01154e992efbb88cb8fe94eaa11bfc487f38e772beffcdee"
May 25 11:26:34.499539 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:26:34.499522    2545 scope.go:117] "RemoveContainer" containerID="d356b1c9372d58cf9a70f2a7aabc32bfa4d4431ca1888391533c26c4f508bf99"
May 25 11:26:34.505357 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:26:34.505341    2545 scope.go:117] "RemoveContainer" containerID="27ddc99cc23629f47211a7e379e50ad5155bfe5e821ebeb842b1ba13a1de3b4c"
May 25 11:26:34.512868 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:26:34.512834    2545 scope.go:117] "RemoveContainer" containerID="9c528e59f2d8fe5a69c0f022e898e003743212c1443af2bc56cccb71c59c6813"
May 25 11:26:34.520147 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:26:34.520009    2545 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6ce930cd-ee46-4495-9bfc-b326ded02436-configmap-kubelet-serving-ca-bundle\") pod \"6ce930cd-ee46-4495-9bfc-b326ded02436\" (UID: \"6ce930cd-ee46-4495-9bfc-b326ded02436\") "
May 25 11:26:34.520147 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:26:34.520051    2545 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/6ce930cd-ee46-4495-9bfc-b326ded02436-prometheus-k8s-rulefiles-0\") pod \"6ce930cd-ee46-4495-9bfc-b326ded02436\" (UID: \"6ce930cd-ee46-4495-9bfc-b326ded02436\") "
May 25 11:26:34.520147 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:26:34.520094    2545 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6ce930cd-ee46-4495-9bfc-b326ded02436-configmap-serving-certs-ca-bundle\") pod \"6ce930cd-ee46-4495-9bfc-b326ded02436\" (UID: \"6ce930cd-ee46-4495-9bfc-b326ded02436\") "
May 25 11:26:34.520147 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:26:34.520101    2545 scope.go:117] "RemoveContainer" containerID="31ff27f16f606207ac345d9848f1ae3cacabb6f0763802df2a5356b1c0606ff0"
May 25 11:26:34.520147 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:26:34.520119    2545 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/6ce930cd-ee46-4495-9bfc-b326ded02436-secret-grpc-tls\") pod \"6ce930cd-ee46-4495-9bfc-b326ded02436\" (UID: \"6ce930cd-ee46-4495-9bfc-b326ded02436\") "
May 25 11:26:34.520361 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:26:34.520157    2545 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6ce930cd-ee46-4495-9bfc-b326ded02436-configmap-metrics-client-ca\") pod \"6ce930cd-ee46-4495-9bfc-b326ded02436\" (UID: \"6ce930cd-ee46-4495-9bfc-b326ded02436\") "
May 25 11:26:34.520361 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:26:34.520184    2545 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6ce930cd-ee46-4495-9bfc-b326ded02436-prometheus-trusted-ca-bundle\") pod \"6ce930cd-ee46-4495-9bfc-b326ded02436\" (UID: \"6ce930cd-ee46-4495-9bfc-b326ded02436\") "
May 25 11:26:34.520361 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:26:34.520209    2545 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vg6wt\" (UniqueName: \"kubernetes.io/projected/6ce930cd-ee46-4495-9bfc-b326ded02436-kube-api-access-vg6wt\") pod \"6ce930cd-ee46-4495-9bfc-b326ded02436\" (UID: \"6ce930cd-ee46-4495-9bfc-b326ded02436\") "
May 25 11:26:34.520361 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:26:34.520250    2545 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/6ce930cd-ee46-4495-9bfc-b326ded02436-secret-prometheus-k8s-tls\") pod \"6ce930cd-ee46-4495-9bfc-b326ded02436\" (UID: \"6ce930cd-ee46-4495-9bfc-b326ded02436\") "
May 25 11:26:34.520361 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:26:34.520276    2545 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/6ce930cd-ee46-4495-9bfc-b326ded02436-config\") pod \"6ce930cd-ee46-4495-9bfc-b326ded02436\" (UID: \"6ce930cd-ee46-4495-9bfc-b326ded02436\") "
May 25 11:26:34.520361 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:26:34.520304    2545 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/6ce930cd-ee46-4495-9bfc-b326ded02436-secret-metrics-client-certs\") pod \"6ce930cd-ee46-4495-9bfc-b326ded02436\" (UID: \"6ce930cd-ee46-4495-9bfc-b326ded02436\") "
May 25 11:26:34.520361 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:26:34.520330    2545 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/6ce930cd-ee46-4495-9bfc-b326ded02436-secret-kube-rbac-proxy\") pod \"6ce930cd-ee46-4495-9bfc-b326ded02436\" (UID: \"6ce930cd-ee46-4495-9bfc-b326ded02436\") "
May 25 11:26:34.520361 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:26:34.520361    2545 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/6ce930cd-ee46-4495-9bfc-b326ded02436-config-out\") pod \"6ce930cd-ee46-4495-9bfc-b326ded02436\" (UID: \"6ce930cd-ee46-4495-9bfc-b326ded02436\") "
May 25 11:26:34.520659 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:26:34.520388    2545 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/6ce930cd-ee46-4495-9bfc-b326ded02436-prometheus-k8s-db\") pod \"6ce930cd-ee46-4495-9bfc-b326ded02436\" (UID: \"6ce930cd-ee46-4495-9bfc-b326ded02436\") "
May 25 11:26:34.520659 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:26:34.520422    2545 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/6ce930cd-ee46-4495-9bfc-b326ded02436-tls-assets\") pod \"6ce930cd-ee46-4495-9bfc-b326ded02436\" (UID: \"6ce930cd-ee46-4495-9bfc-b326ded02436\") "
May 25 11:26:34.520659 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:26:34.520446    2545 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/6ce930cd-ee46-4495-9bfc-b326ded02436-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"6ce930cd-ee46-4495-9bfc-b326ded02436\" (UID: \"6ce930cd-ee46-4495-9bfc-b326ded02436\") "
May 25 11:26:34.520659 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:26:34.520474    2545 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/6ce930cd-ee46-4495-9bfc-b326ded02436-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"6ce930cd-ee46-4495-9bfc-b326ded02436\" (UID: \"6ce930cd-ee46-4495-9bfc-b326ded02436\") "
May 25 11:26:34.520659 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:26:34.520504    2545 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/6ce930cd-ee46-4495-9bfc-b326ded02436-thanos-prometheus-http-client-file\") pod \"6ce930cd-ee46-4495-9bfc-b326ded02436\" (UID: \"6ce930cd-ee46-4495-9bfc-b326ded02436\") "
May 25 11:26:34.520659 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:26:34.520500    2545 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6ce930cd-ee46-4495-9bfc-b326ded02436-configmap-serving-certs-ca-bundle" (OuterVolumeSpecName: "configmap-serving-certs-ca-bundle") pod "6ce930cd-ee46-4495-9bfc-b326ded02436" (UID: "6ce930cd-ee46-4495-9bfc-b326ded02436"). InnerVolumeSpecName "configmap-serving-certs-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 25 11:26:34.520659 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:26:34.520500    2545 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6ce930cd-ee46-4495-9bfc-b326ded02436-configmap-kubelet-serving-ca-bundle" (OuterVolumeSpecName: "configmap-kubelet-serving-ca-bundle") pod "6ce930cd-ee46-4495-9bfc-b326ded02436" (UID: "6ce930cd-ee46-4495-9bfc-b326ded02436"). InnerVolumeSpecName "configmap-kubelet-serving-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 25 11:26:34.520659 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:26:34.520531    2545 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/6ce930cd-ee46-4495-9bfc-b326ded02436-web-config\") pod \"6ce930cd-ee46-4495-9bfc-b326ded02436\" (UID: \"6ce930cd-ee46-4495-9bfc-b326ded02436\") "
May 25 11:26:34.521071 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:26:34.520782    2545 reconciler_common.go:299] "Volume detached for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6ce930cd-ee46-4495-9bfc-b326ded02436-configmap-serving-certs-ca-bundle\") on node \"ip-10-0-128-206.ec2.internal\" DevicePath \"\""
May 25 11:26:34.521071 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:26:34.520803    2545 reconciler_common.go:299] "Volume detached for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6ce930cd-ee46-4495-9bfc-b326ded02436-configmap-kubelet-serving-ca-bundle\") on node \"ip-10-0-128-206.ec2.internal\" DevicePath \"\""
May 25 11:26:34.522231 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:26:34.522202    2545 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6ce930cd-ee46-4495-9bfc-b326ded02436-prometheus-trusted-ca-bundle" (OuterVolumeSpecName: "prometheus-trusted-ca-bundle") pod "6ce930cd-ee46-4495-9bfc-b326ded02436" (UID: "6ce930cd-ee46-4495-9bfc-b326ded02436"). InnerVolumeSpecName "prometheus-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 25 11:26:34.522332 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:26:34.522274    2545 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6ce930cd-ee46-4495-9bfc-b326ded02436-prometheus-k8s-rulefiles-0" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-0") pod "6ce930cd-ee46-4495-9bfc-b326ded02436" (UID: "6ce930cd-ee46-4495-9bfc-b326ded02436"). InnerVolumeSpecName "prometheus-k8s-rulefiles-0". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 25 11:26:34.522397 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:26:34.522370    2545 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6ce930cd-ee46-4495-9bfc-b326ded02436-configmap-metrics-client-ca" (OuterVolumeSpecName: "configmap-metrics-client-ca") pod "6ce930cd-ee46-4495-9bfc-b326ded02436" (UID: "6ce930cd-ee46-4495-9bfc-b326ded02436"). InnerVolumeSpecName "configmap-metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 25 11:26:34.523046 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:26:34.523015    2545 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6ce930cd-ee46-4495-9bfc-b326ded02436-secret-grpc-tls" (OuterVolumeSpecName: "secret-grpc-tls") pod "6ce930cd-ee46-4495-9bfc-b326ded02436" (UID: "6ce930cd-ee46-4495-9bfc-b326ded02436"). InnerVolumeSpecName "secret-grpc-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 25 11:26:34.523136 ip-10-0-128-206 kubenswrapper[2545]: E0525 11:26:34.523033    2545 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"31ff27f16f606207ac345d9848f1ae3cacabb6f0763802df2a5356b1c0606ff0\": container with ID starting with 31ff27f16f606207ac345d9848f1ae3cacabb6f0763802df2a5356b1c0606ff0 not found: ID does not exist" containerID="31ff27f16f606207ac345d9848f1ae3cacabb6f0763802df2a5356b1c0606ff0"
May 25 11:26:34.523136 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:26:34.523076    2545 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"31ff27f16f606207ac345d9848f1ae3cacabb6f0763802df2a5356b1c0606ff0"} err="failed to get container status \"31ff27f16f606207ac345d9848f1ae3cacabb6f0763802df2a5356b1c0606ff0\": rpc error: code = NotFound desc = could not find container \"31ff27f16f606207ac345d9848f1ae3cacabb6f0763802df2a5356b1c0606ff0\": container with ID starting with 31ff27f16f606207ac345d9848f1ae3cacabb6f0763802df2a5356b1c0606ff0 not found: ID does not exist"
May 25 11:26:34.523136 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:26:34.523103    2545 scope.go:117] "RemoveContainer" containerID="49e3f78ba3681ba54f723234556a5b5a409110c111bf8212dc774c023a94a6e6"
May 25 11:26:34.523445 ip-10-0-128-206 kubenswrapper[2545]: E0525 11:26:34.523425    2545 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"49e3f78ba3681ba54f723234556a5b5a409110c111bf8212dc774c023a94a6e6\": container with ID starting with 49e3f78ba3681ba54f723234556a5b5a409110c111bf8212dc774c023a94a6e6 not found: ID does not exist" containerID="49e3f78ba3681ba54f723234556a5b5a409110c111bf8212dc774c023a94a6e6"
May 25 11:26:34.523521 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:26:34.523453    2545 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"49e3f78ba3681ba54f723234556a5b5a409110c111bf8212dc774c023a94a6e6"} err="failed to get container status \"49e3f78ba3681ba54f723234556a5b5a409110c111bf8212dc774c023a94a6e6\": rpc error: code = NotFound desc = could not find container \"49e3f78ba3681ba54f723234556a5b5a409110c111bf8212dc774c023a94a6e6\": container with ID starting with 49e3f78ba3681ba54f723234556a5b5a409110c111bf8212dc774c023a94a6e6 not found: ID does not exist"
May 25 11:26:34.523521 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:26:34.523473    2545 scope.go:117] "RemoveContainer" containerID="735b07ee353a99691a142ec1835e1c337c8c3f344b346444836d18503486bb10"
May 25 11:26:34.523627 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:26:34.523583    2545 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6ce930cd-ee46-4495-9bfc-b326ded02436-secret-metrics-client-certs" (OuterVolumeSpecName: "secret-metrics-client-certs") pod "6ce930cd-ee46-4495-9bfc-b326ded02436" (UID: "6ce930cd-ee46-4495-9bfc-b326ded02436"). InnerVolumeSpecName "secret-metrics-client-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 25 11:26:34.523703 ip-10-0-128-206 kubenswrapper[2545]: E0525 11:26:34.523674    2545 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"735b07ee353a99691a142ec1835e1c337c8c3f344b346444836d18503486bb10\": container with ID starting with 735b07ee353a99691a142ec1835e1c337c8c3f344b346444836d18503486bb10 not found: ID does not exist" containerID="735b07ee353a99691a142ec1835e1c337c8c3f344b346444836d18503486bb10"
May 25 11:26:34.523808 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:26:34.523711    2545 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"735b07ee353a99691a142ec1835e1c337c8c3f344b346444836d18503486bb10"} err="failed to get container status \"735b07ee353a99691a142ec1835e1c337c8c3f344b346444836d18503486bb10\": rpc error: code = NotFound desc = could not find container \"735b07ee353a99691a142ec1835e1c337c8c3f344b346444836d18503486bb10\": container with ID starting with 735b07ee353a99691a142ec1835e1c337c8c3f344b346444836d18503486bb10 not found: ID does not exist"
May 25 11:26:34.523808 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:26:34.523731    2545 scope.go:117] "RemoveContainer" containerID="2c80b1cf5e35d0cf01154e992efbb88cb8fe94eaa11bfc487f38e772beffcdee"
May 25 11:26:34.523982 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:26:34.523941    2545 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6ce930cd-ee46-4495-9bfc-b326ded02436-prometheus-k8s-db" (OuterVolumeSpecName: "prometheus-k8s-db") pod "6ce930cd-ee46-4495-9bfc-b326ded02436" (UID: "6ce930cd-ee46-4495-9bfc-b326ded02436"). InnerVolumeSpecName "prometheus-k8s-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 25 11:26:34.524110 ip-10-0-128-206 kubenswrapper[2545]: E0525 11:26:34.523938    2545 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2c80b1cf5e35d0cf01154e992efbb88cb8fe94eaa11bfc487f38e772beffcdee\": container with ID starting with 2c80b1cf5e35d0cf01154e992efbb88cb8fe94eaa11bfc487f38e772beffcdee not found: ID does not exist" containerID="2c80b1cf5e35d0cf01154e992efbb88cb8fe94eaa11bfc487f38e772beffcdee"
May 25 11:26:34.524176 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:26:34.524131    2545 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2c80b1cf5e35d0cf01154e992efbb88cb8fe94eaa11bfc487f38e772beffcdee"} err="failed to get container status \"2c80b1cf5e35d0cf01154e992efbb88cb8fe94eaa11bfc487f38e772beffcdee\": rpc error: code = NotFound desc = could not find container \"2c80b1cf5e35d0cf01154e992efbb88cb8fe94eaa11bfc487f38e772beffcdee\": container with ID starting with 2c80b1cf5e35d0cf01154e992efbb88cb8fe94eaa11bfc487f38e772beffcdee not found: ID does not exist"
May 25 11:26:34.524176 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:26:34.524154    2545 scope.go:117] "RemoveContainer" containerID="d356b1c9372d58cf9a70f2a7aabc32bfa4d4431ca1888391533c26c4f508bf99"
May 25 11:26:34.524645 ip-10-0-128-206 kubenswrapper[2545]: E0525 11:26:34.524618    2545 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d356b1c9372d58cf9a70f2a7aabc32bfa4d4431ca1888391533c26c4f508bf99\": container with ID starting with d356b1c9372d58cf9a70f2a7aabc32bfa4d4431ca1888391533c26c4f508bf99 not found: ID does not exist" containerID="d356b1c9372d58cf9a70f2a7aabc32bfa4d4431ca1888391533c26c4f508bf99"
May 25 11:26:34.524732 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:26:34.524703    2545 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d356b1c9372d58cf9a70f2a7aabc32bfa4d4431ca1888391533c26c4f508bf99"} err="failed to get container status \"d356b1c9372d58cf9a70f2a7aabc32bfa4d4431ca1888391533c26c4f508bf99\": rpc error: code = NotFound desc = could not find container \"d356b1c9372d58cf9a70f2a7aabc32bfa4d4431ca1888391533c26c4f508bf99\": container with ID starting with d356b1c9372d58cf9a70f2a7aabc32bfa4d4431ca1888391533c26c4f508bf99 not found: ID does not exist"
May 25 11:26:34.524732 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:26:34.524724    2545 scope.go:117] "RemoveContainer" containerID="27ddc99cc23629f47211a7e379e50ad5155bfe5e821ebeb842b1ba13a1de3b4c"
May 25 11:26:34.525144 ip-10-0-128-206 kubenswrapper[2545]: E0525 11:26:34.525021    2545 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"27ddc99cc23629f47211a7e379e50ad5155bfe5e821ebeb842b1ba13a1de3b4c\": container with ID starting with 27ddc99cc23629f47211a7e379e50ad5155bfe5e821ebeb842b1ba13a1de3b4c not found: ID does not exist" containerID="27ddc99cc23629f47211a7e379e50ad5155bfe5e821ebeb842b1ba13a1de3b4c"
May 25 11:26:34.525144 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:26:34.525057    2545 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"27ddc99cc23629f47211a7e379e50ad5155bfe5e821ebeb842b1ba13a1de3b4c"} err="failed to get container status \"27ddc99cc23629f47211a7e379e50ad5155bfe5e821ebeb842b1ba13a1de3b4c\": rpc error: code = NotFound desc = could not find container \"27ddc99cc23629f47211a7e379e50ad5155bfe5e821ebeb842b1ba13a1de3b4c\": container with ID starting with 27ddc99cc23629f47211a7e379e50ad5155bfe5e821ebeb842b1ba13a1de3b4c not found: ID does not exist"
May 25 11:26:34.525144 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:26:34.525080    2545 scope.go:117] "RemoveContainer" containerID="9c528e59f2d8fe5a69c0f022e898e003743212c1443af2bc56cccb71c59c6813"
May 25 11:26:34.525630 ip-10-0-128-206 kubenswrapper[2545]: E0525 11:26:34.525604    2545 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9c528e59f2d8fe5a69c0f022e898e003743212c1443af2bc56cccb71c59c6813\": container with ID starting with 9c528e59f2d8fe5a69c0f022e898e003743212c1443af2bc56cccb71c59c6813 not found: ID does not exist" containerID="9c528e59f2d8fe5a69c0f022e898e003743212c1443af2bc56cccb71c59c6813"
May 25 11:26:34.525726 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:26:34.525635    2545 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9c528e59f2d8fe5a69c0f022e898e003743212c1443af2bc56cccb71c59c6813"} err="failed to get container status \"9c528e59f2d8fe5a69c0f022e898e003743212c1443af2bc56cccb71c59c6813\": rpc error: code = NotFound desc = could not find container \"9c528e59f2d8fe5a69c0f022e898e003743212c1443af2bc56cccb71c59c6813\": container with ID starting with 9c528e59f2d8fe5a69c0f022e898e003743212c1443af2bc56cccb71c59c6813 not found: ID does not exist"
May 25 11:26:34.525726 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:26:34.525655    2545 scope.go:117] "RemoveContainer" containerID="31ff27f16f606207ac345d9848f1ae3cacabb6f0763802df2a5356b1c0606ff0"
May 25 11:26:34.525941 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:26:34.525896    2545 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"31ff27f16f606207ac345d9848f1ae3cacabb6f0763802df2a5356b1c0606ff0"} err="failed to get container status \"31ff27f16f606207ac345d9848f1ae3cacabb6f0763802df2a5356b1c0606ff0\": rpc error: code = NotFound desc = could not find container \"31ff27f16f606207ac345d9848f1ae3cacabb6f0763802df2a5356b1c0606ff0\": container with ID starting with 31ff27f16f606207ac345d9848f1ae3cacabb6f0763802df2a5356b1c0606ff0 not found: ID does not exist"
May 25 11:26:34.525941 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:26:34.525919    2545 scope.go:117] "RemoveContainer" containerID="49e3f78ba3681ba54f723234556a5b5a409110c111bf8212dc774c023a94a6e6"
May 25 11:26:34.526202 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:26:34.526177    2545 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"49e3f78ba3681ba54f723234556a5b5a409110c111bf8212dc774c023a94a6e6"} err="failed to get container status \"49e3f78ba3681ba54f723234556a5b5a409110c111bf8212dc774c023a94a6e6\": rpc error: code = NotFound desc = could not find container \"49e3f78ba3681ba54f723234556a5b5a409110c111bf8212dc774c023a94a6e6\": container with ID starting with 49e3f78ba3681ba54f723234556a5b5a409110c111bf8212dc774c023a94a6e6 not found: ID does not exist"
May 25 11:26:34.526305 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:26:34.526203    2545 scope.go:117] "RemoveContainer" containerID="735b07ee353a99691a142ec1835e1c337c8c3f344b346444836d18503486bb10"
May 25 11:26:34.526483 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:26:34.526452    2545 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"735b07ee353a99691a142ec1835e1c337c8c3f344b346444836d18503486bb10"} err="failed to get container status \"735b07ee353a99691a142ec1835e1c337c8c3f344b346444836d18503486bb10\": rpc error: code = NotFound desc = could not find container \"735b07ee353a99691a142ec1835e1c337c8c3f344b346444836d18503486bb10\": container with ID starting with 735b07ee353a99691a142ec1835e1c337c8c3f344b346444836d18503486bb10 not found: ID does not exist"
May 25 11:26:34.526573 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:26:34.526485    2545 scope.go:117] "RemoveContainer" containerID="2c80b1cf5e35d0cf01154e992efbb88cb8fe94eaa11bfc487f38e772beffcdee"
May 25 11:26:34.526757 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:26:34.526723    2545 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6ce930cd-ee46-4495-9bfc-b326ded02436-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "6ce930cd-ee46-4495-9bfc-b326ded02436" (UID: "6ce930cd-ee46-4495-9bfc-b326ded02436"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 25 11:26:34.526757 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:26:34.526722    2545 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2c80b1cf5e35d0cf01154e992efbb88cb8fe94eaa11bfc487f38e772beffcdee"} err="failed to get container status \"2c80b1cf5e35d0cf01154e992efbb88cb8fe94eaa11bfc487f38e772beffcdee\": rpc error: code = NotFound desc = could not find container \"2c80b1cf5e35d0cf01154e992efbb88cb8fe94eaa11bfc487f38e772beffcdee\": container with ID starting with 2c80b1cf5e35d0cf01154e992efbb88cb8fe94eaa11bfc487f38e772beffcdee not found: ID does not exist"
May 25 11:26:34.526908 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:26:34.526759    2545 scope.go:117] "RemoveContainer" containerID="d356b1c9372d58cf9a70f2a7aabc32bfa4d4431ca1888391533c26c4f508bf99"
May 25 11:26:34.526987 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:26:34.526931    2545 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6ce930cd-ee46-4495-9bfc-b326ded02436-secret-prometheus-k8s-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-tls") pod "6ce930cd-ee46-4495-9bfc-b326ded02436" (UID: "6ce930cd-ee46-4495-9bfc-b326ded02436"). InnerVolumeSpecName "secret-prometheus-k8s-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 25 11:26:34.527089 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:26:34.527044    2545 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d356b1c9372d58cf9a70f2a7aabc32bfa4d4431ca1888391533c26c4f508bf99"} err="failed to get container status \"d356b1c9372d58cf9a70f2a7aabc32bfa4d4431ca1888391533c26c4f508bf99\": rpc error: code = NotFound desc = could not find container \"d356b1c9372d58cf9a70f2a7aabc32bfa4d4431ca1888391533c26c4f508bf99\": container with ID starting with d356b1c9372d58cf9a70f2a7aabc32bfa4d4431ca1888391533c26c4f508bf99 not found: ID does not exist"
May 25 11:26:34.527089 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:26:34.527073    2545 scope.go:117] "RemoveContainer" containerID="27ddc99cc23629f47211a7e379e50ad5155bfe5e821ebeb842b1ba13a1de3b4c"
May 25 11:26:34.527352 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:26:34.527314    2545 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"27ddc99cc23629f47211a7e379e50ad5155bfe5e821ebeb842b1ba13a1de3b4c"} err="failed to get container status \"27ddc99cc23629f47211a7e379e50ad5155bfe5e821ebeb842b1ba13a1de3b4c\": rpc error: code = NotFound desc = could not find container \"27ddc99cc23629f47211a7e379e50ad5155bfe5e821ebeb842b1ba13a1de3b4c\": container with ID starting with 27ddc99cc23629f47211a7e379e50ad5155bfe5e821ebeb842b1ba13a1de3b4c not found: ID does not exist"
May 25 11:26:34.527412 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:26:34.527359    2545 scope.go:117] "RemoveContainer" containerID="9c528e59f2d8fe5a69c0f022e898e003743212c1443af2bc56cccb71c59c6813"
May 25 11:26:34.527412 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:26:34.527328    2545 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6ce930cd-ee46-4495-9bfc-b326ded02436-kube-api-access-vg6wt" (OuterVolumeSpecName: "kube-api-access-vg6wt") pod "6ce930cd-ee46-4495-9bfc-b326ded02436" (UID: "6ce930cd-ee46-4495-9bfc-b326ded02436"). InnerVolumeSpecName "kube-api-access-vg6wt". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 25 11:26:34.527644 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:26:34.527622    2545 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9c528e59f2d8fe5a69c0f022e898e003743212c1443af2bc56cccb71c59c6813"} err="failed to get container status \"9c528e59f2d8fe5a69c0f022e898e003743212c1443af2bc56cccb71c59c6813\": rpc error: code = NotFound desc = could not find container \"9c528e59f2d8fe5a69c0f022e898e003743212c1443af2bc56cccb71c59c6813\": container with ID starting with 9c528e59f2d8fe5a69c0f022e898e003743212c1443af2bc56cccb71c59c6813 not found: ID does not exist"
May 25 11:26:34.527644 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:26:34.527644    2545 scope.go:117] "RemoveContainer" containerID="31ff27f16f606207ac345d9848f1ae3cacabb6f0763802df2a5356b1c0606ff0"
May 25 11:26:34.527885 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:26:34.527863    2545 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"31ff27f16f606207ac345d9848f1ae3cacabb6f0763802df2a5356b1c0606ff0"} err="failed to get container status \"31ff27f16f606207ac345d9848f1ae3cacabb6f0763802df2a5356b1c0606ff0\": rpc error: code = NotFound desc = could not find container \"31ff27f16f606207ac345d9848f1ae3cacabb6f0763802df2a5356b1c0606ff0\": container with ID starting with 31ff27f16f606207ac345d9848f1ae3cacabb6f0763802df2a5356b1c0606ff0 not found: ID does not exist"
May 25 11:26:34.527978 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:26:34.527888    2545 scope.go:117] "RemoveContainer" containerID="49e3f78ba3681ba54f723234556a5b5a409110c111bf8212dc774c023a94a6e6"
May 25 11:26:34.528307 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:26:34.528207    2545 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6ce930cd-ee46-4495-9bfc-b326ded02436-secret-kube-rbac-proxy" (OuterVolumeSpecName: "secret-kube-rbac-proxy") pod "6ce930cd-ee46-4495-9bfc-b326ded02436" (UID: "6ce930cd-ee46-4495-9bfc-b326ded02436"). InnerVolumeSpecName "secret-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 25 11:26:34.528307 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:26:34.528226    2545 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6ce930cd-ee46-4495-9bfc-b326ded02436-secret-prometheus-k8s-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-prometheus-k8s-kube-rbac-proxy-web") pod "6ce930cd-ee46-4495-9bfc-b326ded02436" (UID: "6ce930cd-ee46-4495-9bfc-b326ded02436"). InnerVolumeSpecName "secret-prometheus-k8s-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 25 11:26:34.528307 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:26:34.528235    2545 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6ce930cd-ee46-4495-9bfc-b326ded02436-config" (OuterVolumeSpecName: "config") pod "6ce930cd-ee46-4495-9bfc-b326ded02436" (UID: "6ce930cd-ee46-4495-9bfc-b326ded02436"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 25 11:26:34.528307 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:26:34.528262    2545 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6ce930cd-ee46-4495-9bfc-b326ded02436-secret-prometheus-k8s-thanos-sidecar-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-thanos-sidecar-tls") pod "6ce930cd-ee46-4495-9bfc-b326ded02436" (UID: "6ce930cd-ee46-4495-9bfc-b326ded02436"). InnerVolumeSpecName "secret-prometheus-k8s-thanos-sidecar-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 25 11:26:34.528307 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:26:34.528276    2545 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6ce930cd-ee46-4495-9bfc-b326ded02436-thanos-prometheus-http-client-file" (OuterVolumeSpecName: "thanos-prometheus-http-client-file") pod "6ce930cd-ee46-4495-9bfc-b326ded02436" (UID: "6ce930cd-ee46-4495-9bfc-b326ded02436"). InnerVolumeSpecName "thanos-prometheus-http-client-file". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 25 11:26:34.528307 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:26:34.528290    2545 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"49e3f78ba3681ba54f723234556a5b5a409110c111bf8212dc774c023a94a6e6"} err="failed to get container status \"49e3f78ba3681ba54f723234556a5b5a409110c111bf8212dc774c023a94a6e6\": rpc error: code = NotFound desc = could not find container \"49e3f78ba3681ba54f723234556a5b5a409110c111bf8212dc774c023a94a6e6\": container with ID starting with 49e3f78ba3681ba54f723234556a5b5a409110c111bf8212dc774c023a94a6e6 not found: ID does not exist"
May 25 11:26:34.528307 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:26:34.528310    2545 scope.go:117] "RemoveContainer" containerID="735b07ee353a99691a142ec1835e1c337c8c3f344b346444836d18503486bb10"
May 25 11:26:34.528702 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:26:34.528519    2545 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"735b07ee353a99691a142ec1835e1c337c8c3f344b346444836d18503486bb10"} err="failed to get container status \"735b07ee353a99691a142ec1835e1c337c8c3f344b346444836d18503486bb10\": rpc error: code = NotFound desc = could not find container \"735b07ee353a99691a142ec1835e1c337c8c3f344b346444836d18503486bb10\": container with ID starting with 735b07ee353a99691a142ec1835e1c337c8c3f344b346444836d18503486bb10 not found: ID does not exist"
May 25 11:26:34.528702 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:26:34.528538    2545 scope.go:117] "RemoveContainer" containerID="2c80b1cf5e35d0cf01154e992efbb88cb8fe94eaa11bfc487f38e772beffcdee"
May 25 11:26:34.528800 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:26:34.528752    2545 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2c80b1cf5e35d0cf01154e992efbb88cb8fe94eaa11bfc487f38e772beffcdee"} err="failed to get container status \"2c80b1cf5e35d0cf01154e992efbb88cb8fe94eaa11bfc487f38e772beffcdee\": rpc error: code = NotFound desc = could not find container \"2c80b1cf5e35d0cf01154e992efbb88cb8fe94eaa11bfc487f38e772beffcdee\": container with ID starting with 2c80b1cf5e35d0cf01154e992efbb88cb8fe94eaa11bfc487f38e772beffcdee not found: ID does not exist"
May 25 11:26:34.528800 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:26:34.528767    2545 scope.go:117] "RemoveContainer" containerID="d356b1c9372d58cf9a70f2a7aabc32bfa4d4431ca1888391533c26c4f508bf99"
May 25 11:26:34.529036 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:26:34.529004    2545 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d356b1c9372d58cf9a70f2a7aabc32bfa4d4431ca1888391533c26c4f508bf99"} err="failed to get container status \"d356b1c9372d58cf9a70f2a7aabc32bfa4d4431ca1888391533c26c4f508bf99\": rpc error: code = NotFound desc = could not find container \"d356b1c9372d58cf9a70f2a7aabc32bfa4d4431ca1888391533c26c4f508bf99\": container with ID starting with d356b1c9372d58cf9a70f2a7aabc32bfa4d4431ca1888391533c26c4f508bf99 not found: ID does not exist"
May 25 11:26:34.529036 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:26:34.529028    2545 scope.go:117] "RemoveContainer" containerID="27ddc99cc23629f47211a7e379e50ad5155bfe5e821ebeb842b1ba13a1de3b4c"
May 25 11:26:34.529272 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:26:34.529244    2545 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"27ddc99cc23629f47211a7e379e50ad5155bfe5e821ebeb842b1ba13a1de3b4c"} err="failed to get container status \"27ddc99cc23629f47211a7e379e50ad5155bfe5e821ebeb842b1ba13a1de3b4c\": rpc error: code = NotFound desc = could not find container \"27ddc99cc23629f47211a7e379e50ad5155bfe5e821ebeb842b1ba13a1de3b4c\": container with ID starting with 27ddc99cc23629f47211a7e379e50ad5155bfe5e821ebeb842b1ba13a1de3b4c not found: ID does not exist"
May 25 11:26:34.529327 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:26:34.529277    2545 scope.go:117] "RemoveContainer" containerID="9c528e59f2d8fe5a69c0f022e898e003743212c1443af2bc56cccb71c59c6813"
May 25 11:26:34.529513 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:26:34.529494    2545 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9c528e59f2d8fe5a69c0f022e898e003743212c1443af2bc56cccb71c59c6813"} err="failed to get container status \"9c528e59f2d8fe5a69c0f022e898e003743212c1443af2bc56cccb71c59c6813\": rpc error: code = NotFound desc = could not find container \"9c528e59f2d8fe5a69c0f022e898e003743212c1443af2bc56cccb71c59c6813\": container with ID starting with 9c528e59f2d8fe5a69c0f022e898e003743212c1443af2bc56cccb71c59c6813 not found: ID does not exist"
May 25 11:26:34.529585 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:26:34.529514    2545 scope.go:117] "RemoveContainer" containerID="31ff27f16f606207ac345d9848f1ae3cacabb6f0763802df2a5356b1c0606ff0"
May 25 11:26:34.529778 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:26:34.529747    2545 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"31ff27f16f606207ac345d9848f1ae3cacabb6f0763802df2a5356b1c0606ff0"} err="failed to get container status \"31ff27f16f606207ac345d9848f1ae3cacabb6f0763802df2a5356b1c0606ff0\": rpc error: code = NotFound desc = could not find container \"31ff27f16f606207ac345d9848f1ae3cacabb6f0763802df2a5356b1c0606ff0\": container with ID starting with 31ff27f16f606207ac345d9848f1ae3cacabb6f0763802df2a5356b1c0606ff0 not found: ID does not exist"
May 25 11:26:34.529844 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:26:34.529780    2545 scope.go:117] "RemoveContainer" containerID="49e3f78ba3681ba54f723234556a5b5a409110c111bf8212dc774c023a94a6e6"
May 25 11:26:34.529844 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:26:34.529828    2545 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6ce930cd-ee46-4495-9bfc-b326ded02436-config-out" (OuterVolumeSpecName: "config-out") pod "6ce930cd-ee46-4495-9bfc-b326ded02436" (UID: "6ce930cd-ee46-4495-9bfc-b326ded02436"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 25 11:26:34.530047 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:26:34.530018    2545 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"49e3f78ba3681ba54f723234556a5b5a409110c111bf8212dc774c023a94a6e6"} err="failed to get container status \"49e3f78ba3681ba54f723234556a5b5a409110c111bf8212dc774c023a94a6e6\": rpc error: code = NotFound desc = could not find container \"49e3f78ba3681ba54f723234556a5b5a409110c111bf8212dc774c023a94a6e6\": container with ID starting with 49e3f78ba3681ba54f723234556a5b5a409110c111bf8212dc774c023a94a6e6 not found: ID does not exist"
May 25 11:26:34.530168 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:26:34.530049    2545 scope.go:117] "RemoveContainer" containerID="735b07ee353a99691a142ec1835e1c337c8c3f344b346444836d18503486bb10"
May 25 11:26:34.530324 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:26:34.530306    2545 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"735b07ee353a99691a142ec1835e1c337c8c3f344b346444836d18503486bb10"} err="failed to get container status \"735b07ee353a99691a142ec1835e1c337c8c3f344b346444836d18503486bb10\": rpc error: code = NotFound desc = could not find container \"735b07ee353a99691a142ec1835e1c337c8c3f344b346444836d18503486bb10\": container with ID starting with 735b07ee353a99691a142ec1835e1c337c8c3f344b346444836d18503486bb10 not found: ID does not exist"
May 25 11:26:34.530324 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:26:34.530324    2545 scope.go:117] "RemoveContainer" containerID="2c80b1cf5e35d0cf01154e992efbb88cb8fe94eaa11bfc487f38e772beffcdee"
May 25 11:26:34.530581 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:26:34.530559    2545 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2c80b1cf5e35d0cf01154e992efbb88cb8fe94eaa11bfc487f38e772beffcdee"} err="failed to get container status \"2c80b1cf5e35d0cf01154e992efbb88cb8fe94eaa11bfc487f38e772beffcdee\": rpc error: code = NotFound desc = could not find container \"2c80b1cf5e35d0cf01154e992efbb88cb8fe94eaa11bfc487f38e772beffcdee\": container with ID starting with 2c80b1cf5e35d0cf01154e992efbb88cb8fe94eaa11bfc487f38e772beffcdee not found: ID does not exist"
May 25 11:26:34.530581 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:26:34.530583    2545 scope.go:117] "RemoveContainer" containerID="d356b1c9372d58cf9a70f2a7aabc32bfa4d4431ca1888391533c26c4f508bf99"
May 25 11:26:34.530826 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:26:34.530803    2545 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d356b1c9372d58cf9a70f2a7aabc32bfa4d4431ca1888391533c26c4f508bf99"} err="failed to get container status \"d356b1c9372d58cf9a70f2a7aabc32bfa4d4431ca1888391533c26c4f508bf99\": rpc error: code = NotFound desc = could not find container \"d356b1c9372d58cf9a70f2a7aabc32bfa4d4431ca1888391533c26c4f508bf99\": container with ID starting with d356b1c9372d58cf9a70f2a7aabc32bfa4d4431ca1888391533c26c4f508bf99 not found: ID does not exist"
May 25 11:26:34.530826 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:26:34.530825    2545 scope.go:117] "RemoveContainer" containerID="27ddc99cc23629f47211a7e379e50ad5155bfe5e821ebeb842b1ba13a1de3b4c"
May 25 11:26:34.531139 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:26:34.531113    2545 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"27ddc99cc23629f47211a7e379e50ad5155bfe5e821ebeb842b1ba13a1de3b4c"} err="failed to get container status \"27ddc99cc23629f47211a7e379e50ad5155bfe5e821ebeb842b1ba13a1de3b4c\": rpc error: code = NotFound desc = could not find container \"27ddc99cc23629f47211a7e379e50ad5155bfe5e821ebeb842b1ba13a1de3b4c\": container with ID starting with 27ddc99cc23629f47211a7e379e50ad5155bfe5e821ebeb842b1ba13a1de3b4c not found: ID does not exist"
May 25 11:26:34.531208 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:26:34.531140    2545 scope.go:117] "RemoveContainer" containerID="9c528e59f2d8fe5a69c0f022e898e003743212c1443af2bc56cccb71c59c6813"
May 25 11:26:34.531372 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:26:34.531348    2545 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9c528e59f2d8fe5a69c0f022e898e003743212c1443af2bc56cccb71c59c6813"} err="failed to get container status \"9c528e59f2d8fe5a69c0f022e898e003743212c1443af2bc56cccb71c59c6813\": rpc error: code = NotFound desc = could not find container \"9c528e59f2d8fe5a69c0f022e898e003743212c1443af2bc56cccb71c59c6813\": container with ID starting with 9c528e59f2d8fe5a69c0f022e898e003743212c1443af2bc56cccb71c59c6813 not found: ID does not exist"
May 25 11:26:34.531436 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:26:34.531375    2545 scope.go:117] "RemoveContainer" containerID="31ff27f16f606207ac345d9848f1ae3cacabb6f0763802df2a5356b1c0606ff0"
May 25 11:26:34.531651 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:26:34.531623    2545 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"31ff27f16f606207ac345d9848f1ae3cacabb6f0763802df2a5356b1c0606ff0"} err="failed to get container status \"31ff27f16f606207ac345d9848f1ae3cacabb6f0763802df2a5356b1c0606ff0\": rpc error: code = NotFound desc = could not find container \"31ff27f16f606207ac345d9848f1ae3cacabb6f0763802df2a5356b1c0606ff0\": container with ID starting with 31ff27f16f606207ac345d9848f1ae3cacabb6f0763802df2a5356b1c0606ff0 not found: ID does not exist"
May 25 11:26:34.531731 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:26:34.531652    2545 scope.go:117] "RemoveContainer" containerID="49e3f78ba3681ba54f723234556a5b5a409110c111bf8212dc774c023a94a6e6"
May 25 11:26:34.531929 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:26:34.531907    2545 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"49e3f78ba3681ba54f723234556a5b5a409110c111bf8212dc774c023a94a6e6"} err="failed to get container status \"49e3f78ba3681ba54f723234556a5b5a409110c111bf8212dc774c023a94a6e6\": rpc error: code = NotFound desc = could not find container \"49e3f78ba3681ba54f723234556a5b5a409110c111bf8212dc774c023a94a6e6\": container with ID starting with 49e3f78ba3681ba54f723234556a5b5a409110c111bf8212dc774c023a94a6e6 not found: ID does not exist"
May 25 11:26:34.532002 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:26:34.531931    2545 scope.go:117] "RemoveContainer" containerID="735b07ee353a99691a142ec1835e1c337c8c3f344b346444836d18503486bb10"
May 25 11:26:34.532213 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:26:34.532194    2545 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"735b07ee353a99691a142ec1835e1c337c8c3f344b346444836d18503486bb10"} err="failed to get container status \"735b07ee353a99691a142ec1835e1c337c8c3f344b346444836d18503486bb10\": rpc error: code = NotFound desc = could not find container \"735b07ee353a99691a142ec1835e1c337c8c3f344b346444836d18503486bb10\": container with ID starting with 735b07ee353a99691a142ec1835e1c337c8c3f344b346444836d18503486bb10 not found: ID does not exist"
May 25 11:26:34.532270 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:26:34.532214    2545 scope.go:117] "RemoveContainer" containerID="2c80b1cf5e35d0cf01154e992efbb88cb8fe94eaa11bfc487f38e772beffcdee"
May 25 11:26:34.532464 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:26:34.532436    2545 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2c80b1cf5e35d0cf01154e992efbb88cb8fe94eaa11bfc487f38e772beffcdee"} err="failed to get container status \"2c80b1cf5e35d0cf01154e992efbb88cb8fe94eaa11bfc487f38e772beffcdee\": rpc error: code = NotFound desc = could not find container \"2c80b1cf5e35d0cf01154e992efbb88cb8fe94eaa11bfc487f38e772beffcdee\": container with ID starting with 2c80b1cf5e35d0cf01154e992efbb88cb8fe94eaa11bfc487f38e772beffcdee not found: ID does not exist"
May 25 11:26:34.532464 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:26:34.532456    2545 scope.go:117] "RemoveContainer" containerID="d356b1c9372d58cf9a70f2a7aabc32bfa4d4431ca1888391533c26c4f508bf99"
May 25 11:26:34.532692 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:26:34.532662    2545 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d356b1c9372d58cf9a70f2a7aabc32bfa4d4431ca1888391533c26c4f508bf99"} err="failed to get container status \"d356b1c9372d58cf9a70f2a7aabc32bfa4d4431ca1888391533c26c4f508bf99\": rpc error: code = NotFound desc = could not find container \"d356b1c9372d58cf9a70f2a7aabc32bfa4d4431ca1888391533c26c4f508bf99\": container with ID starting with d356b1c9372d58cf9a70f2a7aabc32bfa4d4431ca1888391533c26c4f508bf99 not found: ID does not exist"
May 25 11:26:34.532762 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:26:34.532693    2545 scope.go:117] "RemoveContainer" containerID="27ddc99cc23629f47211a7e379e50ad5155bfe5e821ebeb842b1ba13a1de3b4c"
May 25 11:26:34.532977 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:26:34.532935    2545 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"27ddc99cc23629f47211a7e379e50ad5155bfe5e821ebeb842b1ba13a1de3b4c"} err="failed to get container status \"27ddc99cc23629f47211a7e379e50ad5155bfe5e821ebeb842b1ba13a1de3b4c\": rpc error: code = NotFound desc = could not find container \"27ddc99cc23629f47211a7e379e50ad5155bfe5e821ebeb842b1ba13a1de3b4c\": container with ID starting with 27ddc99cc23629f47211a7e379e50ad5155bfe5e821ebeb842b1ba13a1de3b4c not found: ID does not exist"
May 25 11:26:34.532977 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:26:34.532977    2545 scope.go:117] "RemoveContainer" containerID="9c528e59f2d8fe5a69c0f022e898e003743212c1443af2bc56cccb71c59c6813"
May 25 11:26:34.533219 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:26:34.533196    2545 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9c528e59f2d8fe5a69c0f022e898e003743212c1443af2bc56cccb71c59c6813"} err="failed to get container status \"9c528e59f2d8fe5a69c0f022e898e003743212c1443af2bc56cccb71c59c6813\": rpc error: code = NotFound desc = could not find container \"9c528e59f2d8fe5a69c0f022e898e003743212c1443af2bc56cccb71c59c6813\": container with ID starting with 9c528e59f2d8fe5a69c0f022e898e003743212c1443af2bc56cccb71c59c6813 not found: ID does not exist"
May 25 11:26:34.533286 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:26:34.533222    2545 scope.go:117] "RemoveContainer" containerID="31ff27f16f606207ac345d9848f1ae3cacabb6f0763802df2a5356b1c0606ff0"
May 25 11:26:34.533477 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:26:34.533458    2545 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"31ff27f16f606207ac345d9848f1ae3cacabb6f0763802df2a5356b1c0606ff0"} err="failed to get container status \"31ff27f16f606207ac345d9848f1ae3cacabb6f0763802df2a5356b1c0606ff0\": rpc error: code = NotFound desc = could not find container \"31ff27f16f606207ac345d9848f1ae3cacabb6f0763802df2a5356b1c0606ff0\": container with ID starting with 31ff27f16f606207ac345d9848f1ae3cacabb6f0763802df2a5356b1c0606ff0 not found: ID does not exist"
May 25 11:26:34.533552 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:26:34.533477    2545 scope.go:117] "RemoveContainer" containerID="49e3f78ba3681ba54f723234556a5b5a409110c111bf8212dc774c023a94a6e6"
May 25 11:26:34.533718 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:26:34.533702    2545 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"49e3f78ba3681ba54f723234556a5b5a409110c111bf8212dc774c023a94a6e6"} err="failed to get container status \"49e3f78ba3681ba54f723234556a5b5a409110c111bf8212dc774c023a94a6e6\": rpc error: code = NotFound desc = could not find container \"49e3f78ba3681ba54f723234556a5b5a409110c111bf8212dc774c023a94a6e6\": container with ID starting with 49e3f78ba3681ba54f723234556a5b5a409110c111bf8212dc774c023a94a6e6 not found: ID does not exist"
May 25 11:26:34.533782 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:26:34.533719    2545 scope.go:117] "RemoveContainer" containerID="735b07ee353a99691a142ec1835e1c337c8c3f344b346444836d18503486bb10"
May 25 11:26:34.533972 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:26:34.533937    2545 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"735b07ee353a99691a142ec1835e1c337c8c3f344b346444836d18503486bb10"} err="failed to get container status \"735b07ee353a99691a142ec1835e1c337c8c3f344b346444836d18503486bb10\": rpc error: code = NotFound desc = could not find container \"735b07ee353a99691a142ec1835e1c337c8c3f344b346444836d18503486bb10\": container with ID starting with 735b07ee353a99691a142ec1835e1c337c8c3f344b346444836d18503486bb10 not found: ID does not exist"
May 25 11:26:34.534044 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:26:34.533971    2545 scope.go:117] "RemoveContainer" containerID="2c80b1cf5e35d0cf01154e992efbb88cb8fe94eaa11bfc487f38e772beffcdee"
May 25 11:26:34.534228 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:26:34.534191    2545 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2c80b1cf5e35d0cf01154e992efbb88cb8fe94eaa11bfc487f38e772beffcdee"} err="failed to get container status \"2c80b1cf5e35d0cf01154e992efbb88cb8fe94eaa11bfc487f38e772beffcdee\": rpc error: code = NotFound desc = could not find container \"2c80b1cf5e35d0cf01154e992efbb88cb8fe94eaa11bfc487f38e772beffcdee\": container with ID starting with 2c80b1cf5e35d0cf01154e992efbb88cb8fe94eaa11bfc487f38e772beffcdee not found: ID does not exist"
May 25 11:26:34.534228 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:26:34.534218    2545 scope.go:117] "RemoveContainer" containerID="d356b1c9372d58cf9a70f2a7aabc32bfa4d4431ca1888391533c26c4f508bf99"
May 25 11:26:34.534513 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:26:34.534496    2545 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d356b1c9372d58cf9a70f2a7aabc32bfa4d4431ca1888391533c26c4f508bf99"} err="failed to get container status \"d356b1c9372d58cf9a70f2a7aabc32bfa4d4431ca1888391533c26c4f508bf99\": rpc error: code = NotFound desc = could not find container \"d356b1c9372d58cf9a70f2a7aabc32bfa4d4431ca1888391533c26c4f508bf99\": container with ID starting with d356b1c9372d58cf9a70f2a7aabc32bfa4d4431ca1888391533c26c4f508bf99 not found: ID does not exist"
May 25 11:26:34.534556 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:26:34.534515    2545 scope.go:117] "RemoveContainer" containerID="27ddc99cc23629f47211a7e379e50ad5155bfe5e821ebeb842b1ba13a1de3b4c"
May 25 11:26:34.534768 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:26:34.534747    2545 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"27ddc99cc23629f47211a7e379e50ad5155bfe5e821ebeb842b1ba13a1de3b4c"} err="failed to get container status \"27ddc99cc23629f47211a7e379e50ad5155bfe5e821ebeb842b1ba13a1de3b4c\": rpc error: code = NotFound desc = could not find container \"27ddc99cc23629f47211a7e379e50ad5155bfe5e821ebeb842b1ba13a1de3b4c\": container with ID starting with 27ddc99cc23629f47211a7e379e50ad5155bfe5e821ebeb842b1ba13a1de3b4c not found: ID does not exist"
May 25 11:26:34.534768 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:26:34.534768    2545 scope.go:117] "RemoveContainer" containerID="9c528e59f2d8fe5a69c0f022e898e003743212c1443af2bc56cccb71c59c6813"
May 25 11:26:34.535029 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:26:34.534997    2545 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9c528e59f2d8fe5a69c0f022e898e003743212c1443af2bc56cccb71c59c6813"} err="failed to get container status \"9c528e59f2d8fe5a69c0f022e898e003743212c1443af2bc56cccb71c59c6813\": rpc error: code = NotFound desc = could not find container \"9c528e59f2d8fe5a69c0f022e898e003743212c1443af2bc56cccb71c59c6813\": container with ID starting with 9c528e59f2d8fe5a69c0f022e898e003743212c1443af2bc56cccb71c59c6813 not found: ID does not exist"
May 25 11:26:34.539303 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:26:34.539281    2545 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6ce930cd-ee46-4495-9bfc-b326ded02436-web-config" (OuterVolumeSpecName: "web-config") pod "6ce930cd-ee46-4495-9bfc-b326ded02436" (UID: "6ce930cd-ee46-4495-9bfc-b326ded02436"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 25 11:26:34.621595 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:26:34.621562    2545 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/6ce930cd-ee46-4495-9bfc-b326ded02436-tls-assets\") on node \"ip-10-0-128-206.ec2.internal\" DevicePath \"\""
May 25 11:26:34.621595 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:26:34.621591    2545 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/6ce930cd-ee46-4495-9bfc-b326ded02436-secret-prometheus-k8s-thanos-sidecar-tls\") on node \"ip-10-0-128-206.ec2.internal\" DevicePath \"\""
May 25 11:26:34.621595 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:26:34.621602    2545 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/6ce930cd-ee46-4495-9bfc-b326ded02436-secret-prometheus-k8s-kube-rbac-proxy-web\") on node \"ip-10-0-128-206.ec2.internal\" DevicePath \"\""
May 25 11:26:34.621816 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:26:34.621612    2545 reconciler_common.go:299] "Volume detached for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/6ce930cd-ee46-4495-9bfc-b326ded02436-thanos-prometheus-http-client-file\") on node \"ip-10-0-128-206.ec2.internal\" DevicePath \"\""
May 25 11:26:34.621816 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:26:34.621622    2545 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/6ce930cd-ee46-4495-9bfc-b326ded02436-web-config\") on node \"ip-10-0-128-206.ec2.internal\" DevicePath \"\""
May 25 11:26:34.621816 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:26:34.621634    2545 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/6ce930cd-ee46-4495-9bfc-b326ded02436-prometheus-k8s-rulefiles-0\") on node \"ip-10-0-128-206.ec2.internal\" DevicePath \"\""
May 25 11:26:34.621816 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:26:34.621642    2545 reconciler_common.go:299] "Volume detached for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/6ce930cd-ee46-4495-9bfc-b326ded02436-secret-grpc-tls\") on node \"ip-10-0-128-206.ec2.internal\" DevicePath \"\""
May 25 11:26:34.621816 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:26:34.621653    2545 reconciler_common.go:299] "Volume detached for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6ce930cd-ee46-4495-9bfc-b326ded02436-configmap-metrics-client-ca\") on node \"ip-10-0-128-206.ec2.internal\" DevicePath \"\""
May 25 11:26:34.621816 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:26:34.621674    2545 reconciler_common.go:299] "Volume detached for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6ce930cd-ee46-4495-9bfc-b326ded02436-prometheus-trusted-ca-bundle\") on node \"ip-10-0-128-206.ec2.internal\" DevicePath \"\""
May 25 11:26:34.621816 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:26:34.621684    2545 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vg6wt\" (UniqueName: \"kubernetes.io/projected/6ce930cd-ee46-4495-9bfc-b326ded02436-kube-api-access-vg6wt\") on node \"ip-10-0-128-206.ec2.internal\" DevicePath \"\""
May 25 11:26:34.621816 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:26:34.621693    2545 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/6ce930cd-ee46-4495-9bfc-b326ded02436-secret-prometheus-k8s-tls\") on node \"ip-10-0-128-206.ec2.internal\" DevicePath \"\""
May 25 11:26:34.621816 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:26:34.621702    2545 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/6ce930cd-ee46-4495-9bfc-b326ded02436-config\") on node \"ip-10-0-128-206.ec2.internal\" DevicePath \"\""
May 25 11:26:34.621816 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:26:34.621710    2545 reconciler_common.go:299] "Volume detached for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/6ce930cd-ee46-4495-9bfc-b326ded02436-secret-metrics-client-certs\") on node \"ip-10-0-128-206.ec2.internal\" DevicePath \"\""
May 25 11:26:34.621816 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:26:34.621720    2545 reconciler_common.go:299] "Volume detached for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/6ce930cd-ee46-4495-9bfc-b326ded02436-secret-kube-rbac-proxy\") on node \"ip-10-0-128-206.ec2.internal\" DevicePath \"\""
May 25 11:26:34.621816 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:26:34.621730    2545 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/6ce930cd-ee46-4495-9bfc-b326ded02436-config-out\") on node \"ip-10-0-128-206.ec2.internal\" DevicePath \"\""
May 25 11:26:34.621816 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:26:34.621738    2545 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/6ce930cd-ee46-4495-9bfc-b326ded02436-prometheus-k8s-db\") on node \"ip-10-0-128-206.ec2.internal\" DevicePath \"\""
May 25 11:26:35.475012 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:26:35.474985    2545 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
May 25 11:26:35.497299 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:26:35.497272    2545 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
May 25 11:26:35.504359 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:26:35.504305    2545 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
May 25 11:26:35.529166 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:26:35.529146    2545 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
May 25 11:26:35.529495 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:26:35.529474    2545 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="918141d8-d07a-4526-aafe-3ba8eeceafd4" containerName="registry"
May 25 11:26:35.529495 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:26:35.529491    2545 state_mem.go:107] "Deleted CPUSet assignment" podUID="918141d8-d07a-4526-aafe-3ba8eeceafd4" containerName="registry"
May 25 11:26:35.529495 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:26:35.529504    2545 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6ce930cd-ee46-4495-9bfc-b326ded02436" containerName="prometheus"
May 25 11:26:35.529495 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:26:35.529512    2545 state_mem.go:107] "Deleted CPUSet assignment" podUID="6ce930cd-ee46-4495-9bfc-b326ded02436" containerName="prometheus"
May 25 11:26:35.529710 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:26:35.529529    2545 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6ce930cd-ee46-4495-9bfc-b326ded02436" containerName="kube-rbac-proxy"
May 25 11:26:35.529710 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:26:35.529535    2545 state_mem.go:107] "Deleted CPUSet assignment" podUID="6ce930cd-ee46-4495-9bfc-b326ded02436" containerName="kube-rbac-proxy"
May 25 11:26:35.529710 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:26:35.529543    2545 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6ce930cd-ee46-4495-9bfc-b326ded02436" containerName="kube-rbac-proxy-thanos"
May 25 11:26:35.529710 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:26:35.529548    2545 state_mem.go:107] "Deleted CPUSet assignment" podUID="6ce930cd-ee46-4495-9bfc-b326ded02436" containerName="kube-rbac-proxy-thanos"
May 25 11:26:35.529710 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:26:35.529557    2545 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6ce930cd-ee46-4495-9bfc-b326ded02436" containerName="kube-rbac-proxy-web"
May 25 11:26:35.529710 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:26:35.529562    2545 state_mem.go:107] "Deleted CPUSet assignment" podUID="6ce930cd-ee46-4495-9bfc-b326ded02436" containerName="kube-rbac-proxy-web"
May 25 11:26:35.529710 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:26:35.529570    2545 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6ce930cd-ee46-4495-9bfc-b326ded02436" containerName="config-reloader"
May 25 11:26:35.529710 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:26:35.529575    2545 state_mem.go:107] "Deleted CPUSet assignment" podUID="6ce930cd-ee46-4495-9bfc-b326ded02436" containerName="config-reloader"
May 25 11:26:35.529710 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:26:35.529583    2545 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6ce930cd-ee46-4495-9bfc-b326ded02436" containerName="thanos-sidecar"
May 25 11:26:35.529710 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:26:35.529588    2545 state_mem.go:107] "Deleted CPUSet assignment" podUID="6ce930cd-ee46-4495-9bfc-b326ded02436" containerName="thanos-sidecar"
May 25 11:26:35.529710 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:26:35.529597    2545 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6ce930cd-ee46-4495-9bfc-b326ded02436" containerName="init-config-reloader"
May 25 11:26:35.529710 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:26:35.529606    2545 state_mem.go:107] "Deleted CPUSet assignment" podUID="6ce930cd-ee46-4495-9bfc-b326ded02436" containerName="init-config-reloader"
May 25 11:26:35.529710 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:26:35.529657    2545 memory_manager.go:356] "RemoveStaleState removing state" podUID="6ce930cd-ee46-4495-9bfc-b326ded02436" containerName="kube-rbac-proxy-thanos"
May 25 11:26:35.529710 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:26:35.529666    2545 memory_manager.go:356] "RemoveStaleState removing state" podUID="918141d8-d07a-4526-aafe-3ba8eeceafd4" containerName="registry"
May 25 11:26:35.529710 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:26:35.529673    2545 memory_manager.go:356] "RemoveStaleState removing state" podUID="6ce930cd-ee46-4495-9bfc-b326ded02436" containerName="prometheus"
May 25 11:26:35.529710 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:26:35.529682    2545 memory_manager.go:356] "RemoveStaleState removing state" podUID="6ce930cd-ee46-4495-9bfc-b326ded02436" containerName="kube-rbac-proxy"
May 25 11:26:35.529710 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:26:35.529691    2545 memory_manager.go:356] "RemoveStaleState removing state" podUID="6ce930cd-ee46-4495-9bfc-b326ded02436" containerName="kube-rbac-proxy-web"
May 25 11:26:35.529710 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:26:35.529698    2545 memory_manager.go:356] "RemoveStaleState removing state" podUID="6ce930cd-ee46-4495-9bfc-b326ded02436" containerName="config-reloader"
May 25 11:26:35.529710 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:26:35.529705    2545 memory_manager.go:356] "RemoveStaleState removing state" podUID="6ce930cd-ee46-4495-9bfc-b326ded02436" containerName="thanos-sidecar"
May 25 11:26:35.535854 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:26:35.535838    2545 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
May 25 11:26:35.538899 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:26:35.538877    2545 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\""
May 25 11:26:35.539214 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:26:35.539093    2545 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\""
May 25 11:26:35.539295 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:26:35.539278    2545 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-hwswd\""
May 25 11:26:35.539361 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:26:35.539340    2545 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\""
May 25 11:26:35.539471 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:26:35.539438    2545 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\""
May 25 11:26:35.539471 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:26:35.539442    2545 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\""
May 25 11:26:35.539693 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:26:35.539677    2545 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-d6dv3co18a7sr\""
May 25 11:26:35.539693 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:26:35.539689    2545 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\""
May 25 11:26:35.539805 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:26:35.539746    2545 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\""
May 25 11:26:35.539918 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:26:35.539900    2545 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\""
May 25 11:26:35.540003 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:26:35.539924    2545 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\""
May 25 11:26:35.540071 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:26:35.540054    2545 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\""
May 25 11:26:35.543082 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:26:35.543065    2545 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\""
May 25 11:26:35.546223 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:26:35.546207    2545 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\""
May 25 11:26:35.550909 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:26:35.550886    2545 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
May 25 11:26:35.628360 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:26:35.628326    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/d91fabd5-f2de-469d-a280-f16e253bff1f-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"d91fabd5-f2de-469d-a280-f16e253bff1f\") " pod="openshift-monitoring/prometheus-k8s-0"
May 25 11:26:35.628536 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:26:35.628381    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/d91fabd5-f2de-469d-a280-f16e253bff1f-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"d91fabd5-f2de-469d-a280-f16e253bff1f\") " pod="openshift-monitoring/prometheus-k8s-0"
May 25 11:26:35.628536 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:26:35.628441    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/d91fabd5-f2de-469d-a280-f16e253bff1f-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"d91fabd5-f2de-469d-a280-f16e253bff1f\") " pod="openshift-monitoring/prometheus-k8s-0"
May 25 11:26:35.628627 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:26:35.628530    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d91fabd5-f2de-469d-a280-f16e253bff1f-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"d91fabd5-f2de-469d-a280-f16e253bff1f\") " pod="openshift-monitoring/prometheus-k8s-0"
May 25 11:26:35.628627 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:26:35.628573    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d91fabd5-f2de-469d-a280-f16e253bff1f-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"d91fabd5-f2de-469d-a280-f16e253bff1f\") " pod="openshift-monitoring/prometheus-k8s-0"
May 25 11:26:35.628627 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:26:35.628610    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/d91fabd5-f2de-469d-a280-f16e253bff1f-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"d91fabd5-f2de-469d-a280-f16e253bff1f\") " pod="openshift-monitoring/prometheus-k8s-0"
May 25 11:26:35.628723 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:26:35.628638    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d91fabd5-f2de-469d-a280-f16e253bff1f-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"d91fabd5-f2de-469d-a280-f16e253bff1f\") " pod="openshift-monitoring/prometheus-k8s-0"
May 25 11:26:35.628723 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:26:35.628676    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/d91fabd5-f2de-469d-a280-f16e253bff1f-config-out\") pod \"prometheus-k8s-0\" (UID: \"d91fabd5-f2de-469d-a280-f16e253bff1f\") " pod="openshift-monitoring/prometheus-k8s-0"
May 25 11:26:35.628723 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:26:35.628700    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/d91fabd5-f2de-469d-a280-f16e253bff1f-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"d91fabd5-f2de-469d-a280-f16e253bff1f\") " pod="openshift-monitoring/prometheus-k8s-0"
May 25 11:26:35.628814 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:26:35.628731    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/d91fabd5-f2de-469d-a280-f16e253bff1f-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"d91fabd5-f2de-469d-a280-f16e253bff1f\") " pod="openshift-monitoring/prometheus-k8s-0"
May 25 11:26:35.628814 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:26:35.628757    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/d91fabd5-f2de-469d-a280-f16e253bff1f-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"d91fabd5-f2de-469d-a280-f16e253bff1f\") " pod="openshift-monitoring/prometheus-k8s-0"
May 25 11:26:35.628814 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:26:35.628805    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/d91fabd5-f2de-469d-a280-f16e253bff1f-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"d91fabd5-f2de-469d-a280-f16e253bff1f\") " pod="openshift-monitoring/prometheus-k8s-0"
May 25 11:26:35.628987 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:26:35.628831    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/d91fabd5-f2de-469d-a280-f16e253bff1f-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"d91fabd5-f2de-469d-a280-f16e253bff1f\") " pod="openshift-monitoring/prometheus-k8s-0"
May 25 11:26:35.628987 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:26:35.628878    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/d91fabd5-f2de-469d-a280-f16e253bff1f-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"d91fabd5-f2de-469d-a280-f16e253bff1f\") " pod="openshift-monitoring/prometheus-k8s-0"
May 25 11:26:35.628987 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:26:35.628921    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/d91fabd5-f2de-469d-a280-f16e253bff1f-web-config\") pod \"prometheus-k8s-0\" (UID: \"d91fabd5-f2de-469d-a280-f16e253bff1f\") " pod="openshift-monitoring/prometheus-k8s-0"
May 25 11:26:35.628987 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:26:35.628983    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/d91fabd5-f2de-469d-a280-f16e253bff1f-config\") pod \"prometheus-k8s-0\" (UID: \"d91fabd5-f2de-469d-a280-f16e253bff1f\") " pod="openshift-monitoring/prometheus-k8s-0"
May 25 11:26:35.629135 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:26:35.629021    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d91fabd5-f2de-469d-a280-f16e253bff1f-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"d91fabd5-f2de-469d-a280-f16e253bff1f\") " pod="openshift-monitoring/prometheus-k8s-0"
May 25 11:26:35.629135 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:26:35.629060    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kdtmr\" (UniqueName: \"kubernetes.io/projected/d91fabd5-f2de-469d-a280-f16e253bff1f-kube-api-access-kdtmr\") pod \"prometheus-k8s-0\" (UID: \"d91fabd5-f2de-469d-a280-f16e253bff1f\") " pod="openshift-monitoring/prometheus-k8s-0"
May 25 11:26:35.729838 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:26:35.729805    2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d91fabd5-f2de-469d-a280-f16e253bff1f-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"d91fabd5-f2de-469d-a280-f16e253bff1f\") " pod="openshift-monitoring/prometheus-k8s-0"
May 25 11:26:35.729838 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:26:35.729838    2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/d91fabd5-f2de-469d-a280-f16e253bff1f-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"d91fabd5-f2de-469d-a280-f16e253bff1f\") " pod="openshift-monitoring/prometheus-k8s-0"
May 25 11:26:35.730075 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:26:35.729856    2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d91fabd5-f2de-469d-a280-f16e253bff1f-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"d91fabd5-f2de-469d-a280-f16e253bff1f\") " pod="openshift-monitoring/prometheus-k8s-0"
May 25 11:26:35.730075 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:26:35.729876    2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/d91fabd5-f2de-469d-a280-f16e253bff1f-config-out\") pod \"prometheus-k8s-0\" (UID: \"d91fabd5-f2de-469d-a280-f16e253bff1f\") " pod="openshift-monitoring/prometheus-k8s-0"
May 25 11:26:35.730075 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:26:35.729892    2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/d91fabd5-f2de-469d-a280-f16e253bff1f-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"d91fabd5-f2de-469d-a280-f16e253bff1f\") " pod="openshift-monitoring/prometheus-k8s-0"
May 25 11:26:35.730075 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:26:35.730020    2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/d91fabd5-f2de-469d-a280-f16e253bff1f-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"d91fabd5-f2de-469d-a280-f16e253bff1f\") " pod="openshift-monitoring/prometheus-k8s-0"
May 25 11:26:35.730075 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:26:35.730046    2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/d91fabd5-f2de-469d-a280-f16e253bff1f-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"d91fabd5-f2de-469d-a280-f16e253bff1f\") " pod="openshift-monitoring/prometheus-k8s-0"
May 25 11:26:35.730075 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:26:35.730072    2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/d91fabd5-f2de-469d-a280-f16e253bff1f-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"d91fabd5-f2de-469d-a280-f16e253bff1f\") " pod="openshift-monitoring/prometheus-k8s-0"
May 25 11:26:35.730360 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:26:35.730132    2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/d91fabd5-f2de-469d-a280-f16e253bff1f-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"d91fabd5-f2de-469d-a280-f16e253bff1f\") " pod="openshift-monitoring/prometheus-k8s-0"
May 25 11:26:35.730360 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:26:35.730181    2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/d91fabd5-f2de-469d-a280-f16e253bff1f-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"d91fabd5-f2de-469d-a280-f16e253bff1f\") " pod="openshift-monitoring/prometheus-k8s-0"
May 25 11:26:35.730360 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:26:35.730216    2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/d91fabd5-f2de-469d-a280-f16e253bff1f-web-config\") pod \"prometheus-k8s-0\" (UID: \"d91fabd5-f2de-469d-a280-f16e253bff1f\") " pod="openshift-monitoring/prometheus-k8s-0"
May 25 11:26:35.730360 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:26:35.730241    2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/d91fabd5-f2de-469d-a280-f16e253bff1f-config\") pod \"prometheus-k8s-0\" (UID: \"d91fabd5-f2de-469d-a280-f16e253bff1f\") " pod="openshift-monitoring/prometheus-k8s-0"
May 25 11:26:35.730360 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:26:35.730264    2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d91fabd5-f2de-469d-a280-f16e253bff1f-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"d91fabd5-f2de-469d-a280-f16e253bff1f\") " pod="openshift-monitoring/prometheus-k8s-0"
May 25 11:26:35.730360 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:26:35.730284    2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/d91fabd5-f2de-469d-a280-f16e253bff1f-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"d91fabd5-f2de-469d-a280-f16e253bff1f\") " pod="openshift-monitoring/prometheus-k8s-0"
May 25 11:26:35.730360 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:26:35.730298    2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-kdtmr\" (UniqueName: \"kubernetes.io/projected/d91fabd5-f2de-469d-a280-f16e253bff1f-kube-api-access-kdtmr\") pod \"prometheus-k8s-0\" (UID: \"d91fabd5-f2de-469d-a280-f16e253bff1f\") " pod="openshift-monitoring/prometheus-k8s-0"
May 25 11:26:35.730677 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:26:35.730368    2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/d91fabd5-f2de-469d-a280-f16e253bff1f-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"d91fabd5-f2de-469d-a280-f16e253bff1f\") " pod="openshift-monitoring/prometheus-k8s-0"
May 25 11:26:35.730677 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:26:35.730421    2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/d91fabd5-f2de-469d-a280-f16e253bff1f-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"d91fabd5-f2de-469d-a280-f16e253bff1f\") " pod="openshift-monitoring/prometheus-k8s-0"
May 25 11:26:35.730677 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:26:35.730452    2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/d91fabd5-f2de-469d-a280-f16e253bff1f-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"d91fabd5-f2de-469d-a280-f16e253bff1f\") " pod="openshift-monitoring/prometheus-k8s-0"
May 25 11:26:35.730677 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:26:35.730486    2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d91fabd5-f2de-469d-a280-f16e253bff1f-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"d91fabd5-f2de-469d-a280-f16e253bff1f\") " pod="openshift-monitoring/prometheus-k8s-0"
May 25 11:26:35.730859 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:26:35.730704    2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d91fabd5-f2de-469d-a280-f16e253bff1f-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"d91fabd5-f2de-469d-a280-f16e253bff1f\") " pod="openshift-monitoring/prometheus-k8s-0"
May 25 11:26:35.731678 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:26:35.731654    2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d91fabd5-f2de-469d-a280-f16e253bff1f-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"d91fabd5-f2de-469d-a280-f16e253bff1f\") " pod="openshift-monitoring/prometheus-k8s-0"
May 25 11:26:35.733091 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:26:35.732716    2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/d91fabd5-f2de-469d-a280-f16e253bff1f-config-out\") pod \"prometheus-k8s-0\" (UID: \"d91fabd5-f2de-469d-a280-f16e253bff1f\") " pod="openshift-monitoring/prometheus-k8s-0"
May 25 11:26:35.733091 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:26:35.732948    2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/d91fabd5-f2de-469d-a280-f16e253bff1f-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"d91fabd5-f2de-469d-a280-f16e253bff1f\") " pod="openshift-monitoring/prometheus-k8s-0"
May 25 11:26:35.733507 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:26:35.733478    2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/d91fabd5-f2de-469d-a280-f16e253bff1f-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"d91fabd5-f2de-469d-a280-f16e253bff1f\") " pod="openshift-monitoring/prometheus-k8s-0"
May 25 11:26:35.733595 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:26:35.730705    2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d91fabd5-f2de-469d-a280-f16e253bff1f-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"d91fabd5-f2de-469d-a280-f16e253bff1f\") " pod="openshift-monitoring/prometheus-k8s-0"
May 25 11:26:35.733595 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:26:35.733532    2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/d91fabd5-f2de-469d-a280-f16e253bff1f-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"d91fabd5-f2de-469d-a280-f16e253bff1f\") " pod="openshift-monitoring/prometheus-k8s-0"
May 25 11:26:35.733595 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:26:35.733545    2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/d91fabd5-f2de-469d-a280-f16e253bff1f-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"d91fabd5-f2de-469d-a280-f16e253bff1f\") " pod="openshift-monitoring/prometheus-k8s-0"
May 25 11:26:35.734248 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:26:35.734223    2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d91fabd5-f2de-469d-a280-f16e253bff1f-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"d91fabd5-f2de-469d-a280-f16e253bff1f\") " pod="openshift-monitoring/prometheus-k8s-0"
May 25 11:26:35.734345 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:26:35.734254    2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/d91fabd5-f2de-469d-a280-f16e253bff1f-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"d91fabd5-f2de-469d-a280-f16e253bff1f\") " pod="openshift-monitoring/prometheus-k8s-0"
May 25 11:26:35.734451 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:26:35.734424    2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/d91fabd5-f2de-469d-a280-f16e253bff1f-web-config\") pod \"prometheus-k8s-0\" (UID: \"d91fabd5-f2de-469d-a280-f16e253bff1f\") " pod="openshift-monitoring/prometheus-k8s-0"
May 25 11:26:35.734950 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:26:35.734923    2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/d91fabd5-f2de-469d-a280-f16e253bff1f-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"d91fabd5-f2de-469d-a280-f16e253bff1f\") " pod="openshift-monitoring/prometheus-k8s-0"
May 25 11:26:35.735212 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:26:35.735194    2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/d91fabd5-f2de-469d-a280-f16e253bff1f-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"d91fabd5-f2de-469d-a280-f16e253bff1f\") " pod="openshift-monitoring/prometheus-k8s-0"
May 25 11:26:35.735647 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:26:35.735624    2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/d91fabd5-f2de-469d-a280-f16e253bff1f-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"d91fabd5-f2de-469d-a280-f16e253bff1f\") " pod="openshift-monitoring/prometheus-k8s-0"
May 25 11:26:35.735921 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:26:35.735906    2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/d91fabd5-f2de-469d-a280-f16e253bff1f-config\") pod \"prometheus-k8s-0\" (UID: \"d91fabd5-f2de-469d-a280-f16e253bff1f\") " pod="openshift-monitoring/prometheus-k8s-0"
May 25 11:26:35.736042 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:26:35.736026    2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/d91fabd5-f2de-469d-a280-f16e253bff1f-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"d91fabd5-f2de-469d-a280-f16e253bff1f\") " pod="openshift-monitoring/prometheus-k8s-0"
May 25 11:26:35.738770 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:26:35.738754    2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kdtmr\" (UniqueName: \"kubernetes.io/projected/d91fabd5-f2de-469d-a280-f16e253bff1f-kube-api-access-kdtmr\") pod \"prometheus-k8s-0\" (UID: \"d91fabd5-f2de-469d-a280-f16e253bff1f\") " pod="openshift-monitoring/prometheus-k8s-0"
May 25 11:26:35.845504 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:26:35.845410    2545 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
May 25 11:26:35.986470 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:26:35.983585    2545 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
May 25 11:26:36.479378 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:26:36.479343    2545 generic.go:358] "Generic (PLEG): container finished" podID="d91fabd5-f2de-469d-a280-f16e253bff1f" containerID="e6a2283bb0935ea21469e0f0ed882a5c9ab6b0aabb11ca890007c2229219a430" exitCode=0
May 25 11:26:36.479704 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:26:36.479432    2545 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"d91fabd5-f2de-469d-a280-f16e253bff1f","Type":"ContainerDied","Data":"e6a2283bb0935ea21469e0f0ed882a5c9ab6b0aabb11ca890007c2229219a430"}
May 25 11:26:36.479704 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:26:36.479462    2545 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"d91fabd5-f2de-469d-a280-f16e253bff1f","Type":"ContainerStarted","Data":"bccbcc1ae8663f0e64cd7519ec7d4e3155a6d3185480639c99ab668db1bb2a10"}
May 25 11:26:36.775829 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:26:36.775780    2545 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6ce930cd-ee46-4495-9bfc-b326ded02436" path="/var/lib/kubelet/pods/6ce930cd-ee46-4495-9bfc-b326ded02436/volumes"
May 25 11:26:37.485435 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:26:37.485399    2545 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"d91fabd5-f2de-469d-a280-f16e253bff1f","Type":"ContainerStarted","Data":"033e9cc81fc7bbdf29b297ab58616d7d343ae5ade4c1f917ac356b793f7b054c"}
May 25 11:26:37.485435 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:26:37.485430    2545 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"d91fabd5-f2de-469d-a280-f16e253bff1f","Type":"ContainerStarted","Data":"ac1e05172c8a12d0b40ea74fda93d65a8713b37f61ad6fcbb5ca4accf8ffa93c"}
May 25 11:26:37.485435 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:26:37.485441    2545 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"d91fabd5-f2de-469d-a280-f16e253bff1f","Type":"ContainerStarted","Data":"31aeecab8fff2b1312687ba451baf3262fe658ece06d39214c2eb75af357be00"}
May 25 11:26:37.485844 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:26:37.485450    2545 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"d91fabd5-f2de-469d-a280-f16e253bff1f","Type":"ContainerStarted","Data":"9f031fca3194f65ba02a827f6a1d9d02e2ef2514cfefbd1c1375bd0fefbc7a02"}
May 25 11:26:37.485844 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:26:37.485459    2545 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"d91fabd5-f2de-469d-a280-f16e253bff1f","Type":"ContainerStarted","Data":"54fb5820e1875a1ae030b9e68e27a707ae5d07a6332156beae3d57ac9b7b6e22"}
May 25 11:26:37.485844 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:26:37.485467    2545 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"d91fabd5-f2de-469d-a280-f16e253bff1f","Type":"ContainerStarted","Data":"612baad100e65e1571078a07140a91264bcb3b5d6db0e3b5d599d5e992643eec"}
May 25 11:26:37.515645 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:26:37.515594    2545 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.515577257 podStartE2EDuration="2.515577257s" podCreationTimestamp="2026-05-25 11:26:35 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-25 11:26:37.514163963 +0000 UTC m=+189.280448910" watchObservedRunningTime="2026-05-25 11:26:37.515577257 +0000 UTC m=+189.281862203"
May 25 11:26:40.846496 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:26:40.846454    2545 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0"
May 25 11:26:51.196931 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:26:51.196881    2545 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kube-system/global-pull-secret-syncer-49lh6"]
May 25 11:26:51.200343 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:26:51.200324    2545 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-49lh6"
May 25 11:26:51.203037 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:26:51.203006    2545 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
May 25 11:26:51.209225 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:26:51.209202    2545 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-49lh6"]
May 25 11:26:51.253291 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:26:51.253263    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/47e25bdd-612b-46e8-87d2-0f25c52e5509-original-pull-secret\") pod \"global-pull-secret-syncer-49lh6\" (UID: \"47e25bdd-612b-46e8-87d2-0f25c52e5509\") " pod="kube-system/global-pull-secret-syncer-49lh6"
May 25 11:26:51.253411 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:26:51.253309    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/47e25bdd-612b-46e8-87d2-0f25c52e5509-dbus\") pod \"global-pull-secret-syncer-49lh6\" (UID: \"47e25bdd-612b-46e8-87d2-0f25c52e5509\") " pod="kube-system/global-pull-secret-syncer-49lh6"
May 25 11:26:51.253411 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:26:51.253344    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/47e25bdd-612b-46e8-87d2-0f25c52e5509-kubelet-config\") pod \"global-pull-secret-syncer-49lh6\" (UID: \"47e25bdd-612b-46e8-87d2-0f25c52e5509\") " pod="kube-system/global-pull-secret-syncer-49lh6"
May 25 11:26:51.354302 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:26:51.354274    2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/47e25bdd-612b-46e8-87d2-0f25c52e5509-dbus\") pod \"global-pull-secret-syncer-49lh6\" (UID: \"47e25bdd-612b-46e8-87d2-0f25c52e5509\") " pod="kube-system/global-pull-secret-syncer-49lh6"
May 25 11:26:51.354441 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:26:51.354335    2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/47e25bdd-612b-46e8-87d2-0f25c52e5509-kubelet-config\") pod \"global-pull-secret-syncer-49lh6\" (UID: \"47e25bdd-612b-46e8-87d2-0f25c52e5509\") " pod="kube-system/global-pull-secret-syncer-49lh6"
May 25 11:26:51.354441 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:26:51.354382    2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/47e25bdd-612b-46e8-87d2-0f25c52e5509-original-pull-secret\") pod \"global-pull-secret-syncer-49lh6\" (UID: \"47e25bdd-612b-46e8-87d2-0f25c52e5509\") " pod="kube-system/global-pull-secret-syncer-49lh6"
May 25 11:26:51.354441 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:26:51.354407    2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/47e25bdd-612b-46e8-87d2-0f25c52e5509-kubelet-config\") pod \"global-pull-secret-syncer-49lh6\" (UID: \"47e25bdd-612b-46e8-87d2-0f25c52e5509\") " pod="kube-system/global-pull-secret-syncer-49lh6"
May 25 11:26:51.354541 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:26:51.354453    2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/47e25bdd-612b-46e8-87d2-0f25c52e5509-dbus\") pod \"global-pull-secret-syncer-49lh6\" (UID: \"47e25bdd-612b-46e8-87d2-0f25c52e5509\") " pod="kube-system/global-pull-secret-syncer-49lh6"
May 25 11:26:51.356538 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:26:51.356511    2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/47e25bdd-612b-46e8-87d2-0f25c52e5509-original-pull-secret\") pod \"global-pull-secret-syncer-49lh6\" (UID: \"47e25bdd-612b-46e8-87d2-0f25c52e5509\") " pod="kube-system/global-pull-secret-syncer-49lh6"
May 25 11:26:51.510306 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:26:51.510285    2545 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-49lh6"
May 25 11:26:51.630393 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:26:51.630372    2545 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-49lh6"]
May 25 11:26:51.632856 ip-10-0-128-206 kubenswrapper[2545]: W0525 11:26:51.632815    2545 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod47e25bdd_612b_46e8_87d2_0f25c52e5509.slice/crio-2dd91329dd9976a570e0fa7f79000996c1cdb76c2cad8179845f01d2f5670f66 WatchSource:0}: Error finding container 2dd91329dd9976a570e0fa7f79000996c1cdb76c2cad8179845f01d2f5670f66: Status 404 returned error can't find the container with id 2dd91329dd9976a570e0fa7f79000996c1cdb76c2cad8179845f01d2f5670f66
May 25 11:26:52.534159 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:26:52.534117    2545 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-49lh6" event={"ID":"47e25bdd-612b-46e8-87d2-0f25c52e5509","Type":"ContainerStarted","Data":"2dd91329dd9976a570e0fa7f79000996c1cdb76c2cad8179845f01d2f5670f66"}
May 25 11:26:55.546528 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:26:55.546486    2545 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-49lh6" event={"ID":"47e25bdd-612b-46e8-87d2-0f25c52e5509","Type":"ContainerStarted","Data":"6bef5122dcebdd4d876f4a75e640a0b61d8eefd92ebc7e1ece6c7b1e6a21fa1f"}
May 25 11:26:55.561359 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:26:55.561237    2545 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-49lh6" podStartSLOduration=1.19835056 podStartE2EDuration="4.561214837s" podCreationTimestamp="2026-05-25 11:26:51 +0000 UTC" firstStartedPulling="2026-05-25 11:26:51.634563074 +0000 UTC m=+203.400847997" lastFinishedPulling="2026-05-25 11:26:54.997427351 +0000 UTC m=+206.763712274" observedRunningTime="2026-05-25 11:26:55.561165625 +0000 UTC m=+207.327450572" watchObservedRunningTime="2026-05-25 11:26:55.561214837 +0000 UTC m=+207.327499784"
May 25 11:27:35.846456 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:27:35.846416    2545 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0"
May 25 11:27:35.861600 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:27:35.861578    2545 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0"
May 25 11:27:36.677495 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:27:36.677466    2545 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0"
May 25 11:28:28.655902 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:28:28.655862    2545 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-krfmt_4e27bcd6-c257-422b-a332-0df274cf6fcc/ovn-acl-logging/0.log"
May 25 11:28:28.656462 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:28:28.656309    2545 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-krfmt_4e27bcd6-c257-422b-a332-0df274cf6fcc/ovn-acl-logging/0.log"
May 25 11:28:28.669162 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:28:28.669139    2545 kubelet.go:1628] "Image garbage collection succeeded"
May 25 11:29:16.051426 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:29:16.051359    2545 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-webhook-587ccfb98-mvb2v"]
May 25 11:29:16.054680 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:29:16.054663    2545 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-587ccfb98-mvb2v"
May 25 11:29:16.057274 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:29:16.057253    2545 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\""
May 25 11:29:16.057443 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:29:16.057302    2545 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\""
May 25 11:29:16.063424 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:29:16.063399    2545 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-587ccfb98-mvb2v"]
May 25 11:29:16.158035 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:29:16.158008    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bpz5p\" (UniqueName: \"kubernetes.io/projected/0e785cf0-c01c-4a88-96ab-6706e1ccbbc1-kube-api-access-bpz5p\") pod \"cert-manager-webhook-587ccfb98-mvb2v\" (UID: \"0e785cf0-c01c-4a88-96ab-6706e1ccbbc1\") " pod="cert-manager/cert-manager-webhook-587ccfb98-mvb2v"
May 25 11:29:16.158174 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:29:16.158049    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/0e785cf0-c01c-4a88-96ab-6706e1ccbbc1-bound-sa-token\") pod \"cert-manager-webhook-587ccfb98-mvb2v\" (UID: \"0e785cf0-c01c-4a88-96ab-6706e1ccbbc1\") " pod="cert-manager/cert-manager-webhook-587ccfb98-mvb2v"
May 25 11:29:16.259122 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:29:16.259086    2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-bpz5p\" (UniqueName: \"kubernetes.io/projected/0e785cf0-c01c-4a88-96ab-6706e1ccbbc1-kube-api-access-bpz5p\") pod \"cert-manager-webhook-587ccfb98-mvb2v\" (UID: \"0e785cf0-c01c-4a88-96ab-6706e1ccbbc1\") " pod="cert-manager/cert-manager-webhook-587ccfb98-mvb2v"
May 25 11:29:16.259270 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:29:16.259129    2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/0e785cf0-c01c-4a88-96ab-6706e1ccbbc1-bound-sa-token\") pod \"cert-manager-webhook-587ccfb98-mvb2v\" (UID: \"0e785cf0-c01c-4a88-96ab-6706e1ccbbc1\") " pod="cert-manager/cert-manager-webhook-587ccfb98-mvb2v"
May 25 11:29:16.267232 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:29:16.267203    2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/0e785cf0-c01c-4a88-96ab-6706e1ccbbc1-bound-sa-token\") pod \"cert-manager-webhook-587ccfb98-mvb2v\" (UID: \"0e785cf0-c01c-4a88-96ab-6706e1ccbbc1\") " pod="cert-manager/cert-manager-webhook-587ccfb98-mvb2v"
May 25 11:29:16.267232 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:29:16.267217    2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bpz5p\" (UniqueName: \"kubernetes.io/projected/0e785cf0-c01c-4a88-96ab-6706e1ccbbc1-kube-api-access-bpz5p\") pod \"cert-manager-webhook-587ccfb98-mvb2v\" (UID: \"0e785cf0-c01c-4a88-96ab-6706e1ccbbc1\") " pod="cert-manager/cert-manager-webhook-587ccfb98-mvb2v"
May 25 11:29:16.373854 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:29:16.373781    2545 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-587ccfb98-mvb2v"
May 25 11:29:16.495096 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:29:16.495075    2545 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-587ccfb98-mvb2v"]
May 25 11:29:16.497700 ip-10-0-128-206 kubenswrapper[2545]: W0525 11:29:16.497669    2545 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod0e785cf0_c01c_4a88_96ab_6706e1ccbbc1.slice/crio-5ce1995285ec73f4cbb6b9000bc4d33654102ebfc54c257fccdcf09ee791c1e0 WatchSource:0}: Error finding container 5ce1995285ec73f4cbb6b9000bc4d33654102ebfc54c257fccdcf09ee791c1e0: Status 404 returned error can't find the container with id 5ce1995285ec73f4cbb6b9000bc4d33654102ebfc54c257fccdcf09ee791c1e0
May 25 11:29:16.499297 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:29:16.499284    2545 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
May 25 11:29:16.942617 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:29:16.942578    2545 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-587ccfb98-mvb2v" event={"ID":"0e785cf0-c01c-4a88-96ab-6706e1ccbbc1","Type":"ContainerStarted","Data":"5ce1995285ec73f4cbb6b9000bc4d33654102ebfc54c257fccdcf09ee791c1e0"}
May 25 11:29:17.762220 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:29:17.762189    2545 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-cainjector-68b757865b-6cctm"]
May 25 11:29:17.765835 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:29:17.765806    2545 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-68b757865b-6cctm"
May 25 11:29:17.768494 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:29:17.768467    2545 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-cainjector-dockercfg-6nt66\""
May 25 11:29:17.777457 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:29:17.773856    2545 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-68b757865b-6cctm"]
May 25 11:29:17.873575 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:29:17.873538    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/99fdfada-991b-484c-96d9-b7840203a182-bound-sa-token\") pod \"cert-manager-cainjector-68b757865b-6cctm\" (UID: \"99fdfada-991b-484c-96d9-b7840203a182\") " pod="cert-manager/cert-manager-cainjector-68b757865b-6cctm"
May 25 11:29:17.873758 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:29:17.873606    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l2tzr\" (UniqueName: \"kubernetes.io/projected/99fdfada-991b-484c-96d9-b7840203a182-kube-api-access-l2tzr\") pod \"cert-manager-cainjector-68b757865b-6cctm\" (UID: \"99fdfada-991b-484c-96d9-b7840203a182\") " pod="cert-manager/cert-manager-cainjector-68b757865b-6cctm"
May 25 11:29:17.974297 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:29:17.974260    2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/99fdfada-991b-484c-96d9-b7840203a182-bound-sa-token\") pod \"cert-manager-cainjector-68b757865b-6cctm\" (UID: \"99fdfada-991b-484c-96d9-b7840203a182\") " pod="cert-manager/cert-manager-cainjector-68b757865b-6cctm"
May 25 11:29:17.974480 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:29:17.974328    2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-l2tzr\" (UniqueName: \"kubernetes.io/projected/99fdfada-991b-484c-96d9-b7840203a182-kube-api-access-l2tzr\") pod \"cert-manager-cainjector-68b757865b-6cctm\" (UID: \"99fdfada-991b-484c-96d9-b7840203a182\") " pod="cert-manager/cert-manager-cainjector-68b757865b-6cctm"
May 25 11:29:17.983803 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:29:17.983778    2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/99fdfada-991b-484c-96d9-b7840203a182-bound-sa-token\") pod \"cert-manager-cainjector-68b757865b-6cctm\" (UID: \"99fdfada-991b-484c-96d9-b7840203a182\") " pod="cert-manager/cert-manager-cainjector-68b757865b-6cctm"
May 25 11:29:17.983925 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:29:17.983859    2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-l2tzr\" (UniqueName: \"kubernetes.io/projected/99fdfada-991b-484c-96d9-b7840203a182-kube-api-access-l2tzr\") pod \"cert-manager-cainjector-68b757865b-6cctm\" (UID: \"99fdfada-991b-484c-96d9-b7840203a182\") " pod="cert-manager/cert-manager-cainjector-68b757865b-6cctm"
May 25 11:29:18.080703 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:29:18.080609    2545 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-68b757865b-6cctm"
May 25 11:29:18.239260 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:29:18.239222    2545 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-68b757865b-6cctm"]
May 25 11:29:18.241980 ip-10-0-128-206 kubenswrapper[2545]: W0525 11:29:18.241760    2545 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod99fdfada_991b_484c_96d9_b7840203a182.slice/crio-286a9ba5d6bf9cd853b854b307813dcb2d74a0738940008c96beccd63dee5ab6 WatchSource:0}: Error finding container 286a9ba5d6bf9cd853b854b307813dcb2d74a0738940008c96beccd63dee5ab6: Status 404 returned error can't find the container with id 286a9ba5d6bf9cd853b854b307813dcb2d74a0738940008c96beccd63dee5ab6
May 25 11:29:18.951263 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:29:18.951227    2545 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-68b757865b-6cctm" event={"ID":"99fdfada-991b-484c-96d9-b7840203a182","Type":"ContainerStarted","Data":"286a9ba5d6bf9cd853b854b307813dcb2d74a0738940008c96beccd63dee5ab6"}
May 25 11:29:20.960246 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:29:20.960210    2545 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-587ccfb98-mvb2v" event={"ID":"0e785cf0-c01c-4a88-96ab-6706e1ccbbc1","Type":"ContainerStarted","Data":"f8ecf5f558290a377c44ece5e77eff74711e62df938ff311061a18e6b5a5b822"}
May 25 11:29:20.960695 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:29:20.960270    2545 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="cert-manager/cert-manager-webhook-587ccfb98-mvb2v"
May 25 11:29:20.961588 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:29:20.961564    2545 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-68b757865b-6cctm" event={"ID":"99fdfada-991b-484c-96d9-b7840203a182","Type":"ContainerStarted","Data":"b4d2b8aa7d9a87011a0d13be1c403bc07c7481f19de7673b2099e36cf027bd1a"}
May 25 11:29:20.989501 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:29:20.989455    2545 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="cert-manager/cert-manager-webhook-587ccfb98-mvb2v" podStartSLOduration=1.524875562 podStartE2EDuration="4.989443606s" podCreationTimestamp="2026-05-25 11:29:16 +0000 UTC" firstStartedPulling="2026-05-25 11:29:16.49943293 +0000 UTC m=+348.265717855" lastFinishedPulling="2026-05-25 11:29:19.964000976 +0000 UTC m=+351.730285899" observedRunningTime="2026-05-25 11:29:20.988418582 +0000 UTC m=+352.754703540" watchObservedRunningTime="2026-05-25 11:29:20.989443606 +0000 UTC m=+352.755728552"
May 25 11:29:21.006757 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:29:21.006715    2545 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="cert-manager/cert-manager-cainjector-68b757865b-6cctm" podStartSLOduration=2.286336315 podStartE2EDuration="4.006703414s" podCreationTimestamp="2026-05-25 11:29:17 +0000 UTC" firstStartedPulling="2026-05-25 11:29:18.244158705 +0000 UTC m=+350.010443638" lastFinishedPulling="2026-05-25 11:29:19.9645258 +0000 UTC m=+351.730810737" observedRunningTime="2026-05-25 11:29:21.004527743 +0000 UTC m=+352.770812690" watchObservedRunningTime="2026-05-25 11:29:21.006703414 +0000 UTC m=+352.772988359"
May 25 11:29:26.966548 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:29:26.966514    2545 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="cert-manager/cert-manager-webhook-587ccfb98-mvb2v"
May 25 11:29:35.073011 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:29:35.072980    2545 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-79c8d999ff-67lv5"]
May 25 11:29:35.076469 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:29:35.076450    2545 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-79c8d999ff-67lv5"
May 25 11:29:35.079389 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:29:35.079372    2545 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-dockercfg-8x97j\""
May 25 11:29:35.091141 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:29:35.091123    2545 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-79c8d999ff-67lv5"]
May 25 11:29:35.218344 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:29:35.218313    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zxppk\" (UniqueName: \"kubernetes.io/projected/63458a9a-dad9-44cf-95d8-c927fa2e9fba-kube-api-access-zxppk\") pod \"cert-manager-79c8d999ff-67lv5\" (UID: \"63458a9a-dad9-44cf-95d8-c927fa2e9fba\") " pod="cert-manager/cert-manager-79c8d999ff-67lv5"
May 25 11:29:35.218480 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:29:35.218366    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/63458a9a-dad9-44cf-95d8-c927fa2e9fba-bound-sa-token\") pod \"cert-manager-79c8d999ff-67lv5\" (UID: \"63458a9a-dad9-44cf-95d8-c927fa2e9fba\") " pod="cert-manager/cert-manager-79c8d999ff-67lv5"
May 25 11:29:35.319189 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:29:35.319151    2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/63458a9a-dad9-44cf-95d8-c927fa2e9fba-bound-sa-token\") pod \"cert-manager-79c8d999ff-67lv5\" (UID: \"63458a9a-dad9-44cf-95d8-c927fa2e9fba\") " pod="cert-manager/cert-manager-79c8d999ff-67lv5"
May 25 11:29:35.319347 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:29:35.319231    2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-zxppk\" (UniqueName: \"kubernetes.io/projected/63458a9a-dad9-44cf-95d8-c927fa2e9fba-kube-api-access-zxppk\") pod \"cert-manager-79c8d999ff-67lv5\" (UID: \"63458a9a-dad9-44cf-95d8-c927fa2e9fba\") " pod="cert-manager/cert-manager-79c8d999ff-67lv5"
May 25 11:29:35.328994 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:29:35.328914    2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/63458a9a-dad9-44cf-95d8-c927fa2e9fba-bound-sa-token\") pod \"cert-manager-79c8d999ff-67lv5\" (UID: \"63458a9a-dad9-44cf-95d8-c927fa2e9fba\") " pod="cert-manager/cert-manager-79c8d999ff-67lv5"
May 25 11:29:35.329093 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:29:35.329002    2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zxppk\" (UniqueName: \"kubernetes.io/projected/63458a9a-dad9-44cf-95d8-c927fa2e9fba-kube-api-access-zxppk\") pod \"cert-manager-79c8d999ff-67lv5\" (UID: \"63458a9a-dad9-44cf-95d8-c927fa2e9fba\") " pod="cert-manager/cert-manager-79c8d999ff-67lv5"
May 25 11:29:35.385537 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:29:35.385510    2545 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-79c8d999ff-67lv5"
May 25 11:29:35.512394 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:29:35.512372    2545 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-79c8d999ff-67lv5"]
May 25 11:29:35.514893 ip-10-0-128-206 kubenswrapper[2545]: W0525 11:29:35.514867    2545 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod63458a9a_dad9_44cf_95d8_c927fa2e9fba.slice/crio-6e7b4e6056ca600b8c1b9d3e1f81f2b761fb8eb7323ce62c24573522a7a6e00b WatchSource:0}: Error finding container 6e7b4e6056ca600b8c1b9d3e1f81f2b761fb8eb7323ce62c24573522a7a6e00b: Status 404 returned error can't find the container with id 6e7b4e6056ca600b8c1b9d3e1f81f2b761fb8eb7323ce62c24573522a7a6e00b
May 25 11:29:36.005608 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:29:36.005571    2545 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-79c8d999ff-67lv5" event={"ID":"63458a9a-dad9-44cf-95d8-c927fa2e9fba","Type":"ContainerStarted","Data":"e2141d808431ab53af9de6e10b82007f122176f550cae39cd7f7055c78b517b8"}
May 25 11:29:36.005795 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:29:36.005617    2545 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-79c8d999ff-67lv5" event={"ID":"63458a9a-dad9-44cf-95d8-c927fa2e9fba","Type":"ContainerStarted","Data":"6e7b4e6056ca600b8c1b9d3e1f81f2b761fb8eb7323ce62c24573522a7a6e00b"}
May 25 11:29:36.023211 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:29:36.023168    2545 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="cert-manager/cert-manager-79c8d999ff-67lv5" podStartSLOduration=1.023154521 podStartE2EDuration="1.023154521s" podCreationTimestamp="2026-05-25 11:29:35 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-25 11:29:36.021442255 +0000 UTC m=+367.787727202" watchObservedRunningTime="2026-05-25 11:29:36.023154521 +0000 UTC m=+367.789439467"
May 25 11:30:08.757482 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:30:08.757446    2545 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-8646484d7f-qnpwr"]
May 25 11:30:08.760843 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:30:08.760821    2545 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-8646484d7f-qnpwr"
May 25 11:30:08.768637 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:30:08.768615    2545 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\""
May 25 11:30:08.771322 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:30:08.771305    2545 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\""
May 25 11:30:08.772451 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:30:08.772431    2545 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\""
May 25 11:30:08.778157 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:30:08.778140    2545 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-hssbk\""
May 25 11:30:08.780117 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:30:08.780095    2545 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-8646484d7f-qnpwr"]
May 25 11:30:08.782670 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:30:08.782647    2545 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\""
May 25 11:30:08.782914 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:30:08.782898    2545 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\""
May 25 11:30:08.802753 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:30:08.802633    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/8afc5e54-3254-46c1-b952-a63f6ec47c41-manager-config\") pod \"lws-controller-manager-8646484d7f-qnpwr\" (UID: \"8afc5e54-3254-46c1-b952-a63f6ec47c41\") " pod="openshift-lws-operator/lws-controller-manager-8646484d7f-qnpwr"
May 25 11:30:08.802753 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:30:08.802680    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/8afc5e54-3254-46c1-b952-a63f6ec47c41-metrics-cert\") pod \"lws-controller-manager-8646484d7f-qnpwr\" (UID: \"8afc5e54-3254-46c1-b952-a63f6ec47c41\") " pod="openshift-lws-operator/lws-controller-manager-8646484d7f-qnpwr"
May 25 11:30:08.802929 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:30:08.802770    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6zgt7\" (UniqueName: \"kubernetes.io/projected/8afc5e54-3254-46c1-b952-a63f6ec47c41-kube-api-access-6zgt7\") pod \"lws-controller-manager-8646484d7f-qnpwr\" (UID: \"8afc5e54-3254-46c1-b952-a63f6ec47c41\") " pod="openshift-lws-operator/lws-controller-manager-8646484d7f-qnpwr"
May 25 11:30:08.802929 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:30:08.802831    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/8afc5e54-3254-46c1-b952-a63f6ec47c41-cert\") pod \"lws-controller-manager-8646484d7f-qnpwr\" (UID: \"8afc5e54-3254-46c1-b952-a63f6ec47c41\") " pod="openshift-lws-operator/lws-controller-manager-8646484d7f-qnpwr"
May 25 11:30:08.903979 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:30:08.903921    2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-6zgt7\" (UniqueName: \"kubernetes.io/projected/8afc5e54-3254-46c1-b952-a63f6ec47c41-kube-api-access-6zgt7\") pod \"lws-controller-manager-8646484d7f-qnpwr\" (UID: \"8afc5e54-3254-46c1-b952-a63f6ec47c41\") " pod="openshift-lws-operator/lws-controller-manager-8646484d7f-qnpwr"
May 25 11:30:08.904151 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:30:08.903996    2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/8afc5e54-3254-46c1-b952-a63f6ec47c41-cert\") pod \"lws-controller-manager-8646484d7f-qnpwr\" (UID: \"8afc5e54-3254-46c1-b952-a63f6ec47c41\") " pod="openshift-lws-operator/lws-controller-manager-8646484d7f-qnpwr"
May 25 11:30:08.904151 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:30:08.904040    2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/8afc5e54-3254-46c1-b952-a63f6ec47c41-manager-config\") pod \"lws-controller-manager-8646484d7f-qnpwr\" (UID: \"8afc5e54-3254-46c1-b952-a63f6ec47c41\") " pod="openshift-lws-operator/lws-controller-manager-8646484d7f-qnpwr"
May 25 11:30:08.904151 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:30:08.904081    2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/8afc5e54-3254-46c1-b952-a63f6ec47c41-metrics-cert\") pod \"lws-controller-manager-8646484d7f-qnpwr\" (UID: \"8afc5e54-3254-46c1-b952-a63f6ec47c41\") " pod="openshift-lws-operator/lws-controller-manager-8646484d7f-qnpwr"
May 25 11:30:08.904719 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:30:08.904692    2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/8afc5e54-3254-46c1-b952-a63f6ec47c41-manager-config\") pod \"lws-controller-manager-8646484d7f-qnpwr\" (UID: \"8afc5e54-3254-46c1-b952-a63f6ec47c41\") " pod="openshift-lws-operator/lws-controller-manager-8646484d7f-qnpwr"
May 25 11:30:08.906491 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:30:08.906469    2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/8afc5e54-3254-46c1-b952-a63f6ec47c41-metrics-cert\") pod \"lws-controller-manager-8646484d7f-qnpwr\" (UID: \"8afc5e54-3254-46c1-b952-a63f6ec47c41\") " pod="openshift-lws-operator/lws-controller-manager-8646484d7f-qnpwr"
May 25 11:30:08.906576 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:30:08.906502    2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/8afc5e54-3254-46c1-b952-a63f6ec47c41-cert\") pod \"lws-controller-manager-8646484d7f-qnpwr\" (UID: \"8afc5e54-3254-46c1-b952-a63f6ec47c41\") " pod="openshift-lws-operator/lws-controller-manager-8646484d7f-qnpwr"
May 25 11:30:08.916087 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:30:08.916052    2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6zgt7\" (UniqueName: \"kubernetes.io/projected/8afc5e54-3254-46c1-b952-a63f6ec47c41-kube-api-access-6zgt7\") pod \"lws-controller-manager-8646484d7f-qnpwr\" (UID: \"8afc5e54-3254-46c1-b952-a63f6ec47c41\") " pod="openshift-lws-operator/lws-controller-manager-8646484d7f-qnpwr"
May 25 11:30:09.070120 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:30:09.070049    2545 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-8646484d7f-qnpwr"
May 25 11:30:09.210253 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:30:09.210228    2545 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-8646484d7f-qnpwr"]
May 25 11:30:09.212017 ip-10-0-128-206 kubenswrapper[2545]: W0525 11:30:09.211993    2545 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8afc5e54_3254_46c1_b952_a63f6ec47c41.slice/crio-81a0365385233cc0a297ed238c04e8419661624b12ed19ab0e036113b37fa321 WatchSource:0}: Error finding container 81a0365385233cc0a297ed238c04e8419661624b12ed19ab0e036113b37fa321: Status 404 returned error can't find the container with id 81a0365385233cc0a297ed238c04e8419661624b12ed19ab0e036113b37fa321
May 25 11:30:10.110753 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:30:10.110169    2545 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-8646484d7f-qnpwr" event={"ID":"8afc5e54-3254-46c1-b952-a63f6ec47c41","Type":"ContainerStarted","Data":"81a0365385233cc0a297ed238c04e8419661624b12ed19ab0e036113b37fa321"}
May 25 11:30:12.118768 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:30:12.118733    2545 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-8646484d7f-qnpwr" event={"ID":"8afc5e54-3254-46c1-b952-a63f6ec47c41","Type":"ContainerStarted","Data":"42258458ced1cc26752935099c6d416a18580334eb044e1c5aba71f71b5d96b1"}
May 25 11:30:12.119224 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:30:12.118837    2545 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-8646484d7f-qnpwr"
May 25 11:30:12.144594 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:30:12.144551    2545 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-8646484d7f-qnpwr" podStartSLOduration=1.329041924 podStartE2EDuration="4.144536584s" podCreationTimestamp="2026-05-25 11:30:08 +0000 UTC" firstStartedPulling="2026-05-25 11:30:09.213721065 +0000 UTC m=+400.980005990" lastFinishedPulling="2026-05-25 11:30:12.029215725 +0000 UTC m=+403.795500650" observedRunningTime="2026-05-25 11:30:12.143308448 +0000 UTC m=+403.909593399" watchObservedRunningTime="2026-05-25 11:30:12.144536584 +0000 UTC m=+403.910821529"
May 25 11:30:23.124366 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:30:23.124330    2545 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-8646484d7f-qnpwr"
May 25 11:31:07.084078 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:31:07.084044    2545 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-57dd85bb4-v6rrw"]
May 25 11:31:07.086383 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:31:07.086366    2545 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-57dd85bb4-v6rrw"
May 25 11:31:07.090139 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:31:07.090116    2545 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
May 25 11:31:07.090252 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:31:07.090171    2545 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
May 25 11:31:07.090570 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:31:07.090550    2545 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-wdt6v\""
May 25 11:31:07.102230 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:31:07.102209    2545 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-57dd85bb4-v6rrw"]
May 25 11:31:07.207325 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:31:07.207287    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/3b60dce9-0ee6-439b-ac2b-9f58afb192ad-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-57dd85bb4-v6rrw\" (UID: \"3b60dce9-0ee6-439b-ac2b-9f58afb192ad\") " pod="kuadrant-system/kuadrant-operator-controller-manager-57dd85bb4-v6rrw"
May 25 11:31:07.207492 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:31:07.207419    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rmqmn\" (UniqueName: \"kubernetes.io/projected/3b60dce9-0ee6-439b-ac2b-9f58afb192ad-kube-api-access-rmqmn\") pod \"kuadrant-operator-controller-manager-57dd85bb4-v6rrw\" (UID: \"3b60dce9-0ee6-439b-ac2b-9f58afb192ad\") " pod="kuadrant-system/kuadrant-operator-controller-manager-57dd85bb4-v6rrw"
May 25 11:31:07.308045 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:31:07.308009    2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/3b60dce9-0ee6-439b-ac2b-9f58afb192ad-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-57dd85bb4-v6rrw\" (UID: \"3b60dce9-0ee6-439b-ac2b-9f58afb192ad\") " pod="kuadrant-system/kuadrant-operator-controller-manager-57dd85bb4-v6rrw"
May 25 11:31:07.308226 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:31:07.308106    2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-rmqmn\" (UniqueName: \"kubernetes.io/projected/3b60dce9-0ee6-439b-ac2b-9f58afb192ad-kube-api-access-rmqmn\") pod \"kuadrant-operator-controller-manager-57dd85bb4-v6rrw\" (UID: \"3b60dce9-0ee6-439b-ac2b-9f58afb192ad\") " pod="kuadrant-system/kuadrant-operator-controller-manager-57dd85bb4-v6rrw"
May 25 11:31:07.308388 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:31:07.308368    2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/3b60dce9-0ee6-439b-ac2b-9f58afb192ad-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-57dd85bb4-v6rrw\" (UID: \"3b60dce9-0ee6-439b-ac2b-9f58afb192ad\") " pod="kuadrant-system/kuadrant-operator-controller-manager-57dd85bb4-v6rrw"
May 25 11:31:07.335692 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:31:07.335623    2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rmqmn\" (UniqueName: \"kubernetes.io/projected/3b60dce9-0ee6-439b-ac2b-9f58afb192ad-kube-api-access-rmqmn\") pod \"kuadrant-operator-controller-manager-57dd85bb4-v6rrw\" (UID: \"3b60dce9-0ee6-439b-ac2b-9f58afb192ad\") " pod="kuadrant-system/kuadrant-operator-controller-manager-57dd85bb4-v6rrw"
May 25 11:31:07.396257 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:31:07.396223    2545 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-57dd85bb4-v6rrw"
May 25 11:31:07.552179 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:31:07.552140    2545 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-57dd85bb4-v6rrw"]
May 25 11:31:07.555712 ip-10-0-128-206 kubenswrapper[2545]: W0525 11:31:07.555685    2545 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3b60dce9_0ee6_439b_ac2b_9f58afb192ad.slice/crio-1a3ec633e2e02569aa0cc9a470fa39be439ac899f2b9eb64fae351ab93e430c6 WatchSource:0}: Error finding container 1a3ec633e2e02569aa0cc9a470fa39be439ac899f2b9eb64fae351ab93e430c6: Status 404 returned error can't find the container with id 1a3ec633e2e02569aa0cc9a470fa39be439ac899f2b9eb64fae351ab93e430c6
May 25 11:31:08.290634 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:31:08.290599    2545 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-57dd85bb4-v6rrw" event={"ID":"3b60dce9-0ee6-439b-ac2b-9f58afb192ad","Type":"ContainerStarted","Data":"1a3ec633e2e02569aa0cc9a470fa39be439ac899f2b9eb64fae351ab93e430c6"}
May 25 11:31:13.310277 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:31:13.310238    2545 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-57dd85bb4-v6rrw" event={"ID":"3b60dce9-0ee6-439b-ac2b-9f58afb192ad","Type":"ContainerStarted","Data":"1ca3f6ae87693ac4bdebff0a6337f5f2e897668978043ce819deda85c8400e1d"}
May 25 11:31:13.310615 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:31:13.310333    2545 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-57dd85bb4-v6rrw"
May 25 11:31:13.340478 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:31:13.340433    2545 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-57dd85bb4-v6rrw" podStartSLOduration=0.76576674 podStartE2EDuration="6.340419032s" podCreationTimestamp="2026-05-25 11:31:07 +0000 UTC" firstStartedPulling="2026-05-25 11:31:07.558019929 +0000 UTC m=+459.324304852" lastFinishedPulling="2026-05-25 11:31:13.132672215 +0000 UTC m=+464.898957144" observedRunningTime="2026-05-25 11:31:13.337993689 +0000 UTC m=+465.104278635" watchObservedRunningTime="2026-05-25 11:31:13.340419032 +0000 UTC m=+465.106703978"
May 25 11:31:24.315267 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:31:24.315236    2545 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-57dd85bb4-v6rrw"
May 25 11:31:58.463433 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:31:58.463401    2545 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-67566c68b4-ts9hg"]
May 25 11:31:58.465979 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:31:58.465936    2545 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-67566c68b4-ts9hg"
May 25 11:31:58.468477 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:31:58.468456    2545 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\""
May 25 11:31:58.468584 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:31:58.468519    2545 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-26pd8\""
May 25 11:31:58.473885 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:31:58.473862    2545 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-67566c68b4-ts9hg"]
May 25 11:31:58.500555 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:31:58.500525    2545 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-67566c68b4-ts9hg"]
May 25 11:31:58.522452 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:31:58.522430    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/f4dc404f-a9c2-4816-a1ff-20a38b91b340-config-file\") pod \"limitador-limitador-67566c68b4-ts9hg\" (UID: \"f4dc404f-a9c2-4816-a1ff-20a38b91b340\") " pod="kuadrant-system/limitador-limitador-67566c68b4-ts9hg"
May 25 11:31:58.522540 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:31:58.522475    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fnx47\" (UniqueName: \"kubernetes.io/projected/f4dc404f-a9c2-4816-a1ff-20a38b91b340-kube-api-access-fnx47\") pod \"limitador-limitador-67566c68b4-ts9hg\" (UID: \"f4dc404f-a9c2-4816-a1ff-20a38b91b340\") " pod="kuadrant-system/limitador-limitador-67566c68b4-ts9hg"
May 25 11:31:58.623797 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:31:58.623765    2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/f4dc404f-a9c2-4816-a1ff-20a38b91b340-config-file\") pod \"limitador-limitador-67566c68b4-ts9hg\" (UID: \"f4dc404f-a9c2-4816-a1ff-20a38b91b340\") " pod="kuadrant-system/limitador-limitador-67566c68b4-ts9hg"
May 25 11:31:58.623935 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:31:58.623815    2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-fnx47\" (UniqueName: \"kubernetes.io/projected/f4dc404f-a9c2-4816-a1ff-20a38b91b340-kube-api-access-fnx47\") pod \"limitador-limitador-67566c68b4-ts9hg\" (UID: \"f4dc404f-a9c2-4816-a1ff-20a38b91b340\") " pod="kuadrant-system/limitador-limitador-67566c68b4-ts9hg"
May 25 11:31:58.624382 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:31:58.624363    2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/f4dc404f-a9c2-4816-a1ff-20a38b91b340-config-file\") pod \"limitador-limitador-67566c68b4-ts9hg\" (UID: \"f4dc404f-a9c2-4816-a1ff-20a38b91b340\") " pod="kuadrant-system/limitador-limitador-67566c68b4-ts9hg"
May 25 11:31:58.632204 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:31:58.632184    2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fnx47\" (UniqueName: \"kubernetes.io/projected/f4dc404f-a9c2-4816-a1ff-20a38b91b340-kube-api-access-fnx47\") pod \"limitador-limitador-67566c68b4-ts9hg\" (UID: \"f4dc404f-a9c2-4816-a1ff-20a38b91b340\") " pod="kuadrant-system/limitador-limitador-67566c68b4-ts9hg"
May 25 11:31:58.777545 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:31:58.777518    2545 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-67566c68b4-ts9hg"
May 25 11:31:58.903945 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:31:58.903921    2545 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-67566c68b4-ts9hg"]
May 25 11:31:58.906128 ip-10-0-128-206 kubenswrapper[2545]: W0525 11:31:58.906099    2545 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf4dc404f_a9c2_4816_a1ff_20a38b91b340.slice/crio-d8eff4f6897f874d14e36228884cee6e62edec5f6ba1902828fd1636120bda63 WatchSource:0}: Error finding container d8eff4f6897f874d14e36228884cee6e62edec5f6ba1902828fd1636120bda63: Status 404 returned error can't find the container with id d8eff4f6897f874d14e36228884cee6e62edec5f6ba1902828fd1636120bda63
May 25 11:31:59.465621 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:31:59.465586    2545 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-67566c68b4-ts9hg" event={"ID":"f4dc404f-a9c2-4816-a1ff-20a38b91b340","Type":"ContainerStarted","Data":"d8eff4f6897f874d14e36228884cee6e62edec5f6ba1902828fd1636120bda63"}
May 25 11:32:03.481901 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:32:03.481866    2545 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-67566c68b4-ts9hg" event={"ID":"f4dc404f-a9c2-4816-a1ff-20a38b91b340","Type":"ContainerStarted","Data":"fcf49f39d2a8d3108802aa24b2d84642803d0bb031ee90e636b79201c03027be"}
May 25 11:32:03.482308 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:32:03.481926    2545 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-67566c68b4-ts9hg"
May 25 11:32:03.505210 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:32:03.505163    2545 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-67566c68b4-ts9hg" podStartSLOduration=1.642030043 podStartE2EDuration="5.505149227s" podCreationTimestamp="2026-05-25 11:31:58 +0000 UTC" firstStartedPulling="2026-05-25 11:31:58.90836914 +0000 UTC m=+510.674654066" lastFinishedPulling="2026-05-25 11:32:02.771488313 +0000 UTC m=+514.537773250" observedRunningTime="2026-05-25 11:32:03.503738997 +0000 UTC m=+515.270023941" watchObservedRunningTime="2026-05-25 11:32:03.505149227 +0000 UTC m=+515.271434173"
May 25 11:32:14.486264 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:32:14.486181    2545 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-67566c68b4-ts9hg"
May 25 11:33:28.686585 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:33:28.686551    2545 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-krfmt_4e27bcd6-c257-422b-a332-0df274cf6fcc/ovn-acl-logging/0.log"
May 25 11:33:28.688636 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:33:28.688619    2545 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-krfmt_4e27bcd6-c257-422b-a332-0df274cf6fcc/ovn-acl-logging/0.log"
May 25 11:34:51.136806 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:34:51.136776    2545 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/gw-section-name-router-with-gat-2f0a622e-kserve-684d6648fd69j6q"]
May 25 11:34:51.139335 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:34:51.139317    2545 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/gw-section-name-router-with-gat-2f0a622e-kserve-684d6648fd69j6q"
May 25 11:34:51.142406 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:34:51.142385    2545 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"gw-sec0c69dceeb48768325d1a53a749e65786-kserve-self-signed-certs\""
May 25 11:34:51.143782 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:34:51.143761    2545 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"kube-root-ca.crt\""
May 25 11:34:51.143884 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:34:51.143857    2545 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"openshift-service-ca.crt\""
May 25 11:34:51.143949 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:34:51.143900    2545 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"default-dockercfg-vcvlw\""
May 25 11:34:51.156678 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:34:51.156659    2545 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/gw-section-name-router-with-gat-2f0a622e-kserve-684d6648fd69j6q"]
May 25 11:34:51.160369 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:34:51.160350    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3ea24468-5903-417f-a01b-1aa7a9c3c6ff-model-cache\") pod \"gw-section-name-router-with-gat-2f0a622e-kserve-684d6648fd69j6q\" (UID: \"3ea24468-5903-417f-a01b-1aa7a9c3c6ff\") " pod="kserve-ci-e2e-test/gw-section-name-router-with-gat-2f0a622e-kserve-684d6648fd69j6q"
May 25 11:34:51.160451 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:34:51.160383    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/3ea24468-5903-417f-a01b-1aa7a9c3c6ff-kserve-provision-location\") pod \"gw-section-name-router-with-gat-2f0a622e-kserve-684d6648fd69j6q\" (UID: \"3ea24468-5903-417f-a01b-1aa7a9c3c6ff\") " pod="kserve-ci-e2e-test/gw-section-name-router-with-gat-2f0a622e-kserve-684d6648fd69j6q"
May 25 11:34:51.160451 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:34:51.160417    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3ea24468-5903-417f-a01b-1aa7a9c3c6ff-home\") pod \"gw-section-name-router-with-gat-2f0a622e-kserve-684d6648fd69j6q\" (UID: \"3ea24468-5903-417f-a01b-1aa7a9c3c6ff\") " pod="kserve-ci-e2e-test/gw-section-name-router-with-gat-2f0a622e-kserve-684d6648fd69j6q"
May 25 11:34:51.160451 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:34:51.160442    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3ea24468-5903-417f-a01b-1aa7a9c3c6ff-dshm\") pod \"gw-section-name-router-with-gat-2f0a622e-kserve-684d6648fd69j6q\" (UID: \"3ea24468-5903-417f-a01b-1aa7a9c3c6ff\") " pod="kserve-ci-e2e-test/gw-section-name-router-with-gat-2f0a622e-kserve-684d6648fd69j6q"
May 25 11:34:51.160553 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:34:51.160503    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3ea24468-5903-417f-a01b-1aa7a9c3c6ff-tmp-dir\") pod \"gw-section-name-router-with-gat-2f0a622e-kserve-684d6648fd69j6q\" (UID: \"3ea24468-5903-417f-a01b-1aa7a9c3c6ff\") " pod="kserve-ci-e2e-test/gw-section-name-router-with-gat-2f0a622e-kserve-684d6648fd69j6q"
May 25 11:34:51.160640 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:34:51.160618    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-44nvt\" (UniqueName: \"kubernetes.io/projected/3ea24468-5903-417f-a01b-1aa7a9c3c6ff-kube-api-access-44nvt\") pod \"gw-section-name-router-with-gat-2f0a622e-kserve-684d6648fd69j6q\" (UID: \"3ea24468-5903-417f-a01b-1aa7a9c3c6ff\") " pod="kserve-ci-e2e-test/gw-section-name-router-with-gat-2f0a622e-kserve-684d6648fd69j6q"
May 25 11:34:51.160685 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:34:51.160668    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3ea24468-5903-417f-a01b-1aa7a9c3c6ff-tls-certs\") pod \"gw-section-name-router-with-gat-2f0a622e-kserve-684d6648fd69j6q\" (UID: \"3ea24468-5903-417f-a01b-1aa7a9c3c6ff\") " pod="kserve-ci-e2e-test/gw-section-name-router-with-gat-2f0a622e-kserve-684d6648fd69j6q"
May 25 11:34:51.261693 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:34:51.261656    2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-44nvt\" (UniqueName: \"kubernetes.io/projected/3ea24468-5903-417f-a01b-1aa7a9c3c6ff-kube-api-access-44nvt\") pod \"gw-section-name-router-with-gat-2f0a622e-kserve-684d6648fd69j6q\" (UID: \"3ea24468-5903-417f-a01b-1aa7a9c3c6ff\") " pod="kserve-ci-e2e-test/gw-section-name-router-with-gat-2f0a622e-kserve-684d6648fd69j6q"
May 25 11:34:51.261870 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:34:51.261706    2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3ea24468-5903-417f-a01b-1aa7a9c3c6ff-tls-certs\") pod \"gw-section-name-router-with-gat-2f0a622e-kserve-684d6648fd69j6q\" (UID: \"3ea24468-5903-417f-a01b-1aa7a9c3c6ff\") " pod="kserve-ci-e2e-test/gw-section-name-router-with-gat-2f0a622e-kserve-684d6648fd69j6q"
May 25 11:34:51.261870 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:34:51.261734    2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3ea24468-5903-417f-a01b-1aa7a9c3c6ff-model-cache\") pod \"gw-section-name-router-with-gat-2f0a622e-kserve-684d6648fd69j6q\" (UID: \"3ea24468-5903-417f-a01b-1aa7a9c3c6ff\") " pod="kserve-ci-e2e-test/gw-section-name-router-with-gat-2f0a622e-kserve-684d6648fd69j6q"
May 25 11:34:51.261870 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:34:51.261765    2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/3ea24468-5903-417f-a01b-1aa7a9c3c6ff-kserve-provision-location\") pod \"gw-section-name-router-with-gat-2f0a622e-kserve-684d6648fd69j6q\" (UID: \"3ea24468-5903-417f-a01b-1aa7a9c3c6ff\") " pod="kserve-ci-e2e-test/gw-section-name-router-with-gat-2f0a622e-kserve-684d6648fd69j6q"
May 25 11:34:51.261870 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:34:51.261811    2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3ea24468-5903-417f-a01b-1aa7a9c3c6ff-home\") pod \"gw-section-name-router-with-gat-2f0a622e-kserve-684d6648fd69j6q\" (UID: \"3ea24468-5903-417f-a01b-1aa7a9c3c6ff\") " pod="kserve-ci-e2e-test/gw-section-name-router-with-gat-2f0a622e-kserve-684d6648fd69j6q"
May 25 11:34:51.261870 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:34:51.261834    2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3ea24468-5903-417f-a01b-1aa7a9c3c6ff-dshm\") pod \"gw-section-name-router-with-gat-2f0a622e-kserve-684d6648fd69j6q\" (UID: \"3ea24468-5903-417f-a01b-1aa7a9c3c6ff\") " pod="kserve-ci-e2e-test/gw-section-name-router-with-gat-2f0a622e-kserve-684d6648fd69j6q"
May 25 11:34:51.262152 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:34:51.261885    2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3ea24468-5903-417f-a01b-1aa7a9c3c6ff-tmp-dir\") pod \"gw-section-name-router-with-gat-2f0a622e-kserve-684d6648fd69j6q\" (UID: \"3ea24468-5903-417f-a01b-1aa7a9c3c6ff\") " pod="kserve-ci-e2e-test/gw-section-name-router-with-gat-2f0a622e-kserve-684d6648fd69j6q"
May 25 11:34:51.262211 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:34:51.262192    2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3ea24468-5903-417f-a01b-1aa7a9c3c6ff-model-cache\") pod \"gw-section-name-router-with-gat-2f0a622e-kserve-684d6648fd69j6q\" (UID: \"3ea24468-5903-417f-a01b-1aa7a9c3c6ff\") " pod="kserve-ci-e2e-test/gw-section-name-router-with-gat-2f0a622e-kserve-684d6648fd69j6q"
May 25 11:34:51.262265 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:34:51.262213    2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/3ea24468-5903-417f-a01b-1aa7a9c3c6ff-kserve-provision-location\") pod \"gw-section-name-router-with-gat-2f0a622e-kserve-684d6648fd69j6q\" (UID: \"3ea24468-5903-417f-a01b-1aa7a9c3c6ff\") " pod="kserve-ci-e2e-test/gw-section-name-router-with-gat-2f0a622e-kserve-684d6648fd69j6q"
May 25 11:34:51.262265 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:34:51.262248    2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3ea24468-5903-417f-a01b-1aa7a9c3c6ff-home\") pod \"gw-section-name-router-with-gat-2f0a622e-kserve-684d6648fd69j6q\" (UID: \"3ea24468-5903-417f-a01b-1aa7a9c3c6ff\") " pod="kserve-ci-e2e-test/gw-section-name-router-with-gat-2f0a622e-kserve-684d6648fd69j6q"
May 25 11:34:51.262374 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:34:51.262325    2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3ea24468-5903-417f-a01b-1aa7a9c3c6ff-tmp-dir\") pod \"gw-section-name-router-with-gat-2f0a622e-kserve-684d6648fd69j6q\" (UID: \"3ea24468-5903-417f-a01b-1aa7a9c3c6ff\") " pod="kserve-ci-e2e-test/gw-section-name-router-with-gat-2f0a622e-kserve-684d6648fd69j6q"
May 25 11:34:51.264098 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:34:51.264078    2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3ea24468-5903-417f-a01b-1aa7a9c3c6ff-dshm\") pod \"gw-section-name-router-with-gat-2f0a622e-kserve-684d6648fd69j6q\" (UID: \"3ea24468-5903-417f-a01b-1aa7a9c3c6ff\") " pod="kserve-ci-e2e-test/gw-section-name-router-with-gat-2f0a622e-kserve-684d6648fd69j6q"
May 25 11:34:51.264379 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:34:51.264359    2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3ea24468-5903-417f-a01b-1aa7a9c3c6ff-tls-certs\") pod \"gw-section-name-router-with-gat-2f0a622e-kserve-684d6648fd69j6q\" (UID: \"3ea24468-5903-417f-a01b-1aa7a9c3c6ff\") " pod="kserve-ci-e2e-test/gw-section-name-router-with-gat-2f0a622e-kserve-684d6648fd69j6q"
May 25 11:34:51.274236 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:34:51.274214    2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-44nvt\" (UniqueName: \"kubernetes.io/projected/3ea24468-5903-417f-a01b-1aa7a9c3c6ff-kube-api-access-44nvt\") pod \"gw-section-name-router-with-gat-2f0a622e-kserve-684d6648fd69j6q\" (UID: \"3ea24468-5903-417f-a01b-1aa7a9c3c6ff\") " pod="kserve-ci-e2e-test/gw-section-name-router-with-gat-2f0a622e-kserve-684d6648fd69j6q"
May 25 11:34:51.452347 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:34:51.452265    2545 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/gw-section-name-router-with-gat-2f0a622e-kserve-684d6648fd69j6q"
May 25 11:34:51.598586 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:34:51.598562    2545 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/gw-section-name-router-with-gat-2f0a622e-kserve-684d6648fd69j6q"]
May 25 11:34:51.601256 ip-10-0-128-206 kubenswrapper[2545]: W0525 11:34:51.601229    2545 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3ea24468_5903_417f_a01b_1aa7a9c3c6ff.slice/crio-0c417a1bb409ead504b5ea25013c3b5e7512a797e13816e5b3a5d84c082dcf8c WatchSource:0}: Error finding container 0c417a1bb409ead504b5ea25013c3b5e7512a797e13816e5b3a5d84c082dcf8c: Status 404 returned error can't find the container with id 0c417a1bb409ead504b5ea25013c3b5e7512a797e13816e5b3a5d84c082dcf8c
May 25 11:34:51.603049 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:34:51.603033    2545 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
May 25 11:34:52.049911 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:34:52.049873    2545 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/gw-section-name-router-with-gat-2f0a622e-kserve-684d6648fd69j6q" event={"ID":"3ea24468-5903-417f-a01b-1aa7a9c3c6ff","Type":"ContainerStarted","Data":"0c417a1bb409ead504b5ea25013c3b5e7512a797e13816e5b3a5d84c082dcf8c"}
May 25 11:34:56.065138 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:34:56.065101    2545 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/gw-section-name-router-with-gat-2f0a622e-kserve-684d6648fd69j6q" event={"ID":"3ea24468-5903-417f-a01b-1aa7a9c3c6ff","Type":"ContainerStarted","Data":"58959df03c3061399794eed9204c1d429f6a207c3b11e9568edefcca3d97b613"}
May 25 11:35:01.081841 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:35:01.081810    2545 generic.go:358] "Generic (PLEG): container finished" podID="3ea24468-5903-417f-a01b-1aa7a9c3c6ff" containerID="58959df03c3061399794eed9204c1d429f6a207c3b11e9568edefcca3d97b613" exitCode=0
May 25 11:35:01.082271 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:35:01.081884    2545 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/gw-section-name-router-with-gat-2f0a622e-kserve-684d6648fd69j6q" event={"ID":"3ea24468-5903-417f-a01b-1aa7a9c3c6ff","Type":"ContainerDied","Data":"58959df03c3061399794eed9204c1d429f6a207c3b11e9568edefcca3d97b613"}
May 25 11:35:03.093717 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:35:03.093678    2545 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/gw-section-name-router-with-gat-2f0a622e-kserve-684d6648fd69j6q" event={"ID":"3ea24468-5903-417f-a01b-1aa7a9c3c6ff","Type":"ContainerStarted","Data":"a61ae40a26fedbf7d6af5c944691ae119a78dfd91b21e1cb512085888bff4e42"}
May 25 11:35:04.326875 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:35:04.326819    2545 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kserve-ci-e2e-test/gw-section-name-router-with-gat-2f0a622e-kserve-684d6648fd69j6q" podStartSLOduration=2.6957287880000003 podStartE2EDuration="13.326805323s" podCreationTimestamp="2026-05-25 11:34:51 +0000 UTC" firstStartedPulling="2026-05-25 11:34:51.603164521 +0000 UTC m=+683.369449445" lastFinishedPulling="2026-05-25 11:35:02.234241052 +0000 UTC m=+694.000525980" observedRunningTime="2026-05-25 11:35:03.14317219 +0000 UTC m=+694.909457135" watchObservedRunningTime="2026-05-25 11:35:04.326805323 +0000 UTC m=+696.093090270"
May 25 11:35:04.327985 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:35:04.327939    2545 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/gw-section-name-router-with-gat-2f0a622e-kserve-684d6648fd69j6q"]
May 25 11:35:04.328203 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:35:04.328181    2545 kuberuntime_container.go:864] "Killing container with a grace period" pod="kserve-ci-e2e-test/gw-section-name-router-with-gat-2f0a622e-kserve-684d6648fd69j6q" podUID="3ea24468-5903-417f-a01b-1aa7a9c3c6ff" containerName="main" containerID="cri-o://a61ae40a26fedbf7d6af5c944691ae119a78dfd91b21e1cb512085888bff4e42" gracePeriod=30
May 25 11:35:04.579303 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:35:04.579248    2545 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/gw-section-name-router-with-gat-2f0a622e-kserve-684d6648fd69j6q"
May 25 11:35:04.684377 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:35:04.684344    2545 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3ea24468-5903-417f-a01b-1aa7a9c3c6ff-tls-certs\") pod \"3ea24468-5903-417f-a01b-1aa7a9c3c6ff\" (UID: \"3ea24468-5903-417f-a01b-1aa7a9c3c6ff\") "
May 25 11:35:04.684554 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:35:04.684394    2545 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3ea24468-5903-417f-a01b-1aa7a9c3c6ff-tmp-dir\") pod \"3ea24468-5903-417f-a01b-1aa7a9c3c6ff\" (UID: \"3ea24468-5903-417f-a01b-1aa7a9c3c6ff\") "
May 25 11:35:04.684554 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:35:04.684423    2545 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-44nvt\" (UniqueName: \"kubernetes.io/projected/3ea24468-5903-417f-a01b-1aa7a9c3c6ff-kube-api-access-44nvt\") pod \"3ea24468-5903-417f-a01b-1aa7a9c3c6ff\" (UID: \"3ea24468-5903-417f-a01b-1aa7a9c3c6ff\") "
May 25 11:35:04.684554 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:35:04.684446    2545 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3ea24468-5903-417f-a01b-1aa7a9c3c6ff-model-cache\") pod \"3ea24468-5903-417f-a01b-1aa7a9c3c6ff\" (UID: \"3ea24468-5903-417f-a01b-1aa7a9c3c6ff\") "
May 25 11:35:04.684554 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:35:04.684472    2545 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3ea24468-5903-417f-a01b-1aa7a9c3c6ff-dshm\") pod \"3ea24468-5903-417f-a01b-1aa7a9c3c6ff\" (UID: \"3ea24468-5903-417f-a01b-1aa7a9c3c6ff\") "
May 25 11:35:04.684554 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:35:04.684489    2545 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3ea24468-5903-417f-a01b-1aa7a9c3c6ff-home\") pod \"3ea24468-5903-417f-a01b-1aa7a9c3c6ff\" (UID: \"3ea24468-5903-417f-a01b-1aa7a9c3c6ff\") "
May 25 11:35:04.684554 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:35:04.684505    2545 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/3ea24468-5903-417f-a01b-1aa7a9c3c6ff-kserve-provision-location\") pod \"3ea24468-5903-417f-a01b-1aa7a9c3c6ff\" (UID: \"3ea24468-5903-417f-a01b-1aa7a9c3c6ff\") "
May 25 11:35:04.684872 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:35:04.684758    2545 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3ea24468-5903-417f-a01b-1aa7a9c3c6ff-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "3ea24468-5903-417f-a01b-1aa7a9c3c6ff" (UID: "3ea24468-5903-417f-a01b-1aa7a9c3c6ff"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 25 11:35:04.684872 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:35:04.684789    2545 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3ea24468-5903-417f-a01b-1aa7a9c3c6ff-model-cache" (OuterVolumeSpecName: "model-cache") pod "3ea24468-5903-417f-a01b-1aa7a9c3c6ff" (UID: "3ea24468-5903-417f-a01b-1aa7a9c3c6ff"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 25 11:35:04.684872 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:35:04.684771    2545 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3ea24468-5903-417f-a01b-1aa7a9c3c6ff-home" (OuterVolumeSpecName: "home") pod "3ea24468-5903-417f-a01b-1aa7a9c3c6ff" (UID: "3ea24468-5903-417f-a01b-1aa7a9c3c6ff"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 25 11:35:04.686753 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:35:04.686726    2545 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3ea24468-5903-417f-a01b-1aa7a9c3c6ff-kube-api-access-44nvt" (OuterVolumeSpecName: "kube-api-access-44nvt") pod "3ea24468-5903-417f-a01b-1aa7a9c3c6ff" (UID: "3ea24468-5903-417f-a01b-1aa7a9c3c6ff"). InnerVolumeSpecName "kube-api-access-44nvt". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 25 11:35:04.687026 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:35:04.687004    2545 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3ea24468-5903-417f-a01b-1aa7a9c3c6ff-dshm" (OuterVolumeSpecName: "dshm") pod "3ea24468-5903-417f-a01b-1aa7a9c3c6ff" (UID: "3ea24468-5903-417f-a01b-1aa7a9c3c6ff"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 25 11:35:04.687026 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:35:04.687020    2545 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3ea24468-5903-417f-a01b-1aa7a9c3c6ff-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "3ea24468-5903-417f-a01b-1aa7a9c3c6ff" (UID: "3ea24468-5903-417f-a01b-1aa7a9c3c6ff"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 25 11:35:04.751647 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:35:04.751607    2545 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3ea24468-5903-417f-a01b-1aa7a9c3c6ff-kserve-provision-location" (OuterVolumeSpecName: "kserve-provision-location") pod "3ea24468-5903-417f-a01b-1aa7a9c3c6ff" (UID: "3ea24468-5903-417f-a01b-1aa7a9c3c6ff"). InnerVolumeSpecName "kserve-provision-location". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 25 11:35:04.785614 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:35:04.785592    2545 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3ea24468-5903-417f-a01b-1aa7a9c3c6ff-tls-certs\") on node \"ip-10-0-128-206.ec2.internal\" DevicePath \"\""
May 25 11:35:04.785614 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:35:04.785615    2545 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3ea24468-5903-417f-a01b-1aa7a9c3c6ff-tmp-dir\") on node \"ip-10-0-128-206.ec2.internal\" DevicePath \"\""
May 25 11:35:04.785748 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:35:04.785625    2545 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-44nvt\" (UniqueName: \"kubernetes.io/projected/3ea24468-5903-417f-a01b-1aa7a9c3c6ff-kube-api-access-44nvt\") on node \"ip-10-0-128-206.ec2.internal\" DevicePath \"\""
May 25 11:35:04.785748 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:35:04.785634    2545 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3ea24468-5903-417f-a01b-1aa7a9c3c6ff-model-cache\") on node \"ip-10-0-128-206.ec2.internal\" DevicePath \"\""
May 25 11:35:04.785748 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:35:04.785643    2545 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3ea24468-5903-417f-a01b-1aa7a9c3c6ff-dshm\") on node \"ip-10-0-128-206.ec2.internal\" DevicePath \"\""
May 25 11:35:04.785748 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:35:04.785651    2545 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3ea24468-5903-417f-a01b-1aa7a9c3c6ff-home\") on node \"ip-10-0-128-206.ec2.internal\" DevicePath \"\""
May 25 11:35:04.785748 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:35:04.785659    2545 reconciler_common.go:299] "Volume detached for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/3ea24468-5903-417f-a01b-1aa7a9c3c6ff-kserve-provision-location\") on node \"ip-10-0-128-206.ec2.internal\" DevicePath \"\""
May 25 11:35:05.102551 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:35:05.102518    2545 generic.go:358] "Generic (PLEG): container finished" podID="3ea24468-5903-417f-a01b-1aa7a9c3c6ff" containerID="a61ae40a26fedbf7d6af5c944691ae119a78dfd91b21e1cb512085888bff4e42" exitCode=0
May 25 11:35:05.102715 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:35:05.102589    2545 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/gw-section-name-router-with-gat-2f0a622e-kserve-684d6648fd69j6q"
May 25 11:35:05.102715 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:35:05.102597    2545 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/gw-section-name-router-with-gat-2f0a622e-kserve-684d6648fd69j6q" event={"ID":"3ea24468-5903-417f-a01b-1aa7a9c3c6ff","Type":"ContainerDied","Data":"a61ae40a26fedbf7d6af5c944691ae119a78dfd91b21e1cb512085888bff4e42"}
May 25 11:35:05.102715 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:35:05.102636    2545 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/gw-section-name-router-with-gat-2f0a622e-kserve-684d6648fd69j6q" event={"ID":"3ea24468-5903-417f-a01b-1aa7a9c3c6ff","Type":"ContainerDied","Data":"0c417a1bb409ead504b5ea25013c3b5e7512a797e13816e5b3a5d84c082dcf8c"}
May 25 11:35:05.102715 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:35:05.102657    2545 scope.go:117] "RemoveContainer" containerID="a61ae40a26fedbf7d6af5c944691ae119a78dfd91b21e1cb512085888bff4e42"
May 25 11:35:05.111063 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:35:05.111044    2545 scope.go:117] "RemoveContainer" containerID="58959df03c3061399794eed9204c1d429f6a207c3b11e9568edefcca3d97b613"
May 25 11:35:05.138345 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:35:05.138310    2545 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/gw-section-name-router-with-gat-2f0a622e-kserve-684d6648fd69j6q"]
May 25 11:35:05.140692 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:35:05.140671    2545 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/gw-section-name-router-with-gat-2f0a622e-kserve-684d6648fd69j6q"]
May 25 11:35:05.187866 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:35:05.187844    2545 scope.go:117] "RemoveContainer" containerID="a61ae40a26fedbf7d6af5c944691ae119a78dfd91b21e1cb512085888bff4e42"
May 25 11:35:05.188262 ip-10-0-128-206 kubenswrapper[2545]: E0525 11:35:05.188243    2545 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a61ae40a26fedbf7d6af5c944691ae119a78dfd91b21e1cb512085888bff4e42\": container with ID starting with a61ae40a26fedbf7d6af5c944691ae119a78dfd91b21e1cb512085888bff4e42 not found: ID does not exist" containerID="a61ae40a26fedbf7d6af5c944691ae119a78dfd91b21e1cb512085888bff4e42"
May 25 11:35:05.188309 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:35:05.188273    2545 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a61ae40a26fedbf7d6af5c944691ae119a78dfd91b21e1cb512085888bff4e42"} err="failed to get container status \"a61ae40a26fedbf7d6af5c944691ae119a78dfd91b21e1cb512085888bff4e42\": rpc error: code = NotFound desc = could not find container \"a61ae40a26fedbf7d6af5c944691ae119a78dfd91b21e1cb512085888bff4e42\": container with ID starting with a61ae40a26fedbf7d6af5c944691ae119a78dfd91b21e1cb512085888bff4e42 not found: ID does not exist"
May 25 11:35:05.188309 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:35:05.188294    2545 scope.go:117] "RemoveContainer" containerID="58959df03c3061399794eed9204c1d429f6a207c3b11e9568edefcca3d97b613"
May 25 11:35:05.188558 ip-10-0-128-206 kubenswrapper[2545]: E0525 11:35:05.188537    2545 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"58959df03c3061399794eed9204c1d429f6a207c3b11e9568edefcca3d97b613\": container with ID starting with 58959df03c3061399794eed9204c1d429f6a207c3b11e9568edefcca3d97b613 not found: ID does not exist" containerID="58959df03c3061399794eed9204c1d429f6a207c3b11e9568edefcca3d97b613"
May 25 11:35:05.188591 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:35:05.188566    2545 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"58959df03c3061399794eed9204c1d429f6a207c3b11e9568edefcca3d97b613"} err="failed to get container status \"58959df03c3061399794eed9204c1d429f6a207c3b11e9568edefcca3d97b613\": rpc error: code = NotFound desc = could not find container \"58959df03c3061399794eed9204c1d429f6a207c3b11e9568edefcca3d97b613\": container with ID starting with 58959df03c3061399794eed9204c1d429f6a207c3b11e9568edefcca3d97b613 not found: ID does not exist"
May 25 11:35:06.774924 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:35:06.774887    2545 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3ea24468-5903-417f-a01b-1aa7a9c3c6ff" path="/var/lib/kubelet/pods/3ea24468-5903-417f-a01b-1aa7a9c3c6ff/volumes"
May 25 11:35:27.323591 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:35:27.323518    2545 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/gw-section-name-router-with-gat-f1d92d0f-kserve-8465c5bff7tvnbd"]
May 25 11:35:27.324030 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:35:27.323856    2545 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3ea24468-5903-417f-a01b-1aa7a9c3c6ff" containerName="storage-initializer"
May 25 11:35:27.324030 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:35:27.323868    2545 state_mem.go:107] "Deleted CPUSet assignment" podUID="3ea24468-5903-417f-a01b-1aa7a9c3c6ff" containerName="storage-initializer"
May 25 11:35:27.324030 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:35:27.323889    2545 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3ea24468-5903-417f-a01b-1aa7a9c3c6ff" containerName="main"
May 25 11:35:27.324030 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:35:27.323894    2545 state_mem.go:107] "Deleted CPUSet assignment" podUID="3ea24468-5903-417f-a01b-1aa7a9c3c6ff" containerName="main"
May 25 11:35:27.324030 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:35:27.323951    2545 memory_manager.go:356] "RemoveStaleState removing state" podUID="3ea24468-5903-417f-a01b-1aa7a9c3c6ff" containerName="main"
May 25 11:35:27.327227 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:35:27.327210    2545 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/gw-section-name-router-with-gat-f1d92d0f-kserve-8465c5bff7tvnbd"
May 25 11:35:27.331459 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:35:27.331437    2545 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"gw-sec2774c263d49959f50d9eebc552e13bf9-kserve-self-signed-certs\""
May 25 11:35:27.331992 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:35:27.331978    2545 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"openshift-service-ca.crt\""
May 25 11:35:27.332048 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:35:27.332013    2545 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"default-dockercfg-vcvlw\""
May 25 11:35:27.332552 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:35:27.332537    2545 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"kube-root-ca.crt\""
May 25 11:35:27.345023 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:35:27.344997    2545 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/gw-section-name-router-with-gat-f1d92d0f-kserve-8465c5bff7tvnbd"]
May 25 11:35:27.488381 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:35:27.488348    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9c7b2d91-c28d-4a0f-b6fd-0162f6ca58bd-model-cache\") pod \"gw-section-name-router-with-gat-f1d92d0f-kserve-8465c5bff7tvnbd\" (UID: \"9c7b2d91-c28d-4a0f-b6fd-0162f6ca58bd\") " pod="kserve-ci-e2e-test/gw-section-name-router-with-gat-f1d92d0f-kserve-8465c5bff7tvnbd"
May 25 11:35:27.488381 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:35:27.488382    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9c7b2d91-c28d-4a0f-b6fd-0162f6ca58bd-tmp-dir\") pod \"gw-section-name-router-with-gat-f1d92d0f-kserve-8465c5bff7tvnbd\" (UID: \"9c7b2d91-c28d-4a0f-b6fd-0162f6ca58bd\") " pod="kserve-ci-e2e-test/gw-section-name-router-with-gat-f1d92d0f-kserve-8465c5bff7tvnbd"
May 25 11:35:27.488586 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:35:27.488408    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/9c7b2d91-c28d-4a0f-b6fd-0162f6ca58bd-kserve-provision-location\") pod \"gw-section-name-router-with-gat-f1d92d0f-kserve-8465c5bff7tvnbd\" (UID: \"9c7b2d91-c28d-4a0f-b6fd-0162f6ca58bd\") " pod="kserve-ci-e2e-test/gw-section-name-router-with-gat-f1d92d0f-kserve-8465c5bff7tvnbd"
May 25 11:35:27.488586 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:35:27.488433    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9c7b2d91-c28d-4a0f-b6fd-0162f6ca58bd-home\") pod \"gw-section-name-router-with-gat-f1d92d0f-kserve-8465c5bff7tvnbd\" (UID: \"9c7b2d91-c28d-4a0f-b6fd-0162f6ca58bd\") " pod="kserve-ci-e2e-test/gw-section-name-router-with-gat-f1d92d0f-kserve-8465c5bff7tvnbd"
May 25 11:35:27.488586 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:35:27.488485    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9c7b2d91-c28d-4a0f-b6fd-0162f6ca58bd-dshm\") pod \"gw-section-name-router-with-gat-f1d92d0f-kserve-8465c5bff7tvnbd\" (UID: \"9c7b2d91-c28d-4a0f-b6fd-0162f6ca58bd\") " pod="kserve-ci-e2e-test/gw-section-name-router-with-gat-f1d92d0f-kserve-8465c5bff7tvnbd"
May 25 11:35:27.488586 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:35:27.488504    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9c7b2d91-c28d-4a0f-b6fd-0162f6ca58bd-tls-certs\") pod \"gw-section-name-router-with-gat-f1d92d0f-kserve-8465c5bff7tvnbd\" (UID: \"9c7b2d91-c28d-4a0f-b6fd-0162f6ca58bd\") " pod="kserve-ci-e2e-test/gw-section-name-router-with-gat-f1d92d0f-kserve-8465c5bff7tvnbd"
May 25 11:35:27.488586 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:35:27.488574    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z2476\" (UniqueName: \"kubernetes.io/projected/9c7b2d91-c28d-4a0f-b6fd-0162f6ca58bd-kube-api-access-z2476\") pod \"gw-section-name-router-with-gat-f1d92d0f-kserve-8465c5bff7tvnbd\" (UID: \"9c7b2d91-c28d-4a0f-b6fd-0162f6ca58bd\") " pod="kserve-ci-e2e-test/gw-section-name-router-with-gat-f1d92d0f-kserve-8465c5bff7tvnbd"
May 25 11:35:27.589885 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:35:27.589799    2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/9c7b2d91-c28d-4a0f-b6fd-0162f6ca58bd-kserve-provision-location\") pod \"gw-section-name-router-with-gat-f1d92d0f-kserve-8465c5bff7tvnbd\" (UID: \"9c7b2d91-c28d-4a0f-b6fd-0162f6ca58bd\") " pod="kserve-ci-e2e-test/gw-section-name-router-with-gat-f1d92d0f-kserve-8465c5bff7tvnbd"
May 25 11:35:27.589885 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:35:27.589850    2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9c7b2d91-c28d-4a0f-b6fd-0162f6ca58bd-home\") pod \"gw-section-name-router-with-gat-f1d92d0f-kserve-8465c5bff7tvnbd\" (UID: \"9c7b2d91-c28d-4a0f-b6fd-0162f6ca58bd\") " pod="kserve-ci-e2e-test/gw-section-name-router-with-gat-f1d92d0f-kserve-8465c5bff7tvnbd"
May 25 11:35:27.590144 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:35:27.589888    2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9c7b2d91-c28d-4a0f-b6fd-0162f6ca58bd-dshm\") pod \"gw-section-name-router-with-gat-f1d92d0f-kserve-8465c5bff7tvnbd\" (UID: \"9c7b2d91-c28d-4a0f-b6fd-0162f6ca58bd\") " pod="kserve-ci-e2e-test/gw-section-name-router-with-gat-f1d92d0f-kserve-8465c5bff7tvnbd"
May 25 11:35:27.590144 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:35:27.589918    2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9c7b2d91-c28d-4a0f-b6fd-0162f6ca58bd-tls-certs\") pod \"gw-section-name-router-with-gat-f1d92d0f-kserve-8465c5bff7tvnbd\" (UID: \"9c7b2d91-c28d-4a0f-b6fd-0162f6ca58bd\") " pod="kserve-ci-e2e-test/gw-section-name-router-with-gat-f1d92d0f-kserve-8465c5bff7tvnbd"
May 25 11:35:27.590144 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:35:27.589988    2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-z2476\" (UniqueName: \"kubernetes.io/projected/9c7b2d91-c28d-4a0f-b6fd-0162f6ca58bd-kube-api-access-z2476\") pod \"gw-section-name-router-with-gat-f1d92d0f-kserve-8465c5bff7tvnbd\" (UID: \"9c7b2d91-c28d-4a0f-b6fd-0162f6ca58bd\") " pod="kserve-ci-e2e-test/gw-section-name-router-with-gat-f1d92d0f-kserve-8465c5bff7tvnbd"
May 25 11:35:27.590144 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:35:27.590074    2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9c7b2d91-c28d-4a0f-b6fd-0162f6ca58bd-model-cache\") pod \"gw-section-name-router-with-gat-f1d92d0f-kserve-8465c5bff7tvnbd\" (UID: \"9c7b2d91-c28d-4a0f-b6fd-0162f6ca58bd\") " pod="kserve-ci-e2e-test/gw-section-name-router-with-gat-f1d92d0f-kserve-8465c5bff7tvnbd"
May 25 11:35:27.590144 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:35:27.590098    2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9c7b2d91-c28d-4a0f-b6fd-0162f6ca58bd-tmp-dir\") pod \"gw-section-name-router-with-gat-f1d92d0f-kserve-8465c5bff7tvnbd\" (UID: \"9c7b2d91-c28d-4a0f-b6fd-0162f6ca58bd\") " pod="kserve-ci-e2e-test/gw-section-name-router-with-gat-f1d92d0f-kserve-8465c5bff7tvnbd"
May 25 11:35:27.590407 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:35:27.590271    2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/9c7b2d91-c28d-4a0f-b6fd-0162f6ca58bd-kserve-provision-location\") pod \"gw-section-name-router-with-gat-f1d92d0f-kserve-8465c5bff7tvnbd\" (UID: \"9c7b2d91-c28d-4a0f-b6fd-0162f6ca58bd\") " pod="kserve-ci-e2e-test/gw-section-name-router-with-gat-f1d92d0f-kserve-8465c5bff7tvnbd"
May 25 11:35:27.590407 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:35:27.590329    2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9c7b2d91-c28d-4a0f-b6fd-0162f6ca58bd-home\") pod \"gw-section-name-router-with-gat-f1d92d0f-kserve-8465c5bff7tvnbd\" (UID: \"9c7b2d91-c28d-4a0f-b6fd-0162f6ca58bd\") " pod="kserve-ci-e2e-test/gw-section-name-router-with-gat-f1d92d0f-kserve-8465c5bff7tvnbd"
May 25 11:35:27.590527 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:35:27.590480    2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9c7b2d91-c28d-4a0f-b6fd-0162f6ca58bd-model-cache\") pod \"gw-section-name-router-with-gat-f1d92d0f-kserve-8465c5bff7tvnbd\" (UID: \"9c7b2d91-c28d-4a0f-b6fd-0162f6ca58bd\") " pod="kserve-ci-e2e-test/gw-section-name-router-with-gat-f1d92d0f-kserve-8465c5bff7tvnbd"
May 25 11:35:27.590527 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:35:27.590503    2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9c7b2d91-c28d-4a0f-b6fd-0162f6ca58bd-tmp-dir\") pod \"gw-section-name-router-with-gat-f1d92d0f-kserve-8465c5bff7tvnbd\" (UID: \"9c7b2d91-c28d-4a0f-b6fd-0162f6ca58bd\") " pod="kserve-ci-e2e-test/gw-section-name-router-with-gat-f1d92d0f-kserve-8465c5bff7tvnbd"
May 25 11:35:27.592711 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:35:27.592684    2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9c7b2d91-c28d-4a0f-b6fd-0162f6ca58bd-dshm\") pod \"gw-section-name-router-with-gat-f1d92d0f-kserve-8465c5bff7tvnbd\" (UID: \"9c7b2d91-c28d-4a0f-b6fd-0162f6ca58bd\") " pod="kserve-ci-e2e-test/gw-section-name-router-with-gat-f1d92d0f-kserve-8465c5bff7tvnbd"
May 25 11:35:27.592986 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:35:27.592969    2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9c7b2d91-c28d-4a0f-b6fd-0162f6ca58bd-tls-certs\") pod \"gw-section-name-router-with-gat-f1d92d0f-kserve-8465c5bff7tvnbd\" (UID: \"9c7b2d91-c28d-4a0f-b6fd-0162f6ca58bd\") " pod="kserve-ci-e2e-test/gw-section-name-router-with-gat-f1d92d0f-kserve-8465c5bff7tvnbd"
May 25 11:35:27.603065 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:35:27.603043    2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-z2476\" (UniqueName: \"kubernetes.io/projected/9c7b2d91-c28d-4a0f-b6fd-0162f6ca58bd-kube-api-access-z2476\") pod \"gw-section-name-router-with-gat-f1d92d0f-kserve-8465c5bff7tvnbd\" (UID: \"9c7b2d91-c28d-4a0f-b6fd-0162f6ca58bd\") " pod="kserve-ci-e2e-test/gw-section-name-router-with-gat-f1d92d0f-kserve-8465c5bff7tvnbd"
May 25 11:35:27.639046 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:35:27.639018    2545 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/gw-section-name-router-with-gat-f1d92d0f-kserve-8465c5bff7tvnbd"
May 25 11:35:27.778077 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:35:27.778051    2545 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/gw-section-name-router-with-gat-f1d92d0f-kserve-8465c5bff7tvnbd"]
May 25 11:35:27.779517 ip-10-0-128-206 kubenswrapper[2545]: W0525 11:35:27.779488    2545 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9c7b2d91_c28d_4a0f_b6fd_0162f6ca58bd.slice/crio-58837d4ffe404e511a59318e6daed2bd982be17f491d1e1296c565048549240e WatchSource:0}: Error finding container 58837d4ffe404e511a59318e6daed2bd982be17f491d1e1296c565048549240e: Status 404 returned error can't find the container with id 58837d4ffe404e511a59318e6daed2bd982be17f491d1e1296c565048549240e
May 25 11:35:28.179172 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:35:28.179134    2545 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/gw-section-name-router-with-gat-f1d92d0f-kserve-8465c5bff7tvnbd" event={"ID":"9c7b2d91-c28d-4a0f-b6fd-0162f6ca58bd","Type":"ContainerStarted","Data":"22a40e5329bb73afdb6170fb438cfe3f9b0f371a754d955cd5c8831b177f868d"}
May 25 11:35:28.179172 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:35:28.179175    2545 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/gw-section-name-router-with-gat-f1d92d0f-kserve-8465c5bff7tvnbd" event={"ID":"9c7b2d91-c28d-4a0f-b6fd-0162f6ca58bd","Type":"ContainerStarted","Data":"58837d4ffe404e511a59318e6daed2bd982be17f491d1e1296c565048549240e"}
May 25 11:35:39.128747 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:35:39.128711    2545 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/gw-section-name-router-with-gat-f1d92d0f-kserve-8465c5bff7tvnbd"]
May 25 11:35:39.129162 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:35:39.129000    2545 kuberuntime_container.go:864] "Killing container with a grace period" pod="kserve-ci-e2e-test/gw-section-name-router-with-gat-f1d92d0f-kserve-8465c5bff7tvnbd" podUID="9c7b2d91-c28d-4a0f-b6fd-0162f6ca58bd" containerName="storage-initializer" containerID="cri-o://22a40e5329bb73afdb6170fb438cfe3f9b0f371a754d955cd5c8831b177f868d" gracePeriod=30
May 25 11:36:09.316889 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:36:09.316859    2545 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_gw-section-name-router-with-gat-f1d92d0f-kserve-8465c5bff7tvnbd_9c7b2d91-c28d-4a0f-b6fd-0162f6ca58bd/storage-initializer/0.log"
May 25 11:36:09.317234 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:36:09.316914    2545 generic.go:358] "Generic (PLEG): container finished" podID="9c7b2d91-c28d-4a0f-b6fd-0162f6ca58bd" containerID="22a40e5329bb73afdb6170fb438cfe3f9b0f371a754d955cd5c8831b177f868d" exitCode=137
May 25 11:36:09.317234 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:36:09.316989    2545 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/gw-section-name-router-with-gat-f1d92d0f-kserve-8465c5bff7tvnbd" event={"ID":"9c7b2d91-c28d-4a0f-b6fd-0162f6ca58bd","Type":"ContainerDied","Data":"22a40e5329bb73afdb6170fb438cfe3f9b0f371a754d955cd5c8831b177f868d"}
May 25 11:36:09.317234 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:36:09.317026    2545 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/gw-section-name-router-with-gat-f1d92d0f-kserve-8465c5bff7tvnbd" event={"ID":"9c7b2d91-c28d-4a0f-b6fd-0162f6ca58bd","Type":"ContainerDied","Data":"58837d4ffe404e511a59318e6daed2bd982be17f491d1e1296c565048549240e"}
May 25 11:36:09.317234 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:36:09.317035    2545 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="58837d4ffe404e511a59318e6daed2bd982be17f491d1e1296c565048549240e"
May 25 11:36:09.324136 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:36:09.324122    2545 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_gw-section-name-router-with-gat-f1d92d0f-kserve-8465c5bff7tvnbd_9c7b2d91-c28d-4a0f-b6fd-0162f6ca58bd/storage-initializer/0.log"
May 25 11:36:09.324228 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:36:09.324177    2545 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/gw-section-name-router-with-gat-f1d92d0f-kserve-8465c5bff7tvnbd"
May 25 11:36:09.437084 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:36:09.437017    2545 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9c7b2d91-c28d-4a0f-b6fd-0162f6ca58bd-tls-certs\") pod \"9c7b2d91-c28d-4a0f-b6fd-0162f6ca58bd\" (UID: \"9c7b2d91-c28d-4a0f-b6fd-0162f6ca58bd\") "
May 25 11:36:09.437084 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:36:09.437058    2545 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9c7b2d91-c28d-4a0f-b6fd-0162f6ca58bd-model-cache\") pod \"9c7b2d91-c28d-4a0f-b6fd-0162f6ca58bd\" (UID: \"9c7b2d91-c28d-4a0f-b6fd-0162f6ca58bd\") "
May 25 11:36:09.437084 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:36:09.437075    2545 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9c7b2d91-c28d-4a0f-b6fd-0162f6ca58bd-dshm\") pod \"9c7b2d91-c28d-4a0f-b6fd-0162f6ca58bd\" (UID: \"9c7b2d91-c28d-4a0f-b6fd-0162f6ca58bd\") "
May 25 11:36:09.437321 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:36:09.437112    2545 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9c7b2d91-c28d-4a0f-b6fd-0162f6ca58bd-home\") pod \"9c7b2d91-c28d-4a0f-b6fd-0162f6ca58bd\" (UID: \"9c7b2d91-c28d-4a0f-b6fd-0162f6ca58bd\") "
May 25 11:36:09.437321 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:36:09.437210    2545 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-z2476\" (UniqueName: \"kubernetes.io/projected/9c7b2d91-c28d-4a0f-b6fd-0162f6ca58bd-kube-api-access-z2476\") pod \"9c7b2d91-c28d-4a0f-b6fd-0162f6ca58bd\" (UID: \"9c7b2d91-c28d-4a0f-b6fd-0162f6ca58bd\") "
May 25 11:36:09.437321 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:36:09.437244    2545 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9c7b2d91-c28d-4a0f-b6fd-0162f6ca58bd-tmp-dir\") pod \"9c7b2d91-c28d-4a0f-b6fd-0162f6ca58bd\" (UID: \"9c7b2d91-c28d-4a0f-b6fd-0162f6ca58bd\") "
May 25 11:36:09.437321 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:36:09.437267    2545 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/9c7b2d91-c28d-4a0f-b6fd-0162f6ca58bd-kserve-provision-location\") pod \"9c7b2d91-c28d-4a0f-b6fd-0162f6ca58bd\" (UID: \"9c7b2d91-c28d-4a0f-b6fd-0162f6ca58bd\") "
May 25 11:36:09.437532 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:36:09.437391    2545 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9c7b2d91-c28d-4a0f-b6fd-0162f6ca58bd-home" (OuterVolumeSpecName: "home") pod "9c7b2d91-c28d-4a0f-b6fd-0162f6ca58bd" (UID: "9c7b2d91-c28d-4a0f-b6fd-0162f6ca58bd"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 25 11:36:09.437532 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:36:09.437510    2545 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9c7b2d91-c28d-4a0f-b6fd-0162f6ca58bd-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "9c7b2d91-c28d-4a0f-b6fd-0162f6ca58bd" (UID: "9c7b2d91-c28d-4a0f-b6fd-0162f6ca58bd"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 25 11:36:09.437632 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:36:09.437526    2545 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9c7b2d91-c28d-4a0f-b6fd-0162f6ca58bd-model-cache" (OuterVolumeSpecName: "model-cache") pod "9c7b2d91-c28d-4a0f-b6fd-0162f6ca58bd" (UID: "9c7b2d91-c28d-4a0f-b6fd-0162f6ca58bd"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 25 11:36:09.437632 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:36:09.437617    2545 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9c7b2d91-c28d-4a0f-b6fd-0162f6ca58bd-tmp-dir\") on node \"ip-10-0-128-206.ec2.internal\" DevicePath \"\""
May 25 11:36:09.437734 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:36:09.437639    2545 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9c7b2d91-c28d-4a0f-b6fd-0162f6ca58bd-model-cache\") on node \"ip-10-0-128-206.ec2.internal\" DevicePath \"\""
May 25 11:36:09.437734 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:36:09.437651    2545 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9c7b2d91-c28d-4a0f-b6fd-0162f6ca58bd-home\") on node \"ip-10-0-128-206.ec2.internal\" DevicePath \"\""
May 25 11:36:09.439207 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:36:09.439184    2545 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9c7b2d91-c28d-4a0f-b6fd-0162f6ca58bd-dshm" (OuterVolumeSpecName: "dshm") pod "9c7b2d91-c28d-4a0f-b6fd-0162f6ca58bd" (UID: "9c7b2d91-c28d-4a0f-b6fd-0162f6ca58bd"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 25 11:36:09.439326 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:36:09.439240    2545 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9c7b2d91-c28d-4a0f-b6fd-0162f6ca58bd-kube-api-access-z2476" (OuterVolumeSpecName: "kube-api-access-z2476") pod "9c7b2d91-c28d-4a0f-b6fd-0162f6ca58bd" (UID: "9c7b2d91-c28d-4a0f-b6fd-0162f6ca58bd"). InnerVolumeSpecName "kube-api-access-z2476". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 25 11:36:09.439326 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:36:09.439270    2545 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9c7b2d91-c28d-4a0f-b6fd-0162f6ca58bd-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "9c7b2d91-c28d-4a0f-b6fd-0162f6ca58bd" (UID: "9c7b2d91-c28d-4a0f-b6fd-0162f6ca58bd"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 25 11:36:09.455968 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:36:09.455934    2545 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9c7b2d91-c28d-4a0f-b6fd-0162f6ca58bd-kserve-provision-location" (OuterVolumeSpecName: "kserve-provision-location") pod "9c7b2d91-c28d-4a0f-b6fd-0162f6ca58bd" (UID: "9c7b2d91-c28d-4a0f-b6fd-0162f6ca58bd"). InnerVolumeSpecName "kserve-provision-location". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 25 11:36:09.537972 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:36:09.537937    2545 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9c7b2d91-c28d-4a0f-b6fd-0162f6ca58bd-dshm\") on node \"ip-10-0-128-206.ec2.internal\" DevicePath \"\""
May 25 11:36:09.538067 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:36:09.537985    2545 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-z2476\" (UniqueName: \"kubernetes.io/projected/9c7b2d91-c28d-4a0f-b6fd-0162f6ca58bd-kube-api-access-z2476\") on node \"ip-10-0-128-206.ec2.internal\" DevicePath \"\""
May 25 11:36:09.538067 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:36:09.538002    2545 reconciler_common.go:299] "Volume detached for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/9c7b2d91-c28d-4a0f-b6fd-0162f6ca58bd-kserve-provision-location\") on node \"ip-10-0-128-206.ec2.internal\" DevicePath \"\""
May 25 11:36:09.538067 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:36:09.538015    2545 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9c7b2d91-c28d-4a0f-b6fd-0162f6ca58bd-tls-certs\") on node \"ip-10-0-128-206.ec2.internal\" DevicePath \"\""
May 25 11:36:10.325800 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:36:10.325767    2545 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/gw-section-name-router-with-gat-f1d92d0f-kserve-8465c5bff7tvnbd"
May 25 11:36:10.367043 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:36:10.367013    2545 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/gw-section-name-router-with-gat-f1d92d0f-kserve-8465c5bff7tvnbd"]
May 25 11:36:10.373786 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:36:10.373760    2545 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/gw-section-name-router-with-gat-f1d92d0f-kserve-8465c5bff7tvnbd"]
May 25 11:36:10.774144 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:36:10.774117    2545 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9c7b2d91-c28d-4a0f-b6fd-0162f6ca58bd" path="/var/lib/kubelet/pods/9c7b2d91-c28d-4a0f-b6fd-0162f6ca58bd/volumes"
May 25 11:36:49.431515 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:36:49.431443    2545 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/scheduler-configmap-ref-test-kserve-74fb5ff78f-mnpfd"]
May 25 11:36:49.432013 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:36:49.431789    2545 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9c7b2d91-c28d-4a0f-b6fd-0162f6ca58bd" containerName="storage-initializer"
May 25 11:36:49.432013 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:36:49.431803    2545 state_mem.go:107] "Deleted CPUSet assignment" podUID="9c7b2d91-c28d-4a0f-b6fd-0162f6ca58bd" containerName="storage-initializer"
May 25 11:36:49.432013 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:36:49.431870    2545 memory_manager.go:356] "RemoveStaleState removing state" podUID="9c7b2d91-c28d-4a0f-b6fd-0162f6ca58bd" containerName="storage-initializer"
May 25 11:36:49.434891 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:36:49.434870    2545 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/scheduler-configmap-ref-test-kserve-74fb5ff78f-mnpfd"
May 25 11:36:49.439009 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:36:49.438988    2545 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"default-dockercfg-vcvlw\""
May 25 11:36:49.439009 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:36:49.438998    2545 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"openshift-service-ca.crt\""
May 25 11:36:49.439165 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:36:49.439022    2545 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"kube-root-ca.crt\""
May 25 11:36:49.439165 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:36:49.439041    2545 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"scheduler-configmap-ref-test-kserve-self-signed-certs\""
May 25 11:36:49.446030 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:36:49.446009    2545 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/scheduler-configmap-ref-test-kserve-74fb5ff78f-mnpfd"]
May 25 11:36:49.574189 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:36:49.574157    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/0d3e2400-018c-44f8-9b37-5cce3857f8ed-kserve-provision-location\") pod \"scheduler-configmap-ref-test-kserve-74fb5ff78f-mnpfd\" (UID: \"0d3e2400-018c-44f8-9b37-5cce3857f8ed\") " pod="kserve-ci-e2e-test/scheduler-configmap-ref-test-kserve-74fb5ff78f-mnpfd"
May 25 11:36:49.574353 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:36:49.574222    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9nxwt\" (UniqueName: \"kubernetes.io/projected/0d3e2400-018c-44f8-9b37-5cce3857f8ed-kube-api-access-9nxwt\") pod \"scheduler-configmap-ref-test-kserve-74fb5ff78f-mnpfd\" (UID: \"0d3e2400-018c-44f8-9b37-5cce3857f8ed\") " pod="kserve-ci-e2e-test/scheduler-configmap-ref-test-kserve-74fb5ff78f-mnpfd"
May 25 11:36:49.574353 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:36:49.574254    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0d3e2400-018c-44f8-9b37-5cce3857f8ed-tls-certs\") pod \"scheduler-configmap-ref-test-kserve-74fb5ff78f-mnpfd\" (UID: \"0d3e2400-018c-44f8-9b37-5cce3857f8ed\") " pod="kserve-ci-e2e-test/scheduler-configmap-ref-test-kserve-74fb5ff78f-mnpfd"
May 25 11:36:49.574475 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:36:49.574371    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0d3e2400-018c-44f8-9b37-5cce3857f8ed-dshm\") pod \"scheduler-configmap-ref-test-kserve-74fb5ff78f-mnpfd\" (UID: \"0d3e2400-018c-44f8-9b37-5cce3857f8ed\") " pod="kserve-ci-e2e-test/scheduler-configmap-ref-test-kserve-74fb5ff78f-mnpfd"
May 25 11:36:49.574475 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:36:49.574418    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0d3e2400-018c-44f8-9b37-5cce3857f8ed-tmp-dir\") pod \"scheduler-configmap-ref-test-kserve-74fb5ff78f-mnpfd\" (UID: \"0d3e2400-018c-44f8-9b37-5cce3857f8ed\") " pod="kserve-ci-e2e-test/scheduler-configmap-ref-test-kserve-74fb5ff78f-mnpfd"
May 25 11:36:49.574475 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:36:49.574446    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0d3e2400-018c-44f8-9b37-5cce3857f8ed-home\") pod \"scheduler-configmap-ref-test-kserve-74fb5ff78f-mnpfd\" (UID: \"0d3e2400-018c-44f8-9b37-5cce3857f8ed\") " pod="kserve-ci-e2e-test/scheduler-configmap-ref-test-kserve-74fb5ff78f-mnpfd"
May 25 11:36:49.574475 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:36:49.574470    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0d3e2400-018c-44f8-9b37-5cce3857f8ed-model-cache\") pod \"scheduler-configmap-ref-test-kserve-74fb5ff78f-mnpfd\" (UID: \"0d3e2400-018c-44f8-9b37-5cce3857f8ed\") " pod="kserve-ci-e2e-test/scheduler-configmap-ref-test-kserve-74fb5ff78f-mnpfd"
May 25 11:36:49.675781 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:36:49.675746    2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0d3e2400-018c-44f8-9b37-5cce3857f8ed-dshm\") pod \"scheduler-configmap-ref-test-kserve-74fb5ff78f-mnpfd\" (UID: \"0d3e2400-018c-44f8-9b37-5cce3857f8ed\") " pod="kserve-ci-e2e-test/scheduler-configmap-ref-test-kserve-74fb5ff78f-mnpfd"
May 25 11:36:49.675979 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:36:49.675806    2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0d3e2400-018c-44f8-9b37-5cce3857f8ed-tmp-dir\") pod \"scheduler-configmap-ref-test-kserve-74fb5ff78f-mnpfd\" (UID: \"0d3e2400-018c-44f8-9b37-5cce3857f8ed\") " pod="kserve-ci-e2e-test/scheduler-configmap-ref-test-kserve-74fb5ff78f-mnpfd"
May 25 11:36:49.675979 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:36:49.675832    2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0d3e2400-018c-44f8-9b37-5cce3857f8ed-home\") pod \"scheduler-configmap-ref-test-kserve-74fb5ff78f-mnpfd\" (UID: \"0d3e2400-018c-44f8-9b37-5cce3857f8ed\") " pod="kserve-ci-e2e-test/scheduler-configmap-ref-test-kserve-74fb5ff78f-mnpfd"
May 25 11:36:49.675979 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:36:49.675854    2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0d3e2400-018c-44f8-9b37-5cce3857f8ed-model-cache\") pod \"scheduler-configmap-ref-test-kserve-74fb5ff78f-mnpfd\" (UID: \"0d3e2400-018c-44f8-9b37-5cce3857f8ed\") " pod="kserve-ci-e2e-test/scheduler-configmap-ref-test-kserve-74fb5ff78f-mnpfd"
May 25 11:36:49.675979 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:36:49.675899    2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/0d3e2400-018c-44f8-9b37-5cce3857f8ed-kserve-provision-location\") pod \"scheduler-configmap-ref-test-kserve-74fb5ff78f-mnpfd\" (UID: \"0d3e2400-018c-44f8-9b37-5cce3857f8ed\") " pod="kserve-ci-e2e-test/scheduler-configmap-ref-test-kserve-74fb5ff78f-mnpfd"
May 25 11:36:49.675979 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:36:49.675927    2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-9nxwt\" (UniqueName: \"kubernetes.io/projected/0d3e2400-018c-44f8-9b37-5cce3857f8ed-kube-api-access-9nxwt\") pod \"scheduler-configmap-ref-test-kserve-74fb5ff78f-mnpfd\" (UID: \"0d3e2400-018c-44f8-9b37-5cce3857f8ed\") " pod="kserve-ci-e2e-test/scheduler-configmap-ref-test-kserve-74fb5ff78f-mnpfd"
May 25 11:36:49.675979 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:36:49.675979    2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0d3e2400-018c-44f8-9b37-5cce3857f8ed-tls-certs\") pod \"scheduler-configmap-ref-test-kserve-74fb5ff78f-mnpfd\" (UID: \"0d3e2400-018c-44f8-9b37-5cce3857f8ed\") " pod="kserve-ci-e2e-test/scheduler-configmap-ref-test-kserve-74fb5ff78f-mnpfd"
May 25 11:36:49.676303 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:36:49.676253    2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0d3e2400-018c-44f8-9b37-5cce3857f8ed-home\") pod \"scheduler-configmap-ref-test-kserve-74fb5ff78f-mnpfd\" (UID: \"0d3e2400-018c-44f8-9b37-5cce3857f8ed\") " pod="kserve-ci-e2e-test/scheduler-configmap-ref-test-kserve-74fb5ff78f-mnpfd"
May 25 11:36:49.676378 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:36:49.676331    2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0d3e2400-018c-44f8-9b37-5cce3857f8ed-model-cache\") pod \"scheduler-configmap-ref-test-kserve-74fb5ff78f-mnpfd\" (UID: \"0d3e2400-018c-44f8-9b37-5cce3857f8ed\") " pod="kserve-ci-e2e-test/scheduler-configmap-ref-test-kserve-74fb5ff78f-mnpfd"
May 25 11:36:49.676378 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:36:49.676361    2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0d3e2400-018c-44f8-9b37-5cce3857f8ed-tmp-dir\") pod \"scheduler-configmap-ref-test-kserve-74fb5ff78f-mnpfd\" (UID: \"0d3e2400-018c-44f8-9b37-5cce3857f8ed\") " pod="kserve-ci-e2e-test/scheduler-configmap-ref-test-kserve-74fb5ff78f-mnpfd"
May 25 11:36:49.676487 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:36:49.676381    2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/0d3e2400-018c-44f8-9b37-5cce3857f8ed-kserve-provision-location\") pod \"scheduler-configmap-ref-test-kserve-74fb5ff78f-mnpfd\" (UID: \"0d3e2400-018c-44f8-9b37-5cce3857f8ed\") " pod="kserve-ci-e2e-test/scheduler-configmap-ref-test-kserve-74fb5ff78f-mnpfd"
May 25 11:36:49.677994 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:36:49.677972    2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0d3e2400-018c-44f8-9b37-5cce3857f8ed-dshm\") pod \"scheduler-configmap-ref-test-kserve-74fb5ff78f-mnpfd\" (UID: \"0d3e2400-018c-44f8-9b37-5cce3857f8ed\") " pod="kserve-ci-e2e-test/scheduler-configmap-ref-test-kserve-74fb5ff78f-mnpfd"
May 25 11:36:49.678306 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:36:49.678288    2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0d3e2400-018c-44f8-9b37-5cce3857f8ed-tls-certs\") pod \"scheduler-configmap-ref-test-kserve-74fb5ff78f-mnpfd\" (UID: \"0d3e2400-018c-44f8-9b37-5cce3857f8ed\") " pod="kserve-ci-e2e-test/scheduler-configmap-ref-test-kserve-74fb5ff78f-mnpfd"
May 25 11:36:49.684867 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:36:49.684801    2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9nxwt\" (UniqueName: \"kubernetes.io/projected/0d3e2400-018c-44f8-9b37-5cce3857f8ed-kube-api-access-9nxwt\") pod \"scheduler-configmap-ref-test-kserve-74fb5ff78f-mnpfd\" (UID: \"0d3e2400-018c-44f8-9b37-5cce3857f8ed\") " pod="kserve-ci-e2e-test/scheduler-configmap-ref-test-kserve-74fb5ff78f-mnpfd"
May 25 11:36:49.745169 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:36:49.745142    2545 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/scheduler-configmap-ref-test-kserve-74fb5ff78f-mnpfd"
May 25 11:36:49.888762 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:36:49.888740    2545 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/scheduler-configmap-ref-test-kserve-74fb5ff78f-mnpfd"]
May 25 11:36:49.891047 ip-10-0-128-206 kubenswrapper[2545]: W0525 11:36:49.891022    2545 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0d3e2400_018c_44f8_9b37_5cce3857f8ed.slice/crio-515de0998c0d8d954ba5196725dbc51ce2cc5b33233348049ea10cf1805e7f5c WatchSource:0}: Error finding container 515de0998c0d8d954ba5196725dbc51ce2cc5b33233348049ea10cf1805e7f5c: Status 404 returned error can't find the container with id 515de0998c0d8d954ba5196725dbc51ce2cc5b33233348049ea10cf1805e7f5c
May 25 11:36:50.468332 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:36:50.468299    2545 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/scheduler-configmap-ref-test-kserve-74fb5ff78f-mnpfd" event={"ID":"0d3e2400-018c-44f8-9b37-5cce3857f8ed","Type":"ContainerStarted","Data":"7b5857c1fe0f9ea92e1c58705c75208bd62f3540cc8e14ca7ca838b74355f2e8"}
May 25 11:36:50.468707 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:36:50.468342    2545 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/scheduler-configmap-ref-test-kserve-74fb5ff78f-mnpfd" event={"ID":"0d3e2400-018c-44f8-9b37-5cce3857f8ed","Type":"ContainerStarted","Data":"515de0998c0d8d954ba5196725dbc51ce2cc5b33233348049ea10cf1805e7f5c"}
May 25 11:36:54.483695 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:36:54.483660    2545 generic.go:358] "Generic (PLEG): container finished" podID="0d3e2400-018c-44f8-9b37-5cce3857f8ed" containerID="7b5857c1fe0f9ea92e1c58705c75208bd62f3540cc8e14ca7ca838b74355f2e8" exitCode=0
May 25 11:36:54.484049 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:36:54.483736    2545 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/scheduler-configmap-ref-test-kserve-74fb5ff78f-mnpfd" event={"ID":"0d3e2400-018c-44f8-9b37-5cce3857f8ed","Type":"ContainerDied","Data":"7b5857c1fe0f9ea92e1c58705c75208bd62f3540cc8e14ca7ca838b74355f2e8"}
May 25 11:36:55.488747 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:36:55.488715    2545 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/scheduler-configmap-ref-test-kserve-74fb5ff78f-mnpfd" event={"ID":"0d3e2400-018c-44f8-9b37-5cce3857f8ed","Type":"ContainerStarted","Data":"278f28527c363c4758f27a007161e3091dd0728e09eac0f8908b7a5730d05107"}
May 25 11:36:55.510939 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:36:55.510894    2545 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kserve-ci-e2e-test/scheduler-configmap-ref-test-kserve-74fb5ff78f-mnpfd" podStartSLOduration=6.51088208 podStartE2EDuration="6.51088208s" podCreationTimestamp="2026-05-25 11:36:49 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-25 11:36:55.509482314 +0000 UTC m=+807.275767260" watchObservedRunningTime="2026-05-25 11:36:55.51088208 +0000 UTC m=+807.277167025"
May 25 11:36:59.746247 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:36:59.746198    2545 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/scheduler-configmap-ref-test-kserve-74fb5ff78f-mnpfd"
May 25 11:36:59.746634 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:36:59.746361    2545 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kserve-ci-e2e-test/scheduler-configmap-ref-test-kserve-74fb5ff78f-mnpfd"
May 25 11:36:59.758622 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:36:59.758589    2545 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="kserve-ci-e2e-test/scheduler-configmap-ref-test-kserve-74fb5ff78f-mnpfd"
May 25 11:37:00.515422 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:37:00.515394    2545 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/scheduler-configmap-ref-test-kserve-74fb5ff78f-mnpfd"
May 25 11:37:32.784713 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:37:32.784679    2545 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/scheduler-ha-replicas-test-kserve-router-scheduler-54d8f6fds7zl"]
May 25 11:37:32.787618 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:37:32.787592    2545 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/scheduler-ha-replicas-test-kserve-router-scheduler-54d8f6fds7zl"
May 25 11:37:32.816337 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:37:32.816312    2545 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"scheduler-ha-replicas-test-kserve-self-signed-certs\""
May 25 11:37:32.845653 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:37:32.845627    2545 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"scheduler-ha-replicas-test-epp-sa-dockercfg-8mc2f\""
May 25 11:37:32.858619 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:37:32.858592    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/7e0a1318-7cf0-406a-bdb9-6eaee7a179e0-kserve-provision-location\") pod \"scheduler-ha-replicas-test-kserve-router-scheduler-54d8f6fds7zl\" (UID: \"7e0a1318-7cf0-406a-bdb9-6eaee7a179e0\") " pod="kserve-ci-e2e-test/scheduler-ha-replicas-test-kserve-router-scheduler-54d8f6fds7zl"
May 25 11:37:32.858724 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:37:32.858638    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tokenizer-cache\" (UniqueName: \"kubernetes.io/empty-dir/7e0a1318-7cf0-406a-bdb9-6eaee7a179e0-tokenizer-cache\") pod \"scheduler-ha-replicas-test-kserve-router-scheduler-54d8f6fds7zl\" (UID: \"7e0a1318-7cf0-406a-bdb9-6eaee7a179e0\") " pod="kserve-ci-e2e-test/scheduler-ha-replicas-test-kserve-router-scheduler-54d8f6fds7zl"
May 25 11:37:32.858724 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:37:32.858664    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k86rb\" (UniqueName: \"kubernetes.io/projected/7e0a1318-7cf0-406a-bdb9-6eaee7a179e0-kube-api-access-k86rb\") pod \"scheduler-ha-replicas-test-kserve-router-scheduler-54d8f6fds7zl\" (UID: \"7e0a1318-7cf0-406a-bdb9-6eaee7a179e0\") " pod="kserve-ci-e2e-test/scheduler-ha-replicas-test-kserve-router-scheduler-54d8f6fds7zl"
May 25 11:37:32.858838 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:37:32.858727    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tokenizer-tmp\" (UniqueName: \"kubernetes.io/empty-dir/7e0a1318-7cf0-406a-bdb9-6eaee7a179e0-tokenizer-tmp\") pod \"scheduler-ha-replicas-test-kserve-router-scheduler-54d8f6fds7zl\" (UID: \"7e0a1318-7cf0-406a-bdb9-6eaee7a179e0\") " pod="kserve-ci-e2e-test/scheduler-ha-replicas-test-kserve-router-scheduler-54d8f6fds7zl"
May 25 11:37:32.858838 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:37:32.858821    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7e0a1318-7cf0-406a-bdb9-6eaee7a179e0-tls-certs\") pod \"scheduler-ha-replicas-test-kserve-router-scheduler-54d8f6fds7zl\" (UID: \"7e0a1318-7cf0-406a-bdb9-6eaee7a179e0\") " pod="kserve-ci-e2e-test/scheduler-ha-replicas-test-kserve-router-scheduler-54d8f6fds7zl"
May 25 11:37:32.858919 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:37:32.858874    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tokenizer-uds\" (UniqueName: \"kubernetes.io/empty-dir/7e0a1318-7cf0-406a-bdb9-6eaee7a179e0-tokenizer-uds\") pod \"scheduler-ha-replicas-test-kserve-router-scheduler-54d8f6fds7zl\" (UID: \"7e0a1318-7cf0-406a-bdb9-6eaee7a179e0\") " pod="kserve-ci-e2e-test/scheduler-ha-replicas-test-kserve-router-scheduler-54d8f6fds7zl"
May 25 11:37:32.873316 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:37:32.873293    2545 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/scheduler-ha-replicas-test-kserve-router-scheduler-54d8f6fds7zl"]
May 25 11:37:32.959880 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:37:32.959849    2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tokenizer-cache\" (UniqueName: \"kubernetes.io/empty-dir/7e0a1318-7cf0-406a-bdb9-6eaee7a179e0-tokenizer-cache\") pod \"scheduler-ha-replicas-test-kserve-router-scheduler-54d8f6fds7zl\" (UID: \"7e0a1318-7cf0-406a-bdb9-6eaee7a179e0\") " pod="kserve-ci-e2e-test/scheduler-ha-replicas-test-kserve-router-scheduler-54d8f6fds7zl"
May 25 11:37:32.960055 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:37:32.959885    2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-k86rb\" (UniqueName: \"kubernetes.io/projected/7e0a1318-7cf0-406a-bdb9-6eaee7a179e0-kube-api-access-k86rb\") pod \"scheduler-ha-replicas-test-kserve-router-scheduler-54d8f6fds7zl\" (UID: \"7e0a1318-7cf0-406a-bdb9-6eaee7a179e0\") " pod="kserve-ci-e2e-test/scheduler-ha-replicas-test-kserve-router-scheduler-54d8f6fds7zl"
May 25 11:37:32.960055 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:37:32.959940    2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tokenizer-tmp\" (UniqueName: \"kubernetes.io/empty-dir/7e0a1318-7cf0-406a-bdb9-6eaee7a179e0-tokenizer-tmp\") pod \"scheduler-ha-replicas-test-kserve-router-scheduler-54d8f6fds7zl\" (UID: \"7e0a1318-7cf0-406a-bdb9-6eaee7a179e0\") " pod="kserve-ci-e2e-test/scheduler-ha-replicas-test-kserve-router-scheduler-54d8f6fds7zl"
May 25 11:37:32.960055 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:37:32.960003    2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7e0a1318-7cf0-406a-bdb9-6eaee7a179e0-tls-certs\") pod \"scheduler-ha-replicas-test-kserve-router-scheduler-54d8f6fds7zl\" (UID: \"7e0a1318-7cf0-406a-bdb9-6eaee7a179e0\") " pod="kserve-ci-e2e-test/scheduler-ha-replicas-test-kserve-router-scheduler-54d8f6fds7zl"
May 25 11:37:32.960055 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:37:32.960044    2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tokenizer-uds\" (UniqueName: \"kubernetes.io/empty-dir/7e0a1318-7cf0-406a-bdb9-6eaee7a179e0-tokenizer-uds\") pod \"scheduler-ha-replicas-test-kserve-router-scheduler-54d8f6fds7zl\" (UID: \"7e0a1318-7cf0-406a-bdb9-6eaee7a179e0\") " pod="kserve-ci-e2e-test/scheduler-ha-replicas-test-kserve-router-scheduler-54d8f6fds7zl"
May 25 11:37:32.960231 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:37:32.960082    2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/7e0a1318-7cf0-406a-bdb9-6eaee7a179e0-kserve-provision-location\") pod \"scheduler-ha-replicas-test-kserve-router-scheduler-54d8f6fds7zl\" (UID: \"7e0a1318-7cf0-406a-bdb9-6eaee7a179e0\") " pod="kserve-ci-e2e-test/scheduler-ha-replicas-test-kserve-router-scheduler-54d8f6fds7zl"
May 25 11:37:32.960350 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:37:32.960327    2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tokenizer-cache\" (UniqueName: \"kubernetes.io/empty-dir/7e0a1318-7cf0-406a-bdb9-6eaee7a179e0-tokenizer-cache\") pod \"scheduler-ha-replicas-test-kserve-router-scheduler-54d8f6fds7zl\" (UID: \"7e0a1318-7cf0-406a-bdb9-6eaee7a179e0\") " pod="kserve-ci-e2e-test/scheduler-ha-replicas-test-kserve-router-scheduler-54d8f6fds7zl"
May 25 11:37:32.960388 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:37:32.960357    2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tokenizer-uds\" (UniqueName: \"kubernetes.io/empty-dir/7e0a1318-7cf0-406a-bdb9-6eaee7a179e0-tokenizer-uds\") pod \"scheduler-ha-replicas-test-kserve-router-scheduler-54d8f6fds7zl\" (UID: \"7e0a1318-7cf0-406a-bdb9-6eaee7a179e0\") " pod="kserve-ci-e2e-test/scheduler-ha-replicas-test-kserve-router-scheduler-54d8f6fds7zl"
May 25 11:37:32.960388 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:37:32.960371    2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tokenizer-tmp\" (UniqueName: \"kubernetes.io/empty-dir/7e0a1318-7cf0-406a-bdb9-6eaee7a179e0-tokenizer-tmp\") pod \"scheduler-ha-replicas-test-kserve-router-scheduler-54d8f6fds7zl\" (UID: \"7e0a1318-7cf0-406a-bdb9-6eaee7a179e0\") " pod="kserve-ci-e2e-test/scheduler-ha-replicas-test-kserve-router-scheduler-54d8f6fds7zl"
May 25 11:37:32.960458 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:37:32.960409    2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/7e0a1318-7cf0-406a-bdb9-6eaee7a179e0-kserve-provision-location\") pod \"scheduler-ha-replicas-test-kserve-router-scheduler-54d8f6fds7zl\" (UID: \"7e0a1318-7cf0-406a-bdb9-6eaee7a179e0\") " pod="kserve-ci-e2e-test/scheduler-ha-replicas-test-kserve-router-scheduler-54d8f6fds7zl"
May 25 11:37:32.962385 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:37:32.962369    2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7e0a1318-7cf0-406a-bdb9-6eaee7a179e0-tls-certs\") pod \"scheduler-ha-replicas-test-kserve-router-scheduler-54d8f6fds7zl\" (UID: \"7e0a1318-7cf0-406a-bdb9-6eaee7a179e0\") " pod="kserve-ci-e2e-test/scheduler-ha-replicas-test-kserve-router-scheduler-54d8f6fds7zl"
May 25 11:37:32.990247 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:37:32.990218    2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-k86rb\" (UniqueName: \"kubernetes.io/projected/7e0a1318-7cf0-406a-bdb9-6eaee7a179e0-kube-api-access-k86rb\") pod \"scheduler-ha-replicas-test-kserve-router-scheduler-54d8f6fds7zl\" (UID: \"7e0a1318-7cf0-406a-bdb9-6eaee7a179e0\") " pod="kserve-ci-e2e-test/scheduler-ha-replicas-test-kserve-router-scheduler-54d8f6fds7zl"
May 25 11:37:33.097607 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:37:33.097530    2545 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/scheduler-ha-replicas-test-kserve-router-scheduler-54d8f6fds7zl"
May 25 11:37:33.248391 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:37:33.248365    2545 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/scheduler-ha-replicas-test-kserve-router-scheduler-54d8f6fds7zl"]
May 25 11:37:33.249478 ip-10-0-128-206 kubenswrapper[2545]: W0525 11:37:33.249436    2545 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7e0a1318_7cf0_406a_bdb9_6eaee7a179e0.slice/crio-e4ffc12952a881d86b62a84893ed205d56d63d6472d3fe43d285c164180619d5 WatchSource:0}: Error finding container e4ffc12952a881d86b62a84893ed205d56d63d6472d3fe43d285c164180619d5: Status 404 returned error can't find the container with id e4ffc12952a881d86b62a84893ed205d56d63d6472d3fe43d285c164180619d5
May 25 11:37:33.615883 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:37:33.615825    2545 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/scheduler-ha-replicas-test-kserve-router-scheduler-54d8f6fds7zl" event={"ID":"7e0a1318-7cf0-406a-bdb9-6eaee7a179e0","Type":"ContainerStarted","Data":"c11753df203f146ef30dfd6b271079048c6c8d457aa135b510e740627312751c"}
May 25 11:37:33.615883 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:37:33.615888    2545 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/scheduler-ha-replicas-test-kserve-router-scheduler-54d8f6fds7zl" event={"ID":"7e0a1318-7cf0-406a-bdb9-6eaee7a179e0","Type":"ContainerStarted","Data":"e4ffc12952a881d86b62a84893ed205d56d63d6472d3fe43d285c164180619d5"}
May 25 11:37:34.188257 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:37:34.188215    2545 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/scheduler-configmap-ref-test-kserve-74fb5ff78f-mnpfd"]
May 25 11:37:34.188625 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:37:34.188481    2545 kuberuntime_container.go:864] "Killing container with a grace period" pod="kserve-ci-e2e-test/scheduler-configmap-ref-test-kserve-74fb5ff78f-mnpfd" podUID="0d3e2400-018c-44f8-9b37-5cce3857f8ed" containerName="main" containerID="cri-o://278f28527c363c4758f27a007161e3091dd0728e09eac0f8908b7a5730d05107" gracePeriod=30
May 25 11:37:34.439859 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:37:34.439837    2545 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/scheduler-configmap-ref-test-kserve-74fb5ff78f-mnpfd"
May 25 11:37:34.574606 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:37:34.574537    2545 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/0d3e2400-018c-44f8-9b37-5cce3857f8ed-kserve-provision-location\") pod \"0d3e2400-018c-44f8-9b37-5cce3857f8ed\" (UID: \"0d3e2400-018c-44f8-9b37-5cce3857f8ed\") "
May 25 11:37:34.574606 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:37:34.574569    2545 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0d3e2400-018c-44f8-9b37-5cce3857f8ed-model-cache\") pod \"0d3e2400-018c-44f8-9b37-5cce3857f8ed\" (UID: \"0d3e2400-018c-44f8-9b37-5cce3857f8ed\") "
May 25 11:37:34.574606 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:37:34.574595    2545 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0d3e2400-018c-44f8-9b37-5cce3857f8ed-home\") pod \"0d3e2400-018c-44f8-9b37-5cce3857f8ed\" (UID: \"0d3e2400-018c-44f8-9b37-5cce3857f8ed\") "
May 25 11:37:34.574872 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:37:34.574616    2545 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0d3e2400-018c-44f8-9b37-5cce3857f8ed-tmp-dir\") pod \"0d3e2400-018c-44f8-9b37-5cce3857f8ed\" (UID: \"0d3e2400-018c-44f8-9b37-5cce3857f8ed\") "
May 25 11:37:34.574872 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:37:34.574637    2545 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0d3e2400-018c-44f8-9b37-5cce3857f8ed-dshm\") pod \"0d3e2400-018c-44f8-9b37-5cce3857f8ed\" (UID: \"0d3e2400-018c-44f8-9b37-5cce3857f8ed\") "
May 25 11:37:34.574872 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:37:34.574673    2545 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9nxwt\" (UniqueName: \"kubernetes.io/projected/0d3e2400-018c-44f8-9b37-5cce3857f8ed-kube-api-access-9nxwt\") pod \"0d3e2400-018c-44f8-9b37-5cce3857f8ed\" (UID: \"0d3e2400-018c-44f8-9b37-5cce3857f8ed\") "
May 25 11:37:34.574872 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:37:34.574722    2545 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0d3e2400-018c-44f8-9b37-5cce3857f8ed-tls-certs\") pod \"0d3e2400-018c-44f8-9b37-5cce3857f8ed\" (UID: \"0d3e2400-018c-44f8-9b37-5cce3857f8ed\") "
May 25 11:37:34.574872 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:37:34.574828    2545 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0d3e2400-018c-44f8-9b37-5cce3857f8ed-model-cache" (OuterVolumeSpecName: "model-cache") pod "0d3e2400-018c-44f8-9b37-5cce3857f8ed" (UID: "0d3e2400-018c-44f8-9b37-5cce3857f8ed"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 25 11:37:34.574872 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:37:34.574851    2545 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0d3e2400-018c-44f8-9b37-5cce3857f8ed-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "0d3e2400-018c-44f8-9b37-5cce3857f8ed" (UID: "0d3e2400-018c-44f8-9b37-5cce3857f8ed"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 25 11:37:34.574872 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:37:34.574861    2545 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0d3e2400-018c-44f8-9b37-5cce3857f8ed-home" (OuterVolumeSpecName: "home") pod "0d3e2400-018c-44f8-9b37-5cce3857f8ed" (UID: "0d3e2400-018c-44f8-9b37-5cce3857f8ed"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 25 11:37:34.575255 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:37:34.575026    2545 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0d3e2400-018c-44f8-9b37-5cce3857f8ed-model-cache\") on node \"ip-10-0-128-206.ec2.internal\" DevicePath \"\""
May 25 11:37:34.575255 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:37:34.575046    2545 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0d3e2400-018c-44f8-9b37-5cce3857f8ed-home\") on node \"ip-10-0-128-206.ec2.internal\" DevicePath \"\""
May 25 11:37:34.575255 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:37:34.575060    2545 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0d3e2400-018c-44f8-9b37-5cce3857f8ed-tmp-dir\") on node \"ip-10-0-128-206.ec2.internal\" DevicePath \"\""
May 25 11:37:34.576759 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:37:34.576738    2545 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0d3e2400-018c-44f8-9b37-5cce3857f8ed-dshm" (OuterVolumeSpecName: "dshm") pod "0d3e2400-018c-44f8-9b37-5cce3857f8ed" (UID: "0d3e2400-018c-44f8-9b37-5cce3857f8ed"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 25 11:37:34.576875 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:37:34.576859    2545 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0d3e2400-018c-44f8-9b37-5cce3857f8ed-kube-api-access-9nxwt" (OuterVolumeSpecName: "kube-api-access-9nxwt") pod "0d3e2400-018c-44f8-9b37-5cce3857f8ed" (UID: "0d3e2400-018c-44f8-9b37-5cce3857f8ed"). InnerVolumeSpecName "kube-api-access-9nxwt". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 25 11:37:34.577062 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:37:34.577047    2545 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0d3e2400-018c-44f8-9b37-5cce3857f8ed-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "0d3e2400-018c-44f8-9b37-5cce3857f8ed" (UID: "0d3e2400-018c-44f8-9b37-5cce3857f8ed"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 25 11:37:34.626530 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:37:34.626489    2545 generic.go:358] "Generic (PLEG): container finished" podID="7e0a1318-7cf0-406a-bdb9-6eaee7a179e0" containerID="c11753df203f146ef30dfd6b271079048c6c8d457aa135b510e740627312751c" exitCode=0
May 25 11:37:34.626680 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:37:34.626568    2545 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/scheduler-ha-replicas-test-kserve-router-scheduler-54d8f6fds7zl" event={"ID":"7e0a1318-7cf0-406a-bdb9-6eaee7a179e0","Type":"ContainerDied","Data":"c11753df203f146ef30dfd6b271079048c6c8d457aa135b510e740627312751c"}
May 25 11:37:34.628115 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:37:34.628091    2545 generic.go:358] "Generic (PLEG): container finished" podID="0d3e2400-018c-44f8-9b37-5cce3857f8ed" containerID="278f28527c363c4758f27a007161e3091dd0728e09eac0f8908b7a5730d05107" exitCode=0
May 25 11:37:34.628243 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:37:34.628160    2545 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/scheduler-configmap-ref-test-kserve-74fb5ff78f-mnpfd" event={"ID":"0d3e2400-018c-44f8-9b37-5cce3857f8ed","Type":"ContainerDied","Data":"278f28527c363c4758f27a007161e3091dd0728e09eac0f8908b7a5730d05107"}
May 25 11:37:34.628243 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:37:34.628185    2545 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/scheduler-configmap-ref-test-kserve-74fb5ff78f-mnpfd" event={"ID":"0d3e2400-018c-44f8-9b37-5cce3857f8ed","Type":"ContainerDied","Data":"515de0998c0d8d954ba5196725dbc51ce2cc5b33233348049ea10cf1805e7f5c"}
May 25 11:37:34.628243 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:37:34.628186    2545 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/scheduler-configmap-ref-test-kserve-74fb5ff78f-mnpfd"
May 25 11:37:34.628243 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:37:34.628206    2545 scope.go:117] "RemoveContainer" containerID="278f28527c363c4758f27a007161e3091dd0728e09eac0f8908b7a5730d05107"
May 25 11:37:34.636818 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:37:34.636799    2545 scope.go:117] "RemoveContainer" containerID="7b5857c1fe0f9ea92e1c58705c75208bd62f3540cc8e14ca7ca838b74355f2e8"
May 25 11:37:34.638352 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:37:34.638320    2545 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0d3e2400-018c-44f8-9b37-5cce3857f8ed-kserve-provision-location" (OuterVolumeSpecName: "kserve-provision-location") pod "0d3e2400-018c-44f8-9b37-5cce3857f8ed" (UID: "0d3e2400-018c-44f8-9b37-5cce3857f8ed"). InnerVolumeSpecName "kserve-provision-location". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 25 11:37:34.675736 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:37:34.675709    2545 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9nxwt\" (UniqueName: \"kubernetes.io/projected/0d3e2400-018c-44f8-9b37-5cce3857f8ed-kube-api-access-9nxwt\") on node \"ip-10-0-128-206.ec2.internal\" DevicePath \"\""
May 25 11:37:34.675736 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:37:34.675735    2545 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0d3e2400-018c-44f8-9b37-5cce3857f8ed-tls-certs\") on node \"ip-10-0-128-206.ec2.internal\" DevicePath \"\""
May 25 11:37:34.675878 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:37:34.675752    2545 reconciler_common.go:299] "Volume detached for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/0d3e2400-018c-44f8-9b37-5cce3857f8ed-kserve-provision-location\") on node \"ip-10-0-128-206.ec2.internal\" DevicePath \"\""
May 25 11:37:34.675878 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:37:34.675764    2545 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0d3e2400-018c-44f8-9b37-5cce3857f8ed-dshm\") on node \"ip-10-0-128-206.ec2.internal\" DevicePath \"\""
May 25 11:37:34.695826 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:37:34.695807    2545 scope.go:117] "RemoveContainer" containerID="278f28527c363c4758f27a007161e3091dd0728e09eac0f8908b7a5730d05107"
May 25 11:37:34.696117 ip-10-0-128-206 kubenswrapper[2545]: E0525 11:37:34.696097    2545 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"278f28527c363c4758f27a007161e3091dd0728e09eac0f8908b7a5730d05107\": container with ID starting with 278f28527c363c4758f27a007161e3091dd0728e09eac0f8908b7a5730d05107 not found: ID does not exist" containerID="278f28527c363c4758f27a007161e3091dd0728e09eac0f8908b7a5730d05107"
May 25 11:37:34.696164 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:37:34.696124    2545 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"278f28527c363c4758f27a007161e3091dd0728e09eac0f8908b7a5730d05107"} err="failed to get container status \"278f28527c363c4758f27a007161e3091dd0728e09eac0f8908b7a5730d05107\": rpc error: code = NotFound desc = could not find container \"278f28527c363c4758f27a007161e3091dd0728e09eac0f8908b7a5730d05107\": container with ID starting with 278f28527c363c4758f27a007161e3091dd0728e09eac0f8908b7a5730d05107 not found: ID does not exist"
May 25 11:37:34.696164 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:37:34.696141    2545 scope.go:117] "RemoveContainer" containerID="7b5857c1fe0f9ea92e1c58705c75208bd62f3540cc8e14ca7ca838b74355f2e8"
May 25 11:37:34.696363 ip-10-0-128-206 kubenswrapper[2545]: E0525 11:37:34.696346    2545 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7b5857c1fe0f9ea92e1c58705c75208bd62f3540cc8e14ca7ca838b74355f2e8\": container with ID starting with 7b5857c1fe0f9ea92e1c58705c75208bd62f3540cc8e14ca7ca838b74355f2e8 not found: ID does not exist" containerID="7b5857c1fe0f9ea92e1c58705c75208bd62f3540cc8e14ca7ca838b74355f2e8"
May 25 11:37:34.696404 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:37:34.696367    2545 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7b5857c1fe0f9ea92e1c58705c75208bd62f3540cc8e14ca7ca838b74355f2e8"} err="failed to get container status \"7b5857c1fe0f9ea92e1c58705c75208bd62f3540cc8e14ca7ca838b74355f2e8\": rpc error: code = NotFound desc = could not find container \"7b5857c1fe0f9ea92e1c58705c75208bd62f3540cc8e14ca7ca838b74355f2e8\": container with ID starting with 7b5857c1fe0f9ea92e1c58705c75208bd62f3540cc8e14ca7ca838b74355f2e8 not found: ID does not exist"
May 25 11:37:34.968522 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:37:34.968421    2545 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/scheduler-configmap-ref-test-kserve-74fb5ff78f-mnpfd"]
May 25 11:37:34.993282 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:37:34.993247    2545 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/scheduler-configmap-ref-test-kserve-74fb5ff78f-mnpfd"]
May 25 11:37:35.634412 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:37:35.634375    2545 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/scheduler-ha-replicas-test-kserve-router-scheduler-54d8f6fds7zl" event={"ID":"7e0a1318-7cf0-406a-bdb9-6eaee7a179e0","Type":"ContainerStarted","Data":"d2752294d2caa37c9d55373d308ecbd7f231c068af7d24944a76be2ad4e0785b"}
May 25 11:37:36.776724 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:37:36.776684    2545 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0d3e2400-018c-44f8-9b37-5cce3857f8ed" path="/var/lib/kubelet/pods/0d3e2400-018c-44f8-9b37-5cce3857f8ed/volumes"
May 25 11:38:05.758029 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:38:05.757989    2545 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/scheduler-ha-replicas-test-kserve-router-scheduler-54d8f6fds7zl" event={"ID":"7e0a1318-7cf0-406a-bdb9-6eaee7a179e0","Type":"ContainerStarted","Data":"5144fb2e68a7beead154b21e5ebd0fc48df1b67a673de10fb256c1920046ebeb"}
May 25 11:38:05.758478 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:38:05.758276    2545 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/scheduler-ha-replicas-test-kserve-router-scheduler-54d8f6fds7zl"
May 25 11:38:05.761006 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:38:05.760952    2545 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/scheduler-ha-replicas-test-kserve-router-scheduler-54d8f6fds7zl" podUID="7e0a1318-7cf0-406a-bdb9-6eaee7a179e0" containerName="main" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
May 25 11:38:05.791370 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:38:05.791331    2545 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kserve-ci-e2e-test/scheduler-ha-replicas-test-kserve-router-scheduler-54d8f6fds7zl" podStartSLOduration=3.189804872 podStartE2EDuration="33.791319416s" podCreationTimestamp="2026-05-25 11:37:32 +0000 UTC" firstStartedPulling="2026-05-25 11:37:34.627701503 +0000 UTC m=+846.393986428" lastFinishedPulling="2026-05-25 11:38:05.229216031 +0000 UTC m=+876.995500972" observedRunningTime="2026-05-25 11:38:05.78955273 +0000 UTC m=+877.555837678" watchObservedRunningTime="2026-05-25 11:38:05.791319416 +0000 UTC m=+877.557604361"
May 25 11:38:06.763388 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:38:06.763354    2545 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/scheduler-ha-replicas-test-kserve-router-scheduler-54d8f6fds7zl" podUID="7e0a1318-7cf0-406a-bdb9-6eaee7a179e0" containerName="main" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
May 25 11:38:13.098526 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:38:13.098447    2545 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/scheduler-ha-replicas-test-kserve-router-scheduler-54d8f6fds7zl"
May 25 11:38:13.098526 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:38:13.098492    2545 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kserve-ci-e2e-test/scheduler-ha-replicas-test-kserve-router-scheduler-54d8f6fds7zl"
May 25 11:38:13.100117 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:38:13.100089    2545 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/scheduler-ha-replicas-test-kserve-router-scheduler-54d8f6fds7zl" podUID="7e0a1318-7cf0-406a-bdb9-6eaee7a179e0" containerName="main" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
May 25 11:38:13.100245 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:38:13.100167    2545 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="kserve-ci-e2e-test/scheduler-ha-replicas-test-kserve-router-scheduler-54d8f6fds7zl"
May 25 11:38:13.785627 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:38:13.785583    2545 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/scheduler-ha-replicas-test-kserve-router-scheduler-54d8f6fds7zl" podUID="7e0a1318-7cf0-406a-bdb9-6eaee7a179e0" containerName="main" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
May 25 11:38:13.785812 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:38:13.785682    2545 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/scheduler-ha-replicas-test-kserve-router-scheduler-54d8f6fds7zl"
May 25 11:38:14.788563 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:38:14.788529    2545 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/scheduler-ha-replicas-test-kserve-router-scheduler-54d8f6fds7zl" podUID="7e0a1318-7cf0-406a-bdb9-6eaee7a179e0" containerName="main" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
May 25 11:38:24.788834 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:38:24.788790    2545 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/scheduler-ha-replicas-test-kserve-router-scheduler-54d8f6fds7zl" podUID="7e0a1318-7cf0-406a-bdb9-6eaee7a179e0" containerName="main" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
May 25 11:38:28.713798 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:38:28.713766    2545 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-krfmt_4e27bcd6-c257-422b-a332-0df274cf6fcc/ovn-acl-logging/0.log"
May 25 11:38:28.714260 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:38:28.713944    2545 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-krfmt_4e27bcd6-c257-422b-a332-0df274cf6fcc/ovn-acl-logging/0.log"
May 25 11:38:34.788722 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:38:34.788684    2545 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/scheduler-ha-replicas-test-kserve-router-scheduler-54d8f6fds7zl" podUID="7e0a1318-7cf0-406a-bdb9-6eaee7a179e0" containerName="main" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
May 25 11:38:44.788833 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:38:44.788787    2545 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/scheduler-ha-replicas-test-kserve-router-scheduler-54d8f6fds7zl" podUID="7e0a1318-7cf0-406a-bdb9-6eaee7a179e0" containerName="main" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
May 25 11:38:54.789145 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:38:54.789100    2545 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/scheduler-ha-replicas-test-kserve-router-scheduler-54d8f6fds7zl" podUID="7e0a1318-7cf0-406a-bdb9-6eaee7a179e0" containerName="main" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
May 25 11:39:04.789310 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:39:04.789272    2545 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/scheduler-ha-replicas-test-kserve-router-scheduler-54d8f6fds7zl" podUID="7e0a1318-7cf0-406a-bdb9-6eaee7a179e0" containerName="main" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
May 25 11:39:14.789183 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:39:14.789147    2545 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/scheduler-ha-replicas-test-kserve-router-scheduler-54d8f6fds7zl" podUID="7e0a1318-7cf0-406a-bdb9-6eaee7a179e0" containerName="main" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
May 25 11:39:24.789339 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:39:24.789304    2545 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/scheduler-ha-replicas-test-kserve-router-scheduler-54d8f6fds7zl" podUID="7e0a1318-7cf0-406a-bdb9-6eaee7a179e0" containerName="main" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
May 25 11:39:34.788673 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:39:34.788638    2545 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/scheduler-ha-replicas-test-kserve-router-scheduler-54d8f6fds7zl" podUID="7e0a1318-7cf0-406a-bdb9-6eaee7a179e0" containerName="main" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
May 25 11:39:43.564324 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:39:43.564241    2545 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/scheduler-ha-replicas-test-kserve-router-scheduler-54d8f6fds7zl"]
May 25 11:39:43.564820 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:39:43.564664    2545 kuberuntime_container.go:864] "Killing container with a grace period" pod="kserve-ci-e2e-test/scheduler-ha-replicas-test-kserve-router-scheduler-54d8f6fds7zl" podUID="7e0a1318-7cf0-406a-bdb9-6eaee7a179e0" containerName="main" containerID="cri-o://d2752294d2caa37c9d55373d308ecbd7f231c068af7d24944a76be2ad4e0785b" gracePeriod=30
May 25 11:39:43.564820 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:39:43.564733    2545 kuberuntime_container.go:864] "Killing container with a grace period" pod="kserve-ci-e2e-test/scheduler-ha-replicas-test-kserve-router-scheduler-54d8f6fds7zl" podUID="7e0a1318-7cf0-406a-bdb9-6eaee7a179e0" containerName="tokenizer" containerID="cri-o://5144fb2e68a7beead154b21e5ebd0fc48df1b67a673de10fb256c1920046ebeb" gracePeriod=30
May 25 11:39:43.566600 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:39:43.566571    2545 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/scheduler-ha-replicas-test-kserve-router-scheduler-54d8f6fds7zl" podUID="7e0a1318-7cf0-406a-bdb9-6eaee7a179e0" containerName="main" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
May 25 11:39:43.785271 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:39:43.785226    2545 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/scheduler-ha-replicas-test-kserve-router-scheduler-54d8f6fds7zl" podUID="7e0a1318-7cf0-406a-bdb9-6eaee7a179e0" containerName="tokenizer" probeResult="failure" output="Get \"http://10.134.0.32:8082/healthz\": dial tcp 10.134.0.32:8082: connect: connection refused"
May 25 11:39:44.081205 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:39:44.081165    2545 generic.go:358] "Generic (PLEG): container finished" podID="7e0a1318-7cf0-406a-bdb9-6eaee7a179e0" containerID="d2752294d2caa37c9d55373d308ecbd7f231c068af7d24944a76be2ad4e0785b" exitCode=0
May 25 11:39:44.081378 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:39:44.081224    2545 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/scheduler-ha-replicas-test-kserve-router-scheduler-54d8f6fds7zl" event={"ID":"7e0a1318-7cf0-406a-bdb9-6eaee7a179e0","Type":"ContainerDied","Data":"d2752294d2caa37c9d55373d308ecbd7f231c068af7d24944a76be2ad4e0785b"}
May 25 11:39:44.721990 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:39:44.721939    2545 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/scheduler-ha-replicas-test-kserve-router-scheduler-54d8f6fds7zl"
May 25 11:39:44.817174 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:39:44.817094    2545 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"tokenizer-uds\" (UniqueName: \"kubernetes.io/empty-dir/7e0a1318-7cf0-406a-bdb9-6eaee7a179e0-tokenizer-uds\") pod \"7e0a1318-7cf0-406a-bdb9-6eaee7a179e0\" (UID: \"7e0a1318-7cf0-406a-bdb9-6eaee7a179e0\") "
May 25 11:39:44.817174 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:39:44.817131    2545 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/7e0a1318-7cf0-406a-bdb9-6eaee7a179e0-kserve-provision-location\") pod \"7e0a1318-7cf0-406a-bdb9-6eaee7a179e0\" (UID: \"7e0a1318-7cf0-406a-bdb9-6eaee7a179e0\") "
May 25 11:39:44.817397 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:39:44.817188    2545 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-k86rb\" (UniqueName: \"kubernetes.io/projected/7e0a1318-7cf0-406a-bdb9-6eaee7a179e0-kube-api-access-k86rb\") pod \"7e0a1318-7cf0-406a-bdb9-6eaee7a179e0\" (UID: \"7e0a1318-7cf0-406a-bdb9-6eaee7a179e0\") "
May 25 11:39:44.817397 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:39:44.817215    2545 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"tokenizer-cache\" (UniqueName: \"kubernetes.io/empty-dir/7e0a1318-7cf0-406a-bdb9-6eaee7a179e0-tokenizer-cache\") pod \"7e0a1318-7cf0-406a-bdb9-6eaee7a179e0\" (UID: \"7e0a1318-7cf0-406a-bdb9-6eaee7a179e0\") "
May 25 11:39:44.817397 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:39:44.817241    2545 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"tokenizer-tmp\" (UniqueName: \"kubernetes.io/empty-dir/7e0a1318-7cf0-406a-bdb9-6eaee7a179e0-tokenizer-tmp\") pod \"7e0a1318-7cf0-406a-bdb9-6eaee7a179e0\" (UID: \"7e0a1318-7cf0-406a-bdb9-6eaee7a179e0\") "
May 25 11:39:44.817397 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:39:44.817293    2545 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7e0a1318-7cf0-406a-bdb9-6eaee7a179e0-tls-certs\") pod \"7e0a1318-7cf0-406a-bdb9-6eaee7a179e0\" (UID: \"7e0a1318-7cf0-406a-bdb9-6eaee7a179e0\") "
May 25 11:39:44.817397 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:39:44.817375    2545 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7e0a1318-7cf0-406a-bdb9-6eaee7a179e0-tokenizer-uds" (OuterVolumeSpecName: "tokenizer-uds") pod "7e0a1318-7cf0-406a-bdb9-6eaee7a179e0" (UID: "7e0a1318-7cf0-406a-bdb9-6eaee7a179e0"). InnerVolumeSpecName "tokenizer-uds". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 25 11:39:44.817612 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:39:44.817520    2545 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7e0a1318-7cf0-406a-bdb9-6eaee7a179e0-tokenizer-cache" (OuterVolumeSpecName: "tokenizer-cache") pod "7e0a1318-7cf0-406a-bdb9-6eaee7a179e0" (UID: "7e0a1318-7cf0-406a-bdb9-6eaee7a179e0"). InnerVolumeSpecName "tokenizer-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 25 11:39:44.817612 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:39:44.817601    2545 reconciler_common.go:299] "Volume detached for volume \"tokenizer-uds\" (UniqueName: \"kubernetes.io/empty-dir/7e0a1318-7cf0-406a-bdb9-6eaee7a179e0-tokenizer-uds\") on node \"ip-10-0-128-206.ec2.internal\" DevicePath \"\""
May 25 11:39:44.817717 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:39:44.817619    2545 reconciler_common.go:299] "Volume detached for volume \"tokenizer-cache\" (UniqueName: \"kubernetes.io/empty-dir/7e0a1318-7cf0-406a-bdb9-6eaee7a179e0-tokenizer-cache\") on node \"ip-10-0-128-206.ec2.internal\" DevicePath \"\""
May 25 11:39:44.817717 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:39:44.817637    2545 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7e0a1318-7cf0-406a-bdb9-6eaee7a179e0-tokenizer-tmp" (OuterVolumeSpecName: "tokenizer-tmp") pod "7e0a1318-7cf0-406a-bdb9-6eaee7a179e0" (UID: "7e0a1318-7cf0-406a-bdb9-6eaee7a179e0"). InnerVolumeSpecName "tokenizer-tmp". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 25 11:39:44.817980 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:39:44.817941    2545 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7e0a1318-7cf0-406a-bdb9-6eaee7a179e0-kserve-provision-location" (OuterVolumeSpecName: "kserve-provision-location") pod "7e0a1318-7cf0-406a-bdb9-6eaee7a179e0" (UID: "7e0a1318-7cf0-406a-bdb9-6eaee7a179e0"). InnerVolumeSpecName "kserve-provision-location". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 25 11:39:44.819435 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:39:44.819416    2545 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7e0a1318-7cf0-406a-bdb9-6eaee7a179e0-kube-api-access-k86rb" (OuterVolumeSpecName: "kube-api-access-k86rb") pod "7e0a1318-7cf0-406a-bdb9-6eaee7a179e0" (UID: "7e0a1318-7cf0-406a-bdb9-6eaee7a179e0"). InnerVolumeSpecName "kube-api-access-k86rb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 25 11:39:44.819435 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:39:44.819427    2545 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7e0a1318-7cf0-406a-bdb9-6eaee7a179e0-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "7e0a1318-7cf0-406a-bdb9-6eaee7a179e0" (UID: "7e0a1318-7cf0-406a-bdb9-6eaee7a179e0"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 25 11:39:44.918714 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:39:44.918682    2545 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7e0a1318-7cf0-406a-bdb9-6eaee7a179e0-tls-certs\") on node \"ip-10-0-128-206.ec2.internal\" DevicePath \"\""
May 25 11:39:44.918714 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:39:44.918707    2545 reconciler_common.go:299] "Volume detached for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/7e0a1318-7cf0-406a-bdb9-6eaee7a179e0-kserve-provision-location\") on node \"ip-10-0-128-206.ec2.internal\" DevicePath \"\""
May 25 11:39:44.918714 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:39:44.918719    2545 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-k86rb\" (UniqueName: \"kubernetes.io/projected/7e0a1318-7cf0-406a-bdb9-6eaee7a179e0-kube-api-access-k86rb\") on node \"ip-10-0-128-206.ec2.internal\" DevicePath \"\""
May 25 11:39:44.918924 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:39:44.918729    2545 reconciler_common.go:299] "Volume detached for volume \"tokenizer-tmp\" (UniqueName: \"kubernetes.io/empty-dir/7e0a1318-7cf0-406a-bdb9-6eaee7a179e0-tokenizer-tmp\") on node \"ip-10-0-128-206.ec2.internal\" DevicePath \"\""
May 25 11:39:45.086289 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:39:45.086208    2545 generic.go:358] "Generic (PLEG): container finished" podID="7e0a1318-7cf0-406a-bdb9-6eaee7a179e0" containerID="5144fb2e68a7beead154b21e5ebd0fc48df1b67a673de10fb256c1920046ebeb" exitCode=0
May 25 11:39:45.086289 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:39:45.086265    2545 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/scheduler-ha-replicas-test-kserve-router-scheduler-54d8f6fds7zl" event={"ID":"7e0a1318-7cf0-406a-bdb9-6eaee7a179e0","Type":"ContainerDied","Data":"5144fb2e68a7beead154b21e5ebd0fc48df1b67a673de10fb256c1920046ebeb"}
May 25 11:39:45.086289 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:39:45.086286    2545 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/scheduler-ha-replicas-test-kserve-router-scheduler-54d8f6fds7zl"
May 25 11:39:45.086504 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:39:45.086310    2545 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/scheduler-ha-replicas-test-kserve-router-scheduler-54d8f6fds7zl" event={"ID":"7e0a1318-7cf0-406a-bdb9-6eaee7a179e0","Type":"ContainerDied","Data":"e4ffc12952a881d86b62a84893ed205d56d63d6472d3fe43d285c164180619d5"}
May 25 11:39:45.086504 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:39:45.086331    2545 scope.go:117] "RemoveContainer" containerID="5144fb2e68a7beead154b21e5ebd0fc48df1b67a673de10fb256c1920046ebeb"
May 25 11:39:45.095573 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:39:45.095558    2545 scope.go:117] "RemoveContainer" containerID="d2752294d2caa37c9d55373d308ecbd7f231c068af7d24944a76be2ad4e0785b"
May 25 11:39:45.104520 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:39:45.104501    2545 scope.go:117] "RemoveContainer" containerID="c11753df203f146ef30dfd6b271079048c6c8d457aa135b510e740627312751c"
May 25 11:39:45.111844 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:39:45.111824    2545 scope.go:117] "RemoveContainer" containerID="5144fb2e68a7beead154b21e5ebd0fc48df1b67a673de10fb256c1920046ebeb"
May 25 11:39:45.112147 ip-10-0-128-206 kubenswrapper[2545]: E0525 11:39:45.112127    2545 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5144fb2e68a7beead154b21e5ebd0fc48df1b67a673de10fb256c1920046ebeb\": container with ID starting with 5144fb2e68a7beead154b21e5ebd0fc48df1b67a673de10fb256c1920046ebeb not found: ID does not exist" containerID="5144fb2e68a7beead154b21e5ebd0fc48df1b67a673de10fb256c1920046ebeb"
May 25 11:39:45.112239 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:39:45.112154    2545 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5144fb2e68a7beead154b21e5ebd0fc48df1b67a673de10fb256c1920046ebeb"} err="failed to get container status \"5144fb2e68a7beead154b21e5ebd0fc48df1b67a673de10fb256c1920046ebeb\": rpc error: code = NotFound desc = could not find container \"5144fb2e68a7beead154b21e5ebd0fc48df1b67a673de10fb256c1920046ebeb\": container with ID starting with 5144fb2e68a7beead154b21e5ebd0fc48df1b67a673de10fb256c1920046ebeb not found: ID does not exist"
May 25 11:39:45.112239 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:39:45.112175    2545 scope.go:117] "RemoveContainer" containerID="d2752294d2caa37c9d55373d308ecbd7f231c068af7d24944a76be2ad4e0785b"
May 25 11:39:45.112445 ip-10-0-128-206 kubenswrapper[2545]: E0525 11:39:45.112426    2545 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d2752294d2caa37c9d55373d308ecbd7f231c068af7d24944a76be2ad4e0785b\": container with ID starting with d2752294d2caa37c9d55373d308ecbd7f231c068af7d24944a76be2ad4e0785b not found: ID does not exist" containerID="d2752294d2caa37c9d55373d308ecbd7f231c068af7d24944a76be2ad4e0785b"
May 25 11:39:45.112515 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:39:45.112454    2545 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d2752294d2caa37c9d55373d308ecbd7f231c068af7d24944a76be2ad4e0785b"} err="failed to get container status \"d2752294d2caa37c9d55373d308ecbd7f231c068af7d24944a76be2ad4e0785b\": rpc error: code = NotFound desc = could not find container \"d2752294d2caa37c9d55373d308ecbd7f231c068af7d24944a76be2ad4e0785b\": container with ID starting with d2752294d2caa37c9d55373d308ecbd7f231c068af7d24944a76be2ad4e0785b not found: ID does not exist"
May 25 11:39:45.112515 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:39:45.112476    2545 scope.go:117] "RemoveContainer" containerID="c11753df203f146ef30dfd6b271079048c6c8d457aa135b510e740627312751c"
May 25 11:39:45.112744 ip-10-0-128-206 kubenswrapper[2545]: E0525 11:39:45.112727    2545 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c11753df203f146ef30dfd6b271079048c6c8d457aa135b510e740627312751c\": container with ID starting with c11753df203f146ef30dfd6b271079048c6c8d457aa135b510e740627312751c not found: ID does not exist" containerID="c11753df203f146ef30dfd6b271079048c6c8d457aa135b510e740627312751c"
May 25 11:39:45.112804 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:39:45.112752    2545 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c11753df203f146ef30dfd6b271079048c6c8d457aa135b510e740627312751c"} err="failed to get container status \"c11753df203f146ef30dfd6b271079048c6c8d457aa135b510e740627312751c\": rpc error: code = NotFound desc = could not find container \"c11753df203f146ef30dfd6b271079048c6c8d457aa135b510e740627312751c\": container with ID starting with c11753df203f146ef30dfd6b271079048c6c8d457aa135b510e740627312751c not found: ID does not exist"
May 25 11:39:45.113365 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:39:45.113343    2545 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/scheduler-ha-replicas-test-kserve-router-scheduler-54d8f6fds7zl"]
May 25 11:39:45.119814 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:39:45.119792    2545 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/scheduler-ha-replicas-test-kserve-router-scheduler-54d8f6fds7zl"]
May 25 11:39:46.775421 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:39:46.775384    2545 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7e0a1318-7cf0-406a-bdb9-6eaee7a179e0" path="/var/lib/kubelet/pods/7e0a1318-7cf0-406a-bdb9-6eaee7a179e0/volumes"
May 25 11:39:49.238025 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:39:49.237992    2545 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/precise-prefix-cache-test-kserve-55c6c598f5-sg6qd"]
May 25 11:39:49.238382 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:39:49.238354    2545 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0d3e2400-018c-44f8-9b37-5cce3857f8ed" containerName="main"
May 25 11:39:49.238382 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:39:49.238366    2545 state_mem.go:107] "Deleted CPUSet assignment" podUID="0d3e2400-018c-44f8-9b37-5cce3857f8ed" containerName="main"
May 25 11:39:49.238453 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:39:49.238386    2545 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7e0a1318-7cf0-406a-bdb9-6eaee7a179e0" containerName="storage-initializer"
May 25 11:39:49.238453 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:39:49.238391    2545 state_mem.go:107] "Deleted CPUSet assignment" podUID="7e0a1318-7cf0-406a-bdb9-6eaee7a179e0" containerName="storage-initializer"
May 25 11:39:49.238453 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:39:49.238403    2545 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0d3e2400-018c-44f8-9b37-5cce3857f8ed" containerName="storage-initializer"
May 25 11:39:49.238453 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:39:49.238409    2545 state_mem.go:107] "Deleted CPUSet assignment" podUID="0d3e2400-018c-44f8-9b37-5cce3857f8ed" containerName="storage-initializer"
May 25 11:39:49.238453 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:39:49.238416    2545 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7e0a1318-7cf0-406a-bdb9-6eaee7a179e0" containerName="main"
May 25 11:39:49.238453 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:39:49.238423    2545 state_mem.go:107] "Deleted CPUSet assignment" podUID="7e0a1318-7cf0-406a-bdb9-6eaee7a179e0" containerName="main"
May 25 11:39:49.238453 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:39:49.238436    2545 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7e0a1318-7cf0-406a-bdb9-6eaee7a179e0" containerName="tokenizer"
May 25 11:39:49.238453 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:39:49.238442    2545 state_mem.go:107] "Deleted CPUSet assignment" podUID="7e0a1318-7cf0-406a-bdb9-6eaee7a179e0" containerName="tokenizer"
May 25 11:39:49.238677 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:39:49.238494    2545 memory_manager.go:356] "RemoveStaleState removing state" podUID="7e0a1318-7cf0-406a-bdb9-6eaee7a179e0" containerName="main"
May 25 11:39:49.238677 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:39:49.238506    2545 memory_manager.go:356] "RemoveStaleState removing state" podUID="7e0a1318-7cf0-406a-bdb9-6eaee7a179e0" containerName="tokenizer"
May 25 11:39:49.238677 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:39:49.238518    2545 memory_manager.go:356] "RemoveStaleState removing state" podUID="0d3e2400-018c-44f8-9b37-5cce3857f8ed" containerName="main"
May 25 11:39:49.240531 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:39:49.240515    2545 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/precise-prefix-cache-test-kserve-55c6c598f5-sg6qd"
May 25 11:39:49.247597 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:39:49.247575    2545 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"precise-prefix-cache-test-kserve-self-signed-certs\""
May 25 11:39:49.248518 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:39:49.248495    2545 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"openshift-service-ca.crt\""
May 25 11:39:49.248518 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:39:49.248507    2545 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"default-dockercfg-vcvlw\""
May 25 11:39:49.248678 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:39:49.248534    2545 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"kube-root-ca.crt\""
May 25 11:39:49.263981 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:39:49.263932    2545 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/precise-prefix-cache-test-kserve-55c6c598f5-sg6qd"]
May 25 11:39:49.356415 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:39:49.356383    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/96a2dfd8-9cbc-4c05-9652-a34949a935ef-home\") pod \"precise-prefix-cache-test-kserve-55c6c598f5-sg6qd\" (UID: \"96a2dfd8-9cbc-4c05-9652-a34949a935ef\") " pod="kserve-ci-e2e-test/precise-prefix-cache-test-kserve-55c6c598f5-sg6qd"
May 25 11:39:49.356578 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:39:49.356439    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/96a2dfd8-9cbc-4c05-9652-a34949a935ef-kserve-provision-location\") pod \"precise-prefix-cache-test-kserve-55c6c598f5-sg6qd\" (UID: \"96a2dfd8-9cbc-4c05-9652-a34949a935ef\") " pod="kserve-ci-e2e-test/precise-prefix-cache-test-kserve-55c6c598f5-sg6qd"
May 25 11:39:49.356578 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:39:49.356521    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kd4mw\" (UniqueName: \"kubernetes.io/projected/96a2dfd8-9cbc-4c05-9652-a34949a935ef-kube-api-access-kd4mw\") pod \"precise-prefix-cache-test-kserve-55c6c598f5-sg6qd\" (UID: \"96a2dfd8-9cbc-4c05-9652-a34949a935ef\") " pod="kserve-ci-e2e-test/precise-prefix-cache-test-kserve-55c6c598f5-sg6qd"
May 25 11:39:49.356578 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:39:49.356555    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/96a2dfd8-9cbc-4c05-9652-a34949a935ef-dshm\") pod \"precise-prefix-cache-test-kserve-55c6c598f5-sg6qd\" (UID: \"96a2dfd8-9cbc-4c05-9652-a34949a935ef\") " pod="kserve-ci-e2e-test/precise-prefix-cache-test-kserve-55c6c598f5-sg6qd"
May 25 11:39:49.356695 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:39:49.356586    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/96a2dfd8-9cbc-4c05-9652-a34949a935ef-tmp-dir\") pod \"precise-prefix-cache-test-kserve-55c6c598f5-sg6qd\" (UID: \"96a2dfd8-9cbc-4c05-9652-a34949a935ef\") " pod="kserve-ci-e2e-test/precise-prefix-cache-test-kserve-55c6c598f5-sg6qd"
May 25 11:39:49.356695 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:39:49.356602    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/96a2dfd8-9cbc-4c05-9652-a34949a935ef-tls-certs\") pod \"precise-prefix-cache-test-kserve-55c6c598f5-sg6qd\" (UID: \"96a2dfd8-9cbc-4c05-9652-a34949a935ef\") " pod="kserve-ci-e2e-test/precise-prefix-cache-test-kserve-55c6c598f5-sg6qd"
May 25 11:39:49.356695 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:39:49.356625    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/96a2dfd8-9cbc-4c05-9652-a34949a935ef-model-cache\") pod \"precise-prefix-cache-test-kserve-55c6c598f5-sg6qd\" (UID: \"96a2dfd8-9cbc-4c05-9652-a34949a935ef\") " pod="kserve-ci-e2e-test/precise-prefix-cache-test-kserve-55c6c598f5-sg6qd"
May 25 11:39:49.457922 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:39:49.457886    2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/96a2dfd8-9cbc-4c05-9652-a34949a935ef-kserve-provision-location\") pod \"precise-prefix-cache-test-kserve-55c6c598f5-sg6qd\" (UID: \"96a2dfd8-9cbc-4c05-9652-a34949a935ef\") " pod="kserve-ci-e2e-test/precise-prefix-cache-test-kserve-55c6c598f5-sg6qd"
May 25 11:39:49.458121 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:39:49.457940    2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-kd4mw\" (UniqueName: \"kubernetes.io/projected/96a2dfd8-9cbc-4c05-9652-a34949a935ef-kube-api-access-kd4mw\") pod \"precise-prefix-cache-test-kserve-55c6c598f5-sg6qd\" (UID: \"96a2dfd8-9cbc-4c05-9652-a34949a935ef\") " pod="kserve-ci-e2e-test/precise-prefix-cache-test-kserve-55c6c598f5-sg6qd"
May 25 11:39:49.458188 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:39:49.458123    2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/96a2dfd8-9cbc-4c05-9652-a34949a935ef-dshm\") pod \"precise-prefix-cache-test-kserve-55c6c598f5-sg6qd\" (UID: \"96a2dfd8-9cbc-4c05-9652-a34949a935ef\") " pod="kserve-ci-e2e-test/precise-prefix-cache-test-kserve-55c6c598f5-sg6qd"
May 25 11:39:49.458188 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:39:49.458172    2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/96a2dfd8-9cbc-4c05-9652-a34949a935ef-tmp-dir\") pod \"precise-prefix-cache-test-kserve-55c6c598f5-sg6qd\" (UID: \"96a2dfd8-9cbc-4c05-9652-a34949a935ef\") " pod="kserve-ci-e2e-test/precise-prefix-cache-test-kserve-55c6c598f5-sg6qd"
May 25 11:39:49.458294 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:39:49.458199    2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/96a2dfd8-9cbc-4c05-9652-a34949a935ef-tls-certs\") pod \"precise-prefix-cache-test-kserve-55c6c598f5-sg6qd\" (UID: \"96a2dfd8-9cbc-4c05-9652-a34949a935ef\") " pod="kserve-ci-e2e-test/precise-prefix-cache-test-kserve-55c6c598f5-sg6qd"
May 25 11:39:49.458294 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:39:49.458249    2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/96a2dfd8-9cbc-4c05-9652-a34949a935ef-model-cache\") pod \"precise-prefix-cache-test-kserve-55c6c598f5-sg6qd\" (UID: \"96a2dfd8-9cbc-4c05-9652-a34949a935ef\") " pod="kserve-ci-e2e-test/precise-prefix-cache-test-kserve-55c6c598f5-sg6qd"
May 25 11:39:49.458294 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:39:49.458280    2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/96a2dfd8-9cbc-4c05-9652-a34949a935ef-home\") pod \"precise-prefix-cache-test-kserve-55c6c598f5-sg6qd\" (UID: \"96a2dfd8-9cbc-4c05-9652-a34949a935ef\") " pod="kserve-ci-e2e-test/precise-prefix-cache-test-kserve-55c6c598f5-sg6qd"
May 25 11:39:49.458430 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:39:49.458354    2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/96a2dfd8-9cbc-4c05-9652-a34949a935ef-kserve-provision-location\") pod \"precise-prefix-cache-test-kserve-55c6c598f5-sg6qd\" (UID: \"96a2dfd8-9cbc-4c05-9652-a34949a935ef\") " pod="kserve-ci-e2e-test/precise-prefix-cache-test-kserve-55c6c598f5-sg6qd"
May 25 11:39:49.458577 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:39:49.458551    2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/96a2dfd8-9cbc-4c05-9652-a34949a935ef-tmp-dir\") pod \"precise-prefix-cache-test-kserve-55c6c598f5-sg6qd\" (UID: \"96a2dfd8-9cbc-4c05-9652-a34949a935ef\") " pod="kserve-ci-e2e-test/precise-prefix-cache-test-kserve-55c6c598f5-sg6qd"
May 25 11:39:49.458644 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:39:49.458587    2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/96a2dfd8-9cbc-4c05-9652-a34949a935ef-home\") pod \"precise-prefix-cache-test-kserve-55c6c598f5-sg6qd\" (UID: \"96a2dfd8-9cbc-4c05-9652-a34949a935ef\") " pod="kserve-ci-e2e-test/precise-prefix-cache-test-kserve-55c6c598f5-sg6qd"
May 25 11:39:49.458644 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:39:49.458627    2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/96a2dfd8-9cbc-4c05-9652-a34949a935ef-model-cache\") pod \"precise-prefix-cache-test-kserve-55c6c598f5-sg6qd\" (UID: \"96a2dfd8-9cbc-4c05-9652-a34949a935ef\") " pod="kserve-ci-e2e-test/precise-prefix-cache-test-kserve-55c6c598f5-sg6qd"
May 25 11:39:49.460353 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:39:49.460327    2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/96a2dfd8-9cbc-4c05-9652-a34949a935ef-dshm\") pod \"precise-prefix-cache-test-kserve-55c6c598f5-sg6qd\" (UID: \"96a2dfd8-9cbc-4c05-9652-a34949a935ef\") " pod="kserve-ci-e2e-test/precise-prefix-cache-test-kserve-55c6c598f5-sg6qd"
May 25 11:39:49.460562 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:39:49.460547    2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/96a2dfd8-9cbc-4c05-9652-a34949a935ef-tls-certs\") pod \"precise-prefix-cache-test-kserve-55c6c598f5-sg6qd\" (UID: \"96a2dfd8-9cbc-4c05-9652-a34949a935ef\") " pod="kserve-ci-e2e-test/precise-prefix-cache-test-kserve-55c6c598f5-sg6qd"
May 25 11:39:49.470352 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:39:49.470334    2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kd4mw\" (UniqueName: \"kubernetes.io/projected/96a2dfd8-9cbc-4c05-9652-a34949a935ef-kube-api-access-kd4mw\") pod \"precise-prefix-cache-test-kserve-55c6c598f5-sg6qd\" (UID: \"96a2dfd8-9cbc-4c05-9652-a34949a935ef\") " pod="kserve-ci-e2e-test/precise-prefix-cache-test-kserve-55c6c598f5-sg6qd"
May 25 11:39:49.551180 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:39:49.551105    2545 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/precise-prefix-cache-test-kserve-55c6c598f5-sg6qd"
May 25 11:39:49.592682 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:39:49.592647    2545 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/precise-prefix-cache-test-kserve-router-scheduler-7d6895b9bmqfv"]
May 25 11:39:49.596707 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:39:49.596683    2545 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/precise-prefix-cache-test-kserve-router-scheduler-7d6895b9bmqfv"
May 25 11:39:49.600350 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:39:49.600320    2545 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"precise-prefix-cache-test-epp-sa-dockercfg-pvtmk\""
May 25 11:39:49.628145 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:39:49.628106    2545 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/precise-prefix-cache-test-kserve-router-scheduler-7d6895b9bmqfv"]
May 25 11:39:49.663659 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:39:49.660836    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/3851a8a1-305d-4edf-8d59-0e79ec9acecc-kserve-provision-location\") pod \"precise-prefix-cache-test-kserve-router-scheduler-7d6895b9bmqfv\" (UID: \"3851a8a1-305d-4edf-8d59-0e79ec9acecc\") " pod="kserve-ci-e2e-test/precise-prefix-cache-test-kserve-router-scheduler-7d6895b9bmqfv"
May 25 11:39:49.663659 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:39:49.660937    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3851a8a1-305d-4edf-8d59-0e79ec9acecc-tls-certs\") pod \"precise-prefix-cache-test-kserve-router-scheduler-7d6895b9bmqfv\" (UID: \"3851a8a1-305d-4edf-8d59-0e79ec9acecc\") " pod="kserve-ci-e2e-test/precise-prefix-cache-test-kserve-router-scheduler-7d6895b9bmqfv"
May 25 11:39:49.663659 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:39:49.661007    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tokenizer-tmp\" (UniqueName: \"kubernetes.io/empty-dir/3851a8a1-305d-4edf-8d59-0e79ec9acecc-tokenizer-tmp\") pod \"precise-prefix-cache-test-kserve-router-scheduler-7d6895b9bmqfv\" (UID: \"3851a8a1-305d-4edf-8d59-0e79ec9acecc\") " pod="kserve-ci-e2e-test/precise-prefix-cache-test-kserve-router-scheduler-7d6895b9bmqfv"
May 25 11:39:49.663659 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:39:49.661077    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tokenizer-uds\" (UniqueName: \"kubernetes.io/empty-dir/3851a8a1-305d-4edf-8d59-0e79ec9acecc-tokenizer-uds\") pod \"precise-prefix-cache-test-kserve-router-scheduler-7d6895b9bmqfv\" (UID: \"3851a8a1-305d-4edf-8d59-0e79ec9acecc\") " pod="kserve-ci-e2e-test/precise-prefix-cache-test-kserve-router-scheduler-7d6895b9bmqfv"
May 25 11:39:49.663659 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:39:49.661113    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n99w7\" (UniqueName: \"kubernetes.io/projected/3851a8a1-305d-4edf-8d59-0e79ec9acecc-kube-api-access-n99w7\") pod \"precise-prefix-cache-test-kserve-router-scheduler-7d6895b9bmqfv\" (UID: \"3851a8a1-305d-4edf-8d59-0e79ec9acecc\") " pod="kserve-ci-e2e-test/precise-prefix-cache-test-kserve-router-scheduler-7d6895b9bmqfv"
May 25 11:39:49.663659 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:39:49.661149    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tokenizer-cache\" (UniqueName: \"kubernetes.io/empty-dir/3851a8a1-305d-4edf-8d59-0e79ec9acecc-tokenizer-cache\") pod \"precise-prefix-cache-test-kserve-router-scheduler-7d6895b9bmqfv\" (UID: \"3851a8a1-305d-4edf-8d59-0e79ec9acecc\") " pod="kserve-ci-e2e-test/precise-prefix-cache-test-kserve-router-scheduler-7d6895b9bmqfv"
May 25 11:39:49.703457 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:39:49.703435    2545 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/precise-prefix-cache-test-kserve-55c6c598f5-sg6qd"]
May 25 11:39:49.705473 ip-10-0-128-206 kubenswrapper[2545]: W0525 11:39:49.705445    2545 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod96a2dfd8_9cbc_4c05_9652_a34949a935ef.slice/crio-a73496258f27640e5df8c6734867e0c81a8e04c4d2e9ca3bc9280421190668a4 WatchSource:0}: Error finding container a73496258f27640e5df8c6734867e0c81a8e04c4d2e9ca3bc9280421190668a4: Status 404 returned error can't find the container with id a73496258f27640e5df8c6734867e0c81a8e04c4d2e9ca3bc9280421190668a4
May 25 11:39:49.762125 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:39:49.762054    2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3851a8a1-305d-4edf-8d59-0e79ec9acecc-tls-certs\") pod \"precise-prefix-cache-test-kserve-router-scheduler-7d6895b9bmqfv\" (UID: \"3851a8a1-305d-4edf-8d59-0e79ec9acecc\") " pod="kserve-ci-e2e-test/precise-prefix-cache-test-kserve-router-scheduler-7d6895b9bmqfv"
May 25 11:39:49.762125 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:39:49.762116    2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tokenizer-tmp\" (UniqueName: \"kubernetes.io/empty-dir/3851a8a1-305d-4edf-8d59-0e79ec9acecc-tokenizer-tmp\") pod \"precise-prefix-cache-test-kserve-router-scheduler-7d6895b9bmqfv\" (UID: \"3851a8a1-305d-4edf-8d59-0e79ec9acecc\") " pod="kserve-ci-e2e-test/precise-prefix-cache-test-kserve-router-scheduler-7d6895b9bmqfv"
May 25 11:39:49.762254 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:39:49.762175    2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tokenizer-uds\" (UniqueName: \"kubernetes.io/empty-dir/3851a8a1-305d-4edf-8d59-0e79ec9acecc-tokenizer-uds\") pod \"precise-prefix-cache-test-kserve-router-scheduler-7d6895b9bmqfv\" (UID: \"3851a8a1-305d-4edf-8d59-0e79ec9acecc\") " pod="kserve-ci-e2e-test/precise-prefix-cache-test-kserve-router-scheduler-7d6895b9bmqfv"
May 25 11:39:49.762254 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:39:49.762204    2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-n99w7\" (UniqueName: \"kubernetes.io/projected/3851a8a1-305d-4edf-8d59-0e79ec9acecc-kube-api-access-n99w7\") pod \"precise-prefix-cache-test-kserve-router-scheduler-7d6895b9bmqfv\" (UID: \"3851a8a1-305d-4edf-8d59-0e79ec9acecc\") " pod="kserve-ci-e2e-test/precise-prefix-cache-test-kserve-router-scheduler-7d6895b9bmqfv"
May 25 11:39:49.762254 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:39:49.762242    2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tokenizer-cache\" (UniqueName: \"kubernetes.io/empty-dir/3851a8a1-305d-4edf-8d59-0e79ec9acecc-tokenizer-cache\") pod \"precise-prefix-cache-test-kserve-router-scheduler-7d6895b9bmqfv\" (UID: \"3851a8a1-305d-4edf-8d59-0e79ec9acecc\") " pod="kserve-ci-e2e-test/precise-prefix-cache-test-kserve-router-scheduler-7d6895b9bmqfv"
May 25 11:39:49.762399 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:39:49.762297    2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/3851a8a1-305d-4edf-8d59-0e79ec9acecc-kserve-provision-location\") pod \"precise-prefix-cache-test-kserve-router-scheduler-7d6895b9bmqfv\" (UID: \"3851a8a1-305d-4edf-8d59-0e79ec9acecc\") " pod="kserve-ci-e2e-test/precise-prefix-cache-test-kserve-router-scheduler-7d6895b9bmqfv"
May 25 11:39:49.762709 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:39:49.762566    2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tokenizer-tmp\" (UniqueName: \"kubernetes.io/empty-dir/3851a8a1-305d-4edf-8d59-0e79ec9acecc-tokenizer-tmp\") pod \"precise-prefix-cache-test-kserve-router-scheduler-7d6895b9bmqfv\" (UID: \"3851a8a1-305d-4edf-8d59-0e79ec9acecc\") " pod="kserve-ci-e2e-test/precise-prefix-cache-test-kserve-router-scheduler-7d6895b9bmqfv"
May 25 11:39:49.762709 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:39:49.762643    2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/3851a8a1-305d-4edf-8d59-0e79ec9acecc-kserve-provision-location\") pod \"precise-prefix-cache-test-kserve-router-scheduler-7d6895b9bmqfv\" (UID: \"3851a8a1-305d-4edf-8d59-0e79ec9acecc\") " pod="kserve-ci-e2e-test/precise-prefix-cache-test-kserve-router-scheduler-7d6895b9bmqfv"
May 25 11:39:49.762709 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:39:49.762684    2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tokenizer-uds\" (UniqueName: \"kubernetes.io/empty-dir/3851a8a1-305d-4edf-8d59-0e79ec9acecc-tokenizer-uds\") pod \"precise-prefix-cache-test-kserve-router-scheduler-7d6895b9bmqfv\" (UID: \"3851a8a1-305d-4edf-8d59-0e79ec9acecc\") " pod="kserve-ci-e2e-test/precise-prefix-cache-test-kserve-router-scheduler-7d6895b9bmqfv"
May 25 11:39:49.762852 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:39:49.762722    2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tokenizer-cache\" (UniqueName: \"kubernetes.io/empty-dir/3851a8a1-305d-4edf-8d59-0e79ec9acecc-tokenizer-cache\") pod \"precise-prefix-cache-test-kserve-router-scheduler-7d6895b9bmqfv\" (UID: \"3851a8a1-305d-4edf-8d59-0e79ec9acecc\") " pod="kserve-ci-e2e-test/precise-prefix-cache-test-kserve-router-scheduler-7d6895b9bmqfv"
May 25 11:39:49.764720 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:39:49.764701    2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3851a8a1-305d-4edf-8d59-0e79ec9acecc-tls-certs\") pod \"precise-prefix-cache-test-kserve-router-scheduler-7d6895b9bmqfv\" (UID: \"3851a8a1-305d-4edf-8d59-0e79ec9acecc\") " pod="kserve-ci-e2e-test/precise-prefix-cache-test-kserve-router-scheduler-7d6895b9bmqfv"
May 25 11:39:49.791727 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:39:49.791699    2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-n99w7\" (UniqueName: \"kubernetes.io/projected/3851a8a1-305d-4edf-8d59-0e79ec9acecc-kube-api-access-n99w7\") pod \"precise-prefix-cache-test-kserve-router-scheduler-7d6895b9bmqfv\" (UID: \"3851a8a1-305d-4edf-8d59-0e79ec9acecc\") " pod="kserve-ci-e2e-test/precise-prefix-cache-test-kserve-router-scheduler-7d6895b9bmqfv"
May 25 11:39:49.909714 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:39:49.909627    2545 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/precise-prefix-cache-test-kserve-router-scheduler-7d6895b9bmqfv"
May 25 11:39:50.059441 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:39:50.059409    2545 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/precise-prefix-cache-test-kserve-router-scheduler-7d6895b9bmqfv"]
May 25 11:39:50.062930 ip-10-0-128-206 kubenswrapper[2545]: W0525 11:39:50.062898    2545 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3851a8a1_305d_4edf_8d59_0e79ec9acecc.slice/crio-34eee6596d97700d13a52576233a8f8eba96d03efceaf0d57dbed101293657fd WatchSource:0}: Error finding container 34eee6596d97700d13a52576233a8f8eba96d03efceaf0d57dbed101293657fd: Status 404 returned error can't find the container with id 34eee6596d97700d13a52576233a8f8eba96d03efceaf0d57dbed101293657fd
May 25 11:39:50.106214 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:39:50.106177    2545 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/precise-prefix-cache-test-kserve-router-scheduler-7d6895b9bmqfv" event={"ID":"3851a8a1-305d-4edf-8d59-0e79ec9acecc","Type":"ContainerStarted","Data":"34eee6596d97700d13a52576233a8f8eba96d03efceaf0d57dbed101293657fd"}
May 25 11:39:50.107787 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:39:50.107762    2545 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/precise-prefix-cache-test-kserve-55c6c598f5-sg6qd" event={"ID":"96a2dfd8-9cbc-4c05-9652-a34949a935ef","Type":"ContainerStarted","Data":"15c344871ecc82acb350ab0caa5dff52c6496b992647019a5635d0d6cf0689ff"}
May 25 11:39:50.107879 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:39:50.107793    2545 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/precise-prefix-cache-test-kserve-55c6c598f5-sg6qd" event={"ID":"96a2dfd8-9cbc-4c05-9652-a34949a935ef","Type":"ContainerStarted","Data":"a73496258f27640e5df8c6734867e0c81a8e04c4d2e9ca3bc9280421190668a4"}
May 25 11:39:51.113700 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:39:51.113620    2545 generic.go:358] "Generic (PLEG): container finished" podID="3851a8a1-305d-4edf-8d59-0e79ec9acecc" containerID="686995315e6aad340500a47cfe6a75aa1e92308738a5f63a6e347a2b84eb287d" exitCode=0
May 25 11:39:51.114187 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:39:51.113708    2545 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/precise-prefix-cache-test-kserve-router-scheduler-7d6895b9bmqfv" event={"ID":"3851a8a1-305d-4edf-8d59-0e79ec9acecc","Type":"ContainerDied","Data":"686995315e6aad340500a47cfe6a75aa1e92308738a5f63a6e347a2b84eb287d"}
May 25 11:39:52.118842 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:39:52.118804    2545 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/precise-prefix-cache-test-kserve-router-scheduler-7d6895b9bmqfv" event={"ID":"3851a8a1-305d-4edf-8d59-0e79ec9acecc","Type":"ContainerStarted","Data":"bb7c59343a86f04af8dc3373555a95c9f02ea87ac24d94b3b050d926f2b73f7e"}
May 25 11:39:52.118842 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:39:52.118844    2545 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/precise-prefix-cache-test-kserve-router-scheduler-7d6895b9bmqfv" event={"ID":"3851a8a1-305d-4edf-8d59-0e79ec9acecc","Type":"ContainerStarted","Data":"18e803af1ad0d73370c8bf0ee28dc1039b6e9afbcc9d9d5409e8a6cdc612bc42"}
May 25 11:39:52.119426 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:39:52.118915    2545 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/precise-prefix-cache-test-kserve-router-scheduler-7d6895b9bmqfv"
May 25 11:39:52.161699 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:39:52.161641    2545 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kserve-ci-e2e-test/precise-prefix-cache-test-kserve-router-scheduler-7d6895b9bmqfv" podStartSLOduration=3.161622824 podStartE2EDuration="3.161622824s" podCreationTimestamp="2026-05-25 11:39:49 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-25 11:39:52.161473978 +0000 UTC m=+983.927758924" watchObservedRunningTime="2026-05-25 11:39:52.161622824 +0000 UTC m=+983.927907771"
May 25 11:39:59.151393 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:39:59.151301    2545 generic.go:358] "Generic (PLEG): container finished" podID="96a2dfd8-9cbc-4c05-9652-a34949a935ef" containerID="15c344871ecc82acb350ab0caa5dff52c6496b992647019a5635d0d6cf0689ff" exitCode=0
May 25 11:39:59.151393 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:39:59.151372    2545 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/precise-prefix-cache-test-kserve-55c6c598f5-sg6qd" event={"ID":"96a2dfd8-9cbc-4c05-9652-a34949a935ef","Type":"ContainerDied","Data":"15c344871ecc82acb350ab0caa5dff52c6496b992647019a5635d0d6cf0689ff"}
May 25 11:39:59.152429 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:39:59.152413    2545 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
May 25 11:39:59.910214 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:39:59.910183    2545 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/precise-prefix-cache-test-kserve-router-scheduler-7d6895b9bmqfv"
May 25 11:39:59.910418 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:39:59.910342    2545 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kserve-ci-e2e-test/precise-prefix-cache-test-kserve-router-scheduler-7d6895b9bmqfv"
May 25 11:39:59.911457 ip-10-0-128-206 kubenswrapper[2545]: W0525 11:39:59.911436    2545 logging.go:55] [core] [Channel #89 SubChannel #90]grpc: addrConn.createTransport failed to connect to {Addr: "10.134.0.34:9003", ServerName: "10.134.0.34:9003", }. Err: connection error: desc = "transport: Error while dialing: dial tcp 10.134.0.34:9003: connect: connection refused"
May 25 11:39:59.912659 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:39:59.912640    2545 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="kserve-ci-e2e-test/precise-prefix-cache-test-kserve-router-scheduler-7d6895b9bmqfv"
May 25 11:40:00.158311 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:40:00.158277    2545 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/precise-prefix-cache-test-kserve-55c6c598f5-sg6qd" event={"ID":"96a2dfd8-9cbc-4c05-9652-a34949a935ef","Type":"ContainerStarted","Data":"14e49269faccf9e4edec5c46f8dd8cd7ed7006cd26082ac1294613682961d074"}
May 25 11:40:00.159672 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:40:00.159651    2545 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/precise-prefix-cache-test-kserve-router-scheduler-7d6895b9bmqfv"
May 25 11:40:00.186792 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:40:00.186681    2545 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kserve-ci-e2e-test/precise-prefix-cache-test-kserve-55c6c598f5-sg6qd" podStartSLOduration=11.186666064 podStartE2EDuration="11.186666064s" podCreationTimestamp="2026-05-25 11:39:49 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-25 11:40:00.185878522 +0000 UTC m=+991.952163469" watchObservedRunningTime="2026-05-25 11:40:00.186666064 +0000 UTC m=+991.952951010"
May 25 11:40:00.910745 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:40:00.910699    2545 prober.go:120] "Probe failed" probeType="Liveness" pod="kserve-ci-e2e-test/precise-prefix-cache-test-kserve-router-scheduler-7d6895b9bmqfv" podUID="3851a8a1-305d-4edf-8d59-0e79ec9acecc" containerName="main" probeResult="failure" output="timeout: failed to connect service \"10.134.0.34:9003\" within 1s: context deadline exceeded"
May 25 11:40:09.551535 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:40:09.551501    2545 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kserve-ci-e2e-test/precise-prefix-cache-test-kserve-55c6c598f5-sg6qd"
May 25 11:40:09.551535 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:40:09.551542    2545 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/precise-prefix-cache-test-kserve-55c6c598f5-sg6qd"
May 25 11:40:09.564128 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:40:09.564104    2545 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="kserve-ci-e2e-test/precise-prefix-cache-test-kserve-55c6c598f5-sg6qd"
May 25 11:40:09.911297 ip-10-0-128-206 kubenswrapper[2545]: W0525 11:40:09.911216    2545 logging.go:55] [core] [Channel #91 SubChannel #92]grpc: addrConn.createTransport failed to connect to {Addr: "10.134.0.34:9003", ServerName: "10.134.0.34:9003", }. Err: connection error: desc = "transport: Error while dialing: dial tcp 10.134.0.34:9003: connect: connection refused"
May 25 11:40:10.205243 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:40:10.205167    2545 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/precise-prefix-cache-test-kserve-55c6c598f5-sg6qd"
May 25 11:40:10.911683 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:40:10.911635    2545 prober.go:120] "Probe failed" probeType="Liveness" pod="kserve-ci-e2e-test/precise-prefix-cache-test-kserve-router-scheduler-7d6895b9bmqfv" podUID="3851a8a1-305d-4edf-8d59-0e79ec9acecc" containerName="main" probeResult="failure" output="timeout: failed to connect service \"10.134.0.34:9003\" within 1s: context deadline exceeded"
May 25 11:40:22.167008 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:40:22.166975    2545 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/precise-prefix-cache-test-kserve-router-scheduler-7d6895b9bmqfv"
May 25 11:40:23.667088 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:40:23.667052    2545 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/precise-prefix-cache-test-kserve-router-scheduler-7d6895b9bmqfv"]
May 25 11:40:23.667494 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:40:23.667428    2545 kuberuntime_container.go:864] "Killing container with a grace period" pod="kserve-ci-e2e-test/precise-prefix-cache-test-kserve-router-scheduler-7d6895b9bmqfv" podUID="3851a8a1-305d-4edf-8d59-0e79ec9acecc" containerName="main" containerID="cri-o://18e803af1ad0d73370c8bf0ee28dc1039b6e9afbcc9d9d5409e8a6cdc612bc42" gracePeriod=30
May 25 11:40:23.667561 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:40:23.667489    2545 kuberuntime_container.go:864] "Killing container with a grace period" pod="kserve-ci-e2e-test/precise-prefix-cache-test-kserve-router-scheduler-7d6895b9bmqfv" podUID="3851a8a1-305d-4edf-8d59-0e79ec9acecc" containerName="tokenizer" containerID="cri-o://bb7c59343a86f04af8dc3373555a95c9f02ea87ac24d94b3b050d926f2b73f7e" gracePeriod=30
May 25 11:40:23.685137 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:40:23.683225    2545 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/precise-prefix-cache-test-kserve-55c6c598f5-sg6qd"]
May 25 11:40:23.685137 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:40:23.683670    2545 kuberuntime_container.go:864] "Killing container with a grace period" pod="kserve-ci-e2e-test/precise-prefix-cache-test-kserve-55c6c598f5-sg6qd" podUID="96a2dfd8-9cbc-4c05-9652-a34949a935ef" containerName="main" containerID="cri-o://14e49269faccf9e4edec5c46f8dd8cd7ed7006cd26082ac1294613682961d074" gracePeriod=30
May 25 11:40:23.949210 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:40:23.949187    2545 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/precise-prefix-cache-test-kserve-55c6c598f5-sg6qd"
May 25 11:40:24.073942 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:40:24.073906    2545 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/96a2dfd8-9cbc-4c05-9652-a34949a935ef-model-cache\") pod \"96a2dfd8-9cbc-4c05-9652-a34949a935ef\" (UID: \"96a2dfd8-9cbc-4c05-9652-a34949a935ef\") "
May 25 11:40:24.074158 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:40:24.074008    2545 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/96a2dfd8-9cbc-4c05-9652-a34949a935ef-tmp-dir\") pod \"96a2dfd8-9cbc-4c05-9652-a34949a935ef\" (UID: \"96a2dfd8-9cbc-4c05-9652-a34949a935ef\") "
May 25 11:40:24.074158 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:40:24.074047    2545 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/96a2dfd8-9cbc-4c05-9652-a34949a935ef-tls-certs\") pod \"96a2dfd8-9cbc-4c05-9652-a34949a935ef\" (UID: \"96a2dfd8-9cbc-4c05-9652-a34949a935ef\") "
May 25 11:40:24.074158 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:40:24.074097    2545 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/96a2dfd8-9cbc-4c05-9652-a34949a935ef-home\") pod \"96a2dfd8-9cbc-4c05-9652-a34949a935ef\" (UID: \"96a2dfd8-9cbc-4c05-9652-a34949a935ef\") "
May 25 11:40:24.074158 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:40:24.074145    2545 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kd4mw\" (UniqueName: \"kubernetes.io/projected/96a2dfd8-9cbc-4c05-9652-a34949a935ef-kube-api-access-kd4mw\") pod \"96a2dfd8-9cbc-4c05-9652-a34949a935ef\" (UID: \"96a2dfd8-9cbc-4c05-9652-a34949a935ef\") "
May 25 11:40:24.074361 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:40:24.074169    2545 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/96a2dfd8-9cbc-4c05-9652-a34949a935ef-dshm\") pod \"96a2dfd8-9cbc-4c05-9652-a34949a935ef\" (UID: \"96a2dfd8-9cbc-4c05-9652-a34949a935ef\") "
May 25 11:40:24.074361 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:40:24.074209    2545 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/96a2dfd8-9cbc-4c05-9652-a34949a935ef-kserve-provision-location\") pod \"96a2dfd8-9cbc-4c05-9652-a34949a935ef\" (UID: \"96a2dfd8-9cbc-4c05-9652-a34949a935ef\") "
May 25 11:40:24.074361 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:40:24.074218    2545 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/96a2dfd8-9cbc-4c05-9652-a34949a935ef-model-cache" (OuterVolumeSpecName: "model-cache") pod "96a2dfd8-9cbc-4c05-9652-a34949a935ef" (UID: "96a2dfd8-9cbc-4c05-9652-a34949a935ef"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 25 11:40:24.074361 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:40:24.074225    2545 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/96a2dfd8-9cbc-4c05-9652-a34949a935ef-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "96a2dfd8-9cbc-4c05-9652-a34949a935ef" (UID: "96a2dfd8-9cbc-4c05-9652-a34949a935ef"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 25 11:40:24.074539 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:40:24.074358    2545 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/96a2dfd8-9cbc-4c05-9652-a34949a935ef-home" (OuterVolumeSpecName: "home") pod "96a2dfd8-9cbc-4c05-9652-a34949a935ef" (UID: "96a2dfd8-9cbc-4c05-9652-a34949a935ef"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 25 11:40:24.074539 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:40:24.074503    2545 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/96a2dfd8-9cbc-4c05-9652-a34949a935ef-model-cache\") on node \"ip-10-0-128-206.ec2.internal\" DevicePath \"\""
May 25 11:40:24.074539 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:40:24.074523    2545 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/96a2dfd8-9cbc-4c05-9652-a34949a935ef-tmp-dir\") on node \"ip-10-0-128-206.ec2.internal\" DevicePath \"\""
May 25 11:40:24.074539 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:40:24.074535    2545 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/96a2dfd8-9cbc-4c05-9652-a34949a935ef-home\") on node \"ip-10-0-128-206.ec2.internal\" DevicePath \"\""
May 25 11:40:24.076458 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:40:24.076358    2545 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/96a2dfd8-9cbc-4c05-9652-a34949a935ef-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "96a2dfd8-9cbc-4c05-9652-a34949a935ef" (UID: "96a2dfd8-9cbc-4c05-9652-a34949a935ef"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 25 11:40:24.076458 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:40:24.076427    2545 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/96a2dfd8-9cbc-4c05-9652-a34949a935ef-dshm" (OuterVolumeSpecName: "dshm") pod "96a2dfd8-9cbc-4c05-9652-a34949a935ef" (UID: "96a2dfd8-9cbc-4c05-9652-a34949a935ef"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 25 11:40:24.076648 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:40:24.076498    2545 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/96a2dfd8-9cbc-4c05-9652-a34949a935ef-kube-api-access-kd4mw" (OuterVolumeSpecName: "kube-api-access-kd4mw") pod "96a2dfd8-9cbc-4c05-9652-a34949a935ef" (UID: "96a2dfd8-9cbc-4c05-9652-a34949a935ef"). InnerVolumeSpecName "kube-api-access-kd4mw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 25 11:40:24.134684 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:40:24.134623    2545 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/96a2dfd8-9cbc-4c05-9652-a34949a935ef-kserve-provision-location" (OuterVolumeSpecName: "kserve-provision-location") pod "96a2dfd8-9cbc-4c05-9652-a34949a935ef" (UID: "96a2dfd8-9cbc-4c05-9652-a34949a935ef"). InnerVolumeSpecName "kserve-provision-location". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 25 11:40:24.174976 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:40:24.174928    2545 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/96a2dfd8-9cbc-4c05-9652-a34949a935ef-tls-certs\") on node \"ip-10-0-128-206.ec2.internal\" DevicePath \"\""
May 25 11:40:24.174976 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:40:24.174969    2545 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kd4mw\" (UniqueName: \"kubernetes.io/projected/96a2dfd8-9cbc-4c05-9652-a34949a935ef-kube-api-access-kd4mw\") on node \"ip-10-0-128-206.ec2.internal\" DevicePath \"\""
May 25 11:40:24.174976 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:40:24.174982    2545 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/96a2dfd8-9cbc-4c05-9652-a34949a935ef-dshm\") on node \"ip-10-0-128-206.ec2.internal\" DevicePath \"\""
May 25 11:40:24.175253 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:40:24.174992    2545 reconciler_common.go:299] "Volume detached for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/96a2dfd8-9cbc-4c05-9652-a34949a935ef-kserve-provision-location\") on node \"ip-10-0-128-206.ec2.internal\" DevicePath \"\""
May 25 11:40:24.244459 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:40:24.244410    2545 generic.go:358] "Generic (PLEG): container finished" podID="3851a8a1-305d-4edf-8d59-0e79ec9acecc" containerID="18e803af1ad0d73370c8bf0ee28dc1039b6e9afbcc9d9d5409e8a6cdc612bc42" exitCode=0
May 25 11:40:24.244649 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:40:24.244493    2545 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/precise-prefix-cache-test-kserve-router-scheduler-7d6895b9bmqfv" event={"ID":"3851a8a1-305d-4edf-8d59-0e79ec9acecc","Type":"ContainerDied","Data":"18e803af1ad0d73370c8bf0ee28dc1039b6e9afbcc9d9d5409e8a6cdc612bc42"}
May 25 11:40:24.245996 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:40:24.245950    2545 generic.go:358] "Generic (PLEG): container finished" podID="96a2dfd8-9cbc-4c05-9652-a34949a935ef" containerID="14e49269faccf9e4edec5c46f8dd8cd7ed7006cd26082ac1294613682961d074" exitCode=0
May 25 11:40:24.246143 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:40:24.246020    2545 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/precise-prefix-cache-test-kserve-55c6c598f5-sg6qd" event={"ID":"96a2dfd8-9cbc-4c05-9652-a34949a935ef","Type":"ContainerDied","Data":"14e49269faccf9e4edec5c46f8dd8cd7ed7006cd26082ac1294613682961d074"}
May 25 11:40:24.246143 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:40:24.246038    2545 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/precise-prefix-cache-test-kserve-55c6c598f5-sg6qd" event={"ID":"96a2dfd8-9cbc-4c05-9652-a34949a935ef","Type":"ContainerDied","Data":"a73496258f27640e5df8c6734867e0c81a8e04c4d2e9ca3bc9280421190668a4"}
May 25 11:40:24.246143 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:40:24.246055    2545 scope.go:117] "RemoveContainer" containerID="14e49269faccf9e4edec5c46f8dd8cd7ed7006cd26082ac1294613682961d074"
May 25 11:40:24.246143 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:40:24.246072    2545 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/precise-prefix-cache-test-kserve-55c6c598f5-sg6qd"
May 25 11:40:24.257154 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:40:24.257131    2545 scope.go:117] "RemoveContainer" containerID="15c344871ecc82acb350ab0caa5dff52c6496b992647019a5635d0d6cf0689ff"
May 25 11:40:24.282490 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:40:24.282457    2545 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/precise-prefix-cache-test-kserve-55c6c598f5-sg6qd"]
May 25 11:40:24.292285 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:40:24.292255    2545 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/precise-prefix-cache-test-kserve-55c6c598f5-sg6qd"]
May 25 11:40:24.326041 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:40:24.326020    2545 scope.go:117] "RemoveContainer" containerID="14e49269faccf9e4edec5c46f8dd8cd7ed7006cd26082ac1294613682961d074"
May 25 11:40:24.326380 ip-10-0-128-206 kubenswrapper[2545]: E0525 11:40:24.326355    2545 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"14e49269faccf9e4edec5c46f8dd8cd7ed7006cd26082ac1294613682961d074\": container with ID starting with 14e49269faccf9e4edec5c46f8dd8cd7ed7006cd26082ac1294613682961d074 not found: ID does not exist" containerID="14e49269faccf9e4edec5c46f8dd8cd7ed7006cd26082ac1294613682961d074"
May 25 11:40:24.326485 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:40:24.326385    2545 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"14e49269faccf9e4edec5c46f8dd8cd7ed7006cd26082ac1294613682961d074"} err="failed to get container status \"14e49269faccf9e4edec5c46f8dd8cd7ed7006cd26082ac1294613682961d074\": rpc error: code = NotFound desc = could not find container \"14e49269faccf9e4edec5c46f8dd8cd7ed7006cd26082ac1294613682961d074\": container with ID starting with 14e49269faccf9e4edec5c46f8dd8cd7ed7006cd26082ac1294613682961d074 not found: ID does not exist"
May 25 11:40:24.326485 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:40:24.326406    2545 scope.go:117] "RemoveContainer" containerID="15c344871ecc82acb350ab0caa5dff52c6496b992647019a5635d0d6cf0689ff"
May 25 11:40:24.326691 ip-10-0-128-206 kubenswrapper[2545]: E0525 11:40:24.326674    2545 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"15c344871ecc82acb350ab0caa5dff52c6496b992647019a5635d0d6cf0689ff\": container with ID starting with 15c344871ecc82acb350ab0caa5dff52c6496b992647019a5635d0d6cf0689ff not found: ID does not exist" containerID="15c344871ecc82acb350ab0caa5dff52c6496b992647019a5635d0d6cf0689ff"
May 25 11:40:24.326735 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:40:24.326699    2545 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"15c344871ecc82acb350ab0caa5dff52c6496b992647019a5635d0d6cf0689ff"} err="failed to get container status \"15c344871ecc82acb350ab0caa5dff52c6496b992647019a5635d0d6cf0689ff\": rpc error: code = NotFound desc = could not find container \"15c344871ecc82acb350ab0caa5dff52c6496b992647019a5635d0d6cf0689ff\": container with ID starting with 15c344871ecc82acb350ab0caa5dff52c6496b992647019a5635d0d6cf0689ff not found: ID does not exist"
May 25 11:40:24.774860 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:40:24.774828    2545 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="96a2dfd8-9cbc-4c05-9652-a34949a935ef" path="/var/lib/kubelet/pods/96a2dfd8-9cbc-4c05-9652-a34949a935ef/volumes"
May 25 11:40:25.122451 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:40:25.122429    2545 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/precise-prefix-cache-test-kserve-router-scheduler-7d6895b9bmqfv"
May 25 11:40:25.184074 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:40:25.184046    2545 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"tokenizer-tmp\" (UniqueName: \"kubernetes.io/empty-dir/3851a8a1-305d-4edf-8d59-0e79ec9acecc-tokenizer-tmp\") pod \"3851a8a1-305d-4edf-8d59-0e79ec9acecc\" (UID: \"3851a8a1-305d-4edf-8d59-0e79ec9acecc\") "
May 25 11:40:25.184074 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:40:25.184077    2545 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-n99w7\" (UniqueName: \"kubernetes.io/projected/3851a8a1-305d-4edf-8d59-0e79ec9acecc-kube-api-access-n99w7\") pod \"3851a8a1-305d-4edf-8d59-0e79ec9acecc\" (UID: \"3851a8a1-305d-4edf-8d59-0e79ec9acecc\") "
May 25 11:40:25.184299 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:40:25.184108    2545 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"tokenizer-cache\" (UniqueName: \"kubernetes.io/empty-dir/3851a8a1-305d-4edf-8d59-0e79ec9acecc-tokenizer-cache\") pod \"3851a8a1-305d-4edf-8d59-0e79ec9acecc\" (UID: \"3851a8a1-305d-4edf-8d59-0e79ec9acecc\") "
May 25 11:40:25.184299 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:40:25.184137    2545 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3851a8a1-305d-4edf-8d59-0e79ec9acecc-tls-certs\") pod \"3851a8a1-305d-4edf-8d59-0e79ec9acecc\" (UID: \"3851a8a1-305d-4edf-8d59-0e79ec9acecc\") "
May 25 11:40:25.184299 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:40:25.184205    2545 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/3851a8a1-305d-4edf-8d59-0e79ec9acecc-kserve-provision-location\") pod \"3851a8a1-305d-4edf-8d59-0e79ec9acecc\" (UID: \"3851a8a1-305d-4edf-8d59-0e79ec9acecc\") "
May 25 11:40:25.184299 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:40:25.184285    2545 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"tokenizer-uds\" (UniqueName: \"kubernetes.io/empty-dir/3851a8a1-305d-4edf-8d59-0e79ec9acecc-tokenizer-uds\") pod \"3851a8a1-305d-4edf-8d59-0e79ec9acecc\" (UID: \"3851a8a1-305d-4edf-8d59-0e79ec9acecc\") "
May 25 11:40:25.184522 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:40:25.184432    2545 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3851a8a1-305d-4edf-8d59-0e79ec9acecc-tokenizer-tmp" (OuterVolumeSpecName: "tokenizer-tmp") pod "3851a8a1-305d-4edf-8d59-0e79ec9acecc" (UID: "3851a8a1-305d-4edf-8d59-0e79ec9acecc"). InnerVolumeSpecName "tokenizer-tmp". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 25 11:40:25.184522 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:40:25.184462    2545 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3851a8a1-305d-4edf-8d59-0e79ec9acecc-tokenizer-cache" (OuterVolumeSpecName: "tokenizer-cache") pod "3851a8a1-305d-4edf-8d59-0e79ec9acecc" (UID: "3851a8a1-305d-4edf-8d59-0e79ec9acecc"). InnerVolumeSpecName "tokenizer-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 25 11:40:25.184614 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:40:25.184557    2545 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3851a8a1-305d-4edf-8d59-0e79ec9acecc-tokenizer-uds" (OuterVolumeSpecName: "tokenizer-uds") pod "3851a8a1-305d-4edf-8d59-0e79ec9acecc" (UID: "3851a8a1-305d-4edf-8d59-0e79ec9acecc"). InnerVolumeSpecName "tokenizer-uds". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 25 11:40:25.184695 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:40:25.184677    2545 reconciler_common.go:299] "Volume detached for volume \"tokenizer-uds\" (UniqueName: \"kubernetes.io/empty-dir/3851a8a1-305d-4edf-8d59-0e79ec9acecc-tokenizer-uds\") on node \"ip-10-0-128-206.ec2.internal\" DevicePath \"\""
May 25 11:40:25.184742 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:40:25.184701    2545 reconciler_common.go:299] "Volume detached for volume \"tokenizer-tmp\" (UniqueName: \"kubernetes.io/empty-dir/3851a8a1-305d-4edf-8d59-0e79ec9acecc-tokenizer-tmp\") on node \"ip-10-0-128-206.ec2.internal\" DevicePath \"\""
May 25 11:40:25.184742 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:40:25.184714    2545 reconciler_common.go:299] "Volume detached for volume \"tokenizer-cache\" (UniqueName: \"kubernetes.io/empty-dir/3851a8a1-305d-4edf-8d59-0e79ec9acecc-tokenizer-cache\") on node \"ip-10-0-128-206.ec2.internal\" DevicePath \"\""
May 25 11:40:25.185027 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:40:25.185010    2545 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3851a8a1-305d-4edf-8d59-0e79ec9acecc-kserve-provision-location" (OuterVolumeSpecName: "kserve-provision-location") pod "3851a8a1-305d-4edf-8d59-0e79ec9acecc" (UID: "3851a8a1-305d-4edf-8d59-0e79ec9acecc"). InnerVolumeSpecName "kserve-provision-location". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 25 11:40:25.186246 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:40:25.186226    2545 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3851a8a1-305d-4edf-8d59-0e79ec9acecc-kube-api-access-n99w7" (OuterVolumeSpecName: "kube-api-access-n99w7") pod "3851a8a1-305d-4edf-8d59-0e79ec9acecc" (UID: "3851a8a1-305d-4edf-8d59-0e79ec9acecc"). InnerVolumeSpecName "kube-api-access-n99w7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 25 11:40:25.186246 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:40:25.186226    2545 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3851a8a1-305d-4edf-8d59-0e79ec9acecc-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "3851a8a1-305d-4edf-8d59-0e79ec9acecc" (UID: "3851a8a1-305d-4edf-8d59-0e79ec9acecc"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 25 11:40:25.251434 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:40:25.251403    2545 generic.go:358] "Generic (PLEG): container finished" podID="3851a8a1-305d-4edf-8d59-0e79ec9acecc" containerID="bb7c59343a86f04af8dc3373555a95c9f02ea87ac24d94b3b050d926f2b73f7e" exitCode=0
May 25 11:40:25.251595 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:40:25.251474    2545 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/precise-prefix-cache-test-kserve-router-scheduler-7d6895b9bmqfv"
May 25 11:40:25.251595 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:40:25.251494    2545 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/precise-prefix-cache-test-kserve-router-scheduler-7d6895b9bmqfv" event={"ID":"3851a8a1-305d-4edf-8d59-0e79ec9acecc","Type":"ContainerDied","Data":"bb7c59343a86f04af8dc3373555a95c9f02ea87ac24d94b3b050d926f2b73f7e"}
May 25 11:40:25.251595 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:40:25.251541    2545 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/precise-prefix-cache-test-kserve-router-scheduler-7d6895b9bmqfv" event={"ID":"3851a8a1-305d-4edf-8d59-0e79ec9acecc","Type":"ContainerDied","Data":"34eee6596d97700d13a52576233a8f8eba96d03efceaf0d57dbed101293657fd"}
May 25 11:40:25.251595 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:40:25.251562    2545 scope.go:117] "RemoveContainer" containerID="bb7c59343a86f04af8dc3373555a95c9f02ea87ac24d94b3b050d926f2b73f7e"
May 25 11:40:25.260675 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:40:25.260660    2545 scope.go:117] "RemoveContainer" containerID="18e803af1ad0d73370c8bf0ee28dc1039b6e9afbcc9d9d5409e8a6cdc612bc42"
May 25 11:40:25.267735 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:40:25.267719    2545 scope.go:117] "RemoveContainer" containerID="686995315e6aad340500a47cfe6a75aa1e92308738a5f63a6e347a2b84eb287d"
May 25 11:40:25.274737 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:40:25.274722    2545 scope.go:117] "RemoveContainer" containerID="bb7c59343a86f04af8dc3373555a95c9f02ea87ac24d94b3b050d926f2b73f7e"
May 25 11:40:25.274996 ip-10-0-128-206 kubenswrapper[2545]: E0525 11:40:25.274977    2545 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bb7c59343a86f04af8dc3373555a95c9f02ea87ac24d94b3b050d926f2b73f7e\": container with ID starting with bb7c59343a86f04af8dc3373555a95c9f02ea87ac24d94b3b050d926f2b73f7e not found: ID does not exist" containerID="bb7c59343a86f04af8dc3373555a95c9f02ea87ac24d94b3b050d926f2b73f7e"
May 25 11:40:25.275048 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:40:25.275004    2545 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bb7c59343a86f04af8dc3373555a95c9f02ea87ac24d94b3b050d926f2b73f7e"} err="failed to get container status \"bb7c59343a86f04af8dc3373555a95c9f02ea87ac24d94b3b050d926f2b73f7e\": rpc error: code = NotFound desc = could not find container \"bb7c59343a86f04af8dc3373555a95c9f02ea87ac24d94b3b050d926f2b73f7e\": container with ID starting with bb7c59343a86f04af8dc3373555a95c9f02ea87ac24d94b3b050d926f2b73f7e not found: ID does not exist"
May 25 11:40:25.275048 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:40:25.275021    2545 scope.go:117] "RemoveContainer" containerID="18e803af1ad0d73370c8bf0ee28dc1039b6e9afbcc9d9d5409e8a6cdc612bc42"
May 25 11:40:25.275246 ip-10-0-128-206 kubenswrapper[2545]: E0525 11:40:25.275228    2545 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"18e803af1ad0d73370c8bf0ee28dc1039b6e9afbcc9d9d5409e8a6cdc612bc42\": container with ID starting with 18e803af1ad0d73370c8bf0ee28dc1039b6e9afbcc9d9d5409e8a6cdc612bc42 not found: ID does not exist" containerID="18e803af1ad0d73370c8bf0ee28dc1039b6e9afbcc9d9d5409e8a6cdc612bc42"
May 25 11:40:25.275281 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:40:25.275253    2545 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"18e803af1ad0d73370c8bf0ee28dc1039b6e9afbcc9d9d5409e8a6cdc612bc42"} err="failed to get container status \"18e803af1ad0d73370c8bf0ee28dc1039b6e9afbcc9d9d5409e8a6cdc612bc42\": rpc error: code = NotFound desc = could not find container \"18e803af1ad0d73370c8bf0ee28dc1039b6e9afbcc9d9d5409e8a6cdc612bc42\": container with ID starting with 18e803af1ad0d73370c8bf0ee28dc1039b6e9afbcc9d9d5409e8a6cdc612bc42 not found: ID does not exist"
May 25 11:40:25.275281 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:40:25.275271    2545 scope.go:117] "RemoveContainer" containerID="686995315e6aad340500a47cfe6a75aa1e92308738a5f63a6e347a2b84eb287d"
May 25 11:40:25.275468 ip-10-0-128-206 kubenswrapper[2545]: E0525 11:40:25.275452    2545 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"686995315e6aad340500a47cfe6a75aa1e92308738a5f63a6e347a2b84eb287d\": container with ID starting with 686995315e6aad340500a47cfe6a75aa1e92308738a5f63a6e347a2b84eb287d not found: ID does not exist" containerID="686995315e6aad340500a47cfe6a75aa1e92308738a5f63a6e347a2b84eb287d"
May 25 11:40:25.275503 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:40:25.275472    2545 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"686995315e6aad340500a47cfe6a75aa1e92308738a5f63a6e347a2b84eb287d"} err="failed to get container status \"686995315e6aad340500a47cfe6a75aa1e92308738a5f63a6e347a2b84eb287d\": rpc error: code = NotFound desc = could not find container \"686995315e6aad340500a47cfe6a75aa1e92308738a5f63a6e347a2b84eb287d\": container with ID starting with 686995315e6aad340500a47cfe6a75aa1e92308738a5f63a6e347a2b84eb287d not found: ID does not exist"
May 25 11:40:25.280545 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:40:25.280520    2545 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/precise-prefix-cache-test-kserve-router-scheduler-7d6895b9bmqfv"]
May 25 11:40:25.285909 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:40:25.285853    2545 reconciler_common.go:299] "Volume detached for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/3851a8a1-305d-4edf-8d59-0e79ec9acecc-kserve-provision-location\") on node \"ip-10-0-128-206.ec2.internal\" DevicePath \"\""
May 25 11:40:25.285909 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:40:25.285881    2545 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-n99w7\" (UniqueName: \"kubernetes.io/projected/3851a8a1-305d-4edf-8d59-0e79ec9acecc-kube-api-access-n99w7\") on node \"ip-10-0-128-206.ec2.internal\" DevicePath \"\""
May 25 11:40:25.285909 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:40:25.285895    2545 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3851a8a1-305d-4edf-8d59-0e79ec9acecc-tls-certs\") on node \"ip-10-0-128-206.ec2.internal\" DevicePath \"\""
May 25 11:40:25.286089 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:40:25.285937    2545 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/precise-prefix-cache-test-kserve-router-scheduler-7d6895b9bmqfv"]
May 25 11:40:26.775388 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:40:26.775356    2545 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3851a8a1-305d-4edf-8d59-0e79ec9acecc" path="/var/lib/kubelet/pods/3851a8a1-305d-4edf-8d59-0e79ec9acecc/volumes"
May 25 11:40:53.500073 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:40:53.500041    2545 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/stop-feature-test-kserve-router-scheduler-86cbf4d9fb-6bffq"]
May 25 11:40:53.500463 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:40:53.500375    2545 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="96a2dfd8-9cbc-4c05-9652-a34949a935ef" containerName="main"
May 25 11:40:53.500463 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:40:53.500387    2545 state_mem.go:107] "Deleted CPUSet assignment" podUID="96a2dfd8-9cbc-4c05-9652-a34949a935ef" containerName="main"
May 25 11:40:53.500463 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:40:53.500394    2545 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3851a8a1-305d-4edf-8d59-0e79ec9acecc" containerName="main"
May 25 11:40:53.500463 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:40:53.500399    2545 state_mem.go:107] "Deleted CPUSet assignment" podUID="3851a8a1-305d-4edf-8d59-0e79ec9acecc" containerName="main"
May 25 11:40:53.500463 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:40:53.500409    2545 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3851a8a1-305d-4edf-8d59-0e79ec9acecc" containerName="tokenizer"
May 25 11:40:53.500463 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:40:53.500414    2545 state_mem.go:107] "Deleted CPUSet assignment" podUID="3851a8a1-305d-4edf-8d59-0e79ec9acecc" containerName="tokenizer"
May 25 11:40:53.500463 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:40:53.500424    2545 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3851a8a1-305d-4edf-8d59-0e79ec9acecc" containerName="storage-initializer"
May 25 11:40:53.500463 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:40:53.500430    2545 state_mem.go:107] "Deleted CPUSet assignment" podUID="3851a8a1-305d-4edf-8d59-0e79ec9acecc" containerName="storage-initializer"
May 25 11:40:53.500463 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:40:53.500445    2545 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="96a2dfd8-9cbc-4c05-9652-a34949a935ef" containerName="storage-initializer"
May 25 11:40:53.500463 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:40:53.500449    2545 state_mem.go:107] "Deleted CPUSet assignment" podUID="96a2dfd8-9cbc-4c05-9652-a34949a935ef" containerName="storage-initializer"
May 25 11:40:53.500773 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:40:53.500500    2545 memory_manager.go:356] "RemoveStaleState removing state" podUID="3851a8a1-305d-4edf-8d59-0e79ec9acecc" containerName="main"
May 25 11:40:53.500773 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:40:53.500507    2545 memory_manager.go:356] "RemoveStaleState removing state" podUID="96a2dfd8-9cbc-4c05-9652-a34949a935ef" containerName="main"
May 25 11:40:53.500773 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:40:53.500516    2545 memory_manager.go:356] "RemoveStaleState removing state" podUID="3851a8a1-305d-4edf-8d59-0e79ec9acecc" containerName="tokenizer"
May 25 11:40:53.503593 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:40:53.503577    2545 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/stop-feature-test-kserve-router-scheduler-86cbf4d9fb-6bffq"
May 25 11:40:53.510189 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:40:53.510165    2545 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"stop-feature-test-kserve-self-signed-certs\""
May 25 11:40:53.510291 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:40:53.510174    2545 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"kube-root-ca.crt\""
May 25 11:40:53.511278 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:40:53.511259    2545 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"stop-feature-test-epp-sa-dockercfg-j6tjf\""
May 25 11:40:53.511378 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:40:53.511350    2545 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"default-dockercfg-vcvlw\""
May 25 11:40:53.534776 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:40:53.534749    2545 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"openshift-service-ca.crt\""
May 25 11:40:53.572343 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:40:53.572318    2545 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/stop-feature-test-kserve-router-scheduler-86cbf4d9fb-6bffq"]
May 25 11:40:53.635728 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:40:53.635694    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f0f21c10-b7e6-44e6-892a-04f68ff21a52-tls-certs\") pod \"stop-feature-test-kserve-router-scheduler-86cbf4d9fb-6bffq\" (UID: \"f0f21c10-b7e6-44e6-892a-04f68ff21a52\") " pod="kserve-ci-e2e-test/stop-feature-test-kserve-router-scheduler-86cbf4d9fb-6bffq"
May 25 11:40:53.635728 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:40:53.635727    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tokenizer-uds\" (UniqueName: \"kubernetes.io/empty-dir/f0f21c10-b7e6-44e6-892a-04f68ff21a52-tokenizer-uds\") pod \"stop-feature-test-kserve-router-scheduler-86cbf4d9fb-6bffq\" (UID: \"f0f21c10-b7e6-44e6-892a-04f68ff21a52\") " pod="kserve-ci-e2e-test/stop-feature-test-kserve-router-scheduler-86cbf4d9fb-6bffq"
May 25 11:40:53.635924 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:40:53.635765    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/f0f21c10-b7e6-44e6-892a-04f68ff21a52-kserve-provision-location\") pod \"stop-feature-test-kserve-router-scheduler-86cbf4d9fb-6bffq\" (UID: \"f0f21c10-b7e6-44e6-892a-04f68ff21a52\") " pod="kserve-ci-e2e-test/stop-feature-test-kserve-router-scheduler-86cbf4d9fb-6bffq"
May 25 11:40:53.635924 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:40:53.635789    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6t7rl\" (UniqueName: \"kubernetes.io/projected/f0f21c10-b7e6-44e6-892a-04f68ff21a52-kube-api-access-6t7rl\") pod \"stop-feature-test-kserve-router-scheduler-86cbf4d9fb-6bffq\" (UID: \"f0f21c10-b7e6-44e6-892a-04f68ff21a52\") " pod="kserve-ci-e2e-test/stop-feature-test-kserve-router-scheduler-86cbf4d9fb-6bffq"
May 25 11:40:53.635924 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:40:53.635816    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tokenizer-tmp\" (UniqueName: \"kubernetes.io/empty-dir/f0f21c10-b7e6-44e6-892a-04f68ff21a52-tokenizer-tmp\") pod \"stop-feature-test-kserve-router-scheduler-86cbf4d9fb-6bffq\" (UID: \"f0f21c10-b7e6-44e6-892a-04f68ff21a52\") " pod="kserve-ci-e2e-test/stop-feature-test-kserve-router-scheduler-86cbf4d9fb-6bffq"
May 25 11:40:53.635924 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:40:53.635850    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tokenizer-cache\" (UniqueName: \"kubernetes.io/empty-dir/f0f21c10-b7e6-44e6-892a-04f68ff21a52-tokenizer-cache\") pod \"stop-feature-test-kserve-router-scheduler-86cbf4d9fb-6bffq\" (UID: \"f0f21c10-b7e6-44e6-892a-04f68ff21a52\") " pod="kserve-ci-e2e-test/stop-feature-test-kserve-router-scheduler-86cbf4d9fb-6bffq"
May 25 11:40:53.736856 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:40:53.736810    2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f0f21c10-b7e6-44e6-892a-04f68ff21a52-tls-certs\") pod \"stop-feature-test-kserve-router-scheduler-86cbf4d9fb-6bffq\" (UID: \"f0f21c10-b7e6-44e6-892a-04f68ff21a52\") " pod="kserve-ci-e2e-test/stop-feature-test-kserve-router-scheduler-86cbf4d9fb-6bffq"
May 25 11:40:53.737052 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:40:53.736889    2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tokenizer-uds\" (UniqueName: \"kubernetes.io/empty-dir/f0f21c10-b7e6-44e6-892a-04f68ff21a52-tokenizer-uds\") pod \"stop-feature-test-kserve-router-scheduler-86cbf4d9fb-6bffq\" (UID: \"f0f21c10-b7e6-44e6-892a-04f68ff21a52\") " pod="kserve-ci-e2e-test/stop-feature-test-kserve-router-scheduler-86cbf4d9fb-6bffq"
May 25 11:40:53.737052 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:40:53.736929    2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/f0f21c10-b7e6-44e6-892a-04f68ff21a52-kserve-provision-location\") pod \"stop-feature-test-kserve-router-scheduler-86cbf4d9fb-6bffq\" (UID: \"f0f21c10-b7e6-44e6-892a-04f68ff21a52\") " pod="kserve-ci-e2e-test/stop-feature-test-kserve-router-scheduler-86cbf4d9fb-6bffq"
May 25 11:40:53.737052 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:40:53.736969    2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-6t7rl\" (UniqueName: \"kubernetes.io/projected/f0f21c10-b7e6-44e6-892a-04f68ff21a52-kube-api-access-6t7rl\") pod \"stop-feature-test-kserve-router-scheduler-86cbf4d9fb-6bffq\" (UID: \"f0f21c10-b7e6-44e6-892a-04f68ff21a52\") " pod="kserve-ci-e2e-test/stop-feature-test-kserve-router-scheduler-86cbf4d9fb-6bffq"
May 25 11:40:53.737052 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:40:53.737012    2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tokenizer-tmp\" (UniqueName: \"kubernetes.io/empty-dir/f0f21c10-b7e6-44e6-892a-04f68ff21a52-tokenizer-tmp\") pod \"stop-feature-test-kserve-router-scheduler-86cbf4d9fb-6bffq\" (UID: \"f0f21c10-b7e6-44e6-892a-04f68ff21a52\") " pod="kserve-ci-e2e-test/stop-feature-test-kserve-router-scheduler-86cbf4d9fb-6bffq"
May 25 11:40:53.737260 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:40:53.737054    2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tokenizer-cache\" (UniqueName: \"kubernetes.io/empty-dir/f0f21c10-b7e6-44e6-892a-04f68ff21a52-tokenizer-cache\") pod \"stop-feature-test-kserve-router-scheduler-86cbf4d9fb-6bffq\" (UID: \"f0f21c10-b7e6-44e6-892a-04f68ff21a52\") " pod="kserve-ci-e2e-test/stop-feature-test-kserve-router-scheduler-86cbf4d9fb-6bffq"
May 25 11:40:53.737440 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:40:53.737420    2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tokenizer-uds\" (UniqueName: \"kubernetes.io/empty-dir/f0f21c10-b7e6-44e6-892a-04f68ff21a52-tokenizer-uds\") pod \"stop-feature-test-kserve-router-scheduler-86cbf4d9fb-6bffq\" (UID: \"f0f21c10-b7e6-44e6-892a-04f68ff21a52\") " pod="kserve-ci-e2e-test/stop-feature-test-kserve-router-scheduler-86cbf4d9fb-6bffq"
May 25 11:40:53.737521 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:40:53.737493    2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tokenizer-tmp\" (UniqueName: \"kubernetes.io/empty-dir/f0f21c10-b7e6-44e6-892a-04f68ff21a52-tokenizer-tmp\") pod \"stop-feature-test-kserve-router-scheduler-86cbf4d9fb-6bffq\" (UID: \"f0f21c10-b7e6-44e6-892a-04f68ff21a52\") " pod="kserve-ci-e2e-test/stop-feature-test-kserve-router-scheduler-86cbf4d9fb-6bffq"
May 25 11:40:53.737579 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:40:53.737525    2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/f0f21c10-b7e6-44e6-892a-04f68ff21a52-kserve-provision-location\") pod \"stop-feature-test-kserve-router-scheduler-86cbf4d9fb-6bffq\" (UID: \"f0f21c10-b7e6-44e6-892a-04f68ff21a52\") " pod="kserve-ci-e2e-test/stop-feature-test-kserve-router-scheduler-86cbf4d9fb-6bffq"
May 25 11:40:53.737579 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:40:53.737558    2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tokenizer-cache\" (UniqueName: \"kubernetes.io/empty-dir/f0f21c10-b7e6-44e6-892a-04f68ff21a52-tokenizer-cache\") pod \"stop-feature-test-kserve-router-scheduler-86cbf4d9fb-6bffq\" (UID: \"f0f21c10-b7e6-44e6-892a-04f68ff21a52\") " pod="kserve-ci-e2e-test/stop-feature-test-kserve-router-scheduler-86cbf4d9fb-6bffq"
May 25 11:40:53.739208 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:40:53.739188    2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f0f21c10-b7e6-44e6-892a-04f68ff21a52-tls-certs\") pod \"stop-feature-test-kserve-router-scheduler-86cbf4d9fb-6bffq\" (UID: \"f0f21c10-b7e6-44e6-892a-04f68ff21a52\") " pod="kserve-ci-e2e-test/stop-feature-test-kserve-router-scheduler-86cbf4d9fb-6bffq"
May 25 11:40:53.750663 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:40:53.750615    2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6t7rl\" (UniqueName: \"kubernetes.io/projected/f0f21c10-b7e6-44e6-892a-04f68ff21a52-kube-api-access-6t7rl\") pod \"stop-feature-test-kserve-router-scheduler-86cbf4d9fb-6bffq\" (UID: \"f0f21c10-b7e6-44e6-892a-04f68ff21a52\") " pod="kserve-ci-e2e-test/stop-feature-test-kserve-router-scheduler-86cbf4d9fb-6bffq"
May 25 11:40:53.812071 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:40:53.812045    2545 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/stop-feature-test-kserve-router-scheduler-86cbf4d9fb-6bffq"
May 25 11:40:53.969846 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:40:53.969823    2545 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/stop-feature-test-kserve-router-scheduler-86cbf4d9fb-6bffq"]
May 25 11:40:53.971629 ip-10-0-128-206 kubenswrapper[2545]: W0525 11:40:53.971607    2545 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf0f21c10_b7e6_44e6_892a_04f68ff21a52.slice/crio-4cb1eb547a9c129b9bb24bff7272bb1aed58a587ff2aaf431ce436a0a531ed1e WatchSource:0}: Error finding container 4cb1eb547a9c129b9bb24bff7272bb1aed58a587ff2aaf431ce436a0a531ed1e: Status 404 returned error can't find the container with id 4cb1eb547a9c129b9bb24bff7272bb1aed58a587ff2aaf431ce436a0a531ed1e
May 25 11:40:54.353700 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:40:54.353618    2545 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/stop-feature-test-kserve-router-scheduler-86cbf4d9fb-6bffq" event={"ID":"f0f21c10-b7e6-44e6-892a-04f68ff21a52","Type":"ContainerStarted","Data":"bd56f178de31fec9acc1ab847e5fae0d0d9d238c2715ce09dc9cacea26f71196"}
May 25 11:40:54.353700 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:40:54.353653    2545 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/stop-feature-test-kserve-router-scheduler-86cbf4d9fb-6bffq" event={"ID":"f0f21c10-b7e6-44e6-892a-04f68ff21a52","Type":"ContainerStarted","Data":"4cb1eb547a9c129b9bb24bff7272bb1aed58a587ff2aaf431ce436a0a531ed1e"}
May 25 11:40:55.358713 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:40:55.358674    2545 generic.go:358] "Generic (PLEG): container finished" podID="f0f21c10-b7e6-44e6-892a-04f68ff21a52" containerID="bd56f178de31fec9acc1ab847e5fae0d0d9d238c2715ce09dc9cacea26f71196" exitCode=0
May 25 11:40:55.359176 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:40:55.358718    2545 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/stop-feature-test-kserve-router-scheduler-86cbf4d9fb-6bffq" event={"ID":"f0f21c10-b7e6-44e6-892a-04f68ff21a52","Type":"ContainerDied","Data":"bd56f178de31fec9acc1ab847e5fae0d0d9d238c2715ce09dc9cacea26f71196"}
May 25 11:40:56.364369 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:40:56.364338    2545 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/stop-feature-test-kserve-router-scheduler-86cbf4d9fb-6bffq" event={"ID":"f0f21c10-b7e6-44e6-892a-04f68ff21a52","Type":"ContainerStarted","Data":"d1cbfae2393a1f00b481ef4ecc04747aa19029be787b47158c2c302af3f0f650"}
May 25 11:40:56.364369 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:40:56.364375    2545 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/stop-feature-test-kserve-router-scheduler-86cbf4d9fb-6bffq" event={"ID":"f0f21c10-b7e6-44e6-892a-04f68ff21a52","Type":"ContainerStarted","Data":"7c65e0bcbcb025ab9a94b3b34c3f4b0f96385a1b33cce7c0f6e98ed9b6c15e95"}
May 25 11:40:56.364815 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:40:56.364412    2545 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/stop-feature-test-kserve-router-scheduler-86cbf4d9fb-6bffq"
May 25 11:40:56.395540 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:40:56.395493    2545 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kserve-ci-e2e-test/stop-feature-test-kserve-router-scheduler-86cbf4d9fb-6bffq" podStartSLOduration=3.395479344 podStartE2EDuration="3.395479344s" podCreationTimestamp="2026-05-25 11:40:53 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-25 11:40:56.392927129 +0000 UTC m=+1048.159212076" watchObservedRunningTime="2026-05-25 11:40:56.395479344 +0000 UTC m=+1048.161764289"
May 25 11:41:03.812370 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:41:03.812334    2545 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/stop-feature-test-kserve-router-scheduler-86cbf4d9fb-6bffq"
May 25 11:41:03.812988 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:41:03.812509    2545 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kserve-ci-e2e-test/stop-feature-test-kserve-router-scheduler-86cbf4d9fb-6bffq"
May 25 11:41:03.815127 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:41:03.815101    2545 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="kserve-ci-e2e-test/stop-feature-test-kserve-router-scheduler-86cbf4d9fb-6bffq"
May 25 11:41:04.395285 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:41:04.395255    2545 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/stop-feature-test-kserve-router-scheduler-86cbf4d9fb-6bffq"
May 25 11:41:26.401939 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:41:26.401859    2545 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/stop-feature-test-kserve-router-scheduler-86cbf4d9fb-6bffq"
May 25 11:41:28.753867 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:41:28.753837    2545 scope.go:117] "RemoveContainer" containerID="22a40e5329bb73afdb6170fb438cfe3f9b0f371a754d955cd5c8831b177f868d"
May 25 11:42:45.770625 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:42:45.770554    2545 kubelet_pods.go:1019] "Unable to retrieve pull secret, the image pull may not succeed." pod="kserve-ci-e2e-test/stop-feature-test-kserve-router-scheduler-86cbf4d9fb-6bffq" secret="" err="secret \"stop-feature-test-epp-sa-dockercfg-j6tjf\" not found"
May 25 11:42:45.807670 ip-10-0-128-206 kubenswrapper[2545]: E0525 11:42:45.807223    2545 secret.go:189] Couldn't get secret kserve-ci-e2e-test/stop-feature-test-kserve-self-signed-certs: secret "stop-feature-test-kserve-self-signed-certs" not found
May 25 11:42:45.807670 ip-10-0-128-206 kubenswrapper[2545]: E0525 11:42:45.807290    2545 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f0f21c10-b7e6-44e6-892a-04f68ff21a52-tls-certs podName:f0f21c10-b7e6-44e6-892a-04f68ff21a52 nodeName:}" failed. No retries permitted until 2026-05-25 11:42:46.307271168 +0000 UTC m=+1158.073556093 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certs" (UniqueName: "kubernetes.io/secret/f0f21c10-b7e6-44e6-892a-04f68ff21a52-tls-certs") pod "stop-feature-test-kserve-router-scheduler-86cbf4d9fb-6bffq" (UID: "f0f21c10-b7e6-44e6-892a-04f68ff21a52") : secret "stop-feature-test-kserve-self-signed-certs" not found
May 25 11:42:46.312389 ip-10-0-128-206 kubenswrapper[2545]: E0525 11:42:46.312357    2545 secret.go:189] Couldn't get secret kserve-ci-e2e-test/stop-feature-test-kserve-self-signed-certs: secret "stop-feature-test-kserve-self-signed-certs" not found
May 25 11:42:46.312555 ip-10-0-128-206 kubenswrapper[2545]: E0525 11:42:46.312433    2545 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f0f21c10-b7e6-44e6-892a-04f68ff21a52-tls-certs podName:f0f21c10-b7e6-44e6-892a-04f68ff21a52 nodeName:}" failed. No retries permitted until 2026-05-25 11:42:47.312417113 +0000 UTC m=+1159.078702036 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "tls-certs" (UniqueName: "kubernetes.io/secret/f0f21c10-b7e6-44e6-892a-04f68ff21a52-tls-certs") pod "stop-feature-test-kserve-router-scheduler-86cbf4d9fb-6bffq" (UID: "f0f21c10-b7e6-44e6-892a-04f68ff21a52") : secret "stop-feature-test-kserve-self-signed-certs" not found
May 25 11:42:47.320588 ip-10-0-128-206 kubenswrapper[2545]: E0525 11:42:47.320546    2545 secret.go:189] Couldn't get secret kserve-ci-e2e-test/stop-feature-test-kserve-self-signed-certs: secret "stop-feature-test-kserve-self-signed-certs" not found
May 25 11:42:47.321016 ip-10-0-128-206 kubenswrapper[2545]: E0525 11:42:47.320639    2545 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f0f21c10-b7e6-44e6-892a-04f68ff21a52-tls-certs podName:f0f21c10-b7e6-44e6-892a-04f68ff21a52 nodeName:}" failed. No retries permitted until 2026-05-25 11:42:49.320618646 +0000 UTC m=+1161.086903593 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "tls-certs" (UniqueName: "kubernetes.io/secret/f0f21c10-b7e6-44e6-892a-04f68ff21a52-tls-certs") pod "stop-feature-test-kserve-router-scheduler-86cbf4d9fb-6bffq" (UID: "f0f21c10-b7e6-44e6-892a-04f68ff21a52") : secret "stop-feature-test-kserve-self-signed-certs" not found
May 25 11:42:48.310564 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:42:48.310533    2545 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/stop-feature-test-kserve-router-scheduler-86cbf4d9fb-6bffq"]
May 25 11:42:48.310948 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:42:48.310870    2545 kuberuntime_container.go:864] "Killing container with a grace period" pod="kserve-ci-e2e-test/stop-feature-test-kserve-router-scheduler-86cbf4d9fb-6bffq" podUID="f0f21c10-b7e6-44e6-892a-04f68ff21a52" containerName="main" containerID="cri-o://7c65e0bcbcb025ab9a94b3b34c3f4b0f96385a1b33cce7c0f6e98ed9b6c15e95" gracePeriod=30
May 25 11:42:48.311111 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:42:48.310945    2545 kuberuntime_container.go:864] "Killing container with a grace period" pod="kserve-ci-e2e-test/stop-feature-test-kserve-router-scheduler-86cbf4d9fb-6bffq" podUID="f0f21c10-b7e6-44e6-892a-04f68ff21a52" containerName="tokenizer" containerID="cri-o://d1cbfae2393a1f00b481ef4ecc04747aa19029be787b47158c2c302af3f0f650" gracePeriod=30
May 25 11:42:48.753809 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:42:48.753767    2545 generic.go:358] "Generic (PLEG): container finished" podID="f0f21c10-b7e6-44e6-892a-04f68ff21a52" containerID="7c65e0bcbcb025ab9a94b3b34c3f4b0f96385a1b33cce7c0f6e98ed9b6c15e95" exitCode=0
May 25 11:42:48.754179 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:42:48.753834    2545 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/stop-feature-test-kserve-router-scheduler-86cbf4d9fb-6bffq" event={"ID":"f0f21c10-b7e6-44e6-892a-04f68ff21a52","Type":"ContainerDied","Data":"7c65e0bcbcb025ab9a94b3b34c3f4b0f96385a1b33cce7c0f6e98ed9b6c15e95"}
May 25 11:42:49.336922 ip-10-0-128-206 kubenswrapper[2545]: E0525 11:42:49.336896    2545 secret.go:189] Couldn't get secret kserve-ci-e2e-test/stop-feature-test-kserve-self-signed-certs: secret "stop-feature-test-kserve-self-signed-certs" not found
May 25 11:42:49.337053 ip-10-0-128-206 kubenswrapper[2545]: E0525 11:42:49.336998    2545 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f0f21c10-b7e6-44e6-892a-04f68ff21a52-tls-certs podName:f0f21c10-b7e6-44e6-892a-04f68ff21a52 nodeName:}" failed. No retries permitted until 2026-05-25 11:42:53.33697671 +0000 UTC m=+1165.103261648 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "tls-certs" (UniqueName: "kubernetes.io/secret/f0f21c10-b7e6-44e6-892a-04f68ff21a52-tls-certs") pod "stop-feature-test-kserve-router-scheduler-86cbf4d9fb-6bffq" (UID: "f0f21c10-b7e6-44e6-892a-04f68ff21a52") : secret "stop-feature-test-kserve-self-signed-certs" not found
May 25 11:42:49.570377 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:42:49.570323    2545 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/stop-feature-test-kserve-router-scheduler-86cbf4d9fb-6bffq"
May 25 11:42:49.639060 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:42:49.639026    2545 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6t7rl\" (UniqueName: \"kubernetes.io/projected/f0f21c10-b7e6-44e6-892a-04f68ff21a52-kube-api-access-6t7rl\") pod \"f0f21c10-b7e6-44e6-892a-04f68ff21a52\" (UID: \"f0f21c10-b7e6-44e6-892a-04f68ff21a52\") "
May 25 11:42:49.639226 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:42:49.639071    2545 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"tokenizer-uds\" (UniqueName: \"kubernetes.io/empty-dir/f0f21c10-b7e6-44e6-892a-04f68ff21a52-tokenizer-uds\") pod \"f0f21c10-b7e6-44e6-892a-04f68ff21a52\" (UID: \"f0f21c10-b7e6-44e6-892a-04f68ff21a52\") "
May 25 11:42:49.639226 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:42:49.639104    2545 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f0f21c10-b7e6-44e6-892a-04f68ff21a52-tls-certs\") pod \"f0f21c10-b7e6-44e6-892a-04f68ff21a52\" (UID: \"f0f21c10-b7e6-44e6-892a-04f68ff21a52\") "
May 25 11:42:49.639226 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:42:49.639145    2545 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"tokenizer-cache\" (UniqueName: \"kubernetes.io/empty-dir/f0f21c10-b7e6-44e6-892a-04f68ff21a52-tokenizer-cache\") pod \"f0f21c10-b7e6-44e6-892a-04f68ff21a52\" (UID: \"f0f21c10-b7e6-44e6-892a-04f68ff21a52\") "
May 25 11:42:49.639226 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:42:49.639174    2545 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/f0f21c10-b7e6-44e6-892a-04f68ff21a52-kserve-provision-location\") pod \"f0f21c10-b7e6-44e6-892a-04f68ff21a52\" (UID: \"f0f21c10-b7e6-44e6-892a-04f68ff21a52\") "
May 25 11:42:49.639432 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:42:49.639252    2545 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"tokenizer-tmp\" (UniqueName: \"kubernetes.io/empty-dir/f0f21c10-b7e6-44e6-892a-04f68ff21a52-tokenizer-tmp\") pod \"f0f21c10-b7e6-44e6-892a-04f68ff21a52\" (UID: \"f0f21c10-b7e6-44e6-892a-04f68ff21a52\") "
May 25 11:42:49.639432 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:42:49.639371    2545 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f0f21c10-b7e6-44e6-892a-04f68ff21a52-tokenizer-uds" (OuterVolumeSpecName: "tokenizer-uds") pod "f0f21c10-b7e6-44e6-892a-04f68ff21a52" (UID: "f0f21c10-b7e6-44e6-892a-04f68ff21a52"). InnerVolumeSpecName "tokenizer-uds". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 25 11:42:49.639432 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:42:49.639389    2545 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f0f21c10-b7e6-44e6-892a-04f68ff21a52-tokenizer-cache" (OuterVolumeSpecName: "tokenizer-cache") pod "f0f21c10-b7e6-44e6-892a-04f68ff21a52" (UID: "f0f21c10-b7e6-44e6-892a-04f68ff21a52"). InnerVolumeSpecName "tokenizer-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 25 11:42:49.639605 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:42:49.639587    2545 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f0f21c10-b7e6-44e6-892a-04f68ff21a52-tokenizer-tmp" (OuterVolumeSpecName: "tokenizer-tmp") pod "f0f21c10-b7e6-44e6-892a-04f68ff21a52" (UID: "f0f21c10-b7e6-44e6-892a-04f68ff21a52"). InnerVolumeSpecName "tokenizer-tmp". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 25 11:42:49.639667 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:42:49.639646    2545 reconciler_common.go:299] "Volume detached for volume \"tokenizer-uds\" (UniqueName: \"kubernetes.io/empty-dir/f0f21c10-b7e6-44e6-892a-04f68ff21a52-tokenizer-uds\") on node \"ip-10-0-128-206.ec2.internal\" DevicePath \"\""
May 25 11:42:49.639721 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:42:49.639665    2545 reconciler_common.go:299] "Volume detached for volume \"tokenizer-cache\" (UniqueName: \"kubernetes.io/empty-dir/f0f21c10-b7e6-44e6-892a-04f68ff21a52-tokenizer-cache\") on node \"ip-10-0-128-206.ec2.internal\" DevicePath \"\""
May 25 11:42:49.639914 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:42:49.639892    2545 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f0f21c10-b7e6-44e6-892a-04f68ff21a52-kserve-provision-location" (OuterVolumeSpecName: "kserve-provision-location") pod "f0f21c10-b7e6-44e6-892a-04f68ff21a52" (UID: "f0f21c10-b7e6-44e6-892a-04f68ff21a52"). InnerVolumeSpecName "kserve-provision-location". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 25 11:42:49.641211 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:42:49.641191    2545 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f0f21c10-b7e6-44e6-892a-04f68ff21a52-kube-api-access-6t7rl" (OuterVolumeSpecName: "kube-api-access-6t7rl") pod "f0f21c10-b7e6-44e6-892a-04f68ff21a52" (UID: "f0f21c10-b7e6-44e6-892a-04f68ff21a52"). InnerVolumeSpecName "kube-api-access-6t7rl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 25 11:42:49.641300 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:42:49.641210    2545 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f0f21c10-b7e6-44e6-892a-04f68ff21a52-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "f0f21c10-b7e6-44e6-892a-04f68ff21a52" (UID: "f0f21c10-b7e6-44e6-892a-04f68ff21a52"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 25 11:42:49.740852 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:42:49.740815    2545 reconciler_common.go:299] "Volume detached for volume \"tokenizer-tmp\" (UniqueName: \"kubernetes.io/empty-dir/f0f21c10-b7e6-44e6-892a-04f68ff21a52-tokenizer-tmp\") on node \"ip-10-0-128-206.ec2.internal\" DevicePath \"\""
May 25 11:42:49.740852 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:42:49.740849    2545 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6t7rl\" (UniqueName: \"kubernetes.io/projected/f0f21c10-b7e6-44e6-892a-04f68ff21a52-kube-api-access-6t7rl\") on node \"ip-10-0-128-206.ec2.internal\" DevicePath \"\""
May 25 11:42:49.741033 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:42:49.740860    2545 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f0f21c10-b7e6-44e6-892a-04f68ff21a52-tls-certs\") on node \"ip-10-0-128-206.ec2.internal\" DevicePath \"\""
May 25 11:42:49.741033 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:42:49.740870    2545 reconciler_common.go:299] "Volume detached for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/f0f21c10-b7e6-44e6-892a-04f68ff21a52-kserve-provision-location\") on node \"ip-10-0-128-206.ec2.internal\" DevicePath \"\""
May 25 11:42:49.759622 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:42:49.759596    2545 generic.go:358] "Generic (PLEG): container finished" podID="f0f21c10-b7e6-44e6-892a-04f68ff21a52" containerID="d1cbfae2393a1f00b481ef4ecc04747aa19029be787b47158c2c302af3f0f650" exitCode=0
May 25 11:42:49.759936 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:42:49.759678    2545 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/stop-feature-test-kserve-router-scheduler-86cbf4d9fb-6bffq"
May 25 11:42:49.759936 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:42:49.759686    2545 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/stop-feature-test-kserve-router-scheduler-86cbf4d9fb-6bffq" event={"ID":"f0f21c10-b7e6-44e6-892a-04f68ff21a52","Type":"ContainerDied","Data":"d1cbfae2393a1f00b481ef4ecc04747aa19029be787b47158c2c302af3f0f650"}
May 25 11:42:49.759936 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:42:49.759721    2545 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/stop-feature-test-kserve-router-scheduler-86cbf4d9fb-6bffq" event={"ID":"f0f21c10-b7e6-44e6-892a-04f68ff21a52","Type":"ContainerDied","Data":"4cb1eb547a9c129b9bb24bff7272bb1aed58a587ff2aaf431ce436a0a531ed1e"}
May 25 11:42:49.759936 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:42:49.759736    2545 scope.go:117] "RemoveContainer" containerID="d1cbfae2393a1f00b481ef4ecc04747aa19029be787b47158c2c302af3f0f650"
May 25 11:42:49.768004 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:42:49.767989    2545 scope.go:117] "RemoveContainer" containerID="7c65e0bcbcb025ab9a94b3b34c3f4b0f96385a1b33cce7c0f6e98ed9b6c15e95"
May 25 11:42:49.775235 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:42:49.775218    2545 scope.go:117] "RemoveContainer" containerID="bd56f178de31fec9acc1ab847e5fae0d0d9d238c2715ce09dc9cacea26f71196"
May 25 11:42:49.782187 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:42:49.782165    2545 scope.go:117] "RemoveContainer" containerID="d1cbfae2393a1f00b481ef4ecc04747aa19029be787b47158c2c302af3f0f650"
May 25 11:42:49.782477 ip-10-0-128-206 kubenswrapper[2545]: E0525 11:42:49.782449    2545 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d1cbfae2393a1f00b481ef4ecc04747aa19029be787b47158c2c302af3f0f650\": container with ID starting with d1cbfae2393a1f00b481ef4ecc04747aa19029be787b47158c2c302af3f0f650 not found: ID does not exist" containerID="d1cbfae2393a1f00b481ef4ecc04747aa19029be787b47158c2c302af3f0f650"
May 25 11:42:49.782584 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:42:49.782485    2545 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d1cbfae2393a1f00b481ef4ecc04747aa19029be787b47158c2c302af3f0f650"} err="failed to get container status \"d1cbfae2393a1f00b481ef4ecc04747aa19029be787b47158c2c302af3f0f650\": rpc error: code = NotFound desc = could not find container \"d1cbfae2393a1f00b481ef4ecc04747aa19029be787b47158c2c302af3f0f650\": container with ID starting with d1cbfae2393a1f00b481ef4ecc04747aa19029be787b47158c2c302af3f0f650 not found: ID does not exist"
May 25 11:42:49.782584 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:42:49.782521    2545 scope.go:117] "RemoveContainer" containerID="7c65e0bcbcb025ab9a94b3b34c3f4b0f96385a1b33cce7c0f6e98ed9b6c15e95"
May 25 11:42:49.782845 ip-10-0-128-206 kubenswrapper[2545]: E0525 11:42:49.782816    2545 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7c65e0bcbcb025ab9a94b3b34c3f4b0f96385a1b33cce7c0f6e98ed9b6c15e95\": container with ID starting with 7c65e0bcbcb025ab9a94b3b34c3f4b0f96385a1b33cce7c0f6e98ed9b6c15e95 not found: ID does not exist" containerID="7c65e0bcbcb025ab9a94b3b34c3f4b0f96385a1b33cce7c0f6e98ed9b6c15e95"
May 25 11:42:49.782907 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:42:49.782845    2545 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7c65e0bcbcb025ab9a94b3b34c3f4b0f96385a1b33cce7c0f6e98ed9b6c15e95"} err="failed to get container status \"7c65e0bcbcb025ab9a94b3b34c3f4b0f96385a1b33cce7c0f6e98ed9b6c15e95\": rpc error: code = NotFound desc = could not find container \"7c65e0bcbcb025ab9a94b3b34c3f4b0f96385a1b33cce7c0f6e98ed9b6c15e95\": container with ID starting with 7c65e0bcbcb025ab9a94b3b34c3f4b0f96385a1b33cce7c0f6e98ed9b6c15e95 not found: ID does not exist"
May 25 11:42:49.782907 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:42:49.782869    2545 scope.go:117] "RemoveContainer" containerID="bd56f178de31fec9acc1ab847e5fae0d0d9d238c2715ce09dc9cacea26f71196"
May 25 11:42:49.783293 ip-10-0-128-206 kubenswrapper[2545]: E0525 11:42:49.783273    2545 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bd56f178de31fec9acc1ab847e5fae0d0d9d238c2715ce09dc9cacea26f71196\": container with ID starting with bd56f178de31fec9acc1ab847e5fae0d0d9d238c2715ce09dc9cacea26f71196 not found: ID does not exist" containerID="bd56f178de31fec9acc1ab847e5fae0d0d9d238c2715ce09dc9cacea26f71196"
May 25 11:42:49.783382 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:42:49.783297    2545 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bd56f178de31fec9acc1ab847e5fae0d0d9d238c2715ce09dc9cacea26f71196"} err="failed to get container status \"bd56f178de31fec9acc1ab847e5fae0d0d9d238c2715ce09dc9cacea26f71196\": rpc error: code = NotFound desc = could not find container \"bd56f178de31fec9acc1ab847e5fae0d0d9d238c2715ce09dc9cacea26f71196\": container with ID starting with bd56f178de31fec9acc1ab847e5fae0d0d9d238c2715ce09dc9cacea26f71196 not found: ID does not exist"
May 25 11:42:49.784893 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:42:49.784875    2545 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/stop-feature-test-kserve-router-scheduler-86cbf4d9fb-6bffq"]
May 25 11:42:49.790520 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:42:49.790500    2545 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/stop-feature-test-kserve-router-scheduler-86cbf4d9fb-6bffq"]
May 25 11:42:50.774928 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:42:50.774895    2545 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f0f21c10-b7e6-44e6-892a-04f68ff21a52" path="/var/lib/kubelet/pods/f0f21c10-b7e6-44e6-892a-04f68ff21a52/volumes"
May 25 11:42:57.439554 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:42:57.439513    2545 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/stop-feature-test-kserve-router-scheduler-86cbf4d9fb-9q7j4"]
May 25 11:42:57.440205 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:42:57.439898    2545 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f0f21c10-b7e6-44e6-892a-04f68ff21a52" containerName="storage-initializer"
May 25 11:42:57.440205 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:42:57.439911    2545 state_mem.go:107] "Deleted CPUSet assignment" podUID="f0f21c10-b7e6-44e6-892a-04f68ff21a52" containerName="storage-initializer"
May 25 11:42:57.440205 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:42:57.439925    2545 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f0f21c10-b7e6-44e6-892a-04f68ff21a52" containerName="tokenizer"
May 25 11:42:57.440205 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:42:57.439931    2545 state_mem.go:107] "Deleted CPUSet assignment" podUID="f0f21c10-b7e6-44e6-892a-04f68ff21a52" containerName="tokenizer"
May 25 11:42:57.440205 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:42:57.439938    2545 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f0f21c10-b7e6-44e6-892a-04f68ff21a52" containerName="main"
May 25 11:42:57.440205 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:42:57.439945    2545 state_mem.go:107] "Deleted CPUSet assignment" podUID="f0f21c10-b7e6-44e6-892a-04f68ff21a52" containerName="main"
May 25 11:42:57.440205 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:42:57.440026    2545 memory_manager.go:356] "RemoveStaleState removing state" podUID="f0f21c10-b7e6-44e6-892a-04f68ff21a52" containerName="tokenizer"
May 25 11:42:57.440205 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:42:57.440038    2545 memory_manager.go:356] "RemoveStaleState removing state" podUID="f0f21c10-b7e6-44e6-892a-04f68ff21a52" containerName="main"
May 25 11:42:57.445101 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:42:57.445083    2545 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/stop-feature-test-kserve-router-scheduler-86cbf4d9fb-9q7j4"
May 25 11:42:57.448265 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:42:57.448240    2545 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"kube-root-ca.crt\""
May 25 11:42:57.448376 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:42:57.448244    2545 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"openshift-service-ca.crt\""
May 25 11:42:57.448376 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:42:57.448306    2545 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"default-dockercfg-vcvlw\""
May 25 11:42:57.448376 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:42:57.448347    2545 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"stop-feature-test-epp-sa-dockercfg-sxzs8\""
May 25 11:42:57.449453 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:42:57.449435    2545 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"stop-feature-test-kserve-self-signed-certs\""
May 25 11:42:57.501326 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:42:57.501296    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tokenizer-tmp\" (UniqueName: \"kubernetes.io/empty-dir/6a8d17b5-945f-4ef7-a5f2-a9875ed9a7fb-tokenizer-tmp\") pod \"stop-feature-test-kserve-router-scheduler-86cbf4d9fb-9q7j4\" (UID: \"6a8d17b5-945f-4ef7-a5f2-a9875ed9a7fb\") " pod="kserve-ci-e2e-test/stop-feature-test-kserve-router-scheduler-86cbf4d9fb-9q7j4"
May 25 11:42:57.501326 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:42:57.501328    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-56n7q\" (UniqueName: \"kubernetes.io/projected/6a8d17b5-945f-4ef7-a5f2-a9875ed9a7fb-kube-api-access-56n7q\") pod \"stop-feature-test-kserve-router-scheduler-86cbf4d9fb-9q7j4\" (UID: \"6a8d17b5-945f-4ef7-a5f2-a9875ed9a7fb\") " pod="kserve-ci-e2e-test/stop-feature-test-kserve-router-scheduler-86cbf4d9fb-9q7j4"
May 25 11:42:57.501518 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:42:57.501350    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tokenizer-uds\" (UniqueName: \"kubernetes.io/empty-dir/6a8d17b5-945f-4ef7-a5f2-a9875ed9a7fb-tokenizer-uds\") pod \"stop-feature-test-kserve-router-scheduler-86cbf4d9fb-9q7j4\" (UID: \"6a8d17b5-945f-4ef7-a5f2-a9875ed9a7fb\") " pod="kserve-ci-e2e-test/stop-feature-test-kserve-router-scheduler-86cbf4d9fb-9q7j4"
May 25 11:42:57.501518 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:42:57.501440    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6a8d17b5-945f-4ef7-a5f2-a9875ed9a7fb-tls-certs\") pod \"stop-feature-test-kserve-router-scheduler-86cbf4d9fb-9q7j4\" (UID: \"6a8d17b5-945f-4ef7-a5f2-a9875ed9a7fb\") " pod="kserve-ci-e2e-test/stop-feature-test-kserve-router-scheduler-86cbf4d9fb-9q7j4"
May 25 11:42:57.501518 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:42:57.501482    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/6a8d17b5-945f-4ef7-a5f2-a9875ed9a7fb-kserve-provision-location\") pod \"stop-feature-test-kserve-router-scheduler-86cbf4d9fb-9q7j4\" (UID: \"6a8d17b5-945f-4ef7-a5f2-a9875ed9a7fb\") " pod="kserve-ci-e2e-test/stop-feature-test-kserve-router-scheduler-86cbf4d9fb-9q7j4"
May 25 11:42:57.501616 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:42:57.501546    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tokenizer-cache\" (UniqueName: \"kubernetes.io/empty-dir/6a8d17b5-945f-4ef7-a5f2-a9875ed9a7fb-tokenizer-cache\") pod \"stop-feature-test-kserve-router-scheduler-86cbf4d9fb-9q7j4\" (UID: \"6a8d17b5-945f-4ef7-a5f2-a9875ed9a7fb\") " pod="kserve-ci-e2e-test/stop-feature-test-kserve-router-scheduler-86cbf4d9fb-9q7j4"
May 25 11:42:57.548801 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:42:57.548766    2545 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/stop-feature-test-kserve-router-scheduler-86cbf4d9fb-9q7j4"]
May 25 11:42:57.602727 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:42:57.602696    2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/6a8d17b5-945f-4ef7-a5f2-a9875ed9a7fb-kserve-provision-location\") pod \"stop-feature-test-kserve-router-scheduler-86cbf4d9fb-9q7j4\" (UID: \"6a8d17b5-945f-4ef7-a5f2-a9875ed9a7fb\") " pod="kserve-ci-e2e-test/stop-feature-test-kserve-router-scheduler-86cbf4d9fb-9q7j4"
May 25 11:42:57.602890 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:42:57.602752    2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tokenizer-cache\" (UniqueName: \"kubernetes.io/empty-dir/6a8d17b5-945f-4ef7-a5f2-a9875ed9a7fb-tokenizer-cache\") pod \"stop-feature-test-kserve-router-scheduler-86cbf4d9fb-9q7j4\" (UID: \"6a8d17b5-945f-4ef7-a5f2-a9875ed9a7fb\") " pod="kserve-ci-e2e-test/stop-feature-test-kserve-router-scheduler-86cbf4d9fb-9q7j4"
May 25 11:42:57.602890 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:42:57.602805    2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tokenizer-tmp\" (UniqueName: \"kubernetes.io/empty-dir/6a8d17b5-945f-4ef7-a5f2-a9875ed9a7fb-tokenizer-tmp\") pod \"stop-feature-test-kserve-router-scheduler-86cbf4d9fb-9q7j4\" (UID: \"6a8d17b5-945f-4ef7-a5f2-a9875ed9a7fb\") " pod="kserve-ci-e2e-test/stop-feature-test-kserve-router-scheduler-86cbf4d9fb-9q7j4"
May 25 11:42:57.602890 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:42:57.602836    2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-56n7q\" (UniqueName: \"kubernetes.io/projected/6a8d17b5-945f-4ef7-a5f2-a9875ed9a7fb-kube-api-access-56n7q\") pod \"stop-feature-test-kserve-router-scheduler-86cbf4d9fb-9q7j4\" (UID: \"6a8d17b5-945f-4ef7-a5f2-a9875ed9a7fb\") " pod="kserve-ci-e2e-test/stop-feature-test-kserve-router-scheduler-86cbf4d9fb-9q7j4"
May 25 11:42:57.602890 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:42:57.602860    2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tokenizer-uds\" (UniqueName: \"kubernetes.io/empty-dir/6a8d17b5-945f-4ef7-a5f2-a9875ed9a7fb-tokenizer-uds\") pod \"stop-feature-test-kserve-router-scheduler-86cbf4d9fb-9q7j4\" (UID: \"6a8d17b5-945f-4ef7-a5f2-a9875ed9a7fb\") " pod="kserve-ci-e2e-test/stop-feature-test-kserve-router-scheduler-86cbf4d9fb-9q7j4"
May 25 11:42:57.603092 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:42:57.602895    2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6a8d17b5-945f-4ef7-a5f2-a9875ed9a7fb-tls-certs\") pod \"stop-feature-test-kserve-router-scheduler-86cbf4d9fb-9q7j4\" (UID: \"6a8d17b5-945f-4ef7-a5f2-a9875ed9a7fb\") " pod="kserve-ci-e2e-test/stop-feature-test-kserve-router-scheduler-86cbf4d9fb-9q7j4"
May 25 11:42:57.603147 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:42:57.603127    2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tokenizer-cache\" (UniqueName: \"kubernetes.io/empty-dir/6a8d17b5-945f-4ef7-a5f2-a9875ed9a7fb-tokenizer-cache\") pod \"stop-feature-test-kserve-router-scheduler-86cbf4d9fb-9q7j4\" (UID: \"6a8d17b5-945f-4ef7-a5f2-a9875ed9a7fb\") " pod="kserve-ci-e2e-test/stop-feature-test-kserve-router-scheduler-86cbf4d9fb-9q7j4"
May 25 11:42:57.603236 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:42:57.603215    2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/6a8d17b5-945f-4ef7-a5f2-a9875ed9a7fb-kserve-provision-location\") pod \"stop-feature-test-kserve-router-scheduler-86cbf4d9fb-9q7j4\" (UID: \"6a8d17b5-945f-4ef7-a5f2-a9875ed9a7fb\") " pod="kserve-ci-e2e-test/stop-feature-test-kserve-router-scheduler-86cbf4d9fb-9q7j4"
May 25 11:42:57.603310 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:42:57.603296    2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tokenizer-tmp\" (UniqueName: \"kubernetes.io/empty-dir/6a8d17b5-945f-4ef7-a5f2-a9875ed9a7fb-tokenizer-tmp\") pod \"stop-feature-test-kserve-router-scheduler-86cbf4d9fb-9q7j4\" (UID: \"6a8d17b5-945f-4ef7-a5f2-a9875ed9a7fb\") " pod="kserve-ci-e2e-test/stop-feature-test-kserve-router-scheduler-86cbf4d9fb-9q7j4"
May 25 11:42:57.603310 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:42:57.603292    2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tokenizer-uds\" (UniqueName: \"kubernetes.io/empty-dir/6a8d17b5-945f-4ef7-a5f2-a9875ed9a7fb-tokenizer-uds\") pod \"stop-feature-test-kserve-router-scheduler-86cbf4d9fb-9q7j4\" (UID: \"6a8d17b5-945f-4ef7-a5f2-a9875ed9a7fb\") " pod="kserve-ci-e2e-test/stop-feature-test-kserve-router-scheduler-86cbf4d9fb-9q7j4"
May 25 11:42:57.605406 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:42:57.605375    2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6a8d17b5-945f-4ef7-a5f2-a9875ed9a7fb-tls-certs\") pod \"stop-feature-test-kserve-router-scheduler-86cbf4d9fb-9q7j4\" (UID: \"6a8d17b5-945f-4ef7-a5f2-a9875ed9a7fb\") " pod="kserve-ci-e2e-test/stop-feature-test-kserve-router-scheduler-86cbf4d9fb-9q7j4"
May 25 11:42:57.617346 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:42:57.617322    2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-56n7q\" (UniqueName: \"kubernetes.io/projected/6a8d17b5-945f-4ef7-a5f2-a9875ed9a7fb-kube-api-access-56n7q\") pod \"stop-feature-test-kserve-router-scheduler-86cbf4d9fb-9q7j4\" (UID: \"6a8d17b5-945f-4ef7-a5f2-a9875ed9a7fb\") " pod="kserve-ci-e2e-test/stop-feature-test-kserve-router-scheduler-86cbf4d9fb-9q7j4"
May 25 11:42:57.755221 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:42:57.755192    2545 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/stop-feature-test-kserve-router-scheduler-86cbf4d9fb-9q7j4"
May 25 11:42:57.905292 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:42:57.905260    2545 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/stop-feature-test-kserve-router-scheduler-86cbf4d9fb-9q7j4"]
May 25 11:42:57.908542 ip-10-0-128-206 kubenswrapper[2545]: W0525 11:42:57.908515    2545 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6a8d17b5_945f_4ef7_a5f2_a9875ed9a7fb.slice/crio-521a463dc9ee0836ad6fb8b925769e095e7179d9d3b42bdae625a1844ccf3769 WatchSource:0}: Error finding container 521a463dc9ee0836ad6fb8b925769e095e7179d9d3b42bdae625a1844ccf3769: Status 404 returned error can't find the container with id 521a463dc9ee0836ad6fb8b925769e095e7179d9d3b42bdae625a1844ccf3769
May 25 11:42:58.790832 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:42:58.790800    2545 generic.go:358] "Generic (PLEG): container finished" podID="6a8d17b5-945f-4ef7-a5f2-a9875ed9a7fb" containerID="f912f3328750868aac636792bf82bd177597bd76cf947289d5a252fa14e77571" exitCode=0
May 25 11:42:58.791213 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:42:58.790828    2545 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/stop-feature-test-kserve-router-scheduler-86cbf4d9fb-9q7j4" event={"ID":"6a8d17b5-945f-4ef7-a5f2-a9875ed9a7fb","Type":"ContainerDied","Data":"f912f3328750868aac636792bf82bd177597bd76cf947289d5a252fa14e77571"}
May 25 11:42:58.791213 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:42:58.790859    2545 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/stop-feature-test-kserve-router-scheduler-86cbf4d9fb-9q7j4" event={"ID":"6a8d17b5-945f-4ef7-a5f2-a9875ed9a7fb","Type":"ContainerStarted","Data":"521a463dc9ee0836ad6fb8b925769e095e7179d9d3b42bdae625a1844ccf3769"}
May 25 11:42:59.796157 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:42:59.796120    2545 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/stop-feature-test-kserve-router-scheduler-86cbf4d9fb-9q7j4" event={"ID":"6a8d17b5-945f-4ef7-a5f2-a9875ed9a7fb","Type":"ContainerStarted","Data":"cd41933dde1d36eef92c1dc422293150a57e899d6e3e26f06f38ce70046115eb"}
May 25 11:42:59.796157 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:42:59.796161    2545 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/stop-feature-test-kserve-router-scheduler-86cbf4d9fb-9q7j4" event={"ID":"6a8d17b5-945f-4ef7-a5f2-a9875ed9a7fb","Type":"ContainerStarted","Data":"7dd8e2863a793d25a3ca5114ee82a5964407fdb1954810493a97e084918d52ff"}
May 25 11:42:59.796713 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:42:59.796246    2545 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/stop-feature-test-kserve-router-scheduler-86cbf4d9fb-9q7j4"
May 25 11:42:59.819923 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:42:59.819859    2545 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kserve-ci-e2e-test/stop-feature-test-kserve-router-scheduler-86cbf4d9fb-9q7j4" podStartSLOduration=2.819839928 podStartE2EDuration="2.819839928s" podCreationTimestamp="2026-05-25 11:42:57 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-25 11:42:59.817370409 +0000 UTC m=+1171.583655381" watchObservedRunningTime="2026-05-25 11:42:59.819839928 +0000 UTC m=+1171.586124877"
May 25 11:43:07.755976 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:43:07.755922    2545 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kserve-ci-e2e-test/stop-feature-test-kserve-router-scheduler-86cbf4d9fb-9q7j4"
May 25 11:43:07.756381 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:43:07.755984    2545 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/stop-feature-test-kserve-router-scheduler-86cbf4d9fb-9q7j4"
May 25 11:43:07.758941 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:43:07.758917    2545 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="kserve-ci-e2e-test/stop-feature-test-kserve-router-scheduler-86cbf4d9fb-9q7j4"
May 25 11:43:07.826762 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:43:07.826735    2545 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/stop-feature-test-kserve-router-scheduler-86cbf4d9fb-9q7j4"
May 25 11:43:28.743823 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:43:28.743784    2545 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-krfmt_4e27bcd6-c257-422b-a332-0df274cf6fcc/ovn-acl-logging/0.log"
May 25 11:43:28.746246 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:43:28.746223    2545 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-krfmt_4e27bcd6-c257-422b-a332-0df274cf6fcc/ovn-acl-logging/0.log"
May 25 11:43:28.830519 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:43:28.830498    2545 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/stop-feature-test-kserve-router-scheduler-86cbf4d9fb-9q7j4"
May 25 11:45:48.722005 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:45:48.721917    2545 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/stop-feature-test-kserve-router-scheduler-86cbf4d9fb-9q7j4"]
May 25 11:45:48.722512 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:45:48.722257    2545 kuberuntime_container.go:864] "Killing container with a grace period" pod="kserve-ci-e2e-test/stop-feature-test-kserve-router-scheduler-86cbf4d9fb-9q7j4" podUID="6a8d17b5-945f-4ef7-a5f2-a9875ed9a7fb" containerName="main" containerID="cri-o://7dd8e2863a793d25a3ca5114ee82a5964407fdb1954810493a97e084918d52ff" gracePeriod=30
May 25 11:45:48.722512 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:45:48.722332    2545 kuberuntime_container.go:864] "Killing container with a grace period" pod="kserve-ci-e2e-test/stop-feature-test-kserve-router-scheduler-86cbf4d9fb-9q7j4" podUID="6a8d17b5-945f-4ef7-a5f2-a9875ed9a7fb" containerName="tokenizer" containerID="cri-o://cd41933dde1d36eef92c1dc422293150a57e899d6e3e26f06f38ce70046115eb" gracePeriod=30
May 25 11:45:48.830064 ip-10-0-128-206 kubenswrapper[2545]: W0525 11:45:48.830024    2545 logging.go:55] [core] [Channel #252 SubChannel #253]grpc: addrConn.createTransport failed to connect to {Addr: "10.134.0.36:9003", ServerName: "10.134.0.36:9003", }. Err: connection error: desc = "transport: Error while dialing: dial tcp 10.134.0.36:9003: connect: connection refused"
May 25 11:45:49.390386 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:45:49.390350    2545 generic.go:358] "Generic (PLEG): container finished" podID="6a8d17b5-945f-4ef7-a5f2-a9875ed9a7fb" containerID="7dd8e2863a793d25a3ca5114ee82a5964407fdb1954810493a97e084918d52ff" exitCode=0
May 25 11:45:49.390552 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:45:49.390425    2545 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/stop-feature-test-kserve-router-scheduler-86cbf4d9fb-9q7j4" event={"ID":"6a8d17b5-945f-4ef7-a5f2-a9875ed9a7fb","Type":"ContainerDied","Data":"7dd8e2863a793d25a3ca5114ee82a5964407fdb1954810493a97e084918d52ff"}
May 25 11:45:49.830027 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:45:49.829978    2545 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/stop-feature-test-kserve-router-scheduler-86cbf4d9fb-9q7j4" podUID="6a8d17b5-945f-4ef7-a5f2-a9875ed9a7fb" containerName="main" probeResult="failure" output="timeout: failed to connect service \"10.134.0.36:9003\" within 1s: context deadline exceeded"
May 25 11:45:49.970841 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:45:49.970816    2545 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/stop-feature-test-kserve-router-scheduler-86cbf4d9fb-9q7j4"
May 25 11:45:50.078015 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:45:50.077923    2545 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"tokenizer-uds\" (UniqueName: \"kubernetes.io/empty-dir/6a8d17b5-945f-4ef7-a5f2-a9875ed9a7fb-tokenizer-uds\") pod \"6a8d17b5-945f-4ef7-a5f2-a9875ed9a7fb\" (UID: \"6a8d17b5-945f-4ef7-a5f2-a9875ed9a7fb\") "
May 25 11:45:50.078015 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:45:50.077953    2545 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"tokenizer-cache\" (UniqueName: \"kubernetes.io/empty-dir/6a8d17b5-945f-4ef7-a5f2-a9875ed9a7fb-tokenizer-cache\") pod \"6a8d17b5-945f-4ef7-a5f2-a9875ed9a7fb\" (UID: \"6a8d17b5-945f-4ef7-a5f2-a9875ed9a7fb\") "
May 25 11:45:50.078015 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:45:50.078004    2545 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/6a8d17b5-945f-4ef7-a5f2-a9875ed9a7fb-kserve-provision-location\") pod \"6a8d17b5-945f-4ef7-a5f2-a9875ed9a7fb\" (UID: \"6a8d17b5-945f-4ef7-a5f2-a9875ed9a7fb\") "
May 25 11:45:50.078279 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:45:50.078075    2545 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6a8d17b5-945f-4ef7-a5f2-a9875ed9a7fb-tls-certs\") pod \"6a8d17b5-945f-4ef7-a5f2-a9875ed9a7fb\" (UID: \"6a8d17b5-945f-4ef7-a5f2-a9875ed9a7fb\") "
May 25 11:45:50.078279 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:45:50.078147    2545 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-56n7q\" (UniqueName: \"kubernetes.io/projected/6a8d17b5-945f-4ef7-a5f2-a9875ed9a7fb-kube-api-access-56n7q\") pod \"6a8d17b5-945f-4ef7-a5f2-a9875ed9a7fb\" (UID: \"6a8d17b5-945f-4ef7-a5f2-a9875ed9a7fb\") "
May 25 11:45:50.078279 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:45:50.078196    2545 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"tokenizer-tmp\" (UniqueName: \"kubernetes.io/empty-dir/6a8d17b5-945f-4ef7-a5f2-a9875ed9a7fb-tokenizer-tmp\") pod \"6a8d17b5-945f-4ef7-a5f2-a9875ed9a7fb\" (UID: \"6a8d17b5-945f-4ef7-a5f2-a9875ed9a7fb\") "
May 25 11:45:50.078279 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:45:50.078204    2545 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6a8d17b5-945f-4ef7-a5f2-a9875ed9a7fb-tokenizer-uds" (OuterVolumeSpecName: "tokenizer-uds") pod "6a8d17b5-945f-4ef7-a5f2-a9875ed9a7fb" (UID: "6a8d17b5-945f-4ef7-a5f2-a9875ed9a7fb"). InnerVolumeSpecName "tokenizer-uds". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 25 11:45:50.078481 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:45:50.078280    2545 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6a8d17b5-945f-4ef7-a5f2-a9875ed9a7fb-tokenizer-cache" (OuterVolumeSpecName: "tokenizer-cache") pod "6a8d17b5-945f-4ef7-a5f2-a9875ed9a7fb" (UID: "6a8d17b5-945f-4ef7-a5f2-a9875ed9a7fb"). InnerVolumeSpecName "tokenizer-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 25 11:45:50.078481 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:45:50.078439    2545 reconciler_common.go:299] "Volume detached for volume \"tokenizer-uds\" (UniqueName: \"kubernetes.io/empty-dir/6a8d17b5-945f-4ef7-a5f2-a9875ed9a7fb-tokenizer-uds\") on node \"ip-10-0-128-206.ec2.internal\" DevicePath \"\""
May 25 11:45:50.078481 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:45:50.078459    2545 reconciler_common.go:299] "Volume detached for volume \"tokenizer-cache\" (UniqueName: \"kubernetes.io/empty-dir/6a8d17b5-945f-4ef7-a5f2-a9875ed9a7fb-tokenizer-cache\") on node \"ip-10-0-128-206.ec2.internal\" DevicePath \"\""
May 25 11:45:50.078725 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:45:50.078699    2545 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6a8d17b5-945f-4ef7-a5f2-a9875ed9a7fb-kserve-provision-location" (OuterVolumeSpecName: "kserve-provision-location") pod "6a8d17b5-945f-4ef7-a5f2-a9875ed9a7fb" (UID: "6a8d17b5-945f-4ef7-a5f2-a9875ed9a7fb"). InnerVolumeSpecName "kserve-provision-location". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 25 11:45:50.079429 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:45:50.079409    2545 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6a8d17b5-945f-4ef7-a5f2-a9875ed9a7fb-tokenizer-tmp" (OuterVolumeSpecName: "tokenizer-tmp") pod "6a8d17b5-945f-4ef7-a5f2-a9875ed9a7fb" (UID: "6a8d17b5-945f-4ef7-a5f2-a9875ed9a7fb"). InnerVolumeSpecName "tokenizer-tmp". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 25 11:45:50.080255 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:45:50.080226    2545 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6a8d17b5-945f-4ef7-a5f2-a9875ed9a7fb-kube-api-access-56n7q" (OuterVolumeSpecName: "kube-api-access-56n7q") pod "6a8d17b5-945f-4ef7-a5f2-a9875ed9a7fb" (UID: "6a8d17b5-945f-4ef7-a5f2-a9875ed9a7fb"). InnerVolumeSpecName "kube-api-access-56n7q". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 25 11:45:50.080255 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:45:50.080239    2545 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6a8d17b5-945f-4ef7-a5f2-a9875ed9a7fb-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "6a8d17b5-945f-4ef7-a5f2-a9875ed9a7fb" (UID: "6a8d17b5-945f-4ef7-a5f2-a9875ed9a7fb"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 25 11:45:50.179209 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:45:50.179179    2545 reconciler_common.go:299] "Volume detached for volume \"tokenizer-tmp\" (UniqueName: \"kubernetes.io/empty-dir/6a8d17b5-945f-4ef7-a5f2-a9875ed9a7fb-tokenizer-tmp\") on node \"ip-10-0-128-206.ec2.internal\" DevicePath \"\""
May 25 11:45:50.179209 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:45:50.179205    2545 reconciler_common.go:299] "Volume detached for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/6a8d17b5-945f-4ef7-a5f2-a9875ed9a7fb-kserve-provision-location\") on node \"ip-10-0-128-206.ec2.internal\" DevicePath \"\""
May 25 11:45:50.179209 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:45:50.179216    2545 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6a8d17b5-945f-4ef7-a5f2-a9875ed9a7fb-tls-certs\") on node \"ip-10-0-128-206.ec2.internal\" DevicePath \"\""
May 25 11:45:50.179451 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:45:50.179226    2545 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-56n7q\" (UniqueName: \"kubernetes.io/projected/6a8d17b5-945f-4ef7-a5f2-a9875ed9a7fb-kube-api-access-56n7q\") on node \"ip-10-0-128-206.ec2.internal\" DevicePath \"\""
May 25 11:45:50.395923 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:45:50.395833    2545 generic.go:358] "Generic (PLEG): container finished" podID="6a8d17b5-945f-4ef7-a5f2-a9875ed9a7fb" containerID="cd41933dde1d36eef92c1dc422293150a57e899d6e3e26f06f38ce70046115eb" exitCode=0
May 25 11:45:50.395923 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:45:50.395911    2545 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/stop-feature-test-kserve-router-scheduler-86cbf4d9fb-9q7j4"
May 25 11:45:50.396207 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:45:50.395921    2545 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/stop-feature-test-kserve-router-scheduler-86cbf4d9fb-9q7j4" event={"ID":"6a8d17b5-945f-4ef7-a5f2-a9875ed9a7fb","Type":"ContainerDied","Data":"cd41933dde1d36eef92c1dc422293150a57e899d6e3e26f06f38ce70046115eb"}
May 25 11:45:50.396207 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:45:50.396004    2545 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/stop-feature-test-kserve-router-scheduler-86cbf4d9fb-9q7j4" event={"ID":"6a8d17b5-945f-4ef7-a5f2-a9875ed9a7fb","Type":"ContainerDied","Data":"521a463dc9ee0836ad6fb8b925769e095e7179d9d3b42bdae625a1844ccf3769"}
May 25 11:45:50.396207 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:45:50.396028    2545 scope.go:117] "RemoveContainer" containerID="cd41933dde1d36eef92c1dc422293150a57e899d6e3e26f06f38ce70046115eb"
May 25 11:45:50.404845 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:45:50.404828    2545 scope.go:117] "RemoveContainer" containerID="7dd8e2863a793d25a3ca5114ee82a5964407fdb1954810493a97e084918d52ff"
May 25 11:45:50.412788 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:45:50.412770    2545 scope.go:117] "RemoveContainer" containerID="f912f3328750868aac636792bf82bd177597bd76cf947289d5a252fa14e77571"
May 25 11:45:50.419243 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:45:50.419218    2545 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/stop-feature-test-kserve-router-scheduler-86cbf4d9fb-9q7j4"]
May 25 11:45:50.420682 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:45:50.420665    2545 scope.go:117] "RemoveContainer" containerID="cd41933dde1d36eef92c1dc422293150a57e899d6e3e26f06f38ce70046115eb"
May 25 11:45:50.420967 ip-10-0-128-206 kubenswrapper[2545]: E0525 11:45:50.420932    2545 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cd41933dde1d36eef92c1dc422293150a57e899d6e3e26f06f38ce70046115eb\": container with ID starting with cd41933dde1d36eef92c1dc422293150a57e899d6e3e26f06f38ce70046115eb not found: ID does not exist" containerID="cd41933dde1d36eef92c1dc422293150a57e899d6e3e26f06f38ce70046115eb"
May 25 11:45:50.421106 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:45:50.421082    2545 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cd41933dde1d36eef92c1dc422293150a57e899d6e3e26f06f38ce70046115eb"} err="failed to get container status \"cd41933dde1d36eef92c1dc422293150a57e899d6e3e26f06f38ce70046115eb\": rpc error: code = NotFound desc = could not find container \"cd41933dde1d36eef92c1dc422293150a57e899d6e3e26f06f38ce70046115eb\": container with ID starting with cd41933dde1d36eef92c1dc422293150a57e899d6e3e26f06f38ce70046115eb not found: ID does not exist"
May 25 11:45:50.421183 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:45:50.421111    2545 scope.go:117] "RemoveContainer" containerID="7dd8e2863a793d25a3ca5114ee82a5964407fdb1954810493a97e084918d52ff"
May 25 11:45:50.421366 ip-10-0-128-206 kubenswrapper[2545]: E0525 11:45:50.421349    2545 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7dd8e2863a793d25a3ca5114ee82a5964407fdb1954810493a97e084918d52ff\": container with ID starting with 7dd8e2863a793d25a3ca5114ee82a5964407fdb1954810493a97e084918d52ff not found: ID does not exist" containerID="7dd8e2863a793d25a3ca5114ee82a5964407fdb1954810493a97e084918d52ff"
May 25 11:45:50.421435 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:45:50.421375    2545 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7dd8e2863a793d25a3ca5114ee82a5964407fdb1954810493a97e084918d52ff"} err="failed to get container status \"7dd8e2863a793d25a3ca5114ee82a5964407fdb1954810493a97e084918d52ff\": rpc error: code = NotFound desc = could not find container \"7dd8e2863a793d25a3ca5114ee82a5964407fdb1954810493a97e084918d52ff\": container with ID starting with 7dd8e2863a793d25a3ca5114ee82a5964407fdb1954810493a97e084918d52ff not found: ID does not exist"
May 25 11:45:50.421435 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:45:50.421398    2545 scope.go:117] "RemoveContainer" containerID="f912f3328750868aac636792bf82bd177597bd76cf947289d5a252fa14e77571"
May 25 11:45:50.421619 ip-10-0-128-206 kubenswrapper[2545]: E0525 11:45:50.421602    2545 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f912f3328750868aac636792bf82bd177597bd76cf947289d5a252fa14e77571\": container with ID starting with f912f3328750868aac636792bf82bd177597bd76cf947289d5a252fa14e77571 not found: ID does not exist" containerID="f912f3328750868aac636792bf82bd177597bd76cf947289d5a252fa14e77571"
May 25 11:45:50.421673 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:45:50.421626    2545 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f912f3328750868aac636792bf82bd177597bd76cf947289d5a252fa14e77571"} err="failed to get container status \"f912f3328750868aac636792bf82bd177597bd76cf947289d5a252fa14e77571\": rpc error: code = NotFound desc = could not find container \"f912f3328750868aac636792bf82bd177597bd76cf947289d5a252fa14e77571\": container with ID starting with f912f3328750868aac636792bf82bd177597bd76cf947289d5a252fa14e77571 not found: ID does not exist"
May 25 11:45:50.426371 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:45:50.426352    2545 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/stop-feature-test-kserve-router-scheduler-86cbf4d9fb-9q7j4"]
May 25 11:45:50.774854 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:45:50.774822    2545 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6a8d17b5-945f-4ef7-a5f2-a9875ed9a7fb" path="/var/lib/kubelet/pods/6a8d17b5-945f-4ef7-a5f2-a9875ed9a7fb/volumes"
May 25 11:45:50.841183 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:45:50.841147    2545 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kserve/llmisvc-controller-manager-69548c8666-v2mfl"]
May 25 11:45:50.841552 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:45:50.841509    2545 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6a8d17b5-945f-4ef7-a5f2-a9875ed9a7fb" containerName="storage-initializer"
May 25 11:45:50.841552 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:45:50.841524    2545 state_mem.go:107] "Deleted CPUSet assignment" podUID="6a8d17b5-945f-4ef7-a5f2-a9875ed9a7fb" containerName="storage-initializer"
May 25 11:45:50.841552 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:45:50.841539    2545 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6a8d17b5-945f-4ef7-a5f2-a9875ed9a7fb" containerName="tokenizer"
May 25 11:45:50.841552 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:45:50.841544    2545 state_mem.go:107] "Deleted CPUSet assignment" podUID="6a8d17b5-945f-4ef7-a5f2-a9875ed9a7fb" containerName="tokenizer"
May 25 11:45:50.841681 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:45:50.841560    2545 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6a8d17b5-945f-4ef7-a5f2-a9875ed9a7fb" containerName="main"
May 25 11:45:50.841681 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:45:50.841566    2545 state_mem.go:107] "Deleted CPUSet assignment" podUID="6a8d17b5-945f-4ef7-a5f2-a9875ed9a7fb" containerName="main"
May 25 11:45:50.841681 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:45:50.841644    2545 memory_manager.go:356] "RemoveStaleState removing state" podUID="6a8d17b5-945f-4ef7-a5f2-a9875ed9a7fb" containerName="tokenizer"
May 25 11:45:50.841681 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:45:50.841655    2545 memory_manager.go:356] "RemoveStaleState removing state" podUID="6a8d17b5-945f-4ef7-a5f2-a9875ed9a7fb" containerName="main"
May 25 11:45:50.846043 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:45:50.846025    2545 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kserve/llmisvc-controller-manager-69548c8666-v2mfl"
May 25 11:45:50.850197 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:45:50.850018    2545 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve\"/\"kube-root-ca.crt\""
May 25 11:45:50.850197 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:45:50.850069    2545 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve\"/\"openshift-service-ca.crt\""
May 25 11:45:50.850197 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:45:50.850083    2545 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"llmisvc-controller-manager-dockercfg-gjkmg\""
May 25 11:45:50.850197 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:45:50.850102    2545 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"llmisvc-webhook-server-cert\""
May 25 11:45:50.852407 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:45:50.852383    2545 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kserve/llmisvc-controller-manager-69548c8666-v2mfl"]
May 25 11:45:50.985664 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:45:50.985627    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l98jj\" (UniqueName: \"kubernetes.io/projected/db761a67-f204-4c60-ac43-2bb30c43dde8-kube-api-access-l98jj\") pod \"llmisvc-controller-manager-69548c8666-v2mfl\" (UID: \"db761a67-f204-4c60-ac43-2bb30c43dde8\") " pod="kserve/llmisvc-controller-manager-69548c8666-v2mfl"
May 25 11:45:50.985664 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:45:50.985667    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/db761a67-f204-4c60-ac43-2bb30c43dde8-cert\") pod \"llmisvc-controller-manager-69548c8666-v2mfl\" (UID: \"db761a67-f204-4c60-ac43-2bb30c43dde8\") " pod="kserve/llmisvc-controller-manager-69548c8666-v2mfl"
May 25 11:45:51.087131 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:45:51.087050    2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-l98jj\" (UniqueName: \"kubernetes.io/projected/db761a67-f204-4c60-ac43-2bb30c43dde8-kube-api-access-l98jj\") pod \"llmisvc-controller-manager-69548c8666-v2mfl\" (UID: \"db761a67-f204-4c60-ac43-2bb30c43dde8\") " pod="kserve/llmisvc-controller-manager-69548c8666-v2mfl"
May 25 11:45:51.087131 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:45:51.087086    2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/db761a67-f204-4c60-ac43-2bb30c43dde8-cert\") pod \"llmisvc-controller-manager-69548c8666-v2mfl\" (UID: \"db761a67-f204-4c60-ac43-2bb30c43dde8\") " pod="kserve/llmisvc-controller-manager-69548c8666-v2mfl"
May 25 11:45:51.089326 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:45:51.089304    2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/db761a67-f204-4c60-ac43-2bb30c43dde8-cert\") pod \"llmisvc-controller-manager-69548c8666-v2mfl\" (UID: \"db761a67-f204-4c60-ac43-2bb30c43dde8\") " pod="kserve/llmisvc-controller-manager-69548c8666-v2mfl"
May 25 11:45:51.097143 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:45:51.097117    2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-l98jj\" (UniqueName: \"kubernetes.io/projected/db761a67-f204-4c60-ac43-2bb30c43dde8-kube-api-access-l98jj\") pod \"llmisvc-controller-manager-69548c8666-v2mfl\" (UID: \"db761a67-f204-4c60-ac43-2bb30c43dde8\") " pod="kserve/llmisvc-controller-manager-69548c8666-v2mfl"
May 25 11:45:51.157217 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:45:51.157189    2545 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kserve/llmisvc-controller-manager-69548c8666-v2mfl"
May 25 11:45:51.290717 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:45:51.290695    2545 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kserve/llmisvc-controller-manager-69548c8666-v2mfl"]
May 25 11:45:51.292881 ip-10-0-128-206 kubenswrapper[2545]: W0525 11:45:51.292853    2545 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-poddb761a67_f204_4c60_ac43_2bb30c43dde8.slice/crio-9578785242fba68c7e0ea9e3dd34c418e85534e888a4b12f132d2de43d674e39 WatchSource:0}: Error finding container 9578785242fba68c7e0ea9e3dd34c418e85534e888a4b12f132d2de43d674e39: Status 404 returned error can't find the container with id 9578785242fba68c7e0ea9e3dd34c418e85534e888a4b12f132d2de43d674e39
May 25 11:45:51.294183 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:45:51.294166    2545 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
May 25 11:45:51.399706 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:45:51.399615    2545 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kserve/llmisvc-controller-manager-69548c8666-v2mfl" event={"ID":"db761a67-f204-4c60-ac43-2bb30c43dde8","Type":"ContainerStarted","Data":"9578785242fba68c7e0ea9e3dd34c418e85534e888a4b12f132d2de43d674e39"}
May 25 11:45:54.412686 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:45:54.412589    2545 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kserve/llmisvc-controller-manager-69548c8666-v2mfl" event={"ID":"db761a67-f204-4c60-ac43-2bb30c43dde8","Type":"ContainerStarted","Data":"bf7a7c18c95273dd6e94e323153019e5b05c3d48b056795e24d49e175b4ab113"}
May 25 11:45:54.412686 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:45:54.412667    2545 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve/llmisvc-controller-manager-69548c8666-v2mfl"
May 25 11:45:54.462342 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:45:54.462291    2545 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kserve/llmisvc-controller-manager-69548c8666-v2mfl" podStartSLOduration=1.625309858 podStartE2EDuration="4.462278207s" podCreationTimestamp="2026-05-25 11:45:50 +0000 UTC" firstStartedPulling="2026-05-25 11:45:51.294292916 +0000 UTC m=+1343.060577839" lastFinishedPulling="2026-05-25 11:45:54.131261253 +0000 UTC m=+1345.897546188" observedRunningTime="2026-05-25 11:45:54.44508192 +0000 UTC m=+1346.211366891" watchObservedRunningTime="2026-05-25 11:45:54.462278207 +0000 UTC m=+1346.228563153"
May 25 11:46:25.418697 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:46:25.418668    2545 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve/llmisvc-controller-manager-69548c8666-v2mfl"
May 25 11:47:18.593682 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:47:18.593602    2545 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/router-with-refs-pd-test-kserve-router-scheduler-7f965564fz645t"]
May 25 11:47:18.597479 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:47:18.597455    2545 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/router-with-refs-pd-test-kserve-router-scheduler-7f965564fz645t"
May 25 11:47:18.600585 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:47:18.600565    2545 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"openshift-service-ca.crt\""
May 25 11:47:18.601851 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:47:18.601830    2545 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"kube-root-ca.crt\""
May 25 11:47:18.601946 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:47:18.601861    2545 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"router-with-refs-pd-test-epp-sa-dockercfg-dk9sl\""
May 25 11:47:18.601946 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:47:18.601933    2545 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"default-dockercfg-vcvlw\""
May 25 11:47:18.602091 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:47:18.601866    2545 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"router-with-refs-pd-test-kserve-self-signed-certs\""
May 25 11:47:18.608952 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:47:18.608929    2545 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/router-with-refs-pd-test-kserve-router-scheduler-7f965564fz645t"]
May 25 11:47:18.629778 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:47:18.629751    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t4mbr\" (UniqueName: \"kubernetes.io/projected/6ae23725-1da2-4aa0-9ff9-9e9f1284efd1-kube-api-access-t4mbr\") pod \"router-with-refs-pd-test-kserve-router-scheduler-7f965564fz645t\" (UID: \"6ae23725-1da2-4aa0-9ff9-9e9f1284efd1\") " pod="kserve-ci-e2e-test/router-with-refs-pd-test-kserve-router-scheduler-7f965564fz645t"
May 25 11:47:18.629890 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:47:18.629798    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tokenizer-tmp\" (UniqueName: \"kubernetes.io/empty-dir/6ae23725-1da2-4aa0-9ff9-9e9f1284efd1-tokenizer-tmp\") pod \"router-with-refs-pd-test-kserve-router-scheduler-7f965564fz645t\" (UID: \"6ae23725-1da2-4aa0-9ff9-9e9f1284efd1\") " pod="kserve-ci-e2e-test/router-with-refs-pd-test-kserve-router-scheduler-7f965564fz645t"
May 25 11:47:18.629890 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:47:18.629875    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6ae23725-1da2-4aa0-9ff9-9e9f1284efd1-tls-certs\") pod \"router-with-refs-pd-test-kserve-router-scheduler-7f965564fz645t\" (UID: \"6ae23725-1da2-4aa0-9ff9-9e9f1284efd1\") " pod="kserve-ci-e2e-test/router-with-refs-pd-test-kserve-router-scheduler-7f965564fz645t"
May 25 11:47:18.629984 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:47:18.629927    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/6ae23725-1da2-4aa0-9ff9-9e9f1284efd1-kserve-provision-location\") pod \"router-with-refs-pd-test-kserve-router-scheduler-7f965564fz645t\" (UID: \"6ae23725-1da2-4aa0-9ff9-9e9f1284efd1\") " pod="kserve-ci-e2e-test/router-with-refs-pd-test-kserve-router-scheduler-7f965564fz645t"
May 25 11:47:18.630031 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:47:18.630010    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tokenizer-uds\" (UniqueName: \"kubernetes.io/empty-dir/6ae23725-1da2-4aa0-9ff9-9e9f1284efd1-tokenizer-uds\") pod \"router-with-refs-pd-test-kserve-router-scheduler-7f965564fz645t\" (UID: \"6ae23725-1da2-4aa0-9ff9-9e9f1284efd1\") " pod="kserve-ci-e2e-test/router-with-refs-pd-test-kserve-router-scheduler-7f965564fz645t"
May 25 11:47:18.630095 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:47:18.630079    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tokenizer-cache\" (UniqueName: \"kubernetes.io/empty-dir/6ae23725-1da2-4aa0-9ff9-9e9f1284efd1-tokenizer-cache\") pod \"router-with-refs-pd-test-kserve-router-scheduler-7f965564fz645t\" (UID: \"6ae23725-1da2-4aa0-9ff9-9e9f1284efd1\") " pod="kserve-ci-e2e-test/router-with-refs-pd-test-kserve-router-scheduler-7f965564fz645t"
May 25 11:47:18.731294 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:47:18.731264    2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6ae23725-1da2-4aa0-9ff9-9e9f1284efd1-tls-certs\") pod \"router-with-refs-pd-test-kserve-router-scheduler-7f965564fz645t\" (UID: \"6ae23725-1da2-4aa0-9ff9-9e9f1284efd1\") " pod="kserve-ci-e2e-test/router-with-refs-pd-test-kserve-router-scheduler-7f965564fz645t"
May 25 11:47:18.731460 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:47:18.731315    2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/6ae23725-1da2-4aa0-9ff9-9e9f1284efd1-kserve-provision-location\") pod \"router-with-refs-pd-test-kserve-router-scheduler-7f965564fz645t\" (UID: \"6ae23725-1da2-4aa0-9ff9-9e9f1284efd1\") " pod="kserve-ci-e2e-test/router-with-refs-pd-test-kserve-router-scheduler-7f965564fz645t"
May 25 11:47:18.731460 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:47:18.731352    2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tokenizer-uds\" (UniqueName: \"kubernetes.io/empty-dir/6ae23725-1da2-4aa0-9ff9-9e9f1284efd1-tokenizer-uds\") pod \"router-with-refs-pd-test-kserve-router-scheduler-7f965564fz645t\" (UID: \"6ae23725-1da2-4aa0-9ff9-9e9f1284efd1\") " pod="kserve-ci-e2e-test/router-with-refs-pd-test-kserve-router-scheduler-7f965564fz645t"
May 25 11:47:18.731460 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:47:18.731395    2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tokenizer-cache\" (UniqueName: \"kubernetes.io/empty-dir/6ae23725-1da2-4aa0-9ff9-9e9f1284efd1-tokenizer-cache\") pod \"router-with-refs-pd-test-kserve-router-scheduler-7f965564fz645t\" (UID: \"6ae23725-1da2-4aa0-9ff9-9e9f1284efd1\") " pod="kserve-ci-e2e-test/router-with-refs-pd-test-kserve-router-scheduler-7f965564fz645t"
May 25 11:47:18.731608 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:47:18.731469    2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-t4mbr\" (UniqueName: \"kubernetes.io/projected/6ae23725-1da2-4aa0-9ff9-9e9f1284efd1-kube-api-access-t4mbr\") pod \"router-with-refs-pd-test-kserve-router-scheduler-7f965564fz645t\" (UID: \"6ae23725-1da2-4aa0-9ff9-9e9f1284efd1\") " pod="kserve-ci-e2e-test/router-with-refs-pd-test-kserve-router-scheduler-7f965564fz645t"
May 25 11:47:18.731608 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:47:18.731497    2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tokenizer-tmp\" (UniqueName: \"kubernetes.io/empty-dir/6ae23725-1da2-4aa0-9ff9-9e9f1284efd1-tokenizer-tmp\") pod \"router-with-refs-pd-test-kserve-router-scheduler-7f965564fz645t\" (UID: \"6ae23725-1da2-4aa0-9ff9-9e9f1284efd1\") " pod="kserve-ci-e2e-test/router-with-refs-pd-test-kserve-router-scheduler-7f965564fz645t"
May 25 11:47:18.731795 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:47:18.731771    2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/6ae23725-1da2-4aa0-9ff9-9e9f1284efd1-kserve-provision-location\") pod \"router-with-refs-pd-test-kserve-router-scheduler-7f965564fz645t\" (UID: \"6ae23725-1da2-4aa0-9ff9-9e9f1284efd1\") " pod="kserve-ci-e2e-test/router-with-refs-pd-test-kserve-router-scheduler-7f965564fz645t"
May 25 11:47:18.731862 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:47:18.731799    2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tokenizer-uds\" (UniqueName: \"kubernetes.io/empty-dir/6ae23725-1da2-4aa0-9ff9-9e9f1284efd1-tokenizer-uds\") pod \"router-with-refs-pd-test-kserve-router-scheduler-7f965564fz645t\" (UID: \"6ae23725-1da2-4aa0-9ff9-9e9f1284efd1\") " pod="kserve-ci-e2e-test/router-with-refs-pd-test-kserve-router-scheduler-7f965564fz645t"
May 25 11:47:18.731862 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:47:18.731835    2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tokenizer-cache\" (UniqueName: \"kubernetes.io/empty-dir/6ae23725-1da2-4aa0-9ff9-9e9f1284efd1-tokenizer-cache\") pod \"router-with-refs-pd-test-kserve-router-scheduler-7f965564fz645t\" (UID: \"6ae23725-1da2-4aa0-9ff9-9e9f1284efd1\") " pod="kserve-ci-e2e-test/router-with-refs-pd-test-kserve-router-scheduler-7f965564fz645t"
May 25 11:47:18.731991 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:47:18.731895    2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tokenizer-tmp\" (UniqueName: \"kubernetes.io/empty-dir/6ae23725-1da2-4aa0-9ff9-9e9f1284efd1-tokenizer-tmp\") pod \"router-with-refs-pd-test-kserve-router-scheduler-7f965564fz645t\" (UID: \"6ae23725-1da2-4aa0-9ff9-9e9f1284efd1\") " pod="kserve-ci-e2e-test/router-with-refs-pd-test-kserve-router-scheduler-7f965564fz645t"
May 25 11:47:18.733729 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:47:18.733712    2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6ae23725-1da2-4aa0-9ff9-9e9f1284efd1-tls-certs\") pod \"router-with-refs-pd-test-kserve-router-scheduler-7f965564fz645t\" (UID: \"6ae23725-1da2-4aa0-9ff9-9e9f1284efd1\") " pod="kserve-ci-e2e-test/router-with-refs-pd-test-kserve-router-scheduler-7f965564fz645t"
May 25 11:47:18.745362 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:47:18.745336    2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-t4mbr\" (UniqueName: \"kubernetes.io/projected/6ae23725-1da2-4aa0-9ff9-9e9f1284efd1-kube-api-access-t4mbr\") pod \"router-with-refs-pd-test-kserve-router-scheduler-7f965564fz645t\" (UID: \"6ae23725-1da2-4aa0-9ff9-9e9f1284efd1\") " pod="kserve-ci-e2e-test/router-with-refs-pd-test-kserve-router-scheduler-7f965564fz645t"
May 25 11:47:18.907423 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:47:18.907333    2545 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/router-with-refs-pd-test-kserve-router-scheduler-7f965564fz645t"
May 25 11:47:19.055462 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:47:19.055435    2545 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/router-with-refs-pd-test-kserve-router-scheduler-7f965564fz645t"]
May 25 11:47:19.057282 ip-10-0-128-206 kubenswrapper[2545]: W0525 11:47:19.057254    2545 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6ae23725_1da2_4aa0_9ff9_9e9f1284efd1.slice/crio-534bdba72a237436ca319891f5aba094514661435e53635bcbaac41e50fd90a8 WatchSource:0}: Error finding container 534bdba72a237436ca319891f5aba094514661435e53635bcbaac41e50fd90a8: Status 404 returned error can't find the container with id 534bdba72a237436ca319891f5aba094514661435e53635bcbaac41e50fd90a8
May 25 11:47:19.698361 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:47:19.698324    2545 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/router-with-refs-pd-test-kserve-router-scheduler-7f965564fz645t" event={"ID":"6ae23725-1da2-4aa0-9ff9-9e9f1284efd1","Type":"ContainerStarted","Data":"6c34620c50482932fd8c6c4dcaabbc8a3088f0cb4fb8a2156aabe552b3cab93c"}
May 25 11:47:19.698361 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:47:19.698359    2545 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/router-with-refs-pd-test-kserve-router-scheduler-7f965564fz645t" event={"ID":"6ae23725-1da2-4aa0-9ff9-9e9f1284efd1","Type":"ContainerStarted","Data":"534bdba72a237436ca319891f5aba094514661435e53635bcbaac41e50fd90a8"}
May 25 11:47:20.702643 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:47:20.702604    2545 generic.go:358] "Generic (PLEG): container finished" podID="6ae23725-1da2-4aa0-9ff9-9e9f1284efd1" containerID="6c34620c50482932fd8c6c4dcaabbc8a3088f0cb4fb8a2156aabe552b3cab93c" exitCode=0
May 25 11:47:20.703031 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:47:20.702685    2545 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/router-with-refs-pd-test-kserve-router-scheduler-7f965564fz645t" event={"ID":"6ae23725-1da2-4aa0-9ff9-9e9f1284efd1","Type":"ContainerDied","Data":"6c34620c50482932fd8c6c4dcaabbc8a3088f0cb4fb8a2156aabe552b3cab93c"}
May 25 11:47:21.708144 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:47:21.708105    2545 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/router-with-refs-pd-test-kserve-router-scheduler-7f965564fz645t" event={"ID":"6ae23725-1da2-4aa0-9ff9-9e9f1284efd1","Type":"ContainerStarted","Data":"15a0ee04f0a70fc7dad7a57b96398d5c2430ccbb58c103e021da4aaaf582dd82"}
May 25 11:47:21.708533 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:47:21.708153    2545 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/router-with-refs-pd-test-kserve-router-scheduler-7f965564fz645t" event={"ID":"6ae23725-1da2-4aa0-9ff9-9e9f1284efd1","Type":"ContainerStarted","Data":"31685b77dea50ba4f97dc3b5129d184d8c7f312db1bb38706a35d5c608ff52f0"}
May 25 11:47:21.708533 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:47:21.708246    2545 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/router-with-refs-pd-test-kserve-router-scheduler-7f965564fz645t"
May 25 11:47:21.733839 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:47:21.733794    2545 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kserve-ci-e2e-test/router-with-refs-pd-test-kserve-router-scheduler-7f965564fz645t" podStartSLOduration=3.733779784 podStartE2EDuration="3.733779784s" podCreationTimestamp="2026-05-25 11:47:18 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-25 11:47:21.732246766 +0000 UTC m=+1433.498531715" watchObservedRunningTime="2026-05-25 11:47:21.733779784 +0000 UTC m=+1433.500064731"
May 25 11:47:28.908332 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:47:28.908285    2545 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kserve-ci-e2e-test/router-with-refs-pd-test-kserve-router-scheduler-7f965564fz645t"
May 25 11:47:28.908332 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:47:28.908337    2545 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/router-with-refs-pd-test-kserve-router-scheduler-7f965564fz645t"
May 25 11:47:28.911034 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:47:28.911006    2545 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="kserve-ci-e2e-test/router-with-refs-pd-test-kserve-router-scheduler-7f965564fz645t"
May 25 11:47:29.736536 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:47:29.736495    2545 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/router-with-refs-pd-test-kserve-router-scheduler-7f965564fz645t"
May 25 11:47:50.740430 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:47:50.740403    2545 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/router-with-refs-pd-test-kserve-router-scheduler-7f965564fz645t"
May 25 11:48:28.768148 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:48:28.768116    2545 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-krfmt_4e27bcd6-c257-422b-a332-0df274cf6fcc/ovn-acl-logging/0.log"
May 25 11:48:28.771294 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:48:28.771271    2545 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-krfmt_4e27bcd6-c257-422b-a332-0df274cf6fcc/ovn-acl-logging/0.log"
May 25 11:53:28.799401 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:53:28.799373    2545 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-krfmt_4e27bcd6-c257-422b-a332-0df274cf6fcc/ovn-acl-logging/0.log"
May 25 11:53:28.803976 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:53:28.803936    2545 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-krfmt_4e27bcd6-c257-422b-a332-0df274cf6fcc/ovn-acl-logging/0.log"
May 25 11:58:28.823837 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:58:28.823802    2545 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-krfmt_4e27bcd6-c257-422b-a332-0df274cf6fcc/ovn-acl-logging/0.log"
May 25 11:58:28.830716 ip-10-0-128-206 kubenswrapper[2545]: I0525 11:58:28.830694    2545 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-krfmt_4e27bcd6-c257-422b-a332-0df274cf6fcc/ovn-acl-logging/0.log"
May 25 12:02:01.337248 ip-10-0-128-206 kubenswrapper[2545]: I0525 12:02:01.337214    2545 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/router-with-refs-pd-test-kserve-router-scheduler-7f965564fz645t"]
May 25 12:02:01.337762 ip-10-0-128-206 kubenswrapper[2545]: I0525 12:02:01.337499    2545 kuberuntime_container.go:864] "Killing container with a grace period" pod="kserve-ci-e2e-test/router-with-refs-pd-test-kserve-router-scheduler-7f965564fz645t" podUID="6ae23725-1da2-4aa0-9ff9-9e9f1284efd1" containerName="main" containerID="cri-o://31685b77dea50ba4f97dc3b5129d184d8c7f312db1bb38706a35d5c608ff52f0" gracePeriod=30
May 25 12:02:01.337762 ip-10-0-128-206 kubenswrapper[2545]: I0525 12:02:01.337552    2545 kuberuntime_container.go:864] "Killing container with a grace period" pod="kserve-ci-e2e-test/router-with-refs-pd-test-kserve-router-scheduler-7f965564fz645t" podUID="6ae23725-1da2-4aa0-9ff9-9e9f1284efd1" containerName="tokenizer" containerID="cri-o://15a0ee04f0a70fc7dad7a57b96398d5c2430ccbb58c103e021da4aaaf582dd82" gracePeriod=30
May 25 12:02:01.706530 ip-10-0-128-206 kubenswrapper[2545]: I0525 12:02:01.706437    2545 generic.go:358] "Generic (PLEG): container finished" podID="6ae23725-1da2-4aa0-9ff9-9e9f1284efd1" containerID="31685b77dea50ba4f97dc3b5129d184d8c7f312db1bb38706a35d5c608ff52f0" exitCode=0
May 25 12:02:01.706530 ip-10-0-128-206 kubenswrapper[2545]: I0525 12:02:01.706506    2545 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/router-with-refs-pd-test-kserve-router-scheduler-7f965564fz645t" event={"ID":"6ae23725-1da2-4aa0-9ff9-9e9f1284efd1","Type":"ContainerDied","Data":"31685b77dea50ba4f97dc3b5129d184d8c7f312db1bb38706a35d5c608ff52f0"}
May 25 12:02:02.496574 ip-10-0-128-206 kubenswrapper[2545]: I0525 12:02:02.496552    2545 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/router-with-refs-pd-test-kserve-router-scheduler-7f965564fz645t"
May 25 12:02:02.553646 ip-10-0-128-206 kubenswrapper[2545]: I0525 12:02:02.553616    2545 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6ae23725-1da2-4aa0-9ff9-9e9f1284efd1-tls-certs\") pod \"6ae23725-1da2-4aa0-9ff9-9e9f1284efd1\" (UID: \"6ae23725-1da2-4aa0-9ff9-9e9f1284efd1\") "
May 25 12:02:02.553820 ip-10-0-128-206 kubenswrapper[2545]: I0525 12:02:02.553657    2545 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"tokenizer-cache\" (UniqueName: \"kubernetes.io/empty-dir/6ae23725-1da2-4aa0-9ff9-9e9f1284efd1-tokenizer-cache\") pod \"6ae23725-1da2-4aa0-9ff9-9e9f1284efd1\" (UID: \"6ae23725-1da2-4aa0-9ff9-9e9f1284efd1\") "
May 25 12:02:02.553820 ip-10-0-128-206 kubenswrapper[2545]: I0525 12:02:02.553699    2545 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/6ae23725-1da2-4aa0-9ff9-9e9f1284efd1-kserve-provision-location\") pod \"6ae23725-1da2-4aa0-9ff9-9e9f1284efd1\" (UID: \"6ae23725-1da2-4aa0-9ff9-9e9f1284efd1\") "
May 25 12:02:02.553820 ip-10-0-128-206 kubenswrapper[2545]: I0525 12:02:02.553730    2545 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"tokenizer-uds\" (UniqueName: \"kubernetes.io/empty-dir/6ae23725-1da2-4aa0-9ff9-9e9f1284efd1-tokenizer-uds\") pod \"6ae23725-1da2-4aa0-9ff9-9e9f1284efd1\" (UID: \"6ae23725-1da2-4aa0-9ff9-9e9f1284efd1\") "
May 25 12:02:02.553820 ip-10-0-128-206 kubenswrapper[2545]: I0525 12:02:02.553806    2545 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-t4mbr\" (UniqueName: \"kubernetes.io/projected/6ae23725-1da2-4aa0-9ff9-9e9f1284efd1-kube-api-access-t4mbr\") pod \"6ae23725-1da2-4aa0-9ff9-9e9f1284efd1\" (UID: \"6ae23725-1da2-4aa0-9ff9-9e9f1284efd1\") "
May 25 12:02:02.554083 ip-10-0-128-206 kubenswrapper[2545]: I0525 12:02:02.553832    2545 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"tokenizer-tmp\" (UniqueName: \"kubernetes.io/empty-dir/6ae23725-1da2-4aa0-9ff9-9e9f1284efd1-tokenizer-tmp\") pod \"6ae23725-1da2-4aa0-9ff9-9e9f1284efd1\" (UID: \"6ae23725-1da2-4aa0-9ff9-9e9f1284efd1\") "
May 25 12:02:02.554083 ip-10-0-128-206 kubenswrapper[2545]: I0525 12:02:02.553991    2545 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6ae23725-1da2-4aa0-9ff9-9e9f1284efd1-tokenizer-cache" (OuterVolumeSpecName: "tokenizer-cache") pod "6ae23725-1da2-4aa0-9ff9-9e9f1284efd1" (UID: "6ae23725-1da2-4aa0-9ff9-9e9f1284efd1"). InnerVolumeSpecName "tokenizer-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 25 12:02:02.554202 ip-10-0-128-206 kubenswrapper[2545]: I0525 12:02:02.554139    2545 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6ae23725-1da2-4aa0-9ff9-9e9f1284efd1-tokenizer-uds" (OuterVolumeSpecName: "tokenizer-uds") pod "6ae23725-1da2-4aa0-9ff9-9e9f1284efd1" (UID: "6ae23725-1da2-4aa0-9ff9-9e9f1284efd1"). InnerVolumeSpecName "tokenizer-uds". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 25 12:02:02.554202 ip-10-0-128-206 kubenswrapper[2545]: I0525 12:02:02.554151    2545 reconciler_common.go:299] "Volume detached for volume \"tokenizer-cache\" (UniqueName: \"kubernetes.io/empty-dir/6ae23725-1da2-4aa0-9ff9-9e9f1284efd1-tokenizer-cache\") on node \"ip-10-0-128-206.ec2.internal\" DevicePath \"\""
May 25 12:02:02.554278 ip-10-0-128-206 kubenswrapper[2545]: I0525 12:02:02.554217    2545 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6ae23725-1da2-4aa0-9ff9-9e9f1284efd1-tokenizer-tmp" (OuterVolumeSpecName: "tokenizer-tmp") pod "6ae23725-1da2-4aa0-9ff9-9e9f1284efd1" (UID: "6ae23725-1da2-4aa0-9ff9-9e9f1284efd1"). InnerVolumeSpecName "tokenizer-tmp". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 25 12:02:02.554554 ip-10-0-128-206 kubenswrapper[2545]: I0525 12:02:02.554527    2545 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6ae23725-1da2-4aa0-9ff9-9e9f1284efd1-kserve-provision-location" (OuterVolumeSpecName: "kserve-provision-location") pod "6ae23725-1da2-4aa0-9ff9-9e9f1284efd1" (UID: "6ae23725-1da2-4aa0-9ff9-9e9f1284efd1"). InnerVolumeSpecName "kserve-provision-location". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 25 12:02:02.555925 ip-10-0-128-206 kubenswrapper[2545]: I0525 12:02:02.555906    2545 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6ae23725-1da2-4aa0-9ff9-9e9f1284efd1-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "6ae23725-1da2-4aa0-9ff9-9e9f1284efd1" (UID: "6ae23725-1da2-4aa0-9ff9-9e9f1284efd1"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 25 12:02:02.555925 ip-10-0-128-206 kubenswrapper[2545]: I0525 12:02:02.555912    2545 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6ae23725-1da2-4aa0-9ff9-9e9f1284efd1-kube-api-access-t4mbr" (OuterVolumeSpecName: "kube-api-access-t4mbr") pod "6ae23725-1da2-4aa0-9ff9-9e9f1284efd1" (UID: "6ae23725-1da2-4aa0-9ff9-9e9f1284efd1"). InnerVolumeSpecName "kube-api-access-t4mbr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 25 12:02:02.655348 ip-10-0-128-206 kubenswrapper[2545]: I0525 12:02:02.655266    2545 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-t4mbr\" (UniqueName: \"kubernetes.io/projected/6ae23725-1da2-4aa0-9ff9-9e9f1284efd1-kube-api-access-t4mbr\") on node \"ip-10-0-128-206.ec2.internal\" DevicePath \"\""
May 25 12:02:02.655348 ip-10-0-128-206 kubenswrapper[2545]: I0525 12:02:02.655296    2545 reconciler_common.go:299] "Volume detached for volume \"tokenizer-tmp\" (UniqueName: \"kubernetes.io/empty-dir/6ae23725-1da2-4aa0-9ff9-9e9f1284efd1-tokenizer-tmp\") on node \"ip-10-0-128-206.ec2.internal\" DevicePath \"\""
May 25 12:02:02.655348 ip-10-0-128-206 kubenswrapper[2545]: I0525 12:02:02.655306    2545 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6ae23725-1da2-4aa0-9ff9-9e9f1284efd1-tls-certs\") on node \"ip-10-0-128-206.ec2.internal\" DevicePath \"\""
May 25 12:02:02.655348 ip-10-0-128-206 kubenswrapper[2545]: I0525 12:02:02.655316    2545 reconciler_common.go:299] "Volume detached for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/6ae23725-1da2-4aa0-9ff9-9e9f1284efd1-kserve-provision-location\") on node \"ip-10-0-128-206.ec2.internal\" DevicePath \"\""
May 25 12:02:02.655348 ip-10-0-128-206 kubenswrapper[2545]: I0525 12:02:02.655324    2545 reconciler_common.go:299] "Volume detached for volume \"tokenizer-uds\" (UniqueName: \"kubernetes.io/empty-dir/6ae23725-1da2-4aa0-9ff9-9e9f1284efd1-tokenizer-uds\") on node \"ip-10-0-128-206.ec2.internal\" DevicePath \"\""
May 25 12:02:02.711816 ip-10-0-128-206 kubenswrapper[2545]: I0525 12:02:02.711787    2545 generic.go:358] "Generic (PLEG): container finished" podID="6ae23725-1da2-4aa0-9ff9-9e9f1284efd1" containerID="15a0ee04f0a70fc7dad7a57b96398d5c2430ccbb58c103e021da4aaaf582dd82" exitCode=0
May 25 12:02:02.711984 ip-10-0-128-206 kubenswrapper[2545]: I0525 12:02:02.711844    2545 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/router-with-refs-pd-test-kserve-router-scheduler-7f965564fz645t" event={"ID":"6ae23725-1da2-4aa0-9ff9-9e9f1284efd1","Type":"ContainerDied","Data":"15a0ee04f0a70fc7dad7a57b96398d5c2430ccbb58c103e021da4aaaf582dd82"}
May 25 12:02:02.711984 ip-10-0-128-206 kubenswrapper[2545]: I0525 12:02:02.711858    2545 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/router-with-refs-pd-test-kserve-router-scheduler-7f965564fz645t"
May 25 12:02:02.711984 ip-10-0-128-206 kubenswrapper[2545]: I0525 12:02:02.711870    2545 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/router-with-refs-pd-test-kserve-router-scheduler-7f965564fz645t" event={"ID":"6ae23725-1da2-4aa0-9ff9-9e9f1284efd1","Type":"ContainerDied","Data":"534bdba72a237436ca319891f5aba094514661435e53635bcbaac41e50fd90a8"}
May 25 12:02:02.711984 ip-10-0-128-206 kubenswrapper[2545]: I0525 12:02:02.711886    2545 scope.go:117] "RemoveContainer" containerID="15a0ee04f0a70fc7dad7a57b96398d5c2430ccbb58c103e021da4aaaf582dd82"
May 25 12:02:02.720561 ip-10-0-128-206 kubenswrapper[2545]: I0525 12:02:02.720541    2545 scope.go:117] "RemoveContainer" containerID="31685b77dea50ba4f97dc3b5129d184d8c7f312db1bb38706a35d5c608ff52f0"
May 25 12:02:02.727771 ip-10-0-128-206 kubenswrapper[2545]: I0525 12:02:02.727756    2545 scope.go:117] "RemoveContainer" containerID="6c34620c50482932fd8c6c4dcaabbc8a3088f0cb4fb8a2156aabe552b3cab93c"
May 25 12:02:02.734488 ip-10-0-128-206 kubenswrapper[2545]: I0525 12:02:02.734463    2545 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/router-with-refs-pd-test-kserve-router-scheduler-7f965564fz645t"]
May 25 12:02:02.735713 ip-10-0-128-206 kubenswrapper[2545]: I0525 12:02:02.735695    2545 scope.go:117] "RemoveContainer" containerID="15a0ee04f0a70fc7dad7a57b96398d5c2430ccbb58c103e021da4aaaf582dd82"
May 25 12:02:02.736344 ip-10-0-128-206 kubenswrapper[2545]: E0525 12:02:02.736319    2545 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"15a0ee04f0a70fc7dad7a57b96398d5c2430ccbb58c103e021da4aaaf582dd82\": container with ID starting with 15a0ee04f0a70fc7dad7a57b96398d5c2430ccbb58c103e021da4aaaf582dd82 not found: ID does not exist" containerID="15a0ee04f0a70fc7dad7a57b96398d5c2430ccbb58c103e021da4aaaf582dd82"
May 25 12:02:02.736504 ip-10-0-128-206 kubenswrapper[2545]: I0525 12:02:02.736353    2545 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"15a0ee04f0a70fc7dad7a57b96398d5c2430ccbb58c103e021da4aaaf582dd82"} err="failed to get container status \"15a0ee04f0a70fc7dad7a57b96398d5c2430ccbb58c103e021da4aaaf582dd82\": rpc error: code = NotFound desc = could not find container \"15a0ee04f0a70fc7dad7a57b96398d5c2430ccbb58c103e021da4aaaf582dd82\": container with ID starting with 15a0ee04f0a70fc7dad7a57b96398d5c2430ccbb58c103e021da4aaaf582dd82 not found: ID does not exist"
May 25 12:02:02.736504 ip-10-0-128-206 kubenswrapper[2545]: I0525 12:02:02.736378    2545 scope.go:117] "RemoveContainer" containerID="31685b77dea50ba4f97dc3b5129d184d8c7f312db1bb38706a35d5c608ff52f0"
May 25 12:02:02.736857 ip-10-0-128-206 kubenswrapper[2545]: E0525 12:02:02.736836    2545 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"31685b77dea50ba4f97dc3b5129d184d8c7f312db1bb38706a35d5c608ff52f0\": container with ID starting with 31685b77dea50ba4f97dc3b5129d184d8c7f312db1bb38706a35d5c608ff52f0 not found: ID does not exist" containerID="31685b77dea50ba4f97dc3b5129d184d8c7f312db1bb38706a35d5c608ff52f0"
May 25 12:02:02.736943 ip-10-0-128-206 kubenswrapper[2545]: I0525 12:02:02.736864    2545 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"31685b77dea50ba4f97dc3b5129d184d8c7f312db1bb38706a35d5c608ff52f0"} err="failed to get container status \"31685b77dea50ba4f97dc3b5129d184d8c7f312db1bb38706a35d5c608ff52f0\": rpc error: code = NotFound desc = could not find container \"31685b77dea50ba4f97dc3b5129d184d8c7f312db1bb38706a35d5c608ff52f0\": container with ID starting with 31685b77dea50ba4f97dc3b5129d184d8c7f312db1bb38706a35d5c608ff52f0 not found: ID does not exist"
May 25 12:02:02.736943 ip-10-0-128-206 kubenswrapper[2545]: I0525 12:02:02.736888    2545 scope.go:117] "RemoveContainer" containerID="6c34620c50482932fd8c6c4dcaabbc8a3088f0cb4fb8a2156aabe552b3cab93c"
May 25 12:02:02.737166 ip-10-0-128-206 kubenswrapper[2545]: E0525 12:02:02.737146    2545 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6c34620c50482932fd8c6c4dcaabbc8a3088f0cb4fb8a2156aabe552b3cab93c\": container with ID starting with 6c34620c50482932fd8c6c4dcaabbc8a3088f0cb4fb8a2156aabe552b3cab93c not found: ID does not exist" containerID="6c34620c50482932fd8c6c4dcaabbc8a3088f0cb4fb8a2156aabe552b3cab93c"
May 25 12:02:02.737208 ip-10-0-128-206 kubenswrapper[2545]: I0525 12:02:02.737172    2545 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6c34620c50482932fd8c6c4dcaabbc8a3088f0cb4fb8a2156aabe552b3cab93c"} err="failed to get container status \"6c34620c50482932fd8c6c4dcaabbc8a3088f0cb4fb8a2156aabe552b3cab93c\": rpc error: code = NotFound desc = could not find container \"6c34620c50482932fd8c6c4dcaabbc8a3088f0cb4fb8a2156aabe552b3cab93c\": container with ID starting with 6c34620c50482932fd8c6c4dcaabbc8a3088f0cb4fb8a2156aabe552b3cab93c not found: ID does not exist"
May 25 12:02:02.738322 ip-10-0-128-206 kubenswrapper[2545]: I0525 12:02:02.738304    2545 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/router-with-refs-pd-test-kserve-router-scheduler-7f965564fz645t"]
May 25 12:02:02.775416 ip-10-0-128-206 kubenswrapper[2545]: I0525 12:02:02.775392    2545 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6ae23725-1da2-4aa0-9ff9-9e9f1284efd1" path="/var/lib/kubelet/pods/6ae23725-1da2-4aa0-9ff9-9e9f1284efd1/volumes"
May 25 12:03:28.847531 ip-10-0-128-206 kubenswrapper[2545]: I0525 12:03:28.847420    2545 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-krfmt_4e27bcd6-c257-422b-a332-0df274cf6fcc/ovn-acl-logging/0.log"
May 25 12:03:28.855275 ip-10-0-128-206 kubenswrapper[2545]: I0525 12:03:28.855253    2545 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-krfmt_4e27bcd6-c257-422b-a332-0df274cf6fcc/ovn-acl-logging/0.log"
May 25 12:07:26.642495 ip-10-0-128-206 kubenswrapper[2545]: I0525 12:07:26.642457    2545 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/llmisvc4e643bc258191ffc517a31cd1d0ddd27-kserve-router-schedczgz"]
May 25 12:07:26.643062 ip-10-0-128-206 kubenswrapper[2545]: I0525 12:07:26.643023    2545 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6ae23725-1da2-4aa0-9ff9-9e9f1284efd1" containerName="tokenizer"
May 25 12:07:26.643062 ip-10-0-128-206 kubenswrapper[2545]: I0525 12:07:26.643045    2545 state_mem.go:107] "Deleted CPUSet assignment" podUID="6ae23725-1da2-4aa0-9ff9-9e9f1284efd1" containerName="tokenizer"
May 25 12:07:26.643195 ip-10-0-128-206 kubenswrapper[2545]: I0525 12:07:26.643065    2545 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6ae23725-1da2-4aa0-9ff9-9e9f1284efd1" containerName="storage-initializer"
May 25 12:07:26.643195 ip-10-0-128-206 kubenswrapper[2545]: I0525 12:07:26.643074    2545 state_mem.go:107] "Deleted CPUSet assignment" podUID="6ae23725-1da2-4aa0-9ff9-9e9f1284efd1" containerName="storage-initializer"
May 25 12:07:26.643195 ip-10-0-128-206 kubenswrapper[2545]: I0525 12:07:26.643083    2545 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6ae23725-1da2-4aa0-9ff9-9e9f1284efd1" containerName="main"
May 25 12:07:26.643195 ip-10-0-128-206 kubenswrapper[2545]: I0525 12:07:26.643093    2545 state_mem.go:107] "Deleted CPUSet assignment" podUID="6ae23725-1da2-4aa0-9ff9-9e9f1284efd1" containerName="main"
May 25 12:07:26.643195 ip-10-0-128-206 kubenswrapper[2545]: I0525 12:07:26.643188    2545 memory_manager.go:356] "RemoveStaleState removing state" podUID="6ae23725-1da2-4aa0-9ff9-9e9f1284efd1" containerName="tokenizer"
May 25 12:07:26.643447 ip-10-0-128-206 kubenswrapper[2545]: I0525 12:07:26.643203    2545 memory_manager.go:356] "RemoveStaleState removing state" podUID="6ae23725-1da2-4aa0-9ff9-9e9f1284efd1" containerName="main"
May 25 12:07:26.646936 ip-10-0-128-206 kubenswrapper[2545]: I0525 12:07:26.646912    2545 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/llmisvc4e643bc258191ffc517a31cd1d0ddd27-kserve-router-schedczgz"
May 25 12:07:26.650021 ip-10-0-128-206 kubenswrapper[2545]: I0525 12:07:26.649989    2545 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"kube-root-ca.crt\""
May 25 12:07:26.651213 ip-10-0-128-206 kubenswrapper[2545]: I0525 12:07:26.651183    2545 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"llmisv4e643bc258191ffc517a31cd1d0ddd27-kserve-self-signed-certs\""
May 25 12:07:26.651370 ip-10-0-128-206 kubenswrapper[2545]: I0525 12:07:26.651225    2545 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"openshift-service-ca.crt\""
May 25 12:07:26.651370 ip-10-0-128-206 kubenswrapper[2545]: I0525 12:07:26.651260    2545 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"llmisvc-model-fb-opt-125m-route-f312f5ec-epp-sa-dockercfg-8kqq5\""
May 25 12:07:26.651370 ip-10-0-128-206 kubenswrapper[2545]: I0525 12:07:26.651274    2545 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"default-dockercfg-vcvlw\""
May 25 12:07:26.658775 ip-10-0-128-206 kubenswrapper[2545]: I0525 12:07:26.658744    2545 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/llmisvc4e643bc258191ffc517a31cd1d0ddd27-kserve-router-schedczgz"]
May 25 12:07:26.785503 ip-10-0-128-206 kubenswrapper[2545]: I0525 12:07:26.785468    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f95wq\" (UniqueName: \"kubernetes.io/projected/c4260983-1043-48fc-b4c8-7924e88ac806-kube-api-access-f95wq\") pod \"llmisvc4e643bc258191ffc517a31cd1d0ddd27-kserve-router-schedczgz\" (UID: \"c4260983-1043-48fc-b4c8-7924e88ac806\") " pod="kserve-ci-e2e-test/llmisvc4e643bc258191ffc517a31cd1d0ddd27-kserve-router-schedczgz"
May 25 12:07:26.785685 ip-10-0-128-206 kubenswrapper[2545]: I0525 12:07:26.785521    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c4260983-1043-48fc-b4c8-7924e88ac806-tls-certs\") pod \"llmisvc4e643bc258191ffc517a31cd1d0ddd27-kserve-router-schedczgz\" (UID: \"c4260983-1043-48fc-b4c8-7924e88ac806\") " pod="kserve-ci-e2e-test/llmisvc4e643bc258191ffc517a31cd1d0ddd27-kserve-router-schedczgz"
May 25 12:07:26.785685 ip-10-0-128-206 kubenswrapper[2545]: I0525 12:07:26.785558    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/c4260983-1043-48fc-b4c8-7924e88ac806-kserve-provision-location\") pod \"llmisvc4e643bc258191ffc517a31cd1d0ddd27-kserve-router-schedczgz\" (UID: \"c4260983-1043-48fc-b4c8-7924e88ac806\") " pod="kserve-ci-e2e-test/llmisvc4e643bc258191ffc517a31cd1d0ddd27-kserve-router-schedczgz"
May 25 12:07:26.785685 ip-10-0-128-206 kubenswrapper[2545]: I0525 12:07:26.785676    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tokenizer-tmp\" (UniqueName: \"kubernetes.io/empty-dir/c4260983-1043-48fc-b4c8-7924e88ac806-tokenizer-tmp\") pod \"llmisvc4e643bc258191ffc517a31cd1d0ddd27-kserve-router-schedczgz\" (UID: \"c4260983-1043-48fc-b4c8-7924e88ac806\") " pod="kserve-ci-e2e-test/llmisvc4e643bc258191ffc517a31cd1d0ddd27-kserve-router-schedczgz"
May 25 12:07:26.785799 ip-10-0-128-206 kubenswrapper[2545]: I0525 12:07:26.785709    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tokenizer-cache\" (UniqueName: \"kubernetes.io/empty-dir/c4260983-1043-48fc-b4c8-7924e88ac806-tokenizer-cache\") pod \"llmisvc4e643bc258191ffc517a31cd1d0ddd27-kserve-router-schedczgz\" (UID: \"c4260983-1043-48fc-b4c8-7924e88ac806\") " pod="kserve-ci-e2e-test/llmisvc4e643bc258191ffc517a31cd1d0ddd27-kserve-router-schedczgz"
May 25 12:07:26.785799 ip-10-0-128-206 kubenswrapper[2545]: I0525 12:07:26.785752    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tokenizer-uds\" (UniqueName: \"kubernetes.io/empty-dir/c4260983-1043-48fc-b4c8-7924e88ac806-tokenizer-uds\") pod \"llmisvc4e643bc258191ffc517a31cd1d0ddd27-kserve-router-schedczgz\" (UID: \"c4260983-1043-48fc-b4c8-7924e88ac806\") " pod="kserve-ci-e2e-test/llmisvc4e643bc258191ffc517a31cd1d0ddd27-kserve-router-schedczgz"
May 25 12:07:26.886853 ip-10-0-128-206 kubenswrapper[2545]: I0525 12:07:26.886817    2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tokenizer-uds\" (UniqueName: \"kubernetes.io/empty-dir/c4260983-1043-48fc-b4c8-7924e88ac806-tokenizer-uds\") pod \"llmisvc4e643bc258191ffc517a31cd1d0ddd27-kserve-router-schedczgz\" (UID: \"c4260983-1043-48fc-b4c8-7924e88ac806\") " pod="kserve-ci-e2e-test/llmisvc4e643bc258191ffc517a31cd1d0ddd27-kserve-router-schedczgz"
May 25 12:07:26.886853 ip-10-0-128-206 kubenswrapper[2545]: I0525 12:07:26.886858    2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-f95wq\" (UniqueName: \"kubernetes.io/projected/c4260983-1043-48fc-b4c8-7924e88ac806-kube-api-access-f95wq\") pod \"llmisvc4e643bc258191ffc517a31cd1d0ddd27-kserve-router-schedczgz\" (UID: \"c4260983-1043-48fc-b4c8-7924e88ac806\") " pod="kserve-ci-e2e-test/llmisvc4e643bc258191ffc517a31cd1d0ddd27-kserve-router-schedczgz"
May 25 12:07:26.887112 ip-10-0-128-206 kubenswrapper[2545]: I0525 12:07:26.887004    2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c4260983-1043-48fc-b4c8-7924e88ac806-tls-certs\") pod \"llmisvc4e643bc258191ffc517a31cd1d0ddd27-kserve-router-schedczgz\" (UID: \"c4260983-1043-48fc-b4c8-7924e88ac806\") " pod="kserve-ci-e2e-test/llmisvc4e643bc258191ffc517a31cd1d0ddd27-kserve-router-schedczgz"
May 25 12:07:26.887112 ip-10-0-128-206 kubenswrapper[2545]: I0525 12:07:26.887070    2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/c4260983-1043-48fc-b4c8-7924e88ac806-kserve-provision-location\") pod \"llmisvc4e643bc258191ffc517a31cd1d0ddd27-kserve-router-schedczgz\" (UID: \"c4260983-1043-48fc-b4c8-7924e88ac806\") " pod="kserve-ci-e2e-test/llmisvc4e643bc258191ffc517a31cd1d0ddd27-kserve-router-schedczgz"
May 25 12:07:26.887272 ip-10-0-128-206 kubenswrapper[2545]: I0525 12:07:26.887251    2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tokenizer-tmp\" (UniqueName: \"kubernetes.io/empty-dir/c4260983-1043-48fc-b4c8-7924e88ac806-tokenizer-tmp\") pod \"llmisvc4e643bc258191ffc517a31cd1d0ddd27-kserve-router-schedczgz\" (UID: \"c4260983-1043-48fc-b4c8-7924e88ac806\") " pod="kserve-ci-e2e-test/llmisvc4e643bc258191ffc517a31cd1d0ddd27-kserve-router-schedczgz"
May 25 12:07:26.887352 ip-10-0-128-206 kubenswrapper[2545]: I0525 12:07:26.887310    2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tokenizer-cache\" (UniqueName: \"kubernetes.io/empty-dir/c4260983-1043-48fc-b4c8-7924e88ac806-tokenizer-cache\") pod \"llmisvc4e643bc258191ffc517a31cd1d0ddd27-kserve-router-schedczgz\" (UID: \"c4260983-1043-48fc-b4c8-7924e88ac806\") " pod="kserve-ci-e2e-test/llmisvc4e643bc258191ffc517a31cd1d0ddd27-kserve-router-schedczgz"
May 25 12:07:26.887412 ip-10-0-128-206 kubenswrapper[2545]: I0525 12:07:26.887309    2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tokenizer-uds\" (UniqueName: \"kubernetes.io/empty-dir/c4260983-1043-48fc-b4c8-7924e88ac806-tokenizer-uds\") pod \"llmisvc4e643bc258191ffc517a31cd1d0ddd27-kserve-router-schedczgz\" (UID: \"c4260983-1043-48fc-b4c8-7924e88ac806\") " pod="kserve-ci-e2e-test/llmisvc4e643bc258191ffc517a31cd1d0ddd27-kserve-router-schedczgz"
May 25 12:07:26.887473 ip-10-0-128-206 kubenswrapper[2545]: I0525 12:07:26.887450    2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/c4260983-1043-48fc-b4c8-7924e88ac806-kserve-provision-location\") pod \"llmisvc4e643bc258191ffc517a31cd1d0ddd27-kserve-router-schedczgz\" (UID: \"c4260983-1043-48fc-b4c8-7924e88ac806\") " pod="kserve-ci-e2e-test/llmisvc4e643bc258191ffc517a31cd1d0ddd27-kserve-router-schedczgz"
May 25 12:07:26.887522 ip-10-0-128-206 kubenswrapper[2545]: I0525 12:07:26.887468    2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tokenizer-tmp\" (UniqueName: \"kubernetes.io/empty-dir/c4260983-1043-48fc-b4c8-7924e88ac806-tokenizer-tmp\") pod \"llmisvc4e643bc258191ffc517a31cd1d0ddd27-kserve-router-schedczgz\" (UID: \"c4260983-1043-48fc-b4c8-7924e88ac806\") " pod="kserve-ci-e2e-test/llmisvc4e643bc258191ffc517a31cd1d0ddd27-kserve-router-schedczgz"
May 25 12:07:26.887605 ip-10-0-128-206 kubenswrapper[2545]: I0525 12:07:26.887561    2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tokenizer-cache\" (UniqueName: \"kubernetes.io/empty-dir/c4260983-1043-48fc-b4c8-7924e88ac806-tokenizer-cache\") pod \"llmisvc4e643bc258191ffc517a31cd1d0ddd27-kserve-router-schedczgz\" (UID: \"c4260983-1043-48fc-b4c8-7924e88ac806\") " pod="kserve-ci-e2e-test/llmisvc4e643bc258191ffc517a31cd1d0ddd27-kserve-router-schedczgz"
May 25 12:07:26.889623 ip-10-0-128-206 kubenswrapper[2545]: I0525 12:07:26.889601    2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c4260983-1043-48fc-b4c8-7924e88ac806-tls-certs\") pod \"llmisvc4e643bc258191ffc517a31cd1d0ddd27-kserve-router-schedczgz\" (UID: \"c4260983-1043-48fc-b4c8-7924e88ac806\") " pod="kserve-ci-e2e-test/llmisvc4e643bc258191ffc517a31cd1d0ddd27-kserve-router-schedczgz"
May 25 12:07:26.896642 ip-10-0-128-206 kubenswrapper[2545]: I0525 12:07:26.896575    2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-f95wq\" (UniqueName: \"kubernetes.io/projected/c4260983-1043-48fc-b4c8-7924e88ac806-kube-api-access-f95wq\") pod \"llmisvc4e643bc258191ffc517a31cd1d0ddd27-kserve-router-schedczgz\" (UID: \"c4260983-1043-48fc-b4c8-7924e88ac806\") " pod="kserve-ci-e2e-test/llmisvc4e643bc258191ffc517a31cd1d0ddd27-kserve-router-schedczgz"
May 25 12:07:26.958975 ip-10-0-128-206 kubenswrapper[2545]: I0525 12:07:26.958927    2545 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/llmisvc4e643bc258191ffc517a31cd1d0ddd27-kserve-router-schedczgz"
May 25 12:07:27.101366 ip-10-0-128-206 kubenswrapper[2545]: I0525 12:07:27.101331    2545 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/llmisvc4e643bc258191ffc517a31cd1d0ddd27-kserve-router-schedczgz"]
May 25 12:07:27.103983 ip-10-0-128-206 kubenswrapper[2545]: W0525 12:07:27.103932    2545 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc4260983_1043_48fc_b4c8_7924e88ac806.slice/crio-e3639d1a4aff52e9779b9aece440abf4fa4b5cd78bc7d523862488a8cda66266 WatchSource:0}: Error finding container e3639d1a4aff52e9779b9aece440abf4fa4b5cd78bc7d523862488a8cda66266: Status 404 returned error can't find the container with id e3639d1a4aff52e9779b9aece440abf4fa4b5cd78bc7d523862488a8cda66266
May 25 12:07:27.105871 ip-10-0-128-206 kubenswrapper[2545]: I0525 12:07:27.105855    2545 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
May 25 12:07:27.793816 ip-10-0-128-206 kubenswrapper[2545]: I0525 12:07:27.793777    2545 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/llmisvc4e643bc258191ffc517a31cd1d0ddd27-kserve-router-schedczgz" event={"ID":"c4260983-1043-48fc-b4c8-7924e88ac806","Type":"ContainerStarted","Data":"959b147c1f3553603142c2a52ebcd4cc3bead5160a560129e0a12fa8e4c17336"}
May 25 12:07:27.793816 ip-10-0-128-206 kubenswrapper[2545]: I0525 12:07:27.793814    2545 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/llmisvc4e643bc258191ffc517a31cd1d0ddd27-kserve-router-schedczgz" event={"ID":"c4260983-1043-48fc-b4c8-7924e88ac806","Type":"ContainerStarted","Data":"e3639d1a4aff52e9779b9aece440abf4fa4b5cd78bc7d523862488a8cda66266"}
May 25 12:07:28.798403 ip-10-0-128-206 kubenswrapper[2545]: I0525 12:07:28.798363    2545 generic.go:358] "Generic (PLEG): container finished" podID="c4260983-1043-48fc-b4c8-7924e88ac806" containerID="959b147c1f3553603142c2a52ebcd4cc3bead5160a560129e0a12fa8e4c17336" exitCode=0
May 25 12:07:28.798785 ip-10-0-128-206 kubenswrapper[2545]: I0525 12:07:28.798447    2545 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/llmisvc4e643bc258191ffc517a31cd1d0ddd27-kserve-router-schedczgz" event={"ID":"c4260983-1043-48fc-b4c8-7924e88ac806","Type":"ContainerDied","Data":"959b147c1f3553603142c2a52ebcd4cc3bead5160a560129e0a12fa8e4c17336"}
May 25 12:07:29.803499 ip-10-0-128-206 kubenswrapper[2545]: I0525 12:07:29.803462    2545 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/llmisvc4e643bc258191ffc517a31cd1d0ddd27-kserve-router-schedczgz" event={"ID":"c4260983-1043-48fc-b4c8-7924e88ac806","Type":"ContainerStarted","Data":"8803624330df6501a3cee2a00af3738fe39b64f1eb6fd15ca821a7aa6c6f4dcf"}
May 25 12:07:29.803499 ip-10-0-128-206 kubenswrapper[2545]: I0525 12:07:29.803502    2545 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/llmisvc4e643bc258191ffc517a31cd1d0ddd27-kserve-router-schedczgz" event={"ID":"c4260983-1043-48fc-b4c8-7924e88ac806","Type":"ContainerStarted","Data":"4dc5ceb55284c0aab9193d97cb2c77a31c6f1918a46959f266f34123f05e0e0b"}
May 25 12:07:29.803925 ip-10-0-128-206 kubenswrapper[2545]: I0525 12:07:29.803608    2545 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/llmisvc4e643bc258191ffc517a31cd1d0ddd27-kserve-router-schedczgz"
May 25 12:07:29.835312 ip-10-0-128-206 kubenswrapper[2545]: I0525 12:07:29.835249    2545 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kserve-ci-e2e-test/llmisvc4e643bc258191ffc517a31cd1d0ddd27-kserve-router-schedczgz" podStartSLOduration=3.835230105 podStartE2EDuration="3.835230105s" podCreationTimestamp="2026-05-25 12:07:26 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-25 12:07:29.833934008 +0000 UTC m=+2641.600218954" watchObservedRunningTime="2026-05-25 12:07:29.835230105 +0000 UTC m=+2641.601515054"
May 25 12:07:36.960107 ip-10-0-128-206 kubenswrapper[2545]: I0525 12:07:36.960069    2545 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/llmisvc4e643bc258191ffc517a31cd1d0ddd27-kserve-router-schedczgz"
May 25 12:07:36.960567 ip-10-0-128-206 kubenswrapper[2545]: I0525 12:07:36.960236    2545 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kserve-ci-e2e-test/llmisvc4e643bc258191ffc517a31cd1d0ddd27-kserve-router-schedczgz"
May 25 12:07:36.962843 ip-10-0-128-206 kubenswrapper[2545]: I0525 12:07:36.962822    2545 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="kserve-ci-e2e-test/llmisvc4e643bc258191ffc517a31cd1d0ddd27-kserve-router-schedczgz"
May 25 12:07:37.830652 ip-10-0-128-206 kubenswrapper[2545]: I0525 12:07:37.830615    2545 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/llmisvc4e643bc258191ffc517a31cd1d0ddd27-kserve-router-schedczgz"
May 25 12:07:59.837569 ip-10-0-128-206 kubenswrapper[2545]: I0525 12:07:59.837533    2545 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/llmisvc4e643bc258191ffc517a31cd1d0ddd27-kserve-router-schedczgz"
May 25 12:08:28.872734 ip-10-0-128-206 kubenswrapper[2545]: I0525 12:08:28.872619    2545 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-krfmt_4e27bcd6-c257-422b-a332-0df274cf6fcc/ovn-acl-logging/0.log"
May 25 12:08:28.882970 ip-10-0-128-206 kubenswrapper[2545]: I0525 12:08:28.882938    2545 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-krfmt_4e27bcd6-c257-422b-a332-0df274cf6fcc/ovn-acl-logging/0.log"
May 25 12:13:14.637858 ip-10-0-128-206 kubenswrapper[2545]: I0525 12:13:14.637770    2545 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/llmisvc4e643bc258191ffc517a31cd1d0ddd27-kserve-router-schedczgz"]
May 25 12:13:14.638492 ip-10-0-128-206 kubenswrapper[2545]: I0525 12:13:14.638190    2545 kuberuntime_container.go:864] "Killing container with a grace period" pod="kserve-ci-e2e-test/llmisvc4e643bc258191ffc517a31cd1d0ddd27-kserve-router-schedczgz" podUID="c4260983-1043-48fc-b4c8-7924e88ac806" containerName="main" containerID="cri-o://4dc5ceb55284c0aab9193d97cb2c77a31c6f1918a46959f266f34123f05e0e0b" gracePeriod=30
May 25 12:13:14.638492 ip-10-0-128-206 kubenswrapper[2545]: I0525 12:13:14.638225    2545 kuberuntime_container.go:864] "Killing container with a grace period" pod="kserve-ci-e2e-test/llmisvc4e643bc258191ffc517a31cd1d0ddd27-kserve-router-schedczgz" podUID="c4260983-1043-48fc-b4c8-7924e88ac806" containerName="tokenizer" containerID="cri-o://8803624330df6501a3cee2a00af3738fe39b64f1eb6fd15ca821a7aa6c6f4dcf" gracePeriod=30
May 25 12:13:14.966347 ip-10-0-128-206 kubenswrapper[2545]: I0525 12:13:14.966253    2545 generic.go:358] "Generic (PLEG): container finished" podID="c4260983-1043-48fc-b4c8-7924e88ac806" containerID="4dc5ceb55284c0aab9193d97cb2c77a31c6f1918a46959f266f34123f05e0e0b" exitCode=0
May 25 12:13:14.966347 ip-10-0-128-206 kubenswrapper[2545]: I0525 12:13:14.966331    2545 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/llmisvc4e643bc258191ffc517a31cd1d0ddd27-kserve-router-schedczgz" event={"ID":"c4260983-1043-48fc-b4c8-7924e88ac806","Type":"ContainerDied","Data":"4dc5ceb55284c0aab9193d97cb2c77a31c6f1918a46959f266f34123f05e0e0b"}
May 25 12:13:15.808372 ip-10-0-128-206 kubenswrapper[2545]: I0525 12:13:15.808351    2545 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/llmisvc4e643bc258191ffc517a31cd1d0ddd27-kserve-router-schedczgz"
May 25 12:13:15.859998 ip-10-0-128-206 kubenswrapper[2545]: I0525 12:13:15.859937    2545 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"tokenizer-tmp\" (UniqueName: \"kubernetes.io/empty-dir/c4260983-1043-48fc-b4c8-7924e88ac806-tokenizer-tmp\") pod \"c4260983-1043-48fc-b4c8-7924e88ac806\" (UID: \"c4260983-1043-48fc-b4c8-7924e88ac806\") "
May 25 12:13:15.860159 ip-10-0-128-206 kubenswrapper[2545]: I0525 12:13:15.860014    2545 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"tokenizer-uds\" (UniqueName: \"kubernetes.io/empty-dir/c4260983-1043-48fc-b4c8-7924e88ac806-tokenizer-uds\") pod \"c4260983-1043-48fc-b4c8-7924e88ac806\" (UID: \"c4260983-1043-48fc-b4c8-7924e88ac806\") "
May 25 12:13:15.860159 ip-10-0-128-206 kubenswrapper[2545]: I0525 12:13:15.860071    2545 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c4260983-1043-48fc-b4c8-7924e88ac806-tls-certs\") pod \"c4260983-1043-48fc-b4c8-7924e88ac806\" (UID: \"c4260983-1043-48fc-b4c8-7924e88ac806\") "
May 25 12:13:15.860159 ip-10-0-128-206 kubenswrapper[2545]: I0525 12:13:15.860114    2545 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/c4260983-1043-48fc-b4c8-7924e88ac806-kserve-provision-location\") pod \"c4260983-1043-48fc-b4c8-7924e88ac806\" (UID: \"c4260983-1043-48fc-b4c8-7924e88ac806\") "
May 25 12:13:15.860332 ip-10-0-128-206 kubenswrapper[2545]: I0525 12:13:15.860179    2545 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"tokenizer-cache\" (UniqueName: \"kubernetes.io/empty-dir/c4260983-1043-48fc-b4c8-7924e88ac806-tokenizer-cache\") pod \"c4260983-1043-48fc-b4c8-7924e88ac806\" (UID: \"c4260983-1043-48fc-b4c8-7924e88ac806\") "
May 25 12:13:15.860332 ip-10-0-128-206 kubenswrapper[2545]: I0525 12:13:15.860263    2545 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-f95wq\" (UniqueName: \"kubernetes.io/projected/c4260983-1043-48fc-b4c8-7924e88ac806-kube-api-access-f95wq\") pod \"c4260983-1043-48fc-b4c8-7924e88ac806\" (UID: \"c4260983-1043-48fc-b4c8-7924e88ac806\") "
May 25 12:13:15.860332 ip-10-0-128-206 kubenswrapper[2545]: I0525 12:13:15.860263    2545 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c4260983-1043-48fc-b4c8-7924e88ac806-tokenizer-tmp" (OuterVolumeSpecName: "tokenizer-tmp") pod "c4260983-1043-48fc-b4c8-7924e88ac806" (UID: "c4260983-1043-48fc-b4c8-7924e88ac806"). InnerVolumeSpecName "tokenizer-tmp". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 25 12:13:15.860332 ip-10-0-128-206 kubenswrapper[2545]: I0525 12:13:15.860288    2545 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c4260983-1043-48fc-b4c8-7924e88ac806-tokenizer-uds" (OuterVolumeSpecName: "tokenizer-uds") pod "c4260983-1043-48fc-b4c8-7924e88ac806" (UID: "c4260983-1043-48fc-b4c8-7924e88ac806"). InnerVolumeSpecName "tokenizer-uds". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 25 12:13:15.860542 ip-10-0-128-206 kubenswrapper[2545]: I0525 12:13:15.860522    2545 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c4260983-1043-48fc-b4c8-7924e88ac806-tokenizer-cache" (OuterVolumeSpecName: "tokenizer-cache") pod "c4260983-1043-48fc-b4c8-7924e88ac806" (UID: "c4260983-1043-48fc-b4c8-7924e88ac806"). InnerVolumeSpecName "tokenizer-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 25 12:13:15.861002 ip-10-0-128-206 kubenswrapper[2545]: I0525 12:13:15.860657    2545 reconciler_common.go:299] "Volume detached for volume \"tokenizer-cache\" (UniqueName: \"kubernetes.io/empty-dir/c4260983-1043-48fc-b4c8-7924e88ac806-tokenizer-cache\") on node \"ip-10-0-128-206.ec2.internal\" DevicePath \"\""
May 25 12:13:15.861002 ip-10-0-128-206 kubenswrapper[2545]: I0525 12:13:15.860681    2545 reconciler_common.go:299] "Volume detached for volume \"tokenizer-tmp\" (UniqueName: \"kubernetes.io/empty-dir/c4260983-1043-48fc-b4c8-7924e88ac806-tokenizer-tmp\") on node \"ip-10-0-128-206.ec2.internal\" DevicePath \"\""
May 25 12:13:15.861002 ip-10-0-128-206 kubenswrapper[2545]: I0525 12:13:15.860697    2545 reconciler_common.go:299] "Volume detached for volume \"tokenizer-uds\" (UniqueName: \"kubernetes.io/empty-dir/c4260983-1043-48fc-b4c8-7924e88ac806-tokenizer-uds\") on node \"ip-10-0-128-206.ec2.internal\" DevicePath \"\""
May 25 12:13:15.861002 ip-10-0-128-206 kubenswrapper[2545]: I0525 12:13:15.860951    2545 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c4260983-1043-48fc-b4c8-7924e88ac806-kserve-provision-location" (OuterVolumeSpecName: "kserve-provision-location") pod "c4260983-1043-48fc-b4c8-7924e88ac806" (UID: "c4260983-1043-48fc-b4c8-7924e88ac806"). InnerVolumeSpecName "kserve-provision-location". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 25 12:13:15.862383 ip-10-0-128-206 kubenswrapper[2545]: I0525 12:13:15.862361    2545 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c4260983-1043-48fc-b4c8-7924e88ac806-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "c4260983-1043-48fc-b4c8-7924e88ac806" (UID: "c4260983-1043-48fc-b4c8-7924e88ac806"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 25 12:13:15.862760 ip-10-0-128-206 kubenswrapper[2545]: I0525 12:13:15.862740    2545 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c4260983-1043-48fc-b4c8-7924e88ac806-kube-api-access-f95wq" (OuterVolumeSpecName: "kube-api-access-f95wq") pod "c4260983-1043-48fc-b4c8-7924e88ac806" (UID: "c4260983-1043-48fc-b4c8-7924e88ac806"). InnerVolumeSpecName "kube-api-access-f95wq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 25 12:13:15.961331 ip-10-0-128-206 kubenswrapper[2545]: I0525 12:13:15.961266    2545 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-f95wq\" (UniqueName: \"kubernetes.io/projected/c4260983-1043-48fc-b4c8-7924e88ac806-kube-api-access-f95wq\") on node \"ip-10-0-128-206.ec2.internal\" DevicePath \"\""
May 25 12:13:15.961331 ip-10-0-128-206 kubenswrapper[2545]: I0525 12:13:15.961289    2545 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c4260983-1043-48fc-b4c8-7924e88ac806-tls-certs\") on node \"ip-10-0-128-206.ec2.internal\" DevicePath \"\""
May 25 12:13:15.961331 ip-10-0-128-206 kubenswrapper[2545]: I0525 12:13:15.961302    2545 reconciler_common.go:299] "Volume detached for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/c4260983-1043-48fc-b4c8-7924e88ac806-kserve-provision-location\") on node \"ip-10-0-128-206.ec2.internal\" DevicePath \"\""
May 25 12:13:15.972304 ip-10-0-128-206 kubenswrapper[2545]: I0525 12:13:15.972275    2545 generic.go:358] "Generic (PLEG): container finished" podID="c4260983-1043-48fc-b4c8-7924e88ac806" containerID="8803624330df6501a3cee2a00af3738fe39b64f1eb6fd15ca821a7aa6c6f4dcf" exitCode=0
May 25 12:13:15.972427 ip-10-0-128-206 kubenswrapper[2545]: I0525 12:13:15.972323    2545 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/llmisvc4e643bc258191ffc517a31cd1d0ddd27-kserve-router-schedczgz" event={"ID":"c4260983-1043-48fc-b4c8-7924e88ac806","Type":"ContainerDied","Data":"8803624330df6501a3cee2a00af3738fe39b64f1eb6fd15ca821a7aa6c6f4dcf"}
May 25 12:13:15.972427 ip-10-0-128-206 kubenswrapper[2545]: I0525 12:13:15.972355    2545 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/llmisvc4e643bc258191ffc517a31cd1d0ddd27-kserve-router-schedczgz"
May 25 12:13:15.972427 ip-10-0-128-206 kubenswrapper[2545]: I0525 12:13:15.972369    2545 scope.go:117] "RemoveContainer" containerID="8803624330df6501a3cee2a00af3738fe39b64f1eb6fd15ca821a7aa6c6f4dcf"
May 25 12:13:15.972542 ip-10-0-128-206 kubenswrapper[2545]: I0525 12:13:15.972357    2545 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/llmisvc4e643bc258191ffc517a31cd1d0ddd27-kserve-router-schedczgz" event={"ID":"c4260983-1043-48fc-b4c8-7924e88ac806","Type":"ContainerDied","Data":"e3639d1a4aff52e9779b9aece440abf4fa4b5cd78bc7d523862488a8cda66266"}
May 25 12:13:15.982514 ip-10-0-128-206 kubenswrapper[2545]: I0525 12:13:15.982492    2545 scope.go:117] "RemoveContainer" containerID="4dc5ceb55284c0aab9193d97cb2c77a31c6f1918a46959f266f34123f05e0e0b"
May 25 12:13:15.989527 ip-10-0-128-206 kubenswrapper[2545]: I0525 12:13:15.989513    2545 scope.go:117] "RemoveContainer" containerID="959b147c1f3553603142c2a52ebcd4cc3bead5160a560129e0a12fa8e4c17336"
May 25 12:13:15.996272 ip-10-0-128-206 kubenswrapper[2545]: I0525 12:13:15.996251    2545 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/llmisvc4e643bc258191ffc517a31cd1d0ddd27-kserve-router-schedczgz"]
May 25 12:13:15.996533 ip-10-0-128-206 kubenswrapper[2545]: I0525 12:13:15.996517    2545 scope.go:117] "RemoveContainer" containerID="8803624330df6501a3cee2a00af3738fe39b64f1eb6fd15ca821a7aa6c6f4dcf"
May 25 12:13:15.996769 ip-10-0-128-206 kubenswrapper[2545]: E0525 12:13:15.996750    2545 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8803624330df6501a3cee2a00af3738fe39b64f1eb6fd15ca821a7aa6c6f4dcf\": container with ID starting with 8803624330df6501a3cee2a00af3738fe39b64f1eb6fd15ca821a7aa6c6f4dcf not found: ID does not exist" containerID="8803624330df6501a3cee2a00af3738fe39b64f1eb6fd15ca821a7aa6c6f4dcf"
May 25 12:13:15.996838 ip-10-0-128-206 kubenswrapper[2545]: I0525 12:13:15.996777    2545 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8803624330df6501a3cee2a00af3738fe39b64f1eb6fd15ca821a7aa6c6f4dcf"} err="failed to get container status \"8803624330df6501a3cee2a00af3738fe39b64f1eb6fd15ca821a7aa6c6f4dcf\": rpc error: code = NotFound desc = could not find container \"8803624330df6501a3cee2a00af3738fe39b64f1eb6fd15ca821a7aa6c6f4dcf\": container with ID starting with 8803624330df6501a3cee2a00af3738fe39b64f1eb6fd15ca821a7aa6c6f4dcf not found: ID does not exist"
May 25 12:13:15.996838 ip-10-0-128-206 kubenswrapper[2545]: I0525 12:13:15.996801    2545 scope.go:117] "RemoveContainer" containerID="4dc5ceb55284c0aab9193d97cb2c77a31c6f1918a46959f266f34123f05e0e0b"
May 25 12:13:15.997094 ip-10-0-128-206 kubenswrapper[2545]: E0525 12:13:15.997074    2545 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4dc5ceb55284c0aab9193d97cb2c77a31c6f1918a46959f266f34123f05e0e0b\": container with ID starting with 4dc5ceb55284c0aab9193d97cb2c77a31c6f1918a46959f266f34123f05e0e0b not found: ID does not exist" containerID="4dc5ceb55284c0aab9193d97cb2c77a31c6f1918a46959f266f34123f05e0e0b"
May 25 12:13:15.997197 ip-10-0-128-206 kubenswrapper[2545]: I0525 12:13:15.997098    2545 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4dc5ceb55284c0aab9193d97cb2c77a31c6f1918a46959f266f34123f05e0e0b"} err="failed to get container status \"4dc5ceb55284c0aab9193d97cb2c77a31c6f1918a46959f266f34123f05e0e0b\": rpc error: code = NotFound desc = could not find container \"4dc5ceb55284c0aab9193d97cb2c77a31c6f1918a46959f266f34123f05e0e0b\": container with ID starting with 4dc5ceb55284c0aab9193d97cb2c77a31c6f1918a46959f266f34123f05e0e0b not found: ID does not exist"
May 25 12:13:15.997197 ip-10-0-128-206 kubenswrapper[2545]: I0525 12:13:15.997113    2545 scope.go:117] "RemoveContainer" containerID="959b147c1f3553603142c2a52ebcd4cc3bead5160a560129e0a12fa8e4c17336"
May 25 12:13:15.997370 ip-10-0-128-206 kubenswrapper[2545]: E0525 12:13:15.997344    2545 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"959b147c1f3553603142c2a52ebcd4cc3bead5160a560129e0a12fa8e4c17336\": container with ID starting with 959b147c1f3553603142c2a52ebcd4cc3bead5160a560129e0a12fa8e4c17336 not found: ID does not exist" containerID="959b147c1f3553603142c2a52ebcd4cc3bead5160a560129e0a12fa8e4c17336"
May 25 12:13:15.997424 ip-10-0-128-206 kubenswrapper[2545]: I0525 12:13:15.997380    2545 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"959b147c1f3553603142c2a52ebcd4cc3bead5160a560129e0a12fa8e4c17336"} err="failed to get container status \"959b147c1f3553603142c2a52ebcd4cc3bead5160a560129e0a12fa8e4c17336\": rpc error: code = NotFound desc = could not find container \"959b147c1f3553603142c2a52ebcd4cc3bead5160a560129e0a12fa8e4c17336\": container with ID starting with 959b147c1f3553603142c2a52ebcd4cc3bead5160a560129e0a12fa8e4c17336 not found: ID does not exist"
May 25 12:13:16.005326 ip-10-0-128-206 kubenswrapper[2545]: I0525 12:13:16.003557    2545 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/llmisvc4e643bc258191ffc517a31cd1d0ddd27-kserve-router-schedczgz"]
May 25 12:13:16.774818 ip-10-0-128-206 kubenswrapper[2545]: I0525 12:13:16.774783    2545 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c4260983-1043-48fc-b4c8-7924e88ac806" path="/var/lib/kubelet/pods/c4260983-1043-48fc-b4c8-7924e88ac806/volumes"
May 25 12:13:28.895810 ip-10-0-128-206 kubenswrapper[2545]: I0525 12:13:28.895692    2545 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-krfmt_4e27bcd6-c257-422b-a332-0df274cf6fcc/ovn-acl-logging/0.log"
May 25 12:13:28.907139 ip-10-0-128-206 kubenswrapper[2545]: I0525 12:13:28.907113    2545 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-krfmt_4e27bcd6-c257-422b-a332-0df274cf6fcc/ovn-acl-logging/0.log"
May 25 12:13:46.758973 ip-10-0-128-206 kubenswrapper[2545]: I0525 12:13:46.758915    2545 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-57dd85bb4-v6rrw_3b60dce9-0ee6-439b-ac2b-9f58afb192ad/manager/0.log"
May 25 12:13:46.768902 ip-10-0-128-206 kubenswrapper[2545]: I0525 12:13:46.768879    2545 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-67566c68b4-ts9hg_f4dc404f-a9c2-4816-a1ff-20a38b91b340/limitador/0.log"
May 25 12:13:51.652440 ip-10-0-128-206 kubenswrapper[2545]: I0525 12:13:51.652399    2545 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-49lh6_47e25bdd-612b-46e8-87d2-0f25c52e5509/global-pull-secret-syncer/0.log"
May 25 12:13:51.786397 ip-10-0-128-206 kubenswrapper[2545]: I0525 12:13:51.786369    2545 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-k89nm_cc9f9059-2f19-464a-86c2-c8ec5ed6c010/konnectivity-agent/0.log"
May 25 12:13:51.840061 ip-10-0-128-206 kubenswrapper[2545]: I0525 12:13:51.840024    2545 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-128-206.ec2.internal_a6772c4d9844f0928036a579dcf5d882/haproxy/0.log"
May 25 12:13:55.897232 ip-10-0-128-206 kubenswrapper[2545]: I0525 12:13:55.897198    2545 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-57dd85bb4-v6rrw_3b60dce9-0ee6-439b-ac2b-9f58afb192ad/manager/0.log"
May 25 12:13:55.923924 ip-10-0-128-206 kubenswrapper[2545]: I0525 12:13:55.923847    2545 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-67566c68b4-ts9hg_f4dc404f-a9c2-4816-a1ff-20a38b91b340/limitador/0.log"
May 25 12:13:57.192231 ip-10-0-128-206 kubenswrapper[2545]: I0525 12:13:57.192139    2545 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-6c75959455-zg7q8_65aceb42-dd6c-4b1f-8eab-c38f414063dd/cluster-monitoring-operator/0.log"
May 25 12:13:57.218340 ip-10-0-128-206 kubenswrapper[2545]: I0525 12:13:57.218313    2545 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-54fd6bc5c4-nw692_055f66f3-871f-4b06-aacb-a6eddb624423/kube-state-metrics/0.log"
May 25 12:13:57.233039 ip-10-0-128-206 kubenswrapper[2545]: I0525 12:13:57.233017    2545 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-54fd6bc5c4-nw692_055f66f3-871f-4b06-aacb-a6eddb624423/kube-rbac-proxy-main/0.log"
May 25 12:13:57.251946 ip-10-0-128-206 kubenswrapper[2545]: I0525 12:13:57.251923    2545 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-54fd6bc5c4-nw692_055f66f3-871f-4b06-aacb-a6eddb624423/kube-rbac-proxy-self/0.log"
May 25 12:13:57.275294 ip-10-0-128-206 kubenswrapper[2545]: I0525 12:13:57.275268    2545 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-78dd8f8c95-dz85t_15ef2bca-b153-42db-bdb7-b063d94f451f/metrics-server/0.log"
May 25 12:13:57.295438 ip-10-0-128-206 kubenswrapper[2545]: I0525 12:13:57.295414    2545 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-665c9c8584-zw2xk_3a4ac090-6c16-4c7c-8fc4-63f07c1f3695/monitoring-plugin/0.log"
May 25 12:13:57.488755 ip-10-0-128-206 kubenswrapper[2545]: I0525 12:13:57.488724    2545 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-xm9xm_29d23f19-1174-4990-a3d9-37d0b761beab/node-exporter/0.log"
May 25 12:13:57.507004 ip-10-0-128-206 kubenswrapper[2545]: I0525 12:13:57.506985    2545 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-xm9xm_29d23f19-1174-4990-a3d9-37d0b761beab/kube-rbac-proxy/0.log"
May 25 12:13:57.525707 ip-10-0-128-206 kubenswrapper[2545]: I0525 12:13:57.525687    2545 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-xm9xm_29d23f19-1174-4990-a3d9-37d0b761beab/init-textfile/0.log"
May 25 12:13:57.557500 ip-10-0-128-206 kubenswrapper[2545]: I0525 12:13:57.557470    2545 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-9c959559f-9rfsh_3d4a2ede-835d-41bb-b345-66f853f58ad7/kube-rbac-proxy-main/0.log"
May 25 12:13:57.582868 ip-10-0-128-206 kubenswrapper[2545]: I0525 12:13:57.582848    2545 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-9c959559f-9rfsh_3d4a2ede-835d-41bb-b345-66f853f58ad7/kube-rbac-proxy-self/0.log"
May 25 12:13:57.603229 ip-10-0-128-206 kubenswrapper[2545]: I0525 12:13:57.603206    2545 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-9c959559f-9rfsh_3d4a2ede-835d-41bb-b345-66f853f58ad7/openshift-state-metrics/0.log"
May 25 12:13:57.648891 ip-10-0-128-206 kubenswrapper[2545]: I0525 12:13:57.648868    2545 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_d91fabd5-f2de-469d-a280-f16e253bff1f/prometheus/0.log"
May 25 12:13:57.669230 ip-10-0-128-206 kubenswrapper[2545]: I0525 12:13:57.669200    2545 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_d91fabd5-f2de-469d-a280-f16e253bff1f/config-reloader/0.log"
May 25 12:13:57.688441 ip-10-0-128-206 kubenswrapper[2545]: I0525 12:13:57.688420    2545 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_d91fabd5-f2de-469d-a280-f16e253bff1f/thanos-sidecar/0.log"
May 25 12:13:57.708036 ip-10-0-128-206 kubenswrapper[2545]: I0525 12:13:57.708016    2545 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_d91fabd5-f2de-469d-a280-f16e253bff1f/kube-rbac-proxy-web/0.log"
May 25 12:13:57.729923 ip-10-0-128-206 kubenswrapper[2545]: I0525 12:13:57.729898    2545 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_d91fabd5-f2de-469d-a280-f16e253bff1f/kube-rbac-proxy/0.log"
May 25 12:13:57.756718 ip-10-0-128-206 kubenswrapper[2545]: I0525 12:13:57.756646    2545 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_d91fabd5-f2de-469d-a280-f16e253bff1f/kube-rbac-proxy-thanos/0.log"
May 25 12:13:57.774794 ip-10-0-128-206 kubenswrapper[2545]: I0525 12:13:57.774776    2545 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_d91fabd5-f2de-469d-a280-f16e253bff1f/init-config-reloader/0.log"
May 25 12:13:58.001717 ip-10-0-128-206 kubenswrapper[2545]: I0525 12:13:58.001682    2545 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-557d9f868-8t7zm_17182e04-8c7b-42af-bf81-6388aae24602/thanos-query/0.log"
May 25 12:13:58.027299 ip-10-0-128-206 kubenswrapper[2545]: I0525 12:13:58.027278    2545 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-557d9f868-8t7zm_17182e04-8c7b-42af-bf81-6388aae24602/kube-rbac-proxy-web/0.log"
May 25 12:13:58.051904 ip-10-0-128-206 kubenswrapper[2545]: I0525 12:13:58.051879    2545 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-557d9f868-8t7zm_17182e04-8c7b-42af-bf81-6388aae24602/kube-rbac-proxy/0.log"
May 25 12:13:58.074880 ip-10-0-128-206 kubenswrapper[2545]: I0525 12:13:58.074854    2545 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-557d9f868-8t7zm_17182e04-8c7b-42af-bf81-6388aae24602/prom-label-proxy/0.log"
May 25 12:13:58.096922 ip-10-0-128-206 kubenswrapper[2545]: I0525 12:13:58.096889    2545 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-557d9f868-8t7zm_17182e04-8c7b-42af-bf81-6388aae24602/kube-rbac-proxy-rules/0.log"
May 25 12:13:58.120861 ip-10-0-128-206 kubenswrapper[2545]: I0525 12:13:58.120837    2545 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-557d9f868-8t7zm_17182e04-8c7b-42af-bf81-6388aae24602/kube-rbac-proxy-metrics/0.log"
May 25 12:13:59.311475 ip-10-0-128-206 kubenswrapper[2545]: I0525 12:13:59.311447    2545 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-d4d8f94f9-9j55l_80a7105d-5b9e-4230-8a58-4f0802e6d8a8/networking-console-plugin/0.log"
May 25 12:14:00.601918 ip-10-0-128-206 kubenswrapper[2545]: I0525 12:14:00.601883    2545 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-must-gather-w6vp7/perf-node-gather-daemonset-g89hf"]
May 25 12:14:00.602415 ip-10-0-128-206 kubenswrapper[2545]: I0525 12:14:00.602264    2545 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c4260983-1043-48fc-b4c8-7924e88ac806" containerName="storage-initializer"
May 25 12:14:00.602415 ip-10-0-128-206 kubenswrapper[2545]: I0525 12:14:00.602276    2545 state_mem.go:107] "Deleted CPUSet assignment" podUID="c4260983-1043-48fc-b4c8-7924e88ac806" containerName="storage-initializer"
May 25 12:14:00.602415 ip-10-0-128-206 kubenswrapper[2545]: I0525 12:14:00.602284    2545 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c4260983-1043-48fc-b4c8-7924e88ac806" containerName="tokenizer"
May 25 12:14:00.602415 ip-10-0-128-206 kubenswrapper[2545]: I0525 12:14:00.602289    2545 state_mem.go:107] "Deleted CPUSet assignment" podUID="c4260983-1043-48fc-b4c8-7924e88ac806" containerName="tokenizer"
May 25 12:14:00.602415 ip-10-0-128-206 kubenswrapper[2545]: I0525 12:14:00.602299    2545 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c4260983-1043-48fc-b4c8-7924e88ac806" containerName="main"
May 25 12:14:00.602415 ip-10-0-128-206 kubenswrapper[2545]: I0525 12:14:00.602304    2545 state_mem.go:107] "Deleted CPUSet assignment" podUID="c4260983-1043-48fc-b4c8-7924e88ac806" containerName="main"
May 25 12:14:00.602415 ip-10-0-128-206 kubenswrapper[2545]: I0525 12:14:00.602356    2545 memory_manager.go:356] "RemoveStaleState removing state" podUID="c4260983-1043-48fc-b4c8-7924e88ac806" containerName="main"
May 25 12:14:00.602415 ip-10-0-128-206 kubenswrapper[2545]: I0525 12:14:00.602365    2545 memory_manager.go:356] "RemoveStaleState removing state" podUID="c4260983-1043-48fc-b4c8-7924e88ac806" containerName="tokenizer"
May 25 12:14:00.605429 ip-10-0-128-206 kubenswrapper[2545]: I0525 12:14:00.605413    2545 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-w6vp7/perf-node-gather-daemonset-g89hf"
May 25 12:14:00.613534 ip-10-0-128-206 kubenswrapper[2545]: I0525 12:14:00.613518    2545 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-w6vp7\"/\"kube-root-ca.crt\""
May 25 12:14:00.614186 ip-10-0-128-206 kubenswrapper[2545]: I0525 12:14:00.614168    2545 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-w6vp7\"/\"openshift-service-ca.crt\""
May 25 12:14:00.616924 ip-10-0-128-206 kubenswrapper[2545]: I0525 12:14:00.616910    2545 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-w6vp7\"/\"default-dockercfg-fw7vm\""
May 25 12:14:00.635195 ip-10-0-128-206 kubenswrapper[2545]: I0525 12:14:00.635171    2545 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-w6vp7/perf-node-gather-daemonset-g89hf"]
May 25 12:14:00.643855 ip-10-0-128-206 kubenswrapper[2545]: I0525 12:14:00.643834    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/a3ddbdc4-d227-4ec7-82f1-febab836444b-proc\") pod \"perf-node-gather-daemonset-g89hf\" (UID: \"a3ddbdc4-d227-4ec7-82f1-febab836444b\") " pod="openshift-must-gather-w6vp7/perf-node-gather-daemonset-g89hf"
May 25 12:14:00.643994 ip-10-0-128-206 kubenswrapper[2545]: I0525 12:14:00.643870    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/a3ddbdc4-d227-4ec7-82f1-febab836444b-podres\") pod \"perf-node-gather-daemonset-g89hf\" (UID: \"a3ddbdc4-d227-4ec7-82f1-febab836444b\") " pod="openshift-must-gather-w6vp7/perf-node-gather-daemonset-g89hf"
May 25 12:14:00.644062 ip-10-0-128-206 kubenswrapper[2545]: I0525 12:14:00.644001    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/a3ddbdc4-d227-4ec7-82f1-febab836444b-lib-modules\") pod \"perf-node-gather-daemonset-g89hf\" (UID: \"a3ddbdc4-d227-4ec7-82f1-febab836444b\") " pod="openshift-must-gather-w6vp7/perf-node-gather-daemonset-g89hf"
May 25 12:14:00.644120 ip-10-0-128-206 kubenswrapper[2545]: I0525 12:14:00.644066    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a3ddbdc4-d227-4ec7-82f1-febab836444b-sys\") pod \"perf-node-gather-daemonset-g89hf\" (UID: \"a3ddbdc4-d227-4ec7-82f1-febab836444b\") " pod="openshift-must-gather-w6vp7/perf-node-gather-daemonset-g89hf"
May 25 12:14:00.644120 ip-10-0-128-206 kubenswrapper[2545]: I0525 12:14:00.644098    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jjwwh\" (UniqueName: \"kubernetes.io/projected/a3ddbdc4-d227-4ec7-82f1-febab836444b-kube-api-access-jjwwh\") pod \"perf-node-gather-daemonset-g89hf\" (UID: \"a3ddbdc4-d227-4ec7-82f1-febab836444b\") " pod="openshift-must-gather-w6vp7/perf-node-gather-daemonset-g89hf"
May 25 12:14:00.744688 ip-10-0-128-206 kubenswrapper[2545]: I0525 12:14:00.744654    2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/a3ddbdc4-d227-4ec7-82f1-febab836444b-lib-modules\") pod \"perf-node-gather-daemonset-g89hf\" (UID: \"a3ddbdc4-d227-4ec7-82f1-febab836444b\") " pod="openshift-must-gather-w6vp7/perf-node-gather-daemonset-g89hf"
May 25 12:14:00.744871 ip-10-0-128-206 kubenswrapper[2545]: I0525 12:14:00.744718    2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a3ddbdc4-d227-4ec7-82f1-febab836444b-sys\") pod \"perf-node-gather-daemonset-g89hf\" (UID: \"a3ddbdc4-d227-4ec7-82f1-febab836444b\") " pod="openshift-must-gather-w6vp7/perf-node-gather-daemonset-g89hf"
May 25 12:14:00.744871 ip-10-0-128-206 kubenswrapper[2545]: I0525 12:14:00.744751    2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-jjwwh\" (UniqueName: \"kubernetes.io/projected/a3ddbdc4-d227-4ec7-82f1-febab836444b-kube-api-access-jjwwh\") pod \"perf-node-gather-daemonset-g89hf\" (UID: \"a3ddbdc4-d227-4ec7-82f1-febab836444b\") " pod="openshift-must-gather-w6vp7/perf-node-gather-daemonset-g89hf"
May 25 12:14:00.744871 ip-10-0-128-206 kubenswrapper[2545]: I0525 12:14:00.744785    2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/a3ddbdc4-d227-4ec7-82f1-febab836444b-proc\") pod \"perf-node-gather-daemonset-g89hf\" (UID: \"a3ddbdc4-d227-4ec7-82f1-febab836444b\") " pod="openshift-must-gather-w6vp7/perf-node-gather-daemonset-g89hf"
May 25 12:14:00.744871 ip-10-0-128-206 kubenswrapper[2545]: I0525 12:14:00.744792    2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/a3ddbdc4-d227-4ec7-82f1-febab836444b-lib-modules\") pod \"perf-node-gather-daemonset-g89hf\" (UID: \"a3ddbdc4-d227-4ec7-82f1-febab836444b\") " pod="openshift-must-gather-w6vp7/perf-node-gather-daemonset-g89hf"
May 25 12:14:00.744871 ip-10-0-128-206 kubenswrapper[2545]: I0525 12:14:00.744817    2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/a3ddbdc4-d227-4ec7-82f1-febab836444b-podres\") pod \"perf-node-gather-daemonset-g89hf\" (UID: \"a3ddbdc4-d227-4ec7-82f1-febab836444b\") " pod="openshift-must-gather-w6vp7/perf-node-gather-daemonset-g89hf"
May 25 12:14:00.744871 ip-10-0-128-206 kubenswrapper[2545]: I0525 12:14:00.744824    2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a3ddbdc4-d227-4ec7-82f1-febab836444b-sys\") pod \"perf-node-gather-daemonset-g89hf\" (UID: \"a3ddbdc4-d227-4ec7-82f1-febab836444b\") " pod="openshift-must-gather-w6vp7/perf-node-gather-daemonset-g89hf"
May 25 12:14:00.745135 ip-10-0-128-206 kubenswrapper[2545]: I0525 12:14:00.744877    2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/a3ddbdc4-d227-4ec7-82f1-febab836444b-proc\") pod \"perf-node-gather-daemonset-g89hf\" (UID: \"a3ddbdc4-d227-4ec7-82f1-febab836444b\") " pod="openshift-must-gather-w6vp7/perf-node-gather-daemonset-g89hf"
May 25 12:14:00.745135 ip-10-0-128-206 kubenswrapper[2545]: I0525 12:14:00.744987    2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/a3ddbdc4-d227-4ec7-82f1-febab836444b-podres\") pod \"perf-node-gather-daemonset-g89hf\" (UID: \"a3ddbdc4-d227-4ec7-82f1-febab836444b\") " pod="openshift-must-gather-w6vp7/perf-node-gather-daemonset-g89hf"
May 25 12:14:00.755282 ip-10-0-128-206 kubenswrapper[2545]: I0525 12:14:00.755260    2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jjwwh\" (UniqueName: \"kubernetes.io/projected/a3ddbdc4-d227-4ec7-82f1-febab836444b-kube-api-access-jjwwh\") pod \"perf-node-gather-daemonset-g89hf\" (UID: \"a3ddbdc4-d227-4ec7-82f1-febab836444b\") " pod="openshift-must-gather-w6vp7/perf-node-gather-daemonset-g89hf"
May 25 12:14:00.915063 ip-10-0-128-206 kubenswrapper[2545]: I0525 12:14:00.914922    2545 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-w6vp7/perf-node-gather-daemonset-g89hf"
May 25 12:14:00.916305 ip-10-0-128-206 kubenswrapper[2545]: I0525 12:14:00.916282    2545 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-5cf8c89d64-8ht7l_a4aca2db-3982-449b-9179-425094d3501d/volume-data-source-validator/0.log"
May 25 12:14:01.045088 ip-10-0-128-206 kubenswrapper[2545]: I0525 12:14:01.045063    2545 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-w6vp7/perf-node-gather-daemonset-g89hf"]
May 25 12:14:01.047746 ip-10-0-128-206 kubenswrapper[2545]: W0525 12:14:01.047705    2545 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-poda3ddbdc4_d227_4ec7_82f1_febab836444b.slice/crio-7fb6b159af8e83fbab142894595d6be3789fea0d7a8f79dfc4a477f44eac3b0d WatchSource:0}: Error finding container 7fb6b159af8e83fbab142894595d6be3789fea0d7a8f79dfc4a477f44eac3b0d: Status 404 returned error can't find the container with id 7fb6b159af8e83fbab142894595d6be3789fea0d7a8f79dfc4a477f44eac3b0d
May 25 12:14:01.049284 ip-10-0-128-206 kubenswrapper[2545]: I0525 12:14:01.049269    2545 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
May 25 12:14:01.122897 ip-10-0-128-206 kubenswrapper[2545]: I0525 12:14:01.122859    2545 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-w6vp7/perf-node-gather-daemonset-g89hf" event={"ID":"a3ddbdc4-d227-4ec7-82f1-febab836444b","Type":"ContainerStarted","Data":"7fb6b159af8e83fbab142894595d6be3789fea0d7a8f79dfc4a477f44eac3b0d"}
May 25 12:14:01.644408 ip-10-0-128-206 kubenswrapper[2545]: I0525 12:14:01.644379    2545 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-hzp8b_06d7f51c-471c-4691-a24a-2c5729f0560a/dns/0.log"
May 25 12:14:01.662337 ip-10-0-128-206 kubenswrapper[2545]: I0525 12:14:01.662310    2545 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-hzp8b_06d7f51c-471c-4691-a24a-2c5729f0560a/kube-rbac-proxy/0.log"
May 25 12:14:01.782551 ip-10-0-128-206 kubenswrapper[2545]: I0525 12:14:01.782522    2545 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-nkmp2_f692c3e7-6b4e-443a-a334-88792f73d9d6/dns-node-resolver/0.log"
May 25 12:14:02.128515 ip-10-0-128-206 kubenswrapper[2545]: I0525 12:14:02.128479    2545 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-w6vp7/perf-node-gather-daemonset-g89hf" event={"ID":"a3ddbdc4-d227-4ec7-82f1-febab836444b","Type":"ContainerStarted","Data":"6a71d6a5e59fc46e866333791fae9e83ca487b7afba75b0b672b718515dfd5db"}
May 25 12:14:02.128665 ip-10-0-128-206 kubenswrapper[2545]: I0525 12:14:02.128579    2545 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-w6vp7/perf-node-gather-daemonset-g89hf"
May 25 12:14:02.352655 ip-10-0-128-206 kubenswrapper[2545]: I0525 12:14:02.352625    2545 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-296nq_803d9bd1-2b5f-451c-a4da-817e22be6c56/node-ca/0.log"
May 25 12:14:03.821866 ip-10-0-128-206 kubenswrapper[2545]: I0525 12:14:03.821827    2545 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-54rns_52c3a045-c0fc-41d6-b253-f96682889610/serve-healthcheck-canary/0.log"
May 25 12:14:04.392783 ip-10-0-128-206 kubenswrapper[2545]: I0525 12:14:04.392753    2545 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-78bdfb888c-xd89p_516a1b71-e17b-4035-987c-116abe33a4f8/insights-operator/0.log"
May 25 12:14:04.395399 ip-10-0-128-206 kubenswrapper[2545]: I0525 12:14:04.395379    2545 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-78bdfb888c-xd89p_516a1b71-e17b-4035-987c-116abe33a4f8/insights-operator/1.log"
May 25 12:14:04.475581 ip-10-0-128-206 kubenswrapper[2545]: I0525 12:14:04.475552    2545 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-b6j58_3103b499-c1d8-4b1f-be59-285c04f3098a/kube-rbac-proxy/0.log"
May 25 12:14:04.492640 ip-10-0-128-206 kubenswrapper[2545]: I0525 12:14:04.492617    2545 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-b6j58_3103b499-c1d8-4b1f-be59-285c04f3098a/exporter/0.log"
May 25 12:14:04.510183 ip-10-0-128-206 kubenswrapper[2545]: I0525 12:14:04.510156    2545 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-b6j58_3103b499-c1d8-4b1f-be59-285c04f3098a/extractor/0.log"
May 25 12:14:07.182913 ip-10-0-128-206 kubenswrapper[2545]: I0525 12:14:07.182872    2545 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-8646484d7f-qnpwr_8afc5e54-3254-46c1-b952-a63f6ec47c41/manager/0.log"
May 25 12:14:07.806320 ip-10-0-128-206 kubenswrapper[2545]: I0525 12:14:07.806288    2545 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve_llmisvc-controller-manager-69548c8666-v2mfl_db761a67-f204-4c60-ac43-2bb30c43dde8/manager/0.log"
May 25 12:14:08.141381 ip-10-0-128-206 kubenswrapper[2545]: I0525 12:14:08.141300    2545 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-w6vp7/perf-node-gather-daemonset-g89hf"
May 25 12:14:08.160890 ip-10-0-128-206 kubenswrapper[2545]: I0525 12:14:08.160843    2545 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-must-gather-w6vp7/perf-node-gather-daemonset-g89hf" podStartSLOduration=8.160828197 podStartE2EDuration="8.160828197s" podCreationTimestamp="2026-05-25 12:14:00 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-25 12:14:02.155012758 +0000 UTC m=+3033.921297707" watchObservedRunningTime="2026-05-25 12:14:08.160828197 +0000 UTC m=+3039.927113188"
May 25 12:14:12.739420 ip-10-0-128-206 kubenswrapper[2545]: I0525 12:14:12.739356    2545 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-b985f5d89-l7hq8_e96f7c44-a3a2-4ef6-bd44-7049837dc7cd/migrator/0.log"
May 25 12:14:12.756701 ip-10-0-128-206 kubenswrapper[2545]: I0525 12:14:12.756677    2545 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-b985f5d89-l7hq8_e96f7c44-a3a2-4ef6-bd44-7049837dc7cd/graceful-termination/0.log"
May 25 12:14:14.202024 ip-10-0-128-206 kubenswrapper[2545]: I0525 12:14:14.201998    2545 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-cgxtl_0e95b3fe-d141-4227-80df-1b6f63fc89db/kube-multus-additional-cni-plugins/0.log"
May 25 12:14:14.221441 ip-10-0-128-206 kubenswrapper[2545]: I0525 12:14:14.221411    2545 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-cgxtl_0e95b3fe-d141-4227-80df-1b6f63fc89db/egress-router-binary-copy/0.log"
May 25 12:14:14.240461 ip-10-0-128-206 kubenswrapper[2545]: I0525 12:14:14.240440    2545 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-cgxtl_0e95b3fe-d141-4227-80df-1b6f63fc89db/cni-plugins/0.log"
May 25 12:14:14.260480 ip-10-0-128-206 kubenswrapper[2545]: I0525 12:14:14.260448    2545 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-cgxtl_0e95b3fe-d141-4227-80df-1b6f63fc89db/bond-cni-plugin/0.log"
May 25 12:14:14.278867 ip-10-0-128-206 kubenswrapper[2545]: I0525 12:14:14.278844    2545 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-cgxtl_0e95b3fe-d141-4227-80df-1b6f63fc89db/routeoverride-cni/0.log"
May 25 12:14:14.295731 ip-10-0-128-206 kubenswrapper[2545]: I0525 12:14:14.295710    2545 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-cgxtl_0e95b3fe-d141-4227-80df-1b6f63fc89db/whereabouts-cni-bincopy/0.log"
May 25 12:14:14.313268 ip-10-0-128-206 kubenswrapper[2545]: I0525 12:14:14.313245    2545 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-cgxtl_0e95b3fe-d141-4227-80df-1b6f63fc89db/whereabouts-cni/0.log"
May 25 12:14:14.508522 ip-10-0-128-206 kubenswrapper[2545]: I0525 12:14:14.508495    2545 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-mppq2_8d3be6d2-efff-4793-9082-593746afd78c/kube-multus/0.log"
May 25 12:14:14.598450 ip-10-0-128-206 kubenswrapper[2545]: I0525 12:14:14.598422    2545 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-cvfxv_3872d4b9-e2c4-40ab-8fee-706d08118a88/network-metrics-daemon/0.log"
May 25 12:14:14.615971 ip-10-0-128-206 kubenswrapper[2545]: I0525 12:14:14.615936    2545 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-cvfxv_3872d4b9-e2c4-40ab-8fee-706d08118a88/kube-rbac-proxy/0.log"
May 25 12:14:15.444664 ip-10-0-128-206 kubenswrapper[2545]: I0525 12:14:15.444632    2545 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-krfmt_4e27bcd6-c257-422b-a332-0df274cf6fcc/ovn-controller/0.log"
May 25 12:14:15.461348 ip-10-0-128-206 kubenswrapper[2545]: I0525 12:14:15.461314    2545 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-krfmt_4e27bcd6-c257-422b-a332-0df274cf6fcc/ovn-acl-logging/0.log"
May 25 12:14:15.487702 ip-10-0-128-206 kubenswrapper[2545]: I0525 12:14:15.487673    2545 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-krfmt_4e27bcd6-c257-422b-a332-0df274cf6fcc/ovn-acl-logging/1.log"
May 25 12:14:15.507581 ip-10-0-128-206 kubenswrapper[2545]: I0525 12:14:15.507561    2545 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-krfmt_4e27bcd6-c257-422b-a332-0df274cf6fcc/kube-rbac-proxy-node/0.log"
May 25 12:14:15.532647 ip-10-0-128-206 kubenswrapper[2545]: I0525 12:14:15.532627    2545 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-krfmt_4e27bcd6-c257-422b-a332-0df274cf6fcc/kube-rbac-proxy-ovn-metrics/0.log"
May 25 12:14:15.552135 ip-10-0-128-206 kubenswrapper[2545]: I0525 12:14:15.552116    2545 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-krfmt_4e27bcd6-c257-422b-a332-0df274cf6fcc/northd/0.log"
May 25 12:14:15.571875 ip-10-0-128-206 kubenswrapper[2545]: I0525 12:14:15.571854    2545 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-krfmt_4e27bcd6-c257-422b-a332-0df274cf6fcc/nbdb/0.log"
May 25 12:14:15.590412 ip-10-0-128-206 kubenswrapper[2545]: I0525 12:14:15.590394    2545 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-krfmt_4e27bcd6-c257-422b-a332-0df274cf6fcc/sbdb/0.log"
May 25 12:14:15.759381 ip-10-0-128-206 kubenswrapper[2545]: I0525 12:14:15.759352    2545 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-krfmt_4e27bcd6-c257-422b-a332-0df274cf6fcc/ovnkube-controller/0.log"
May 25 12:14:17.538810 ip-10-0-128-206 kubenswrapper[2545]: I0525 12:14:17.538781    2545 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-diagnostics_network-check-target-vnft7_36dcd564-65d2-4f2e-82d7-8c8af53ca015/network-check-target-container/0.log"