May 28 10:02:43.778959 ip-10-0-128-206 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory
May 28 10:02:43.778971 ip-10-0-128-206 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory
May 28 10:02:43.778978 ip-10-0-128-206 systemd[1]: kubelet.service: Failed with result 'resources'.
May 28 10:02:43.779266 ip-10-0-128-206 systemd[1]: Failed to start Kubernetes Kubelet.
May 28 10:02:53.947146 ip-10-0-128-206 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found.
May 28 10:02:53.947168 ip-10-0-128-206 systemd[1]: kubelet.service: Failed with result 'resources'.
-- Boot 6629b06ba1c445da91e4c601798a1731 --
May 28 10:05:14.402643 ip-10-0-128-206 systemd[1]: Starting Kubernetes Kubelet...
May 28 10:05:14.899554 ip-10-0-128-206 kubenswrapper[2565]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
May 28 10:05:14.899554 ip-10-0-128-206 kubenswrapper[2565]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
May 28 10:05:14.899554 ip-10-0-128-206 kubenswrapper[2565]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
May 28 10:05:14.899554 ip-10-0-128-206 kubenswrapper[2565]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
May 28 10:05:14.899554 ip-10-0-128-206 kubenswrapper[2565]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
May 28 10:05:14.901565 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:14.901442    2565 server.go:212] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
May 28 10:05:14.905022 ip-10-0-128-206 kubenswrapper[2565]: W0528 10:05:14.905004    2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
May 28 10:05:14.905022 ip-10-0-128-206 kubenswrapper[2565]: W0528 10:05:14.905020    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
May 28 10:05:14.905022 ip-10-0-128-206 kubenswrapper[2565]: W0528 10:05:14.905027    2565 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS
May 28 10:05:14.905221 ip-10-0-128-206 kubenswrapper[2565]: W0528 10:05:14.905032    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
May 28 10:05:14.905221 ip-10-0-128-206 kubenswrapper[2565]: W0528 10:05:14.905037    2565 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
May 28 10:05:14.905221 ip-10-0-128-206 kubenswrapper[2565]: W0528 10:05:14.905041    2565 feature_gate.go:328] unrecognized feature gate: SignatureStores
May 28 10:05:14.905221 ip-10-0-128-206 kubenswrapper[2565]: W0528 10:05:14.905047    2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
May 28 10:05:14.905221 ip-10-0-128-206 kubenswrapper[2565]: W0528 10:05:14.905051    2565 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
May 28 10:05:14.905221 ip-10-0-128-206 kubenswrapper[2565]: W0528 10:05:14.905055    2565 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
May 28 10:05:14.905221 ip-10-0-128-206 kubenswrapper[2565]: W0528 10:05:14.905061    2565 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
May 28 10:05:14.905221 ip-10-0-128-206 kubenswrapper[2565]: W0528 10:05:14.905066    2565 feature_gate.go:328] unrecognized feature gate: NewOLM
May 28 10:05:14.905221 ip-10-0-128-206 kubenswrapper[2565]: W0528 10:05:14.905071    2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
May 28 10:05:14.905221 ip-10-0-128-206 kubenswrapper[2565]: W0528 10:05:14.905075    2565 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
May 28 10:05:14.905221 ip-10-0-128-206 kubenswrapper[2565]: W0528 10:05:14.905079    2565 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
May 28 10:05:14.905221 ip-10-0-128-206 kubenswrapper[2565]: W0528 10:05:14.905083    2565 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
May 28 10:05:14.905221 ip-10-0-128-206 kubenswrapper[2565]: W0528 10:05:14.905087    2565 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations
May 28 10:05:14.905221 ip-10-0-128-206 kubenswrapper[2565]: W0528 10:05:14.905091    2565 feature_gate.go:328] unrecognized feature gate: DualReplica
May 28 10:05:14.905221 ip-10-0-128-206 kubenswrapper[2565]: W0528 10:05:14.905095    2565 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
May 28 10:05:14.905221 ip-10-0-128-206 kubenswrapper[2565]: W0528 10:05:14.905098    2565 feature_gate.go:328] unrecognized feature gate: PinnedImages
May 28 10:05:14.905221 ip-10-0-128-206 kubenswrapper[2565]: W0528 10:05:14.905102    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPI
May 28 10:05:14.905221 ip-10-0-128-206 kubenswrapper[2565]: W0528 10:05:14.905106    2565 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
May 28 10:05:14.905221 ip-10-0-128-206 kubenswrapper[2565]: W0528 10:05:14.905109    2565 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
May 28 10:05:14.906005 ip-10-0-128-206 kubenswrapper[2565]: W0528 10:05:14.905118    2565 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
May 28 10:05:14.906005 ip-10-0-128-206 kubenswrapper[2565]: W0528 10:05:14.905123    2565 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
May 28 10:05:14.906005 ip-10-0-128-206 kubenswrapper[2565]: W0528 10:05:14.905127    2565 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
May 28 10:05:14.906005 ip-10-0-128-206 kubenswrapper[2565]: W0528 10:05:14.905131    2565 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
May 28 10:05:14.906005 ip-10-0-128-206 kubenswrapper[2565]: W0528 10:05:14.905135    2565 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
May 28 10:05:14.906005 ip-10-0-128-206 kubenswrapper[2565]: W0528 10:05:14.905139    2565 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
May 28 10:05:14.906005 ip-10-0-128-206 kubenswrapper[2565]: W0528 10:05:14.905143    2565 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
May 28 10:05:14.906005 ip-10-0-128-206 kubenswrapper[2565]: W0528 10:05:14.905146    2565 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
May 28 10:05:14.906005 ip-10-0-128-206 kubenswrapper[2565]: W0528 10:05:14.905151    2565 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
May 28 10:05:14.906005 ip-10-0-128-206 kubenswrapper[2565]: W0528 10:05:14.905155    2565 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
May 28 10:05:14.906005 ip-10-0-128-206 kubenswrapper[2565]: W0528 10:05:14.905159    2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
May 28 10:05:14.906005 ip-10-0-128-206 kubenswrapper[2565]: W0528 10:05:14.905163    2565 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
May 28 10:05:14.906005 ip-10-0-128-206 kubenswrapper[2565]: W0528 10:05:14.905167    2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
May 28 10:05:14.906005 ip-10-0-128-206 kubenswrapper[2565]: W0528 10:05:14.905171    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
May 28 10:05:14.906005 ip-10-0-128-206 kubenswrapper[2565]: W0528 10:05:14.905175    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
May 28 10:05:14.906005 ip-10-0-128-206 kubenswrapper[2565]: W0528 10:05:14.905179    2565 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
May 28 10:05:14.906005 ip-10-0-128-206 kubenswrapper[2565]: W0528 10:05:14.905184    2565 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
May 28 10:05:14.906005 ip-10-0-128-206 kubenswrapper[2565]: W0528 10:05:14.905189    2565 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
May 28 10:05:14.906005 ip-10-0-128-206 kubenswrapper[2565]: W0528 10:05:14.905194    2565 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI
May 28 10:05:14.906005 ip-10-0-128-206 kubenswrapper[2565]: W0528 10:05:14.905198    2565 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
May 28 10:05:14.906776 ip-10-0-128-206 kubenswrapper[2565]: W0528 10:05:14.905202    2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
May 28 10:05:14.906776 ip-10-0-128-206 kubenswrapper[2565]: W0528 10:05:14.905206    2565 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
May 28 10:05:14.906776 ip-10-0-128-206 kubenswrapper[2565]: W0528 10:05:14.905210    2565 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
May 28 10:05:14.906776 ip-10-0-128-206 kubenswrapper[2565]: W0528 10:05:14.905214    2565 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
May 28 10:05:14.906776 ip-10-0-128-206 kubenswrapper[2565]: W0528 10:05:14.905218    2565 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
May 28 10:05:14.906776 ip-10-0-128-206 kubenswrapper[2565]: W0528 10:05:14.905222    2565 feature_gate.go:328] unrecognized feature gate: InsightsConfig
May 28 10:05:14.906776 ip-10-0-128-206 kubenswrapper[2565]: W0528 10:05:14.905226    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
May 28 10:05:14.906776 ip-10-0-128-206 kubenswrapper[2565]: W0528 10:05:14.905230    2565 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
May 28 10:05:14.906776 ip-10-0-128-206 kubenswrapper[2565]: W0528 10:05:14.905234    2565 feature_gate.go:328] unrecognized feature gate: Example
May 28 10:05:14.906776 ip-10-0-128-206 kubenswrapper[2565]: W0528 10:05:14.905238    2565 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
May 28 10:05:14.906776 ip-10-0-128-206 kubenswrapper[2565]: W0528 10:05:14.905242    2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
May 28 10:05:14.906776 ip-10-0-128-206 kubenswrapper[2565]: W0528 10:05:14.905247    2565 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
May 28 10:05:14.906776 ip-10-0-128-206 kubenswrapper[2565]: W0528 10:05:14.905251    2565 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
May 28 10:05:14.906776 ip-10-0-128-206 kubenswrapper[2565]: W0528 10:05:14.905255    2565 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
May 28 10:05:14.906776 ip-10-0-128-206 kubenswrapper[2565]: W0528 10:05:14.905259    2565 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
May 28 10:05:14.906776 ip-10-0-128-206 kubenswrapper[2565]: W0528 10:05:14.905264    2565 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
May 28 10:05:14.906776 ip-10-0-128-206 kubenswrapper[2565]: W0528 10:05:14.905268    2565 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
May 28 10:05:14.906776 ip-10-0-128-206 kubenswrapper[2565]: W0528 10:05:14.905273    2565 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
May 28 10:05:14.906776 ip-10-0-128-206 kubenswrapper[2565]: W0528 10:05:14.905277    2565 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
May 28 10:05:14.906776 ip-10-0-128-206 kubenswrapper[2565]: W0528 10:05:14.905281    2565 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
May 28 10:05:14.907257 ip-10-0-128-206 kubenswrapper[2565]: W0528 10:05:14.905285    2565 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
May 28 10:05:14.907257 ip-10-0-128-206 kubenswrapper[2565]: W0528 10:05:14.905289    2565 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController
May 28 10:05:14.907257 ip-10-0-128-206 kubenswrapper[2565]: W0528 10:05:14.905293    2565 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
May 28 10:05:14.907257 ip-10-0-128-206 kubenswrapper[2565]: W0528 10:05:14.905297    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
May 28 10:05:14.907257 ip-10-0-128-206 kubenswrapper[2565]: W0528 10:05:14.905301    2565 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
May 28 10:05:14.907257 ip-10-0-128-206 kubenswrapper[2565]: W0528 10:05:14.905305    2565 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
May 28 10:05:14.907257 ip-10-0-128-206 kubenswrapper[2565]: W0528 10:05:14.905327    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
May 28 10:05:14.907257 ip-10-0-128-206 kubenswrapper[2565]: W0528 10:05:14.905331    2565 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
May 28 10:05:14.907257 ip-10-0-128-206 kubenswrapper[2565]: W0528 10:05:14.905335    2565 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
May 28 10:05:14.907257 ip-10-0-128-206 kubenswrapper[2565]: W0528 10:05:14.905339    2565 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
May 28 10:05:14.907257 ip-10-0-128-206 kubenswrapper[2565]: W0528 10:05:14.905344    2565 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
May 28 10:05:14.907257 ip-10-0-128-206 kubenswrapper[2565]: W0528 10:05:14.905348    2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
May 28 10:05:14.907257 ip-10-0-128-206 kubenswrapper[2565]: W0528 10:05:14.905354    2565 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
May 28 10:05:14.907257 ip-10-0-128-206 kubenswrapper[2565]: W0528 10:05:14.905359    2565 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
May 28 10:05:14.907257 ip-10-0-128-206 kubenswrapper[2565]: W0528 10:05:14.905363    2565 feature_gate.go:328] unrecognized feature gate: Example2
May 28 10:05:14.907257 ip-10-0-128-206 kubenswrapper[2565]: W0528 10:05:14.905367    2565 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
May 28 10:05:14.907257 ip-10-0-128-206 kubenswrapper[2565]: W0528 10:05:14.905371    2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
May 28 10:05:14.907257 ip-10-0-128-206 kubenswrapper[2565]: W0528 10:05:14.905376    2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
May 28 10:05:14.907257 ip-10-0-128-206 kubenswrapper[2565]: W0528 10:05:14.905380    2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
May 28 10:05:14.907754 ip-10-0-128-206 kubenswrapper[2565]: W0528 10:05:14.905384    2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
May 28 10:05:14.907754 ip-10-0-128-206 kubenswrapper[2565]: W0528 10:05:14.905389    2565 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
May 28 10:05:14.907754 ip-10-0-128-206 kubenswrapper[2565]: W0528 10:05:14.905393    2565 feature_gate.go:328] unrecognized feature gate: OVNObservability
May 28 10:05:14.907754 ip-10-0-128-206 kubenswrapper[2565]: W0528 10:05:14.905402    2565 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
May 28 10:05:14.907754 ip-10-0-128-206 kubenswrapper[2565]: W0528 10:05:14.905410    2565 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
May 28 10:05:14.907754 ip-10-0-128-206 kubenswrapper[2565]: W0528 10:05:14.906030    2565 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
May 28 10:05:14.907754 ip-10-0-128-206 kubenswrapper[2565]: W0528 10:05:14.906039    2565 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
May 28 10:05:14.907754 ip-10-0-128-206 kubenswrapper[2565]: W0528 10:05:14.906043    2565 feature_gate.go:328] unrecognized feature gate: Example
May 28 10:05:14.907754 ip-10-0-128-206 kubenswrapper[2565]: W0528 10:05:14.906048    2565 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
May 28 10:05:14.907754 ip-10-0-128-206 kubenswrapper[2565]: W0528 10:05:14.906054    2565 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
May 28 10:05:14.907754 ip-10-0-128-206 kubenswrapper[2565]: W0528 10:05:14.906058    2565 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
May 28 10:05:14.907754 ip-10-0-128-206 kubenswrapper[2565]: W0528 10:05:14.906062    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPI
May 28 10:05:14.907754 ip-10-0-128-206 kubenswrapper[2565]: W0528 10:05:14.906066    2565 feature_gate.go:328] unrecognized feature gate: SignatureStores
May 28 10:05:14.907754 ip-10-0-128-206 kubenswrapper[2565]: W0528 10:05:14.906070    2565 feature_gate.go:328] unrecognized feature gate: InsightsConfig
May 28 10:05:14.907754 ip-10-0-128-206 kubenswrapper[2565]: W0528 10:05:14.906074    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
May 28 10:05:14.907754 ip-10-0-128-206 kubenswrapper[2565]: W0528 10:05:14.906078    2565 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
May 28 10:05:14.907754 ip-10-0-128-206 kubenswrapper[2565]: W0528 10:05:14.906082    2565 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
May 28 10:05:14.907754 ip-10-0-128-206 kubenswrapper[2565]: W0528 10:05:14.906086    2565 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
May 28 10:05:14.907754 ip-10-0-128-206 kubenswrapper[2565]: W0528 10:05:14.906090    2565 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
May 28 10:05:14.907754 ip-10-0-128-206 kubenswrapper[2565]: W0528 10:05:14.906096    2565 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
May 28 10:05:14.908564 ip-10-0-128-206 kubenswrapper[2565]: W0528 10:05:14.906102    2565 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
May 28 10:05:14.908564 ip-10-0-128-206 kubenswrapper[2565]: W0528 10:05:14.906106    2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
May 28 10:05:14.908564 ip-10-0-128-206 kubenswrapper[2565]: W0528 10:05:14.906110    2565 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
May 28 10:05:14.908564 ip-10-0-128-206 kubenswrapper[2565]: W0528 10:05:14.906115    2565 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
May 28 10:05:14.908564 ip-10-0-128-206 kubenswrapper[2565]: W0528 10:05:14.906119    2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
May 28 10:05:14.908564 ip-10-0-128-206 kubenswrapper[2565]: W0528 10:05:14.906124    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
May 28 10:05:14.908564 ip-10-0-128-206 kubenswrapper[2565]: W0528 10:05:14.906128    2565 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
May 28 10:05:14.908564 ip-10-0-128-206 kubenswrapper[2565]: W0528 10:05:14.906132    2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
May 28 10:05:14.908564 ip-10-0-128-206 kubenswrapper[2565]: W0528 10:05:14.906136    2565 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
May 28 10:05:14.908564 ip-10-0-128-206 kubenswrapper[2565]: W0528 10:05:14.906140    2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
May 28 10:05:14.908564 ip-10-0-128-206 kubenswrapper[2565]: W0528 10:05:14.906144    2565 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
May 28 10:05:14.908564 ip-10-0-128-206 kubenswrapper[2565]: W0528 10:05:14.906148    2565 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
May 28 10:05:14.908564 ip-10-0-128-206 kubenswrapper[2565]: W0528 10:05:14.906153    2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
May 28 10:05:14.908564 ip-10-0-128-206 kubenswrapper[2565]: W0528 10:05:14.906157    2565 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations
May 28 10:05:14.908564 ip-10-0-128-206 kubenswrapper[2565]: W0528 10:05:14.906163    2565 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
May 28 10:05:14.908564 ip-10-0-128-206 kubenswrapper[2565]: W0528 10:05:14.906168    2565 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
May 28 10:05:14.908564 ip-10-0-128-206 kubenswrapper[2565]: W0528 10:05:14.906172    2565 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS
May 28 10:05:14.908564 ip-10-0-128-206 kubenswrapper[2565]: W0528 10:05:14.906176    2565 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
May 28 10:05:14.908564 ip-10-0-128-206 kubenswrapper[2565]: W0528 10:05:14.906180    2565 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
May 28 10:05:14.908564 ip-10-0-128-206 kubenswrapper[2565]: W0528 10:05:14.906184    2565 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
May 28 10:05:14.909435 ip-10-0-128-206 kubenswrapper[2565]: W0528 10:05:14.906189    2565 feature_gate.go:328] unrecognized feature gate: Example2
May 28 10:05:14.909435 ip-10-0-128-206 kubenswrapper[2565]: W0528 10:05:14.906194    2565 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
May 28 10:05:14.909435 ip-10-0-128-206 kubenswrapper[2565]: W0528 10:05:14.906198    2565 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
May 28 10:05:14.909435 ip-10-0-128-206 kubenswrapper[2565]: W0528 10:05:14.906202    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
May 28 10:05:14.909435 ip-10-0-128-206 kubenswrapper[2565]: W0528 10:05:14.906206    2565 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
May 28 10:05:14.909435 ip-10-0-128-206 kubenswrapper[2565]: W0528 10:05:14.906210    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
May 28 10:05:14.909435 ip-10-0-128-206 kubenswrapper[2565]: W0528 10:05:14.906214    2565 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
May 28 10:05:14.909435 ip-10-0-128-206 kubenswrapper[2565]: W0528 10:05:14.906218    2565 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
May 28 10:05:14.909435 ip-10-0-128-206 kubenswrapper[2565]: W0528 10:05:14.906223    2565 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
May 28 10:05:14.909435 ip-10-0-128-206 kubenswrapper[2565]: W0528 10:05:14.906228    2565 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
May 28 10:05:14.909435 ip-10-0-128-206 kubenswrapper[2565]: W0528 10:05:14.906232    2565 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
May 28 10:05:14.909435 ip-10-0-128-206 kubenswrapper[2565]: W0528 10:05:14.906236    2565 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
May 28 10:05:14.909435 ip-10-0-128-206 kubenswrapper[2565]: W0528 10:05:14.906240    2565 feature_gate.go:328] unrecognized feature gate: NewOLM
May 28 10:05:14.909435 ip-10-0-128-206 kubenswrapper[2565]: W0528 10:05:14.906244    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
May 28 10:05:14.909435 ip-10-0-128-206 kubenswrapper[2565]: W0528 10:05:14.906248    2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
May 28 10:05:14.909435 ip-10-0-128-206 kubenswrapper[2565]: W0528 10:05:14.906253    2565 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
May 28 10:05:14.909435 ip-10-0-128-206 kubenswrapper[2565]: W0528 10:05:14.906258    2565 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
May 28 10:05:14.909435 ip-10-0-128-206 kubenswrapper[2565]: W0528 10:05:14.906262    2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
May 28 10:05:14.909435 ip-10-0-128-206 kubenswrapper[2565]: W0528 10:05:14.906267    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
May 28 10:05:14.909435 ip-10-0-128-206 kubenswrapper[2565]: W0528 10:05:14.906271    2565 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
May 28 10:05:14.910051 ip-10-0-128-206 kubenswrapper[2565]: W0528 10:05:14.906276    2565 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
May 28 10:05:14.910051 ip-10-0-128-206 kubenswrapper[2565]: W0528 10:05:14.906280    2565 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
May 28 10:05:14.910051 ip-10-0-128-206 kubenswrapper[2565]: W0528 10:05:14.906284    2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
May 28 10:05:14.910051 ip-10-0-128-206 kubenswrapper[2565]: W0528 10:05:14.906291    2565 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
May 28 10:05:14.910051 ip-10-0-128-206 kubenswrapper[2565]: W0528 10:05:14.906297    2565 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController
May 28 10:05:14.910051 ip-10-0-128-206 kubenswrapper[2565]: W0528 10:05:14.906301    2565 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
May 28 10:05:14.910051 ip-10-0-128-206 kubenswrapper[2565]: W0528 10:05:14.906306    2565 feature_gate.go:328] unrecognized feature gate: PinnedImages
May 28 10:05:14.910051 ip-10-0-128-206 kubenswrapper[2565]: W0528 10:05:14.906332    2565 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
May 28 10:05:14.910051 ip-10-0-128-206 kubenswrapper[2565]: W0528 10:05:14.906337    2565 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI
May 28 10:05:14.910051 ip-10-0-128-206 kubenswrapper[2565]: W0528 10:05:14.906342    2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
May 28 10:05:14.910051 ip-10-0-128-206 kubenswrapper[2565]: W0528 10:05:14.906346    2565 feature_gate.go:328] unrecognized feature gate: DualReplica
May 28 10:05:14.910051 ip-10-0-128-206 kubenswrapper[2565]: W0528 10:05:14.906351    2565 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
May 28 10:05:14.910051 ip-10-0-128-206 kubenswrapper[2565]: W0528 10:05:14.906356    2565 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
May 28 10:05:14.910051 ip-10-0-128-206 kubenswrapper[2565]: W0528 10:05:14.906359    2565 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
May 28 10:05:14.910051 ip-10-0-128-206 kubenswrapper[2565]: W0528 10:05:14.906365    2565 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
May 28 10:05:14.910051 ip-10-0-128-206 kubenswrapper[2565]: W0528 10:05:14.906369    2565 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
May 28 10:05:14.910051 ip-10-0-128-206 kubenswrapper[2565]: W0528 10:05:14.906373    2565 feature_gate.go:328] unrecognized feature gate: OVNObservability
May 28 10:05:14.910051 ip-10-0-128-206 kubenswrapper[2565]: W0528 10:05:14.906378    2565 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
May 28 10:05:14.910051 ip-10-0-128-206 kubenswrapper[2565]: W0528 10:05:14.906382    2565 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
May 28 10:05:14.910051 ip-10-0-128-206 kubenswrapper[2565]: W0528 10:05:14.906386    2565 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
May 28 10:05:14.910728 ip-10-0-128-206 kubenswrapper[2565]: W0528 10:05:14.906390    2565 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
May 28 10:05:14.910728 ip-10-0-128-206 kubenswrapper[2565]: W0528 10:05:14.906394    2565 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
May 28 10:05:14.910728 ip-10-0-128-206 kubenswrapper[2565]: W0528 10:05:14.906398    2565 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
May 28 10:05:14.910728 ip-10-0-128-206 kubenswrapper[2565]: W0528 10:05:14.906402    2565 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
May 28 10:05:14.910728 ip-10-0-128-206 kubenswrapper[2565]: W0528 10:05:14.906407    2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
May 28 10:05:14.910728 ip-10-0-128-206 kubenswrapper[2565]: W0528 10:05:14.906411    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
May 28 10:05:14.910728 ip-10-0-128-206 kubenswrapper[2565]: W0528 10:05:14.906415    2565 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
May 28 10:05:14.910728 ip-10-0-128-206 kubenswrapper[2565]: W0528 10:05:14.906419    2565 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
May 28 10:05:14.910728 ip-10-0-128-206 kubenswrapper[2565]: W0528 10:05:14.906423    2565 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
May 28 10:05:14.910728 ip-10-0-128-206 kubenswrapper[2565]: W0528 10:05:14.906427    2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
May 28 10:05:14.910728 ip-10-0-128-206 kubenswrapper[2565]: W0528 10:05:14.906431    2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
May 28 10:05:14.910728 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:14.907850    2565 flags.go:64] FLAG: --address="0.0.0.0"
May 28 10:05:14.910728 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:14.907866    2565 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
May 28 10:05:14.910728 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:14.907876    2565 flags.go:64] FLAG: --anonymous-auth="true"
May 28 10:05:14.910728 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:14.907883    2565 flags.go:64] FLAG: --application-metrics-count-limit="100"
May 28 10:05:14.910728 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:14.907890    2565 flags.go:64] FLAG: --authentication-token-webhook="false"
May 28 10:05:14.910728 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:14.907895    2565 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
May 28 10:05:14.910728 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:14.907902    2565 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
May 28 10:05:14.910728 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:14.907910    2565 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
May 28 10:05:14.910728 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:14.907915    2565 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
May 28 10:05:14.910728 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:14.907920    2565 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
May 28 10:05:14.911238 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:14.907926    2565 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
May 28 10:05:14.911238 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:14.907931    2565 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
May 28 10:05:14.911238 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:14.907937    2565 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
May 28 10:05:14.911238 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:14.907942    2565 flags.go:64] FLAG: --cgroup-root=""
May 28 10:05:14.911238 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:14.907947    2565 flags.go:64] FLAG: --cgroups-per-qos="true"
May 28 10:05:14.911238 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:14.907952    2565 flags.go:64] FLAG: --client-ca-file=""
May 28 10:05:14.911238 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:14.907957    2565 flags.go:64] FLAG: --cloud-config=""
May 28 10:05:14.911238 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:14.907961    2565 flags.go:64] FLAG: --cloud-provider="external"
May 28 10:05:14.911238 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:14.907966    2565 flags.go:64] FLAG: --cluster-dns="[]"
May 28 10:05:14.911238 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:14.907974    2565 flags.go:64] FLAG: --cluster-domain=""
May 28 10:05:14.911238 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:14.907980    2565 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
May 28 10:05:14.911238 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:14.907985    2565 flags.go:64] FLAG: --config-dir=""
May 28 10:05:14.911238 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:14.907990    2565 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
May 28 10:05:14.911238 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:14.907995    2565 flags.go:64] FLAG: --container-log-max-files="5"
May 28 10:05:14.911238 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:14.908002    2565 flags.go:64] FLAG: --container-log-max-size="10Mi"
May 28 10:05:14.911238 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:14.908007    2565 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
May 28 10:05:14.911238 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:14.908012    2565 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
May 28 10:05:14.911238 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:14.908017    2565 flags.go:64] FLAG: --containerd-namespace="k8s.io"
May 28 10:05:14.911238 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:14.908023    2565 flags.go:64] FLAG: --contention-profiling="false"
May 28 10:05:14.911238 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:14.908028    2565 flags.go:64] FLAG: --cpu-cfs-quota="true"
May 28 10:05:14.911238 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:14.908033    2565 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
May 28 10:05:14.911238 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:14.908038    2565 flags.go:64] FLAG: --cpu-manager-policy="none"
May 28 10:05:14.911238 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:14.908043    2565 flags.go:64] FLAG: --cpu-manager-policy-options=""
May 28 10:05:14.911238 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:14.908050    2565 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
May 28 10:05:14.911238 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:14.908055    2565 flags.go:64] FLAG: --enable-controller-attach-detach="true"
May 28 10:05:14.911948 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:14.908060    2565 flags.go:64] FLAG: --enable-debugging-handlers="true"
May 28 10:05:14.911948 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:14.908065    2565 flags.go:64] FLAG: --enable-load-reader="false"
May 28 10:05:14.911948 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:14.908070    2565 flags.go:64] FLAG: --enable-server="true"
May 28 10:05:14.911948 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:14.908075    2565 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
May 28 10:05:14.911948 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:14.908082    2565 flags.go:64] FLAG: --event-burst="100"
May 28 10:05:14.911948 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:14.908088    2565 flags.go:64] FLAG: --event-qps="50"
May 28 10:05:14.911948 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:14.908092    2565 flags.go:64] FLAG: --event-storage-age-limit="default=0"
May 28 10:05:14.911948 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:14.908098    2565 flags.go:64] FLAG: --event-storage-event-limit="default=0"
May 28 10:05:14.911948 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:14.908103    2565 flags.go:64] FLAG: --eviction-hard=""
May 28 10:05:14.911948 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:14.908109    2565 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
May 28 10:05:14.911948 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:14.908114    2565 flags.go:64] FLAG: --eviction-minimum-reclaim=""
May 28 10:05:14.911948 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:14.908119    2565 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
May 28 10:05:14.911948 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:14.908124    2565 flags.go:64] FLAG: --eviction-soft=""
May 28 10:05:14.911948 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:14.908128    2565 flags.go:64] FLAG: --eviction-soft-grace-period=""
May 28 10:05:14.911948 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:14.908133    2565 flags.go:64] FLAG: --exit-on-lock-contention="false"
May 28 10:05:14.911948 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:14.908139    2565 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
May 28 10:05:14.911948 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:14.908143    2565 flags.go:64] FLAG: --experimental-mounter-path=""
May 28 10:05:14.911948 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:14.908148    2565 flags.go:64] FLAG: --fail-cgroupv1="false"
May 28 10:05:14.911948 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:14.908153    2565 flags.go:64] FLAG: --fail-swap-on="true"
May 28 10:05:14.911948 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:14.908157    2565 flags.go:64] FLAG: --feature-gates=""
May 28 10:05:14.911948 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:14.908164    2565 flags.go:64] FLAG: --file-check-frequency="20s"
May 28 10:05:14.911948 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:14.908169    2565 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
May 28 10:05:14.911948 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:14.908174    2565 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
May 28 10:05:14.911948 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:14.908179    2565 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
May 28 10:05:14.911948 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:14.908184    2565 flags.go:64] FLAG: --healthz-port="10248"
May 28 10:05:14.911948 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:14.908189    2565 flags.go:64] FLAG: --help="false"
May 28 10:05:14.912579 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:14.908194    2565 flags.go:64] FLAG: --hostname-override="ip-10-0-128-206.ec2.internal"
May 28 10:05:14.912579 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:14.908199    2565 flags.go:64] FLAG: --housekeeping-interval="10s"
May 28 10:05:14.912579 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:14.908205    2565 flags.go:64] FLAG: --http-check-frequency="20s"
May 28 10:05:14.912579 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:14.908210    2565 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
May 28 10:05:14.912579 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:14.908216    2565 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
May 28 10:05:14.912579 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:14.908223    2565 flags.go:64] FLAG: --image-gc-high-threshold="85"
May 28 10:05:14.912579 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:14.908228    2565 flags.go:64] FLAG: --image-gc-low-threshold="80"
May 28 10:05:14.912579 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:14.908233    2565 flags.go:64] FLAG: --image-service-endpoint=""
May 28 10:05:14.912579 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:14.908238    2565 flags.go:64] FLAG: --kernel-memcg-notification="false"
May 28 10:05:14.912579 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:14.908242    2565 flags.go:64] FLAG: --kube-api-burst="100"
May 28 10:05:14.912579 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:14.908247    2565 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
May 28 10:05:14.912579 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:14.908252    2565 flags.go:64] FLAG: --kube-api-qps="50"
May 28 10:05:14.912579 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:14.908257    2565 flags.go:64] FLAG: --kube-reserved=""
May 28 10:05:14.912579 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:14.908262    2565 flags.go:64] FLAG: --kube-reserved-cgroup=""
May 28 10:05:14.912579 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:14.908267    2565 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
May 28 10:05:14.912579 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:14.908272    2565 flags.go:64] FLAG: --kubelet-cgroups=""
May 28 10:05:14.912579 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:14.908277    2565 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
May 28 10:05:14.912579 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:14.908281    2565 flags.go:64] FLAG: --lock-file=""
May 28 10:05:14.912579 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:14.908286    2565 flags.go:64] FLAG: --log-cadvisor-usage="false"
May 28 10:05:14.912579 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:14.908291    2565 flags.go:64] FLAG: --log-flush-frequency="5s"
May 28 10:05:14.912579 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:14.908296    2565 flags.go:64] FLAG: --log-json-info-buffer-size="0"
May 28 10:05:14.912579 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:14.908305    2565 flags.go:64] FLAG: --log-json-split-stream="false"
May 28 10:05:14.912579 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:14.908330    2565 flags.go:64] FLAG: --log-text-info-buffer-size="0"
May 28 10:05:14.913133 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:14.908335    2565 flags.go:64] FLAG: --log-text-split-stream="false"
May 28 10:05:14.913133 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:14.908339    2565 flags.go:64] FLAG: --logging-format="text"
May 28 10:05:14.913133 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:14.908344    2565 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
May 28 10:05:14.913133 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:14.908349    2565 flags.go:64] FLAG: --make-iptables-util-chains="true"
May 28 10:05:14.913133 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:14.908354    2565 flags.go:64] FLAG: --manifest-url=""
May 28 10:05:14.913133 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:14.908358    2565 flags.go:64] FLAG: --manifest-url-header=""
May 28 10:05:14.913133 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:14.908365    2565 flags.go:64] FLAG: --max-housekeeping-interval="15s"
May 28 10:05:14.913133 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:14.908370    2565 flags.go:64] FLAG: --max-open-files="1000000"
May 28 10:05:14.913133 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:14.908376    2565 flags.go:64] FLAG: --max-pods="110"
May 28 10:05:14.913133 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:14.908381    2565 flags.go:64] FLAG: --maximum-dead-containers="-1"
May 28 10:05:14.913133 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:14.908386    2565 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
May 28 10:05:14.913133 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:14.908391    2565 flags.go:64] FLAG: --memory-manager-policy="None"
May 28 10:05:14.913133 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:14.908396    2565 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
May 28 10:05:14.913133 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:14.908400    2565 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
May 28 10:05:14.913133 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:14.908405    2565 flags.go:64] FLAG: --node-ip="0.0.0.0"
May 28 10:05:14.913133 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:14.908418    2565 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
May 28 10:05:14.913133 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:14.908430    2565 flags.go:64] FLAG: --node-status-max-images="50"
May 28 10:05:14.913133 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:14.908435    2565 flags.go:64] FLAG: --node-status-update-frequency="10s"
May 28 10:05:14.913133 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:14.908440    2565 flags.go:64] FLAG: --oom-score-adj="-999"
May 28 10:05:14.913133 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:14.908445    2565 flags.go:64] FLAG: --pod-cidr=""
May 28 10:05:14.913133 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:14.908449    2565 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:afe88671bf163c42b467d159dc6f0b784dbe28b1ed44e171edc9c06fd99cc6fc"
May 28 10:05:14.913133 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:14.908459    2565 flags.go:64] FLAG: --pod-manifest-path=""
May 28 10:05:14.913133 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:14.908463    2565 flags.go:64] FLAG: --pod-max-pids="-1"
May 28 10:05:14.913133 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:14.908468    2565 flags.go:64] FLAG: --pods-per-core="0"
May 28 10:05:14.913741 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:14.908473    2565 flags.go:64] FLAG: --port="10250"
May 28 10:05:14.913741 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:14.908478    2565 flags.go:64] FLAG: --protect-kernel-defaults="false"
May 28 10:05:14.913741 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:14.908482    2565 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-02ff3e2fe64aadc89"
May 28 10:05:14.913741 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:14.908488    2565 flags.go:64] FLAG: --qos-reserved=""
May 28 10:05:14.913741 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:14.908492    2565 flags.go:64] FLAG: --read-only-port="10255"
May 28 10:05:14.913741 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:14.908497    2565 flags.go:64] FLAG: --register-node="true"
May 28 10:05:14.913741 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:14.908502    2565 flags.go:64] FLAG: --register-schedulable="true"
May 28 10:05:14.913741 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:14.908507    2565 flags.go:64] FLAG: --register-with-taints=""
May 28 10:05:14.913741 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:14.908512    2565 flags.go:64] FLAG: --registry-burst="10"
May 28 10:05:14.913741 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:14.908517    2565 flags.go:64] FLAG: --registry-qps="5"
May 28 10:05:14.913741 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:14.908521    2565 flags.go:64] FLAG: --reserved-cpus=""
May 28 10:05:14.913741 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:14.908526    2565 flags.go:64] FLAG: --reserved-memory=""
May 28 10:05:14.913741 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:14.908532    2565 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
May 28 10:05:14.913741 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:14.908537    2565 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
May 28 10:05:14.913741 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:14.908541    2565 flags.go:64] FLAG: --rotate-certificates="false"
May 28 10:05:14.913741 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:14.908546    2565 flags.go:64] FLAG: --rotate-server-certificates="false"
May 28 10:05:14.913741 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:14.908550    2565 flags.go:64] FLAG: --runonce="false"
May 28 10:05:14.913741 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:14.908555    2565 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
May 28 10:05:14.913741 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:14.908560    2565 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
May 28 10:05:14.913741 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:14.908568    2565 flags.go:64] FLAG: --seccomp-default="false"
May 28 10:05:14.913741 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:14.908572    2565 flags.go:64] FLAG: --serialize-image-pulls="true"
May 28 10:05:14.913741 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:14.908577    2565 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
May 28 10:05:14.913741 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:14.908582    2565 flags.go:64] FLAG: --storage-driver-db="cadvisor"
May 28 10:05:14.913741 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:14.908587    2565 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
May 28 10:05:14.913741 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:14.908593    2565 flags.go:64] FLAG: --storage-driver-password="root"
May 28 10:05:14.913741 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:14.908598    2565 flags.go:64] FLAG: --storage-driver-secure="false"
May 28 10:05:14.914396 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:14.908604    2565 flags.go:64] FLAG: --storage-driver-table="stats"
May 28 10:05:14.914396 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:14.908608    2565 flags.go:64] FLAG: --storage-driver-user="root"
May 28 10:05:14.914396 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:14.908613    2565 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
May 28 10:05:14.914396 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:14.908619    2565 flags.go:64] FLAG: --sync-frequency="1m0s"
May 28 10:05:14.914396 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:14.908623    2565 flags.go:64] FLAG: --system-cgroups=""
May 28 10:05:14.914396 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:14.908628    2565 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
May 28 10:05:14.914396 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:14.908637    2565 flags.go:64] FLAG: --system-reserved-cgroup=""
May 28 10:05:14.914396 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:14.908642    2565 flags.go:64] FLAG: --tls-cert-file=""
May 28 10:05:14.914396 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:14.908647    2565 flags.go:64] FLAG: --tls-cipher-suites="[]"
May 28 10:05:14.914396 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:14.908654    2565 flags.go:64] FLAG: --tls-min-version=""
May 28 10:05:14.914396 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:14.908659    2565 flags.go:64] FLAG: --tls-private-key-file=""
May 28 10:05:14.914396 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:14.908663    2565 flags.go:64] FLAG: --topology-manager-policy="none"
May 28 10:05:14.914396 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:14.908668    2565 flags.go:64] FLAG: --topology-manager-policy-options=""
May 28 10:05:14.914396 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:14.908673    2565 flags.go:64] FLAG: --topology-manager-scope="container"
May 28 10:05:14.914396 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:14.908678    2565 flags.go:64] FLAG: --v="2"
May 28 10:05:14.914396 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:14.908685    2565 flags.go:64] FLAG: --version="false"
May 28 10:05:14.914396 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:14.908692    2565 flags.go:64] FLAG: --vmodule=""
May 28 10:05:14.914396 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:14.908698    2565 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
May 28 10:05:14.914396 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:14.908704    2565 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
May 28 10:05:14.914396 ip-10-0-128-206 kubenswrapper[2565]: W0528 10:05:14.908886    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
May 28 10:05:14.914396 ip-10-0-128-206 kubenswrapper[2565]: W0528 10:05:14.908893    2565 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
May 28 10:05:14.914396 ip-10-0-128-206 kubenswrapper[2565]: W0528 10:05:14.908898    2565 feature_gate.go:328] unrecognized feature gate: Example
May 28 10:05:14.914396 ip-10-0-128-206 kubenswrapper[2565]: W0528 10:05:14.908904    2565 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
May 28 10:05:14.914396 ip-10-0-128-206 kubenswrapper[2565]: W0528 10:05:14.908909    2565 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
May 28 10:05:14.915020 ip-10-0-128-206 kubenswrapper[2565]: W0528 10:05:14.908913    2565 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
May 28 10:05:14.915020 ip-10-0-128-206 kubenswrapper[2565]: W0528 10:05:14.908919    2565 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
May 28 10:05:14.915020 ip-10-0-128-206 kubenswrapper[2565]: W0528 10:05:14.908932    2565 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
May 28 10:05:14.915020 ip-10-0-128-206 kubenswrapper[2565]: W0528 10:05:14.908937    2565 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
May 28 10:05:14.915020 ip-10-0-128-206 kubenswrapper[2565]: W0528 10:05:14.908941    2565 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
May 28 10:05:14.915020 ip-10-0-128-206 kubenswrapper[2565]: W0528 10:05:14.908946    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
May 28 10:05:14.915020 ip-10-0-128-206 kubenswrapper[2565]: W0528 10:05:14.908949    2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
May 28 10:05:14.915020 ip-10-0-128-206 kubenswrapper[2565]: W0528 10:05:14.908958    2565 feature_gate.go:328] unrecognized feature gate: PinnedImages
May 28 10:05:14.915020 ip-10-0-128-206 kubenswrapper[2565]: W0528 10:05:14.908963    2565 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
May 28 10:05:14.915020 ip-10-0-128-206 kubenswrapper[2565]: W0528 10:05:14.908968    2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
May 28 10:05:14.915020 ip-10-0-128-206 kubenswrapper[2565]: W0528 10:05:14.908972    2565 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
May 28 10:05:14.915020 ip-10-0-128-206 kubenswrapper[2565]: W0528 10:05:14.908977    2565 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
May 28 10:05:14.915020 ip-10-0-128-206 kubenswrapper[2565]: W0528 10:05:14.908981    2565 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
May 28 10:05:14.915020 ip-10-0-128-206 kubenswrapper[2565]: W0528 10:05:14.908985    2565 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
May 28 10:05:14.915020 ip-10-0-128-206 kubenswrapper[2565]: W0528 10:05:14.908989    2565 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
May 28 10:05:14.915020 ip-10-0-128-206 kubenswrapper[2565]: W0528 10:05:14.908993    2565 feature_gate.go:328] unrecognized feature gate: SignatureStores
May 28 10:05:14.915020 ip-10-0-128-206 kubenswrapper[2565]: W0528 10:05:14.908997    2565 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
May 28 10:05:14.915020 ip-10-0-128-206 kubenswrapper[2565]: W0528 10:05:14.909001    2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
May 28 10:05:14.915020 ip-10-0-128-206 kubenswrapper[2565]: W0528 10:05:14.909006    2565 feature_gate.go:328] unrecognized feature gate: Example2
May 28 10:05:14.915526 ip-10-0-128-206 kubenswrapper[2565]: W0528 10:05:14.909012    2565 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
May 28 10:05:14.915526 ip-10-0-128-206 kubenswrapper[2565]: W0528 10:05:14.909018    2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
May 28 10:05:14.915526 ip-10-0-128-206 kubenswrapper[2565]: W0528 10:05:14.909023    2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
May 28 10:05:14.915526 ip-10-0-128-206 kubenswrapper[2565]: W0528 10:05:14.909027    2565 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
May 28 10:05:14.915526 ip-10-0-128-206 kubenswrapper[2565]: W0528 10:05:14.909032    2565 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
May 28 10:05:14.915526 ip-10-0-128-206 kubenswrapper[2565]: W0528 10:05:14.909036    2565 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
May 28 10:05:14.915526 ip-10-0-128-206 kubenswrapper[2565]: W0528 10:05:14.909040    2565 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI
May 28 10:05:14.915526 ip-10-0-128-206 kubenswrapper[2565]: W0528 10:05:14.909044    2565 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
May 28 10:05:14.915526 ip-10-0-128-206 kubenswrapper[2565]: W0528 10:05:14.909048    2565 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
May 28 10:05:14.915526 ip-10-0-128-206 kubenswrapper[2565]: W0528 10:05:14.909052    2565 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
May 28 10:05:14.915526 ip-10-0-128-206 kubenswrapper[2565]: W0528 10:05:14.909058    2565 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
May 28 10:05:14.915526 ip-10-0-128-206 kubenswrapper[2565]: W0528 10:05:14.909062    2565 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
May 28 10:05:14.915526 ip-10-0-128-206 kubenswrapper[2565]: W0528 10:05:14.909069    2565 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
May 28 10:05:14.915526 ip-10-0-128-206 kubenswrapper[2565]: W0528 10:05:14.909075    2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
May 28 10:05:14.915526 ip-10-0-128-206 kubenswrapper[2565]: W0528 10:05:14.909080    2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
May 28 10:05:14.915526 ip-10-0-128-206 kubenswrapper[2565]: W0528 10:05:14.909085    2565 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
May 28 10:05:14.915526 ip-10-0-128-206 kubenswrapper[2565]: W0528 10:05:14.909089    2565 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
May 28 10:05:14.915526 ip-10-0-128-206 kubenswrapper[2565]: W0528 10:05:14.909093    2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
May 28 10:05:14.915526 ip-10-0-128-206 kubenswrapper[2565]: W0528 10:05:14.909098    2565 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
May 28 10:05:14.915991 ip-10-0-128-206 kubenswrapper[2565]: W0528 10:05:14.909102    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
May 28 10:05:14.915991 ip-10-0-128-206 kubenswrapper[2565]: W0528 10:05:14.909106    2565 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
May 28 10:05:14.915991 ip-10-0-128-206 kubenswrapper[2565]: W0528 10:05:14.909111    2565 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
May 28 10:05:14.915991 ip-10-0-128-206 kubenswrapper[2565]: W0528 10:05:14.909115    2565 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
May 28 10:05:14.915991 ip-10-0-128-206 kubenswrapper[2565]: W0528 10:05:14.909119    2565 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
May 28 10:05:14.915991 ip-10-0-128-206 kubenswrapper[2565]: W0528 10:05:14.909122    2565 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS
May 28 10:05:14.915991 ip-10-0-128-206 kubenswrapper[2565]: W0528 10:05:14.909126    2565 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
May 28 10:05:14.915991 ip-10-0-128-206 kubenswrapper[2565]: W0528 10:05:14.909130    2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
May 28 10:05:14.915991 ip-10-0-128-206 kubenswrapper[2565]: W0528 10:05:14.909134    2565 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
May 28 10:05:14.915991 ip-10-0-128-206 kubenswrapper[2565]: W0528 10:05:14.909138    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
May 28 10:05:14.915991 ip-10-0-128-206 kubenswrapper[2565]: W0528 10:05:14.909142    2565 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
May 28 10:05:14.915991 ip-10-0-128-206 kubenswrapper[2565]: W0528 10:05:14.909146    2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
May 28 10:05:14.915991 ip-10-0-128-206 kubenswrapper[2565]: W0528 10:05:14.909150    2565 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
May 28 10:05:14.915991 ip-10-0-128-206 kubenswrapper[2565]: W0528 10:05:14.909154    2565 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController
May 28 10:05:14.915991 ip-10-0-128-206 kubenswrapper[2565]: W0528 10:05:14.909158    2565 feature_gate.go:328] unrecognized feature gate: OVNObservability
May 28 10:05:14.915991 ip-10-0-128-206 kubenswrapper[2565]: W0528 10:05:14.909162    2565 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
May 28 10:05:14.915991 ip-10-0-128-206 kubenswrapper[2565]: W0528 10:05:14.909166    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
May 28 10:05:14.915991 ip-10-0-128-206 kubenswrapper[2565]: W0528 10:05:14.909170    2565 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
May 28 10:05:14.915991 ip-10-0-128-206 kubenswrapper[2565]: W0528 10:05:14.909174    2565 feature_gate.go:328] unrecognized feature gate: DualReplica
May 28 10:05:14.916468 ip-10-0-128-206 kubenswrapper[2565]: W0528 10:05:14.909178    2565 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
May 28 10:05:14.916468 ip-10-0-128-206 kubenswrapper[2565]: W0528 10:05:14.909182    2565 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
May 28 10:05:14.916468 ip-10-0-128-206 kubenswrapper[2565]: W0528 10:05:14.909186    2565 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
May 28 10:05:14.916468 ip-10-0-128-206 kubenswrapper[2565]: W0528 10:05:14.909190    2565 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
May 28 10:05:14.916468 ip-10-0-128-206 kubenswrapper[2565]: W0528 10:05:14.909196    2565 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
May 28 10:05:14.916468 ip-10-0-128-206 kubenswrapper[2565]: W0528 10:05:14.909200    2565 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
May 28 10:05:14.916468 ip-10-0-128-206 kubenswrapper[2565]: W0528 10:05:14.909204    2565 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
May 28 10:05:14.916468 ip-10-0-128-206 kubenswrapper[2565]: W0528 10:05:14.909208    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPI
May 28 10:05:14.916468 ip-10-0-128-206 kubenswrapper[2565]: W0528 10:05:14.909213    2565 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
May 28 10:05:14.916468 ip-10-0-128-206 kubenswrapper[2565]: W0528 10:05:14.909217    2565 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
May 28 10:05:14.916468 ip-10-0-128-206 kubenswrapper[2565]: W0528 10:05:14.909221    2565 feature_gate.go:328] unrecognized feature gate: NewOLM
May 28 10:05:14.916468 ip-10-0-128-206 kubenswrapper[2565]: W0528 10:05:14.909225    2565 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
May 28 10:05:14.916468 ip-10-0-128-206 kubenswrapper[2565]: W0528 10:05:14.909229    2565 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
May 28 10:05:14.916468 ip-10-0-128-206 kubenswrapper[2565]: W0528 10:05:14.909233    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
May 28 10:05:14.916468 ip-10-0-128-206 kubenswrapper[2565]: W0528 10:05:14.909237    2565 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
May 28 10:05:14.916468 ip-10-0-128-206 kubenswrapper[2565]: W0528 10:05:14.909241    2565 feature_gate.go:328] unrecognized feature gate: InsightsConfig
May 28 10:05:14.916468 ip-10-0-128-206 kubenswrapper[2565]: W0528 10:05:14.909246    2565 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
May 28 10:05:14.916468 ip-10-0-128-206 kubenswrapper[2565]: W0528 10:05:14.909250    2565 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
May 28 10:05:14.916468 ip-10-0-128-206 kubenswrapper[2565]: W0528 10:05:14.909254    2565 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
May 28 10:05:14.916468 ip-10-0-128-206 kubenswrapper[2565]: W0528 10:05:14.909258    2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
May 28 10:05:14.916990 ip-10-0-128-206 kubenswrapper[2565]: W0528 10:05:14.909262    2565 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations
May 28 10:05:14.916990 ip-10-0-128-206 kubenswrapper[2565]: W0528 10:05:14.909266    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
May 28 10:05:14.916990 ip-10-0-128-206 kubenswrapper[2565]: W0528 10:05:14.909270    2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
May 28 10:05:14.916990 ip-10-0-128-206 kubenswrapper[2565]: W0528 10:05:14.909274    2565 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
May 28 10:05:14.916990 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:14.909282    2565 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]}
May 28 10:05:14.916990 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:14.916082    2565 server.go:530] "Kubelet version" kubeletVersion="v1.33.11"
May 28 10:05:14.916990 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:14.916099    2565 server.go:532] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
May 28 10:05:14.916990 ip-10-0-128-206 kubenswrapper[2565]: W0528 10:05:14.916153    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
May 28 10:05:14.916990 ip-10-0-128-206 kubenswrapper[2565]: W0528 10:05:14.916159    2565 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
May 28 10:05:14.916990 ip-10-0-128-206 kubenswrapper[2565]: W0528 10:05:14.916162    2565 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
May 28 10:05:14.916990 ip-10-0-128-206 kubenswrapper[2565]: W0528 10:05:14.916165    2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
May 28 10:05:14.916990 ip-10-0-128-206 kubenswrapper[2565]: W0528 10:05:14.916168    2565 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
May 28 10:05:14.916990 ip-10-0-128-206 kubenswrapper[2565]: W0528 10:05:14.916171    2565 feature_gate.go:328] unrecognized feature gate: Example
May 28 10:05:14.916990 ip-10-0-128-206 kubenswrapper[2565]: W0528 10:05:14.916174    2565 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
May 28 10:05:14.916990 ip-10-0-128-206 kubenswrapper[2565]: W0528 10:05:14.916177    2565 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
May 28 10:05:14.917383 ip-10-0-128-206 kubenswrapper[2565]: W0528 10:05:14.916179    2565 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
May 28 10:05:14.917383 ip-10-0-128-206 kubenswrapper[2565]: W0528 10:05:14.916182    2565 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
May 28 10:05:14.917383 ip-10-0-128-206 kubenswrapper[2565]: W0528 10:05:14.916184    2565 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
May 28 10:05:14.917383 ip-10-0-128-206 kubenswrapper[2565]: W0528 10:05:14.916187    2565 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
May 28 10:05:14.917383 ip-10-0-128-206 kubenswrapper[2565]: W0528 10:05:14.916189    2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
May 28 10:05:14.917383 ip-10-0-128-206 kubenswrapper[2565]: W0528 10:05:14.916192    2565 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
May 28 10:05:14.917383 ip-10-0-128-206 kubenswrapper[2565]: W0528 10:05:14.916195    2565 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
May 28 10:05:14.917383 ip-10-0-128-206 kubenswrapper[2565]: W0528 10:05:14.916197    2565 feature_gate.go:328] unrecognized feature gate: OVNObservability
May 28 10:05:14.917383 ip-10-0-128-206 kubenswrapper[2565]: W0528 10:05:14.916200    2565 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
May 28 10:05:14.917383 ip-10-0-128-206 kubenswrapper[2565]: W0528 10:05:14.916202    2565 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
May 28 10:05:14.917383 ip-10-0-128-206 kubenswrapper[2565]: W0528 10:05:14.916206    2565 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
May 28 10:05:14.917383 ip-10-0-128-206 kubenswrapper[2565]: W0528 10:05:14.916211    2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
May 28 10:05:14.917383 ip-10-0-128-206 kubenswrapper[2565]: W0528 10:05:14.916215    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
May 28 10:05:14.917383 ip-10-0-128-206 kubenswrapper[2565]: W0528 10:05:14.916219    2565 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
May 28 10:05:14.917383 ip-10-0-128-206 kubenswrapper[2565]: W0528 10:05:14.916224    2565 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
May 28 10:05:14.917383 ip-10-0-128-206 kubenswrapper[2565]: W0528 10:05:14.916226    2565 feature_gate.go:328] unrecognized feature gate: DualReplica
May 28 10:05:14.917383 ip-10-0-128-206 kubenswrapper[2565]: W0528 10:05:14.916229    2565 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
May 28 10:05:14.917383 ip-10-0-128-206 kubenswrapper[2565]: W0528 10:05:14.916232    2565 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
May 28 10:05:14.917383 ip-10-0-128-206 kubenswrapper[2565]: W0528 10:05:14.916234    2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
May 28 10:05:14.917383 ip-10-0-128-206 kubenswrapper[2565]: W0528 10:05:14.916237    2565 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
May 28 10:05:14.917871 ip-10-0-128-206 kubenswrapper[2565]: W0528 10:05:14.916239    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
May 28 10:05:14.917871 ip-10-0-128-206 kubenswrapper[2565]: W0528 10:05:14.916242    2565 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
May 28 10:05:14.917871 ip-10-0-128-206 kubenswrapper[2565]: W0528 10:05:14.916244    2565 feature_gate.go:328] unrecognized feature gate: PinnedImages
May 28 10:05:14.917871 ip-10-0-128-206 kubenswrapper[2565]: W0528 10:05:14.916248    2565 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
May 28 10:05:14.917871 ip-10-0-128-206 kubenswrapper[2565]: W0528 10:05:14.916251    2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
May 28 10:05:14.917871 ip-10-0-128-206 kubenswrapper[2565]: W0528 10:05:14.916253    2565 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
May 28 10:05:14.917871 ip-10-0-128-206 kubenswrapper[2565]: W0528 10:05:14.916256    2565 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
May 28 10:05:14.917871 ip-10-0-128-206 kubenswrapper[2565]: W0528 10:05:14.916259    2565 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
May 28 10:05:14.917871 ip-10-0-128-206 kubenswrapper[2565]: W0528 10:05:14.916261    2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
May 28 10:05:14.917871 ip-10-0-128-206 kubenswrapper[2565]: W0528 10:05:14.916264    2565 feature_gate.go:328] unrecognized feature gate: InsightsConfig
May 28 10:05:14.917871 ip-10-0-128-206 kubenswrapper[2565]: W0528 10:05:14.916266    2565 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS
May 28 10:05:14.917871 ip-10-0-128-206 kubenswrapper[2565]: W0528 10:05:14.916268    2565 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
May 28 10:05:14.917871 ip-10-0-128-206 kubenswrapper[2565]: W0528 10:05:14.916271    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
May 28 10:05:14.917871 ip-10-0-128-206 kubenswrapper[2565]: W0528 10:05:14.916275    2565 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
May 28 10:05:14.917871 ip-10-0-128-206 kubenswrapper[2565]: W0528 10:05:14.916279    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
May 28 10:05:14.917871 ip-10-0-128-206 kubenswrapper[2565]: W0528 10:05:14.916282    2565 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
May 28 10:05:14.917871 ip-10-0-128-206 kubenswrapper[2565]: W0528 10:05:14.916284    2565 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
May 28 10:05:14.917871 ip-10-0-128-206 kubenswrapper[2565]: W0528 10:05:14.916287    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
May 28 10:05:14.917871 ip-10-0-128-206 kubenswrapper[2565]: W0528 10:05:14.916291    2565 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
May 28 10:05:14.918399 ip-10-0-128-206 kubenswrapper[2565]: W0528 10:05:14.916296    2565 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
May 28 10:05:14.918399 ip-10-0-128-206 kubenswrapper[2565]: W0528 10:05:14.916300    2565 feature_gate.go:328] unrecognized feature gate: NewOLM
May 28 10:05:14.918399 ip-10-0-128-206 kubenswrapper[2565]: W0528 10:05:14.916304    2565 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
May 28 10:05:14.918399 ip-10-0-128-206 kubenswrapper[2565]: W0528 10:05:14.916324    2565 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
May 28 10:05:14.918399 ip-10-0-128-206 kubenswrapper[2565]: W0528 10:05:14.916328    2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
May 28 10:05:14.918399 ip-10-0-128-206 kubenswrapper[2565]: W0528 10:05:14.916331    2565 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
May 28 10:05:14.918399 ip-10-0-128-206 kubenswrapper[2565]: W0528 10:05:14.916334    2565 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
May 28 10:05:14.918399 ip-10-0-128-206 kubenswrapper[2565]: W0528 10:05:14.916336    2565 feature_gate.go:328] unrecognized feature gate: Example2
May 28 10:05:14.918399 ip-10-0-128-206 kubenswrapper[2565]: W0528 10:05:14.916339    2565 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
May 28 10:05:14.918399 ip-10-0-128-206 kubenswrapper[2565]: W0528 10:05:14.916341    2565 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
May 28 10:05:14.918399 ip-10-0-128-206 kubenswrapper[2565]: W0528 10:05:14.916344    2565 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI
May 28 10:05:14.918399 ip-10-0-128-206 kubenswrapper[2565]: W0528 10:05:14.916346    2565 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
May 28 10:05:14.918399 ip-10-0-128-206 kubenswrapper[2565]: W0528 10:05:14.916349    2565 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
May 28 10:05:14.918399 ip-10-0-128-206 kubenswrapper[2565]: W0528 10:05:14.916351    2565 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
May 28 10:05:14.918399 ip-10-0-128-206 kubenswrapper[2565]: W0528 10:05:14.916354    2565 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
May 28 10:05:14.918399 ip-10-0-128-206 kubenswrapper[2565]: W0528 10:05:14.916357    2565 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
May 28 10:05:14.918399 ip-10-0-128-206 kubenswrapper[2565]: W0528 10:05:14.916360    2565 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
May 28 10:05:14.918399 ip-10-0-128-206 kubenswrapper[2565]: W0528 10:05:14.916363    2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
May 28 10:05:14.918399 ip-10-0-128-206 kubenswrapper[2565]: W0528 10:05:14.916366    2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
May 28 10:05:14.918399 ip-10-0-128-206 kubenswrapper[2565]: W0528 10:05:14.916369    2565 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations
May 28 10:05:14.918898 ip-10-0-128-206 kubenswrapper[2565]: W0528 10:05:14.916373    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
May 28 10:05:14.918898 ip-10-0-128-206 kubenswrapper[2565]: W0528 10:05:14.916377    2565 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
May 28 10:05:14.918898 ip-10-0-128-206 kubenswrapper[2565]: W0528 10:05:14.916382    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPI
May 28 10:05:14.918898 ip-10-0-128-206 kubenswrapper[2565]: W0528 10:05:14.916385    2565 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
May 28 10:05:14.918898 ip-10-0-128-206 kubenswrapper[2565]: W0528 10:05:14.916388    2565 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
May 28 10:05:14.918898 ip-10-0-128-206 kubenswrapper[2565]: W0528 10:05:14.916390    2565 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
May 28 10:05:14.918898 ip-10-0-128-206 kubenswrapper[2565]: W0528 10:05:14.916393    2565 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
May 28 10:05:14.918898 ip-10-0-128-206 kubenswrapper[2565]: W0528 10:05:14.916396    2565 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
May 28 10:05:14.918898 ip-10-0-128-206 kubenswrapper[2565]: W0528 10:05:14.916401    2565 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController
May 28 10:05:14.918898 ip-10-0-128-206 kubenswrapper[2565]: W0528 10:05:14.916404    2565 feature_gate.go:328] unrecognized feature gate: SignatureStores
May 28 10:05:14.918898 ip-10-0-128-206 kubenswrapper[2565]: W0528 10:05:14.916407    2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
May 28 10:05:14.918898 ip-10-0-128-206 kubenswrapper[2565]: W0528 10:05:14.916410    2565 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
May 28 10:05:14.918898 ip-10-0-128-206 kubenswrapper[2565]: W0528 10:05:14.916412    2565 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
May 28 10:05:14.918898 ip-10-0-128-206 kubenswrapper[2565]: W0528 10:05:14.916415    2565 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
May 28 10:05:14.918898 ip-10-0-128-206 kubenswrapper[2565]: W0528 10:05:14.916418    2565 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
May 28 10:05:14.918898 ip-10-0-128-206 kubenswrapper[2565]: W0528 10:05:14.916421    2565 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
May 28 10:05:14.918898 ip-10-0-128-206 kubenswrapper[2565]: W0528 10:05:14.916423    2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
May 28 10:05:14.918898 ip-10-0-128-206 kubenswrapper[2565]: W0528 10:05:14.916426    2565 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
May 28 10:05:14.918898 ip-10-0-128-206 kubenswrapper[2565]: W0528 10:05:14.916428    2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
May 28 10:05:14.919442 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:14.916434    2565 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]}
May 28 10:05:14.919442 ip-10-0-128-206 kubenswrapper[2565]: W0528 10:05:14.916546    2565 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
May 28 10:05:14.919442 ip-10-0-128-206 kubenswrapper[2565]: W0528 10:05:14.916551    2565 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
May 28 10:05:14.919442 ip-10-0-128-206 kubenswrapper[2565]: W0528 10:05:14.916554    2565 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
May 28 10:05:14.919442 ip-10-0-128-206 kubenswrapper[2565]: W0528 10:05:14.916557    2565 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
May 28 10:05:14.919442 ip-10-0-128-206 kubenswrapper[2565]: W0528 10:05:14.916560    2565 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
May 28 10:05:14.919442 ip-10-0-128-206 kubenswrapper[2565]: W0528 10:05:14.916563    2565 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
May 28 10:05:14.919442 ip-10-0-128-206 kubenswrapper[2565]: W0528 10:05:14.916566    2565 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
May 28 10:05:14.919442 ip-10-0-128-206 kubenswrapper[2565]: W0528 10:05:14.916569    2565 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
May 28 10:05:14.919442 ip-10-0-128-206 kubenswrapper[2565]: W0528 10:05:14.916571    2565 feature_gate.go:328] unrecognized feature gate: OVNObservability
May 28 10:05:14.919442 ip-10-0-128-206 kubenswrapper[2565]: W0528 10:05:14.916574    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
May 28 10:05:14.919442 ip-10-0-128-206 kubenswrapper[2565]: W0528 10:05:14.916577    2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
May 28 10:05:14.919442 ip-10-0-128-206 kubenswrapper[2565]: W0528 10:05:14.916580    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
May 28 10:05:14.919442 ip-10-0-128-206 kubenswrapper[2565]: W0528 10:05:14.916582    2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
May 28 10:05:14.919442 ip-10-0-128-206 kubenswrapper[2565]: W0528 10:05:14.916585    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
May 28 10:05:14.919442 ip-10-0-128-206 kubenswrapper[2565]: W0528 10:05:14.916587    2565 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
May 28 10:05:14.919868 ip-10-0-128-206 kubenswrapper[2565]: W0528 10:05:14.916589    2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
May 28 10:05:14.919868 ip-10-0-128-206 kubenswrapper[2565]: W0528 10:05:14.916593    2565 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
May 28 10:05:14.919868 ip-10-0-128-206 kubenswrapper[2565]: W0528 10:05:14.916597    2565 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
May 28 10:05:14.919868 ip-10-0-128-206 kubenswrapper[2565]: W0528 10:05:14.916600    2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
May 28 10:05:14.919868 ip-10-0-128-206 kubenswrapper[2565]: W0528 10:05:14.916603    2565 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
May 28 10:05:14.919868 ip-10-0-128-206 kubenswrapper[2565]: W0528 10:05:14.916605    2565 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
May 28 10:05:14.919868 ip-10-0-128-206 kubenswrapper[2565]: W0528 10:05:14.916609    2565 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
May 28 10:05:14.919868 ip-10-0-128-206 kubenswrapper[2565]: W0528 10:05:14.916613    2565 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
May 28 10:05:14.919868 ip-10-0-128-206 kubenswrapper[2565]: W0528 10:05:14.916617    2565 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
May 28 10:05:14.919868 ip-10-0-128-206 kubenswrapper[2565]: W0528 10:05:14.916621    2565 feature_gate.go:328] unrecognized feature gate: PinnedImages
May 28 10:05:14.919868 ip-10-0-128-206 kubenswrapper[2565]: W0528 10:05:14.916626    2565 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
May 28 10:05:14.919868 ip-10-0-128-206 kubenswrapper[2565]: W0528 10:05:14.916628    2565 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
May 28 10:05:14.919868 ip-10-0-128-206 kubenswrapper[2565]: W0528 10:05:14.916631    2565 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
May 28 10:05:14.919868 ip-10-0-128-206 kubenswrapper[2565]: W0528 10:05:14.916633    2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
May 28 10:05:14.919868 ip-10-0-128-206 kubenswrapper[2565]: W0528 10:05:14.916636    2565 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI
May 28 10:05:14.919868 ip-10-0-128-206 kubenswrapper[2565]: W0528 10:05:14.916638    2565 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
May 28 10:05:14.919868 ip-10-0-128-206 kubenswrapper[2565]: W0528 10:05:14.916641    2565 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS
May 28 10:05:14.919868 ip-10-0-128-206 kubenswrapper[2565]: W0528 10:05:14.916643    2565 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
May 28 10:05:14.919868 ip-10-0-128-206 kubenswrapper[2565]: W0528 10:05:14.916646    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPI
May 28 10:05:14.920444 ip-10-0-128-206 kubenswrapper[2565]: W0528 10:05:14.916649    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
May 28 10:05:14.920444 ip-10-0-128-206 kubenswrapper[2565]: W0528 10:05:14.916651    2565 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
May 28 10:05:14.920444 ip-10-0-128-206 kubenswrapper[2565]: W0528 10:05:14.916654    2565 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
May 28 10:05:14.920444 ip-10-0-128-206 kubenswrapper[2565]: W0528 10:05:14.916656    2565 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController
May 28 10:05:14.920444 ip-10-0-128-206 kubenswrapper[2565]: W0528 10:05:14.916658    2565 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
May 28 10:05:14.920444 ip-10-0-128-206 kubenswrapper[2565]: W0528 10:05:14.916661    2565 feature_gate.go:328] unrecognized feature gate: SignatureStores
May 28 10:05:14.920444 ip-10-0-128-206 kubenswrapper[2565]: W0528 10:05:14.916663    2565 feature_gate.go:328] unrecognized feature gate: Example
May 28 10:05:14.920444 ip-10-0-128-206 kubenswrapper[2565]: W0528 10:05:14.916666    2565 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
May 28 10:05:14.920444 ip-10-0-128-206 kubenswrapper[2565]: W0528 10:05:14.916668    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
May 28 10:05:14.920444 ip-10-0-128-206 kubenswrapper[2565]: W0528 10:05:14.916672    2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
May 28 10:05:14.920444 ip-10-0-128-206 kubenswrapper[2565]: W0528 10:05:14.916675    2565 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
May 28 10:05:14.920444 ip-10-0-128-206 kubenswrapper[2565]: W0528 10:05:14.916677    2565 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
May 28 10:05:14.920444 ip-10-0-128-206 kubenswrapper[2565]: W0528 10:05:14.916680    2565 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
May 28 10:05:14.920444 ip-10-0-128-206 kubenswrapper[2565]: W0528 10:05:14.916682    2565 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
May 28 10:05:14.920444 ip-10-0-128-206 kubenswrapper[2565]: W0528 10:05:14.916685    2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
May 28 10:05:14.920444 ip-10-0-128-206 kubenswrapper[2565]: W0528 10:05:14.916688    2565 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations
May 28 10:05:14.920444 ip-10-0-128-206 kubenswrapper[2565]: W0528 10:05:14.916692    2565 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
May 28 10:05:14.920444 ip-10-0-128-206 kubenswrapper[2565]: W0528 10:05:14.916696    2565 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
May 28 10:05:14.920444 ip-10-0-128-206 kubenswrapper[2565]: W0528 10:05:14.916700    2565 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
May 28 10:05:14.920444 ip-10-0-128-206 kubenswrapper[2565]: W0528 10:05:14.916704    2565 feature_gate.go:328] unrecognized feature gate: DualReplica
May 28 10:05:14.920920 ip-10-0-128-206 kubenswrapper[2565]: W0528 10:05:14.916706    2565 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
May 28 10:05:14.920920 ip-10-0-128-206 kubenswrapper[2565]: W0528 10:05:14.916709    2565 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
May 28 10:05:14.920920 ip-10-0-128-206 kubenswrapper[2565]: W0528 10:05:14.916711    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
May 28 10:05:14.920920 ip-10-0-128-206 kubenswrapper[2565]: W0528 10:05:14.916714    2565 feature_gate.go:328] unrecognized feature gate: InsightsConfig
May 28 10:05:14.920920 ip-10-0-128-206 kubenswrapper[2565]: W0528 10:05:14.916717    2565 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
May 28 10:05:14.920920 ip-10-0-128-206 kubenswrapper[2565]: W0528 10:05:14.916719    2565 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
May 28 10:05:14.920920 ip-10-0-128-206 kubenswrapper[2565]: W0528 10:05:14.916722    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
May 28 10:05:14.920920 ip-10-0-128-206 kubenswrapper[2565]: W0528 10:05:14.916724    2565 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
May 28 10:05:14.920920 ip-10-0-128-206 kubenswrapper[2565]: W0528 10:05:14.916726    2565 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
May 28 10:05:14.920920 ip-10-0-128-206 kubenswrapper[2565]: W0528 10:05:14.916729    2565 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
May 28 10:05:14.920920 ip-10-0-128-206 kubenswrapper[2565]: W0528 10:05:14.916731    2565 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
May 28 10:05:14.920920 ip-10-0-128-206 kubenswrapper[2565]: W0528 10:05:14.916734    2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
May 28 10:05:14.920920 ip-10-0-128-206 kubenswrapper[2565]: W0528 10:05:14.916736    2565 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
May 28 10:05:14.920920 ip-10-0-128-206 kubenswrapper[2565]: W0528 10:05:14.916739    2565 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
May 28 10:05:14.920920 ip-10-0-128-206 kubenswrapper[2565]: W0528 10:05:14.916742    2565 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
May 28 10:05:14.920920 ip-10-0-128-206 kubenswrapper[2565]: W0528 10:05:14.916744    2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
May 28 10:05:14.920920 ip-10-0-128-206 kubenswrapper[2565]: W0528 10:05:14.916747    2565 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
May 28 10:05:14.920920 ip-10-0-128-206 kubenswrapper[2565]: W0528 10:05:14.916749    2565 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
May 28 10:05:14.920920 ip-10-0-128-206 kubenswrapper[2565]: W0528 10:05:14.916752    2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
May 28 10:05:14.920920 ip-10-0-128-206 kubenswrapper[2565]: W0528 10:05:14.916754    2565 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
May 28 10:05:14.921438 ip-10-0-128-206 kubenswrapper[2565]: W0528 10:05:14.916756    2565 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
May 28 10:05:14.921438 ip-10-0-128-206 kubenswrapper[2565]: W0528 10:05:14.916759    2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
May 28 10:05:14.921438 ip-10-0-128-206 kubenswrapper[2565]: W0528 10:05:14.916762    2565 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
May 28 10:05:14.921438 ip-10-0-128-206 kubenswrapper[2565]: W0528 10:05:14.916764    2565 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
May 28 10:05:14.921438 ip-10-0-128-206 kubenswrapper[2565]: W0528 10:05:14.916770    2565 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
May 28 10:05:14.921438 ip-10-0-128-206 kubenswrapper[2565]: W0528 10:05:14.916776    2565 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
May 28 10:05:14.921438 ip-10-0-128-206 kubenswrapper[2565]: W0528 10:05:14.916781    2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
May 28 10:05:14.921438 ip-10-0-128-206 kubenswrapper[2565]: W0528 10:05:14.916785    2565 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
May 28 10:05:14.921438 ip-10-0-128-206 kubenswrapper[2565]: W0528 10:05:14.916788    2565 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
May 28 10:05:14.921438 ip-10-0-128-206 kubenswrapper[2565]: W0528 10:05:14.916791    2565 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
May 28 10:05:14.921438 ip-10-0-128-206 kubenswrapper[2565]: W0528 10:05:14.916794    2565 feature_gate.go:328] unrecognized feature gate: Example2
May 28 10:05:14.921438 ip-10-0-128-206 kubenswrapper[2565]: W0528 10:05:14.916796    2565 feature_gate.go:328] unrecognized feature gate: NewOLM
May 28 10:05:14.921438 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:14.916801    2565 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]}
May 28 10:05:14.921438 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:14.917591    2565 server.go:962] "Client rotation is on, will bootstrap in background"
May 28 10:05:14.921438 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:14.919707    2565 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
May 28 10:05:14.921805 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:14.920715    2565 server.go:1019] "Starting client certificate rotation"
May 28 10:05:14.921805 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:14.920819    2565 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
May 28 10:05:14.922356 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:14.922343    2565 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
May 28 10:05:14.948933 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:14.948909    2565 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
May 28 10:05:14.953774 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:14.953756    2565 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
May 28 10:05:14.979741 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:14.979716    2565 log.go:25] "Validated CRI v1 runtime API"
May 28 10:05:14.985569 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:14.985544    2565 log.go:25] "Validated CRI v1 image API"
May 28 10:05:14.987598 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:14.987583    2565 server.go:1452] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
May 28 10:05:14.990986 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:14.990968    2565 reflector.go:430] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
May 28 10:05:14.993780 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:14.993758    2565 fs.go:135] Filesystem UUIDs: map[7B77-95E7:/dev/nvme0n1p2 be72f187-0651-4de6-aabd-19f1b52b1ba0:/dev/nvme0n1p4 cf3b692a-96a1-4494-b4da-db8126323057:/dev/nvme0n1p3]
May 28 10:05:14.993847 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:14.993779    2565 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
May 28 10:05:14.997962 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:14.997859    2565 manager.go:217] Machine: {Timestamp:2026-05-28 10:05:14.997360487 +0000 UTC m=+0.457694630 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3003518 MemoryCapacity:32812167168 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec296d66e98f6716fa573884584a021d SystemUUID:ec296d66-e98f-6716-fa57-3884584a021d BootID:6629b06b-a1c4-45da-91e4-c601798a1731 Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16406081536 Type:vfs Inodes:4005391 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6562435072 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6103040 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16406085632 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:ba:53:6a:c1:a5 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:ba:53:6a:c1:a5 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:ca:4d:49:d6:a5:bd Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:32812167168 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:34603008 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
May 28 10:05:14.998771 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:14.998760    2565 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
May 28 10:05:14.998903 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:14.998890    2565 manager.go:233] Version: {KernelVersion:5.14.0-570.114.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260512-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
May 28 10:05:15.000935 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:15.000901    2565 container_manager_linux.go:270] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
May 28 10:05:15.001116 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:15.000940    2565 container_manager_linux.go:275] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-128-206.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
May 28 10:05:15.001164 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:15.001126    2565 topology_manager.go:138] "Creating topology manager with none policy"
May 28 10:05:15.001164 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:15.001135    2565 container_manager_linux.go:306] "Creating device plugin manager"
May 28 10:05:15.001164 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:15.001142    2565 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
May 28 10:05:15.002142 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:15.002131    2565 server.go:72] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
May 28 10:05:15.003476 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:15.003465    2565 state_mem.go:36] "Initialized new in-memory state store"
May 28 10:05:15.003584 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:15.003575    2565 server.go:1267] "Using root directory" path="/var/lib/kubelet"
May 28 10:05:15.006067 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:15.006056    2565 kubelet.go:491] "Attempting to sync node with API server"
May 28 10:05:15.006112 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:15.006070    2565 kubelet.go:386] "Adding static pod path" path="/etc/kubernetes/manifests"
May 28 10:05:15.006112 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:15.006083    2565 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
May 28 10:05:15.006112 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:15.006093    2565 kubelet.go:397] "Adding apiserver pod source"
May 28 10:05:15.006112 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:15.006101    2565 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
May 28 10:05:15.007430 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:15.007418    2565 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
May 28 10:05:15.007479 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:15.007438    2565 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
May 28 10:05:15.014514 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:15.014497    2565 kuberuntime_manager.go:279] "Container runtime initialized" containerRuntime="cri-o" version="1.33.11-2.rhaos4.20.gitb2a8320.el9" apiVersion="v1"
May 28 10:05:15.016292 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:15.016278    2565 kubelet.go:953] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
May 28 10:05:15.017321 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:15.017302    2565 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
May 28 10:05:15.017365 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:15.017333    2565 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
May 28 10:05:15.017365 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:15.017340    2565 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
May 28 10:05:15.017365 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:15.017347    2565 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
May 28 10:05:15.017365 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:15.017354    2565 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
May 28 10:05:15.017365 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:15.017360    2565 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/secret"
May 28 10:05:15.017365 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:15.017365    2565 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
May 28 10:05:15.017512 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:15.017371    2565 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
May 28 10:05:15.017512 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:15.017378    2565 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/fc"
May 28 10:05:15.017512 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:15.017383    2565 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
May 28 10:05:15.017512 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:15.017392    2565 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/projected"
May 28 10:05:15.017760 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:15.017751    2565 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
May 28 10:05:15.025199 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:15.019592    2565 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/csi"
May 28 10:05:15.025199 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:15.019618    2565 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/image"
May 28 10:05:15.025199 ip-10-0-128-206 kubenswrapper[2565]: E0528 10:05:15.020570    2565 reflector.go:200] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-128-206.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
May 28 10:05:15.025199 ip-10-0-128-206 kubenswrapper[2565]: E0528 10:05:15.020782    2565 reflector.go:200] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
May 28 10:05:15.025199 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:15.022896    2565 watchdog_linux.go:99] "Systemd watchdog is not enabled"
May 28 10:05:15.025199 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:15.022932    2565 server.go:1295] "Started kubelet"
May 28 10:05:15.025199 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:15.023007    2565 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
May 28 10:05:15.025199 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:15.023045    2565 ratelimit.go:55] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
May 28 10:05:15.025199 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:15.023113    2565 server_v1.go:47] "podresources" method="list" useActivePods=true
May 28 10:05:15.025606 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:15.025386    2565 server.go:255] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
May 28 10:05:15.025807 ip-10-0-128-206 systemd[1]: Started Kubernetes Kubelet.
May 28 10:05:15.026938 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:15.026924    2565 server.go:317] "Adding debug handlers to kubelet server"
May 28 10:05:15.033606 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:15.033575    2565 csi_plugin.go:988] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-128-206.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
May 28 10:05:15.036945 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:15.036920    2565 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
May 28 10:05:15.036945 ip-10-0-128-206 kubenswrapper[2565]: E0528 10:05:15.036914    2565 kubelet.go:1618] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
May 28 10:05:15.037093 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:15.036920    2565 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
May 28 10:05:15.037093 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:15.036984    2565 volume_manager.go:295] "The desired_state_of_world populator starts"
May 28 10:05:15.037093 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:15.037014    2565 volume_manager.go:297] "Starting Kubelet Volume Manager"
May 28 10:05:15.037219 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:15.037145    2565 desired_state_of_world_populator.go:150] "Desired state populator starts to run"
May 28 10:05:15.037219 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:15.037205    2565 reconstruct.go:97] "Volume reconstruction finished"
May 28 10:05:15.037219 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:15.037212    2565 reconciler.go:26] "Reconciler: start to sync state"
May 28 10:05:15.037909 ip-10-0-128-206 kubenswrapper[2565]: E0528 10:05:15.037874    2565 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-128-206.ec2.internal\" not found"
May 28 10:05:15.038106 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:15.038089    2565 factory.go:153] Registering CRI-O factory
May 28 10:05:15.038106 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:15.038108    2565 factory.go:223] Registration of the crio container factory successfully
May 28 10:05:15.038235 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:15.038167    2565 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
May 28 10:05:15.038235 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:15.038176    2565 factory.go:55] Registering systemd factory
May 28 10:05:15.038235 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:15.038184    2565 factory.go:223] Registration of the systemd container factory successfully
May 28 10:05:15.038235 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:15.038200    2565 factory.go:103] Registering Raw factory
May 28 10:05:15.038235 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:15.038219    2565 manager.go:1196] Started watching for new ooms in manager
May 28 10:05:15.038634 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:15.038621    2565 manager.go:319] Starting recovery of all containers
May 28 10:05:15.044832 ip-10-0-128-206 kubenswrapper[2565]: E0528 10:05:15.044799    2565 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-128-206.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
May 28 10:05:15.044832 ip-10-0-128-206 kubenswrapper[2565]: E0528 10:05:15.044808    2565 reflector.go:200] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
May 28 10:05:15.046090 ip-10-0-128-206 kubenswrapper[2565]: E0528 10:05:15.044803    2565 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-128-206.ec2.internal.18b3b2a89e614e36  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-128-206.ec2.internal,UID:ip-10-0-128-206.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-128-206.ec2.internal,},FirstTimestamp:2026-05-28 10:05:15.022904886 +0000 UTC m=+0.483239028,LastTimestamp:2026-05-28 10:05:15.022904886 +0000 UTC m=+0.483239028,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-128-206.ec2.internal,}"
May 28 10:05:15.048415 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:15.048401    2565 manager.go:324] Recovery completed
May 28 10:05:15.052286 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:15.052265    2565 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach"
May 28 10:05:15.054485 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:15.054458    2565 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-128-206.ec2.internal" event="NodeHasSufficientMemory"
May 28 10:05:15.054568 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:15.054503    2565 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-128-206.ec2.internal" event="NodeHasNoDiskPressure"
May 28 10:05:15.054568 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:15.054521    2565 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-128-206.ec2.internal" event="NodeHasSufficientPID"
May 28 10:05:15.055016 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:15.055003    2565 cpu_manager.go:222] "Starting CPU manager" policy="none"
May 28 10:05:15.055016 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:15.055014    2565 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
May 28 10:05:15.055113 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:15.055029    2565 state_mem.go:36] "Initialized new in-memory state store"
May 28 10:05:15.057273 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:15.057262    2565 policy_none.go:49] "None policy: Start"
May 28 10:05:15.057330 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:15.057279    2565 memory_manager.go:186] "Starting memorymanager" policy="None"
May 28 10:05:15.057330 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:15.057289    2565 state_mem.go:35] "Initializing new in-memory state store"
May 28 10:05:15.062570 ip-10-0-128-206 kubenswrapper[2565]: E0528 10:05:15.062490    2565 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-128-206.ec2.internal.18b3b2a8a0432f6b  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-128-206.ec2.internal,UID:ip-10-0-128-206.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-128-206.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-128-206.ec2.internal,},FirstTimestamp:2026-05-28 10:05:15.054485355 +0000 UTC m=+0.514819506,LastTimestamp:2026-05-28 10:05:15.054485355 +0000 UTC m=+0.514819506,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-128-206.ec2.internal,}"
May 28 10:05:15.072050 ip-10-0-128-206 kubenswrapper[2565]: E0528 10:05:15.071978    2565 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-128-206.ec2.internal.18b3b2a8a043911d  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-128-206.ec2.internal,UID:ip-10-0-128-206.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-128-206.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-128-206.ec2.internal,},FirstTimestamp:2026-05-28 10:05:15.054510365 +0000 UTC m=+0.514844507,LastTimestamp:2026-05-28 10:05:15.054510365 +0000 UTC m=+0.514844507,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-128-206.ec2.internal,}"
May 28 10:05:15.072761 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:15.072742    2565 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-65l2r"
May 28 10:05:15.081980 ip-10-0-128-206 kubenswrapper[2565]: E0528 10:05:15.081906    2565 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-128-206.ec2.internal.18b3b2a8a043d7aa  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-128-206.ec2.internal,UID:ip-10-0-128-206.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientPID,Message:Node ip-10-0-128-206.ec2.internal status is now: NodeHasSufficientPID,Source:EventSource{Component:kubelet,Host:ip-10-0-128-206.ec2.internal,},FirstTimestamp:2026-05-28 10:05:15.054528426 +0000 UTC m=+0.514862568,LastTimestamp:2026-05-28 10:05:15.054528426 +0000 UTC m=+0.514862568,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-128-206.ec2.internal,}"
May 28 10:05:15.084016 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:15.083999    2565 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-65l2r"
May 28 10:05:15.113912 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:15.100657    2565 manager.go:341] "Starting Device Plugin manager"
May 28 10:05:15.113912 ip-10-0-128-206 kubenswrapper[2565]: E0528 10:05:15.100694    2565 manager.go:517] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
May 28 10:05:15.113912 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:15.100704    2565 server.go:85] "Starting device plugin registration server"
May 28 10:05:15.113912 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:15.100951    2565 eviction_manager.go:189] "Eviction manager: starting control loop"
May 28 10:05:15.113912 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:15.100961    2565 container_log_manager.go:189] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
May 28 10:05:15.113912 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:15.101048    2565 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
May 28 10:05:15.113912 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:15.101134    2565 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
May 28 10:05:15.113912 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:15.101142    2565 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
May 28 10:05:15.113912 ip-10-0-128-206 kubenswrapper[2565]: E0528 10:05:15.101601    2565 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
May 28 10:05:15.113912 ip-10-0-128-206 kubenswrapper[2565]: E0528 10:05:15.101633    2565 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-128-206.ec2.internal\" not found"
May 28 10:05:15.148296 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:15.148266    2565 kubelet_network_linux.go:49] "Initialized iptables rules." protocol="IPv4"
May 28 10:05:15.149622 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:15.149567    2565 kubelet_network_linux.go:49] "Initialized iptables rules." protocol="IPv6"
May 28 10:05:15.149622 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:15.149589    2565 status_manager.go:230] "Starting to sync pod status with apiserver"
May 28 10:05:15.149622 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:15.149608    2565 watchdog_linux.go:127] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
May 28 10:05:15.149622 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:15.149617    2565 kubelet.go:2451] "Starting kubelet main sync loop"
May 28 10:05:15.149864 ip-10-0-128-206 kubenswrapper[2565]: E0528 10:05:15.149717    2565 kubelet.go:2475] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
May 28 10:05:15.151927 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:15.151907    2565 reflector.go:430] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
May 28 10:05:15.201809 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:15.201775    2565 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach"
May 28 10:05:15.202780 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:15.202764    2565 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-128-206.ec2.internal" event="NodeHasSufficientMemory"
May 28 10:05:15.202848 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:15.202800    2565 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-128-206.ec2.internal" event="NodeHasNoDiskPressure"
May 28 10:05:15.202848 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:15.202814    2565 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-128-206.ec2.internal" event="NodeHasSufficientPID"
May 28 10:05:15.202848 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:15.202837    2565 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-128-206.ec2.internal"
May 28 10:05:15.214038 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:15.214017    2565 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-128-206.ec2.internal"
May 28 10:05:15.214119 ip-10-0-128-206 kubenswrapper[2565]: E0528 10:05:15.214041    2565 kubelet_node_status.go:597] "Error updating node status, will retry" err="error getting node \"ip-10-0-128-206.ec2.internal\": node \"ip-10-0-128-206.ec2.internal\" not found"
May 28 10:05:15.241914 ip-10-0-128-206 kubenswrapper[2565]: E0528 10:05:15.241884    2565 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-128-206.ec2.internal\" not found"
May 28 10:05:15.250754 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:15.250731    2565 kubelet.go:2537] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-206.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-128-206.ec2.internal"]
May 28 10:05:15.250820 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:15.250798    2565 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach"
May 28 10:05:15.252235 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:15.252219    2565 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-128-206.ec2.internal" event="NodeHasSufficientMemory"
May 28 10:05:15.252322 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:15.252248    2565 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-128-206.ec2.internal" event="NodeHasNoDiskPressure"
May 28 10:05:15.252322 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:15.252264    2565 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-128-206.ec2.internal" event="NodeHasSufficientPID"
May 28 10:05:15.253496 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:15.253484    2565 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach"
May 28 10:05:15.253693 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:15.253680    2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-206.ec2.internal"
May 28 10:05:15.253733 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:15.253711    2565 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach"
May 28 10:05:15.254225 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:15.254210    2565 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-128-206.ec2.internal" event="NodeHasSufficientMemory"
May 28 10:05:15.254290 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:15.254235    2565 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-128-206.ec2.internal" event="NodeHasNoDiskPressure"
May 28 10:05:15.254290 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:15.254251    2565 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-128-206.ec2.internal" event="NodeHasSufficientPID"
May 28 10:05:15.254375 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:15.254211    2565 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-128-206.ec2.internal" event="NodeHasSufficientMemory"
May 28 10:05:15.254375 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:15.254336    2565 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-128-206.ec2.internal" event="NodeHasNoDiskPressure"
May 28 10:05:15.254375 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:15.254346    2565 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-128-206.ec2.internal" event="NodeHasSufficientPID"
May 28 10:05:15.255508 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:15.255491    2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-206.ec2.internal"
May 28 10:05:15.255591 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:15.255515    2565 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach"
May 28 10:05:15.256162 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:15.256148    2565 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-128-206.ec2.internal" event="NodeHasSufficientMemory"
May 28 10:05:15.256240 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:15.256173    2565 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-128-206.ec2.internal" event="NodeHasNoDiskPressure"
May 28 10:05:15.256240 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:15.256188    2565 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-128-206.ec2.internal" event="NodeHasSufficientPID"
May 28 10:05:15.277977 ip-10-0-128-206 kubenswrapper[2565]: E0528 10:05:15.277953    2565 kubelet.go:3336] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-128-206.ec2.internal\" not found" node="ip-10-0-128-206.ec2.internal"
May 28 10:05:15.282212 ip-10-0-128-206 kubenswrapper[2565]: E0528 10:05:15.282196    2565 kubelet.go:3336] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-128-206.ec2.internal\" not found" node="ip-10-0-128-206.ec2.internal"
May 28 10:05:15.337981 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:15.337944    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/dafcffec46e93c961979dd9c978f3fcd-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-128-206.ec2.internal\" (UID: \"dafcffec46e93c961979dd9c978f3fcd\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-206.ec2.internal"
May 28 10:05:15.337981 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:15.337976    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/a6772c4d9844f0928036a579dcf5d882-config\") pod \"kube-apiserver-proxy-ip-10-0-128-206.ec2.internal\" (UID: \"a6772c4d9844f0928036a579dcf5d882\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-128-206.ec2.internal"
May 28 10:05:15.338170 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:15.337992    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/dafcffec46e93c961979dd9c978f3fcd-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-128-206.ec2.internal\" (UID: \"dafcffec46e93c961979dd9c978f3fcd\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-206.ec2.internal"
May 28 10:05:15.341962 ip-10-0-128-206 kubenswrapper[2565]: E0528 10:05:15.341942    2565 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-128-206.ec2.internal\" not found"
May 28 10:05:15.438607 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:15.438543    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/dafcffec46e93c961979dd9c978f3fcd-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-128-206.ec2.internal\" (UID: \"dafcffec46e93c961979dd9c978f3fcd\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-206.ec2.internal"
May 28 10:05:15.438607 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:15.438494    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/dafcffec46e93c961979dd9c978f3fcd-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-128-206.ec2.internal\" (UID: \"dafcffec46e93c961979dd9c978f3fcd\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-206.ec2.internal"
May 28 10:05:15.438721 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:15.438609    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/dafcffec46e93c961979dd9c978f3fcd-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-128-206.ec2.internal\" (UID: \"dafcffec46e93c961979dd9c978f3fcd\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-206.ec2.internal"
May 28 10:05:15.438721 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:15.438626    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/a6772c4d9844f0928036a579dcf5d882-config\") pod \"kube-apiserver-proxy-ip-10-0-128-206.ec2.internal\" (UID: \"a6772c4d9844f0928036a579dcf5d882\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-128-206.ec2.internal"
May 28 10:05:15.438721 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:15.438651    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/a6772c4d9844f0928036a579dcf5d882-config\") pod \"kube-apiserver-proxy-ip-10-0-128-206.ec2.internal\" (UID: \"a6772c4d9844f0928036a579dcf5d882\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-128-206.ec2.internal"
May 28 10:05:15.438721 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:15.438687    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/dafcffec46e93c961979dd9c978f3fcd-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-128-206.ec2.internal\" (UID: \"dafcffec46e93c961979dd9c978f3fcd\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-206.ec2.internal"
May 28 10:05:15.442595 ip-10-0-128-206 kubenswrapper[2565]: E0528 10:05:15.442577    2565 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-128-206.ec2.internal\" not found"
May 28 10:05:15.543382 ip-10-0-128-206 kubenswrapper[2565]: E0528 10:05:15.543336    2565 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-128-206.ec2.internal\" not found"
May 28 10:05:15.580524 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:15.580490    2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-206.ec2.internal"
May 28 10:05:15.585330 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:15.585294    2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-206.ec2.internal"
May 28 10:05:15.644284 ip-10-0-128-206 kubenswrapper[2565]: E0528 10:05:15.644246    2565 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-128-206.ec2.internal\" not found"
May 28 10:05:15.744775 ip-10-0-128-206 kubenswrapper[2565]: E0528 10:05:15.744710    2565 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-128-206.ec2.internal\" not found"
May 28 10:05:15.845223 ip-10-0-128-206 kubenswrapper[2565]: E0528 10:05:15.845190    2565 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-128-206.ec2.internal\" not found"
May 28 10:05:15.920396 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:15.920369    2565 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
May 28 10:05:15.920959 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:15.920516    2565 reflector.go:556] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
May 28 10:05:15.945827 ip-10-0-128-206 kubenswrapper[2565]: E0528 10:05:15.945808    2565 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-128-206.ec2.internal\" not found"
May 28 10:05:15.997821 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:15.997629    2565 reflector.go:430] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
May 28 10:05:16.007123 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:16.007104    2565 apiserver.go:52] "Watching apiserver"
May 28 10:05:16.018952 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:16.018922    2565 reflector.go:430] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
May 28 10:05:16.019937 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:16.019914    2565 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kube-system/konnectivity-agent-6qpxx","openshift-cluster-node-tuning-operator/tuned-8nw9l","openshift-image-registry/node-ca-8jmk5","openshift-multus/network-metrics-daemon-jj9f8","openshift-network-diagnostics/network-check-target-kvx8v","openshift-ovn-kubernetes/ovnkube-node-j4whq","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-78j5q","openshift-dns/node-resolver-8vr88","openshift-multus/multus-additional-cni-plugins-ck4jd","openshift-multus/multus-vwktp","openshift-network-operator/iptables-alerter-q87km"]
May 28 10:05:16.022469 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:16.022448    2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-6qpxx"
May 28 10:05:16.023488 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:16.023459    2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-8nw9l"
May 28 10:05:16.024686 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:16.024667    2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-8jmk5"
May 28 10:05:16.025460 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:16.025446    2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-gf9gb\""
May 28 10:05:16.025521 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:16.025497    2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
May 28 10:05:16.025822 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:16.025804    2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
May 28 10:05:16.025933 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:16.025856    2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jj9f8"
May 28 10:05:16.025997 ip-10-0-128-206 kubenswrapper[2565]: E0528 10:05:16.025919    2565 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jj9f8" podUID="9024e35e-a291-4ee1-b4ad-c8b75c8d31ca"
May 28 10:05:16.025997 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:16.025957    2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kvx8v"
May 28 10:05:16.026104 ip-10-0-128-206 kubenswrapper[2565]: E0528 10:05:16.026071    2565 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kvx8v" podUID="477435e8-f3a1-4bda-8764-5dd5b8afe64f"
May 28 10:05:16.026159 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:16.026138    2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
May 28 10:05:16.026223 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:16.026199    2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
May 28 10:05:16.026514 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:16.026499    2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-5f2gn\""
May 28 10:05:16.026939 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:16.026921    2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
May 28 10:05:16.027340 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:16.027325    2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-qwh27\""
May 28 10:05:16.027768 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:16.027754    2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
May 28 10:05:16.027848 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:16.027801    2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
May 28 10:05:16.028271 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:16.028254    2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-78j5q"
May 28 10:05:16.028373 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:16.028270    2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-j4whq"
May 28 10:05:16.029568 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:16.029552    2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-8vr88"
May 28 10:05:16.030840 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:16.030825    2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-ck4jd"
May 28 10:05:16.032298 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:16.032276    2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-vwktp"
May 28 10:05:16.033268 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:16.033248    2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
May 28 10:05:16.033422 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:16.033272    2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
May 28 10:05:16.033422 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:16.033363    2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
May 28 10:05:16.033422 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:16.033369    2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
May 28 10:05:16.033422 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:16.033376    2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
May 28 10:05:16.033422 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:16.033393    2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
May 28 10:05:16.033627 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:16.033570    2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-vq75v\""
May 28 10:05:16.033627 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:16.033605    2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
May 28 10:05:16.033762 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:16.033746    2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-q87km"
May 28 10:05:16.035899 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:16.035880    2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
May 28 10:05:16.035992 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:16.035952    2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
May 28 10:05:16.035992 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:16.035975    2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
May 28 10:05:16.035992 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:16.035983    2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
May 28 10:05:16.036260 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:16.035983    2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
May 28 10:05:16.036439 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:16.036285    2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-4kg27\""
May 28 10:05:16.037345 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:16.036983    2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
May 28 10:05:16.037345 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:16.037117    2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
May 28 10:05:16.037345 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:16.037280    2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
May 28 10:05:16.037532 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:16.037438    2565 kubelet.go:3340] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-206.ec2.internal"
May 28 10:05:16.038448 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:16.038432    2565 desired_state_of_world_populator.go:158] "Finished populating initial desired state of world"
May 28 10:05:16.038550 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:16.038533    2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-cx56m\""
May 28 10:05:16.038609 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:16.038597    2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
May 28 10:05:16.038899 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:16.038882    2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
May 28 10:05:16.039013 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:16.038995    2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
May 28 10:05:16.039301 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:16.039280    2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-x8lkg\""
May 28 10:05:16.039301 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:16.039289    2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
May 28 10:05:16.039301 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:16.039293    2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-58dp7\""
May 28 10:05:16.039484 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:16.039287    2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-2xbk8\""
May 28 10:05:16.039563 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:16.039548    2565 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
May 28 10:05:16.039615 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:16.039590    2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
May 28 10:05:16.041946 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:16.041927    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/c52e0100-163d-47e8-9414-e07548bc3e37-multus-socket-dir-parent\") pod \"multus-vwktp\" (UID: \"c52e0100-163d-47e8-9414-e07548bc3e37\") " pod="openshift-multus/multus-vwktp"
May 28 10:05:16.042009 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:16.041962    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/5185dc25-c431-4639-a53a-0c38db5a6f4f-var-lib-openvswitch\") pod \"ovnkube-node-j4whq\" (UID: \"5185dc25-c431-4639-a53a-0c38db5a6f4f\") " pod="openshift-ovn-kubernetes/ovnkube-node-j4whq"
May 28 10:05:16.042009 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:16.041985    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/2a281715-5613-4b06-9963-0addcc9b432a-os-release\") pod \"multus-additional-cni-plugins-ck4jd\" (UID: \"2a281715-5613-4b06-9963-0addcc9b432a\") " pod="openshift-multus/multus-additional-cni-plugins-ck4jd"
May 28 10:05:16.042009 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:16.042001    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c52e0100-163d-47e8-9414-e07548bc3e37-system-cni-dir\") pod \"multus-vwktp\" (UID: \"c52e0100-163d-47e8-9414-e07548bc3e37\") " pod="openshift-multus/multus-vwktp"
May 28 10:05:16.042122 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:16.042042    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/c52e0100-163d-47e8-9414-e07548bc3e37-host-run-k8s-cni-cncf-io\") pod \"multus-vwktp\" (UID: \"c52e0100-163d-47e8-9414-e07548bc3e37\") " pod="openshift-multus/multus-vwktp"
May 28 10:05:16.042122 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:16.042067    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b4abbf06-e346-4870-a227-65afbd0db899-tmp-dir\") pod \"node-resolver-8vr88\" (UID: \"b4abbf06-e346-4870-a227-65afbd0db899\") " pod="openshift-dns/node-resolver-8vr88"
May 28 10:05:16.042122 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:16.042091    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/a5f7c60c-f57b-475b-a97a-32f0e1dbdc5b-etc-sysctl-d\") pod \"tuned-8nw9l\" (UID: \"a5f7c60c-f57b-475b-a97a-32f0e1dbdc5b\") " pod="openshift-cluster-node-tuning-operator/tuned-8nw9l"
May 28 10:05:16.042246 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:16.042126    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2gns7\" (UniqueName: \"kubernetes.io/projected/2a281715-5613-4b06-9963-0addcc9b432a-kube-api-access-2gns7\") pod \"multus-additional-cni-plugins-ck4jd\" (UID: \"2a281715-5613-4b06-9963-0addcc9b432a\") " pod="openshift-multus/multus-additional-cni-plugins-ck4jd"
May 28 10:05:16.042246 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:16.042146    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/c52e0100-163d-47e8-9414-e07548bc3e37-host-run-multus-certs\") pod \"multus-vwktp\" (UID: \"c52e0100-163d-47e8-9414-e07548bc3e37\") " pod="openshift-multus/multus-vwktp"
May 28 10:05:16.042246 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:16.042160    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c52e0100-163d-47e8-9414-e07548bc3e37-etc-kubernetes\") pod \"multus-vwktp\" (UID: \"c52e0100-163d-47e8-9414-e07548bc3e37\") " pod="openshift-multus/multus-vwktp"
May 28 10:05:16.042246 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:16.042174    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/a5f7c60c-f57b-475b-a97a-32f0e1dbdc5b-etc-modprobe-d\") pod \"tuned-8nw9l\" (UID: \"a5f7c60c-f57b-475b-a97a-32f0e1dbdc5b\") " pod="openshift-cluster-node-tuning-operator/tuned-8nw9l"
May 28 10:05:16.042246 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:16.042226    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/a5f7c60c-f57b-475b-a97a-32f0e1dbdc5b-host\") pod \"tuned-8nw9l\" (UID: \"a5f7c60c-f57b-475b-a97a-32f0e1dbdc5b\") " pod="openshift-cluster-node-tuning-operator/tuned-8nw9l"
May 28 10:05:16.042487 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:16.042263    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/5185dc25-c431-4639-a53a-0c38db5a6f4f-etc-openvswitch\") pod \"ovnkube-node-j4whq\" (UID: \"5185dc25-c431-4639-a53a-0c38db5a6f4f\") " pod="openshift-ovn-kubernetes/ovnkube-node-j4whq"
May 28 10:05:16.042487 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:16.042299    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/5185dc25-c431-4639-a53a-0c38db5a6f4f-run-ovn\") pod \"ovnkube-node-j4whq\" (UID: \"5185dc25-c431-4639-a53a-0c38db5a6f4f\") " pod="openshift-ovn-kubernetes/ovnkube-node-j4whq"
May 28 10:05:16.042487 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:16.042344    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/5185dc25-c431-4639-a53a-0c38db5a6f4f-log-socket\") pod \"ovnkube-node-j4whq\" (UID: \"5185dc25-c431-4639-a53a-0c38db5a6f4f\") " pod="openshift-ovn-kubernetes/ovnkube-node-j4whq"
May 28 10:05:16.042487 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:16.042361    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cq8kb\" (UniqueName: \"kubernetes.io/projected/9f62bd21-c44c-4022-a4d8-1ffa1422c955-kube-api-access-cq8kb\") pod \"aws-ebs-csi-driver-node-78j5q\" (UID: \"9f62bd21-c44c-4022-a4d8-1ffa1422c955\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-78j5q"
May 28 10:05:16.042487 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:16.042374    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/c52e0100-163d-47e8-9414-e07548bc3e37-host-run-netns\") pod \"multus-vwktp\" (UID: \"c52e0100-163d-47e8-9414-e07548bc3e37\") " pod="openshift-multus/multus-vwktp"
May 28 10:05:16.042487 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:16.042405    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/c925ed8e-f4ec-45e6-bfa6-2128a0947aca-agent-certs\") pod \"konnectivity-agent-6qpxx\" (UID: \"c925ed8e-f4ec-45e6-bfa6-2128a0947aca\") " pod="kube-system/konnectivity-agent-6qpxx"
May 28 10:05:16.042487 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:16.042434    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/5185dc25-c431-4639-a53a-0c38db5a6f4f-host-run-netns\") pod \"ovnkube-node-j4whq\" (UID: \"5185dc25-c431-4639-a53a-0c38db5a6f4f\") " pod="openshift-ovn-kubernetes/ovnkube-node-j4whq"
May 28 10:05:16.042487 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:16.042458    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/5185dc25-c431-4639-a53a-0c38db5a6f4f-host-cni-netd\") pod \"ovnkube-node-j4whq\" (UID: \"5185dc25-c431-4639-a53a-0c38db5a6f4f\") " pod="openshift-ovn-kubernetes/ovnkube-node-j4whq"
May 28 10:05:16.042487 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:16.042481    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/9f62bd21-c44c-4022-a4d8-1ffa1422c955-kubelet-dir\") pod \"aws-ebs-csi-driver-node-78j5q\" (UID: \"9f62bd21-c44c-4022-a4d8-1ffa1422c955\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-78j5q"
May 28 10:05:16.042815 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:16.042504    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/c52e0100-163d-47e8-9414-e07548bc3e37-host-var-lib-cni-multus\") pod \"multus-vwktp\" (UID: \"c52e0100-163d-47e8-9414-e07548bc3e37\") " pod="openshift-multus/multus-vwktp"
May 28 10:05:16.042815 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:16.042543    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/c52e0100-163d-47e8-9414-e07548bc3e37-hostroot\") pod \"multus-vwktp\" (UID: \"c52e0100-163d-47e8-9414-e07548bc3e37\") " pod="openshift-multus/multus-vwktp"
May 28 10:05:16.042815 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:16.042562    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rhgm5\" (UniqueName: \"kubernetes.io/projected/c1d9d1d1-da1a-431d-9baa-2bf4928f94d3-kube-api-access-rhgm5\") pod \"iptables-alerter-q87km\" (UID: \"c1d9d1d1-da1a-431d-9baa-2bf4928f94d3\") " pod="openshift-network-operator/iptables-alerter-q87km"
May 28 10:05:16.042815 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:16.042576    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/5185dc25-c431-4639-a53a-0c38db5a6f4f-host-kubelet\") pod \"ovnkube-node-j4whq\" (UID: \"5185dc25-c431-4639-a53a-0c38db5a6f4f\") " pod="openshift-ovn-kubernetes/ovnkube-node-j4whq"
May 28 10:05:16.042815 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:16.042591    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5185dc25-c431-4639-a53a-0c38db5a6f4f-host-run-ovn-kubernetes\") pod \"ovnkube-node-j4whq\" (UID: \"5185dc25-c431-4639-a53a-0c38db5a6f4f\") " pod="openshift-ovn-kubernetes/ovnkube-node-j4whq"
May 28 10:05:16.042815 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:16.042612    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/5185dc25-c431-4639-a53a-0c38db5a6f4f-host-cni-bin\") pod \"ovnkube-node-j4whq\" (UID: \"5185dc25-c431-4639-a53a-0c38db5a6f4f\") " pod="openshift-ovn-kubernetes/ovnkube-node-j4whq"
May 28 10:05:16.042815 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:16.042627    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/c1d9d1d1-da1a-431d-9baa-2bf4928f94d3-host-slash\") pod \"iptables-alerter-q87km\" (UID: \"c1d9d1d1-da1a-431d-9baa-2bf4928f94d3\") " pod="openshift-network-operator/iptables-alerter-q87km"
May 28 10:05:16.042815 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:16.042641    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a5f7c60c-f57b-475b-a97a-32f0e1dbdc5b-var-lib-kubelet\") pod \"tuned-8nw9l\" (UID: \"a5f7c60c-f57b-475b-a97a-32f0e1dbdc5b\") " pod="openshift-cluster-node-tuning-operator/tuned-8nw9l"
May 28 10:05:16.042815 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:16.042659    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/9f62bd21-c44c-4022-a4d8-1ffa1422c955-socket-dir\") pod \"aws-ebs-csi-driver-node-78j5q\" (UID: \"9f62bd21-c44c-4022-a4d8-1ffa1422c955\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-78j5q"
May 28 10:05:16.042815 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:16.042683    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c52e0100-163d-47e8-9414-e07548bc3e37-host-var-lib-kubelet\") pod \"multus-vwktp\" (UID: \"c52e0100-163d-47e8-9414-e07548bc3e37\") " pod="openshift-multus/multus-vwktp"
May 28 10:05:16.042815 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:16.042699    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9024e35e-a291-4ee1-b4ad-c8b75c8d31ca-metrics-certs\") pod \"network-metrics-daemon-jj9f8\" (UID: \"9024e35e-a291-4ee1-b4ad-c8b75c8d31ca\") " pod="openshift-multus/network-metrics-daemon-jj9f8"
May 28 10:05:16.042815 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:16.042731    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/5185dc25-c431-4639-a53a-0c38db5a6f4f-systemd-units\") pod \"ovnkube-node-j4whq\" (UID: \"5185dc25-c431-4639-a53a-0c38db5a6f4f\") " pod="openshift-ovn-kubernetes/ovnkube-node-j4whq"
May 28 10:05:16.042815 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:16.042753    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/5185dc25-c431-4639-a53a-0c38db5a6f4f-host-slash\") pod \"ovnkube-node-j4whq\" (UID: \"5185dc25-c431-4639-a53a-0c38db5a6f4f\") " pod="openshift-ovn-kubernetes/ovnkube-node-j4whq"
May 28 10:05:16.042815 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:16.042770    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/5185dc25-c431-4639-a53a-0c38db5a6f4f-run-openvswitch\") pod \"ovnkube-node-j4whq\" (UID: \"5185dc25-c431-4639-a53a-0c38db5a6f4f\") " pod="openshift-ovn-kubernetes/ovnkube-node-j4whq"
May 28 10:05:16.042815 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:16.042798    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5185dc25-c431-4639-a53a-0c38db5a6f4f-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-j4whq\" (UID: \"5185dc25-c431-4639-a53a-0c38db5a6f4f\") " pod="openshift-ovn-kubernetes/ovnkube-node-j4whq"
May 28 10:05:16.042815 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:16.042817    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/5185dc25-c431-4639-a53a-0c38db5a6f4f-ovnkube-script-lib\") pod \"ovnkube-node-j4whq\" (UID: \"5185dc25-c431-4639-a53a-0c38db5a6f4f\") " pod="openshift-ovn-kubernetes/ovnkube-node-j4whq"
May 28 10:05:16.043459 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:16.042833    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/2a281715-5613-4b06-9963-0addcc9b432a-cnibin\") pod \"multus-additional-cni-plugins-ck4jd\" (UID: \"2a281715-5613-4b06-9963-0addcc9b432a\") " pod="openshift-multus/multus-additional-cni-plugins-ck4jd"
May 28 10:05:16.043459 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:16.042847    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/c52e0100-163d-47e8-9414-e07548bc3e37-multus-daemon-config\") pod \"multus-vwktp\" (UID: \"c52e0100-163d-47e8-9414-e07548bc3e37\") " pod="openshift-multus/multus-vwktp"
May 28 10:05:16.043459 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:16.042866    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7vnbz\" (UniqueName: \"kubernetes.io/projected/a5f7c60c-f57b-475b-a97a-32f0e1dbdc5b-kube-api-access-7vnbz\") pod \"tuned-8nw9l\" (UID: \"a5f7c60c-f57b-475b-a97a-32f0e1dbdc5b\") " pod="openshift-cluster-node-tuning-operator/tuned-8nw9l"
May 28 10:05:16.043459 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:16.042880    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/5185dc25-c431-4639-a53a-0c38db5a6f4f-env-overrides\") pod \"ovnkube-node-j4whq\" (UID: \"5185dc25-c431-4639-a53a-0c38db5a6f4f\") " pod="openshift-ovn-kubernetes/ovnkube-node-j4whq"
May 28 10:05:16.043459 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:16.042895    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/2a281715-5613-4b06-9963-0addcc9b432a-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-ck4jd\" (UID: \"2a281715-5613-4b06-9963-0addcc9b432a\") " pod="openshift-multus/multus-additional-cni-plugins-ck4jd"
May 28 10:05:16.043459 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:16.042909    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lxwtn\" (UniqueName: \"kubernetes.io/projected/74f14c89-a025-4bda-ab55-a7a661f2702e-kube-api-access-lxwtn\") pod \"node-ca-8jmk5\" (UID: \"74f14c89-a025-4bda-ab55-a7a661f2702e\") " pod="openshift-image-registry/node-ca-8jmk5"
May 28 10:05:16.043459 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:16.042932    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/a5f7c60c-f57b-475b-a97a-32f0e1dbdc5b-etc-sysconfig\") pod \"tuned-8nw9l\" (UID: \"a5f7c60c-f57b-475b-a97a-32f0e1dbdc5b\") " pod="openshift-cluster-node-tuning-operator/tuned-8nw9l"
May 28 10:05:16.043459 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:16.042965    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/a5f7c60c-f57b-475b-a97a-32f0e1dbdc5b-lib-modules\") pod \"tuned-8nw9l\" (UID: \"a5f7c60c-f57b-475b-a97a-32f0e1dbdc5b\") " pod="openshift-cluster-node-tuning-operator/tuned-8nw9l"
May 28 10:05:16.043459 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:16.042991    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v29s6\" (UniqueName: \"kubernetes.io/projected/5185dc25-c431-4639-a53a-0c38db5a6f4f-kube-api-access-v29s6\") pod \"ovnkube-node-j4whq\" (UID: \"5185dc25-c431-4639-a53a-0c38db5a6f4f\") " pod="openshift-ovn-kubernetes/ovnkube-node-j4whq"
May 28 10:05:16.043459 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:16.043017    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/a5f7c60c-f57b-475b-a97a-32f0e1dbdc5b-etc-systemd\") pod \"tuned-8nw9l\" (UID: \"a5f7c60c-f57b-475b-a97a-32f0e1dbdc5b\") " pod="openshift-cluster-node-tuning-operator/tuned-8nw9l"
May 28 10:05:16.043459 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:16.043040    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a5f7c60c-f57b-475b-a97a-32f0e1dbdc5b-tmp\") pod \"tuned-8nw9l\" (UID: \"a5f7c60c-f57b-475b-a97a-32f0e1dbdc5b\") " pod="openshift-cluster-node-tuning-operator/tuned-8nw9l"
May 28 10:05:16.043459 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:16.043064    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/9f62bd21-c44c-4022-a4d8-1ffa1422c955-sys-fs\") pod \"aws-ebs-csi-driver-node-78j5q\" (UID: \"9f62bd21-c44c-4022-a4d8-1ffa1422c955\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-78j5q"
May 28 10:05:16.043459 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:16.043089    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/c52e0100-163d-47e8-9414-e07548bc3e37-multus-conf-dir\") pod \"multus-vwktp\" (UID: \"c52e0100-163d-47e8-9414-e07548bc3e37\") " pod="openshift-multus/multus-vwktp"
May 28 10:05:16.043459 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:16.043112    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a5f7c60c-f57b-475b-a97a-32f0e1dbdc5b-etc-kubernetes\") pod \"tuned-8nw9l\" (UID: \"a5f7c60c-f57b-475b-a97a-32f0e1dbdc5b\") " pod="openshift-cluster-node-tuning-operator/tuned-8nw9l"
May 28 10:05:16.043459 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:16.043133    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/a5f7c60c-f57b-475b-a97a-32f0e1dbdc5b-run\") pod \"tuned-8nw9l\" (UID: \"a5f7c60c-f57b-475b-a97a-32f0e1dbdc5b\") " pod="openshift-cluster-node-tuning-operator/tuned-8nw9l"
May 28 10:05:16.043459 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:16.043155    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/9f62bd21-c44c-4022-a4d8-1ffa1422c955-etc-selinux\") pod \"aws-ebs-csi-driver-node-78j5q\" (UID: \"9f62bd21-c44c-4022-a4d8-1ffa1422c955\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-78j5q"
May 28 10:05:16.044393 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:16.043185    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c52e0100-163d-47e8-9414-e07548bc3e37-multus-cni-dir\") pod \"multus-vwktp\" (UID: \"c52e0100-163d-47e8-9414-e07548bc3e37\") " pod="openshift-multus/multus-vwktp"
May 28 10:05:16.044393 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:16.043209    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/c52e0100-163d-47e8-9414-e07548bc3e37-cni-binary-copy\") pod \"multus-vwktp\" (UID: \"c52e0100-163d-47e8-9414-e07548bc3e37\") " pod="openshift-multus/multus-vwktp"
May 28 10:05:16.044393 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:16.043246    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/a5f7c60c-f57b-475b-a97a-32f0e1dbdc5b-etc-tuned\") pod \"tuned-8nw9l\" (UID: \"a5f7c60c-f57b-475b-a97a-32f0e1dbdc5b\") " pod="openshift-cluster-node-tuning-operator/tuned-8nw9l"
May 28 10:05:16.044393 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:16.043289    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/2a281715-5613-4b06-9963-0addcc9b432a-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-ck4jd\" (UID: \"2a281715-5613-4b06-9963-0addcc9b432a\") " pod="openshift-multus/multus-additional-cni-plugins-ck4jd"
May 28 10:05:16.044393 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:16.043331    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/c52e0100-163d-47e8-9414-e07548bc3e37-cnibin\") pod \"multus-vwktp\" (UID: \"c52e0100-163d-47e8-9414-e07548bc3e37\") " pod="openshift-multus/multus-vwktp"
May 28 10:05:16.044393 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:16.043356    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/c925ed8e-f4ec-45e6-bfa6-2128a0947aca-konnectivity-ca\") pod \"konnectivity-agent-6qpxx\" (UID: \"c925ed8e-f4ec-45e6-bfa6-2128a0947aca\") " pod="kube-system/konnectivity-agent-6qpxx"
May 28 10:05:16.044393 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:16.043378    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/74f14c89-a025-4bda-ab55-a7a661f2702e-host\") pod \"node-ca-8jmk5\" (UID: \"74f14c89-a025-4bda-ab55-a7a661f2702e\") " pod="openshift-image-registry/node-ca-8jmk5"
May 28 10:05:16.044393 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:16.043401    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-67kpf\" (UniqueName: \"kubernetes.io/projected/9024e35e-a291-4ee1-b4ad-c8b75c8d31ca-kube-api-access-67kpf\") pod \"network-metrics-daemon-jj9f8\" (UID: \"9024e35e-a291-4ee1-b4ad-c8b75c8d31ca\") " pod="openshift-multus/network-metrics-daemon-jj9f8"
May 28 10:05:16.044393 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:16.043426    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/9f62bd21-c44c-4022-a4d8-1ffa1422c955-registration-dir\") pod \"aws-ebs-csi-driver-node-78j5q\" (UID: \"9f62bd21-c44c-4022-a4d8-1ffa1422c955\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-78j5q"
May 28 10:05:16.044393 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:16.043451    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2a281715-5613-4b06-9963-0addcc9b432a-system-cni-dir\") pod \"multus-additional-cni-plugins-ck4jd\" (UID: \"2a281715-5613-4b06-9963-0addcc9b432a\") " pod="openshift-multus/multus-additional-cni-plugins-ck4jd"
May 28 10:05:16.044393 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:16.043491    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/2a281715-5613-4b06-9963-0addcc9b432a-cni-binary-copy\") pod \"multus-additional-cni-plugins-ck4jd\" (UID: \"2a281715-5613-4b06-9963-0addcc9b432a\") " pod="openshift-multus/multus-additional-cni-plugins-ck4jd"
May 28 10:05:16.044393 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:16.043514    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/c52e0100-163d-47e8-9414-e07548bc3e37-os-release\") pod \"multus-vwktp\" (UID: \"c52e0100-163d-47e8-9414-e07548bc3e37\") " pod="openshift-multus/multus-vwktp"
May 28 10:05:16.044393 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:16.043537    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fdwsm\" (UniqueName: \"kubernetes.io/projected/b4abbf06-e346-4870-a227-65afbd0db899-kube-api-access-fdwsm\") pod \"node-resolver-8vr88\" (UID: \"b4abbf06-e346-4870-a227-65afbd0db899\") " pod="openshift-dns/node-resolver-8vr88"
May 28 10:05:16.044393 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:16.043557    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/c1d9d1d1-da1a-431d-9baa-2bf4928f94d3-iptables-alerter-script\") pod \"iptables-alerter-q87km\" (UID: \"c1d9d1d1-da1a-431d-9baa-2bf4928f94d3\") " pod="openshift-network-operator/iptables-alerter-q87km"
May 28 10:05:16.044393 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:16.043577    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a5f7c60c-f57b-475b-a97a-32f0e1dbdc5b-sys\") pod \"tuned-8nw9l\" (UID: \"a5f7c60c-f57b-475b-a97a-32f0e1dbdc5b\") " pod="openshift-cluster-node-tuning-operator/tuned-8nw9l"
May 28 10:05:16.044393 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:16.043597    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qdj6s\" (UniqueName: \"kubernetes.io/projected/477435e8-f3a1-4bda-8764-5dd5b8afe64f-kube-api-access-qdj6s\") pod \"network-check-target-kvx8v\" (UID: \"477435e8-f3a1-4bda-8764-5dd5b8afe64f\") " pod="openshift-network-diagnostics/network-check-target-kvx8v"
May 28 10:05:16.044850 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:16.043621    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/9f62bd21-c44c-4022-a4d8-1ffa1422c955-device-dir\") pod \"aws-ebs-csi-driver-node-78j5q\" (UID: \"9f62bd21-c44c-4022-a4d8-1ffa1422c955\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-78j5q"
May 28 10:05:16.044850 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:16.043640    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/2a281715-5613-4b06-9963-0addcc9b432a-tuning-conf-dir\") pod \"multus-additional-cni-plugins-ck4jd\" (UID: \"2a281715-5613-4b06-9963-0addcc9b432a\") " pod="openshift-multus/multus-additional-cni-plugins-ck4jd"
May 28 10:05:16.044850 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:16.043661    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/74f14c89-a025-4bda-ab55-a7a661f2702e-serviceca\") pod \"node-ca-8jmk5\" (UID: \"74f14c89-a025-4bda-ab55-a7a661f2702e\") " pod="openshift-image-registry/node-ca-8jmk5"
May 28 10:05:16.044850 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:16.043682    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/a5f7c60c-f57b-475b-a97a-32f0e1dbdc5b-etc-sysctl-conf\") pod \"tuned-8nw9l\" (UID: \"a5f7c60c-f57b-475b-a97a-32f0e1dbdc5b\") " pod="openshift-cluster-node-tuning-operator/tuned-8nw9l"
May 28 10:05:16.044850 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:16.043696    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/5185dc25-c431-4639-a53a-0c38db5a6f4f-run-systemd\") pod \"ovnkube-node-j4whq\" (UID: \"5185dc25-c431-4639-a53a-0c38db5a6f4f\") " pod="openshift-ovn-kubernetes/ovnkube-node-j4whq"
May 28 10:05:16.044850 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:16.043709    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/5185dc25-c431-4639-a53a-0c38db5a6f4f-node-log\") pod \"ovnkube-node-j4whq\" (UID: \"5185dc25-c431-4639-a53a-0c38db5a6f4f\") " pod="openshift-ovn-kubernetes/ovnkube-node-j4whq"
May 28 10:05:16.044850 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:16.043725    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/5185dc25-c431-4639-a53a-0c38db5a6f4f-ovn-node-metrics-cert\") pod \"ovnkube-node-j4whq\" (UID: \"5185dc25-c431-4639-a53a-0c38db5a6f4f\") " pod="openshift-ovn-kubernetes/ovnkube-node-j4whq"
May 28 10:05:16.044850 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:16.043745    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/c52e0100-163d-47e8-9414-e07548bc3e37-host-var-lib-cni-bin\") pod \"multus-vwktp\" (UID: \"c52e0100-163d-47e8-9414-e07548bc3e37\") " pod="openshift-multus/multus-vwktp"
May 28 10:05:16.044850 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:16.043765    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kwp68\" (UniqueName: \"kubernetes.io/projected/c52e0100-163d-47e8-9414-e07548bc3e37-kube-api-access-kwp68\") pod \"multus-vwktp\" (UID: \"c52e0100-163d-47e8-9414-e07548bc3e37\") " pod="openshift-multus/multus-vwktp"
May 28 10:05:16.044850 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:16.043779    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/b4abbf06-e346-4870-a227-65afbd0db899-hosts-file\") pod \"node-resolver-8vr88\" (UID: \"b4abbf06-e346-4870-a227-65afbd0db899\") " pod="openshift-dns/node-resolver-8vr88"
May 28 10:05:16.044850 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:16.043795    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/5185dc25-c431-4639-a53a-0c38db5a6f4f-ovnkube-config\") pod \"ovnkube-node-j4whq\" (UID: \"5185dc25-c431-4639-a53a-0c38db5a6f4f\") " pod="openshift-ovn-kubernetes/ovnkube-node-j4whq"
May 28 10:05:16.051986 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:16.051955    2565 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kube-system/kube-apiserver-proxy-ip-10-0-128-206.ec2.internal"]
May 28 10:05:16.052589 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:16.052573    2565 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
May 28 10:05:16.052651 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:16.052640    2565 kubelet.go:3340] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-206.ec2.internal"
May 28 10:05:16.054336 ip-10-0-128-206 kubenswrapper[2565]: W0528 10:05:16.054290    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda6772c4d9844f0928036a579dcf5d882.slice/crio-60c3ebacd89eca38af64c0b59ab6886c524826f18e7e827948cb9e91b8de2fb1 WatchSource:0}: Error finding container 60c3ebacd89eca38af64c0b59ab6886c524826f18e7e827948cb9e91b8de2fb1: Status 404 returned error can't find the container with id 60c3ebacd89eca38af64c0b59ab6886c524826f18e7e827948cb9e91b8de2fb1
May 28 10:05:16.054590 ip-10-0-128-206 kubenswrapper[2565]: W0528 10:05:16.054574    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddafcffec46e93c961979dd9c978f3fcd.slice/crio-690f16383aeccba841f870771d87272da44801720a94b43e6bd2458fe8208740 WatchSource:0}: Error finding container 690f16383aeccba841f870771d87272da44801720a94b43e6bd2458fe8208740: Status 404 returned error can't find the container with id 690f16383aeccba841f870771d87272da44801720a94b43e6bd2458fe8208740
May 28 10:05:16.059907 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:16.059891    2565 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
May 28 10:05:16.064875 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:16.064857    2565 reflector.go:430] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
May 28 10:05:16.068142 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:16.068124    2565 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
May 28 10:05:16.068487 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:16.068465    2565 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-206.ec2.internal"]
May 28 10:05:16.085840 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:16.085816    2565 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-05-27 10:00:15 +0000 UTC" deadline="2027-11-14 11:16:39.393308336 +0000 UTC"
May 28 10:05:16.085913 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:16.085840    2565 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="12841h11m23.307471399s"
May 28 10:05:16.108798 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:16.108779    2565 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-g5wdn"
May 28 10:05:16.115945 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:16.115927    2565 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-g5wdn"
May 28 10:05:16.117041 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:16.117026    2565 reflector.go:430] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
May 28 10:05:16.144371 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:16.144344    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/c1d9d1d1-da1a-431d-9baa-2bf4928f94d3-iptables-alerter-script\") pod \"iptables-alerter-q87km\" (UID: \"c1d9d1d1-da1a-431d-9baa-2bf4928f94d3\") " pod="openshift-network-operator/iptables-alerter-q87km"
May 28 10:05:16.144371 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:16.144373    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a5f7c60c-f57b-475b-a97a-32f0e1dbdc5b-sys\") pod \"tuned-8nw9l\" (UID: \"a5f7c60c-f57b-475b-a97a-32f0e1dbdc5b\") " pod="openshift-cluster-node-tuning-operator/tuned-8nw9l"
May 28 10:05:16.144560 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:16.144390    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-qdj6s\" (UniqueName: \"kubernetes.io/projected/477435e8-f3a1-4bda-8764-5dd5b8afe64f-kube-api-access-qdj6s\") pod \"network-check-target-kvx8v\" (UID: \"477435e8-f3a1-4bda-8764-5dd5b8afe64f\") " pod="openshift-network-diagnostics/network-check-target-kvx8v"
May 28 10:05:16.144560 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:16.144405    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/9f62bd21-c44c-4022-a4d8-1ffa1422c955-device-dir\") pod \"aws-ebs-csi-driver-node-78j5q\" (UID: \"9f62bd21-c44c-4022-a4d8-1ffa1422c955\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-78j5q"
May 28 10:05:16.144560 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:16.144470    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a5f7c60c-f57b-475b-a97a-32f0e1dbdc5b-sys\") pod \"tuned-8nw9l\" (UID: \"a5f7c60c-f57b-475b-a97a-32f0e1dbdc5b\") " pod="openshift-cluster-node-tuning-operator/tuned-8nw9l"
May 28 10:05:16.144703 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:16.144598    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/2a281715-5613-4b06-9963-0addcc9b432a-tuning-conf-dir\") pod \"multus-additional-cni-plugins-ck4jd\" (UID: \"2a281715-5613-4b06-9963-0addcc9b432a\") " pod="openshift-multus/multus-additional-cni-plugins-ck4jd"
May 28 10:05:16.144703 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:16.144627    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/74f14c89-a025-4bda-ab55-a7a661f2702e-serviceca\") pod \"node-ca-8jmk5\" (UID: \"74f14c89-a025-4bda-ab55-a7a661f2702e\") " pod="openshift-image-registry/node-ca-8jmk5"
May 28 10:05:16.144703 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:16.144642    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/a5f7c60c-f57b-475b-a97a-32f0e1dbdc5b-etc-sysctl-conf\") pod \"tuned-8nw9l\" (UID: \"a5f7c60c-f57b-475b-a97a-32f0e1dbdc5b\") " pod="openshift-cluster-node-tuning-operator/tuned-8nw9l"
May 28 10:05:16.144703 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:16.144658    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/5185dc25-c431-4639-a53a-0c38db5a6f4f-run-systemd\") pod \"ovnkube-node-j4whq\" (UID: \"5185dc25-c431-4639-a53a-0c38db5a6f4f\") " pod="openshift-ovn-kubernetes/ovnkube-node-j4whq"
May 28 10:05:16.144703 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:16.144676    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/5185dc25-c431-4639-a53a-0c38db5a6f4f-node-log\") pod \"ovnkube-node-j4whq\" (UID: \"5185dc25-c431-4639-a53a-0c38db5a6f4f\") " pod="openshift-ovn-kubernetes/ovnkube-node-j4whq"
May 28 10:05:16.144703 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:16.144603    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/9f62bd21-c44c-4022-a4d8-1ffa1422c955-device-dir\") pod \"aws-ebs-csi-driver-node-78j5q\" (UID: \"9f62bd21-c44c-4022-a4d8-1ffa1422c955\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-78j5q"
May 28 10:05:16.144978 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:16.144727    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/2a281715-5613-4b06-9963-0addcc9b432a-tuning-conf-dir\") pod \"multus-additional-cni-plugins-ck4jd\" (UID: \"2a281715-5613-4b06-9963-0addcc9b432a\") " pod="openshift-multus/multus-additional-cni-plugins-ck4jd"
May 28 10:05:16.144978 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:16.144735    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/5185dc25-c431-4639-a53a-0c38db5a6f4f-run-systemd\") pod \"ovnkube-node-j4whq\" (UID: \"5185dc25-c431-4639-a53a-0c38db5a6f4f\") " pod="openshift-ovn-kubernetes/ovnkube-node-j4whq"
May 28 10:05:16.144978 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:16.144765    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/5185dc25-c431-4639-a53a-0c38db5a6f4f-ovn-node-metrics-cert\") pod \"ovnkube-node-j4whq\" (UID: \"5185dc25-c431-4639-a53a-0c38db5a6f4f\") " pod="openshift-ovn-kubernetes/ovnkube-node-j4whq"
May 28 10:05:16.144978 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:16.144766    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/5185dc25-c431-4639-a53a-0c38db5a6f4f-node-log\") pod \"ovnkube-node-j4whq\" (UID: \"5185dc25-c431-4639-a53a-0c38db5a6f4f\") " pod="openshift-ovn-kubernetes/ovnkube-node-j4whq"
May 28 10:05:16.144978 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:16.144790    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/c52e0100-163d-47e8-9414-e07548bc3e37-host-var-lib-cni-bin\") pod \"multus-vwktp\" (UID: \"c52e0100-163d-47e8-9414-e07548bc3e37\") " pod="openshift-multus/multus-vwktp"
May 28 10:05:16.144978 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:16.144832    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/a5f7c60c-f57b-475b-a97a-32f0e1dbdc5b-etc-sysctl-conf\") pod \"tuned-8nw9l\" (UID: \"a5f7c60c-f57b-475b-a97a-32f0e1dbdc5b\") " pod="openshift-cluster-node-tuning-operator/tuned-8nw9l"
May 28 10:05:16.144978 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:16.144841    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-kwp68\" (UniqueName: \"kubernetes.io/projected/c52e0100-163d-47e8-9414-e07548bc3e37-kube-api-access-kwp68\") pod \"multus-vwktp\" (UID: \"c52e0100-163d-47e8-9414-e07548bc3e37\") " pod="openshift-multus/multus-vwktp"
May 28 10:05:16.144978 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:16.144884    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/b4abbf06-e346-4870-a227-65afbd0db899-hosts-file\") pod \"node-resolver-8vr88\" (UID: \"b4abbf06-e346-4870-a227-65afbd0db899\") " pod="openshift-dns/node-resolver-8vr88"
May 28 10:05:16.144978 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:16.144835    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/c52e0100-163d-47e8-9414-e07548bc3e37-host-var-lib-cni-bin\") pod \"multus-vwktp\" (UID: \"c52e0100-163d-47e8-9414-e07548bc3e37\") " pod="openshift-multus/multus-vwktp"
May 28 10:05:16.144978 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:16.144913    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/5185dc25-c431-4639-a53a-0c38db5a6f4f-ovnkube-config\") pod \"ovnkube-node-j4whq\" (UID: \"5185dc25-c431-4639-a53a-0c38db5a6f4f\") " pod="openshift-ovn-kubernetes/ovnkube-node-j4whq"
May 28 10:05:16.144978 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:16.144948    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/c52e0100-163d-47e8-9414-e07548bc3e37-multus-socket-dir-parent\") pod \"multus-vwktp\" (UID: \"c52e0100-163d-47e8-9414-e07548bc3e37\") " pod="openshift-multus/multus-vwktp"
May 28 10:05:16.144978 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:16.144975    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/5185dc25-c431-4639-a53a-0c38db5a6f4f-var-lib-openvswitch\") pod \"ovnkube-node-j4whq\" (UID: \"5185dc25-c431-4639-a53a-0c38db5a6f4f\") " pod="openshift-ovn-kubernetes/ovnkube-node-j4whq"
May 28 10:05:16.145494 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:16.144997    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/2a281715-5613-4b06-9963-0addcc9b432a-os-release\") pod \"multus-additional-cni-plugins-ck4jd\" (UID: \"2a281715-5613-4b06-9963-0addcc9b432a\") " pod="openshift-multus/multus-additional-cni-plugins-ck4jd"
May 28 10:05:16.145494 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:16.145022    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c52e0100-163d-47e8-9414-e07548bc3e37-system-cni-dir\") pod \"multus-vwktp\" (UID: \"c52e0100-163d-47e8-9414-e07548bc3e37\") " pod="openshift-multus/multus-vwktp"
May 28 10:05:16.145494 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:16.145027    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/c1d9d1d1-da1a-431d-9baa-2bf4928f94d3-iptables-alerter-script\") pod \"iptables-alerter-q87km\" (UID: \"c1d9d1d1-da1a-431d-9baa-2bf4928f94d3\") " pod="openshift-network-operator/iptables-alerter-q87km"
May 28 10:05:16.145494 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:16.145044    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/c52e0100-163d-47e8-9414-e07548bc3e37-host-run-k8s-cni-cncf-io\") pod \"multus-vwktp\" (UID: \"c52e0100-163d-47e8-9414-e07548bc3e37\") " pod="openshift-multus/multus-vwktp"
May 28 10:05:16.145494 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:16.145072    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b4abbf06-e346-4870-a227-65afbd0db899-tmp-dir\") pod \"node-resolver-8vr88\" (UID: \"b4abbf06-e346-4870-a227-65afbd0db899\") " pod="openshift-dns/node-resolver-8vr88"
May 28 10:05:16.145494 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:16.145090    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/5185dc25-c431-4639-a53a-0c38db5a6f4f-var-lib-openvswitch\") pod \"ovnkube-node-j4whq\" (UID: \"5185dc25-c431-4639-a53a-0c38db5a6f4f\") " pod="openshift-ovn-kubernetes/ovnkube-node-j4whq"
May 28 10:05:16.145494 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:16.145090    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/74f14c89-a025-4bda-ab55-a7a661f2702e-serviceca\") pod \"node-ca-8jmk5\" (UID: \"74f14c89-a025-4bda-ab55-a7a661f2702e\") " pod="openshift-image-registry/node-ca-8jmk5"
May 28 10:05:16.145494 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:16.145039    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/c52e0100-163d-47e8-9414-e07548bc3e37-multus-socket-dir-parent\") pod \"multus-vwktp\" (UID: \"c52e0100-163d-47e8-9414-e07548bc3e37\") " pod="openshift-multus/multus-vwktp"
May 28 10:05:16.145494 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:16.145113    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/2a281715-5613-4b06-9963-0addcc9b432a-os-release\") pod \"multus-additional-cni-plugins-ck4jd\" (UID: \"2a281715-5613-4b06-9963-0addcc9b432a\") " pod="openshift-multus/multus-additional-cni-plugins-ck4jd"
May 28 10:05:16.145494 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:16.145096    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/a5f7c60c-f57b-475b-a97a-32f0e1dbdc5b-etc-sysctl-d\") pod \"tuned-8nw9l\" (UID: \"a5f7c60c-f57b-475b-a97a-32f0e1dbdc5b\") " pod="openshift-cluster-node-tuning-operator/tuned-8nw9l"
May 28 10:05:16.145494 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:16.145136    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/c52e0100-163d-47e8-9414-e07548bc3e37-host-run-k8s-cni-cncf-io\") pod \"multus-vwktp\" (UID: \"c52e0100-163d-47e8-9414-e07548bc3e37\") " pod="openshift-multus/multus-vwktp"
May 28 10:05:16.145494 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:16.145147    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c52e0100-163d-47e8-9414-e07548bc3e37-system-cni-dir\") pod \"multus-vwktp\" (UID: \"c52e0100-163d-47e8-9414-e07548bc3e37\") " pod="openshift-multus/multus-vwktp"
May 28 10:05:16.145494 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:16.144978    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/b4abbf06-e346-4870-a227-65afbd0db899-hosts-file\") pod \"node-resolver-8vr88\" (UID: \"b4abbf06-e346-4870-a227-65afbd0db899\") " pod="openshift-dns/node-resolver-8vr88"
May 28 10:05:16.145494 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:16.145140    2565 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
May 28 10:05:16.145494 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:16.145170    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-2gns7\" (UniqueName: \"kubernetes.io/projected/2a281715-5613-4b06-9963-0addcc9b432a-kube-api-access-2gns7\") pod \"multus-additional-cni-plugins-ck4jd\" (UID: \"2a281715-5613-4b06-9963-0addcc9b432a\") " pod="openshift-multus/multus-additional-cni-plugins-ck4jd"
May 28 10:05:16.145494 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:16.145198    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/c52e0100-163d-47e8-9414-e07548bc3e37-host-run-multus-certs\") pod \"multus-vwktp\" (UID: \"c52e0100-163d-47e8-9414-e07548bc3e37\") " pod="openshift-multus/multus-vwktp"
May 28 10:05:16.145494 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:16.145224    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c52e0100-163d-47e8-9414-e07548bc3e37-etc-kubernetes\") pod \"multus-vwktp\" (UID: \"c52e0100-163d-47e8-9414-e07548bc3e37\") " pod="openshift-multus/multus-vwktp"
May 28 10:05:16.145494 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:16.145263    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c52e0100-163d-47e8-9414-e07548bc3e37-etc-kubernetes\") pod \"multus-vwktp\" (UID: \"c52e0100-163d-47e8-9414-e07548bc3e37\") " pod="openshift-multus/multus-vwktp"
May 28 10:05:16.146389 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:16.145269    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/c52e0100-163d-47e8-9414-e07548bc3e37-host-run-multus-certs\") pod \"multus-vwktp\" (UID: \"c52e0100-163d-47e8-9414-e07548bc3e37\") " pod="openshift-multus/multus-vwktp"
May 28 10:05:16.146389 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:16.145259    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/a5f7c60c-f57b-475b-a97a-32f0e1dbdc5b-etc-sysctl-d\") pod \"tuned-8nw9l\" (UID: \"a5f7c60c-f57b-475b-a97a-32f0e1dbdc5b\") " pod="openshift-cluster-node-tuning-operator/tuned-8nw9l"
May 28 10:05:16.146389 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:16.145294    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/a5f7c60c-f57b-475b-a97a-32f0e1dbdc5b-etc-modprobe-d\") pod \"tuned-8nw9l\" (UID: \"a5f7c60c-f57b-475b-a97a-32f0e1dbdc5b\") " pod="openshift-cluster-node-tuning-operator/tuned-8nw9l"
May 28 10:05:16.146389 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:16.145350    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/a5f7c60c-f57b-475b-a97a-32f0e1dbdc5b-host\") pod \"tuned-8nw9l\" (UID: \"a5f7c60c-f57b-475b-a97a-32f0e1dbdc5b\") " pod="openshift-cluster-node-tuning-operator/tuned-8nw9l"
May 28 10:05:16.146389 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:16.145360    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b4abbf06-e346-4870-a227-65afbd0db899-tmp-dir\") pod \"node-resolver-8vr88\" (UID: \"b4abbf06-e346-4870-a227-65afbd0db899\") " pod="openshift-dns/node-resolver-8vr88"
May 28 10:05:16.146389 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:16.145375    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/5185dc25-c431-4639-a53a-0c38db5a6f4f-etc-openvswitch\") pod \"ovnkube-node-j4whq\" (UID: \"5185dc25-c431-4639-a53a-0c38db5a6f4f\") " pod="openshift-ovn-kubernetes/ovnkube-node-j4whq"
May 28 10:05:16.146389 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:16.145398    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/5185dc25-c431-4639-a53a-0c38db5a6f4f-run-ovn\") pod \"ovnkube-node-j4whq\" (UID: \"5185dc25-c431-4639-a53a-0c38db5a6f4f\") " pod="openshift-ovn-kubernetes/ovnkube-node-j4whq"
May 28 10:05:16.146389 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:16.145421    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/a5f7c60c-f57b-475b-a97a-32f0e1dbdc5b-etc-modprobe-d\") pod \"tuned-8nw9l\" (UID: \"a5f7c60c-f57b-475b-a97a-32f0e1dbdc5b\") " pod="openshift-cluster-node-tuning-operator/tuned-8nw9l"
May 28 10:05:16.146389 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:16.145433    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/5185dc25-c431-4639-a53a-0c38db5a6f4f-log-socket\") pod \"ovnkube-node-j4whq\" (UID: \"5185dc25-c431-4639-a53a-0c38db5a6f4f\") " pod="openshift-ovn-kubernetes/ovnkube-node-j4whq"
May 28 10:05:16.146389 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:16.145446    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/a5f7c60c-f57b-475b-a97a-32f0e1dbdc5b-host\") pod \"tuned-8nw9l\" (UID: \"a5f7c60c-f57b-475b-a97a-32f0e1dbdc5b\") " pod="openshift-cluster-node-tuning-operator/tuned-8nw9l"
May 28 10:05:16.146389 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:16.145424    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/5185dc25-c431-4639-a53a-0c38db5a6f4f-etc-openvswitch\") pod \"ovnkube-node-j4whq\" (UID: \"5185dc25-c431-4639-a53a-0c38db5a6f4f\") " pod="openshift-ovn-kubernetes/ovnkube-node-j4whq"
May 28 10:05:16.146389 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:16.145462    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-cq8kb\" (UniqueName: \"kubernetes.io/projected/9f62bd21-c44c-4022-a4d8-1ffa1422c955-kube-api-access-cq8kb\") pod \"aws-ebs-csi-driver-node-78j5q\" (UID: \"9f62bd21-c44c-4022-a4d8-1ffa1422c955\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-78j5q"
May 28 10:05:16.146389 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:16.145446    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/5185dc25-c431-4639-a53a-0c38db5a6f4f-run-ovn\") pod \"ovnkube-node-j4whq\" (UID: \"5185dc25-c431-4639-a53a-0c38db5a6f4f\") " pod="openshift-ovn-kubernetes/ovnkube-node-j4whq"
May 28 10:05:16.146389 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:16.145470    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/5185dc25-c431-4639-a53a-0c38db5a6f4f-ovnkube-config\") pod \"ovnkube-node-j4whq\" (UID: \"5185dc25-c431-4639-a53a-0c38db5a6f4f\") " pod="openshift-ovn-kubernetes/ovnkube-node-j4whq"
May 28 10:05:16.146389 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:16.145488    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/5185dc25-c431-4639-a53a-0c38db5a6f4f-log-socket\") pod \"ovnkube-node-j4whq\" (UID: \"5185dc25-c431-4639-a53a-0c38db5a6f4f\") " pod="openshift-ovn-kubernetes/ovnkube-node-j4whq"
May 28 10:05:16.146389 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:16.145500    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/c52e0100-163d-47e8-9414-e07548bc3e37-host-run-netns\") pod \"multus-vwktp\" (UID: \"c52e0100-163d-47e8-9414-e07548bc3e37\") " pod="openshift-multus/multus-vwktp"
May 28 10:05:16.146389 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:16.145531    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/c52e0100-163d-47e8-9414-e07548bc3e37-host-run-netns\") pod \"multus-vwktp\" (UID: \"c52e0100-163d-47e8-9414-e07548bc3e37\") " pod="openshift-multus/multus-vwktp"
May 28 10:05:16.146389 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:16.145532    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/c925ed8e-f4ec-45e6-bfa6-2128a0947aca-agent-certs\") pod \"konnectivity-agent-6qpxx\" (UID: \"c925ed8e-f4ec-45e6-bfa6-2128a0947aca\") " pod="kube-system/konnectivity-agent-6qpxx"
May 28 10:05:16.147148 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:16.145578    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/5185dc25-c431-4639-a53a-0c38db5a6f4f-host-run-netns\") pod \"ovnkube-node-j4whq\" (UID: \"5185dc25-c431-4639-a53a-0c38db5a6f4f\") " pod="openshift-ovn-kubernetes/ovnkube-node-j4whq"
May 28 10:05:16.147148 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:16.145602    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/5185dc25-c431-4639-a53a-0c38db5a6f4f-host-cni-netd\") pod \"ovnkube-node-j4whq\" (UID: \"5185dc25-c431-4639-a53a-0c38db5a6f4f\") " pod="openshift-ovn-kubernetes/ovnkube-node-j4whq"
May 28 10:05:16.147148 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:16.145643    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/9f62bd21-c44c-4022-a4d8-1ffa1422c955-kubelet-dir\") pod \"aws-ebs-csi-driver-node-78j5q\" (UID: \"9f62bd21-c44c-4022-a4d8-1ffa1422c955\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-78j5q"
May 28 10:05:16.147148 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:16.145667    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/c52e0100-163d-47e8-9414-e07548bc3e37-host-var-lib-cni-multus\") pod \"multus-vwktp\" (UID: \"c52e0100-163d-47e8-9414-e07548bc3e37\") " pod="openshift-multus/multus-vwktp"
May 28 10:05:16.147148 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:16.145669    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/5185dc25-c431-4639-a53a-0c38db5a6f4f-host-run-netns\") pod \"ovnkube-node-j4whq\" (UID: \"5185dc25-c431-4639-a53a-0c38db5a6f4f\") " pod="openshift-ovn-kubernetes/ovnkube-node-j4whq"
May 28 10:05:16.147148 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:16.145675    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/5185dc25-c431-4639-a53a-0c38db5a6f4f-host-cni-netd\") pod \"ovnkube-node-j4whq\" (UID: \"5185dc25-c431-4639-a53a-0c38db5a6f4f\") " pod="openshift-ovn-kubernetes/ovnkube-node-j4whq"
May 28 10:05:16.147148 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:16.145692    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/c52e0100-163d-47e8-9414-e07548bc3e37-hostroot\") pod \"multus-vwktp\" (UID: \"c52e0100-163d-47e8-9414-e07548bc3e37\") " pod="openshift-multus/multus-vwktp"
May 28 10:05:16.147148 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:16.145718    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-rhgm5\" (UniqueName: \"kubernetes.io/projected/c1d9d1d1-da1a-431d-9baa-2bf4928f94d3-kube-api-access-rhgm5\") pod \"iptables-alerter-q87km\" (UID: \"c1d9d1d1-da1a-431d-9baa-2bf4928f94d3\") " pod="openshift-network-operator/iptables-alerter-q87km"
May 28 10:05:16.147148 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:16.145723    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/c52e0100-163d-47e8-9414-e07548bc3e37-host-var-lib-cni-multus\") pod \"multus-vwktp\" (UID: \"c52e0100-163d-47e8-9414-e07548bc3e37\") " pod="openshift-multus/multus-vwktp"
May 28 10:05:16.147148 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:16.145733    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/9f62bd21-c44c-4022-a4d8-1ffa1422c955-kubelet-dir\") pod \"aws-ebs-csi-driver-node-78j5q\" (UID: \"9f62bd21-c44c-4022-a4d8-1ffa1422c955\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-78j5q"
May 28 10:05:16.147148 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:16.145740    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/c52e0100-163d-47e8-9414-e07548bc3e37-hostroot\") pod \"multus-vwktp\" (UID: \"c52e0100-163d-47e8-9414-e07548bc3e37\") " pod="openshift-multus/multus-vwktp"
May 28 10:05:16.147148 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:16.145751    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/5185dc25-c431-4639-a53a-0c38db5a6f4f-host-kubelet\") pod \"ovnkube-node-j4whq\" (UID: \"5185dc25-c431-4639-a53a-0c38db5a6f4f\") " pod="openshift-ovn-kubernetes/ovnkube-node-j4whq"
May 28 10:05:16.147148 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:16.145778    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5185dc25-c431-4639-a53a-0c38db5a6f4f-host-run-ovn-kubernetes\") pod \"ovnkube-node-j4whq\" (UID: \"5185dc25-c431-4639-a53a-0c38db5a6f4f\") " pod="openshift-ovn-kubernetes/ovnkube-node-j4whq"
May 28 10:05:16.147148 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:16.145781    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/5185dc25-c431-4639-a53a-0c38db5a6f4f-host-kubelet\") pod \"ovnkube-node-j4whq\" (UID: \"5185dc25-c431-4639-a53a-0c38db5a6f4f\") " pod="openshift-ovn-kubernetes/ovnkube-node-j4whq"
May 28 10:05:16.147148 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:16.145803    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/5185dc25-c431-4639-a53a-0c38db5a6f4f-host-cni-bin\") pod \"ovnkube-node-j4whq\" (UID: \"5185dc25-c431-4639-a53a-0c38db5a6f4f\") " pod="openshift-ovn-kubernetes/ovnkube-node-j4whq"
May 28 10:05:16.147148 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:16.145820    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5185dc25-c431-4639-a53a-0c38db5a6f4f-host-run-ovn-kubernetes\") pod \"ovnkube-node-j4whq\" (UID: \"5185dc25-c431-4639-a53a-0c38db5a6f4f\") " pod="openshift-ovn-kubernetes/ovnkube-node-j4whq"
May 28 10:05:16.147148 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:16.145827    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/c1d9d1d1-da1a-431d-9baa-2bf4928f94d3-host-slash\") pod \"iptables-alerter-q87km\" (UID: \"c1d9d1d1-da1a-431d-9baa-2bf4928f94d3\") " pod="openshift-network-operator/iptables-alerter-q87km"
May 28 10:05:16.147926 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:16.145862    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/5185dc25-c431-4639-a53a-0c38db5a6f4f-host-cni-bin\") pod \"ovnkube-node-j4whq\" (UID: \"5185dc25-c431-4639-a53a-0c38db5a6f4f\") " pod="openshift-ovn-kubernetes/ovnkube-node-j4whq"
May 28 10:05:16.147926 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:16.145871    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/c1d9d1d1-da1a-431d-9baa-2bf4928f94d3-host-slash\") pod \"iptables-alerter-q87km\" (UID: \"c1d9d1d1-da1a-431d-9baa-2bf4928f94d3\") " pod="openshift-network-operator/iptables-alerter-q87km"
May 28 10:05:16.147926 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:16.145887    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a5f7c60c-f57b-475b-a97a-32f0e1dbdc5b-var-lib-kubelet\") pod \"tuned-8nw9l\" (UID: \"a5f7c60c-f57b-475b-a97a-32f0e1dbdc5b\") " pod="openshift-cluster-node-tuning-operator/tuned-8nw9l"
May 28 10:05:16.147926 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:16.145911    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/9f62bd21-c44c-4022-a4d8-1ffa1422c955-socket-dir\") pod \"aws-ebs-csi-driver-node-78j5q\" (UID: \"9f62bd21-c44c-4022-a4d8-1ffa1422c955\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-78j5q"
May 28 10:05:16.147926 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:16.145929    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c52e0100-163d-47e8-9414-e07548bc3e37-host-var-lib-kubelet\") pod \"multus-vwktp\" (UID: \"c52e0100-163d-47e8-9414-e07548bc3e37\") " pod="openshift-multus/multus-vwktp"
May 28 10:05:16.147926 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:16.145944    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9024e35e-a291-4ee1-b4ad-c8b75c8d31ca-metrics-certs\") pod \"network-metrics-daemon-jj9f8\" (UID: \"9024e35e-a291-4ee1-b4ad-c8b75c8d31ca\") " pod="openshift-multus/network-metrics-daemon-jj9f8"
May 28 10:05:16.147926 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:16.145946    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a5f7c60c-f57b-475b-a97a-32f0e1dbdc5b-var-lib-kubelet\") pod \"tuned-8nw9l\" (UID: \"a5f7c60c-f57b-475b-a97a-32f0e1dbdc5b\") " pod="openshift-cluster-node-tuning-operator/tuned-8nw9l"
May 28 10:05:16.147926 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:16.145970    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/5185dc25-c431-4639-a53a-0c38db5a6f4f-systemd-units\") pod \"ovnkube-node-j4whq\" (UID: \"5185dc25-c431-4639-a53a-0c38db5a6f4f\") " pod="openshift-ovn-kubernetes/ovnkube-node-j4whq"
May 28 10:05:16.147926 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:16.145975    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c52e0100-163d-47e8-9414-e07548bc3e37-host-var-lib-kubelet\") pod \"multus-vwktp\" (UID: \"c52e0100-163d-47e8-9414-e07548bc3e37\") " pod="openshift-multus/multus-vwktp"
May 28 10:05:16.147926 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:16.146002    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/9f62bd21-c44c-4022-a4d8-1ffa1422c955-socket-dir\") pod \"aws-ebs-csi-driver-node-78j5q\" (UID: \"9f62bd21-c44c-4022-a4d8-1ffa1422c955\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-78j5q"
May 28 10:05:16.147926 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:16.146022    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/5185dc25-c431-4639-a53a-0c38db5a6f4f-host-slash\") pod \"ovnkube-node-j4whq\" (UID: \"5185dc25-c431-4639-a53a-0c38db5a6f4f\") " pod="openshift-ovn-kubernetes/ovnkube-node-j4whq"
May 28 10:05:16.147926 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:16.146053    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/5185dc25-c431-4639-a53a-0c38db5a6f4f-run-openvswitch\") pod \"ovnkube-node-j4whq\" (UID: \"5185dc25-c431-4639-a53a-0c38db5a6f4f\") " pod="openshift-ovn-kubernetes/ovnkube-node-j4whq"
May 28 10:05:16.147926 ip-10-0-128-206 kubenswrapper[2565]: E0528 10:05:16.146085    2565 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
May 28 10:05:16.147926 ip-10-0-128-206 kubenswrapper[2565]: E0528 10:05:16.146196    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9024e35e-a291-4ee1-b4ad-c8b75c8d31ca-metrics-certs podName:9024e35e-a291-4ee1-b4ad-c8b75c8d31ca nodeName:}" failed. No retries permitted until 2026-05-28 10:05:16.64615231 +0000 UTC m=+2.106486438 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/9024e35e-a291-4ee1-b4ad-c8b75c8d31ca-metrics-certs") pod "network-metrics-daemon-jj9f8" (UID: "9024e35e-a291-4ee1-b4ad-c8b75c8d31ca") : object "openshift-multus"/"metrics-daemon-secret" not registered
May 28 10:05:16.147926 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:16.146215    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/5185dc25-c431-4639-a53a-0c38db5a6f4f-host-slash\") pod \"ovnkube-node-j4whq\" (UID: \"5185dc25-c431-4639-a53a-0c38db5a6f4f\") " pod="openshift-ovn-kubernetes/ovnkube-node-j4whq"
May 28 10:05:16.147926 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:16.146216    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/5185dc25-c431-4639-a53a-0c38db5a6f4f-run-openvswitch\") pod \"ovnkube-node-j4whq\" (UID: \"5185dc25-c431-4639-a53a-0c38db5a6f4f\") " pod="openshift-ovn-kubernetes/ovnkube-node-j4whq"
May 28 10:05:16.147926 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:16.146216    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5185dc25-c431-4639-a53a-0c38db5a6f4f-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-j4whq\" (UID: \"5185dc25-c431-4639-a53a-0c38db5a6f4f\") " pod="openshift-ovn-kubernetes/ovnkube-node-j4whq"
May 28 10:05:16.148643 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:16.146258    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/5185dc25-c431-4639-a53a-0c38db5a6f4f-systemd-units\") pod \"ovnkube-node-j4whq\" (UID: \"5185dc25-c431-4639-a53a-0c38db5a6f4f\") " pod="openshift-ovn-kubernetes/ovnkube-node-j4whq"
May 28 10:05:16.148643 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:16.146266    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/5185dc25-c431-4639-a53a-0c38db5a6f4f-ovnkube-script-lib\") pod \"ovnkube-node-j4whq\" (UID: \"5185dc25-c431-4639-a53a-0c38db5a6f4f\") " pod="openshift-ovn-kubernetes/ovnkube-node-j4whq"
May 28 10:05:16.148643 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:16.146292    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/2a281715-5613-4b06-9963-0addcc9b432a-cnibin\") pod \"multus-additional-cni-plugins-ck4jd\" (UID: \"2a281715-5613-4b06-9963-0addcc9b432a\") " pod="openshift-multus/multus-additional-cni-plugins-ck4jd"
May 28 10:05:16.148643 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:16.146295    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5185dc25-c431-4639-a53a-0c38db5a6f4f-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-j4whq\" (UID: \"5185dc25-c431-4639-a53a-0c38db5a6f4f\") " pod="openshift-ovn-kubernetes/ovnkube-node-j4whq"
May 28 10:05:16.148643 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:16.146344    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/c52e0100-163d-47e8-9414-e07548bc3e37-multus-daemon-config\") pod \"multus-vwktp\" (UID: \"c52e0100-163d-47e8-9414-e07548bc3e37\") " pod="openshift-multus/multus-vwktp"
May 28 10:05:16.148643 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:16.146359    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/2a281715-5613-4b06-9963-0addcc9b432a-cnibin\") pod \"multus-additional-cni-plugins-ck4jd\" (UID: \"2a281715-5613-4b06-9963-0addcc9b432a\") " pod="openshift-multus/multus-additional-cni-plugins-ck4jd"
May 28 10:05:16.148643 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:16.146371    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-7vnbz\" (UniqueName: \"kubernetes.io/projected/a5f7c60c-f57b-475b-a97a-32f0e1dbdc5b-kube-api-access-7vnbz\") pod \"tuned-8nw9l\" (UID: \"a5f7c60c-f57b-475b-a97a-32f0e1dbdc5b\") " pod="openshift-cluster-node-tuning-operator/tuned-8nw9l"
May 28 10:05:16.148643 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:16.146411    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/5185dc25-c431-4639-a53a-0c38db5a6f4f-env-overrides\") pod \"ovnkube-node-j4whq\" (UID: \"5185dc25-c431-4639-a53a-0c38db5a6f4f\") " pod="openshift-ovn-kubernetes/ovnkube-node-j4whq"
May 28 10:05:16.148643 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:16.146436    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/2a281715-5613-4b06-9963-0addcc9b432a-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-ck4jd\" (UID: \"2a281715-5613-4b06-9963-0addcc9b432a\") " pod="openshift-multus/multus-additional-cni-plugins-ck4jd"
May 28 10:05:16.148643 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:16.146460    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-lxwtn\" (UniqueName: \"kubernetes.io/projected/74f14c89-a025-4bda-ab55-a7a661f2702e-kube-api-access-lxwtn\") pod \"node-ca-8jmk5\" (UID: \"74f14c89-a025-4bda-ab55-a7a661f2702e\") " pod="openshift-image-registry/node-ca-8jmk5"
May 28 10:05:16.148643 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:16.146483    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/a5f7c60c-f57b-475b-a97a-32f0e1dbdc5b-etc-sysconfig\") pod \"tuned-8nw9l\" (UID: \"a5f7c60c-f57b-475b-a97a-32f0e1dbdc5b\") " pod="openshift-cluster-node-tuning-operator/tuned-8nw9l"
May 28 10:05:16.148643 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:16.146504    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/a5f7c60c-f57b-475b-a97a-32f0e1dbdc5b-lib-modules\") pod \"tuned-8nw9l\" (UID: \"a5f7c60c-f57b-475b-a97a-32f0e1dbdc5b\") " pod="openshift-cluster-node-tuning-operator/tuned-8nw9l"
May 28 10:05:16.148643 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:16.146528    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-v29s6\" (UniqueName: \"kubernetes.io/projected/5185dc25-c431-4639-a53a-0c38db5a6f4f-kube-api-access-v29s6\") pod \"ovnkube-node-j4whq\" (UID: \"5185dc25-c431-4639-a53a-0c38db5a6f4f\") " pod="openshift-ovn-kubernetes/ovnkube-node-j4whq"
May 28 10:05:16.148643 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:16.146553    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/a5f7c60c-f57b-475b-a97a-32f0e1dbdc5b-etc-systemd\") pod \"tuned-8nw9l\" (UID: \"a5f7c60c-f57b-475b-a97a-32f0e1dbdc5b\") " pod="openshift-cluster-node-tuning-operator/tuned-8nw9l"
May 28 10:05:16.148643 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:16.146579    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a5f7c60c-f57b-475b-a97a-32f0e1dbdc5b-tmp\") pod \"tuned-8nw9l\" (UID: \"a5f7c60c-f57b-475b-a97a-32f0e1dbdc5b\") " pod="openshift-cluster-node-tuning-operator/tuned-8nw9l"
May 28 10:05:16.148643 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:16.146593    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/a5f7c60c-f57b-475b-a97a-32f0e1dbdc5b-etc-sysconfig\") pod \"tuned-8nw9l\" (UID: \"a5f7c60c-f57b-475b-a97a-32f0e1dbdc5b\") " pod="openshift-cluster-node-tuning-operator/tuned-8nw9l"
May 28 10:05:16.148643 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:16.146603    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/9f62bd21-c44c-4022-a4d8-1ffa1422c955-sys-fs\") pod \"aws-ebs-csi-driver-node-78j5q\" (UID: \"9f62bd21-c44c-4022-a4d8-1ffa1422c955\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-78j5q"
May 28 10:05:16.149238 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:16.146625    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/c52e0100-163d-47e8-9414-e07548bc3e37-multus-conf-dir\") pod \"multus-vwktp\" (UID: \"c52e0100-163d-47e8-9414-e07548bc3e37\") " pod="openshift-multus/multus-vwktp"
May 28 10:05:16.149238 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:16.146649    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a5f7c60c-f57b-475b-a97a-32f0e1dbdc5b-etc-kubernetes\") pod \"tuned-8nw9l\" (UID: \"a5f7c60c-f57b-475b-a97a-32f0e1dbdc5b\") " pod="openshift-cluster-node-tuning-operator/tuned-8nw9l"
May 28 10:05:16.149238 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:16.146672    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/a5f7c60c-f57b-475b-a97a-32f0e1dbdc5b-run\") pod \"tuned-8nw9l\" (UID: \"a5f7c60c-f57b-475b-a97a-32f0e1dbdc5b\") " pod="openshift-cluster-node-tuning-operator/tuned-8nw9l"
May 28 10:05:16.149238 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:16.146695    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/9f62bd21-c44c-4022-a4d8-1ffa1422c955-etc-selinux\") pod \"aws-ebs-csi-driver-node-78j5q\" (UID: \"9f62bd21-c44c-4022-a4d8-1ffa1422c955\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-78j5q"
May 28 10:05:16.149238 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:16.146718    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c52e0100-163d-47e8-9414-e07548bc3e37-multus-cni-dir\") pod \"multus-vwktp\" (UID: \"c52e0100-163d-47e8-9414-e07548bc3e37\") " pod="openshift-multus/multus-vwktp"
May 28 10:05:16.149238 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:16.146742    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/c52e0100-163d-47e8-9414-e07548bc3e37-cni-binary-copy\") pod \"multus-vwktp\" (UID: \"c52e0100-163d-47e8-9414-e07548bc3e37\") " pod="openshift-multus/multus-vwktp"
May 28 10:05:16.149238 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:16.146764    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/a5f7c60c-f57b-475b-a97a-32f0e1dbdc5b-etc-tuned\") pod \"tuned-8nw9l\" (UID: \"a5f7c60c-f57b-475b-a97a-32f0e1dbdc5b\") " pod="openshift-cluster-node-tuning-operator/tuned-8nw9l"
May 28 10:05:16.149238 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:16.146791    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/2a281715-5613-4b06-9963-0addcc9b432a-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-ck4jd\" (UID: \"2a281715-5613-4b06-9963-0addcc9b432a\") " pod="openshift-multus/multus-additional-cni-plugins-ck4jd"
May 28 10:05:16.149238 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:16.146812    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/c52e0100-163d-47e8-9414-e07548bc3e37-cnibin\") pod \"multus-vwktp\" (UID: \"c52e0100-163d-47e8-9414-e07548bc3e37\") " pod="openshift-multus/multus-vwktp"
May 28 10:05:16.149238 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:16.146837    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/c925ed8e-f4ec-45e6-bfa6-2128a0947aca-konnectivity-ca\") pod \"konnectivity-agent-6qpxx\" (UID: \"c925ed8e-f4ec-45e6-bfa6-2128a0947aca\") " pod="kube-system/konnectivity-agent-6qpxx"
May 28 10:05:16.149238 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:16.146879    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/74f14c89-a025-4bda-ab55-a7a661f2702e-host\") pod \"node-ca-8jmk5\" (UID: \"74f14c89-a025-4bda-ab55-a7a661f2702e\") " pod="openshift-image-registry/node-ca-8jmk5"
May 28 10:05:16.149238 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:16.146911    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/c52e0100-163d-47e8-9414-e07548bc3e37-multus-daemon-config\") pod \"multus-vwktp\" (UID: \"c52e0100-163d-47e8-9414-e07548bc3e37\") " pod="openshift-multus/multus-vwktp"
May 28 10:05:16.149238 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:16.146907    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-67kpf\" (UniqueName: \"kubernetes.io/projected/9024e35e-a291-4ee1-b4ad-c8b75c8d31ca-kube-api-access-67kpf\") pod \"network-metrics-daemon-jj9f8\" (UID: \"9024e35e-a291-4ee1-b4ad-c8b75c8d31ca\") " pod="openshift-multus/network-metrics-daemon-jj9f8"
May 28 10:05:16.149238 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:16.146920    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/a5f7c60c-f57b-475b-a97a-32f0e1dbdc5b-lib-modules\") pod \"tuned-8nw9l\" (UID: \"a5f7c60c-f57b-475b-a97a-32f0e1dbdc5b\") " pod="openshift-cluster-node-tuning-operator/tuned-8nw9l"
May 28 10:05:16.149238 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:16.146943    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/9f62bd21-c44c-4022-a4d8-1ffa1422c955-registration-dir\") pod \"aws-ebs-csi-driver-node-78j5q\" (UID: \"9f62bd21-c44c-4022-a4d8-1ffa1422c955\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-78j5q"
May 28 10:05:16.149238 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:16.146959    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a5f7c60c-f57b-475b-a97a-32f0e1dbdc5b-etc-kubernetes\") pod \"tuned-8nw9l\" (UID: \"a5f7c60c-f57b-475b-a97a-32f0e1dbdc5b\") " pod="openshift-cluster-node-tuning-operator/tuned-8nw9l"
May 28 10:05:16.149238 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:16.146970    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2a281715-5613-4b06-9963-0addcc9b432a-system-cni-dir\") pod \"multus-additional-cni-plugins-ck4jd\" (UID: \"2a281715-5613-4b06-9963-0addcc9b432a\") " pod="openshift-multus/multus-additional-cni-plugins-ck4jd"
May 28 10:05:16.149238 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:16.146975    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/c52e0100-163d-47e8-9414-e07548bc3e37-cnibin\") pod \"multus-vwktp\" (UID: \"c52e0100-163d-47e8-9414-e07548bc3e37\") " pod="openshift-multus/multus-vwktp"
May 28 10:05:16.149824 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:16.146998    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/2a281715-5613-4b06-9963-0addcc9b432a-cni-binary-copy\") pod \"multus-additional-cni-plugins-ck4jd\" (UID: \"2a281715-5613-4b06-9963-0addcc9b432a\") " pod="openshift-multus/multus-additional-cni-plugins-ck4jd"
May 28 10:05:16.149824 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:16.147021    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/a5f7c60c-f57b-475b-a97a-32f0e1dbdc5b-run\") pod \"tuned-8nw9l\" (UID: \"a5f7c60c-f57b-475b-a97a-32f0e1dbdc5b\") " pod="openshift-cluster-node-tuning-operator/tuned-8nw9l"
May 28 10:05:16.149824 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:16.147024    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/c52e0100-163d-47e8-9414-e07548bc3e37-os-release\") pod \"multus-vwktp\" (UID: \"c52e0100-163d-47e8-9414-e07548bc3e37\") " pod="openshift-multus/multus-vwktp"
May 28 10:05:16.149824 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:16.147051    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-fdwsm\" (UniqueName: \"kubernetes.io/projected/b4abbf06-e346-4870-a227-65afbd0db899-kube-api-access-fdwsm\") pod \"node-resolver-8vr88\" (UID: \"b4abbf06-e346-4870-a227-65afbd0db899\") " pod="openshift-dns/node-resolver-8vr88"
May 28 10:05:16.149824 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:16.147074    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/a5f7c60c-f57b-475b-a97a-32f0e1dbdc5b-etc-systemd\") pod \"tuned-8nw9l\" (UID: \"a5f7c60c-f57b-475b-a97a-32f0e1dbdc5b\") " pod="openshift-cluster-node-tuning-operator/tuned-8nw9l"
May 28 10:05:16.149824 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:16.146837    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/5185dc25-c431-4639-a53a-0c38db5a6f4f-env-overrides\") pod \"ovnkube-node-j4whq\" (UID: \"5185dc25-c431-4639-a53a-0c38db5a6f4f\") " pod="openshift-ovn-kubernetes/ovnkube-node-j4whq"
May 28 10:05:16.149824 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:16.147110    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/2a281715-5613-4b06-9963-0addcc9b432a-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-ck4jd\" (UID: \"2a281715-5613-4b06-9963-0addcc9b432a\") " pod="openshift-multus/multus-additional-cni-plugins-ck4jd"
May 28 10:05:16.149824 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:16.147138    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c52e0100-163d-47e8-9414-e07548bc3e37-multus-cni-dir\") pod \"multus-vwktp\" (UID: \"c52e0100-163d-47e8-9414-e07548bc3e37\") " pod="openshift-multus/multus-vwktp"
May 28 10:05:16.149824 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:16.147075    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/9f62bd21-c44c-4022-a4d8-1ffa1422c955-etc-selinux\") pod \"aws-ebs-csi-driver-node-78j5q\" (UID: \"9f62bd21-c44c-4022-a4d8-1ffa1422c955\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-78j5q"
May 28 10:05:16.149824 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:16.147176    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/74f14c89-a025-4bda-ab55-a7a661f2702e-host\") pod \"node-ca-8jmk5\" (UID: \"74f14c89-a025-4bda-ab55-a7a661f2702e\") " pod="openshift-image-registry/node-ca-8jmk5"
May 28 10:05:16.149824 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:16.147204    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/9f62bd21-c44c-4022-a4d8-1ffa1422c955-registration-dir\") pod \"aws-ebs-csi-driver-node-78j5q\" (UID: \"9f62bd21-c44c-4022-a4d8-1ffa1422c955\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-78j5q"
May 28 10:05:16.149824 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:16.146840    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/5185dc25-c431-4639-a53a-0c38db5a6f4f-ovnkube-script-lib\") pod \"ovnkube-node-j4whq\" (UID: \"5185dc25-c431-4639-a53a-0c38db5a6f4f\") " pod="openshift-ovn-kubernetes/ovnkube-node-j4whq"
May 28 10:05:16.149824 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:16.147220    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2a281715-5613-4b06-9963-0addcc9b432a-system-cni-dir\") pod \"multus-additional-cni-plugins-ck4jd\" (UID: \"2a281715-5613-4b06-9963-0addcc9b432a\") " pod="openshift-multus/multus-additional-cni-plugins-ck4jd"
May 28 10:05:16.149824 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:16.147291    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/9f62bd21-c44c-4022-a4d8-1ffa1422c955-sys-fs\") pod \"aws-ebs-csi-driver-node-78j5q\" (UID: \"9f62bd21-c44c-4022-a4d8-1ffa1422c955\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-78j5q"
May 28 10:05:16.149824 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:16.147533    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/c52e0100-163d-47e8-9414-e07548bc3e37-cni-binary-copy\") pod \"multus-vwktp\" (UID: \"c52e0100-163d-47e8-9414-e07548bc3e37\") " pod="openshift-multus/multus-vwktp"
May 28 10:05:16.149824 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:16.147538    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/c52e0100-163d-47e8-9414-e07548bc3e37-os-release\") pod \"multus-vwktp\" (UID: \"c52e0100-163d-47e8-9414-e07548bc3e37\") " pod="openshift-multus/multus-vwktp"
May 28 10:05:16.149824 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:16.147714    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/2a281715-5613-4b06-9963-0addcc9b432a-cni-binary-copy\") pod \"multus-additional-cni-plugins-ck4jd\" (UID: \"2a281715-5613-4b06-9963-0addcc9b432a\") " pod="openshift-multus/multus-additional-cni-plugins-ck4jd"
May 28 10:05:16.150264 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:16.147746    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/c925ed8e-f4ec-45e6-bfa6-2128a0947aca-konnectivity-ca\") pod \"konnectivity-agent-6qpxx\" (UID: \"c925ed8e-f4ec-45e6-bfa6-2128a0947aca\") " pod="kube-system/konnectivity-agent-6qpxx"
May 28 10:05:16.150264 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:16.147768    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/c52e0100-163d-47e8-9414-e07548bc3e37-multus-conf-dir\") pod \"multus-vwktp\" (UID: \"c52e0100-163d-47e8-9414-e07548bc3e37\") " pod="openshift-multus/multus-vwktp"
May 28 10:05:16.150264 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:16.148282    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/2a281715-5613-4b06-9963-0addcc9b432a-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-ck4jd\" (UID: \"2a281715-5613-4b06-9963-0addcc9b432a\") " pod="openshift-multus/multus-additional-cni-plugins-ck4jd"
May 28 10:05:16.150264 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:16.148623    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/5185dc25-c431-4639-a53a-0c38db5a6f4f-ovn-node-metrics-cert\") pod \"ovnkube-node-j4whq\" (UID: \"5185dc25-c431-4639-a53a-0c38db5a6f4f\") " pod="openshift-ovn-kubernetes/ovnkube-node-j4whq"
May 28 10:05:16.150264 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:16.148761    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/c925ed8e-f4ec-45e6-bfa6-2128a0947aca-agent-certs\") pod \"konnectivity-agent-6qpxx\" (UID: \"c925ed8e-f4ec-45e6-bfa6-2128a0947aca\") " pod="kube-system/konnectivity-agent-6qpxx"
May 28 10:05:16.150264 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:16.149641    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a5f7c60c-f57b-475b-a97a-32f0e1dbdc5b-tmp\") pod \"tuned-8nw9l\" (UID: \"a5f7c60c-f57b-475b-a97a-32f0e1dbdc5b\") " pod="openshift-cluster-node-tuning-operator/tuned-8nw9l"
May 28 10:05:16.150264 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:16.150153    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/a5f7c60c-f57b-475b-a97a-32f0e1dbdc5b-etc-tuned\") pod \"tuned-8nw9l\" (UID: \"a5f7c60c-f57b-475b-a97a-32f0e1dbdc5b\") " pod="openshift-cluster-node-tuning-operator/tuned-8nw9l"
May 28 10:05:16.152902 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:16.152865    2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-206.ec2.internal" event={"ID":"a6772c4d9844f0928036a579dcf5d882","Type":"ContainerStarted","Data":"60c3ebacd89eca38af64c0b59ab6886c524826f18e7e827948cb9e91b8de2fb1"}
May 28 10:05:16.153776 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:16.153749    2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-206.ec2.internal" event={"ID":"dafcffec46e93c961979dd9c978f3fcd","Type":"ContainerStarted","Data":"690f16383aeccba841f870771d87272da44801720a94b43e6bd2458fe8208740"}
May 28 10:05:16.154733 ip-10-0-128-206 kubenswrapper[2565]: E0528 10:05:16.154719    2565 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
May 28 10:05:16.154786 ip-10-0-128-206 kubenswrapper[2565]: E0528 10:05:16.154736    2565 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
May 28 10:05:16.154786 ip-10-0-128-206 kubenswrapper[2565]: E0528 10:05:16.154745    2565 projected.go:194] Error preparing data for projected volume kube-api-access-qdj6s for pod openshift-network-diagnostics/network-check-target-kvx8v: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 28 10:05:16.154843 ip-10-0-128-206 kubenswrapper[2565]: E0528 10:05:16.154796    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/477435e8-f3a1-4bda-8764-5dd5b8afe64f-kube-api-access-qdj6s podName:477435e8-f3a1-4bda-8764-5dd5b8afe64f nodeName:}" failed. No retries permitted until 2026-05-28 10:05:16.654785376 +0000 UTC m=+2.115119518 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-qdj6s" (UniqueName: "kubernetes.io/projected/477435e8-f3a1-4bda-8764-5dd5b8afe64f-kube-api-access-qdj6s") pod "network-check-target-kvx8v" (UID: "477435e8-f3a1-4bda-8764-5dd5b8afe64f") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 28 10:05:16.174041 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:16.174015    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rhgm5\" (UniqueName: \"kubernetes.io/projected/c1d9d1d1-da1a-431d-9baa-2bf4928f94d3-kube-api-access-rhgm5\") pod \"iptables-alerter-q87km\" (UID: \"c1d9d1d1-da1a-431d-9baa-2bf4928f94d3\") " pod="openshift-network-operator/iptables-alerter-q87km"
May 28 10:05:16.175017 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:16.174995    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lxwtn\" (UniqueName: \"kubernetes.io/projected/74f14c89-a025-4bda-ab55-a7a661f2702e-kube-api-access-lxwtn\") pod \"node-ca-8jmk5\" (UID: \"74f14c89-a025-4bda-ab55-a7a661f2702e\") " pod="openshift-image-registry/node-ca-8jmk5"
May 28 10:05:16.175230 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:16.175210    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2gns7\" (UniqueName: \"kubernetes.io/projected/2a281715-5613-4b06-9963-0addcc9b432a-kube-api-access-2gns7\") pod \"multus-additional-cni-plugins-ck4jd\" (UID: \"2a281715-5613-4b06-9963-0addcc9b432a\") " pod="openshift-multus/multus-additional-cni-plugins-ck4jd"
May 28 10:05:16.176815 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:16.176793    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7vnbz\" (UniqueName: \"kubernetes.io/projected/a5f7c60c-f57b-475b-a97a-32f0e1dbdc5b-kube-api-access-7vnbz\") pod \"tuned-8nw9l\" (UID: \"a5f7c60c-f57b-475b-a97a-32f0e1dbdc5b\") " pod="openshift-cluster-node-tuning-operator/tuned-8nw9l"
May 28 10:05:16.177173 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:16.177150    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-v29s6\" (UniqueName: \"kubernetes.io/projected/5185dc25-c431-4639-a53a-0c38db5a6f4f-kube-api-access-v29s6\") pod \"ovnkube-node-j4whq\" (UID: \"5185dc25-c431-4639-a53a-0c38db5a6f4f\") " pod="openshift-ovn-kubernetes/ovnkube-node-j4whq"
May 28 10:05:16.177214 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:16.177195    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kwp68\" (UniqueName: \"kubernetes.io/projected/c52e0100-163d-47e8-9414-e07548bc3e37-kube-api-access-kwp68\") pod \"multus-vwktp\" (UID: \"c52e0100-163d-47e8-9414-e07548bc3e37\") " pod="openshift-multus/multus-vwktp"
May 28 10:05:16.180626 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:16.180605    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fdwsm\" (UniqueName: \"kubernetes.io/projected/b4abbf06-e346-4870-a227-65afbd0db899-kube-api-access-fdwsm\") pod \"node-resolver-8vr88\" (UID: \"b4abbf06-e346-4870-a227-65afbd0db899\") " pod="openshift-dns/node-resolver-8vr88"
May 28 10:05:16.181406 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:16.181388    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cq8kb\" (UniqueName: \"kubernetes.io/projected/9f62bd21-c44c-4022-a4d8-1ffa1422c955-kube-api-access-cq8kb\") pod \"aws-ebs-csi-driver-node-78j5q\" (UID: \"9f62bd21-c44c-4022-a4d8-1ffa1422c955\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-78j5q"
May 28 10:05:16.181406 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:16.181398    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-67kpf\" (UniqueName: \"kubernetes.io/projected/9024e35e-a291-4ee1-b4ad-c8b75c8d31ca-kube-api-access-67kpf\") pod \"network-metrics-daemon-jj9f8\" (UID: \"9024e35e-a291-4ee1-b4ad-c8b75c8d31ca\") " pod="openshift-multus/network-metrics-daemon-jj9f8"
May 28 10:05:16.362494 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:16.362393    2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-6qpxx"
May 28 10:05:16.368014 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:16.367997    2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-8nw9l"
May 28 10:05:16.369142 ip-10-0-128-206 kubenswrapper[2565]: W0528 10:05:16.369121    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc925ed8e_f4ec_45e6_bfa6_2128a0947aca.slice/crio-f4141171ec1a82cf6d33566362db37421a5782422cc46e0a5a1bd111758340a5 WatchSource:0}: Error finding container f4141171ec1a82cf6d33566362db37421a5782422cc46e0a5a1bd111758340a5: Status 404 returned error can't find the container with id f4141171ec1a82cf6d33566362db37421a5782422cc46e0a5a1bd111758340a5
May 28 10:05:16.374608 ip-10-0-128-206 kubenswrapper[2565]: W0528 10:05:16.374586    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda5f7c60c_f57b_475b_a97a_32f0e1dbdc5b.slice/crio-8d3b2aae2671485bbde78b9e0385597f909331e7d8c662714426e4b22b4485c4 WatchSource:0}: Error finding container 8d3b2aae2671485bbde78b9e0385597f909331e7d8c662714426e4b22b4485c4: Status 404 returned error can't find the container with id 8d3b2aae2671485bbde78b9e0385597f909331e7d8c662714426e4b22b4485c4
May 28 10:05:16.375089 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:16.375068    2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-8jmk5"
May 28 10:05:16.380684 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:16.380663    2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-78j5q"
May 28 10:05:16.381612 ip-10-0-128-206 kubenswrapper[2565]: W0528 10:05:16.381594    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod74f14c89_a025_4bda_ab55_a7a661f2702e.slice/crio-f3d60becb177b488325c32acc4925fd6f5d5c93bae88f1a80d5ed304a302fbce WatchSource:0}: Error finding container f3d60becb177b488325c32acc4925fd6f5d5c93bae88f1a80d5ed304a302fbce: Status 404 returned error can't find the container with id f3d60becb177b488325c32acc4925fd6f5d5c93bae88f1a80d5ed304a302fbce
May 28 10:05:16.384028 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:16.384011    2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-j4whq"
May 28 10:05:16.387227 ip-10-0-128-206 kubenswrapper[2565]: W0528 10:05:16.387205    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9f62bd21_c44c_4022_a4d8_1ffa1422c955.slice/crio-be118aecf45aaf60c66e102e26acdfb84f46ecfba5652a3b538f67b656fd80e1 WatchSource:0}: Error finding container be118aecf45aaf60c66e102e26acdfb84f46ecfba5652a3b538f67b656fd80e1: Status 404 returned error can't find the container with id be118aecf45aaf60c66e102e26acdfb84f46ecfba5652a3b538f67b656fd80e1
May 28 10:05:16.389292 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:16.389227    2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-8vr88"
May 28 10:05:16.393745 ip-10-0-128-206 kubenswrapper[2565]: W0528 10:05:16.393724    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5185dc25_c431_4639_a53a_0c38db5a6f4f.slice/crio-bbf6a34df06b99bb78f134a3a2ba54615369c970e4e5656ecb0586ff3bb62372 WatchSource:0}: Error finding container bbf6a34df06b99bb78f134a3a2ba54615369c970e4e5656ecb0586ff3bb62372: Status 404 returned error can't find the container with id bbf6a34df06b99bb78f134a3a2ba54615369c970e4e5656ecb0586ff3bb62372
May 28 10:05:16.394488 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:16.394469    2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-ck4jd"
May 28 10:05:16.396872 ip-10-0-128-206 kubenswrapper[2565]: W0528 10:05:16.396847    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb4abbf06_e346_4870_a227_65afbd0db899.slice/crio-f508dadeeb8925d729986065fa98c4c23501ed89a9470f93f6d617681ce0d754 WatchSource:0}: Error finding container f508dadeeb8925d729986065fa98c4c23501ed89a9470f93f6d617681ce0d754: Status 404 returned error can't find the container with id f508dadeeb8925d729986065fa98c4c23501ed89a9470f93f6d617681ce0d754
May 28 10:05:16.400572 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:16.400552    2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-vwktp"
May 28 10:05:16.401224 ip-10-0-128-206 kubenswrapper[2565]: W0528 10:05:16.401202    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2a281715_5613_4b06_9963_0addcc9b432a.slice/crio-412f3f688104872d498070918ae58531d2a90432d15d3223fe7591923aa5173a WatchSource:0}: Error finding container 412f3f688104872d498070918ae58531d2a90432d15d3223fe7591923aa5173a: Status 404 returned error can't find the container with id 412f3f688104872d498070918ae58531d2a90432d15d3223fe7591923aa5173a
May 28 10:05:16.405434 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:16.405409    2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-q87km"
May 28 10:05:16.414035 ip-10-0-128-206 kubenswrapper[2565]: W0528 10:05:16.413986    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc1d9d1d1_da1a_431d_9baa_2bf4928f94d3.slice/crio-0f79ef025edaea922f204ba759f7d086cde462d155db5963c5a78055f6754761 WatchSource:0}: Error finding container 0f79ef025edaea922f204ba759f7d086cde462d155db5963c5a78055f6754761: Status 404 returned error can't find the container with id 0f79ef025edaea922f204ba759f7d086cde462d155db5963c5a78055f6754761
May 28 10:05:16.466405 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:16.466372    2565 reflector.go:430] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
May 28 10:05:16.651503 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:16.651416    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9024e35e-a291-4ee1-b4ad-c8b75c8d31ca-metrics-certs\") pod \"network-metrics-daemon-jj9f8\" (UID: \"9024e35e-a291-4ee1-b4ad-c8b75c8d31ca\") " pod="openshift-multus/network-metrics-daemon-jj9f8"
May 28 10:05:16.651657 ip-10-0-128-206 kubenswrapper[2565]: E0528 10:05:16.651595    2565 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
May 28 10:05:16.651715 ip-10-0-128-206 kubenswrapper[2565]: E0528 10:05:16.651676    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9024e35e-a291-4ee1-b4ad-c8b75c8d31ca-metrics-certs podName:9024e35e-a291-4ee1-b4ad-c8b75c8d31ca nodeName:}" failed. No retries permitted until 2026-05-28 10:05:17.651653988 +0000 UTC m=+3.111988118 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/9024e35e-a291-4ee1-b4ad-c8b75c8d31ca-metrics-certs") pod "network-metrics-daemon-jj9f8" (UID: "9024e35e-a291-4ee1-b4ad-c8b75c8d31ca") : object "openshift-multus"/"metrics-daemon-secret" not registered
May 28 10:05:16.752643 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:16.752601    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-qdj6s\" (UniqueName: \"kubernetes.io/projected/477435e8-f3a1-4bda-8764-5dd5b8afe64f-kube-api-access-qdj6s\") pod \"network-check-target-kvx8v\" (UID: \"477435e8-f3a1-4bda-8764-5dd5b8afe64f\") " pod="openshift-network-diagnostics/network-check-target-kvx8v"
May 28 10:05:16.752818 ip-10-0-128-206 kubenswrapper[2565]: E0528 10:05:16.752798    2565 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
May 28 10:05:16.752902 ip-10-0-128-206 kubenswrapper[2565]: E0528 10:05:16.752820    2565 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
May 28 10:05:16.752902 ip-10-0-128-206 kubenswrapper[2565]: E0528 10:05:16.752835    2565 projected.go:194] Error preparing data for projected volume kube-api-access-qdj6s for pod openshift-network-diagnostics/network-check-target-kvx8v: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 28 10:05:16.752902 ip-10-0-128-206 kubenswrapper[2565]: E0528 10:05:16.752900    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/477435e8-f3a1-4bda-8764-5dd5b8afe64f-kube-api-access-qdj6s podName:477435e8-f3a1-4bda-8764-5dd5b8afe64f nodeName:}" failed. No retries permitted until 2026-05-28 10:05:17.752882184 +0000 UTC m=+3.213216318 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-qdj6s" (UniqueName: "kubernetes.io/projected/477435e8-f3a1-4bda-8764-5dd5b8afe64f-kube-api-access-qdj6s") pod "network-check-target-kvx8v" (UID: "477435e8-f3a1-4bda-8764-5dd5b8afe64f") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 28 10:05:17.117230 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:17.117097    2565 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-05-27 10:00:16 +0000 UTC" deadline="2027-11-16 09:10:43.244184197 +0000 UTC"
May 28 10:05:17.117230 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:17.117133    2565 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12887h5m26.127055236s"
May 28 10:05:17.170129 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:17.170042    2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-vwktp" event={"ID":"c52e0100-163d-47e8-9414-e07548bc3e37","Type":"ContainerStarted","Data":"515ad485c5dcdfde366994ab43b99c2e7366d5daccda100081fc99d099d22dd2"}
May 28 10:05:17.178162 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:17.178116    2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-8vr88" event={"ID":"b4abbf06-e346-4870-a227-65afbd0db899","Type":"ContainerStarted","Data":"f508dadeeb8925d729986065fa98c4c23501ed89a9470f93f6d617681ce0d754"}
May 28 10:05:17.184562 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:17.184486    2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-j4whq" event={"ID":"5185dc25-c431-4639-a53a-0c38db5a6f4f","Type":"ContainerStarted","Data":"bbf6a34df06b99bb78f134a3a2ba54615369c970e4e5656ecb0586ff3bb62372"}
May 28 10:05:17.192183 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:17.192148    2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-8jmk5" event={"ID":"74f14c89-a025-4bda-ab55-a7a661f2702e","Type":"ContainerStarted","Data":"f3d60becb177b488325c32acc4925fd6f5d5c93bae88f1a80d5ed304a302fbce"}
May 28 10:05:17.205669 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:17.205600    2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-ck4jd" event={"ID":"2a281715-5613-4b06-9963-0addcc9b432a","Type":"ContainerStarted","Data":"412f3f688104872d498070918ae58531d2a90432d15d3223fe7591923aa5173a"}
May 28 10:05:17.213607 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:17.213573    2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-78j5q" event={"ID":"9f62bd21-c44c-4022-a4d8-1ffa1422c955","Type":"ContainerStarted","Data":"be118aecf45aaf60c66e102e26acdfb84f46ecfba5652a3b538f67b656fd80e1"}
May 28 10:05:17.215731 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:17.215703    2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-8nw9l" event={"ID":"a5f7c60c-f57b-475b-a97a-32f0e1dbdc5b","Type":"ContainerStarted","Data":"8d3b2aae2671485bbde78b9e0385597f909331e7d8c662714426e4b22b4485c4"}
May 28 10:05:17.229102 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:17.229066    2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-6qpxx" event={"ID":"c925ed8e-f4ec-45e6-bfa6-2128a0947aca","Type":"ContainerStarted","Data":"f4141171ec1a82cf6d33566362db37421a5782422cc46e0a5a1bd111758340a5"}
May 28 10:05:17.236079 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:17.236036    2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-q87km" event={"ID":"c1d9d1d1-da1a-431d-9baa-2bf4928f94d3","Type":"ContainerStarted","Data":"0f79ef025edaea922f204ba759f7d086cde462d155db5963c5a78055f6754761"}
May 28 10:05:17.431555 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:17.431470    2565 reflector.go:430] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
May 28 10:05:17.660750 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:17.660715    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9024e35e-a291-4ee1-b4ad-c8b75c8d31ca-metrics-certs\") pod \"network-metrics-daemon-jj9f8\" (UID: \"9024e35e-a291-4ee1-b4ad-c8b75c8d31ca\") " pod="openshift-multus/network-metrics-daemon-jj9f8"
May 28 10:05:17.660910 ip-10-0-128-206 kubenswrapper[2565]: E0528 10:05:17.660880    2565 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
May 28 10:05:17.660993 ip-10-0-128-206 kubenswrapper[2565]: E0528 10:05:17.660950    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9024e35e-a291-4ee1-b4ad-c8b75c8d31ca-metrics-certs podName:9024e35e-a291-4ee1-b4ad-c8b75c8d31ca nodeName:}" failed. No retries permitted until 2026-05-28 10:05:19.66093122 +0000 UTC m=+5.121265365 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/9024e35e-a291-4ee1-b4ad-c8b75c8d31ca-metrics-certs") pod "network-metrics-daemon-jj9f8" (UID: "9024e35e-a291-4ee1-b4ad-c8b75c8d31ca") : object "openshift-multus"/"metrics-daemon-secret" not registered
May 28 10:05:17.761116 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:17.761035    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-qdj6s\" (UniqueName: \"kubernetes.io/projected/477435e8-f3a1-4bda-8764-5dd5b8afe64f-kube-api-access-qdj6s\") pod \"network-check-target-kvx8v\" (UID: \"477435e8-f3a1-4bda-8764-5dd5b8afe64f\") " pod="openshift-network-diagnostics/network-check-target-kvx8v"
May 28 10:05:17.761274 ip-10-0-128-206 kubenswrapper[2565]: E0528 10:05:17.761203    2565 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
May 28 10:05:17.761274 ip-10-0-128-206 kubenswrapper[2565]: E0528 10:05:17.761223    2565 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
May 28 10:05:17.761274 ip-10-0-128-206 kubenswrapper[2565]: E0528 10:05:17.761235    2565 projected.go:194] Error preparing data for projected volume kube-api-access-qdj6s for pod openshift-network-diagnostics/network-check-target-kvx8v: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 28 10:05:17.761457 ip-10-0-128-206 kubenswrapper[2565]: E0528 10:05:17.761292    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/477435e8-f3a1-4bda-8764-5dd5b8afe64f-kube-api-access-qdj6s podName:477435e8-f3a1-4bda-8764-5dd5b8afe64f nodeName:}" failed. No retries permitted until 2026-05-28 10:05:19.761274769 +0000 UTC m=+5.221608905 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-qdj6s" (UniqueName: "kubernetes.io/projected/477435e8-f3a1-4bda-8764-5dd5b8afe64f-kube-api-access-qdj6s") pod "network-check-target-kvx8v" (UID: "477435e8-f3a1-4bda-8764-5dd5b8afe64f") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 28 10:05:18.087270 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:18.087189    2565 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kube-system/global-pull-secret-syncer-qljhc"]
May 28 10:05:18.090105 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:18.090079    2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qljhc"
May 28 10:05:18.090252 ip-10-0-128-206 kubenswrapper[2565]: E0528 10:05:18.090169    2565 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qljhc" podUID="9454ad66-c829-4c38-afd5-8405924abbc5"
May 28 10:05:18.120345 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:18.118384    2565 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-05-27 10:00:16 +0000 UTC" deadline="2027-12-01 03:47:48.517947567 +0000 UTC"
May 28 10:05:18.120345 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:18.118422    2565 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13241h42m30.39952961s"
May 28 10:05:18.150445 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:18.150413    2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kvx8v"
May 28 10:05:18.150608 ip-10-0-128-206 kubenswrapper[2565]: E0528 10:05:18.150532    2565 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kvx8v" podUID="477435e8-f3a1-4bda-8764-5dd5b8afe64f"
May 28 10:05:18.150907 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:18.150887    2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jj9f8"
May 28 10:05:18.151020 ip-10-0-128-206 kubenswrapper[2565]: E0528 10:05:18.150992    2565 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jj9f8" podUID="9024e35e-a291-4ee1-b4ad-c8b75c8d31ca"
May 28 10:05:18.163855 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:18.163823    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/9454ad66-c829-4c38-afd5-8405924abbc5-dbus\") pod \"global-pull-secret-syncer-qljhc\" (UID: \"9454ad66-c829-4c38-afd5-8405924abbc5\") " pod="kube-system/global-pull-secret-syncer-qljhc"
May 28 10:05:18.164033 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:18.163897    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/9454ad66-c829-4c38-afd5-8405924abbc5-kubelet-config\") pod \"global-pull-secret-syncer-qljhc\" (UID: \"9454ad66-c829-4c38-afd5-8405924abbc5\") " pod="kube-system/global-pull-secret-syncer-qljhc"
May 28 10:05:18.164033 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:18.163937    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/9454ad66-c829-4c38-afd5-8405924abbc5-original-pull-secret\") pod \"global-pull-secret-syncer-qljhc\" (UID: \"9454ad66-c829-4c38-afd5-8405924abbc5\") " pod="kube-system/global-pull-secret-syncer-qljhc"
May 28 10:05:18.265442 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:18.264753    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/9454ad66-c829-4c38-afd5-8405924abbc5-kubelet-config\") pod \"global-pull-secret-syncer-qljhc\" (UID: \"9454ad66-c829-4c38-afd5-8405924abbc5\") " pod="kube-system/global-pull-secret-syncer-qljhc"
May 28 10:05:18.265442 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:18.264814    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/9454ad66-c829-4c38-afd5-8405924abbc5-original-pull-secret\") pod \"global-pull-secret-syncer-qljhc\" (UID: \"9454ad66-c829-4c38-afd5-8405924abbc5\") " pod="kube-system/global-pull-secret-syncer-qljhc"
May 28 10:05:18.265442 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:18.264870    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/9454ad66-c829-4c38-afd5-8405924abbc5-dbus\") pod \"global-pull-secret-syncer-qljhc\" (UID: \"9454ad66-c829-4c38-afd5-8405924abbc5\") " pod="kube-system/global-pull-secret-syncer-qljhc"
May 28 10:05:18.265442 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:18.264993    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/9454ad66-c829-4c38-afd5-8405924abbc5-dbus\") pod \"global-pull-secret-syncer-qljhc\" (UID: \"9454ad66-c829-4c38-afd5-8405924abbc5\") " pod="kube-system/global-pull-secret-syncer-qljhc"
May 28 10:05:18.265442 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:18.265053    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/9454ad66-c829-4c38-afd5-8405924abbc5-kubelet-config\") pod \"global-pull-secret-syncer-qljhc\" (UID: \"9454ad66-c829-4c38-afd5-8405924abbc5\") " pod="kube-system/global-pull-secret-syncer-qljhc"
May 28 10:05:18.265442 ip-10-0-128-206 kubenswrapper[2565]: E0528 10:05:18.265150    2565 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
May 28 10:05:18.265442 ip-10-0-128-206 kubenswrapper[2565]: E0528 10:05:18.265208    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9454ad66-c829-4c38-afd5-8405924abbc5-original-pull-secret podName:9454ad66-c829-4c38-afd5-8405924abbc5 nodeName:}" failed. No retries permitted until 2026-05-28 10:05:18.765190459 +0000 UTC m=+4.225524595 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/9454ad66-c829-4c38-afd5-8405924abbc5-original-pull-secret") pod "global-pull-secret-syncer-qljhc" (UID: "9454ad66-c829-4c38-afd5-8405924abbc5") : object "kube-system"/"original-pull-secret" not registered
May 28 10:05:18.769704 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:18.769038    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/9454ad66-c829-4c38-afd5-8405924abbc5-original-pull-secret\") pod \"global-pull-secret-syncer-qljhc\" (UID: \"9454ad66-c829-4c38-afd5-8405924abbc5\") " pod="kube-system/global-pull-secret-syncer-qljhc"
May 28 10:05:18.769704 ip-10-0-128-206 kubenswrapper[2565]: E0528 10:05:18.769212    2565 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
May 28 10:05:18.769704 ip-10-0-128-206 kubenswrapper[2565]: E0528 10:05:18.769274    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9454ad66-c829-4c38-afd5-8405924abbc5-original-pull-secret podName:9454ad66-c829-4c38-afd5-8405924abbc5 nodeName:}" failed. No retries permitted until 2026-05-28 10:05:19.769256867 +0000 UTC m=+5.229591001 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/9454ad66-c829-4c38-afd5-8405924abbc5-original-pull-secret") pod "global-pull-secret-syncer-qljhc" (UID: "9454ad66-c829-4c38-afd5-8405924abbc5") : object "kube-system"/"original-pull-secret" not registered
May 28 10:05:19.679946 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:19.679912    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9024e35e-a291-4ee1-b4ad-c8b75c8d31ca-metrics-certs\") pod \"network-metrics-daemon-jj9f8\" (UID: \"9024e35e-a291-4ee1-b4ad-c8b75c8d31ca\") " pod="openshift-multus/network-metrics-daemon-jj9f8"
May 28 10:05:19.680406 ip-10-0-128-206 kubenswrapper[2565]: E0528 10:05:19.680059    2565 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
May 28 10:05:19.680406 ip-10-0-128-206 kubenswrapper[2565]: E0528 10:05:19.680125    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9024e35e-a291-4ee1-b4ad-c8b75c8d31ca-metrics-certs podName:9024e35e-a291-4ee1-b4ad-c8b75c8d31ca nodeName:}" failed. No retries permitted until 2026-05-28 10:05:23.680107074 +0000 UTC m=+9.140441219 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/9024e35e-a291-4ee1-b4ad-c8b75c8d31ca-metrics-certs") pod "network-metrics-daemon-jj9f8" (UID: "9024e35e-a291-4ee1-b4ad-c8b75c8d31ca") : object "openshift-multus"/"metrics-daemon-secret" not registered
May 28 10:05:19.781204 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:19.781156    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/9454ad66-c829-4c38-afd5-8405924abbc5-original-pull-secret\") pod \"global-pull-secret-syncer-qljhc\" (UID: \"9454ad66-c829-4c38-afd5-8405924abbc5\") " pod="kube-system/global-pull-secret-syncer-qljhc"
May 28 10:05:19.781357 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:19.781246    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-qdj6s\" (UniqueName: \"kubernetes.io/projected/477435e8-f3a1-4bda-8764-5dd5b8afe64f-kube-api-access-qdj6s\") pod \"network-check-target-kvx8v\" (UID: \"477435e8-f3a1-4bda-8764-5dd5b8afe64f\") " pod="openshift-network-diagnostics/network-check-target-kvx8v"
May 28 10:05:19.781420 ip-10-0-128-206 kubenswrapper[2565]: E0528 10:05:19.781403    2565 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
May 28 10:05:19.781460 ip-10-0-128-206 kubenswrapper[2565]: E0528 10:05:19.781422    2565 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
May 28 10:05:19.781460 ip-10-0-128-206 kubenswrapper[2565]: E0528 10:05:19.781435    2565 projected.go:194] Error preparing data for projected volume kube-api-access-qdj6s for pod openshift-network-diagnostics/network-check-target-kvx8v: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 28 10:05:19.781531 ip-10-0-128-206 kubenswrapper[2565]: E0528 10:05:19.781491    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/477435e8-f3a1-4bda-8764-5dd5b8afe64f-kube-api-access-qdj6s podName:477435e8-f3a1-4bda-8764-5dd5b8afe64f nodeName:}" failed. No retries permitted until 2026-05-28 10:05:23.781477143 +0000 UTC m=+9.241811276 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-qdj6s" (UniqueName: "kubernetes.io/projected/477435e8-f3a1-4bda-8764-5dd5b8afe64f-kube-api-access-qdj6s") pod "network-check-target-kvx8v" (UID: "477435e8-f3a1-4bda-8764-5dd5b8afe64f") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 28 10:05:19.781699 ip-10-0-128-206 kubenswrapper[2565]: E0528 10:05:19.781668    2565 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
May 28 10:05:19.781795 ip-10-0-128-206 kubenswrapper[2565]: E0528 10:05:19.781754    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9454ad66-c829-4c38-afd5-8405924abbc5-original-pull-secret podName:9454ad66-c829-4c38-afd5-8405924abbc5 nodeName:}" failed. No retries permitted until 2026-05-28 10:05:21.781724354 +0000 UTC m=+7.242058495 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/9454ad66-c829-4c38-afd5-8405924abbc5-original-pull-secret") pod "global-pull-secret-syncer-qljhc" (UID: "9454ad66-c829-4c38-afd5-8405924abbc5") : object "kube-system"/"original-pull-secret" not registered
May 28 10:05:20.150426 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:20.150394    2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jj9f8"
May 28 10:05:20.150585 ip-10-0-128-206 kubenswrapper[2565]: E0528 10:05:20.150541    2565 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jj9f8" podUID="9024e35e-a291-4ee1-b4ad-c8b75c8d31ca"
May 28 10:05:20.160977 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:20.160478    2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qljhc"
May 28 10:05:20.160977 ip-10-0-128-206 kubenswrapper[2565]: E0528 10:05:20.160637    2565 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qljhc" podUID="9454ad66-c829-4c38-afd5-8405924abbc5"
May 28 10:05:20.160977 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:20.160790    2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kvx8v"
May 28 10:05:20.160977 ip-10-0-128-206 kubenswrapper[2565]: E0528 10:05:20.160907    2565 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kvx8v" podUID="477435e8-f3a1-4bda-8764-5dd5b8afe64f"
May 28 10:05:21.798993 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:21.798452    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/9454ad66-c829-4c38-afd5-8405924abbc5-original-pull-secret\") pod \"global-pull-secret-syncer-qljhc\" (UID: \"9454ad66-c829-4c38-afd5-8405924abbc5\") " pod="kube-system/global-pull-secret-syncer-qljhc"
May 28 10:05:21.798993 ip-10-0-128-206 kubenswrapper[2565]: E0528 10:05:21.798616    2565 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
May 28 10:05:21.798993 ip-10-0-128-206 kubenswrapper[2565]: E0528 10:05:21.798676    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9454ad66-c829-4c38-afd5-8405924abbc5-original-pull-secret podName:9454ad66-c829-4c38-afd5-8405924abbc5 nodeName:}" failed. No retries permitted until 2026-05-28 10:05:25.798658605 +0000 UTC m=+11.258992738 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/9454ad66-c829-4c38-afd5-8405924abbc5-original-pull-secret") pod "global-pull-secret-syncer-qljhc" (UID: "9454ad66-c829-4c38-afd5-8405924abbc5") : object "kube-system"/"original-pull-secret" not registered
May 28 10:05:22.150554 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:22.150471    2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kvx8v"
May 28 10:05:22.150703 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:22.150478    2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qljhc"
May 28 10:05:22.150703 ip-10-0-128-206 kubenswrapper[2565]: E0528 10:05:22.150603    2565 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kvx8v" podUID="477435e8-f3a1-4bda-8764-5dd5b8afe64f"
May 28 10:05:22.150703 ip-10-0-128-206 kubenswrapper[2565]: E0528 10:05:22.150658    2565 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qljhc" podUID="9454ad66-c829-4c38-afd5-8405924abbc5"
May 28 10:05:22.150703 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:22.150478    2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jj9f8"
May 28 10:05:22.150910 ip-10-0-128-206 kubenswrapper[2565]: E0528 10:05:22.150748    2565 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jj9f8" podUID="9024e35e-a291-4ee1-b4ad-c8b75c8d31ca"
May 28 10:05:23.713128 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:23.712589    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9024e35e-a291-4ee1-b4ad-c8b75c8d31ca-metrics-certs\") pod \"network-metrics-daemon-jj9f8\" (UID: \"9024e35e-a291-4ee1-b4ad-c8b75c8d31ca\") " pod="openshift-multus/network-metrics-daemon-jj9f8"
May 28 10:05:23.713128 ip-10-0-128-206 kubenswrapper[2565]: E0528 10:05:23.712747    2565 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
May 28 10:05:23.713128 ip-10-0-128-206 kubenswrapper[2565]: E0528 10:05:23.712805    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9024e35e-a291-4ee1-b4ad-c8b75c8d31ca-metrics-certs podName:9024e35e-a291-4ee1-b4ad-c8b75c8d31ca nodeName:}" failed. No retries permitted until 2026-05-28 10:05:31.712787067 +0000 UTC m=+17.173121198 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/9024e35e-a291-4ee1-b4ad-c8b75c8d31ca-metrics-certs") pod "network-metrics-daemon-jj9f8" (UID: "9024e35e-a291-4ee1-b4ad-c8b75c8d31ca") : object "openshift-multus"/"metrics-daemon-secret" not registered
May 28 10:05:23.813403 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:23.813360    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-qdj6s\" (UniqueName: \"kubernetes.io/projected/477435e8-f3a1-4bda-8764-5dd5b8afe64f-kube-api-access-qdj6s\") pod \"network-check-target-kvx8v\" (UID: \"477435e8-f3a1-4bda-8764-5dd5b8afe64f\") " pod="openshift-network-diagnostics/network-check-target-kvx8v"
May 28 10:05:23.813573 ip-10-0-128-206 kubenswrapper[2565]: E0528 10:05:23.813530    2565 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
May 28 10:05:23.813573 ip-10-0-128-206 kubenswrapper[2565]: E0528 10:05:23.813553    2565 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
May 28 10:05:23.813573 ip-10-0-128-206 kubenswrapper[2565]: E0528 10:05:23.813568    2565 projected.go:194] Error preparing data for projected volume kube-api-access-qdj6s for pod openshift-network-diagnostics/network-check-target-kvx8v: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 28 10:05:23.813679 ip-10-0-128-206 kubenswrapper[2565]: E0528 10:05:23.813629    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/477435e8-f3a1-4bda-8764-5dd5b8afe64f-kube-api-access-qdj6s podName:477435e8-f3a1-4bda-8764-5dd5b8afe64f nodeName:}" failed. No retries permitted until 2026-05-28 10:05:31.813610731 +0000 UTC m=+17.273944877 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-qdj6s" (UniqueName: "kubernetes.io/projected/477435e8-f3a1-4bda-8764-5dd5b8afe64f-kube-api-access-qdj6s") pod "network-check-target-kvx8v" (UID: "477435e8-f3a1-4bda-8764-5dd5b8afe64f") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 28 10:05:24.150951 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:24.150854    2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qljhc"
May 28 10:05:24.150951 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:24.150904    2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jj9f8"
May 28 10:05:24.150951 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:24.150858    2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kvx8v"
May 28 10:05:24.151202 ip-10-0-128-206 kubenswrapper[2565]: E0528 10:05:24.150983    2565 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qljhc" podUID="9454ad66-c829-4c38-afd5-8405924abbc5"
May 28 10:05:24.151202 ip-10-0-128-206 kubenswrapper[2565]: E0528 10:05:24.151064    2565 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kvx8v" podUID="477435e8-f3a1-4bda-8764-5dd5b8afe64f"
May 28 10:05:24.151202 ip-10-0-128-206 kubenswrapper[2565]: E0528 10:05:24.151174    2565 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jj9f8" podUID="9024e35e-a291-4ee1-b4ad-c8b75c8d31ca"
May 28 10:05:25.829854 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:25.829811    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/9454ad66-c829-4c38-afd5-8405924abbc5-original-pull-secret\") pod \"global-pull-secret-syncer-qljhc\" (UID: \"9454ad66-c829-4c38-afd5-8405924abbc5\") " pod="kube-system/global-pull-secret-syncer-qljhc"
May 28 10:05:25.830215 ip-10-0-128-206 kubenswrapper[2565]: E0528 10:05:25.830002    2565 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
May 28 10:05:25.830215 ip-10-0-128-206 kubenswrapper[2565]: E0528 10:05:25.830066    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9454ad66-c829-4c38-afd5-8405924abbc5-original-pull-secret podName:9454ad66-c829-4c38-afd5-8405924abbc5 nodeName:}" failed. No retries permitted until 2026-05-28 10:05:33.830046932 +0000 UTC m=+19.290381076 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/9454ad66-c829-4c38-afd5-8405924abbc5-original-pull-secret") pod "global-pull-secret-syncer-qljhc" (UID: "9454ad66-c829-4c38-afd5-8405924abbc5") : object "kube-system"/"original-pull-secret" not registered
May 28 10:05:26.150092 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:26.150059    2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jj9f8"
May 28 10:05:26.150285 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:26.150060    2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kvx8v"
May 28 10:05:26.150285 ip-10-0-128-206 kubenswrapper[2565]: E0528 10:05:26.150172    2565 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jj9f8" podUID="9024e35e-a291-4ee1-b4ad-c8b75c8d31ca"
May 28 10:05:26.150285 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:26.150058    2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qljhc"
May 28 10:05:26.150285 ip-10-0-128-206 kubenswrapper[2565]: E0528 10:05:26.150263    2565 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kvx8v" podUID="477435e8-f3a1-4bda-8764-5dd5b8afe64f"
May 28 10:05:26.150519 ip-10-0-128-206 kubenswrapper[2565]: E0528 10:05:26.150383    2565 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qljhc" podUID="9454ad66-c829-4c38-afd5-8405924abbc5"
May 28 10:05:28.150500 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:28.150462    2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kvx8v"
May 28 10:05:28.150949 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:28.150462    2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jj9f8"
May 28 10:05:28.150949 ip-10-0-128-206 kubenswrapper[2565]: E0528 10:05:28.150592    2565 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kvx8v" podUID="477435e8-f3a1-4bda-8764-5dd5b8afe64f"
May 28 10:05:28.150949 ip-10-0-128-206 kubenswrapper[2565]: E0528 10:05:28.150699    2565 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jj9f8" podUID="9024e35e-a291-4ee1-b4ad-c8b75c8d31ca"
May 28 10:05:28.150949 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:28.150462    2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qljhc"
May 28 10:05:28.150949 ip-10-0-128-206 kubenswrapper[2565]: E0528 10:05:28.150801    2565 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qljhc" podUID="9454ad66-c829-4c38-afd5-8405924abbc5"
May 28 10:05:30.150790 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:30.150748    2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qljhc"
May 28 10:05:30.150790 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:30.150748    2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kvx8v"
May 28 10:05:30.150790 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:30.150767    2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jj9f8"
May 28 10:05:30.151294 ip-10-0-128-206 kubenswrapper[2565]: E0528 10:05:30.150880    2565 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qljhc" podUID="9454ad66-c829-4c38-afd5-8405924abbc5"
May 28 10:05:30.151294 ip-10-0-128-206 kubenswrapper[2565]: E0528 10:05:30.151039    2565 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kvx8v" podUID="477435e8-f3a1-4bda-8764-5dd5b8afe64f"
May 28 10:05:30.151294 ip-10-0-128-206 kubenswrapper[2565]: E0528 10:05:30.151132    2565 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jj9f8" podUID="9024e35e-a291-4ee1-b4ad-c8b75c8d31ca"
May 28 10:05:31.771491 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:31.771456    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9024e35e-a291-4ee1-b4ad-c8b75c8d31ca-metrics-certs\") pod \"network-metrics-daemon-jj9f8\" (UID: \"9024e35e-a291-4ee1-b4ad-c8b75c8d31ca\") " pod="openshift-multus/network-metrics-daemon-jj9f8"
May 28 10:05:31.771954 ip-10-0-128-206 kubenswrapper[2565]: E0528 10:05:31.771567    2565 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
May 28 10:05:31.771954 ip-10-0-128-206 kubenswrapper[2565]: E0528 10:05:31.771626    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9024e35e-a291-4ee1-b4ad-c8b75c8d31ca-metrics-certs podName:9024e35e-a291-4ee1-b4ad-c8b75c8d31ca nodeName:}" failed. No retries permitted until 2026-05-28 10:05:47.771612127 +0000 UTC m=+33.231946257 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/9024e35e-a291-4ee1-b4ad-c8b75c8d31ca-metrics-certs") pod "network-metrics-daemon-jj9f8" (UID: "9024e35e-a291-4ee1-b4ad-c8b75c8d31ca") : object "openshift-multus"/"metrics-daemon-secret" not registered
May 28 10:05:31.872595 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:31.872565    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-qdj6s\" (UniqueName: \"kubernetes.io/projected/477435e8-f3a1-4bda-8764-5dd5b8afe64f-kube-api-access-qdj6s\") pod \"network-check-target-kvx8v\" (UID: \"477435e8-f3a1-4bda-8764-5dd5b8afe64f\") " pod="openshift-network-diagnostics/network-check-target-kvx8v"
May 28 10:05:31.872758 ip-10-0-128-206 kubenswrapper[2565]: E0528 10:05:31.872686    2565 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
May 28 10:05:31.872758 ip-10-0-128-206 kubenswrapper[2565]: E0528 10:05:31.872701    2565 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
May 28 10:05:31.872758 ip-10-0-128-206 kubenswrapper[2565]: E0528 10:05:31.872709    2565 projected.go:194] Error preparing data for projected volume kube-api-access-qdj6s for pod openshift-network-diagnostics/network-check-target-kvx8v: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 28 10:05:31.872758 ip-10-0-128-206 kubenswrapper[2565]: E0528 10:05:31.872759    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/477435e8-f3a1-4bda-8764-5dd5b8afe64f-kube-api-access-qdj6s podName:477435e8-f3a1-4bda-8764-5dd5b8afe64f nodeName:}" failed. No retries permitted until 2026-05-28 10:05:47.872746095 +0000 UTC m=+33.333080223 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-qdj6s" (UniqueName: "kubernetes.io/projected/477435e8-f3a1-4bda-8764-5dd5b8afe64f-kube-api-access-qdj6s") pod "network-check-target-kvx8v" (UID: "477435e8-f3a1-4bda-8764-5dd5b8afe64f") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 28 10:05:32.150157 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:32.150125    2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kvx8v"
May 28 10:05:32.150157 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:32.150149    2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qljhc"
May 28 10:05:32.150411 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:32.150239    2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jj9f8"
May 28 10:05:32.150411 ip-10-0-128-206 kubenswrapper[2565]: E0528 10:05:32.150259    2565 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kvx8v" podUID="477435e8-f3a1-4bda-8764-5dd5b8afe64f"
May 28 10:05:32.150411 ip-10-0-128-206 kubenswrapper[2565]: E0528 10:05:32.150352    2565 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jj9f8" podUID="9024e35e-a291-4ee1-b4ad-c8b75c8d31ca"
May 28 10:05:32.150558 ip-10-0-128-206 kubenswrapper[2565]: E0528 10:05:32.150418    2565 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qljhc" podUID="9454ad66-c829-4c38-afd5-8405924abbc5"
May 28 10:05:33.884839 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:33.884803    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/9454ad66-c829-4c38-afd5-8405924abbc5-original-pull-secret\") pod \"global-pull-secret-syncer-qljhc\" (UID: \"9454ad66-c829-4c38-afd5-8405924abbc5\") " pod="kube-system/global-pull-secret-syncer-qljhc"
May 28 10:05:33.885403 ip-10-0-128-206 kubenswrapper[2565]: E0528 10:05:33.884977    2565 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
May 28 10:05:33.885403 ip-10-0-128-206 kubenswrapper[2565]: E0528 10:05:33.885048    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9454ad66-c829-4c38-afd5-8405924abbc5-original-pull-secret podName:9454ad66-c829-4c38-afd5-8405924abbc5 nodeName:}" failed. No retries permitted until 2026-05-28 10:05:49.8850281 +0000 UTC m=+35.345362233 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/9454ad66-c829-4c38-afd5-8405924abbc5-original-pull-secret") pod "global-pull-secret-syncer-qljhc" (UID: "9454ad66-c829-4c38-afd5-8405924abbc5") : object "kube-system"/"original-pull-secret" not registered
May 28 10:05:34.150046 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:34.149968    2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qljhc"
May 28 10:05:34.150046 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:34.149997    2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kvx8v"
May 28 10:05:34.150234 ip-10-0-128-206 kubenswrapper[2565]: E0528 10:05:34.150106    2565 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qljhc" podUID="9454ad66-c829-4c38-afd5-8405924abbc5"
May 28 10:05:34.150234 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:34.150196    2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jj9f8"
May 28 10:05:34.150361 ip-10-0-128-206 kubenswrapper[2565]: E0528 10:05:34.150339    2565 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jj9f8" podUID="9024e35e-a291-4ee1-b4ad-c8b75c8d31ca"
May 28 10:05:34.150472 ip-10-0-128-206 kubenswrapper[2565]: E0528 10:05:34.150443    2565 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kvx8v" podUID="477435e8-f3a1-4bda-8764-5dd5b8afe64f"
May 28 10:05:36.150393 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:36.149964    2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jj9f8"
May 28 10:05:36.150952 ip-10-0-128-206 kubenswrapper[2565]: E0528 10:05:36.150526    2565 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jj9f8" podUID="9024e35e-a291-4ee1-b4ad-c8b75c8d31ca"
May 28 10:05:36.150952 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:36.149996    2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kvx8v"
May 28 10:05:36.150952 ip-10-0-128-206 kubenswrapper[2565]: E0528 10:05:36.150624    2565 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kvx8v" podUID="477435e8-f3a1-4bda-8764-5dd5b8afe64f"
May 28 10:05:36.150952 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:36.149984    2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qljhc"
May 28 10:05:36.150952 ip-10-0-128-206 kubenswrapper[2565]: E0528 10:05:36.150700    2565 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qljhc" podUID="9454ad66-c829-4c38-afd5-8405924abbc5"
May 28 10:05:36.273695 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:36.273657    2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-8jmk5" event={"ID":"74f14c89-a025-4bda-ab55-a7a661f2702e","Type":"ContainerStarted","Data":"41376205187d66c57bd8c78122011a564c6114401e744314979c2ce167cb78f1"}
May 28 10:05:36.275303 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:36.275271    2565 generic.go:358] "Generic (PLEG): container finished" podID="2a281715-5613-4b06-9963-0addcc9b432a" containerID="2587b70b25dcf541c399b6e42e5bfd4e22196f54893dd34bbf98fd0f2f82e06a" exitCode=0
May 28 10:05:36.275426 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:36.275354    2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-ck4jd" event={"ID":"2a281715-5613-4b06-9963-0addcc9b432a","Type":"ContainerDied","Data":"2587b70b25dcf541c399b6e42e5bfd4e22196f54893dd34bbf98fd0f2f82e06a"}
May 28 10:05:36.276890 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:36.276873    2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-78j5q" event={"ID":"9f62bd21-c44c-4022-a4d8-1ffa1422c955","Type":"ContainerStarted","Data":"32a0cc3593e6bd5b3b5adaeb7902edcc65ad7bfd341e6d5fc7eb44f2b05de32b"}
May 28 10:05:36.278861 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:36.278832    2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-8nw9l" event={"ID":"a5f7c60c-f57b-475b-a97a-32f0e1dbdc5b","Type":"ContainerStarted","Data":"29ff457bb91892784cc03dc8beffa2566994bd4dcc976b1c01f7969d7779824d"}
May 28 10:05:36.280090 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:36.280074    2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-6qpxx" event={"ID":"c925ed8e-f4ec-45e6-bfa6-2128a0947aca","Type":"ContainerStarted","Data":"81c9de0d348b9ad947a66e6372925e5e421b736386698a55de1511090ccadf27"}
May 28 10:05:36.281374 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:36.281352    2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-206.ec2.internal" event={"ID":"a6772c4d9844f0928036a579dcf5d882","Type":"ContainerStarted","Data":"78a52999ccac7062d284724e09d6fa47a9cc9c83a4deb2494a97defb75de4676"}
May 28 10:05:36.282567 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:36.282547    2565 generic.go:358] "Generic (PLEG): container finished" podID="dafcffec46e93c961979dd9c978f3fcd" containerID="88e33444683876b4807f26e78d0d548a96d99e5e8ec3a4f0307f82e1a67aa6c3" exitCode=0
May 28 10:05:36.282639 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:36.282609    2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-206.ec2.internal" event={"ID":"dafcffec46e93c961979dd9c978f3fcd","Type":"ContainerDied","Data":"88e33444683876b4807f26e78d0d548a96d99e5e8ec3a4f0307f82e1a67aa6c3"}
May 28 10:05:36.283770 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:36.283752    2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-vwktp" event={"ID":"c52e0100-163d-47e8-9414-e07548bc3e37","Type":"ContainerStarted","Data":"d9db63ad0378f8279f57fb87816cac450710c0862a5d6db6625a0d1e0a8ba378"}
May 28 10:05:36.284940 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:36.284917    2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-8vr88" event={"ID":"b4abbf06-e346-4870-a227-65afbd0db899","Type":"ContainerStarted","Data":"0221d3282c13dcb8a6c3e8b30605440b2561eea1fac48cb100dfa7265f0edf28"}
May 28 10:05:36.286968 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:36.286951    2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-j4whq" event={"ID":"5185dc25-c431-4639-a53a-0c38db5a6f4f","Type":"ContainerStarted","Data":"b1a1c965c9d90496a38318033fad11d76973ca5559543154aceb616c16349003"}
May 28 10:05:36.287055 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:36.286971    2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-j4whq" event={"ID":"5185dc25-c431-4639-a53a-0c38db5a6f4f","Type":"ContainerStarted","Data":"8a773619817fda6444ad7491f6e79995eee2bed4a882b54566be0fdc4d3031dc"}
May 28 10:05:36.287055 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:36.286979    2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-j4whq" event={"ID":"5185dc25-c431-4639-a53a-0c38db5a6f4f","Type":"ContainerStarted","Data":"ae78d99624b132879d73f47be65c5fdac5229ddcd480f3eb3ccf1e6ce79b5bac"}
May 28 10:05:36.287055 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:36.286987    2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-j4whq" event={"ID":"5185dc25-c431-4639-a53a-0c38db5a6f4f","Type":"ContainerStarted","Data":"70fefadd4f01d7cd9ce0f12a04052ef9dad92d4fe368f007336cb0c3514b76f7"}
May 28 10:05:36.287055 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:36.286994    2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-j4whq" event={"ID":"5185dc25-c431-4639-a53a-0c38db5a6f4f","Type":"ContainerStarted","Data":"e173701eb02b352d3e00590311a21033b158005b7fc57188a4e8de89d3955213"}
May 28 10:05:36.289954 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:36.289913    2565 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-image-registry/node-ca-8jmk5" podStartSLOduration=2.044465426 podStartE2EDuration="21.289904328s" podCreationTimestamp="2026-05-28 10:05:15 +0000 UTC" firstStartedPulling="2026-05-28 10:05:16.383348314 +0000 UTC m=+1.843682446" lastFinishedPulling="2026-05-28 10:05:35.628787209 +0000 UTC m=+21.089121348" observedRunningTime="2026-05-28 10:05:36.289740368 +0000 UTC m=+21.750074519" watchObservedRunningTime="2026-05-28 10:05:36.289904328 +0000 UTC m=+21.750238478"
May 28 10:05:36.347177 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:36.347132    2565 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-dns/node-resolver-8vr88" podStartSLOduration=2.117496582 podStartE2EDuration="21.347116048s" podCreationTimestamp="2026-05-28 10:05:15 +0000 UTC" firstStartedPulling="2026-05-28 10:05:16.39896791 +0000 UTC m=+1.859302039" lastFinishedPulling="2026-05-28 10:05:35.628587373 +0000 UTC m=+21.088921505" observedRunningTime="2026-05-28 10:05:36.32333557 +0000 UTC m=+21.783669721" watchObservedRunningTime="2026-05-28 10:05:36.347116048 +0000 UTC m=+21.807450199"
May 28 10:05:36.368584 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:36.368525    2565 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/multus-vwktp" podStartSLOduration=2.004661774 podStartE2EDuration="21.368493163s" podCreationTimestamp="2026-05-28 10:05:15 +0000 UTC" firstStartedPulling="2026-05-28 10:05:16.412568356 +0000 UTC m=+1.872902492" lastFinishedPulling="2026-05-28 10:05:35.776399737 +0000 UTC m=+21.236733881" observedRunningTime="2026-05-28 10:05:36.367672291 +0000 UTC m=+21.828006443" watchObservedRunningTime="2026-05-28 10:05:36.368493163 +0000 UTC m=+21.828827503"
May 28 10:05:36.388642 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:36.388532    2565 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-206.ec2.internal" podStartSLOduration=20.388519361 podStartE2EDuration="20.388519361s" podCreationTimestamp="2026-05-28 10:05:16 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-28 10:05:36.388174855 +0000 UTC m=+21.848509010" watchObservedRunningTime="2026-05-28 10:05:36.388519361 +0000 UTC m=+21.848853511"
May 28 10:05:36.415512 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:36.415468    2565 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/konnectivity-agent-6qpxx" podStartSLOduration=2.088521923 podStartE2EDuration="21.415448317s" podCreationTimestamp="2026-05-28 10:05:15 +0000 UTC" firstStartedPulling="2026-05-28 10:05:16.371441318 +0000 UTC m=+1.831775449" lastFinishedPulling="2026-05-28 10:05:35.698367697 +0000 UTC m=+21.158701843" observedRunningTime="2026-05-28 10:05:36.415167575 +0000 UTC m=+21.875501727" watchObservedRunningTime="2026-05-28 10:05:36.415448317 +0000 UTC m=+21.875782498"
May 28 10:05:37.290482 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:37.290440    2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-206.ec2.internal" event={"ID":"dafcffec46e93c961979dd9c978f3fcd","Type":"ContainerStarted","Data":"b7c6b70597a6773c30ee9072c4d9e9f2f1a8ee4276ca65516b74cac5499cd962"}
May 28 10:05:37.292223 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:37.292192    2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-q87km" event={"ID":"c1d9d1d1-da1a-431d-9baa-2bf4928f94d3","Type":"ContainerStarted","Data":"fb59d294700811c51070e81db4c925ffa21b4aee07de5908340feabc0f614805"}
May 28 10:05:37.304403 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:37.304367    2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-j4whq" event={"ID":"5185dc25-c431-4639-a53a-0c38db5a6f4f","Type":"ContainerStarted","Data":"177b6ccd0981d8e740d60a784019ae3afbe295fca39877fc532f9cb1d0278fa9"}
May 28 10:05:37.312659 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:37.312607    2565 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-206.ec2.internal" podStartSLOduration=21.312593594 podStartE2EDuration="21.312593594s" podCreationTimestamp="2026-05-28 10:05:16 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-28 10:05:37.311919939 +0000 UTC m=+22.772254091" watchObservedRunningTime="2026-05-28 10:05:37.312593594 +0000 UTC m=+22.772927744"
May 28 10:05:37.312800 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:37.312707    2565 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-8nw9l" podStartSLOduration=3.060283679 podStartE2EDuration="22.312703187s" podCreationTimestamp="2026-05-28 10:05:15 +0000 UTC" firstStartedPulling="2026-05-28 10:05:16.376249134 +0000 UTC m=+1.836583262" lastFinishedPulling="2026-05-28 10:05:35.628668642 +0000 UTC m=+21.089002770" observedRunningTime="2026-05-28 10:05:36.438635428 +0000 UTC m=+21.898969578" watchObservedRunningTime="2026-05-28 10:05:37.312703187 +0000 UTC m=+22.773037387"
May 28 10:05:37.332837 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:37.332786    2565 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-q87km" podStartSLOduration=3.021526917 podStartE2EDuration="22.332771689s" podCreationTimestamp="2026-05-28 10:05:15 +0000 UTC" firstStartedPulling="2026-05-28 10:05:16.415801902 +0000 UTC m=+1.876136034" lastFinishedPulling="2026-05-28 10:05:35.72704667 +0000 UTC m=+21.187380806" observedRunningTime="2026-05-28 10:05:37.332444657 +0000 UTC m=+22.792778819" watchObservedRunningTime="2026-05-28 10:05:37.332771689 +0000 UTC m=+22.793105839"
May 28 10:05:37.586252 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:37.586090    2565 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
May 28 10:05:38.113568 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:38.113296    2565 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-05-28T10:05:37.586247104Z","UUID":"1cd59edb-88f1-4672-839c-4f7cb269c4c1","Handler":null,"Name":"","Endpoint":""}
May 28 10:05:38.115300 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:38.115262    2565 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
May 28 10:05:38.115300 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:38.115295    2565 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
May 28 10:05:38.149908 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:38.149837    2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jj9f8"
May 28 10:05:38.149908 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:38.149871    2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kvx8v"
May 28 10:05:38.150144 ip-10-0-128-206 kubenswrapper[2565]: E0528 10:05:38.149970    2565 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jj9f8" podUID="9024e35e-a291-4ee1-b4ad-c8b75c8d31ca"
May 28 10:05:38.150324 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:38.149850    2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qljhc"
May 28 10:05:38.150440 ip-10-0-128-206 kubenswrapper[2565]: E0528 10:05:38.150280    2565 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kvx8v" podUID="477435e8-f3a1-4bda-8764-5dd5b8afe64f"
May 28 10:05:38.150440 ip-10-0-128-206 kubenswrapper[2565]: E0528 10:05:38.150398    2565 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qljhc" podUID="9454ad66-c829-4c38-afd5-8405924abbc5"
May 28 10:05:38.307652 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:38.307606    2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-78j5q" event={"ID":"9f62bd21-c44c-4022-a4d8-1ffa1422c955","Type":"ContainerStarted","Data":"a75402eb9333f95c9b8063c987fa45fa92a52bc84be9891a3e84010e440ec5cb"}
May 28 10:05:38.692047 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:38.691967    2565 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-6qpxx"
May 28 10:05:38.692654 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:38.692631    2565 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-6qpxx"
May 28 10:05:39.310936 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:39.310856    2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-78j5q" event={"ID":"9f62bd21-c44c-4022-a4d8-1ffa1422c955","Type":"ContainerStarted","Data":"d9b7ae61f89c94de193981e00bcc43b8cf3d42e92def7893ab7ff19de2b8461b"}
May 28 10:05:39.313483 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:39.313456    2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-j4whq" event={"ID":"5185dc25-c431-4639-a53a-0c38db5a6f4f","Type":"ContainerStarted","Data":"e888c5fd0379b646eb856ff4fd05b0143a5f5b306d2bcb17540c039038c3b1ad"}
May 28 10:05:39.350368 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:39.350322    2565 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-78j5q" podStartSLOduration=1.874597215 podStartE2EDuration="24.350295331s" podCreationTimestamp="2026-05-28 10:05:15 +0000 UTC" firstStartedPulling="2026-05-28 10:05:16.390016716 +0000 UTC m=+1.850350858" lastFinishedPulling="2026-05-28 10:05:38.865714842 +0000 UTC m=+24.326048974" observedRunningTime="2026-05-28 10:05:39.350162006 +0000 UTC m=+24.810496158" watchObservedRunningTime="2026-05-28 10:05:39.350295331 +0000 UTC m=+24.810629481"
May 28 10:05:40.150720 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:40.150648    2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kvx8v"
May 28 10:05:40.150882 ip-10-0-128-206 kubenswrapper[2565]: E0528 10:05:40.150758    2565 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kvx8v" podUID="477435e8-f3a1-4bda-8764-5dd5b8afe64f"
May 28 10:05:40.150882 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:40.150864    2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jj9f8"
May 28 10:05:40.151005 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:40.150927    2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qljhc"
May 28 10:05:40.151065 ip-10-0-128-206 kubenswrapper[2565]: E0528 10:05:40.151022    2565 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qljhc" podUID="9454ad66-c829-4c38-afd5-8405924abbc5"
May 28 10:05:40.151121 ip-10-0-128-206 kubenswrapper[2565]: E0528 10:05:40.151072    2565 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jj9f8" podUID="9024e35e-a291-4ee1-b4ad-c8b75c8d31ca"
May 28 10:05:41.319876 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:41.319586    2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-j4whq" event={"ID":"5185dc25-c431-4639-a53a-0c38db5a6f4f","Type":"ContainerStarted","Data":"1e7faf79aeb34c9994a83b61c4a339886184a8693d55ccb120900dba8cab9764"}
May 28 10:05:41.320501 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:41.319969    2565 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-j4whq"
May 28 10:05:41.320501 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:41.319997    2565 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-j4whq"
May 28 10:05:41.321506 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:41.321478    2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-ck4jd" event={"ID":"2a281715-5613-4b06-9963-0addcc9b432a","Type":"ContainerStarted","Data":"0131d3b32ef8fe9fa37b8b0eae65658f3903a94b77b6e87faaee09a3ade50eb0"}
May 28 10:05:41.335800 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:41.335779    2565 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-j4whq"
May 28 10:05:41.359943 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:41.359885    2565 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-j4whq" podStartSLOduration=7.019181534 podStartE2EDuration="26.359870577s" podCreationTimestamp="2026-05-28 10:05:15 +0000 UTC" firstStartedPulling="2026-05-28 10:05:16.395226604 +0000 UTC m=+1.855560732" lastFinishedPulling="2026-05-28 10:05:35.735915646 +0000 UTC m=+21.196249775" observedRunningTime="2026-05-28 10:05:41.358655433 +0000 UTC m=+26.818989585" watchObservedRunningTime="2026-05-28 10:05:41.359870577 +0000 UTC m=+26.820204728"
May 28 10:05:42.150568 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:42.150540    2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qljhc"
May 28 10:05:42.150841 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:42.150546    2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jj9f8"
May 28 10:05:42.150841 ip-10-0-128-206 kubenswrapper[2565]: E0528 10:05:42.150648    2565 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qljhc" podUID="9454ad66-c829-4c38-afd5-8405924abbc5"
May 28 10:05:42.150841 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:42.150546    2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kvx8v"
May 28 10:05:42.150841 ip-10-0-128-206 kubenswrapper[2565]: E0528 10:05:42.150723    2565 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jj9f8" podUID="9024e35e-a291-4ee1-b4ad-c8b75c8d31ca"
May 28 10:05:42.150841 ip-10-0-128-206 kubenswrapper[2565]: E0528 10:05:42.150778    2565 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kvx8v" podUID="477435e8-f3a1-4bda-8764-5dd5b8afe64f"
May 28 10:05:42.325583 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:42.325548    2565 generic.go:358] "Generic (PLEG): container finished" podID="2a281715-5613-4b06-9963-0addcc9b432a" containerID="0131d3b32ef8fe9fa37b8b0eae65658f3903a94b77b6e87faaee09a3ade50eb0" exitCode=0
May 28 10:05:42.325968 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:42.325675    2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-ck4jd" event={"ID":"2a281715-5613-4b06-9963-0addcc9b432a","Type":"ContainerDied","Data":"0131d3b32ef8fe9fa37b8b0eae65658f3903a94b77b6e87faaee09a3ade50eb0"}
May 28 10:05:42.327203 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:42.326299    2565 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-j4whq"
May 28 10:05:42.347544 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:42.347518    2565 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-j4whq"
May 28 10:05:43.021546 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:43.021376    2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-jj9f8"]
May 28 10:05:43.021684 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:43.021633    2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jj9f8"
May 28 10:05:43.021742 ip-10-0-128-206 kubenswrapper[2565]: E0528 10:05:43.021722    2565 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jj9f8" podUID="9024e35e-a291-4ee1-b4ad-c8b75c8d31ca"
May 28 10:05:43.023440 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:43.023415    2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-kvx8v"]
May 28 10:05:43.023540 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:43.023507    2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kvx8v"
May 28 10:05:43.023589 ip-10-0-128-206 kubenswrapper[2565]: E0528 10:05:43.023570    2565 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kvx8v" podUID="477435e8-f3a1-4bda-8764-5dd5b8afe64f"
May 28 10:05:43.036145 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:43.036122    2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-qljhc"]
May 28 10:05:43.036265 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:43.036217    2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qljhc"
May 28 10:05:43.036302 ip-10-0-128-206 kubenswrapper[2565]: E0528 10:05:43.036291    2565 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qljhc" podUID="9454ad66-c829-4c38-afd5-8405924abbc5"
May 28 10:05:43.676506 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:43.676474    2565 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-6qpxx"
May 28 10:05:43.676969 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:43.676600    2565 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness"
May 28 10:05:43.677043 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:43.677027    2565 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-6qpxx"
May 28 10:05:44.330631 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:44.330599    2565 generic.go:358] "Generic (PLEG): container finished" podID="2a281715-5613-4b06-9963-0addcc9b432a" containerID="22b2d884cc7c6c50eba84ef5c5f1c6da345fe03a459cc0ffd6bbbdfc95d76511" exitCode=0
May 28 10:05:44.330801 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:44.330680    2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-ck4jd" event={"ID":"2a281715-5613-4b06-9963-0addcc9b432a","Type":"ContainerDied","Data":"22b2d884cc7c6c50eba84ef5c5f1c6da345fe03a459cc0ffd6bbbdfc95d76511"}
May 28 10:05:45.150661 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:45.150630    2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qljhc"
May 28 10:05:45.151362 ip-10-0-128-206 kubenswrapper[2565]: E0528 10:05:45.150720    2565 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qljhc" podUID="9454ad66-c829-4c38-afd5-8405924abbc5"
May 28 10:05:45.151362 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:45.150811    2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jj9f8"
May 28 10:05:45.151362 ip-10-0-128-206 kubenswrapper[2565]: E0528 10:05:45.150953    2565 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jj9f8" podUID="9024e35e-a291-4ee1-b4ad-c8b75c8d31ca"
May 28 10:05:45.151362 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:45.151024    2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kvx8v"
May 28 10:05:45.151362 ip-10-0-128-206 kubenswrapper[2565]: E0528 10:05:45.151118    2565 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kvx8v" podUID="477435e8-f3a1-4bda-8764-5dd5b8afe64f"
May 28 10:05:45.334723 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:45.334638    2565 generic.go:358] "Generic (PLEG): container finished" podID="2a281715-5613-4b06-9963-0addcc9b432a" containerID="bed1d980a3aefb1f59f343ac56df69da746798f2fa8752d31ac4c0a2e2a02cf2" exitCode=0
May 28 10:05:45.334723 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:45.334704    2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-ck4jd" event={"ID":"2a281715-5613-4b06-9963-0addcc9b432a","Type":"ContainerDied","Data":"bed1d980a3aefb1f59f343ac56df69da746798f2fa8752d31ac4c0a2e2a02cf2"}
May 28 10:05:47.151208 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:47.150867    2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kvx8v"
May 28 10:05:47.151208 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:47.150903    2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jj9f8"
May 28 10:05:47.151208 ip-10-0-128-206 kubenswrapper[2565]: E0528 10:05:47.150992    2565 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kvx8v" podUID="477435e8-f3a1-4bda-8764-5dd5b8afe64f"
May 28 10:05:47.151208 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:47.151023    2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qljhc"
May 28 10:05:47.151208 ip-10-0-128-206 kubenswrapper[2565]: E0528 10:05:47.151148    2565 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qljhc" podUID="9454ad66-c829-4c38-afd5-8405924abbc5"
May 28 10:05:47.151983 ip-10-0-128-206 kubenswrapper[2565]: E0528 10:05:47.151240    2565 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jj9f8" podUID="9024e35e-a291-4ee1-b4ad-c8b75c8d31ca"
May 28 10:05:47.783647 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:47.783613    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9024e35e-a291-4ee1-b4ad-c8b75c8d31ca-metrics-certs\") pod \"network-metrics-daemon-jj9f8\" (UID: \"9024e35e-a291-4ee1-b4ad-c8b75c8d31ca\") " pod="openshift-multus/network-metrics-daemon-jj9f8"
May 28 10:05:47.783801 ip-10-0-128-206 kubenswrapper[2565]: E0528 10:05:47.783776    2565 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
May 28 10:05:47.783864 ip-10-0-128-206 kubenswrapper[2565]: E0528 10:05:47.783842    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9024e35e-a291-4ee1-b4ad-c8b75c8d31ca-metrics-certs podName:9024e35e-a291-4ee1-b4ad-c8b75c8d31ca nodeName:}" failed. No retries permitted until 2026-05-28 10:06:19.783828928 +0000 UTC m=+65.244163057 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/9024e35e-a291-4ee1-b4ad-c8b75c8d31ca-metrics-certs") pod "network-metrics-daemon-jj9f8" (UID: "9024e35e-a291-4ee1-b4ad-c8b75c8d31ca") : object "openshift-multus"/"metrics-daemon-secret" not registered
May 28 10:05:47.884261 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:47.884220    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-qdj6s\" (UniqueName: \"kubernetes.io/projected/477435e8-f3a1-4bda-8764-5dd5b8afe64f-kube-api-access-qdj6s\") pod \"network-check-target-kvx8v\" (UID: \"477435e8-f3a1-4bda-8764-5dd5b8afe64f\") " pod="openshift-network-diagnostics/network-check-target-kvx8v"
May 28 10:05:47.884469 ip-10-0-128-206 kubenswrapper[2565]: E0528 10:05:47.884384    2565 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
May 28 10:05:47.884469 ip-10-0-128-206 kubenswrapper[2565]: E0528 10:05:47.884400    2565 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
May 28 10:05:47.884469 ip-10-0-128-206 kubenswrapper[2565]: E0528 10:05:47.884409    2565 projected.go:194] Error preparing data for projected volume kube-api-access-qdj6s for pod openshift-network-diagnostics/network-check-target-kvx8v: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 28 10:05:47.884469 ip-10-0-128-206 kubenswrapper[2565]: E0528 10:05:47.884464    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/477435e8-f3a1-4bda-8764-5dd5b8afe64f-kube-api-access-qdj6s podName:477435e8-f3a1-4bda-8764-5dd5b8afe64f nodeName:}" failed. No retries permitted until 2026-05-28 10:06:19.88444803 +0000 UTC m=+65.344782160 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-qdj6s" (UniqueName: "kubernetes.io/projected/477435e8-f3a1-4bda-8764-5dd5b8afe64f-kube-api-access-qdj6s") pod "network-check-target-kvx8v" (UID: "477435e8-f3a1-4bda-8764-5dd5b8afe64f") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 28 10:05:48.308305 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:48.308122    2565 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-128-206.ec2.internal" event="NodeReady"
May 28 10:05:48.308720 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:48.308432    2565 kubelet_node_status.go:550] "Fast updating node status as it just became ready"
May 28 10:05:48.347729 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:48.347690    2565 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-7db77487f9-bljn6"]
May 28 10:05:48.349472 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:48.349452    2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7db77487f9-bljn6"
May 28 10:05:48.353427 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:48.353135    2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
May 28 10:05:48.353427 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:48.353135    2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
May 28 10:05:48.353427 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:48.353279    2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
May 28 10:05:48.353685 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:48.353581    2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-9brr7\""
May 28 10:05:48.357711 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:48.357676    2565 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-hcldz"]
May 28 10:05:48.359745 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:48.359726    2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-hcldz"
May 28 10:05:48.359906 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:48.359888    2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
May 28 10:05:48.363174 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:48.363143    2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-d6fcq\""
May 28 10:05:48.363640 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:48.363618    2565 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-9q7gx"]
May 28 10:05:48.364269 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:48.364252    2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
May 28 10:05:48.364353 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:48.364281    2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
May 28 10:05:48.365063 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:48.365042    2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-7db77487f9-bljn6"]
May 28 10:05:48.365219 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:48.365133    2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-9q7gx"
May 28 10:05:48.368389 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:48.367959    2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-49hfj\""
May 28 10:05:48.368389 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:48.367994    2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
May 28 10:05:48.368389 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:48.368180    2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
May 28 10:05:48.368389 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:48.368238    2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
May 28 10:05:48.372720 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:48.372555    2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-hcldz"]
May 28 10:05:48.377986 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:48.377057    2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-9q7gx"]
May 28 10:05:48.489789 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:48.489615    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/36bbe57c-1087-4fb9-a8b2-66ae7b6c32d2-installation-pull-secrets\") pod \"image-registry-7db77487f9-bljn6\" (UID: \"36bbe57c-1087-4fb9-a8b2-66ae7b6c32d2\") " pod="openshift-image-registry/image-registry-7db77487f9-bljn6"
May 28 10:05:48.489789 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:48.489667    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/36bbe57c-1087-4fb9-a8b2-66ae7b6c32d2-trusted-ca\") pod \"image-registry-7db77487f9-bljn6\" (UID: \"36bbe57c-1087-4fb9-a8b2-66ae7b6c32d2\") " pod="openshift-image-registry/image-registry-7db77487f9-bljn6"
May 28 10:05:48.489789 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:48.489697    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/be308a10-eaec-4c81-9d1d-4f5bf03358ab-cert\") pod \"ingress-canary-9q7gx\" (UID: \"be308a10-eaec-4c81-9d1d-4f5bf03358ab\") " pod="openshift-ingress-canary/ingress-canary-9q7gx"
May 28 10:05:48.489789 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:48.489728    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pwtxw\" (UniqueName: \"kubernetes.io/projected/be308a10-eaec-4c81-9d1d-4f5bf03358ab-kube-api-access-pwtxw\") pod \"ingress-canary-9q7gx\" (UID: \"be308a10-eaec-4c81-9d1d-4f5bf03358ab\") " pod="openshift-ingress-canary/ingress-canary-9q7gx"
May 28 10:05:48.489789 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:48.489779    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/36bbe57c-1087-4fb9-a8b2-66ae7b6c32d2-bound-sa-token\") pod \"image-registry-7db77487f9-bljn6\" (UID: \"36bbe57c-1087-4fb9-a8b2-66ae7b6c32d2\") " pod="openshift-image-registry/image-registry-7db77487f9-bljn6"
May 28 10:05:48.490193 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:48.489810    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/36bbe57c-1087-4fb9-a8b2-66ae7b6c32d2-registry-tls\") pod \"image-registry-7db77487f9-bljn6\" (UID: \"36bbe57c-1087-4fb9-a8b2-66ae7b6c32d2\") " pod="openshift-image-registry/image-registry-7db77487f9-bljn6"
May 28 10:05:48.490193 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:48.489834    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/36bbe57c-1087-4fb9-a8b2-66ae7b6c32d2-ca-trust-extracted\") pod \"image-registry-7db77487f9-bljn6\" (UID: \"36bbe57c-1087-4fb9-a8b2-66ae7b6c32d2\") " pod="openshift-image-registry/image-registry-7db77487f9-bljn6"
May 28 10:05:48.490193 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:48.489875    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/36bbe57c-1087-4fb9-a8b2-66ae7b6c32d2-image-registry-private-configuration\") pod \"image-registry-7db77487f9-bljn6\" (UID: \"36bbe57c-1087-4fb9-a8b2-66ae7b6c32d2\") " pod="openshift-image-registry/image-registry-7db77487f9-bljn6"
May 28 10:05:48.490193 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:48.489900    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/63f2ebc8-d3a0-40d0-b1ec-c03108b51c0a-config-volume\") pod \"dns-default-hcldz\" (UID: \"63f2ebc8-d3a0-40d0-b1ec-c03108b51c0a\") " pod="openshift-dns/dns-default-hcldz"
May 28 10:05:48.490193 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:48.489923    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/63f2ebc8-d3a0-40d0-b1ec-c03108b51c0a-metrics-tls\") pod \"dns-default-hcldz\" (UID: \"63f2ebc8-d3a0-40d0-b1ec-c03108b51c0a\") " pod="openshift-dns/dns-default-hcldz"
May 28 10:05:48.490193 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:48.489951    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9hp8b\" (UniqueName: \"kubernetes.io/projected/63f2ebc8-d3a0-40d0-b1ec-c03108b51c0a-kube-api-access-9hp8b\") pod \"dns-default-hcldz\" (UID: \"63f2ebc8-d3a0-40d0-b1ec-c03108b51c0a\") " pod="openshift-dns/dns-default-hcldz"
May 28 10:05:48.490193 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:48.489982    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/36bbe57c-1087-4fb9-a8b2-66ae7b6c32d2-registry-certificates\") pod \"image-registry-7db77487f9-bljn6\" (UID: \"36bbe57c-1087-4fb9-a8b2-66ae7b6c32d2\") " pod="openshift-image-registry/image-registry-7db77487f9-bljn6"
May 28 10:05:48.490193 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:48.490007    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ggkj9\" (UniqueName: \"kubernetes.io/projected/36bbe57c-1087-4fb9-a8b2-66ae7b6c32d2-kube-api-access-ggkj9\") pod \"image-registry-7db77487f9-bljn6\" (UID: \"36bbe57c-1087-4fb9-a8b2-66ae7b6c32d2\") " pod="openshift-image-registry/image-registry-7db77487f9-bljn6"
May 28 10:05:48.490193 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:48.490070    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/63f2ebc8-d3a0-40d0-b1ec-c03108b51c0a-tmp-dir\") pod \"dns-default-hcldz\" (UID: \"63f2ebc8-d3a0-40d0-b1ec-c03108b51c0a\") " pod="openshift-dns/dns-default-hcldz"
May 28 10:05:48.591177 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:48.591145    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-9hp8b\" (UniqueName: \"kubernetes.io/projected/63f2ebc8-d3a0-40d0-b1ec-c03108b51c0a-kube-api-access-9hp8b\") pod \"dns-default-hcldz\" (UID: \"63f2ebc8-d3a0-40d0-b1ec-c03108b51c0a\") " pod="openshift-dns/dns-default-hcldz"
May 28 10:05:48.591299 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:48.591193    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/36bbe57c-1087-4fb9-a8b2-66ae7b6c32d2-registry-certificates\") pod \"image-registry-7db77487f9-bljn6\" (UID: \"36bbe57c-1087-4fb9-a8b2-66ae7b6c32d2\") " pod="openshift-image-registry/image-registry-7db77487f9-bljn6"
May 28 10:05:48.591299 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:48.591215    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-ggkj9\" (UniqueName: \"kubernetes.io/projected/36bbe57c-1087-4fb9-a8b2-66ae7b6c32d2-kube-api-access-ggkj9\") pod \"image-registry-7db77487f9-bljn6\" (UID: \"36bbe57c-1087-4fb9-a8b2-66ae7b6c32d2\") " pod="openshift-image-registry/image-registry-7db77487f9-bljn6"
May 28 10:05:48.591398 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:48.591352    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/63f2ebc8-d3a0-40d0-b1ec-c03108b51c0a-tmp-dir\") pod \"dns-default-hcldz\" (UID: \"63f2ebc8-d3a0-40d0-b1ec-c03108b51c0a\") " pod="openshift-dns/dns-default-hcldz"
May 28 10:05:48.591440 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:48.591422    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/36bbe57c-1087-4fb9-a8b2-66ae7b6c32d2-installation-pull-secrets\") pod \"image-registry-7db77487f9-bljn6\" (UID: \"36bbe57c-1087-4fb9-a8b2-66ae7b6c32d2\") " pod="openshift-image-registry/image-registry-7db77487f9-bljn6"
May 28 10:05:48.591491 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:48.591459    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/36bbe57c-1087-4fb9-a8b2-66ae7b6c32d2-trusted-ca\") pod \"image-registry-7db77487f9-bljn6\" (UID: \"36bbe57c-1087-4fb9-a8b2-66ae7b6c32d2\") " pod="openshift-image-registry/image-registry-7db77487f9-bljn6"
May 28 10:05:48.591533 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:48.591519    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/be308a10-eaec-4c81-9d1d-4f5bf03358ab-cert\") pod \"ingress-canary-9q7gx\" (UID: \"be308a10-eaec-4c81-9d1d-4f5bf03358ab\") " pod="openshift-ingress-canary/ingress-canary-9q7gx"
May 28 10:05:48.591588 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:48.591554    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-pwtxw\" (UniqueName: \"kubernetes.io/projected/be308a10-eaec-4c81-9d1d-4f5bf03358ab-kube-api-access-pwtxw\") pod \"ingress-canary-9q7gx\" (UID: \"be308a10-eaec-4c81-9d1d-4f5bf03358ab\") " pod="openshift-ingress-canary/ingress-canary-9q7gx"
May 28 10:05:48.591647 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:48.591603    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/36bbe57c-1087-4fb9-a8b2-66ae7b6c32d2-bound-sa-token\") pod \"image-registry-7db77487f9-bljn6\" (UID: \"36bbe57c-1087-4fb9-a8b2-66ae7b6c32d2\") " pod="openshift-image-registry/image-registry-7db77487f9-bljn6"
May 28 10:05:48.591647 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:48.591640    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/36bbe57c-1087-4fb9-a8b2-66ae7b6c32d2-registry-tls\") pod \"image-registry-7db77487f9-bljn6\" (UID: \"36bbe57c-1087-4fb9-a8b2-66ae7b6c32d2\") " pod="openshift-image-registry/image-registry-7db77487f9-bljn6"
May 28 10:05:48.591742 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:48.591668    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/36bbe57c-1087-4fb9-a8b2-66ae7b6c32d2-ca-trust-extracted\") pod \"image-registry-7db77487f9-bljn6\" (UID: \"36bbe57c-1087-4fb9-a8b2-66ae7b6c32d2\") " pod="openshift-image-registry/image-registry-7db77487f9-bljn6"
May 28 10:05:48.591797 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:48.591731    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/63f2ebc8-d3a0-40d0-b1ec-c03108b51c0a-tmp-dir\") pod \"dns-default-hcldz\" (UID: \"63f2ebc8-d3a0-40d0-b1ec-c03108b51c0a\") " pod="openshift-dns/dns-default-hcldz"
May 28 10:05:48.592034 ip-10-0-128-206 kubenswrapper[2565]: E0528 10:05:48.591641    2565 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
May 28 10:05:48.592034 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:48.591903    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/36bbe57c-1087-4fb9-a8b2-66ae7b6c32d2-registry-certificates\") pod \"image-registry-7db77487f9-bljn6\" (UID: \"36bbe57c-1087-4fb9-a8b2-66ae7b6c32d2\") " pod="openshift-image-registry/image-registry-7db77487f9-bljn6"
May 28 10:05:48.592034 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:48.591905    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/36bbe57c-1087-4fb9-a8b2-66ae7b6c32d2-image-registry-private-configuration\") pod \"image-registry-7db77487f9-bljn6\" (UID: \"36bbe57c-1087-4fb9-a8b2-66ae7b6c32d2\") " pod="openshift-image-registry/image-registry-7db77487f9-bljn6"
May 28 10:05:48.592034 ip-10-0-128-206 kubenswrapper[2565]: E0528 10:05:48.591875    2565 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
May 28 10:05:48.592034 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:48.591965    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/63f2ebc8-d3a0-40d0-b1ec-c03108b51c0a-config-volume\") pod \"dns-default-hcldz\" (UID: \"63f2ebc8-d3a0-40d0-b1ec-c03108b51c0a\") " pod="openshift-dns/dns-default-hcldz"
May 28 10:05:48.592034 ip-10-0-128-206 kubenswrapper[2565]: E0528 10:05:48.591974    2565 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7db77487f9-bljn6: secret "image-registry-tls" not found
May 28 10:05:48.592034 ip-10-0-128-206 kubenswrapper[2565]: E0528 10:05:48.591984    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/be308a10-eaec-4c81-9d1d-4f5bf03358ab-cert podName:be308a10-eaec-4c81-9d1d-4f5bf03358ab nodeName:}" failed. No retries permitted until 2026-05-28 10:05:49.091956069 +0000 UTC m=+34.552290199 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/be308a10-eaec-4c81-9d1d-4f5bf03358ab-cert") pod "ingress-canary-9q7gx" (UID: "be308a10-eaec-4c81-9d1d-4f5bf03358ab") : secret "canary-serving-cert" not found
May 28 10:05:48.592034 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:48.592017    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/36bbe57c-1087-4fb9-a8b2-66ae7b6c32d2-ca-trust-extracted\") pod \"image-registry-7db77487f9-bljn6\" (UID: \"36bbe57c-1087-4fb9-a8b2-66ae7b6c32d2\") " pod="openshift-image-registry/image-registry-7db77487f9-bljn6"
May 28 10:05:48.592034 ip-10-0-128-206 kubenswrapper[2565]: E0528 10:05:48.592030    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/36bbe57c-1087-4fb9-a8b2-66ae7b6c32d2-registry-tls podName:36bbe57c-1087-4fb9-a8b2-66ae7b6c32d2 nodeName:}" failed. No retries permitted until 2026-05-28 10:05:49.092010421 +0000 UTC m=+34.552344571 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/36bbe57c-1087-4fb9-a8b2-66ae7b6c32d2-registry-tls") pod "image-registry-7db77487f9-bljn6" (UID: "36bbe57c-1087-4fb9-a8b2-66ae7b6c32d2") : secret "image-registry-tls" not found
May 28 10:05:48.592608 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:48.592051    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/63f2ebc8-d3a0-40d0-b1ec-c03108b51c0a-metrics-tls\") pod \"dns-default-hcldz\" (UID: \"63f2ebc8-d3a0-40d0-b1ec-c03108b51c0a\") " pod="openshift-dns/dns-default-hcldz"
May 28 10:05:48.592608 ip-10-0-128-206 kubenswrapper[2565]: E0528 10:05:48.592161    2565 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
May 28 10:05:48.592608 ip-10-0-128-206 kubenswrapper[2565]: E0528 10:05:48.592203    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/63f2ebc8-d3a0-40d0-b1ec-c03108b51c0a-metrics-tls podName:63f2ebc8-d3a0-40d0-b1ec-c03108b51c0a nodeName:}" failed. No retries permitted until 2026-05-28 10:05:49.092189335 +0000 UTC m=+34.552523481 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/63f2ebc8-d3a0-40d0-b1ec-c03108b51c0a-metrics-tls") pod "dns-default-hcldz" (UID: "63f2ebc8-d3a0-40d0-b1ec-c03108b51c0a") : secret "dns-default-metrics-tls" not found
May 28 10:05:48.592608 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:48.592425    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/63f2ebc8-d3a0-40d0-b1ec-c03108b51c0a-config-volume\") pod \"dns-default-hcldz\" (UID: \"63f2ebc8-d3a0-40d0-b1ec-c03108b51c0a\") " pod="openshift-dns/dns-default-hcldz"
May 28 10:05:48.593044 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:48.593023    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/36bbe57c-1087-4fb9-a8b2-66ae7b6c32d2-trusted-ca\") pod \"image-registry-7db77487f9-bljn6\" (UID: \"36bbe57c-1087-4fb9-a8b2-66ae7b6c32d2\") " pod="openshift-image-registry/image-registry-7db77487f9-bljn6"
May 28 10:05:48.595789 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:48.595767    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/36bbe57c-1087-4fb9-a8b2-66ae7b6c32d2-installation-pull-secrets\") pod \"image-registry-7db77487f9-bljn6\" (UID: \"36bbe57c-1087-4fb9-a8b2-66ae7b6c32d2\") " pod="openshift-image-registry/image-registry-7db77487f9-bljn6"
May 28 10:05:48.595868 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:48.595771    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/36bbe57c-1087-4fb9-a8b2-66ae7b6c32d2-image-registry-private-configuration\") pod \"image-registry-7db77487f9-bljn6\" (UID: \"36bbe57c-1087-4fb9-a8b2-66ae7b6c32d2\") " pod="openshift-image-registry/image-registry-7db77487f9-bljn6"
May 28 10:05:48.603807 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:48.603785    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ggkj9\" (UniqueName: \"kubernetes.io/projected/36bbe57c-1087-4fb9-a8b2-66ae7b6c32d2-kube-api-access-ggkj9\") pod \"image-registry-7db77487f9-bljn6\" (UID: \"36bbe57c-1087-4fb9-a8b2-66ae7b6c32d2\") " pod="openshift-image-registry/image-registry-7db77487f9-bljn6"
May 28 10:05:48.604035 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:48.604012    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pwtxw\" (UniqueName: \"kubernetes.io/projected/be308a10-eaec-4c81-9d1d-4f5bf03358ab-kube-api-access-pwtxw\") pod \"ingress-canary-9q7gx\" (UID: \"be308a10-eaec-4c81-9d1d-4f5bf03358ab\") " pod="openshift-ingress-canary/ingress-canary-9q7gx"
May 28 10:05:48.604228 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:48.604209    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/36bbe57c-1087-4fb9-a8b2-66ae7b6c32d2-bound-sa-token\") pod \"image-registry-7db77487f9-bljn6\" (UID: \"36bbe57c-1087-4fb9-a8b2-66ae7b6c32d2\") " pod="openshift-image-registry/image-registry-7db77487f9-bljn6"
May 28 10:05:48.604805 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:48.604784    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9hp8b\" (UniqueName: \"kubernetes.io/projected/63f2ebc8-d3a0-40d0-b1ec-c03108b51c0a-kube-api-access-9hp8b\") pod \"dns-default-hcldz\" (UID: \"63f2ebc8-d3a0-40d0-b1ec-c03108b51c0a\") " pod="openshift-dns/dns-default-hcldz"
May 28 10:05:49.096947 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:49.096896    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/be308a10-eaec-4c81-9d1d-4f5bf03358ab-cert\") pod \"ingress-canary-9q7gx\" (UID: \"be308a10-eaec-4c81-9d1d-4f5bf03358ab\") " pod="openshift-ingress-canary/ingress-canary-9q7gx"
May 28 10:05:49.097133 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:49.096981    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/36bbe57c-1087-4fb9-a8b2-66ae7b6c32d2-registry-tls\") pod \"image-registry-7db77487f9-bljn6\" (UID: \"36bbe57c-1087-4fb9-a8b2-66ae7b6c32d2\") " pod="openshift-image-registry/image-registry-7db77487f9-bljn6"
May 28 10:05:49.097133 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:49.097028    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/63f2ebc8-d3a0-40d0-b1ec-c03108b51c0a-metrics-tls\") pod \"dns-default-hcldz\" (UID: \"63f2ebc8-d3a0-40d0-b1ec-c03108b51c0a\") " pod="openshift-dns/dns-default-hcldz"
May 28 10:05:49.097133 ip-10-0-128-206 kubenswrapper[2565]: E0528 10:05:49.097051    2565 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
May 28 10:05:49.097133 ip-10-0-128-206 kubenswrapper[2565]: E0528 10:05:49.097112    2565 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
May 28 10:05:49.097133 ip-10-0-128-206 kubenswrapper[2565]: E0528 10:05:49.097118    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/be308a10-eaec-4c81-9d1d-4f5bf03358ab-cert podName:be308a10-eaec-4c81-9d1d-4f5bf03358ab nodeName:}" failed. No retries permitted until 2026-05-28 10:05:50.097102865 +0000 UTC m=+35.557436997 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/be308a10-eaec-4c81-9d1d-4f5bf03358ab-cert") pod "ingress-canary-9q7gx" (UID: "be308a10-eaec-4c81-9d1d-4f5bf03358ab") : secret "canary-serving-cert" not found
May 28 10:05:49.097292 ip-10-0-128-206 kubenswrapper[2565]: E0528 10:05:49.097151    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/63f2ebc8-d3a0-40d0-b1ec-c03108b51c0a-metrics-tls podName:63f2ebc8-d3a0-40d0-b1ec-c03108b51c0a nodeName:}" failed. No retries permitted until 2026-05-28 10:05:50.097138936 +0000 UTC m=+35.557473065 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/63f2ebc8-d3a0-40d0-b1ec-c03108b51c0a-metrics-tls") pod "dns-default-hcldz" (UID: "63f2ebc8-d3a0-40d0-b1ec-c03108b51c0a") : secret "dns-default-metrics-tls" not found
May 28 10:05:49.097292 ip-10-0-128-206 kubenswrapper[2565]: E0528 10:05:49.097196    2565 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
May 28 10:05:49.097292 ip-10-0-128-206 kubenswrapper[2565]: E0528 10:05:49.097203    2565 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7db77487f9-bljn6: secret "image-registry-tls" not found
May 28 10:05:49.097292 ip-10-0-128-206 kubenswrapper[2565]: E0528 10:05:49.097223    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/36bbe57c-1087-4fb9-a8b2-66ae7b6c32d2-registry-tls podName:36bbe57c-1087-4fb9-a8b2-66ae7b6c32d2 nodeName:}" failed. No retries permitted until 2026-05-28 10:05:50.097216864 +0000 UTC m=+35.557550993 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/36bbe57c-1087-4fb9-a8b2-66ae7b6c32d2-registry-tls") pod "image-registry-7db77487f9-bljn6" (UID: "36bbe57c-1087-4fb9-a8b2-66ae7b6c32d2") : secret "image-registry-tls" not found
May 28 10:05:49.150680 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:49.150644    2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jj9f8"
May 28 10:05:49.150855 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:49.150650    2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kvx8v"
May 28 10:05:49.150976 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:49.150662    2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qljhc"
May 28 10:05:49.153859 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:49.153834    2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
May 28 10:05:49.153994 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:49.153901    2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
May 28 10:05:49.154042 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:49.153988    2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-cpsql\""
May 28 10:05:49.154121 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:49.154105    2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-99c9d\""
May 28 10:05:49.154187 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:49.154162    2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
May 28 10:05:49.154719 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:49.154700    2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
May 28 10:05:49.904066 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:49.904032    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/9454ad66-c829-4c38-afd5-8405924abbc5-original-pull-secret\") pod \"global-pull-secret-syncer-qljhc\" (UID: \"9454ad66-c829-4c38-afd5-8405924abbc5\") " pod="kube-system/global-pull-secret-syncer-qljhc"
May 28 10:05:49.906787 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:49.906763    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/9454ad66-c829-4c38-afd5-8405924abbc5-original-pull-secret\") pod \"global-pull-secret-syncer-qljhc\" (UID: \"9454ad66-c829-4c38-afd5-8405924abbc5\") " pod="kube-system/global-pull-secret-syncer-qljhc"
May 28 10:05:50.075760 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:50.075721    2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qljhc"
May 28 10:05:50.105721 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:50.105684    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/be308a10-eaec-4c81-9d1d-4f5bf03358ab-cert\") pod \"ingress-canary-9q7gx\" (UID: \"be308a10-eaec-4c81-9d1d-4f5bf03358ab\") " pod="openshift-ingress-canary/ingress-canary-9q7gx"
May 28 10:05:50.105887 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:50.105738    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/36bbe57c-1087-4fb9-a8b2-66ae7b6c32d2-registry-tls\") pod \"image-registry-7db77487f9-bljn6\" (UID: \"36bbe57c-1087-4fb9-a8b2-66ae7b6c32d2\") " pod="openshift-image-registry/image-registry-7db77487f9-bljn6"
May 28 10:05:50.105887 ip-10-0-128-206 kubenswrapper[2565]: E0528 10:05:50.105841    2565 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
May 28 10:05:50.105961 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:50.105886    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/63f2ebc8-d3a0-40d0-b1ec-c03108b51c0a-metrics-tls\") pod \"dns-default-hcldz\" (UID: \"63f2ebc8-d3a0-40d0-b1ec-c03108b51c0a\") " pod="openshift-dns/dns-default-hcldz"
May 28 10:05:50.105961 ip-10-0-128-206 kubenswrapper[2565]: E0528 10:05:50.105916    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/be308a10-eaec-4c81-9d1d-4f5bf03358ab-cert podName:be308a10-eaec-4c81-9d1d-4f5bf03358ab nodeName:}" failed. No retries permitted until 2026-05-28 10:05:52.105894908 +0000 UTC m=+37.566229046 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/be308a10-eaec-4c81-9d1d-4f5bf03358ab-cert") pod "ingress-canary-9q7gx" (UID: "be308a10-eaec-4c81-9d1d-4f5bf03358ab") : secret "canary-serving-cert" not found
May 28 10:05:50.105961 ip-10-0-128-206 kubenswrapper[2565]: E0528 10:05:50.105842    2565 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
May 28 10:05:50.105961 ip-10-0-128-206 kubenswrapper[2565]: E0528 10:05:50.105942    2565 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7db77487f9-bljn6: secret "image-registry-tls" not found
May 28 10:05:50.106140 ip-10-0-128-206 kubenswrapper[2565]: E0528 10:05:50.105975    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/36bbe57c-1087-4fb9-a8b2-66ae7b6c32d2-registry-tls podName:36bbe57c-1087-4fb9-a8b2-66ae7b6c32d2 nodeName:}" failed. No retries permitted until 2026-05-28 10:05:52.105965067 +0000 UTC m=+37.566299208 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/36bbe57c-1087-4fb9-a8b2-66ae7b6c32d2-registry-tls") pod "image-registry-7db77487f9-bljn6" (UID: "36bbe57c-1087-4fb9-a8b2-66ae7b6c32d2") : secret "image-registry-tls" not found
May 28 10:05:50.106140 ip-10-0-128-206 kubenswrapper[2565]: E0528 10:05:50.105987    2565 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
May 28 10:05:50.106140 ip-10-0-128-206 kubenswrapper[2565]: E0528 10:05:50.106018    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/63f2ebc8-d3a0-40d0-b1ec-c03108b51c0a-metrics-tls podName:63f2ebc8-d3a0-40d0-b1ec-c03108b51c0a nodeName:}" failed. No retries permitted until 2026-05-28 10:05:52.106007303 +0000 UTC m=+37.566341447 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/63f2ebc8-d3a0-40d0-b1ec-c03108b51c0a-metrics-tls") pod "dns-default-hcldz" (UID: "63f2ebc8-d3a0-40d0-b1ec-c03108b51c0a") : secret "dns-default-metrics-tls" not found
May 28 10:05:50.963698 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:50.963668    2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-qljhc"]
May 28 10:05:51.001573 ip-10-0-128-206 kubenswrapper[2565]: W0528 10:05:51.001530    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9454ad66_c829_4c38_afd5_8405924abbc5.slice/crio-945fc40fc70f74ec90de36ff7b22bbb152602825e12784f0cf2557bde9494644 WatchSource:0}: Error finding container 945fc40fc70f74ec90de36ff7b22bbb152602825e12784f0cf2557bde9494644: Status 404 returned error can't find the container with id 945fc40fc70f74ec90de36ff7b22bbb152602825e12784f0cf2557bde9494644
May 28 10:05:51.349022 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:51.348789    2565 generic.go:358] "Generic (PLEG): container finished" podID="2a281715-5613-4b06-9963-0addcc9b432a" containerID="94827c1d9031e0d8915fc076a3c992ac3cca49c9cf6173af234843ad365cbfb5" exitCode=0
May 28 10:05:51.349171 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:51.348847    2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-ck4jd" event={"ID":"2a281715-5613-4b06-9963-0addcc9b432a","Type":"ContainerDied","Data":"94827c1d9031e0d8915fc076a3c992ac3cca49c9cf6173af234843ad365cbfb5"}
May 28 10:05:51.350064 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:51.350043    2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-qljhc" event={"ID":"9454ad66-c829-4c38-afd5-8405924abbc5","Type":"ContainerStarted","Data":"945fc40fc70f74ec90de36ff7b22bbb152602825e12784f0cf2557bde9494644"}
May 28 10:05:52.121224 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:52.121188    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/be308a10-eaec-4c81-9d1d-4f5bf03358ab-cert\") pod \"ingress-canary-9q7gx\" (UID: \"be308a10-eaec-4c81-9d1d-4f5bf03358ab\") " pod="openshift-ingress-canary/ingress-canary-9q7gx"
May 28 10:05:52.121782 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:52.121242    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/36bbe57c-1087-4fb9-a8b2-66ae7b6c32d2-registry-tls\") pod \"image-registry-7db77487f9-bljn6\" (UID: \"36bbe57c-1087-4fb9-a8b2-66ae7b6c32d2\") " pod="openshift-image-registry/image-registry-7db77487f9-bljn6"
May 28 10:05:52.121782 ip-10-0-128-206 kubenswrapper[2565]: E0528 10:05:52.121354    2565 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
May 28 10:05:52.121782 ip-10-0-128-206 kubenswrapper[2565]: E0528 10:05:52.121367    2565 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7db77487f9-bljn6: secret "image-registry-tls" not found
May 28 10:05:52.121782 ip-10-0-128-206 kubenswrapper[2565]: E0528 10:05:52.121391    2565 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
May 28 10:05:52.121782 ip-10-0-128-206 kubenswrapper[2565]: E0528 10:05:52.121456    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/be308a10-eaec-4c81-9d1d-4f5bf03358ab-cert podName:be308a10-eaec-4c81-9d1d-4f5bf03358ab nodeName:}" failed. No retries permitted until 2026-05-28 10:05:56.121438621 +0000 UTC m=+41.581772775 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/be308a10-eaec-4c81-9d1d-4f5bf03358ab-cert") pod "ingress-canary-9q7gx" (UID: "be308a10-eaec-4c81-9d1d-4f5bf03358ab") : secret "canary-serving-cert" not found
May 28 10:05:52.121782 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:52.121481    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/63f2ebc8-d3a0-40d0-b1ec-c03108b51c0a-metrics-tls\") pod \"dns-default-hcldz\" (UID: \"63f2ebc8-d3a0-40d0-b1ec-c03108b51c0a\") " pod="openshift-dns/dns-default-hcldz"
May 28 10:05:52.121782 ip-10-0-128-206 kubenswrapper[2565]: E0528 10:05:52.121551    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/36bbe57c-1087-4fb9-a8b2-66ae7b6c32d2-registry-tls podName:36bbe57c-1087-4fb9-a8b2-66ae7b6c32d2 nodeName:}" failed. No retries permitted until 2026-05-28 10:05:56.121539348 +0000 UTC m=+41.581873487 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/36bbe57c-1087-4fb9-a8b2-66ae7b6c32d2-registry-tls") pod "image-registry-7db77487f9-bljn6" (UID: "36bbe57c-1087-4fb9-a8b2-66ae7b6c32d2") : secret "image-registry-tls" not found
May 28 10:05:52.121782 ip-10-0-128-206 kubenswrapper[2565]: E0528 10:05:52.121607    2565 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
May 28 10:05:52.121782 ip-10-0-128-206 kubenswrapper[2565]: E0528 10:05:52.121665    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/63f2ebc8-d3a0-40d0-b1ec-c03108b51c0a-metrics-tls podName:63f2ebc8-d3a0-40d0-b1ec-c03108b51c0a nodeName:}" failed. No retries permitted until 2026-05-28 10:05:56.121648502 +0000 UTC m=+41.581982638 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/63f2ebc8-d3a0-40d0-b1ec-c03108b51c0a-metrics-tls") pod "dns-default-hcldz" (UID: "63f2ebc8-d3a0-40d0-b1ec-c03108b51c0a") : secret "dns-default-metrics-tls" not found
May 28 10:05:52.354802 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:52.354764    2565 generic.go:358] "Generic (PLEG): container finished" podID="2a281715-5613-4b06-9963-0addcc9b432a" containerID="6856a7ddb53374dd7f28c2d1edfa061425a8f23c0439915a056a90db3ba0b959" exitCode=0
May 28 10:05:52.354958 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:52.354847    2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-ck4jd" event={"ID":"2a281715-5613-4b06-9963-0addcc9b432a","Type":"ContainerDied","Data":"6856a7ddb53374dd7f28c2d1edfa061425a8f23c0439915a056a90db3ba0b959"}
May 28 10:05:53.359685 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:53.359646    2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-ck4jd" event={"ID":"2a281715-5613-4b06-9963-0addcc9b432a","Type":"ContainerStarted","Data":"b7848a010576267b3d6410cf04439575a37a26d1bf5775e0a1adf5ccd890b9ef"}
May 28 10:05:53.387445 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:53.387393    2565 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-ck4jd" podStartSLOduration=3.759942666 podStartE2EDuration="38.387377503s" podCreationTimestamp="2026-05-28 10:05:15 +0000 UTC" firstStartedPulling="2026-05-28 10:05:16.403428456 +0000 UTC m=+1.863762585" lastFinishedPulling="2026-05-28 10:05:51.030863294 +0000 UTC m=+36.491197422" observedRunningTime="2026-05-28 10:05:53.386776604 +0000 UTC m=+38.847110766" watchObservedRunningTime="2026-05-28 10:05:53.387377503 +0000 UTC m=+38.847711655"
May 28 10:05:56.157631 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:56.157600    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/be308a10-eaec-4c81-9d1d-4f5bf03358ab-cert\") pod \"ingress-canary-9q7gx\" (UID: \"be308a10-eaec-4c81-9d1d-4f5bf03358ab\") " pod="openshift-ingress-canary/ingress-canary-9q7gx"
May 28 10:05:56.157631 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:56.157646    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/36bbe57c-1087-4fb9-a8b2-66ae7b6c32d2-registry-tls\") pod \"image-registry-7db77487f9-bljn6\" (UID: \"36bbe57c-1087-4fb9-a8b2-66ae7b6c32d2\") " pod="openshift-image-registry/image-registry-7db77487f9-bljn6"
May 28 10:05:56.158063 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:56.157675    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/63f2ebc8-d3a0-40d0-b1ec-c03108b51c0a-metrics-tls\") pod \"dns-default-hcldz\" (UID: \"63f2ebc8-d3a0-40d0-b1ec-c03108b51c0a\") " pod="openshift-dns/dns-default-hcldz"
May 28 10:05:56.158063 ip-10-0-128-206 kubenswrapper[2565]: E0528 10:05:56.157764    2565 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
May 28 10:05:56.158063 ip-10-0-128-206 kubenswrapper[2565]: E0528 10:05:56.157782    2565 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7db77487f9-bljn6: secret "image-registry-tls" not found
May 28 10:05:56.158063 ip-10-0-128-206 kubenswrapper[2565]: E0528 10:05:56.157768    2565 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
May 28 10:05:56.158063 ip-10-0-128-206 kubenswrapper[2565]: E0528 10:05:56.157854    2565 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
May 28 10:05:56.158063 ip-10-0-128-206 kubenswrapper[2565]: E0528 10:05:56.157828    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/36bbe57c-1087-4fb9-a8b2-66ae7b6c32d2-registry-tls podName:36bbe57c-1087-4fb9-a8b2-66ae7b6c32d2 nodeName:}" failed. No retries permitted until 2026-05-28 10:06:04.157813062 +0000 UTC m=+49.618147191 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/36bbe57c-1087-4fb9-a8b2-66ae7b6c32d2-registry-tls") pod "image-registry-7db77487f9-bljn6" (UID: "36bbe57c-1087-4fb9-a8b2-66ae7b6c32d2") : secret "image-registry-tls" not found
May 28 10:05:56.158063 ip-10-0-128-206 kubenswrapper[2565]: E0528 10:05:56.157887    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/63f2ebc8-d3a0-40d0-b1ec-c03108b51c0a-metrics-tls podName:63f2ebc8-d3a0-40d0-b1ec-c03108b51c0a nodeName:}" failed. No retries permitted until 2026-05-28 10:06:04.157871222 +0000 UTC m=+49.618205351 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/63f2ebc8-d3a0-40d0-b1ec-c03108b51c0a-metrics-tls") pod "dns-default-hcldz" (UID: "63f2ebc8-d3a0-40d0-b1ec-c03108b51c0a") : secret "dns-default-metrics-tls" not found
May 28 10:05:56.158063 ip-10-0-128-206 kubenswrapper[2565]: E0528 10:05:56.157903    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/be308a10-eaec-4c81-9d1d-4f5bf03358ab-cert podName:be308a10-eaec-4c81-9d1d-4f5bf03358ab nodeName:}" failed. No retries permitted until 2026-05-28 10:06:04.157894252 +0000 UTC m=+49.618228382 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/be308a10-eaec-4c81-9d1d-4f5bf03358ab-cert") pod "ingress-canary-9q7gx" (UID: "be308a10-eaec-4c81-9d1d-4f5bf03358ab") : secret "canary-serving-cert" not found
May 28 10:05:57.368123 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:57.368077    2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-qljhc" event={"ID":"9454ad66-c829-4c38-afd5-8405924abbc5","Type":"ContainerStarted","Data":"bba6114b499426f46bf28d7304cf4bc5e2a5287593235c72e0b30ac66bbc6b37"}
May 28 10:05:57.386594 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:05:57.386532    2565 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-qljhc" podStartSLOduration=34.035041887 podStartE2EDuration="39.386520078s" podCreationTimestamp="2026-05-28 10:05:18 +0000 UTC" firstStartedPulling="2026-05-28 10:05:51.008395386 +0000 UTC m=+36.468729515" lastFinishedPulling="2026-05-28 10:05:56.35987356 +0000 UTC m=+41.820207706" observedRunningTime="2026-05-28 10:05:57.386200816 +0000 UTC m=+42.846534970" watchObservedRunningTime="2026-05-28 10:05:57.386520078 +0000 UTC m=+42.846854228"
May 28 10:06:02.137794 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:06:02.137770    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-8vr88_b4abbf06-e346-4870-a227-65afbd0db899/dns-node-resolver/0.log"
May 28 10:06:03.139185 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:06:03.139161    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-8jmk5_74f14c89-a025-4bda-ab55-a7a661f2702e/node-ca/0.log"
May 28 10:06:04.214697 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:06:04.214654    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/63f2ebc8-d3a0-40d0-b1ec-c03108b51c0a-metrics-tls\") pod \"dns-default-hcldz\" (UID: \"63f2ebc8-d3a0-40d0-b1ec-c03108b51c0a\") " pod="openshift-dns/dns-default-hcldz"
May 28 10:06:04.215184 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:06:04.214734    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/be308a10-eaec-4c81-9d1d-4f5bf03358ab-cert\") pod \"ingress-canary-9q7gx\" (UID: \"be308a10-eaec-4c81-9d1d-4f5bf03358ab\") " pod="openshift-ingress-canary/ingress-canary-9q7gx"
May 28 10:06:04.215184 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:06:04.214774    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/36bbe57c-1087-4fb9-a8b2-66ae7b6c32d2-registry-tls\") pod \"image-registry-7db77487f9-bljn6\" (UID: \"36bbe57c-1087-4fb9-a8b2-66ae7b6c32d2\") " pod="openshift-image-registry/image-registry-7db77487f9-bljn6"
May 28 10:06:04.215184 ip-10-0-128-206 kubenswrapper[2565]: E0528 10:06:04.214812    2565 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
May 28 10:06:04.215184 ip-10-0-128-206 kubenswrapper[2565]: E0528 10:06:04.214875    2565 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
May 28 10:06:04.215184 ip-10-0-128-206 kubenswrapper[2565]: E0528 10:06:04.214887    2565 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
May 28 10:06:04.215184 ip-10-0-128-206 kubenswrapper[2565]: E0528 10:06:04.214901    2565 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7db77487f9-bljn6: secret "image-registry-tls" not found
May 28 10:06:04.215184 ip-10-0-128-206 kubenswrapper[2565]: E0528 10:06:04.214884    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/63f2ebc8-d3a0-40d0-b1ec-c03108b51c0a-metrics-tls podName:63f2ebc8-d3a0-40d0-b1ec-c03108b51c0a nodeName:}" failed. No retries permitted until 2026-05-28 10:06:20.214868766 +0000 UTC m=+65.675202894 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/63f2ebc8-d3a0-40d0-b1ec-c03108b51c0a-metrics-tls") pod "dns-default-hcldz" (UID: "63f2ebc8-d3a0-40d0-b1ec-c03108b51c0a") : secret "dns-default-metrics-tls" not found
May 28 10:06:04.215184 ip-10-0-128-206 kubenswrapper[2565]: E0528 10:06:04.214933    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/be308a10-eaec-4c81-9d1d-4f5bf03358ab-cert podName:be308a10-eaec-4c81-9d1d-4f5bf03358ab nodeName:}" failed. No retries permitted until 2026-05-28 10:06:20.214920694 +0000 UTC m=+65.675254826 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/be308a10-eaec-4c81-9d1d-4f5bf03358ab-cert") pod "ingress-canary-9q7gx" (UID: "be308a10-eaec-4c81-9d1d-4f5bf03358ab") : secret "canary-serving-cert" not found
May 28 10:06:04.215184 ip-10-0-128-206 kubenswrapper[2565]: E0528 10:06:04.214949    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/36bbe57c-1087-4fb9-a8b2-66ae7b6c32d2-registry-tls podName:36bbe57c-1087-4fb9-a8b2-66ae7b6c32d2 nodeName:}" failed. No retries permitted until 2026-05-28 10:06:20.214940699 +0000 UTC m=+65.675274829 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/36bbe57c-1087-4fb9-a8b2-66ae7b6c32d2-registry-tls") pod "image-registry-7db77487f9-bljn6" (UID: "36bbe57c-1087-4fb9-a8b2-66ae7b6c32d2") : secret "image-registry-tls" not found
May 28 10:06:14.350045 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:06:14.350017    2565 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-j4whq"
May 28 10:06:19.836434 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:06:19.836400    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9024e35e-a291-4ee1-b4ad-c8b75c8d31ca-metrics-certs\") pod \"network-metrics-daemon-jj9f8\" (UID: \"9024e35e-a291-4ee1-b4ad-c8b75c8d31ca\") " pod="openshift-multus/network-metrics-daemon-jj9f8"
May 28 10:06:19.839350 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:06:19.839332    2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
May 28 10:06:19.850674 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:06:19.850653    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9024e35e-a291-4ee1-b4ad-c8b75c8d31ca-metrics-certs\") pod \"network-metrics-daemon-jj9f8\" (UID: \"9024e35e-a291-4ee1-b4ad-c8b75c8d31ca\") " pod="openshift-multus/network-metrics-daemon-jj9f8"
May 28 10:06:19.937019 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:06:19.936974    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-qdj6s\" (UniqueName: \"kubernetes.io/projected/477435e8-f3a1-4bda-8764-5dd5b8afe64f-kube-api-access-qdj6s\") pod \"network-check-target-kvx8v\" (UID: \"477435e8-f3a1-4bda-8764-5dd5b8afe64f\") " pod="openshift-network-diagnostics/network-check-target-kvx8v"
May 28 10:06:19.940652 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:06:19.940634    2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
May 28 10:06:19.950834 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:06:19.950817    2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
May 28 10:06:19.961348 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:06:19.961327    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qdj6s\" (UniqueName: \"kubernetes.io/projected/477435e8-f3a1-4bda-8764-5dd5b8afe64f-kube-api-access-qdj6s\") pod \"network-check-target-kvx8v\" (UID: \"477435e8-f3a1-4bda-8764-5dd5b8afe64f\") " pod="openshift-network-diagnostics/network-check-target-kvx8v"
May 28 10:06:20.066636 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:06:20.066607    2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-99c9d\""
May 28 10:06:20.072579 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:06:20.072559    2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-cpsql\""
May 28 10:06:20.074667 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:06:20.074654    2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jj9f8"
May 28 10:06:20.080279 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:06:20.080259    2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kvx8v"
May 28 10:06:20.202298 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:06:20.202264    2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-jj9f8"]
May 28 10:06:20.207195 ip-10-0-128-206 kubenswrapper[2565]: W0528 10:06:20.207166    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9024e35e_a291_4ee1_b4ad_c8b75c8d31ca.slice/crio-9e4465176a39394899e1f497a229b669e894f2cc2828cebf0a3dc4ff95020303 WatchSource:0}: Error finding container 9e4465176a39394899e1f497a229b669e894f2cc2828cebf0a3dc4ff95020303: Status 404 returned error can't find the container with id 9e4465176a39394899e1f497a229b669e894f2cc2828cebf0a3dc4ff95020303
May 28 10:06:20.216573 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:06:20.216552    2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-kvx8v"]
May 28 10:06:20.219749 ip-10-0-128-206 kubenswrapper[2565]: W0528 10:06:20.219730    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod477435e8_f3a1_4bda_8764_5dd5b8afe64f.slice/crio-6b416c13a854119f0cf1bc0ff4570084c636babfc634642b26ba344ff99ea6de WatchSource:0}: Error finding container 6b416c13a854119f0cf1bc0ff4570084c636babfc634642b26ba344ff99ea6de: Status 404 returned error can't find the container with id 6b416c13a854119f0cf1bc0ff4570084c636babfc634642b26ba344ff99ea6de
May 28 10:06:20.239390 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:06:20.239371    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/be308a10-eaec-4c81-9d1d-4f5bf03358ab-cert\") pod \"ingress-canary-9q7gx\" (UID: \"be308a10-eaec-4c81-9d1d-4f5bf03358ab\") " pod="openshift-ingress-canary/ingress-canary-9q7gx"
May 28 10:06:20.239476 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:06:20.239410    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/36bbe57c-1087-4fb9-a8b2-66ae7b6c32d2-registry-tls\") pod \"image-registry-7db77487f9-bljn6\" (UID: \"36bbe57c-1087-4fb9-a8b2-66ae7b6c32d2\") " pod="openshift-image-registry/image-registry-7db77487f9-bljn6"
May 28 10:06:20.239476 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:06:20.239445    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/63f2ebc8-d3a0-40d0-b1ec-c03108b51c0a-metrics-tls\") pod \"dns-default-hcldz\" (UID: \"63f2ebc8-d3a0-40d0-b1ec-c03108b51c0a\") " pod="openshift-dns/dns-default-hcldz"
May 28 10:06:20.243427 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:06:20.242598    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/63f2ebc8-d3a0-40d0-b1ec-c03108b51c0a-metrics-tls\") pod \"dns-default-hcldz\" (UID: \"63f2ebc8-d3a0-40d0-b1ec-c03108b51c0a\") " pod="openshift-dns/dns-default-hcldz"
May 28 10:06:20.244062 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:06:20.244044    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/be308a10-eaec-4c81-9d1d-4f5bf03358ab-cert\") pod \"ingress-canary-9q7gx\" (UID: \"be308a10-eaec-4c81-9d1d-4f5bf03358ab\") " pod="openshift-ingress-canary/ingress-canary-9q7gx"
May 28 10:06:20.244133 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:06:20.244094    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/36bbe57c-1087-4fb9-a8b2-66ae7b6c32d2-registry-tls\") pod \"image-registry-7db77487f9-bljn6\" (UID: \"36bbe57c-1087-4fb9-a8b2-66ae7b6c32d2\") " pod="openshift-image-registry/image-registry-7db77487f9-bljn6"
May 28 10:06:20.412586 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:06:20.412549    2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-jj9f8" event={"ID":"9024e35e-a291-4ee1-b4ad-c8b75c8d31ca","Type":"ContainerStarted","Data":"9e4465176a39394899e1f497a229b669e894f2cc2828cebf0a3dc4ff95020303"}
May 28 10:06:20.413529 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:06:20.413493    2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-kvx8v" event={"ID":"477435e8-f3a1-4bda-8764-5dd5b8afe64f","Type":"ContainerStarted","Data":"6b416c13a854119f0cf1bc0ff4570084c636babfc634642b26ba344ff99ea6de"}
May 28 10:06:20.466877 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:06:20.466848    2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-9brr7\""
May 28 10:06:20.474238 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:06:20.474208    2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7db77487f9-bljn6"
May 28 10:06:20.477049 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:06:20.477034    2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-d6fcq\""
May 28 10:06:20.483505 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:06:20.483488    2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-49hfj\""
May 28 10:06:20.484539 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:06:20.484521    2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-hcldz"
May 28 10:06:20.491896 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:06:20.491873    2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-9q7gx"
May 28 10:06:20.619855 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:06:20.619824    2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-7db77487f9-bljn6"]
May 28 10:06:20.624199 ip-10-0-128-206 kubenswrapper[2565]: W0528 10:06:20.624160    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod36bbe57c_1087_4fb9_a8b2_66ae7b6c32d2.slice/crio-9b41902221569b174e27620517ddac7bde29136c775102c6f4084d172ec853bd WatchSource:0}: Error finding container 9b41902221569b174e27620517ddac7bde29136c775102c6f4084d172ec853bd: Status 404 returned error can't find the container with id 9b41902221569b174e27620517ddac7bde29136c775102c6f4084d172ec853bd
May 28 10:06:20.634217 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:06:20.634194    2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-hcldz"]
May 28 10:06:20.641880 ip-10-0-128-206 kubenswrapper[2565]: W0528 10:06:20.641853    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod63f2ebc8_d3a0_40d0_b1ec_c03108b51c0a.slice/crio-b306ae8648df6d18a653a34b74fa08fb3589e9a9469a79be369e0ef3f77d9dda WatchSource:0}: Error finding container b306ae8648df6d18a653a34b74fa08fb3589e9a9469a79be369e0ef3f77d9dda: Status 404 returned error can't find the container with id b306ae8648df6d18a653a34b74fa08fb3589e9a9469a79be369e0ef3f77d9dda
May 28 10:06:20.651956 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:06:20.651932    2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-9q7gx"]
May 28 10:06:20.658298 ip-10-0-128-206 kubenswrapper[2565]: W0528 10:06:20.658278    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbe308a10_eaec_4c81_9d1d_4f5bf03358ab.slice/crio-8f7cb7eafbf3013a5b09fe1f78dd345cf717299098d1690e4b9d3bd4ca6b32b5 WatchSource:0}: Error finding container 8f7cb7eafbf3013a5b09fe1f78dd345cf717299098d1690e4b9d3bd4ca6b32b5: Status 404 returned error can't find the container with id 8f7cb7eafbf3013a5b09fe1f78dd345cf717299098d1690e4b9d3bd4ca6b32b5
May 28 10:06:21.418393 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:06:21.418347    2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7db77487f9-bljn6" event={"ID":"36bbe57c-1087-4fb9-a8b2-66ae7b6c32d2","Type":"ContainerStarted","Data":"2efd528ea55363498cd8ae7a6c312d74d48ee9387b5b39aed30c36dd964bddf2"}
May 28 10:06:21.418393 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:06:21.418392    2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7db77487f9-bljn6" event={"ID":"36bbe57c-1087-4fb9-a8b2-66ae7b6c32d2","Type":"ContainerStarted","Data":"9b41902221569b174e27620517ddac7bde29136c775102c6f4084d172ec853bd"}
May 28 10:06:21.418918 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:06:21.418433    2565 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-7db77487f9-bljn6"
May 28 10:06:21.419738 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:06:21.419711    2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-9q7gx" event={"ID":"be308a10-eaec-4c81-9d1d-4f5bf03358ab","Type":"ContainerStarted","Data":"8f7cb7eafbf3013a5b09fe1f78dd345cf717299098d1690e4b9d3bd4ca6b32b5"}
May 28 10:06:21.420745 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:06:21.420703    2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-hcldz" event={"ID":"63f2ebc8-d3a0-40d0-b1ec-c03108b51c0a","Type":"ContainerStarted","Data":"b306ae8648df6d18a653a34b74fa08fb3589e9a9469a79be369e0ef3f77d9dda"}
May 28 10:06:21.450512 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:06:21.450473    2565 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-image-registry/image-registry-7db77487f9-bljn6" podStartSLOduration=63.450459399 podStartE2EDuration="1m3.450459399s" podCreationTimestamp="2026-05-28 10:05:18 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-28 10:06:21.449470267 +0000 UTC m=+66.909804420" watchObservedRunningTime="2026-05-28 10:06:21.450459399 +0000 UTC m=+66.910793554"
May 28 10:06:24.429405 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:06:24.429298    2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-jj9f8" event={"ID":"9024e35e-a291-4ee1-b4ad-c8b75c8d31ca","Type":"ContainerStarted","Data":"8ccd0ff9acbced2e4ed89f0181db16b2815778e57c7caeb4c65bdc3c3d47e01f"}
May 28 10:06:24.429405 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:06:24.429354    2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-jj9f8" event={"ID":"9024e35e-a291-4ee1-b4ad-c8b75c8d31ca","Type":"ContainerStarted","Data":"115afb75319c41b519023e29b55f9ee05afa20fcb682ab21ce1907b2d07ceeb9"}
May 28 10:06:24.430594 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:06:24.430564    2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-9q7gx" event={"ID":"be308a10-eaec-4c81-9d1d-4f5bf03358ab","Type":"ContainerStarted","Data":"1dba6e1d2dd0021953f09b8cc6dedf9be21ab6e9f6b55f94052a73e589cb0a2e"}
May 28 10:06:24.432046 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:06:24.432025    2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-hcldz" event={"ID":"63f2ebc8-d3a0-40d0-b1ec-c03108b51c0a","Type":"ContainerStarted","Data":"fccd23e3504a68612b840b8023383c75fa851d360735ce166978ec84f01b1433"}
May 28 10:06:24.432126 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:06:24.432052    2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-hcldz" event={"ID":"63f2ebc8-d3a0-40d0-b1ec-c03108b51c0a","Type":"ContainerStarted","Data":"8f3e610f0bb526021aac131a8736086542b10af269f16a60a169b64211187f15"}
May 28 10:06:24.432182 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:06:24.432132    2565 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-hcldz"
May 28 10:06:24.433445 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:06:24.433411    2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-kvx8v" event={"ID":"477435e8-f3a1-4bda-8764-5dd5b8afe64f","Type":"ContainerStarted","Data":"a4e697c1dd84b019fcbd0741f021e2c4df9c2854526b7c5f0367c4a0059a5b10"}
May 28 10:06:24.433554 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:06:24.433497    2565 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-kvx8v"
May 28 10:06:24.448707 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:06:24.448658    2565 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-jj9f8" podStartSLOduration=65.555284173 podStartE2EDuration="1m9.448642992s" podCreationTimestamp="2026-05-28 10:05:15 +0000 UTC" firstStartedPulling="2026-05-28 10:06:20.208998347 +0000 UTC m=+65.669332476" lastFinishedPulling="2026-05-28 10:06:24.102357167 +0000 UTC m=+69.562691295" observedRunningTime="2026-05-28 10:06:24.447145312 +0000 UTC m=+69.907479486" watchObservedRunningTime="2026-05-28 10:06:24.448642992 +0000 UTC m=+69.908977146"
May 28 10:06:24.464519 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:06:24.464472    2565 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-kvx8v" podStartSLOduration=65.566450027 podStartE2EDuration="1m9.464459779s" podCreationTimestamp="2026-05-28 10:05:15 +0000 UTC" firstStartedPulling="2026-05-28 10:06:20.22154895 +0000 UTC m=+65.681883079" lastFinishedPulling="2026-05-28 10:06:24.119558701 +0000 UTC m=+69.579892831" observedRunningTime="2026-05-28 10:06:24.463598163 +0000 UTC m=+69.923932308" watchObservedRunningTime="2026-05-28 10:06:24.464459779 +0000 UTC m=+69.924793943"
May 28 10:06:24.484942 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:06:24.484884    2565 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-dns/dns-default-hcldz" podStartSLOduration=33.022969599 podStartE2EDuration="36.484870585s" podCreationTimestamp="2026-05-28 10:05:48 +0000 UTC" firstStartedPulling="2026-05-28 10:06:20.643635402 +0000 UTC m=+66.103969534" lastFinishedPulling="2026-05-28 10:06:24.105536387 +0000 UTC m=+69.565870520" observedRunningTime="2026-05-28 10:06:24.48418718 +0000 UTC m=+69.944521331" watchObservedRunningTime="2026-05-28 10:06:24.484870585 +0000 UTC m=+69.945204750"
May 28 10:06:24.501859 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:06:24.501812    2565 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-9q7gx" podStartSLOduration=33.053693913 podStartE2EDuration="36.501798612s" podCreationTimestamp="2026-05-28 10:05:48 +0000 UTC" firstStartedPulling="2026-05-28 10:06:20.66044633 +0000 UTC m=+66.120780461" lastFinishedPulling="2026-05-28 10:06:24.108551022 +0000 UTC m=+69.568885160" observedRunningTime="2026-05-28 10:06:24.501707152 +0000 UTC m=+69.962041303" watchObservedRunningTime="2026-05-28 10:06:24.501798612 +0000 UTC m=+69.962132763"
May 28 10:06:26.145219 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:06:26.145186    2565 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-7db77487f9-bljn6"]
May 28 10:06:26.290856 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:06:26.290820    2565 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-pr7st"]
May 28 10:06:26.293652 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:06:26.293633    2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-pr7st"
May 28 10:06:26.300234 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:06:26.300211    2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
May 28 10:06:26.303777 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:06:26.303759    2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
May 28 10:06:26.304195 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:06:26.304177    2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
May 28 10:06:26.304280 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:06:26.304242    2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
May 28 10:06:26.305930 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:06:26.305915    2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-zl88p\""
May 28 10:06:26.323874 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:06:26.323851    2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-pr7st"]
May 28 10:06:26.380664 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:06:26.380629    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/5bce5c13-a963-4b98-adf3-7ebc88f12c97-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-pr7st\" (UID: \"5bce5c13-a963-4b98-adf3-7ebc88f12c97\") " pod="openshift-insights/insights-runtime-extractor-pr7st"
May 28 10:06:26.380664 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:06:26.380664    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/5bce5c13-a963-4b98-adf3-7ebc88f12c97-crio-socket\") pod \"insights-runtime-extractor-pr7st\" (UID: \"5bce5c13-a963-4b98-adf3-7ebc88f12c97\") " pod="openshift-insights/insights-runtime-extractor-pr7st"
May 28 10:06:26.380848 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:06:26.380704    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/5bce5c13-a963-4b98-adf3-7ebc88f12c97-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-pr7st\" (UID: \"5bce5c13-a963-4b98-adf3-7ebc88f12c97\") " pod="openshift-insights/insights-runtime-extractor-pr7st"
May 28 10:06:26.380848 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:06:26.380744    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qdt5c\" (UniqueName: \"kubernetes.io/projected/5bce5c13-a963-4b98-adf3-7ebc88f12c97-kube-api-access-qdt5c\") pod \"insights-runtime-extractor-pr7st\" (UID: \"5bce5c13-a963-4b98-adf3-7ebc88f12c97\") " pod="openshift-insights/insights-runtime-extractor-pr7st"
May 28 10:06:26.380848 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:06:26.380806    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/5bce5c13-a963-4b98-adf3-7ebc88f12c97-data-volume\") pod \"insights-runtime-extractor-pr7st\" (UID: \"5bce5c13-a963-4b98-adf3-7ebc88f12c97\") " pod="openshift-insights/insights-runtime-extractor-pr7st"
May 28 10:06:26.481269 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:06:26.481187    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/5bce5c13-a963-4b98-adf3-7ebc88f12c97-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-pr7st\" (UID: \"5bce5c13-a963-4b98-adf3-7ebc88f12c97\") " pod="openshift-insights/insights-runtime-extractor-pr7st"
May 28 10:06:26.481269 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:06:26.481219    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/5bce5c13-a963-4b98-adf3-7ebc88f12c97-crio-socket\") pod \"insights-runtime-extractor-pr7st\" (UID: \"5bce5c13-a963-4b98-adf3-7ebc88f12c97\") " pod="openshift-insights/insights-runtime-extractor-pr7st"
May 28 10:06:26.481269 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:06:26.481257    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/5bce5c13-a963-4b98-adf3-7ebc88f12c97-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-pr7st\" (UID: \"5bce5c13-a963-4b98-adf3-7ebc88f12c97\") " pod="openshift-insights/insights-runtime-extractor-pr7st"
May 28 10:06:26.481501 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:06:26.481280    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-qdt5c\" (UniqueName: \"kubernetes.io/projected/5bce5c13-a963-4b98-adf3-7ebc88f12c97-kube-api-access-qdt5c\") pod \"insights-runtime-extractor-pr7st\" (UID: \"5bce5c13-a963-4b98-adf3-7ebc88f12c97\") " pod="openshift-insights/insights-runtime-extractor-pr7st"
May 28 10:06:26.481501 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:06:26.481332    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/5bce5c13-a963-4b98-adf3-7ebc88f12c97-crio-socket\") pod \"insights-runtime-extractor-pr7st\" (UID: \"5bce5c13-a963-4b98-adf3-7ebc88f12c97\") " pod="openshift-insights/insights-runtime-extractor-pr7st"
May 28 10:06:26.481501 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:06:26.481344    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/5bce5c13-a963-4b98-adf3-7ebc88f12c97-data-volume\") pod \"insights-runtime-extractor-pr7st\" (UID: \"5bce5c13-a963-4b98-adf3-7ebc88f12c97\") " pod="openshift-insights/insights-runtime-extractor-pr7st"
May 28 10:06:26.481672 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:06:26.481656    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/5bce5c13-a963-4b98-adf3-7ebc88f12c97-data-volume\") pod \"insights-runtime-extractor-pr7st\" (UID: \"5bce5c13-a963-4b98-adf3-7ebc88f12c97\") " pod="openshift-insights/insights-runtime-extractor-pr7st"
May 28 10:06:26.481831 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:06:26.481816    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/5bce5c13-a963-4b98-adf3-7ebc88f12c97-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-pr7st\" (UID: \"5bce5c13-a963-4b98-adf3-7ebc88f12c97\") " pod="openshift-insights/insights-runtime-extractor-pr7st"
May 28 10:06:26.483688 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:06:26.483672    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/5bce5c13-a963-4b98-adf3-7ebc88f12c97-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-pr7st\" (UID: \"5bce5c13-a963-4b98-adf3-7ebc88f12c97\") " pod="openshift-insights/insights-runtime-extractor-pr7st"
May 28 10:06:26.506147 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:06:26.506121    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qdt5c\" (UniqueName: \"kubernetes.io/projected/5bce5c13-a963-4b98-adf3-7ebc88f12c97-kube-api-access-qdt5c\") pod \"insights-runtime-extractor-pr7st\" (UID: \"5bce5c13-a963-4b98-adf3-7ebc88f12c97\") " pod="openshift-insights/insights-runtime-extractor-pr7st"
May 28 10:06:26.602385 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:06:26.602348    2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-pr7st"
May 28 10:06:26.768168 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:06:26.768083    2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-pr7st"]
May 28 10:06:26.772202 ip-10-0-128-206 kubenswrapper[2565]: W0528 10:06:26.772173    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5bce5c13_a963_4b98_adf3_7ebc88f12c97.slice/crio-68d8ccabf6365c8eb29f6e942495aaa4e69b6203ecf6532f11333b85b86a4ff2 WatchSource:0}: Error finding container 68d8ccabf6365c8eb29f6e942495aaa4e69b6203ecf6532f11333b85b86a4ff2: Status 404 returned error can't find the container with id 68d8ccabf6365c8eb29f6e942495aaa4e69b6203ecf6532f11333b85b86a4ff2
May 28 10:06:27.443976 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:06:27.443936    2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-pr7st" event={"ID":"5bce5c13-a963-4b98-adf3-7ebc88f12c97","Type":"ContainerStarted","Data":"6e5c8f5856af9a885a938e26b4b97f656846b367a438435f765779ddb45ab92e"}
May 28 10:06:27.444386 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:06:27.443978    2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-pr7st" event={"ID":"5bce5c13-a963-4b98-adf3-7ebc88f12c97","Type":"ContainerStarted","Data":"68d8ccabf6365c8eb29f6e942495aaa4e69b6203ecf6532f11333b85b86a4ff2"}
May 28 10:06:28.203850 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:06:28.203816    2565 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-console/console-9cd87fd46-g4xnc"]
May 28 10:06:28.205874 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:06:28.205858    2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-9cd87fd46-g4xnc"
May 28 10:06:28.209162 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:06:28.209140    2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
May 28 10:06:28.209286 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:06:28.209183    2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
May 28 10:06:28.210262 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:06:28.210241    2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
May 28 10:06:28.210430 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:06:28.210275    2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
May 28 10:06:28.210532 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:06:28.210518    2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
May 28 10:06:28.210591 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:06:28.210543    2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-4585z\""
May 28 10:06:28.210816 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:06:28.210635    2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
May 28 10:06:28.210816 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:06:28.210640    2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
May 28 10:06:28.218666 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:06:28.218644    2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-9cd87fd46-g4xnc"]
May 28 10:06:28.293637 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:06:28.293608    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/82b5199d-ad56-4bf8-93ea-cb1b467e50f1-service-ca\") pod \"console-9cd87fd46-g4xnc\" (UID: \"82b5199d-ad56-4bf8-93ea-cb1b467e50f1\") " pod="openshift-console/console-9cd87fd46-g4xnc"
May 28 10:06:28.293637 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:06:28.293647    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ts44h\" (UniqueName: \"kubernetes.io/projected/82b5199d-ad56-4bf8-93ea-cb1b467e50f1-kube-api-access-ts44h\") pod \"console-9cd87fd46-g4xnc\" (UID: \"82b5199d-ad56-4bf8-93ea-cb1b467e50f1\") " pod="openshift-console/console-9cd87fd46-g4xnc"
May 28 10:06:28.293866 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:06:28.293689    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/82b5199d-ad56-4bf8-93ea-cb1b467e50f1-oauth-serving-cert\") pod \"console-9cd87fd46-g4xnc\" (UID: \"82b5199d-ad56-4bf8-93ea-cb1b467e50f1\") " pod="openshift-console/console-9cd87fd46-g4xnc"
May 28 10:06:28.293866 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:06:28.293793    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/82b5199d-ad56-4bf8-93ea-cb1b467e50f1-console-serving-cert\") pod \"console-9cd87fd46-g4xnc\" (UID: \"82b5199d-ad56-4bf8-93ea-cb1b467e50f1\") " pod="openshift-console/console-9cd87fd46-g4xnc"
May 28 10:06:28.293866 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:06:28.293833    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/82b5199d-ad56-4bf8-93ea-cb1b467e50f1-console-oauth-config\") pod \"console-9cd87fd46-g4xnc\" (UID: \"82b5199d-ad56-4bf8-93ea-cb1b467e50f1\") " pod="openshift-console/console-9cd87fd46-g4xnc"
May 28 10:06:28.294007 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:06:28.293865    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/82b5199d-ad56-4bf8-93ea-cb1b467e50f1-console-config\") pod \"console-9cd87fd46-g4xnc\" (UID: \"82b5199d-ad56-4bf8-93ea-cb1b467e50f1\") " pod="openshift-console/console-9cd87fd46-g4xnc"
May 28 10:06:28.395055 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:06:28.395021    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/82b5199d-ad56-4bf8-93ea-cb1b467e50f1-console-serving-cert\") pod \"console-9cd87fd46-g4xnc\" (UID: \"82b5199d-ad56-4bf8-93ea-cb1b467e50f1\") " pod="openshift-console/console-9cd87fd46-g4xnc"
May 28 10:06:28.395055 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:06:28.395054    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/82b5199d-ad56-4bf8-93ea-cb1b467e50f1-console-oauth-config\") pod \"console-9cd87fd46-g4xnc\" (UID: \"82b5199d-ad56-4bf8-93ea-cb1b467e50f1\") " pod="openshift-console/console-9cd87fd46-g4xnc"
May 28 10:06:28.395285 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:06:28.395071    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/82b5199d-ad56-4bf8-93ea-cb1b467e50f1-console-config\") pod \"console-9cd87fd46-g4xnc\" (UID: \"82b5199d-ad56-4bf8-93ea-cb1b467e50f1\") " pod="openshift-console/console-9cd87fd46-g4xnc"
May 28 10:06:28.395285 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:06:28.395098    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/82b5199d-ad56-4bf8-93ea-cb1b467e50f1-service-ca\") pod \"console-9cd87fd46-g4xnc\" (UID: \"82b5199d-ad56-4bf8-93ea-cb1b467e50f1\") " pod="openshift-console/console-9cd87fd46-g4xnc"
May 28 10:06:28.395285 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:06:28.395119    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-ts44h\" (UniqueName: \"kubernetes.io/projected/82b5199d-ad56-4bf8-93ea-cb1b467e50f1-kube-api-access-ts44h\") pod \"console-9cd87fd46-g4xnc\" (UID: \"82b5199d-ad56-4bf8-93ea-cb1b467e50f1\") " pod="openshift-console/console-9cd87fd46-g4xnc"
May 28 10:06:28.395285 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:06:28.395145    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/82b5199d-ad56-4bf8-93ea-cb1b467e50f1-oauth-serving-cert\") pod \"console-9cd87fd46-g4xnc\" (UID: \"82b5199d-ad56-4bf8-93ea-cb1b467e50f1\") " pod="openshift-console/console-9cd87fd46-g4xnc"
May 28 10:06:28.395931 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:06:28.395905    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/82b5199d-ad56-4bf8-93ea-cb1b467e50f1-service-ca\") pod \"console-9cd87fd46-g4xnc\" (UID: \"82b5199d-ad56-4bf8-93ea-cb1b467e50f1\") " pod="openshift-console/console-9cd87fd46-g4xnc"
May 28 10:06:28.396036 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:06:28.395907    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/82b5199d-ad56-4bf8-93ea-cb1b467e50f1-console-config\") pod \"console-9cd87fd46-g4xnc\" (UID: \"82b5199d-ad56-4bf8-93ea-cb1b467e50f1\") " pod="openshift-console/console-9cd87fd46-g4xnc"
May 28 10:06:28.396092 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:06:28.396045    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/82b5199d-ad56-4bf8-93ea-cb1b467e50f1-oauth-serving-cert\") pod \"console-9cd87fd46-g4xnc\" (UID: \"82b5199d-ad56-4bf8-93ea-cb1b467e50f1\") " pod="openshift-console/console-9cd87fd46-g4xnc"
May 28 10:06:28.397621 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:06:28.397602    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/82b5199d-ad56-4bf8-93ea-cb1b467e50f1-console-serving-cert\") pod \"console-9cd87fd46-g4xnc\" (UID: \"82b5199d-ad56-4bf8-93ea-cb1b467e50f1\") " pod="openshift-console/console-9cd87fd46-g4xnc"
May 28 10:06:28.397621 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:06:28.397612    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/82b5199d-ad56-4bf8-93ea-cb1b467e50f1-console-oauth-config\") pod \"console-9cd87fd46-g4xnc\" (UID: \"82b5199d-ad56-4bf8-93ea-cb1b467e50f1\") " pod="openshift-console/console-9cd87fd46-g4xnc"
May 28 10:06:28.407212 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:06:28.407182    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ts44h\" (UniqueName: \"kubernetes.io/projected/82b5199d-ad56-4bf8-93ea-cb1b467e50f1-kube-api-access-ts44h\") pod \"console-9cd87fd46-g4xnc\" (UID: \"82b5199d-ad56-4bf8-93ea-cb1b467e50f1\") " pod="openshift-console/console-9cd87fd46-g4xnc"
May 28 10:06:28.448177 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:06:28.448146    2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-pr7st" event={"ID":"5bce5c13-a963-4b98-adf3-7ebc88f12c97","Type":"ContainerStarted","Data":"ea74332685c58367c0865de1bbf2c68a84081eaa914fdddbf410a00e8e7886e7"}
May 28 10:06:28.515005 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:06:28.514923    2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-9cd87fd46-g4xnc"
May 28 10:06:28.652842 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:06:28.652813    2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-9cd87fd46-g4xnc"]
May 28 10:06:28.656132 ip-10-0-128-206 kubenswrapper[2565]: W0528 10:06:28.656104    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod82b5199d_ad56_4bf8_93ea_cb1b467e50f1.slice/crio-0e26a2200f11bbfcac5d8193f45bea56dc5b50083e4a84480475932cd9969d87 WatchSource:0}: Error finding container 0e26a2200f11bbfcac5d8193f45bea56dc5b50083e4a84480475932cd9969d87: Status 404 returned error can't find the container with id 0e26a2200f11bbfcac5d8193f45bea56dc5b50083e4a84480475932cd9969d87
May 28 10:06:29.451706 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:06:29.451668    2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-9cd87fd46-g4xnc" event={"ID":"82b5199d-ad56-4bf8-93ea-cb1b467e50f1","Type":"ContainerStarted","Data":"0e26a2200f11bbfcac5d8193f45bea56dc5b50083e4a84480475932cd9969d87"}
May 28 10:06:29.453755 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:06:29.453725    2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-pr7st" event={"ID":"5bce5c13-a963-4b98-adf3-7ebc88f12c97","Type":"ContainerStarted","Data":"002211641d8bf1313b95d03a6df2d6ed3dcc72cab6016679282825aac6df8973"}
May 28 10:06:29.506928 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:06:29.506860    2565 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-pr7st" podStartSLOduration=0.983975123 podStartE2EDuration="3.506840386s" podCreationTimestamp="2026-05-28 10:06:26 +0000 UTC" firstStartedPulling="2026-05-28 10:06:26.831370343 +0000 UTC m=+72.291704472" lastFinishedPulling="2026-05-28 10:06:29.354235591 +0000 UTC m=+74.814569735" observedRunningTime="2026-05-28 10:06:29.50618055 +0000 UTC m=+74.966514702" watchObservedRunningTime="2026-05-28 10:06:29.506840386 +0000 UTC m=+74.967174540"
May 28 10:06:30.553563 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:06:30.553526    2565 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-7779bbdd78-s5dhp"]
May 28 10:06:30.565090 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:06:30.565066    2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-7779bbdd78-s5dhp"
May 28 10:06:30.569183 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:06:30.569157    2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\""
May 28 10:06:30.569353 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:06:30.569210    2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
May 28 10:06:30.569432 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:06:30.569420    2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\""
May 28 10:06:30.569525 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:06:30.569509    2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-8sbn7\""
May 28 10:06:30.570133 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:06:30.570109    2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-7779bbdd78-s5dhp"]
May 28 10:06:30.570364 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:06:30.570343    2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
May 28 10:06:30.570590 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:06:30.570574    2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
May 28 10:06:30.612112 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:06:30.612068    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6c76e5e6-3caa-4db2-b4ac-12249d876f7d-metrics-client-ca\") pod \"prometheus-operator-7779bbdd78-s5dhp\" (UID: \"6c76e5e6-3caa-4db2-b4ac-12249d876f7d\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-s5dhp"
May 28 10:06:30.612291 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:06:30.612120    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nt2ff\" (UniqueName: \"kubernetes.io/projected/6c76e5e6-3caa-4db2-b4ac-12249d876f7d-kube-api-access-nt2ff\") pod \"prometheus-operator-7779bbdd78-s5dhp\" (UID: \"6c76e5e6-3caa-4db2-b4ac-12249d876f7d\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-s5dhp"
May 28 10:06:30.612389 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:06:30.612280    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/6c76e5e6-3caa-4db2-b4ac-12249d876f7d-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-7779bbdd78-s5dhp\" (UID: \"6c76e5e6-3caa-4db2-b4ac-12249d876f7d\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-s5dhp"
May 28 10:06:30.612446 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:06:30.612402    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/6c76e5e6-3caa-4db2-b4ac-12249d876f7d-prometheus-operator-tls\") pod \"prometheus-operator-7779bbdd78-s5dhp\" (UID: \"6c76e5e6-3caa-4db2-b4ac-12249d876f7d\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-s5dhp"
May 28 10:06:30.713120 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:06:30.713078    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/6c76e5e6-3caa-4db2-b4ac-12249d876f7d-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-7779bbdd78-s5dhp\" (UID: \"6c76e5e6-3caa-4db2-b4ac-12249d876f7d\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-s5dhp"
May 28 10:06:30.713341 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:06:30.713140    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/6c76e5e6-3caa-4db2-b4ac-12249d876f7d-prometheus-operator-tls\") pod \"prometheus-operator-7779bbdd78-s5dhp\" (UID: \"6c76e5e6-3caa-4db2-b4ac-12249d876f7d\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-s5dhp"
May 28 10:06:30.713341 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:06:30.713182    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6c76e5e6-3caa-4db2-b4ac-12249d876f7d-metrics-client-ca\") pod \"prometheus-operator-7779bbdd78-s5dhp\" (UID: \"6c76e5e6-3caa-4db2-b4ac-12249d876f7d\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-s5dhp"
May 28 10:06:30.713341 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:06:30.713213    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-nt2ff\" (UniqueName: \"kubernetes.io/projected/6c76e5e6-3caa-4db2-b4ac-12249d876f7d-kube-api-access-nt2ff\") pod \"prometheus-operator-7779bbdd78-s5dhp\" (UID: \"6c76e5e6-3caa-4db2-b4ac-12249d876f7d\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-s5dhp"
May 28 10:06:30.714041 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:06:30.713996    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6c76e5e6-3caa-4db2-b4ac-12249d876f7d-metrics-client-ca\") pod \"prometheus-operator-7779bbdd78-s5dhp\" (UID: \"6c76e5e6-3caa-4db2-b4ac-12249d876f7d\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-s5dhp"
May 28 10:06:30.716047 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:06:30.716024    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/6c76e5e6-3caa-4db2-b4ac-12249d876f7d-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-7779bbdd78-s5dhp\" (UID: \"6c76e5e6-3caa-4db2-b4ac-12249d876f7d\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-s5dhp"
May 28 10:06:30.716176 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:06:30.716156    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/6c76e5e6-3caa-4db2-b4ac-12249d876f7d-prometheus-operator-tls\") pod \"prometheus-operator-7779bbdd78-s5dhp\" (UID: \"6c76e5e6-3caa-4db2-b4ac-12249d876f7d\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-s5dhp"
May 28 10:06:30.723126 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:06:30.723098    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nt2ff\" (UniqueName: \"kubernetes.io/projected/6c76e5e6-3caa-4db2-b4ac-12249d876f7d-kube-api-access-nt2ff\") pod \"prometheus-operator-7779bbdd78-s5dhp\" (UID: \"6c76e5e6-3caa-4db2-b4ac-12249d876f7d\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-s5dhp"
May 28 10:06:30.877175 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:06:30.877137    2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-7779bbdd78-s5dhp"
May 28 10:06:31.651603 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:06:31.651576    2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-7779bbdd78-s5dhp"]
May 28 10:06:31.654198 ip-10-0-128-206 kubenswrapper[2565]: W0528 10:06:31.654175    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6c76e5e6_3caa_4db2_b4ac_12249d876f7d.slice/crio-927999759e1fc10d40dcea943f32b9dbd5a776f0caa6991327d768e20b007910 WatchSource:0}: Error finding container 927999759e1fc10d40dcea943f32b9dbd5a776f0caa6991327d768e20b007910: Status 404 returned error can't find the container with id 927999759e1fc10d40dcea943f32b9dbd5a776f0caa6991327d768e20b007910
May 28 10:06:32.464523 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:06:32.464374    2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-9cd87fd46-g4xnc" event={"ID":"82b5199d-ad56-4bf8-93ea-cb1b467e50f1","Type":"ContainerStarted","Data":"e9829fabd8fa24cdcb8a694ff77a38d01bde9354865039ce6a4c41cee4f0eac3"}
May 28 10:06:32.465407 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:06:32.465376    2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-7779bbdd78-s5dhp" event={"ID":"6c76e5e6-3caa-4db2-b4ac-12249d876f7d","Type":"ContainerStarted","Data":"927999759e1fc10d40dcea943f32b9dbd5a776f0caa6991327d768e20b007910"}
May 28 10:06:32.486366 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:06:32.486296    2565 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-console/console-9cd87fd46-g4xnc" podStartSLOduration=1.588876599 podStartE2EDuration="4.486278728s" podCreationTimestamp="2026-05-28 10:06:28 +0000 UTC" firstStartedPulling="2026-05-28 10:06:28.658114721 +0000 UTC m=+74.118448851" lastFinishedPulling="2026-05-28 10:06:31.555516839 +0000 UTC m=+77.015850980" observedRunningTime="2026-05-28 10:06:32.485136147 +0000 UTC m=+77.945470298" watchObservedRunningTime="2026-05-28 10:06:32.486278728 +0000 UTC m=+77.946612880"
May 28 10:06:33.469159 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:06:33.469066    2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-7779bbdd78-s5dhp" event={"ID":"6c76e5e6-3caa-4db2-b4ac-12249d876f7d","Type":"ContainerStarted","Data":"bf1087b1ca653d06b983d9addb99f1e0c19ee9a2bcad4667721e6f22865c30b9"}
May 28 10:06:33.469159 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:06:33.469113    2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-7779bbdd78-s5dhp" event={"ID":"6c76e5e6-3caa-4db2-b4ac-12249d876f7d","Type":"ContainerStarted","Data":"6e3c491ab1cb27808120ba7500e1ef3e60eec01d027bed9c23e0891ae159e7a8"}
May 28 10:06:33.492374 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:06:33.492334    2565 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-7779bbdd78-s5dhp" podStartSLOduration=2.019057878 podStartE2EDuration="3.492296265s" podCreationTimestamp="2026-05-28 10:06:30 +0000 UTC" firstStartedPulling="2026-05-28 10:06:31.656569153 +0000 UTC m=+77.116903281" lastFinishedPulling="2026-05-28 10:06:33.129807536 +0000 UTC m=+78.590141668" observedRunningTime="2026-05-28 10:06:33.491065911 +0000 UTC m=+78.951400061" watchObservedRunningTime="2026-05-28 10:06:33.492296265 +0000 UTC m=+78.952630415"
May 28 10:06:34.439201 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:06:34.439174    2565 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-hcldz"
May 28 10:06:35.989145 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:06:35.989109    2565 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-9c959559f-blf8b"]
May 28 10:06:35.991953 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:06:35.991937    2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-9c959559f-blf8b"
May 28 10:06:35.994846 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:06:35.994828    2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-gpkzn\""
May 28 10:06:35.994983 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:06:35.994963    2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\""
May 28 10:06:35.995084 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:06:35.995070    2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\""
May 28 10:06:36.004327 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:06:36.004287    2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-9c959559f-blf8b"]
May 28 10:06:36.051568 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:06:36.051544    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/42a0443b-9cf7-4f77-ba88-cdff4eeccd8a-metrics-client-ca\") pod \"openshift-state-metrics-9c959559f-blf8b\" (UID: \"42a0443b-9cf7-4f77-ba88-cdff4eeccd8a\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-blf8b"
May 28 10:06:36.051689 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:06:36.051592    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r52z5\" (UniqueName: \"kubernetes.io/projected/42a0443b-9cf7-4f77-ba88-cdff4eeccd8a-kube-api-access-r52z5\") pod \"openshift-state-metrics-9c959559f-blf8b\" (UID: \"42a0443b-9cf7-4f77-ba88-cdff4eeccd8a\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-blf8b"
May 28 10:06:36.051689 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:06:36.051681    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/42a0443b-9cf7-4f77-ba88-cdff4eeccd8a-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-9c959559f-blf8b\" (UID: \"42a0443b-9cf7-4f77-ba88-cdff4eeccd8a\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-blf8b"
May 28 10:06:36.051768 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:06:36.051711    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/42a0443b-9cf7-4f77-ba88-cdff4eeccd8a-openshift-state-metrics-tls\") pod \"openshift-state-metrics-9c959559f-blf8b\" (UID: \"42a0443b-9cf7-4f77-ba88-cdff4eeccd8a\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-blf8b"
May 28 10:06:36.056954 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:06:36.056926    2565 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-vvzss"]
May 28 10:06:36.059514 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:06:36.059501    2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-vvzss"
May 28 10:06:36.062683 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:06:36.062663    2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
May 28 10:06:36.062798 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:06:36.062754    2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-t9x7r\""
May 28 10:06:36.062870 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:06:36.062808    2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
May 28 10:06:36.062952 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:06:36.062888    2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
May 28 10:06:36.150682 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:06:36.150651    2565 patch_prober.go:28] interesting pod/image-registry-7db77487f9-bljn6 container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
May 28 10:06:36.150817 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:06:36.150700    2565 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-7db77487f9-bljn6" podUID="36bbe57c-1087-4fb9-a8b2-66ae7b6c32d2" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
May 28 10:06:36.152915 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:06:36.152890    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/696c43c1-d6a7-4ebd-8a85-16648e86ebaa-metrics-client-ca\") pod \"node-exporter-vvzss\" (UID: \"696c43c1-d6a7-4ebd-8a85-16648e86ebaa\") " pod="openshift-monitoring/node-exporter-vvzss"
May 28 10:06:36.153055 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:06:36.152925    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/42a0443b-9cf7-4f77-ba88-cdff4eeccd8a-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-9c959559f-blf8b\" (UID: \"42a0443b-9cf7-4f77-ba88-cdff4eeccd8a\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-blf8b"
May 28 10:06:36.153055 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:06:36.152955    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/42a0443b-9cf7-4f77-ba88-cdff4eeccd8a-openshift-state-metrics-tls\") pod \"openshift-state-metrics-9c959559f-blf8b\" (UID: \"42a0443b-9cf7-4f77-ba88-cdff4eeccd8a\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-blf8b"
May 28 10:06:36.153055 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:06:36.153010    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/696c43c1-d6a7-4ebd-8a85-16648e86ebaa-sys\") pod \"node-exporter-vvzss\" (UID: \"696c43c1-d6a7-4ebd-8a85-16648e86ebaa\") " pod="openshift-monitoring/node-exporter-vvzss"
May 28 10:06:36.153055 ip-10-0-128-206 kubenswrapper[2565]: E0528 10:06:36.153035    2565 secret.go:189] Couldn't get secret openshift-monitoring/openshift-state-metrics-tls: secret "openshift-state-metrics-tls" not found
May 28 10:06:36.153055 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:06:36.153051    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/696c43c1-d6a7-4ebd-8a85-16648e86ebaa-node-exporter-wtmp\") pod \"node-exporter-vvzss\" (UID: \"696c43c1-d6a7-4ebd-8a85-16648e86ebaa\") " pod="openshift-monitoring/node-exporter-vvzss"
May 28 10:06:36.153269 ip-10-0-128-206 kubenswrapper[2565]: E0528 10:06:36.153073    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/42a0443b-9cf7-4f77-ba88-cdff4eeccd8a-openshift-state-metrics-tls podName:42a0443b-9cf7-4f77-ba88-cdff4eeccd8a nodeName:}" failed. No retries permitted until 2026-05-28 10:06:36.653060298 +0000 UTC m=+82.113394428 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "openshift-state-metrics-tls" (UniqueName: "kubernetes.io/secret/42a0443b-9cf7-4f77-ba88-cdff4eeccd8a-openshift-state-metrics-tls") pod "openshift-state-metrics-9c959559f-blf8b" (UID: "42a0443b-9cf7-4f77-ba88-cdff4eeccd8a") : secret "openshift-state-metrics-tls" not found
May 28 10:06:36.153269 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:06:36.153099    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x9c6l\" (UniqueName: \"kubernetes.io/projected/696c43c1-d6a7-4ebd-8a85-16648e86ebaa-kube-api-access-x9c6l\") pod \"node-exporter-vvzss\" (UID: \"696c43c1-d6a7-4ebd-8a85-16648e86ebaa\") " pod="openshift-monitoring/node-exporter-vvzss"
May 28 10:06:36.153269 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:06:36.153120    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/696c43c1-d6a7-4ebd-8a85-16648e86ebaa-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-vvzss\" (UID: \"696c43c1-d6a7-4ebd-8a85-16648e86ebaa\") " pod="openshift-monitoring/node-exporter-vvzss"
May 28 10:06:36.153269 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:06:36.153176    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/42a0443b-9cf7-4f77-ba88-cdff4eeccd8a-metrics-client-ca\") pod \"openshift-state-metrics-9c959559f-blf8b\" (UID: \"42a0443b-9cf7-4f77-ba88-cdff4eeccd8a\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-blf8b"
May 28 10:06:36.153498 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:06:36.153281    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-r52z5\" (UniqueName: \"kubernetes.io/projected/42a0443b-9cf7-4f77-ba88-cdff4eeccd8a-kube-api-access-r52z5\") pod \"openshift-state-metrics-9c959559f-blf8b\" (UID: \"42a0443b-9cf7-4f77-ba88-cdff4eeccd8a\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-blf8b"
May 28 10:06:36.153498 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:06:36.153335    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/696c43c1-d6a7-4ebd-8a85-16648e86ebaa-node-exporter-accelerators-collector-config\") pod \"node-exporter-vvzss\" (UID: \"696c43c1-d6a7-4ebd-8a85-16648e86ebaa\") " pod="openshift-monitoring/node-exporter-vvzss"
May 28 10:06:36.153498 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:06:36.153370    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/696c43c1-d6a7-4ebd-8a85-16648e86ebaa-root\") pod \"node-exporter-vvzss\" (UID: \"696c43c1-d6a7-4ebd-8a85-16648e86ebaa\") " pod="openshift-monitoring/node-exporter-vvzss"
May 28 10:06:36.153498 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:06:36.153397    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/696c43c1-d6a7-4ebd-8a85-16648e86ebaa-node-exporter-tls\") pod \"node-exporter-vvzss\" (UID: \"696c43c1-d6a7-4ebd-8a85-16648e86ebaa\") " pod="openshift-monitoring/node-exporter-vvzss"
May 28 10:06:36.153498 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:06:36.153433    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/696c43c1-d6a7-4ebd-8a85-16648e86ebaa-node-exporter-textfile\") pod \"node-exporter-vvzss\" (UID: \"696c43c1-d6a7-4ebd-8a85-16648e86ebaa\") " pod="openshift-monitoring/node-exporter-vvzss"
May 28 10:06:36.153755 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:06:36.153738    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/42a0443b-9cf7-4f77-ba88-cdff4eeccd8a-metrics-client-ca\") pod \"openshift-state-metrics-9c959559f-blf8b\" (UID: \"42a0443b-9cf7-4f77-ba88-cdff4eeccd8a\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-blf8b"
May 28 10:06:36.155372 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:06:36.155355    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/42a0443b-9cf7-4f77-ba88-cdff4eeccd8a-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-9c959559f-blf8b\" (UID: \"42a0443b-9cf7-4f77-ba88-cdff4eeccd8a\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-blf8b"
May 28 10:06:36.162623 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:06:36.162601    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-r52z5\" (UniqueName: \"kubernetes.io/projected/42a0443b-9cf7-4f77-ba88-cdff4eeccd8a-kube-api-access-r52z5\") pod \"openshift-state-metrics-9c959559f-blf8b\" (UID: \"42a0443b-9cf7-4f77-ba88-cdff4eeccd8a\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-blf8b"
May 28 10:06:36.254216 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:06:36.254148    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/696c43c1-d6a7-4ebd-8a85-16648e86ebaa-node-exporter-textfile\") pod \"node-exporter-vvzss\" (UID: \"696c43c1-d6a7-4ebd-8a85-16648e86ebaa\") " pod="openshift-monitoring/node-exporter-vvzss"
May 28 10:06:36.254216 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:06:36.254185    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/696c43c1-d6a7-4ebd-8a85-16648e86ebaa-metrics-client-ca\") pod \"node-exporter-vvzss\" (UID: \"696c43c1-d6a7-4ebd-8a85-16648e86ebaa\") " pod="openshift-monitoring/node-exporter-vvzss"
May 28 10:06:36.254430 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:06:36.254240    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/696c43c1-d6a7-4ebd-8a85-16648e86ebaa-sys\") pod \"node-exporter-vvzss\" (UID: \"696c43c1-d6a7-4ebd-8a85-16648e86ebaa\") " pod="openshift-monitoring/node-exporter-vvzss"
May 28 10:06:36.254430 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:06:36.254263    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/696c43c1-d6a7-4ebd-8a85-16648e86ebaa-node-exporter-wtmp\") pod \"node-exporter-vvzss\" (UID: \"696c43c1-d6a7-4ebd-8a85-16648e86ebaa\") " pod="openshift-monitoring/node-exporter-vvzss"
May 28 10:06:36.254430 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:06:36.254283    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-x9c6l\" (UniqueName: \"kubernetes.io/projected/696c43c1-d6a7-4ebd-8a85-16648e86ebaa-kube-api-access-x9c6l\") pod \"node-exporter-vvzss\" (UID: \"696c43c1-d6a7-4ebd-8a85-16648e86ebaa\") " pod="openshift-monitoring/node-exporter-vvzss"
May 28 10:06:36.254430 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:06:36.254338    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/696c43c1-d6a7-4ebd-8a85-16648e86ebaa-sys\") pod \"node-exporter-vvzss\" (UID: \"696c43c1-d6a7-4ebd-8a85-16648e86ebaa\") " pod="openshift-monitoring/node-exporter-vvzss"
May 28 10:06:36.254430 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:06:36.254369    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/696c43c1-d6a7-4ebd-8a85-16648e86ebaa-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-vvzss\" (UID: \"696c43c1-d6a7-4ebd-8a85-16648e86ebaa\") " pod="openshift-monitoring/node-exporter-vvzss"
May 28 10:06:36.254691 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:06:36.254434    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/696c43c1-d6a7-4ebd-8a85-16648e86ebaa-node-exporter-wtmp\") pod \"node-exporter-vvzss\" (UID: \"696c43c1-d6a7-4ebd-8a85-16648e86ebaa\") " pod="openshift-monitoring/node-exporter-vvzss"
May 28 10:06:36.254691 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:06:36.254443    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/696c43c1-d6a7-4ebd-8a85-16648e86ebaa-node-exporter-accelerators-collector-config\") pod \"node-exporter-vvzss\" (UID: \"696c43c1-d6a7-4ebd-8a85-16648e86ebaa\") " pod="openshift-monitoring/node-exporter-vvzss"
May 28 10:06:36.254691 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:06:36.254504    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/696c43c1-d6a7-4ebd-8a85-16648e86ebaa-root\") pod \"node-exporter-vvzss\" (UID: \"696c43c1-d6a7-4ebd-8a85-16648e86ebaa\") " pod="openshift-monitoring/node-exporter-vvzss"
May 28 10:06:36.254691 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:06:36.254511    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/696c43c1-d6a7-4ebd-8a85-16648e86ebaa-node-exporter-textfile\") pod \"node-exporter-vvzss\" (UID: \"696c43c1-d6a7-4ebd-8a85-16648e86ebaa\") " pod="openshift-monitoring/node-exporter-vvzss"
May 28 10:06:36.254691 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:06:36.254532    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/696c43c1-d6a7-4ebd-8a85-16648e86ebaa-node-exporter-tls\") pod \"node-exporter-vvzss\" (UID: \"696c43c1-d6a7-4ebd-8a85-16648e86ebaa\") " pod="openshift-monitoring/node-exporter-vvzss"
May 28 10:06:36.254691 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:06:36.254557    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/696c43c1-d6a7-4ebd-8a85-16648e86ebaa-root\") pod \"node-exporter-vvzss\" (UID: \"696c43c1-d6a7-4ebd-8a85-16648e86ebaa\") " pod="openshift-monitoring/node-exporter-vvzss"
May 28 10:06:36.254691 ip-10-0-128-206 kubenswrapper[2565]: E0528 10:06:36.254635    2565 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found
May 28 10:06:36.254691 ip-10-0-128-206 kubenswrapper[2565]: E0528 10:06:36.254693    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/696c43c1-d6a7-4ebd-8a85-16648e86ebaa-node-exporter-tls podName:696c43c1-d6a7-4ebd-8a85-16648e86ebaa nodeName:}" failed. No retries permitted until 2026-05-28 10:06:36.754679301 +0000 UTC m=+82.215013429 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/696c43c1-d6a7-4ebd-8a85-16648e86ebaa-node-exporter-tls") pod "node-exporter-vvzss" (UID: "696c43c1-d6a7-4ebd-8a85-16648e86ebaa") : secret "node-exporter-tls" not found
May 28 10:06:36.255056 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:06:36.254820    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/696c43c1-d6a7-4ebd-8a85-16648e86ebaa-metrics-client-ca\") pod \"node-exporter-vvzss\" (UID: \"696c43c1-d6a7-4ebd-8a85-16648e86ebaa\") " pod="openshift-monitoring/node-exporter-vvzss"
May 28 10:06:36.255056 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:06:36.254956    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/696c43c1-d6a7-4ebd-8a85-16648e86ebaa-node-exporter-accelerators-collector-config\") pod \"node-exporter-vvzss\" (UID: \"696c43c1-d6a7-4ebd-8a85-16648e86ebaa\") " pod="openshift-monitoring/node-exporter-vvzss"
May 28 10:06:36.256676 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:06:36.256656    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/696c43c1-d6a7-4ebd-8a85-16648e86ebaa-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-vvzss\" (UID: \"696c43c1-d6a7-4ebd-8a85-16648e86ebaa\") " pod="openshift-monitoring/node-exporter-vvzss"
May 28 10:06:36.265152 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:06:36.265123    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-x9c6l\" (UniqueName: \"kubernetes.io/projected/696c43c1-d6a7-4ebd-8a85-16648e86ebaa-kube-api-access-x9c6l\") pod \"node-exporter-vvzss\" (UID: \"696c43c1-d6a7-4ebd-8a85-16648e86ebaa\") " pod="openshift-monitoring/node-exporter-vvzss"
May 28 10:06:36.660155 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:06:36.657420    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/42a0443b-9cf7-4f77-ba88-cdff4eeccd8a-openshift-state-metrics-tls\") pod \"openshift-state-metrics-9c959559f-blf8b\" (UID: \"42a0443b-9cf7-4f77-ba88-cdff4eeccd8a\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-blf8b"
May 28 10:06:36.660155 ip-10-0-128-206 kubenswrapper[2565]: E0528 10:06:36.657601    2565 secret.go:189] Couldn't get secret openshift-monitoring/openshift-state-metrics-tls: secret "openshift-state-metrics-tls" not found
May 28 10:06:36.660155 ip-10-0-128-206 kubenswrapper[2565]: E0528 10:06:36.657697    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/42a0443b-9cf7-4f77-ba88-cdff4eeccd8a-openshift-state-metrics-tls podName:42a0443b-9cf7-4f77-ba88-cdff4eeccd8a nodeName:}" failed. No retries permitted until 2026-05-28 10:06:37.657646938 +0000 UTC m=+83.117981086 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "openshift-state-metrics-tls" (UniqueName: "kubernetes.io/secret/42a0443b-9cf7-4f77-ba88-cdff4eeccd8a-openshift-state-metrics-tls") pod "openshift-state-metrics-9c959559f-blf8b" (UID: "42a0443b-9cf7-4f77-ba88-cdff4eeccd8a") : secret "openshift-state-metrics-tls" not found
May 28 10:06:36.758512 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:06:36.758470    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/696c43c1-d6a7-4ebd-8a85-16648e86ebaa-node-exporter-tls\") pod \"node-exporter-vvzss\" (UID: \"696c43c1-d6a7-4ebd-8a85-16648e86ebaa\") " pod="openshift-monitoring/node-exporter-vvzss"
May 28 10:06:36.760898 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:06:36.760878    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/696c43c1-d6a7-4ebd-8a85-16648e86ebaa-node-exporter-tls\") pod \"node-exporter-vvzss\" (UID: \"696c43c1-d6a7-4ebd-8a85-16648e86ebaa\") " pod="openshift-monitoring/node-exporter-vvzss"
May 28 10:06:36.968135 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:06:36.968057    2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-vvzss"
May 28 10:06:36.976444 ip-10-0-128-206 kubenswrapper[2565]: W0528 10:06:36.976419    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod696c43c1_d6a7_4ebd_8a85_16648e86ebaa.slice/crio-4397662c1119ef7033a471874caa2bfc53e5c7249eca2937b692adf8767ac85c WatchSource:0}: Error finding container 4397662c1119ef7033a471874caa2bfc53e5c7249eca2937b692adf8767ac85c: Status 404 returned error can't find the container with id 4397662c1119ef7033a471874caa2bfc53e5c7249eca2937b692adf8767ac85c
May 28 10:06:37.083101 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:06:37.083071    2565 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
May 28 10:06:37.086850 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:06:37.086829    2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
May 28 10:06:37.089613 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:06:37.089455    2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\""
May 28 10:06:37.089613 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:06:37.089469    2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\""
May 28 10:06:37.089613 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:06:37.089488    2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-dcnqg\""
May 28 10:06:37.089613 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:06:37.089505    2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\""
May 28 10:06:37.089613 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:06:37.089518    2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\""
May 28 10:06:37.089613 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:06:37.089465    2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\""
May 28 10:06:37.089613 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:06:37.089570    2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\""
May 28 10:06:37.090144 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:06:37.089718    2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\""
May 28 10:06:37.090144 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:06:37.089780    2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\""
May 28 10:06:37.090144 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:06:37.089816    2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\""
May 28 10:06:37.101152 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:06:37.101128    2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
May 28 10:06:37.162577 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:06:37.162536    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/aa86ed4e-28cf-4607-831f-636c37755e8e-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"aa86ed4e-28cf-4607-831f-636c37755e8e\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 10:06:37.162718 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:06:37.162580    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/aa86ed4e-28cf-4607-831f-636c37755e8e-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"aa86ed4e-28cf-4607-831f-636c37755e8e\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 10:06:37.162718 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:06:37.162607    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cttdz\" (UniqueName: \"kubernetes.io/projected/aa86ed4e-28cf-4607-831f-636c37755e8e-kube-api-access-cttdz\") pod \"alertmanager-main-0\" (UID: \"aa86ed4e-28cf-4607-831f-636c37755e8e\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 10:06:37.162718 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:06:37.162680    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/aa86ed4e-28cf-4607-831f-636c37755e8e-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"aa86ed4e-28cf-4607-831f-636c37755e8e\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 10:06:37.162718 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:06:37.162698    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/aa86ed4e-28cf-4607-831f-636c37755e8e-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"aa86ed4e-28cf-4607-831f-636c37755e8e\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 10:06:37.162718 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:06:37.162718    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/aa86ed4e-28cf-4607-831f-636c37755e8e-config-out\") pod \"alertmanager-main-0\" (UID: \"aa86ed4e-28cf-4607-831f-636c37755e8e\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 10:06:37.162942 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:06:37.162735    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/aa86ed4e-28cf-4607-831f-636c37755e8e-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"aa86ed4e-28cf-4607-831f-636c37755e8e\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 10:06:37.162942 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:06:37.162762    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/aa86ed4e-28cf-4607-831f-636c37755e8e-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"aa86ed4e-28cf-4607-831f-636c37755e8e\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 10:06:37.162942 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:06:37.162846    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/aa86ed4e-28cf-4607-831f-636c37755e8e-config-volume\") pod \"alertmanager-main-0\" (UID: \"aa86ed4e-28cf-4607-831f-636c37755e8e\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 10:06:37.162942 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:06:37.162884    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/aa86ed4e-28cf-4607-831f-636c37755e8e-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"aa86ed4e-28cf-4607-831f-636c37755e8e\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 10:06:37.162942 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:06:37.162918    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/aa86ed4e-28cf-4607-831f-636c37755e8e-tls-assets\") pod \"alertmanager-main-0\" (UID: \"aa86ed4e-28cf-4607-831f-636c37755e8e\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 10:06:37.162942 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:06:37.162941    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/aa86ed4e-28cf-4607-831f-636c37755e8e-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"aa86ed4e-28cf-4607-831f-636c37755e8e\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 10:06:37.163157 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:06:37.162970    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/aa86ed4e-28cf-4607-831f-636c37755e8e-web-config\") pod \"alertmanager-main-0\" (UID: \"aa86ed4e-28cf-4607-831f-636c37755e8e\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 10:06:37.264013 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:06:37.263932    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/aa86ed4e-28cf-4607-831f-636c37755e8e-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"aa86ed4e-28cf-4607-831f-636c37755e8e\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 10:06:37.264013 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:06:37.263970    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/aa86ed4e-28cf-4607-831f-636c37755e8e-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"aa86ed4e-28cf-4607-831f-636c37755e8e\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 10:06:37.264013 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:06:37.263988    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-cttdz\" (UniqueName: \"kubernetes.io/projected/aa86ed4e-28cf-4607-831f-636c37755e8e-kube-api-access-cttdz\") pod \"alertmanager-main-0\" (UID: \"aa86ed4e-28cf-4607-831f-636c37755e8e\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 10:06:37.264013 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:06:37.264007    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/aa86ed4e-28cf-4607-831f-636c37755e8e-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"aa86ed4e-28cf-4607-831f-636c37755e8e\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 10:06:37.264347 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:06:37.264025    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/aa86ed4e-28cf-4607-831f-636c37755e8e-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"aa86ed4e-28cf-4607-831f-636c37755e8e\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 10:06:37.264347 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:06:37.264083    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/aa86ed4e-28cf-4607-831f-636c37755e8e-config-out\") pod \"alertmanager-main-0\" (UID: \"aa86ed4e-28cf-4607-831f-636c37755e8e\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 10:06:37.264347 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:06:37.264118    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/aa86ed4e-28cf-4607-831f-636c37755e8e-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"aa86ed4e-28cf-4607-831f-636c37755e8e\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 10:06:37.264347 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:06:37.264163    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/aa86ed4e-28cf-4607-831f-636c37755e8e-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"aa86ed4e-28cf-4607-831f-636c37755e8e\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 10:06:37.264347 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:06:37.264194    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/aa86ed4e-28cf-4607-831f-636c37755e8e-config-volume\") pod \"alertmanager-main-0\" (UID: \"aa86ed4e-28cf-4607-831f-636c37755e8e\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 10:06:37.264347 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:06:37.264223    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/aa86ed4e-28cf-4607-831f-636c37755e8e-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"aa86ed4e-28cf-4607-831f-636c37755e8e\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 10:06:37.264347 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:06:37.264258    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/aa86ed4e-28cf-4607-831f-636c37755e8e-tls-assets\") pod \"alertmanager-main-0\" (UID: \"aa86ed4e-28cf-4607-831f-636c37755e8e\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 10:06:37.264347 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:06:37.264290    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/aa86ed4e-28cf-4607-831f-636c37755e8e-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"aa86ed4e-28cf-4607-831f-636c37755e8e\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 10:06:37.264347 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:06:37.264336    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/aa86ed4e-28cf-4607-831f-636c37755e8e-web-config\") pod \"alertmanager-main-0\" (UID: \"aa86ed4e-28cf-4607-831f-636c37755e8e\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 10:06:37.264763 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:06:37.264426    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/aa86ed4e-28cf-4607-831f-636c37755e8e-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"aa86ed4e-28cf-4607-831f-636c37755e8e\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 10:06:37.264763 ip-10-0-128-206 kubenswrapper[2565]: E0528 10:06:37.264456    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/aa86ed4e-28cf-4607-831f-636c37755e8e-alertmanager-trusted-ca-bundle podName:aa86ed4e-28cf-4607-831f-636c37755e8e nodeName:}" failed. No retries permitted until 2026-05-28 10:06:37.764434847 +0000 UTC m=+83.224768990 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "alertmanager-trusted-ca-bundle" (UniqueName: "kubernetes.io/configmap/aa86ed4e-28cf-4607-831f-636c37755e8e-alertmanager-trusted-ca-bundle") pod "alertmanager-main-0" (UID: "aa86ed4e-28cf-4607-831f-636c37755e8e") : configmap references non-existent config key: ca-bundle.crt
May 28 10:06:37.265428 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:06:37.265405    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/aa86ed4e-28cf-4607-831f-636c37755e8e-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"aa86ed4e-28cf-4607-831f-636c37755e8e\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 10:06:37.267329 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:06:37.267297    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/aa86ed4e-28cf-4607-831f-636c37755e8e-config-out\") pod \"alertmanager-main-0\" (UID: \"aa86ed4e-28cf-4607-831f-636c37755e8e\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 10:06:37.268021 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:06:37.267991    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/aa86ed4e-28cf-4607-831f-636c37755e8e-config-volume\") pod \"alertmanager-main-0\" (UID: \"aa86ed4e-28cf-4607-831f-636c37755e8e\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 10:06:37.268121 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:06:37.268071    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/aa86ed4e-28cf-4607-831f-636c37755e8e-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"aa86ed4e-28cf-4607-831f-636c37755e8e\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 10:06:37.268183 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:06:37.268131    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/aa86ed4e-28cf-4607-831f-636c37755e8e-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"aa86ed4e-28cf-4607-831f-636c37755e8e\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 10:06:37.268183 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:06:37.268158    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/aa86ed4e-28cf-4607-831f-636c37755e8e-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"aa86ed4e-28cf-4607-831f-636c37755e8e\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 10:06:37.268330 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:06:37.268293    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/aa86ed4e-28cf-4607-831f-636c37755e8e-tls-assets\") pod \"alertmanager-main-0\" (UID: \"aa86ed4e-28cf-4607-831f-636c37755e8e\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 10:06:37.268705 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:06:37.268686    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/aa86ed4e-28cf-4607-831f-636c37755e8e-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"aa86ed4e-28cf-4607-831f-636c37755e8e\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 10:06:37.269382 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:06:37.269366    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/aa86ed4e-28cf-4607-831f-636c37755e8e-web-config\") pod \"alertmanager-main-0\" (UID: \"aa86ed4e-28cf-4607-831f-636c37755e8e\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 10:06:37.269608 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:06:37.269590    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/aa86ed4e-28cf-4607-831f-636c37755e8e-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"aa86ed4e-28cf-4607-831f-636c37755e8e\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 10:06:37.275224 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:06:37.275207    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cttdz\" (UniqueName: \"kubernetes.io/projected/aa86ed4e-28cf-4607-831f-636c37755e8e-kube-api-access-cttdz\") pod \"alertmanager-main-0\" (UID: \"aa86ed4e-28cf-4607-831f-636c37755e8e\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 10:06:37.482070 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:06:37.482023    2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-vvzss" event={"ID":"696c43c1-d6a7-4ebd-8a85-16648e86ebaa","Type":"ContainerStarted","Data":"4397662c1119ef7033a471874caa2bfc53e5c7249eca2937b692adf8767ac85c"}
May 28 10:06:37.667624 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:06:37.667588    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/42a0443b-9cf7-4f77-ba88-cdff4eeccd8a-openshift-state-metrics-tls\") pod \"openshift-state-metrics-9c959559f-blf8b\" (UID: \"42a0443b-9cf7-4f77-ba88-cdff4eeccd8a\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-blf8b"
May 28 10:06:37.670329 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:06:37.670286    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/42a0443b-9cf7-4f77-ba88-cdff4eeccd8a-openshift-state-metrics-tls\") pod \"openshift-state-metrics-9c959559f-blf8b\" (UID: \"42a0443b-9cf7-4f77-ba88-cdff4eeccd8a\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-blf8b"
May 28 10:06:37.768273 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:06:37.768237    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/aa86ed4e-28cf-4607-831f-636c37755e8e-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"aa86ed4e-28cf-4607-831f-636c37755e8e\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 10:06:37.769116 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:06:37.769090    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/aa86ed4e-28cf-4607-831f-636c37755e8e-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"aa86ed4e-28cf-4607-831f-636c37755e8e\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 10:06:37.800725 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:06:37.800687    2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-9c959559f-blf8b"
May 28 10:06:38.012782 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:06:38.012752    2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
May 28 10:06:38.038231 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:06:38.038185    2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-9c959559f-blf8b"]
May 28 10:06:38.041654 ip-10-0-128-206 kubenswrapper[2565]: W0528 10:06:38.041617    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod42a0443b_9cf7_4f77_ba88_cdff4eeccd8a.slice/crio-67f4acd47cd0b46b507717857a43cee7c893b569ce7528e9db5db0062b0a238f WatchSource:0}: Error finding container 67f4acd47cd0b46b507717857a43cee7c893b569ce7528e9db5db0062b0a238f: Status 404 returned error can't find the container with id 67f4acd47cd0b46b507717857a43cee7c893b569ce7528e9db5db0062b0a238f
May 28 10:06:38.155806 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:06:38.155778    2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
May 28 10:06:38.158402 ip-10-0-128-206 kubenswrapper[2565]: W0528 10:06:38.158371    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaa86ed4e_28cf_4607_831f_636c37755e8e.slice/crio-8763b9fda9f63a16d2426e87abf7ddeeffbd2949a1b86aa8d0440faf86ea5cad WatchSource:0}: Error finding container 8763b9fda9f63a16d2426e87abf7ddeeffbd2949a1b86aa8d0440faf86ea5cad: Status 404 returned error can't find the container with id 8763b9fda9f63a16d2426e87abf7ddeeffbd2949a1b86aa8d0440faf86ea5cad
May 28 10:06:38.485814 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:06:38.485778    2565 generic.go:358] "Generic (PLEG): container finished" podID="696c43c1-d6a7-4ebd-8a85-16648e86ebaa" containerID="90bcdacd6fed4082d83984f12ec6828b8ad24056af8a6c5bd8bdc20c21d013ca" exitCode=0
May 28 10:06:38.485988 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:06:38.485851    2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-vvzss" event={"ID":"696c43c1-d6a7-4ebd-8a85-16648e86ebaa","Type":"ContainerDied","Data":"90bcdacd6fed4082d83984f12ec6828b8ad24056af8a6c5bd8bdc20c21d013ca"}
May 28 10:06:38.486972 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:06:38.486939    2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"aa86ed4e-28cf-4607-831f-636c37755e8e","Type":"ContainerStarted","Data":"8763b9fda9f63a16d2426e87abf7ddeeffbd2949a1b86aa8d0440faf86ea5cad"}
May 28 10:06:38.488623 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:06:38.488595    2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-9c959559f-blf8b" event={"ID":"42a0443b-9cf7-4f77-ba88-cdff4eeccd8a","Type":"ContainerStarted","Data":"874550a268de038d87cc3ad7cb87427f17403e5cde0fdf9793eb79a839a96d07"}
May 28 10:06:38.488623 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:06:38.488617    2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-9c959559f-blf8b" event={"ID":"42a0443b-9cf7-4f77-ba88-cdff4eeccd8a","Type":"ContainerStarted","Data":"018ed878b063d3f02e7a3283c49ae6ff8c032f2935b9682baeeddf63f4310a75"}
May 28 10:06:38.488736 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:06:38.488626    2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-9c959559f-blf8b" event={"ID":"42a0443b-9cf7-4f77-ba88-cdff4eeccd8a","Type":"ContainerStarted","Data":"67f4acd47cd0b46b507717857a43cee7c893b569ce7528e9db5db0062b0a238f"}
May 28 10:06:38.516021 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:06:38.516000    2565 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-9cd87fd46-g4xnc"
May 28 10:06:38.516101 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:06:38.516028    2565 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-9cd87fd46-g4xnc"
May 28 10:06:38.520607 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:06:38.520589    2565 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-9cd87fd46-g4xnc"
May 28 10:06:39.493629 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:06:39.493597    2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-vvzss" event={"ID":"696c43c1-d6a7-4ebd-8a85-16648e86ebaa","Type":"ContainerStarted","Data":"69c1fafea27f7ce0eb989601e7ebe9d305fddc4ef03737424425a0d68a7c8c54"}
May 28 10:06:39.493629 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:06:39.493635    2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-vvzss" event={"ID":"696c43c1-d6a7-4ebd-8a85-16648e86ebaa","Type":"ContainerStarted","Data":"666f5de38cab5543634454fff647808ddf623cddc9e489b6138db2251d4b9f37"}
May 28 10:06:39.495067 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:06:39.495039    2565 generic.go:358] "Generic (PLEG): container finished" podID="aa86ed4e-28cf-4607-831f-636c37755e8e" containerID="4e6762546890ce97d726d186dcd97993d279d27e655272d52ff99a0419be00e1" exitCode=0
May 28 10:06:39.495210 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:06:39.495106    2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"aa86ed4e-28cf-4607-831f-636c37755e8e","Type":"ContainerDied","Data":"4e6762546890ce97d726d186dcd97993d279d27e655272d52ff99a0419be00e1"}
May 28 10:06:39.496991 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:06:39.496945    2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-9c959559f-blf8b" event={"ID":"42a0443b-9cf7-4f77-ba88-cdff4eeccd8a","Type":"ContainerStarted","Data":"c1d3805a89a2102777204c2792b5b47bf01b303d151b5092dd0e5b6e9f720fa3"}
May 28 10:06:39.501680 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:06:39.501653    2565 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-9cd87fd46-g4xnc"
May 28 10:06:39.524643 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:06:39.524593    2565 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-vvzss" podStartSLOduration=2.571713341 podStartE2EDuration="3.524579431s" podCreationTimestamp="2026-05-28 10:06:36 +0000 UTC" firstStartedPulling="2026-05-28 10:06:36.977977132 +0000 UTC m=+82.438311261" lastFinishedPulling="2026-05-28 10:06:37.930843218 +0000 UTC m=+83.391177351" observedRunningTime="2026-05-28 10:06:39.522213781 +0000 UTC m=+84.982547931" watchObservedRunningTime="2026-05-28 10:06:39.524579431 +0000 UTC m=+84.984913583"
May 28 10:06:39.550473 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:06:39.550434    2565 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-9c959559f-blf8b" podStartSLOduration=3.372879951 podStartE2EDuration="4.550423983s" podCreationTimestamp="2026-05-28 10:06:35 +0000 UTC" firstStartedPulling="2026-05-28 10:06:38.17483861 +0000 UTC m=+83.635172739" lastFinishedPulling="2026-05-28 10:06:39.352382637 +0000 UTC m=+84.812716771" observedRunningTime="2026-05-28 10:06:39.549841032 +0000 UTC m=+85.010175182" watchObservedRunningTime="2026-05-28 10:06:39.550423983 +0000 UTC m=+85.010758159"
May 28 10:06:40.805236 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:06:40.805199    2565 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-665c9c8584-6cfpl"]
May 28 10:06:40.807497 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:06:40.807475    2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-665c9c8584-6cfpl"
May 28 10:06:40.810451 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:06:40.810429    2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\""
May 28 10:06:40.810725 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:06:40.810701    2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"default-dockercfg-mrq9h\""
May 28 10:06:40.820920 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:06:40.820895    2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-665c9c8584-6cfpl"]
May 28 10:06:40.898677 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:06:40.898640    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/c3e76743-52b9-4701-8b24-ec8604ef166e-monitoring-plugin-cert\") pod \"monitoring-plugin-665c9c8584-6cfpl\" (UID: \"c3e76743-52b9-4701-8b24-ec8604ef166e\") " pod="openshift-monitoring/monitoring-plugin-665c9c8584-6cfpl"
May 28 10:06:41.000148 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:06:41.000112    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/c3e76743-52b9-4701-8b24-ec8604ef166e-monitoring-plugin-cert\") pod \"monitoring-plugin-665c9c8584-6cfpl\" (UID: \"c3e76743-52b9-4701-8b24-ec8604ef166e\") " pod="openshift-monitoring/monitoring-plugin-665c9c8584-6cfpl"
May 28 10:06:41.000347 ip-10-0-128-206 kubenswrapper[2565]: E0528 10:06:41.000272    2565 secret.go:189] Couldn't get secret openshift-monitoring/monitoring-plugin-cert: secret "monitoring-plugin-cert" not found
May 28 10:06:41.000409 ip-10-0-128-206 kubenswrapper[2565]: E0528 10:06:41.000362    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c3e76743-52b9-4701-8b24-ec8604ef166e-monitoring-plugin-cert podName:c3e76743-52b9-4701-8b24-ec8604ef166e nodeName:}" failed. No retries permitted until 2026-05-28 10:06:41.500339092 +0000 UTC m=+86.960673246 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "monitoring-plugin-cert" (UniqueName: "kubernetes.io/secret/c3e76743-52b9-4701-8b24-ec8604ef166e-monitoring-plugin-cert") pod "monitoring-plugin-665c9c8584-6cfpl" (UID: "c3e76743-52b9-4701-8b24-ec8604ef166e") : secret "monitoring-plugin-cert" not found
May 28 10:06:41.503372 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:06:41.503339    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/c3e76743-52b9-4701-8b24-ec8604ef166e-monitoring-plugin-cert\") pod \"monitoring-plugin-665c9c8584-6cfpl\" (UID: \"c3e76743-52b9-4701-8b24-ec8604ef166e\") " pod="openshift-monitoring/monitoring-plugin-665c9c8584-6cfpl"
May 28 10:06:41.505615 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:06:41.505592    2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"aa86ed4e-28cf-4607-831f-636c37755e8e","Type":"ContainerStarted","Data":"2c13740addf2d4d0b75278c925ba9edb173c7401a2b534ca6fd00a0dd2ac8529"}
May 28 10:06:41.505721 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:06:41.505621    2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"aa86ed4e-28cf-4607-831f-636c37755e8e","Type":"ContainerStarted","Data":"bc67439d755f0502090295bea567fa2766213b49ed82ead5bc769ff33b13dcc4"}
May 28 10:06:41.505721 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:06:41.505630    2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"aa86ed4e-28cf-4607-831f-636c37755e8e","Type":"ContainerStarted","Data":"20ae764ca415722c6c08f0794a5e7f4b2d648e0f37dd8c13f1782ceffad13b3c"}
May 28 10:06:41.505721 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:06:41.505641    2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"aa86ed4e-28cf-4607-831f-636c37755e8e","Type":"ContainerStarted","Data":"a17bde6119949d9a821a30187b2a4d3320c4a64081670b8f3f3c6e9e26bb4cad"}
May 28 10:06:41.505721 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:06:41.505663    2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"aa86ed4e-28cf-4607-831f-636c37755e8e","Type":"ContainerStarted","Data":"106ed78a74bd942d79c71c9faf203e23dcb1dec2f5030779187c734b69207f96"}
May 28 10:06:41.505977 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:06:41.505959    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/c3e76743-52b9-4701-8b24-ec8604ef166e-monitoring-plugin-cert\") pod \"monitoring-plugin-665c9c8584-6cfpl\" (UID: \"c3e76743-52b9-4701-8b24-ec8604ef166e\") " pod="openshift-monitoring/monitoring-plugin-665c9c8584-6cfpl"
May 28 10:06:41.717653 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:06:41.717585    2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-665c9c8584-6cfpl"
May 28 10:06:41.840924 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:06:41.840891    2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-665c9c8584-6cfpl"]
May 28 10:06:41.843591 ip-10-0-128-206 kubenswrapper[2565]: W0528 10:06:41.843567    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc3e76743_52b9_4701_8b24_ec8604ef166e.slice/crio-e6c93f82c4ff61fe30d0d60d8f5fd765c46313177bd603bb775ccc6c3cd7066b WatchSource:0}: Error finding container e6c93f82c4ff61fe30d0d60d8f5fd765c46313177bd603bb775ccc6c3cd7066b: Status 404 returned error can't find the container with id e6c93f82c4ff61fe30d0d60d8f5fd765c46313177bd603bb775ccc6c3cd7066b
May 28 10:06:42.292824 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:06:42.292796    2565 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
May 28 10:06:42.295896 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:06:42.295852    2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
May 28 10:06:42.299112 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:06:42.298851    2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\""
May 28 10:06:42.299246 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:06:42.299121    2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\""
May 28 10:06:42.300019 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:06:42.299396    2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\""
May 28 10:06:42.300019 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:06:42.299487    2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\""
May 28 10:06:42.300019 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:06:42.299624    2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\""
May 28 10:06:42.300019 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:06:42.299646    2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\""
May 28 10:06:42.300019 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:06:42.299835    2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\""
May 28 10:06:42.300019 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:06:42.299913    2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-srhlb\""
May 28 10:06:42.301142 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:06:42.300617    2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\""
May 28 10:06:42.301142 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:06:42.300656    2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\""
May 28 10:06:42.301142 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:06:42.300750    2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-89k16ektds9um\""
May 28 10:06:42.301142 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:06:42.300970    2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\""
May 28 10:06:42.303435 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:06:42.301346    2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\""
May 28 10:06:42.303435 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:06:42.302067    2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\""
May 28 10:06:42.304160 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:06:42.304120    2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\""
May 28 10:06:42.311438 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:06:42.311413    2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
May 28 10:06:42.411972 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:06:42.411936    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/82289d40-b0b7-453a-b897-fc3b27d27a05-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"82289d40-b0b7-453a-b897-fc3b27d27a05\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 10:06:42.412123 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:06:42.411982    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/82289d40-b0b7-453a-b897-fc3b27d27a05-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"82289d40-b0b7-453a-b897-fc3b27d27a05\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 10:06:42.412123 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:06:42.412079    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/82289d40-b0b7-453a-b897-fc3b27d27a05-config\") pod \"prometheus-k8s-0\" (UID: \"82289d40-b0b7-453a-b897-fc3b27d27a05\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 10:06:42.412239 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:06:42.412118    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/82289d40-b0b7-453a-b897-fc3b27d27a05-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"82289d40-b0b7-453a-b897-fc3b27d27a05\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 10:06:42.412239 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:06:42.412147    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tjbw5\" (UniqueName: \"kubernetes.io/projected/82289d40-b0b7-453a-b897-fc3b27d27a05-kube-api-access-tjbw5\") pod \"prometheus-k8s-0\" (UID: \"82289d40-b0b7-453a-b897-fc3b27d27a05\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 10:06:42.412239 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:06:42.412176    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/82289d40-b0b7-453a-b897-fc3b27d27a05-web-config\") pod \"prometheus-k8s-0\" (UID: \"82289d40-b0b7-453a-b897-fc3b27d27a05\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 10:06:42.412239 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:06:42.412211    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/82289d40-b0b7-453a-b897-fc3b27d27a05-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"82289d40-b0b7-453a-b897-fc3b27d27a05\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 10:06:42.412407 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:06:42.412278    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/82289d40-b0b7-453a-b897-fc3b27d27a05-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"82289d40-b0b7-453a-b897-fc3b27d27a05\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 10:06:42.412407 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:06:42.412332    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/82289d40-b0b7-453a-b897-fc3b27d27a05-config-out\") pod \"prometheus-k8s-0\" (UID: \"82289d40-b0b7-453a-b897-fc3b27d27a05\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 10:06:42.412407 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:06:42.412365    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/82289d40-b0b7-453a-b897-fc3b27d27a05-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"82289d40-b0b7-453a-b897-fc3b27d27a05\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 10:06:42.412407 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:06:42.412393    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/82289d40-b0b7-453a-b897-fc3b27d27a05-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"82289d40-b0b7-453a-b897-fc3b27d27a05\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 10:06:42.412574 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:06:42.412426    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/82289d40-b0b7-453a-b897-fc3b27d27a05-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"82289d40-b0b7-453a-b897-fc3b27d27a05\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 10:06:42.412574 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:06:42.412461    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/82289d40-b0b7-453a-b897-fc3b27d27a05-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"82289d40-b0b7-453a-b897-fc3b27d27a05\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 10:06:42.412574 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:06:42.412486    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/82289d40-b0b7-453a-b897-fc3b27d27a05-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"82289d40-b0b7-453a-b897-fc3b27d27a05\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 10:06:42.412574 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:06:42.412531    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/82289d40-b0b7-453a-b897-fc3b27d27a05-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"82289d40-b0b7-453a-b897-fc3b27d27a05\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 10:06:42.412772 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:06:42.412585    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/82289d40-b0b7-453a-b897-fc3b27d27a05-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"82289d40-b0b7-453a-b897-fc3b27d27a05\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 10:06:42.412772 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:06:42.412609    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/82289d40-b0b7-453a-b897-fc3b27d27a05-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"82289d40-b0b7-453a-b897-fc3b27d27a05\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 10:06:42.412772 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:06:42.412637    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/82289d40-b0b7-453a-b897-fc3b27d27a05-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"82289d40-b0b7-453a-b897-fc3b27d27a05\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 10:06:42.513287 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:06:42.513261    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/82289d40-b0b7-453a-b897-fc3b27d27a05-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"82289d40-b0b7-453a-b897-fc3b27d27a05\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 10:06:42.513434 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:06:42.513294    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/82289d40-b0b7-453a-b897-fc3b27d27a05-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"82289d40-b0b7-453a-b897-fc3b27d27a05\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 10:06:42.513434 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:06:42.513328    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/82289d40-b0b7-453a-b897-fc3b27d27a05-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"82289d40-b0b7-453a-b897-fc3b27d27a05\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 10:06:42.513434 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:06:42.513365    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/82289d40-b0b7-453a-b897-fc3b27d27a05-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"82289d40-b0b7-453a-b897-fc3b27d27a05\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 10:06:42.513434 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:06:42.513403    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/82289d40-b0b7-453a-b897-fc3b27d27a05-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"82289d40-b0b7-453a-b897-fc3b27d27a05\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 10:06:42.513434 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:06:42.513426    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/82289d40-b0b7-453a-b897-fc3b27d27a05-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"82289d40-b0b7-453a-b897-fc3b27d27a05\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 10:06:42.513682 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:06:42.513454    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/82289d40-b0b7-453a-b897-fc3b27d27a05-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"82289d40-b0b7-453a-b897-fc3b27d27a05\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 10:06:42.513682 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:06:42.513497    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/82289d40-b0b7-453a-b897-fc3b27d27a05-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"82289d40-b0b7-453a-b897-fc3b27d27a05\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 10:06:42.513682 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:06:42.513524    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/82289d40-b0b7-453a-b897-fc3b27d27a05-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"82289d40-b0b7-453a-b897-fc3b27d27a05\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 10:06:42.513682 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:06:42.513556    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/82289d40-b0b7-453a-b897-fc3b27d27a05-config\") pod \"prometheus-k8s-0\" (UID: \"82289d40-b0b7-453a-b897-fc3b27d27a05\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 10:06:42.513682 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:06:42.513578    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/82289d40-b0b7-453a-b897-fc3b27d27a05-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"82289d40-b0b7-453a-b897-fc3b27d27a05\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 10:06:42.513682 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:06:42.513601    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-tjbw5\" (UniqueName: \"kubernetes.io/projected/82289d40-b0b7-453a-b897-fc3b27d27a05-kube-api-access-tjbw5\") pod \"prometheus-k8s-0\" (UID: \"82289d40-b0b7-453a-b897-fc3b27d27a05\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 10:06:42.513682 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:06:42.513632    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/82289d40-b0b7-453a-b897-fc3b27d27a05-web-config\") pod \"prometheus-k8s-0\" (UID: \"82289d40-b0b7-453a-b897-fc3b27d27a05\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 10:06:42.513682 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:06:42.513666    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/82289d40-b0b7-453a-b897-fc3b27d27a05-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"82289d40-b0b7-453a-b897-fc3b27d27a05\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 10:06:42.514051 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:06:42.513703    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/82289d40-b0b7-453a-b897-fc3b27d27a05-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"82289d40-b0b7-453a-b897-fc3b27d27a05\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 10:06:42.514051 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:06:42.513743    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/82289d40-b0b7-453a-b897-fc3b27d27a05-config-out\") pod \"prometheus-k8s-0\" (UID: \"82289d40-b0b7-453a-b897-fc3b27d27a05\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 10:06:42.514051 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:06:42.513775    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/82289d40-b0b7-453a-b897-fc3b27d27a05-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"82289d40-b0b7-453a-b897-fc3b27d27a05\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 10:06:42.514051 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:06:42.513804    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/82289d40-b0b7-453a-b897-fc3b27d27a05-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"82289d40-b0b7-453a-b897-fc3b27d27a05\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 10:06:42.514647 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:06:42.514579    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/82289d40-b0b7-453a-b897-fc3b27d27a05-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"82289d40-b0b7-453a-b897-fc3b27d27a05\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 10:06:42.517735 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:06:42.515040    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/82289d40-b0b7-453a-b897-fc3b27d27a05-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"82289d40-b0b7-453a-b897-fc3b27d27a05\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 10:06:42.517735 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:06:42.516352    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/82289d40-b0b7-453a-b897-fc3b27d27a05-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"82289d40-b0b7-453a-b897-fc3b27d27a05\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 10:06:42.519173 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:06:42.518613    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/82289d40-b0b7-453a-b897-fc3b27d27a05-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"82289d40-b0b7-453a-b897-fc3b27d27a05\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 10:06:42.519478 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:06:42.519452    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/82289d40-b0b7-453a-b897-fc3b27d27a05-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"82289d40-b0b7-453a-b897-fc3b27d27a05\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 10:06:42.519944 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:06:42.519895    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/82289d40-b0b7-453a-b897-fc3b27d27a05-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"82289d40-b0b7-453a-b897-fc3b27d27a05\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 10:06:42.520044 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:06:42.520014    2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-665c9c8584-6cfpl" event={"ID":"c3e76743-52b9-4701-8b24-ec8604ef166e","Type":"ContainerStarted","Data":"e6c93f82c4ff61fe30d0d60d8f5fd765c46313177bd603bb775ccc6c3cd7066b"}
May 28 10:06:42.520284 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:06:42.520222    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/82289d40-b0b7-453a-b897-fc3b27d27a05-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"82289d40-b0b7-453a-b897-fc3b27d27a05\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 10:06:42.521651 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:06:42.521625    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/82289d40-b0b7-453a-b897-fc3b27d27a05-config-out\") pod \"prometheus-k8s-0\" (UID: \"82289d40-b0b7-453a-b897-fc3b27d27a05\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 10:06:42.521815 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:06:42.521791    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/82289d40-b0b7-453a-b897-fc3b27d27a05-config\") pod \"prometheus-k8s-0\" (UID: \"82289d40-b0b7-453a-b897-fc3b27d27a05\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 10:06:42.522354 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:06:42.522333    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/82289d40-b0b7-453a-b897-fc3b27d27a05-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"82289d40-b0b7-453a-b897-fc3b27d27a05\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 10:06:42.522442 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:06:42.522355    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/82289d40-b0b7-453a-b897-fc3b27d27a05-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"82289d40-b0b7-453a-b897-fc3b27d27a05\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 10:06:42.522497 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:06:42.522459    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/82289d40-b0b7-453a-b897-fc3b27d27a05-web-config\") pod \"prometheus-k8s-0\" (UID: \"82289d40-b0b7-453a-b897-fc3b27d27a05\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 10:06:42.522888 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:06:42.522864    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/82289d40-b0b7-453a-b897-fc3b27d27a05-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"82289d40-b0b7-453a-b897-fc3b27d27a05\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 10:06:42.522979 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:06:42.522867    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/82289d40-b0b7-453a-b897-fc3b27d27a05-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"82289d40-b0b7-453a-b897-fc3b27d27a05\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 10:06:42.523046 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:06:42.523024    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/82289d40-b0b7-453a-b897-fc3b27d27a05-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"82289d40-b0b7-453a-b897-fc3b27d27a05\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 10:06:42.523560 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:06:42.523537    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/82289d40-b0b7-453a-b897-fc3b27d27a05-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"82289d40-b0b7-453a-b897-fc3b27d27a05\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 10:06:42.524522 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:06:42.524478    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/82289d40-b0b7-453a-b897-fc3b27d27a05-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"82289d40-b0b7-453a-b897-fc3b27d27a05\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 10:06:42.528149 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:06:42.528125    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tjbw5\" (UniqueName: \"kubernetes.io/projected/82289d40-b0b7-453a-b897-fc3b27d27a05-kube-api-access-tjbw5\") pod \"prometheus-k8s-0\" (UID: \"82289d40-b0b7-453a-b897-fc3b27d27a05\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 10:06:42.613803 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:06:42.613765    2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
May 28 10:06:42.777857 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:06:42.777826    2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
May 28 10:06:42.778514 ip-10-0-128-206 kubenswrapper[2565]: W0528 10:06:42.778468    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod82289d40_b0b7_453a_b897_fc3b27d27a05.slice/crio-4f56f3ac6332be5575d60a39df3386e27597f5a337385dd144b5df1c3a255a58 WatchSource:0}: Error finding container 4f56f3ac6332be5575d60a39df3386e27597f5a337385dd144b5df1c3a255a58: Status 404 returned error can't find the container with id 4f56f3ac6332be5575d60a39df3386e27597f5a337385dd144b5df1c3a255a58
May 28 10:06:43.524823 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:06:43.524720    2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-665c9c8584-6cfpl" event={"ID":"c3e76743-52b9-4701-8b24-ec8604ef166e","Type":"ContainerStarted","Data":"fb96b51b7397075d9ed56ad5ce21a223bd73328082a6f4576a04a58db0bc8cb7"}
May 28 10:06:43.525253 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:06:43.524950    2565 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-665c9c8584-6cfpl"
May 28 10:06:43.526278 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:06:43.526252    2565 generic.go:358] "Generic (PLEG): container finished" podID="82289d40-b0b7-453a-b897-fc3b27d27a05" containerID="4246f4e1b055275c098570c985011faf09b731de78574b74c2333e17ba449fdb" exitCode=0
May 28 10:06:43.526409 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:06:43.526353    2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"82289d40-b0b7-453a-b897-fc3b27d27a05","Type":"ContainerDied","Data":"4246f4e1b055275c098570c985011faf09b731de78574b74c2333e17ba449fdb"}
May 28 10:06:43.526409 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:06:43.526383    2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"82289d40-b0b7-453a-b897-fc3b27d27a05","Type":"ContainerStarted","Data":"4f56f3ac6332be5575d60a39df3386e27597f5a337385dd144b5df1c3a255a58"}
May 28 10:06:43.529573 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:06:43.529548    2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"aa86ed4e-28cf-4607-831f-636c37755e8e","Type":"ContainerStarted","Data":"7df2b853c1bf36133ff8b0666c5c41f39732f7b54e1eaa1241b13c5ce1fe0cb4"}
May 28 10:06:43.530871 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:06:43.530853    2565 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-665c9c8584-6cfpl"
May 28 10:06:43.544505 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:06:43.544471    2565 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-665c9c8584-6cfpl" podStartSLOduration=2.229342424 podStartE2EDuration="3.544459915s" podCreationTimestamp="2026-05-28 10:06:40 +0000 UTC" firstStartedPulling="2026-05-28 10:06:41.845423785 +0000 UTC m=+87.305757914" lastFinishedPulling="2026-05-28 10:06:43.160541273 +0000 UTC m=+88.620875405" observedRunningTime="2026-05-28 10:06:43.54335457 +0000 UTC m=+89.003688722" watchObservedRunningTime="2026-05-28 10:06:43.544459915 +0000 UTC m=+89.004794108"
May 28 10:06:43.622631 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:06:43.622577    2565 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.297173642 podStartE2EDuration="6.622558935s" podCreationTimestamp="2026-05-28 10:06:37 +0000 UTC" firstStartedPulling="2026-05-28 10:06:38.160587727 +0000 UTC m=+83.620921856" lastFinishedPulling="2026-05-28 10:06:42.485973007 +0000 UTC m=+87.946307149" observedRunningTime="2026-05-28 10:06:43.620392905 +0000 UTC m=+89.080727055" watchObservedRunningTime="2026-05-28 10:06:43.622558935 +0000 UTC m=+89.082893088"
May 28 10:06:46.150005 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:06:46.149979    2565 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-7db77487f9-bljn6"
May 28 10:06:46.540864 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:06:46.540830    2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"82289d40-b0b7-453a-b897-fc3b27d27a05","Type":"ContainerStarted","Data":"0685aa8a24fa1180379b68b768d056c0eaa132c4aa3a99fba82169446d2bb8e4"}
May 28 10:06:46.540864 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:06:46.540862    2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"82289d40-b0b7-453a-b897-fc3b27d27a05","Type":"ContainerStarted","Data":"b095e35c844eedc456f25f913313d021ee03555fd82e80a24a7fe6391b1b7f7c"}
May 28 10:06:48.552066 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:06:48.552036    2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"82289d40-b0b7-453a-b897-fc3b27d27a05","Type":"ContainerStarted","Data":"e0bf0228afb91ecd40f3359f9b4a50387a0ee53c6b0aac174dc12b10f1253325"}
May 28 10:06:48.552386 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:06:48.552073    2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"82289d40-b0b7-453a-b897-fc3b27d27a05","Type":"ContainerStarted","Data":"cebef29c6393baaa10061563ca9387167aa5a18f6ea5fba3fdca4623bb1f2d2f"}
May 28 10:06:49.562210 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:06:49.562172    2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"82289d40-b0b7-453a-b897-fc3b27d27a05","Type":"ContainerStarted","Data":"7a54eb7080dcac1e96f5aa1551d17c75c15da6832dc3f29b6bbe70ba15acecc7"}
May 28 10:06:49.562210 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:06:49.562205    2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"82289d40-b0b7-453a-b897-fc3b27d27a05","Type":"ContainerStarted","Data":"b156ff6daf6410de7588432d9d7859d54315988126e098fe881ac32a87c0c2e9"}
May 28 10:06:49.600736 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:06:49.600683    2565 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.734330247 podStartE2EDuration="7.600671216s" podCreationTimestamp="2026-05-28 10:06:42 +0000 UTC" firstStartedPulling="2026-05-28 10:06:43.527572845 +0000 UTC m=+88.987906989" lastFinishedPulling="2026-05-28 10:06:48.393913829 +0000 UTC m=+93.854247958" observedRunningTime="2026-05-28 10:06:49.598775489 +0000 UTC m=+95.059109654" watchObservedRunningTime="2026-05-28 10:06:49.600671216 +0000 UTC m=+95.061005366"
May 28 10:06:51.163871 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:06:51.163799    2565 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-image-registry/image-registry-7db77487f9-bljn6" podUID="36bbe57c-1087-4fb9-a8b2-66ae7b6c32d2" containerName="registry" containerID="cri-o://2efd528ea55363498cd8ae7a6c312d74d48ee9387b5b39aed30c36dd964bddf2" gracePeriod=30
May 28 10:06:51.405511 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:06:51.405489    2565 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7db77487f9-bljn6"
May 28 10:06:51.502361 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:06:51.502291    2565 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/36bbe57c-1087-4fb9-a8b2-66ae7b6c32d2-image-registry-private-configuration\") pod \"36bbe57c-1087-4fb9-a8b2-66ae7b6c32d2\" (UID: \"36bbe57c-1087-4fb9-a8b2-66ae7b6c32d2\") "
May 28 10:06:51.502361 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:06:51.502349    2565 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/36bbe57c-1087-4fb9-a8b2-66ae7b6c32d2-registry-certificates\") pod \"36bbe57c-1087-4fb9-a8b2-66ae7b6c32d2\" (UID: \"36bbe57c-1087-4fb9-a8b2-66ae7b6c32d2\") "
May 28 10:06:51.502605 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:06:51.502369    2565 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/36bbe57c-1087-4fb9-a8b2-66ae7b6c32d2-ca-trust-extracted\") pod \"36bbe57c-1087-4fb9-a8b2-66ae7b6c32d2\" (UID: \"36bbe57c-1087-4fb9-a8b2-66ae7b6c32d2\") "
May 28 10:06:51.502605 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:06:51.502392    2565 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ggkj9\" (UniqueName: \"kubernetes.io/projected/36bbe57c-1087-4fb9-a8b2-66ae7b6c32d2-kube-api-access-ggkj9\") pod \"36bbe57c-1087-4fb9-a8b2-66ae7b6c32d2\" (UID: \"36bbe57c-1087-4fb9-a8b2-66ae7b6c32d2\") "
May 28 10:06:51.502605 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:06:51.502419    2565 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/36bbe57c-1087-4fb9-a8b2-66ae7b6c32d2-installation-pull-secrets\") pod \"36bbe57c-1087-4fb9-a8b2-66ae7b6c32d2\" (UID: \"36bbe57c-1087-4fb9-a8b2-66ae7b6c32d2\") "
May 28 10:06:51.502605 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:06:51.502434    2565 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/36bbe57c-1087-4fb9-a8b2-66ae7b6c32d2-registry-tls\") pod \"36bbe57c-1087-4fb9-a8b2-66ae7b6c32d2\" (UID: \"36bbe57c-1087-4fb9-a8b2-66ae7b6c32d2\") "
May 28 10:06:51.502605 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:06:51.502461    2565 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/36bbe57c-1087-4fb9-a8b2-66ae7b6c32d2-trusted-ca\") pod \"36bbe57c-1087-4fb9-a8b2-66ae7b6c32d2\" (UID: \"36bbe57c-1087-4fb9-a8b2-66ae7b6c32d2\") "
May 28 10:06:51.502605 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:06:51.502497    2565 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/36bbe57c-1087-4fb9-a8b2-66ae7b6c32d2-bound-sa-token\") pod \"36bbe57c-1087-4fb9-a8b2-66ae7b6c32d2\" (UID: \"36bbe57c-1087-4fb9-a8b2-66ae7b6c32d2\") "
May 28 10:06:51.502969 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:06:51.502851    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/36bbe57c-1087-4fb9-a8b2-66ae7b6c32d2-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "36bbe57c-1087-4fb9-a8b2-66ae7b6c32d2" (UID: "36bbe57c-1087-4fb9-a8b2-66ae7b6c32d2"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 28 10:06:51.503078 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:06:51.503042    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/36bbe57c-1087-4fb9-a8b2-66ae7b6c32d2-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "36bbe57c-1087-4fb9-a8b2-66ae7b6c32d2" (UID: "36bbe57c-1087-4fb9-a8b2-66ae7b6c32d2"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 28 10:06:51.505141 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:06:51.505111    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/36bbe57c-1087-4fb9-a8b2-66ae7b6c32d2-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "36bbe57c-1087-4fb9-a8b2-66ae7b6c32d2" (UID: "36bbe57c-1087-4fb9-a8b2-66ae7b6c32d2"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 28 10:06:51.505257 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:06:51.505117    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/36bbe57c-1087-4fb9-a8b2-66ae7b6c32d2-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "36bbe57c-1087-4fb9-a8b2-66ae7b6c32d2" (UID: "36bbe57c-1087-4fb9-a8b2-66ae7b6c32d2"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 28 10:06:51.505440 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:06:51.505416    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/36bbe57c-1087-4fb9-a8b2-66ae7b6c32d2-kube-api-access-ggkj9" (OuterVolumeSpecName: "kube-api-access-ggkj9") pod "36bbe57c-1087-4fb9-a8b2-66ae7b6c32d2" (UID: "36bbe57c-1087-4fb9-a8b2-66ae7b6c32d2"). InnerVolumeSpecName "kube-api-access-ggkj9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 28 10:06:51.505506 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:06:51.505474    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/36bbe57c-1087-4fb9-a8b2-66ae7b6c32d2-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "36bbe57c-1087-4fb9-a8b2-66ae7b6c32d2" (UID: "36bbe57c-1087-4fb9-a8b2-66ae7b6c32d2"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 28 10:06:51.505665 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:06:51.505639    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/36bbe57c-1087-4fb9-a8b2-66ae7b6c32d2-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "36bbe57c-1087-4fb9-a8b2-66ae7b6c32d2" (UID: "36bbe57c-1087-4fb9-a8b2-66ae7b6c32d2"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 28 10:06:51.511638 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:06:51.511615    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/36bbe57c-1087-4fb9-a8b2-66ae7b6c32d2-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "36bbe57c-1087-4fb9-a8b2-66ae7b6c32d2" (UID: "36bbe57c-1087-4fb9-a8b2-66ae7b6c32d2"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 28 10:06:51.569659 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:06:51.569631    2565 generic.go:358] "Generic (PLEG): container finished" podID="36bbe57c-1087-4fb9-a8b2-66ae7b6c32d2" containerID="2efd528ea55363498cd8ae7a6c312d74d48ee9387b5b39aed30c36dd964bddf2" exitCode=0
May 28 10:06:51.569802 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:06:51.569696    2565 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7db77487f9-bljn6"
May 28 10:06:51.569802 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:06:51.569705    2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7db77487f9-bljn6" event={"ID":"36bbe57c-1087-4fb9-a8b2-66ae7b6c32d2","Type":"ContainerDied","Data":"2efd528ea55363498cd8ae7a6c312d74d48ee9387b5b39aed30c36dd964bddf2"}
May 28 10:06:51.569802 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:06:51.569739    2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7db77487f9-bljn6" event={"ID":"36bbe57c-1087-4fb9-a8b2-66ae7b6c32d2","Type":"ContainerDied","Data":"9b41902221569b174e27620517ddac7bde29136c775102c6f4084d172ec853bd"}
May 28 10:06:51.569802 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:06:51.569759    2565 scope.go:117] "RemoveContainer" containerID="2efd528ea55363498cd8ae7a6c312d74d48ee9387b5b39aed30c36dd964bddf2"
May 28 10:06:51.578127 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:06:51.578112    2565 scope.go:117] "RemoveContainer" containerID="2efd528ea55363498cd8ae7a6c312d74d48ee9387b5b39aed30c36dd964bddf2"
May 28 10:06:51.578403 ip-10-0-128-206 kubenswrapper[2565]: E0528 10:06:51.578384    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2efd528ea55363498cd8ae7a6c312d74d48ee9387b5b39aed30c36dd964bddf2\": container with ID starting with 2efd528ea55363498cd8ae7a6c312d74d48ee9387b5b39aed30c36dd964bddf2 not found: ID does not exist" containerID="2efd528ea55363498cd8ae7a6c312d74d48ee9387b5b39aed30c36dd964bddf2"
May 28 10:06:51.578453 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:06:51.578410    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2efd528ea55363498cd8ae7a6c312d74d48ee9387b5b39aed30c36dd964bddf2"} err="failed to get container status \"2efd528ea55363498cd8ae7a6c312d74d48ee9387b5b39aed30c36dd964bddf2\": rpc error: code = NotFound desc = could not find container \"2efd528ea55363498cd8ae7a6c312d74d48ee9387b5b39aed30c36dd964bddf2\": container with ID starting with 2efd528ea55363498cd8ae7a6c312d74d48ee9387b5b39aed30c36dd964bddf2 not found: ID does not exist"
May 28 10:06:51.603035 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:06:51.603001    2565 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-7db77487f9-bljn6"]
May 28 10:06:51.603302 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:06:51.603283    2565 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/36bbe57c-1087-4fb9-a8b2-66ae7b6c32d2-image-registry-private-configuration\") on node \"ip-10-0-128-206.ec2.internal\" DevicePath \"\""
May 28 10:06:51.603385 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:06:51.603323    2565 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/36bbe57c-1087-4fb9-a8b2-66ae7b6c32d2-registry-certificates\") on node \"ip-10-0-128-206.ec2.internal\" DevicePath \"\""
May 28 10:06:51.603385 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:06:51.603342    2565 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/36bbe57c-1087-4fb9-a8b2-66ae7b6c32d2-ca-trust-extracted\") on node \"ip-10-0-128-206.ec2.internal\" DevicePath \"\""
May 28 10:06:51.603385 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:06:51.603353    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ggkj9\" (UniqueName: \"kubernetes.io/projected/36bbe57c-1087-4fb9-a8b2-66ae7b6c32d2-kube-api-access-ggkj9\") on node \"ip-10-0-128-206.ec2.internal\" DevicePath \"\""
May 28 10:06:51.603385 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:06:51.603361    2565 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/36bbe57c-1087-4fb9-a8b2-66ae7b6c32d2-installation-pull-secrets\") on node \"ip-10-0-128-206.ec2.internal\" DevicePath \"\""
May 28 10:06:51.603385 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:06:51.603374    2565 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/36bbe57c-1087-4fb9-a8b2-66ae7b6c32d2-registry-tls\") on node \"ip-10-0-128-206.ec2.internal\" DevicePath \"\""
May 28 10:06:51.603385 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:06:51.603385    2565 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/36bbe57c-1087-4fb9-a8b2-66ae7b6c32d2-trusted-ca\") on node \"ip-10-0-128-206.ec2.internal\" DevicePath \"\""
May 28 10:06:51.603572 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:06:51.603393    2565 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/36bbe57c-1087-4fb9-a8b2-66ae7b6c32d2-bound-sa-token\") on node \"ip-10-0-128-206.ec2.internal\" DevicePath \"\""
May 28 10:06:51.607678 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:06:51.607660    2565 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-7db77487f9-bljn6"]
May 28 10:06:52.615278 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:06:52.615254    2565 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0"
May 28 10:06:53.153721 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:06:53.153678    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="36bbe57c-1087-4fb9-a8b2-66ae7b6c32d2" path="/var/lib/kubelet/pods/36bbe57c-1087-4fb9-a8b2-66ae7b6c32d2/volumes"
May 28 10:06:54.286778 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:06:54.286736    2565 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-9cd87fd46-g4xnc"]
May 28 10:06:55.000213 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:06:55.000183    2565 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-console/console-847d55b9f7-bzhp2"]
May 28 10:06:55.000499 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:06:55.000487    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="36bbe57c-1087-4fb9-a8b2-66ae7b6c32d2" containerName="registry"
May 28 10:06:55.000551 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:06:55.000501    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="36bbe57c-1087-4fb9-a8b2-66ae7b6c32d2" containerName="registry"
May 28 10:06:55.000593 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:06:55.000550    2565 memory_manager.go:356] "RemoveStaleState removing state" podUID="36bbe57c-1087-4fb9-a8b2-66ae7b6c32d2" containerName="registry"
May 28 10:06:55.004352 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:06:55.004305    2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-847d55b9f7-bzhp2"
May 28 10:06:55.012418 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:06:55.012390    2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\""
May 28 10:06:55.013812 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:06:55.013789    2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-847d55b9f7-bzhp2"]
May 28 10:06:55.132080 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:06:55.132054    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/02839c99-e06b-4998-9442-2329b6210f0c-service-ca\") pod \"console-847d55b9f7-bzhp2\" (UID: \"02839c99-e06b-4998-9442-2329b6210f0c\") " pod="openshift-console/console-847d55b9f7-bzhp2"
May 28 10:06:55.132080 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:06:55.132082    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5f2mc\" (UniqueName: \"kubernetes.io/projected/02839c99-e06b-4998-9442-2329b6210f0c-kube-api-access-5f2mc\") pod \"console-847d55b9f7-bzhp2\" (UID: \"02839c99-e06b-4998-9442-2329b6210f0c\") " pod="openshift-console/console-847d55b9f7-bzhp2"
May 28 10:06:55.132347 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:06:55.132104    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/02839c99-e06b-4998-9442-2329b6210f0c-console-config\") pod \"console-847d55b9f7-bzhp2\" (UID: \"02839c99-e06b-4998-9442-2329b6210f0c\") " pod="openshift-console/console-847d55b9f7-bzhp2"
May 28 10:06:55.132347 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:06:55.132125    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/02839c99-e06b-4998-9442-2329b6210f0c-trusted-ca-bundle\") pod \"console-847d55b9f7-bzhp2\" (UID: \"02839c99-e06b-4998-9442-2329b6210f0c\") " pod="openshift-console/console-847d55b9f7-bzhp2"
May 28 10:06:55.132347 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:06:55.132177    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/02839c99-e06b-4998-9442-2329b6210f0c-oauth-serving-cert\") pod \"console-847d55b9f7-bzhp2\" (UID: \"02839c99-e06b-4998-9442-2329b6210f0c\") " pod="openshift-console/console-847d55b9f7-bzhp2"
May 28 10:06:55.132347 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:06:55.132222    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/02839c99-e06b-4998-9442-2329b6210f0c-console-serving-cert\") pod \"console-847d55b9f7-bzhp2\" (UID: \"02839c99-e06b-4998-9442-2329b6210f0c\") " pod="openshift-console/console-847d55b9f7-bzhp2"
May 28 10:06:55.132347 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:06:55.132249    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/02839c99-e06b-4998-9442-2329b6210f0c-console-oauth-config\") pod \"console-847d55b9f7-bzhp2\" (UID: \"02839c99-e06b-4998-9442-2329b6210f0c\") " pod="openshift-console/console-847d55b9f7-bzhp2"
May 28 10:06:55.232832 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:06:55.232803    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/02839c99-e06b-4998-9442-2329b6210f0c-service-ca\") pod \"console-847d55b9f7-bzhp2\" (UID: \"02839c99-e06b-4998-9442-2329b6210f0c\") " pod="openshift-console/console-847d55b9f7-bzhp2"
May 28 10:06:55.232832 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:06:55.232834    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-5f2mc\" (UniqueName: \"kubernetes.io/projected/02839c99-e06b-4998-9442-2329b6210f0c-kube-api-access-5f2mc\") pod \"console-847d55b9f7-bzhp2\" (UID: \"02839c99-e06b-4998-9442-2329b6210f0c\") " pod="openshift-console/console-847d55b9f7-bzhp2"
May 28 10:06:55.233067 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:06:55.232858    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/02839c99-e06b-4998-9442-2329b6210f0c-console-config\") pod \"console-847d55b9f7-bzhp2\" (UID: \"02839c99-e06b-4998-9442-2329b6210f0c\") " pod="openshift-console/console-847d55b9f7-bzhp2"
May 28 10:06:55.233067 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:06:55.232877    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/02839c99-e06b-4998-9442-2329b6210f0c-trusted-ca-bundle\") pod \"console-847d55b9f7-bzhp2\" (UID: \"02839c99-e06b-4998-9442-2329b6210f0c\") " pod="openshift-console/console-847d55b9f7-bzhp2"
May 28 10:06:55.233067 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:06:55.232897    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/02839c99-e06b-4998-9442-2329b6210f0c-oauth-serving-cert\") pod \"console-847d55b9f7-bzhp2\" (UID: \"02839c99-e06b-4998-9442-2329b6210f0c\") " pod="openshift-console/console-847d55b9f7-bzhp2"
May 28 10:06:55.233067 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:06:55.232915    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/02839c99-e06b-4998-9442-2329b6210f0c-console-serving-cert\") pod \"console-847d55b9f7-bzhp2\" (UID: \"02839c99-e06b-4998-9442-2329b6210f0c\") " pod="openshift-console/console-847d55b9f7-bzhp2"
May 28 10:06:55.233067 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:06:55.232938    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/02839c99-e06b-4998-9442-2329b6210f0c-console-oauth-config\") pod \"console-847d55b9f7-bzhp2\" (UID: \"02839c99-e06b-4998-9442-2329b6210f0c\") " pod="openshift-console/console-847d55b9f7-bzhp2"
May 28 10:06:55.233695 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:06:55.233667    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/02839c99-e06b-4998-9442-2329b6210f0c-oauth-serving-cert\") pod \"console-847d55b9f7-bzhp2\" (UID: \"02839c99-e06b-4998-9442-2329b6210f0c\") " pod="openshift-console/console-847d55b9f7-bzhp2"
May 28 10:06:55.233827 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:06:55.233733    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/02839c99-e06b-4998-9442-2329b6210f0c-console-config\") pod \"console-847d55b9f7-bzhp2\" (UID: \"02839c99-e06b-4998-9442-2329b6210f0c\") " pod="openshift-console/console-847d55b9f7-bzhp2"
May 28 10:06:55.233973 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:06:55.233950    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/02839c99-e06b-4998-9442-2329b6210f0c-service-ca\") pod \"console-847d55b9f7-bzhp2\" (UID: \"02839c99-e06b-4998-9442-2329b6210f0c\") " pod="openshift-console/console-847d55b9f7-bzhp2"
May 28 10:06:55.234020 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:06:55.233999    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/02839c99-e06b-4998-9442-2329b6210f0c-trusted-ca-bundle\") pod \"console-847d55b9f7-bzhp2\" (UID: \"02839c99-e06b-4998-9442-2329b6210f0c\") " pod="openshift-console/console-847d55b9f7-bzhp2"
May 28 10:06:55.235455 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:06:55.235435    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/02839c99-e06b-4998-9442-2329b6210f0c-console-oauth-config\") pod \"console-847d55b9f7-bzhp2\" (UID: \"02839c99-e06b-4998-9442-2329b6210f0c\") " pod="openshift-console/console-847d55b9f7-bzhp2"
May 28 10:06:55.235758 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:06:55.235734    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/02839c99-e06b-4998-9442-2329b6210f0c-console-serving-cert\") pod \"console-847d55b9f7-bzhp2\" (UID: \"02839c99-e06b-4998-9442-2329b6210f0c\") " pod="openshift-console/console-847d55b9f7-bzhp2"
May 28 10:06:55.241118 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:06:55.241098    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5f2mc\" (UniqueName: \"kubernetes.io/projected/02839c99-e06b-4998-9442-2329b6210f0c-kube-api-access-5f2mc\") pod \"console-847d55b9f7-bzhp2\" (UID: \"02839c99-e06b-4998-9442-2329b6210f0c\") " pod="openshift-console/console-847d55b9f7-bzhp2"
May 28 10:06:55.315532 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:06:55.315462    2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-847d55b9f7-bzhp2"
May 28 10:06:55.440049 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:06:55.440020    2565 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-kvx8v"
May 28 10:06:55.472803 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:06:55.472758    2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-847d55b9f7-bzhp2"]
May 28 10:06:55.476212 ip-10-0-128-206 kubenswrapper[2565]: W0528 10:06:55.476182    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod02839c99_e06b_4998_9442_2329b6210f0c.slice/crio-78e4a1778e49d21e894915854e387046558cbf0d30640c07984ad4bfa45170c3 WatchSource:0}: Error finding container 78e4a1778e49d21e894915854e387046558cbf0d30640c07984ad4bfa45170c3: Status 404 returned error can't find the container with id 78e4a1778e49d21e894915854e387046558cbf0d30640c07984ad4bfa45170c3
May 28 10:06:55.587622 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:06:55.587591    2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-847d55b9f7-bzhp2" event={"ID":"02839c99-e06b-4998-9442-2329b6210f0c","Type":"ContainerStarted","Data":"4b6de902ce3c63ea8090e5abb99e82a441969e486eba0f96acec155e015afe79"}
May 28 10:06:55.587622 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:06:55.587626    2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-847d55b9f7-bzhp2" event={"ID":"02839c99-e06b-4998-9442-2329b6210f0c","Type":"ContainerStarted","Data":"78e4a1778e49d21e894915854e387046558cbf0d30640c07984ad4bfa45170c3"}
May 28 10:06:55.607253 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:06:55.607196    2565 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-console/console-847d55b9f7-bzhp2" podStartSLOduration=1.607183062 podStartE2EDuration="1.607183062s" podCreationTimestamp="2026-05-28 10:06:54 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-28 10:06:55.60554642 +0000 UTC m=+101.065880574" watchObservedRunningTime="2026-05-28 10:06:55.607183062 +0000 UTC m=+101.067517213"
May 28 10:07:05.315713 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:07:05.315669    2565 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-847d55b9f7-bzhp2"
May 28 10:07:05.316179 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:07:05.315733    2565 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-847d55b9f7-bzhp2"
May 28 10:07:05.320682 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:07:05.320663    2565 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-847d55b9f7-bzhp2"
May 28 10:07:05.616804 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:07:05.616780    2565 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-847d55b9f7-bzhp2"
May 28 10:07:19.309164 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:07:19.309100    2565 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-console/console-9cd87fd46-g4xnc" podUID="82b5199d-ad56-4bf8-93ea-cb1b467e50f1" containerName="console" containerID="cri-o://e9829fabd8fa24cdcb8a694ff77a38d01bde9354865039ce6a4c41cee4f0eac3" gracePeriod=15
May 28 10:07:19.497712 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:07:19.497684    2565 patch_prober.go:28] interesting pod/console-9cd87fd46-g4xnc container/console namespace/openshift-console: Readiness probe status=failure output="Get \"https://10.133.0.10:8443/health\": dial tcp 10.133.0.10:8443: connect: connection refused" start-of-body=
May 28 10:07:19.497840 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:07:19.497749    2565 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-console/console-9cd87fd46-g4xnc" podUID="82b5199d-ad56-4bf8-93ea-cb1b467e50f1" containerName="console" probeResult="failure" output="Get \"https://10.133.0.10:8443/health\": dial tcp 10.133.0.10:8443: connect: connection refused"
May 28 10:07:19.608441 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:07:19.608418    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-9cd87fd46-g4xnc_82b5199d-ad56-4bf8-93ea-cb1b467e50f1/console/0.log"
May 28 10:07:19.608550 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:07:19.608479    2565 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-9cd87fd46-g4xnc"
May 28 10:07:19.624382 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:07:19.624366    2565 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ts44h\" (UniqueName: \"kubernetes.io/projected/82b5199d-ad56-4bf8-93ea-cb1b467e50f1-kube-api-access-ts44h\") pod \"82b5199d-ad56-4bf8-93ea-cb1b467e50f1\" (UID: \"82b5199d-ad56-4bf8-93ea-cb1b467e50f1\") "
May 28 10:07:19.624438 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:07:19.624419    2565 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/82b5199d-ad56-4bf8-93ea-cb1b467e50f1-console-serving-cert\") pod \"82b5199d-ad56-4bf8-93ea-cb1b467e50f1\" (UID: \"82b5199d-ad56-4bf8-93ea-cb1b467e50f1\") "
May 28 10:07:19.624473 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:07:19.624458    2565 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/82b5199d-ad56-4bf8-93ea-cb1b467e50f1-console-config\") pod \"82b5199d-ad56-4bf8-93ea-cb1b467e50f1\" (UID: \"82b5199d-ad56-4bf8-93ea-cb1b467e50f1\") "
May 28 10:07:19.624516 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:07:19.624505    2565 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/82b5199d-ad56-4bf8-93ea-cb1b467e50f1-oauth-serving-cert\") pod \"82b5199d-ad56-4bf8-93ea-cb1b467e50f1\" (UID: \"82b5199d-ad56-4bf8-93ea-cb1b467e50f1\") "
May 28 10:07:19.624720 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:07:19.624693    2565 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/82b5199d-ad56-4bf8-93ea-cb1b467e50f1-service-ca\") pod \"82b5199d-ad56-4bf8-93ea-cb1b467e50f1\" (UID: \"82b5199d-ad56-4bf8-93ea-cb1b467e50f1\") "
May 28 10:07:19.624836 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:07:19.624738    2565 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/82b5199d-ad56-4bf8-93ea-cb1b467e50f1-console-oauth-config\") pod \"82b5199d-ad56-4bf8-93ea-cb1b467e50f1\" (UID: \"82b5199d-ad56-4bf8-93ea-cb1b467e50f1\") "
May 28 10:07:19.624836 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:07:19.624783    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/82b5199d-ad56-4bf8-93ea-cb1b467e50f1-console-config" (OuterVolumeSpecName: "console-config") pod "82b5199d-ad56-4bf8-93ea-cb1b467e50f1" (UID: "82b5199d-ad56-4bf8-93ea-cb1b467e50f1"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 28 10:07:19.624836 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:07:19.624811    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/82b5199d-ad56-4bf8-93ea-cb1b467e50f1-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "82b5199d-ad56-4bf8-93ea-cb1b467e50f1" (UID: "82b5199d-ad56-4bf8-93ea-cb1b467e50f1"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 28 10:07:19.625098 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:07:19.625072    2565 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/82b5199d-ad56-4bf8-93ea-cb1b467e50f1-console-config\") on node \"ip-10-0-128-206.ec2.internal\" DevicePath \"\""
May 28 10:07:19.625189 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:07:19.625105    2565 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/82b5199d-ad56-4bf8-93ea-cb1b467e50f1-oauth-serving-cert\") on node \"ip-10-0-128-206.ec2.internal\" DevicePath \"\""
May 28 10:07:19.625245 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:07:19.625220    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/82b5199d-ad56-4bf8-93ea-cb1b467e50f1-service-ca" (OuterVolumeSpecName: "service-ca") pod "82b5199d-ad56-4bf8-93ea-cb1b467e50f1" (UID: "82b5199d-ad56-4bf8-93ea-cb1b467e50f1"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 28 10:07:19.626677 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:07:19.626648    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/82b5199d-ad56-4bf8-93ea-cb1b467e50f1-kube-api-access-ts44h" (OuterVolumeSpecName: "kube-api-access-ts44h") pod "82b5199d-ad56-4bf8-93ea-cb1b467e50f1" (UID: "82b5199d-ad56-4bf8-93ea-cb1b467e50f1"). InnerVolumeSpecName "kube-api-access-ts44h". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 28 10:07:19.626816 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:07:19.626798    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/82b5199d-ad56-4bf8-93ea-cb1b467e50f1-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "82b5199d-ad56-4bf8-93ea-cb1b467e50f1" (UID: "82b5199d-ad56-4bf8-93ea-cb1b467e50f1"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 28 10:07:19.626857 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:07:19.626818    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/82b5199d-ad56-4bf8-93ea-cb1b467e50f1-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "82b5199d-ad56-4bf8-93ea-cb1b467e50f1" (UID: "82b5199d-ad56-4bf8-93ea-cb1b467e50f1"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 28 10:07:19.658830 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:07:19.658807    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-9cd87fd46-g4xnc_82b5199d-ad56-4bf8-93ea-cb1b467e50f1/console/0.log"
May 28 10:07:19.658968 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:07:19.658851    2565 generic.go:358] "Generic (PLEG): container finished" podID="82b5199d-ad56-4bf8-93ea-cb1b467e50f1" containerID="e9829fabd8fa24cdcb8a694ff77a38d01bde9354865039ce6a4c41cee4f0eac3" exitCode=2
May 28 10:07:19.658968 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:07:19.658929    2565 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-9cd87fd46-g4xnc"
May 28 10:07:19.658968 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:07:19.658931    2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-9cd87fd46-g4xnc" event={"ID":"82b5199d-ad56-4bf8-93ea-cb1b467e50f1","Type":"ContainerDied","Data":"e9829fabd8fa24cdcb8a694ff77a38d01bde9354865039ce6a4c41cee4f0eac3"}
May 28 10:07:19.659068 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:07:19.658967    2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-9cd87fd46-g4xnc" event={"ID":"82b5199d-ad56-4bf8-93ea-cb1b467e50f1","Type":"ContainerDied","Data":"0e26a2200f11bbfcac5d8193f45bea56dc5b50083e4a84480475932cd9969d87"}
May 28 10:07:19.659068 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:07:19.658986    2565 scope.go:117] "RemoveContainer" containerID="e9829fabd8fa24cdcb8a694ff77a38d01bde9354865039ce6a4c41cee4f0eac3"
May 28 10:07:19.667530 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:07:19.667509    2565 scope.go:117] "RemoveContainer" containerID="e9829fabd8fa24cdcb8a694ff77a38d01bde9354865039ce6a4c41cee4f0eac3"
May 28 10:07:19.667759 ip-10-0-128-206 kubenswrapper[2565]: E0528 10:07:19.667739    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e9829fabd8fa24cdcb8a694ff77a38d01bde9354865039ce6a4c41cee4f0eac3\": container with ID starting with e9829fabd8fa24cdcb8a694ff77a38d01bde9354865039ce6a4c41cee4f0eac3 not found: ID does not exist" containerID="e9829fabd8fa24cdcb8a694ff77a38d01bde9354865039ce6a4c41cee4f0eac3"
May 28 10:07:19.667831 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:07:19.667771    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e9829fabd8fa24cdcb8a694ff77a38d01bde9354865039ce6a4c41cee4f0eac3"} err="failed to get container status \"e9829fabd8fa24cdcb8a694ff77a38d01bde9354865039ce6a4c41cee4f0eac3\": rpc error: code = NotFound desc = could not find container \"e9829fabd8fa24cdcb8a694ff77a38d01bde9354865039ce6a4c41cee4f0eac3\": container with ID starting with e9829fabd8fa24cdcb8a694ff77a38d01bde9354865039ce6a4c41cee4f0eac3 not found: ID does not exist"
May 28 10:07:19.682525 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:07:19.682500    2565 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-9cd87fd46-g4xnc"]
May 28 10:07:19.692949 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:07:19.692923    2565 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-9cd87fd46-g4xnc"]
May 28 10:07:19.726505 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:07:19.726466    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ts44h\" (UniqueName: \"kubernetes.io/projected/82b5199d-ad56-4bf8-93ea-cb1b467e50f1-kube-api-access-ts44h\") on node \"ip-10-0-128-206.ec2.internal\" DevicePath \"\""
May 28 10:07:19.726505 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:07:19.726501    2565 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/82b5199d-ad56-4bf8-93ea-cb1b467e50f1-console-serving-cert\") on node \"ip-10-0-128-206.ec2.internal\" DevicePath \"\""
May 28 10:07:19.726505 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:07:19.726513    2565 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/82b5199d-ad56-4bf8-93ea-cb1b467e50f1-service-ca\") on node \"ip-10-0-128-206.ec2.internal\" DevicePath \"\""
May 28 10:07:19.726687 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:07:19.726522    2565 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/82b5199d-ad56-4bf8-93ea-cb1b467e50f1-console-oauth-config\") on node \"ip-10-0-128-206.ec2.internal\" DevicePath \"\""
May 28 10:07:21.154032 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:07:21.153998    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="82b5199d-ad56-4bf8-93ea-cb1b467e50f1" path="/var/lib/kubelet/pods/82b5199d-ad56-4bf8-93ea-cb1b467e50f1/volumes"
May 28 10:07:42.615204 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:07:42.615163    2565 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0"
May 28 10:07:42.635598 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:07:42.635573    2565 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0"
May 28 10:07:42.738416 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:07:42.738390    2565 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0"
May 28 10:07:56.481035 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:07:56.481001    2565 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
May 28 10:07:56.481477 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:07:56.481451    2565 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="aa86ed4e-28cf-4607-831f-636c37755e8e" containerName="alertmanager" containerID="cri-o://106ed78a74bd942d79c71c9faf203e23dcb1dec2f5030779187c734b69207f96" gracePeriod=120
May 28 10:07:56.481563 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:07:56.481513    2565 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="aa86ed4e-28cf-4607-831f-636c37755e8e" containerName="kube-rbac-proxy-metric" containerID="cri-o://2c13740addf2d4d0b75278c925ba9edb173c7401a2b534ca6fd00a0dd2ac8529" gracePeriod=120
May 28 10:07:56.481639 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:07:56.481601    2565 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="aa86ed4e-28cf-4607-831f-636c37755e8e" containerName="kube-rbac-proxy" containerID="cri-o://bc67439d755f0502090295bea567fa2766213b49ed82ead5bc769ff33b13dcc4" gracePeriod=120
May 28 10:07:56.481639 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:07:56.481565    2565 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="aa86ed4e-28cf-4607-831f-636c37755e8e" containerName="prom-label-proxy" containerID="cri-o://7df2b853c1bf36133ff8b0666c5c41f39732f7b54e1eaa1241b13c5ce1fe0cb4" gracePeriod=120
May 28 10:07:56.481639 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:07:56.481589    2565 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="aa86ed4e-28cf-4607-831f-636c37755e8e" containerName="kube-rbac-proxy-web" containerID="cri-o://20ae764ca415722c6c08f0794a5e7f4b2d648e0f37dd8c13f1782ceffad13b3c" gracePeriod=120
May 28 10:07:56.481779 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:07:56.481587    2565 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="aa86ed4e-28cf-4607-831f-636c37755e8e" containerName="config-reloader" containerID="cri-o://a17bde6119949d9a821a30187b2a4d3320c4a64081670b8f3f3c6e9e26bb4cad" gracePeriod=120
May 28 10:07:56.780400 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:07:56.780288    2565 generic.go:358] "Generic (PLEG): container finished" podID="aa86ed4e-28cf-4607-831f-636c37755e8e" containerID="7df2b853c1bf36133ff8b0666c5c41f39732f7b54e1eaa1241b13c5ce1fe0cb4" exitCode=0
May 28 10:07:56.780400 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:07:56.780343    2565 generic.go:358] "Generic (PLEG): container finished" podID="aa86ed4e-28cf-4607-831f-636c37755e8e" containerID="bc67439d755f0502090295bea567fa2766213b49ed82ead5bc769ff33b13dcc4" exitCode=0
May 28 10:07:56.780400 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:07:56.780354    2565 generic.go:358] "Generic (PLEG): container finished" podID="aa86ed4e-28cf-4607-831f-636c37755e8e" containerID="a17bde6119949d9a821a30187b2a4d3320c4a64081670b8f3f3c6e9e26bb4cad" exitCode=0
May 28 10:07:56.780400 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:07:56.780361    2565 generic.go:358] "Generic (PLEG): container finished" podID="aa86ed4e-28cf-4607-831f-636c37755e8e" containerID="106ed78a74bd942d79c71c9faf203e23dcb1dec2f5030779187c734b69207f96" exitCode=0
May 28 10:07:56.780676 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:07:56.780464    2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"aa86ed4e-28cf-4607-831f-636c37755e8e","Type":"ContainerDied","Data":"7df2b853c1bf36133ff8b0666c5c41f39732f7b54e1eaa1241b13c5ce1fe0cb4"}
May 28 10:07:56.780676 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:07:56.780507    2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"aa86ed4e-28cf-4607-831f-636c37755e8e","Type":"ContainerDied","Data":"bc67439d755f0502090295bea567fa2766213b49ed82ead5bc769ff33b13dcc4"}
May 28 10:07:56.780676 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:07:56.780520    2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"aa86ed4e-28cf-4607-831f-636c37755e8e","Type":"ContainerDied","Data":"a17bde6119949d9a821a30187b2a4d3320c4a64081670b8f3f3c6e9e26bb4cad"}
May 28 10:07:56.780676 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:07:56.780531    2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"aa86ed4e-28cf-4607-831f-636c37755e8e","Type":"ContainerDied","Data":"106ed78a74bd942d79c71c9faf203e23dcb1dec2f5030779187c734b69207f96"}
May 28 10:07:57.717761 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:07:57.717733    2565 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
May 28 10:07:57.786604 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:07:57.786570    2565 generic.go:358] "Generic (PLEG): container finished" podID="aa86ed4e-28cf-4607-831f-636c37755e8e" containerID="2c13740addf2d4d0b75278c925ba9edb173c7401a2b534ca6fd00a0dd2ac8529" exitCode=0
May 28 10:07:57.786604 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:07:57.786598    2565 generic.go:358] "Generic (PLEG): container finished" podID="aa86ed4e-28cf-4607-831f-636c37755e8e" containerID="20ae764ca415722c6c08f0794a5e7f4b2d648e0f37dd8c13f1782ceffad13b3c" exitCode=0
May 28 10:07:57.786832 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:07:57.786657    2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"aa86ed4e-28cf-4607-831f-636c37755e8e","Type":"ContainerDied","Data":"2c13740addf2d4d0b75278c925ba9edb173c7401a2b534ca6fd00a0dd2ac8529"}
May 28 10:07:57.786832 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:07:57.786683    2565 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
May 28 10:07:57.786832 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:07:57.786695    2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"aa86ed4e-28cf-4607-831f-636c37755e8e","Type":"ContainerDied","Data":"20ae764ca415722c6c08f0794a5e7f4b2d648e0f37dd8c13f1782ceffad13b3c"}
May 28 10:07:57.786832 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:07:57.786707    2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"aa86ed4e-28cf-4607-831f-636c37755e8e","Type":"ContainerDied","Data":"8763b9fda9f63a16d2426e87abf7ddeeffbd2949a1b86aa8d0440faf86ea5cad"}
May 28 10:07:57.786832 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:07:57.786722    2565 scope.go:117] "RemoveContainer" containerID="7df2b853c1bf36133ff8b0666c5c41f39732f7b54e1eaa1241b13c5ce1fe0cb4"
May 28 10:07:57.794794 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:07:57.794778    2565 scope.go:117] "RemoveContainer" containerID="2c13740addf2d4d0b75278c925ba9edb173c7401a2b534ca6fd00a0dd2ac8529"
May 28 10:07:57.802636 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:07:57.802607    2565 scope.go:117] "RemoveContainer" containerID="bc67439d755f0502090295bea567fa2766213b49ed82ead5bc769ff33b13dcc4"
May 28 10:07:57.808947 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:07:57.808931    2565 scope.go:117] "RemoveContainer" containerID="20ae764ca415722c6c08f0794a5e7f4b2d648e0f37dd8c13f1782ceffad13b3c"
May 28 10:07:57.815090 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:07:57.815075    2565 scope.go:117] "RemoveContainer" containerID="a17bde6119949d9a821a30187b2a4d3320c4a64081670b8f3f3c6e9e26bb4cad"
May 28 10:07:57.821347 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:07:57.821330    2565 scope.go:117] "RemoveContainer" containerID="106ed78a74bd942d79c71c9faf203e23dcb1dec2f5030779187c734b69207f96"
May 28 10:07:57.827683 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:07:57.827666    2565 scope.go:117] "RemoveContainer" containerID="4e6762546890ce97d726d186dcd97993d279d27e655272d52ff99a0419be00e1"
May 28 10:07:57.832643 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:07:57.832625    2565 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/aa86ed4e-28cf-4607-831f-636c37755e8e-alertmanager-trusted-ca-bundle\") pod \"aa86ed4e-28cf-4607-831f-636c37755e8e\" (UID: \"aa86ed4e-28cf-4607-831f-636c37755e8e\") "
May 28 10:07:57.832732 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:07:57.832665    2565 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/aa86ed4e-28cf-4607-831f-636c37755e8e-secret-alertmanager-kube-rbac-proxy\") pod \"aa86ed4e-28cf-4607-831f-636c37755e8e\" (UID: \"aa86ed4e-28cf-4607-831f-636c37755e8e\") "
May 28 10:07:57.832732 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:07:57.832711    2565 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/aa86ed4e-28cf-4607-831f-636c37755e8e-alertmanager-main-db\") pod \"aa86ed4e-28cf-4607-831f-636c37755e8e\" (UID: \"aa86ed4e-28cf-4607-831f-636c37755e8e\") "
May 28 10:07:57.832840 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:07:57.832829    2565 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/aa86ed4e-28cf-4607-831f-636c37755e8e-secret-alertmanager-main-tls\") pod \"aa86ed4e-28cf-4607-831f-636c37755e8e\" (UID: \"aa86ed4e-28cf-4607-831f-636c37755e8e\") "
May 28 10:07:57.832894 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:07:57.832881    2565 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/aa86ed4e-28cf-4607-831f-636c37755e8e-cluster-tls-config\") pod \"aa86ed4e-28cf-4607-831f-636c37755e8e\" (UID: \"aa86ed4e-28cf-4607-831f-636c37755e8e\") "
May 28 10:07:57.832947 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:07:57.832917    2565 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/aa86ed4e-28cf-4607-831f-636c37755e8e-config-volume\") pod \"aa86ed4e-28cf-4607-831f-636c37755e8e\" (UID: \"aa86ed4e-28cf-4607-831f-636c37755e8e\") "
May 28 10:07:57.832947 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:07:57.832939    2565 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/aa86ed4e-28cf-4607-831f-636c37755e8e-tls-assets\") pod \"aa86ed4e-28cf-4607-831f-636c37755e8e\" (UID: \"aa86ed4e-28cf-4607-831f-636c37755e8e\") "
May 28 10:07:57.833046 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:07:57.832965    2565 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/aa86ed4e-28cf-4607-831f-636c37755e8e-web-config\") pod \"aa86ed4e-28cf-4607-831f-636c37755e8e\" (UID: \"aa86ed4e-28cf-4607-831f-636c37755e8e\") "
May 28 10:07:57.833046 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:07:57.832991    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/aa86ed4e-28cf-4607-831f-636c37755e8e-alertmanager-main-db" (OuterVolumeSpecName: "alertmanager-main-db") pod "aa86ed4e-28cf-4607-831f-636c37755e8e" (UID: "aa86ed4e-28cf-4607-831f-636c37755e8e"). InnerVolumeSpecName "alertmanager-main-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 28 10:07:57.833046 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:07:57.833000    2565 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/aa86ed4e-28cf-4607-831f-636c37755e8e-secret-alertmanager-kube-rbac-proxy-metric\") pod \"aa86ed4e-28cf-4607-831f-636c37755e8e\" (UID: \"aa86ed4e-28cf-4607-831f-636c37755e8e\") "
May 28 10:07:57.833202 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:07:57.833039    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/aa86ed4e-28cf-4607-831f-636c37755e8e-alertmanager-trusted-ca-bundle" (OuterVolumeSpecName: "alertmanager-trusted-ca-bundle") pod "aa86ed4e-28cf-4607-831f-636c37755e8e" (UID: "aa86ed4e-28cf-4607-831f-636c37755e8e"). InnerVolumeSpecName "alertmanager-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 28 10:07:57.833202 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:07:57.833058    2565 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/aa86ed4e-28cf-4607-831f-636c37755e8e-metrics-client-ca\") pod \"aa86ed4e-28cf-4607-831f-636c37755e8e\" (UID: \"aa86ed4e-28cf-4607-831f-636c37755e8e\") "
May 28 10:07:57.833202 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:07:57.833085    2565 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/aa86ed4e-28cf-4607-831f-636c37755e8e-config-out\") pod \"aa86ed4e-28cf-4607-831f-636c37755e8e\" (UID: \"aa86ed4e-28cf-4607-831f-636c37755e8e\") "
May 28 10:07:57.833202 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:07:57.833115    2565 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/aa86ed4e-28cf-4607-831f-636c37755e8e-secret-alertmanager-kube-rbac-proxy-web\") pod \"aa86ed4e-28cf-4607-831f-636c37755e8e\" (UID: \"aa86ed4e-28cf-4607-831f-636c37755e8e\") "
May 28 10:07:57.833202 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:07:57.833143    2565 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cttdz\" (UniqueName: \"kubernetes.io/projected/aa86ed4e-28cf-4607-831f-636c37755e8e-kube-api-access-cttdz\") pod \"aa86ed4e-28cf-4607-831f-636c37755e8e\" (UID: \"aa86ed4e-28cf-4607-831f-636c37755e8e\") "
May 28 10:07:57.833486 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:07:57.833429    2565 reconciler_common.go:299] "Volume detached for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/aa86ed4e-28cf-4607-831f-636c37755e8e-alertmanager-trusted-ca-bundle\") on node \"ip-10-0-128-206.ec2.internal\" DevicePath \"\""
May 28 10:07:57.833486 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:07:57.833450    2565 reconciler_common.go:299] "Volume detached for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/aa86ed4e-28cf-4607-831f-636c37755e8e-alertmanager-main-db\") on node \"ip-10-0-128-206.ec2.internal\" DevicePath \"\""
May 28 10:07:57.834076 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:07:57.834031    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/aa86ed4e-28cf-4607-831f-636c37755e8e-metrics-client-ca" (OuterVolumeSpecName: "metrics-client-ca") pod "aa86ed4e-28cf-4607-831f-636c37755e8e" (UID: "aa86ed4e-28cf-4607-831f-636c37755e8e"). InnerVolumeSpecName "metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 28 10:07:57.835601 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:07:57.835389    2565 scope.go:117] "RemoveContainer" containerID="7df2b853c1bf36133ff8b0666c5c41f39732f7b54e1eaa1241b13c5ce1fe0cb4"
May 28 10:07:57.835945 ip-10-0-128-206 kubenswrapper[2565]: E0528 10:07:57.835778    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7df2b853c1bf36133ff8b0666c5c41f39732f7b54e1eaa1241b13c5ce1fe0cb4\": container with ID starting with 7df2b853c1bf36133ff8b0666c5c41f39732f7b54e1eaa1241b13c5ce1fe0cb4 not found: ID does not exist" containerID="7df2b853c1bf36133ff8b0666c5c41f39732f7b54e1eaa1241b13c5ce1fe0cb4"
May 28 10:07:57.835945 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:07:57.835812    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7df2b853c1bf36133ff8b0666c5c41f39732f7b54e1eaa1241b13c5ce1fe0cb4"} err="failed to get container status \"7df2b853c1bf36133ff8b0666c5c41f39732f7b54e1eaa1241b13c5ce1fe0cb4\": rpc error: code = NotFound desc = could not find container \"7df2b853c1bf36133ff8b0666c5c41f39732f7b54e1eaa1241b13c5ce1fe0cb4\": container with ID starting with 7df2b853c1bf36133ff8b0666c5c41f39732f7b54e1eaa1241b13c5ce1fe0cb4 not found: ID does not exist"
May 28 10:07:57.835945 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:07:57.835839    2565 scope.go:117] "RemoveContainer" containerID="2c13740addf2d4d0b75278c925ba9edb173c7401a2b534ca6fd00a0dd2ac8529"
May 28 10:07:57.836145 ip-10-0-128-206 kubenswrapper[2565]: E0528 10:07:57.836098    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2c13740addf2d4d0b75278c925ba9edb173c7401a2b534ca6fd00a0dd2ac8529\": container with ID starting with 2c13740addf2d4d0b75278c925ba9edb173c7401a2b534ca6fd00a0dd2ac8529 not found: ID does not exist" containerID="2c13740addf2d4d0b75278c925ba9edb173c7401a2b534ca6fd00a0dd2ac8529"
May 28 10:07:57.836145 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:07:57.836128    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2c13740addf2d4d0b75278c925ba9edb173c7401a2b534ca6fd00a0dd2ac8529"} err="failed to get container status \"2c13740addf2d4d0b75278c925ba9edb173c7401a2b534ca6fd00a0dd2ac8529\": rpc error: code = NotFound desc = could not find container \"2c13740addf2d4d0b75278c925ba9edb173c7401a2b534ca6fd00a0dd2ac8529\": container with ID starting with 2c13740addf2d4d0b75278c925ba9edb173c7401a2b534ca6fd00a0dd2ac8529 not found: ID does not exist"
May 28 10:07:57.836251 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:07:57.836150    2565 scope.go:117] "RemoveContainer" containerID="bc67439d755f0502090295bea567fa2766213b49ed82ead5bc769ff33b13dcc4"
May 28 10:07:57.836537 ip-10-0-128-206 kubenswrapper[2565]: E0528 10:07:57.836510    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bc67439d755f0502090295bea567fa2766213b49ed82ead5bc769ff33b13dcc4\": container with ID starting with bc67439d755f0502090295bea567fa2766213b49ed82ead5bc769ff33b13dcc4 not found: ID does not exist" containerID="bc67439d755f0502090295bea567fa2766213b49ed82ead5bc769ff33b13dcc4"
May 28 10:07:57.836629 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:07:57.836544    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bc67439d755f0502090295bea567fa2766213b49ed82ead5bc769ff33b13dcc4"} err="failed to get container status \"bc67439d755f0502090295bea567fa2766213b49ed82ead5bc769ff33b13dcc4\": rpc error: code = NotFound desc = could not find container \"bc67439d755f0502090295bea567fa2766213b49ed82ead5bc769ff33b13dcc4\": container with ID starting with bc67439d755f0502090295bea567fa2766213b49ed82ead5bc769ff33b13dcc4 not found: ID does not exist"
May 28 10:07:57.836629 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:07:57.836565    2565 scope.go:117] "RemoveContainer" containerID="20ae764ca415722c6c08f0794a5e7f4b2d648e0f37dd8c13f1782ceffad13b3c"
May 28 10:07:57.836729 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:07:57.836631    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/aa86ed4e-28cf-4607-831f-636c37755e8e-config-volume" (OuterVolumeSpecName: "config-volume") pod "aa86ed4e-28cf-4607-831f-636c37755e8e" (UID: "aa86ed4e-28cf-4607-831f-636c37755e8e"). InnerVolumeSpecName "config-volume". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 28 10:07:57.837494 ip-10-0-128-206 kubenswrapper[2565]: E0528 10:07:57.836831    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"20ae764ca415722c6c08f0794a5e7f4b2d648e0f37dd8c13f1782ceffad13b3c\": container with ID starting with 20ae764ca415722c6c08f0794a5e7f4b2d648e0f37dd8c13f1782ceffad13b3c not found: ID does not exist" containerID="20ae764ca415722c6c08f0794a5e7f4b2d648e0f37dd8c13f1782ceffad13b3c"
May 28 10:07:57.837494 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:07:57.836864    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"20ae764ca415722c6c08f0794a5e7f4b2d648e0f37dd8c13f1782ceffad13b3c"} err="failed to get container status \"20ae764ca415722c6c08f0794a5e7f4b2d648e0f37dd8c13f1782ceffad13b3c\": rpc error: code = NotFound desc = could not find container \"20ae764ca415722c6c08f0794a5e7f4b2d648e0f37dd8c13f1782ceffad13b3c\": container with ID starting with 20ae764ca415722c6c08f0794a5e7f4b2d648e0f37dd8c13f1782ceffad13b3c not found: ID does not exist"
May 28 10:07:57.837494 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:07:57.836885    2565 scope.go:117] "RemoveContainer" containerID="a17bde6119949d9a821a30187b2a4d3320c4a64081670b8f3f3c6e9e26bb4cad"
May 28 10:07:57.837494 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:07:57.836947    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/aa86ed4e-28cf-4607-831f-636c37755e8e-kube-api-access-cttdz" (OuterVolumeSpecName: "kube-api-access-cttdz") pod "aa86ed4e-28cf-4607-831f-636c37755e8e" (UID: "aa86ed4e-28cf-4607-831f-636c37755e8e"). InnerVolumeSpecName "kube-api-access-cttdz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 28 10:07:57.837494 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:07:57.837150    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/aa86ed4e-28cf-4607-831f-636c37755e8e-config-out" (OuterVolumeSpecName: "config-out") pod "aa86ed4e-28cf-4607-831f-636c37755e8e" (UID: "aa86ed4e-28cf-4607-831f-636c37755e8e"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 28 10:07:57.837494 ip-10-0-128-206 kubenswrapper[2565]: E0528 10:07:57.837151    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a17bde6119949d9a821a30187b2a4d3320c4a64081670b8f3f3c6e9e26bb4cad\": container with ID starting with a17bde6119949d9a821a30187b2a4d3320c4a64081670b8f3f3c6e9e26bb4cad not found: ID does not exist" containerID="a17bde6119949d9a821a30187b2a4d3320c4a64081670b8f3f3c6e9e26bb4cad"
May 28 10:07:57.837494 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:07:57.837190    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a17bde6119949d9a821a30187b2a4d3320c4a64081670b8f3f3c6e9e26bb4cad"} err="failed to get container status \"a17bde6119949d9a821a30187b2a4d3320c4a64081670b8f3f3c6e9e26bb4cad\": rpc error: code = NotFound desc = could not find container \"a17bde6119949d9a821a30187b2a4d3320c4a64081670b8f3f3c6e9e26bb4cad\": container with ID starting with a17bde6119949d9a821a30187b2a4d3320c4a64081670b8f3f3c6e9e26bb4cad not found: ID does not exist"
May 28 10:07:57.837494 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:07:57.837211    2565 scope.go:117] "RemoveContainer" containerID="106ed78a74bd942d79c71c9faf203e23dcb1dec2f5030779187c734b69207f96"
May 28 10:07:57.837494 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:07:57.837234    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/aa86ed4e-28cf-4607-831f-636c37755e8e-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "aa86ed4e-28cf-4607-831f-636c37755e8e" (UID: "aa86ed4e-28cf-4607-831f-636c37755e8e"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 28 10:07:57.837494 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:07:57.837388    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/aa86ed4e-28cf-4607-831f-636c37755e8e-secret-alertmanager-main-tls" (OuterVolumeSpecName: "secret-alertmanager-main-tls") pod "aa86ed4e-28cf-4607-831f-636c37755e8e" (UID: "aa86ed4e-28cf-4607-831f-636c37755e8e"). InnerVolumeSpecName "secret-alertmanager-main-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 28 10:07:57.838012 ip-10-0-128-206 kubenswrapper[2565]: E0528 10:07:57.837560    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"106ed78a74bd942d79c71c9faf203e23dcb1dec2f5030779187c734b69207f96\": container with ID starting with 106ed78a74bd942d79c71c9faf203e23dcb1dec2f5030779187c734b69207f96 not found: ID does not exist" containerID="106ed78a74bd942d79c71c9faf203e23dcb1dec2f5030779187c734b69207f96"
May 28 10:07:57.838012 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:07:57.837587    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"106ed78a74bd942d79c71c9faf203e23dcb1dec2f5030779187c734b69207f96"} err="failed to get container status \"106ed78a74bd942d79c71c9faf203e23dcb1dec2f5030779187c734b69207f96\": rpc error: code = NotFound desc = could not find container \"106ed78a74bd942d79c71c9faf203e23dcb1dec2f5030779187c734b69207f96\": container with ID starting with 106ed78a74bd942d79c71c9faf203e23dcb1dec2f5030779187c734b69207f96 not found: ID does not exist"
May 28 10:07:57.838012 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:07:57.837606    2565 scope.go:117] "RemoveContainer" containerID="4e6762546890ce97d726d186dcd97993d279d27e655272d52ff99a0419be00e1"
May 28 10:07:57.838012 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:07:57.837728    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/aa86ed4e-28cf-4607-831f-636c37755e8e-secret-alertmanager-kube-rbac-proxy" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy") pod "aa86ed4e-28cf-4607-831f-636c37755e8e" (UID: "aa86ed4e-28cf-4607-831f-636c37755e8e"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 28 10:07:57.838012 ip-10-0-128-206 kubenswrapper[2565]: E0528 10:07:57.837867    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4e6762546890ce97d726d186dcd97993d279d27e655272d52ff99a0419be00e1\": container with ID starting with 4e6762546890ce97d726d186dcd97993d279d27e655272d52ff99a0419be00e1 not found: ID does not exist" containerID="4e6762546890ce97d726d186dcd97993d279d27e655272d52ff99a0419be00e1"
May 28 10:07:57.838012 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:07:57.837893    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4e6762546890ce97d726d186dcd97993d279d27e655272d52ff99a0419be00e1"} err="failed to get container status \"4e6762546890ce97d726d186dcd97993d279d27e655272d52ff99a0419be00e1\": rpc error: code = NotFound desc = could not find container \"4e6762546890ce97d726d186dcd97993d279d27e655272d52ff99a0419be00e1\": container with ID starting with 4e6762546890ce97d726d186dcd97993d279d27e655272d52ff99a0419be00e1 not found: ID does not exist"
May 28 10:07:57.838012 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:07:57.837914    2565 scope.go:117] "RemoveContainer" containerID="7df2b853c1bf36133ff8b0666c5c41f39732f7b54e1eaa1241b13c5ce1fe0cb4"
May 28 10:07:57.838381 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:07:57.838015    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/aa86ed4e-28cf-4607-831f-636c37755e8e-secret-alertmanager-kube-rbac-proxy-metric" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-metric") pod "aa86ed4e-28cf-4607-831f-636c37755e8e" (UID: "aa86ed4e-28cf-4607-831f-636c37755e8e"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-metric". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 28 10:07:57.838381 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:07:57.838172    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7df2b853c1bf36133ff8b0666c5c41f39732f7b54e1eaa1241b13c5ce1fe0cb4"} err="failed to get container status \"7df2b853c1bf36133ff8b0666c5c41f39732f7b54e1eaa1241b13c5ce1fe0cb4\": rpc error: code = NotFound desc = could not find container \"7df2b853c1bf36133ff8b0666c5c41f39732f7b54e1eaa1241b13c5ce1fe0cb4\": container with ID starting with 7df2b853c1bf36133ff8b0666c5c41f39732f7b54e1eaa1241b13c5ce1fe0cb4 not found: ID does not exist"
May 28 10:07:57.838381 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:07:57.838205    2565 scope.go:117] "RemoveContainer" containerID="2c13740addf2d4d0b75278c925ba9edb173c7401a2b534ca6fd00a0dd2ac8529"
May 28 10:07:57.838513 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:07:57.838483    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2c13740addf2d4d0b75278c925ba9edb173c7401a2b534ca6fd00a0dd2ac8529"} err="failed to get container status \"2c13740addf2d4d0b75278c925ba9edb173c7401a2b534ca6fd00a0dd2ac8529\": rpc error: code = NotFound desc = could not find container \"2c13740addf2d4d0b75278c925ba9edb173c7401a2b534ca6fd00a0dd2ac8529\": container with ID starting with 2c13740addf2d4d0b75278c925ba9edb173c7401a2b534ca6fd00a0dd2ac8529 not found: ID does not exist"
May 28 10:07:57.838513 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:07:57.838508    2565 scope.go:117] "RemoveContainer" containerID="bc67439d755f0502090295bea567fa2766213b49ed82ead5bc769ff33b13dcc4"
May 28 10:07:57.838652 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:07:57.838622    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/aa86ed4e-28cf-4607-831f-636c37755e8e-secret-alertmanager-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-web") pod "aa86ed4e-28cf-4607-831f-636c37755e8e" (UID: "aa86ed4e-28cf-4607-831f-636c37755e8e"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 28 10:07:57.838801 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:07:57.838775    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bc67439d755f0502090295bea567fa2766213b49ed82ead5bc769ff33b13dcc4"} err="failed to get container status \"bc67439d755f0502090295bea567fa2766213b49ed82ead5bc769ff33b13dcc4\": rpc error: code = NotFound desc = could not find container \"bc67439d755f0502090295bea567fa2766213b49ed82ead5bc769ff33b13dcc4\": container with ID starting with bc67439d755f0502090295bea567fa2766213b49ed82ead5bc769ff33b13dcc4 not found: ID does not exist"
May 28 10:07:57.838877 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:07:57.838803    2565 scope.go:117] "RemoveContainer" containerID="20ae764ca415722c6c08f0794a5e7f4b2d648e0f37dd8c13f1782ceffad13b3c"
May 28 10:07:57.839053 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:07:57.839032    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"20ae764ca415722c6c08f0794a5e7f4b2d648e0f37dd8c13f1782ceffad13b3c"} err="failed to get container status \"20ae764ca415722c6c08f0794a5e7f4b2d648e0f37dd8c13f1782ceffad13b3c\": rpc error: code = NotFound desc = could not find container \"20ae764ca415722c6c08f0794a5e7f4b2d648e0f37dd8c13f1782ceffad13b3c\": container with ID starting with 20ae764ca415722c6c08f0794a5e7f4b2d648e0f37dd8c13f1782ceffad13b3c not found: ID does not exist"
May 28 10:07:57.839125 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:07:57.839054    2565 scope.go:117] "RemoveContainer" containerID="a17bde6119949d9a821a30187b2a4d3320c4a64081670b8f3f3c6e9e26bb4cad"
May 28 10:07:57.839265 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:07:57.839245    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a17bde6119949d9a821a30187b2a4d3320c4a64081670b8f3f3c6e9e26bb4cad"} err="failed to get container status \"a17bde6119949d9a821a30187b2a4d3320c4a64081670b8f3f3c6e9e26bb4cad\": rpc error: code = NotFound desc = could not find container \"a17bde6119949d9a821a30187b2a4d3320c4a64081670b8f3f3c6e9e26bb4cad\": container with ID starting with a17bde6119949d9a821a30187b2a4d3320c4a64081670b8f3f3c6e9e26bb4cad not found: ID does not exist"
May 28 10:07:57.839355 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:07:57.839266    2565 scope.go:117] "RemoveContainer" containerID="106ed78a74bd942d79c71c9faf203e23dcb1dec2f5030779187c734b69207f96"
May 28 10:07:57.839525 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:07:57.839500    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"106ed78a74bd942d79c71c9faf203e23dcb1dec2f5030779187c734b69207f96"} err="failed to get container status \"106ed78a74bd942d79c71c9faf203e23dcb1dec2f5030779187c734b69207f96\": rpc error: code = NotFound desc = could not find container \"106ed78a74bd942d79c71c9faf203e23dcb1dec2f5030779187c734b69207f96\": container with ID starting with 106ed78a74bd942d79c71c9faf203e23dcb1dec2f5030779187c734b69207f96 not found: ID does not exist"
May 28 10:07:57.839602 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:07:57.839532    2565 scope.go:117] "RemoveContainer" containerID="4e6762546890ce97d726d186dcd97993d279d27e655272d52ff99a0419be00e1"
May 28 10:07:57.839794 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:07:57.839766    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4e6762546890ce97d726d186dcd97993d279d27e655272d52ff99a0419be00e1"} err="failed to get container status \"4e6762546890ce97d726d186dcd97993d279d27e655272d52ff99a0419be00e1\": rpc error: code = NotFound desc = could not find container \"4e6762546890ce97d726d186dcd97993d279d27e655272d52ff99a0419be00e1\": container with ID starting with 4e6762546890ce97d726d186dcd97993d279d27e655272d52ff99a0419be00e1 not found: ID does not exist"
May 28 10:07:57.841735 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:07:57.841714    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/aa86ed4e-28cf-4607-831f-636c37755e8e-cluster-tls-config" (OuterVolumeSpecName: "cluster-tls-config") pod "aa86ed4e-28cf-4607-831f-636c37755e8e" (UID: "aa86ed4e-28cf-4607-831f-636c37755e8e"). InnerVolumeSpecName "cluster-tls-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 28 10:07:57.848378 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:07:57.848351    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/aa86ed4e-28cf-4607-831f-636c37755e8e-web-config" (OuterVolumeSpecName: "web-config") pod "aa86ed4e-28cf-4607-831f-636c37755e8e" (UID: "aa86ed4e-28cf-4607-831f-636c37755e8e"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 28 10:07:57.933913 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:07:57.933878    2565 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/aa86ed4e-28cf-4607-831f-636c37755e8e-secret-alertmanager-main-tls\") on node \"ip-10-0-128-206.ec2.internal\" DevicePath \"\""
May 28 10:07:57.933913 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:07:57.933908    2565 reconciler_common.go:299] "Volume detached for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/aa86ed4e-28cf-4607-831f-636c37755e8e-cluster-tls-config\") on node \"ip-10-0-128-206.ec2.internal\" DevicePath \"\""
May 28 10:07:57.933913 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:07:57.933917    2565 reconciler_common.go:299] "Volume detached for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/aa86ed4e-28cf-4607-831f-636c37755e8e-config-volume\") on node \"ip-10-0-128-206.ec2.internal\" DevicePath \"\""
May 28 10:07:57.934114 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:07:57.933927    2565 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/aa86ed4e-28cf-4607-831f-636c37755e8e-tls-assets\") on node \"ip-10-0-128-206.ec2.internal\" DevicePath \"\""
May 28 10:07:57.934114 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:07:57.933935    2565 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/aa86ed4e-28cf-4607-831f-636c37755e8e-web-config\") on node \"ip-10-0-128-206.ec2.internal\" DevicePath \"\""
May 28 10:07:57.934114 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:07:57.933944    2565 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/aa86ed4e-28cf-4607-831f-636c37755e8e-secret-alertmanager-kube-rbac-proxy-metric\") on node \"ip-10-0-128-206.ec2.internal\" DevicePath \"\""
May 28 10:07:57.934114 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:07:57.933953    2565 reconciler_common.go:299] "Volume detached for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/aa86ed4e-28cf-4607-831f-636c37755e8e-metrics-client-ca\") on node \"ip-10-0-128-206.ec2.internal\" DevicePath \"\""
May 28 10:07:57.934114 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:07:57.933960    2565 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/aa86ed4e-28cf-4607-831f-636c37755e8e-config-out\") on node \"ip-10-0-128-206.ec2.internal\" DevicePath \"\""
May 28 10:07:57.934114 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:07:57.933969    2565 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/aa86ed4e-28cf-4607-831f-636c37755e8e-secret-alertmanager-kube-rbac-proxy-web\") on node \"ip-10-0-128-206.ec2.internal\" DevicePath \"\""
May 28 10:07:57.934114 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:07:57.933978    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cttdz\" (UniqueName: \"kubernetes.io/projected/aa86ed4e-28cf-4607-831f-636c37755e8e-kube-api-access-cttdz\") on node \"ip-10-0-128-206.ec2.internal\" DevicePath \"\""
May 28 10:07:57.934114 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:07:57.933987    2565 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/aa86ed4e-28cf-4607-831f-636c37755e8e-secret-alertmanager-kube-rbac-proxy\") on node \"ip-10-0-128-206.ec2.internal\" DevicePath \"\""
May 28 10:07:58.111362 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:07:58.111302    2565 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
May 28 10:07:58.116329 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:07:58.116287    2565 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
May 28 10:07:59.153672 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:07:59.153640    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="aa86ed4e-28cf-4607-831f-636c37755e8e" path="/var/lib/kubelet/pods/aa86ed4e-28cf-4607-831f-636c37755e8e/volumes"
May 28 10:08:00.757386 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:08:00.757347    2565 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
May 28 10:08:00.758216 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:08:00.757991    2565 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="82289d40-b0b7-453a-b897-fc3b27d27a05" containerName="prometheus" containerID="cri-o://b095e35c844eedc456f25f913313d021ee03555fd82e80a24a7fe6391b1b7f7c" gracePeriod=600
May 28 10:08:00.758216 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:08:00.758011    2565 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="82289d40-b0b7-453a-b897-fc3b27d27a05" containerName="kube-rbac-proxy" containerID="cri-o://b156ff6daf6410de7588432d9d7859d54315988126e098fe881ac32a87c0c2e9" gracePeriod=600
May 28 10:08:00.758216 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:08:00.758042    2565 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="82289d40-b0b7-453a-b897-fc3b27d27a05" containerName="kube-rbac-proxy-thanos" containerID="cri-o://7a54eb7080dcac1e96f5aa1551d17c75c15da6832dc3f29b6bbe70ba15acecc7" gracePeriod=600
May 28 10:08:00.758216 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:08:00.758019    2565 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="82289d40-b0b7-453a-b897-fc3b27d27a05" containerName="thanos-sidecar" containerID="cri-o://cebef29c6393baaa10061563ca9387167aa5a18f6ea5fba3fdca4623bb1f2d2f" gracePeriod=600
May 28 10:08:00.758216 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:08:00.758052    2565 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="82289d40-b0b7-453a-b897-fc3b27d27a05" containerName="kube-rbac-proxy-web" containerID="cri-o://e0bf0228afb91ecd40f3359f9b4a50387a0ee53c6b0aac174dc12b10f1253325" gracePeriod=600
May 28 10:08:00.758216 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:08:00.758043    2565 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="82289d40-b0b7-453a-b897-fc3b27d27a05" containerName="config-reloader" containerID="cri-o://0685aa8a24fa1180379b68b768d056c0eaa132c4aa3a99fba82169446d2bb8e4" gracePeriod=600
May 28 10:08:01.009428 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:08:01.009343    2565 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
May 28 10:08:01.159739 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:08:01.159711    2565 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/82289d40-b0b7-453a-b897-fc3b27d27a05-prometheus-k8s-db\") pod \"82289d40-b0b7-453a-b897-fc3b27d27a05\" (UID: \"82289d40-b0b7-453a-b897-fc3b27d27a05\") "
May 28 10:08:01.159906 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:08:01.159755    2565 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tjbw5\" (UniqueName: \"kubernetes.io/projected/82289d40-b0b7-453a-b897-fc3b27d27a05-kube-api-access-tjbw5\") pod \"82289d40-b0b7-453a-b897-fc3b27d27a05\" (UID: \"82289d40-b0b7-453a-b897-fc3b27d27a05\") "
May 28 10:08:01.159906 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:08:01.159781    2565 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/82289d40-b0b7-453a-b897-fc3b27d27a05-configmap-metrics-client-ca\") pod \"82289d40-b0b7-453a-b897-fc3b27d27a05\" (UID: \"82289d40-b0b7-453a-b897-fc3b27d27a05\") "
May 28 10:08:01.159906 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:08:01.159811    2565 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/82289d40-b0b7-453a-b897-fc3b27d27a05-secret-grpc-tls\") pod \"82289d40-b0b7-453a-b897-fc3b27d27a05\" (UID: \"82289d40-b0b7-453a-b897-fc3b27d27a05\") "
May 28 10:08:01.159906 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:08:01.159834    2565 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/82289d40-b0b7-453a-b897-fc3b27d27a05-secret-kube-rbac-proxy\") pod \"82289d40-b0b7-453a-b897-fc3b27d27a05\" (UID: \"82289d40-b0b7-453a-b897-fc3b27d27a05\") "
May 28 10:08:01.159906 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:08:01.159858    2565 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/82289d40-b0b7-453a-b897-fc3b27d27a05-configmap-serving-certs-ca-bundle\") pod \"82289d40-b0b7-453a-b897-fc3b27d27a05\" (UID: \"82289d40-b0b7-453a-b897-fc3b27d27a05\") "
May 28 10:08:01.159906 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:08:01.159881    2565 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/82289d40-b0b7-453a-b897-fc3b27d27a05-secret-metrics-client-certs\") pod \"82289d40-b0b7-453a-b897-fc3b27d27a05\" (UID: \"82289d40-b0b7-453a-b897-fc3b27d27a05\") "
May 28 10:08:01.160199 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:08:01.159922    2565 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/82289d40-b0b7-453a-b897-fc3b27d27a05-prometheus-k8s-rulefiles-0\") pod \"82289d40-b0b7-453a-b897-fc3b27d27a05\" (UID: \"82289d40-b0b7-453a-b897-fc3b27d27a05\") "
May 28 10:08:01.160199 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:08:01.159946    2565 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/82289d40-b0b7-453a-b897-fc3b27d27a05-tls-assets\") pod \"82289d40-b0b7-453a-b897-fc3b27d27a05\" (UID: \"82289d40-b0b7-453a-b897-fc3b27d27a05\") "
May 28 10:08:01.160199 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:08:01.159977    2565 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/82289d40-b0b7-453a-b897-fc3b27d27a05-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"82289d40-b0b7-453a-b897-fc3b27d27a05\" (UID: \"82289d40-b0b7-453a-b897-fc3b27d27a05\") "
May 28 10:08:01.160199 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:08:01.160017    2565 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/82289d40-b0b7-453a-b897-fc3b27d27a05-config-out\") pod \"82289d40-b0b7-453a-b897-fc3b27d27a05\" (UID: \"82289d40-b0b7-453a-b897-fc3b27d27a05\") "
May 28 10:08:01.160199 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:08:01.160045    2565 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/82289d40-b0b7-453a-b897-fc3b27d27a05-config\") pod \"82289d40-b0b7-453a-b897-fc3b27d27a05\" (UID: \"82289d40-b0b7-453a-b897-fc3b27d27a05\") "
May 28 10:08:01.160199 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:08:01.160079    2565 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/82289d40-b0b7-453a-b897-fc3b27d27a05-configmap-kubelet-serving-ca-bundle\") pod \"82289d40-b0b7-453a-b897-fc3b27d27a05\" (UID: \"82289d40-b0b7-453a-b897-fc3b27d27a05\") "
May 28 10:08:01.160199 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:08:01.160124    2565 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/82289d40-b0b7-453a-b897-fc3b27d27a05-secret-prometheus-k8s-tls\") pod \"82289d40-b0b7-453a-b897-fc3b27d27a05\" (UID: \"82289d40-b0b7-453a-b897-fc3b27d27a05\") "
May 28 10:08:01.160199 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:08:01.160167    2565 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/82289d40-b0b7-453a-b897-fc3b27d27a05-web-config\") pod \"82289d40-b0b7-453a-b897-fc3b27d27a05\" (UID: \"82289d40-b0b7-453a-b897-fc3b27d27a05\") "
May 28 10:08:01.160600 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:08:01.160198    2565 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/82289d40-b0b7-453a-b897-fc3b27d27a05-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"82289d40-b0b7-453a-b897-fc3b27d27a05\" (UID: \"82289d40-b0b7-453a-b897-fc3b27d27a05\") "
May 28 10:08:01.160600 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:08:01.160229    2565 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/82289d40-b0b7-453a-b897-fc3b27d27a05-thanos-prometheus-http-client-file\") pod \"82289d40-b0b7-453a-b897-fc3b27d27a05\" (UID: \"82289d40-b0b7-453a-b897-fc3b27d27a05\") "
May 28 10:08:01.160600 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:08:01.160231    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/82289d40-b0b7-453a-b897-fc3b27d27a05-configmap-metrics-client-ca" (OuterVolumeSpecName: "configmap-metrics-client-ca") pod "82289d40-b0b7-453a-b897-fc3b27d27a05" (UID: "82289d40-b0b7-453a-b897-fc3b27d27a05"). InnerVolumeSpecName "configmap-metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 28 10:08:01.160600 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:08:01.160235    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/82289d40-b0b7-453a-b897-fc3b27d27a05-configmap-serving-certs-ca-bundle" (OuterVolumeSpecName: "configmap-serving-certs-ca-bundle") pod "82289d40-b0b7-453a-b897-fc3b27d27a05" (UID: "82289d40-b0b7-453a-b897-fc3b27d27a05"). InnerVolumeSpecName "configmap-serving-certs-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 28 10:08:01.160600 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:08:01.160295    2565 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/82289d40-b0b7-453a-b897-fc3b27d27a05-prometheus-trusted-ca-bundle\") pod \"82289d40-b0b7-453a-b897-fc3b27d27a05\" (UID: \"82289d40-b0b7-453a-b897-fc3b27d27a05\") "
May 28 10:08:01.160600 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:08:01.160508    2565 reconciler_common.go:299] "Volume detached for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/82289d40-b0b7-453a-b897-fc3b27d27a05-configmap-metrics-client-ca\") on node \"ip-10-0-128-206.ec2.internal\" DevicePath \"\""
May 28 10:08:01.160600 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:08:01.160530    2565 reconciler_common.go:299] "Volume detached for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/82289d40-b0b7-453a-b897-fc3b27d27a05-configmap-serving-certs-ca-bundle\") on node \"ip-10-0-128-206.ec2.internal\" DevicePath \"\""
May 28 10:08:01.161127 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:08:01.161094    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/82289d40-b0b7-453a-b897-fc3b27d27a05-prometheus-k8s-db" (OuterVolumeSpecName: "prometheus-k8s-db") pod "82289d40-b0b7-453a-b897-fc3b27d27a05" (UID: "82289d40-b0b7-453a-b897-fc3b27d27a05"). InnerVolumeSpecName "prometheus-k8s-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 28 10:08:01.161344 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:08:01.161293    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/82289d40-b0b7-453a-b897-fc3b27d27a05-prometheus-trusted-ca-bundle" (OuterVolumeSpecName: "prometheus-trusted-ca-bundle") pod "82289d40-b0b7-453a-b897-fc3b27d27a05" (UID: "82289d40-b0b7-453a-b897-fc3b27d27a05"). InnerVolumeSpecName "prometheus-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 28 10:08:01.162749 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:08:01.162587    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/82289d40-b0b7-453a-b897-fc3b27d27a05-prometheus-k8s-rulefiles-0" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-0") pod "82289d40-b0b7-453a-b897-fc3b27d27a05" (UID: "82289d40-b0b7-453a-b897-fc3b27d27a05"). InnerVolumeSpecName "prometheus-k8s-rulefiles-0". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 28 10:08:01.162963 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:08:01.162893    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/82289d40-b0b7-453a-b897-fc3b27d27a05-kube-api-access-tjbw5" (OuterVolumeSpecName: "kube-api-access-tjbw5") pod "82289d40-b0b7-453a-b897-fc3b27d27a05" (UID: "82289d40-b0b7-453a-b897-fc3b27d27a05"). InnerVolumeSpecName "kube-api-access-tjbw5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 28 10:08:01.162963 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:08:01.162939    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/82289d40-b0b7-453a-b897-fc3b27d27a05-secret-grpc-tls" (OuterVolumeSpecName: "secret-grpc-tls") pod "82289d40-b0b7-453a-b897-fc3b27d27a05" (UID: "82289d40-b0b7-453a-b897-fc3b27d27a05"). InnerVolumeSpecName "secret-grpc-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 28 10:08:01.163134 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:08:01.163063    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/82289d40-b0b7-453a-b897-fc3b27d27a05-secret-kube-rbac-proxy" (OuterVolumeSpecName: "secret-kube-rbac-proxy") pod "82289d40-b0b7-453a-b897-fc3b27d27a05" (UID: "82289d40-b0b7-453a-b897-fc3b27d27a05"). InnerVolumeSpecName "secret-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 28 10:08:01.163784 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:08:01.163754    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/82289d40-b0b7-453a-b897-fc3b27d27a05-configmap-kubelet-serving-ca-bundle" (OuterVolumeSpecName: "configmap-kubelet-serving-ca-bundle") pod "82289d40-b0b7-453a-b897-fc3b27d27a05" (UID: "82289d40-b0b7-453a-b897-fc3b27d27a05"). InnerVolumeSpecName "configmap-kubelet-serving-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 28 10:08:01.164169 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:08:01.164129    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/82289d40-b0b7-453a-b897-fc3b27d27a05-config-out" (OuterVolumeSpecName: "config-out") pod "82289d40-b0b7-453a-b897-fc3b27d27a05" (UID: "82289d40-b0b7-453a-b897-fc3b27d27a05"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 28 10:08:01.164392 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:08:01.164361    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/82289d40-b0b7-453a-b897-fc3b27d27a05-secret-prometheus-k8s-thanos-sidecar-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-thanos-sidecar-tls") pod "82289d40-b0b7-453a-b897-fc3b27d27a05" (UID: "82289d40-b0b7-453a-b897-fc3b27d27a05"). InnerVolumeSpecName "secret-prometheus-k8s-thanos-sidecar-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 28 10:08:01.164595 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:08:01.164555    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/82289d40-b0b7-453a-b897-fc3b27d27a05-secret-prometheus-k8s-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-tls") pod "82289d40-b0b7-453a-b897-fc3b27d27a05" (UID: "82289d40-b0b7-453a-b897-fc3b27d27a05"). InnerVolumeSpecName "secret-prometheus-k8s-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 28 10:08:01.164879 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:08:01.164860    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/82289d40-b0b7-453a-b897-fc3b27d27a05-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "82289d40-b0b7-453a-b897-fc3b27d27a05" (UID: "82289d40-b0b7-453a-b897-fc3b27d27a05"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 28 10:08:01.165038 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:08:01.165014    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/82289d40-b0b7-453a-b897-fc3b27d27a05-secret-metrics-client-certs" (OuterVolumeSpecName: "secret-metrics-client-certs") pod "82289d40-b0b7-453a-b897-fc3b27d27a05" (UID: "82289d40-b0b7-453a-b897-fc3b27d27a05"). InnerVolumeSpecName "secret-metrics-client-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 28 10:08:01.165091 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:08:01.165059    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/82289d40-b0b7-453a-b897-fc3b27d27a05-thanos-prometheus-http-client-file" (OuterVolumeSpecName: "thanos-prometheus-http-client-file") pod "82289d40-b0b7-453a-b897-fc3b27d27a05" (UID: "82289d40-b0b7-453a-b897-fc3b27d27a05"). InnerVolumeSpecName "thanos-prometheus-http-client-file". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 28 10:08:01.165562 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:08:01.165546    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/82289d40-b0b7-453a-b897-fc3b27d27a05-secret-prometheus-k8s-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-prometheus-k8s-kube-rbac-proxy-web") pod "82289d40-b0b7-453a-b897-fc3b27d27a05" (UID: "82289d40-b0b7-453a-b897-fc3b27d27a05"). InnerVolumeSpecName "secret-prometheus-k8s-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 28 10:08:01.166174 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:08:01.166161    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/82289d40-b0b7-453a-b897-fc3b27d27a05-config" (OuterVolumeSpecName: "config") pod "82289d40-b0b7-453a-b897-fc3b27d27a05" (UID: "82289d40-b0b7-453a-b897-fc3b27d27a05"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 28 10:08:01.174072 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:08:01.174048    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/82289d40-b0b7-453a-b897-fc3b27d27a05-web-config" (OuterVolumeSpecName: "web-config") pod "82289d40-b0b7-453a-b897-fc3b27d27a05" (UID: "82289d40-b0b7-453a-b897-fc3b27d27a05"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 28 10:08:01.261397 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:08:01.261273    2565 reconciler_common.go:299] "Volume detached for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/82289d40-b0b7-453a-b897-fc3b27d27a05-thanos-prometheus-http-client-file\") on node \"ip-10-0-128-206.ec2.internal\" DevicePath \"\""
May 28 10:08:01.261397 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:08:01.261338    2565 reconciler_common.go:299] "Volume detached for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/82289d40-b0b7-453a-b897-fc3b27d27a05-prometheus-trusted-ca-bundle\") on node \"ip-10-0-128-206.ec2.internal\" DevicePath \"\""
May 28 10:08:01.261397 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:08:01.261355    2565 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/82289d40-b0b7-453a-b897-fc3b27d27a05-prometheus-k8s-db\") on node \"ip-10-0-128-206.ec2.internal\" DevicePath \"\""
May 28 10:08:01.261397 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:08:01.261367    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tjbw5\" (UniqueName: \"kubernetes.io/projected/82289d40-b0b7-453a-b897-fc3b27d27a05-kube-api-access-tjbw5\") on node \"ip-10-0-128-206.ec2.internal\" DevicePath \"\""
May 28 10:08:01.261397 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:08:01.261379    2565 reconciler_common.go:299] "Volume detached for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/82289d40-b0b7-453a-b897-fc3b27d27a05-secret-grpc-tls\") on node \"ip-10-0-128-206.ec2.internal\" DevicePath \"\""
May 28 10:08:01.261397 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:08:01.261394    2565 reconciler_common.go:299] "Volume detached for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/82289d40-b0b7-453a-b897-fc3b27d27a05-secret-kube-rbac-proxy\") on node \"ip-10-0-128-206.ec2.internal\" DevicePath \"\""
May 28 10:08:01.261714 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:08:01.261407    2565 reconciler_common.go:299] "Volume detached for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/82289d40-b0b7-453a-b897-fc3b27d27a05-secret-metrics-client-certs\") on node \"ip-10-0-128-206.ec2.internal\" DevicePath \"\""
May 28 10:08:01.261714 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:08:01.261420    2565 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/82289d40-b0b7-453a-b897-fc3b27d27a05-prometheus-k8s-rulefiles-0\") on node \"ip-10-0-128-206.ec2.internal\" DevicePath \"\""
May 28 10:08:01.261714 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:08:01.261432    2565 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/82289d40-b0b7-453a-b897-fc3b27d27a05-tls-assets\") on node \"ip-10-0-128-206.ec2.internal\" DevicePath \"\""
May 28 10:08:01.261714 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:08:01.261444    2565 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/82289d40-b0b7-453a-b897-fc3b27d27a05-secret-prometheus-k8s-thanos-sidecar-tls\") on node \"ip-10-0-128-206.ec2.internal\" DevicePath \"\""
May 28 10:08:01.261714 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:08:01.261455    2565 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/82289d40-b0b7-453a-b897-fc3b27d27a05-config-out\") on node \"ip-10-0-128-206.ec2.internal\" DevicePath \"\""
May 28 10:08:01.261714 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:08:01.261468    2565 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/82289d40-b0b7-453a-b897-fc3b27d27a05-config\") on node \"ip-10-0-128-206.ec2.internal\" DevicePath \"\""
May 28 10:08:01.261714 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:08:01.261480    2565 reconciler_common.go:299] "Volume detached for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/82289d40-b0b7-453a-b897-fc3b27d27a05-configmap-kubelet-serving-ca-bundle\") on node \"ip-10-0-128-206.ec2.internal\" DevicePath \"\""
May 28 10:08:01.261714 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:08:01.261493    2565 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/82289d40-b0b7-453a-b897-fc3b27d27a05-secret-prometheus-k8s-tls\") on node \"ip-10-0-128-206.ec2.internal\" DevicePath \"\""
May 28 10:08:01.261714 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:08:01.261506    2565 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/82289d40-b0b7-453a-b897-fc3b27d27a05-web-config\") on node \"ip-10-0-128-206.ec2.internal\" DevicePath \"\""
May 28 10:08:01.261714 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:08:01.261519    2565 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/82289d40-b0b7-453a-b897-fc3b27d27a05-secret-prometheus-k8s-kube-rbac-proxy-web\") on node \"ip-10-0-128-206.ec2.internal\" DevicePath \"\""
May 28 10:08:01.800895 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:08:01.800864    2565 generic.go:358] "Generic (PLEG): container finished" podID="82289d40-b0b7-453a-b897-fc3b27d27a05" containerID="7a54eb7080dcac1e96f5aa1551d17c75c15da6832dc3f29b6bbe70ba15acecc7" exitCode=0
May 28 10:08:01.800895 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:08:01.800889    2565 generic.go:358] "Generic (PLEG): container finished" podID="82289d40-b0b7-453a-b897-fc3b27d27a05" containerID="b156ff6daf6410de7588432d9d7859d54315988126e098fe881ac32a87c0c2e9" exitCode=0
May 28 10:08:01.800895 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:08:01.800895    2565 generic.go:358] "Generic (PLEG): container finished" podID="82289d40-b0b7-453a-b897-fc3b27d27a05" containerID="e0bf0228afb91ecd40f3359f9b4a50387a0ee53c6b0aac174dc12b10f1253325" exitCode=0
May 28 10:08:01.800895 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:08:01.800901    2565 generic.go:358] "Generic (PLEG): container finished" podID="82289d40-b0b7-453a-b897-fc3b27d27a05" containerID="cebef29c6393baaa10061563ca9387167aa5a18f6ea5fba3fdca4623bb1f2d2f" exitCode=0
May 28 10:08:01.800895 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:08:01.800906    2565 generic.go:358] "Generic (PLEG): container finished" podID="82289d40-b0b7-453a-b897-fc3b27d27a05" containerID="0685aa8a24fa1180379b68b768d056c0eaa132c4aa3a99fba82169446d2bb8e4" exitCode=0
May 28 10:08:01.801482 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:08:01.800911    2565 generic.go:358] "Generic (PLEG): container finished" podID="82289d40-b0b7-453a-b897-fc3b27d27a05" containerID="b095e35c844eedc456f25f913313d021ee03555fd82e80a24a7fe6391b1b7f7c" exitCode=0
May 28 10:08:01.801482 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:08:01.800953    2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"82289d40-b0b7-453a-b897-fc3b27d27a05","Type":"ContainerDied","Data":"7a54eb7080dcac1e96f5aa1551d17c75c15da6832dc3f29b6bbe70ba15acecc7"}
May 28 10:08:01.801482 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:08:01.800977    2565 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
May 28 10:08:01.801482 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:08:01.800998    2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"82289d40-b0b7-453a-b897-fc3b27d27a05","Type":"ContainerDied","Data":"b156ff6daf6410de7588432d9d7859d54315988126e098fe881ac32a87c0c2e9"}
May 28 10:08:01.801482 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:08:01.801018    2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"82289d40-b0b7-453a-b897-fc3b27d27a05","Type":"ContainerDied","Data":"e0bf0228afb91ecd40f3359f9b4a50387a0ee53c6b0aac174dc12b10f1253325"}
May 28 10:08:01.801482 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:08:01.801030    2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"82289d40-b0b7-453a-b897-fc3b27d27a05","Type":"ContainerDied","Data":"cebef29c6393baaa10061563ca9387167aa5a18f6ea5fba3fdca4623bb1f2d2f"}
May 28 10:08:01.801482 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:08:01.801043    2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"82289d40-b0b7-453a-b897-fc3b27d27a05","Type":"ContainerDied","Data":"0685aa8a24fa1180379b68b768d056c0eaa132c4aa3a99fba82169446d2bb8e4"}
May 28 10:08:01.801482 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:08:01.801057    2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"82289d40-b0b7-453a-b897-fc3b27d27a05","Type":"ContainerDied","Data":"b095e35c844eedc456f25f913313d021ee03555fd82e80a24a7fe6391b1b7f7c"}
May 28 10:08:01.801482 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:08:01.801065    2565 scope.go:117] "RemoveContainer" containerID="7a54eb7080dcac1e96f5aa1551d17c75c15da6832dc3f29b6bbe70ba15acecc7"
May 28 10:08:01.801482 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:08:01.801070    2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"82289d40-b0b7-453a-b897-fc3b27d27a05","Type":"ContainerDied","Data":"4f56f3ac6332be5575d60a39df3386e27597f5a337385dd144b5df1c3a255a58"}
May 28 10:08:01.809201 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:08:01.809181    2565 scope.go:117] "RemoveContainer" containerID="b156ff6daf6410de7588432d9d7859d54315988126e098fe881ac32a87c0c2e9"
May 28 10:08:01.817869 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:08:01.817420    2565 scope.go:117] "RemoveContainer" containerID="e0bf0228afb91ecd40f3359f9b4a50387a0ee53c6b0aac174dc12b10f1253325"
May 28 10:08:01.824331 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:08:01.824291    2565 scope.go:117] "RemoveContainer" containerID="cebef29c6393baaa10061563ca9387167aa5a18f6ea5fba3fdca4623bb1f2d2f"
May 28 10:08:01.831017 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:08:01.830992    2565 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
May 28 10:08:01.832127 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:08:01.832097    2565 scope.go:117] "RemoveContainer" containerID="0685aa8a24fa1180379b68b768d056c0eaa132c4aa3a99fba82169446d2bb8e4"
May 28 10:08:01.833967 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:08:01.833945    2565 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
May 28 10:08:01.839110 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:08:01.839094    2565 scope.go:117] "RemoveContainer" containerID="b095e35c844eedc456f25f913313d021ee03555fd82e80a24a7fe6391b1b7f7c"
May 28 10:08:01.845842 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:08:01.845826    2565 scope.go:117] "RemoveContainer" containerID="4246f4e1b055275c098570c985011faf09b731de78574b74c2333e17ba449fdb"
May 28 10:08:01.852092 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:08:01.852076    2565 scope.go:117] "RemoveContainer" containerID="7a54eb7080dcac1e96f5aa1551d17c75c15da6832dc3f29b6bbe70ba15acecc7"
May 28 10:08:01.852352 ip-10-0-128-206 kubenswrapper[2565]: E0528 10:08:01.852325    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7a54eb7080dcac1e96f5aa1551d17c75c15da6832dc3f29b6bbe70ba15acecc7\": container with ID starting with 7a54eb7080dcac1e96f5aa1551d17c75c15da6832dc3f29b6bbe70ba15acecc7 not found: ID does not exist" containerID="7a54eb7080dcac1e96f5aa1551d17c75c15da6832dc3f29b6bbe70ba15acecc7"
May 28 10:08:01.852443 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:08:01.852365    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7a54eb7080dcac1e96f5aa1551d17c75c15da6832dc3f29b6bbe70ba15acecc7"} err="failed to get container status \"7a54eb7080dcac1e96f5aa1551d17c75c15da6832dc3f29b6bbe70ba15acecc7\": rpc error: code = NotFound desc = could not find container \"7a54eb7080dcac1e96f5aa1551d17c75c15da6832dc3f29b6bbe70ba15acecc7\": container with ID starting with 7a54eb7080dcac1e96f5aa1551d17c75c15da6832dc3f29b6bbe70ba15acecc7 not found: ID does not exist"
May 28 10:08:01.852443 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:08:01.852385    2565 scope.go:117] "RemoveContainer" containerID="b156ff6daf6410de7588432d9d7859d54315988126e098fe881ac32a87c0c2e9"
May 28 10:08:01.852647 ip-10-0-128-206 kubenswrapper[2565]: E0528 10:08:01.852627    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b156ff6daf6410de7588432d9d7859d54315988126e098fe881ac32a87c0c2e9\": container with ID starting with b156ff6daf6410de7588432d9d7859d54315988126e098fe881ac32a87c0c2e9 not found: ID does not exist" containerID="b156ff6daf6410de7588432d9d7859d54315988126e098fe881ac32a87c0c2e9"
May 28 10:08:01.852690 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:08:01.852651    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b156ff6daf6410de7588432d9d7859d54315988126e098fe881ac32a87c0c2e9"} err="failed to get container status \"b156ff6daf6410de7588432d9d7859d54315988126e098fe881ac32a87c0c2e9\": rpc error: code = NotFound desc = could not find container \"b156ff6daf6410de7588432d9d7859d54315988126e098fe881ac32a87c0c2e9\": container with ID starting with b156ff6daf6410de7588432d9d7859d54315988126e098fe881ac32a87c0c2e9 not found: ID does not exist"
May 28 10:08:01.852690 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:08:01.852665    2565 scope.go:117] "RemoveContainer" containerID="e0bf0228afb91ecd40f3359f9b4a50387a0ee53c6b0aac174dc12b10f1253325"
May 28 10:08:01.852876 ip-10-0-128-206 kubenswrapper[2565]: E0528 10:08:01.852862    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e0bf0228afb91ecd40f3359f9b4a50387a0ee53c6b0aac174dc12b10f1253325\": container with ID starting with e0bf0228afb91ecd40f3359f9b4a50387a0ee53c6b0aac174dc12b10f1253325 not found: ID does not exist" containerID="e0bf0228afb91ecd40f3359f9b4a50387a0ee53c6b0aac174dc12b10f1253325"
May 28 10:08:01.852916 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:08:01.852880    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e0bf0228afb91ecd40f3359f9b4a50387a0ee53c6b0aac174dc12b10f1253325"} err="failed to get container status \"e0bf0228afb91ecd40f3359f9b4a50387a0ee53c6b0aac174dc12b10f1253325\": rpc error: code = NotFound desc = could not find container \"e0bf0228afb91ecd40f3359f9b4a50387a0ee53c6b0aac174dc12b10f1253325\": container with ID starting with e0bf0228afb91ecd40f3359f9b4a50387a0ee53c6b0aac174dc12b10f1253325 not found: ID does not exist"
May 28 10:08:01.852916 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:08:01.852891    2565 scope.go:117] "RemoveContainer" containerID="cebef29c6393baaa10061563ca9387167aa5a18f6ea5fba3fdca4623bb1f2d2f"
May 28 10:08:01.853097 ip-10-0-128-206 kubenswrapper[2565]: E0528 10:08:01.853079    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cebef29c6393baaa10061563ca9387167aa5a18f6ea5fba3fdca4623bb1f2d2f\": container with ID starting with cebef29c6393baaa10061563ca9387167aa5a18f6ea5fba3fdca4623bb1f2d2f not found: ID does not exist" containerID="cebef29c6393baaa10061563ca9387167aa5a18f6ea5fba3fdca4623bb1f2d2f"
May 28 10:08:01.853131 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:08:01.853103    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cebef29c6393baaa10061563ca9387167aa5a18f6ea5fba3fdca4623bb1f2d2f"} err="failed to get container status \"cebef29c6393baaa10061563ca9387167aa5a18f6ea5fba3fdca4623bb1f2d2f\": rpc error: code = NotFound desc = could not find container \"cebef29c6393baaa10061563ca9387167aa5a18f6ea5fba3fdca4623bb1f2d2f\": container with ID starting with cebef29c6393baaa10061563ca9387167aa5a18f6ea5fba3fdca4623bb1f2d2f not found: ID does not exist"
May 28 10:08:01.853131 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:08:01.853119    2565 scope.go:117] "RemoveContainer" containerID="0685aa8a24fa1180379b68b768d056c0eaa132c4aa3a99fba82169446d2bb8e4"
May 28 10:08:01.853379 ip-10-0-128-206 kubenswrapper[2565]: E0528 10:08:01.853354    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0685aa8a24fa1180379b68b768d056c0eaa132c4aa3a99fba82169446d2bb8e4\": container with ID starting with 0685aa8a24fa1180379b68b768d056c0eaa132c4aa3a99fba82169446d2bb8e4 not found: ID does not exist" containerID="0685aa8a24fa1180379b68b768d056c0eaa132c4aa3a99fba82169446d2bb8e4"
May 28 10:08:01.853468 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:08:01.853380    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0685aa8a24fa1180379b68b768d056c0eaa132c4aa3a99fba82169446d2bb8e4"} err="failed to get container status \"0685aa8a24fa1180379b68b768d056c0eaa132c4aa3a99fba82169446d2bb8e4\": rpc error: code = NotFound desc = could not find container \"0685aa8a24fa1180379b68b768d056c0eaa132c4aa3a99fba82169446d2bb8e4\": container with ID starting with 0685aa8a24fa1180379b68b768d056c0eaa132c4aa3a99fba82169446d2bb8e4 not found: ID does not exist"
May 28 10:08:01.853468 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:08:01.853398    2565 scope.go:117] "RemoveContainer" containerID="b095e35c844eedc456f25f913313d021ee03555fd82e80a24a7fe6391b1b7f7c"
May 28 10:08:01.853606 ip-10-0-128-206 kubenswrapper[2565]: E0528 10:08:01.853592    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b095e35c844eedc456f25f913313d021ee03555fd82e80a24a7fe6391b1b7f7c\": container with ID starting with b095e35c844eedc456f25f913313d021ee03555fd82e80a24a7fe6391b1b7f7c not found: ID does not exist" containerID="b095e35c844eedc456f25f913313d021ee03555fd82e80a24a7fe6391b1b7f7c"
May 28 10:08:01.853644 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:08:01.853609    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b095e35c844eedc456f25f913313d021ee03555fd82e80a24a7fe6391b1b7f7c"} err="failed to get container status \"b095e35c844eedc456f25f913313d021ee03555fd82e80a24a7fe6391b1b7f7c\": rpc error: code = NotFound desc = could not find container \"b095e35c844eedc456f25f913313d021ee03555fd82e80a24a7fe6391b1b7f7c\": container with ID starting with b095e35c844eedc456f25f913313d021ee03555fd82e80a24a7fe6391b1b7f7c not found: ID does not exist"
May 28 10:08:01.853644 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:08:01.853622    2565 scope.go:117] "RemoveContainer" containerID="4246f4e1b055275c098570c985011faf09b731de78574b74c2333e17ba449fdb"
May 28 10:08:01.853816 ip-10-0-128-206 kubenswrapper[2565]: E0528 10:08:01.853802    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4246f4e1b055275c098570c985011faf09b731de78574b74c2333e17ba449fdb\": container with ID starting with 4246f4e1b055275c098570c985011faf09b731de78574b74c2333e17ba449fdb not found: ID does not exist" containerID="4246f4e1b055275c098570c985011faf09b731de78574b74c2333e17ba449fdb"
May 28 10:08:01.853859 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:08:01.853818    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4246f4e1b055275c098570c985011faf09b731de78574b74c2333e17ba449fdb"} err="failed to get container status \"4246f4e1b055275c098570c985011faf09b731de78574b74c2333e17ba449fdb\": rpc error: code = NotFound desc = could not find container \"4246f4e1b055275c098570c985011faf09b731de78574b74c2333e17ba449fdb\": container with ID starting with 4246f4e1b055275c098570c985011faf09b731de78574b74c2333e17ba449fdb not found: ID does not exist"
May 28 10:08:01.853859 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:08:01.853829    2565 scope.go:117] "RemoveContainer" containerID="7a54eb7080dcac1e96f5aa1551d17c75c15da6832dc3f29b6bbe70ba15acecc7"
May 28 10:08:01.853994 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:08:01.853979    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7a54eb7080dcac1e96f5aa1551d17c75c15da6832dc3f29b6bbe70ba15acecc7"} err="failed to get container status \"7a54eb7080dcac1e96f5aa1551d17c75c15da6832dc3f29b6bbe70ba15acecc7\": rpc error: code = NotFound desc = could not find container \"7a54eb7080dcac1e96f5aa1551d17c75c15da6832dc3f29b6bbe70ba15acecc7\": container with ID starting with 7a54eb7080dcac1e96f5aa1551d17c75c15da6832dc3f29b6bbe70ba15acecc7 not found: ID does not exist"
May 28 10:08:01.854042 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:08:01.853994    2565 scope.go:117] "RemoveContainer" containerID="b156ff6daf6410de7588432d9d7859d54315988126e098fe881ac32a87c0c2e9"
May 28 10:08:01.854157 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:08:01.854143    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b156ff6daf6410de7588432d9d7859d54315988126e098fe881ac32a87c0c2e9"} err="failed to get container status \"b156ff6daf6410de7588432d9d7859d54315988126e098fe881ac32a87c0c2e9\": rpc error: code = NotFound desc = could not find container \"b156ff6daf6410de7588432d9d7859d54315988126e098fe881ac32a87c0c2e9\": container with ID starting with b156ff6daf6410de7588432d9d7859d54315988126e098fe881ac32a87c0c2e9 not found: ID does not exist"
May 28 10:08:01.854205 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:08:01.854156    2565 scope.go:117] "RemoveContainer" containerID="e0bf0228afb91ecd40f3359f9b4a50387a0ee53c6b0aac174dc12b10f1253325"
May 28 10:08:01.854342 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:08:01.854305    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e0bf0228afb91ecd40f3359f9b4a50387a0ee53c6b0aac174dc12b10f1253325"} err="failed to get container status \"e0bf0228afb91ecd40f3359f9b4a50387a0ee53c6b0aac174dc12b10f1253325\": rpc error: code = NotFound desc = could not find container \"e0bf0228afb91ecd40f3359f9b4a50387a0ee53c6b0aac174dc12b10f1253325\": container with ID starting with e0bf0228afb91ecd40f3359f9b4a50387a0ee53c6b0aac174dc12b10f1253325 not found: ID does not exist"
May 28 10:08:01.854393 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:08:01.854342    2565 scope.go:117] "RemoveContainer" containerID="cebef29c6393baaa10061563ca9387167aa5a18f6ea5fba3fdca4623bb1f2d2f"
May 28 10:08:01.854506 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:08:01.854492    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cebef29c6393baaa10061563ca9387167aa5a18f6ea5fba3fdca4623bb1f2d2f"} err="failed to get container status \"cebef29c6393baaa10061563ca9387167aa5a18f6ea5fba3fdca4623bb1f2d2f\": rpc error: code = NotFound desc = could not find container \"cebef29c6393baaa10061563ca9387167aa5a18f6ea5fba3fdca4623bb1f2d2f\": container with ID starting with cebef29c6393baaa10061563ca9387167aa5a18f6ea5fba3fdca4623bb1f2d2f not found: ID does not exist"
May 28 10:08:01.854553 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:08:01.854506    2565 scope.go:117] "RemoveContainer" containerID="0685aa8a24fa1180379b68b768d056c0eaa132c4aa3a99fba82169446d2bb8e4"
May 28 10:08:01.854686 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:08:01.854671    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0685aa8a24fa1180379b68b768d056c0eaa132c4aa3a99fba82169446d2bb8e4"} err="failed to get container status \"0685aa8a24fa1180379b68b768d056c0eaa132c4aa3a99fba82169446d2bb8e4\": rpc error: code = NotFound desc = could not find container \"0685aa8a24fa1180379b68b768d056c0eaa132c4aa3a99fba82169446d2bb8e4\": container with ID starting with 0685aa8a24fa1180379b68b768d056c0eaa132c4aa3a99fba82169446d2bb8e4 not found: ID does not exist"
May 28 10:08:01.854733 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:08:01.854686    2565 scope.go:117] "RemoveContainer" containerID="b095e35c844eedc456f25f913313d021ee03555fd82e80a24a7fe6391b1b7f7c"
May 28 10:08:01.854846 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:08:01.854833    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b095e35c844eedc456f25f913313d021ee03555fd82e80a24a7fe6391b1b7f7c"} err="failed to get container status \"b095e35c844eedc456f25f913313d021ee03555fd82e80a24a7fe6391b1b7f7c\": rpc error: code = NotFound desc = could not find container \"b095e35c844eedc456f25f913313d021ee03555fd82e80a24a7fe6391b1b7f7c\": container with ID starting with b095e35c844eedc456f25f913313d021ee03555fd82e80a24a7fe6391b1b7f7c not found: ID does not exist"
May 28 10:08:01.854887 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:08:01.854846    2565 scope.go:117] "RemoveContainer" containerID="4246f4e1b055275c098570c985011faf09b731de78574b74c2333e17ba449fdb"
May 28 10:08:01.855010 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:08:01.854996    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4246f4e1b055275c098570c985011faf09b731de78574b74c2333e17ba449fdb"} err="failed to get container status \"4246f4e1b055275c098570c985011faf09b731de78574b74c2333e17ba449fdb\": rpc error: code = NotFound desc = could not find container \"4246f4e1b055275c098570c985011faf09b731de78574b74c2333e17ba449fdb\": container with ID starting with 4246f4e1b055275c098570c985011faf09b731de78574b74c2333e17ba449fdb not found: ID does not exist"
May 28 10:08:01.855054 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:08:01.855010    2565 scope.go:117] "RemoveContainer" containerID="7a54eb7080dcac1e96f5aa1551d17c75c15da6832dc3f29b6bbe70ba15acecc7"
May 28 10:08:01.855192 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:08:01.855170    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7a54eb7080dcac1e96f5aa1551d17c75c15da6832dc3f29b6bbe70ba15acecc7"} err="failed to get container status \"7a54eb7080dcac1e96f5aa1551d17c75c15da6832dc3f29b6bbe70ba15acecc7\": rpc error: code = NotFound desc = could not find container \"7a54eb7080dcac1e96f5aa1551d17c75c15da6832dc3f29b6bbe70ba15acecc7\": container with ID starting with 7a54eb7080dcac1e96f5aa1551d17c75c15da6832dc3f29b6bbe70ba15acecc7 not found: ID does not exist"
May 28 10:08:01.855263 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:08:01.855194    2565 scope.go:117] "RemoveContainer" containerID="b156ff6daf6410de7588432d9d7859d54315988126e098fe881ac32a87c0c2e9"
May 28 10:08:01.855421 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:08:01.855404    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b156ff6daf6410de7588432d9d7859d54315988126e098fe881ac32a87c0c2e9"} err="failed to get container status \"b156ff6daf6410de7588432d9d7859d54315988126e098fe881ac32a87c0c2e9\": rpc error: code = NotFound desc = could not find container \"b156ff6daf6410de7588432d9d7859d54315988126e098fe881ac32a87c0c2e9\": container with ID starting with b156ff6daf6410de7588432d9d7859d54315988126e098fe881ac32a87c0c2e9 not found: ID does not exist"
May 28 10:08:01.855489 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:08:01.855423    2565 scope.go:117] "RemoveContainer" containerID="e0bf0228afb91ecd40f3359f9b4a50387a0ee53c6b0aac174dc12b10f1253325"
May 28 10:08:01.855611 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:08:01.855590    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e0bf0228afb91ecd40f3359f9b4a50387a0ee53c6b0aac174dc12b10f1253325"} err="failed to get container status \"e0bf0228afb91ecd40f3359f9b4a50387a0ee53c6b0aac174dc12b10f1253325\": rpc error: code = NotFound desc = could not find container \"e0bf0228afb91ecd40f3359f9b4a50387a0ee53c6b0aac174dc12b10f1253325\": container with ID starting with e0bf0228afb91ecd40f3359f9b4a50387a0ee53c6b0aac174dc12b10f1253325 not found: ID does not exist"
May 28 10:08:01.855657 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:08:01.855612    2565 scope.go:117] "RemoveContainer" containerID="cebef29c6393baaa10061563ca9387167aa5a18f6ea5fba3fdca4623bb1f2d2f"
May 28 10:08:01.855798 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:08:01.855784    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cebef29c6393baaa10061563ca9387167aa5a18f6ea5fba3fdca4623bb1f2d2f"} err="failed to get container status \"cebef29c6393baaa10061563ca9387167aa5a18f6ea5fba3fdca4623bb1f2d2f\": rpc error: code = NotFound desc = could not find container \"cebef29c6393baaa10061563ca9387167aa5a18f6ea5fba3fdca4623bb1f2d2f\": container with ID starting with cebef29c6393baaa10061563ca9387167aa5a18f6ea5fba3fdca4623bb1f2d2f not found: ID does not exist"
May 28 10:08:01.855838 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:08:01.855798    2565 scope.go:117] "RemoveContainer" containerID="0685aa8a24fa1180379b68b768d056c0eaa132c4aa3a99fba82169446d2bb8e4"
May 28 10:08:01.855973 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:08:01.855955    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0685aa8a24fa1180379b68b768d056c0eaa132c4aa3a99fba82169446d2bb8e4"} err="failed to get container status \"0685aa8a24fa1180379b68b768d056c0eaa132c4aa3a99fba82169446d2bb8e4\": rpc error: code = NotFound desc = could not find container \"0685aa8a24fa1180379b68b768d056c0eaa132c4aa3a99fba82169446d2bb8e4\": container with ID starting with 0685aa8a24fa1180379b68b768d056c0eaa132c4aa3a99fba82169446d2bb8e4 not found: ID does not exist"
May 28 10:08:01.856007 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:08:01.855975    2565 scope.go:117] "RemoveContainer" containerID="b095e35c844eedc456f25f913313d021ee03555fd82e80a24a7fe6391b1b7f7c"
May 28 10:08:01.856169 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:08:01.856155    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b095e35c844eedc456f25f913313d021ee03555fd82e80a24a7fe6391b1b7f7c"} err="failed to get container status \"b095e35c844eedc456f25f913313d021ee03555fd82e80a24a7fe6391b1b7f7c\": rpc error: code = NotFound desc = could not find container \"b095e35c844eedc456f25f913313d021ee03555fd82e80a24a7fe6391b1b7f7c\": container with ID starting with b095e35c844eedc456f25f913313d021ee03555fd82e80a24a7fe6391b1b7f7c not found: ID does not exist"
May 28 10:08:01.856215 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:08:01.856169    2565 scope.go:117] "RemoveContainer" containerID="4246f4e1b055275c098570c985011faf09b731de78574b74c2333e17ba449fdb"
May 28 10:08:01.856388 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:08:01.856367    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4246f4e1b055275c098570c985011faf09b731de78574b74c2333e17ba449fdb"} err="failed to get container status \"4246f4e1b055275c098570c985011faf09b731de78574b74c2333e17ba449fdb\": rpc error: code = NotFound desc = could not find container \"4246f4e1b055275c098570c985011faf09b731de78574b74c2333e17ba449fdb\": container with ID starting with 4246f4e1b055275c098570c985011faf09b731de78574b74c2333e17ba449fdb not found: ID does not exist"
May 28 10:08:01.856437 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:08:01.856389    2565 scope.go:117] "RemoveContainer" containerID="7a54eb7080dcac1e96f5aa1551d17c75c15da6832dc3f29b6bbe70ba15acecc7"
May 28 10:08:01.856593 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:08:01.856578    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7a54eb7080dcac1e96f5aa1551d17c75c15da6832dc3f29b6bbe70ba15acecc7"} err="failed to get container status \"7a54eb7080dcac1e96f5aa1551d17c75c15da6832dc3f29b6bbe70ba15acecc7\": rpc error: code = NotFound desc = could not find container \"7a54eb7080dcac1e96f5aa1551d17c75c15da6832dc3f29b6bbe70ba15acecc7\": container with ID starting with 7a54eb7080dcac1e96f5aa1551d17c75c15da6832dc3f29b6bbe70ba15acecc7 not found: ID does not exist"
May 28 10:08:01.856634 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:08:01.856595    2565 scope.go:117] "RemoveContainer" containerID="b156ff6daf6410de7588432d9d7859d54315988126e098fe881ac32a87c0c2e9"
May 28 10:08:01.856796 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:08:01.856781    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b156ff6daf6410de7588432d9d7859d54315988126e098fe881ac32a87c0c2e9"} err="failed to get container status \"b156ff6daf6410de7588432d9d7859d54315988126e098fe881ac32a87c0c2e9\": rpc error: code = NotFound desc = could not find container \"b156ff6daf6410de7588432d9d7859d54315988126e098fe881ac32a87c0c2e9\": container with ID starting with b156ff6daf6410de7588432d9d7859d54315988126e098fe881ac32a87c0c2e9 not found: ID does not exist"
May 28 10:08:01.856854 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:08:01.856796    2565 scope.go:117] "RemoveContainer" containerID="e0bf0228afb91ecd40f3359f9b4a50387a0ee53c6b0aac174dc12b10f1253325"
May 28 10:08:01.857016 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:08:01.857001    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e0bf0228afb91ecd40f3359f9b4a50387a0ee53c6b0aac174dc12b10f1253325"} err="failed to get container status \"e0bf0228afb91ecd40f3359f9b4a50387a0ee53c6b0aac174dc12b10f1253325\": rpc error: code = NotFound desc = could not find container \"e0bf0228afb91ecd40f3359f9b4a50387a0ee53c6b0aac174dc12b10f1253325\": container with ID starting with e0bf0228afb91ecd40f3359f9b4a50387a0ee53c6b0aac174dc12b10f1253325 not found: ID does not exist"
May 28 10:08:01.857016 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:08:01.857015    2565 scope.go:117] "RemoveContainer" containerID="cebef29c6393baaa10061563ca9387167aa5a18f6ea5fba3fdca4623bb1f2d2f"
May 28 10:08:01.857190 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:08:01.857171    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cebef29c6393baaa10061563ca9387167aa5a18f6ea5fba3fdca4623bb1f2d2f"} err="failed to get container status \"cebef29c6393baaa10061563ca9387167aa5a18f6ea5fba3fdca4623bb1f2d2f\": rpc error: code = NotFound desc = could not find container \"cebef29c6393baaa10061563ca9387167aa5a18f6ea5fba3fdca4623bb1f2d2f\": container with ID starting with cebef29c6393baaa10061563ca9387167aa5a18f6ea5fba3fdca4623bb1f2d2f not found: ID does not exist"
May 28 10:08:01.857231 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:08:01.857194    2565 scope.go:117] "RemoveContainer" containerID="0685aa8a24fa1180379b68b768d056c0eaa132c4aa3a99fba82169446d2bb8e4"
May 28 10:08:01.857401 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:08:01.857385    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0685aa8a24fa1180379b68b768d056c0eaa132c4aa3a99fba82169446d2bb8e4"} err="failed to get container status \"0685aa8a24fa1180379b68b768d056c0eaa132c4aa3a99fba82169446d2bb8e4\": rpc error: code = NotFound desc = could not find container \"0685aa8a24fa1180379b68b768d056c0eaa132c4aa3a99fba82169446d2bb8e4\": container with ID starting with 0685aa8a24fa1180379b68b768d056c0eaa132c4aa3a99fba82169446d2bb8e4 not found: ID does not exist"
May 28 10:08:01.857440 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:08:01.857400    2565 scope.go:117] "RemoveContainer" containerID="b095e35c844eedc456f25f913313d021ee03555fd82e80a24a7fe6391b1b7f7c"
May 28 10:08:01.857580 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:08:01.857565    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b095e35c844eedc456f25f913313d021ee03555fd82e80a24a7fe6391b1b7f7c"} err="failed to get container status \"b095e35c844eedc456f25f913313d021ee03555fd82e80a24a7fe6391b1b7f7c\": rpc error: code = NotFound desc = could not find container \"b095e35c844eedc456f25f913313d021ee03555fd82e80a24a7fe6391b1b7f7c\": container with ID starting with b095e35c844eedc456f25f913313d021ee03555fd82e80a24a7fe6391b1b7f7c not found: ID does not exist"
May 28 10:08:01.857626 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:08:01.857581    2565 scope.go:117] "RemoveContainer" containerID="4246f4e1b055275c098570c985011faf09b731de78574b74c2333e17ba449fdb"
May 28 10:08:01.857736 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:08:01.857722    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4246f4e1b055275c098570c985011faf09b731de78574b74c2333e17ba449fdb"} err="failed to get container status \"4246f4e1b055275c098570c985011faf09b731de78574b74c2333e17ba449fdb\": rpc error: code = NotFound desc = could not find container \"4246f4e1b055275c098570c985011faf09b731de78574b74c2333e17ba449fdb\": container with ID starting with 4246f4e1b055275c098570c985011faf09b731de78574b74c2333e17ba449fdb not found: ID does not exist"
May 28 10:08:01.857785 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:08:01.857736    2565 scope.go:117] "RemoveContainer" containerID="7a54eb7080dcac1e96f5aa1551d17c75c15da6832dc3f29b6bbe70ba15acecc7"
May 28 10:08:01.857911 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:08:01.857895    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7a54eb7080dcac1e96f5aa1551d17c75c15da6832dc3f29b6bbe70ba15acecc7"} err="failed to get container status \"7a54eb7080dcac1e96f5aa1551d17c75c15da6832dc3f29b6bbe70ba15acecc7\": rpc error: code = NotFound desc = could not find container \"7a54eb7080dcac1e96f5aa1551d17c75c15da6832dc3f29b6bbe70ba15acecc7\": container with ID starting with 7a54eb7080dcac1e96f5aa1551d17c75c15da6832dc3f29b6bbe70ba15acecc7 not found: ID does not exist"
May 28 10:08:01.857911 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:08:01.857910    2565 scope.go:117] "RemoveContainer" containerID="b156ff6daf6410de7588432d9d7859d54315988126e098fe881ac32a87c0c2e9"
May 28 10:08:01.858096 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:08:01.858074    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b156ff6daf6410de7588432d9d7859d54315988126e098fe881ac32a87c0c2e9"} err="failed to get container status \"b156ff6daf6410de7588432d9d7859d54315988126e098fe881ac32a87c0c2e9\": rpc error: code = NotFound desc = could not find container \"b156ff6daf6410de7588432d9d7859d54315988126e098fe881ac32a87c0c2e9\": container with ID starting with b156ff6daf6410de7588432d9d7859d54315988126e098fe881ac32a87c0c2e9 not found: ID does not exist"
May 28 10:08:01.858096 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:08:01.858096    2565 scope.go:117] "RemoveContainer" containerID="e0bf0228afb91ecd40f3359f9b4a50387a0ee53c6b0aac174dc12b10f1253325"
May 28 10:08:01.858301 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:08:01.858283    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e0bf0228afb91ecd40f3359f9b4a50387a0ee53c6b0aac174dc12b10f1253325"} err="failed to get container status \"e0bf0228afb91ecd40f3359f9b4a50387a0ee53c6b0aac174dc12b10f1253325\": rpc error: code = NotFound desc = could not find container \"e0bf0228afb91ecd40f3359f9b4a50387a0ee53c6b0aac174dc12b10f1253325\": container with ID starting with e0bf0228afb91ecd40f3359f9b4a50387a0ee53c6b0aac174dc12b10f1253325 not found: ID does not exist"
May 28 10:08:01.858369 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:08:01.858302    2565 scope.go:117] "RemoveContainer" containerID="cebef29c6393baaa10061563ca9387167aa5a18f6ea5fba3fdca4623bb1f2d2f"
May 28 10:08:01.858513 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:08:01.858499    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cebef29c6393baaa10061563ca9387167aa5a18f6ea5fba3fdca4623bb1f2d2f"} err="failed to get container status \"cebef29c6393baaa10061563ca9387167aa5a18f6ea5fba3fdca4623bb1f2d2f\": rpc error: code = NotFound desc = could not find container \"cebef29c6393baaa10061563ca9387167aa5a18f6ea5fba3fdca4623bb1f2d2f\": container with ID starting with cebef29c6393baaa10061563ca9387167aa5a18f6ea5fba3fdca4623bb1f2d2f not found: ID does not exist"
May 28 10:08:01.858561 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:08:01.858514    2565 scope.go:117] "RemoveContainer" containerID="0685aa8a24fa1180379b68b768d056c0eaa132c4aa3a99fba82169446d2bb8e4"
May 28 10:08:01.858694 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:08:01.858677    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0685aa8a24fa1180379b68b768d056c0eaa132c4aa3a99fba82169446d2bb8e4"} err="failed to get container status \"0685aa8a24fa1180379b68b768d056c0eaa132c4aa3a99fba82169446d2bb8e4\": rpc error: code = NotFound desc = could not find container \"0685aa8a24fa1180379b68b768d056c0eaa132c4aa3a99fba82169446d2bb8e4\": container with ID starting with 0685aa8a24fa1180379b68b768d056c0eaa132c4aa3a99fba82169446d2bb8e4 not found: ID does not exist"
May 28 10:08:01.858768 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:08:01.858697    2565 scope.go:117] "RemoveContainer" containerID="b095e35c844eedc456f25f913313d021ee03555fd82e80a24a7fe6391b1b7f7c"
May 28 10:08:01.858886 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:08:01.858867    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b095e35c844eedc456f25f913313d021ee03555fd82e80a24a7fe6391b1b7f7c"} err="failed to get container status \"b095e35c844eedc456f25f913313d021ee03555fd82e80a24a7fe6391b1b7f7c\": rpc error: code = NotFound desc = could not find container \"b095e35c844eedc456f25f913313d021ee03555fd82e80a24a7fe6391b1b7f7c\": container with ID starting with b095e35c844eedc456f25f913313d021ee03555fd82e80a24a7fe6391b1b7f7c not found: ID does not exist"
May 28 10:08:01.858938 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:08:01.858886    2565 scope.go:117] "RemoveContainer" containerID="4246f4e1b055275c098570c985011faf09b731de78574b74c2333e17ba449fdb"
May 28 10:08:01.859087 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:08:01.859073    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4246f4e1b055275c098570c985011faf09b731de78574b74c2333e17ba449fdb"} err="failed to get container status \"4246f4e1b055275c098570c985011faf09b731de78574b74c2333e17ba449fdb\": rpc error: code = NotFound desc = could not find container \"4246f4e1b055275c098570c985011faf09b731de78574b74c2333e17ba449fdb\": container with ID starting with 4246f4e1b055275c098570c985011faf09b731de78574b74c2333e17ba449fdb not found: ID does not exist"
May 28 10:08:01.859136 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:08:01.859087    2565 scope.go:117] "RemoveContainer" containerID="7a54eb7080dcac1e96f5aa1551d17c75c15da6832dc3f29b6bbe70ba15acecc7"
May 28 10:08:01.859270 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:08:01.859250    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7a54eb7080dcac1e96f5aa1551d17c75c15da6832dc3f29b6bbe70ba15acecc7"} err="failed to get container status \"7a54eb7080dcac1e96f5aa1551d17c75c15da6832dc3f29b6bbe70ba15acecc7\": rpc error: code = NotFound desc = could not find container \"7a54eb7080dcac1e96f5aa1551d17c75c15da6832dc3f29b6bbe70ba15acecc7\": container with ID starting with 7a54eb7080dcac1e96f5aa1551d17c75c15da6832dc3f29b6bbe70ba15acecc7 not found: ID does not exist"
May 28 10:08:01.859270 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:08:01.859268    2565 scope.go:117] "RemoveContainer" containerID="b156ff6daf6410de7588432d9d7859d54315988126e098fe881ac32a87c0c2e9"
May 28 10:08:01.859465 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:08:01.859445    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b156ff6daf6410de7588432d9d7859d54315988126e098fe881ac32a87c0c2e9"} err="failed to get container status \"b156ff6daf6410de7588432d9d7859d54315988126e098fe881ac32a87c0c2e9\": rpc error: code = NotFound desc = could not find container \"b156ff6daf6410de7588432d9d7859d54315988126e098fe881ac32a87c0c2e9\": container with ID starting with b156ff6daf6410de7588432d9d7859d54315988126e098fe881ac32a87c0c2e9 not found: ID does not exist"
May 28 10:08:01.859510 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:08:01.859468    2565 scope.go:117] "RemoveContainer" containerID="e0bf0228afb91ecd40f3359f9b4a50387a0ee53c6b0aac174dc12b10f1253325"
May 28 10:08:01.859676 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:08:01.859658    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e0bf0228afb91ecd40f3359f9b4a50387a0ee53c6b0aac174dc12b10f1253325"} err="failed to get container status \"e0bf0228afb91ecd40f3359f9b4a50387a0ee53c6b0aac174dc12b10f1253325\": rpc error: code = NotFound desc = could not find container \"e0bf0228afb91ecd40f3359f9b4a50387a0ee53c6b0aac174dc12b10f1253325\": container with ID starting with e0bf0228afb91ecd40f3359f9b4a50387a0ee53c6b0aac174dc12b10f1253325 not found: ID does not exist"
May 28 10:08:01.859768 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:08:01.859678    2565 scope.go:117] "RemoveContainer" containerID="cebef29c6393baaa10061563ca9387167aa5a18f6ea5fba3fdca4623bb1f2d2f"
May 28 10:08:01.859928 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:08:01.859898    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cebef29c6393baaa10061563ca9387167aa5a18f6ea5fba3fdca4623bb1f2d2f"} err="failed to get container status \"cebef29c6393baaa10061563ca9387167aa5a18f6ea5fba3fdca4623bb1f2d2f\": rpc error: code = NotFound desc = could not find container \"cebef29c6393baaa10061563ca9387167aa5a18f6ea5fba3fdca4623bb1f2d2f\": container with ID starting with cebef29c6393baaa10061563ca9387167aa5a18f6ea5fba3fdca4623bb1f2d2f not found: ID does not exist"
May 28 10:08:01.860069 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:08:01.859928    2565 scope.go:117] "RemoveContainer" containerID="0685aa8a24fa1180379b68b768d056c0eaa132c4aa3a99fba82169446d2bb8e4"
May 28 10:08:01.860200 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:08:01.860169    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0685aa8a24fa1180379b68b768d056c0eaa132c4aa3a99fba82169446d2bb8e4"} err="failed to get container status \"0685aa8a24fa1180379b68b768d056c0eaa132c4aa3a99fba82169446d2bb8e4\": rpc error: code = NotFound desc = could not find container \"0685aa8a24fa1180379b68b768d056c0eaa132c4aa3a99fba82169446d2bb8e4\": container with ID starting with 0685aa8a24fa1180379b68b768d056c0eaa132c4aa3a99fba82169446d2bb8e4 not found: ID does not exist"
May 28 10:08:01.860200 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:08:01.860201    2565 scope.go:117] "RemoveContainer" containerID="b095e35c844eedc456f25f913313d021ee03555fd82e80a24a7fe6391b1b7f7c"
May 28 10:08:01.860525 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:08:01.860501    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b095e35c844eedc456f25f913313d021ee03555fd82e80a24a7fe6391b1b7f7c"} err="failed to get container status \"b095e35c844eedc456f25f913313d021ee03555fd82e80a24a7fe6391b1b7f7c\": rpc error: code = NotFound desc = could not find container \"b095e35c844eedc456f25f913313d021ee03555fd82e80a24a7fe6391b1b7f7c\": container with ID starting with b095e35c844eedc456f25f913313d021ee03555fd82e80a24a7fe6391b1b7f7c not found: ID does not exist"
May 28 10:08:01.860613 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:08:01.860526    2565 scope.go:117] "RemoveContainer" containerID="4246f4e1b055275c098570c985011faf09b731de78574b74c2333e17ba449fdb"
May 28 10:08:01.860838 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:08:01.860774    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4246f4e1b055275c098570c985011faf09b731de78574b74c2333e17ba449fdb"} err="failed to get container status \"4246f4e1b055275c098570c985011faf09b731de78574b74c2333e17ba449fdb\": rpc error: code = NotFound desc = could not find container \"4246f4e1b055275c098570c985011faf09b731de78574b74c2333e17ba449fdb\": container with ID starting with 4246f4e1b055275c098570c985011faf09b731de78574b74c2333e17ba449fdb not found: ID does not exist"
May 28 10:08:01.861897 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:08:01.861877    2565 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
May 28 10:08:01.862207 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:08:01.862193    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="82289d40-b0b7-453a-b897-fc3b27d27a05" containerName="kube-rbac-proxy-web"
May 28 10:08:01.862243 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:08:01.862211    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="82289d40-b0b7-453a-b897-fc3b27d27a05" containerName="kube-rbac-proxy-web"
May 28 10:08:01.862243 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:08:01.862221    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="82289d40-b0b7-453a-b897-fc3b27d27a05" containerName="kube-rbac-proxy"
May 28 10:08:01.862243 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:08:01.862229    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="82289d40-b0b7-453a-b897-fc3b27d27a05" containerName="kube-rbac-proxy"
May 28 10:08:01.862351 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:08:01.862247    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="82289d40-b0b7-453a-b897-fc3b27d27a05" containerName="init-config-reloader"
May 28 10:08:01.862351 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:08:01.862255    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="82289d40-b0b7-453a-b897-fc3b27d27a05" containerName="init-config-reloader"
May 28 10:08:01.862351 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:08:01.862263    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="82289d40-b0b7-453a-b897-fc3b27d27a05" containerName="thanos-sidecar"
May 28 10:08:01.862351 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:08:01.862272    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="82289d40-b0b7-453a-b897-fc3b27d27a05" containerName="thanos-sidecar"
May 28 10:08:01.862351 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:08:01.862283    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="aa86ed4e-28cf-4607-831f-636c37755e8e" containerName="kube-rbac-proxy-metric"
May 28 10:08:01.862351 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:08:01.862290    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="aa86ed4e-28cf-4607-831f-636c37755e8e" containerName="kube-rbac-proxy-metric"
May 28 10:08:01.862351 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:08:01.862300    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="82289d40-b0b7-453a-b897-fc3b27d27a05" containerName="kube-rbac-proxy-thanos"
May 28 10:08:01.862351 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:08:01.862325    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="82289d40-b0b7-453a-b897-fc3b27d27a05" containerName="kube-rbac-proxy-thanos"
May 28 10:08:01.862351 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:08:01.862336    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="82289d40-b0b7-453a-b897-fc3b27d27a05" containerName="config-reloader"
May 28 10:08:01.862351 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:08:01.862343    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="82289d40-b0b7-453a-b897-fc3b27d27a05" containerName="config-reloader"
May 28 10:08:01.862351 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:08:01.862353    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="82b5199d-ad56-4bf8-93ea-cb1b467e50f1" containerName="console"
May 28 10:08:01.862638 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:08:01.862361    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="82b5199d-ad56-4bf8-93ea-cb1b467e50f1" containerName="console"
May 28 10:08:01.862638 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:08:01.862370    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="aa86ed4e-28cf-4607-831f-636c37755e8e" containerName="alertmanager"
May 28 10:08:01.862638 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:08:01.862377    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="aa86ed4e-28cf-4607-831f-636c37755e8e" containerName="alertmanager"
May 28 10:08:01.862638 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:08:01.862384    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="aa86ed4e-28cf-4607-831f-636c37755e8e" containerName="kube-rbac-proxy"
May 28 10:08:01.862638 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:08:01.862392    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="aa86ed4e-28cf-4607-831f-636c37755e8e" containerName="kube-rbac-proxy"
May 28 10:08:01.862638 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:08:01.862401    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="82289d40-b0b7-453a-b897-fc3b27d27a05" containerName="prometheus"
May 28 10:08:01.862638 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:08:01.862409    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="82289d40-b0b7-453a-b897-fc3b27d27a05" containerName="prometheus"
May 28 10:08:01.862638 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:08:01.862417    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="aa86ed4e-28cf-4607-831f-636c37755e8e" containerName="kube-rbac-proxy-web"
May 28 10:08:01.862638 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:08:01.862425    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="aa86ed4e-28cf-4607-831f-636c37755e8e" containerName="kube-rbac-proxy-web"
May 28 10:08:01.862638 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:08:01.862438    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="aa86ed4e-28cf-4607-831f-636c37755e8e" containerName="init-config-reloader"
May 28 10:08:01.862638 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:08:01.862446    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="aa86ed4e-28cf-4607-831f-636c37755e8e" containerName="init-config-reloader"
May 28 10:08:01.862638 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:08:01.862455    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="aa86ed4e-28cf-4607-831f-636c37755e8e" containerName="config-reloader"
May 28 10:08:01.862638 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:08:01.862464    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="aa86ed4e-28cf-4607-831f-636c37755e8e" containerName="config-reloader"
May 28 10:08:01.862638 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:08:01.862478    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="aa86ed4e-28cf-4607-831f-636c37755e8e" containerName="prom-label-proxy"
May 28 10:08:01.862638 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:08:01.862485    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="aa86ed4e-28cf-4607-831f-636c37755e8e" containerName="prom-label-proxy"
May 28 10:08:01.862638 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:08:01.862547    2565 memory_manager.go:356] "RemoveStaleState removing state" podUID="82289d40-b0b7-453a-b897-fc3b27d27a05" containerName="kube-rbac-proxy-thanos"
May 28 10:08:01.862638 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:08:01.862559    2565 memory_manager.go:356] "RemoveStaleState removing state" podUID="82289d40-b0b7-453a-b897-fc3b27d27a05" containerName="config-reloader"
May 28 10:08:01.862638 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:08:01.862569    2565 memory_manager.go:356] "RemoveStaleState removing state" podUID="aa86ed4e-28cf-4607-831f-636c37755e8e" containerName="config-reloader"
May 28 10:08:01.862638 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:08:01.862579    2565 memory_manager.go:356] "RemoveStaleState removing state" podUID="aa86ed4e-28cf-4607-831f-636c37755e8e" containerName="prom-label-proxy"
May 28 10:08:01.862638 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:08:01.862589    2565 memory_manager.go:356] "RemoveStaleState removing state" podUID="82289d40-b0b7-453a-b897-fc3b27d27a05" containerName="kube-rbac-proxy-web"
May 28 10:08:01.862638 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:08:01.862599    2565 memory_manager.go:356] "RemoveStaleState removing state" podUID="82b5199d-ad56-4bf8-93ea-cb1b467e50f1" containerName="console"
May 28 10:08:01.862638 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:08:01.862609    2565 memory_manager.go:356] "RemoveStaleState removing state" podUID="aa86ed4e-28cf-4607-831f-636c37755e8e" containerName="alertmanager"
May 28 10:08:01.862638 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:08:01.862618    2565 memory_manager.go:356] "RemoveStaleState removing state" podUID="aa86ed4e-28cf-4607-831f-636c37755e8e" containerName="kube-rbac-proxy"
May 28 10:08:01.862638 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:08:01.862628    2565 memory_manager.go:356] "RemoveStaleState removing state" podUID="aa86ed4e-28cf-4607-831f-636c37755e8e" containerName="kube-rbac-proxy-metric"
May 28 10:08:01.862638 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:08:01.862637    2565 memory_manager.go:356] "RemoveStaleState removing state" podUID="aa86ed4e-28cf-4607-831f-636c37755e8e" containerName="kube-rbac-proxy-web"
May 28 10:08:01.862638 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:08:01.862645    2565 memory_manager.go:356] "RemoveStaleState removing state" podUID="82289d40-b0b7-453a-b897-fc3b27d27a05" containerName="prometheus"
May 28 10:08:01.863375 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:08:01.862653    2565 memory_manager.go:356] "RemoveStaleState removing state" podUID="82289d40-b0b7-453a-b897-fc3b27d27a05" containerName="thanos-sidecar"
May 28 10:08:01.863375 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:08:01.862662    2565 memory_manager.go:356] "RemoveStaleState removing state" podUID="82289d40-b0b7-453a-b897-fc3b27d27a05" containerName="kube-rbac-proxy"
May 28 10:08:01.866016 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:08:01.865994    2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
May 28 10:08:01.870914 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:08:01.870891    2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\""
May 28 10:08:01.871005 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:08:01.870959    2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\""
May 28 10:08:01.871005 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:08:01.870969    2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\""
May 28 10:08:01.871005 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:08:01.870979    2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\""
May 28 10:08:01.871229 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:08:01.871082    2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\""
May 28 10:08:01.871229 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:08:01.871126    2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\""
May 28 10:08:01.871370 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:08:01.871354    2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\""
May 28 10:08:01.871601 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:08:01.871585    2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\""
May 28 10:08:01.871684 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:08:01.871670    2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\""
May 28 10:08:01.871740 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:08:01.871706    2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\""
May 28 10:08:01.871795 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:08:01.871745    2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-89k16ektds9um\""
May 28 10:08:01.871795 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:08:01.871672    2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-srhlb\""
May 28 10:08:01.871904 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:08:01.871833    2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\""
May 28 10:08:01.873572 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:08:01.873555    2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\""
May 28 10:08:01.875325 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:08:01.875294    2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\""
May 28 10:08:01.883182 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:08:01.883162    2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
May 28 10:08:01.966726 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:08:01.966690    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/b701439f-7c19-4fe4-998e-1aec44e22ba9-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"b701439f-7c19-4fe4-998e-1aec44e22ba9\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 10:08:01.966726 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:08:01.966724    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/b701439f-7c19-4fe4-998e-1aec44e22ba9-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"b701439f-7c19-4fe4-998e-1aec44e22ba9\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 10:08:01.966922 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:08:01.966744    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-92wfw\" (UniqueName: \"kubernetes.io/projected/b701439f-7c19-4fe4-998e-1aec44e22ba9-kube-api-access-92wfw\") pod \"prometheus-k8s-0\" (UID: \"b701439f-7c19-4fe4-998e-1aec44e22ba9\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 10:08:01.966922 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:08:01.966788    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b701439f-7c19-4fe4-998e-1aec44e22ba9-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"b701439f-7c19-4fe4-998e-1aec44e22ba9\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 10:08:01.966922 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:08:01.966820    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/b701439f-7c19-4fe4-998e-1aec44e22ba9-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"b701439f-7c19-4fe4-998e-1aec44e22ba9\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 10:08:01.966922 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:08:01.966846    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/b701439f-7c19-4fe4-998e-1aec44e22ba9-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"b701439f-7c19-4fe4-998e-1aec44e22ba9\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 10:08:01.966922 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:08:01.966860    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/b701439f-7c19-4fe4-998e-1aec44e22ba9-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"b701439f-7c19-4fe4-998e-1aec44e22ba9\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 10:08:01.966922 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:08:01.966879    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b701439f-7c19-4fe4-998e-1aec44e22ba9-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"b701439f-7c19-4fe4-998e-1aec44e22ba9\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 10:08:01.966922 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:08:01.966893    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/b701439f-7c19-4fe4-998e-1aec44e22ba9-config\") pod \"prometheus-k8s-0\" (UID: \"b701439f-7c19-4fe4-998e-1aec44e22ba9\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 10:08:01.966922 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:08:01.966912    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/b701439f-7c19-4fe4-998e-1aec44e22ba9-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"b701439f-7c19-4fe4-998e-1aec44e22ba9\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 10:08:01.967157 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:08:01.966927    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/b701439f-7c19-4fe4-998e-1aec44e22ba9-web-config\") pod \"prometheus-k8s-0\" (UID: \"b701439f-7c19-4fe4-998e-1aec44e22ba9\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 10:08:01.967157 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:08:01.966974    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/b701439f-7c19-4fe4-998e-1aec44e22ba9-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"b701439f-7c19-4fe4-998e-1aec44e22ba9\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 10:08:01.967157 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:08:01.967024    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/b701439f-7c19-4fe4-998e-1aec44e22ba9-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"b701439f-7c19-4fe4-998e-1aec44e22ba9\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 10:08:01.967157 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:08:01.967054    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b701439f-7c19-4fe4-998e-1aec44e22ba9-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"b701439f-7c19-4fe4-998e-1aec44e22ba9\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 10:08:01.967157 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:08:01.967070    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b701439f-7c19-4fe4-998e-1aec44e22ba9-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"b701439f-7c19-4fe4-998e-1aec44e22ba9\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 10:08:01.967157 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:08:01.967094    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/b701439f-7c19-4fe4-998e-1aec44e22ba9-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"b701439f-7c19-4fe4-998e-1aec44e22ba9\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 10:08:01.967157 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:08:01.967112    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/b701439f-7c19-4fe4-998e-1aec44e22ba9-config-out\") pod \"prometheus-k8s-0\" (UID: \"b701439f-7c19-4fe4-998e-1aec44e22ba9\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 10:08:01.967157 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:08:01.967128    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/b701439f-7c19-4fe4-998e-1aec44e22ba9-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"b701439f-7c19-4fe4-998e-1aec44e22ba9\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 10:08:02.068216 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:08:02.068137    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/b701439f-7c19-4fe4-998e-1aec44e22ba9-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"b701439f-7c19-4fe4-998e-1aec44e22ba9\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 10:08:02.068216 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:08:02.068184    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/b701439f-7c19-4fe4-998e-1aec44e22ba9-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"b701439f-7c19-4fe4-998e-1aec44e22ba9\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 10:08:02.068216 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:08:02.068206    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b701439f-7c19-4fe4-998e-1aec44e22ba9-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"b701439f-7c19-4fe4-998e-1aec44e22ba9\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 10:08:02.068216 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:08:02.068223    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/b701439f-7c19-4fe4-998e-1aec44e22ba9-config\") pod \"prometheus-k8s-0\" (UID: \"b701439f-7c19-4fe4-998e-1aec44e22ba9\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 10:08:02.068493 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:08:02.068244    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/b701439f-7c19-4fe4-998e-1aec44e22ba9-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"b701439f-7c19-4fe4-998e-1aec44e22ba9\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 10:08:02.068493 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:08:02.068261    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/b701439f-7c19-4fe4-998e-1aec44e22ba9-web-config\") pod \"prometheus-k8s-0\" (UID: \"b701439f-7c19-4fe4-998e-1aec44e22ba9\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 10:08:02.068493 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:08:02.068286    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/b701439f-7c19-4fe4-998e-1aec44e22ba9-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"b701439f-7c19-4fe4-998e-1aec44e22ba9\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 10:08:02.068493 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:08:02.068341    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/b701439f-7c19-4fe4-998e-1aec44e22ba9-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"b701439f-7c19-4fe4-998e-1aec44e22ba9\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 10:08:02.068493 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:08:02.068372    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b701439f-7c19-4fe4-998e-1aec44e22ba9-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"b701439f-7c19-4fe4-998e-1aec44e22ba9\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 10:08:02.068493 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:08:02.068397    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b701439f-7c19-4fe4-998e-1aec44e22ba9-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"b701439f-7c19-4fe4-998e-1aec44e22ba9\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 10:08:02.068493 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:08:02.068423    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/b701439f-7c19-4fe4-998e-1aec44e22ba9-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"b701439f-7c19-4fe4-998e-1aec44e22ba9\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 10:08:02.068493 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:08:02.068445    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/b701439f-7c19-4fe4-998e-1aec44e22ba9-config-out\") pod \"prometheus-k8s-0\" (UID: \"b701439f-7c19-4fe4-998e-1aec44e22ba9\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 10:08:02.068493 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:08:02.068467    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/b701439f-7c19-4fe4-998e-1aec44e22ba9-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"b701439f-7c19-4fe4-998e-1aec44e22ba9\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 10:08:02.068885 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:08:02.068498    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/b701439f-7c19-4fe4-998e-1aec44e22ba9-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"b701439f-7c19-4fe4-998e-1aec44e22ba9\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 10:08:02.068885 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:08:02.068519    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/b701439f-7c19-4fe4-998e-1aec44e22ba9-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"b701439f-7c19-4fe4-998e-1aec44e22ba9\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 10:08:02.068885 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:08:02.068543    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-92wfw\" (UniqueName: \"kubernetes.io/projected/b701439f-7c19-4fe4-998e-1aec44e22ba9-kube-api-access-92wfw\") pod \"prometheus-k8s-0\" (UID: \"b701439f-7c19-4fe4-998e-1aec44e22ba9\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 10:08:02.068885 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:08:02.068579    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b701439f-7c19-4fe4-998e-1aec44e22ba9-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"b701439f-7c19-4fe4-998e-1aec44e22ba9\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 10:08:02.068885 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:08:02.068627    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/b701439f-7c19-4fe4-998e-1aec44e22ba9-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"b701439f-7c19-4fe4-998e-1aec44e22ba9\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 10:08:02.069533 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:08:02.069452    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b701439f-7c19-4fe4-998e-1aec44e22ba9-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"b701439f-7c19-4fe4-998e-1aec44e22ba9\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 10:08:02.072298 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:08:02.071520    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/b701439f-7c19-4fe4-998e-1aec44e22ba9-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"b701439f-7c19-4fe4-998e-1aec44e22ba9\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 10:08:02.072298 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:08:02.071655    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/b701439f-7c19-4fe4-998e-1aec44e22ba9-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"b701439f-7c19-4fe4-998e-1aec44e22ba9\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 10:08:02.072298 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:08:02.071718    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/b701439f-7c19-4fe4-998e-1aec44e22ba9-config\") pod \"prometheus-k8s-0\" (UID: \"b701439f-7c19-4fe4-998e-1aec44e22ba9\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 10:08:02.072298 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:08:02.071953    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/b701439f-7c19-4fe4-998e-1aec44e22ba9-config-out\") pod \"prometheus-k8s-0\" (UID: \"b701439f-7c19-4fe4-998e-1aec44e22ba9\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 10:08:02.072298 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:08:02.071991    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/b701439f-7c19-4fe4-998e-1aec44e22ba9-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"b701439f-7c19-4fe4-998e-1aec44e22ba9\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 10:08:02.072298 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:08:02.072011    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/b701439f-7c19-4fe4-998e-1aec44e22ba9-web-config\") pod \"prometheus-k8s-0\" (UID: \"b701439f-7c19-4fe4-998e-1aec44e22ba9\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 10:08:02.072298 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:08:02.072031    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/b701439f-7c19-4fe4-998e-1aec44e22ba9-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"b701439f-7c19-4fe4-998e-1aec44e22ba9\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 10:08:02.072298 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:08:02.072250    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/b701439f-7c19-4fe4-998e-1aec44e22ba9-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"b701439f-7c19-4fe4-998e-1aec44e22ba9\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 10:08:02.072989 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:08:02.072397    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b701439f-7c19-4fe4-998e-1aec44e22ba9-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"b701439f-7c19-4fe4-998e-1aec44e22ba9\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 10:08:02.072989 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:08:02.072530    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b701439f-7c19-4fe4-998e-1aec44e22ba9-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"b701439f-7c19-4fe4-998e-1aec44e22ba9\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 10:08:02.072989 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:08:02.072931    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/b701439f-7c19-4fe4-998e-1aec44e22ba9-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"b701439f-7c19-4fe4-998e-1aec44e22ba9\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 10:08:02.072989 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:08:02.072961    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b701439f-7c19-4fe4-998e-1aec44e22ba9-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"b701439f-7c19-4fe4-998e-1aec44e22ba9\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 10:08:02.074081 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:08:02.074057    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/b701439f-7c19-4fe4-998e-1aec44e22ba9-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"b701439f-7c19-4fe4-998e-1aec44e22ba9\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 10:08:02.074444 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:08:02.074426    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/b701439f-7c19-4fe4-998e-1aec44e22ba9-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"b701439f-7c19-4fe4-998e-1aec44e22ba9\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 10:08:02.074823 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:08:02.074802    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/b701439f-7c19-4fe4-998e-1aec44e22ba9-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"b701439f-7c19-4fe4-998e-1aec44e22ba9\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 10:08:02.074984 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:08:02.074967    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/b701439f-7c19-4fe4-998e-1aec44e22ba9-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"b701439f-7c19-4fe4-998e-1aec44e22ba9\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 10:08:02.081520 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:08:02.081500    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-92wfw\" (UniqueName: \"kubernetes.io/projected/b701439f-7c19-4fe4-998e-1aec44e22ba9-kube-api-access-92wfw\") pod \"prometheus-k8s-0\" (UID: \"b701439f-7c19-4fe4-998e-1aec44e22ba9\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 10:08:02.176653 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:08:02.176618    2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
May 28 10:08:02.313975 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:08:02.313215    2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
May 28 10:08:02.805225 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:08:02.805185    2565 generic.go:358] "Generic (PLEG): container finished" podID="b701439f-7c19-4fe4-998e-1aec44e22ba9" containerID="86032953f12aad12640e2a3cbd25c547bc23cf6f88c4028c6542f247e26631e3" exitCode=0
May 28 10:08:02.805597 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:08:02.805246    2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"b701439f-7c19-4fe4-998e-1aec44e22ba9","Type":"ContainerDied","Data":"86032953f12aad12640e2a3cbd25c547bc23cf6f88c4028c6542f247e26631e3"}
May 28 10:08:02.805597 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:08:02.805271    2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"b701439f-7c19-4fe4-998e-1aec44e22ba9","Type":"ContainerStarted","Data":"94ea08041849691bac580c3bf74d553906387e1b45d91e77c0848dceaa7384e4"}
May 28 10:08:03.155212 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:08:03.155182    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="82289d40-b0b7-453a-b897-fc3b27d27a05" path="/var/lib/kubelet/pods/82289d40-b0b7-453a-b897-fc3b27d27a05/volumes"
May 28 10:08:03.811773 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:08:03.811739    2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"b701439f-7c19-4fe4-998e-1aec44e22ba9","Type":"ContainerStarted","Data":"6f050361d958d1b56e227c71cb70b51435efb288d101b1fbc33f4bb2155851cc"}
May 28 10:08:03.811773 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:08:03.811774    2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"b701439f-7c19-4fe4-998e-1aec44e22ba9","Type":"ContainerStarted","Data":"79444914289d7e8738c81b7cb03f05a97aa9fbbf49ed9dccc551735d47c2e568"}
May 28 10:08:03.812187 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:08:03.811783    2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"b701439f-7c19-4fe4-998e-1aec44e22ba9","Type":"ContainerStarted","Data":"0f6f28a73c9a576155384e4d921c9cb5b30d94aaa28db80d912805afaa9e83c6"}
May 28 10:08:03.812187 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:08:03.811791    2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"b701439f-7c19-4fe4-998e-1aec44e22ba9","Type":"ContainerStarted","Data":"732c80d42b5f69ddb35a49bf4bd0019f18213e6e0dfa6fbba55c54c6429f6f41"}
May 28 10:08:03.812187 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:08:03.811800    2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"b701439f-7c19-4fe4-998e-1aec44e22ba9","Type":"ContainerStarted","Data":"c5595025b32c9ef11714a8cac196375229468b9c9ea1a54adf4f18bc77fd861a"}
May 28 10:08:03.812187 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:08:03.811807    2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"b701439f-7c19-4fe4-998e-1aec44e22ba9","Type":"ContainerStarted","Data":"c79b9dcfa982cd20b5cac7aeab9f98350e7459de0684d35e31cdcf4d81c400b0"}
May 28 10:08:03.848913 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:08:03.848862    2565 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.8488468510000002 podStartE2EDuration="2.848846851s" podCreationTimestamp="2026-05-28 10:08:01 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-28 10:08:03.847240243 +0000 UTC m=+169.307574417" watchObservedRunningTime="2026-05-28 10:08:03.848846851 +0000 UTC m=+169.309181002"
May 28 10:08:07.176909 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:08:07.176880    2565 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0"
May 28 10:08:14.497063 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:08:14.497020    2565 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-847d55b9f7-bzhp2"]
May 28 10:08:39.519534 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:08:39.519494    2565 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-console/console-847d55b9f7-bzhp2" podUID="02839c99-e06b-4998-9442-2329b6210f0c" containerName="console" containerID="cri-o://4b6de902ce3c63ea8090e5abb99e82a441969e486eba0f96acec155e015afe79" gracePeriod=15
May 28 10:08:39.752851 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:08:39.752832    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-847d55b9f7-bzhp2_02839c99-e06b-4998-9442-2329b6210f0c/console/0.log"
May 28 10:08:39.752952 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:08:39.752894    2565 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-847d55b9f7-bzhp2"
May 28 10:08:39.843615 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:08:39.843589    2565 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/02839c99-e06b-4998-9442-2329b6210f0c-trusted-ca-bundle\") pod \"02839c99-e06b-4998-9442-2329b6210f0c\" (UID: \"02839c99-e06b-4998-9442-2329b6210f0c\") "
May 28 10:08:39.843790 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:08:39.843628    2565 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/02839c99-e06b-4998-9442-2329b6210f0c-console-oauth-config\") pod \"02839c99-e06b-4998-9442-2329b6210f0c\" (UID: \"02839c99-e06b-4998-9442-2329b6210f0c\") "
May 28 10:08:39.843790 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:08:39.843671    2565 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/02839c99-e06b-4998-9442-2329b6210f0c-oauth-serving-cert\") pod \"02839c99-e06b-4998-9442-2329b6210f0c\" (UID: \"02839c99-e06b-4998-9442-2329b6210f0c\") "
May 28 10:08:39.843907 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:08:39.843786    2565 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/02839c99-e06b-4998-9442-2329b6210f0c-console-serving-cert\") pod \"02839c99-e06b-4998-9442-2329b6210f0c\" (UID: \"02839c99-e06b-4998-9442-2329b6210f0c\") "
May 28 10:08:39.843907 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:08:39.843821    2565 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5f2mc\" (UniqueName: \"kubernetes.io/projected/02839c99-e06b-4998-9442-2329b6210f0c-kube-api-access-5f2mc\") pod \"02839c99-e06b-4998-9442-2329b6210f0c\" (UID: \"02839c99-e06b-4998-9442-2329b6210f0c\") "
May 28 10:08:39.843907 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:08:39.843852    2565 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/02839c99-e06b-4998-9442-2329b6210f0c-console-config\") pod \"02839c99-e06b-4998-9442-2329b6210f0c\" (UID: \"02839c99-e06b-4998-9442-2329b6210f0c\") "
May 28 10:08:39.843907 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:08:39.843875    2565 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/02839c99-e06b-4998-9442-2329b6210f0c-service-ca\") pod \"02839c99-e06b-4998-9442-2329b6210f0c\" (UID: \"02839c99-e06b-4998-9442-2329b6210f0c\") "
May 28 10:08:39.844104 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:08:39.843985    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/02839c99-e06b-4998-9442-2329b6210f0c-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "02839c99-e06b-4998-9442-2329b6210f0c" (UID: "02839c99-e06b-4998-9442-2329b6210f0c"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 28 10:08:39.844176 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:08:39.844050    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/02839c99-e06b-4998-9442-2329b6210f0c-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "02839c99-e06b-4998-9442-2329b6210f0c" (UID: "02839c99-e06b-4998-9442-2329b6210f0c"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 28 10:08:39.844255 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:08:39.844228    2565 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/02839c99-e06b-4998-9442-2329b6210f0c-trusted-ca-bundle\") on node \"ip-10-0-128-206.ec2.internal\" DevicePath \"\""
May 28 10:08:39.844333 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:08:39.844250    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/02839c99-e06b-4998-9442-2329b6210f0c-console-config" (OuterVolumeSpecName: "console-config") pod "02839c99-e06b-4998-9442-2329b6210f0c" (UID: "02839c99-e06b-4998-9442-2329b6210f0c"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 28 10:08:39.844333 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:08:39.844283    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/02839c99-e06b-4998-9442-2329b6210f0c-service-ca" (OuterVolumeSpecName: "service-ca") pod "02839c99-e06b-4998-9442-2329b6210f0c" (UID: "02839c99-e06b-4998-9442-2329b6210f0c"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 28 10:08:39.846038 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:08:39.846011    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/02839c99-e06b-4998-9442-2329b6210f0c-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "02839c99-e06b-4998-9442-2329b6210f0c" (UID: "02839c99-e06b-4998-9442-2329b6210f0c"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 28 10:08:39.846141 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:08:39.846077    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/02839c99-e06b-4998-9442-2329b6210f0c-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "02839c99-e06b-4998-9442-2329b6210f0c" (UID: "02839c99-e06b-4998-9442-2329b6210f0c"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 28 10:08:39.846141 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:08:39.846090    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/02839c99-e06b-4998-9442-2329b6210f0c-kube-api-access-5f2mc" (OuterVolumeSpecName: "kube-api-access-5f2mc") pod "02839c99-e06b-4998-9442-2329b6210f0c" (UID: "02839c99-e06b-4998-9442-2329b6210f0c"). InnerVolumeSpecName "kube-api-access-5f2mc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 28 10:08:39.915406 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:08:39.915379    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-847d55b9f7-bzhp2_02839c99-e06b-4998-9442-2329b6210f0c/console/0.log"
May 28 10:08:39.915566 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:08:39.915417    2565 generic.go:358] "Generic (PLEG): container finished" podID="02839c99-e06b-4998-9442-2329b6210f0c" containerID="4b6de902ce3c63ea8090e5abb99e82a441969e486eba0f96acec155e015afe79" exitCode=2
May 28 10:08:39.915566 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:08:39.915460    2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-847d55b9f7-bzhp2" event={"ID":"02839c99-e06b-4998-9442-2329b6210f0c","Type":"ContainerDied","Data":"4b6de902ce3c63ea8090e5abb99e82a441969e486eba0f96acec155e015afe79"}
May 28 10:08:39.915566 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:08:39.915483    2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-847d55b9f7-bzhp2" event={"ID":"02839c99-e06b-4998-9442-2329b6210f0c","Type":"ContainerDied","Data":"78e4a1778e49d21e894915854e387046558cbf0d30640c07984ad4bfa45170c3"}
May 28 10:08:39.915566 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:08:39.915496    2565 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-847d55b9f7-bzhp2"
May 28 10:08:39.915762 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:08:39.915503    2565 scope.go:117] "RemoveContainer" containerID="4b6de902ce3c63ea8090e5abb99e82a441969e486eba0f96acec155e015afe79"
May 28 10:08:39.923413 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:08:39.923391    2565 scope.go:117] "RemoveContainer" containerID="4b6de902ce3c63ea8090e5abb99e82a441969e486eba0f96acec155e015afe79"
May 28 10:08:39.923638 ip-10-0-128-206 kubenswrapper[2565]: E0528 10:08:39.923621    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4b6de902ce3c63ea8090e5abb99e82a441969e486eba0f96acec155e015afe79\": container with ID starting with 4b6de902ce3c63ea8090e5abb99e82a441969e486eba0f96acec155e015afe79 not found: ID does not exist" containerID="4b6de902ce3c63ea8090e5abb99e82a441969e486eba0f96acec155e015afe79"
May 28 10:08:39.923691 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:08:39.923647    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4b6de902ce3c63ea8090e5abb99e82a441969e486eba0f96acec155e015afe79"} err="failed to get container status \"4b6de902ce3c63ea8090e5abb99e82a441969e486eba0f96acec155e015afe79\": rpc error: code = NotFound desc = could not find container \"4b6de902ce3c63ea8090e5abb99e82a441969e486eba0f96acec155e015afe79\": container with ID starting with 4b6de902ce3c63ea8090e5abb99e82a441969e486eba0f96acec155e015afe79 not found: ID does not exist"
May 28 10:08:39.937212 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:08:39.937193    2565 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-847d55b9f7-bzhp2"]
May 28 10:08:39.940529 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:08:39.940506    2565 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-847d55b9f7-bzhp2"]
May 28 10:08:39.944547 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:08:39.944528    2565 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/02839c99-e06b-4998-9442-2329b6210f0c-oauth-serving-cert\") on node \"ip-10-0-128-206.ec2.internal\" DevicePath \"\""
May 28 10:08:39.944547 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:08:39.944548    2565 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/02839c99-e06b-4998-9442-2329b6210f0c-console-serving-cert\") on node \"ip-10-0-128-206.ec2.internal\" DevicePath \"\""
May 28 10:08:39.944657 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:08:39.944559    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5f2mc\" (UniqueName: \"kubernetes.io/projected/02839c99-e06b-4998-9442-2329b6210f0c-kube-api-access-5f2mc\") on node \"ip-10-0-128-206.ec2.internal\" DevicePath \"\""
May 28 10:08:39.944657 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:08:39.944570    2565 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/02839c99-e06b-4998-9442-2329b6210f0c-console-config\") on node \"ip-10-0-128-206.ec2.internal\" DevicePath \"\""
May 28 10:08:39.944657 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:08:39.944579    2565 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/02839c99-e06b-4998-9442-2329b6210f0c-service-ca\") on node \"ip-10-0-128-206.ec2.internal\" DevicePath \"\""
May 28 10:08:39.944657 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:08:39.944587    2565 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/02839c99-e06b-4998-9442-2329b6210f0c-console-oauth-config\") on node \"ip-10-0-128-206.ec2.internal\" DevicePath \"\""
May 28 10:08:41.154232 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:08:41.154200    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="02839c99-e06b-4998-9442-2329b6210f0c" path="/var/lib/kubelet/pods/02839c99-e06b-4998-9442-2329b6210f0c/volumes"
May 28 10:09:02.177416 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:09:02.177363    2565 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0"
May 28 10:09:02.192916 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:09:02.192890    2565 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0"
May 28 10:09:02.990331 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:09:02.990287    2565 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0"
May 28 10:10:15.055914 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:10:15.055883    2565 kubelet.go:1628] "Image garbage collection succeeded"
May 28 10:11:05.352086 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:11:05.351998    2565 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["test-ns-feast/feast-simple-feast-setup-67c544c456-pm7k6"]
May 28 10:11:05.352634 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:11:05.352471    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="02839c99-e06b-4998-9442-2329b6210f0c" containerName="console"
May 28 10:11:05.352634 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:11:05.352490    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="02839c99-e06b-4998-9442-2329b6210f0c" containerName="console"
May 28 10:11:05.352634 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:11:05.352566    2565 memory_manager.go:356] "RemoveStaleState removing state" podUID="02839c99-e06b-4998-9442-2329b6210f0c" containerName="console"
May 28 10:11:05.355505 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:11:05.355487    2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-67c544c456-pm7k6"
May 28 10:11:05.358289 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:11:05.358267    2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-registry-tls\""
May 28 10:11:05.358618 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:11:05.358592    2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-ui-tls\""
May 28 10:11:05.358972 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:11:05.358954    2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-intra-comm\""
May 28 10:11:05.359106 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:11:05.359084    2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-offline-tls\""
May 28 10:11:05.359208 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:11:05.359190    2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast\"/\"openshift-service-ca.crt\""
May 28 10:11:05.359371 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:11:05.358993    2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-online-tls\""
May 28 10:11:05.359452 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:11:05.359359    2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast\"/\"kube-root-ca.crt\""
May 28 10:11:05.359452 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:11:05.359093    2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-dockercfg-kqdfl\""
May 28 10:11:05.368531 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:11:05.368506    2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-67c544c456-pm7k6"]
May 28 10:11:05.481457 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:11:05.481429    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vd4lq\" (UniqueName: \"kubernetes.io/projected/d459b851-57ec-41c6-87ce-1d7f394971a8-kube-api-access-vd4lq\") pod \"feast-simple-feast-setup-67c544c456-pm7k6\" (UID: \"d459b851-57ec-41c6-87ce-1d7f394971a8\") " pod="test-ns-feast/feast-simple-feast-setup-67c544c456-pm7k6"
May 28 10:11:05.481609 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:11:05.481474    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/d459b851-57ec-41c6-87ce-1d7f394971a8-ui-tls\") pod \"feast-simple-feast-setup-67c544c456-pm7k6\" (UID: \"d459b851-57ec-41c6-87ce-1d7f394971a8\") " pod="test-ns-feast/feast-simple-feast-setup-67c544c456-pm7k6"
May 28 10:11:05.481609 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:11:05.481499    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/d459b851-57ec-41c6-87ce-1d7f394971a8-feast-data\") pod \"feast-simple-feast-setup-67c544c456-pm7k6\" (UID: \"d459b851-57ec-41c6-87ce-1d7f394971a8\") " pod="test-ns-feast/feast-simple-feast-setup-67c544c456-pm7k6"
May 28 10:11:05.481609 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:11:05.481560    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/d459b851-57ec-41c6-87ce-1d7f394971a8-registry-tls\") pod \"feast-simple-feast-setup-67c544c456-pm7k6\" (UID: \"d459b851-57ec-41c6-87ce-1d7f394971a8\") " pod="test-ns-feast/feast-simple-feast-setup-67c544c456-pm7k6"
May 28 10:11:05.481609 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:11:05.481604    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/d459b851-57ec-41c6-87ce-1d7f394971a8-offline-tls\") pod \"feast-simple-feast-setup-67c544c456-pm7k6\" (UID: \"d459b851-57ec-41c6-87ce-1d7f394971a8\") " pod="test-ns-feast/feast-simple-feast-setup-67c544c456-pm7k6"
May 28 10:11:05.481769 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:11:05.481628    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/d459b851-57ec-41c6-87ce-1d7f394971a8-online-tls\") pod \"feast-simple-feast-setup-67c544c456-pm7k6\" (UID: \"d459b851-57ec-41c6-87ce-1d7f394971a8\") " pod="test-ns-feast/feast-simple-feast-setup-67c544c456-pm7k6"
May 28 10:11:05.582700 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:11:05.582670    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/d459b851-57ec-41c6-87ce-1d7f394971a8-offline-tls\") pod \"feast-simple-feast-setup-67c544c456-pm7k6\" (UID: \"d459b851-57ec-41c6-87ce-1d7f394971a8\") " pod="test-ns-feast/feast-simple-feast-setup-67c544c456-pm7k6"
May 28 10:11:05.582834 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:11:05.582714    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/d459b851-57ec-41c6-87ce-1d7f394971a8-online-tls\") pod \"feast-simple-feast-setup-67c544c456-pm7k6\" (UID: \"d459b851-57ec-41c6-87ce-1d7f394971a8\") " pod="test-ns-feast/feast-simple-feast-setup-67c544c456-pm7k6"
May 28 10:11:05.582834 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:11:05.582739    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-vd4lq\" (UniqueName: \"kubernetes.io/projected/d459b851-57ec-41c6-87ce-1d7f394971a8-kube-api-access-vd4lq\") pod \"feast-simple-feast-setup-67c544c456-pm7k6\" (UID: \"d459b851-57ec-41c6-87ce-1d7f394971a8\") " pod="test-ns-feast/feast-simple-feast-setup-67c544c456-pm7k6"
May 28 10:11:05.582834 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:11:05.582770    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/d459b851-57ec-41c6-87ce-1d7f394971a8-ui-tls\") pod \"feast-simple-feast-setup-67c544c456-pm7k6\" (UID: \"d459b851-57ec-41c6-87ce-1d7f394971a8\") " pod="test-ns-feast/feast-simple-feast-setup-67c544c456-pm7k6"
May 28 10:11:05.582834 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:11:05.582788    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/d459b851-57ec-41c6-87ce-1d7f394971a8-feast-data\") pod \"feast-simple-feast-setup-67c544c456-pm7k6\" (UID: \"d459b851-57ec-41c6-87ce-1d7f394971a8\") " pod="test-ns-feast/feast-simple-feast-setup-67c544c456-pm7k6"
May 28 10:11:05.582834 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:11:05.582806    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/d459b851-57ec-41c6-87ce-1d7f394971a8-registry-tls\") pod \"feast-simple-feast-setup-67c544c456-pm7k6\" (UID: \"d459b851-57ec-41c6-87ce-1d7f394971a8\") " pod="test-ns-feast/feast-simple-feast-setup-67c544c456-pm7k6"
May 28 10:11:05.583081 ip-10-0-128-206 kubenswrapper[2565]: E0528 10:11:05.582830    2565 secret.go:189] Couldn't get secret test-ns-feast/feast-simple-feast-setup-online-tls: secret "feast-simple-feast-setup-online-tls" not found
May 28 10:11:05.583081 ip-10-0-128-206 kubenswrapper[2565]: E0528 10:11:05.582896    2565 secret.go:189] Couldn't get secret test-ns-feast/feast-simple-feast-setup-ui-tls: secret "feast-simple-feast-setup-ui-tls" not found
May 28 10:11:05.583081 ip-10-0-128-206 kubenswrapper[2565]: E0528 10:11:05.582923    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d459b851-57ec-41c6-87ce-1d7f394971a8-online-tls podName:d459b851-57ec-41c6-87ce-1d7f394971a8 nodeName:}" failed. No retries permitted until 2026-05-28 10:11:06.08290062 +0000 UTC m=+351.543234749 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "online-tls" (UniqueName: "kubernetes.io/secret/d459b851-57ec-41c6-87ce-1d7f394971a8-online-tls") pod "feast-simple-feast-setup-67c544c456-pm7k6" (UID: "d459b851-57ec-41c6-87ce-1d7f394971a8") : secret "feast-simple-feast-setup-online-tls" not found
May 28 10:11:05.583081 ip-10-0-128-206 kubenswrapper[2565]: E0528 10:11:05.582958    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d459b851-57ec-41c6-87ce-1d7f394971a8-ui-tls podName:d459b851-57ec-41c6-87ce-1d7f394971a8 nodeName:}" failed. No retries permitted until 2026-05-28 10:11:06.082942554 +0000 UTC m=+351.543276701 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "ui-tls" (UniqueName: "kubernetes.io/secret/d459b851-57ec-41c6-87ce-1d7f394971a8-ui-tls") pod "feast-simple-feast-setup-67c544c456-pm7k6" (UID: "d459b851-57ec-41c6-87ce-1d7f394971a8") : secret "feast-simple-feast-setup-ui-tls" not found
May 28 10:11:05.583294 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:11:05.583280    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/d459b851-57ec-41c6-87ce-1d7f394971a8-feast-data\") pod \"feast-simple-feast-setup-67c544c456-pm7k6\" (UID: \"d459b851-57ec-41c6-87ce-1d7f394971a8\") " pod="test-ns-feast/feast-simple-feast-setup-67c544c456-pm7k6"
May 28 10:11:05.585189 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:11:05.585163    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/d459b851-57ec-41c6-87ce-1d7f394971a8-registry-tls\") pod \"feast-simple-feast-setup-67c544c456-pm7k6\" (UID: \"d459b851-57ec-41c6-87ce-1d7f394971a8\") " pod="test-ns-feast/feast-simple-feast-setup-67c544c456-pm7k6"
May 28 10:11:05.585298 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:11:05.585278    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/d459b851-57ec-41c6-87ce-1d7f394971a8-offline-tls\") pod \"feast-simple-feast-setup-67c544c456-pm7k6\" (UID: \"d459b851-57ec-41c6-87ce-1d7f394971a8\") " pod="test-ns-feast/feast-simple-feast-setup-67c544c456-pm7k6"
May 28 10:11:05.592022 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:11:05.591992    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vd4lq\" (UniqueName: \"kubernetes.io/projected/d459b851-57ec-41c6-87ce-1d7f394971a8-kube-api-access-vd4lq\") pod \"feast-simple-feast-setup-67c544c456-pm7k6\" (UID: \"d459b851-57ec-41c6-87ce-1d7f394971a8\") " pod="test-ns-feast/feast-simple-feast-setup-67c544c456-pm7k6"
May 28 10:11:06.086632 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:11:06.086585    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/d459b851-57ec-41c6-87ce-1d7f394971a8-ui-tls\") pod \"feast-simple-feast-setup-67c544c456-pm7k6\" (UID: \"d459b851-57ec-41c6-87ce-1d7f394971a8\") " pod="test-ns-feast/feast-simple-feast-setup-67c544c456-pm7k6"
May 28 10:11:06.086815 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:11:06.086668    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/d459b851-57ec-41c6-87ce-1d7f394971a8-online-tls\") pod \"feast-simple-feast-setup-67c544c456-pm7k6\" (UID: \"d459b851-57ec-41c6-87ce-1d7f394971a8\") " pod="test-ns-feast/feast-simple-feast-setup-67c544c456-pm7k6"
May 28 10:11:06.089032 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:11:06.089007    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/d459b851-57ec-41c6-87ce-1d7f394971a8-ui-tls\") pod \"feast-simple-feast-setup-67c544c456-pm7k6\" (UID: \"d459b851-57ec-41c6-87ce-1d7f394971a8\") " pod="test-ns-feast/feast-simple-feast-setup-67c544c456-pm7k6"
May 28 10:11:06.089135 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:11:06.089053    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/d459b851-57ec-41c6-87ce-1d7f394971a8-online-tls\") pod \"feast-simple-feast-setup-67c544c456-pm7k6\" (UID: \"d459b851-57ec-41c6-87ce-1d7f394971a8\") " pod="test-ns-feast/feast-simple-feast-setup-67c544c456-pm7k6"
May 28 10:11:06.277771 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:11:06.277732    2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-67c544c456-pm7k6"
May 28 10:11:06.410305 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:11:06.410278    2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-67c544c456-pm7k6"]
May 28 10:11:06.411276 ip-10-0-128-206 kubenswrapper[2565]: W0528 10:11:06.411251    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podd459b851_57ec_41c6_87ce_1d7f394971a8.slice/crio-16a72fe93ea89abebd1d382d29cfbcd098ee05df60fd14bb933dbb900010f4a3 WatchSource:0}: Error finding container 16a72fe93ea89abebd1d382d29cfbcd098ee05df60fd14bb933dbb900010f4a3: Status 404 returned error can't find the container with id 16a72fe93ea89abebd1d382d29cfbcd098ee05df60fd14bb933dbb900010f4a3
May 28 10:11:06.412933 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:11:06.412919    2565 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
May 28 10:11:07.295276 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:11:07.295211    2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-67c544c456-pm7k6" event={"ID":"d459b851-57ec-41c6-87ce-1d7f394971a8","Type":"ContainerStarted","Data":"16a72fe93ea89abebd1d382d29cfbcd098ee05df60fd14bb933dbb900010f4a3"}
May 28 10:11:39.386275 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:11:39.386239    2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-67c544c456-pm7k6" event={"ID":"d459b851-57ec-41c6-87ce-1d7f394971a8","Type":"ContainerStarted","Data":"3c2d6b0551f60e5ea4fa54fe5a54d9b13046c39f94d40d1d8ed31a313c4bbb8a"}
May 28 10:11:44.400358 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:11:44.400306    2565 generic.go:358] "Generic (PLEG): container finished" podID="d459b851-57ec-41c6-87ce-1d7f394971a8" containerID="3c2d6b0551f60e5ea4fa54fe5a54d9b13046c39f94d40d1d8ed31a313c4bbb8a" exitCode=0
May 28 10:11:44.400358 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:11:44.400337    2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-67c544c456-pm7k6" event={"ID":"d459b851-57ec-41c6-87ce-1d7f394971a8","Type":"ContainerDied","Data":"3c2d6b0551f60e5ea4fa54fe5a54d9b13046c39f94d40d1d8ed31a313c4bbb8a"}
May 28 10:11:45.404855 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:11:45.404818    2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-67c544c456-pm7k6" event={"ID":"d459b851-57ec-41c6-87ce-1d7f394971a8","Type":"ContainerStarted","Data":"88ee11dfc46590277e3856bc84cc82d0a6b1515397dcf69345f9e76345a2d757"}
May 28 10:11:50.421277 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:11:50.421245    2565 generic.go:358] "Generic (PLEG): container finished" podID="d459b851-57ec-41c6-87ce-1d7f394971a8" containerID="88ee11dfc46590277e3856bc84cc82d0a6b1515397dcf69345f9e76345a2d757" exitCode=0
May 28 10:11:50.421646 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:11:50.421344    2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-67c544c456-pm7k6" event={"ID":"d459b851-57ec-41c6-87ce-1d7f394971a8","Type":"ContainerDied","Data":"88ee11dfc46590277e3856bc84cc82d0a6b1515397dcf69345f9e76345a2d757"}
May 28 10:11:50.430366 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:11:50.430349    2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-intra-comm\""
May 28 10:11:51.428359 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:11:51.428294    2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-67c544c456-pm7k6" event={"ID":"d459b851-57ec-41c6-87ce-1d7f394971a8","Type":"ContainerStarted","Data":"5eb6b2ddf854fe0f427141125aedac05264966b98fd3be96831cf48d8c797a3c"}
May 28 10:11:51.428836 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:11:51.428370    2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-67c544c456-pm7k6" event={"ID":"d459b851-57ec-41c6-87ce-1d7f394971a8","Type":"ContainerStarted","Data":"80e243d4dafbe8421871b8527a3a8b0b05bc8331dcf58737856a13e7528a9df7"}
May 28 10:11:51.428836 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:11:51.428385    2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-67c544c456-pm7k6" event={"ID":"d459b851-57ec-41c6-87ce-1d7f394971a8","Type":"ContainerStarted","Data":"7e3b14cfa70587dfbfad9d9654208a8b7957e71b29566dcff6bd4ae8dc9b8256"}
May 28 10:11:51.428836 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:11:51.428397    2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-67c544c456-pm7k6" event={"ID":"d459b851-57ec-41c6-87ce-1d7f394971a8","Type":"ContainerStarted","Data":"cbedca71de5703e44433f2e5a83b2e03453a7776ed613abb5e65b4b80e16be61"}
May 28 10:11:51.463761 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:11:51.463698    2565 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="test-ns-feast/feast-simple-feast-setup-67c544c456-pm7k6" podStartSLOduration=13.655228587 podStartE2EDuration="46.463675347s" podCreationTimestamp="2026-05-28 10:11:05 +0000 UTC" firstStartedPulling="2026-05-28 10:11:06.413041416 +0000 UTC m=+351.873375545" lastFinishedPulling="2026-05-28 10:11:39.221488163 +0000 UTC m=+384.681822305" observedRunningTime="2026-05-28 10:11:51.462108966 +0000 UTC m=+396.922443117" watchObservedRunningTime="2026-05-28 10:11:51.463675347 +0000 UTC m=+396.924009500"
May 28 10:11:54.278659 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:11:54.278617    2565 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-67c544c456-pm7k6"
May 28 10:11:54.278659 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:11:54.278667    2565 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-67c544c456-pm7k6"
May 28 10:11:54.279183 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:11:54.278682    2565 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-67c544c456-pm7k6"
May 28 10:11:54.279183 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:11:54.278694    2565 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-67c544c456-pm7k6"
May 28 10:11:54.280640 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:11:54.280596    2565 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-67c544c456-pm7k6" podUID="d459b851-57ec-41c6-87ce-1d7f394971a8" containerName="ui" probeResult="failure" output="dial tcp 10.133.0.18:8443: connect: connection refused"
May 28 10:11:54.280640 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:11:54.280629    2565 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-67c544c456-pm7k6" podUID="d459b851-57ec-41c6-87ce-1d7f394971a8" containerName="offline" probeResult="failure" output="dial tcp 10.133.0.18:8816: connect: connection refused"
May 28 10:11:54.280856 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:11:54.280635    2565 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-67c544c456-pm7k6" podUID="d459b851-57ec-41c6-87ce-1d7f394971a8" containerName="registry" probeResult="failure" output="dial tcp 10.133.0.18:6571: connect: connection refused"
May 28 10:11:54.280856 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:11:54.280690    2565 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-67c544c456-pm7k6" podUID="d459b851-57ec-41c6-87ce-1d7f394971a8" containerName="online" probeResult="failure" output="Get \"https://10.133.0.18:6567/health\": dial tcp 10.133.0.18:6567: connect: connection refused"
May 28 10:11:56.278348 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:11:56.278295    2565 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-67c544c456-pm7k6"
May 28 10:11:56.278348 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:11:56.278357    2565 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-67c544c456-pm7k6"
May 28 10:11:56.278741 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:11:56.278366    2565 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-67c544c456-pm7k6"
May 28 10:11:56.278741 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:11:56.278375    2565 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-67c544c456-pm7k6"
May 28 10:11:57.279630 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:11:57.279593    2565 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-67c544c456-pm7k6"
May 28 10:11:57.279980 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:11:57.279755    2565 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-67c544c456-pm7k6"
May 28 10:11:57.280091 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:11:57.280071    2565 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-67c544c456-pm7k6"
May 28 10:11:57.280473 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:11:57.280450    2565 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-67c544c456-pm7k6"
May 28 10:11:57.280586 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:11:57.280496    2565 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-67c544c456-pm7k6"
May 28 10:11:57.281460 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:11:57.281441    2565 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-67c544c456-pm7k6"
May 28 10:11:57.284252 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:11:57.284233    2565 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-67c544c456-pm7k6"
May 28 10:11:57.453745 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:11:57.453718    2565 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-67c544c456-pm7k6"
May 28 10:12:58.669373 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:12:58.669336    2565 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-67c544c456-pm7k6"]
May 28 10:12:58.669838 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:12:58.669663    2565 kuberuntime_container.go:864] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-67c544c456-pm7k6" podUID="d459b851-57ec-41c6-87ce-1d7f394971a8" containerName="registry" containerID="cri-o://cbedca71de5703e44433f2e5a83b2e03453a7776ed613abb5e65b4b80e16be61" gracePeriod=30
May 28 10:12:58.669838 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:12:58.669729    2565 kuberuntime_container.go:864] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-67c544c456-pm7k6" podUID="d459b851-57ec-41c6-87ce-1d7f394971a8" containerName="ui" containerID="cri-o://5eb6b2ddf854fe0f427141125aedac05264966b98fd3be96831cf48d8c797a3c" gracePeriod=30
May 28 10:12:58.669838 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:12:58.669721    2565 kuberuntime_container.go:864] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-67c544c456-pm7k6" podUID="d459b851-57ec-41c6-87ce-1d7f394971a8" containerName="offline" containerID="cri-o://80e243d4dafbe8421871b8527a3a8b0b05bc8331dcf58737856a13e7528a9df7" gracePeriod=30
May 28 10:12:58.669838 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:12:58.669741    2565 kuberuntime_container.go:864] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-67c544c456-pm7k6" podUID="d459b851-57ec-41c6-87ce-1d7f394971a8" containerName="online" containerID="cri-o://7e3b14cfa70587dfbfad9d9654208a8b7957e71b29566dcff6bd4ae8dc9b8256" gracePeriod=30
May 28 10:12:58.916954 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:12:58.916918    2565 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["test-ns-feast/feast-simple-feast-setup-67c544c456-c9mrg"]
May 28 10:12:58.921160 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:12:58.921112    2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-67c544c456-c9mrg"
May 28 10:12:58.924052 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:12:58.924027    2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-dockercfg-7g47n\""
May 28 10:12:58.935895 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:12:58.935870    2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-67c544c456-c9mrg"]
May 28 10:12:58.940775 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:12:58.940752    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/82cfaf0d-784e-4581-96ec-54cce23ea99b-online-tls\") pod \"feast-simple-feast-setup-67c544c456-c9mrg\" (UID: \"82cfaf0d-784e-4581-96ec-54cce23ea99b\") " pod="test-ns-feast/feast-simple-feast-setup-67c544c456-c9mrg"
May 28 10:12:58.940881 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:12:58.940788    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/82cfaf0d-784e-4581-96ec-54cce23ea99b-feast-data\") pod \"feast-simple-feast-setup-67c544c456-c9mrg\" (UID: \"82cfaf0d-784e-4581-96ec-54cce23ea99b\") " pod="test-ns-feast/feast-simple-feast-setup-67c544c456-c9mrg"
May 28 10:12:58.940881 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:12:58.940824    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sb5qc\" (UniqueName: \"kubernetes.io/projected/82cfaf0d-784e-4581-96ec-54cce23ea99b-kube-api-access-sb5qc\") pod \"feast-simple-feast-setup-67c544c456-c9mrg\" (UID: \"82cfaf0d-784e-4581-96ec-54cce23ea99b\") " pod="test-ns-feast/feast-simple-feast-setup-67c544c456-c9mrg"
May 28 10:12:58.940955 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:12:58.940900    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/82cfaf0d-784e-4581-96ec-54cce23ea99b-offline-tls\") pod \"feast-simple-feast-setup-67c544c456-c9mrg\" (UID: \"82cfaf0d-784e-4581-96ec-54cce23ea99b\") " pod="test-ns-feast/feast-simple-feast-setup-67c544c456-c9mrg"
May 28 10:12:58.940955 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:12:58.940940    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/82cfaf0d-784e-4581-96ec-54cce23ea99b-ui-tls\") pod \"feast-simple-feast-setup-67c544c456-c9mrg\" (UID: \"82cfaf0d-784e-4581-96ec-54cce23ea99b\") " pod="test-ns-feast/feast-simple-feast-setup-67c544c456-c9mrg"
May 28 10:12:58.941032 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:12:58.940996    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/82cfaf0d-784e-4581-96ec-54cce23ea99b-registry-tls\") pod \"feast-simple-feast-setup-67c544c456-c9mrg\" (UID: \"82cfaf0d-784e-4581-96ec-54cce23ea99b\") " pod="test-ns-feast/feast-simple-feast-setup-67c544c456-c9mrg"
May 28 10:12:59.041945 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:12:59.041910    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/82cfaf0d-784e-4581-96ec-54cce23ea99b-ui-tls\") pod \"feast-simple-feast-setup-67c544c456-c9mrg\" (UID: \"82cfaf0d-784e-4581-96ec-54cce23ea99b\") " pod="test-ns-feast/feast-simple-feast-setup-67c544c456-c9mrg"
May 28 10:12:59.042143 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:12:59.041963    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/82cfaf0d-784e-4581-96ec-54cce23ea99b-registry-tls\") pod \"feast-simple-feast-setup-67c544c456-c9mrg\" (UID: \"82cfaf0d-784e-4581-96ec-54cce23ea99b\") " pod="test-ns-feast/feast-simple-feast-setup-67c544c456-c9mrg"
May 28 10:12:59.042143 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:12:59.041996    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/82cfaf0d-784e-4581-96ec-54cce23ea99b-online-tls\") pod \"feast-simple-feast-setup-67c544c456-c9mrg\" (UID: \"82cfaf0d-784e-4581-96ec-54cce23ea99b\") " pod="test-ns-feast/feast-simple-feast-setup-67c544c456-c9mrg"
May 28 10:12:59.042143 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:12:59.042015    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/82cfaf0d-784e-4581-96ec-54cce23ea99b-feast-data\") pod \"feast-simple-feast-setup-67c544c456-c9mrg\" (UID: \"82cfaf0d-784e-4581-96ec-54cce23ea99b\") " pod="test-ns-feast/feast-simple-feast-setup-67c544c456-c9mrg"
May 28 10:12:59.042143 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:12:59.042043    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-sb5qc\" (UniqueName: \"kubernetes.io/projected/82cfaf0d-784e-4581-96ec-54cce23ea99b-kube-api-access-sb5qc\") pod \"feast-simple-feast-setup-67c544c456-c9mrg\" (UID: \"82cfaf0d-784e-4581-96ec-54cce23ea99b\") " pod="test-ns-feast/feast-simple-feast-setup-67c544c456-c9mrg"
May 28 10:12:59.042143 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:12:59.042073    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/82cfaf0d-784e-4581-96ec-54cce23ea99b-offline-tls\") pod \"feast-simple-feast-setup-67c544c456-c9mrg\" (UID: \"82cfaf0d-784e-4581-96ec-54cce23ea99b\") " pod="test-ns-feast/feast-simple-feast-setup-67c544c456-c9mrg"
May 28 10:12:59.042143 ip-10-0-128-206 kubenswrapper[2565]: E0528 10:12:59.042073    2565 secret.go:189] Couldn't get secret test-ns-feast/feast-simple-feast-setup-ui-tls: secret "feast-simple-feast-setup-ui-tls" not found
May 28 10:12:59.042499 ip-10-0-128-206 kubenswrapper[2565]: E0528 10:12:59.042151    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/82cfaf0d-784e-4581-96ec-54cce23ea99b-ui-tls podName:82cfaf0d-784e-4581-96ec-54cce23ea99b nodeName:}" failed. No retries permitted until 2026-05-28 10:12:59.542129698 +0000 UTC m=+465.002463827 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "ui-tls" (UniqueName: "kubernetes.io/secret/82cfaf0d-784e-4581-96ec-54cce23ea99b-ui-tls") pod "feast-simple-feast-setup-67c544c456-c9mrg" (UID: "82cfaf0d-784e-4581-96ec-54cce23ea99b") : secret "feast-simple-feast-setup-ui-tls" not found
May 28 10:12:59.042499 ip-10-0-128-206 kubenswrapper[2565]: E0528 10:12:59.042155    2565 secret.go:189] Couldn't get secret test-ns-feast/feast-simple-feast-setup-registry-tls: secret "feast-simple-feast-setup-registry-tls" not found
May 28 10:12:59.042499 ip-10-0-128-206 kubenswrapper[2565]: E0528 10:12:59.042170    2565 secret.go:189] Couldn't get secret test-ns-feast/feast-simple-feast-setup-offline-tls: secret "feast-simple-feast-setup-offline-tls" not found
May 28 10:12:59.042499 ip-10-0-128-206 kubenswrapper[2565]: E0528 10:12:59.042213    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/82cfaf0d-784e-4581-96ec-54cce23ea99b-registry-tls podName:82cfaf0d-784e-4581-96ec-54cce23ea99b nodeName:}" failed. No retries permitted until 2026-05-28 10:12:59.542197547 +0000 UTC m=+465.002531684 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/secret/82cfaf0d-784e-4581-96ec-54cce23ea99b-registry-tls") pod "feast-simple-feast-setup-67c544c456-c9mrg" (UID: "82cfaf0d-784e-4581-96ec-54cce23ea99b") : secret "feast-simple-feast-setup-registry-tls" not found
May 28 10:12:59.042499 ip-10-0-128-206 kubenswrapper[2565]: E0528 10:12:59.042229    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/82cfaf0d-784e-4581-96ec-54cce23ea99b-offline-tls podName:82cfaf0d-784e-4581-96ec-54cce23ea99b nodeName:}" failed. No retries permitted until 2026-05-28 10:12:59.542221546 +0000 UTC m=+465.002555675 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "offline-tls" (UniqueName: "kubernetes.io/secret/82cfaf0d-784e-4581-96ec-54cce23ea99b-offline-tls") pod "feast-simple-feast-setup-67c544c456-c9mrg" (UID: "82cfaf0d-784e-4581-96ec-54cce23ea99b") : secret "feast-simple-feast-setup-offline-tls" not found
May 28 10:12:59.042715 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:12:59.042523    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/82cfaf0d-784e-4581-96ec-54cce23ea99b-feast-data\") pod \"feast-simple-feast-setup-67c544c456-c9mrg\" (UID: \"82cfaf0d-784e-4581-96ec-54cce23ea99b\") " pod="test-ns-feast/feast-simple-feast-setup-67c544c456-c9mrg"
May 28 10:12:59.044663 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:12:59.044641    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/82cfaf0d-784e-4581-96ec-54cce23ea99b-online-tls\") pod \"feast-simple-feast-setup-67c544c456-c9mrg\" (UID: \"82cfaf0d-784e-4581-96ec-54cce23ea99b\") " pod="test-ns-feast/feast-simple-feast-setup-67c544c456-c9mrg"
May 28 10:12:59.054296 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:12:59.054260    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sb5qc\" (UniqueName: \"kubernetes.io/projected/82cfaf0d-784e-4581-96ec-54cce23ea99b-kube-api-access-sb5qc\") pod \"feast-simple-feast-setup-67c544c456-c9mrg\" (UID: \"82cfaf0d-784e-4581-96ec-54cce23ea99b\") " pod="test-ns-feast/feast-simple-feast-setup-67c544c456-c9mrg"
May 28 10:12:59.546769 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:12:59.546739    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/82cfaf0d-784e-4581-96ec-54cce23ea99b-ui-tls\") pod \"feast-simple-feast-setup-67c544c456-c9mrg\" (UID: \"82cfaf0d-784e-4581-96ec-54cce23ea99b\") " pod="test-ns-feast/feast-simple-feast-setup-67c544c456-c9mrg"
May 28 10:12:59.546894 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:12:59.546787    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/82cfaf0d-784e-4581-96ec-54cce23ea99b-registry-tls\") pod \"feast-simple-feast-setup-67c544c456-c9mrg\" (UID: \"82cfaf0d-784e-4581-96ec-54cce23ea99b\") " pod="test-ns-feast/feast-simple-feast-setup-67c544c456-c9mrg"
May 28 10:12:59.546894 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:12:59.546836    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/82cfaf0d-784e-4581-96ec-54cce23ea99b-offline-tls\") pod \"feast-simple-feast-setup-67c544c456-c9mrg\" (UID: \"82cfaf0d-784e-4581-96ec-54cce23ea99b\") " pod="test-ns-feast/feast-simple-feast-setup-67c544c456-c9mrg"
May 28 10:12:59.549237 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:12:59.549213    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/82cfaf0d-784e-4581-96ec-54cce23ea99b-offline-tls\") pod \"feast-simple-feast-setup-67c544c456-c9mrg\" (UID: \"82cfaf0d-784e-4581-96ec-54cce23ea99b\") " pod="test-ns-feast/feast-simple-feast-setup-67c544c456-c9mrg"
May 28 10:12:59.549364 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:12:59.549249    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/82cfaf0d-784e-4581-96ec-54cce23ea99b-ui-tls\") pod \"feast-simple-feast-setup-67c544c456-c9mrg\" (UID: \"82cfaf0d-784e-4581-96ec-54cce23ea99b\") " pod="test-ns-feast/feast-simple-feast-setup-67c544c456-c9mrg"
May 28 10:12:59.549364 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:12:59.549305    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/82cfaf0d-784e-4581-96ec-54cce23ea99b-registry-tls\") pod \"feast-simple-feast-setup-67c544c456-c9mrg\" (UID: \"82cfaf0d-784e-4581-96ec-54cce23ea99b\") " pod="test-ns-feast/feast-simple-feast-setup-67c544c456-c9mrg"
May 28 10:12:59.618201 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:12:59.618167    2565 generic.go:358] "Generic (PLEG): container finished" podID="d459b851-57ec-41c6-87ce-1d7f394971a8" containerID="5eb6b2ddf854fe0f427141125aedac05264966b98fd3be96831cf48d8c797a3c" exitCode=0
May 28 10:12:59.618201 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:12:59.618192    2565 generic.go:358] "Generic (PLEG): container finished" podID="d459b851-57ec-41c6-87ce-1d7f394971a8" containerID="7e3b14cfa70587dfbfad9d9654208a8b7957e71b29566dcff6bd4ae8dc9b8256" exitCode=0
May 28 10:12:59.618404 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:12:59.618233    2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-67c544c456-pm7k6" event={"ID":"d459b851-57ec-41c6-87ce-1d7f394971a8","Type":"ContainerDied","Data":"5eb6b2ddf854fe0f427141125aedac05264966b98fd3be96831cf48d8c797a3c"}
May 28 10:12:59.618404 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:12:59.618255    2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-67c544c456-pm7k6" event={"ID":"d459b851-57ec-41c6-87ce-1d7f394971a8","Type":"ContainerDied","Data":"7e3b14cfa70587dfbfad9d9654208a8b7957e71b29566dcff6bd4ae8dc9b8256"}
May 28 10:12:59.830558 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:12:59.830463    2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-67c544c456-c9mrg"
May 28 10:12:59.961653 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:12:59.961629    2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-67c544c456-c9mrg"]
May 28 10:12:59.963297 ip-10-0-128-206 kubenswrapper[2565]: W0528 10:12:59.963272    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod82cfaf0d_784e_4581_96ec_54cce23ea99b.slice/crio-c49fc88f36762c9b7ee45bacee9d79708689dcee016d9ba36d0b302549f5e878 WatchSource:0}: Error finding container c49fc88f36762c9b7ee45bacee9d79708689dcee016d9ba36d0b302549f5e878: Status 404 returned error can't find the container with id c49fc88f36762c9b7ee45bacee9d79708689dcee016d9ba36d0b302549f5e878
May 28 10:13:00.623033 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:13:00.622988    2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-67c544c456-c9mrg" event={"ID":"82cfaf0d-784e-4581-96ec-54cce23ea99b","Type":"ContainerStarted","Data":"c3d6c5149c3ce3fe3f00d00c5bd875d4692df6b4eefe6c19c471270938cad005"}
May 28 10:13:00.623033 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:13:00.623035    2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-67c544c456-c9mrg" event={"ID":"82cfaf0d-784e-4581-96ec-54cce23ea99b","Type":"ContainerStarted","Data":"c49fc88f36762c9b7ee45bacee9d79708689dcee016d9ba36d0b302549f5e878"}
May 28 10:13:04.636632 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:13:04.636591    2565 generic.go:358] "Generic (PLEG): container finished" podID="82cfaf0d-784e-4581-96ec-54cce23ea99b" containerID="c3d6c5149c3ce3fe3f00d00c5bd875d4692df6b4eefe6c19c471270938cad005" exitCode=0
May 28 10:13:04.636982 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:13:04.636665    2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-67c544c456-c9mrg" event={"ID":"82cfaf0d-784e-4581-96ec-54cce23ea99b","Type":"ContainerDied","Data":"c3d6c5149c3ce3fe3f00d00c5bd875d4692df6b4eefe6c19c471270938cad005"}
May 28 10:13:05.641391 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:13:05.641355    2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-67c544c456-c9mrg" event={"ID":"82cfaf0d-784e-4581-96ec-54cce23ea99b","Type":"ContainerStarted","Data":"ce7f9f2da871a3c638c512ddf2f4f7aaa16d7565704252c22adb4f0dda680648"}
May 28 10:13:07.281179 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:13:07.281128    2565 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-67c544c456-pm7k6" podUID="d459b851-57ec-41c6-87ce-1d7f394971a8" containerName="ui" probeResult="failure" output="dial tcp 10.133.0.18:8443: connect: connection refused"
May 28 10:13:07.451279 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:13:07.451230    2565 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-67c544c456-pm7k6" podUID="d459b851-57ec-41c6-87ce-1d7f394971a8" containerName="online" probeResult="failure" output="Get \"https://10.133.0.18:6567/health\": dial tcp 10.133.0.18:6567: connect: connection refused"
May 28 10:13:10.660474 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:13:10.660440    2565 generic.go:358] "Generic (PLEG): container finished" podID="82cfaf0d-784e-4581-96ec-54cce23ea99b" containerID="ce7f9f2da871a3c638c512ddf2f4f7aaa16d7565704252c22adb4f0dda680648" exitCode=0
May 28 10:13:10.660825 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:13:10.660503    2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-67c544c456-c9mrg" event={"ID":"82cfaf0d-784e-4581-96ec-54cce23ea99b","Type":"ContainerDied","Data":"ce7f9f2da871a3c638c512ddf2f4f7aaa16d7565704252c22adb4f0dda680648"}
May 28 10:13:11.667164 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:13:11.667121    2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-67c544c456-c9mrg" event={"ID":"82cfaf0d-784e-4581-96ec-54cce23ea99b","Type":"ContainerStarted","Data":"7b775d8c7ff3c3b96d51b13362c6638651ce40c50c13ed44d503aa7af6eba513"}
May 28 10:13:11.667164 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:13:11.667171    2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-67c544c456-c9mrg" event={"ID":"82cfaf0d-784e-4581-96ec-54cce23ea99b","Type":"ContainerStarted","Data":"def49523bcc503d336499441bd5e8fdc60c0c1d61c9e99fa17d755db794df1c9"}
May 28 10:13:11.667708 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:13:11.667186    2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-67c544c456-c9mrg" event={"ID":"82cfaf0d-784e-4581-96ec-54cce23ea99b","Type":"ContainerStarted","Data":"9b7aaf8bd64bea885dab96c4ecfa3a896d7b7d1d396dc72928149a95225a878f"}
May 28 10:13:11.667708 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:13:11.667201    2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-67c544c456-c9mrg" event={"ID":"82cfaf0d-784e-4581-96ec-54cce23ea99b","Type":"ContainerStarted","Data":"47f6e045a95f5931c0498969583f61fa05e8285f272d14e99548c203eb537fe9"}
May 28 10:13:11.698718 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:13:11.698656    2565 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="test-ns-feast/feast-simple-feast-setup-67c544c456-c9mrg" podStartSLOduration=13.698637597 podStartE2EDuration="13.698637597s" podCreationTimestamp="2026-05-28 10:12:58 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-28 10:13:11.697648044 +0000 UTC m=+477.157982222" watchObservedRunningTime="2026-05-28 10:13:11.698637597 +0000 UTC m=+477.158971761"
May 28 10:13:11.831326 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:13:11.831266    2565 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-67c544c456-c9mrg"
May 28 10:13:11.831511 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:13:11.831336    2565 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-67c544c456-c9mrg"
May 28 10:13:11.831511 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:13:11.831352    2565 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-67c544c456-c9mrg"
May 28 10:13:11.831511 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:13:11.831364    2565 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-67c544c456-c9mrg"
May 28 10:13:11.833427 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:13:11.833293    2565 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-67c544c456-c9mrg" podUID="82cfaf0d-784e-4581-96ec-54cce23ea99b" containerName="ui" probeResult="failure" output="dial tcp 10.133.0.19:8443: connect: connection refused"
May 28 10:13:11.833427 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:13:11.833334    2565 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-67c544c456-c9mrg" podUID="82cfaf0d-784e-4581-96ec-54cce23ea99b" containerName="registry" probeResult="failure" output="dial tcp 10.133.0.19:6571: connect: connection refused"
May 28 10:13:11.833427 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:13:11.833355    2565 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-67c544c456-c9mrg" podUID="82cfaf0d-784e-4581-96ec-54cce23ea99b" containerName="offline" probeResult="failure" output="dial tcp 10.133.0.19:8816: connect: connection refused"
May 28 10:13:11.833427 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:13:11.833420    2565 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-67c544c456-c9mrg" podUID="82cfaf0d-784e-4581-96ec-54cce23ea99b" containerName="online" probeResult="failure" output="Get \"https://10.133.0.19:6567/health\": dial tcp 10.133.0.19:6567: connect: connection refused"
May 28 10:13:14.831761 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:13:14.831592    2565 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-67c544c456-c9mrg" podUID="82cfaf0d-784e-4581-96ec-54cce23ea99b" containerName="registry" probeResult="failure" output="dial tcp 10.133.0.19:6571: connect: connection refused"
May 28 10:13:14.831761 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:13:14.831635    2565 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-67c544c456-c9mrg" podUID="82cfaf0d-784e-4581-96ec-54cce23ea99b" containerName="offline" probeResult="failure" output="dial tcp 10.133.0.19:8816: connect: connection refused"
May 28 10:13:14.831761 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:13:14.831672    2565 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-67c544c456-c9mrg" podUID="82cfaf0d-784e-4581-96ec-54cce23ea99b" containerName="online" probeResult="failure" output="Get \"https://10.133.0.19:6567/health\": dial tcp 10.133.0.19:6567: connect: connection refused"
May 28 10:13:14.831761 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:13:14.831592    2565 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-67c544c456-c9mrg" podUID="82cfaf0d-784e-4581-96ec-54cce23ea99b" containerName="ui" probeResult="failure" output="dial tcp 10.133.0.19:8443: connect: connection refused"
May 28 10:13:17.280698 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:13:17.280648    2565 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-67c544c456-pm7k6" podUID="d459b851-57ec-41c6-87ce-1d7f394971a8" containerName="ui" probeResult="failure" output="dial tcp 10.133.0.18:8443: connect: connection refused"
May 28 10:13:17.451395 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:13:17.451356    2565 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-67c544c456-pm7k6" podUID="d459b851-57ec-41c6-87ce-1d7f394971a8" containerName="online" probeResult="failure" output="Get \"https://10.133.0.18:6567/health\": dial tcp 10.133.0.18:6567: connect: connection refused"
May 28 10:13:17.831641 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:13:17.831606    2565 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-67c544c456-c9mrg"
May 28 10:13:17.831797 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:13:17.831706    2565 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-67c544c456-c9mrg"
May 28 10:13:17.831838 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:13:17.831800    2565 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-67c544c456-c9mrg"
May 28 10:13:17.832338 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:13:17.832298    2565 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-67c544c456-c9mrg"
May 28 10:13:17.832454 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:13:17.832348    2565 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-67c544c456-c9mrg"
May 28 10:13:17.832454 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:13:17.832363    2565 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-67c544c456-c9mrg"
May 28 10:13:17.832454 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:13:17.832407    2565 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-67c544c456-c9mrg"
May 28 10:13:17.832580 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:13:17.832496    2565 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-67c544c456-c9mrg"
May 28 10:13:17.832775 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:13:17.832755    2565 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-67c544c456-c9mrg"
May 28 10:13:17.836243 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:13:17.836226    2565 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-67c544c456-c9mrg"
May 28 10:13:18.689948 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:13:18.689923    2565 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-67c544c456-c9mrg"
May 28 10:13:18.692908 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:13:18.692886    2565 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-67c544c456-c9mrg"
May 28 10:13:27.280561 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:13:27.280518    2565 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-67c544c456-pm7k6" podUID="d459b851-57ec-41c6-87ce-1d7f394971a8" containerName="ui" probeResult="failure" output="dial tcp 10.133.0.18:8443: connect: connection refused"
May 28 10:13:27.281022 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:13:27.280750    2565 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-67c544c456-pm7k6"
May 28 10:13:27.451634 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:13:27.451592    2565 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-67c544c456-pm7k6" podUID="d459b851-57ec-41c6-87ce-1d7f394971a8" containerName="online" probeResult="failure" output="Get \"https://10.133.0.18:6567/health\": dial tcp 10.133.0.18:6567: connect: connection refused"
May 28 10:13:27.451782 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:13:27.451754    2565 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-67c544c456-pm7k6"
May 28 10:13:28.723622 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:13:28.723592    2565 generic.go:358] "Generic (PLEG): container finished" podID="d459b851-57ec-41c6-87ce-1d7f394971a8" containerID="80e243d4dafbe8421871b8527a3a8b0b05bc8331dcf58737856a13e7528a9df7" exitCode=137
May 28 10:13:28.723622 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:13:28.723616    2565 generic.go:358] "Generic (PLEG): container finished" podID="d459b851-57ec-41c6-87ce-1d7f394971a8" containerID="cbedca71de5703e44433f2e5a83b2e03453a7776ed613abb5e65b4b80e16be61" exitCode=137
May 28 10:13:28.724000 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:13:28.723661    2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-67c544c456-pm7k6" event={"ID":"d459b851-57ec-41c6-87ce-1d7f394971a8","Type":"ContainerDied","Data":"80e243d4dafbe8421871b8527a3a8b0b05bc8331dcf58737856a13e7528a9df7"}
May 28 10:13:28.724000 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:13:28.723703    2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-67c544c456-pm7k6" event={"ID":"d459b851-57ec-41c6-87ce-1d7f394971a8","Type":"ContainerDied","Data":"cbedca71de5703e44433f2e5a83b2e03453a7776ed613abb5e65b4b80e16be61"}
May 28 10:13:29.310173 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:13:29.310151    2565 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-67c544c456-pm7k6"
May 28 10:13:29.387223 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:13:29.387192    2565 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/d459b851-57ec-41c6-87ce-1d7f394971a8-feast-data\") pod \"d459b851-57ec-41c6-87ce-1d7f394971a8\" (UID: \"d459b851-57ec-41c6-87ce-1d7f394971a8\") "
May 28 10:13:29.387424 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:13:29.387250    2565 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vd4lq\" (UniqueName: \"kubernetes.io/projected/d459b851-57ec-41c6-87ce-1d7f394971a8-kube-api-access-vd4lq\") pod \"d459b851-57ec-41c6-87ce-1d7f394971a8\" (UID: \"d459b851-57ec-41c6-87ce-1d7f394971a8\") "
May 28 10:13:29.387424 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:13:29.387284    2565 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/d459b851-57ec-41c6-87ce-1d7f394971a8-registry-tls\") pod \"d459b851-57ec-41c6-87ce-1d7f394971a8\" (UID: \"d459b851-57ec-41c6-87ce-1d7f394971a8\") "
May 28 10:13:29.387424 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:13:29.387305    2565 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/d459b851-57ec-41c6-87ce-1d7f394971a8-offline-tls\") pod \"d459b851-57ec-41c6-87ce-1d7f394971a8\" (UID: \"d459b851-57ec-41c6-87ce-1d7f394971a8\") "
May 28 10:13:29.387424 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:13:29.387387    2565 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/d459b851-57ec-41c6-87ce-1d7f394971a8-ui-tls\") pod \"d459b851-57ec-41c6-87ce-1d7f394971a8\" (UID: \"d459b851-57ec-41c6-87ce-1d7f394971a8\") "
May 28 10:13:29.387424 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:13:29.387411    2565 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/d459b851-57ec-41c6-87ce-1d7f394971a8-online-tls\") pod \"d459b851-57ec-41c6-87ce-1d7f394971a8\" (UID: \"d459b851-57ec-41c6-87ce-1d7f394971a8\") "
May 28 10:13:29.387879 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:13:29.387845    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d459b851-57ec-41c6-87ce-1d7f394971a8-feast-data" (OuterVolumeSpecName: "feast-data") pod "d459b851-57ec-41c6-87ce-1d7f394971a8" (UID: "d459b851-57ec-41c6-87ce-1d7f394971a8"). InnerVolumeSpecName "feast-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 28 10:13:29.389890 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:13:29.389865    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d459b851-57ec-41c6-87ce-1d7f394971a8-ui-tls" (OuterVolumeSpecName: "ui-tls") pod "d459b851-57ec-41c6-87ce-1d7f394971a8" (UID: "d459b851-57ec-41c6-87ce-1d7f394971a8"). InnerVolumeSpecName "ui-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 28 10:13:29.390111 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:13:29.390081    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d459b851-57ec-41c6-87ce-1d7f394971a8-kube-api-access-vd4lq" (OuterVolumeSpecName: "kube-api-access-vd4lq") pod "d459b851-57ec-41c6-87ce-1d7f394971a8" (UID: "d459b851-57ec-41c6-87ce-1d7f394971a8"). InnerVolumeSpecName "kube-api-access-vd4lq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 28 10:13:29.390111 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:13:29.390105    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d459b851-57ec-41c6-87ce-1d7f394971a8-online-tls" (OuterVolumeSpecName: "online-tls") pod "d459b851-57ec-41c6-87ce-1d7f394971a8" (UID: "d459b851-57ec-41c6-87ce-1d7f394971a8"). InnerVolumeSpecName "online-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 28 10:13:29.390231 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:13:29.390131    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d459b851-57ec-41c6-87ce-1d7f394971a8-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "d459b851-57ec-41c6-87ce-1d7f394971a8" (UID: "d459b851-57ec-41c6-87ce-1d7f394971a8"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 28 10:13:29.390231 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:13:29.390170    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d459b851-57ec-41c6-87ce-1d7f394971a8-offline-tls" (OuterVolumeSpecName: "offline-tls") pod "d459b851-57ec-41c6-87ce-1d7f394971a8" (UID: "d459b851-57ec-41c6-87ce-1d7f394971a8"). InnerVolumeSpecName "offline-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 28 10:13:29.488333 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:13:29.488227    2565 reconciler_common.go:299] "Volume detached for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/d459b851-57ec-41c6-87ce-1d7f394971a8-ui-tls\") on node \"ip-10-0-128-206.ec2.internal\" DevicePath \"\""
May 28 10:13:29.488333 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:13:29.488256    2565 reconciler_common.go:299] "Volume detached for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/d459b851-57ec-41c6-87ce-1d7f394971a8-online-tls\") on node \"ip-10-0-128-206.ec2.internal\" DevicePath \"\""
May 28 10:13:29.488333 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:13:29.488267    2565 reconciler_common.go:299] "Volume detached for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/d459b851-57ec-41c6-87ce-1d7f394971a8-feast-data\") on node \"ip-10-0-128-206.ec2.internal\" DevicePath \"\""
May 28 10:13:29.488333 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:13:29.488277    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vd4lq\" (UniqueName: \"kubernetes.io/projected/d459b851-57ec-41c6-87ce-1d7f394971a8-kube-api-access-vd4lq\") on node \"ip-10-0-128-206.ec2.internal\" DevicePath \"\""
May 28 10:13:29.488333 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:13:29.488286    2565 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/d459b851-57ec-41c6-87ce-1d7f394971a8-registry-tls\") on node \"ip-10-0-128-206.ec2.internal\" DevicePath \"\""
May 28 10:13:29.488333 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:13:29.488294    2565 reconciler_common.go:299] "Volume detached for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/d459b851-57ec-41c6-87ce-1d7f394971a8-offline-tls\") on node \"ip-10-0-128-206.ec2.internal\" DevicePath \"\""
May 28 10:13:29.729174 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:13:29.729141    2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-67c544c456-pm7k6" event={"ID":"d459b851-57ec-41c6-87ce-1d7f394971a8","Type":"ContainerDied","Data":"16a72fe93ea89abebd1d382d29cfbcd098ee05df60fd14bb933dbb900010f4a3"}
May 28 10:13:29.729678 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:13:29.729193    2565 scope.go:117] "RemoveContainer" containerID="5eb6b2ddf854fe0f427141125aedac05264966b98fd3be96831cf48d8c797a3c"
May 28 10:13:29.729678 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:13:29.729210    2565 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-67c544c456-pm7k6"
May 28 10:13:29.737920 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:13:29.737902    2565 scope.go:117] "RemoveContainer" containerID="80e243d4dafbe8421871b8527a3a8b0b05bc8331dcf58737856a13e7528a9df7"
May 28 10:13:29.745035 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:13:29.745011    2565 scope.go:117] "RemoveContainer" containerID="7e3b14cfa70587dfbfad9d9654208a8b7957e71b29566dcff6bd4ae8dc9b8256"
May 28 10:13:29.752211 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:13:29.752185    2565 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-67c544c456-pm7k6"]
May 28 10:13:29.753089 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:13:29.753074    2565 scope.go:117] "RemoveContainer" containerID="cbedca71de5703e44433f2e5a83b2e03453a7776ed613abb5e65b4b80e16be61"
May 28 10:13:29.755199 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:13:29.755177    2565 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-67c544c456-pm7k6"]
May 28 10:13:29.760591 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:13:29.760573    2565 scope.go:117] "RemoveContainer" containerID="88ee11dfc46590277e3856bc84cc82d0a6b1515397dcf69345f9e76345a2d757"
May 28 10:13:29.767526 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:13:29.767504    2565 scope.go:117] "RemoveContainer" containerID="3c2d6b0551f60e5ea4fa54fe5a54d9b13046c39f94d40d1d8ed31a313c4bbb8a"
May 28 10:13:31.154414 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:13:31.154383    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d459b851-57ec-41c6-87ce-1d7f394971a8" path="/var/lib/kubelet/pods/d459b851-57ec-41c6-87ce-1d7f394971a8/volumes"
May 28 10:14:20.597139 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:14:20.597101    2565 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-79bbc6b9fd-nkwgn"]
May 28 10:14:20.597574 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:14:20.597382    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d459b851-57ec-41c6-87ce-1d7f394971a8" containerName="offline"
May 28 10:14:20.597574 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:14:20.597393    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="d459b851-57ec-41c6-87ce-1d7f394971a8" containerName="offline"
May 28 10:14:20.597574 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:14:20.597408    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d459b851-57ec-41c6-87ce-1d7f394971a8" containerName="ui"
May 28 10:14:20.597574 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:14:20.597415    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="d459b851-57ec-41c6-87ce-1d7f394971a8" containerName="ui"
May 28 10:14:20.597574 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:14:20.597421    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d459b851-57ec-41c6-87ce-1d7f394971a8" containerName="registry"
May 28 10:14:20.597574 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:14:20.597427    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="d459b851-57ec-41c6-87ce-1d7f394971a8" containerName="registry"
May 28 10:14:20.597574 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:14:20.597433    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d459b851-57ec-41c6-87ce-1d7f394971a8" containerName="feast-apply"
May 28 10:14:20.597574 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:14:20.597438    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="d459b851-57ec-41c6-87ce-1d7f394971a8" containerName="feast-apply"
May 28 10:14:20.597574 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:14:20.597446    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d459b851-57ec-41c6-87ce-1d7f394971a8" containerName="feast-init"
May 28 10:14:20.597574 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:14:20.597452    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="d459b851-57ec-41c6-87ce-1d7f394971a8" containerName="feast-init"
May 28 10:14:20.597574 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:14:20.597458    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d459b851-57ec-41c6-87ce-1d7f394971a8" containerName="online"
May 28 10:14:20.597574 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:14:20.597463    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="d459b851-57ec-41c6-87ce-1d7f394971a8" containerName="online"
May 28 10:14:20.597574 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:14:20.597505    2565 memory_manager.go:356] "RemoveStaleState removing state" podUID="d459b851-57ec-41c6-87ce-1d7f394971a8" containerName="online"
May 28 10:14:20.597574 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:14:20.597515    2565 memory_manager.go:356] "RemoveStaleState removing state" podUID="d459b851-57ec-41c6-87ce-1d7f394971a8" containerName="offline"
May 28 10:14:20.597574 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:14:20.597521    2565 memory_manager.go:356] "RemoveStaleState removing state" podUID="d459b851-57ec-41c6-87ce-1d7f394971a8" containerName="registry"
May 28 10:14:20.597574 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:14:20.597527    2565 memory_manager.go:356] "RemoveStaleState removing state" podUID="d459b851-57ec-41c6-87ce-1d7f394971a8" containerName="ui"
May 28 10:14:20.601495 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:14:20.601479    2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-79bbc6b9fd-nkwgn"
May 28 10:14:20.605267 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:14:20.605246    2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-client-ca\""
May 28 10:14:20.609235 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:14:20.609218    2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-remote-registry\"/\"openshift-service-ca.crt\""
May 28 10:14:20.609350 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:14:20.609244    2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-ui-tls\""
May 28 10:14:20.609498 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:14:20.609482    2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-intra-comm\""
May 28 10:14:20.609572 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:14:20.609549    2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-remote-registry\"/\"kube-root-ca.crt\""
May 28 10:14:20.609692 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:14:20.609673    2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-online-tls\""
May 28 10:14:20.612540 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:14:20.612523    2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-offline-tls\""
May 28 10:14:20.612728 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:14:20.612716    2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-dockercfg-7kkkx\""
May 28 10:14:20.657120 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:14:20.657083    2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-79bbc6b9fd-nkwgn"]
May 28 10:14:20.670780 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:14:20.670748    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/417dbd1f-c29c-4d54-8ba9-206195ed8352-feast-data\") pod \"feast-simple-feast-remote-setup-79bbc6b9fd-nkwgn\" (UID: \"417dbd1f-c29c-4d54-8ba9-206195ed8352\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-79bbc6b9fd-nkwgn"
May 28 10:14:20.670924 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:14:20.670785    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/417dbd1f-c29c-4d54-8ba9-206195ed8352-offline-tls\") pod \"feast-simple-feast-remote-setup-79bbc6b9fd-nkwgn\" (UID: \"417dbd1f-c29c-4d54-8ba9-206195ed8352\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-79bbc6b9fd-nkwgn"
May 28 10:14:20.670924 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:14:20.670813    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/417dbd1f-c29c-4d54-8ba9-206195ed8352-online-tls\") pod \"feast-simple-feast-remote-setup-79bbc6b9fd-nkwgn\" (UID: \"417dbd1f-c29c-4d54-8ba9-206195ed8352\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-79bbc6b9fd-nkwgn"
May 28 10:14:20.670924 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:14:20.670865    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/configmap/417dbd1f-c29c-4d54-8ba9-206195ed8352-registry-tls\") pod \"feast-simple-feast-remote-setup-79bbc6b9fd-nkwgn\" (UID: \"417dbd1f-c29c-4d54-8ba9-206195ed8352\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-79bbc6b9fd-nkwgn"
May 28 10:14:20.671047 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:14:20.670947    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/417dbd1f-c29c-4d54-8ba9-206195ed8352-ui-tls\") pod \"feast-simple-feast-remote-setup-79bbc6b9fd-nkwgn\" (UID: \"417dbd1f-c29c-4d54-8ba9-206195ed8352\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-79bbc6b9fd-nkwgn"
May 28 10:14:20.671047 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:14:20.670988    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z6fb5\" (UniqueName: \"kubernetes.io/projected/417dbd1f-c29c-4d54-8ba9-206195ed8352-kube-api-access-z6fb5\") pod \"feast-simple-feast-remote-setup-79bbc6b9fd-nkwgn\" (UID: \"417dbd1f-c29c-4d54-8ba9-206195ed8352\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-79bbc6b9fd-nkwgn"
May 28 10:14:20.771844 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:14:20.771806    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/417dbd1f-c29c-4d54-8ba9-206195ed8352-feast-data\") pod \"feast-simple-feast-remote-setup-79bbc6b9fd-nkwgn\" (UID: \"417dbd1f-c29c-4d54-8ba9-206195ed8352\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-79bbc6b9fd-nkwgn"
May 28 10:14:20.771844 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:14:20.771847    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/417dbd1f-c29c-4d54-8ba9-206195ed8352-offline-tls\") pod \"feast-simple-feast-remote-setup-79bbc6b9fd-nkwgn\" (UID: \"417dbd1f-c29c-4d54-8ba9-206195ed8352\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-79bbc6b9fd-nkwgn"
May 28 10:14:20.772092 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:14:20.771872    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/417dbd1f-c29c-4d54-8ba9-206195ed8352-online-tls\") pod \"feast-simple-feast-remote-setup-79bbc6b9fd-nkwgn\" (UID: \"417dbd1f-c29c-4d54-8ba9-206195ed8352\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-79bbc6b9fd-nkwgn"
May 28 10:14:20.772092 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:14:20.771992    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/configmap/417dbd1f-c29c-4d54-8ba9-206195ed8352-registry-tls\") pod \"feast-simple-feast-remote-setup-79bbc6b9fd-nkwgn\" (UID: \"417dbd1f-c29c-4d54-8ba9-206195ed8352\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-79bbc6b9fd-nkwgn"
May 28 10:14:20.772092 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:14:20.772090    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/417dbd1f-c29c-4d54-8ba9-206195ed8352-ui-tls\") pod \"feast-simple-feast-remote-setup-79bbc6b9fd-nkwgn\" (UID: \"417dbd1f-c29c-4d54-8ba9-206195ed8352\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-79bbc6b9fd-nkwgn"
May 28 10:14:20.772257 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:14:20.772159    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-z6fb5\" (UniqueName: \"kubernetes.io/projected/417dbd1f-c29c-4d54-8ba9-206195ed8352-kube-api-access-z6fb5\") pod \"feast-simple-feast-remote-setup-79bbc6b9fd-nkwgn\" (UID: \"417dbd1f-c29c-4d54-8ba9-206195ed8352\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-79bbc6b9fd-nkwgn"
May 28 10:14:20.772342 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:14:20.772272    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/417dbd1f-c29c-4d54-8ba9-206195ed8352-feast-data\") pod \"feast-simple-feast-remote-setup-79bbc6b9fd-nkwgn\" (UID: \"417dbd1f-c29c-4d54-8ba9-206195ed8352\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-79bbc6b9fd-nkwgn"
May 28 10:14:20.772915 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:14:20.772891    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/configmap/417dbd1f-c29c-4d54-8ba9-206195ed8352-registry-tls\") pod \"feast-simple-feast-remote-setup-79bbc6b9fd-nkwgn\" (UID: \"417dbd1f-c29c-4d54-8ba9-206195ed8352\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-79bbc6b9fd-nkwgn"
May 28 10:14:20.774620 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:14:20.774601    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/417dbd1f-c29c-4d54-8ba9-206195ed8352-offline-tls\") pod \"feast-simple-feast-remote-setup-79bbc6b9fd-nkwgn\" (UID: \"417dbd1f-c29c-4d54-8ba9-206195ed8352\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-79bbc6b9fd-nkwgn"
May 28 10:14:20.774620 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:14:20.774617    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/417dbd1f-c29c-4d54-8ba9-206195ed8352-online-tls\") pod \"feast-simple-feast-remote-setup-79bbc6b9fd-nkwgn\" (UID: \"417dbd1f-c29c-4d54-8ba9-206195ed8352\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-79bbc6b9fd-nkwgn"
May 28 10:14:20.774758 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:14:20.774653    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/417dbd1f-c29c-4d54-8ba9-206195ed8352-ui-tls\") pod \"feast-simple-feast-remote-setup-79bbc6b9fd-nkwgn\" (UID: \"417dbd1f-c29c-4d54-8ba9-206195ed8352\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-79bbc6b9fd-nkwgn"
May 28 10:14:20.782645 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:14:20.782623    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-z6fb5\" (UniqueName: \"kubernetes.io/projected/417dbd1f-c29c-4d54-8ba9-206195ed8352-kube-api-access-z6fb5\") pod \"feast-simple-feast-remote-setup-79bbc6b9fd-nkwgn\" (UID: \"417dbd1f-c29c-4d54-8ba9-206195ed8352\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-79bbc6b9fd-nkwgn"
May 28 10:14:20.910706 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:14:20.910625    2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-79bbc6b9fd-nkwgn"
May 28 10:14:21.048255 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:14:21.048228    2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-79bbc6b9fd-nkwgn"]
May 28 10:14:21.050383 ip-10-0-128-206 kubenswrapper[2565]: W0528 10:14:21.050356    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod417dbd1f_c29c_4d54_8ba9_206195ed8352.slice/crio-b389a269b192d117470f21098876b940d025901cb1563dceb659031d05a1e8e7 WatchSource:0}: Error finding container b389a269b192d117470f21098876b940d025901cb1563dceb659031d05a1e8e7: Status 404 returned error can't find the container with id b389a269b192d117470f21098876b940d025901cb1563dceb659031d05a1e8e7
May 28 10:14:21.870734 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:14:21.870699    2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-79bbc6b9fd-nkwgn" event={"ID":"417dbd1f-c29c-4d54-8ba9-206195ed8352","Type":"ContainerStarted","Data":"779d6ec63957d15f4c7fde7518575d9942e30554cef70e223b6be606bda9c6ff"}
May 28 10:14:21.870734 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:14:21.870736    2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-79bbc6b9fd-nkwgn" event={"ID":"417dbd1f-c29c-4d54-8ba9-206195ed8352","Type":"ContainerStarted","Data":"b389a269b192d117470f21098876b940d025901cb1563dceb659031d05a1e8e7"}
May 28 10:14:25.883800 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:14:25.883766    2565 generic.go:358] "Generic (PLEG): container finished" podID="417dbd1f-c29c-4d54-8ba9-206195ed8352" containerID="779d6ec63957d15f4c7fde7518575d9942e30554cef70e223b6be606bda9c6ff" exitCode=0
May 28 10:14:25.884185 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:14:25.883839    2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-79bbc6b9fd-nkwgn" event={"ID":"417dbd1f-c29c-4d54-8ba9-206195ed8352","Type":"ContainerDied","Data":"779d6ec63957d15f4c7fde7518575d9942e30554cef70e223b6be606bda9c6ff"}
May 28 10:14:26.888200 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:14:26.888168    2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-79bbc6b9fd-nkwgn" event={"ID":"417dbd1f-c29c-4d54-8ba9-206195ed8352","Type":"ContainerStarted","Data":"d7ddf38a71f493a84c04b0ba71ce4e0698039692c0798c2f6eeb0ab7db2d1327"}
May 28 10:14:31.903121 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:14:31.903089    2565 generic.go:358] "Generic (PLEG): container finished" podID="417dbd1f-c29c-4d54-8ba9-206195ed8352" containerID="d7ddf38a71f493a84c04b0ba71ce4e0698039692c0798c2f6eeb0ab7db2d1327" exitCode=0
May 28 10:14:31.903502 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:14:31.903151    2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-79bbc6b9fd-nkwgn" event={"ID":"417dbd1f-c29c-4d54-8ba9-206195ed8352","Type":"ContainerDied","Data":"d7ddf38a71f493a84c04b0ba71ce4e0698039692c0798c2f6eeb0ab7db2d1327"}
May 28 10:14:32.909846 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:14:32.909807    2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-79bbc6b9fd-nkwgn" event={"ID":"417dbd1f-c29c-4d54-8ba9-206195ed8352","Type":"ContainerStarted","Data":"5aab1214048f3fa909711d00189f79fc0cd77bda3ed0fd93816fdd9b801dd908"}
May 28 10:14:32.909846 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:14:32.909849    2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-79bbc6b9fd-nkwgn" event={"ID":"417dbd1f-c29c-4d54-8ba9-206195ed8352","Type":"ContainerStarted","Data":"f5fce263692546df3394bf78fb50413d2c8e12a7cf4f80abd52efca68d698035"}
May 28 10:14:32.910390 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:14:32.909859    2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-79bbc6b9fd-nkwgn" event={"ID":"417dbd1f-c29c-4d54-8ba9-206195ed8352","Type":"ContainerStarted","Data":"89d940bbfeeed0b3bc53bb2442160923340d4a7e32958e507696c3133b31ee71"}
May 28 10:14:32.911364 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:14:32.911339    2565 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-79bbc6b9fd-nkwgn"
May 28 10:14:32.911463 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:14:32.911379    2565 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-79bbc6b9fd-nkwgn"
May 28 10:14:32.911463 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:14:32.911393    2565 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-79bbc6b9fd-nkwgn"
May 28 10:14:32.912942 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:14:32.912897    2565 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-79bbc6b9fd-nkwgn" podUID="417dbd1f-c29c-4d54-8ba9-206195ed8352" containerName="online" probeResult="failure" output="Get \"https://10.133.0.20:6567/health\": dial tcp 10.133.0.20:6567: connect: connection refused"
May 28 10:14:32.913061 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:14:32.912902    2565 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-79bbc6b9fd-nkwgn" podUID="417dbd1f-c29c-4d54-8ba9-206195ed8352" containerName="ui" probeResult="failure" output="dial tcp 10.133.0.20:8443: connect: connection refused"
May 28 10:14:32.913061 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:14:32.912910    2565 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-79bbc6b9fd-nkwgn" podUID="417dbd1f-c29c-4d54-8ba9-206195ed8352" containerName="offline" probeResult="failure" output="dial tcp 10.133.0.20:8816: connect: connection refused"
May 28 10:14:32.937296 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:14:32.937239    2565 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-79bbc6b9fd-nkwgn" podStartSLOduration=12.93721878 podStartE2EDuration="12.93721878s" podCreationTimestamp="2026-05-28 10:14:20 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-28 10:14:32.934443773 +0000 UTC m=+558.394777948" watchObservedRunningTime="2026-05-28 10:14:32.93721878 +0000 UTC m=+558.397552933"
May 28 10:14:35.911118 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:14:35.911065    2565 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-79bbc6b9fd-nkwgn" podUID="417dbd1f-c29c-4d54-8ba9-206195ed8352" containerName="ui" probeResult="failure" output="dial tcp 10.133.0.20:8443: connect: connection refused"
May 28 10:14:35.911599 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:14:35.911090    2565 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-79bbc6b9fd-nkwgn" podUID="417dbd1f-c29c-4d54-8ba9-206195ed8352" containerName="offline" probeResult="failure" output="dial tcp 10.133.0.20:8816: connect: connection refused"
May 28 10:14:35.911599 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:14:35.911159    2565 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-79bbc6b9fd-nkwgn" podUID="417dbd1f-c29c-4d54-8ba9-206195ed8352" containerName="online" probeResult="failure" output="Get \"https://10.133.0.20:6567/health\": dial tcp 10.133.0.20:6567: connect: connection refused"
May 28 10:14:38.912616 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:14:38.912584    2565 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-79bbc6b9fd-nkwgn"
May 28 10:14:38.913072 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:14:38.912687    2565 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-79bbc6b9fd-nkwgn"
May 28 10:14:38.913072 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:14:38.913032    2565 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-79bbc6b9fd-nkwgn"
May 28 10:14:38.913072 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:14:38.913066    2565 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-79bbc6b9fd-nkwgn"
May 28 10:14:38.913455 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:14:38.913436    2565 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-79bbc6b9fd-nkwgn"
May 28 10:14:38.913522 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:14:38.913478    2565 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-79bbc6b9fd-nkwgn"
May 28 10:14:38.916766 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:14:38.916750    2565 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-79bbc6b9fd-nkwgn"
May 28 10:14:38.933801 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:14:38.933777    2565 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-79bbc6b9fd-nkwgn"
May 28 10:14:38.936590 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:14:38.936564    2565 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-79bbc6b9fd-nkwgn"
May 28 10:15:41.838115 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:15:41.837916    2565 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-79bbc6b9fd-nkwgn"]
May 28 10:15:41.838678 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:15:41.838349    2565 kuberuntime_container.go:864] "Killing container with a grace period" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-79bbc6b9fd-nkwgn" podUID="417dbd1f-c29c-4d54-8ba9-206195ed8352" containerName="online" containerID="cri-o://89d940bbfeeed0b3bc53bb2442160923340d4a7e32958e507696c3133b31ee71" gracePeriod=30
May 28 10:15:41.838678 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:15:41.838424    2565 kuberuntime_container.go:864] "Killing container with a grace period" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-79bbc6b9fd-nkwgn" podUID="417dbd1f-c29c-4d54-8ba9-206195ed8352" containerName="offline" containerID="cri-o://f5fce263692546df3394bf78fb50413d2c8e12a7cf4f80abd52efca68d698035" gracePeriod=30
May 28 10:15:41.838678 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:15:41.838435    2565 kuberuntime_container.go:864] "Killing container with a grace period" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-79bbc6b9fd-nkwgn" podUID="417dbd1f-c29c-4d54-8ba9-206195ed8352" containerName="ui" containerID="cri-o://5aab1214048f3fa909711d00189f79fc0cd77bda3ed0fd93816fdd9b801dd908" gracePeriod=30
May 28 10:15:41.927951 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:15:41.927918    2565 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-67c544c456-c9mrg"]
May 28 10:15:41.928399 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:15:41.928374    2565 kuberuntime_container.go:864] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-67c544c456-c9mrg" podUID="82cfaf0d-784e-4581-96ec-54cce23ea99b" containerName="registry" containerID="cri-o://47f6e045a95f5931c0498969583f61fa05e8285f272d14e99548c203eb537fe9" gracePeriod=30
May 28 10:15:41.928509 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:15:41.928486    2565 kuberuntime_container.go:864] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-67c544c456-c9mrg" podUID="82cfaf0d-784e-4581-96ec-54cce23ea99b" containerName="online" containerID="cri-o://9b7aaf8bd64bea885dab96c4ecfa3a896d7b7d1d396dc72928149a95225a878f" gracePeriod=30
May 28 10:15:41.928573 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:15:41.928488    2565 kuberuntime_container.go:864] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-67c544c456-c9mrg" podUID="82cfaf0d-784e-4581-96ec-54cce23ea99b" containerName="ui" containerID="cri-o://7b775d8c7ff3c3b96d51b13362c6638651ce40c50c13ed44d503aa7af6eba513" gracePeriod=30
May 28 10:15:41.928573 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:15:41.928480    2565 kuberuntime_container.go:864] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-67c544c456-c9mrg" podUID="82cfaf0d-784e-4581-96ec-54cce23ea99b" containerName="offline" containerID="cri-o://def49523bcc503d336499441bd5e8fdc60c0c1d61c9e99fa17d755db794df1c9" gracePeriod=30
May 28 10:15:43.115038 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:15:43.114996    2565 generic.go:358] "Generic (PLEG): container finished" podID="417dbd1f-c29c-4d54-8ba9-206195ed8352" containerID="5aab1214048f3fa909711d00189f79fc0cd77bda3ed0fd93816fdd9b801dd908" exitCode=0
May 28 10:15:43.115038 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:15:43.115018    2565 generic.go:358] "Generic (PLEG): container finished" podID="417dbd1f-c29c-4d54-8ba9-206195ed8352" containerID="89d940bbfeeed0b3bc53bb2442160923340d4a7e32958e507696c3133b31ee71" exitCode=0
May 28 10:15:43.115480 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:15:43.115072    2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-79bbc6b9fd-nkwgn" event={"ID":"417dbd1f-c29c-4d54-8ba9-206195ed8352","Type":"ContainerDied","Data":"5aab1214048f3fa909711d00189f79fc0cd77bda3ed0fd93816fdd9b801dd908"}
May 28 10:15:43.115480 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:15:43.115119    2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-79bbc6b9fd-nkwgn" event={"ID":"417dbd1f-c29c-4d54-8ba9-206195ed8352","Type":"ContainerDied","Data":"89d940bbfeeed0b3bc53bb2442160923340d4a7e32958e507696c3133b31ee71"}
May 28 10:15:43.117554 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:15:43.117534    2565 generic.go:358] "Generic (PLEG): container finished" podID="82cfaf0d-784e-4581-96ec-54cce23ea99b" containerID="7b775d8c7ff3c3b96d51b13362c6638651ce40c50c13ed44d503aa7af6eba513" exitCode=0
May 28 10:15:43.117554 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:15:43.117554    2565 generic.go:358] "Generic (PLEG): container finished" podID="82cfaf0d-784e-4581-96ec-54cce23ea99b" containerID="9b7aaf8bd64bea885dab96c4ecfa3a896d7b7d1d396dc72928149a95225a878f" exitCode=0
May 28 10:15:43.117695 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:15:43.117579    2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-67c544c456-c9mrg" event={"ID":"82cfaf0d-784e-4581-96ec-54cce23ea99b","Type":"ContainerDied","Data":"7b775d8c7ff3c3b96d51b13362c6638651ce40c50c13ed44d503aa7af6eba513"}
May 28 10:15:43.117695 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:15:43.117602    2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-67c544c456-c9mrg" event={"ID":"82cfaf0d-784e-4581-96ec-54cce23ea99b","Type":"ContainerDied","Data":"9b7aaf8bd64bea885dab96c4ecfa3a896d7b7d1d396dc72928149a95225a878f"}
May 28 10:15:47.832612 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:15:47.832570    2565 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-67c544c456-c9mrg" podUID="82cfaf0d-784e-4581-96ec-54cce23ea99b" containerName="ui" probeResult="failure" output="dial tcp 10.133.0.19:8443: connect: connection refused"
May 28 10:15:48.691101 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:15:48.691058    2565 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-67c544c456-c9mrg" podUID="82cfaf0d-784e-4581-96ec-54cce23ea99b" containerName="online" probeResult="failure" output="Get \"https://10.133.0.19:6567/health\": dial tcp 10.133.0.19:6567: connect: connection refused"
May 28 10:15:48.914126 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:15:48.914078    2565 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-79bbc6b9fd-nkwgn" podUID="417dbd1f-c29c-4d54-8ba9-206195ed8352" containerName="ui" probeResult="failure" output="dial tcp 10.133.0.20:8443: connect: connection refused"
May 28 10:15:48.934467 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:15:48.934426    2565 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-79bbc6b9fd-nkwgn" podUID="417dbd1f-c29c-4d54-8ba9-206195ed8352" containerName="online" probeResult="failure" output="Get \"https://10.133.0.20:6567/health\": dial tcp 10.133.0.20:6567: connect: connection refused"
May 28 10:15:57.833174 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:15:57.833105    2565 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-67c544c456-c9mrg" podUID="82cfaf0d-784e-4581-96ec-54cce23ea99b" containerName="ui" probeResult="failure" output="dial tcp 10.133.0.19:8443: connect: connection refused"
May 28 10:15:58.690852 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:15:58.690809    2565 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-67c544c456-c9mrg" podUID="82cfaf0d-784e-4581-96ec-54cce23ea99b" containerName="online" probeResult="failure" output="Get \"https://10.133.0.19:6567/health\": dial tcp 10.133.0.19:6567: connect: connection refused"
May 28 10:15:58.913800 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:15:58.913750    2565 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-79bbc6b9fd-nkwgn" podUID="417dbd1f-c29c-4d54-8ba9-206195ed8352" containerName="ui" probeResult="failure" output="dial tcp 10.133.0.20:8443: connect: connection refused"
May 28 10:15:58.934633 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:15:58.934589    2565 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-79bbc6b9fd-nkwgn" podUID="417dbd1f-c29c-4d54-8ba9-206195ed8352" containerName="online" probeResult="failure" output="Get \"https://10.133.0.20:6567/health\": dial tcp 10.133.0.20:6567: connect: connection refused"
May 28 10:16:07.832865 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:16:07.832817    2565 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-67c544c456-c9mrg" podUID="82cfaf0d-784e-4581-96ec-54cce23ea99b" containerName="ui" probeResult="failure" output="dial tcp 10.133.0.19:8443: connect: connection refused"
May 28 10:16:07.833341 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:16:07.832991    2565 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-67c544c456-c9mrg"
May 28 10:16:08.690307 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:16:08.690264    2565 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-67c544c456-c9mrg" podUID="82cfaf0d-784e-4581-96ec-54cce23ea99b" containerName="online" probeResult="failure" output="Get \"https://10.133.0.19:6567/health\": dial tcp 10.133.0.19:6567: connect: connection refused"
May 28 10:16:08.690505 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:16:08.690401    2565 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-67c544c456-c9mrg"
May 28 10:16:08.913625 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:16:08.913586    2565 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-79bbc6b9fd-nkwgn" podUID="417dbd1f-c29c-4d54-8ba9-206195ed8352" containerName="ui" probeResult="failure" output="dial tcp 10.133.0.20:8443: connect: connection refused"
May 28 10:16:08.914019 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:16:08.913728    2565 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-79bbc6b9fd-nkwgn"
May 28 10:16:08.934718 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:16:08.934681    2565 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-79bbc6b9fd-nkwgn" podUID="417dbd1f-c29c-4d54-8ba9-206195ed8352" containerName="online" probeResult="failure" output="Get \"https://10.133.0.20:6567/health\": dial tcp 10.133.0.20:6567: connect: connection refused"
May 28 10:16:08.934860 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:16:08.934793    2565 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-79bbc6b9fd-nkwgn"
May 28 10:16:12.045176 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:16:12.045154    2565 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-79bbc6b9fd-nkwgn"
May 28 10:16:12.124633 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:16:12.124548    2565 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/417dbd1f-c29c-4d54-8ba9-206195ed8352-online-tls\") pod \"417dbd1f-c29c-4d54-8ba9-206195ed8352\" (UID: \"417dbd1f-c29c-4d54-8ba9-206195ed8352\") "
May 28 10:16:12.124633 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:16:12.124589    2565 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/configmap/417dbd1f-c29c-4d54-8ba9-206195ed8352-registry-tls\") pod \"417dbd1f-c29c-4d54-8ba9-206195ed8352\" (UID: \"417dbd1f-c29c-4d54-8ba9-206195ed8352\") "
May 28 10:16:12.124633 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:16:12.124623    2565 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/417dbd1f-c29c-4d54-8ba9-206195ed8352-feast-data\") pod \"417dbd1f-c29c-4d54-8ba9-206195ed8352\" (UID: \"417dbd1f-c29c-4d54-8ba9-206195ed8352\") "
May 28 10:16:12.124904 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:16:12.124640    2565 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-z6fb5\" (UniqueName: \"kubernetes.io/projected/417dbd1f-c29c-4d54-8ba9-206195ed8352-kube-api-access-z6fb5\") pod \"417dbd1f-c29c-4d54-8ba9-206195ed8352\" (UID: \"417dbd1f-c29c-4d54-8ba9-206195ed8352\") "
May 28 10:16:12.124904 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:16:12.124707    2565 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/417dbd1f-c29c-4d54-8ba9-206195ed8352-ui-tls\") pod \"417dbd1f-c29c-4d54-8ba9-206195ed8352\" (UID: \"417dbd1f-c29c-4d54-8ba9-206195ed8352\") "
May 28 10:16:12.124904 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:16:12.124733    2565 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/417dbd1f-c29c-4d54-8ba9-206195ed8352-offline-tls\") pod \"417dbd1f-c29c-4d54-8ba9-206195ed8352\" (UID: \"417dbd1f-c29c-4d54-8ba9-206195ed8352\") "
May 28 10:16:12.125055 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:16:12.124993    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/417dbd1f-c29c-4d54-8ba9-206195ed8352-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "417dbd1f-c29c-4d54-8ba9-206195ed8352" (UID: "417dbd1f-c29c-4d54-8ba9-206195ed8352"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 28 10:16:12.125156 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:16:12.125127    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/417dbd1f-c29c-4d54-8ba9-206195ed8352-feast-data" (OuterVolumeSpecName: "feast-data") pod "417dbd1f-c29c-4d54-8ba9-206195ed8352" (UID: "417dbd1f-c29c-4d54-8ba9-206195ed8352"). InnerVolumeSpecName "feast-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 28 10:16:12.127006 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:16:12.126970    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/417dbd1f-c29c-4d54-8ba9-206195ed8352-kube-api-access-z6fb5" (OuterVolumeSpecName: "kube-api-access-z6fb5") pod "417dbd1f-c29c-4d54-8ba9-206195ed8352" (UID: "417dbd1f-c29c-4d54-8ba9-206195ed8352"). InnerVolumeSpecName "kube-api-access-z6fb5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 28 10:16:12.127114 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:16:12.127004    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/417dbd1f-c29c-4d54-8ba9-206195ed8352-offline-tls" (OuterVolumeSpecName: "offline-tls") pod "417dbd1f-c29c-4d54-8ba9-206195ed8352" (UID: "417dbd1f-c29c-4d54-8ba9-206195ed8352"). InnerVolumeSpecName "offline-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 28 10:16:12.127114 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:16:12.127027    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/417dbd1f-c29c-4d54-8ba9-206195ed8352-ui-tls" (OuterVolumeSpecName: "ui-tls") pod "417dbd1f-c29c-4d54-8ba9-206195ed8352" (UID: "417dbd1f-c29c-4d54-8ba9-206195ed8352"). InnerVolumeSpecName "ui-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 28 10:16:12.127114 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:16:12.127068    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/417dbd1f-c29c-4d54-8ba9-206195ed8352-online-tls" (OuterVolumeSpecName: "online-tls") pod "417dbd1f-c29c-4d54-8ba9-206195ed8352" (UID: "417dbd1f-c29c-4d54-8ba9-206195ed8352"). InnerVolumeSpecName "online-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 28 10:16:12.194891 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:16:12.194860    2565 generic.go:358] "Generic (PLEG): container finished" podID="417dbd1f-c29c-4d54-8ba9-206195ed8352" containerID="f5fce263692546df3394bf78fb50413d2c8e12a7cf4f80abd52efca68d698035" exitCode=137
May 28 10:16:12.195046 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:16:12.194933    2565 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-79bbc6b9fd-nkwgn"
May 28 10:16:12.195046 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:16:12.194939    2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-79bbc6b9fd-nkwgn" event={"ID":"417dbd1f-c29c-4d54-8ba9-206195ed8352","Type":"ContainerDied","Data":"f5fce263692546df3394bf78fb50413d2c8e12a7cf4f80abd52efca68d698035"}
May 28 10:16:12.195046 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:16:12.194984    2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-79bbc6b9fd-nkwgn" event={"ID":"417dbd1f-c29c-4d54-8ba9-206195ed8352","Type":"ContainerDied","Data":"b389a269b192d117470f21098876b940d025901cb1563dceb659031d05a1e8e7"}
May 28 10:16:12.195046 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:16:12.195005    2565 scope.go:117] "RemoveContainer" containerID="5aab1214048f3fa909711d00189f79fc0cd77bda3ed0fd93816fdd9b801dd908"
May 28 10:16:12.197643 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:16:12.197624    2565 generic.go:358] "Generic (PLEG): container finished" podID="82cfaf0d-784e-4581-96ec-54cce23ea99b" containerID="def49523bcc503d336499441bd5e8fdc60c0c1d61c9e99fa17d755db794df1c9" exitCode=137
May 28 10:16:12.197643 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:16:12.197640    2565 generic.go:358] "Generic (PLEG): container finished" podID="82cfaf0d-784e-4581-96ec-54cce23ea99b" containerID="47f6e045a95f5931c0498969583f61fa05e8285f272d14e99548c203eb537fe9" exitCode=137
May 28 10:16:12.197818 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:16:12.197686    2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-67c544c456-c9mrg" event={"ID":"82cfaf0d-784e-4581-96ec-54cce23ea99b","Type":"ContainerDied","Data":"def49523bcc503d336499441bd5e8fdc60c0c1d61c9e99fa17d755db794df1c9"}
May 28 10:16:12.197818 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:16:12.197719    2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-67c544c456-c9mrg" event={"ID":"82cfaf0d-784e-4581-96ec-54cce23ea99b","Type":"ContainerDied","Data":"47f6e045a95f5931c0498969583f61fa05e8285f272d14e99548c203eb537fe9"}
May 28 10:16:12.203562 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:16:12.203544    2565 scope.go:117] "RemoveContainer" containerID="f5fce263692546df3394bf78fb50413d2c8e12a7cf4f80abd52efca68d698035"
May 28 10:16:12.210358 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:16:12.210340    2565 scope.go:117] "RemoveContainer" containerID="89d940bbfeeed0b3bc53bb2442160923340d4a7e32958e507696c3133b31ee71"
May 28 10:16:12.217505 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:16:12.217482    2565 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-79bbc6b9fd-nkwgn"]
May 28 10:16:12.218222 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:16:12.218148    2565 scope.go:117] "RemoveContainer" containerID="d7ddf38a71f493a84c04b0ba71ce4e0698039692c0798c2f6eeb0ab7db2d1327"
May 28 10:16:12.219444 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:16:12.219426    2565 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-79bbc6b9fd-nkwgn"]
May 28 10:16:12.224992 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:16:12.224975    2565 scope.go:117] "RemoveContainer" containerID="779d6ec63957d15f4c7fde7518575d9942e30554cef70e223b6be606bda9c6ff"
May 28 10:16:12.225239 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:16:12.225218    2565 reconciler_common.go:299] "Volume detached for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/417dbd1f-c29c-4d54-8ba9-206195ed8352-ui-tls\") on node \"ip-10-0-128-206.ec2.internal\" DevicePath \"\""
May 28 10:16:12.225239 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:16:12.225239    2565 reconciler_common.go:299] "Volume detached for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/417dbd1f-c29c-4d54-8ba9-206195ed8352-offline-tls\") on node \"ip-10-0-128-206.ec2.internal\" DevicePath \"\""
May 28 10:16:12.225438 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:16:12.225249    2565 reconciler_common.go:299] "Volume detached for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/417dbd1f-c29c-4d54-8ba9-206195ed8352-online-tls\") on node \"ip-10-0-128-206.ec2.internal\" DevicePath \"\""
May 28 10:16:12.225438 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:16:12.225257    2565 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/configmap/417dbd1f-c29c-4d54-8ba9-206195ed8352-registry-tls\") on node \"ip-10-0-128-206.ec2.internal\" DevicePath \"\""
May 28 10:16:12.225438 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:16:12.225266    2565 reconciler_common.go:299] "Volume detached for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/417dbd1f-c29c-4d54-8ba9-206195ed8352-feast-data\") on node \"ip-10-0-128-206.ec2.internal\" DevicePath \"\""
May 28 10:16:12.225438 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:16:12.225274    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-z6fb5\" (UniqueName: \"kubernetes.io/projected/417dbd1f-c29c-4d54-8ba9-206195ed8352-kube-api-access-z6fb5\") on node \"ip-10-0-128-206.ec2.internal\" DevicePath \"\""
May 28 10:16:12.231549 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:16:12.231535    2565 scope.go:117] "RemoveContainer" containerID="5aab1214048f3fa909711d00189f79fc0cd77bda3ed0fd93816fdd9b801dd908"
May 28 10:16:12.231787 ip-10-0-128-206 kubenswrapper[2565]: E0528 10:16:12.231768    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5aab1214048f3fa909711d00189f79fc0cd77bda3ed0fd93816fdd9b801dd908\": container with ID starting with 5aab1214048f3fa909711d00189f79fc0cd77bda3ed0fd93816fdd9b801dd908 not found: ID does not exist" containerID="5aab1214048f3fa909711d00189f79fc0cd77bda3ed0fd93816fdd9b801dd908"
May 28 10:16:12.231846 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:16:12.231797    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5aab1214048f3fa909711d00189f79fc0cd77bda3ed0fd93816fdd9b801dd908"} err="failed to get container status \"5aab1214048f3fa909711d00189f79fc0cd77bda3ed0fd93816fdd9b801dd908\": rpc error: code = NotFound desc = could not find container \"5aab1214048f3fa909711d00189f79fc0cd77bda3ed0fd93816fdd9b801dd908\": container with ID starting with 5aab1214048f3fa909711d00189f79fc0cd77bda3ed0fd93816fdd9b801dd908 not found: ID does not exist"
May 28 10:16:12.231846 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:16:12.231815    2565 scope.go:117] "RemoveContainer" containerID="f5fce263692546df3394bf78fb50413d2c8e12a7cf4f80abd52efca68d698035"
May 28 10:16:12.232052 ip-10-0-128-206 kubenswrapper[2565]: E0528 10:16:12.232036    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f5fce263692546df3394bf78fb50413d2c8e12a7cf4f80abd52efca68d698035\": container with ID starting with f5fce263692546df3394bf78fb50413d2c8e12a7cf4f80abd52efca68d698035 not found: ID does not exist" containerID="f5fce263692546df3394bf78fb50413d2c8e12a7cf4f80abd52efca68d698035"
May 28 10:16:12.232101 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:16:12.232060    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f5fce263692546df3394bf78fb50413d2c8e12a7cf4f80abd52efca68d698035"} err="failed to get container status \"f5fce263692546df3394bf78fb50413d2c8e12a7cf4f80abd52efca68d698035\": rpc error: code = NotFound desc = could not find container \"f5fce263692546df3394bf78fb50413d2c8e12a7cf4f80abd52efca68d698035\": container with ID starting with f5fce263692546df3394bf78fb50413d2c8e12a7cf4f80abd52efca68d698035 not found: ID does not exist"
May 28 10:16:12.232101 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:16:12.232075    2565 scope.go:117] "RemoveContainer" containerID="89d940bbfeeed0b3bc53bb2442160923340d4a7e32958e507696c3133b31ee71"
May 28 10:16:12.232333 ip-10-0-128-206 kubenswrapper[2565]: E0528 10:16:12.232300    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"89d940bbfeeed0b3bc53bb2442160923340d4a7e32958e507696c3133b31ee71\": container with ID starting with 89d940bbfeeed0b3bc53bb2442160923340d4a7e32958e507696c3133b31ee71 not found: ID does not exist" containerID="89d940bbfeeed0b3bc53bb2442160923340d4a7e32958e507696c3133b31ee71"
May 28 10:16:12.232394 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:16:12.232337    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"89d940bbfeeed0b3bc53bb2442160923340d4a7e32958e507696c3133b31ee71"} err="failed to get container status \"89d940bbfeeed0b3bc53bb2442160923340d4a7e32958e507696c3133b31ee71\": rpc error: code = NotFound desc = could not find container \"89d940bbfeeed0b3bc53bb2442160923340d4a7e32958e507696c3133b31ee71\": container with ID starting with 89d940bbfeeed0b3bc53bb2442160923340d4a7e32958e507696c3133b31ee71 not found: ID does not exist"
May 28 10:16:12.232394 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:16:12.232350    2565 scope.go:117] "RemoveContainer" containerID="d7ddf38a71f493a84c04b0ba71ce4e0698039692c0798c2f6eeb0ab7db2d1327"
May 28 10:16:12.232580 ip-10-0-128-206 kubenswrapper[2565]: E0528 10:16:12.232564    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d7ddf38a71f493a84c04b0ba71ce4e0698039692c0798c2f6eeb0ab7db2d1327\": container with ID starting with d7ddf38a71f493a84c04b0ba71ce4e0698039692c0798c2f6eeb0ab7db2d1327 not found: ID does not exist" containerID="d7ddf38a71f493a84c04b0ba71ce4e0698039692c0798c2f6eeb0ab7db2d1327"
May 28 10:16:12.232626 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:16:12.232582    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d7ddf38a71f493a84c04b0ba71ce4e0698039692c0798c2f6eeb0ab7db2d1327"} err="failed to get container status \"d7ddf38a71f493a84c04b0ba71ce4e0698039692c0798c2f6eeb0ab7db2d1327\": rpc error: code = NotFound desc = could not find container \"d7ddf38a71f493a84c04b0ba71ce4e0698039692c0798c2f6eeb0ab7db2d1327\": container with ID starting with d7ddf38a71f493a84c04b0ba71ce4e0698039692c0798c2f6eeb0ab7db2d1327 not found: ID does not exist"
May 28 10:16:12.232626 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:16:12.232595    2565 scope.go:117] "RemoveContainer" containerID="779d6ec63957d15f4c7fde7518575d9942e30554cef70e223b6be606bda9c6ff"
May 28 10:16:12.232787 ip-10-0-128-206 kubenswrapper[2565]: E0528 10:16:12.232768    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"779d6ec63957d15f4c7fde7518575d9942e30554cef70e223b6be606bda9c6ff\": container with ID starting with 779d6ec63957d15f4c7fde7518575d9942e30554cef70e223b6be606bda9c6ff not found: ID does not exist" containerID="779d6ec63957d15f4c7fde7518575d9942e30554cef70e223b6be606bda9c6ff"
May 28 10:16:12.232821 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:16:12.232791    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"779d6ec63957d15f4c7fde7518575d9942e30554cef70e223b6be606bda9c6ff"} err="failed to get container status \"779d6ec63957d15f4c7fde7518575d9942e30554cef70e223b6be606bda9c6ff\": rpc error: code = NotFound desc = could not find container \"779d6ec63957d15f4c7fde7518575d9942e30554cef70e223b6be606bda9c6ff\": container with ID starting with 779d6ec63957d15f4c7fde7518575d9942e30554cef70e223b6be606bda9c6ff not found: ID does not exist"
May 28 10:16:12.573447 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:16:12.573421    2565 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-67c544c456-c9mrg"
May 28 10:16:12.729554 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:16:12.729485    2565 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/82cfaf0d-784e-4581-96ec-54cce23ea99b-registry-tls\") pod \"82cfaf0d-784e-4581-96ec-54cce23ea99b\" (UID: \"82cfaf0d-784e-4581-96ec-54cce23ea99b\") "
May 28 10:16:12.729554 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:16:12.729541    2565 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/82cfaf0d-784e-4581-96ec-54cce23ea99b-online-tls\") pod \"82cfaf0d-784e-4581-96ec-54cce23ea99b\" (UID: \"82cfaf0d-784e-4581-96ec-54cce23ea99b\") "
May 28 10:16:12.729861 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:16:12.729584    2565 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/82cfaf0d-784e-4581-96ec-54cce23ea99b-offline-tls\") pod \"82cfaf0d-784e-4581-96ec-54cce23ea99b\" (UID: \"82cfaf0d-784e-4581-96ec-54cce23ea99b\") "
May 28 10:16:12.729861 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:16:12.729617    2565 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-sb5qc\" (UniqueName: \"kubernetes.io/projected/82cfaf0d-784e-4581-96ec-54cce23ea99b-kube-api-access-sb5qc\") pod \"82cfaf0d-784e-4581-96ec-54cce23ea99b\" (UID: \"82cfaf0d-784e-4581-96ec-54cce23ea99b\") "
May 28 10:16:12.729861 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:16:12.729635    2565 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/82cfaf0d-784e-4581-96ec-54cce23ea99b-ui-tls\") pod \"82cfaf0d-784e-4581-96ec-54cce23ea99b\" (UID: \"82cfaf0d-784e-4581-96ec-54cce23ea99b\") "
May 28 10:16:12.729861 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:16:12.729759    2565 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/82cfaf0d-784e-4581-96ec-54cce23ea99b-feast-data\") pod \"82cfaf0d-784e-4581-96ec-54cce23ea99b\" (UID: \"82cfaf0d-784e-4581-96ec-54cce23ea99b\") "
May 28 10:16:12.730512 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:16:12.730480    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/82cfaf0d-784e-4581-96ec-54cce23ea99b-feast-data" (OuterVolumeSpecName: "feast-data") pod "82cfaf0d-784e-4581-96ec-54cce23ea99b" (UID: "82cfaf0d-784e-4581-96ec-54cce23ea99b"). InnerVolumeSpecName "feast-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 28 10:16:12.731771 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:16:12.731744    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/82cfaf0d-784e-4581-96ec-54cce23ea99b-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "82cfaf0d-784e-4581-96ec-54cce23ea99b" (UID: "82cfaf0d-784e-4581-96ec-54cce23ea99b"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 28 10:16:12.731867 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:16:12.731781    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/82cfaf0d-784e-4581-96ec-54cce23ea99b-kube-api-access-sb5qc" (OuterVolumeSpecName: "kube-api-access-sb5qc") pod "82cfaf0d-784e-4581-96ec-54cce23ea99b" (UID: "82cfaf0d-784e-4581-96ec-54cce23ea99b"). InnerVolumeSpecName "kube-api-access-sb5qc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 28 10:16:12.732054 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:16:12.732035    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/82cfaf0d-784e-4581-96ec-54cce23ea99b-ui-tls" (OuterVolumeSpecName: "ui-tls") pod "82cfaf0d-784e-4581-96ec-54cce23ea99b" (UID: "82cfaf0d-784e-4581-96ec-54cce23ea99b"). InnerVolumeSpecName "ui-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 28 10:16:12.732188 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:16:12.732172    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/82cfaf0d-784e-4581-96ec-54cce23ea99b-online-tls" (OuterVolumeSpecName: "online-tls") pod "82cfaf0d-784e-4581-96ec-54cce23ea99b" (UID: "82cfaf0d-784e-4581-96ec-54cce23ea99b"). InnerVolumeSpecName "online-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 28 10:16:12.732236 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:16:12.732186    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/82cfaf0d-784e-4581-96ec-54cce23ea99b-offline-tls" (OuterVolumeSpecName: "offline-tls") pod "82cfaf0d-784e-4581-96ec-54cce23ea99b" (UID: "82cfaf0d-784e-4581-96ec-54cce23ea99b"). InnerVolumeSpecName "offline-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 28 10:16:12.830843 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:16:12.830794    2565 reconciler_common.go:299] "Volume detached for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/82cfaf0d-784e-4581-96ec-54cce23ea99b-online-tls\") on node \"ip-10-0-128-206.ec2.internal\" DevicePath \"\""
May 28 10:16:12.830843 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:16:12.830839    2565 reconciler_common.go:299] "Volume detached for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/82cfaf0d-784e-4581-96ec-54cce23ea99b-offline-tls\") on node \"ip-10-0-128-206.ec2.internal\" DevicePath \"\""
May 28 10:16:12.830843 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:16:12.830853    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-sb5qc\" (UniqueName: \"kubernetes.io/projected/82cfaf0d-784e-4581-96ec-54cce23ea99b-kube-api-access-sb5qc\") on node \"ip-10-0-128-206.ec2.internal\" DevicePath \"\""
May 28 10:16:12.831085 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:16:12.830869    2565 reconciler_common.go:299] "Volume detached for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/82cfaf0d-784e-4581-96ec-54cce23ea99b-ui-tls\") on node \"ip-10-0-128-206.ec2.internal\" DevicePath \"\""
May 28 10:16:12.831085 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:16:12.830881    2565 reconciler_common.go:299] "Volume detached for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/82cfaf0d-784e-4581-96ec-54cce23ea99b-feast-data\") on node \"ip-10-0-128-206.ec2.internal\" DevicePath \"\""
May 28 10:16:12.831085 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:16:12.830892    2565 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/82cfaf0d-784e-4581-96ec-54cce23ea99b-registry-tls\") on node \"ip-10-0-128-206.ec2.internal\" DevicePath \"\""
May 28 10:16:13.154605 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:16:13.154571    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="417dbd1f-c29c-4d54-8ba9-206195ed8352" path="/var/lib/kubelet/pods/417dbd1f-c29c-4d54-8ba9-206195ed8352/volumes"
May 28 10:16:13.203809 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:16:13.203768    2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-67c544c456-c9mrg" event={"ID":"82cfaf0d-784e-4581-96ec-54cce23ea99b","Type":"ContainerDied","Data":"c49fc88f36762c9b7ee45bacee9d79708689dcee016d9ba36d0b302549f5e878"}
May 28 10:16:13.203965 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:16:13.203816    2565 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-67c544c456-c9mrg"
May 28 10:16:13.203965 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:16:13.203819    2565 scope.go:117] "RemoveContainer" containerID="7b775d8c7ff3c3b96d51b13362c6638651ce40c50c13ed44d503aa7af6eba513"
May 28 10:16:13.211561 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:16:13.211536    2565 scope.go:117] "RemoveContainer" containerID="def49523bcc503d336499441bd5e8fdc60c0c1d61c9e99fa17d755db794df1c9"
May 28 10:16:13.218470 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:16:13.218452    2565 scope.go:117] "RemoveContainer" containerID="9b7aaf8bd64bea885dab96c4ecfa3a896d7b7d1d396dc72928149a95225a878f"
May 28 10:16:13.224893 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:16:13.224875    2565 scope.go:117] "RemoveContainer" containerID="47f6e045a95f5931c0498969583f61fa05e8285f272d14e99548c203eb537fe9"
May 28 10:16:13.229665 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:16:13.229642    2565 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-67c544c456-c9mrg"]
May 28 10:16:13.232871 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:16:13.232844    2565 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-67c544c456-c9mrg"]
May 28 10:16:13.233098 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:16:13.233079    2565 scope.go:117] "RemoveContainer" containerID="ce7f9f2da871a3c638c512ddf2f4f7aaa16d7565704252c22adb4f0dda680648"
May 28 10:16:13.239966 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:16:13.239950    2565 scope.go:117] "RemoveContainer" containerID="c3d6c5149c3ce3fe3f00d00c5bd875d4692df6b4eefe6c19c471270938cad005"
May 28 10:16:15.153755 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:16:15.153716    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="82cfaf0d-784e-4581-96ec-54cce23ea99b" path="/var/lib/kubelet/pods/82cfaf0d-784e-4581-96ec-54cce23ea99b/volumes"
May 28 10:16:25.122060 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:16:25.122024    2565 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["test-ns-feast/postgres-7c7656cc6d-kkrcm"]
May 28 10:16:25.122530 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:16:25.122264    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="82cfaf0d-784e-4581-96ec-54cce23ea99b" containerName="feast-apply"
May 28 10:16:25.122530 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:16:25.122275    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="82cfaf0d-784e-4581-96ec-54cce23ea99b" containerName="feast-apply"
May 28 10:16:25.122530 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:16:25.122284    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="417dbd1f-c29c-4d54-8ba9-206195ed8352" containerName="feast-apply"
May 28 10:16:25.122530 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:16:25.122289    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="417dbd1f-c29c-4d54-8ba9-206195ed8352" containerName="feast-apply"
May 28 10:16:25.122530 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:16:25.122298    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="417dbd1f-c29c-4d54-8ba9-206195ed8352" containerName="ui"
May 28 10:16:25.122530 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:16:25.122303    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="417dbd1f-c29c-4d54-8ba9-206195ed8352" containerName="ui"
May 28 10:16:25.122530 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:16:25.122332    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="82cfaf0d-784e-4581-96ec-54cce23ea99b" containerName="registry"
May 28 10:16:25.122530 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:16:25.122340    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="82cfaf0d-784e-4581-96ec-54cce23ea99b" containerName="registry"
May 28 10:16:25.122530 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:16:25.122348    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="82cfaf0d-784e-4581-96ec-54cce23ea99b" containerName="online"
May 28 10:16:25.122530 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:16:25.122352    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="82cfaf0d-784e-4581-96ec-54cce23ea99b" containerName="online"
May 28 10:16:25.122530 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:16:25.122360    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="82cfaf0d-784e-4581-96ec-54cce23ea99b" containerName="ui"
May 28 10:16:25.122530 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:16:25.122365    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="82cfaf0d-784e-4581-96ec-54cce23ea99b" containerName="ui"
May 28 10:16:25.122530 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:16:25.122372    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="82cfaf0d-784e-4581-96ec-54cce23ea99b" containerName="feast-init"
May 28 10:16:25.122530 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:16:25.122376    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="82cfaf0d-784e-4581-96ec-54cce23ea99b" containerName="feast-init"
May 28 10:16:25.122530 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:16:25.122387    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="417dbd1f-c29c-4d54-8ba9-206195ed8352" containerName="feast-init"
May 28 10:16:25.122530 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:16:25.122391    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="417dbd1f-c29c-4d54-8ba9-206195ed8352" containerName="feast-init"
May 28 10:16:25.122530 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:16:25.122396    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="417dbd1f-c29c-4d54-8ba9-206195ed8352" containerName="online"
May 28 10:16:25.122530 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:16:25.122402    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="417dbd1f-c29c-4d54-8ba9-206195ed8352" containerName="online"
May 28 10:16:25.122530 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:16:25.122410    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="417dbd1f-c29c-4d54-8ba9-206195ed8352" containerName="offline"
May 28 10:16:25.122530 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:16:25.122414    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="417dbd1f-c29c-4d54-8ba9-206195ed8352" containerName="offline"
May 28 10:16:25.122530 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:16:25.122420    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="82cfaf0d-784e-4581-96ec-54cce23ea99b" containerName="offline"
May 28 10:16:25.122530 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:16:25.122425    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="82cfaf0d-784e-4581-96ec-54cce23ea99b" containerName="offline"
May 28 10:16:25.122530 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:16:25.122460    2565 memory_manager.go:356] "RemoveStaleState removing state" podUID="82cfaf0d-784e-4581-96ec-54cce23ea99b" containerName="online"
May 28 10:16:25.122530 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:16:25.122468    2565 memory_manager.go:356] "RemoveStaleState removing state" podUID="82cfaf0d-784e-4581-96ec-54cce23ea99b" containerName="registry"
May 28 10:16:25.122530 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:16:25.122474    2565 memory_manager.go:356] "RemoveStaleState removing state" podUID="417dbd1f-c29c-4d54-8ba9-206195ed8352" containerName="online"
May 28 10:16:25.122530 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:16:25.122481    2565 memory_manager.go:356] "RemoveStaleState removing state" podUID="82cfaf0d-784e-4581-96ec-54cce23ea99b" containerName="offline"
May 28 10:16:25.122530 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:16:25.122486    2565 memory_manager.go:356] "RemoveStaleState removing state" podUID="82cfaf0d-784e-4581-96ec-54cce23ea99b" containerName="ui"
May 28 10:16:25.122530 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:16:25.122491    2565 memory_manager.go:356] "RemoveStaleState removing state" podUID="417dbd1f-c29c-4d54-8ba9-206195ed8352" containerName="offline"
May 28 10:16:25.122530 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:16:25.122497    2565 memory_manager.go:356] "RemoveStaleState removing state" podUID="417dbd1f-c29c-4d54-8ba9-206195ed8352" containerName="ui"
May 28 10:16:25.127252 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:16:25.127232    2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/postgres-7c7656cc6d-kkrcm"
May 28 10:16:25.130777 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:16:25.130751    2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"default-dockercfg-65lqm\""
May 28 10:16:25.130902 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:16:25.130830    2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast\"/\"openshift-service-ca.crt\""
May 28 10:16:25.131972 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:16:25.131951    2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast\"/\"kube-root-ca.crt\""
May 28 10:16:25.132078 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:16:25.131996    2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"postgres-secret\""
May 28 10:16:25.132278 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:16:25.132234    2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/postgres-7c7656cc6d-kkrcm"]
May 28 10:16:25.220020 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:16:25.219988    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4l4gk\" (UniqueName: \"kubernetes.io/projected/3a76905c-b32c-49c1-82c3-bfc3ce1b9778-kube-api-access-4l4gk\") pod \"postgres-7c7656cc6d-kkrcm\" (UID: \"3a76905c-b32c-49c1-82c3-bfc3ce1b9778\") " pod="test-ns-feast/postgres-7c7656cc6d-kkrcm"
May 28 10:16:25.220169 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:16:25.220073    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"postgresdata\" (UniqueName: \"kubernetes.io/empty-dir/3a76905c-b32c-49c1-82c3-bfc3ce1b9778-postgresdata\") pod \"postgres-7c7656cc6d-kkrcm\" (UID: \"3a76905c-b32c-49c1-82c3-bfc3ce1b9778\") " pod="test-ns-feast/postgres-7c7656cc6d-kkrcm"
May 28 10:16:25.320593 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:16:25.320560    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"postgresdata\" (UniqueName: \"kubernetes.io/empty-dir/3a76905c-b32c-49c1-82c3-bfc3ce1b9778-postgresdata\") pod \"postgres-7c7656cc6d-kkrcm\" (UID: \"3a76905c-b32c-49c1-82c3-bfc3ce1b9778\") " pod="test-ns-feast/postgres-7c7656cc6d-kkrcm"
May 28 10:16:25.320752 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:16:25.320616    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-4l4gk\" (UniqueName: \"kubernetes.io/projected/3a76905c-b32c-49c1-82c3-bfc3ce1b9778-kube-api-access-4l4gk\") pod \"postgres-7c7656cc6d-kkrcm\" (UID: \"3a76905c-b32c-49c1-82c3-bfc3ce1b9778\") " pod="test-ns-feast/postgres-7c7656cc6d-kkrcm"
May 28 10:16:25.320911 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:16:25.320891    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"postgresdata\" (UniqueName: \"kubernetes.io/empty-dir/3a76905c-b32c-49c1-82c3-bfc3ce1b9778-postgresdata\") pod \"postgres-7c7656cc6d-kkrcm\" (UID: \"3a76905c-b32c-49c1-82c3-bfc3ce1b9778\") " pod="test-ns-feast/postgres-7c7656cc6d-kkrcm"
May 28 10:16:25.330952 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:16:25.330927    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4l4gk\" (UniqueName: \"kubernetes.io/projected/3a76905c-b32c-49c1-82c3-bfc3ce1b9778-kube-api-access-4l4gk\") pod \"postgres-7c7656cc6d-kkrcm\" (UID: \"3a76905c-b32c-49c1-82c3-bfc3ce1b9778\") " pod="test-ns-feast/postgres-7c7656cc6d-kkrcm"
May 28 10:16:25.447953 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:16:25.447878    2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/postgres-7c7656cc6d-kkrcm"
May 28 10:16:25.570440 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:16:25.570279    2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/postgres-7c7656cc6d-kkrcm"]
May 28 10:16:25.572906 ip-10-0-128-206 kubenswrapper[2565]: W0528 10:16:25.572878    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod3a76905c_b32c_49c1_82c3_bfc3ce1b9778.slice/crio-35ae10841f1762a696e9d1fb4e7f79e627db54d6a656ebd8e228a82293572b35 WatchSource:0}: Error finding container 35ae10841f1762a696e9d1fb4e7f79e627db54d6a656ebd8e228a82293572b35: Status 404 returned error can't find the container with id 35ae10841f1762a696e9d1fb4e7f79e627db54d6a656ebd8e228a82293572b35
May 28 10:16:25.574531 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:16:25.574514    2565 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
May 28 10:16:26.238354 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:16:26.238299    2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/postgres-7c7656cc6d-kkrcm" event={"ID":"3a76905c-b32c-49c1-82c3-bfc3ce1b9778","Type":"ContainerStarted","Data":"35ae10841f1762a696e9d1fb4e7f79e627db54d6a656ebd8e228a82293572b35"}
May 28 10:16:32.254852 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:16:32.254818    2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/postgres-7c7656cc6d-kkrcm" event={"ID":"3a76905c-b32c-49c1-82c3-bfc3ce1b9778","Type":"ContainerStarted","Data":"fa83573c19cd649d711006e341b0f5c50e781ecb3ba8ac7da9898db7ae57a8fa"}
May 28 10:16:32.272081 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:16:32.272038    2565 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="test-ns-feast/postgres-7c7656cc6d-kkrcm" podStartSLOduration=1.6172260999999999 podStartE2EDuration="7.272025186s" podCreationTimestamp="2026-05-28 10:16:25 +0000 UTC" firstStartedPulling="2026-05-28 10:16:25.574637192 +0000 UTC m=+671.034971321" lastFinishedPulling="2026-05-28 10:16:31.229436268 +0000 UTC m=+676.689770407" observedRunningTime="2026-05-28 10:16:32.27141199 +0000 UTC m=+677.731746142" watchObservedRunningTime="2026-05-28 10:16:32.272025186 +0000 UTC m=+677.732359336"
May 28 10:16:35.870712 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:16:35.870679    2565 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["test-ns-feast/feast-credit-scoring-88c65549-6csfl"]
May 28 10:16:35.873840 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:16:35.873824    2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-credit-scoring-88c65549-6csfl"
May 28 10:16:35.876750 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:16:35.876729    2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-credit-scoring-offline-tls\""
May 28 10:16:35.876904 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:16:35.876732    2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-credit-scoring-online-tls\""
May 28 10:16:35.876904 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:16:35.876732    2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-credit-scoring-dockercfg-vp4tp\""
May 28 10:16:35.877176 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:16:35.877160    2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-credit-scoring-registry-tls\""
May 28 10:16:35.877261 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:16:35.877164    2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast\"/\"feast-credit-scoring-intra-comm\""
May 28 10:16:35.885933 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:16:35.885907    2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/feast-credit-scoring-88c65549-6csfl"]
May 28 10:16:36.004244 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:16:36.004207    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/90f5cce7-ebb9-4ef0-b6d6-28532aac402a-offline-tls\") pod \"feast-credit-scoring-88c65549-6csfl\" (UID: \"90f5cce7-ebb9-4ef0-b6d6-28532aac402a\") " pod="test-ns-feast/feast-credit-scoring-88c65549-6csfl"
May 28 10:16:36.004244 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:16:36.004243    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/90f5cce7-ebb9-4ef0-b6d6-28532aac402a-online-tls\") pod \"feast-credit-scoring-88c65549-6csfl\" (UID: \"90f5cce7-ebb9-4ef0-b6d6-28532aac402a\") " pod="test-ns-feast/feast-credit-scoring-88c65549-6csfl"
May 28 10:16:36.004508 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:16:36.004262    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/90f5cce7-ebb9-4ef0-b6d6-28532aac402a-registry-tls\") pod \"feast-credit-scoring-88c65549-6csfl\" (UID: \"90f5cce7-ebb9-4ef0-b6d6-28532aac402a\") " pod="test-ns-feast/feast-credit-scoring-88c65549-6csfl"
May 28 10:16:36.004508 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:16:36.004345    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jpn2l\" (UniqueName: \"kubernetes.io/projected/90f5cce7-ebb9-4ef0-b6d6-28532aac402a-kube-api-access-jpn2l\") pod \"feast-credit-scoring-88c65549-6csfl\" (UID: \"90f5cce7-ebb9-4ef0-b6d6-28532aac402a\") " pod="test-ns-feast/feast-credit-scoring-88c65549-6csfl"
May 28 10:16:36.004508 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:16:36.004418    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/90f5cce7-ebb9-4ef0-b6d6-28532aac402a-feast-data\") pod \"feast-credit-scoring-88c65549-6csfl\" (UID: \"90f5cce7-ebb9-4ef0-b6d6-28532aac402a\") " pod="test-ns-feast/feast-credit-scoring-88c65549-6csfl"
May 28 10:16:36.105598 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:16:36.105569    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/90f5cce7-ebb9-4ef0-b6d6-28532aac402a-offline-tls\") pod \"feast-credit-scoring-88c65549-6csfl\" (UID: \"90f5cce7-ebb9-4ef0-b6d6-28532aac402a\") " pod="test-ns-feast/feast-credit-scoring-88c65549-6csfl"
May 28 10:16:36.105745 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:16:36.105604    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/90f5cce7-ebb9-4ef0-b6d6-28532aac402a-online-tls\") pod \"feast-credit-scoring-88c65549-6csfl\" (UID: \"90f5cce7-ebb9-4ef0-b6d6-28532aac402a\") " pod="test-ns-feast/feast-credit-scoring-88c65549-6csfl"
May 28 10:16:36.105745 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:16:36.105625    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/90f5cce7-ebb9-4ef0-b6d6-28532aac402a-registry-tls\") pod \"feast-credit-scoring-88c65549-6csfl\" (UID: \"90f5cce7-ebb9-4ef0-b6d6-28532aac402a\") " pod="test-ns-feast/feast-credit-scoring-88c65549-6csfl"
May 28 10:16:36.105745 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:16:36.105644    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-jpn2l\" (UniqueName: \"kubernetes.io/projected/90f5cce7-ebb9-4ef0-b6d6-28532aac402a-kube-api-access-jpn2l\") pod \"feast-credit-scoring-88c65549-6csfl\" (UID: \"90f5cce7-ebb9-4ef0-b6d6-28532aac402a\") " pod="test-ns-feast/feast-credit-scoring-88c65549-6csfl"
May 28 10:16:36.105745 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:16:36.105678    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/90f5cce7-ebb9-4ef0-b6d6-28532aac402a-feast-data\") pod \"feast-credit-scoring-88c65549-6csfl\" (UID: \"90f5cce7-ebb9-4ef0-b6d6-28532aac402a\") " pod="test-ns-feast/feast-credit-scoring-88c65549-6csfl"
May 28 10:16:36.106113 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:16:36.106087    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/90f5cce7-ebb9-4ef0-b6d6-28532aac402a-feast-data\") pod \"feast-credit-scoring-88c65549-6csfl\" (UID: \"90f5cce7-ebb9-4ef0-b6d6-28532aac402a\") " pod="test-ns-feast/feast-credit-scoring-88c65549-6csfl"
May 28 10:16:36.108187 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:16:36.108157    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/90f5cce7-ebb9-4ef0-b6d6-28532aac402a-registry-tls\") pod \"feast-credit-scoring-88c65549-6csfl\" (UID: \"90f5cce7-ebb9-4ef0-b6d6-28532aac402a\") " pod="test-ns-feast/feast-credit-scoring-88c65549-6csfl"
May 28 10:16:36.108343 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:16:36.108301    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/90f5cce7-ebb9-4ef0-b6d6-28532aac402a-offline-tls\") pod \"feast-credit-scoring-88c65549-6csfl\" (UID: \"90f5cce7-ebb9-4ef0-b6d6-28532aac402a\") " pod="test-ns-feast/feast-credit-scoring-88c65549-6csfl"
May 28 10:16:36.108343 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:16:36.108338    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/90f5cce7-ebb9-4ef0-b6d6-28532aac402a-online-tls\") pod \"feast-credit-scoring-88c65549-6csfl\" (UID: \"90f5cce7-ebb9-4ef0-b6d6-28532aac402a\") " pod="test-ns-feast/feast-credit-scoring-88c65549-6csfl"
May 28 10:16:36.115939 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:16:36.115910    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jpn2l\" (UniqueName: \"kubernetes.io/projected/90f5cce7-ebb9-4ef0-b6d6-28532aac402a-kube-api-access-jpn2l\") pod \"feast-credit-scoring-88c65549-6csfl\" (UID: \"90f5cce7-ebb9-4ef0-b6d6-28532aac402a\") " pod="test-ns-feast/feast-credit-scoring-88c65549-6csfl"
May 28 10:16:36.182332 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:16:36.182254    2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-credit-scoring-88c65549-6csfl"
May 28 10:16:36.312751 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:16:36.312724    2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/feast-credit-scoring-88c65549-6csfl"]
May 28 10:16:36.314690 ip-10-0-128-206 kubenswrapper[2565]: W0528 10:16:36.314666    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod90f5cce7_ebb9_4ef0_b6d6_28532aac402a.slice/crio-4345b9380c7f893bd7fbff2af92cba03533097e8cc76d6cb664c59770542bccb WatchSource:0}: Error finding container 4345b9380c7f893bd7fbff2af92cba03533097e8cc76d6cb664c59770542bccb: Status 404 returned error can't find the container with id 4345b9380c7f893bd7fbff2af92cba03533097e8cc76d6cb664c59770542bccb
May 28 10:16:37.269290 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:16:37.269252    2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-credit-scoring-88c65549-6csfl" event={"ID":"90f5cce7-ebb9-4ef0-b6d6-28532aac402a","Type":"ContainerStarted","Data":"60e1d5648a8c89667656e184e729efd0ce8f2eec1640410a6372cd57932c72c2"}
May 28 10:16:37.269290 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:16:37.269292    2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-credit-scoring-88c65549-6csfl" event={"ID":"90f5cce7-ebb9-4ef0-b6d6-28532aac402a","Type":"ContainerStarted","Data":"4345b9380c7f893bd7fbff2af92cba03533097e8cc76d6cb664c59770542bccb"}
May 28 10:16:38.273489 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:16:38.273451    2565 generic.go:358] "Generic (PLEG): container finished" podID="90f5cce7-ebb9-4ef0-b6d6-28532aac402a" containerID="60e1d5648a8c89667656e184e729efd0ce8f2eec1640410a6372cd57932c72c2" exitCode=0
May 28 10:16:38.273856 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:16:38.273540    2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-credit-scoring-88c65549-6csfl" event={"ID":"90f5cce7-ebb9-4ef0-b6d6-28532aac402a","Type":"ContainerDied","Data":"60e1d5648a8c89667656e184e729efd0ce8f2eec1640410a6372cd57932c72c2"}
May 28 10:16:39.278255 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:16:39.278223    2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-credit-scoring-88c65549-6csfl" event={"ID":"90f5cce7-ebb9-4ef0-b6d6-28532aac402a","Type":"ContainerStarted","Data":"b900a72780d38aa300a063c723c8b0895c60ab9913f75658cf36fb7358f30e77"}
May 28 10:16:45.295934 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:16:45.295903    2565 generic.go:358] "Generic (PLEG): container finished" podID="90f5cce7-ebb9-4ef0-b6d6-28532aac402a" containerID="b900a72780d38aa300a063c723c8b0895c60ab9913f75658cf36fb7358f30e77" exitCode=0
May 28 10:16:45.296355 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:16:45.295970    2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-credit-scoring-88c65549-6csfl" event={"ID":"90f5cce7-ebb9-4ef0-b6d6-28532aac402a","Type":"ContainerDied","Data":"b900a72780d38aa300a063c723c8b0895c60ab9913f75658cf36fb7358f30e77"}
May 28 10:16:46.301889 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:16:46.301849    2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-credit-scoring-88c65549-6csfl" event={"ID":"90f5cce7-ebb9-4ef0-b6d6-28532aac402a","Type":"ContainerStarted","Data":"803c3a88263e4ad0baf7a3f42a58ab5c952de6916eb3b53eb5c466536d398da3"}
May 28 10:16:46.302446 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:16:46.301896    2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-credit-scoring-88c65549-6csfl" event={"ID":"90f5cce7-ebb9-4ef0-b6d6-28532aac402a","Type":"ContainerStarted","Data":"d3d6db63de533864cfcba16f090654cced6e7dcee1abbbffd69f4bea902b45fe"}
May 28 10:16:46.302446 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:16:46.301912    2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-credit-scoring-88c65549-6csfl" event={"ID":"90f5cce7-ebb9-4ef0-b6d6-28532aac402a","Type":"ContainerStarted","Data":"0551ba8f07f069807fca14ecf0f9dc6e4a824cced8c5c16b7de082ecbcc9ad5e"}
May 28 10:16:46.330518 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:16:46.330450    2565 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="test-ns-feast/feast-credit-scoring-88c65549-6csfl" podStartSLOduration=11.330430987 podStartE2EDuration="11.330430987s" podCreationTimestamp="2026-05-28 10:16:35 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-28 10:16:46.32850709 +0000 UTC m=+691.788841266" watchObservedRunningTime="2026-05-28 10:16:46.330430987 +0000 UTC m=+691.790765140"
May 28 10:16:48.183161 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:16:48.183116    2565 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-credit-scoring-88c65549-6csfl"
May 28 10:16:48.183773 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:16:48.183749    2565 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-credit-scoring-88c65549-6csfl"
May 28 10:16:48.183907 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:16:48.183777    2565 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-credit-scoring-88c65549-6csfl"
May 28 10:16:48.184886 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:16:48.184844    2565 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-credit-scoring-88c65549-6csfl" podUID="90f5cce7-ebb9-4ef0-b6d6-28532aac402a" containerName="registry" probeResult="failure" output="dial tcp 10.133.0.22:6571: connect: connection refused"
May 28 10:16:48.185000 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:16:48.184873    2565 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-credit-scoring-88c65549-6csfl" podUID="90f5cce7-ebb9-4ef0-b6d6-28532aac402a" containerName="offline" probeResult="failure" output="dial tcp 10.133.0.22:8816: connect: connection refused"
May 28 10:16:48.185000 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:16:48.184888    2565 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-credit-scoring-88c65549-6csfl" podUID="90f5cce7-ebb9-4ef0-b6d6-28532aac402a" containerName="online" probeResult="failure" output="Get \"https://10.133.0.22:6567/health\": dial tcp 10.133.0.22:6567: connect: connection refused"
May 28 10:16:51.183028 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:16:51.182979    2565 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-credit-scoring-88c65549-6csfl" podUID="90f5cce7-ebb9-4ef0-b6d6-28532aac402a" containerName="registry" probeResult="failure" output="dial tcp 10.133.0.22:6571: connect: connection refused"
May 28 10:16:51.183962 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:16:51.183938    2565 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-credit-scoring-88c65549-6csfl"
May 28 10:16:51.184372 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:16:51.184348    2565 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-credit-scoring-88c65549-6csfl"
May 28 10:16:51.184850 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:16:51.184827    2565 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-credit-scoring-88c65549-6csfl"
May 28 10:16:51.388231 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:16:51.388198    2565 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-credit-scoring-88c65549-6csfl"
May 28 10:16:52.321929 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:16:52.321898    2565 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-credit-scoring-88c65549-6csfl"
May 28 10:16:52.325010 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:16:52.324984    2565 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-credit-scoring-88c65549-6csfl"
May 28 10:16:54.183399 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:16:54.183350    2565 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-credit-scoring-88c65549-6csfl" podUID="90f5cce7-ebb9-4ef0-b6d6-28532aac402a" containerName="registry" probeResult="failure" output="dial tcp 10.133.0.22:6571: connect: connection refused"
May 28 10:16:56.183034 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:16:56.182989    2565 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-credit-scoring-88c65549-6csfl"
May 28 10:16:57.183925 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:16:57.183898    2565 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-credit-scoring-88c65549-6csfl"
May 28 10:16:57.184647 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:16:57.184627    2565 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-credit-scoring-88c65549-6csfl"
May 28 10:17:56.940112 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:17:56.940078    2565 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["test-ns-feast/feast-credit-scoring-88c65549-6csfl"]
May 28 10:17:56.940598 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:17:56.940414    2565 kuberuntime_container.go:864] "Killing container with a grace period" pod="test-ns-feast/feast-credit-scoring-88c65549-6csfl" podUID="90f5cce7-ebb9-4ef0-b6d6-28532aac402a" containerName="registry" containerID="cri-o://0551ba8f07f069807fca14ecf0f9dc6e4a824cced8c5c16b7de082ecbcc9ad5e" gracePeriod=30
May 28 10:17:56.940598 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:17:56.940462    2565 kuberuntime_container.go:864] "Killing container with a grace period" pod="test-ns-feast/feast-credit-scoring-88c65549-6csfl" podUID="90f5cce7-ebb9-4ef0-b6d6-28532aac402a" containerName="online" containerID="cri-o://d3d6db63de533864cfcba16f090654cced6e7dcee1abbbffd69f4bea902b45fe" gracePeriod=30
May 28 10:17:56.940598 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:17:56.940469    2565 kuberuntime_container.go:864] "Killing container with a grace period" pod="test-ns-feast/feast-credit-scoring-88c65549-6csfl" podUID="90f5cce7-ebb9-4ef0-b6d6-28532aac402a" containerName="offline" containerID="cri-o://803c3a88263e4ad0baf7a3f42a58ab5c952de6916eb3b53eb5c466536d398da3" gracePeriod=30
May 28 10:17:56.956467 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:17:56.956439    2565 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["test-ns-feast/postgres-7c7656cc6d-kkrcm"]
May 28 10:17:56.956634 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:17:56.956604    2565 kuberuntime_container.go:864] "Killing container with a grace period" pod="test-ns-feast/postgres-7c7656cc6d-kkrcm" podUID="3a76905c-b32c-49c1-82c3-bfc3ce1b9778" containerName="postgres" containerID="cri-o://fa83573c19cd649d711006e341b0f5c50e781ecb3ba8ac7da9898db7ae57a8fa" gracePeriod=30
May 28 10:17:57.192732 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:17:57.192675    2565 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/postgres-7c7656cc6d-kkrcm"
May 28 10:17:57.232263 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:17:57.232236    2565 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"postgresdata\" (UniqueName: \"kubernetes.io/empty-dir/3a76905c-b32c-49c1-82c3-bfc3ce1b9778-postgresdata\") pod \"3a76905c-b32c-49c1-82c3-bfc3ce1b9778\" (UID: \"3a76905c-b32c-49c1-82c3-bfc3ce1b9778\") "
May 28 10:17:57.232439 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:17:57.232280    2565 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4l4gk\" (UniqueName: \"kubernetes.io/projected/3a76905c-b32c-49c1-82c3-bfc3ce1b9778-kube-api-access-4l4gk\") pod \"3a76905c-b32c-49c1-82c3-bfc3ce1b9778\" (UID: \"3a76905c-b32c-49c1-82c3-bfc3ce1b9778\") "
May 28 10:17:57.234544 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:17:57.234515    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3a76905c-b32c-49c1-82c3-bfc3ce1b9778-kube-api-access-4l4gk" (OuterVolumeSpecName: "kube-api-access-4l4gk") pod "3a76905c-b32c-49c1-82c3-bfc3ce1b9778" (UID: "3a76905c-b32c-49c1-82c3-bfc3ce1b9778"). InnerVolumeSpecName "kube-api-access-4l4gk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 28 10:17:57.264177 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:17:57.264146    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3a76905c-b32c-49c1-82c3-bfc3ce1b9778-postgresdata" (OuterVolumeSpecName: "postgresdata") pod "3a76905c-b32c-49c1-82c3-bfc3ce1b9778" (UID: "3a76905c-b32c-49c1-82c3-bfc3ce1b9778"). InnerVolumeSpecName "postgresdata". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 28 10:17:57.333236 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:17:57.333195    2565 reconciler_common.go:299] "Volume detached for volume \"postgresdata\" (UniqueName: \"kubernetes.io/empty-dir/3a76905c-b32c-49c1-82c3-bfc3ce1b9778-postgresdata\") on node \"ip-10-0-128-206.ec2.internal\" DevicePath \"\""
May 28 10:17:57.333236 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:17:57.333222    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4l4gk\" (UniqueName: \"kubernetes.io/projected/3a76905c-b32c-49c1-82c3-bfc3ce1b9778-kube-api-access-4l4gk\") on node \"ip-10-0-128-206.ec2.internal\" DevicePath \"\""
May 28 10:17:57.505963 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:17:57.505877    2565 generic.go:358] "Generic (PLEG): container finished" podID="3a76905c-b32c-49c1-82c3-bfc3ce1b9778" containerID="fa83573c19cd649d711006e341b0f5c50e781ecb3ba8ac7da9898db7ae57a8fa" exitCode=0
May 28 10:17:57.505963 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:17:57.505930    2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/postgres-7c7656cc6d-kkrcm" event={"ID":"3a76905c-b32c-49c1-82c3-bfc3ce1b9778","Type":"ContainerDied","Data":"fa83573c19cd649d711006e341b0f5c50e781ecb3ba8ac7da9898db7ae57a8fa"}
May 28 10:17:57.505963 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:17:57.505940    2565 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/postgres-7c7656cc6d-kkrcm"
May 28 10:17:57.505963 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:17:57.505951    2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/postgres-7c7656cc6d-kkrcm" event={"ID":"3a76905c-b32c-49c1-82c3-bfc3ce1b9778","Type":"ContainerDied","Data":"35ae10841f1762a696e9d1fb4e7f79e627db54d6a656ebd8e228a82293572b35"}
May 28 10:17:57.506276 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:17:57.505968    2565 scope.go:117] "RemoveContainer" containerID="fa83573c19cd649d711006e341b0f5c50e781ecb3ba8ac7da9898db7ae57a8fa"
May 28 10:17:57.513537 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:17:57.513519    2565 scope.go:117] "RemoveContainer" containerID="fa83573c19cd649d711006e341b0f5c50e781ecb3ba8ac7da9898db7ae57a8fa"
May 28 10:17:57.513784 ip-10-0-128-206 kubenswrapper[2565]: E0528 10:17:57.513767    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fa83573c19cd649d711006e341b0f5c50e781ecb3ba8ac7da9898db7ae57a8fa\": container with ID starting with fa83573c19cd649d711006e341b0f5c50e781ecb3ba8ac7da9898db7ae57a8fa not found: ID does not exist" containerID="fa83573c19cd649d711006e341b0f5c50e781ecb3ba8ac7da9898db7ae57a8fa"
May 28 10:17:57.513843 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:17:57.513794    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fa83573c19cd649d711006e341b0f5c50e781ecb3ba8ac7da9898db7ae57a8fa"} err="failed to get container status \"fa83573c19cd649d711006e341b0f5c50e781ecb3ba8ac7da9898db7ae57a8fa\": rpc error: code = NotFound desc = could not find container \"fa83573c19cd649d711006e341b0f5c50e781ecb3ba8ac7da9898db7ae57a8fa\": container with ID starting with fa83573c19cd649d711006e341b0f5c50e781ecb3ba8ac7da9898db7ae57a8fa not found: ID does not exist"
May 28 10:17:57.528533 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:17:57.528476    2565 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["test-ns-feast/postgres-7c7656cc6d-kkrcm"]
May 28 10:17:57.532365 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:17:57.532343    2565 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["test-ns-feast/postgres-7c7656cc6d-kkrcm"]
May 28 10:17:58.511697 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:17:58.511669    2565 generic.go:358] "Generic (PLEG): container finished" podID="90f5cce7-ebb9-4ef0-b6d6-28532aac402a" containerID="d3d6db63de533864cfcba16f090654cced6e7dcee1abbbffd69f4bea902b45fe" exitCode=0
May 28 10:17:58.512035 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:17:58.511711    2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-credit-scoring-88c65549-6csfl" event={"ID":"90f5cce7-ebb9-4ef0-b6d6-28532aac402a","Type":"ContainerDied","Data":"d3d6db63de533864cfcba16f090654cced6e7dcee1abbbffd69f4bea902b45fe"}
May 28 10:17:59.153645 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:17:59.153613    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3a76905c-b32c-49c1-82c3-bfc3ce1b9778" path="/var/lib/kubelet/pods/3a76905c-b32c-49c1-82c3-bfc3ce1b9778/volumes"
May 28 10:18:02.322799 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:18:02.322762    2565 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-credit-scoring-88c65549-6csfl" podUID="90f5cce7-ebb9-4ef0-b6d6-28532aac402a" containerName="online" probeResult="failure" output="Get \"https://10.133.0.22:6567/health\": dial tcp 10.133.0.22:6567: connect: connection refused"
May 28 10:18:12.322146 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:18:12.322103    2565 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-credit-scoring-88c65549-6csfl" podUID="90f5cce7-ebb9-4ef0-b6d6-28532aac402a" containerName="online" probeResult="failure" output="Get \"https://10.133.0.22:6567/health\": dial tcp 10.133.0.22:6567: connect: connection refused"
May 28 10:18:22.322526 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:18:22.322487    2565 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-credit-scoring-88c65549-6csfl" podUID="90f5cce7-ebb9-4ef0-b6d6-28532aac402a" containerName="online" probeResult="failure" output="Get \"https://10.133.0.22:6567/health\": dial tcp 10.133.0.22:6567: connect: connection refused"
May 28 10:18:22.322974 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:18:22.322633    2565 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-credit-scoring-88c65549-6csfl"
May 28 10:18:27.184434 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:18:27.184393    2565 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-credit-scoring-88c65549-6csfl" podUID="90f5cce7-ebb9-4ef0-b6d6-28532aac402a" containerName="registry" probeResult="failure" output="dial tcp 10.133.0.22:6571: connect: connection refused"
May 28 10:18:27.578414 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:18:27.578389    2565 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-credit-scoring-88c65549-6csfl"
May 28 10:18:27.588355 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:18:27.588330    2565 generic.go:358] "Generic (PLEG): container finished" podID="90f5cce7-ebb9-4ef0-b6d6-28532aac402a" containerID="803c3a88263e4ad0baf7a3f42a58ab5c952de6916eb3b53eb5c466536d398da3" exitCode=137
May 28 10:18:27.588355 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:18:27.588356    2565 generic.go:358] "Generic (PLEG): container finished" podID="90f5cce7-ebb9-4ef0-b6d6-28532aac402a" containerID="0551ba8f07f069807fca14ecf0f9dc6e4a824cced8c5c16b7de082ecbcc9ad5e" exitCode=137
May 28 10:18:27.588529 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:18:27.588380    2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-credit-scoring-88c65549-6csfl" event={"ID":"90f5cce7-ebb9-4ef0-b6d6-28532aac402a","Type":"ContainerDied","Data":"803c3a88263e4ad0baf7a3f42a58ab5c952de6916eb3b53eb5c466536d398da3"}
May 28 10:18:27.588529 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:18:27.588410    2565 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-credit-scoring-88c65549-6csfl"
May 28 10:18:27.588529 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:18:27.588425    2565 scope.go:117] "RemoveContainer" containerID="803c3a88263e4ad0baf7a3f42a58ab5c952de6916eb3b53eb5c466536d398da3"
May 28 10:18:27.588529 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:18:27.588413    2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-credit-scoring-88c65549-6csfl" event={"ID":"90f5cce7-ebb9-4ef0-b6d6-28532aac402a","Type":"ContainerDied","Data":"0551ba8f07f069807fca14ecf0f9dc6e4a824cced8c5c16b7de082ecbcc9ad5e"}
May 28 10:18:27.588711 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:18:27.588551    2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-credit-scoring-88c65549-6csfl" event={"ID":"90f5cce7-ebb9-4ef0-b6d6-28532aac402a","Type":"ContainerDied","Data":"4345b9380c7f893bd7fbff2af92cba03533097e8cc76d6cb664c59770542bccb"}
May 28 10:18:27.595697 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:18:27.595681    2565 scope.go:117] "RemoveContainer" containerID="d3d6db63de533864cfcba16f090654cced6e7dcee1abbbffd69f4bea902b45fe"
May 28 10:18:27.603459 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:18:27.603416    2565 scope.go:117] "RemoveContainer" containerID="0551ba8f07f069807fca14ecf0f9dc6e4a824cced8c5c16b7de082ecbcc9ad5e"
May 28 10:18:27.611957 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:18:27.611935    2565 scope.go:117] "RemoveContainer" containerID="b900a72780d38aa300a063c723c8b0895c60ab9913f75658cf36fb7358f30e77"
May 28 10:18:27.621472 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:18:27.621452    2565 scope.go:117] "RemoveContainer" containerID="60e1d5648a8c89667656e184e729efd0ce8f2eec1640410a6372cd57932c72c2"
May 28 10:18:27.628212 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:18:27.628196    2565 scope.go:117] "RemoveContainer" containerID="803c3a88263e4ad0baf7a3f42a58ab5c952de6916eb3b53eb5c466536d398da3"
May 28 10:18:27.628505 ip-10-0-128-206 kubenswrapper[2565]: E0528 10:18:27.628483    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"803c3a88263e4ad0baf7a3f42a58ab5c952de6916eb3b53eb5c466536d398da3\": container with ID starting with 803c3a88263e4ad0baf7a3f42a58ab5c952de6916eb3b53eb5c466536d398da3 not found: ID does not exist" containerID="803c3a88263e4ad0baf7a3f42a58ab5c952de6916eb3b53eb5c466536d398da3"
May 28 10:18:27.628586 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:18:27.628515    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"803c3a88263e4ad0baf7a3f42a58ab5c952de6916eb3b53eb5c466536d398da3"} err="failed to get container status \"803c3a88263e4ad0baf7a3f42a58ab5c952de6916eb3b53eb5c466536d398da3\": rpc error: code = NotFound desc = could not find container \"803c3a88263e4ad0baf7a3f42a58ab5c952de6916eb3b53eb5c466536d398da3\": container with ID starting with 803c3a88263e4ad0baf7a3f42a58ab5c952de6916eb3b53eb5c466536d398da3 not found: ID does not exist"
May 28 10:18:27.628586 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:18:27.628533    2565 scope.go:117] "RemoveContainer" containerID="d3d6db63de533864cfcba16f090654cced6e7dcee1abbbffd69f4bea902b45fe"
May 28 10:18:27.628783 ip-10-0-128-206 kubenswrapper[2565]: E0528 10:18:27.628767    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d3d6db63de533864cfcba16f090654cced6e7dcee1abbbffd69f4bea902b45fe\": container with ID starting with d3d6db63de533864cfcba16f090654cced6e7dcee1abbbffd69f4bea902b45fe not found: ID does not exist" containerID="d3d6db63de533864cfcba16f090654cced6e7dcee1abbbffd69f4bea902b45fe"
May 28 10:18:27.628844 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:18:27.628784    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d3d6db63de533864cfcba16f090654cced6e7dcee1abbbffd69f4bea902b45fe"} err="failed to get container status \"d3d6db63de533864cfcba16f090654cced6e7dcee1abbbffd69f4bea902b45fe\": rpc error: code = NotFound desc = could not find container \"d3d6db63de533864cfcba16f090654cced6e7dcee1abbbffd69f4bea902b45fe\": container with ID starting with d3d6db63de533864cfcba16f090654cced6e7dcee1abbbffd69f4bea902b45fe not found: ID does not exist"
May 28 10:18:27.628844 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:18:27.628796    2565 scope.go:117] "RemoveContainer" containerID="0551ba8f07f069807fca14ecf0f9dc6e4a824cced8c5c16b7de082ecbcc9ad5e"
May 28 10:18:27.629037 ip-10-0-128-206 kubenswrapper[2565]: E0528 10:18:27.629019    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0551ba8f07f069807fca14ecf0f9dc6e4a824cced8c5c16b7de082ecbcc9ad5e\": container with ID starting with 0551ba8f07f069807fca14ecf0f9dc6e4a824cced8c5c16b7de082ecbcc9ad5e not found: ID does not exist" containerID="0551ba8f07f069807fca14ecf0f9dc6e4a824cced8c5c16b7de082ecbcc9ad5e"
May 28 10:18:27.629079 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:18:27.629045    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0551ba8f07f069807fca14ecf0f9dc6e4a824cced8c5c16b7de082ecbcc9ad5e"} err="failed to get container status \"0551ba8f07f069807fca14ecf0f9dc6e4a824cced8c5c16b7de082ecbcc9ad5e\": rpc error: code = NotFound desc = could not find container \"0551ba8f07f069807fca14ecf0f9dc6e4a824cced8c5c16b7de082ecbcc9ad5e\": container with ID starting with 0551ba8f07f069807fca14ecf0f9dc6e4a824cced8c5c16b7de082ecbcc9ad5e not found: ID does not exist"
May 28 10:18:27.629079 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:18:27.629063    2565 scope.go:117] "RemoveContainer" containerID="b900a72780d38aa300a063c723c8b0895c60ab9913f75658cf36fb7358f30e77"
May 28 10:18:27.629299 ip-10-0-128-206 kubenswrapper[2565]: E0528 10:18:27.629282    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b900a72780d38aa300a063c723c8b0895c60ab9913f75658cf36fb7358f30e77\": container with ID starting with b900a72780d38aa300a063c723c8b0895c60ab9913f75658cf36fb7358f30e77 not found: ID does not exist" containerID="b900a72780d38aa300a063c723c8b0895c60ab9913f75658cf36fb7358f30e77"
May 28 10:18:27.629392 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:18:27.629346    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b900a72780d38aa300a063c723c8b0895c60ab9913f75658cf36fb7358f30e77"} err="failed to get container status \"b900a72780d38aa300a063c723c8b0895c60ab9913f75658cf36fb7358f30e77\": rpc error: code = NotFound desc = could not find container \"b900a72780d38aa300a063c723c8b0895c60ab9913f75658cf36fb7358f30e77\": container with ID starting with b900a72780d38aa300a063c723c8b0895c60ab9913f75658cf36fb7358f30e77 not found: ID does not exist"
May 28 10:18:27.629392 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:18:27.629370    2565 scope.go:117] "RemoveContainer" containerID="60e1d5648a8c89667656e184e729efd0ce8f2eec1640410a6372cd57932c72c2"
May 28 10:18:27.629599 ip-10-0-128-206 kubenswrapper[2565]: E0528 10:18:27.629582    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"60e1d5648a8c89667656e184e729efd0ce8f2eec1640410a6372cd57932c72c2\": container with ID starting with 60e1d5648a8c89667656e184e729efd0ce8f2eec1640410a6372cd57932c72c2 not found: ID does not exist" containerID="60e1d5648a8c89667656e184e729efd0ce8f2eec1640410a6372cd57932c72c2"
May 28 10:18:27.629637 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:18:27.629604    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"60e1d5648a8c89667656e184e729efd0ce8f2eec1640410a6372cd57932c72c2"} err="failed to get container status \"60e1d5648a8c89667656e184e729efd0ce8f2eec1640410a6372cd57932c72c2\": rpc error: code = NotFound desc = could not find container \"60e1d5648a8c89667656e184e729efd0ce8f2eec1640410a6372cd57932c72c2\": container with ID starting with 60e1d5648a8c89667656e184e729efd0ce8f2eec1640410a6372cd57932c72c2 not found: ID does not exist"
May 28 10:18:27.629637 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:18:27.629620    2565 scope.go:117] "RemoveContainer" containerID="803c3a88263e4ad0baf7a3f42a58ab5c952de6916eb3b53eb5c466536d398da3"
May 28 10:18:27.629814 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:18:27.629796    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"803c3a88263e4ad0baf7a3f42a58ab5c952de6916eb3b53eb5c466536d398da3"} err="failed to get container status \"803c3a88263e4ad0baf7a3f42a58ab5c952de6916eb3b53eb5c466536d398da3\": rpc error: code = NotFound desc = could not find container \"803c3a88263e4ad0baf7a3f42a58ab5c952de6916eb3b53eb5c466536d398da3\": container with ID starting with 803c3a88263e4ad0baf7a3f42a58ab5c952de6916eb3b53eb5c466536d398da3 not found: ID does not exist"
May 28 10:18:27.629878 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:18:27.629816    2565 scope.go:117] "RemoveContainer" containerID="d3d6db63de533864cfcba16f090654cced6e7dcee1abbbffd69f4bea902b45fe"
May 28 10:18:27.630025 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:18:27.630007    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d3d6db63de533864cfcba16f090654cced6e7dcee1abbbffd69f4bea902b45fe"} err="failed to get container status \"d3d6db63de533864cfcba16f090654cced6e7dcee1abbbffd69f4bea902b45fe\": rpc error: code = NotFound desc = could not find container \"d3d6db63de533864cfcba16f090654cced6e7dcee1abbbffd69f4bea902b45fe\": container with ID starting with d3d6db63de533864cfcba16f090654cced6e7dcee1abbbffd69f4bea902b45fe not found: ID does not exist"
May 28 10:18:27.630074 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:18:27.630026    2565 scope.go:117] "RemoveContainer" containerID="0551ba8f07f069807fca14ecf0f9dc6e4a824cced8c5c16b7de082ecbcc9ad5e"
May 28 10:18:27.630209 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:18:27.630194    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0551ba8f07f069807fca14ecf0f9dc6e4a824cced8c5c16b7de082ecbcc9ad5e"} err="failed to get container status \"0551ba8f07f069807fca14ecf0f9dc6e4a824cced8c5c16b7de082ecbcc9ad5e\": rpc error: code = NotFound desc = could not find container \"0551ba8f07f069807fca14ecf0f9dc6e4a824cced8c5c16b7de082ecbcc9ad5e\": container with ID starting with 0551ba8f07f069807fca14ecf0f9dc6e4a824cced8c5c16b7de082ecbcc9ad5e not found: ID does not exist"
May 28 10:18:27.630209 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:18:27.630208    2565 scope.go:117] "RemoveContainer" containerID="b900a72780d38aa300a063c723c8b0895c60ab9913f75658cf36fb7358f30e77"
May 28 10:18:27.630382 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:18:27.630366    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b900a72780d38aa300a063c723c8b0895c60ab9913f75658cf36fb7358f30e77"} err="failed to get container status \"b900a72780d38aa300a063c723c8b0895c60ab9913f75658cf36fb7358f30e77\": rpc error: code = NotFound desc = could not find container \"b900a72780d38aa300a063c723c8b0895c60ab9913f75658cf36fb7358f30e77\": container with ID starting with b900a72780d38aa300a063c723c8b0895c60ab9913f75658cf36fb7358f30e77 not found: ID does not exist"
May 28 10:18:27.630382 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:18:27.630381    2565 scope.go:117] "RemoveContainer" containerID="60e1d5648a8c89667656e184e729efd0ce8f2eec1640410a6372cd57932c72c2"
May 28 10:18:27.630577 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:18:27.630555    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"60e1d5648a8c89667656e184e729efd0ce8f2eec1640410a6372cd57932c72c2"} err="failed to get container status \"60e1d5648a8c89667656e184e729efd0ce8f2eec1640410a6372cd57932c72c2\": rpc error: code = NotFound desc = could not find container \"60e1d5648a8c89667656e184e729efd0ce8f2eec1640410a6372cd57932c72c2\": container with ID starting with 60e1d5648a8c89667656e184e729efd0ce8f2eec1640410a6372cd57932c72c2 not found: ID does not exist"
May 28 10:18:27.652879 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:18:27.652851    2565 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/90f5cce7-ebb9-4ef0-b6d6-28532aac402a-online-tls\") pod \"90f5cce7-ebb9-4ef0-b6d6-28532aac402a\" (UID: \"90f5cce7-ebb9-4ef0-b6d6-28532aac402a\") "
May 28 10:18:27.652993 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:18:27.652884    2565 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jpn2l\" (UniqueName: \"kubernetes.io/projected/90f5cce7-ebb9-4ef0-b6d6-28532aac402a-kube-api-access-jpn2l\") pod \"90f5cce7-ebb9-4ef0-b6d6-28532aac402a\" (UID: \"90f5cce7-ebb9-4ef0-b6d6-28532aac402a\") "
May 28 10:18:27.653041 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:18:27.653020    2565 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/90f5cce7-ebb9-4ef0-b6d6-28532aac402a-feast-data\") pod \"90f5cce7-ebb9-4ef0-b6d6-28532aac402a\" (UID: \"90f5cce7-ebb9-4ef0-b6d6-28532aac402a\") "
May 28 10:18:27.653084 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:18:27.653060    2565 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/90f5cce7-ebb9-4ef0-b6d6-28532aac402a-offline-tls\") pod \"90f5cce7-ebb9-4ef0-b6d6-28532aac402a\" (UID: \"90f5cce7-ebb9-4ef0-b6d6-28532aac402a\") "
May 28 10:18:27.653084 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:18:27.653077    2565 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/90f5cce7-ebb9-4ef0-b6d6-28532aac402a-registry-tls\") pod \"90f5cce7-ebb9-4ef0-b6d6-28532aac402a\" (UID: \"90f5cce7-ebb9-4ef0-b6d6-28532aac402a\") "
May 28 10:18:27.655153 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:18:27.655122    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/90f5cce7-ebb9-4ef0-b6d6-28532aac402a-offline-tls" (OuterVolumeSpecName: "offline-tls") pod "90f5cce7-ebb9-4ef0-b6d6-28532aac402a" (UID: "90f5cce7-ebb9-4ef0-b6d6-28532aac402a"). InnerVolumeSpecName "offline-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 28 10:18:27.655263 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:18:27.655185    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/90f5cce7-ebb9-4ef0-b6d6-28532aac402a-online-tls" (OuterVolumeSpecName: "online-tls") pod "90f5cce7-ebb9-4ef0-b6d6-28532aac402a" (UID: "90f5cce7-ebb9-4ef0-b6d6-28532aac402a"). InnerVolumeSpecName "online-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 28 10:18:27.655352 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:18:27.655260    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/90f5cce7-ebb9-4ef0-b6d6-28532aac402a-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "90f5cce7-ebb9-4ef0-b6d6-28532aac402a" (UID: "90f5cce7-ebb9-4ef0-b6d6-28532aac402a"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 28 10:18:27.655414 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:18:27.655374    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/90f5cce7-ebb9-4ef0-b6d6-28532aac402a-kube-api-access-jpn2l" (OuterVolumeSpecName: "kube-api-access-jpn2l") pod "90f5cce7-ebb9-4ef0-b6d6-28532aac402a" (UID: "90f5cce7-ebb9-4ef0-b6d6-28532aac402a"). InnerVolumeSpecName "kube-api-access-jpn2l". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 28 10:18:27.661826 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:18:27.661803    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/90f5cce7-ebb9-4ef0-b6d6-28532aac402a-feast-data" (OuterVolumeSpecName: "feast-data") pod "90f5cce7-ebb9-4ef0-b6d6-28532aac402a" (UID: "90f5cce7-ebb9-4ef0-b6d6-28532aac402a"). InnerVolumeSpecName "feast-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 28 10:18:27.754079 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:18:27.753990    2565 reconciler_common.go:299] "Volume detached for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/90f5cce7-ebb9-4ef0-b6d6-28532aac402a-feast-data\") on node \"ip-10-0-128-206.ec2.internal\" DevicePath \"\""
May 28 10:18:27.754079 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:18:27.754033    2565 reconciler_common.go:299] "Volume detached for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/90f5cce7-ebb9-4ef0-b6d6-28532aac402a-offline-tls\") on node \"ip-10-0-128-206.ec2.internal\" DevicePath \"\""
May 28 10:18:27.754079 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:18:27.754042    2565 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/90f5cce7-ebb9-4ef0-b6d6-28532aac402a-registry-tls\") on node \"ip-10-0-128-206.ec2.internal\" DevicePath \"\""
May 28 10:18:27.754079 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:18:27.754051    2565 reconciler_common.go:299] "Volume detached for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/90f5cce7-ebb9-4ef0-b6d6-28532aac402a-online-tls\") on node \"ip-10-0-128-206.ec2.internal\" DevicePath \"\""
May 28 10:18:27.754079 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:18:27.754060    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jpn2l\" (UniqueName: \"kubernetes.io/projected/90f5cce7-ebb9-4ef0-b6d6-28532aac402a-kube-api-access-jpn2l\") on node \"ip-10-0-128-206.ec2.internal\" DevicePath \"\""
May 28 10:18:27.911290 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:18:27.911258    2565 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["test-ns-feast/feast-credit-scoring-88c65549-6csfl"]
May 28 10:18:27.914923 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:18:27.914897    2565 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["test-ns-feast/feast-credit-scoring-88c65549-6csfl"]
May 28 10:18:29.156572 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:18:29.154496    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="90f5cce7-ebb9-4ef0-b6d6-28532aac402a" path="/var/lib/kubelet/pods/90f5cce7-ebb9-4ef0-b6d6-28532aac402a/volumes"
May 28 10:20:19.043386 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:20:19.043347    2565 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["test-ns-feast-rest/redis-854544c579-c7ttb"]
May 28 10:20:19.043758 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:20:19.043589    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="90f5cce7-ebb9-4ef0-b6d6-28532aac402a" containerName="online"
May 28 10:20:19.043758 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:20:19.043600    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="90f5cce7-ebb9-4ef0-b6d6-28532aac402a" containerName="online"
May 28 10:20:19.043758 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:20:19.043609    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="90f5cce7-ebb9-4ef0-b6d6-28532aac402a" containerName="registry"
May 28 10:20:19.043758 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:20:19.043615    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="90f5cce7-ebb9-4ef0-b6d6-28532aac402a" containerName="registry"
May 28 10:20:19.043758 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:20:19.043624    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="90f5cce7-ebb9-4ef0-b6d6-28532aac402a" containerName="feast-init"
May 28 10:20:19.043758 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:20:19.043629    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="90f5cce7-ebb9-4ef0-b6d6-28532aac402a" containerName="feast-init"
May 28 10:20:19.043758 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:20:19.043634    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3a76905c-b32c-49c1-82c3-bfc3ce1b9778" containerName="postgres"
May 28 10:20:19.043758 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:20:19.043640    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="3a76905c-b32c-49c1-82c3-bfc3ce1b9778" containerName="postgres"
May 28 10:20:19.043758 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:20:19.043646    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="90f5cce7-ebb9-4ef0-b6d6-28532aac402a" containerName="feast-apply"
May 28 10:20:19.043758 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:20:19.043652    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="90f5cce7-ebb9-4ef0-b6d6-28532aac402a" containerName="feast-apply"
May 28 10:20:19.043758 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:20:19.043657    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="90f5cce7-ebb9-4ef0-b6d6-28532aac402a" containerName="offline"
May 28 10:20:19.043758 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:20:19.043662    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="90f5cce7-ebb9-4ef0-b6d6-28532aac402a" containerName="offline"
May 28 10:20:19.043758 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:20:19.043705    2565 memory_manager.go:356] "RemoveStaleState removing state" podUID="3a76905c-b32c-49c1-82c3-bfc3ce1b9778" containerName="postgres"
May 28 10:20:19.043758 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:20:19.043713    2565 memory_manager.go:356] "RemoveStaleState removing state" podUID="90f5cce7-ebb9-4ef0-b6d6-28532aac402a" containerName="online"
May 28 10:20:19.043758 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:20:19.043720    2565 memory_manager.go:356] "RemoveStaleState removing state" podUID="90f5cce7-ebb9-4ef0-b6d6-28532aac402a" containerName="registry"
May 28 10:20:19.043758 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:20:19.043726    2565 memory_manager.go:356] "RemoveStaleState removing state" podUID="90f5cce7-ebb9-4ef0-b6d6-28532aac402a" containerName="offline"
May 28 10:20:19.046560 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:20:19.046541    2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast-rest/redis-854544c579-c7ttb"
May 28 10:20:19.049167 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:20:19.049142    2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast-rest\"/\"kube-root-ca.crt\""
May 28 10:20:19.050113 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:20:19.050098    2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast-rest\"/\"default-dockercfg-9bgvj\""
May 28 10:20:19.050170 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:20:19.050108    2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast-rest\"/\"openshift-service-ca.crt\""
May 28 10:20:19.060424 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:20:19.060403    2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["test-ns-feast-rest/redis-854544c579-c7ttb"]
May 28 10:20:19.121735 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:20:19.121703    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gx4x6\" (UniqueName: \"kubernetes.io/projected/880507e0-703d-4116-a8c6-3c6b5c3d453e-kube-api-access-gx4x6\") pod \"redis-854544c579-c7ttb\" (UID: \"880507e0-703d-4116-a8c6-3c6b5c3d453e\") " pod="test-ns-feast-rest/redis-854544c579-c7ttb"
May 28 10:20:19.222945 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:20:19.222917    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-gx4x6\" (UniqueName: \"kubernetes.io/projected/880507e0-703d-4116-a8c6-3c6b5c3d453e-kube-api-access-gx4x6\") pod \"redis-854544c579-c7ttb\" (UID: \"880507e0-703d-4116-a8c6-3c6b5c3d453e\") " pod="test-ns-feast-rest/redis-854544c579-c7ttb"
May 28 10:20:19.232126 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:20:19.232101    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gx4x6\" (UniqueName: \"kubernetes.io/projected/880507e0-703d-4116-a8c6-3c6b5c3d453e-kube-api-access-gx4x6\") pod \"redis-854544c579-c7ttb\" (UID: \"880507e0-703d-4116-a8c6-3c6b5c3d453e\") " pod="test-ns-feast-rest/redis-854544c579-c7ttb"
May 28 10:20:19.365726 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:20:19.365696    2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast-rest/redis-854544c579-c7ttb"
May 28 10:20:19.489682 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:20:19.489661    2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["test-ns-feast-rest/redis-854544c579-c7ttb"]
May 28 10:20:19.492292 ip-10-0-128-206 kubenswrapper[2565]: W0528 10:20:19.492267    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod880507e0_703d_4116_a8c6_3c6b5c3d453e.slice/crio-dbdc6414cb6cbac47f7d6460e6703f47cb7d094d1ce88e0b3bb5413ff8ec4d1e WatchSource:0}: Error finding container dbdc6414cb6cbac47f7d6460e6703f47cb7d094d1ce88e0b3bb5413ff8ec4d1e: Status 404 returned error can't find the container with id dbdc6414cb6cbac47f7d6460e6703f47cb7d094d1ce88e0b3bb5413ff8ec4d1e
May 28 10:20:19.890982 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:20:19.890948    2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/redis-854544c579-c7ttb" event={"ID":"880507e0-703d-4116-a8c6-3c6b5c3d453e","Type":"ContainerStarted","Data":"dbdc6414cb6cbac47f7d6460e6703f47cb7d094d1ce88e0b3bb5413ff8ec4d1e"}
May 28 10:20:21.897994 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:20:21.897960    2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/redis-854544c579-c7ttb" event={"ID":"880507e0-703d-4116-a8c6-3c6b5c3d453e","Type":"ContainerStarted","Data":"84568db546657318eda9f01935927e1b4dfdebbeb8ade5b3355a48e9a4470cbc"}
May 28 10:20:21.913763 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:20:21.913716    2565 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="test-ns-feast-rest/redis-854544c579-c7ttb" podStartSLOduration=1.511397807 podStartE2EDuration="2.913703442s" podCreationTimestamp="2026-05-28 10:20:19 +0000 UTC" firstStartedPulling="2026-05-28 10:20:19.493974463 +0000 UTC m=+904.954308594" lastFinishedPulling="2026-05-28 10:20:20.89628009 +0000 UTC m=+906.356614229" observedRunningTime="2026-05-28 10:20:21.912648572 +0000 UTC m=+907.372982726" watchObservedRunningTime="2026-05-28 10:20:21.913703442 +0000 UTC m=+907.374037593"
May 28 10:20:24.481875 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:20:24.481841    2565 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["test-ns-feast-rest/postgres-7c7656cc6d-ps27j"]
May 28 10:20:24.485106 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:20:24.485082    2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast-rest/postgres-7c7656cc6d-ps27j"
May 28 10:20:24.487748 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:20:24.487727    2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast-rest\"/\"postgres-secret\""
May 28 10:20:24.493599 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:20:24.493577    2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["test-ns-feast-rest/postgres-7c7656cc6d-ps27j"]
May 28 10:20:24.562811 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:20:24.562764    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-95pnc\" (UniqueName: \"kubernetes.io/projected/d654bcf0-a496-4e11-a9f1-36b7e05c4ff1-kube-api-access-95pnc\") pod \"postgres-7c7656cc6d-ps27j\" (UID: \"d654bcf0-a496-4e11-a9f1-36b7e05c4ff1\") " pod="test-ns-feast-rest/postgres-7c7656cc6d-ps27j"
May 28 10:20:24.562988 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:20:24.562819    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"postgresdata\" (UniqueName: \"kubernetes.io/empty-dir/d654bcf0-a496-4e11-a9f1-36b7e05c4ff1-postgresdata\") pod \"postgres-7c7656cc6d-ps27j\" (UID: \"d654bcf0-a496-4e11-a9f1-36b7e05c4ff1\") " pod="test-ns-feast-rest/postgres-7c7656cc6d-ps27j"
May 28 10:20:24.663550 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:20:24.663519    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"postgresdata\" (UniqueName: \"kubernetes.io/empty-dir/d654bcf0-a496-4e11-a9f1-36b7e05c4ff1-postgresdata\") pod \"postgres-7c7656cc6d-ps27j\" (UID: \"d654bcf0-a496-4e11-a9f1-36b7e05c4ff1\") " pod="test-ns-feast-rest/postgres-7c7656cc6d-ps27j"
May 28 10:20:24.663714 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:20:24.663585    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-95pnc\" (UniqueName: \"kubernetes.io/projected/d654bcf0-a496-4e11-a9f1-36b7e05c4ff1-kube-api-access-95pnc\") pod \"postgres-7c7656cc6d-ps27j\" (UID: \"d654bcf0-a496-4e11-a9f1-36b7e05c4ff1\") " pod="test-ns-feast-rest/postgres-7c7656cc6d-ps27j"
May 28 10:20:24.663960 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:20:24.663940    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"postgresdata\" (UniqueName: \"kubernetes.io/empty-dir/d654bcf0-a496-4e11-a9f1-36b7e05c4ff1-postgresdata\") pod \"postgres-7c7656cc6d-ps27j\" (UID: \"d654bcf0-a496-4e11-a9f1-36b7e05c4ff1\") " pod="test-ns-feast-rest/postgres-7c7656cc6d-ps27j"
May 28 10:20:24.671980 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:20:24.671956    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-95pnc\" (UniqueName: \"kubernetes.io/projected/d654bcf0-a496-4e11-a9f1-36b7e05c4ff1-kube-api-access-95pnc\") pod \"postgres-7c7656cc6d-ps27j\" (UID: \"d654bcf0-a496-4e11-a9f1-36b7e05c4ff1\") " pod="test-ns-feast-rest/postgres-7c7656cc6d-ps27j"
May 28 10:20:24.795777 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:20:24.795690    2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast-rest/postgres-7c7656cc6d-ps27j"
May 28 10:20:24.916015 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:20:24.915985    2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["test-ns-feast-rest/postgres-7c7656cc6d-ps27j"]
May 28 10:20:24.919661 ip-10-0-128-206 kubenswrapper[2565]: W0528 10:20:24.919635    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podd654bcf0_a496_4e11_a9f1_36b7e05c4ff1.slice/crio-9d44c1767fad31522c2cc0c38a35a735540ea9e4fe12815e5deaf38df5c9f9fc WatchSource:0}: Error finding container 9d44c1767fad31522c2cc0c38a35a735540ea9e4fe12815e5deaf38df5c9f9fc: Status 404 returned error can't find the container with id 9d44c1767fad31522c2cc0c38a35a735540ea9e4fe12815e5deaf38df5c9f9fc
May 28 10:20:25.912479 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:20:25.912438    2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/postgres-7c7656cc6d-ps27j" event={"ID":"d654bcf0-a496-4e11-a9f1-36b7e05c4ff1","Type":"ContainerStarted","Data":"9b1ba9c7513aac9b9698be812665af9ebd132c24e269b9bbf2c79c6451f66790"}
May 28 10:20:25.912858 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:20:25.912486    2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/postgres-7c7656cc6d-ps27j" event={"ID":"d654bcf0-a496-4e11-a9f1-36b7e05c4ff1","Type":"ContainerStarted","Data":"9d44c1767fad31522c2cc0c38a35a735540ea9e4fe12815e5deaf38df5c9f9fc"}
May 28 10:20:25.930745 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:20:25.930687    2565 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="test-ns-feast-rest/postgres-7c7656cc6d-ps27j" podStartSLOduration=1.9306729379999998 podStartE2EDuration="1.930672938s" podCreationTimestamp="2026-05-28 10:20:24 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-28 10:20:25.928721847 +0000 UTC m=+911.389055998" watchObservedRunningTime="2026-05-28 10:20:25.930672938 +0000 UTC m=+911.391007115"
May 28 10:20:30.147228 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:20:30.147194    2565 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["test-ns-feast-rest/feast-credit-scoring-d6599d595-mqwpf"]
May 28 10:20:30.153078 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:20:30.153051    2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast-rest/feast-credit-scoring-d6599d595-mqwpf"
May 28 10:20:30.155953 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:20:30.155883    2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast-rest\"/\"feast-credit-scoring-registry-tls\""
May 28 10:20:30.156173 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:20:30.155995    2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast-rest\"/\"feast-credit-scoring-intra-comm\""
May 28 10:20:30.156173 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:20:30.156163    2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast-rest\"/\"feast-credit-scoring-online-tls\""
May 28 10:20:30.156296 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:20:30.156200    2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast-rest\"/\"feast-credit-scoring-dockercfg-clzxr\""
May 28 10:20:30.161945 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:20:30.161920    2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["test-ns-feast-rest/feast-credit-scoring-d6599d595-mqwpf"]
May 28 10:20:30.210381 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:20:30.210344    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hlhzj\" (UniqueName: \"kubernetes.io/projected/cd5fd671-347d-4e72-ad5e-f0b87e3e215d-kube-api-access-hlhzj\") pod \"feast-credit-scoring-d6599d595-mqwpf\" (UID: \"cd5fd671-347d-4e72-ad5e-f0b87e3e215d\") " pod="test-ns-feast-rest/feast-credit-scoring-d6599d595-mqwpf"
May 28 10:20:30.210578 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:20:30.210402    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/cd5fd671-347d-4e72-ad5e-f0b87e3e215d-registry-tls\") pod \"feast-credit-scoring-d6599d595-mqwpf\" (UID: \"cd5fd671-347d-4e72-ad5e-f0b87e3e215d\") " pod="test-ns-feast-rest/feast-credit-scoring-d6599d595-mqwpf"
May 28 10:20:30.210578 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:20:30.210432    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/cd5fd671-347d-4e72-ad5e-f0b87e3e215d-online-tls\") pod \"feast-credit-scoring-d6599d595-mqwpf\" (UID: \"cd5fd671-347d-4e72-ad5e-f0b87e3e215d\") " pod="test-ns-feast-rest/feast-credit-scoring-d6599d595-mqwpf"
May 28 10:20:30.210578 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:20:30.210489    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/cd5fd671-347d-4e72-ad5e-f0b87e3e215d-feast-data\") pod \"feast-credit-scoring-d6599d595-mqwpf\" (UID: \"cd5fd671-347d-4e72-ad5e-f0b87e3e215d\") " pod="test-ns-feast-rest/feast-credit-scoring-d6599d595-mqwpf"
May 28 10:20:30.311491 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:20:30.311450    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-hlhzj\" (UniqueName: \"kubernetes.io/projected/cd5fd671-347d-4e72-ad5e-f0b87e3e215d-kube-api-access-hlhzj\") pod \"feast-credit-scoring-d6599d595-mqwpf\" (UID: \"cd5fd671-347d-4e72-ad5e-f0b87e3e215d\") " pod="test-ns-feast-rest/feast-credit-scoring-d6599d595-mqwpf"
May 28 10:20:30.311491 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:20:30.311495    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/cd5fd671-347d-4e72-ad5e-f0b87e3e215d-registry-tls\") pod \"feast-credit-scoring-d6599d595-mqwpf\" (UID: \"cd5fd671-347d-4e72-ad5e-f0b87e3e215d\") " pod="test-ns-feast-rest/feast-credit-scoring-d6599d595-mqwpf"
May 28 10:20:30.311727 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:20:30.311513    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/cd5fd671-347d-4e72-ad5e-f0b87e3e215d-online-tls\") pod \"feast-credit-scoring-d6599d595-mqwpf\" (UID: \"cd5fd671-347d-4e72-ad5e-f0b87e3e215d\") " pod="test-ns-feast-rest/feast-credit-scoring-d6599d595-mqwpf"
May 28 10:20:30.311727 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:20:30.311647    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/cd5fd671-347d-4e72-ad5e-f0b87e3e215d-feast-data\") pod \"feast-credit-scoring-d6599d595-mqwpf\" (UID: \"cd5fd671-347d-4e72-ad5e-f0b87e3e215d\") " pod="test-ns-feast-rest/feast-credit-scoring-d6599d595-mqwpf"
May 28 10:20:30.316615 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:20:30.312353    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/cd5fd671-347d-4e72-ad5e-f0b87e3e215d-feast-data\") pod \"feast-credit-scoring-d6599d595-mqwpf\" (UID: \"cd5fd671-347d-4e72-ad5e-f0b87e3e215d\") " pod="test-ns-feast-rest/feast-credit-scoring-d6599d595-mqwpf"
May 28 10:20:30.316615 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:20:30.315016    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/cd5fd671-347d-4e72-ad5e-f0b87e3e215d-online-tls\") pod \"feast-credit-scoring-d6599d595-mqwpf\" (UID: \"cd5fd671-347d-4e72-ad5e-f0b87e3e215d\") " pod="test-ns-feast-rest/feast-credit-scoring-d6599d595-mqwpf"
May 28 10:20:30.316615 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:20:30.315084    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/cd5fd671-347d-4e72-ad5e-f0b87e3e215d-registry-tls\") pod \"feast-credit-scoring-d6599d595-mqwpf\" (UID: \"cd5fd671-347d-4e72-ad5e-f0b87e3e215d\") " pod="test-ns-feast-rest/feast-credit-scoring-d6599d595-mqwpf"
May 28 10:20:30.321220 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:20:30.321176    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hlhzj\" (UniqueName: \"kubernetes.io/projected/cd5fd671-347d-4e72-ad5e-f0b87e3e215d-kube-api-access-hlhzj\") pod \"feast-credit-scoring-d6599d595-mqwpf\" (UID: \"cd5fd671-347d-4e72-ad5e-f0b87e3e215d\") " pod="test-ns-feast-rest/feast-credit-scoring-d6599d595-mqwpf"
May 28 10:20:30.462624 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:20:30.462526    2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast-rest/feast-credit-scoring-d6599d595-mqwpf"
May 28 10:20:30.590154 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:20:30.590129    2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["test-ns-feast-rest/feast-credit-scoring-d6599d595-mqwpf"]
May 28 10:20:30.592667 ip-10-0-128-206 kubenswrapper[2565]: W0528 10:20:30.592636    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcd5fd671_347d_4e72_ad5e_f0b87e3e215d.slice/crio-bf8922538239eb9a38bf940308ae90a07cb002d25f2e9395596c87d9eef3087a WatchSource:0}: Error finding container bf8922538239eb9a38bf940308ae90a07cb002d25f2e9395596c87d9eef3087a: Status 404 returned error can't find the container with id bf8922538239eb9a38bf940308ae90a07cb002d25f2e9395596c87d9eef3087a
May 28 10:20:30.927956 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:20:30.927917    2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-credit-scoring-d6599d595-mqwpf" event={"ID":"cd5fd671-347d-4e72-ad5e-f0b87e3e215d","Type":"ContainerStarted","Data":"fd092dcaa9239069b93990422c1fb5d7ba07e8bdda9642540e545a7f2c3dc62d"}
May 28 10:20:30.927956 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:20:30.927957    2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-credit-scoring-d6599d595-mqwpf" event={"ID":"cd5fd671-347d-4e72-ad5e-f0b87e3e215d","Type":"ContainerStarted","Data":"bf8922538239eb9a38bf940308ae90a07cb002d25f2e9395596c87d9eef3087a"}
May 28 10:20:32.934121 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:20:32.934092    2565 generic.go:358] "Generic (PLEG): container finished" podID="cd5fd671-347d-4e72-ad5e-f0b87e3e215d" containerID="fd092dcaa9239069b93990422c1fb5d7ba07e8bdda9642540e545a7f2c3dc62d" exitCode=0
May 28 10:20:32.934495 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:20:32.934130    2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-credit-scoring-d6599d595-mqwpf" event={"ID":"cd5fd671-347d-4e72-ad5e-f0b87e3e215d","Type":"ContainerDied","Data":"fd092dcaa9239069b93990422c1fb5d7ba07e8bdda9642540e545a7f2c3dc62d"}
May 28 10:20:33.938858 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:20:33.938825    2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-credit-scoring-d6599d595-mqwpf" event={"ID":"cd5fd671-347d-4e72-ad5e-f0b87e3e215d","Type":"ContainerStarted","Data":"c0fb71253ed4261cfc2f39067e630b3a8719a6cbded0c77c7c5903fe9035316a"}
May 28 10:20:39.955415 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:20:39.955381    2565 generic.go:358] "Generic (PLEG): container finished" podID="cd5fd671-347d-4e72-ad5e-f0b87e3e215d" containerID="c0fb71253ed4261cfc2f39067e630b3a8719a6cbded0c77c7c5903fe9035316a" exitCode=0
May 28 10:20:39.955780 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:20:39.955449    2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-credit-scoring-d6599d595-mqwpf" event={"ID":"cd5fd671-347d-4e72-ad5e-f0b87e3e215d","Type":"ContainerDied","Data":"c0fb71253ed4261cfc2f39067e630b3a8719a6cbded0c77c7c5903fe9035316a"}
May 28 10:20:40.960677 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:20:40.960641    2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-credit-scoring-d6599d595-mqwpf" event={"ID":"cd5fd671-347d-4e72-ad5e-f0b87e3e215d","Type":"ContainerStarted","Data":"6a59103f257efe133b90722d7aa425b310ade1cafb7a5f119cb4c9781ee8a645"}
May 28 10:20:40.960677 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:20:40.960681    2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-credit-scoring-d6599d595-mqwpf" event={"ID":"cd5fd671-347d-4e72-ad5e-f0b87e3e215d","Type":"ContainerStarted","Data":"22062b5d4b3d1d4a7cf8e647176e7c9c0da6138c979f802a6b7c149aac3b2aeb"}
May 28 10:20:40.987881 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:20:40.987820    2565 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="test-ns-feast-rest/feast-credit-scoring-d6599d595-mqwpf" podStartSLOduration=10.987801371 podStartE2EDuration="10.987801371s" podCreationTimestamp="2026-05-28 10:20:30 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-28 10:20:40.987377637 +0000 UTC m=+926.447711790" watchObservedRunningTime="2026-05-28 10:20:40.987801371 +0000 UTC m=+926.448135523"
May 28 10:20:42.463287 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:20:42.463248    2565 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast-rest/feast-credit-scoring-d6599d595-mqwpf"
May 28 10:20:42.463287 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:20:42.463295    2565 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast-rest/feast-credit-scoring-d6599d595-mqwpf"
May 28 10:20:42.464886 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:20:42.464855    2565 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast-rest/feast-credit-scoring-d6599d595-mqwpf" podUID="cd5fd671-347d-4e72-ad5e-f0b87e3e215d" containerName="registry" probeResult="failure" output="dial tcp 10.133.0.25:6571: connect: connection refused"
May 28 10:20:42.465020 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:20:42.464887    2565 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast-rest/feast-credit-scoring-d6599d595-mqwpf" podUID="cd5fd671-347d-4e72-ad5e-f0b87e3e215d" containerName="online" probeResult="failure" output="Get \"https://10.133.0.25:6567/health\": dial tcp 10.133.0.25:6567: connect: connection refused"
May 28 10:20:45.463571 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:20:45.463514    2565 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast-rest/feast-credit-scoring-d6599d595-mqwpf" podUID="cd5fd671-347d-4e72-ad5e-f0b87e3e215d" containerName="registry" probeResult="failure" output="dial tcp 10.133.0.25:6571: connect: connection refused"
May 28 10:20:45.931622 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:20:45.931573    2565 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast-rest/feast-credit-scoring-d6599d595-mqwpf"
May 28 10:20:45.932153 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:20:45.932134    2565 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast-rest/feast-credit-scoring-d6599d595-mqwpf"
May 28 10:20:45.934704 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:20:45.934680    2565 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast-rest/feast-credit-scoring-d6599d595-mqwpf"
May 28 10:20:48.463671 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:20:48.463627    2565 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast-rest/feast-credit-scoring-d6599d595-mqwpf" podUID="cd5fd671-347d-4e72-ad5e-f0b87e3e215d" containerName="registry" probeResult="failure" output="dial tcp 10.133.0.25:6571: connect: connection refused"
May 28 10:20:50.463026 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:20:50.462987    2565 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast-rest/feast-credit-scoring-d6599d595-mqwpf"
May 28 10:20:51.463500 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:20:51.463469    2565 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast-rest/feast-credit-scoring-d6599d595-mqwpf"
May 28 10:20:51.464110 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:20:51.464092    2565 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast-rest/feast-credit-scoring-d6599d595-mqwpf"
May 28 10:20:56.004585 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:20:56.004549    2565 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["test-ns-feast-rest/feast-driver-ranking-d49489fb-wvbrq"]
May 28 10:20:56.008949 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:20:56.008932    2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast-rest/feast-driver-ranking-d49489fb-wvbrq"
May 28 10:20:56.011658 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:20:56.011640    2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast-rest\"/\"feast-driver-ranking-registry-tls\""
May 28 10:20:56.011815 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:20:56.011803    2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast-rest\"/\"feast-driver-ranking-online-tls\""
May 28 10:20:56.011869 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:20:56.011846    2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast-rest\"/\"feast-driver-ranking-intra-comm\""
May 28 10:20:56.011929 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:20:56.011846    2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast-rest\"/\"feast-driver-ranking-dockercfg-2wmm7\""
May 28 10:20:56.019575 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:20:56.019542    2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["test-ns-feast-rest/feast-driver-ranking-d49489fb-wvbrq"]
May 28 10:20:56.114409 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:20:56.114381    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ksmkd\" (UniqueName: \"kubernetes.io/projected/52a76d46-cbf0-4bd2-8be7-2f4a4c4362e7-kube-api-access-ksmkd\") pod \"feast-driver-ranking-d49489fb-wvbrq\" (UID: \"52a76d46-cbf0-4bd2-8be7-2f4a4c4362e7\") " pod="test-ns-feast-rest/feast-driver-ranking-d49489fb-wvbrq"
May 28 10:20:56.114547 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:20:56.114416    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/52a76d46-cbf0-4bd2-8be7-2f4a4c4362e7-feast-data\") pod \"feast-driver-ranking-d49489fb-wvbrq\" (UID: \"52a76d46-cbf0-4bd2-8be7-2f4a4c4362e7\") " pod="test-ns-feast-rest/feast-driver-ranking-d49489fb-wvbrq"
May 28 10:20:56.114547 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:20:56.114459    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/52a76d46-cbf0-4bd2-8be7-2f4a4c4362e7-registry-tls\") pod \"feast-driver-ranking-d49489fb-wvbrq\" (UID: \"52a76d46-cbf0-4bd2-8be7-2f4a4c4362e7\") " pod="test-ns-feast-rest/feast-driver-ranking-d49489fb-wvbrq"
May 28 10:20:56.114547 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:20:56.114480    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/52a76d46-cbf0-4bd2-8be7-2f4a4c4362e7-online-tls\") pod \"feast-driver-ranking-d49489fb-wvbrq\" (UID: \"52a76d46-cbf0-4bd2-8be7-2f4a4c4362e7\") " pod="test-ns-feast-rest/feast-driver-ranking-d49489fb-wvbrq"
May 28 10:20:56.215660 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:20:56.215622    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-ksmkd\" (UniqueName: \"kubernetes.io/projected/52a76d46-cbf0-4bd2-8be7-2f4a4c4362e7-kube-api-access-ksmkd\") pod \"feast-driver-ranking-d49489fb-wvbrq\" (UID: \"52a76d46-cbf0-4bd2-8be7-2f4a4c4362e7\") " pod="test-ns-feast-rest/feast-driver-ranking-d49489fb-wvbrq"
May 28 10:20:56.215837 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:20:56.215665    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/52a76d46-cbf0-4bd2-8be7-2f4a4c4362e7-feast-data\") pod \"feast-driver-ranking-d49489fb-wvbrq\" (UID: \"52a76d46-cbf0-4bd2-8be7-2f4a4c4362e7\") " pod="test-ns-feast-rest/feast-driver-ranking-d49489fb-wvbrq"
May 28 10:20:56.215837 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:20:56.215709    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/52a76d46-cbf0-4bd2-8be7-2f4a4c4362e7-registry-tls\") pod \"feast-driver-ranking-d49489fb-wvbrq\" (UID: \"52a76d46-cbf0-4bd2-8be7-2f4a4c4362e7\") " pod="test-ns-feast-rest/feast-driver-ranking-d49489fb-wvbrq"
May 28 10:20:56.215837 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:20:56.215737    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/52a76d46-cbf0-4bd2-8be7-2f4a4c4362e7-online-tls\") pod \"feast-driver-ranking-d49489fb-wvbrq\" (UID: \"52a76d46-cbf0-4bd2-8be7-2f4a4c4362e7\") " pod="test-ns-feast-rest/feast-driver-ranking-d49489fb-wvbrq"
May 28 10:20:56.216092 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:20:56.216073    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/52a76d46-cbf0-4bd2-8be7-2f4a4c4362e7-feast-data\") pod \"feast-driver-ranking-d49489fb-wvbrq\" (UID: \"52a76d46-cbf0-4bd2-8be7-2f4a4c4362e7\") " pod="test-ns-feast-rest/feast-driver-ranking-d49489fb-wvbrq"
May 28 10:20:56.218325 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:20:56.218285    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/52a76d46-cbf0-4bd2-8be7-2f4a4c4362e7-online-tls\") pod \"feast-driver-ranking-d49489fb-wvbrq\" (UID: \"52a76d46-cbf0-4bd2-8be7-2f4a4c4362e7\") " pod="test-ns-feast-rest/feast-driver-ranking-d49489fb-wvbrq"
May 28 10:20:56.218403 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:20:56.218376    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/52a76d46-cbf0-4bd2-8be7-2f4a4c4362e7-registry-tls\") pod \"feast-driver-ranking-d49489fb-wvbrq\" (UID: \"52a76d46-cbf0-4bd2-8be7-2f4a4c4362e7\") " pod="test-ns-feast-rest/feast-driver-ranking-d49489fb-wvbrq"
May 28 10:20:56.224537 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:20:56.224517    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ksmkd\" (UniqueName: \"kubernetes.io/projected/52a76d46-cbf0-4bd2-8be7-2f4a4c4362e7-kube-api-access-ksmkd\") pod \"feast-driver-ranking-d49489fb-wvbrq\" (UID: \"52a76d46-cbf0-4bd2-8be7-2f4a4c4362e7\") " pod="test-ns-feast-rest/feast-driver-ranking-d49489fb-wvbrq"
May 28 10:20:56.317652 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:20:56.317566    2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast-rest/feast-driver-ranking-d49489fb-wvbrq"
May 28 10:20:56.443029 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:20:56.442796    2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["test-ns-feast-rest/feast-driver-ranking-d49489fb-wvbrq"]
May 28 10:20:56.445797 ip-10-0-128-206 kubenswrapper[2565]: W0528 10:20:56.445772    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod52a76d46_cbf0_4bd2_8be7_2f4a4c4362e7.slice/crio-89d922b34d8fe58be54eaf3560056c7e15d7fb52924959415916e91b321a5f4d WatchSource:0}: Error finding container 89d922b34d8fe58be54eaf3560056c7e15d7fb52924959415916e91b321a5f4d: Status 404 returned error can't find the container with id 89d922b34d8fe58be54eaf3560056c7e15d7fb52924959415916e91b321a5f4d
May 28 10:20:57.007537 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:20:57.007497    2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-driver-ranking-d49489fb-wvbrq" event={"ID":"52a76d46-cbf0-4bd2-8be7-2f4a4c4362e7","Type":"ContainerStarted","Data":"32db03e243414fab50972c1c066966d10fdc2ee0713664514749cc9034665182"}
May 28 10:20:57.007537 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:20:57.007538    2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-driver-ranking-d49489fb-wvbrq" event={"ID":"52a76d46-cbf0-4bd2-8be7-2f4a4c4362e7","Type":"ContainerStarted","Data":"89d922b34d8fe58be54eaf3560056c7e15d7fb52924959415916e91b321a5f4d"}
May 28 10:21:01.020155 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:21:01.020119    2565 generic.go:358] "Generic (PLEG): container finished" podID="52a76d46-cbf0-4bd2-8be7-2f4a4c4362e7" containerID="32db03e243414fab50972c1c066966d10fdc2ee0713664514749cc9034665182" exitCode=0
May 28 10:21:01.020655 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:21:01.020181    2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-driver-ranking-d49489fb-wvbrq" event={"ID":"52a76d46-cbf0-4bd2-8be7-2f4a4c4362e7","Type":"ContainerDied","Data":"32db03e243414fab50972c1c066966d10fdc2ee0713664514749cc9034665182"}
May 28 10:21:02.024949 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:21:02.024914    2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-driver-ranking-d49489fb-wvbrq" event={"ID":"52a76d46-cbf0-4bd2-8be7-2f4a4c4362e7","Type":"ContainerStarted","Data":"a6b005b201f7409b8652b35b2c58f021651244a55fb4d1673e32c2c5351bdfe0"}
May 28 10:21:08.044249 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:21:08.044211    2565 generic.go:358] "Generic (PLEG): container finished" podID="52a76d46-cbf0-4bd2-8be7-2f4a4c4362e7" containerID="a6b005b201f7409b8652b35b2c58f021651244a55fb4d1673e32c2c5351bdfe0" exitCode=0
May 28 10:21:08.044618 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:21:08.044272    2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-driver-ranking-d49489fb-wvbrq" event={"ID":"52a76d46-cbf0-4bd2-8be7-2f4a4c4362e7","Type":"ContainerDied","Data":"a6b005b201f7409b8652b35b2c58f021651244a55fb4d1673e32c2c5351bdfe0"}
May 28 10:21:09.049553 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:21:09.049518    2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-driver-ranking-d49489fb-wvbrq" event={"ID":"52a76d46-cbf0-4bd2-8be7-2f4a4c4362e7","Type":"ContainerStarted","Data":"6fffe43a7e8e70854e6e86b0a33d852580c1ddf2f7e032db052683c7c217cff8"}
May 28 10:21:09.049918 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:21:09.049561    2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-driver-ranking-d49489fb-wvbrq" event={"ID":"52a76d46-cbf0-4bd2-8be7-2f4a4c4362e7","Type":"ContainerStarted","Data":"04dfd0e942dcb3e8700be2cbda3cb11c22f8d691f7f3bffd1ac3ba7c9e5b8715"}
May 28 10:21:09.073889 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:21:09.073835    2565 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="test-ns-feast-rest/feast-driver-ranking-d49489fb-wvbrq" podStartSLOduration=14.073817679 podStartE2EDuration="14.073817679s" podCreationTimestamp="2026-05-28 10:20:55 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-28 10:21:09.072979545 +0000 UTC m=+954.533313709" watchObservedRunningTime="2026-05-28 10:21:09.073817679 +0000 UTC m=+954.534151829"
May 28 10:21:11.318464 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:21:11.318420    2565 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast-rest/feast-driver-ranking-d49489fb-wvbrq"
May 28 10:21:11.318972 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:21:11.318478    2565 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast-rest/feast-driver-ranking-d49489fb-wvbrq"
May 28 10:21:11.320087 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:21:11.320043    2565 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast-rest/feast-driver-ranking-d49489fb-wvbrq" podUID="52a76d46-cbf0-4bd2-8be7-2f4a4c4362e7" containerName="registry" probeResult="failure" output="dial tcp 10.133.0.26:6571: connect: connection refused"
May 28 10:21:11.320196 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:21:11.320082    2565 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast-rest/feast-driver-ranking-d49489fb-wvbrq" podUID="52a76d46-cbf0-4bd2-8be7-2f4a4c4362e7" containerName="online" probeResult="failure" output="Get \"https://10.133.0.26:6567/health\": dial tcp 10.133.0.26:6567: connect: connection refused"
May 28 10:21:14.318138 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:21:14.318096    2565 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast-rest/feast-driver-ranking-d49489fb-wvbrq" podUID="52a76d46-cbf0-4bd2-8be7-2f4a4c4362e7" containerName="registry" probeResult="failure" output="dial tcp 10.133.0.26:6571: connect: connection refused"
May 28 10:21:14.323391 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:21:14.323357    2565 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast-rest/feast-driver-ranking-d49489fb-wvbrq"
May 28 10:21:14.323938 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:21:14.323917    2565 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast-rest/feast-driver-ranking-d49489fb-wvbrq"
May 28 10:21:14.326712 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:21:14.326685    2565 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast-rest/feast-driver-ranking-d49489fb-wvbrq"
May 28 10:21:16.317757 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:21:16.317707    2565 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast-rest/feast-driver-ranking-d49489fb-wvbrq"
May 28 10:21:17.318581 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:21:17.318535    2565 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast-rest/feast-driver-ranking-d49489fb-wvbrq" podUID="52a76d46-cbf0-4bd2-8be7-2f4a4c4362e7" containerName="registry" probeResult="failure" output="dial tcp 10.133.0.26:6571: connect: connection refused"
May 28 10:21:20.319255 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:21:20.319216    2565 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast-rest/feast-driver-ranking-d49489fb-wvbrq"
May 28 10:21:20.319969 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:21:20.319951    2565 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast-rest/feast-driver-ranking-d49489fb-wvbrq"
May 28 10:22:34.503962 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:22:34.503928    2565 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["test-ns-feast-rest/feast-credit-scoring-d6599d595-mqwpf"]
May 28 10:22:34.504456 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:22:34.504272    2565 kuberuntime_container.go:864] "Killing container with a grace period" pod="test-ns-feast-rest/feast-credit-scoring-d6599d595-mqwpf" podUID="cd5fd671-347d-4e72-ad5e-f0b87e3e215d" containerName="registry" containerID="cri-o://22062b5d4b3d1d4a7cf8e647176e7c9c0da6138c979f802a6b7c149aac3b2aeb" gracePeriod=30
May 28 10:22:34.504456 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:22:34.504339    2565 kuberuntime_container.go:864] "Killing container with a grace period" pod="test-ns-feast-rest/feast-credit-scoring-d6599d595-mqwpf" podUID="cd5fd671-347d-4e72-ad5e-f0b87e3e215d" containerName="online" containerID="cri-o://6a59103f257efe133b90722d7aa425b310ade1cafb7a5f119cb4c9781ee8a645" gracePeriod=30
May 28 10:22:34.509783 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:22:34.509760    2565 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["test-ns-feast-rest/feast-driver-ranking-d49489fb-wvbrq"]
May 28 10:22:34.510074 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:22:34.510035    2565 kuberuntime_container.go:864] "Killing container with a grace period" pod="test-ns-feast-rest/feast-driver-ranking-d49489fb-wvbrq" podUID="52a76d46-cbf0-4bd2-8be7-2f4a4c4362e7" containerName="registry" containerID="cri-o://04dfd0e942dcb3e8700be2cbda3cb11c22f8d691f7f3bffd1ac3ba7c9e5b8715" gracePeriod=30
May 28 10:22:34.510339 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:22:34.510070    2565 kuberuntime_container.go:864] "Killing container with a grace period" pod="test-ns-feast-rest/feast-driver-ranking-d49489fb-wvbrq" podUID="52a76d46-cbf0-4bd2-8be7-2f4a4c4362e7" containerName="online" containerID="cri-o://6fffe43a7e8e70854e6e86b0a33d852580c1ddf2f7e032db052683c7c217cff8" gracePeriod=30
May 28 10:22:35.933304 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:22:35.933252    2565 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast-rest/feast-credit-scoring-d6599d595-mqwpf" podUID="cd5fd671-347d-4e72-ad5e-f0b87e3e215d" containerName="online" probeResult="failure" output="Get \"https://10.133.0.25:6567/health\": dial tcp 10.133.0.25:6567: connect: connection refused"
May 28 10:22:36.298587 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:22:36.298501    2565 generic.go:358] "Generic (PLEG): container finished" podID="cd5fd671-347d-4e72-ad5e-f0b87e3e215d" containerID="6a59103f257efe133b90722d7aa425b310ade1cafb7a5f119cb4c9781ee8a645" exitCode=0
May 28 10:22:36.298739 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:22:36.298578    2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-credit-scoring-d6599d595-mqwpf" event={"ID":"cd5fd671-347d-4e72-ad5e-f0b87e3e215d","Type":"ContainerDied","Data":"6a59103f257efe133b90722d7aa425b310ade1cafb7a5f119cb4c9781ee8a645"}
May 28 10:22:36.300637 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:22:36.300617    2565 generic.go:358] "Generic (PLEG): container finished" podID="52a76d46-cbf0-4bd2-8be7-2f4a4c4362e7" containerID="6fffe43a7e8e70854e6e86b0a33d852580c1ddf2f7e032db052683c7c217cff8" exitCode=0
May 28 10:22:36.300743 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:22:36.300649    2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-driver-ranking-d49489fb-wvbrq" event={"ID":"52a76d46-cbf0-4bd2-8be7-2f4a4c4362e7","Type":"ContainerDied","Data":"6fffe43a7e8e70854e6e86b0a33d852580c1ddf2f7e032db052683c7c217cff8"}
May 28 10:22:36.779779 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:22:36.779744    2565 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["test-ns-feast-rest/postgres-7c7656cc6d-ps27j"]
May 28 10:22:36.779964 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:22:36.779945    2565 kuberuntime_container.go:864] "Killing container with a grace period" pod="test-ns-feast-rest/postgres-7c7656cc6d-ps27j" podUID="d654bcf0-a496-4e11-a9f1-36b7e05c4ff1" containerName="postgres" containerID="cri-o://9b1ba9c7513aac9b9698be812665af9ebd132c24e269b9bbf2c79c6451f66790" gracePeriod=30
May 28 10:22:36.783901 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:22:36.783876    2565 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["test-ns-feast-rest/redis-854544c579-c7ttb"]
May 28 10:22:36.784107 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:22:36.784067    2565 kuberuntime_container.go:864] "Killing container with a grace period" pod="test-ns-feast-rest/redis-854544c579-c7ttb" podUID="880507e0-703d-4116-a8c6-3c6b5c3d453e" containerName="redis" containerID="cri-o://84568db546657318eda9f01935927e1b4dfdebbeb8ade5b3355a48e9a4470cbc" gracePeriod=30
May 28 10:22:37.042471 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:22:37.042451    2565 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast-rest/postgres-7c7656cc6d-ps27j"
May 28 10:22:37.045562 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:22:37.045545    2565 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast-rest/redis-854544c579-c7ttb"
May 28 10:22:37.095687 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:22:37.095655    2565 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gx4x6\" (UniqueName: \"kubernetes.io/projected/880507e0-703d-4116-a8c6-3c6b5c3d453e-kube-api-access-gx4x6\") pod \"880507e0-703d-4116-a8c6-3c6b5c3d453e\" (UID: \"880507e0-703d-4116-a8c6-3c6b5c3d453e\") "
May 28 10:22:37.095874 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:22:37.095725    2565 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"postgresdata\" (UniqueName: \"kubernetes.io/empty-dir/d654bcf0-a496-4e11-a9f1-36b7e05c4ff1-postgresdata\") pod \"d654bcf0-a496-4e11-a9f1-36b7e05c4ff1\" (UID: \"d654bcf0-a496-4e11-a9f1-36b7e05c4ff1\") "
May 28 10:22:37.095874 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:22:37.095789    2565 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-95pnc\" (UniqueName: \"kubernetes.io/projected/d654bcf0-a496-4e11-a9f1-36b7e05c4ff1-kube-api-access-95pnc\") pod \"d654bcf0-a496-4e11-a9f1-36b7e05c4ff1\" (UID: \"d654bcf0-a496-4e11-a9f1-36b7e05c4ff1\") "
May 28 10:22:37.098685 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:22:37.098649    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/880507e0-703d-4116-a8c6-3c6b5c3d453e-kube-api-access-gx4x6" (OuterVolumeSpecName: "kube-api-access-gx4x6") pod "880507e0-703d-4116-a8c6-3c6b5c3d453e" (UID: "880507e0-703d-4116-a8c6-3c6b5c3d453e"). InnerVolumeSpecName "kube-api-access-gx4x6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 28 10:22:37.098835 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:22:37.098698    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d654bcf0-a496-4e11-a9f1-36b7e05c4ff1-kube-api-access-95pnc" (OuterVolumeSpecName: "kube-api-access-95pnc") pod "d654bcf0-a496-4e11-a9f1-36b7e05c4ff1" (UID: "d654bcf0-a496-4e11-a9f1-36b7e05c4ff1"). InnerVolumeSpecName "kube-api-access-95pnc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 28 10:22:37.127037 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:22:37.127002    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d654bcf0-a496-4e11-a9f1-36b7e05c4ff1-postgresdata" (OuterVolumeSpecName: "postgresdata") pod "d654bcf0-a496-4e11-a9f1-36b7e05c4ff1" (UID: "d654bcf0-a496-4e11-a9f1-36b7e05c4ff1"). InnerVolumeSpecName "postgresdata". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 28 10:22:37.197122 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:22:37.197086    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gx4x6\" (UniqueName: \"kubernetes.io/projected/880507e0-703d-4116-a8c6-3c6b5c3d453e-kube-api-access-gx4x6\") on node \"ip-10-0-128-206.ec2.internal\" DevicePath \"\""
May 28 10:22:37.197122 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:22:37.197108    2565 reconciler_common.go:299] "Volume detached for volume \"postgresdata\" (UniqueName: \"kubernetes.io/empty-dir/d654bcf0-a496-4e11-a9f1-36b7e05c4ff1-postgresdata\") on node \"ip-10-0-128-206.ec2.internal\" DevicePath \"\""
May 28 10:22:37.197122 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:22:37.197118    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-95pnc\" (UniqueName: \"kubernetes.io/projected/d654bcf0-a496-4e11-a9f1-36b7e05c4ff1-kube-api-access-95pnc\") on node \"ip-10-0-128-206.ec2.internal\" DevicePath \"\""
May 28 10:22:37.305543 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:22:37.305459    2565 generic.go:358] "Generic (PLEG): container finished" podID="d654bcf0-a496-4e11-a9f1-36b7e05c4ff1" containerID="9b1ba9c7513aac9b9698be812665af9ebd132c24e269b9bbf2c79c6451f66790" exitCode=0
May 28 10:22:37.305543 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:22:37.305513    2565 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast-rest/postgres-7c7656cc6d-ps27j"
May 28 10:22:37.305745 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:22:37.305548    2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/postgres-7c7656cc6d-ps27j" event={"ID":"d654bcf0-a496-4e11-a9f1-36b7e05c4ff1","Type":"ContainerDied","Data":"9b1ba9c7513aac9b9698be812665af9ebd132c24e269b9bbf2c79c6451f66790"}
May 28 10:22:37.305745 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:22:37.305590    2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/postgres-7c7656cc6d-ps27j" event={"ID":"d654bcf0-a496-4e11-a9f1-36b7e05c4ff1","Type":"ContainerDied","Data":"9d44c1767fad31522c2cc0c38a35a735540ea9e4fe12815e5deaf38df5c9f9fc"}
May 28 10:22:37.305745 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:22:37.305609    2565 scope.go:117] "RemoveContainer" containerID="9b1ba9c7513aac9b9698be812665af9ebd132c24e269b9bbf2c79c6451f66790"
May 28 10:22:37.306715 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:22:37.306694    2565 generic.go:358] "Generic (PLEG): container finished" podID="880507e0-703d-4116-a8c6-3c6b5c3d453e" containerID="84568db546657318eda9f01935927e1b4dfdebbeb8ade5b3355a48e9a4470cbc" exitCode=0
May 28 10:22:37.306795 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:22:37.306748    2565 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast-rest/redis-854544c579-c7ttb"
May 28 10:22:37.306795 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:22:37.306751    2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/redis-854544c579-c7ttb" event={"ID":"880507e0-703d-4116-a8c6-3c6b5c3d453e","Type":"ContainerDied","Data":"84568db546657318eda9f01935927e1b4dfdebbeb8ade5b3355a48e9a4470cbc"}
May 28 10:22:37.306795 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:22:37.306776    2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/redis-854544c579-c7ttb" event={"ID":"880507e0-703d-4116-a8c6-3c6b5c3d453e","Type":"ContainerDied","Data":"dbdc6414cb6cbac47f7d6460e6703f47cb7d094d1ce88e0b3bb5413ff8ec4d1e"}
May 28 10:22:37.313443 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:22:37.313428    2565 scope.go:117] "RemoveContainer" containerID="9b1ba9c7513aac9b9698be812665af9ebd132c24e269b9bbf2c79c6451f66790"
May 28 10:22:37.313700 ip-10-0-128-206 kubenswrapper[2565]: E0528 10:22:37.313682    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9b1ba9c7513aac9b9698be812665af9ebd132c24e269b9bbf2c79c6451f66790\": container with ID starting with 9b1ba9c7513aac9b9698be812665af9ebd132c24e269b9bbf2c79c6451f66790 not found: ID does not exist" containerID="9b1ba9c7513aac9b9698be812665af9ebd132c24e269b9bbf2c79c6451f66790"
May 28 10:22:37.313750 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:22:37.313707    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9b1ba9c7513aac9b9698be812665af9ebd132c24e269b9bbf2c79c6451f66790"} err="failed to get container status \"9b1ba9c7513aac9b9698be812665af9ebd132c24e269b9bbf2c79c6451f66790\": rpc error: code = NotFound desc = could not find container \"9b1ba9c7513aac9b9698be812665af9ebd132c24e269b9bbf2c79c6451f66790\": container with ID starting with 9b1ba9c7513aac9b9698be812665af9ebd132c24e269b9bbf2c79c6451f66790 not found: ID does not exist"
May 28 10:22:37.313750 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:22:37.313726    2565 scope.go:117] "RemoveContainer" containerID="84568db546657318eda9f01935927e1b4dfdebbeb8ade5b3355a48e9a4470cbc"
May 28 10:22:37.320872 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:22:37.320654    2565 scope.go:117] "RemoveContainer" containerID="84568db546657318eda9f01935927e1b4dfdebbeb8ade5b3355a48e9a4470cbc"
May 28 10:22:37.320969 ip-10-0-128-206 kubenswrapper[2565]: E0528 10:22:37.320948    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"84568db546657318eda9f01935927e1b4dfdebbeb8ade5b3355a48e9a4470cbc\": container with ID starting with 84568db546657318eda9f01935927e1b4dfdebbeb8ade5b3355a48e9a4470cbc not found: ID does not exist" containerID="84568db546657318eda9f01935927e1b4dfdebbeb8ade5b3355a48e9a4470cbc"
May 28 10:22:37.321026 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:22:37.320981    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"84568db546657318eda9f01935927e1b4dfdebbeb8ade5b3355a48e9a4470cbc"} err="failed to get container status \"84568db546657318eda9f01935927e1b4dfdebbeb8ade5b3355a48e9a4470cbc\": rpc error: code = NotFound desc = could not find container \"84568db546657318eda9f01935927e1b4dfdebbeb8ade5b3355a48e9a4470cbc\": container with ID starting with 84568db546657318eda9f01935927e1b4dfdebbeb8ade5b3355a48e9a4470cbc not found: ID does not exist"
May 28 10:22:37.321815 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:22:37.321796    2565 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["test-ns-feast-rest/redis-854544c579-c7ttb"]
May 28 10:22:37.328029 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:22:37.325226    2565 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["test-ns-feast-rest/redis-854544c579-c7ttb"]
May 28 10:22:37.337469 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:22:37.337438    2565 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["test-ns-feast-rest/postgres-7c7656cc6d-ps27j"]
May 28 10:22:37.341922 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:22:37.341902    2565 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["test-ns-feast-rest/postgres-7c7656cc6d-ps27j"]
May 28 10:22:39.154764 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:22:39.154720    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="880507e0-703d-4116-a8c6-3c6b5c3d453e" path="/var/lib/kubelet/pods/880507e0-703d-4116-a8c6-3c6b5c3d453e/volumes"
May 28 10:22:39.155237 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:22:39.155198    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d654bcf0-a496-4e11-a9f1-36b7e05c4ff1" path="/var/lib/kubelet/pods/d654bcf0-a496-4e11-a9f1-36b7e05c4ff1/volumes"
May 28 10:22:44.324157 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:22:44.324118    2565 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast-rest/feast-driver-ranking-d49489fb-wvbrq" podUID="52a76d46-cbf0-4bd2-8be7-2f4a4c4362e7" containerName="online" probeResult="failure" output="Get \"https://10.133.0.26:6567/health\": dial tcp 10.133.0.26:6567: connect: connection refused"
May 28 10:22:45.933136 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:22:45.933101    2565 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast-rest/feast-credit-scoring-d6599d595-mqwpf" podUID="cd5fd671-347d-4e72-ad5e-f0b87e3e215d" containerName="online" probeResult="failure" output="Get \"https://10.133.0.25:6567/health\": dial tcp 10.133.0.25:6567: connect: connection refused"
May 28 10:22:54.324870 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:22:54.324830    2565 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast-rest/feast-driver-ranking-d49489fb-wvbrq" podUID="52a76d46-cbf0-4bd2-8be7-2f4a4c4362e7" containerName="online" probeResult="failure" output="Get \"https://10.133.0.26:6567/health\": dial tcp 10.133.0.26:6567: connect: connection refused"
May 28 10:22:55.932853 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:22:55.932813    2565 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast-rest/feast-credit-scoring-d6599d595-mqwpf" podUID="cd5fd671-347d-4e72-ad5e-f0b87e3e215d" containerName="online" probeResult="failure" output="Get \"https://10.133.0.25:6567/health\": dial tcp 10.133.0.25:6567: connect: connection refused"
May 28 10:22:55.933191 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:22:55.932956    2565 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast-rest/feast-credit-scoring-d6599d595-mqwpf"
May 28 10:23:04.324773 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:23:04.324681    2565 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast-rest/feast-driver-ranking-d49489fb-wvbrq" podUID="52a76d46-cbf0-4bd2-8be7-2f4a4c4362e7" containerName="online" probeResult="failure" output="Get \"https://10.133.0.26:6567/health\": dial tcp 10.133.0.26:6567: connect: connection refused"
May 28 10:23:04.325125 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:23:04.324802    2565 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast-rest/feast-driver-ranking-d49489fb-wvbrq"
May 28 10:23:05.168923 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:23:05.168903    2565 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast-rest/feast-credit-scoring-d6599d595-mqwpf"
May 28 10:23:05.171800 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:23:05.171783    2565 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast-rest/feast-driver-ranking-d49489fb-wvbrq"
May 28 10:23:05.316343 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:23:05.316256    2565 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/cd5fd671-347d-4e72-ad5e-f0b87e3e215d-registry-tls\") pod \"cd5fd671-347d-4e72-ad5e-f0b87e3e215d\" (UID: \"cd5fd671-347d-4e72-ad5e-f0b87e3e215d\") "
May 28 10:23:05.316343 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:23:05.316292    2565 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/cd5fd671-347d-4e72-ad5e-f0b87e3e215d-feast-data\") pod \"cd5fd671-347d-4e72-ad5e-f0b87e3e215d\" (UID: \"cd5fd671-347d-4e72-ad5e-f0b87e3e215d\") "
May 28 10:23:05.316343 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:23:05.316335    2565 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ksmkd\" (UniqueName: \"kubernetes.io/projected/52a76d46-cbf0-4bd2-8be7-2f4a4c4362e7-kube-api-access-ksmkd\") pod \"52a76d46-cbf0-4bd2-8be7-2f4a4c4362e7\" (UID: \"52a76d46-cbf0-4bd2-8be7-2f4a4c4362e7\") "
May 28 10:23:05.316720 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:23:05.316372    2565 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hlhzj\" (UniqueName: \"kubernetes.io/projected/cd5fd671-347d-4e72-ad5e-f0b87e3e215d-kube-api-access-hlhzj\") pod \"cd5fd671-347d-4e72-ad5e-f0b87e3e215d\" (UID: \"cd5fd671-347d-4e72-ad5e-f0b87e3e215d\") "
May 28 10:23:05.316720 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:23:05.316391    2565 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/52a76d46-cbf0-4bd2-8be7-2f4a4c4362e7-online-tls\") pod \"52a76d46-cbf0-4bd2-8be7-2f4a4c4362e7\" (UID: \"52a76d46-cbf0-4bd2-8be7-2f4a4c4362e7\") "
May 28 10:23:05.316720 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:23:05.316423    2565 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/cd5fd671-347d-4e72-ad5e-f0b87e3e215d-online-tls\") pod \"cd5fd671-347d-4e72-ad5e-f0b87e3e215d\" (UID: \"cd5fd671-347d-4e72-ad5e-f0b87e3e215d\") "
May 28 10:23:05.316720 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:23:05.316511    2565 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/52a76d46-cbf0-4bd2-8be7-2f4a4c4362e7-registry-tls\") pod \"52a76d46-cbf0-4bd2-8be7-2f4a4c4362e7\" (UID: \"52a76d46-cbf0-4bd2-8be7-2f4a4c4362e7\") "
May 28 10:23:05.316720 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:23:05.316560    2565 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/52a76d46-cbf0-4bd2-8be7-2f4a4c4362e7-feast-data\") pod \"52a76d46-cbf0-4bd2-8be7-2f4a4c4362e7\" (UID: \"52a76d46-cbf0-4bd2-8be7-2f4a4c4362e7\") "
May 28 10:23:05.317487 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:23:05.317439    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/52a76d46-cbf0-4bd2-8be7-2f4a4c4362e7-feast-data" (OuterVolumeSpecName: "feast-data") pod "52a76d46-cbf0-4bd2-8be7-2f4a4c4362e7" (UID: "52a76d46-cbf0-4bd2-8be7-2f4a4c4362e7"). InnerVolumeSpecName "feast-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 28 10:23:05.318864 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:23:05.318835    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cd5fd671-347d-4e72-ad5e-f0b87e3e215d-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "cd5fd671-347d-4e72-ad5e-f0b87e3e215d" (UID: "cd5fd671-347d-4e72-ad5e-f0b87e3e215d"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 28 10:23:05.318984 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:23:05.318917    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cd5fd671-347d-4e72-ad5e-f0b87e3e215d-kube-api-access-hlhzj" (OuterVolumeSpecName: "kube-api-access-hlhzj") pod "cd5fd671-347d-4e72-ad5e-f0b87e3e215d" (UID: "cd5fd671-347d-4e72-ad5e-f0b87e3e215d"). InnerVolumeSpecName "kube-api-access-hlhzj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 28 10:23:05.319137 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:23:05.319117    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/52a76d46-cbf0-4bd2-8be7-2f4a4c4362e7-kube-api-access-ksmkd" (OuterVolumeSpecName: "kube-api-access-ksmkd") pod "52a76d46-cbf0-4bd2-8be7-2f4a4c4362e7" (UID: "52a76d46-cbf0-4bd2-8be7-2f4a4c4362e7"). InnerVolumeSpecName "kube-api-access-ksmkd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 28 10:23:05.319255 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:23:05.319237    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cd5fd671-347d-4e72-ad5e-f0b87e3e215d-online-tls" (OuterVolumeSpecName: "online-tls") pod "cd5fd671-347d-4e72-ad5e-f0b87e3e215d" (UID: "cd5fd671-347d-4e72-ad5e-f0b87e3e215d"). InnerVolumeSpecName "online-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 28 10:23:05.319375 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:23:05.319287    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/52a76d46-cbf0-4bd2-8be7-2f4a4c4362e7-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "52a76d46-cbf0-4bd2-8be7-2f4a4c4362e7" (UID: "52a76d46-cbf0-4bd2-8be7-2f4a4c4362e7"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 28 10:23:05.319453 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:23:05.319396    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/52a76d46-cbf0-4bd2-8be7-2f4a4c4362e7-online-tls" (OuterVolumeSpecName: "online-tls") pod "52a76d46-cbf0-4bd2-8be7-2f4a4c4362e7" (UID: "52a76d46-cbf0-4bd2-8be7-2f4a4c4362e7"). InnerVolumeSpecName "online-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 28 10:23:05.325915 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:23:05.325895    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cd5fd671-347d-4e72-ad5e-f0b87e3e215d-feast-data" (OuterVolumeSpecName: "feast-data") pod "cd5fd671-347d-4e72-ad5e-f0b87e3e215d" (UID: "cd5fd671-347d-4e72-ad5e-f0b87e3e215d"). InnerVolumeSpecName "feast-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 28 10:23:05.386424 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:23:05.386395    2565 generic.go:358] "Generic (PLEG): container finished" podID="52a76d46-cbf0-4bd2-8be7-2f4a4c4362e7" containerID="04dfd0e942dcb3e8700be2cbda3cb11c22f8d691f7f3bffd1ac3ba7c9e5b8715" exitCode=137
May 28 10:23:05.386594 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:23:05.386473    2565 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast-rest/feast-driver-ranking-d49489fb-wvbrq"
May 28 10:23:05.386594 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:23:05.386484    2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-driver-ranking-d49489fb-wvbrq" event={"ID":"52a76d46-cbf0-4bd2-8be7-2f4a4c4362e7","Type":"ContainerDied","Data":"04dfd0e942dcb3e8700be2cbda3cb11c22f8d691f7f3bffd1ac3ba7c9e5b8715"}
May 28 10:23:05.386594 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:23:05.386529    2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-driver-ranking-d49489fb-wvbrq" event={"ID":"52a76d46-cbf0-4bd2-8be7-2f4a4c4362e7","Type":"ContainerDied","Data":"89d922b34d8fe58be54eaf3560056c7e15d7fb52924959415916e91b321a5f4d"}
May 28 10:23:05.386594 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:23:05.386550    2565 scope.go:117] "RemoveContainer" containerID="6fffe43a7e8e70854e6e86b0a33d852580c1ddf2f7e032db052683c7c217cff8"
May 28 10:23:05.388428 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:23:05.388406    2565 generic.go:358] "Generic (PLEG): container finished" podID="cd5fd671-347d-4e72-ad5e-f0b87e3e215d" containerID="22062b5d4b3d1d4a7cf8e647176e7c9c0da6138c979f802a6b7c149aac3b2aeb" exitCode=137
May 28 10:23:05.388546 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:23:05.388466    2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-credit-scoring-d6599d595-mqwpf" event={"ID":"cd5fd671-347d-4e72-ad5e-f0b87e3e215d","Type":"ContainerDied","Data":"22062b5d4b3d1d4a7cf8e647176e7c9c0da6138c979f802a6b7c149aac3b2aeb"}
May 28 10:23:05.388546 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:23:05.388484    2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-credit-scoring-d6599d595-mqwpf" event={"ID":"cd5fd671-347d-4e72-ad5e-f0b87e3e215d","Type":"ContainerDied","Data":"bf8922538239eb9a38bf940308ae90a07cb002d25f2e9395596c87d9eef3087a"}
May 28 10:23:05.388546 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:23:05.388483    2565 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast-rest/feast-credit-scoring-d6599d595-mqwpf"
May 28 10:23:05.394756 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:23:05.394738    2565 scope.go:117] "RemoveContainer" containerID="04dfd0e942dcb3e8700be2cbda3cb11c22f8d691f7f3bffd1ac3ba7c9e5b8715"
May 28 10:23:05.402373 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:23:05.402352    2565 scope.go:117] "RemoveContainer" containerID="a6b005b201f7409b8652b35b2c58f021651244a55fb4d1673e32c2c5351bdfe0"
May 28 10:23:05.409049 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:23:05.409033    2565 scope.go:117] "RemoveContainer" containerID="32db03e243414fab50972c1c066966d10fdc2ee0713664514749cc9034665182"
May 28 10:23:05.411746 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:23:05.411722    2565 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["test-ns-feast-rest/feast-credit-scoring-d6599d595-mqwpf"]
May 28 10:23:05.416000 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:23:05.415894    2565 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["test-ns-feast-rest/feast-credit-scoring-d6599d595-mqwpf"]
May 28 10:23:05.416059 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:23:05.416033    2565 scope.go:117] "RemoveContainer" containerID="6fffe43a7e8e70854e6e86b0a33d852580c1ddf2f7e032db052683c7c217cff8"
May 28 10:23:05.416325 ip-10-0-128-206 kubenswrapper[2565]: E0528 10:23:05.416286    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6fffe43a7e8e70854e6e86b0a33d852580c1ddf2f7e032db052683c7c217cff8\": container with ID starting with 6fffe43a7e8e70854e6e86b0a33d852580c1ddf2f7e032db052683c7c217cff8 not found: ID does not exist" containerID="6fffe43a7e8e70854e6e86b0a33d852580c1ddf2f7e032db052683c7c217cff8"
May 28 10:23:05.416404 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:23:05.416337    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6fffe43a7e8e70854e6e86b0a33d852580c1ddf2f7e032db052683c7c217cff8"} err="failed to get container status \"6fffe43a7e8e70854e6e86b0a33d852580c1ddf2f7e032db052683c7c217cff8\": rpc error: code = NotFound desc = could not find container \"6fffe43a7e8e70854e6e86b0a33d852580c1ddf2f7e032db052683c7c217cff8\": container with ID starting with 6fffe43a7e8e70854e6e86b0a33d852580c1ddf2f7e032db052683c7c217cff8 not found: ID does not exist"
May 28 10:23:05.416404 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:23:05.416355    2565 scope.go:117] "RemoveContainer" containerID="04dfd0e942dcb3e8700be2cbda3cb11c22f8d691f7f3bffd1ac3ba7c9e5b8715"
May 28 10:23:05.416600 ip-10-0-128-206 kubenswrapper[2565]: E0528 10:23:05.416582    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"04dfd0e942dcb3e8700be2cbda3cb11c22f8d691f7f3bffd1ac3ba7c9e5b8715\": container with ID starting with 04dfd0e942dcb3e8700be2cbda3cb11c22f8d691f7f3bffd1ac3ba7c9e5b8715 not found: ID does not exist" containerID="04dfd0e942dcb3e8700be2cbda3cb11c22f8d691f7f3bffd1ac3ba7c9e5b8715"
May 28 10:23:05.416641 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:23:05.416607    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"04dfd0e942dcb3e8700be2cbda3cb11c22f8d691f7f3bffd1ac3ba7c9e5b8715"} err="failed to get container status \"04dfd0e942dcb3e8700be2cbda3cb11c22f8d691f7f3bffd1ac3ba7c9e5b8715\": rpc error: code = NotFound desc = could not find container \"04dfd0e942dcb3e8700be2cbda3cb11c22f8d691f7f3bffd1ac3ba7c9e5b8715\": container with ID starting with 04dfd0e942dcb3e8700be2cbda3cb11c22f8d691f7f3bffd1ac3ba7c9e5b8715 not found: ID does not exist"
May 28 10:23:05.416641 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:23:05.416622    2565 scope.go:117] "RemoveContainer" containerID="a6b005b201f7409b8652b35b2c58f021651244a55fb4d1673e32c2c5351bdfe0"
May 28 10:23:05.416850 ip-10-0-128-206 kubenswrapper[2565]: E0528 10:23:05.416831    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a6b005b201f7409b8652b35b2c58f021651244a55fb4d1673e32c2c5351bdfe0\": container with ID starting with a6b005b201f7409b8652b35b2c58f021651244a55fb4d1673e32c2c5351bdfe0 not found: ID does not exist" containerID="a6b005b201f7409b8652b35b2c58f021651244a55fb4d1673e32c2c5351bdfe0"
May 28 10:23:05.416891 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:23:05.416856    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a6b005b201f7409b8652b35b2c58f021651244a55fb4d1673e32c2c5351bdfe0"} err="failed to get container status \"a6b005b201f7409b8652b35b2c58f021651244a55fb4d1673e32c2c5351bdfe0\": rpc error: code = NotFound desc = could not find container \"a6b005b201f7409b8652b35b2c58f021651244a55fb4d1673e32c2c5351bdfe0\": container with ID starting with a6b005b201f7409b8652b35b2c58f021651244a55fb4d1673e32c2c5351bdfe0 not found: ID does not exist"
May 28 10:23:05.416891 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:23:05.416876    2565 scope.go:117] "RemoveContainer" containerID="32db03e243414fab50972c1c066966d10fdc2ee0713664514749cc9034665182"
May 28 10:23:05.417074 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:23:05.417059    2565 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/52a76d46-cbf0-4bd2-8be7-2f4a4c4362e7-registry-tls\") on node \"ip-10-0-128-206.ec2.internal\" DevicePath \"\""
May 28 10:23:05.417118 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:23:05.417080    2565 reconciler_common.go:299] "Volume detached for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/52a76d46-cbf0-4bd2-8be7-2f4a4c4362e7-feast-data\") on node \"ip-10-0-128-206.ec2.internal\" DevicePath \"\""
May 28 10:23:05.417118 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:23:05.417092    2565 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/cd5fd671-347d-4e72-ad5e-f0b87e3e215d-registry-tls\") on node \"ip-10-0-128-206.ec2.internal\" DevicePath \"\""
May 28 10:23:05.417118 ip-10-0-128-206 kubenswrapper[2565]: E0528 10:23:05.417092    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"32db03e243414fab50972c1c066966d10fdc2ee0713664514749cc9034665182\": container with ID starting with 32db03e243414fab50972c1c066966d10fdc2ee0713664514749cc9034665182 not found: ID does not exist" containerID="32db03e243414fab50972c1c066966d10fdc2ee0713664514749cc9034665182"
May 28 10:23:05.417118 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:23:05.417100    2565 reconciler_common.go:299] "Volume detached for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/cd5fd671-347d-4e72-ad5e-f0b87e3e215d-feast-data\") on node \"ip-10-0-128-206.ec2.internal\" DevicePath \"\""
May 28 10:23:05.417118 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:23:05.417111    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ksmkd\" (UniqueName: \"kubernetes.io/projected/52a76d46-cbf0-4bd2-8be7-2f4a4c4362e7-kube-api-access-ksmkd\") on node \"ip-10-0-128-206.ec2.internal\" DevicePath \"\""
May 28 10:23:05.417118 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:23:05.417109    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"32db03e243414fab50972c1c066966d10fdc2ee0713664514749cc9034665182"} err="failed to get container status \"32db03e243414fab50972c1c066966d10fdc2ee0713664514749cc9034665182\": rpc error: code = NotFound desc = could not find container \"32db03e243414fab50972c1c066966d10fdc2ee0713664514749cc9034665182\": container with ID starting with 32db03e243414fab50972c1c066966d10fdc2ee0713664514749cc9034665182 not found: ID does not exist"
May 28 10:23:05.417439 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:23:05.417120    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hlhzj\" (UniqueName: \"kubernetes.io/projected/cd5fd671-347d-4e72-ad5e-f0b87e3e215d-kube-api-access-hlhzj\") on node \"ip-10-0-128-206.ec2.internal\" DevicePath \"\""
May 28 10:23:05.417439 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:23:05.417124    2565 scope.go:117] "RemoveContainer" containerID="6a59103f257efe133b90722d7aa425b310ade1cafb7a5f119cb4c9781ee8a645"
May 28 10:23:05.417439 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:23:05.417133    2565 reconciler_common.go:299] "Volume detached for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/52a76d46-cbf0-4bd2-8be7-2f4a4c4362e7-online-tls\") on node \"ip-10-0-128-206.ec2.internal\" DevicePath \"\""
May 28 10:23:05.417439 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:23:05.417145    2565 reconciler_common.go:299] "Volume detached for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/cd5fd671-347d-4e72-ad5e-f0b87e3e215d-online-tls\") on node \"ip-10-0-128-206.ec2.internal\" DevicePath \"\""
May 28 10:23:05.423772 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:23:05.423757    2565 scope.go:117] "RemoveContainer" containerID="22062b5d4b3d1d4a7cf8e647176e7c9c0da6138c979f802a6b7c149aac3b2aeb"
May 28 10:23:05.427960 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:23:05.427939    2565 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["test-ns-feast-rest/feast-driver-ranking-d49489fb-wvbrq"]
May 28 10:23:05.431225 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:23:05.431208    2565 scope.go:117] "RemoveContainer" containerID="c0fb71253ed4261cfc2f39067e630b3a8719a6cbded0c77c7c5903fe9035316a"
May 28 10:23:05.431519 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:23:05.431501    2565 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["test-ns-feast-rest/feast-driver-ranking-d49489fb-wvbrq"]
May 28 10:23:05.437622 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:23:05.437607    2565 scope.go:117] "RemoveContainer" containerID="fd092dcaa9239069b93990422c1fb5d7ba07e8bdda9642540e545a7f2c3dc62d"
May 28 10:23:05.443944 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:23:05.443929    2565 scope.go:117] "RemoveContainer" containerID="6a59103f257efe133b90722d7aa425b310ade1cafb7a5f119cb4c9781ee8a645"
May 28 10:23:05.444163 ip-10-0-128-206 kubenswrapper[2565]: E0528 10:23:05.444145    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6a59103f257efe133b90722d7aa425b310ade1cafb7a5f119cb4c9781ee8a645\": container with ID starting with 6a59103f257efe133b90722d7aa425b310ade1cafb7a5f119cb4c9781ee8a645 not found: ID does not exist" containerID="6a59103f257efe133b90722d7aa425b310ade1cafb7a5f119cb4c9781ee8a645"
May 28 10:23:05.444226 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:23:05.444169    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6a59103f257efe133b90722d7aa425b310ade1cafb7a5f119cb4c9781ee8a645"} err="failed to get container status \"6a59103f257efe133b90722d7aa425b310ade1cafb7a5f119cb4c9781ee8a645\": rpc error: code = NotFound desc = could not find container \"6a59103f257efe133b90722d7aa425b310ade1cafb7a5f119cb4c9781ee8a645\": container with ID starting with 6a59103f257efe133b90722d7aa425b310ade1cafb7a5f119cb4c9781ee8a645 not found: ID does not exist"
May 28 10:23:05.444226 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:23:05.444184    2565 scope.go:117] "RemoveContainer" containerID="22062b5d4b3d1d4a7cf8e647176e7c9c0da6138c979f802a6b7c149aac3b2aeb"
May 28 10:23:05.444464 ip-10-0-128-206 kubenswrapper[2565]: E0528 10:23:05.444450    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"22062b5d4b3d1d4a7cf8e647176e7c9c0da6138c979f802a6b7c149aac3b2aeb\": container with ID starting with 22062b5d4b3d1d4a7cf8e647176e7c9c0da6138c979f802a6b7c149aac3b2aeb not found: ID does not exist" containerID="22062b5d4b3d1d4a7cf8e647176e7c9c0da6138c979f802a6b7c149aac3b2aeb"
May 28 10:23:05.444512 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:23:05.444479    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"22062b5d4b3d1d4a7cf8e647176e7c9c0da6138c979f802a6b7c149aac3b2aeb"} err="failed to get container status \"22062b5d4b3d1d4a7cf8e647176e7c9c0da6138c979f802a6b7c149aac3b2aeb\": rpc error: code = NotFound desc = could not find container \"22062b5d4b3d1d4a7cf8e647176e7c9c0da6138c979f802a6b7c149aac3b2aeb\": container with ID starting with 22062b5d4b3d1d4a7cf8e647176e7c9c0da6138c979f802a6b7c149aac3b2aeb not found: ID does not exist"
May 28 10:23:05.444512 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:23:05.444492    2565 scope.go:117] "RemoveContainer" containerID="c0fb71253ed4261cfc2f39067e630b3a8719a6cbded0c77c7c5903fe9035316a"
May 28 10:23:05.444732 ip-10-0-128-206 kubenswrapper[2565]: E0528 10:23:05.444714    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c0fb71253ed4261cfc2f39067e630b3a8719a6cbded0c77c7c5903fe9035316a\": container with ID starting with c0fb71253ed4261cfc2f39067e630b3a8719a6cbded0c77c7c5903fe9035316a not found: ID does not exist" containerID="c0fb71253ed4261cfc2f39067e630b3a8719a6cbded0c77c7c5903fe9035316a"
May 28 10:23:05.444780 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:23:05.444736    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c0fb71253ed4261cfc2f39067e630b3a8719a6cbded0c77c7c5903fe9035316a"} err="failed to get container status \"c0fb71253ed4261cfc2f39067e630b3a8719a6cbded0c77c7c5903fe9035316a\": rpc error: code = NotFound desc = could not find container \"c0fb71253ed4261cfc2f39067e630b3a8719a6cbded0c77c7c5903fe9035316a\": container with ID starting with c0fb71253ed4261cfc2f39067e630b3a8719a6cbded0c77c7c5903fe9035316a not found: ID does not exist"
May 28 10:23:05.444780 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:23:05.444753    2565 scope.go:117] "RemoveContainer" containerID="fd092dcaa9239069b93990422c1fb5d7ba07e8bdda9642540e545a7f2c3dc62d"
May 28 10:23:05.444973 ip-10-0-128-206 kubenswrapper[2565]: E0528 10:23:05.444958    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fd092dcaa9239069b93990422c1fb5d7ba07e8bdda9642540e545a7f2c3dc62d\": container with ID starting with fd092dcaa9239069b93990422c1fb5d7ba07e8bdda9642540e545a7f2c3dc62d not found: ID does not exist" containerID="fd092dcaa9239069b93990422c1fb5d7ba07e8bdda9642540e545a7f2c3dc62d"
May 28 10:23:05.445018 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:23:05.444976    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fd092dcaa9239069b93990422c1fb5d7ba07e8bdda9642540e545a7f2c3dc62d"} err="failed to get container status \"fd092dcaa9239069b93990422c1fb5d7ba07e8bdda9642540e545a7f2c3dc62d\": rpc error: code = NotFound desc = could not find container \"fd092dcaa9239069b93990422c1fb5d7ba07e8bdda9642540e545a7f2c3dc62d\": container with ID starting with fd092dcaa9239069b93990422c1fb5d7ba07e8bdda9642540e545a7f2c3dc62d not found: ID does not exist"
May 28 10:23:07.153962 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:23:07.153929    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="52a76d46-cbf0-4bd2-8be7-2f4a4c4362e7" path="/var/lib/kubelet/pods/52a76d46-cbf0-4bd2-8be7-2f4a4c4362e7/volumes"
May 28 10:23:07.154429 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:23:07.154415    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cd5fd671-347d-4e72-ad5e-f0b87e3e215d" path="/var/lib/kubelet/pods/cd5fd671-347d-4e72-ad5e-f0b87e3e215d/volumes"
May 28 10:33:27.366711 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:33:27.366674    2565 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-must-gather-sw9vd/must-gather-hfntc"]
May 28 10:33:27.367275 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:33:27.366940    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cd5fd671-347d-4e72-ad5e-f0b87e3e215d" containerName="online"
May 28 10:33:27.367275 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:33:27.366950    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="cd5fd671-347d-4e72-ad5e-f0b87e3e215d" containerName="online"
May 28 10:33:27.367275 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:33:27.366959    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="880507e0-703d-4116-a8c6-3c6b5c3d453e" containerName="redis"
May 28 10:33:27.367275 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:33:27.366964    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="880507e0-703d-4116-a8c6-3c6b5c3d453e" containerName="redis"
May 28 10:33:27.367275 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:33:27.366971    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cd5fd671-347d-4e72-ad5e-f0b87e3e215d" containerName="registry"
May 28 10:33:27.367275 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:33:27.366976    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="cd5fd671-347d-4e72-ad5e-f0b87e3e215d" containerName="registry"
May 28 10:33:27.367275 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:33:27.366984    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="52a76d46-cbf0-4bd2-8be7-2f4a4c4362e7" containerName="registry"
May 28 10:33:27.367275 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:33:27.366990    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="52a76d46-cbf0-4bd2-8be7-2f4a4c4362e7" containerName="registry"
May 28 10:33:27.367275 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:33:27.366997    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cd5fd671-347d-4e72-ad5e-f0b87e3e215d" containerName="feast-init"
May 28 10:33:27.367275 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:33:27.367002    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="cd5fd671-347d-4e72-ad5e-f0b87e3e215d" containerName="feast-init"
May 28 10:33:27.367275 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:33:27.367007    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="52a76d46-cbf0-4bd2-8be7-2f4a4c4362e7" containerName="feast-init"
May 28 10:33:27.367275 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:33:27.367012    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="52a76d46-cbf0-4bd2-8be7-2f4a4c4362e7" containerName="feast-init"
May 28 10:33:27.367275 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:33:27.367018    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="52a76d46-cbf0-4bd2-8be7-2f4a4c4362e7" containerName="online"
May 28 10:33:27.367275 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:33:27.367023    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="52a76d46-cbf0-4bd2-8be7-2f4a4c4362e7" containerName="online"
May 28 10:33:27.367275 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:33:27.367031    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cd5fd671-347d-4e72-ad5e-f0b87e3e215d" containerName="feast-apply"
May 28 10:33:27.367275 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:33:27.367035    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="cd5fd671-347d-4e72-ad5e-f0b87e3e215d" containerName="feast-apply"
May 28 10:33:27.367275 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:33:27.367042    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d654bcf0-a496-4e11-a9f1-36b7e05c4ff1" containerName="postgres"
May 28 10:33:27.367275 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:33:27.367046    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="d654bcf0-a496-4e11-a9f1-36b7e05c4ff1" containerName="postgres"
May 28 10:33:27.367275 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:33:27.367051    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="52a76d46-cbf0-4bd2-8be7-2f4a4c4362e7" containerName="feast-apply"
May 28 10:33:27.367275 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:33:27.367055    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="52a76d46-cbf0-4bd2-8be7-2f4a4c4362e7" containerName="feast-apply"
May 28 10:33:27.367275 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:33:27.367093    2565 memory_manager.go:356] "RemoveStaleState removing state" podUID="880507e0-703d-4116-a8c6-3c6b5c3d453e" containerName="redis"
May 28 10:33:27.367275 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:33:27.367099    2565 memory_manager.go:356] "RemoveStaleState removing state" podUID="52a76d46-cbf0-4bd2-8be7-2f4a4c4362e7" containerName="online"
May 28 10:33:27.367275 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:33:27.367106    2565 memory_manager.go:356] "RemoveStaleState removing state" podUID="cd5fd671-347d-4e72-ad5e-f0b87e3e215d" containerName="registry"
May 28 10:33:27.367275 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:33:27.367111    2565 memory_manager.go:356] "RemoveStaleState removing state" podUID="d654bcf0-a496-4e11-a9f1-36b7e05c4ff1" containerName="postgres"
May 28 10:33:27.367275 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:33:27.367117    2565 memory_manager.go:356] "RemoveStaleState removing state" podUID="cd5fd671-347d-4e72-ad5e-f0b87e3e215d" containerName="online"
May 28 10:33:27.367275 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:33:27.367124    2565 memory_manager.go:356] "RemoveStaleState removing state" podUID="52a76d46-cbf0-4bd2-8be7-2f4a4c4362e7" containerName="registry"
May 28 10:33:27.370083 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:33:27.370067    2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-sw9vd/must-gather-hfntc"
May 28 10:33:27.372825 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:33:27.372803    2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-sw9vd\"/\"openshift-service-ca.crt\""
May 28 10:33:27.372921 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:33:27.372872    2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-sw9vd\"/\"kube-root-ca.crt\""
May 28 10:33:27.374025 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:33:27.374001    2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-sw9vd\"/\"default-dockercfg-hbbhs\""
May 28 10:33:27.377731 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:33:27.377709    2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-sw9vd/must-gather-hfntc"]
May 28 10:33:27.510813 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:33:27.510780    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/48ca532d-c26d-4494-823b-cfee7a50bd5d-must-gather-output\") pod \"must-gather-hfntc\" (UID: \"48ca532d-c26d-4494-823b-cfee7a50bd5d\") " pod="openshift-must-gather-sw9vd/must-gather-hfntc"
May 28 10:33:27.510988 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:33:27.510828    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-44xbw\" (UniqueName: \"kubernetes.io/projected/48ca532d-c26d-4494-823b-cfee7a50bd5d-kube-api-access-44xbw\") pod \"must-gather-hfntc\" (UID: \"48ca532d-c26d-4494-823b-cfee7a50bd5d\") " pod="openshift-must-gather-sw9vd/must-gather-hfntc"
May 28 10:33:27.612093 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:33:27.612046    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/48ca532d-c26d-4494-823b-cfee7a50bd5d-must-gather-output\") pod \"must-gather-hfntc\" (UID: \"48ca532d-c26d-4494-823b-cfee7a50bd5d\") " pod="openshift-must-gather-sw9vd/must-gather-hfntc"
May 28 10:33:27.612246 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:33:27.612110    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-44xbw\" (UniqueName: \"kubernetes.io/projected/48ca532d-c26d-4494-823b-cfee7a50bd5d-kube-api-access-44xbw\") pod \"must-gather-hfntc\" (UID: \"48ca532d-c26d-4494-823b-cfee7a50bd5d\") " pod="openshift-must-gather-sw9vd/must-gather-hfntc"
May 28 10:33:27.612403 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:33:27.612385    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/48ca532d-c26d-4494-823b-cfee7a50bd5d-must-gather-output\") pod \"must-gather-hfntc\" (UID: \"48ca532d-c26d-4494-823b-cfee7a50bd5d\") " pod="openshift-must-gather-sw9vd/must-gather-hfntc"
May 28 10:33:27.621206 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:33:27.621145    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-44xbw\" (UniqueName: \"kubernetes.io/projected/48ca532d-c26d-4494-823b-cfee7a50bd5d-kube-api-access-44xbw\") pod \"must-gather-hfntc\" (UID: \"48ca532d-c26d-4494-823b-cfee7a50bd5d\") " pod="openshift-must-gather-sw9vd/must-gather-hfntc"
May 28 10:33:27.688795 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:33:27.688759    2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-sw9vd/must-gather-hfntc"
May 28 10:33:27.810697 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:33:27.810603    2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-sw9vd/must-gather-hfntc"]
May 28 10:33:27.813654 ip-10-0-128-206 kubenswrapper[2565]: W0528 10:33:27.813622    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod48ca532d_c26d_4494_823b_cfee7a50bd5d.slice/crio-f1a0e332af19dd3fc0df9fed425ccc8c36ae5eb82d109002a712a85597103238 WatchSource:0}: Error finding container f1a0e332af19dd3fc0df9fed425ccc8c36ae5eb82d109002a712a85597103238: Status 404 returned error can't find the container with id f1a0e332af19dd3fc0df9fed425ccc8c36ae5eb82d109002a712a85597103238
May 28 10:33:27.815290 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:33:27.815273    2565 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
May 28 10:33:28.011757 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:33:28.011674    2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-sw9vd/must-gather-hfntc" event={"ID":"48ca532d-c26d-4494-823b-cfee7a50bd5d","Type":"ContainerStarted","Data":"f1a0e332af19dd3fc0df9fed425ccc8c36ae5eb82d109002a712a85597103238"}
May 28 10:33:34.036094 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:33:34.036054    2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-sw9vd/must-gather-hfntc" event={"ID":"48ca532d-c26d-4494-823b-cfee7a50bd5d","Type":"ContainerStarted","Data":"5e15e50b1b8b3883fe03cf68ff47282642c903a062c7ba2dad5ba1820371cfb0"}
May 28 10:33:35.040228 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:33:35.040192    2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-sw9vd/must-gather-hfntc" event={"ID":"48ca532d-c26d-4494-823b-cfee7a50bd5d","Type":"ContainerStarted","Data":"ea20a1ef4bef14784ecd459f76cee683a0ea114267e350f14be584773c65008c"}
May 28 10:33:35.061692 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:33:35.061637    2565 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-must-gather-sw9vd/must-gather-hfntc" podStartSLOduration=2.022922629 podStartE2EDuration="8.061620884s" podCreationTimestamp="2026-05-28 10:33:27 +0000 UTC" firstStartedPulling="2026-05-28 10:33:27.815446543 +0000 UTC m=+1693.275780672" lastFinishedPulling="2026-05-28 10:33:33.854144794 +0000 UTC m=+1699.314478927" observedRunningTime="2026-05-28 10:33:35.060040877 +0000 UTC m=+1700.520375029" watchObservedRunningTime="2026-05-28 10:33:35.061620884 +0000 UTC m=+1700.521955026"
May 28 10:33:44.066213 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:33:44.066123    2565 generic.go:358] "Generic (PLEG): container finished" podID="48ca532d-c26d-4494-823b-cfee7a50bd5d" containerID="5e15e50b1b8b3883fe03cf68ff47282642c903a062c7ba2dad5ba1820371cfb0" exitCode=0
May 28 10:33:44.066627 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:33:44.066207    2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-sw9vd/must-gather-hfntc" event={"ID":"48ca532d-c26d-4494-823b-cfee7a50bd5d","Type":"ContainerDied","Data":"5e15e50b1b8b3883fe03cf68ff47282642c903a062c7ba2dad5ba1820371cfb0"}
May 28 10:33:44.066627 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:33:44.066533    2565 scope.go:117] "RemoveContainer" containerID="5e15e50b1b8b3883fe03cf68ff47282642c903a062c7ba2dad5ba1820371cfb0"
May 28 10:33:44.631762 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:33:44.631736    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-must-gather-sw9vd_must-gather-hfntc_48ca532d-c26d-4494-823b-cfee7a50bd5d/gather/0.log"
May 28 10:33:47.945163 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:33:47.945132    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-qljhc_9454ad66-c829-4c38-afd5-8405924abbc5/global-pull-secret-syncer/0.log"
May 28 10:33:48.062931 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:33:48.062896    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-6qpxx_c925ed8e-f4ec-45e6-bfa6-2128a0947aca/konnectivity-agent/0.log"
May 28 10:33:48.151022 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:33:48.150991    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-128-206.ec2.internal_a6772c4d9844f0928036a579dcf5d882/haproxy/0.log"
May 28 10:33:49.952681 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:33:49.952646    2565 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-must-gather-sw9vd/must-gather-hfntc"]
May 28 10:33:49.953046 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:33:49.952866    2565 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-must-gather-sw9vd/must-gather-hfntc" podUID="48ca532d-c26d-4494-823b-cfee7a50bd5d" containerName="copy" containerID="cri-o://ea20a1ef4bef14784ecd459f76cee683a0ea114267e350f14be584773c65008c" gracePeriod=2
May 28 10:33:49.955374 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:33:49.955345    2565 status_manager.go:895] "Failed to get status for pod" podUID="48ca532d-c26d-4494-823b-cfee7a50bd5d" pod="openshift-must-gather-sw9vd/must-gather-hfntc" err="pods \"must-gather-hfntc\" is forbidden: User \"system:node:ip-10-0-128-206.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-must-gather-sw9vd\": no relationship found between node 'ip-10-0-128-206.ec2.internal' and this object"
May 28 10:33:49.956265 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:33:49.956241    2565 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-must-gather-sw9vd/must-gather-hfntc"]
May 28 10:33:50.084900 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:33:50.084863    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-must-gather-sw9vd_must-gather-hfntc_48ca532d-c26d-4494-823b-cfee7a50bd5d/copy/0.log"
May 28 10:33:50.085191 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:33:50.085165    2565 generic.go:358] "Generic (PLEG): container finished" podID="48ca532d-c26d-4494-823b-cfee7a50bd5d" containerID="ea20a1ef4bef14784ecd459f76cee683a0ea114267e350f14be584773c65008c" exitCode=143
May 28 10:33:50.179482 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:33:50.179459    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-must-gather-sw9vd_must-gather-hfntc_48ca532d-c26d-4494-823b-cfee7a50bd5d/copy/0.log"
May 28 10:33:50.179813 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:33:50.179799    2565 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-sw9vd/must-gather-hfntc"
May 28 10:33:50.182045 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:33:50.182022    2565 status_manager.go:895] "Failed to get status for pod" podUID="48ca532d-c26d-4494-823b-cfee7a50bd5d" pod="openshift-must-gather-sw9vd/must-gather-hfntc" err="pods \"must-gather-hfntc\" is forbidden: User \"system:node:ip-10-0-128-206.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-must-gather-sw9vd\": no relationship found between node 'ip-10-0-128-206.ec2.internal' and this object"
May 28 10:33:50.290671 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:33:50.290631    2565 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/48ca532d-c26d-4494-823b-cfee7a50bd5d-must-gather-output\") pod \"48ca532d-c26d-4494-823b-cfee7a50bd5d\" (UID: \"48ca532d-c26d-4494-823b-cfee7a50bd5d\") "
May 28 10:33:50.290671 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:33:50.290668    2565 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-44xbw\" (UniqueName: \"kubernetes.io/projected/48ca532d-c26d-4494-823b-cfee7a50bd5d-kube-api-access-44xbw\") pod \"48ca532d-c26d-4494-823b-cfee7a50bd5d\" (UID: \"48ca532d-c26d-4494-823b-cfee7a50bd5d\") "
May 28 10:33:50.291059 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:33:50.291030    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/48ca532d-c26d-4494-823b-cfee7a50bd5d-must-gather-output" (OuterVolumeSpecName: "must-gather-output") pod "48ca532d-c26d-4494-823b-cfee7a50bd5d" (UID: "48ca532d-c26d-4494-823b-cfee7a50bd5d"). InnerVolumeSpecName "must-gather-output". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 28 10:33:50.293060 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:33:50.293039    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/48ca532d-c26d-4494-823b-cfee7a50bd5d-kube-api-access-44xbw" (OuterVolumeSpecName: "kube-api-access-44xbw") pod "48ca532d-c26d-4494-823b-cfee7a50bd5d" (UID: "48ca532d-c26d-4494-823b-cfee7a50bd5d"). InnerVolumeSpecName "kube-api-access-44xbw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 28 10:33:50.392109 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:33:50.392072    2565 reconciler_common.go:299] "Volume detached for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/48ca532d-c26d-4494-823b-cfee7a50bd5d-must-gather-output\") on node \"ip-10-0-128-206.ec2.internal\" DevicePath \"\""
May 28 10:33:50.392109 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:33:50.392100    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-44xbw\" (UniqueName: \"kubernetes.io/projected/48ca532d-c26d-4494-823b-cfee7a50bd5d-kube-api-access-44xbw\") on node \"ip-10-0-128-206.ec2.internal\" DevicePath \"\""
May 28 10:33:51.089273 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:33:51.089252    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-must-gather-sw9vd_must-gather-hfntc_48ca532d-c26d-4494-823b-cfee7a50bd5d/copy/0.log"
May 28 10:33:51.089668 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:33:51.089610    2565 scope.go:117] "RemoveContainer" containerID="ea20a1ef4bef14784ecd459f76cee683a0ea114267e350f14be584773c65008c"
May 28 10:33:51.089668 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:33:51.089628    2565 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-sw9vd/must-gather-hfntc"
May 28 10:33:51.092206 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:33:51.092171    2565 status_manager.go:895] "Failed to get status for pod" podUID="48ca532d-c26d-4494-823b-cfee7a50bd5d" pod="openshift-must-gather-sw9vd/must-gather-hfntc" err="pods \"must-gather-hfntc\" is forbidden: User \"system:node:ip-10-0-128-206.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-must-gather-sw9vd\": no relationship found between node 'ip-10-0-128-206.ec2.internal' and this object"
May 28 10:33:51.097081 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:33:51.097066    2565 scope.go:117] "RemoveContainer" containerID="5e15e50b1b8b3883fe03cf68ff47282642c903a062c7ba2dad5ba1820371cfb0"
May 28 10:33:51.099987 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:33:51.099964    2565 status_manager.go:895] "Failed to get status for pod" podUID="48ca532d-c26d-4494-823b-cfee7a50bd5d" pod="openshift-must-gather-sw9vd/must-gather-hfntc" err="pods \"must-gather-hfntc\" is forbidden: User \"system:node:ip-10-0-128-206.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-must-gather-sw9vd\": no relationship found between node 'ip-10-0-128-206.ec2.internal' and this object"
May 28 10:33:51.154510 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:33:51.154469    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="48ca532d-c26d-4494-823b-cfee7a50bd5d" path="/var/lib/kubelet/pods/48ca532d-c26d-4494-823b-cfee7a50bd5d/volumes"
May 28 10:33:51.533446 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:33:51.533416    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-665c9c8584-6cfpl_c3e76743-52b9-4701-8b24-ec8604ef166e/monitoring-plugin/0.log"
May 28 10:33:51.913962 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:33:51.913935    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-vvzss_696c43c1-d6a7-4ebd-8a85-16648e86ebaa/node-exporter/0.log"
May 28 10:33:51.966271 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:33:51.966249    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-vvzss_696c43c1-d6a7-4ebd-8a85-16648e86ebaa/kube-rbac-proxy/0.log"
May 28 10:33:52.009337 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:33:52.009297    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-vvzss_696c43c1-d6a7-4ebd-8a85-16648e86ebaa/init-textfile/0.log"
May 28 10:33:52.054236 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:33:52.054201    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-9c959559f-blf8b_42a0443b-9cf7-4f77-ba88-cdff4eeccd8a/kube-rbac-proxy-main/0.log"
May 28 10:33:52.106408 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:33:52.106377    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-9c959559f-blf8b_42a0443b-9cf7-4f77-ba88-cdff4eeccd8a/kube-rbac-proxy-self/0.log"
May 28 10:33:52.155483 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:33:52.155451    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-9c959559f-blf8b_42a0443b-9cf7-4f77-ba88-cdff4eeccd8a/openshift-state-metrics/0.log"
May 28 10:33:52.216160 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:33:52.216078    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_b701439f-7c19-4fe4-998e-1aec44e22ba9/prometheus/0.log"
May 28 10:33:52.261395 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:33:52.261373    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_b701439f-7c19-4fe4-998e-1aec44e22ba9/config-reloader/0.log"
May 28 10:33:52.305640 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:33:52.305608    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_b701439f-7c19-4fe4-998e-1aec44e22ba9/thanos-sidecar/0.log"
May 28 10:33:52.366548 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:33:52.366520    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_b701439f-7c19-4fe4-998e-1aec44e22ba9/kube-rbac-proxy-web/0.log"
May 28 10:33:52.443267 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:33:52.443239    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_b701439f-7c19-4fe4-998e-1aec44e22ba9/kube-rbac-proxy/0.log"
May 28 10:33:52.476344 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:33:52.476301    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_b701439f-7c19-4fe4-998e-1aec44e22ba9/kube-rbac-proxy-thanos/0.log"
May 28 10:33:52.513128 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:33:52.513108    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_b701439f-7c19-4fe4-998e-1aec44e22ba9/init-config-reloader/0.log"
May 28 10:33:52.557873 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:33:52.557849    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-7779bbdd78-s5dhp_6c76e5e6-3caa-4db2-b4ac-12249d876f7d/prometheus-operator/0.log"
May 28 10:33:52.599260 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:33:52.599233    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-7779bbdd78-s5dhp_6c76e5e6-3caa-4db2-b4ac-12249d876f7d/kube-rbac-proxy/0.log"
May 28 10:33:53.853548 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:33:53.853516    2565 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-must-gather-sg2z8/perf-node-gather-daemonset-8ccv8"]
May 28 10:33:53.853923 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:33:53.853778    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="48ca532d-c26d-4494-823b-cfee7a50bd5d" containerName="gather"
May 28 10:33:53.853923 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:33:53.853790    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="48ca532d-c26d-4494-823b-cfee7a50bd5d" containerName="gather"
May 28 10:33:53.853923 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:33:53.853804    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="48ca532d-c26d-4494-823b-cfee7a50bd5d" containerName="copy"
May 28 10:33:53.853923 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:33:53.853809    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="48ca532d-c26d-4494-823b-cfee7a50bd5d" containerName="copy"
May 28 10:33:53.853923 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:33:53.853847    2565 memory_manager.go:356] "RemoveStaleState removing state" podUID="48ca532d-c26d-4494-823b-cfee7a50bd5d" containerName="gather"
May 28 10:33:53.853923 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:33:53.853859    2565 memory_manager.go:356] "RemoveStaleState removing state" podUID="48ca532d-c26d-4494-823b-cfee7a50bd5d" containerName="copy"
May 28 10:33:53.857028 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:33:53.856937    2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-sg2z8/perf-node-gather-daemonset-8ccv8"
May 28 10:33:53.859807 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:33:53.859790    2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-sg2z8\"/\"kube-root-ca.crt\""
May 28 10:33:53.860947 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:33:53.860930    2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-sg2z8\"/\"default-dockercfg-vq5rc\""
May 28 10:33:53.861013 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:33:53.860946    2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-sg2z8\"/\"openshift-service-ca.crt\""
May 28 10:33:53.867627 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:33:53.867600    2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-sg2z8/perf-node-gather-daemonset-8ccv8"]
May 28 10:33:53.916282 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:33:53.916242    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/c8cfccb8-47c1-44c3-9d61-28be50e9fda6-podres\") pod \"perf-node-gather-daemonset-8ccv8\" (UID: \"c8cfccb8-47c1-44c3-9d61-28be50e9fda6\") " pod="openshift-must-gather-sg2z8/perf-node-gather-daemonset-8ccv8"
May 28 10:33:53.916282 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:33:53.916281    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zrmw2\" (UniqueName: \"kubernetes.io/projected/c8cfccb8-47c1-44c3-9d61-28be50e9fda6-kube-api-access-zrmw2\") pod \"perf-node-gather-daemonset-8ccv8\" (UID: \"c8cfccb8-47c1-44c3-9d61-28be50e9fda6\") " pod="openshift-must-gather-sg2z8/perf-node-gather-daemonset-8ccv8"
May 28 10:33:53.916496 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:33:53.916354    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c8cfccb8-47c1-44c3-9d61-28be50e9fda6-sys\") pod \"perf-node-gather-daemonset-8ccv8\" (UID: \"c8cfccb8-47c1-44c3-9d61-28be50e9fda6\") " pod="openshift-must-gather-sg2z8/perf-node-gather-daemonset-8ccv8"
May 28 10:33:53.916496 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:33:53.916391    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/c8cfccb8-47c1-44c3-9d61-28be50e9fda6-lib-modules\") pod \"perf-node-gather-daemonset-8ccv8\" (UID: \"c8cfccb8-47c1-44c3-9d61-28be50e9fda6\") " pod="openshift-must-gather-sg2z8/perf-node-gather-daemonset-8ccv8"
May 28 10:33:53.916496 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:33:53.916424    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/c8cfccb8-47c1-44c3-9d61-28be50e9fda6-proc\") pod \"perf-node-gather-daemonset-8ccv8\" (UID: \"c8cfccb8-47c1-44c3-9d61-28be50e9fda6\") " pod="openshift-must-gather-sg2z8/perf-node-gather-daemonset-8ccv8"
May 28 10:33:54.016789 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:33:54.016757    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/c8cfccb8-47c1-44c3-9d61-28be50e9fda6-podres\") pod \"perf-node-gather-daemonset-8ccv8\" (UID: \"c8cfccb8-47c1-44c3-9d61-28be50e9fda6\") " pod="openshift-must-gather-sg2z8/perf-node-gather-daemonset-8ccv8"
May 28 10:33:54.016789 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:33:54.016794    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-zrmw2\" (UniqueName: \"kubernetes.io/projected/c8cfccb8-47c1-44c3-9d61-28be50e9fda6-kube-api-access-zrmw2\") pod \"perf-node-gather-daemonset-8ccv8\" (UID: \"c8cfccb8-47c1-44c3-9d61-28be50e9fda6\") " pod="openshift-must-gather-sg2z8/perf-node-gather-daemonset-8ccv8"
May 28 10:33:54.017056 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:33:54.016830    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c8cfccb8-47c1-44c3-9d61-28be50e9fda6-sys\") pod \"perf-node-gather-daemonset-8ccv8\" (UID: \"c8cfccb8-47c1-44c3-9d61-28be50e9fda6\") " pod="openshift-must-gather-sg2z8/perf-node-gather-daemonset-8ccv8"
May 28 10:33:54.017056 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:33:54.016874    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/c8cfccb8-47c1-44c3-9d61-28be50e9fda6-lib-modules\") pod \"perf-node-gather-daemonset-8ccv8\" (UID: \"c8cfccb8-47c1-44c3-9d61-28be50e9fda6\") " pod="openshift-must-gather-sg2z8/perf-node-gather-daemonset-8ccv8"
May 28 10:33:54.017056 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:33:54.016901    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/c8cfccb8-47c1-44c3-9d61-28be50e9fda6-proc\") pod \"perf-node-gather-daemonset-8ccv8\" (UID: \"c8cfccb8-47c1-44c3-9d61-28be50e9fda6\") " pod="openshift-must-gather-sg2z8/perf-node-gather-daemonset-8ccv8"
May 28 10:33:54.017056 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:33:54.016945    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/c8cfccb8-47c1-44c3-9d61-28be50e9fda6-podres\") pod \"perf-node-gather-daemonset-8ccv8\" (UID: \"c8cfccb8-47c1-44c3-9d61-28be50e9fda6\") " pod="openshift-must-gather-sg2z8/perf-node-gather-daemonset-8ccv8"
May 28 10:33:54.017056 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:33:54.016971    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c8cfccb8-47c1-44c3-9d61-28be50e9fda6-sys\") pod \"perf-node-gather-daemonset-8ccv8\" (UID: \"c8cfccb8-47c1-44c3-9d61-28be50e9fda6\") " pod="openshift-must-gather-sg2z8/perf-node-gather-daemonset-8ccv8"
May 28 10:33:54.017056 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:33:54.016971    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/c8cfccb8-47c1-44c3-9d61-28be50e9fda6-proc\") pod \"perf-node-gather-daemonset-8ccv8\" (UID: \"c8cfccb8-47c1-44c3-9d61-28be50e9fda6\") " pod="openshift-must-gather-sg2z8/perf-node-gather-daemonset-8ccv8"
May 28 10:33:54.017280 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:33:54.017056    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/c8cfccb8-47c1-44c3-9d61-28be50e9fda6-lib-modules\") pod \"perf-node-gather-daemonset-8ccv8\" (UID: \"c8cfccb8-47c1-44c3-9d61-28be50e9fda6\") " pod="openshift-must-gather-sg2z8/perf-node-gather-daemonset-8ccv8"
May 28 10:33:54.026435 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:33:54.026406    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zrmw2\" (UniqueName: \"kubernetes.io/projected/c8cfccb8-47c1-44c3-9d61-28be50e9fda6-kube-api-access-zrmw2\") pod \"perf-node-gather-daemonset-8ccv8\" (UID: \"c8cfccb8-47c1-44c3-9d61-28be50e9fda6\") " pod="openshift-must-gather-sg2z8/perf-node-gather-daemonset-8ccv8"
May 28 10:33:54.165776 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:33:54.165662    2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-sg2z8/perf-node-gather-daemonset-8ccv8"
May 28 10:33:54.290928 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:33:54.290895    2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-sg2z8/perf-node-gather-daemonset-8ccv8"]
May 28 10:33:54.293632 ip-10-0-128-206 kubenswrapper[2565]: W0528 10:33:54.293605    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podc8cfccb8_47c1_44c3_9d61_28be50e9fda6.slice/crio-0039a9f895b274e4f7ddfcc6c686726340e8e1ceba7064b9700918dab40a48ab WatchSource:0}: Error finding container 0039a9f895b274e4f7ddfcc6c686726340e8e1ceba7064b9700918dab40a48ab: Status 404 returned error can't find the container with id 0039a9f895b274e4f7ddfcc6c686726340e8e1ceba7064b9700918dab40a48ab
May 28 10:33:55.101997 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:33:55.101962    2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-sg2z8/perf-node-gather-daemonset-8ccv8" event={"ID":"c8cfccb8-47c1-44c3-9d61-28be50e9fda6","Type":"ContainerStarted","Data":"11e0ac52923f7f46bad074eb56886f04d828f7ed4bba2239fab16acf7a34bbac"}
May 28 10:33:55.101997 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:33:55.101996    2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-sg2z8/perf-node-gather-daemonset-8ccv8" event={"ID":"c8cfccb8-47c1-44c3-9d61-28be50e9fda6","Type":"ContainerStarted","Data":"0039a9f895b274e4f7ddfcc6c686726340e8e1ceba7064b9700918dab40a48ab"}
May 28 10:33:55.102449 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:33:55.102078    2565 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-sg2z8/perf-node-gather-daemonset-8ccv8"
May 28 10:33:55.118911 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:33:55.118841    2565 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-must-gather-sg2z8/perf-node-gather-daemonset-8ccv8" podStartSLOduration=2.118827591 podStartE2EDuration="2.118827591s" podCreationTimestamp="2026-05-28 10:33:53 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-28 10:33:55.11745002 +0000 UTC m=+1720.577784172" watchObservedRunningTime="2026-05-28 10:33:55.118827591 +0000 UTC m=+1720.579161780"
May 28 10:33:55.927129 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:33:55.927099    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-hcldz_63f2ebc8-d3a0-40d0-b1ec-c03108b51c0a/dns/0.log"
May 28 10:33:55.950962 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:33:55.950939    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-hcldz_63f2ebc8-d3a0-40d0-b1ec-c03108b51c0a/kube-rbac-proxy/0.log"
May 28 10:33:55.975024 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:33:55.974999    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-8vr88_b4abbf06-e346-4870-a227-65afbd0db899/dns-node-resolver/0.log"
May 28 10:33:56.474743 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:33:56.474719    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-8jmk5_74f14c89-a025-4bda-ab55-a7a661f2702e/node-ca/0.log"
May 28 10:33:57.612203 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:33:57.612165    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-9q7gx_be308a10-eaec-4c81-9d1d-4f5bf03358ab/serve-healthcheck-canary/0.log"
May 28 10:33:58.245344 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:33:58.245304    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-pr7st_5bce5c13-a963-4b98-adf3-7ebc88f12c97/kube-rbac-proxy/0.log"
May 28 10:33:58.278419 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:33:58.278387    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-pr7st_5bce5c13-a963-4b98-adf3-7ebc88f12c97/exporter/0.log"
May 28 10:33:58.306563 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:33:58.306538    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-pr7st_5bce5c13-a963-4b98-adf3-7ebc88f12c97/extractor/0.log"
May 28 10:34:01.114363 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:34:01.114337    2565 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-sg2z8/perf-node-gather-daemonset-8ccv8"
May 28 10:34:04.168376 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:34:04.164578    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-ck4jd_2a281715-5613-4b06-9963-0addcc9b432a/kube-multus-additional-cni-plugins/0.log"
May 28 10:34:04.193988 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:34:04.193954    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-ck4jd_2a281715-5613-4b06-9963-0addcc9b432a/egress-router-binary-copy/0.log"
May 28 10:34:04.222176 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:34:04.222149    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-ck4jd_2a281715-5613-4b06-9963-0addcc9b432a/cni-plugins/0.log"
May 28 10:34:04.252577 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:34:04.252548    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-ck4jd_2a281715-5613-4b06-9963-0addcc9b432a/bond-cni-plugin/0.log"
May 28 10:34:04.284625 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:34:04.284598    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-ck4jd_2a281715-5613-4b06-9963-0addcc9b432a/routeoverride-cni/0.log"
May 28 10:34:04.319381 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:34:04.319357    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-ck4jd_2a281715-5613-4b06-9963-0addcc9b432a/whereabouts-cni-bincopy/0.log"
May 28 10:34:04.343815 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:34:04.343786    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-ck4jd_2a281715-5613-4b06-9963-0addcc9b432a/whereabouts-cni/0.log"
May 28 10:34:04.881514 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:34:04.881482    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-vwktp_c52e0100-163d-47e8-9414-e07548bc3e37/kube-multus/0.log"
May 28 10:34:04.991644 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:34:04.991563    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-jj9f8_9024e35e-a291-4ee1-b4ad-c8b75c8d31ca/network-metrics-daemon/0.log"
May 28 10:34:05.014999 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:34:05.014969    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-jj9f8_9024e35e-a291-4ee1-b4ad-c8b75c8d31ca/kube-rbac-proxy/0.log"
May 28 10:34:06.130056 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:34:06.130023    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-j4whq_5185dc25-c431-4639-a53a-0c38db5a6f4f/ovn-controller/0.log"
May 28 10:34:06.160917 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:34:06.160886    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-j4whq_5185dc25-c431-4639-a53a-0c38db5a6f4f/ovn-acl-logging/0.log"
May 28 10:34:06.183257 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:34:06.183229    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-j4whq_5185dc25-c431-4639-a53a-0c38db5a6f4f/kube-rbac-proxy-node/0.log"
May 28 10:34:06.207089 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:34:06.207057    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-j4whq_5185dc25-c431-4639-a53a-0c38db5a6f4f/kube-rbac-proxy-ovn-metrics/0.log"
May 28 10:34:06.252849 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:34:06.252820    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-j4whq_5185dc25-c431-4639-a53a-0c38db5a6f4f/northd/0.log"
May 28 10:34:06.294090 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:34:06.294068    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-j4whq_5185dc25-c431-4639-a53a-0c38db5a6f4f/nbdb/0.log"
May 28 10:34:06.338191 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:34:06.338166    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-j4whq_5185dc25-c431-4639-a53a-0c38db5a6f4f/sbdb/0.log"
May 28 10:34:06.461701 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:34:06.461619    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-j4whq_5185dc25-c431-4639-a53a-0c38db5a6f4f/ovnkube-controller/0.log"
May 28 10:34:07.800126 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:34:07.800099    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-diagnostics_network-check-target-kvx8v_477435e8-f3a1-4bda-8764-5dd5b8afe64f/network-check-target-container/0.log"
May 28 10:34:08.796400 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:34:08.796375    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-operator_iptables-alerter-q87km_c1d9d1d1-da1a-431d-9baa-2bf4928f94d3/iptables-alerter/0.log"
May 28 10:34:09.464400 ip-10-0-128-206 kubenswrapper[2565]: I0528 10:34:09.464370    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-node-tuning-operator_tuned-8nw9l_a5f7c60c-f57b-475b-a97a-32f0e1dbdc5b/tuned/0.log"