May 26 15:14:42.635028 ip-10-0-140-164 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory
May 26 15:14:42.635040 ip-10-0-140-164 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory
May 26 15:14:42.635049 ip-10-0-140-164 systemd[1]: kubelet.service: Failed with result 'resources'.
May 26 15:14:42.635368 ip-10-0-140-164 systemd[1]: Failed to start Kubernetes Kubelet.
May 26 15:14:52.757962 ip-10-0-140-164 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found.
May 26 15:14:52.757982 ip-10-0-140-164 systemd[1]: kubelet.service: Failed with result 'resources'.
-- Boot 71c8f4752bb24bb08ee1c16017248524 --
May 26 15:17:40.880493 ip-10-0-140-164 systemd[1]: Starting Kubernetes Kubelet...
May 26 15:17:41.371748 ip-10-0-140-164 kubenswrapper[2581]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
May 26 15:17:41.371748 ip-10-0-140-164 kubenswrapper[2581]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
May 26 15:17:41.371748 ip-10-0-140-164 kubenswrapper[2581]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
May 26 15:17:41.371748 ip-10-0-140-164 kubenswrapper[2581]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
May 26 15:17:41.371748 ip-10-0-140-164 kubenswrapper[2581]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
May 26 15:17:41.372476 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:17:41.372412    2581 server.go:212] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
May 26 15:17:41.376063 ip-10-0-140-164 kubenswrapper[2581]: W0526 15:17:41.375965    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
May 26 15:17:41.376063 ip-10-0-140-164 kubenswrapper[2581]: W0526 15:17:41.376063    2581 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController
May 26 15:17:41.376131 ip-10-0-140-164 kubenswrapper[2581]: W0526 15:17:41.376068    2581 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
May 26 15:17:41.376131 ip-10-0-140-164 kubenswrapper[2581]: W0526 15:17:41.376072    2581 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
May 26 15:17:41.376131 ip-10-0-140-164 kubenswrapper[2581]: W0526 15:17:41.376076    2581 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
May 26 15:17:41.376131 ip-10-0-140-164 kubenswrapper[2581]: W0526 15:17:41.376080    2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
May 26 15:17:41.376131 ip-10-0-140-164 kubenswrapper[2581]: W0526 15:17:41.376083    2581 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
May 26 15:17:41.376131 ip-10-0-140-164 kubenswrapper[2581]: W0526 15:17:41.376085    2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
May 26 15:17:41.376131 ip-10-0-140-164 kubenswrapper[2581]: W0526 15:17:41.376088    2581 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
May 26 15:17:41.376131 ip-10-0-140-164 kubenswrapper[2581]: W0526 15:17:41.376091    2581 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
May 26 15:17:41.376131 ip-10-0-140-164 kubenswrapper[2581]: W0526 15:17:41.376093    2581 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
May 26 15:17:41.376131 ip-10-0-140-164 kubenswrapper[2581]: W0526 15:17:41.376096    2581 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations
May 26 15:17:41.376131 ip-10-0-140-164 kubenswrapper[2581]: W0526 15:17:41.376098    2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
May 26 15:17:41.376131 ip-10-0-140-164 kubenswrapper[2581]: W0526 15:17:41.376101    2581 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
May 26 15:17:41.376131 ip-10-0-140-164 kubenswrapper[2581]: W0526 15:17:41.376104    2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
May 26 15:17:41.376131 ip-10-0-140-164 kubenswrapper[2581]: W0526 15:17:41.376106    2581 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
May 26 15:17:41.376131 ip-10-0-140-164 kubenswrapper[2581]: W0526 15:17:41.376109    2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
May 26 15:17:41.376131 ip-10-0-140-164 kubenswrapper[2581]: W0526 15:17:41.376111    2581 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
May 26 15:17:41.376131 ip-10-0-140-164 kubenswrapper[2581]: W0526 15:17:41.376114    2581 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
May 26 15:17:41.376131 ip-10-0-140-164 kubenswrapper[2581]: W0526 15:17:41.376116    2581 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
May 26 15:17:41.376131 ip-10-0-140-164 kubenswrapper[2581]: W0526 15:17:41.376119    2581 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
May 26 15:17:41.376591 ip-10-0-140-164 kubenswrapper[2581]: W0526 15:17:41.376124    2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
May 26 15:17:41.376591 ip-10-0-140-164 kubenswrapper[2581]: W0526 15:17:41.376126    2581 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
May 26 15:17:41.376591 ip-10-0-140-164 kubenswrapper[2581]: W0526 15:17:41.376129    2581 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
May 26 15:17:41.376591 ip-10-0-140-164 kubenswrapper[2581]: W0526 15:17:41.376132    2581 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
May 26 15:17:41.376591 ip-10-0-140-164 kubenswrapper[2581]: W0526 15:17:41.376136    2581 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
May 26 15:17:41.376591 ip-10-0-140-164 kubenswrapper[2581]: W0526 15:17:41.376140    2581 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
May 26 15:17:41.376591 ip-10-0-140-164 kubenswrapper[2581]: W0526 15:17:41.376144    2581 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
May 26 15:17:41.376591 ip-10-0-140-164 kubenswrapper[2581]: W0526 15:17:41.376147    2581 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
May 26 15:17:41.376591 ip-10-0-140-164 kubenswrapper[2581]: W0526 15:17:41.376150    2581 feature_gate.go:328] unrecognized feature gate: Example
May 26 15:17:41.376591 ip-10-0-140-164 kubenswrapper[2581]: W0526 15:17:41.376153    2581 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
May 26 15:17:41.376591 ip-10-0-140-164 kubenswrapper[2581]: W0526 15:17:41.376155    2581 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
May 26 15:17:41.376591 ip-10-0-140-164 kubenswrapper[2581]: W0526 15:17:41.376157    2581 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
May 26 15:17:41.376591 ip-10-0-140-164 kubenswrapper[2581]: W0526 15:17:41.376160    2581 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
May 26 15:17:41.376591 ip-10-0-140-164 kubenswrapper[2581]: W0526 15:17:41.376164    2581 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
May 26 15:17:41.376591 ip-10-0-140-164 kubenswrapper[2581]: W0526 15:17:41.376166    2581 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
May 26 15:17:41.376591 ip-10-0-140-164 kubenswrapper[2581]: W0526 15:17:41.376169    2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
May 26 15:17:41.376591 ip-10-0-140-164 kubenswrapper[2581]: W0526 15:17:41.376171    2581 feature_gate.go:328] unrecognized feature gate: SignatureStores
May 26 15:17:41.376591 ip-10-0-140-164 kubenswrapper[2581]: W0526 15:17:41.376173    2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
May 26 15:17:41.376591 ip-10-0-140-164 kubenswrapper[2581]: W0526 15:17:41.376176    2581 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
May 26 15:17:41.376591 ip-10-0-140-164 kubenswrapper[2581]: W0526 15:17:41.376178    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
May 26 15:17:41.377119 ip-10-0-140-164 kubenswrapper[2581]: W0526 15:17:41.376181    2581 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
May 26 15:17:41.377119 ip-10-0-140-164 kubenswrapper[2581]: W0526 15:17:41.376183    2581 feature_gate.go:328] unrecognized feature gate: InsightsConfig
May 26 15:17:41.377119 ip-10-0-140-164 kubenswrapper[2581]: W0526 15:17:41.376185    2581 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
May 26 15:17:41.377119 ip-10-0-140-164 kubenswrapper[2581]: W0526 15:17:41.376188    2581 feature_gate.go:328] unrecognized feature gate: OVNObservability
May 26 15:17:41.377119 ip-10-0-140-164 kubenswrapper[2581]: W0526 15:17:41.376190    2581 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
May 26 15:17:41.377119 ip-10-0-140-164 kubenswrapper[2581]: W0526 15:17:41.376193    2581 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
May 26 15:17:41.377119 ip-10-0-140-164 kubenswrapper[2581]: W0526 15:17:41.376195    2581 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
May 26 15:17:41.377119 ip-10-0-140-164 kubenswrapper[2581]: W0526 15:17:41.376198    2581 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
May 26 15:17:41.377119 ip-10-0-140-164 kubenswrapper[2581]: W0526 15:17:41.376200    2581 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
May 26 15:17:41.377119 ip-10-0-140-164 kubenswrapper[2581]: W0526 15:17:41.376203    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
May 26 15:17:41.377119 ip-10-0-140-164 kubenswrapper[2581]: W0526 15:17:41.376205    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
May 26 15:17:41.377119 ip-10-0-140-164 kubenswrapper[2581]: W0526 15:17:41.376208    2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
May 26 15:17:41.377119 ip-10-0-140-164 kubenswrapper[2581]: W0526 15:17:41.376210    2581 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
May 26 15:17:41.377119 ip-10-0-140-164 kubenswrapper[2581]: W0526 15:17:41.376214    2581 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
May 26 15:17:41.377119 ip-10-0-140-164 kubenswrapper[2581]: W0526 15:17:41.376217    2581 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
May 26 15:17:41.377119 ip-10-0-140-164 kubenswrapper[2581]: W0526 15:17:41.376220    2581 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
May 26 15:17:41.377119 ip-10-0-140-164 kubenswrapper[2581]: W0526 15:17:41.376222    2581 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
May 26 15:17:41.377119 ip-10-0-140-164 kubenswrapper[2581]: W0526 15:17:41.376225    2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
May 26 15:17:41.377119 ip-10-0-140-164 kubenswrapper[2581]: W0526 15:17:41.376227    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
May 26 15:17:41.377119 ip-10-0-140-164 kubenswrapper[2581]: W0526 15:17:41.376230    2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
May 26 15:17:41.377605 ip-10-0-140-164 kubenswrapper[2581]: W0526 15:17:41.376232    2581 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
May 26 15:17:41.377605 ip-10-0-140-164 kubenswrapper[2581]: W0526 15:17:41.376235    2581 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
May 26 15:17:41.377605 ip-10-0-140-164 kubenswrapper[2581]: W0526 15:17:41.376237    2581 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS
May 26 15:17:41.377605 ip-10-0-140-164 kubenswrapper[2581]: W0526 15:17:41.376239    2581 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
May 26 15:17:41.377605 ip-10-0-140-164 kubenswrapper[2581]: W0526 15:17:41.376242    2581 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
May 26 15:17:41.377605 ip-10-0-140-164 kubenswrapper[2581]: W0526 15:17:41.376244    2581 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
May 26 15:17:41.377605 ip-10-0-140-164 kubenswrapper[2581]: W0526 15:17:41.376247    2581 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
May 26 15:17:41.377605 ip-10-0-140-164 kubenswrapper[2581]: W0526 15:17:41.376249    2581 feature_gate.go:328] unrecognized feature gate: PinnedImages
May 26 15:17:41.377605 ip-10-0-140-164 kubenswrapper[2581]: W0526 15:17:41.376252    2581 feature_gate.go:328] unrecognized feature gate: NewOLM
May 26 15:17:41.377605 ip-10-0-140-164 kubenswrapper[2581]: W0526 15:17:41.376254    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
May 26 15:17:41.377605 ip-10-0-140-164 kubenswrapper[2581]: W0526 15:17:41.376256    2581 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
May 26 15:17:41.377605 ip-10-0-140-164 kubenswrapper[2581]: W0526 15:17:41.376259    2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
May 26 15:17:41.377605 ip-10-0-140-164 kubenswrapper[2581]: W0526 15:17:41.376261    2581 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
May 26 15:17:41.377605 ip-10-0-140-164 kubenswrapper[2581]: W0526 15:17:41.376264    2581 feature_gate.go:328] unrecognized feature gate: Example2
May 26 15:17:41.377605 ip-10-0-140-164 kubenswrapper[2581]: W0526 15:17:41.376278    2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
May 26 15:17:41.377605 ip-10-0-140-164 kubenswrapper[2581]: W0526 15:17:41.376280    2581 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
May 26 15:17:41.377605 ip-10-0-140-164 kubenswrapper[2581]: W0526 15:17:41.376283    2581 feature_gate.go:328] unrecognized feature gate: DualReplica
May 26 15:17:41.377605 ip-10-0-140-164 kubenswrapper[2581]: W0526 15:17:41.376286    2581 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
May 26 15:17:41.377605 ip-10-0-140-164 kubenswrapper[2581]: W0526 15:17:41.376289    2581 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
May 26 15:17:41.377605 ip-10-0-140-164 kubenswrapper[2581]: W0526 15:17:41.376292    2581 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
May 26 15:17:41.378072 ip-10-0-140-164 kubenswrapper[2581]: W0526 15:17:41.376295    2581 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
May 26 15:17:41.378072 ip-10-0-140-164 kubenswrapper[2581]: W0526 15:17:41.376297    2581 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
May 26 15:17:41.378072 ip-10-0-140-164 kubenswrapper[2581]: W0526 15:17:41.376299    2581 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI
May 26 15:17:41.378072 ip-10-0-140-164 kubenswrapper[2581]: W0526 15:17:41.376302    2581 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
May 26 15:17:41.378072 ip-10-0-140-164 kubenswrapper[2581]: W0526 15:17:41.376304    2581 feature_gate.go:328] unrecognized feature gate: GatewayAPI
May 26 15:17:41.378072 ip-10-0-140-164 kubenswrapper[2581]: W0526 15:17:41.376660    2581 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
May 26 15:17:41.378072 ip-10-0-140-164 kubenswrapper[2581]: W0526 15:17:41.376666    2581 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
May 26 15:17:41.378072 ip-10-0-140-164 kubenswrapper[2581]: W0526 15:17:41.376668    2581 feature_gate.go:328] unrecognized feature gate: Example2
May 26 15:17:41.378072 ip-10-0-140-164 kubenswrapper[2581]: W0526 15:17:41.376672    2581 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
May 26 15:17:41.378072 ip-10-0-140-164 kubenswrapper[2581]: W0526 15:17:41.376675    2581 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
May 26 15:17:41.378072 ip-10-0-140-164 kubenswrapper[2581]: W0526 15:17:41.376678    2581 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
May 26 15:17:41.378072 ip-10-0-140-164 kubenswrapper[2581]: W0526 15:17:41.376681    2581 feature_gate.go:328] unrecognized feature gate: InsightsConfig
May 26 15:17:41.378072 ip-10-0-140-164 kubenswrapper[2581]: W0526 15:17:41.376684    2581 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
May 26 15:17:41.378072 ip-10-0-140-164 kubenswrapper[2581]: W0526 15:17:41.376686    2581 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
May 26 15:17:41.378072 ip-10-0-140-164 kubenswrapper[2581]: W0526 15:17:41.376689    2581 feature_gate.go:328] unrecognized feature gate: NewOLM
May 26 15:17:41.378072 ip-10-0-140-164 kubenswrapper[2581]: W0526 15:17:41.376691    2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
May 26 15:17:41.378072 ip-10-0-140-164 kubenswrapper[2581]: W0526 15:17:41.376694    2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
May 26 15:17:41.378072 ip-10-0-140-164 kubenswrapper[2581]: W0526 15:17:41.376696    2581 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
May 26 15:17:41.378072 ip-10-0-140-164 kubenswrapper[2581]: W0526 15:17:41.376699    2581 feature_gate.go:328] unrecognized feature gate: OVNObservability
May 26 15:17:41.378072 ip-10-0-140-164 kubenswrapper[2581]: W0526 15:17:41.376701    2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
May 26 15:17:41.378563 ip-10-0-140-164 kubenswrapper[2581]: W0526 15:17:41.376703    2581 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
May 26 15:17:41.378563 ip-10-0-140-164 kubenswrapper[2581]: W0526 15:17:41.376706    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
May 26 15:17:41.378563 ip-10-0-140-164 kubenswrapper[2581]: W0526 15:17:41.376708    2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
May 26 15:17:41.378563 ip-10-0-140-164 kubenswrapper[2581]: W0526 15:17:41.376711    2581 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
May 26 15:17:41.378563 ip-10-0-140-164 kubenswrapper[2581]: W0526 15:17:41.376713    2581 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
May 26 15:17:41.378563 ip-10-0-140-164 kubenswrapper[2581]: W0526 15:17:41.376715    2581 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
May 26 15:17:41.378563 ip-10-0-140-164 kubenswrapper[2581]: W0526 15:17:41.376718    2581 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
May 26 15:17:41.378563 ip-10-0-140-164 kubenswrapper[2581]: W0526 15:17:41.376720    2581 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
May 26 15:17:41.378563 ip-10-0-140-164 kubenswrapper[2581]: W0526 15:17:41.376722    2581 feature_gate.go:328] unrecognized feature gate: GatewayAPI
May 26 15:17:41.378563 ip-10-0-140-164 kubenswrapper[2581]: W0526 15:17:41.376725    2581 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
May 26 15:17:41.378563 ip-10-0-140-164 kubenswrapper[2581]: W0526 15:17:41.376728    2581 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
May 26 15:17:41.378563 ip-10-0-140-164 kubenswrapper[2581]: W0526 15:17:41.376731    2581 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
May 26 15:17:41.378563 ip-10-0-140-164 kubenswrapper[2581]: W0526 15:17:41.376733    2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
May 26 15:17:41.378563 ip-10-0-140-164 kubenswrapper[2581]: W0526 15:17:41.376736    2581 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
May 26 15:17:41.378563 ip-10-0-140-164 kubenswrapper[2581]: W0526 15:17:41.376738    2581 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
May 26 15:17:41.378563 ip-10-0-140-164 kubenswrapper[2581]: W0526 15:17:41.376741    2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
May 26 15:17:41.378563 ip-10-0-140-164 kubenswrapper[2581]: W0526 15:17:41.376743    2581 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
May 26 15:17:41.378563 ip-10-0-140-164 kubenswrapper[2581]: W0526 15:17:41.376746    2581 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
May 26 15:17:41.378563 ip-10-0-140-164 kubenswrapper[2581]: W0526 15:17:41.376749    2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
May 26 15:17:41.378563 ip-10-0-140-164 kubenswrapper[2581]: W0526 15:17:41.376753    2581 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
May 26 15:17:41.379045 ip-10-0-140-164 kubenswrapper[2581]: W0526 15:17:41.376757    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
May 26 15:17:41.379045 ip-10-0-140-164 kubenswrapper[2581]: W0526 15:17:41.376760    2581 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS
May 26 15:17:41.379045 ip-10-0-140-164 kubenswrapper[2581]: W0526 15:17:41.376762    2581 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
May 26 15:17:41.379045 ip-10-0-140-164 kubenswrapper[2581]: W0526 15:17:41.376765    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
May 26 15:17:41.379045 ip-10-0-140-164 kubenswrapper[2581]: W0526 15:17:41.376767    2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
May 26 15:17:41.379045 ip-10-0-140-164 kubenswrapper[2581]: W0526 15:17:41.376770    2581 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
May 26 15:17:41.379045 ip-10-0-140-164 kubenswrapper[2581]: W0526 15:17:41.376772    2581 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
May 26 15:17:41.379045 ip-10-0-140-164 kubenswrapper[2581]: W0526 15:17:41.376775    2581 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
May 26 15:17:41.379045 ip-10-0-140-164 kubenswrapper[2581]: W0526 15:17:41.376777    2581 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
May 26 15:17:41.379045 ip-10-0-140-164 kubenswrapper[2581]: W0526 15:17:41.376779    2581 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
May 26 15:17:41.379045 ip-10-0-140-164 kubenswrapper[2581]: W0526 15:17:41.376781    2581 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
May 26 15:17:41.379045 ip-10-0-140-164 kubenswrapper[2581]: W0526 15:17:41.376785    2581 feature_gate.go:328] unrecognized feature gate: PinnedImages
May 26 15:17:41.379045 ip-10-0-140-164 kubenswrapper[2581]: W0526 15:17:41.376787    2581 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
May 26 15:17:41.379045 ip-10-0-140-164 kubenswrapper[2581]: W0526 15:17:41.376790    2581 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
May 26 15:17:41.379045 ip-10-0-140-164 kubenswrapper[2581]: W0526 15:17:41.376792    2581 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
May 26 15:17:41.379045 ip-10-0-140-164 kubenswrapper[2581]: W0526 15:17:41.376794    2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
May 26 15:17:41.379045 ip-10-0-140-164 kubenswrapper[2581]: W0526 15:17:41.376797    2581 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
May 26 15:17:41.379045 ip-10-0-140-164 kubenswrapper[2581]: W0526 15:17:41.376800    2581 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
May 26 15:17:41.379045 ip-10-0-140-164 kubenswrapper[2581]: W0526 15:17:41.376802    2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
May 26 15:17:41.379045 ip-10-0-140-164 kubenswrapper[2581]: W0526 15:17:41.376804    2581 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
May 26 15:17:41.379575 ip-10-0-140-164 kubenswrapper[2581]: W0526 15:17:41.376807    2581 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
May 26 15:17:41.379575 ip-10-0-140-164 kubenswrapper[2581]: W0526 15:17:41.376810    2581 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations
May 26 15:17:41.379575 ip-10-0-140-164 kubenswrapper[2581]: W0526 15:17:41.376812    2581 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
May 26 15:17:41.379575 ip-10-0-140-164 kubenswrapper[2581]: W0526 15:17:41.376815    2581 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
May 26 15:17:41.379575 ip-10-0-140-164 kubenswrapper[2581]: W0526 15:17:41.376817    2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
May 26 15:17:41.379575 ip-10-0-140-164 kubenswrapper[2581]: W0526 15:17:41.376820    2581 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
May 26 15:17:41.379575 ip-10-0-140-164 kubenswrapper[2581]: W0526 15:17:41.376822    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
May 26 15:17:41.379575 ip-10-0-140-164 kubenswrapper[2581]: W0526 15:17:41.376824    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
May 26 15:17:41.379575 ip-10-0-140-164 kubenswrapper[2581]: W0526 15:17:41.376827    2581 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
May 26 15:17:41.379575 ip-10-0-140-164 kubenswrapper[2581]: W0526 15:17:41.376830    2581 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
May 26 15:17:41.379575 ip-10-0-140-164 kubenswrapper[2581]: W0526 15:17:41.376832    2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
May 26 15:17:41.379575 ip-10-0-140-164 kubenswrapper[2581]: W0526 15:17:41.376835    2581 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
May 26 15:17:41.379575 ip-10-0-140-164 kubenswrapper[2581]: W0526 15:17:41.376838    2581 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
May 26 15:17:41.379575 ip-10-0-140-164 kubenswrapper[2581]: W0526 15:17:41.376840    2581 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
May 26 15:17:41.379575 ip-10-0-140-164 kubenswrapper[2581]: W0526 15:17:41.376843    2581 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
May 26 15:17:41.379575 ip-10-0-140-164 kubenswrapper[2581]: W0526 15:17:41.376845    2581 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
May 26 15:17:41.379575 ip-10-0-140-164 kubenswrapper[2581]: W0526 15:17:41.376847    2581 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
May 26 15:17:41.379575 ip-10-0-140-164 kubenswrapper[2581]: W0526 15:17:41.376850    2581 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
May 26 15:17:41.379575 ip-10-0-140-164 kubenswrapper[2581]: W0526 15:17:41.376854    2581 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
May 26 15:17:41.380038 ip-10-0-140-164 kubenswrapper[2581]: W0526 15:17:41.376856    2581 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI
May 26 15:17:41.380038 ip-10-0-140-164 kubenswrapper[2581]: W0526 15:17:41.376858    2581 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
May 26 15:17:41.380038 ip-10-0-140-164 kubenswrapper[2581]: W0526 15:17:41.376861    2581 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController
May 26 15:17:41.380038 ip-10-0-140-164 kubenswrapper[2581]: W0526 15:17:41.376863    2581 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
May 26 15:17:41.380038 ip-10-0-140-164 kubenswrapper[2581]: W0526 15:17:41.376866    2581 feature_gate.go:328] unrecognized feature gate: SignatureStores
May 26 15:17:41.380038 ip-10-0-140-164 kubenswrapper[2581]: W0526 15:17:41.376868    2581 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
May 26 15:17:41.380038 ip-10-0-140-164 kubenswrapper[2581]: W0526 15:17:41.376870    2581 feature_gate.go:328] unrecognized feature gate: Example
May 26 15:17:41.380038 ip-10-0-140-164 kubenswrapper[2581]: W0526 15:17:41.376873    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
May 26 15:17:41.380038 ip-10-0-140-164 kubenswrapper[2581]: W0526 15:17:41.376875    2581 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
May 26 15:17:41.380038 ip-10-0-140-164 kubenswrapper[2581]: W0526 15:17:41.376877    2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
May 26 15:17:41.380038 ip-10-0-140-164 kubenswrapper[2581]: W0526 15:17:41.376880    2581 feature_gate.go:328] unrecognized feature gate: DualReplica
May 26 15:17:41.380038 ip-10-0-140-164 kubenswrapper[2581]: W0526 15:17:41.376882    2581 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
May 26 15:17:41.380038 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:17:41.377709    2581 flags.go:64] FLAG: --address="0.0.0.0"
May 26 15:17:41.380038 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:17:41.377719    2581 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
May 26 15:17:41.380038 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:17:41.377725    2581 flags.go:64] FLAG: --anonymous-auth="true"
May 26 15:17:41.380038 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:17:41.377729    2581 flags.go:64] FLAG: --application-metrics-count-limit="100"
May 26 15:17:41.380038 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:17:41.377733    2581 flags.go:64] FLAG: --authentication-token-webhook="false"
May 26 15:17:41.380038 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:17:41.377736    2581 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
May 26 15:17:41.380038 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:17:41.377739    2581 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
May 26 15:17:41.380038 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:17:41.377743    2581 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
May 26 15:17:41.380038 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:17:41.377747    2581 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
May 26 15:17:41.380551 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:17:41.377749    2581 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
May 26 15:17:41.380551 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:17:41.377753    2581 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
May 26 15:17:41.380551 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:17:41.377756    2581 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
May 26 15:17:41.380551 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:17:41.377759    2581 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
May 26 15:17:41.380551 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:17:41.377766    2581 flags.go:64] FLAG: --cgroup-root=""
May 26 15:17:41.380551 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:17:41.377769    2581 flags.go:64] FLAG: --cgroups-per-qos="true"
May 26 15:17:41.380551 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:17:41.377772    2581 flags.go:64] FLAG: --client-ca-file=""
May 26 15:17:41.380551 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:17:41.377775    2581 flags.go:64] FLAG: --cloud-config=""
May 26 15:17:41.380551 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:17:41.377778    2581 flags.go:64] FLAG: --cloud-provider="external"
May 26 15:17:41.380551 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:17:41.377780    2581 flags.go:64] FLAG: --cluster-dns="[]"
May 26 15:17:41.380551 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:17:41.377784    2581 flags.go:64] FLAG: --cluster-domain=""
May 26 15:17:41.380551 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:17:41.377788    2581 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
May 26 15:17:41.380551 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:17:41.377791    2581 flags.go:64] FLAG: --config-dir=""
May 26 15:17:41.380551 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:17:41.377794    2581 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
May 26 15:17:41.380551 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:17:41.377797    2581 flags.go:64] FLAG: --container-log-max-files="5"
May 26 15:17:41.380551 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:17:41.377801    2581 flags.go:64] FLAG: --container-log-max-size="10Mi"
May 26 15:17:41.380551 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:17:41.377803    2581 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
May 26 15:17:41.380551 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:17:41.377806    2581 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
May 26 15:17:41.380551 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:17:41.377809    2581 flags.go:64] FLAG: --containerd-namespace="k8s.io"
May 26 15:17:41.380551 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:17:41.377812    2581 flags.go:64] FLAG: --contention-profiling="false"
May 26 15:17:41.380551 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:17:41.377815    2581 flags.go:64] FLAG: --cpu-cfs-quota="true"
May 26 15:17:41.380551 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:17:41.377818    2581 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
May 26 15:17:41.380551 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:17:41.377821    2581 flags.go:64] FLAG: --cpu-manager-policy="none"
May 26 15:17:41.380551 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:17:41.377824    2581 flags.go:64] FLAG: --cpu-manager-policy-options=""
May 26 15:17:41.380551 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:17:41.377828    2581 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
May 26 15:17:41.381142 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:17:41.377831    2581 flags.go:64] FLAG: --enable-controller-attach-detach="true"
May 26 15:17:41.381142 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:17:41.377835    2581 flags.go:64] FLAG: --enable-debugging-handlers="true"
May 26 15:17:41.381142 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:17:41.377837    2581 flags.go:64] FLAG: --enable-load-reader="false"
May 26 15:17:41.381142 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:17:41.377840    2581 flags.go:64] FLAG: --enable-server="true"
May 26 15:17:41.381142 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:17:41.377843    2581 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
May 26 15:17:41.381142 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:17:41.377846    2581 flags.go:64] FLAG: --event-burst="100"
May 26 15:17:41.381142 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:17:41.377849    2581 flags.go:64] FLAG: --event-qps="50"
May 26 15:17:41.381142 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:17:41.377852    2581 flags.go:64] FLAG: --event-storage-age-limit="default=0"
May 26 15:17:41.381142 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:17:41.377855    2581 flags.go:64] FLAG: --event-storage-event-limit="default=0"
May 26 15:17:41.381142 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:17:41.377858    2581 flags.go:64] FLAG: --eviction-hard=""
May 26 15:17:41.381142 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:17:41.377861    2581 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
May 26 15:17:41.381142 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:17:41.377864    2581 flags.go:64] FLAG: --eviction-minimum-reclaim=""
May 26 15:17:41.381142 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:17:41.377868    2581 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
May 26 15:17:41.381142 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:17:41.377871    2581 flags.go:64] FLAG: --eviction-soft=""
May 26 15:17:41.381142 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:17:41.377874    2581 flags.go:64] FLAG: --eviction-soft-grace-period=""
May 26 15:17:41.381142 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:17:41.377876    2581 flags.go:64] FLAG: --exit-on-lock-contention="false"
May 26 15:17:41.381142 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:17:41.377879    2581 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
May 26 15:17:41.381142 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:17:41.377882    2581 flags.go:64] FLAG: --experimental-mounter-path=""
May 26 15:17:41.381142 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:17:41.377884    2581 flags.go:64] FLAG: --fail-cgroupv1="false"
May 26 15:17:41.381142 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:17:41.377887    2581 flags.go:64] FLAG: --fail-swap-on="true"
May 26 15:17:41.381142 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:17:41.377890    2581 flags.go:64] FLAG: --feature-gates=""
May 26 15:17:41.381142 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:17:41.377893    2581 flags.go:64] FLAG: --file-check-frequency="20s"
May 26 15:17:41.381142 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:17:41.377896    2581 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
May 26 15:17:41.381142 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:17:41.377899    2581 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
May 26 15:17:41.381142 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:17:41.377902    2581 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
May 26 15:17:41.381825 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:17:41.377904    2581 flags.go:64] FLAG: --healthz-port="10248"
May 26 15:17:41.381825 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:17:41.377907    2581 flags.go:64] FLAG: --help="false"
May 26 15:17:41.381825 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:17:41.377910    2581 flags.go:64] FLAG: --hostname-override="ip-10-0-140-164.ec2.internal"
May 26 15:17:41.381825 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:17:41.377913    2581 flags.go:64] FLAG: --housekeeping-interval="10s"
May 26 15:17:41.381825 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:17:41.377916    2581 flags.go:64] FLAG: --http-check-frequency="20s"
May 26 15:17:41.381825 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:17:41.377919    2581 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
May 26 15:17:41.381825 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:17:41.377922    2581 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
May 26 15:17:41.381825 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:17:41.377926    2581 flags.go:64] FLAG: --image-gc-high-threshold="85"
May 26 15:17:41.381825 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:17:41.377929    2581 flags.go:64] FLAG: --image-gc-low-threshold="80"
May 26 15:17:41.381825 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:17:41.377932    2581 flags.go:64] FLAG: --image-service-endpoint=""
May 26 15:17:41.381825 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:17:41.377935    2581 flags.go:64] FLAG: --kernel-memcg-notification="false"
May 26 15:17:41.381825 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:17:41.377937    2581 flags.go:64] FLAG: --kube-api-burst="100"
May 26 15:17:41.381825 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:17:41.377940    2581 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
May 26 15:17:41.381825 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:17:41.377943    2581 flags.go:64] FLAG: --kube-api-qps="50"
May 26 15:17:41.381825 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:17:41.377946    2581 flags.go:64] FLAG: --kube-reserved=""
May 26 15:17:41.381825 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:17:41.377948    2581 flags.go:64] FLAG: --kube-reserved-cgroup=""
May 26 15:17:41.381825 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:17:41.377951    2581 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
May 26 15:17:41.381825 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:17:41.377954    2581 flags.go:64] FLAG: --kubelet-cgroups=""
May 26 15:17:41.381825 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:17:41.377956    2581 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
May 26 15:17:41.381825 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:17:41.377959    2581 flags.go:64] FLAG: --lock-file=""
May 26 15:17:41.381825 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:17:41.377962    2581 flags.go:64] FLAG: --log-cadvisor-usage="false"
May 26 15:17:41.381825 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:17:41.377965    2581 flags.go:64] FLAG: --log-flush-frequency="5s"
May 26 15:17:41.381825 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:17:41.377968    2581 flags.go:64] FLAG: --log-json-info-buffer-size="0"
May 26 15:17:41.381825 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:17:41.377973    2581 flags.go:64] FLAG: --log-json-split-stream="false"
May 26 15:17:41.382405 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:17:41.377975    2581 flags.go:64] FLAG: --log-text-info-buffer-size="0"
May 26 15:17:41.382405 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:17:41.377978    2581 flags.go:64] FLAG: --log-text-split-stream="false"
May 26 15:17:41.382405 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:17:41.377981    2581 flags.go:64] FLAG: --logging-format="text"
May 26 15:17:41.382405 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:17:41.377983    2581 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
May 26 15:17:41.382405 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:17:41.377987    2581 flags.go:64] FLAG: --make-iptables-util-chains="true"
May 26 15:17:41.382405 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:17:41.377989    2581 flags.go:64] FLAG: --manifest-url=""
May 26 15:17:41.382405 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:17:41.377992    2581 flags.go:64] FLAG: --manifest-url-header=""
May 26 15:17:41.382405 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:17:41.377996    2581 flags.go:64] FLAG: --max-housekeeping-interval="15s"
May 26 15:17:41.382405 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:17:41.377998    2581 flags.go:64] FLAG: --max-open-files="1000000"
May 26 15:17:41.382405 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:17:41.378002    2581 flags.go:64] FLAG: --max-pods="110"
May 26 15:17:41.382405 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:17:41.378005    2581 flags.go:64] FLAG: --maximum-dead-containers="-1"
May 26 15:17:41.382405 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:17:41.378008    2581 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
May 26 15:17:41.382405 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:17:41.378011    2581 flags.go:64] FLAG: --memory-manager-policy="None"
May 26 15:17:41.382405 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:17:41.378014    2581 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
May 26 15:17:41.382405 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:17:41.378017    2581 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
May 26 15:17:41.382405 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:17:41.378020    2581 flags.go:64] FLAG: --node-ip="0.0.0.0"
May 26 15:17:41.382405 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:17:41.378023    2581 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
May 26 15:17:41.382405 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:17:41.378030    2581 flags.go:64] FLAG: --node-status-max-images="50"
May 26 15:17:41.382405 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:17:41.378033    2581 flags.go:64] FLAG: --node-status-update-frequency="10s"
May 26 15:17:41.382405 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:17:41.378036    2581 flags.go:64] FLAG: --oom-score-adj="-999"
May 26 15:17:41.382405 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:17:41.378039    2581 flags.go:64] FLAG: --pod-cidr=""
May 26 15:17:41.382405 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:17:41.378041    2581 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:afe88671bf163c42b467d159dc6f0b784dbe28b1ed44e171edc9c06fd99cc6fc"
May 26 15:17:41.382405 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:17:41.378047    2581 flags.go:64] FLAG: --pod-manifest-path=""
May 26 15:17:41.382980 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:17:41.378049    2581 flags.go:64] FLAG: --pod-max-pids="-1"
May 26 15:17:41.382980 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:17:41.378053    2581 flags.go:64] FLAG: --pods-per-core="0"
May 26 15:17:41.382980 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:17:41.378056    2581 flags.go:64] FLAG: --port="10250"
May 26 15:17:41.382980 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:17:41.378059    2581 flags.go:64] FLAG: --protect-kernel-defaults="false"
May 26 15:17:41.382980 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:17:41.378061    2581 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-051a2ee0ea16a7fa6"
May 26 15:17:41.382980 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:17:41.378064    2581 flags.go:64] FLAG: --qos-reserved=""
May 26 15:17:41.382980 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:17:41.378068    2581 flags.go:64] FLAG: --read-only-port="10255"
May 26 15:17:41.382980 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:17:41.378071    2581 flags.go:64] FLAG: --register-node="true"
May 26 15:17:41.382980 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:17:41.378074    2581 flags.go:64] FLAG: --register-schedulable="true"
May 26 15:17:41.382980 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:17:41.378077    2581 flags.go:64] FLAG: --register-with-taints=""
May 26 15:17:41.382980 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:17:41.378080    2581 flags.go:64] FLAG: --registry-burst="10"
May 26 15:17:41.382980 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:17:41.378083    2581 flags.go:64] FLAG: --registry-qps="5"
May 26 15:17:41.382980 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:17:41.378086    2581 flags.go:64] FLAG: --reserved-cpus=""
May 26 15:17:41.382980 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:17:41.378089    2581 flags.go:64] FLAG: --reserved-memory=""
May 26 15:17:41.382980 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:17:41.378093    2581 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
May 26 15:17:41.382980 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:17:41.378095    2581 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
May 26 15:17:41.382980 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:17:41.378098    2581 flags.go:64] FLAG: --rotate-certificates="false"
May 26 15:17:41.382980 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:17:41.378101    2581 flags.go:64] FLAG: --rotate-server-certificates="false"
May 26 15:17:41.382980 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:17:41.378103    2581 flags.go:64] FLAG: --runonce="false"
May 26 15:17:41.382980 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:17:41.378106    2581 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
May 26 15:17:41.382980 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:17:41.378109    2581 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
May 26 15:17:41.382980 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:17:41.378112    2581 flags.go:64] FLAG: --seccomp-default="false"
May 26 15:17:41.382980 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:17:41.378117    2581 flags.go:64] FLAG: --serialize-image-pulls="true"
May 26 15:17:41.382980 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:17:41.378120    2581 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
May 26 15:17:41.382980 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:17:41.378123    2581 flags.go:64] FLAG: --storage-driver-db="cadvisor"
May 26 15:17:41.382980 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:17:41.378127    2581 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
May 26 15:17:41.383643 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:17:41.378129    2581 flags.go:64] FLAG: --storage-driver-password="root"
May 26 15:17:41.383643 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:17:41.378132    2581 flags.go:64] FLAG: --storage-driver-secure="false"
May 26 15:17:41.383643 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:17:41.378135    2581 flags.go:64] FLAG: --storage-driver-table="stats"
May 26 15:17:41.383643 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:17:41.378138    2581 flags.go:64] FLAG: --storage-driver-user="root"
May 26 15:17:41.383643 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:17:41.378140    2581 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
May 26 15:17:41.383643 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:17:41.378143    2581 flags.go:64] FLAG: --sync-frequency="1m0s"
May 26 15:17:41.383643 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:17:41.378146    2581 flags.go:64] FLAG: --system-cgroups=""
May 26 15:17:41.383643 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:17:41.378149    2581 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
May 26 15:17:41.383643 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:17:41.378154    2581 flags.go:64] FLAG: --system-reserved-cgroup=""
May 26 15:17:41.383643 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:17:41.378156    2581 flags.go:64] FLAG: --tls-cert-file=""
May 26 15:17:41.383643 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:17:41.378159    2581 flags.go:64] FLAG: --tls-cipher-suites="[]"
May 26 15:17:41.383643 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:17:41.378163    2581 flags.go:64] FLAG: --tls-min-version=""
May 26 15:17:41.383643 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:17:41.378166    2581 flags.go:64] FLAG: --tls-private-key-file=""
May 26 15:17:41.383643 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:17:41.378169    2581 flags.go:64] FLAG: --topology-manager-policy="none"
May 26 15:17:41.383643 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:17:41.378172    2581 flags.go:64] FLAG: --topology-manager-policy-options=""
May 26 15:17:41.383643 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:17:41.378175    2581 flags.go:64] FLAG: --topology-manager-scope="container"
May 26 15:17:41.383643 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:17:41.378178    2581 flags.go:64] FLAG: --v="2"
May 26 15:17:41.383643 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:17:41.378182    2581 flags.go:64] FLAG: --version="false"
May 26 15:17:41.383643 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:17:41.378186    2581 flags.go:64] FLAG: --vmodule=""
May 26 15:17:41.383643 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:17:41.378190    2581 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
May 26 15:17:41.383643 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:17:41.378193    2581 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
May 26 15:17:41.383643 ip-10-0-140-164 kubenswrapper[2581]: W0526 15:17:41.378295    2581 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
May 26 15:17:41.383643 ip-10-0-140-164 kubenswrapper[2581]: W0526 15:17:41.378299    2581 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
May 26 15:17:41.383643 ip-10-0-140-164 kubenswrapper[2581]: W0526 15:17:41.378302    2581 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
May 26 15:17:41.384214 ip-10-0-140-164 kubenswrapper[2581]: W0526 15:17:41.378305    2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
May 26 15:17:41.384214 ip-10-0-140-164 kubenswrapper[2581]: W0526 15:17:41.378307    2581 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
May 26 15:17:41.384214 ip-10-0-140-164 kubenswrapper[2581]: W0526 15:17:41.378310    2581 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController
May 26 15:17:41.384214 ip-10-0-140-164 kubenswrapper[2581]: W0526 15:17:41.378313    2581 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
May 26 15:17:41.384214 ip-10-0-140-164 kubenswrapper[2581]: W0526 15:17:41.378318    2581 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations
May 26 15:17:41.384214 ip-10-0-140-164 kubenswrapper[2581]: W0526 15:17:41.378322    2581 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
May 26 15:17:41.384214 ip-10-0-140-164 kubenswrapper[2581]: W0526 15:17:41.378327    2581 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
May 26 15:17:41.384214 ip-10-0-140-164 kubenswrapper[2581]: W0526 15:17:41.378330    2581 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
May 26 15:17:41.384214 ip-10-0-140-164 kubenswrapper[2581]: W0526 15:17:41.378333    2581 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
May 26 15:17:41.384214 ip-10-0-140-164 kubenswrapper[2581]: W0526 15:17:41.378336    2581 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
May 26 15:17:41.384214 ip-10-0-140-164 kubenswrapper[2581]: W0526 15:17:41.378338    2581 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
May 26 15:17:41.384214 ip-10-0-140-164 kubenswrapper[2581]: W0526 15:17:41.378341    2581 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
May 26 15:17:41.384214 ip-10-0-140-164 kubenswrapper[2581]: W0526 15:17:41.378343    2581 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI
May 26 15:17:41.384214 ip-10-0-140-164 kubenswrapper[2581]: W0526 15:17:41.378346    2581 feature_gate.go:328] unrecognized feature gate: SignatureStores
May 26 15:17:41.384214 ip-10-0-140-164 kubenswrapper[2581]: W0526 15:17:41.378349    2581 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
May 26 15:17:41.384214 ip-10-0-140-164 kubenswrapper[2581]: W0526 15:17:41.378352    2581 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
May 26 15:17:41.384214 ip-10-0-140-164 kubenswrapper[2581]: W0526 15:17:41.378354    2581 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
May 26 15:17:41.384214 ip-10-0-140-164 kubenswrapper[2581]: W0526 15:17:41.378357    2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
May 26 15:17:41.384214 ip-10-0-140-164 kubenswrapper[2581]: W0526 15:17:41.378359    2581 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
May 26 15:17:41.384745 ip-10-0-140-164 kubenswrapper[2581]: W0526 15:17:41.378361    2581 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
May 26 15:17:41.384745 ip-10-0-140-164 kubenswrapper[2581]: W0526 15:17:41.378364    2581 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
May 26 15:17:41.384745 ip-10-0-140-164 kubenswrapper[2581]: W0526 15:17:41.378366    2581 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
May 26 15:17:41.384745 ip-10-0-140-164 kubenswrapper[2581]: W0526 15:17:41.378369    2581 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
May 26 15:17:41.384745 ip-10-0-140-164 kubenswrapper[2581]: W0526 15:17:41.378372    2581 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
May 26 15:17:41.384745 ip-10-0-140-164 kubenswrapper[2581]: W0526 15:17:41.378374    2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
May 26 15:17:41.384745 ip-10-0-140-164 kubenswrapper[2581]: W0526 15:17:41.378377    2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
May 26 15:17:41.384745 ip-10-0-140-164 kubenswrapper[2581]: W0526 15:17:41.378379    2581 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
May 26 15:17:41.384745 ip-10-0-140-164 kubenswrapper[2581]: W0526 15:17:41.378381    2581 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
May 26 15:17:41.384745 ip-10-0-140-164 kubenswrapper[2581]: W0526 15:17:41.378384    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
May 26 15:17:41.384745 ip-10-0-140-164 kubenswrapper[2581]: W0526 15:17:41.378386    2581 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
May 26 15:17:41.384745 ip-10-0-140-164 kubenswrapper[2581]: W0526 15:17:41.378389    2581 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
May 26 15:17:41.384745 ip-10-0-140-164 kubenswrapper[2581]: W0526 15:17:41.378391    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
May 26 15:17:41.384745 ip-10-0-140-164 kubenswrapper[2581]: W0526 15:17:41.378394    2581 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
May 26 15:17:41.384745 ip-10-0-140-164 kubenswrapper[2581]: W0526 15:17:41.378396    2581 feature_gate.go:328] unrecognized feature gate: PinnedImages
May 26 15:17:41.384745 ip-10-0-140-164 kubenswrapper[2581]: W0526 15:17:41.378398    2581 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
May 26 15:17:41.384745 ip-10-0-140-164 kubenswrapper[2581]: W0526 15:17:41.378401    2581 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
May 26 15:17:41.384745 ip-10-0-140-164 kubenswrapper[2581]: W0526 15:17:41.378404    2581 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
May 26 15:17:41.384745 ip-10-0-140-164 kubenswrapper[2581]: W0526 15:17:41.378407    2581 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
May 26 15:17:41.384745 ip-10-0-140-164 kubenswrapper[2581]: W0526 15:17:41.378410    2581 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
May 26 15:17:41.385335 ip-10-0-140-164 kubenswrapper[2581]: W0526 15:17:41.378412    2581 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
May 26 15:17:41.385335 ip-10-0-140-164 kubenswrapper[2581]: W0526 15:17:41.378415    2581 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
May 26 15:17:41.385335 ip-10-0-140-164 kubenswrapper[2581]: W0526 15:17:41.378417    2581 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS
May 26 15:17:41.385335 ip-10-0-140-164 kubenswrapper[2581]: W0526 15:17:41.378419    2581 feature_gate.go:328] unrecognized feature gate: NewOLM
May 26 15:17:41.385335 ip-10-0-140-164 kubenswrapper[2581]: W0526 15:17:41.378422    2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
May 26 15:17:41.385335 ip-10-0-140-164 kubenswrapper[2581]: W0526 15:17:41.378424    2581 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
May 26 15:17:41.385335 ip-10-0-140-164 kubenswrapper[2581]: W0526 15:17:41.378426    2581 feature_gate.go:328] unrecognized feature gate: DualReplica
May 26 15:17:41.385335 ip-10-0-140-164 kubenswrapper[2581]: W0526 15:17:41.378430    2581 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
May 26 15:17:41.385335 ip-10-0-140-164 kubenswrapper[2581]: W0526 15:17:41.378434    2581 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
May 26 15:17:41.385335 ip-10-0-140-164 kubenswrapper[2581]: W0526 15:17:41.378436    2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
May 26 15:17:41.385335 ip-10-0-140-164 kubenswrapper[2581]: W0526 15:17:41.378439    2581 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
May 26 15:17:41.385335 ip-10-0-140-164 kubenswrapper[2581]: W0526 15:17:41.378441    2581 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
May 26 15:17:41.385335 ip-10-0-140-164 kubenswrapper[2581]: W0526 15:17:41.378444    2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
May 26 15:17:41.385335 ip-10-0-140-164 kubenswrapper[2581]: W0526 15:17:41.378446    2581 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
May 26 15:17:41.385335 ip-10-0-140-164 kubenswrapper[2581]: W0526 15:17:41.378448    2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
May 26 15:17:41.385335 ip-10-0-140-164 kubenswrapper[2581]: W0526 15:17:41.378451    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
May 26 15:17:41.385335 ip-10-0-140-164 kubenswrapper[2581]: W0526 15:17:41.378453    2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
May 26 15:17:41.385335 ip-10-0-140-164 kubenswrapper[2581]: W0526 15:17:41.378456    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
May 26 15:17:41.385335 ip-10-0-140-164 kubenswrapper[2581]: W0526 15:17:41.378458    2581 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
May 26 15:17:41.386096 ip-10-0-140-164 kubenswrapper[2581]: W0526 15:17:41.378460    2581 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
May 26 15:17:41.386096 ip-10-0-140-164 kubenswrapper[2581]: W0526 15:17:41.378463    2581 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
May 26 15:17:41.386096 ip-10-0-140-164 kubenswrapper[2581]: W0526 15:17:41.378465    2581 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
May 26 15:17:41.386096 ip-10-0-140-164 kubenswrapper[2581]: W0526 15:17:41.378468    2581 feature_gate.go:328] unrecognized feature gate: GatewayAPI
May 26 15:17:41.386096 ip-10-0-140-164 kubenswrapper[2581]: W0526 15:17:41.378470    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
May 26 15:17:41.386096 ip-10-0-140-164 kubenswrapper[2581]: W0526 15:17:41.378472    2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
May 26 15:17:41.386096 ip-10-0-140-164 kubenswrapper[2581]: W0526 15:17:41.378475    2581 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
May 26 15:17:41.386096 ip-10-0-140-164 kubenswrapper[2581]: W0526 15:17:41.378478    2581 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
May 26 15:17:41.386096 ip-10-0-140-164 kubenswrapper[2581]: W0526 15:17:41.378480    2581 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
May 26 15:17:41.386096 ip-10-0-140-164 kubenswrapper[2581]: W0526 15:17:41.378482    2581 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
May 26 15:17:41.386096 ip-10-0-140-164 kubenswrapper[2581]: W0526 15:17:41.378486    2581 feature_gate.go:328] unrecognized feature gate: InsightsConfig
May 26 15:17:41.386096 ip-10-0-140-164 kubenswrapper[2581]: W0526 15:17:41.378488    2581 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
May 26 15:17:41.386096 ip-10-0-140-164 kubenswrapper[2581]: W0526 15:17:41.378491    2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
May 26 15:17:41.386096 ip-10-0-140-164 kubenswrapper[2581]: W0526 15:17:41.378494    2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
May 26 15:17:41.386096 ip-10-0-140-164 kubenswrapper[2581]: W0526 15:17:41.378496    2581 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
May 26 15:17:41.386096 ip-10-0-140-164 kubenswrapper[2581]: W0526 15:17:41.378499    2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
May 26 15:17:41.386096 ip-10-0-140-164 kubenswrapper[2581]: W0526 15:17:41.378501    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
May 26 15:17:41.386096 ip-10-0-140-164 kubenswrapper[2581]: W0526 15:17:41.378504    2581 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
May 26 15:17:41.386096 ip-10-0-140-164 kubenswrapper[2581]: W0526 15:17:41.378506    2581 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
May 26 15:17:41.386096 ip-10-0-140-164 kubenswrapper[2581]: W0526 15:17:41.378508    2581 feature_gate.go:328] unrecognized feature gate: Example2
May 26 15:17:41.386710 ip-10-0-140-164 kubenswrapper[2581]: W0526 15:17:41.378511    2581 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
May 26 15:17:41.386710 ip-10-0-140-164 kubenswrapper[2581]: W0526 15:17:41.378513    2581 feature_gate.go:328] unrecognized feature gate: OVNObservability
May 26 15:17:41.386710 ip-10-0-140-164 kubenswrapper[2581]: W0526 15:17:41.378515    2581 feature_gate.go:328] unrecognized feature gate: Example
May 26 15:17:41.386710 ip-10-0-140-164 kubenswrapper[2581]: W0526 15:17:41.378518    2581 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
May 26 15:17:41.386710 ip-10-0-140-164 kubenswrapper[2581]: W0526 15:17:41.378520    2581 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
May 26 15:17:41.386710 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:17:41.379154    2581 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]}
May 26 15:17:41.387647 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:17:41.387629    2581 server.go:530] "Kubelet version" kubeletVersion="v1.33.11"
May 26 15:17:41.387679 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:17:41.387648    2581 server.go:532] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
May 26 15:17:41.387713 ip-10-0-140-164 kubenswrapper[2581]: W0526 15:17:41.387696    2581 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
May 26 15:17:41.387713 ip-10-0-140-164 kubenswrapper[2581]: W0526 15:17:41.387701    2581 feature_gate.go:328] unrecognized feature gate: Example
May 26 15:17:41.387713 ip-10-0-140-164 kubenswrapper[2581]: W0526 15:17:41.387704    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
May 26 15:17:41.387713 ip-10-0-140-164 kubenswrapper[2581]: W0526 15:17:41.387707    2581 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
May 26 15:17:41.387713 ip-10-0-140-164 kubenswrapper[2581]: W0526 15:17:41.387709    2581 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
May 26 15:17:41.387713 ip-10-0-140-164 kubenswrapper[2581]: W0526 15:17:41.387712    2581 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
May 26 15:17:41.387713 ip-10-0-140-164 kubenswrapper[2581]: W0526 15:17:41.387715    2581 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
May 26 15:17:41.387935 ip-10-0-140-164 kubenswrapper[2581]: W0526 15:17:41.387718    2581 feature_gate.go:328] unrecognized feature gate: SignatureStores
May 26 15:17:41.387935 ip-10-0-140-164 kubenswrapper[2581]: W0526 15:17:41.387721    2581 feature_gate.go:328] unrecognized feature gate: InsightsConfig
May 26 15:17:41.387935 ip-10-0-140-164 kubenswrapper[2581]: W0526 15:17:41.387723    2581 feature_gate.go:328] unrecognized feature gate: GatewayAPI
May 26 15:17:41.387935 ip-10-0-140-164 kubenswrapper[2581]: W0526 15:17:41.387726    2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
May 26 15:17:41.387935 ip-10-0-140-164 kubenswrapper[2581]: W0526 15:17:41.387728    2581 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
May 26 15:17:41.387935 ip-10-0-140-164 kubenswrapper[2581]: W0526 15:17:41.387731    2581 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
May 26 15:17:41.387935 ip-10-0-140-164 kubenswrapper[2581]: W0526 15:17:41.387733    2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
May 26 15:17:41.387935 ip-10-0-140-164 kubenswrapper[2581]: W0526 15:17:41.387736    2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
May 26 15:17:41.387935 ip-10-0-140-164 kubenswrapper[2581]: W0526 15:17:41.387739    2581 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
May 26 15:17:41.387935 ip-10-0-140-164 kubenswrapper[2581]: W0526 15:17:41.387746    2581 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
May 26 15:17:41.387935 ip-10-0-140-164 kubenswrapper[2581]: W0526 15:17:41.387749    2581 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI
May 26 15:17:41.387935 ip-10-0-140-164 kubenswrapper[2581]: W0526 15:17:41.387751    2581 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController
May 26 15:17:41.387935 ip-10-0-140-164 kubenswrapper[2581]: W0526 15:17:41.387754    2581 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
May 26 15:17:41.387935 ip-10-0-140-164 kubenswrapper[2581]: W0526 15:17:41.387756    2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
May 26 15:17:41.387935 ip-10-0-140-164 kubenswrapper[2581]: W0526 15:17:41.387759    2581 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
May 26 15:17:41.387935 ip-10-0-140-164 kubenswrapper[2581]: W0526 15:17:41.387761    2581 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
May 26 15:17:41.387935 ip-10-0-140-164 kubenswrapper[2581]: W0526 15:17:41.387763    2581 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
May 26 15:17:41.387935 ip-10-0-140-164 kubenswrapper[2581]: W0526 15:17:41.387766    2581 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
May 26 15:17:41.387935 ip-10-0-140-164 kubenswrapper[2581]: W0526 15:17:41.387768    2581 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
May 26 15:17:41.387935 ip-10-0-140-164 kubenswrapper[2581]: W0526 15:17:41.387770    2581 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
May 26 15:17:41.388431 ip-10-0-140-164 kubenswrapper[2581]: W0526 15:17:41.387773    2581 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
May 26 15:17:41.388431 ip-10-0-140-164 kubenswrapper[2581]: W0526 15:17:41.387775    2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
May 26 15:17:41.388431 ip-10-0-140-164 kubenswrapper[2581]: W0526 15:17:41.387778    2581 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
May 26 15:17:41.388431 ip-10-0-140-164 kubenswrapper[2581]: W0526 15:17:41.387781    2581 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
May 26 15:17:41.388431 ip-10-0-140-164 kubenswrapper[2581]: W0526 15:17:41.387785    2581 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
May 26 15:17:41.388431 ip-10-0-140-164 kubenswrapper[2581]: W0526 15:17:41.387788    2581 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
May 26 15:17:41.388431 ip-10-0-140-164 kubenswrapper[2581]: W0526 15:17:41.387791    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
May 26 15:17:41.388431 ip-10-0-140-164 kubenswrapper[2581]: W0526 15:17:41.387794    2581 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
May 26 15:17:41.388431 ip-10-0-140-164 kubenswrapper[2581]: W0526 15:17:41.387796    2581 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
May 26 15:17:41.388431 ip-10-0-140-164 kubenswrapper[2581]: W0526 15:17:41.387799    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
May 26 15:17:41.388431 ip-10-0-140-164 kubenswrapper[2581]: W0526 15:17:41.387801    2581 feature_gate.go:328] unrecognized feature gate: NewOLM
May 26 15:17:41.388431 ip-10-0-140-164 kubenswrapper[2581]: W0526 15:17:41.387804    2581 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
May 26 15:17:41.388431 ip-10-0-140-164 kubenswrapper[2581]: W0526 15:17:41.387806    2581 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
May 26 15:17:41.388431 ip-10-0-140-164 kubenswrapper[2581]: W0526 15:17:41.387810    2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
May 26 15:17:41.388431 ip-10-0-140-164 kubenswrapper[2581]: W0526 15:17:41.387812    2581 feature_gate.go:328] unrecognized feature gate: DualReplica
May 26 15:17:41.388431 ip-10-0-140-164 kubenswrapper[2581]: W0526 15:17:41.387815    2581 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
May 26 15:17:41.388431 ip-10-0-140-164 kubenswrapper[2581]: W0526 15:17:41.387818    2581 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations
May 26 15:17:41.388431 ip-10-0-140-164 kubenswrapper[2581]: W0526 15:17:41.387820    2581 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
May 26 15:17:41.388431 ip-10-0-140-164 kubenswrapper[2581]: W0526 15:17:41.387823    2581 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS
May 26 15:17:41.388431 ip-10-0-140-164 kubenswrapper[2581]: W0526 15:17:41.387825    2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
May 26 15:17:41.388916 ip-10-0-140-164 kubenswrapper[2581]: W0526 15:17:41.387828    2581 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
May 26 15:17:41.388916 ip-10-0-140-164 kubenswrapper[2581]: W0526 15:17:41.387830    2581 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
May 26 15:17:41.388916 ip-10-0-140-164 kubenswrapper[2581]: W0526 15:17:41.387833    2581 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
May 26 15:17:41.388916 ip-10-0-140-164 kubenswrapper[2581]: W0526 15:17:41.387835    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
May 26 15:17:41.388916 ip-10-0-140-164 kubenswrapper[2581]: W0526 15:17:41.387837    2581 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
May 26 15:17:41.388916 ip-10-0-140-164 kubenswrapper[2581]: W0526 15:17:41.387840    2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
May 26 15:17:41.388916 ip-10-0-140-164 kubenswrapper[2581]: W0526 15:17:41.387842    2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
May 26 15:17:41.388916 ip-10-0-140-164 kubenswrapper[2581]: W0526 15:17:41.387844    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
May 26 15:17:41.388916 ip-10-0-140-164 kubenswrapper[2581]: W0526 15:17:41.387847    2581 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
May 26 15:17:41.388916 ip-10-0-140-164 kubenswrapper[2581]: W0526 15:17:41.387850    2581 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
May 26 15:17:41.388916 ip-10-0-140-164 kubenswrapper[2581]: W0526 15:17:41.387852    2581 feature_gate.go:328] unrecognized feature gate: OVNObservability
May 26 15:17:41.388916 ip-10-0-140-164 kubenswrapper[2581]: W0526 15:17:41.387855    2581 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
May 26 15:17:41.388916 ip-10-0-140-164 kubenswrapper[2581]: W0526 15:17:41.387857    2581 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
May 26 15:17:41.388916 ip-10-0-140-164 kubenswrapper[2581]: W0526 15:17:41.387859    2581 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
May 26 15:17:41.388916 ip-10-0-140-164 kubenswrapper[2581]: W0526 15:17:41.387862    2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
May 26 15:17:41.388916 ip-10-0-140-164 kubenswrapper[2581]: W0526 15:17:41.387864    2581 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
May 26 15:17:41.388916 ip-10-0-140-164 kubenswrapper[2581]: W0526 15:17:41.387867    2581 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
May 26 15:17:41.388916 ip-10-0-140-164 kubenswrapper[2581]: W0526 15:17:41.387869    2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
May 26 15:17:41.388916 ip-10-0-140-164 kubenswrapper[2581]: W0526 15:17:41.387871    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
May 26 15:17:41.389383 ip-10-0-140-164 kubenswrapper[2581]: W0526 15:17:41.387874    2581 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
May 26 15:17:41.389383 ip-10-0-140-164 kubenswrapper[2581]: W0526 15:17:41.387876    2581 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
May 26 15:17:41.389383 ip-10-0-140-164 kubenswrapper[2581]: W0526 15:17:41.387879    2581 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
May 26 15:17:41.389383 ip-10-0-140-164 kubenswrapper[2581]: W0526 15:17:41.387881    2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
May 26 15:17:41.389383 ip-10-0-140-164 kubenswrapper[2581]: W0526 15:17:41.387883    2581 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
May 26 15:17:41.389383 ip-10-0-140-164 kubenswrapper[2581]: W0526 15:17:41.387886    2581 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
May 26 15:17:41.389383 ip-10-0-140-164 kubenswrapper[2581]: W0526 15:17:41.387889    2581 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
May 26 15:17:41.389383 ip-10-0-140-164 kubenswrapper[2581]: W0526 15:17:41.387892    2581 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
May 26 15:17:41.389383 ip-10-0-140-164 kubenswrapper[2581]: W0526 15:17:41.387896    2581 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
May 26 15:17:41.389383 ip-10-0-140-164 kubenswrapper[2581]: W0526 15:17:41.387901    2581 feature_gate.go:328] unrecognized feature gate: PinnedImages
May 26 15:17:41.389383 ip-10-0-140-164 kubenswrapper[2581]: W0526 15:17:41.387907    2581 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
May 26 15:17:41.389383 ip-10-0-140-164 kubenswrapper[2581]: W0526 15:17:41.387910    2581 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
May 26 15:17:41.389383 ip-10-0-140-164 kubenswrapper[2581]: W0526 15:17:41.387913    2581 feature_gate.go:328] unrecognized feature gate: Example2
May 26 15:17:41.389383 ip-10-0-140-164 kubenswrapper[2581]: W0526 15:17:41.387916    2581 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
May 26 15:17:41.389383 ip-10-0-140-164 kubenswrapper[2581]: W0526 15:17:41.387919    2581 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
May 26 15:17:41.389383 ip-10-0-140-164 kubenswrapper[2581]: W0526 15:17:41.387922    2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
May 26 15:17:41.389383 ip-10-0-140-164 kubenswrapper[2581]: W0526 15:17:41.387925    2581 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
May 26 15:17:41.389383 ip-10-0-140-164 kubenswrapper[2581]: W0526 15:17:41.387927    2581 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
May 26 15:17:41.389383 ip-10-0-140-164 kubenswrapper[2581]: W0526 15:17:41.387930    2581 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
May 26 15:17:41.389839 ip-10-0-140-164 kubenswrapper[2581]: W0526 15:17:41.387932    2581 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
May 26 15:17:41.389839 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:17:41.387938    2581 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]}
May 26 15:17:41.389839 ip-10-0-140-164 kubenswrapper[2581]: W0526 15:17:41.388036    2581 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
May 26 15:17:41.389839 ip-10-0-140-164 kubenswrapper[2581]: W0526 15:17:41.388041    2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
May 26 15:17:41.389839 ip-10-0-140-164 kubenswrapper[2581]: W0526 15:17:41.388044    2581 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
May 26 15:17:41.389839 ip-10-0-140-164 kubenswrapper[2581]: W0526 15:17:41.388046    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
May 26 15:17:41.389839 ip-10-0-140-164 kubenswrapper[2581]: W0526 15:17:41.388049    2581 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
May 26 15:17:41.389839 ip-10-0-140-164 kubenswrapper[2581]: W0526 15:17:41.388051    2581 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
May 26 15:17:41.389839 ip-10-0-140-164 kubenswrapper[2581]: W0526 15:17:41.388054    2581 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
May 26 15:17:41.389839 ip-10-0-140-164 kubenswrapper[2581]: W0526 15:17:41.388057    2581 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
May 26 15:17:41.389839 ip-10-0-140-164 kubenswrapper[2581]: W0526 15:17:41.388060    2581 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
May 26 15:17:41.389839 ip-10-0-140-164 kubenswrapper[2581]: W0526 15:17:41.388063    2581 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
May 26 15:17:41.389839 ip-10-0-140-164 kubenswrapper[2581]: W0526 15:17:41.388065    2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
May 26 15:17:41.389839 ip-10-0-140-164 kubenswrapper[2581]: W0526 15:17:41.388067    2581 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI
May 26 15:17:41.389839 ip-10-0-140-164 kubenswrapper[2581]: W0526 15:17:41.388070    2581 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations
May 26 15:17:41.389839 ip-10-0-140-164 kubenswrapper[2581]: W0526 15:17:41.388072    2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
May 26 15:17:41.390220 ip-10-0-140-164 kubenswrapper[2581]: W0526 15:17:41.388074    2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
May 26 15:17:41.390220 ip-10-0-140-164 kubenswrapper[2581]: W0526 15:17:41.388077    2581 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
May 26 15:17:41.390220 ip-10-0-140-164 kubenswrapper[2581]: W0526 15:17:41.388079    2581 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
May 26 15:17:41.390220 ip-10-0-140-164 kubenswrapper[2581]: W0526 15:17:41.388082    2581 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS
May 26 15:17:41.390220 ip-10-0-140-164 kubenswrapper[2581]: W0526 15:17:41.388085    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
May 26 15:17:41.390220 ip-10-0-140-164 kubenswrapper[2581]: W0526 15:17:41.388087    2581 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
May 26 15:17:41.390220 ip-10-0-140-164 kubenswrapper[2581]: W0526 15:17:41.388089    2581 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
May 26 15:17:41.390220 ip-10-0-140-164 kubenswrapper[2581]: W0526 15:17:41.388092    2581 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
May 26 15:17:41.390220 ip-10-0-140-164 kubenswrapper[2581]: W0526 15:17:41.388095    2581 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
May 26 15:17:41.390220 ip-10-0-140-164 kubenswrapper[2581]: W0526 15:17:41.388098    2581 feature_gate.go:328] unrecognized feature gate: PinnedImages
May 26 15:17:41.390220 ip-10-0-140-164 kubenswrapper[2581]: W0526 15:17:41.388100    2581 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
May 26 15:17:41.390220 ip-10-0-140-164 kubenswrapper[2581]: W0526 15:17:41.388102    2581 feature_gate.go:328] unrecognized feature gate: GatewayAPI
May 26 15:17:41.390220 ip-10-0-140-164 kubenswrapper[2581]: W0526 15:17:41.388105    2581 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
May 26 15:17:41.390220 ip-10-0-140-164 kubenswrapper[2581]: W0526 15:17:41.388107    2581 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
May 26 15:17:41.390220 ip-10-0-140-164 kubenswrapper[2581]: W0526 15:17:41.388110    2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
May 26 15:17:41.390220 ip-10-0-140-164 kubenswrapper[2581]: W0526 15:17:41.388112    2581 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
May 26 15:17:41.390220 ip-10-0-140-164 kubenswrapper[2581]: W0526 15:17:41.388115    2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
May 26 15:17:41.390220 ip-10-0-140-164 kubenswrapper[2581]: W0526 15:17:41.388117    2581 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
May 26 15:17:41.390220 ip-10-0-140-164 kubenswrapper[2581]: W0526 15:17:41.388119    2581 feature_gate.go:328] unrecognized feature gate: NewOLM
May 26 15:17:41.390220 ip-10-0-140-164 kubenswrapper[2581]: W0526 15:17:41.388122    2581 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
May 26 15:17:41.390721 ip-10-0-140-164 kubenswrapper[2581]: W0526 15:17:41.388124    2581 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
May 26 15:17:41.390721 ip-10-0-140-164 kubenswrapper[2581]: W0526 15:17:41.388127    2581 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
May 26 15:17:41.390721 ip-10-0-140-164 kubenswrapper[2581]: W0526 15:17:41.388129    2581 feature_gate.go:328] unrecognized feature gate: InsightsConfig
May 26 15:17:41.390721 ip-10-0-140-164 kubenswrapper[2581]: W0526 15:17:41.388131    2581 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
May 26 15:17:41.390721 ip-10-0-140-164 kubenswrapper[2581]: W0526 15:17:41.388133    2581 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
May 26 15:17:41.390721 ip-10-0-140-164 kubenswrapper[2581]: W0526 15:17:41.388136    2581 feature_gate.go:328] unrecognized feature gate: Example2
May 26 15:17:41.390721 ip-10-0-140-164 kubenswrapper[2581]: W0526 15:17:41.388138    2581 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
May 26 15:17:41.390721 ip-10-0-140-164 kubenswrapper[2581]: W0526 15:17:41.388141    2581 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
May 26 15:17:41.390721 ip-10-0-140-164 kubenswrapper[2581]: W0526 15:17:41.388143    2581 feature_gate.go:328] unrecognized feature gate: SignatureStores
May 26 15:17:41.390721 ip-10-0-140-164 kubenswrapper[2581]: W0526 15:17:41.388145    2581 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
May 26 15:17:41.390721 ip-10-0-140-164 kubenswrapper[2581]: W0526 15:17:41.388147    2581 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
May 26 15:17:41.390721 ip-10-0-140-164 kubenswrapper[2581]: W0526 15:17:41.388150    2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
May 26 15:17:41.390721 ip-10-0-140-164 kubenswrapper[2581]: W0526 15:17:41.388152    2581 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
May 26 15:17:41.390721 ip-10-0-140-164 kubenswrapper[2581]: W0526 15:17:41.388154    2581 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
May 26 15:17:41.390721 ip-10-0-140-164 kubenswrapper[2581]: W0526 15:17:41.388156    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
May 26 15:17:41.390721 ip-10-0-140-164 kubenswrapper[2581]: W0526 15:17:41.388159    2581 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
May 26 15:17:41.390721 ip-10-0-140-164 kubenswrapper[2581]: W0526 15:17:41.388162    2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
May 26 15:17:41.390721 ip-10-0-140-164 kubenswrapper[2581]: W0526 15:17:41.388165    2581 feature_gate.go:328] unrecognized feature gate: Example
May 26 15:17:41.390721 ip-10-0-140-164 kubenswrapper[2581]: W0526 15:17:41.388167    2581 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
May 26 15:17:41.390721 ip-10-0-140-164 kubenswrapper[2581]: W0526 15:17:41.388170    2581 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
May 26 15:17:41.391196 ip-10-0-140-164 kubenswrapper[2581]: W0526 15:17:41.388172    2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
May 26 15:17:41.391196 ip-10-0-140-164 kubenswrapper[2581]: W0526 15:17:41.388175    2581 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
May 26 15:17:41.391196 ip-10-0-140-164 kubenswrapper[2581]: W0526 15:17:41.388178    2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
May 26 15:17:41.391196 ip-10-0-140-164 kubenswrapper[2581]: W0526 15:17:41.388180    2581 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
May 26 15:17:41.391196 ip-10-0-140-164 kubenswrapper[2581]: W0526 15:17:41.388184    2581 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
May 26 15:17:41.391196 ip-10-0-140-164 kubenswrapper[2581]: W0526 15:17:41.388187    2581 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
May 26 15:17:41.391196 ip-10-0-140-164 kubenswrapper[2581]: W0526 15:17:41.388189    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
May 26 15:17:41.391196 ip-10-0-140-164 kubenswrapper[2581]: W0526 15:17:41.388192    2581 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
May 26 15:17:41.391196 ip-10-0-140-164 kubenswrapper[2581]: W0526 15:17:41.388195    2581 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
May 26 15:17:41.391196 ip-10-0-140-164 kubenswrapper[2581]: W0526 15:17:41.388198    2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
May 26 15:17:41.391196 ip-10-0-140-164 kubenswrapper[2581]: W0526 15:17:41.388200    2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
May 26 15:17:41.391196 ip-10-0-140-164 kubenswrapper[2581]: W0526 15:17:41.388202    2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
May 26 15:17:41.391196 ip-10-0-140-164 kubenswrapper[2581]: W0526 15:17:41.388205    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
May 26 15:17:41.391196 ip-10-0-140-164 kubenswrapper[2581]: W0526 15:17:41.388207    2581 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
May 26 15:17:41.391196 ip-10-0-140-164 kubenswrapper[2581]: W0526 15:17:41.388209    2581 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
May 26 15:17:41.391196 ip-10-0-140-164 kubenswrapper[2581]: W0526 15:17:41.388212    2581 feature_gate.go:328] unrecognized feature gate: OVNObservability
May 26 15:17:41.391196 ip-10-0-140-164 kubenswrapper[2581]: W0526 15:17:41.388214    2581 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
May 26 15:17:41.391196 ip-10-0-140-164 kubenswrapper[2581]: W0526 15:17:41.388217    2581 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
May 26 15:17:41.391196 ip-10-0-140-164 kubenswrapper[2581]: W0526 15:17:41.388220    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
May 26 15:17:41.391673 ip-10-0-140-164 kubenswrapper[2581]: W0526 15:17:41.388222    2581 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
May 26 15:17:41.391673 ip-10-0-140-164 kubenswrapper[2581]: W0526 15:17:41.388225    2581 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
May 26 15:17:41.391673 ip-10-0-140-164 kubenswrapper[2581]: W0526 15:17:41.388227    2581 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
May 26 15:17:41.391673 ip-10-0-140-164 kubenswrapper[2581]: W0526 15:17:41.388230    2581 feature_gate.go:328] unrecognized feature gate: DualReplica
May 26 15:17:41.391673 ip-10-0-140-164 kubenswrapper[2581]: W0526 15:17:41.388232    2581 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
May 26 15:17:41.391673 ip-10-0-140-164 kubenswrapper[2581]: W0526 15:17:41.388234    2581 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController
May 26 15:17:41.391673 ip-10-0-140-164 kubenswrapper[2581]: W0526 15:17:41.388237    2581 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
May 26 15:17:41.391673 ip-10-0-140-164 kubenswrapper[2581]: W0526 15:17:41.388239    2581 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
May 26 15:17:41.391673 ip-10-0-140-164 kubenswrapper[2581]: W0526 15:17:41.388241    2581 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
May 26 15:17:41.391673 ip-10-0-140-164 kubenswrapper[2581]: W0526 15:17:41.388244    2581 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
May 26 15:17:41.391673 ip-10-0-140-164 kubenswrapper[2581]: W0526 15:17:41.388246    2581 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
May 26 15:17:41.391673 ip-10-0-140-164 kubenswrapper[2581]: W0526 15:17:41.388249    2581 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
May 26 15:17:41.391673 ip-10-0-140-164 kubenswrapper[2581]: W0526 15:17:41.388251    2581 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
May 26 15:17:41.391673 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:17:41.388256    2581 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]}
May 26 15:17:41.391673 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:17:41.388370    2581 server.go:962] "Client rotation is on, will bootstrap in background"
May 26 15:17:41.393951 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:17:41.393938    2581 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
May 26 15:17:41.394893 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:17:41.394882    2581 server.go:1019] "Starting client certificate rotation"
May 26 15:17:41.394992 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:17:41.394975    2581 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
May 26 15:17:41.395022 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:17:41.395008    2581 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
May 26 15:17:41.424907 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:17:41.424891    2581 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
May 26 15:17:41.431673 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:17:41.431659    2581 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
May 26 15:17:41.446784 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:17:41.446766    2581 log.go:25] "Validated CRI v1 runtime API"
May 26 15:17:41.452911 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:17:41.452897    2581 log.go:25] "Validated CRI v1 image API"
May 26 15:17:41.454149 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:17:41.454137    2581 server.go:1452] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
May 26 15:17:41.456452 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:17:41.456434    2581 fs.go:135] Filesystem UUIDs: map[074a3730-f03a-4b75-a46a-9f3355e3ed5c:/dev/nvme0n1p3 54ccd8f2-db7e-466b-aa69-8e5108be8004:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2]
May 26 15:17:41.456507 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:17:41.456453    2581 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
May 26 15:17:41.463687 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:17:41.463557    2581 manager.go:217] Machine: {Timestamp:2026-05-26 15:17:41.463060524 +0000 UTC m=+0.460763848 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3099650 MemoryCapacity:32812179456 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec259d4ad5379286a1669bd012f5425c SystemUUID:ec259d4a-d537-9286-a166-9bd012f5425c BootID:71c8f475-2bb2-4bb0-8ee1-c16017248524 Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16406089728 Type:vfs Inodes:4005393 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6562439168 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6103040 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16406089728 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:7f:24:87:77:43 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:7f:24:87:77:43 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:96:ff:9c:b3:8b:92 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:32812179456 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:34603008 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
May 26 15:17:41.464423 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:17:41.464408    2581 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
May 26 15:17:41.464582 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:17:41.464510    2581 manager.go:233] Version: {KernelVersion:5.14.0-570.114.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260512-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
May 26 15:17:41.464582 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:17:41.464569    2581 reflector.go:430] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
May 26 15:17:41.467651 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:17:41.467627    2581 container_manager_linux.go:270] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
May 26 15:17:41.467786 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:17:41.467655    2581 container_manager_linux.go:275] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-140-164.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
May 26 15:17:41.467841 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:17:41.467796    2581 topology_manager.go:138] "Creating topology manager with none policy"
May 26 15:17:41.467841 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:17:41.467804    2581 container_manager_linux.go:306] "Creating device plugin manager"
May 26 15:17:41.467841 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:17:41.467811    2581 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
May 26 15:17:41.468458 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:17:41.468448    2581 server.go:72] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
May 26 15:17:41.469765 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:17:41.469756    2581 state_mem.go:36] "Initialized new in-memory state store"
May 26 15:17:41.469868 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:17:41.469860    2581 server.go:1267] "Using root directory" path="/var/lib/kubelet"
May 26 15:17:41.472494 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:17:41.472484    2581 kubelet.go:491] "Attempting to sync node with API server"
May 26 15:17:41.472538 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:17:41.472501    2581 kubelet.go:386] "Adding static pod path" path="/etc/kubernetes/manifests"
May 26 15:17:41.472538 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:17:41.472512    2581 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
May 26 15:17:41.472538 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:17:41.472520    2581 kubelet.go:397] "Adding apiserver pod source"
May 26 15:17:41.472538 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:17:41.472529    2581 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
May 26 15:17:41.473470 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:17:41.473456    2581 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
May 26 15:17:41.473549 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:17:41.473474    2581 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
May 26 15:17:41.477215 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:17:41.477194    2581 kuberuntime_manager.go:279] "Container runtime initialized" containerRuntime="cri-o" version="1.33.11-2.rhaos4.20.gitb2a8320.el9" apiVersion="v1"
May 26 15:17:41.478904 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:17:41.478892    2581 kubelet.go:953] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
May 26 15:17:41.479681 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:17:41.479669    2581 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
May 26 15:17:41.479730 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:17:41.479686    2581 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
May 26 15:17:41.479730 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:17:41.479692    2581 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
May 26 15:17:41.479730 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:17:41.479698    2581 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
May 26 15:17:41.479730 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:17:41.479706    2581 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
May 26 15:17:41.479730 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:17:41.479712    2581 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/secret"
May 26 15:17:41.479730 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:17:41.479717    2581 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
May 26 15:17:41.479730 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:17:41.479723    2581 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
May 26 15:17:41.479730 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:17:41.479730    2581 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/fc"
May 26 15:17:41.480137 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:17:41.479736    2581 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
May 26 15:17:41.480137 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:17:41.479750    2581 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/projected"
May 26 15:17:41.480137 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:17:41.480112    2581 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
May 26 15:17:41.480796 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:17:41.480784    2581 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/csi"
May 26 15:17:41.480796 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:17:41.480796    2581 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/image"
May 26 15:17:41.484228 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:17:41.484214    2581 watchdog_linux.go:99] "Systemd watchdog is not enabled"
May 26 15:17:41.484326 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:17:41.484252    2581 server.go:1295] "Started kubelet"
May 26 15:17:41.484417 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:17:41.484363    2581 ratelimit.go:55] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
May 26 15:17:41.484464 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:17:41.484412    2581 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
May 26 15:17:41.484464 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:17:41.484441    2581 server_v1.go:47] "podresources" method="list" useActivePods=true
May 26 15:17:41.484858 ip-10-0-140-164 systemd[1]: Started Kubernetes Kubelet.
May 26 15:17:41.485623 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:17:41.485599    2581 server.go:255] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
May 26 15:17:41.486226 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:17:41.485824    2581 server.go:317] "Adding debug handlers to kubelet server"
May 26 15:17:41.486296 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:17:41.486233    2581 csi_plugin.go:988] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-140-164.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
May 26 15:17:41.486332 ip-10-0-140-164 kubenswrapper[2581]: E0526 15:17:41.486293    2581 reflector.go:200] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
May 26 15:17:41.486462 ip-10-0-140-164 kubenswrapper[2581]: E0526 15:17:41.486443    2581 reflector.go:200] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-140-164.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
May 26 15:17:41.493339 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:17:41.493321    2581 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
May 26 15:17:41.493417 ip-10-0-140-164 kubenswrapper[2581]: E0526 15:17:41.491965    2581 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-140-164.ec2.internal.18b3268c3bee4399  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-140-164.ec2.internal,UID:ip-10-0-140-164.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-140-164.ec2.internal,},FirstTimestamp:2026-05-26 15:17:41.484225433 +0000 UTC m=+0.481928756,LastTimestamp:2026-05-26 15:17:41.484225433 +0000 UTC m=+0.481928756,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-140-164.ec2.internal,}"
May 26 15:17:41.493417 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:17:41.493342    2581 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
May 26 15:17:41.493417 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:17:41.493393    2581 volume_manager.go:295] "The desired_state_of_world populator starts"
May 26 15:17:41.493583 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:17:41.493421    2581 volume_manager.go:297] "Starting Kubelet Volume Manager"
May 26 15:17:41.493583 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:17:41.493512    2581 desired_state_of_world_populator.go:150] "Desired state populator starts to run"
May 26 15:17:41.493583 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:17:41.493571    2581 reconstruct.go:97] "Volume reconstruction finished"
May 26 15:17:41.493583 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:17:41.493579    2581 reconciler.go:26] "Reconciler: start to sync state"
May 26 15:17:41.494498 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:17:41.494382    2581 factory.go:153] Registering CRI-O factory
May 26 15:17:41.494498 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:17:41.494399    2581 factory.go:223] Registration of the crio container factory successfully
May 26 15:17:41.494498 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:17:41.494448    2581 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
May 26 15:17:41.494498 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:17:41.494457    2581 factory.go:55] Registering systemd factory
May 26 15:17:41.494498 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:17:41.494465    2581 factory.go:223] Registration of the systemd container factory successfully
May 26 15:17:41.494498 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:17:41.494480    2581 factory.go:103] Registering Raw factory
May 26 15:17:41.494498 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:17:41.494493    2581 manager.go:1196] Started watching for new ooms in manager
May 26 15:17:41.494864 ip-10-0-140-164 kubenswrapper[2581]: E0526 15:17:41.494382    2581 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-140-164.ec2.internal\" not found"
May 26 15:17:41.494954 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:17:41.494937    2581 manager.go:319] Starting recovery of all containers
May 26 15:17:41.495833 ip-10-0-140-164 kubenswrapper[2581]: E0526 15:17:41.495815    2581 kubelet.go:1618] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
May 26 15:17:41.505734 ip-10-0-140-164 kubenswrapper[2581]: E0526 15:17:41.505707    2581 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-140-164.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
May 26 15:17:41.505834 ip-10-0-140-164 kubenswrapper[2581]: E0526 15:17:41.505776    2581 reflector.go:200] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
May 26 15:17:41.507473 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:17:41.507455    2581 manager.go:324] Recovery completed
May 26 15:17:41.511602 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:17:41.511589    2581 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach"
May 26 15:17:41.513353 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:17:41.513331    2581 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-140-164.ec2.internal" event="NodeHasSufficientMemory"
May 26 15:17:41.513415 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:17:41.513366    2581 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-140-164.ec2.internal" event="NodeHasNoDiskPressure"
May 26 15:17:41.513415 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:17:41.513377    2581 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-140-164.ec2.internal" event="NodeHasSufficientPID"
May 26 15:17:41.513826 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:17:41.513813    2581 cpu_manager.go:222] "Starting CPU manager" policy="none"
May 26 15:17:41.513826 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:17:41.513825    2581 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
May 26 15:17:41.513913 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:17:41.513863    2581 state_mem.go:36] "Initialized new in-memory state store"
May 26 15:17:41.515641 ip-10-0-140-164 kubenswrapper[2581]: E0526 15:17:41.515576    2581 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-140-164.ec2.internal.18b3268c3daabb83  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-140-164.ec2.internal,UID:ip-10-0-140-164.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-140-164.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-140-164.ec2.internal,},FirstTimestamp:2026-05-26 15:17:41.513354115 +0000 UTC m=+0.511057439,LastTimestamp:2026-05-26 15:17:41.513354115 +0000 UTC m=+0.511057439,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-140-164.ec2.internal,}"
May 26 15:17:41.516339 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:17:41.516327    2581 policy_none.go:49] "None policy: Start"
May 26 15:17:41.516395 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:17:41.516343    2581 memory_manager.go:186] "Starting memorymanager" policy="None"
May 26 15:17:41.516395 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:17:41.516354    2581 state_mem.go:35] "Initializing new in-memory state store"
May 26 15:17:41.518948 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:17:41.518929    2581 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-cnfcd"
May 26 15:17:41.524535 ip-10-0-140-164 kubenswrapper[2581]: E0526 15:17:41.524478    2581 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-140-164.ec2.internal.18b3268c3daafb5d  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-140-164.ec2.internal,UID:ip-10-0-140-164.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-140-164.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-140-164.ec2.internal,},FirstTimestamp:2026-05-26 15:17:41.513370461 +0000 UTC m=+0.511073784,LastTimestamp:2026-05-26 15:17:41.513370461 +0000 UTC m=+0.511073784,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-140-164.ec2.internal,}"
May 26 15:17:41.524946 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:17:41.524932    2581 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-cnfcd"
May 26 15:17:41.571997 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:17:41.562546    2581 manager.go:341] "Starting Device Plugin manager"
May 26 15:17:41.571997 ip-10-0-140-164 kubenswrapper[2581]: E0526 15:17:41.562571    2581 manager.go:517] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
May 26 15:17:41.571997 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:17:41.562579    2581 server.go:85] "Starting device plugin registration server"
May 26 15:17:41.571997 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:17:41.562783    2581 eviction_manager.go:189] "Eviction manager: starting control loop"
May 26 15:17:41.571997 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:17:41.562794    2581 container_log_manager.go:189] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
May 26 15:17:41.571997 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:17:41.562861    2581 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
May 26 15:17:41.571997 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:17:41.562938    2581 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
May 26 15:17:41.571997 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:17:41.562946    2581 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
May 26 15:17:41.571997 ip-10-0-140-164 kubenswrapper[2581]: E0526 15:17:41.563418    2581 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
May 26 15:17:41.571997 ip-10-0-140-164 kubenswrapper[2581]: E0526 15:17:41.563448    2581 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-140-164.ec2.internal\" not found"
May 26 15:17:41.635125 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:17:41.635068    2581 kubelet_network_linux.go:49] "Initialized iptables rules." protocol="IPv4"
May 26 15:17:41.636428 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:17:41.636411    2581 kubelet_network_linux.go:49] "Initialized iptables rules." protocol="IPv6"
May 26 15:17:41.636491 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:17:41.636442    2581 status_manager.go:230] "Starting to sync pod status with apiserver"
May 26 15:17:41.636525 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:17:41.636495    2581 watchdog_linux.go:127] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
May 26 15:17:41.636525 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:17:41.636506    2581 kubelet.go:2451] "Starting kubelet main sync loop"
May 26 15:17:41.636595 ip-10-0-140-164 kubenswrapper[2581]: E0526 15:17:41.636579    2581 kubelet.go:2475] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
May 26 15:17:41.638911 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:17:41.638895    2581 reflector.go:430] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
May 26 15:17:41.663693 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:17:41.663666    2581 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach"
May 26 15:17:41.664510 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:17:41.664496    2581 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-140-164.ec2.internal" event="NodeHasSufficientMemory"
May 26 15:17:41.664582 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:17:41.664521    2581 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-140-164.ec2.internal" event="NodeHasNoDiskPressure"
May 26 15:17:41.664582 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:17:41.664530    2581 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-140-164.ec2.internal" event="NodeHasSufficientPID"
May 26 15:17:41.664582 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:17:41.664550    2581 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-140-164.ec2.internal"
May 26 15:17:41.672390 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:17:41.672376    2581 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-140-164.ec2.internal"
May 26 15:17:41.672445 ip-10-0-140-164 kubenswrapper[2581]: E0526 15:17:41.672395    2581 kubelet_node_status.go:597] "Error updating node status, will retry" err="error getting node \"ip-10-0-140-164.ec2.internal\": node \"ip-10-0-140-164.ec2.internal\" not found"
May 26 15:17:41.687321 ip-10-0-140-164 kubenswrapper[2581]: E0526 15:17:41.687305    2581 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-140-164.ec2.internal\" not found"
May 26 15:17:41.736736 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:17:41.736712    2581 kubelet.go:2537] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-164.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-140-164.ec2.internal"]
May 26 15:17:41.736823 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:17:41.736771    2581 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach"
May 26 15:17:41.737565 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:17:41.737534    2581 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-140-164.ec2.internal" event="NodeHasSufficientMemory"
May 26 15:17:41.737651 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:17:41.737571    2581 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-140-164.ec2.internal" event="NodeHasNoDiskPressure"
May 26 15:17:41.737651 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:17:41.737586    2581 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-140-164.ec2.internal" event="NodeHasSufficientPID"
May 26 15:17:41.738768 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:17:41.738756    2581 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach"
May 26 15:17:41.738915 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:17:41.738901    2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-164.ec2.internal"
May 26 15:17:41.738954 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:17:41.738928    2581 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach"
May 26 15:17:41.739477 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:17:41.739459    2581 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-140-164.ec2.internal" event="NodeHasSufficientMemory"
May 26 15:17:41.739569 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:17:41.739491    2581 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-140-164.ec2.internal" event="NodeHasNoDiskPressure"
May 26 15:17:41.739569 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:17:41.739501    2581 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-140-164.ec2.internal" event="NodeHasSufficientPID"
May 26 15:17:41.739569 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:17:41.739461    2581 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-140-164.ec2.internal" event="NodeHasSufficientMemory"
May 26 15:17:41.739663 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:17:41.739578    2581 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-140-164.ec2.internal" event="NodeHasNoDiskPressure"
May 26 15:17:41.739663 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:17:41.739593    2581 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-140-164.ec2.internal" event="NodeHasSufficientPID"
May 26 15:17:41.740702 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:17:41.740687    2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-164.ec2.internal"
May 26 15:17:41.740768 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:17:41.740712    2581 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach"
May 26 15:17:41.741375 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:17:41.741357    2581 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-140-164.ec2.internal" event="NodeHasSufficientMemory"
May 26 15:17:41.741439 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:17:41.741385    2581 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-140-164.ec2.internal" event="NodeHasNoDiskPressure"
May 26 15:17:41.741439 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:17:41.741394    2581 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-140-164.ec2.internal" event="NodeHasSufficientPID"
May 26 15:17:41.765810 ip-10-0-140-164 kubenswrapper[2581]: E0526 15:17:41.765787    2581 kubelet.go:3336] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-140-164.ec2.internal\" not found" node="ip-10-0-140-164.ec2.internal"
May 26 15:17:41.770070 ip-10-0-140-164 kubenswrapper[2581]: E0526 15:17:41.770054    2581 kubelet.go:3336] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-140-164.ec2.internal\" not found" node="ip-10-0-140-164.ec2.internal"
May 26 15:17:41.787597 ip-10-0-140-164 kubenswrapper[2581]: E0526 15:17:41.787578    2581 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-140-164.ec2.internal\" not found"
May 26 15:17:41.795944 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:17:41.795927    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/55d5a722a2f6ce4004954f6d492eeaa9-config\") pod \"kube-apiserver-proxy-ip-10-0-140-164.ec2.internal\" (UID: \"55d5a722a2f6ce4004954f6d492eeaa9\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-140-164.ec2.internal"
May 26 15:17:41.796031 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:17:41.795951    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/591b4a3ba245c4dc860f8b20f61b92da-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-140-164.ec2.internal\" (UID: \"591b4a3ba245c4dc860f8b20f61b92da\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-164.ec2.internal"
May 26 15:17:41.796031 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:17:41.795969    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/591b4a3ba245c4dc860f8b20f61b92da-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-140-164.ec2.internal\" (UID: \"591b4a3ba245c4dc860f8b20f61b92da\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-164.ec2.internal"
May 26 15:17:41.888303 ip-10-0-140-164 kubenswrapper[2581]: E0526 15:17:41.888241    2581 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-140-164.ec2.internal\" not found"
May 26 15:17:41.896627 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:17:41.896605    2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/55d5a722a2f6ce4004954f6d492eeaa9-config\") pod \"kube-apiserver-proxy-ip-10-0-140-164.ec2.internal\" (UID: \"55d5a722a2f6ce4004954f6d492eeaa9\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-140-164.ec2.internal"
May 26 15:17:41.896705 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:17:41.896637    2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/591b4a3ba245c4dc860f8b20f61b92da-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-140-164.ec2.internal\" (UID: \"591b4a3ba245c4dc860f8b20f61b92da\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-164.ec2.internal"
May 26 15:17:41.896705 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:17:41.896665    2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/591b4a3ba245c4dc860f8b20f61b92da-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-140-164.ec2.internal\" (UID: \"591b4a3ba245c4dc860f8b20f61b92da\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-164.ec2.internal"
May 26 15:17:41.896705 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:17:41.896701    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/591b4a3ba245c4dc860f8b20f61b92da-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-140-164.ec2.internal\" (UID: \"591b4a3ba245c4dc860f8b20f61b92da\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-164.ec2.internal"
May 26 15:17:41.896823 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:17:41.896702    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/591b4a3ba245c4dc860f8b20f61b92da-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-140-164.ec2.internal\" (UID: \"591b4a3ba245c4dc860f8b20f61b92da\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-164.ec2.internal"
May 26 15:17:41.896823 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:17:41.896703    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/55d5a722a2f6ce4004954f6d492eeaa9-config\") pod \"kube-apiserver-proxy-ip-10-0-140-164.ec2.internal\" (UID: \"55d5a722a2f6ce4004954f6d492eeaa9\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-140-164.ec2.internal"
May 26 15:17:41.988997 ip-10-0-140-164 kubenswrapper[2581]: E0526 15:17:41.988976    2581 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-140-164.ec2.internal\" not found"
May 26 15:17:42.069483 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:17:42.069459    2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-164.ec2.internal"
May 26 15:17:42.073103 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:17:42.073087    2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-164.ec2.internal"
May 26 15:17:42.089352 ip-10-0-140-164 kubenswrapper[2581]: E0526 15:17:42.089322    2581 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-140-164.ec2.internal\" not found"
May 26 15:17:42.189894 ip-10-0-140-164 kubenswrapper[2581]: E0526 15:17:42.189841    2581 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-140-164.ec2.internal\" not found"
May 26 15:17:42.290348 ip-10-0-140-164 kubenswrapper[2581]: E0526 15:17:42.290299    2581 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-140-164.ec2.internal\" not found"
May 26 15:17:42.390908 ip-10-0-140-164 kubenswrapper[2581]: E0526 15:17:42.390880    2581 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-140-164.ec2.internal\" not found"
May 26 15:17:42.395132 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:17:42.395115    2581 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
May 26 15:17:42.395289 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:17:42.395250    2581 reflector.go:556] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
May 26 15:17:42.491607 ip-10-0-140-164 kubenswrapper[2581]: E0526 15:17:42.491561    2581 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-140-164.ec2.internal\" not found"
May 26 15:17:42.493744 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:17:42.493723    2581 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
May 26 15:17:42.507489 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:17:42.507456    2581 reflector.go:430] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
May 26 15:17:42.526749 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:17:42.526719    2581 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-05-25 15:12:41 +0000 UTC" deadline="2027-11-14 04:44:05.174148359 +0000 UTC"
May 26 15:17:42.526749 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:17:42.526747    2581 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="12877h26m22.647404431s"
May 26 15:17:42.592183 ip-10-0-140-164 kubenswrapper[2581]: E0526 15:17:42.592046    2581 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-140-164.ec2.internal\" not found"
May 26 15:17:42.598201 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:17:42.598162    2581 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-xh792"
May 26 15:17:42.600035 ip-10-0-140-164 kubenswrapper[2581]: W0526 15:17:42.600009    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod591b4a3ba245c4dc860f8b20f61b92da.slice/crio-cb1a9da260664ccf8652bcb9c1f7734aae060cd8e2a7dbc522ad44750fa23269 WatchSource:0}: Error finding container cb1a9da260664ccf8652bcb9c1f7734aae060cd8e2a7dbc522ad44750fa23269: Status 404 returned error can't find the container with id cb1a9da260664ccf8652bcb9c1f7734aae060cd8e2a7dbc522ad44750fa23269
May 26 15:17:42.600350 ip-10-0-140-164 kubenswrapper[2581]: W0526 15:17:42.600328    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod55d5a722a2f6ce4004954f6d492eeaa9.slice/crio-a1aa4753dc116c6e64dba1318c44cc3a5c45c5420472c31f090a79cfc5b512eb WatchSource:0}: Error finding container a1aa4753dc116c6e64dba1318c44cc3a5c45c5420472c31f090a79cfc5b512eb: Status 404 returned error can't find the container with id a1aa4753dc116c6e64dba1318c44cc3a5c45c5420472c31f090a79cfc5b512eb
May 26 15:17:42.603171 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:17:42.603151    2581 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
May 26 15:17:42.606891 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:17:42.606873    2581 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-xh792"
May 26 15:17:42.638967 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:17:42.638923    2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-164.ec2.internal" event={"ID":"55d5a722a2f6ce4004954f6d492eeaa9","Type":"ContainerStarted","Data":"a1aa4753dc116c6e64dba1318c44cc3a5c45c5420472c31f090a79cfc5b512eb"}
May 26 15:17:42.639849 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:17:42.639831    2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-164.ec2.internal" event={"ID":"591b4a3ba245c4dc860f8b20f61b92da","Type":"ContainerStarted","Data":"cb1a9da260664ccf8652bcb9c1f7734aae060cd8e2a7dbc522ad44750fa23269"}
May 26 15:17:42.692993 ip-10-0-140-164 kubenswrapper[2581]: E0526 15:17:42.692967    2581 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-140-164.ec2.internal\" not found"
May 26 15:17:42.792379 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:17:42.792336    2581 reflector.go:430] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
May 26 15:17:42.793597 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:17:42.793582    2581 kubelet.go:3340] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-164.ec2.internal"
May 26 15:17:42.807931 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:17:42.807905    2581 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
May 26 15:17:42.809991 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:17:42.809976    2581 kubelet.go:3340] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-164.ec2.internal"
May 26 15:17:42.818822 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:17:42.818803    2581 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
May 26 15:17:42.893501 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:17:42.893479    2581 reflector.go:430] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
May 26 15:17:42.969048 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:17:42.969031    2581 reflector.go:430] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
May 26 15:17:43.474513 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:17:43.474487    2581 apiserver.go:52] "Watching apiserver"
May 26 15:17:43.482283 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:17:43.482241    2581 reflector.go:430] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
May 26 15:17:43.482800 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:17:43.482776    2581 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-164.ec2.internal","openshift-network-operator/iptables-alerter-nprns","openshift-ovn-kubernetes/ovnkube-node-gjh9c","kube-system/global-pull-secret-syncer-k56cd","kube-system/kube-apiserver-proxy-ip-10-0-140-164.ec2.internal","openshift-dns/node-resolver-6j49h","openshift-image-registry/node-ca-khnr9","openshift-multus/multus-additional-cni-plugins-bglww","openshift-multus/multus-x5ptz","openshift-multus/network-metrics-daemon-npzrf","openshift-network-diagnostics/network-check-target-qr6zm","kube-system/konnectivity-agent-5nngw","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vsvmw","openshift-cluster-node-tuning-operator/tuned-9rvq6"]
May 26 15:17:43.485050 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:17:43.485028    2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qr6zm"
May 26 15:17:43.485154 ip-10-0-140-164 kubenswrapper[2581]: E0526 15:17:43.485126    2581 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qr6zm" podUID="000947e2-0eeb-4d43-8dc4-6132e5e6cc13"
May 26 15:17:43.486229 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:17:43.486208    2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-nprns"
May 26 15:17:43.487813 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:17:43.487791    2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-gjh9c"
May 26 15:17:43.488710 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:17:43.488572    2581 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
May 26 15:17:43.488710 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:17:43.488591    2581 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-92tlg\""
May 26 15:17:43.488710 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:17:43.488624    2581 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
May 26 15:17:43.488922 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:17:43.488718    2581 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
May 26 15:17:43.490141 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:17:43.490119    2581 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
May 26 15:17:43.490235 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:17:43.490219    2581 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-fhcnw\""
May 26 15:17:43.490308 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:17:43.490119    2581 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
May 26 15:17:43.490528 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:17:43.490511    2581 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
May 26 15:17:43.490720 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:17:43.490701    2581 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
May 26 15:17:43.491491 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:17:43.491471    2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vsvmw"
May 26 15:17:43.491584 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:17:43.491560    2581 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
May 26 15:17:43.491769 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:17:43.491480    2581 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
May 26 15:17:43.492688 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:17:43.492670    2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-9rvq6"
May 26 15:17:43.492774 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:17:43.492753    2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-6j49h"
May 26 15:17:43.494301 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:17:43.494283    2581 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
May 26 15:17:43.494413 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:17:43.494400    2581 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
May 26 15:17:43.494737 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:17:43.494722    2581 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
May 26 15:17:43.495458 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:17:43.495437    2581 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
May 26 15:17:43.495550 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:17:43.495489    2581 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-nc9zz\""
May 26 15:17:43.495835 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:17:43.495819    2581 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-9d9mq\""
May 26 15:17:43.495909 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:17:43.495898    2581 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
May 26 15:17:43.497758 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:17:43.496014    2581 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-dm7gv\""
May 26 15:17:43.497758 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:17:43.496121    2581 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
May 26 15:17:43.497758 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:17:43.496230    2581 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
May 26 15:17:43.497758 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:17:43.496638    2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-khnr9"
May 26 15:17:43.498965 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:17:43.498934    2581 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
May 26 15:17:43.499249 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:17:43.499232    2581 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
May 26 15:17:43.499390 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:17:43.499290    2581 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-j2vbf\""
May 26 15:17:43.499390 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:17:43.499383    2581 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
May 26 15:17:43.499882 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:17:43.499541    2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-5nngw"
May 26 15:17:43.501171 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:17:43.500965    2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-k56cd"
May 26 15:17:43.501171 ip-10-0-140-164 kubenswrapper[2581]: E0526 15:17:43.501033    2581 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-k56cd" podUID="be858157-7e73-43be-81e8-aa5e9344923e"
May 26 15:17:43.501774 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:17:43.501755    2581 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
May 26 15:17:43.501900 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:17:43.501882    2581 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-krkmf\""
May 26 15:17:43.503805 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:17:43.503426    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/1817fb6f-f287-4f86-b684-9b9132f3561a-etc-modprobe-d\") pod \"tuned-9rvq6\" (UID: \"1817fb6f-f287-4f86-b684-9b9132f3561a\") " pod="openshift-cluster-node-tuning-operator/tuned-9rvq6"
May 26 15:17:43.503805 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:17:43.503461    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/1817fb6f-f287-4f86-b684-9b9132f3561a-run\") pod \"tuned-9rvq6\" (UID: \"1817fb6f-f287-4f86-b684-9b9132f3561a\") " pod="openshift-cluster-node-tuning-operator/tuned-9rvq6"
May 26 15:17:43.503805 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:17:43.503486    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/a02c2727-c53c-48c3-aba7-acde4eef632c-systemd-units\") pod \"ovnkube-node-gjh9c\" (UID: \"a02c2727-c53c-48c3-aba7-acde4eef632c\") " pod="openshift-ovn-kubernetes/ovnkube-node-gjh9c"
May 26 15:17:43.503805 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:17:43.503501    2581 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
May 26 15:17:43.503805 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:17:43.503510    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a02c2727-c53c-48c3-aba7-acde4eef632c-run-openvswitch\") pod \"ovnkube-node-gjh9c\" (UID: \"a02c2727-c53c-48c3-aba7-acde4eef632c\") " pod="openshift-ovn-kubernetes/ovnkube-node-gjh9c"
May 26 15:17:43.503805 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:17:43.503535    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a02c2727-c53c-48c3-aba7-acde4eef632c-host-run-ovn-kubernetes\") pod \"ovnkube-node-gjh9c\" (UID: \"a02c2727-c53c-48c3-aba7-acde4eef632c\") " pod="openshift-ovn-kubernetes/ovnkube-node-gjh9c"
May 26 15:17:43.503805 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:17:43.503558    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/a02c2727-c53c-48c3-aba7-acde4eef632c-host-cni-bin\") pod \"ovnkube-node-gjh9c\" (UID: \"a02c2727-c53c-48c3-aba7-acde4eef632c\") " pod="openshift-ovn-kubernetes/ovnkube-node-gjh9c"
May 26 15:17:43.503805 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:17:43.503581    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/a02c2727-c53c-48c3-aba7-acde4eef632c-env-overrides\") pod \"ovnkube-node-gjh9c\" (UID: \"a02c2727-c53c-48c3-aba7-acde4eef632c\") " pod="openshift-ovn-kubernetes/ovnkube-node-gjh9c"
May 26 15:17:43.503805 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:17:43.503604    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/a02c2727-c53c-48c3-aba7-acde4eef632c-ovnkube-script-lib\") pod \"ovnkube-node-gjh9c\" (UID: \"a02c2727-c53c-48c3-aba7-acde4eef632c\") " pod="openshift-ovn-kubernetes/ovnkube-node-gjh9c"
May 26 15:17:43.503805 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:17:43.503626    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/07693aae-634c-4a2f-ac21-fb1bf39c239a-device-dir\") pod \"aws-ebs-csi-driver-node-vsvmw\" (UID: \"07693aae-634c-4a2f-ac21-fb1bf39c239a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vsvmw"
May 26 15:17:43.503805 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:17:43.503649    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/a02c2727-c53c-48c3-aba7-acde4eef632c-host-kubelet\") pod \"ovnkube-node-gjh9c\" (UID: \"a02c2727-c53c-48c3-aba7-acde4eef632c\") " pod="openshift-ovn-kubernetes/ovnkube-node-gjh9c"
May 26 15:17:43.503805 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:17:43.503672    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/a02c2727-c53c-48c3-aba7-acde4eef632c-host-run-netns\") pod \"ovnkube-node-gjh9c\" (UID: \"a02c2727-c53c-48c3-aba7-acde4eef632c\") " pod="openshift-ovn-kubernetes/ovnkube-node-gjh9c"
May 26 15:17:43.503805 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:17:43.503694    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/1817fb6f-f287-4f86-b684-9b9132f3561a-etc-systemd\") pod \"tuned-9rvq6\" (UID: \"1817fb6f-f287-4f86-b684-9b9132f3561a\") " pod="openshift-cluster-node-tuning-operator/tuned-9rvq6"
May 26 15:17:43.503805 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:17:43.503715    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/1817fb6f-f287-4f86-b684-9b9132f3561a-sys\") pod \"tuned-9rvq6\" (UID: \"1817fb6f-f287-4f86-b684-9b9132f3561a\") " pod="openshift-cluster-node-tuning-operator/tuned-9rvq6"
May 26 15:17:43.503805 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:17:43.503736    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/1817fb6f-f287-4f86-b684-9b9132f3561a-lib-modules\") pod \"tuned-9rvq6\" (UID: \"1817fb6f-f287-4f86-b684-9b9132f3561a\") " pod="openshift-cluster-node-tuning-operator/tuned-9rvq6"
May 26 15:17:43.503805 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:17:43.503778    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/1817fb6f-f287-4f86-b684-9b9132f3561a-var-lib-kubelet\") pod \"tuned-9rvq6\" (UID: \"1817fb6f-f287-4f86-b684-9b9132f3561a\") " pod="openshift-cluster-node-tuning-operator/tuned-9rvq6"
May 26 15:17:43.504572 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:17:43.503883    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/efa65a4e-8688-4521-bf81-8938e3041f72-host-slash\") pod \"iptables-alerter-nprns\" (UID: \"efa65a4e-8688-4521-bf81-8938e3041f72\") " pod="openshift-network-operator/iptables-alerter-nprns"
May 26 15:17:43.504572 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:17:43.503908    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/a02c2727-c53c-48c3-aba7-acde4eef632c-run-systemd\") pod \"ovnkube-node-gjh9c\" (UID: \"a02c2727-c53c-48c3-aba7-acde4eef632c\") " pod="openshift-ovn-kubernetes/ovnkube-node-gjh9c"
May 26 15:17:43.504572 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:17:43.503930    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/a02c2727-c53c-48c3-aba7-acde4eef632c-log-socket\") pod \"ovnkube-node-gjh9c\" (UID: \"a02c2727-c53c-48c3-aba7-acde4eef632c\") " pod="openshift-ovn-kubernetes/ovnkube-node-gjh9c"
May 26 15:17:43.504572 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:17:43.503955    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/66fc90a9-1fd5-46e0-aa1a-895166fc81b8-konnectivity-ca\") pod \"konnectivity-agent-5nngw\" (UID: \"66fc90a9-1fd5-46e0-aa1a-895166fc81b8\") " pod="kube-system/konnectivity-agent-5nngw"
May 26 15:17:43.504572 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:17:43.503978    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mlmct\" (UniqueName: \"kubernetes.io/projected/a02c2727-c53c-48c3-aba7-acde4eef632c-kube-api-access-mlmct\") pod \"ovnkube-node-gjh9c\" (UID: \"a02c2727-c53c-48c3-aba7-acde4eef632c\") " pod="openshift-ovn-kubernetes/ovnkube-node-gjh9c"
May 26 15:17:43.504572 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:17:43.504050    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/706d11ce-61db-4788-83f2-2ffbea860487-host\") pod \"node-ca-khnr9\" (UID: \"706d11ce-61db-4788-83f2-2ffbea860487\") " pod="openshift-image-registry/node-ca-khnr9"
May 26 15:17:43.504572 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:17:43.504083    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/be858157-7e73-43be-81e8-aa5e9344923e-dbus\") pod \"global-pull-secret-syncer-k56cd\" (UID: \"be858157-7e73-43be-81e8-aa5e9344923e\") " pod="kube-system/global-pull-secret-syncer-k56cd"
May 26 15:17:43.504572 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:17:43.504112    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a02c2727-c53c-48c3-aba7-acde4eef632c-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-gjh9c\" (UID: \"a02c2727-c53c-48c3-aba7-acde4eef632c\") " pod="openshift-ovn-kubernetes/ovnkube-node-gjh9c"
May 26 15:17:43.504572 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:17:43.504136    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1817fb6f-f287-4f86-b684-9b9132f3561a-etc-kubernetes\") pod \"tuned-9rvq6\" (UID: \"1817fb6f-f287-4f86-b684-9b9132f3561a\") " pod="openshift-cluster-node-tuning-operator/tuned-9rvq6"
May 26 15:17:43.504572 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:17:43.504178    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a02c2727-c53c-48c3-aba7-acde4eef632c-var-lib-openvswitch\") pod \"ovnkube-node-gjh9c\" (UID: \"a02c2727-c53c-48c3-aba7-acde4eef632c\") " pod="openshift-ovn-kubernetes/ovnkube-node-gjh9c"
May 26 15:17:43.504572 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:17:43.504219    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/1817fb6f-f287-4f86-b684-9b9132f3561a-etc-sysconfig\") pod \"tuned-9rvq6\" (UID: \"1817fb6f-f287-4f86-b684-9b9132f3561a\") " pod="openshift-cluster-node-tuning-operator/tuned-9rvq6"
May 26 15:17:43.504572 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:17:43.504247    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1817fb6f-f287-4f86-b684-9b9132f3561a-tmp\") pod \"tuned-9rvq6\" (UID: \"1817fb6f-f287-4f86-b684-9b9132f3561a\") " pod="openshift-cluster-node-tuning-operator/tuned-9rvq6"
May 26 15:17:43.504572 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:17:43.504350    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/a02c2727-c53c-48c3-aba7-acde4eef632c-ovnkube-config\") pod \"ovnkube-node-gjh9c\" (UID: \"a02c2727-c53c-48c3-aba7-acde4eef632c\") " pod="openshift-ovn-kubernetes/ovnkube-node-gjh9c"
May 26 15:17:43.504572 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:17:43.504378    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/07693aae-634c-4a2f-ac21-fb1bf39c239a-kubelet-dir\") pod \"aws-ebs-csi-driver-node-vsvmw\" (UID: \"07693aae-634c-4a2f-ac21-fb1bf39c239a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vsvmw"
May 26 15:17:43.504572 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:17:43.504401    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/07693aae-634c-4a2f-ac21-fb1bf39c239a-etc-selinux\") pod \"aws-ebs-csi-driver-node-vsvmw\" (UID: \"07693aae-634c-4a2f-ac21-fb1bf39c239a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vsvmw"
May 26 15:17:43.504572 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:17:43.504425    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9f965e2e-8e40-4ab4-b3cd-0d52ba317cf2-tmp-dir\") pod \"node-resolver-6j49h\" (UID: \"9f965e2e-8e40-4ab4-b3cd-0d52ba317cf2\") " pod="openshift-dns/node-resolver-6j49h"
May 26 15:17:43.505186 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:17:43.504462    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gxd45\" (UniqueName: \"kubernetes.io/projected/9f965e2e-8e40-4ab4-b3cd-0d52ba317cf2-kube-api-access-gxd45\") pod \"node-resolver-6j49h\" (UID: \"9f965e2e-8e40-4ab4-b3cd-0d52ba317cf2\") " pod="openshift-dns/node-resolver-6j49h"
May 26 15:17:43.505186 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:17:43.504488    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/a02c2727-c53c-48c3-aba7-acde4eef632c-run-ovn\") pod \"ovnkube-node-gjh9c\" (UID: \"a02c2727-c53c-48c3-aba7-acde4eef632c\") " pod="openshift-ovn-kubernetes/ovnkube-node-gjh9c"
May 26 15:17:43.505186 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:17:43.504511    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/9f965e2e-8e40-4ab4-b3cd-0d52ba317cf2-hosts-file\") pod \"node-resolver-6j49h\" (UID: \"9f965e2e-8e40-4ab4-b3cd-0d52ba317cf2\") " pod="openshift-dns/node-resolver-6j49h"
May 26 15:17:43.505186 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:17:43.504543    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cvg7t\" (UniqueName: \"kubernetes.io/projected/efa65a4e-8688-4521-bf81-8938e3041f72-kube-api-access-cvg7t\") pod \"iptables-alerter-nprns\" (UID: \"efa65a4e-8688-4521-bf81-8938e3041f72\") " pod="openshift-network-operator/iptables-alerter-nprns"
May 26 15:17:43.505186 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:17:43.504579    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/be858157-7e73-43be-81e8-aa5e9344923e-original-pull-secret\") pod \"global-pull-secret-syncer-k56cd\" (UID: \"be858157-7e73-43be-81e8-aa5e9344923e\") " pod="kube-system/global-pull-secret-syncer-k56cd"
May 26 15:17:43.505186 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:17:43.504606    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-52vlc\" (UniqueName: \"kubernetes.io/projected/706d11ce-61db-4788-83f2-2ffbea860487-kube-api-access-52vlc\") pod \"node-ca-khnr9\" (UID: \"706d11ce-61db-4788-83f2-2ffbea860487\") " pod="openshift-image-registry/node-ca-khnr9"
May 26 15:17:43.505186 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:17:43.504644    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/66fc90a9-1fd5-46e0-aa1a-895166fc81b8-agent-certs\") pod \"konnectivity-agent-5nngw\" (UID: \"66fc90a9-1fd5-46e0-aa1a-895166fc81b8\") " pod="kube-system/konnectivity-agent-5nngw"
May 26 15:17:43.505186 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:17:43.504685    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/a02c2727-c53c-48c3-aba7-acde4eef632c-host-cni-netd\") pod \"ovnkube-node-gjh9c\" (UID: \"a02c2727-c53c-48c3-aba7-acde4eef632c\") " pod="openshift-ovn-kubernetes/ovnkube-node-gjh9c"
May 26 15:17:43.505186 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:17:43.504718    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/1817fb6f-f287-4f86-b684-9b9132f3561a-etc-sysctl-d\") pod \"tuned-9rvq6\" (UID: \"1817fb6f-f287-4f86-b684-9b9132f3561a\") " pod="openshift-cluster-node-tuning-operator/tuned-9rvq6"
May 26 15:17:43.505186 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:17:43.504741    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/1817fb6f-f287-4f86-b684-9b9132f3561a-host\") pod \"tuned-9rvq6\" (UID: \"1817fb6f-f287-4f86-b684-9b9132f3561a\") " pod="openshift-cluster-node-tuning-operator/tuned-9rvq6"
May 26 15:17:43.505186 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:17:43.504790    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/be858157-7e73-43be-81e8-aa5e9344923e-kubelet-config\") pod \"global-pull-secret-syncer-k56cd\" (UID: \"be858157-7e73-43be-81e8-aa5e9344923e\") " pod="kube-system/global-pull-secret-syncer-k56cd"
May 26 15:17:43.505186 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:17:43.504822    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/a02c2727-c53c-48c3-aba7-acde4eef632c-ovn-node-metrics-cert\") pod \"ovnkube-node-gjh9c\" (UID: \"a02c2727-c53c-48c3-aba7-acde4eef632c\") " pod="openshift-ovn-kubernetes/ovnkube-node-gjh9c"
May 26 15:17:43.505186 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:17:43.504847    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/1817fb6f-f287-4f86-b684-9b9132f3561a-etc-sysctl-conf\") pod \"tuned-9rvq6\" (UID: \"1817fb6f-f287-4f86-b684-9b9132f3561a\") " pod="openshift-cluster-node-tuning-operator/tuned-9rvq6"
May 26 15:17:43.505186 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:17:43.504868    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/07693aae-634c-4a2f-ac21-fb1bf39c239a-sys-fs\") pod \"aws-ebs-csi-driver-node-vsvmw\" (UID: \"07693aae-634c-4a2f-ac21-fb1bf39c239a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vsvmw"
May 26 15:17:43.505186 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:17:43.504882    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/706d11ce-61db-4788-83f2-2ffbea860487-serviceca\") pod \"node-ca-khnr9\" (UID: \"706d11ce-61db-4788-83f2-2ffbea860487\") " pod="openshift-image-registry/node-ca-khnr9"
May 26 15:17:43.505186 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:17:43.504896    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m9l98\" (UniqueName: \"kubernetes.io/projected/000947e2-0eeb-4d43-8dc4-6132e5e6cc13-kube-api-access-m9l98\") pod \"network-check-target-qr6zm\" (UID: \"000947e2-0eeb-4d43-8dc4-6132e5e6cc13\") " pod="openshift-network-diagnostics/network-check-target-qr6zm"
May 26 15:17:43.505785 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:17:43.504910    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/1817fb6f-f287-4f86-b684-9b9132f3561a-etc-tuned\") pod \"tuned-9rvq6\" (UID: \"1817fb6f-f287-4f86-b684-9b9132f3561a\") " pod="openshift-cluster-node-tuning-operator/tuned-9rvq6"
May 26 15:17:43.505785 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:17:43.504923    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z2jtx\" (UniqueName: \"kubernetes.io/projected/07693aae-634c-4a2f-ac21-fb1bf39c239a-kube-api-access-z2jtx\") pod \"aws-ebs-csi-driver-node-vsvmw\" (UID: \"07693aae-634c-4a2f-ac21-fb1bf39c239a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vsvmw"
May 26 15:17:43.505785 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:17:43.504939    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/efa65a4e-8688-4521-bf81-8938e3041f72-iptables-alerter-script\") pod \"iptables-alerter-nprns\" (UID: \"efa65a4e-8688-4521-bf81-8938e3041f72\") " pod="openshift-network-operator/iptables-alerter-nprns"
May 26 15:17:43.505785 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:17:43.504963    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a02c2727-c53c-48c3-aba7-acde4eef632c-etc-openvswitch\") pod \"ovnkube-node-gjh9c\" (UID: \"a02c2727-c53c-48c3-aba7-acde4eef632c\") " pod="openshift-ovn-kubernetes/ovnkube-node-gjh9c"
May 26 15:17:43.505785 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:17:43.504994    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dgsgr\" (UniqueName: \"kubernetes.io/projected/1817fb6f-f287-4f86-b684-9b9132f3561a-kube-api-access-dgsgr\") pod \"tuned-9rvq6\" (UID: \"1817fb6f-f287-4f86-b684-9b9132f3561a\") " pod="openshift-cluster-node-tuning-operator/tuned-9rvq6"
May 26 15:17:43.505785 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:17:43.505017    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/07693aae-634c-4a2f-ac21-fb1bf39c239a-socket-dir\") pod \"aws-ebs-csi-driver-node-vsvmw\" (UID: \"07693aae-634c-4a2f-ac21-fb1bf39c239a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vsvmw"
May 26 15:17:43.505785 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:17:43.505037    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/07693aae-634c-4a2f-ac21-fb1bf39c239a-registration-dir\") pod \"aws-ebs-csi-driver-node-vsvmw\" (UID: \"07693aae-634c-4a2f-ac21-fb1bf39c239a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vsvmw"
May 26 15:17:43.505785 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:17:43.505082    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/a02c2727-c53c-48c3-aba7-acde4eef632c-host-slash\") pod \"ovnkube-node-gjh9c\" (UID: \"a02c2727-c53c-48c3-aba7-acde4eef632c\") " pod="openshift-ovn-kubernetes/ovnkube-node-gjh9c"
May 26 15:17:43.505785 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:17:43.505121    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/a02c2727-c53c-48c3-aba7-acde4eef632c-node-log\") pod \"ovnkube-node-gjh9c\" (UID: \"a02c2727-c53c-48c3-aba7-acde4eef632c\") " pod="openshift-ovn-kubernetes/ovnkube-node-gjh9c"
May 26 15:17:43.506392 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:17:43.505942    2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-npzrf"
May 26 15:17:43.506392 ip-10-0-140-164 kubenswrapper[2581]: E0526 15:17:43.506000    2581 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-npzrf" podUID="ae574985-4900-4b23-bf74-7c72c939f9bd"
May 26 15:17:43.507302 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:17:43.507262    2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-x5ptz"
May 26 15:17:43.507394 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:17:43.507262    2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-bglww"
May 26 15:17:43.509507 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:17:43.509483    2581 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
May 26 15:17:43.509783 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:17:43.509762    2581 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-ktl85\""
May 26 15:17:43.509843 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:17:43.509807    2581 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
May 26 15:17:43.510000 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:17:43.509986    2581 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
May 26 15:17:43.510045 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:17:43.510030    2581 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
May 26 15:17:43.510118 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:17:43.509989    2581 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-86wn7\""
May 26 15:17:43.510197 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:17:43.510183    2581 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
May 26 15:17:43.510290 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:17:43.510260    2581 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
May 26 15:17:43.595061 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:17:43.595041    2581 desired_state_of_world_populator.go:158] "Finished populating initial desired state of world"
May 26 15:17:43.606123 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:17:43.606098    2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/a02c2727-c53c-48c3-aba7-acde4eef632c-ovnkube-config\") pod \"ovnkube-node-gjh9c\" (UID: \"a02c2727-c53c-48c3-aba7-acde4eef632c\") " pod="openshift-ovn-kubernetes/ovnkube-node-gjh9c"
May 26 15:17:43.606228 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:17:43.606136    2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/07693aae-634c-4a2f-ac21-fb1bf39c239a-kubelet-dir\") pod \"aws-ebs-csi-driver-node-vsvmw\" (UID: \"07693aae-634c-4a2f-ac21-fb1bf39c239a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vsvmw"
May 26 15:17:43.606228 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:17:43.606160    2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/07693aae-634c-4a2f-ac21-fb1bf39c239a-etc-selinux\") pod \"aws-ebs-csi-driver-node-vsvmw\" (UID: \"07693aae-634c-4a2f-ac21-fb1bf39c239a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vsvmw"
May 26 15:17:43.606363 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:17:43.606235    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/07693aae-634c-4a2f-ac21-fb1bf39c239a-etc-selinux\") pod \"aws-ebs-csi-driver-node-vsvmw\" (UID: \"07693aae-634c-4a2f-ac21-fb1bf39c239a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vsvmw"
May 26 15:17:43.606363 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:17:43.606237    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/07693aae-634c-4a2f-ac21-fb1bf39c239a-kubelet-dir\") pod \"aws-ebs-csi-driver-node-vsvmw\" (UID: \"07693aae-634c-4a2f-ac21-fb1bf39c239a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vsvmw"
May 26 15:17:43.606363 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:17:43.606309    2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9f965e2e-8e40-4ab4-b3cd-0d52ba317cf2-tmp-dir\") pod \"node-resolver-6j49h\" (UID: \"9f965e2e-8e40-4ab4-b3cd-0d52ba317cf2\") " pod="openshift-dns/node-resolver-6j49h"
May 26 15:17:43.606363 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:17:43.606336    2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-gxd45\" (UniqueName: \"kubernetes.io/projected/9f965e2e-8e40-4ab4-b3cd-0d52ba317cf2-kube-api-access-gxd45\") pod \"node-resolver-6j49h\" (UID: \"9f965e2e-8e40-4ab4-b3cd-0d52ba317cf2\") " pod="openshift-dns/node-resolver-6j49h"
May 26 15:17:43.606538 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:17:43.606364    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ae574985-4900-4b23-bf74-7c72c939f9bd-metrics-certs\") pod \"network-metrics-daemon-npzrf\" (UID: \"ae574985-4900-4b23-bf74-7c72c939f9bd\") " pod="openshift-multus/network-metrics-daemon-npzrf"
May 26 15:17:43.606538 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:17:43.606385    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/afbaeb5e-924a-4076-a161-94955178994c-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-bglww\" (UID: \"afbaeb5e-924a-4076-a161-94955178994c\") " pod="openshift-multus/multus-additional-cni-plugins-bglww"
May 26 15:17:43.606538 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:17:43.606406    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z2nc2\" (UniqueName: \"kubernetes.io/projected/afbaeb5e-924a-4076-a161-94955178994c-kube-api-access-z2nc2\") pod \"multus-additional-cni-plugins-bglww\" (UID: \"afbaeb5e-924a-4076-a161-94955178994c\") " pod="openshift-multus/multus-additional-cni-plugins-bglww"
May 26 15:17:43.606538 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:17:43.606432    2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/a02c2727-c53c-48c3-aba7-acde4eef632c-run-ovn\") pod \"ovnkube-node-gjh9c\" (UID: \"a02c2727-c53c-48c3-aba7-acde4eef632c\") " pod="openshift-ovn-kubernetes/ovnkube-node-gjh9c"
May 26 15:17:43.606538 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:17:43.606449    2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/9f965e2e-8e40-4ab4-b3cd-0d52ba317cf2-hosts-file\") pod \"node-resolver-6j49h\" (UID: \"9f965e2e-8e40-4ab4-b3cd-0d52ba317cf2\") " pod="openshift-dns/node-resolver-6j49h"
May 26 15:17:43.606538 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:17:43.606464    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d8nbr\" (UniqueName: \"kubernetes.io/projected/ae574985-4900-4b23-bf74-7c72c939f9bd-kube-api-access-d8nbr\") pod \"network-metrics-daemon-npzrf\" (UID: \"ae574985-4900-4b23-bf74-7c72c939f9bd\") " pod="openshift-multus/network-metrics-daemon-npzrf"
May 26 15:17:43.606538 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:17:43.606485    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/d861eb05-53c3-4d05-8dce-5a7c60573358-cnibin\") pod \"multus-x5ptz\" (UID: \"d861eb05-53c3-4d05-8dce-5a7c60573358\") " pod="openshift-multus/multus-x5ptz"
May 26 15:17:43.606538 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:17:43.606508    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/d861eb05-53c3-4d05-8dce-5a7c60573358-host-var-lib-cni-bin\") pod \"multus-x5ptz\" (UID: \"d861eb05-53c3-4d05-8dce-5a7c60573358\") " pod="openshift-multus/multus-x5ptz"
May 26 15:17:43.606538 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:17:43.606529    2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-cvg7t\" (UniqueName: \"kubernetes.io/projected/efa65a4e-8688-4521-bf81-8938e3041f72-kube-api-access-cvg7t\") pod \"iptables-alerter-nprns\" (UID: \"efa65a4e-8688-4521-bf81-8938e3041f72\") " pod="openshift-network-operator/iptables-alerter-nprns"
May 26 15:17:43.606902 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:17:43.606549    2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/be858157-7e73-43be-81e8-aa5e9344923e-original-pull-secret\") pod \"global-pull-secret-syncer-k56cd\" (UID: \"be858157-7e73-43be-81e8-aa5e9344923e\") " pod="kube-system/global-pull-secret-syncer-k56cd"
May 26 15:17:43.606902 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:17:43.606579    2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-52vlc\" (UniqueName: \"kubernetes.io/projected/706d11ce-61db-4788-83f2-2ffbea860487-kube-api-access-52vlc\") pod \"node-ca-khnr9\" (UID: \"706d11ce-61db-4788-83f2-2ffbea860487\") " pod="openshift-image-registry/node-ca-khnr9"
May 26 15:17:43.606902 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:17:43.606601    2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/66fc90a9-1fd5-46e0-aa1a-895166fc81b8-agent-certs\") pod \"konnectivity-agent-5nngw\" (UID: \"66fc90a9-1fd5-46e0-aa1a-895166fc81b8\") " pod="kube-system/konnectivity-agent-5nngw"
May 26 15:17:43.606902 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:17:43.606626    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/d861eb05-53c3-4d05-8dce-5a7c60573358-host-run-multus-certs\") pod \"multus-x5ptz\" (UID: \"d861eb05-53c3-4d05-8dce-5a7c60573358\") " pod="openshift-multus/multus-x5ptz"
May 26 15:17:43.606902 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:17:43.606650    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d861eb05-53c3-4d05-8dce-5a7c60573358-etc-kubernetes\") pod \"multus-x5ptz\" (UID: \"d861eb05-53c3-4d05-8dce-5a7c60573358\") " pod="openshift-multus/multus-x5ptz"
May 26 15:17:43.606902 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:17:43.606668    2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/a02c2727-c53c-48c3-aba7-acde4eef632c-host-cni-netd\") pod \"ovnkube-node-gjh9c\" (UID: \"a02c2727-c53c-48c3-aba7-acde4eef632c\") " pod="openshift-ovn-kubernetes/ovnkube-node-gjh9c"
May 26 15:17:43.606902 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:17:43.606683    2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/1817fb6f-f287-4f86-b684-9b9132f3561a-etc-sysctl-d\") pod \"tuned-9rvq6\" (UID: \"1817fb6f-f287-4f86-b684-9b9132f3561a\") " pod="openshift-cluster-node-tuning-operator/tuned-9rvq6"
May 26 15:17:43.606902 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:17:43.606718    2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/1817fb6f-f287-4f86-b684-9b9132f3561a-host\") pod \"tuned-9rvq6\" (UID: \"1817fb6f-f287-4f86-b684-9b9132f3561a\") " pod="openshift-cluster-node-tuning-operator/tuned-9rvq6"
May 26 15:17:43.606902 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:17:43.606746    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/afbaeb5e-924a-4076-a161-94955178994c-system-cni-dir\") pod \"multus-additional-cni-plugins-bglww\" (UID: \"afbaeb5e-924a-4076-a161-94955178994c\") " pod="openshift-multus/multus-additional-cni-plugins-bglww"
May 26 15:17:43.606902 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:17:43.606765    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/afbaeb5e-924a-4076-a161-94955178994c-cni-binary-copy\") pod \"multus-additional-cni-plugins-bglww\" (UID: \"afbaeb5e-924a-4076-a161-94955178994c\") " pod="openshift-multus/multus-additional-cni-plugins-bglww"
May 26 15:17:43.606902 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:17:43.606792    2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/be858157-7e73-43be-81e8-aa5e9344923e-kubelet-config\") pod \"global-pull-secret-syncer-k56cd\" (UID: \"be858157-7e73-43be-81e8-aa5e9344923e\") " pod="kube-system/global-pull-secret-syncer-k56cd"
May 26 15:17:43.606902 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:17:43.606816    2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/a02c2727-c53c-48c3-aba7-acde4eef632c-ovn-node-metrics-cert\") pod \"ovnkube-node-gjh9c\" (UID: \"a02c2727-c53c-48c3-aba7-acde4eef632c\") " pod="openshift-ovn-kubernetes/ovnkube-node-gjh9c"
May 26 15:17:43.606902 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:17:43.606820    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/a02c2727-c53c-48c3-aba7-acde4eef632c-ovnkube-config\") pod \"ovnkube-node-gjh9c\" (UID: \"a02c2727-c53c-48c3-aba7-acde4eef632c\") " pod="openshift-ovn-kubernetes/ovnkube-node-gjh9c"
May 26 15:17:43.606902 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:17:43.606833    2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/1817fb6f-f287-4f86-b684-9b9132f3561a-etc-sysctl-conf\") pod \"tuned-9rvq6\" (UID: \"1817fb6f-f287-4f86-b684-9b9132f3561a\") " pod="openshift-cluster-node-tuning-operator/tuned-9rvq6"
May 26 15:17:43.606902 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:17:43.606849    2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/07693aae-634c-4a2f-ac21-fb1bf39c239a-sys-fs\") pod \"aws-ebs-csi-driver-node-vsvmw\" (UID: \"07693aae-634c-4a2f-ac21-fb1bf39c239a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vsvmw"
May 26 15:17:43.606902 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:17:43.606890    2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/706d11ce-61db-4788-83f2-2ffbea860487-serviceca\") pod \"node-ca-khnr9\" (UID: \"706d11ce-61db-4788-83f2-2ffbea860487\") " pod="openshift-image-registry/node-ca-khnr9"
May 26 15:17:43.606902 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:17:43.606897    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/07693aae-634c-4a2f-ac21-fb1bf39c239a-sys-fs\") pod \"aws-ebs-csi-driver-node-vsvmw\" (UID: \"07693aae-634c-4a2f-ac21-fb1bf39c239a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vsvmw"
May 26 15:17:43.607602 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:17:43.606924    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/d861eb05-53c3-4d05-8dce-5a7c60573358-hostroot\") pod \"multus-x5ptz\" (UID: \"d861eb05-53c3-4d05-8dce-5a7c60573358\") " pod="openshift-multus/multus-x5ptz"
May 26 15:17:43.607602 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:17:43.606954    2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-m9l98\" (UniqueName: \"kubernetes.io/projected/000947e2-0eeb-4d43-8dc4-6132e5e6cc13-kube-api-access-m9l98\") pod \"network-check-target-qr6zm\" (UID: \"000947e2-0eeb-4d43-8dc4-6132e5e6cc13\") " pod="openshift-network-diagnostics/network-check-target-qr6zm"
May 26 15:17:43.607602 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:17:43.606982    2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/1817fb6f-f287-4f86-b684-9b9132f3561a-etc-tuned\") pod \"tuned-9rvq6\" (UID: \"1817fb6f-f287-4f86-b684-9b9132f3561a\") " pod="openshift-cluster-node-tuning-operator/tuned-9rvq6"
May 26 15:17:43.607602 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:17:43.607009    2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-z2jtx\" (UniqueName: \"kubernetes.io/projected/07693aae-634c-4a2f-ac21-fb1bf39c239a-kube-api-access-z2jtx\") pod \"aws-ebs-csi-driver-node-vsvmw\" (UID: \"07693aae-634c-4a2f-ac21-fb1bf39c239a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vsvmw"
May 26 15:17:43.607602 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:17:43.607036    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/d861eb05-53c3-4d05-8dce-5a7c60573358-host-var-lib-cni-multus\") pod \"multus-x5ptz\" (UID: \"d861eb05-53c3-4d05-8dce-5a7c60573358\") " pod="openshift-multus/multus-x5ptz"
May 26 15:17:43.607602 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:17:43.607062    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/afbaeb5e-924a-4076-a161-94955178994c-cnibin\") pod \"multus-additional-cni-plugins-bglww\" (UID: \"afbaeb5e-924a-4076-a161-94955178994c\") " pod="openshift-multus/multus-additional-cni-plugins-bglww"
May 26 15:17:43.607602 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:17:43.607087    2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/efa65a4e-8688-4521-bf81-8938e3041f72-iptables-alerter-script\") pod \"iptables-alerter-nprns\" (UID: \"efa65a4e-8688-4521-bf81-8938e3041f72\") " pod="openshift-network-operator/iptables-alerter-nprns"
May 26 15:17:43.607602 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:17:43.607115    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/d861eb05-53c3-4d05-8dce-5a7c60573358-cni-binary-copy\") pod \"multus-x5ptz\" (UID: \"d861eb05-53c3-4d05-8dce-5a7c60573358\") " pod="openshift-multus/multus-x5ptz"
May 26 15:17:43.607602 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:17:43.607141    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/afbaeb5e-924a-4076-a161-94955178994c-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-bglww\" (UID: \"afbaeb5e-924a-4076-a161-94955178994c\") " pod="openshift-multus/multus-additional-cni-plugins-bglww"
May 26 15:17:43.607602 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:17:43.607148    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9f965e2e-8e40-4ab4-b3cd-0d52ba317cf2-tmp-dir\") pod \"node-resolver-6j49h\" (UID: \"9f965e2e-8e40-4ab4-b3cd-0d52ba317cf2\") " pod="openshift-dns/node-resolver-6j49h"
May 26 15:17:43.607602 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:17:43.607171    2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a02c2727-c53c-48c3-aba7-acde4eef632c-etc-openvswitch\") pod \"ovnkube-node-gjh9c\" (UID: \"a02c2727-c53c-48c3-aba7-acde4eef632c\") " pod="openshift-ovn-kubernetes/ovnkube-node-gjh9c"
May 26 15:17:43.607602 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:17:43.607212    2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-dgsgr\" (UniqueName: \"kubernetes.io/projected/1817fb6f-f287-4f86-b684-9b9132f3561a-kube-api-access-dgsgr\") pod \"tuned-9rvq6\" (UID: \"1817fb6f-f287-4f86-b684-9b9132f3561a\") " pod="openshift-cluster-node-tuning-operator/tuned-9rvq6"
May 26 15:17:43.607602 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:17:43.607223    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a02c2727-c53c-48c3-aba7-acde4eef632c-etc-openvswitch\") pod \"ovnkube-node-gjh9c\" (UID: \"a02c2727-c53c-48c3-aba7-acde4eef632c\") " pod="openshift-ovn-kubernetes/ovnkube-node-gjh9c"
May 26 15:17:43.607602 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:17:43.607241    2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/07693aae-634c-4a2f-ac21-fb1bf39c239a-socket-dir\") pod \"aws-ebs-csi-driver-node-vsvmw\" (UID: \"07693aae-634c-4a2f-ac21-fb1bf39c239a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vsvmw"
May 26 15:17:43.607602 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:17:43.607292    2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/07693aae-634c-4a2f-ac21-fb1bf39c239a-registration-dir\") pod \"aws-ebs-csi-driver-node-vsvmw\" (UID: \"07693aae-634c-4a2f-ac21-fb1bf39c239a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vsvmw"
May 26 15:17:43.607602 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:17:43.607323    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/d861eb05-53c3-4d05-8dce-5a7c60573358-os-release\") pod \"multus-x5ptz\" (UID: \"d861eb05-53c3-4d05-8dce-5a7c60573358\") " pod="openshift-multus/multus-x5ptz"
May 26 15:17:43.607602 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:17:43.607351    2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/a02c2727-c53c-48c3-aba7-acde4eef632c-host-slash\") pod \"ovnkube-node-gjh9c\" (UID: \"a02c2727-c53c-48c3-aba7-acde4eef632c\") " pod="openshift-ovn-kubernetes/ovnkube-node-gjh9c"
May 26 15:17:43.608308 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:17:43.607614    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/706d11ce-61db-4788-83f2-2ffbea860487-serviceca\") pod \"node-ca-khnr9\" (UID: \"706d11ce-61db-4788-83f2-2ffbea860487\") " pod="openshift-image-registry/node-ca-khnr9"
May 26 15:17:43.608308 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:17:43.607844    2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/a02c2727-c53c-48c3-aba7-acde4eef632c-node-log\") pod \"ovnkube-node-gjh9c\" (UID: \"a02c2727-c53c-48c3-aba7-acde4eef632c\") " pod="openshift-ovn-kubernetes/ovnkube-node-gjh9c"
May 26 15:17:43.608308 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:17:43.607882    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d861eb05-53c3-4d05-8dce-5a7c60573358-multus-cni-dir\") pod \"multus-x5ptz\" (UID: \"d861eb05-53c3-4d05-8dce-5a7c60573358\") " pod="openshift-multus/multus-x5ptz"
May 26 15:17:43.608308 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:17:43.607911    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/d861eb05-53c3-4d05-8dce-5a7c60573358-multus-conf-dir\") pod \"multus-x5ptz\" (UID: \"d861eb05-53c3-4d05-8dce-5a7c60573358\") " pod="openshift-multus/multus-x5ptz"
May 26 15:17:43.608308 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:17:43.607937    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/d861eb05-53c3-4d05-8dce-5a7c60573358-multus-daemon-config\") pod \"multus-x5ptz\" (UID: \"d861eb05-53c3-4d05-8dce-5a7c60573358\") " pod="openshift-multus/multus-x5ptz"
May 26 15:17:43.608308 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:17:43.607961    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/afbaeb5e-924a-4076-a161-94955178994c-tuning-conf-dir\") pod \"multus-additional-cni-plugins-bglww\" (UID: \"afbaeb5e-924a-4076-a161-94955178994c\") " pod="openshift-multus/multus-additional-cni-plugins-bglww"
May 26 15:17:43.608308 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:17:43.607987    2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/1817fb6f-f287-4f86-b684-9b9132f3561a-etc-modprobe-d\") pod \"tuned-9rvq6\" (UID: \"1817fb6f-f287-4f86-b684-9b9132f3561a\") " pod="openshift-cluster-node-tuning-operator/tuned-9rvq6"
May 26 15:17:43.608308 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:17:43.608011    2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/1817fb6f-f287-4f86-b684-9b9132f3561a-run\") pod \"tuned-9rvq6\" (UID: \"1817fb6f-f287-4f86-b684-9b9132f3561a\") " pod="openshift-cluster-node-tuning-operator/tuned-9rvq6"
May 26 15:17:43.608308 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:17:43.608037    2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/a02c2727-c53c-48c3-aba7-acde4eef632c-systemd-units\") pod \"ovnkube-node-gjh9c\" (UID: \"a02c2727-c53c-48c3-aba7-acde4eef632c\") " pod="openshift-ovn-kubernetes/ovnkube-node-gjh9c"
May 26 15:17:43.608308 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:17:43.608065    2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a02c2727-c53c-48c3-aba7-acde4eef632c-run-openvswitch\") pod \"ovnkube-node-gjh9c\" (UID: \"a02c2727-c53c-48c3-aba7-acde4eef632c\") " pod="openshift-ovn-kubernetes/ovnkube-node-gjh9c"
May 26 15:17:43.608308 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:17:43.608098    2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a02c2727-c53c-48c3-aba7-acde4eef632c-host-run-ovn-kubernetes\") pod \"ovnkube-node-gjh9c\" (UID: \"a02c2727-c53c-48c3-aba7-acde4eef632c\") " pod="openshift-ovn-kubernetes/ovnkube-node-gjh9c"
May 26 15:17:43.608308 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:17:43.608117    2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/a02c2727-c53c-48c3-aba7-acde4eef632c-host-cni-bin\") pod \"ovnkube-node-gjh9c\" (UID: \"a02c2727-c53c-48c3-aba7-acde4eef632c\") " pod="openshift-ovn-kubernetes/ovnkube-node-gjh9c"
May 26 15:17:43.608308 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:17:43.608132    2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/a02c2727-c53c-48c3-aba7-acde4eef632c-env-overrides\") pod \"ovnkube-node-gjh9c\" (UID: \"a02c2727-c53c-48c3-aba7-acde4eef632c\") " pod="openshift-ovn-kubernetes/ovnkube-node-gjh9c"
May 26 15:17:43.608308 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:17:43.608147    2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/a02c2727-c53c-48c3-aba7-acde4eef632c-ovnkube-script-lib\") pod \"ovnkube-node-gjh9c\" (UID: \"a02c2727-c53c-48c3-aba7-acde4eef632c\") " pod="openshift-ovn-kubernetes/ovnkube-node-gjh9c"
May 26 15:17:43.608308 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:17:43.608167    2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/07693aae-634c-4a2f-ac21-fb1bf39c239a-device-dir\") pod \"aws-ebs-csi-driver-node-vsvmw\" (UID: \"07693aae-634c-4a2f-ac21-fb1bf39c239a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vsvmw"
May 26 15:17:43.608308 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:17:43.608191    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/d861eb05-53c3-4d05-8dce-5a7c60573358-multus-socket-dir-parent\") pod \"multus-x5ptz\" (UID: \"d861eb05-53c3-4d05-8dce-5a7c60573358\") " pod="openshift-multus/multus-x5ptz"
May 26 15:17:43.608308 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:17:43.608218    2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/a02c2727-c53c-48c3-aba7-acde4eef632c-host-kubelet\") pod \"ovnkube-node-gjh9c\" (UID: \"a02c2727-c53c-48c3-aba7-acde4eef632c\") " pod="openshift-ovn-kubernetes/ovnkube-node-gjh9c"
May 26 15:17:43.608953 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:17:43.608243    2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/a02c2727-c53c-48c3-aba7-acde4eef632c-host-run-netns\") pod \"ovnkube-node-gjh9c\" (UID: \"a02c2727-c53c-48c3-aba7-acde4eef632c\") " pod="openshift-ovn-kubernetes/ovnkube-node-gjh9c"
May 26 15:17:43.608953 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:17:43.608286    2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/1817fb6f-f287-4f86-b684-9b9132f3561a-etc-systemd\") pod \"tuned-9rvq6\" (UID: \"1817fb6f-f287-4f86-b684-9b9132f3561a\") " pod="openshift-cluster-node-tuning-operator/tuned-9rvq6"
May 26 15:17:43.608953 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:17:43.608309    2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/1817fb6f-f287-4f86-b684-9b9132f3561a-sys\") pod \"tuned-9rvq6\" (UID: \"1817fb6f-f287-4f86-b684-9b9132f3561a\") " pod="openshift-cluster-node-tuning-operator/tuned-9rvq6"
May 26 15:17:43.608953 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:17:43.608329    2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/1817fb6f-f287-4f86-b684-9b9132f3561a-lib-modules\") pod \"tuned-9rvq6\" (UID: \"1817fb6f-f287-4f86-b684-9b9132f3561a\") " pod="openshift-cluster-node-tuning-operator/tuned-9rvq6"
May 26 15:17:43.608953 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:17:43.608344    2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/1817fb6f-f287-4f86-b684-9b9132f3561a-var-lib-kubelet\") pod \"tuned-9rvq6\" (UID: \"1817fb6f-f287-4f86-b684-9b9132f3561a\") " pod="openshift-cluster-node-tuning-operator/tuned-9rvq6"
May 26 15:17:43.608953 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:17:43.608366    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d861eb05-53c3-4d05-8dce-5a7c60573358-host-var-lib-kubelet\") pod \"multus-x5ptz\" (UID: \"d861eb05-53c3-4d05-8dce-5a7c60573358\") " pod="openshift-multus/multus-x5ptz"
May 26 15:17:43.608953 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:17:43.608396    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-78tzg\" (UniqueName: \"kubernetes.io/projected/d861eb05-53c3-4d05-8dce-5a7c60573358-kube-api-access-78tzg\") pod \"multus-x5ptz\" (UID: \"d861eb05-53c3-4d05-8dce-5a7c60573358\") " pod="openshift-multus/multus-x5ptz"
May 26 15:17:43.608953 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:17:43.608424    2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/efa65a4e-8688-4521-bf81-8938e3041f72-host-slash\") pod \"iptables-alerter-nprns\" (UID: \"efa65a4e-8688-4521-bf81-8938e3041f72\") " pod="openshift-network-operator/iptables-alerter-nprns"
May 26 15:17:43.608953 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:17:43.608450    2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/a02c2727-c53c-48c3-aba7-acde4eef632c-run-systemd\") pod \"ovnkube-node-gjh9c\" (UID: \"a02c2727-c53c-48c3-aba7-acde4eef632c\") " pod="openshift-ovn-kubernetes/ovnkube-node-gjh9c"
May 26 15:17:43.608953 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:17:43.608477    2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/a02c2727-c53c-48c3-aba7-acde4eef632c-log-socket\") pod \"ovnkube-node-gjh9c\" (UID: \"a02c2727-c53c-48c3-aba7-acde4eef632c\") " pod="openshift-ovn-kubernetes/ovnkube-node-gjh9c"
May 26 15:17:43.608953 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:17:43.608501    2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/66fc90a9-1fd5-46e0-aa1a-895166fc81b8-konnectivity-ca\") pod \"konnectivity-agent-5nngw\" (UID: \"66fc90a9-1fd5-46e0-aa1a-895166fc81b8\") " pod="kube-system/konnectivity-agent-5nngw"
May 26 15:17:43.608953 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:17:43.608510    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/efa65a4e-8688-4521-bf81-8938e3041f72-iptables-alerter-script\") pod \"iptables-alerter-nprns\" (UID: \"efa65a4e-8688-4521-bf81-8938e3041f72\") " pod="openshift-network-operator/iptables-alerter-nprns"
May 26 15:17:43.608953 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:17:43.608531    2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-mlmct\" (UniqueName: \"kubernetes.io/projected/a02c2727-c53c-48c3-aba7-acde4eef632c-kube-api-access-mlmct\") pod \"ovnkube-node-gjh9c\" (UID: \"a02c2727-c53c-48c3-aba7-acde4eef632c\") " pod="openshift-ovn-kubernetes/ovnkube-node-gjh9c"
May 26 15:17:43.608953 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:17:43.608552    2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/706d11ce-61db-4788-83f2-2ffbea860487-host\") pod \"node-ca-khnr9\" (UID: \"706d11ce-61db-4788-83f2-2ffbea860487\") " pod="openshift-image-registry/node-ca-khnr9"
May 26 15:17:43.608953 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:17:43.608576    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d861eb05-53c3-4d05-8dce-5a7c60573358-system-cni-dir\") pod \"multus-x5ptz\" (UID: \"d861eb05-53c3-4d05-8dce-5a7c60573358\") " pod="openshift-multus/multus-x5ptz"
May 26 15:17:43.608953 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:17:43.608596    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/a02c2727-c53c-48c3-aba7-acde4eef632c-node-log\") pod \"ovnkube-node-gjh9c\" (UID: \"a02c2727-c53c-48c3-aba7-acde4eef632c\") " pod="openshift-ovn-kubernetes/ovnkube-node-gjh9c"
May 26 15:17:43.608953 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:17:43.608599    2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/be858157-7e73-43be-81e8-aa5e9344923e-dbus\") pod \"global-pull-secret-syncer-k56cd\" (UID: \"be858157-7e73-43be-81e8-aa5e9344923e\") " pod="kube-system/global-pull-secret-syncer-k56cd"
May 26 15:17:43.609666 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:17:43.608648    2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a02c2727-c53c-48c3-aba7-acde4eef632c-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-gjh9c\" (UID: \"a02c2727-c53c-48c3-aba7-acde4eef632c\") " pod="openshift-ovn-kubernetes/ovnkube-node-gjh9c"
May 26 15:17:43.609666 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:17:43.608671    2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1817fb6f-f287-4f86-b684-9b9132f3561a-etc-kubernetes\") pod \"tuned-9rvq6\" (UID: \"1817fb6f-f287-4f86-b684-9b9132f3561a\") " pod="openshift-cluster-node-tuning-operator/tuned-9rvq6"
May 26 15:17:43.609666 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:17:43.608699    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/afbaeb5e-924a-4076-a161-94955178994c-os-release\") pod \"multus-additional-cni-plugins-bglww\" (UID: \"afbaeb5e-924a-4076-a161-94955178994c\") " pod="openshift-multus/multus-additional-cni-plugins-bglww"
May 26 15:17:43.609666 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:17:43.608726    2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a02c2727-c53c-48c3-aba7-acde4eef632c-var-lib-openvswitch\") pod \"ovnkube-node-gjh9c\" (UID: \"a02c2727-c53c-48c3-aba7-acde4eef632c\") " pod="openshift-ovn-kubernetes/ovnkube-node-gjh9c"
May 26 15:17:43.609666 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:17:43.608736    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/be858157-7e73-43be-81e8-aa5e9344923e-dbus\") pod \"global-pull-secret-syncer-k56cd\" (UID: \"be858157-7e73-43be-81e8-aa5e9344923e\") " pod="kube-system/global-pull-secret-syncer-k56cd"
May 26 15:17:43.609666 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:17:43.608752    2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/1817fb6f-f287-4f86-b684-9b9132f3561a-etc-sysconfig\") pod \"tuned-9rvq6\" (UID: \"1817fb6f-f287-4f86-b684-9b9132f3561a\") " pod="openshift-cluster-node-tuning-operator/tuned-9rvq6"
May 26 15:17:43.609666 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:17:43.608780    2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1817fb6f-f287-4f86-b684-9b9132f3561a-tmp\") pod \"tuned-9rvq6\" (UID: \"1817fb6f-f287-4f86-b684-9b9132f3561a\") " pod="openshift-cluster-node-tuning-operator/tuned-9rvq6"
May 26 15:17:43.609666 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:17:43.608976    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/1817fb6f-f287-4f86-b684-9b9132f3561a-etc-sysconfig\") pod \"tuned-9rvq6\" (UID: \"1817fb6f-f287-4f86-b684-9b9132f3561a\") " pod="openshift-cluster-node-tuning-operator/tuned-9rvq6"
May 26 15:17:43.609666 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:17:43.609006    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/d861eb05-53c3-4d05-8dce-5a7c60573358-host-run-k8s-cni-cncf-io\") pod \"multus-x5ptz\" (UID: \"d861eb05-53c3-4d05-8dce-5a7c60573358\") " pod="openshift-multus/multus-x5ptz"
May 26 15:17:43.609666 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:17:43.609006    2581 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
May 26 15:17:43.609666 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:17:43.609029    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/d861eb05-53c3-4d05-8dce-5a7c60573358-host-run-netns\") pod \"multus-x5ptz\" (UID: \"d861eb05-53c3-4d05-8dce-5a7c60573358\") " pod="openshift-multus/multus-x5ptz"
May 26 15:17:43.609666 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:17:43.609334    2581 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-05-25 15:12:42 +0000 UTC" deadline="2027-10-23 13:25:29.253471 +0000 UTC"
May 26 15:17:43.609666 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:17:43.609357    2581 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12358h7m45.644117466s"
May 26 15:17:43.609666 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:17:43.609368    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/a02c2727-c53c-48c3-aba7-acde4eef632c-host-kubelet\") pod \"ovnkube-node-gjh9c\" (UID: \"a02c2727-c53c-48c3-aba7-acde4eef632c\") " pod="openshift-ovn-kubernetes/ovnkube-node-gjh9c"
May 26 15:17:43.609666 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:17:43.609382    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a02c2727-c53c-48c3-aba7-acde4eef632c-run-openvswitch\") pod \"ovnkube-node-gjh9c\" (UID: \"a02c2727-c53c-48c3-aba7-acde4eef632c\") " pod="openshift-ovn-kubernetes/ovnkube-node-gjh9c"
May 26 15:17:43.609666 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:17:43.609433    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a02c2727-c53c-48c3-aba7-acde4eef632c-host-run-ovn-kubernetes\") pod \"ovnkube-node-gjh9c\" (UID: \"a02c2727-c53c-48c3-aba7-acde4eef632c\") " pod="openshift-ovn-kubernetes/ovnkube-node-gjh9c"
May 26 15:17:43.609666 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:17:43.609454    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/1817fb6f-f287-4f86-b684-9b9132f3561a-run\") pod \"tuned-9rvq6\" (UID: \"1817fb6f-f287-4f86-b684-9b9132f3561a\") " pod="openshift-cluster-node-tuning-operator/tuned-9rvq6"
May 26 15:17:43.609666 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:17:43.609479    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/1817fb6f-f287-4f86-b684-9b9132f3561a-etc-modprobe-d\") pod \"tuned-9rvq6\" (UID: \"1817fb6f-f287-4f86-b684-9b9132f3561a\") " pod="openshift-cluster-node-tuning-operator/tuned-9rvq6"
May 26 15:17:43.610549 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:17:43.609483    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/a02c2727-c53c-48c3-aba7-acde4eef632c-host-cni-bin\") pod \"ovnkube-node-gjh9c\" (UID: \"a02c2727-c53c-48c3-aba7-acde4eef632c\") " pod="openshift-ovn-kubernetes/ovnkube-node-gjh9c"
May 26 15:17:43.610549 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:17:43.609506    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/a02c2727-c53c-48c3-aba7-acde4eef632c-systemd-units\") pod \"ovnkube-node-gjh9c\" (UID: \"a02c2727-c53c-48c3-aba7-acde4eef632c\") " pod="openshift-ovn-kubernetes/ovnkube-node-gjh9c"
May 26 15:17:43.610549 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:17:43.609560    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/a02c2727-c53c-48c3-aba7-acde4eef632c-host-run-netns\") pod \"ovnkube-node-gjh9c\" (UID: \"a02c2727-c53c-48c3-aba7-acde4eef632c\") " pod="openshift-ovn-kubernetes/ovnkube-node-gjh9c"
May 26 15:17:43.610549 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:17:43.609562    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/1817fb6f-f287-4f86-b684-9b9132f3561a-etc-sysctl-d\") pod \"tuned-9rvq6\" (UID: \"1817fb6f-f287-4f86-b684-9b9132f3561a\") " pod="openshift-cluster-node-tuning-operator/tuned-9rvq6"
May 26 15:17:43.610549 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:17:43.609606    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/a02c2727-c53c-48c3-aba7-acde4eef632c-run-ovn\") pod \"ovnkube-node-gjh9c\" (UID: \"a02c2727-c53c-48c3-aba7-acde4eef632c\") " pod="openshift-ovn-kubernetes/ovnkube-node-gjh9c"
May 26 15:17:43.610549 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:17:43.609608    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/1817fb6f-f287-4f86-b684-9b9132f3561a-etc-systemd\") pod \"tuned-9rvq6\" (UID: \"1817fb6f-f287-4f86-b684-9b9132f3561a\") " pod="openshift-cluster-node-tuning-operator/tuned-9rvq6"
May 26 15:17:43.610549 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:17:43.609636    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/1817fb6f-f287-4f86-b684-9b9132f3561a-sys\") pod \"tuned-9rvq6\" (UID: \"1817fb6f-f287-4f86-b684-9b9132f3561a\") " pod="openshift-cluster-node-tuning-operator/tuned-9rvq6"
May 26 15:17:43.610549 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:17:43.609646    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/9f965e2e-8e40-4ab4-b3cd-0d52ba317cf2-hosts-file\") pod \"node-resolver-6j49h\" (UID: \"9f965e2e-8e40-4ab4-b3cd-0d52ba317cf2\") " pod="openshift-dns/node-resolver-6j49h"
May 26 15:17:43.610549 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:17:43.609694    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/1817fb6f-f287-4f86-b684-9b9132f3561a-lib-modules\") pod \"tuned-9rvq6\" (UID: \"1817fb6f-f287-4f86-b684-9b9132f3561a\") " pod="openshift-cluster-node-tuning-operator/tuned-9rvq6"
May 26 15:17:43.610549 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:17:43.609721    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/1817fb6f-f287-4f86-b684-9b9132f3561a-var-lib-kubelet\") pod \"tuned-9rvq6\" (UID: \"1817fb6f-f287-4f86-b684-9b9132f3561a\") " pod="openshift-cluster-node-tuning-operator/tuned-9rvq6"
May 26 15:17:43.610549 ip-10-0-140-164 kubenswrapper[2581]: E0526 15:17:43.609815    2581 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
May 26 15:17:43.610549 ip-10-0-140-164 kubenswrapper[2581]: E0526 15:17:43.609869    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/be858157-7e73-43be-81e8-aa5e9344923e-original-pull-secret podName:be858157-7e73-43be-81e8-aa5e9344923e nodeName:}" failed. No retries permitted until 2026-05-26 15:17:44.109846703 +0000 UTC m=+3.107550035 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/be858157-7e73-43be-81e8-aa5e9344923e-original-pull-secret") pod "global-pull-secret-syncer-k56cd" (UID: "be858157-7e73-43be-81e8-aa5e9344923e") : object "kube-system"/"original-pull-secret" not registered
May 26 15:17:43.610549 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:17:43.609868    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/a02c2727-c53c-48c3-aba7-acde4eef632c-env-overrides\") pod \"ovnkube-node-gjh9c\" (UID: \"a02c2727-c53c-48c3-aba7-acde4eef632c\") " pod="openshift-ovn-kubernetes/ovnkube-node-gjh9c"
May 26 15:17:43.610549 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:17:43.609901    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/efa65a4e-8688-4521-bf81-8938e3041f72-host-slash\") pod \"iptables-alerter-nprns\" (UID: \"efa65a4e-8688-4521-bf81-8938e3041f72\") " pod="openshift-network-operator/iptables-alerter-nprns"
May 26 15:17:43.610549 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:17:43.609929    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/a02c2727-c53c-48c3-aba7-acde4eef632c-run-systemd\") pod \"ovnkube-node-gjh9c\" (UID: \"a02c2727-c53c-48c3-aba7-acde4eef632c\") " pod="openshift-ovn-kubernetes/ovnkube-node-gjh9c"
May 26 15:17:43.610549 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:17:43.609967    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/a02c2727-c53c-48c3-aba7-acde4eef632c-log-socket\") pod \"ovnkube-node-gjh9c\" (UID: \"a02c2727-c53c-48c3-aba7-acde4eef632c\") " pod="openshift-ovn-kubernetes/ovnkube-node-gjh9c"
May 26 15:17:43.610549 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:17:43.610041    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/07693aae-634c-4a2f-ac21-fb1bf39c239a-socket-dir\") pod \"aws-ebs-csi-driver-node-vsvmw\" (UID: \"07693aae-634c-4a2f-ac21-fb1bf39c239a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vsvmw"
May 26 15:17:43.610549 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:17:43.610067    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/1817fb6f-f287-4f86-b684-9b9132f3561a-host\") pod \"tuned-9rvq6\" (UID: \"1817fb6f-f287-4f86-b684-9b9132f3561a\") " pod="openshift-cluster-node-tuning-operator/tuned-9rvq6"
May 26 15:17:43.611428 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:17:43.610093    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/be858157-7e73-43be-81e8-aa5e9344923e-kubelet-config\") pod \"global-pull-secret-syncer-k56cd\" (UID: \"be858157-7e73-43be-81e8-aa5e9344923e\") " pod="kube-system/global-pull-secret-syncer-k56cd"
May 26 15:17:43.611428 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:17:43.610349    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/66fc90a9-1fd5-46e0-aa1a-895166fc81b8-konnectivity-ca\") pod \"konnectivity-agent-5nngw\" (UID: \"66fc90a9-1fd5-46e0-aa1a-895166fc81b8\") " pod="kube-system/konnectivity-agent-5nngw"
May 26 15:17:43.611428 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:17:43.610396    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/1817fb6f-f287-4f86-b684-9b9132f3561a-etc-sysctl-conf\") pod \"tuned-9rvq6\" (UID: \"1817fb6f-f287-4f86-b684-9b9132f3561a\") " pod="openshift-cluster-node-tuning-operator/tuned-9rvq6"
May 26 15:17:43.611428 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:17:43.610452    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/706d11ce-61db-4788-83f2-2ffbea860487-host\") pod \"node-ca-khnr9\" (UID: \"706d11ce-61db-4788-83f2-2ffbea860487\") " pod="openshift-image-registry/node-ca-khnr9"
May 26 15:17:43.611428 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:17:43.610803    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/a02c2727-c53c-48c3-aba7-acde4eef632c-ovnkube-script-lib\") pod \"ovnkube-node-gjh9c\" (UID: \"a02c2727-c53c-48c3-aba7-acde4eef632c\") " pod="openshift-ovn-kubernetes/ovnkube-node-gjh9c"
May 26 15:17:43.611428 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:17:43.610843    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a02c2727-c53c-48c3-aba7-acde4eef632c-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-gjh9c\" (UID: \"a02c2727-c53c-48c3-aba7-acde4eef632c\") " pod="openshift-ovn-kubernetes/ovnkube-node-gjh9c"
May 26 15:17:43.611428 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:17:43.610870    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/07693aae-634c-4a2f-ac21-fb1bf39c239a-device-dir\") pod \"aws-ebs-csi-driver-node-vsvmw\" (UID: \"07693aae-634c-4a2f-ac21-fb1bf39c239a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vsvmw"
May 26 15:17:43.611428 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:17:43.610897    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/07693aae-634c-4a2f-ac21-fb1bf39c239a-registration-dir\") pod \"aws-ebs-csi-driver-node-vsvmw\" (UID: \"07693aae-634c-4a2f-ac21-fb1bf39c239a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vsvmw"
May 26 15:17:43.611428 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:17:43.610944    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/a02c2727-c53c-48c3-aba7-acde4eef632c-host-cni-netd\") pod \"ovnkube-node-gjh9c\" (UID: \"a02c2727-c53c-48c3-aba7-acde4eef632c\") " pod="openshift-ovn-kubernetes/ovnkube-node-gjh9c"
May 26 15:17:43.611428 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:17:43.610967    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/a02c2727-c53c-48c3-aba7-acde4eef632c-host-slash\") pod \"ovnkube-node-gjh9c\" (UID: \"a02c2727-c53c-48c3-aba7-acde4eef632c\") " pod="openshift-ovn-kubernetes/ovnkube-node-gjh9c"
May 26 15:17:43.611428 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:17:43.610994    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1817fb6f-f287-4f86-b684-9b9132f3561a-etc-kubernetes\") pod \"tuned-9rvq6\" (UID: \"1817fb6f-f287-4f86-b684-9b9132f3561a\") " pod="openshift-cluster-node-tuning-operator/tuned-9rvq6"
May 26 15:17:43.611428 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:17:43.611043    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a02c2727-c53c-48c3-aba7-acde4eef632c-var-lib-openvswitch\") pod \"ovnkube-node-gjh9c\" (UID: \"a02c2727-c53c-48c3-aba7-acde4eef632c\") " pod="openshift-ovn-kubernetes/ovnkube-node-gjh9c"
May 26 15:17:43.612247 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:17:43.612227    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1817fb6f-f287-4f86-b684-9b9132f3561a-tmp\") pod \"tuned-9rvq6\" (UID: \"1817fb6f-f287-4f86-b684-9b9132f3561a\") " pod="openshift-cluster-node-tuning-operator/tuned-9rvq6"
May 26 15:17:43.612999 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:17:43.612979    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/1817fb6f-f287-4f86-b684-9b9132f3561a-etc-tuned\") pod \"tuned-9rvq6\" (UID: \"1817fb6f-f287-4f86-b684-9b9132f3561a\") " pod="openshift-cluster-node-tuning-operator/tuned-9rvq6"
May 26 15:17:43.613083 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:17:43.613041    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/a02c2727-c53c-48c3-aba7-acde4eef632c-ovn-node-metrics-cert\") pod \"ovnkube-node-gjh9c\" (UID: \"a02c2727-c53c-48c3-aba7-acde4eef632c\") " pod="openshift-ovn-kubernetes/ovnkube-node-gjh9c"
May 26 15:17:43.613083 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:17:43.613056    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/66fc90a9-1fd5-46e0-aa1a-895166fc81b8-agent-certs\") pod \"konnectivity-agent-5nngw\" (UID: \"66fc90a9-1fd5-46e0-aa1a-895166fc81b8\") " pod="kube-system/konnectivity-agent-5nngw"
May 26 15:17:43.621420 ip-10-0-140-164 kubenswrapper[2581]: E0526 15:17:43.621394    2581 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
May 26 15:17:43.621420 ip-10-0-140-164 kubenswrapper[2581]: E0526 15:17:43.621418    2581 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
May 26 15:17:43.621548 ip-10-0-140-164 kubenswrapper[2581]: E0526 15:17:43.621431    2581 projected.go:194] Error preparing data for projected volume kube-api-access-m9l98 for pod openshift-network-diagnostics/network-check-target-qr6zm: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 26 15:17:43.621548 ip-10-0-140-164 kubenswrapper[2581]: E0526 15:17:43.621476    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/000947e2-0eeb-4d43-8dc4-6132e5e6cc13-kube-api-access-m9l98 podName:000947e2-0eeb-4d43-8dc4-6132e5e6cc13 nodeName:}" failed. No retries permitted until 2026-05-26 15:17:44.121464315 +0000 UTC m=+3.119167625 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-m9l98" (UniqueName: "kubernetes.io/projected/000947e2-0eeb-4d43-8dc4-6132e5e6cc13-kube-api-access-m9l98") pod "network-check-target-qr6zm" (UID: "000947e2-0eeb-4d43-8dc4-6132e5e6cc13") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 26 15:17:43.627947 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:17:43.627921    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-z2jtx\" (UniqueName: \"kubernetes.io/projected/07693aae-634c-4a2f-ac21-fb1bf39c239a-kube-api-access-z2jtx\") pod \"aws-ebs-csi-driver-node-vsvmw\" (UID: \"07693aae-634c-4a2f-ac21-fb1bf39c239a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vsvmw"
May 26 15:17:43.628377 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:17:43.628357    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dgsgr\" (UniqueName: \"kubernetes.io/projected/1817fb6f-f287-4f86-b684-9b9132f3561a-kube-api-access-dgsgr\") pod \"tuned-9rvq6\" (UID: \"1817fb6f-f287-4f86-b684-9b9132f3561a\") " pod="openshift-cluster-node-tuning-operator/tuned-9rvq6"
May 26 15:17:43.628449 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:17:43.628435    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gxd45\" (UniqueName: \"kubernetes.io/projected/9f965e2e-8e40-4ab4-b3cd-0d52ba317cf2-kube-api-access-gxd45\") pod \"node-resolver-6j49h\" (UID: \"9f965e2e-8e40-4ab4-b3cd-0d52ba317cf2\") " pod="openshift-dns/node-resolver-6j49h"
May 26 15:17:43.628562 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:17:43.628546    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-52vlc\" (UniqueName: \"kubernetes.io/projected/706d11ce-61db-4788-83f2-2ffbea860487-kube-api-access-52vlc\") pod \"node-ca-khnr9\" (UID: \"706d11ce-61db-4788-83f2-2ffbea860487\") " pod="openshift-image-registry/node-ca-khnr9"
May 26 15:17:43.628722 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:17:43.628702    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cvg7t\" (UniqueName: \"kubernetes.io/projected/efa65a4e-8688-4521-bf81-8938e3041f72-kube-api-access-cvg7t\") pod \"iptables-alerter-nprns\" (UID: \"efa65a4e-8688-4521-bf81-8938e3041f72\") " pod="openshift-network-operator/iptables-alerter-nprns"
May 26 15:17:43.628851 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:17:43.628827    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mlmct\" (UniqueName: \"kubernetes.io/projected/a02c2727-c53c-48c3-aba7-acde4eef632c-kube-api-access-mlmct\") pod \"ovnkube-node-gjh9c\" (UID: \"a02c2727-c53c-48c3-aba7-acde4eef632c\") " pod="openshift-ovn-kubernetes/ovnkube-node-gjh9c"
May 26 15:17:43.710031 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:17:43.710003    2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/d861eb05-53c3-4d05-8dce-5a7c60573358-multus-socket-dir-parent\") pod \"multus-x5ptz\" (UID: \"d861eb05-53c3-4d05-8dce-5a7c60573358\") " pod="openshift-multus/multus-x5ptz"
May 26 15:17:43.710031 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:17:43.710038    2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d861eb05-53c3-4d05-8dce-5a7c60573358-host-var-lib-kubelet\") pod \"multus-x5ptz\" (UID: \"d861eb05-53c3-4d05-8dce-5a7c60573358\") " pod="openshift-multus/multus-x5ptz"
May 26 15:17:43.710248 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:17:43.710054    2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-78tzg\" (UniqueName: \"kubernetes.io/projected/d861eb05-53c3-4d05-8dce-5a7c60573358-kube-api-access-78tzg\") pod \"multus-x5ptz\" (UID: \"d861eb05-53c3-4d05-8dce-5a7c60573358\") " pod="openshift-multus/multus-x5ptz"
May 26 15:17:43.710248 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:17:43.710072    2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d861eb05-53c3-4d05-8dce-5a7c60573358-system-cni-dir\") pod \"multus-x5ptz\" (UID: \"d861eb05-53c3-4d05-8dce-5a7c60573358\") " pod="openshift-multus/multus-x5ptz"
May 26 15:17:43.710248 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:17:43.710123    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d861eb05-53c3-4d05-8dce-5a7c60573358-host-var-lib-kubelet\") pod \"multus-x5ptz\" (UID: \"d861eb05-53c3-4d05-8dce-5a7c60573358\") " pod="openshift-multus/multus-x5ptz"
May 26 15:17:43.710248 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:17:43.710145    2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/afbaeb5e-924a-4076-a161-94955178994c-os-release\") pod \"multus-additional-cni-plugins-bglww\" (UID: \"afbaeb5e-924a-4076-a161-94955178994c\") " pod="openshift-multus/multus-additional-cni-plugins-bglww"
May 26 15:17:43.710248 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:17:43.710178    2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/d861eb05-53c3-4d05-8dce-5a7c60573358-host-run-k8s-cni-cncf-io\") pod \"multus-x5ptz\" (UID: \"d861eb05-53c3-4d05-8dce-5a7c60573358\") " pod="openshift-multus/multus-x5ptz"
May 26 15:17:43.710248 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:17:43.710189    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/afbaeb5e-924a-4076-a161-94955178994c-os-release\") pod \"multus-additional-cni-plugins-bglww\" (UID: \"afbaeb5e-924a-4076-a161-94955178994c\") " pod="openshift-multus/multus-additional-cni-plugins-bglww"
May 26 15:17:43.710248 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:17:43.710194    2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/d861eb05-53c3-4d05-8dce-5a7c60573358-host-run-netns\") pod \"multus-x5ptz\" (UID: \"d861eb05-53c3-4d05-8dce-5a7c60573358\") " pod="openshift-multus/multus-x5ptz"
May 26 15:17:43.710248 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:17:43.710126    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/d861eb05-53c3-4d05-8dce-5a7c60573358-multus-socket-dir-parent\") pod \"multus-x5ptz\" (UID: \"d861eb05-53c3-4d05-8dce-5a7c60573358\") " pod="openshift-multus/multus-x5ptz"
May 26 15:17:43.710248 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:17:43.710129    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d861eb05-53c3-4d05-8dce-5a7c60573358-system-cni-dir\") pod \"multus-x5ptz\" (UID: \"d861eb05-53c3-4d05-8dce-5a7c60573358\") " pod="openshift-multus/multus-x5ptz"
May 26 15:17:43.710248 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:17:43.710214    2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ae574985-4900-4b23-bf74-7c72c939f9bd-metrics-certs\") pod \"network-metrics-daemon-npzrf\" (UID: \"ae574985-4900-4b23-bf74-7c72c939f9bd\") " pod="openshift-multus/network-metrics-daemon-npzrf"
May 26 15:17:43.710248 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:17:43.710223    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/d861eb05-53c3-4d05-8dce-5a7c60573358-host-run-k8s-cni-cncf-io\") pod \"multus-x5ptz\" (UID: \"d861eb05-53c3-4d05-8dce-5a7c60573358\") " pod="openshift-multus/multus-x5ptz"
May 26 15:17:43.710248 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:17:43.710237    2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/afbaeb5e-924a-4076-a161-94955178994c-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-bglww\" (UID: \"afbaeb5e-924a-4076-a161-94955178994c\") " pod="openshift-multus/multus-additional-cni-plugins-bglww"
May 26 15:17:43.710248 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:17:43.710246    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/d861eb05-53c3-4d05-8dce-5a7c60573358-host-run-netns\") pod \"multus-x5ptz\" (UID: \"d861eb05-53c3-4d05-8dce-5a7c60573358\") " pod="openshift-multus/multus-x5ptz"
May 26 15:17:43.710248 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:17:43.710257    2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-z2nc2\" (UniqueName: \"kubernetes.io/projected/afbaeb5e-924a-4076-a161-94955178994c-kube-api-access-z2nc2\") pod \"multus-additional-cni-plugins-bglww\" (UID: \"afbaeb5e-924a-4076-a161-94955178994c\") " pod="openshift-multus/multus-additional-cni-plugins-bglww"
May 26 15:17:43.710968 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:17:43.710300    2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-d8nbr\" (UniqueName: \"kubernetes.io/projected/ae574985-4900-4b23-bf74-7c72c939f9bd-kube-api-access-d8nbr\") pod \"network-metrics-daemon-npzrf\" (UID: \"ae574985-4900-4b23-bf74-7c72c939f9bd\") " pod="openshift-multus/network-metrics-daemon-npzrf"
May 26 15:17:43.710968 ip-10-0-140-164 kubenswrapper[2581]: E0526 15:17:43.710309    2581 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
May 26 15:17:43.710968 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:17:43.710322    2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/d861eb05-53c3-4d05-8dce-5a7c60573358-cnibin\") pod \"multus-x5ptz\" (UID: \"d861eb05-53c3-4d05-8dce-5a7c60573358\") " pod="openshift-multus/multus-x5ptz"
May 26 15:17:43.710968 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:17:43.710345    2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/d861eb05-53c3-4d05-8dce-5a7c60573358-host-var-lib-cni-bin\") pod \"multus-x5ptz\" (UID: \"d861eb05-53c3-4d05-8dce-5a7c60573358\") " pod="openshift-multus/multus-x5ptz"
May 26 15:17:43.710968 ip-10-0-140-164 kubenswrapper[2581]: E0526 15:17:43.710362    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ae574985-4900-4b23-bf74-7c72c939f9bd-metrics-certs podName:ae574985-4900-4b23-bf74-7c72c939f9bd nodeName:}" failed. No retries permitted until 2026-05-26 15:17:44.210343278 +0000 UTC m=+3.208046594 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ae574985-4900-4b23-bf74-7c72c939f9bd-metrics-certs") pod "network-metrics-daemon-npzrf" (UID: "ae574985-4900-4b23-bf74-7c72c939f9bd") : object "openshift-multus"/"metrics-daemon-secret" not registered
May 26 15:17:43.710968 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:17:43.710380    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/d861eb05-53c3-4d05-8dce-5a7c60573358-host-var-lib-cni-bin\") pod \"multus-x5ptz\" (UID: \"d861eb05-53c3-4d05-8dce-5a7c60573358\") " pod="openshift-multus/multus-x5ptz"
May 26 15:17:43.710968 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:17:43.710408    2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/d861eb05-53c3-4d05-8dce-5a7c60573358-host-run-multus-certs\") pod \"multus-x5ptz\" (UID: \"d861eb05-53c3-4d05-8dce-5a7c60573358\") " pod="openshift-multus/multus-x5ptz"
May 26 15:17:43.710968 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:17:43.710428    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/d861eb05-53c3-4d05-8dce-5a7c60573358-cnibin\") pod \"multus-x5ptz\" (UID: \"d861eb05-53c3-4d05-8dce-5a7c60573358\") " pod="openshift-multus/multus-x5ptz"
May 26 15:17:43.710968 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:17:43.710435    2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d861eb05-53c3-4d05-8dce-5a7c60573358-etc-kubernetes\") pod \"multus-x5ptz\" (UID: \"d861eb05-53c3-4d05-8dce-5a7c60573358\") " pod="openshift-multus/multus-x5ptz"
May 26 15:17:43.710968 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:17:43.710465    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d861eb05-53c3-4d05-8dce-5a7c60573358-etc-kubernetes\") pod \"multus-x5ptz\" (UID: \"d861eb05-53c3-4d05-8dce-5a7c60573358\") " pod="openshift-multus/multus-x5ptz"
May 26 15:17:43.710968 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:17:43.710488    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/d861eb05-53c3-4d05-8dce-5a7c60573358-host-run-multus-certs\") pod \"multus-x5ptz\" (UID: \"d861eb05-53c3-4d05-8dce-5a7c60573358\") " pod="openshift-multus/multus-x5ptz"
May 26 15:17:43.710968 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:17:43.710490    2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/afbaeb5e-924a-4076-a161-94955178994c-system-cni-dir\") pod \"multus-additional-cni-plugins-bglww\" (UID: \"afbaeb5e-924a-4076-a161-94955178994c\") " pod="openshift-multus/multus-additional-cni-plugins-bglww"
May 26 15:17:43.710968 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:17:43.710522    2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/afbaeb5e-924a-4076-a161-94955178994c-cni-binary-copy\") pod \"multus-additional-cni-plugins-bglww\" (UID: \"afbaeb5e-924a-4076-a161-94955178994c\") " pod="openshift-multus/multus-additional-cni-plugins-bglww"
May 26 15:17:43.710968 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:17:43.710525    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/afbaeb5e-924a-4076-a161-94955178994c-system-cni-dir\") pod \"multus-additional-cni-plugins-bglww\" (UID: \"afbaeb5e-924a-4076-a161-94955178994c\") " pod="openshift-multus/multus-additional-cni-plugins-bglww"
May 26 15:17:43.710968 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:17:43.710548    2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/d861eb05-53c3-4d05-8dce-5a7c60573358-hostroot\") pod \"multus-x5ptz\" (UID: \"d861eb05-53c3-4d05-8dce-5a7c60573358\") " pod="openshift-multus/multus-x5ptz"
May 26 15:17:43.710968 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:17:43.710576    2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/d861eb05-53c3-4d05-8dce-5a7c60573358-host-var-lib-cni-multus\") pod \"multus-x5ptz\" (UID: \"d861eb05-53c3-4d05-8dce-5a7c60573358\") " pod="openshift-multus/multus-x5ptz"
May 26 15:17:43.710968 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:17:43.710599    2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/afbaeb5e-924a-4076-a161-94955178994c-cnibin\") pod \"multus-additional-cni-plugins-bglww\" (UID: \"afbaeb5e-924a-4076-a161-94955178994c\") " pod="openshift-multus/multus-additional-cni-plugins-bglww"
May 26 15:17:43.711602 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:17:43.710615    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/d861eb05-53c3-4d05-8dce-5a7c60573358-hostroot\") pod \"multus-x5ptz\" (UID: \"d861eb05-53c3-4d05-8dce-5a7c60573358\") " pod="openshift-multus/multus-x5ptz"
May 26 15:17:43.711602 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:17:43.710625    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/d861eb05-53c3-4d05-8dce-5a7c60573358-host-var-lib-cni-multus\") pod \"multus-x5ptz\" (UID: \"d861eb05-53c3-4d05-8dce-5a7c60573358\") " pod="openshift-multus/multus-x5ptz"
May 26 15:17:43.711602 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:17:43.710627    2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/d861eb05-53c3-4d05-8dce-5a7c60573358-cni-binary-copy\") pod \"multus-x5ptz\" (UID: \"d861eb05-53c3-4d05-8dce-5a7c60573358\") " pod="openshift-multus/multus-x5ptz"
May 26 15:17:43.711602 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:17:43.710657    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/afbaeb5e-924a-4076-a161-94955178994c-cnibin\") pod \"multus-additional-cni-plugins-bglww\" (UID: \"afbaeb5e-924a-4076-a161-94955178994c\") " pod="openshift-multus/multus-additional-cni-plugins-bglww"
May 26 15:17:43.711602 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:17:43.710668    2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/afbaeb5e-924a-4076-a161-94955178994c-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-bglww\" (UID: \"afbaeb5e-924a-4076-a161-94955178994c\") " pod="openshift-multus/multus-additional-cni-plugins-bglww"
May 26 15:17:43.711602 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:17:43.710693    2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/d861eb05-53c3-4d05-8dce-5a7c60573358-os-release\") pod \"multus-x5ptz\" (UID: \"d861eb05-53c3-4d05-8dce-5a7c60573358\") " pod="openshift-multus/multus-x5ptz"
May 26 15:17:43.711602 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:17:43.710710    2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d861eb05-53c3-4d05-8dce-5a7c60573358-multus-cni-dir\") pod \"multus-x5ptz\" (UID: \"d861eb05-53c3-4d05-8dce-5a7c60573358\") " pod="openshift-multus/multus-x5ptz"
May 26 15:17:43.711602 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:17:43.710724    2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/d861eb05-53c3-4d05-8dce-5a7c60573358-multus-conf-dir\") pod \"multus-x5ptz\" (UID: \"d861eb05-53c3-4d05-8dce-5a7c60573358\") " pod="openshift-multus/multus-x5ptz"
May 26 15:17:43.711602 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:17:43.710762    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/d861eb05-53c3-4d05-8dce-5a7c60573358-multus-conf-dir\") pod \"multus-x5ptz\" (UID: \"d861eb05-53c3-4d05-8dce-5a7c60573358\") " pod="openshift-multus/multus-x5ptz"
May 26 15:17:43.711602 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:17:43.710779    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/d861eb05-53c3-4d05-8dce-5a7c60573358-os-release\") pod \"multus-x5ptz\" (UID: \"d861eb05-53c3-4d05-8dce-5a7c60573358\") " pod="openshift-multus/multus-x5ptz"
May 26 15:17:43.711602 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:17:43.710784    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/afbaeb5e-924a-4076-a161-94955178994c-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-bglww\" (UID: \"afbaeb5e-924a-4076-a161-94955178994c\") " pod="openshift-multus/multus-additional-cni-plugins-bglww"
May 26 15:17:43.711602 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:17:43.710806    2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/d861eb05-53c3-4d05-8dce-5a7c60573358-multus-daemon-config\") pod \"multus-x5ptz\" (UID: \"d861eb05-53c3-4d05-8dce-5a7c60573358\") " pod="openshift-multus/multus-x5ptz"
May 26 15:17:43.711602 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:17:43.710825    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d861eb05-53c3-4d05-8dce-5a7c60573358-multus-cni-dir\") pod \"multus-x5ptz\" (UID: \"d861eb05-53c3-4d05-8dce-5a7c60573358\") " pod="openshift-multus/multus-x5ptz"
May 26 15:17:43.711602 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:17:43.710833    2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/afbaeb5e-924a-4076-a161-94955178994c-tuning-conf-dir\") pod \"multus-additional-cni-plugins-bglww\" (UID: \"afbaeb5e-924a-4076-a161-94955178994c\") " pod="openshift-multus/multus-additional-cni-plugins-bglww"
May 26 15:17:43.711602 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:17:43.710996    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/afbaeb5e-924a-4076-a161-94955178994c-tuning-conf-dir\") pod \"multus-additional-cni-plugins-bglww\" (UID: \"afbaeb5e-924a-4076-a161-94955178994c\") " pod="openshift-multus/multus-additional-cni-plugins-bglww"
May 26 15:17:43.711602 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:17:43.711063    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/afbaeb5e-924a-4076-a161-94955178994c-cni-binary-copy\") pod \"multus-additional-cni-plugins-bglww\" (UID: \"afbaeb5e-924a-4076-a161-94955178994c\") " pod="openshift-multus/multus-additional-cni-plugins-bglww"
May 26 15:17:43.711602 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:17:43.711207    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/afbaeb5e-924a-4076-a161-94955178994c-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-bglww\" (UID: \"afbaeb5e-924a-4076-a161-94955178994c\") " pod="openshift-multus/multus-additional-cni-plugins-bglww"
May 26 15:17:43.712059 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:17:43.711227    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/d861eb05-53c3-4d05-8dce-5a7c60573358-multus-daemon-config\") pod \"multus-x5ptz\" (UID: \"d861eb05-53c3-4d05-8dce-5a7c60573358\") " pod="openshift-multus/multus-x5ptz"
May 26 15:17:43.712059 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:17:43.711626    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/d861eb05-53c3-4d05-8dce-5a7c60573358-cni-binary-copy\") pod \"multus-x5ptz\" (UID: \"d861eb05-53c3-4d05-8dce-5a7c60573358\") " pod="openshift-multus/multus-x5ptz"
May 26 15:17:43.719176 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:17:43.719145    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-z2nc2\" (UniqueName: \"kubernetes.io/projected/afbaeb5e-924a-4076-a161-94955178994c-kube-api-access-z2nc2\") pod \"multus-additional-cni-plugins-bglww\" (UID: \"afbaeb5e-924a-4076-a161-94955178994c\") " pod="openshift-multus/multus-additional-cni-plugins-bglww"
May 26 15:17:43.719391 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:17:43.719375    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-78tzg\" (UniqueName: \"kubernetes.io/projected/d861eb05-53c3-4d05-8dce-5a7c60573358-kube-api-access-78tzg\") pod \"multus-x5ptz\" (UID: \"d861eb05-53c3-4d05-8dce-5a7c60573358\") " pod="openshift-multus/multus-x5ptz"
May 26 15:17:43.720430 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:17:43.720414    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-d8nbr\" (UniqueName: \"kubernetes.io/projected/ae574985-4900-4b23-bf74-7c72c939f9bd-kube-api-access-d8nbr\") pod \"network-metrics-daemon-npzrf\" (UID: \"ae574985-4900-4b23-bf74-7c72c939f9bd\") " pod="openshift-multus/network-metrics-daemon-npzrf"
May 26 15:17:43.738070 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:17:43.738001    2581 reflector.go:430] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
May 26 15:17:43.801657 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:17:43.801629    2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-nprns"
May 26 15:17:43.811464 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:17:43.811441    2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-gjh9c"
May 26 15:17:43.820085 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:17:43.820064    2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vsvmw"
May 26 15:17:43.826694 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:17:43.826677    2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-9rvq6"
May 26 15:17:43.832115 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:17:43.832100    2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-6j49h"
May 26 15:17:43.837690 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:17:43.837669    2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-khnr9"
May 26 15:17:43.845210 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:17:43.845193    2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-5nngw"
May 26 15:17:43.850738 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:17:43.850722    2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-x5ptz"
May 26 15:17:43.857252 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:17:43.857232    2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-bglww"
May 26 15:17:44.113965 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:17:44.113886    2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/be858157-7e73-43be-81e8-aa5e9344923e-original-pull-secret\") pod \"global-pull-secret-syncer-k56cd\" (UID: \"be858157-7e73-43be-81e8-aa5e9344923e\") " pod="kube-system/global-pull-secret-syncer-k56cd"
May 26 15:17:44.114098 ip-10-0-140-164 kubenswrapper[2581]: E0526 15:17:44.114007    2581 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
May 26 15:17:44.114098 ip-10-0-140-164 kubenswrapper[2581]: E0526 15:17:44.114065    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/be858157-7e73-43be-81e8-aa5e9344923e-original-pull-secret podName:be858157-7e73-43be-81e8-aa5e9344923e nodeName:}" failed. No retries permitted until 2026-05-26 15:17:45.114048439 +0000 UTC m=+4.111751749 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/be858157-7e73-43be-81e8-aa5e9344923e-original-pull-secret") pod "global-pull-secret-syncer-k56cd" (UID: "be858157-7e73-43be-81e8-aa5e9344923e") : object "kube-system"/"original-pull-secret" not registered
May 26 15:17:44.205695 ip-10-0-140-164 kubenswrapper[2581]: W0526 15:17:44.205664    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1817fb6f_f287_4f86_b684_9b9132f3561a.slice/crio-266254fe7881989288affa7b0764e239b6bb3812b949e8467096d0297de4d99f WatchSource:0}: Error finding container 266254fe7881989288affa7b0764e239b6bb3812b949e8467096d0297de4d99f: Status 404 returned error can't find the container with id 266254fe7881989288affa7b0764e239b6bb3812b949e8467096d0297de4d99f
May 26 15:17:44.210104 ip-10-0-140-164 kubenswrapper[2581]: W0526 15:17:44.210080    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda02c2727_c53c_48c3_aba7_acde4eef632c.slice/crio-e37ba8de9f4cb1b24451cab4acce1673b619d19d76a3e786bddc253bdb0821ec WatchSource:0}: Error finding container e37ba8de9f4cb1b24451cab4acce1673b619d19d76a3e786bddc253bdb0821ec: Status 404 returned error can't find the container with id e37ba8de9f4cb1b24451cab4acce1673b619d19d76a3e786bddc253bdb0821ec
May 26 15:17:44.211873 ip-10-0-140-164 kubenswrapper[2581]: W0526 15:17:44.211849    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podefa65a4e_8688_4521_bf81_8938e3041f72.slice/crio-a7faf877bb1121f54e453bfaf90bfaa251651ea30bc1a121c9ac8772a42c558e WatchSource:0}: Error finding container a7faf877bb1121f54e453bfaf90bfaa251651ea30bc1a121c9ac8772a42c558e: Status 404 returned error can't find the container with id a7faf877bb1121f54e453bfaf90bfaa251651ea30bc1a121c9ac8772a42c558e
May 26 15:17:44.212873 ip-10-0-140-164 kubenswrapper[2581]: W0526 15:17:44.212853    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9f965e2e_8e40_4ab4_b3cd_0d52ba317cf2.slice/crio-85d24720f9371079e06b8937ae25243a23ac7c045f31a76d070b1408e5c26828 WatchSource:0}: Error finding container 85d24720f9371079e06b8937ae25243a23ac7c045f31a76d070b1408e5c26828: Status 404 returned error can't find the container with id 85d24720f9371079e06b8937ae25243a23ac7c045f31a76d070b1408e5c26828
May 26 15:17:44.213436 ip-10-0-140-164 kubenswrapper[2581]: W0526 15:17:44.213415    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod66fc90a9_1fd5_46e0_aa1a_895166fc81b8.slice/crio-6e8a6dbfb87f871e7853e7800d9d7af908dfd6c5d0959278a074897d99ebc9ba WatchSource:0}: Error finding container 6e8a6dbfb87f871e7853e7800d9d7af908dfd6c5d0959278a074897d99ebc9ba: Status 404 returned error can't find the container with id 6e8a6dbfb87f871e7853e7800d9d7af908dfd6c5d0959278a074897d99ebc9ba
May 26 15:17:44.214237 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:17:44.214212    2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-m9l98\" (UniqueName: \"kubernetes.io/projected/000947e2-0eeb-4d43-8dc4-6132e5e6cc13-kube-api-access-m9l98\") pod \"network-check-target-qr6zm\" (UID: \"000947e2-0eeb-4d43-8dc4-6132e5e6cc13\") " pod="openshift-network-diagnostics/network-check-target-qr6zm"
May 26 15:17:44.214342 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:17:44.214305    2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ae574985-4900-4b23-bf74-7c72c939f9bd-metrics-certs\") pod \"network-metrics-daemon-npzrf\" (UID: \"ae574985-4900-4b23-bf74-7c72c939f9bd\") " pod="openshift-multus/network-metrics-daemon-npzrf"
May 26 15:17:44.214458 ip-10-0-140-164 kubenswrapper[2581]: E0526 15:17:44.214440    2581 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
May 26 15:17:44.214535 ip-10-0-140-164 kubenswrapper[2581]: E0526 15:17:44.214492    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ae574985-4900-4b23-bf74-7c72c939f9bd-metrics-certs podName:ae574985-4900-4b23-bf74-7c72c939f9bd nodeName:}" failed. No retries permitted until 2026-05-26 15:17:45.214475275 +0000 UTC m=+4.212178605 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ae574985-4900-4b23-bf74-7c72c939f9bd-metrics-certs") pod "network-metrics-daemon-npzrf" (UID: "ae574985-4900-4b23-bf74-7c72c939f9bd") : object "openshift-multus"/"metrics-daemon-secret" not registered
May 26 15:17:44.214535 ip-10-0-140-164 kubenswrapper[2581]: E0526 15:17:44.214525    2581 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
May 26 15:17:44.214656 ip-10-0-140-164 kubenswrapper[2581]: E0526 15:17:44.214547    2581 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
May 26 15:17:44.214656 ip-10-0-140-164 kubenswrapper[2581]: E0526 15:17:44.214572    2581 projected.go:194] Error preparing data for projected volume kube-api-access-m9l98 for pod openshift-network-diagnostics/network-check-target-qr6zm: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 26 15:17:44.214656 ip-10-0-140-164 kubenswrapper[2581]: E0526 15:17:44.214622    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/000947e2-0eeb-4d43-8dc4-6132e5e6cc13-kube-api-access-m9l98 podName:000947e2-0eeb-4d43-8dc4-6132e5e6cc13 nodeName:}" failed. No retries permitted until 2026-05-26 15:17:45.214605221 +0000 UTC m=+4.212308534 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-m9l98" (UniqueName: "kubernetes.io/projected/000947e2-0eeb-4d43-8dc4-6132e5e6cc13-kube-api-access-m9l98") pod "network-check-target-qr6zm" (UID: "000947e2-0eeb-4d43-8dc4-6132e5e6cc13") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 26 15:17:44.215212 ip-10-0-140-164 kubenswrapper[2581]: W0526 15:17:44.215190    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd861eb05_53c3_4d05_8dce_5a7c60573358.slice/crio-19086655d9db196a65ab27d31d621835b1bc326f942be63c777a7857a317be3a WatchSource:0}: Error finding container 19086655d9db196a65ab27d31d621835b1bc326f942be63c777a7857a317be3a: Status 404 returned error can't find the container with id 19086655d9db196a65ab27d31d621835b1bc326f942be63c777a7857a317be3a
May 26 15:17:44.218444 ip-10-0-140-164 kubenswrapper[2581]: W0526 15:17:44.218122    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod07693aae_634c_4a2f_ac21_fb1bf39c239a.slice/crio-c6c412471f10d8a3c53d3af287e6856f93bb66582ac0835a014a04654d91b9f4 WatchSource:0}: Error finding container c6c412471f10d8a3c53d3af287e6856f93bb66582ac0835a014a04654d91b9f4: Status 404 returned error can't find the container with id c6c412471f10d8a3c53d3af287e6856f93bb66582ac0835a014a04654d91b9f4
May 26 15:17:44.219696 ip-10-0-140-164 kubenswrapper[2581]: W0526 15:17:44.219676    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod706d11ce_61db_4788_83f2_2ffbea860487.slice/crio-6f922fa17d71dde942d02c59758ead05ec6fe272b5b0cc8a4b20ae1cc66a9d38 WatchSource:0}: Error finding container 6f922fa17d71dde942d02c59758ead05ec6fe272b5b0cc8a4b20ae1cc66a9d38: Status 404 returned error can't find the container with id 6f922fa17d71dde942d02c59758ead05ec6fe272b5b0cc8a4b20ae1cc66a9d38
May 26 15:17:44.223639 ip-10-0-140-164 kubenswrapper[2581]: W0526 15:17:44.221394    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podafbaeb5e_924a_4076_a161_94955178994c.slice/crio-b83e4da3d224fd318d9dc8acafaee3cfe8a482e6431d65aab1ed5b299c26c187 WatchSource:0}: Error finding container b83e4da3d224fd318d9dc8acafaee3cfe8a482e6431d65aab1ed5b299c26c187: Status 404 returned error can't find the container with id b83e4da3d224fd318d9dc8acafaee3cfe8a482e6431d65aab1ed5b299c26c187
May 26 15:17:44.610240 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:17:44.610204    2581 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-05-25 15:12:42 +0000 UTC" deadline="2028-01-30 03:02:11.173433197 +0000 UTC"
May 26 15:17:44.610552 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:17:44.610240    2581 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14723h44m26.563196873s"
May 26 15:17:44.637245 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:17:44.637211    2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-npzrf"
May 26 15:17:44.637454 ip-10-0-140-164 kubenswrapper[2581]: E0526 15:17:44.637421    2581 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-npzrf" podUID="ae574985-4900-4b23-bf74-7c72c939f9bd"
May 26 15:17:44.644148 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:17:44.644115    2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-164.ec2.internal" event={"ID":"55d5a722a2f6ce4004954f6d492eeaa9","Type":"ContainerStarted","Data":"68d11e86fd7515bf9941ae75e334c0e9d105e547580c0fb36a3e9c6728c2e637"}
May 26 15:17:44.648314 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:17:44.648289    2581 generic.go:358] "Generic (PLEG): container finished" podID="591b4a3ba245c4dc860f8b20f61b92da" containerID="48adedee8d3fc32d0e94573300d250a917df84f37a79a5987e4b672084c1d21b" exitCode=0
May 26 15:17:44.648426 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:17:44.648353    2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-164.ec2.internal" event={"ID":"591b4a3ba245c4dc860f8b20f61b92da","Type":"ContainerDied","Data":"48adedee8d3fc32d0e94573300d250a917df84f37a79a5987e4b672084c1d21b"}
May 26 15:17:44.650309 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:17:44.650258    2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-bglww" event={"ID":"afbaeb5e-924a-4076-a161-94955178994c","Type":"ContainerStarted","Data":"b83e4da3d224fd318d9dc8acafaee3cfe8a482e6431d65aab1ed5b299c26c187"}
May 26 15:17:44.651648 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:17:44.651614    2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-x5ptz" event={"ID":"d861eb05-53c3-4d05-8dce-5a7c60573358","Type":"ContainerStarted","Data":"19086655d9db196a65ab27d31d621835b1bc326f942be63c777a7857a317be3a"}
May 26 15:17:44.653740 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:17:44.653716    2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-nprns" event={"ID":"efa65a4e-8688-4521-bf81-8938e3041f72","Type":"ContainerStarted","Data":"a7faf877bb1121f54e453bfaf90bfaa251651ea30bc1a121c9ac8772a42c558e"}
May 26 15:17:44.655487 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:17:44.655464    2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-gjh9c" event={"ID":"a02c2727-c53c-48c3-aba7-acde4eef632c","Type":"ContainerStarted","Data":"e37ba8de9f4cb1b24451cab4acce1673b619d19d76a3e786bddc253bdb0821ec"}
May 26 15:17:44.657490 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:17:44.657458    2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-khnr9" event={"ID":"706d11ce-61db-4788-83f2-2ffbea860487","Type":"ContainerStarted","Data":"6f922fa17d71dde942d02c59758ead05ec6fe272b5b0cc8a4b20ae1cc66a9d38"}
May 26 15:17:44.660120 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:17:44.659752    2581 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-164.ec2.internal" podStartSLOduration=2.659739427 podStartE2EDuration="2.659739427s" podCreationTimestamp="2026-05-26 15:17:42 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-26 15:17:44.659153821 +0000 UTC m=+3.656857158" watchObservedRunningTime="2026-05-26 15:17:44.659739427 +0000 UTC m=+3.657442801"
May 26 15:17:44.662910 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:17:44.662883    2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vsvmw" event={"ID":"07693aae-634c-4a2f-ac21-fb1bf39c239a","Type":"ContainerStarted","Data":"c6c412471f10d8a3c53d3af287e6856f93bb66582ac0835a014a04654d91b9f4"}
May 26 15:17:44.664173 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:17:44.664131    2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-5nngw" event={"ID":"66fc90a9-1fd5-46e0-aa1a-895166fc81b8","Type":"ContainerStarted","Data":"6e8a6dbfb87f871e7853e7800d9d7af908dfd6c5d0959278a074897d99ebc9ba"}
May 26 15:17:44.666349 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:17:44.666312    2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-6j49h" event={"ID":"9f965e2e-8e40-4ab4-b3cd-0d52ba317cf2","Type":"ContainerStarted","Data":"85d24720f9371079e06b8937ae25243a23ac7c045f31a76d070b1408e5c26828"}
May 26 15:17:44.667849 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:17:44.667822    2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-9rvq6" event={"ID":"1817fb6f-f287-4f86-b684-9b9132f3561a","Type":"ContainerStarted","Data":"266254fe7881989288affa7b0764e239b6bb3812b949e8467096d0297de4d99f"}
May 26 15:17:45.121536 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:17:45.121459    2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/be858157-7e73-43be-81e8-aa5e9344923e-original-pull-secret\") pod \"global-pull-secret-syncer-k56cd\" (UID: \"be858157-7e73-43be-81e8-aa5e9344923e\") " pod="kube-system/global-pull-secret-syncer-k56cd"
May 26 15:17:45.121696 ip-10-0-140-164 kubenswrapper[2581]: E0526 15:17:45.121631    2581 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
May 26 15:17:45.121696 ip-10-0-140-164 kubenswrapper[2581]: E0526 15:17:45.121693    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/be858157-7e73-43be-81e8-aa5e9344923e-original-pull-secret podName:be858157-7e73-43be-81e8-aa5e9344923e nodeName:}" failed. No retries permitted until 2026-05-26 15:17:47.121675171 +0000 UTC m=+6.119378480 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/be858157-7e73-43be-81e8-aa5e9344923e-original-pull-secret") pod "global-pull-secret-syncer-k56cd" (UID: "be858157-7e73-43be-81e8-aa5e9344923e") : object "kube-system"/"original-pull-secret" not registered
May 26 15:17:45.223225 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:17:45.222459    2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ae574985-4900-4b23-bf74-7c72c939f9bd-metrics-certs\") pod \"network-metrics-daemon-npzrf\" (UID: \"ae574985-4900-4b23-bf74-7c72c939f9bd\") " pod="openshift-multus/network-metrics-daemon-npzrf"
May 26 15:17:45.223225 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:17:45.222528    2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-m9l98\" (UniqueName: \"kubernetes.io/projected/000947e2-0eeb-4d43-8dc4-6132e5e6cc13-kube-api-access-m9l98\") pod \"network-check-target-qr6zm\" (UID: \"000947e2-0eeb-4d43-8dc4-6132e5e6cc13\") " pod="openshift-network-diagnostics/network-check-target-qr6zm"
May 26 15:17:45.223225 ip-10-0-140-164 kubenswrapper[2581]: E0526 15:17:45.222670    2581 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
May 26 15:17:45.223225 ip-10-0-140-164 kubenswrapper[2581]: E0526 15:17:45.222689    2581 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
May 26 15:17:45.223225 ip-10-0-140-164 kubenswrapper[2581]: E0526 15:17:45.222703    2581 projected.go:194] Error preparing data for projected volume kube-api-access-m9l98 for pod openshift-network-diagnostics/network-check-target-qr6zm: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 26 15:17:45.223225 ip-10-0-140-164 kubenswrapper[2581]: E0526 15:17:45.222754    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/000947e2-0eeb-4d43-8dc4-6132e5e6cc13-kube-api-access-m9l98 podName:000947e2-0eeb-4d43-8dc4-6132e5e6cc13 nodeName:}" failed. No retries permitted until 2026-05-26 15:17:47.222736067 +0000 UTC m=+6.220439382 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-m9l98" (UniqueName: "kubernetes.io/projected/000947e2-0eeb-4d43-8dc4-6132e5e6cc13-kube-api-access-m9l98") pod "network-check-target-qr6zm" (UID: "000947e2-0eeb-4d43-8dc4-6132e5e6cc13") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 26 15:17:45.223225 ip-10-0-140-164 kubenswrapper[2581]: E0526 15:17:45.223144    2581 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
May 26 15:17:45.223225 ip-10-0-140-164 kubenswrapper[2581]: E0526 15:17:45.223192    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ae574985-4900-4b23-bf74-7c72c939f9bd-metrics-certs podName:ae574985-4900-4b23-bf74-7c72c939f9bd nodeName:}" failed. No retries permitted until 2026-05-26 15:17:47.223177799 +0000 UTC m=+6.220881113 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ae574985-4900-4b23-bf74-7c72c939f9bd-metrics-certs") pod "network-metrics-daemon-npzrf" (UID: "ae574985-4900-4b23-bf74-7c72c939f9bd") : object "openshift-multus"/"metrics-daemon-secret" not registered
May 26 15:17:45.638058 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:17:45.637401    2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-k56cd"
May 26 15:17:45.638058 ip-10-0-140-164 kubenswrapper[2581]: E0526 15:17:45.637521    2581 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-k56cd" podUID="be858157-7e73-43be-81e8-aa5e9344923e"
May 26 15:17:45.638058 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:17:45.637916    2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qr6zm"
May 26 15:17:45.638058 ip-10-0-140-164 kubenswrapper[2581]: E0526 15:17:45.637998    2581 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qr6zm" podUID="000947e2-0eeb-4d43-8dc4-6132e5e6cc13"
May 26 15:17:45.683044 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:17:45.682613    2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-164.ec2.internal" event={"ID":"591b4a3ba245c4dc860f8b20f61b92da","Type":"ContainerStarted","Data":"945085e7c496cbb8b267b71bba969155f5584dfaedafcc020864388ad3e3050a"}
May 26 15:17:45.703371 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:17:45.703321    2581 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-164.ec2.internal" podStartSLOduration=3.703303869 podStartE2EDuration="3.703303869s" podCreationTimestamp="2026-05-26 15:17:42 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-26 15:17:45.702971308 +0000 UTC m=+4.700674643" watchObservedRunningTime="2026-05-26 15:17:45.703303869 +0000 UTC m=+4.701007202"
May 26 15:17:46.637939 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:17:46.637469    2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-npzrf"
May 26 15:17:46.637939 ip-10-0-140-164 kubenswrapper[2581]: E0526 15:17:46.637604    2581 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-npzrf" podUID="ae574985-4900-4b23-bf74-7c72c939f9bd"
May 26 15:17:47.140186 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:17:47.139565    2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/be858157-7e73-43be-81e8-aa5e9344923e-original-pull-secret\") pod \"global-pull-secret-syncer-k56cd\" (UID: \"be858157-7e73-43be-81e8-aa5e9344923e\") " pod="kube-system/global-pull-secret-syncer-k56cd"
May 26 15:17:47.140186 ip-10-0-140-164 kubenswrapper[2581]: E0526 15:17:47.139736    2581 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
May 26 15:17:47.140186 ip-10-0-140-164 kubenswrapper[2581]: E0526 15:17:47.139795    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/be858157-7e73-43be-81e8-aa5e9344923e-original-pull-secret podName:be858157-7e73-43be-81e8-aa5e9344923e nodeName:}" failed. No retries permitted until 2026-05-26 15:17:51.13977788 +0000 UTC m=+10.137481194 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/be858157-7e73-43be-81e8-aa5e9344923e-original-pull-secret") pod "global-pull-secret-syncer-k56cd" (UID: "be858157-7e73-43be-81e8-aa5e9344923e") : object "kube-system"/"original-pull-secret" not registered
May 26 15:17:47.240435 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:17:47.240397    2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ae574985-4900-4b23-bf74-7c72c939f9bd-metrics-certs\") pod \"network-metrics-daemon-npzrf\" (UID: \"ae574985-4900-4b23-bf74-7c72c939f9bd\") " pod="openshift-multus/network-metrics-daemon-npzrf"
May 26 15:17:47.240605 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:17:47.240472    2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-m9l98\" (UniqueName: \"kubernetes.io/projected/000947e2-0eeb-4d43-8dc4-6132e5e6cc13-kube-api-access-m9l98\") pod \"network-check-target-qr6zm\" (UID: \"000947e2-0eeb-4d43-8dc4-6132e5e6cc13\") " pod="openshift-network-diagnostics/network-check-target-qr6zm"
May 26 15:17:47.240663 ip-10-0-140-164 kubenswrapper[2581]: E0526 15:17:47.240610    2581 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
May 26 15:17:47.240663 ip-10-0-140-164 kubenswrapper[2581]: E0526 15:17:47.240629    2581 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
May 26 15:17:47.240663 ip-10-0-140-164 kubenswrapper[2581]: E0526 15:17:47.240642    2581 projected.go:194] Error preparing data for projected volume kube-api-access-m9l98 for pod openshift-network-diagnostics/network-check-target-qr6zm: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 26 15:17:47.240800 ip-10-0-140-164 kubenswrapper[2581]: E0526 15:17:47.240699    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/000947e2-0eeb-4d43-8dc4-6132e5e6cc13-kube-api-access-m9l98 podName:000947e2-0eeb-4d43-8dc4-6132e5e6cc13 nodeName:}" failed. No retries permitted until 2026-05-26 15:17:51.240680352 +0000 UTC m=+10.238383667 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-m9l98" (UniqueName: "kubernetes.io/projected/000947e2-0eeb-4d43-8dc4-6132e5e6cc13-kube-api-access-m9l98") pod "network-check-target-qr6zm" (UID: "000947e2-0eeb-4d43-8dc4-6132e5e6cc13") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 26 15:17:47.241146 ip-10-0-140-164 kubenswrapper[2581]: E0526 15:17:47.241026    2581 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
May 26 15:17:47.241146 ip-10-0-140-164 kubenswrapper[2581]: E0526 15:17:47.241077    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ae574985-4900-4b23-bf74-7c72c939f9bd-metrics-certs podName:ae574985-4900-4b23-bf74-7c72c939f9bd nodeName:}" failed. No retries permitted until 2026-05-26 15:17:51.241061236 +0000 UTC m=+10.238764561 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ae574985-4900-4b23-bf74-7c72c939f9bd-metrics-certs") pod "network-metrics-daemon-npzrf" (UID: "ae574985-4900-4b23-bf74-7c72c939f9bd") : object "openshift-multus"/"metrics-daemon-secret" not registered
May 26 15:17:47.638472 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:17:47.638389    2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-k56cd"
May 26 15:17:47.638883 ip-10-0-140-164 kubenswrapper[2581]: E0526 15:17:47.638580    2581 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-k56cd" podUID="be858157-7e73-43be-81e8-aa5e9344923e"
May 26 15:17:47.639088 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:17:47.639070    2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qr6zm"
May 26 15:17:47.639183 ip-10-0-140-164 kubenswrapper[2581]: E0526 15:17:47.639163    2581 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qr6zm" podUID="000947e2-0eeb-4d43-8dc4-6132e5e6cc13"
May 26 15:17:48.637368 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:17:48.637331    2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-npzrf"
May 26 15:17:48.637533 ip-10-0-140-164 kubenswrapper[2581]: E0526 15:17:48.637499    2581 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-npzrf" podUID="ae574985-4900-4b23-bf74-7c72c939f9bd"
May 26 15:17:49.639311 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:17:49.639280    2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qr6zm"
May 26 15:17:49.639653 ip-10-0-140-164 kubenswrapper[2581]: E0526 15:17:49.639379    2581 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qr6zm" podUID="000947e2-0eeb-4d43-8dc4-6132e5e6cc13"
May 26 15:17:49.639764 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:17:49.639748    2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-k56cd"
May 26 15:17:49.639853 ip-10-0-140-164 kubenswrapper[2581]: E0526 15:17:49.639836    2581 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-k56cd" podUID="be858157-7e73-43be-81e8-aa5e9344923e"
May 26 15:17:50.637489 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:17:50.637458    2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-npzrf"
May 26 15:17:50.637664 ip-10-0-140-164 kubenswrapper[2581]: E0526 15:17:50.637581    2581 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-npzrf" podUID="ae574985-4900-4b23-bf74-7c72c939f9bd"
May 26 15:17:51.172599 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:17:51.172563    2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/be858157-7e73-43be-81e8-aa5e9344923e-original-pull-secret\") pod \"global-pull-secret-syncer-k56cd\" (UID: \"be858157-7e73-43be-81e8-aa5e9344923e\") " pod="kube-system/global-pull-secret-syncer-k56cd"
May 26 15:17:51.173074 ip-10-0-140-164 kubenswrapper[2581]: E0526 15:17:51.172725    2581 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
May 26 15:17:51.173074 ip-10-0-140-164 kubenswrapper[2581]: E0526 15:17:51.172782    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/be858157-7e73-43be-81e8-aa5e9344923e-original-pull-secret podName:be858157-7e73-43be-81e8-aa5e9344923e nodeName:}" failed. No retries permitted until 2026-05-26 15:17:59.172764298 +0000 UTC m=+18.170467615 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/be858157-7e73-43be-81e8-aa5e9344923e-original-pull-secret") pod "global-pull-secret-syncer-k56cd" (UID: "be858157-7e73-43be-81e8-aa5e9344923e") : object "kube-system"/"original-pull-secret" not registered
May 26 15:17:51.273410 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:17:51.273378    2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ae574985-4900-4b23-bf74-7c72c939f9bd-metrics-certs\") pod \"network-metrics-daemon-npzrf\" (UID: \"ae574985-4900-4b23-bf74-7c72c939f9bd\") " pod="openshift-multus/network-metrics-daemon-npzrf"
May 26 15:17:51.273578 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:17:51.273429    2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-m9l98\" (UniqueName: \"kubernetes.io/projected/000947e2-0eeb-4d43-8dc4-6132e5e6cc13-kube-api-access-m9l98\") pod \"network-check-target-qr6zm\" (UID: \"000947e2-0eeb-4d43-8dc4-6132e5e6cc13\") " pod="openshift-network-diagnostics/network-check-target-qr6zm"
May 26 15:17:51.273578 ip-10-0-140-164 kubenswrapper[2581]: E0526 15:17:51.273521    2581 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
May 26 15:17:51.273578 ip-10-0-140-164 kubenswrapper[2581]: E0526 15:17:51.273531    2581 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
May 26 15:17:51.273578 ip-10-0-140-164 kubenswrapper[2581]: E0526 15:17:51.273546    2581 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
May 26 15:17:51.273578 ip-10-0-140-164 kubenswrapper[2581]: E0526 15:17:51.273558    2581 projected.go:194] Error preparing data for projected volume kube-api-access-m9l98 for pod openshift-network-diagnostics/network-check-target-qr6zm: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 26 15:17:51.273836 ip-10-0-140-164 kubenswrapper[2581]: E0526 15:17:51.273585    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ae574985-4900-4b23-bf74-7c72c939f9bd-metrics-certs podName:ae574985-4900-4b23-bf74-7c72c939f9bd nodeName:}" failed. No retries permitted until 2026-05-26 15:17:59.273563736 +0000 UTC m=+18.271267076 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ae574985-4900-4b23-bf74-7c72c939f9bd-metrics-certs") pod "network-metrics-daemon-npzrf" (UID: "ae574985-4900-4b23-bf74-7c72c939f9bd") : object "openshift-multus"/"metrics-daemon-secret" not registered
May 26 15:17:51.273836 ip-10-0-140-164 kubenswrapper[2581]: E0526 15:17:51.273607    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/000947e2-0eeb-4d43-8dc4-6132e5e6cc13-kube-api-access-m9l98 podName:000947e2-0eeb-4d43-8dc4-6132e5e6cc13 nodeName:}" failed. No retries permitted until 2026-05-26 15:17:59.273593556 +0000 UTC m=+18.271296890 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-m9l98" (UniqueName: "kubernetes.io/projected/000947e2-0eeb-4d43-8dc4-6132e5e6cc13-kube-api-access-m9l98") pod "network-check-target-qr6zm" (UID: "000947e2-0eeb-4d43-8dc4-6132e5e6cc13") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 26 15:17:51.638080 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:17:51.638049    2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-k56cd"
May 26 15:17:51.638228 ip-10-0-140-164 kubenswrapper[2581]: E0526 15:17:51.638131    2581 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-k56cd" podUID="be858157-7e73-43be-81e8-aa5e9344923e"
May 26 15:17:51.638228 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:17:51.638217    2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qr6zm"
May 26 15:17:51.638372 ip-10-0-140-164 kubenswrapper[2581]: E0526 15:17:51.638342    2581 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qr6zm" podUID="000947e2-0eeb-4d43-8dc4-6132e5e6cc13"
May 26 15:17:52.637029 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:17:52.636992    2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-npzrf"
May 26 15:17:52.637526 ip-10-0-140-164 kubenswrapper[2581]: E0526 15:17:52.637129    2581 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-npzrf" podUID="ae574985-4900-4b23-bf74-7c72c939f9bd"
May 26 15:17:53.637567 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:17:53.637532    2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qr6zm"
May 26 15:17:53.638024 ip-10-0-140-164 kubenswrapper[2581]: E0526 15:17:53.637657    2581 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qr6zm" podUID="000947e2-0eeb-4d43-8dc4-6132e5e6cc13"
May 26 15:17:53.638024 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:17:53.637724    2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-k56cd"
May 26 15:17:53.638024 ip-10-0-140-164 kubenswrapper[2581]: E0526 15:17:53.637841    2581 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-k56cd" podUID="be858157-7e73-43be-81e8-aa5e9344923e"
May 26 15:17:54.637237 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:17:54.637009    2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-npzrf"
May 26 15:17:54.637398 ip-10-0-140-164 kubenswrapper[2581]: E0526 15:17:54.637368    2581 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-npzrf" podUID="ae574985-4900-4b23-bf74-7c72c939f9bd"
May 26 15:17:54.703058 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:17:54.703024    2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-bglww" event={"ID":"afbaeb5e-924a-4076-a161-94955178994c","Type":"ContainerStarted","Data":"383d5f8115be40ad3ac6d2848dec9284258f581149a333cf5d2bf401b4186f6e"}
May 26 15:17:54.704622 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:17:54.704593    2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-khnr9" event={"ID":"706d11ce-61db-4788-83f2-2ffbea860487","Type":"ContainerStarted","Data":"8fb9177533e74e1969d8cb7bcf7a84a6ce476a0b2c0783b02c4ceaf15555b690"}
May 26 15:17:54.705924 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:17:54.705900    2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vsvmw" event={"ID":"07693aae-634c-4a2f-ac21-fb1bf39c239a","Type":"ContainerStarted","Data":"b394048f9761a990c07eac265864916ff10c77ee6c8a323026a70a0591823b98"}
May 26 15:17:54.707297 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:17:54.707234    2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-5nngw" event={"ID":"66fc90a9-1fd5-46e0-aa1a-895166fc81b8","Type":"ContainerStarted","Data":"ab9239b0a0dc610d96591250f30d0135d218afe0197319231d32f944030c80b8"}
May 26 15:17:54.708773 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:17:54.708752    2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-6j49h" event={"ID":"9f965e2e-8e40-4ab4-b3cd-0d52ba317cf2","Type":"ContainerStarted","Data":"4ff6548428d1924d76efc01cc54c1833d26ffe0284cf4c2b9c6d04e00ed734ac"}
May 26 15:17:54.710418 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:17:54.710394    2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-9rvq6" event={"ID":"1817fb6f-f287-4f86-b684-9b9132f3561a","Type":"ContainerStarted","Data":"3738905f02ff95e8ee1970764875e133cbd2c185ca7c2555ec37844dc84f465c"}
May 26 15:17:54.766771 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:17:54.766726    2581 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-dns/node-resolver-6j49h" podStartSLOduration=4.075163742 podStartE2EDuration="13.766711388s" podCreationTimestamp="2026-05-26 15:17:41 +0000 UTC" firstStartedPulling="2026-05-26 15:17:44.216898289 +0000 UTC m=+3.214601605" lastFinishedPulling="2026-05-26 15:17:53.908445935 +0000 UTC m=+12.906149251" observedRunningTime="2026-05-26 15:17:54.751906985 +0000 UTC m=+13.749610318" watchObservedRunningTime="2026-05-26 15:17:54.766711388 +0000 UTC m=+13.764414723"
May 26 15:17:54.767093 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:17:54.767053    2581 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/konnectivity-agent-5nngw" podStartSLOduration=4.078568692 podStartE2EDuration="13.767044125s" podCreationTimestamp="2026-05-26 15:17:41 +0000 UTC" firstStartedPulling="2026-05-26 15:17:44.217621 +0000 UTC m=+3.215324309" lastFinishedPulling="2026-05-26 15:17:53.90609642 +0000 UTC m=+12.903799742" observedRunningTime="2026-05-26 15:17:54.766795341 +0000 UTC m=+13.764498674" watchObservedRunningTime="2026-05-26 15:17:54.767044125 +0000 UTC m=+13.764747460"
May 26 15:17:54.786177 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:17:54.786140    2581 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-9rvq6" podStartSLOduration=4.066324284 podStartE2EDuration="13.786126097s" podCreationTimestamp="2026-05-26 15:17:41 +0000 UTC" firstStartedPulling="2026-05-26 15:17:44.208209391 +0000 UTC m=+3.205912700" lastFinishedPulling="2026-05-26 15:17:53.928011191 +0000 UTC m=+12.925714513" observedRunningTime="2026-05-26 15:17:54.785906993 +0000 UTC m=+13.783610360" watchObservedRunningTime="2026-05-26 15:17:54.786126097 +0000 UTC m=+13.783829431"
May 26 15:17:54.806801 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:17:54.806764    2581 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-image-registry/node-ca-khnr9" podStartSLOduration=4.131961878 podStartE2EDuration="13.806754813s" podCreationTimestamp="2026-05-26 15:17:41 +0000 UTC" firstStartedPulling="2026-05-26 15:17:44.221943058 +0000 UTC m=+3.219646371" lastFinishedPulling="2026-05-26 15:17:53.896735991 +0000 UTC m=+12.894439306" observedRunningTime="2026-05-26 15:17:54.806026242 +0000 UTC m=+13.803729574" watchObservedRunningTime="2026-05-26 15:17:54.806754813 +0000 UTC m=+13.804458182"
May 26 15:17:55.628059 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:17:55.627983    2581 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-5nngw"
May 26 15:17:55.628877 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:17:55.628855    2581 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-5nngw"
May 26 15:17:55.637704 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:17:55.637683    2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qr6zm"
May 26 15:17:55.637808 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:17:55.637731    2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-k56cd"
May 26 15:17:55.637874 ip-10-0-140-164 kubenswrapper[2581]: E0526 15:17:55.637830    2581 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qr6zm" podUID="000947e2-0eeb-4d43-8dc4-6132e5e6cc13"
May 26 15:17:55.638150 ip-10-0-140-164 kubenswrapper[2581]: E0526 15:17:55.638125    2581 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-k56cd" podUID="be858157-7e73-43be-81e8-aa5e9344923e"
May 26 15:17:55.713909 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:17:55.713878    2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-nprns" event={"ID":"efa65a4e-8688-4521-bf81-8938e3041f72","Type":"ContainerStarted","Data":"5f6d6fa0641e9e9277fc581b4f26e7cb6c259447af74edd46fd634beea498f71"}
May 26 15:17:55.730285 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:17:55.730227    2581 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-nprns" podStartSLOduration=5.036021273 podStartE2EDuration="14.730210149s" podCreationTimestamp="2026-05-26 15:17:41 +0000 UTC" firstStartedPulling="2026-05-26 15:17:44.21535344 +0000 UTC m=+3.213056765" lastFinishedPulling="2026-05-26 15:17:53.90954232 +0000 UTC m=+12.907245641" observedRunningTime="2026-05-26 15:17:55.729876418 +0000 UTC m=+14.727579751" watchObservedRunningTime="2026-05-26 15:17:55.730210149 +0000 UTC m=+14.727913481"
May 26 15:17:56.637384 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:17:56.637348    2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-npzrf"
May 26 15:17:56.637558 ip-10-0-140-164 kubenswrapper[2581]: E0526 15:17:56.637521    2581 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-npzrf" podUID="ae574985-4900-4b23-bf74-7c72c939f9bd"
May 26 15:17:56.715357 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:17:56.715328    2581 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness"
May 26 15:17:57.636853 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:17:57.636670    2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qr6zm"
May 26 15:17:57.637037 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:17:57.636677    2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-k56cd"
May 26 15:17:57.637037 ip-10-0-140-164 kubenswrapper[2581]: E0526 15:17:57.636930    2581 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qr6zm" podUID="000947e2-0eeb-4d43-8dc4-6132e5e6cc13"
May 26 15:17:57.637037 ip-10-0-140-164 kubenswrapper[2581]: E0526 15:17:57.637017    2581 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-k56cd" podUID="be858157-7e73-43be-81e8-aa5e9344923e"
May 26 15:17:58.637262 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:17:58.637236    2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-npzrf"
May 26 15:17:58.637579 ip-10-0-140-164 kubenswrapper[2581]: E0526 15:17:58.637354    2581 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-npzrf" podUID="ae574985-4900-4b23-bf74-7c72c939f9bd"
May 26 15:17:58.721043 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:17:58.721018    2581 generic.go:358] "Generic (PLEG): container finished" podID="afbaeb5e-924a-4076-a161-94955178994c" containerID="383d5f8115be40ad3ac6d2848dec9284258f581149a333cf5d2bf401b4186f6e" exitCode=0
May 26 15:17:58.721151 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:17:58.721053    2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-bglww" event={"ID":"afbaeb5e-924a-4076-a161-94955178994c","Type":"ContainerDied","Data":"383d5f8115be40ad3ac6d2848dec9284258f581149a333cf5d2bf401b4186f6e"}
May 26 15:17:59.232656 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:17:59.232618    2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/be858157-7e73-43be-81e8-aa5e9344923e-original-pull-secret\") pod \"global-pull-secret-syncer-k56cd\" (UID: \"be858157-7e73-43be-81e8-aa5e9344923e\") " pod="kube-system/global-pull-secret-syncer-k56cd"
May 26 15:17:59.232830 ip-10-0-140-164 kubenswrapper[2581]: E0526 15:17:59.232760    2581 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
May 26 15:17:59.232895 ip-10-0-140-164 kubenswrapper[2581]: E0526 15:17:59.232833    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/be858157-7e73-43be-81e8-aa5e9344923e-original-pull-secret podName:be858157-7e73-43be-81e8-aa5e9344923e nodeName:}" failed. No retries permitted until 2026-05-26 15:18:15.232812835 +0000 UTC m=+34.230516145 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/be858157-7e73-43be-81e8-aa5e9344923e-original-pull-secret") pod "global-pull-secret-syncer-k56cd" (UID: "be858157-7e73-43be-81e8-aa5e9344923e") : object "kube-system"/"original-pull-secret" not registered
May 26 15:17:59.245334 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:17:59.245310    2581 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-5nngw"
May 26 15:17:59.245493 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:17:59.245416    2581 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness"
May 26 15:17:59.246008 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:17:59.245859    2581 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-5nngw"
May 26 15:17:59.333936 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:17:59.333872    2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-m9l98\" (UniqueName: \"kubernetes.io/projected/000947e2-0eeb-4d43-8dc4-6132e5e6cc13-kube-api-access-m9l98\") pod \"network-check-target-qr6zm\" (UID: \"000947e2-0eeb-4d43-8dc4-6132e5e6cc13\") " pod="openshift-network-diagnostics/network-check-target-qr6zm"
May 26 15:17:59.334080 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:17:59.333955    2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ae574985-4900-4b23-bf74-7c72c939f9bd-metrics-certs\") pod \"network-metrics-daemon-npzrf\" (UID: \"ae574985-4900-4b23-bf74-7c72c939f9bd\") " pod="openshift-multus/network-metrics-daemon-npzrf"
May 26 15:17:59.334080 ip-10-0-140-164 kubenswrapper[2581]: E0526 15:17:59.334060    2581 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
May 26 15:17:59.334187 ip-10-0-140-164 kubenswrapper[2581]: E0526 15:17:59.334116    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ae574985-4900-4b23-bf74-7c72c939f9bd-metrics-certs podName:ae574985-4900-4b23-bf74-7c72c939f9bd nodeName:}" failed. No retries permitted until 2026-05-26 15:18:15.334098996 +0000 UTC m=+34.331802311 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ae574985-4900-4b23-bf74-7c72c939f9bd-metrics-certs") pod "network-metrics-daemon-npzrf" (UID: "ae574985-4900-4b23-bf74-7c72c939f9bd") : object "openshift-multus"/"metrics-daemon-secret" not registered
May 26 15:17:59.334498 ip-10-0-140-164 kubenswrapper[2581]: E0526 15:17:59.334477    2581 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
May 26 15:17:59.334498 ip-10-0-140-164 kubenswrapper[2581]: E0526 15:17:59.334501    2581 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
May 26 15:17:59.334650 ip-10-0-140-164 kubenswrapper[2581]: E0526 15:17:59.334514    2581 projected.go:194] Error preparing data for projected volume kube-api-access-m9l98 for pod openshift-network-diagnostics/network-check-target-qr6zm: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 26 15:17:59.334650 ip-10-0-140-164 kubenswrapper[2581]: E0526 15:17:59.334564    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/000947e2-0eeb-4d43-8dc4-6132e5e6cc13-kube-api-access-m9l98 podName:000947e2-0eeb-4d43-8dc4-6132e5e6cc13 nodeName:}" failed. No retries permitted until 2026-05-26 15:18:15.334548483 +0000 UTC m=+34.332251797 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-m9l98" (UniqueName: "kubernetes.io/projected/000947e2-0eeb-4d43-8dc4-6132e5e6cc13-kube-api-access-m9l98") pod "network-check-target-qr6zm" (UID: "000947e2-0eeb-4d43-8dc4-6132e5e6cc13") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 26 15:17:59.637355 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:17:59.637291    2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qr6zm"
May 26 15:17:59.637720 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:17:59.637303    2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-k56cd"
May 26 15:17:59.637720 ip-10-0-140-164 kubenswrapper[2581]: E0526 15:17:59.637386    2581 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qr6zm" podUID="000947e2-0eeb-4d43-8dc4-6132e5e6cc13"
May 26 15:17:59.637720 ip-10-0-140-164 kubenswrapper[2581]: E0526 15:17:59.637463    2581 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-k56cd" podUID="be858157-7e73-43be-81e8-aa5e9344923e"
May 26 15:18:00.637599 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:18:00.637561    2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-npzrf"
May 26 15:18:00.638017 ip-10-0-140-164 kubenswrapper[2581]: E0526 15:18:00.637719    2581 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-npzrf" podUID="ae574985-4900-4b23-bf74-7c72c939f9bd"
May 26 15:18:01.638012 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:18:01.637983    2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qr6zm"
May 26 15:18:01.638422 ip-10-0-140-164 kubenswrapper[2581]: E0526 15:18:01.638058    2581 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qr6zm" podUID="000947e2-0eeb-4d43-8dc4-6132e5e6cc13"
May 26 15:18:01.638422 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:18:01.638124    2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-k56cd"
May 26 15:18:01.638422 ip-10-0-140-164 kubenswrapper[2581]: E0526 15:18:01.638234    2581 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-k56cd" podUID="be858157-7e73-43be-81e8-aa5e9344923e"
May 26 15:18:02.637001 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:18:02.636969    2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-npzrf"
May 26 15:18:02.637212 ip-10-0-140-164 kubenswrapper[2581]: E0526 15:18:02.637091    2581 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-npzrf" podUID="ae574985-4900-4b23-bf74-7c72c939f9bd"
May 26 15:18:03.171586 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:18:03.171552    2581 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
May 26 15:18:03.575307 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:18:03.575039    2581 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-05-26T15:18:03.171583179Z","UUID":"a000394e-8e5c-48da-8e95-1b7f3f110296","Handler":null,"Name":"","Endpoint":""}
May 26 15:18:03.576774 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:18:03.576756    2581 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
May 26 15:18:03.576871 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:18:03.576780    2581 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
May 26 15:18:03.637091 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:18:03.637069    2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-k56cd"
May 26 15:18:03.637245 ip-10-0-140-164 kubenswrapper[2581]: E0526 15:18:03.637178    2581 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-k56cd" podUID="be858157-7e73-43be-81e8-aa5e9344923e"
May 26 15:18:03.637534 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:18:03.637515    2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qr6zm"
May 26 15:18:03.637922 ip-10-0-140-164 kubenswrapper[2581]: E0526 15:18:03.637613    2581 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qr6zm" podUID="000947e2-0eeb-4d43-8dc4-6132e5e6cc13"
May 26 15:18:03.731809 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:18:03.731775    2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-x5ptz" event={"ID":"d861eb05-53c3-4d05-8dce-5a7c60573358","Type":"ContainerStarted","Data":"3488dcd17e2dfaa13d55bba749606f340682c2a4269d5645b7b23d885189017a"}
May 26 15:18:03.736095 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:18:03.736046    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-gjh9c_a02c2727-c53c-48c3-aba7-acde4eef632c/ovn-acl-logging/0.log"
May 26 15:18:03.736431 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:18:03.736409    2581 generic.go:358] "Generic (PLEG): container finished" podID="a02c2727-c53c-48c3-aba7-acde4eef632c" containerID="93b73a3ec9d1ee2ae30a52950b6814b8a4f86bbe2ae9181b6eacf9647d75eb07" exitCode=1
May 26 15:18:03.736550 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:18:03.736473    2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-gjh9c" event={"ID":"a02c2727-c53c-48c3-aba7-acde4eef632c","Type":"ContainerStarted","Data":"b438f4dd97b096c389d23801d8451eab86259e197779776254375d44d590e841"}
May 26 15:18:03.736550 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:18:03.736493    2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-gjh9c" event={"ID":"a02c2727-c53c-48c3-aba7-acde4eef632c","Type":"ContainerStarted","Data":"c20bf1f5b2244955bed82eda55b4b679501bebe5d35addff5a48737269c95010"}
May 26 15:18:03.736550 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:18:03.736507    2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-gjh9c" event={"ID":"a02c2727-c53c-48c3-aba7-acde4eef632c","Type":"ContainerStarted","Data":"5ad753d40410656e7784d5e50bcd719539b3c3c37764394ee1566c3326363388"}
May 26 15:18:03.736550 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:18:03.736518    2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-gjh9c" event={"ID":"a02c2727-c53c-48c3-aba7-acde4eef632c","Type":"ContainerStarted","Data":"b05726823b013b72787fa6dd9fe96f4668bed5d15007bd06a64e94ae08a1cde5"}
May 26 15:18:03.736550 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:18:03.736530    2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-gjh9c" event={"ID":"a02c2727-c53c-48c3-aba7-acde4eef632c","Type":"ContainerDied","Data":"93b73a3ec9d1ee2ae30a52950b6814b8a4f86bbe2ae9181b6eacf9647d75eb07"}
May 26 15:18:03.736550 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:18:03.736544    2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-gjh9c" event={"ID":"a02c2727-c53c-48c3-aba7-acde4eef632c","Type":"ContainerStarted","Data":"622d21258e29bab9d9798b8e60e87f2439ca8258be2fd3d73c1a92b40353a94b"}
May 26 15:18:03.738333 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:18:03.738310    2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vsvmw" event={"ID":"07693aae-634c-4a2f-ac21-fb1bf39c239a","Type":"ContainerStarted","Data":"154f96f1deef9ff6402d6914b7d6f93fa89765e21a0eb90808d192b10a795e41"}
May 26 15:18:04.637532 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:18:04.637503    2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-npzrf"
May 26 15:18:04.638182 ip-10-0-140-164 kubenswrapper[2581]: E0526 15:18:04.637629    2581 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-npzrf" podUID="ae574985-4900-4b23-bf74-7c72c939f9bd"
May 26 15:18:04.741877 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:18:04.741806    2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vsvmw" event={"ID":"07693aae-634c-4a2f-ac21-fb1bf39c239a","Type":"ContainerStarted","Data":"cf76ab1af3d918d16053607d9a708acefe7a33d1633083ad4df811ebbc4f41be"}
May 26 15:18:04.762927 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:18:04.762887    2581 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/multus-x5ptz" podStartSLOduration=3.975458442 podStartE2EDuration="22.762872797s" podCreationTimestamp="2026-05-26 15:17:42 +0000 UTC" firstStartedPulling="2026-05-26 15:17:44.218243514 +0000 UTC m=+3.215946841" lastFinishedPulling="2026-05-26 15:18:03.005657884 +0000 UTC m=+22.003361196" observedRunningTime="2026-05-26 15:18:03.76117814 +0000 UTC m=+22.758881471" watchObservedRunningTime="2026-05-26 15:18:04.762872797 +0000 UTC m=+23.760576129"
May 26 15:18:04.763122 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:18:04.763095    2581 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vsvmw" podStartSLOduration=3.56679674 podStartE2EDuration="23.763090017s" podCreationTimestamp="2026-05-26 15:17:41 +0000 UTC" firstStartedPulling="2026-05-26 15:17:44.220879796 +0000 UTC m=+3.218583112" lastFinishedPulling="2026-05-26 15:18:04.417173077 +0000 UTC m=+23.414876389" observedRunningTime="2026-05-26 15:18:04.762609626 +0000 UTC m=+23.760312959" watchObservedRunningTime="2026-05-26 15:18:04.763090017 +0000 UTC m=+23.760793373"
May 26 15:18:05.637013 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:18:05.636979    2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-k56cd"
May 26 15:18:05.637183 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:18:05.637021    2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qr6zm"
May 26 15:18:05.637183 ip-10-0-140-164 kubenswrapper[2581]: E0526 15:18:05.637116    2581 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-k56cd" podUID="be858157-7e73-43be-81e8-aa5e9344923e"
May 26 15:18:05.637316 ip-10-0-140-164 kubenswrapper[2581]: E0526 15:18:05.637244    2581 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qr6zm" podUID="000947e2-0eeb-4d43-8dc4-6132e5e6cc13"
May 26 15:18:06.636758 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:18:06.636719    2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-npzrf"
May 26 15:18:06.637163 ip-10-0-140-164 kubenswrapper[2581]: E0526 15:18:06.636862    2581 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-npzrf" podUID="ae574985-4900-4b23-bf74-7c72c939f9bd"
May 26 15:18:07.637139 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:18:07.637101    2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-k56cd"
May 26 15:18:07.637139 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:18:07.637122    2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qr6zm"
May 26 15:18:07.637678 ip-10-0-140-164 kubenswrapper[2581]: E0526 15:18:07.637212    2581 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-k56cd" podUID="be858157-7e73-43be-81e8-aa5e9344923e"
May 26 15:18:07.637678 ip-10-0-140-164 kubenswrapper[2581]: E0526 15:18:07.637373    2581 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qr6zm" podUID="000947e2-0eeb-4d43-8dc4-6132e5e6cc13"
May 26 15:18:07.748396 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:18:07.748363    2581 generic.go:358] "Generic (PLEG): container finished" podID="afbaeb5e-924a-4076-a161-94955178994c" containerID="ef05f48d37de151ad01f804d816e3036a056b5107de0690b9d85ee42114dc77c" exitCode=0
May 26 15:18:07.748532 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:18:07.748427    2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-bglww" event={"ID":"afbaeb5e-924a-4076-a161-94955178994c","Type":"ContainerDied","Data":"ef05f48d37de151ad01f804d816e3036a056b5107de0690b9d85ee42114dc77c"}
May 26 15:18:07.751982 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:18:07.751961    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-gjh9c_a02c2727-c53c-48c3-aba7-acde4eef632c/ovn-acl-logging/0.log"
May 26 15:18:07.752379 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:18:07.752355    2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-gjh9c" event={"ID":"a02c2727-c53c-48c3-aba7-acde4eef632c","Type":"ContainerStarted","Data":"09f5a1f3f19dfd45c93c2bf4429121c631a999854f484ff7a6560dd5b32749dd"}
May 26 15:18:08.637297 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:18:08.637258    2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-npzrf"
May 26 15:18:08.637578 ip-10-0-140-164 kubenswrapper[2581]: E0526 15:18:08.637375    2581 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-npzrf" podUID="ae574985-4900-4b23-bf74-7c72c939f9bd"
May 26 15:18:08.755452 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:18:08.755428    2581 generic.go:358] "Generic (PLEG): container finished" podID="afbaeb5e-924a-4076-a161-94955178994c" containerID="f9de3b95aaa73ab78cf7a790d66f764df1c7091819396dec25f1fa7a4d3eadf8" exitCode=0
May 26 15:18:08.755541 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:18:08.755479    2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-bglww" event={"ID":"afbaeb5e-924a-4076-a161-94955178994c","Type":"ContainerDied","Data":"f9de3b95aaa73ab78cf7a790d66f764df1c7091819396dec25f1fa7a4d3eadf8"}
May 26 15:18:09.637466 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:18:09.637256    2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qr6zm"
May 26 15:18:09.637881 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:18:09.637256    2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-k56cd"
May 26 15:18:09.637881 ip-10-0-140-164 kubenswrapper[2581]: E0526 15:18:09.637514    2581 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qr6zm" podUID="000947e2-0eeb-4d43-8dc4-6132e5e6cc13"
May 26 15:18:09.637881 ip-10-0-140-164 kubenswrapper[2581]: E0526 15:18:09.637582    2581 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-k56cd" podUID="be858157-7e73-43be-81e8-aa5e9344923e"
May 26 15:18:09.759337 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:18:09.759314    2581 generic.go:358] "Generic (PLEG): container finished" podID="afbaeb5e-924a-4076-a161-94955178994c" containerID="bbabd7a0f63f61c0ef31edb76977ba1a1dfa7dcc96b351944ee7686aeb6019b5" exitCode=0
May 26 15:18:09.759439 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:18:09.759384    2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-bglww" event={"ID":"afbaeb5e-924a-4076-a161-94955178994c","Type":"ContainerDied","Data":"bbabd7a0f63f61c0ef31edb76977ba1a1dfa7dcc96b351944ee7686aeb6019b5"}
May 26 15:18:09.764932 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:18:09.764912    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-gjh9c_a02c2727-c53c-48c3-aba7-acde4eef632c/ovn-acl-logging/0.log"
May 26 15:18:09.765350 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:18:09.765326    2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-gjh9c" event={"ID":"a02c2727-c53c-48c3-aba7-acde4eef632c","Type":"ContainerStarted","Data":"fa4bc2ac1684b0c44cce38b1f14c9627415b0003955ee475ec71dd2b585f1eec"}
May 26 15:18:09.765643 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:18:09.765621    2581 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-gjh9c"
May 26 15:18:09.765757 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:18:09.765661    2581 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-gjh9c"
May 26 15:18:09.765834 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:18:09.765791    2581 scope.go:117] "RemoveContainer" containerID="93b73a3ec9d1ee2ae30a52950b6814b8a4f86bbe2ae9181b6eacf9647d75eb07"
May 26 15:18:09.781881 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:18:09.781863    2581 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-gjh9c"
May 26 15:18:10.637098 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:18:10.637065    2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-npzrf"
May 26 15:18:10.637254 ip-10-0-140-164 kubenswrapper[2581]: E0526 15:18:10.637200    2581 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-npzrf" podUID="ae574985-4900-4b23-bf74-7c72c939f9bd"
May 26 15:18:10.770237 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:18:10.770213    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-gjh9c_a02c2727-c53c-48c3-aba7-acde4eef632c/ovn-acl-logging/0.log"
May 26 15:18:10.770672 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:18:10.770620    2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-gjh9c" event={"ID":"a02c2727-c53c-48c3-aba7-acde4eef632c","Type":"ContainerStarted","Data":"40342bded9a6d1cda7f7e55dad55485b24364f65037b5857c6213e09b9104419"}
May 26 15:18:10.770882 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:18:10.770859    2581 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-gjh9c"
May 26 15:18:10.788751 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:18:10.788732    2581 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-gjh9c"
May 26 15:18:10.805131 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:18:10.805081    2581 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-gjh9c" podStartSLOduration=11.052407429 podStartE2EDuration="29.805055691s" podCreationTimestamp="2026-05-26 15:17:41 +0000 UTC" firstStartedPulling="2026-05-26 15:17:44.212082769 +0000 UTC m=+3.209786079" lastFinishedPulling="2026-05-26 15:18:02.964731024 +0000 UTC m=+21.962434341" observedRunningTime="2026-05-26 15:18:10.802288102 +0000 UTC m=+29.799991429" watchObservedRunningTime="2026-05-26 15:18:10.805055691 +0000 UTC m=+29.802759027"
May 26 15:18:11.353011 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:18:11.351604    2581 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-k56cd"]
May 26 15:18:11.353011 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:18:11.351941    2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-k56cd"
May 26 15:18:11.353011 ip-10-0-140-164 kubenswrapper[2581]: E0526 15:18:11.352040    2581 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-k56cd" podUID="be858157-7e73-43be-81e8-aa5e9344923e"
May 26 15:18:11.353011 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:18:11.352834    2581 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-npzrf"]
May 26 15:18:11.353011 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:18:11.352954    2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-npzrf"
May 26 15:18:11.353352 ip-10-0-140-164 kubenswrapper[2581]: E0526 15:18:11.353031    2581 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-npzrf" podUID="ae574985-4900-4b23-bf74-7c72c939f9bd"
May 26 15:18:11.353655 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:18:11.353634    2581 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-qr6zm"]
May 26 15:18:11.353740 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:18:11.353729    2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qr6zm"
May 26 15:18:11.353831 ip-10-0-140-164 kubenswrapper[2581]: E0526 15:18:11.353814    2581 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qr6zm" podUID="000947e2-0eeb-4d43-8dc4-6132e5e6cc13"
May 26 15:18:12.637440 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:18:12.637410    2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qr6zm"
May 26 15:18:12.638008 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:18:12.637446    2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-npzrf"
May 26 15:18:12.638008 ip-10-0-140-164 kubenswrapper[2581]: E0526 15:18:12.637510    2581 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qr6zm" podUID="000947e2-0eeb-4d43-8dc4-6132e5e6cc13"
May 26 15:18:12.638008 ip-10-0-140-164 kubenswrapper[2581]: E0526 15:18:12.637642    2581 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-npzrf" podUID="ae574985-4900-4b23-bf74-7c72c939f9bd"
May 26 15:18:13.637525 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:18:13.637492    2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-k56cd"
May 26 15:18:13.637967 ip-10-0-140-164 kubenswrapper[2581]: E0526 15:18:13.637599    2581 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-k56cd" podUID="be858157-7e73-43be-81e8-aa5e9344923e"
May 26 15:18:14.637581 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:18:14.637550    2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-npzrf"
May 26 15:18:14.637932 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:18:14.637550    2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qr6zm"
May 26 15:18:14.637932 ip-10-0-140-164 kubenswrapper[2581]: E0526 15:18:14.637696    2581 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-npzrf" podUID="ae574985-4900-4b23-bf74-7c72c939f9bd"
May 26 15:18:14.637932 ip-10-0-140-164 kubenswrapper[2581]: E0526 15:18:14.637744    2581 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qr6zm" podUID="000947e2-0eeb-4d43-8dc4-6132e5e6cc13"
May 26 15:18:14.853484 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:18:14.853450    2581 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-140-164.ec2.internal" event="NodeReady"
May 26 15:18:14.853727 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:18:14.853587    2581 kubelet_node_status.go:550] "Fast updating node status as it just became ready"
May 26 15:18:14.896878 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:18:14.896845    2581 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-797775bcb5-x7sns"]
May 26 15:18:14.900840 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:18:14.900812    2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-797775bcb5-x7sns"
May 26 15:18:14.903707 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:18:14.903679    2581 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
May 26 15:18:14.904109 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:18:14.904087    2581 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-kdpdq\""
May 26 15:18:14.904312 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:18:14.904134    2581 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
May 26 15:18:14.904419 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:18:14.904400    2581 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
May 26 15:18:14.909913 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:18:14.909890    2581 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
May 26 15:18:14.913470 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:18:14.913448    2581 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-kgzwq"]
May 26 15:18:14.916962 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:18:14.916942    2581 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-797775bcb5-x7sns"]
May 26 15:18:14.917087 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:18:14.917072    2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-kgzwq"
May 26 15:18:14.919772 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:18:14.919754    2581 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
May 26 15:18:14.920372 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:18:14.920096    2581 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-m8xk4\""
May 26 15:18:14.920462 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:18:14.920407    2581 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
May 26 15:18:14.920558 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:18:14.920544    2581 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
May 26 15:18:14.929505 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:18:14.929481    2581 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-kgzwq"]
May 26 15:18:15.015724 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:18:15.015700    2581 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-l4rks"]
May 26 15:18:15.018720 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:18:15.018690    2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-l4rks"
May 26 15:18:15.021368 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:18:15.021298    2581 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
May 26 15:18:15.021528 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:18:15.021513    2581 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
May 26 15:18:15.021681 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:18:15.021660    2581 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-lcntx\""
May 26 15:18:15.037901 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:18:15.037879    2581 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-l4rks"]
May 26 15:18:15.058263 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:18:15.058240    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/676b1633-43dc-4fe0-bf8b-5f8247a3e6e2-registry-tls\") pod \"image-registry-797775bcb5-x7sns\" (UID: \"676b1633-43dc-4fe0-bf8b-5f8247a3e6e2\") " pod="openshift-image-registry/image-registry-797775bcb5-x7sns"
May 26 15:18:15.058392 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:18:15.058288    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/676b1633-43dc-4fe0-bf8b-5f8247a3e6e2-bound-sa-token\") pod \"image-registry-797775bcb5-x7sns\" (UID: \"676b1633-43dc-4fe0-bf8b-5f8247a3e6e2\") " pod="openshift-image-registry/image-registry-797775bcb5-x7sns"
May 26 15:18:15.058392 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:18:15.058352    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/676b1633-43dc-4fe0-bf8b-5f8247a3e6e2-ca-trust-extracted\") pod \"image-registry-797775bcb5-x7sns\" (UID: \"676b1633-43dc-4fe0-bf8b-5f8247a3e6e2\") " pod="openshift-image-registry/image-registry-797775bcb5-x7sns"
May 26 15:18:15.058503 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:18:15.058406    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f6g7x\" (UniqueName: \"kubernetes.io/projected/37c203f3-fea7-4b18-a713-d805bf7dd8d9-kube-api-access-f6g7x\") pod \"ingress-canary-kgzwq\" (UID: \"37c203f3-fea7-4b18-a713-d805bf7dd8d9\") " pod="openshift-ingress-canary/ingress-canary-kgzwq"
May 26 15:18:15.058503 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:18:15.058441    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/676b1633-43dc-4fe0-bf8b-5f8247a3e6e2-registry-certificates\") pod \"image-registry-797775bcb5-x7sns\" (UID: \"676b1633-43dc-4fe0-bf8b-5f8247a3e6e2\") " pod="openshift-image-registry/image-registry-797775bcb5-x7sns"
May 26 15:18:15.058503 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:18:15.058465    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8l2zf\" (UniqueName: \"kubernetes.io/projected/676b1633-43dc-4fe0-bf8b-5f8247a3e6e2-kube-api-access-8l2zf\") pod \"image-registry-797775bcb5-x7sns\" (UID: \"676b1633-43dc-4fe0-bf8b-5f8247a3e6e2\") " pod="openshift-image-registry/image-registry-797775bcb5-x7sns"
May 26 15:18:15.058503 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:18:15.058495    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/676b1633-43dc-4fe0-bf8b-5f8247a3e6e2-trusted-ca\") pod \"image-registry-797775bcb5-x7sns\" (UID: \"676b1633-43dc-4fe0-bf8b-5f8247a3e6e2\") " pod="openshift-image-registry/image-registry-797775bcb5-x7sns"
May 26 15:18:15.058712 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:18:15.058529    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/676b1633-43dc-4fe0-bf8b-5f8247a3e6e2-installation-pull-secrets\") pod \"image-registry-797775bcb5-x7sns\" (UID: \"676b1633-43dc-4fe0-bf8b-5f8247a3e6e2\") " pod="openshift-image-registry/image-registry-797775bcb5-x7sns"
May 26 15:18:15.058712 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:18:15.058551    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/37c203f3-fea7-4b18-a713-d805bf7dd8d9-cert\") pod \"ingress-canary-kgzwq\" (UID: \"37c203f3-fea7-4b18-a713-d805bf7dd8d9\") " pod="openshift-ingress-canary/ingress-canary-kgzwq"
May 26 15:18:15.058712 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:18:15.058617    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/676b1633-43dc-4fe0-bf8b-5f8247a3e6e2-image-registry-private-configuration\") pod \"image-registry-797775bcb5-x7sns\" (UID: \"676b1633-43dc-4fe0-bf8b-5f8247a3e6e2\") " pod="openshift-image-registry/image-registry-797775bcb5-x7sns"
May 26 15:18:15.159220 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:18:15.159144    2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/676b1633-43dc-4fe0-bf8b-5f8247a3e6e2-trusted-ca\") pod \"image-registry-797775bcb5-x7sns\" (UID: \"676b1633-43dc-4fe0-bf8b-5f8247a3e6e2\") " pod="openshift-image-registry/image-registry-797775bcb5-x7sns"
May 26 15:18:15.159220 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:18:15.159187    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c1324645-ef27-41da-851e-615da7eab3b0-tmp-dir\") pod \"dns-default-l4rks\" (UID: \"c1324645-ef27-41da-851e-615da7eab3b0\") " pod="openshift-dns/dns-default-l4rks"
May 26 15:18:15.159438 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:18:15.159237    2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/676b1633-43dc-4fe0-bf8b-5f8247a3e6e2-installation-pull-secrets\") pod \"image-registry-797775bcb5-x7sns\" (UID: \"676b1633-43dc-4fe0-bf8b-5f8247a3e6e2\") " pod="openshift-image-registry/image-registry-797775bcb5-x7sns"
May 26 15:18:15.159438 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:18:15.159286    2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/37c203f3-fea7-4b18-a713-d805bf7dd8d9-cert\") pod \"ingress-canary-kgzwq\" (UID: \"37c203f3-fea7-4b18-a713-d805bf7dd8d9\") " pod="openshift-ingress-canary/ingress-canary-kgzwq"
May 26 15:18:15.159438 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:18:15.159376    2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/676b1633-43dc-4fe0-bf8b-5f8247a3e6e2-image-registry-private-configuration\") pod \"image-registry-797775bcb5-x7sns\" (UID: \"676b1633-43dc-4fe0-bf8b-5f8247a3e6e2\") " pod="openshift-image-registry/image-registry-797775bcb5-x7sns"
May 26 15:18:15.159438 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:18:15.159422    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kxdvl\" (UniqueName: \"kubernetes.io/projected/c1324645-ef27-41da-851e-615da7eab3b0-kube-api-access-kxdvl\") pod \"dns-default-l4rks\" (UID: \"c1324645-ef27-41da-851e-615da7eab3b0\") " pod="openshift-dns/dns-default-l4rks"
May 26 15:18:15.159630 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:18:15.159464    2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/676b1633-43dc-4fe0-bf8b-5f8247a3e6e2-registry-tls\") pod \"image-registry-797775bcb5-x7sns\" (UID: \"676b1633-43dc-4fe0-bf8b-5f8247a3e6e2\") " pod="openshift-image-registry/image-registry-797775bcb5-x7sns"
May 26 15:18:15.159630 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:18:15.159491    2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/676b1633-43dc-4fe0-bf8b-5f8247a3e6e2-bound-sa-token\") pod \"image-registry-797775bcb5-x7sns\" (UID: \"676b1633-43dc-4fe0-bf8b-5f8247a3e6e2\") " pod="openshift-image-registry/image-registry-797775bcb5-x7sns"
May 26 15:18:15.159630 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:18:15.159526    2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/676b1633-43dc-4fe0-bf8b-5f8247a3e6e2-ca-trust-extracted\") pod \"image-registry-797775bcb5-x7sns\" (UID: \"676b1633-43dc-4fe0-bf8b-5f8247a3e6e2\") " pod="openshift-image-registry/image-registry-797775bcb5-x7sns"
May 26 15:18:15.159630 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:18:15.159565    2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-f6g7x\" (UniqueName: \"kubernetes.io/projected/37c203f3-fea7-4b18-a713-d805bf7dd8d9-kube-api-access-f6g7x\") pod \"ingress-canary-kgzwq\" (UID: \"37c203f3-fea7-4b18-a713-d805bf7dd8d9\") " pod="openshift-ingress-canary/ingress-canary-kgzwq"
May 26 15:18:15.159630 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:18:15.159591    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c1324645-ef27-41da-851e-615da7eab3b0-metrics-tls\") pod \"dns-default-l4rks\" (UID: \"c1324645-ef27-41da-851e-615da7eab3b0\") " pod="openshift-dns/dns-default-l4rks"
May 26 15:18:15.159630 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:18:15.159627    2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/676b1633-43dc-4fe0-bf8b-5f8247a3e6e2-registry-certificates\") pod \"image-registry-797775bcb5-x7sns\" (UID: \"676b1633-43dc-4fe0-bf8b-5f8247a3e6e2\") " pod="openshift-image-registry/image-registry-797775bcb5-x7sns"
May 26 15:18:15.159877 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:18:15.159652    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/c1324645-ef27-41da-851e-615da7eab3b0-config-volume\") pod \"dns-default-l4rks\" (UID: \"c1324645-ef27-41da-851e-615da7eab3b0\") " pod="openshift-dns/dns-default-l4rks"
May 26 15:18:15.159877 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:18:15.159689    2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-8l2zf\" (UniqueName: \"kubernetes.io/projected/676b1633-43dc-4fe0-bf8b-5f8247a3e6e2-kube-api-access-8l2zf\") pod \"image-registry-797775bcb5-x7sns\" (UID: \"676b1633-43dc-4fe0-bf8b-5f8247a3e6e2\") " pod="openshift-image-registry/image-registry-797775bcb5-x7sns"
May 26 15:18:15.160043 ip-10-0-140-164 kubenswrapper[2581]: E0526 15:18:15.159388    2581 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
May 26 15:18:15.160116 ip-10-0-140-164 kubenswrapper[2581]: E0526 15:18:15.160063    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/37c203f3-fea7-4b18-a713-d805bf7dd8d9-cert podName:37c203f3-fea7-4b18-a713-d805bf7dd8d9 nodeName:}" failed. No retries permitted until 2026-05-26 15:18:15.660041407 +0000 UTC m=+34.657744732 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/37c203f3-fea7-4b18-a713-d805bf7dd8d9-cert") pod "ingress-canary-kgzwq" (UID: "37c203f3-fea7-4b18-a713-d805bf7dd8d9") : secret "canary-serving-cert" not found
May 26 15:18:15.160116 ip-10-0-140-164 kubenswrapper[2581]: E0526 15:18:15.160111    2581 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
May 26 15:18:15.160207 ip-10-0-140-164 kubenswrapper[2581]: E0526 15:18:15.160126    2581 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-797775bcb5-x7sns: secret "image-registry-tls" not found
May 26 15:18:15.160207 ip-10-0-140-164 kubenswrapper[2581]: E0526 15:18:15.160164    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/676b1633-43dc-4fe0-bf8b-5f8247a3e6e2-registry-tls podName:676b1633-43dc-4fe0-bf8b-5f8247a3e6e2 nodeName:}" failed. No retries permitted until 2026-05-26 15:18:15.660150866 +0000 UTC m=+34.657854190 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/676b1633-43dc-4fe0-bf8b-5f8247a3e6e2-registry-tls") pod "image-registry-797775bcb5-x7sns" (UID: "676b1633-43dc-4fe0-bf8b-5f8247a3e6e2") : secret "image-registry-tls" not found
May 26 15:18:15.160207 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:18:15.160185    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/676b1633-43dc-4fe0-bf8b-5f8247a3e6e2-trusted-ca\") pod \"image-registry-797775bcb5-x7sns\" (UID: \"676b1633-43dc-4fe0-bf8b-5f8247a3e6e2\") " pod="openshift-image-registry/image-registry-797775bcb5-x7sns"
May 26 15:18:15.160623 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:18:15.160600    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/676b1633-43dc-4fe0-bf8b-5f8247a3e6e2-registry-certificates\") pod \"image-registry-797775bcb5-x7sns\" (UID: \"676b1633-43dc-4fe0-bf8b-5f8247a3e6e2\") " pod="openshift-image-registry/image-registry-797775bcb5-x7sns"
May 26 15:18:15.160713 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:18:15.160628    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/676b1633-43dc-4fe0-bf8b-5f8247a3e6e2-ca-trust-extracted\") pod \"image-registry-797775bcb5-x7sns\" (UID: \"676b1633-43dc-4fe0-bf8b-5f8247a3e6e2\") " pod="openshift-image-registry/image-registry-797775bcb5-x7sns"
May 26 15:18:15.164705 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:18:15.164684    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/676b1633-43dc-4fe0-bf8b-5f8247a3e6e2-installation-pull-secrets\") pod \"image-registry-797775bcb5-x7sns\" (UID: \"676b1633-43dc-4fe0-bf8b-5f8247a3e6e2\") " pod="openshift-image-registry/image-registry-797775bcb5-x7sns"
May 26 15:18:15.164805 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:18:15.164695    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/676b1633-43dc-4fe0-bf8b-5f8247a3e6e2-image-registry-private-configuration\") pod \"image-registry-797775bcb5-x7sns\" (UID: \"676b1633-43dc-4fe0-bf8b-5f8247a3e6e2\") " pod="openshift-image-registry/image-registry-797775bcb5-x7sns"
May 26 15:18:15.171791 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:18:15.171774    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8l2zf\" (UniqueName: \"kubernetes.io/projected/676b1633-43dc-4fe0-bf8b-5f8247a3e6e2-kube-api-access-8l2zf\") pod \"image-registry-797775bcb5-x7sns\" (UID: \"676b1633-43dc-4fe0-bf8b-5f8247a3e6e2\") " pod="openshift-image-registry/image-registry-797775bcb5-x7sns"
May 26 15:18:15.176020 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:18:15.175998    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-f6g7x\" (UniqueName: \"kubernetes.io/projected/37c203f3-fea7-4b18-a713-d805bf7dd8d9-kube-api-access-f6g7x\") pod \"ingress-canary-kgzwq\" (UID: \"37c203f3-fea7-4b18-a713-d805bf7dd8d9\") " pod="openshift-ingress-canary/ingress-canary-kgzwq"
May 26 15:18:15.176495 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:18:15.176478    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/676b1633-43dc-4fe0-bf8b-5f8247a3e6e2-bound-sa-token\") pod \"image-registry-797775bcb5-x7sns\" (UID: \"676b1633-43dc-4fe0-bf8b-5f8247a3e6e2\") " pod="openshift-image-registry/image-registry-797775bcb5-x7sns"
May 26 15:18:15.260949 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:18:15.260907    2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c1324645-ef27-41da-851e-615da7eab3b0-metrics-tls\") pod \"dns-default-l4rks\" (UID: \"c1324645-ef27-41da-851e-615da7eab3b0\") " pod="openshift-dns/dns-default-l4rks"
May 26 15:18:15.261073 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:18:15.260956    2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/c1324645-ef27-41da-851e-615da7eab3b0-config-volume\") pod \"dns-default-l4rks\" (UID: \"c1324645-ef27-41da-851e-615da7eab3b0\") " pod="openshift-dns/dns-default-l4rks"
May 26 15:18:15.261073 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:18:15.260988    2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c1324645-ef27-41da-851e-615da7eab3b0-tmp-dir\") pod \"dns-default-l4rks\" (UID: \"c1324645-ef27-41da-851e-615da7eab3b0\") " pod="openshift-dns/dns-default-l4rks"
May 26 15:18:15.261073 ip-10-0-140-164 kubenswrapper[2581]: E0526 15:18:15.261046    2581 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
May 26 15:18:15.261073 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:18:15.261069    2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-kxdvl\" (UniqueName: \"kubernetes.io/projected/c1324645-ef27-41da-851e-615da7eab3b0-kube-api-access-kxdvl\") pod \"dns-default-l4rks\" (UID: \"c1324645-ef27-41da-851e-615da7eab3b0\") " pod="openshift-dns/dns-default-l4rks"
May 26 15:18:15.261298 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:18:15.261098    2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/be858157-7e73-43be-81e8-aa5e9344923e-original-pull-secret\") pod \"global-pull-secret-syncer-k56cd\" (UID: \"be858157-7e73-43be-81e8-aa5e9344923e\") " pod="kube-system/global-pull-secret-syncer-k56cd"
May 26 15:18:15.261298 ip-10-0-140-164 kubenswrapper[2581]: E0526 15:18:15.261122    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c1324645-ef27-41da-851e-615da7eab3b0-metrics-tls podName:c1324645-ef27-41da-851e-615da7eab3b0 nodeName:}" failed. No retries permitted until 2026-05-26 15:18:15.761099802 +0000 UTC m=+34.758803131 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/c1324645-ef27-41da-851e-615da7eab3b0-metrics-tls") pod "dns-default-l4rks" (UID: "c1324645-ef27-41da-851e-615da7eab3b0") : secret "dns-default-metrics-tls" not found
May 26 15:18:15.261298 ip-10-0-140-164 kubenswrapper[2581]: E0526 15:18:15.261177    2581 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
May 26 15:18:15.261298 ip-10-0-140-164 kubenswrapper[2581]: E0526 15:18:15.261294    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/be858157-7e73-43be-81e8-aa5e9344923e-original-pull-secret podName:be858157-7e73-43be-81e8-aa5e9344923e nodeName:}" failed. No retries permitted until 2026-05-26 15:18:47.261259555 +0000 UTC m=+66.258962868 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/be858157-7e73-43be-81e8-aa5e9344923e-original-pull-secret") pod "global-pull-secret-syncer-k56cd" (UID: "be858157-7e73-43be-81e8-aa5e9344923e") : object "kube-system"/"original-pull-secret" not registered
May 26 15:18:15.261483 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:18:15.261462    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c1324645-ef27-41da-851e-615da7eab3b0-tmp-dir\") pod \"dns-default-l4rks\" (UID: \"c1324645-ef27-41da-851e-615da7eab3b0\") " pod="openshift-dns/dns-default-l4rks"
May 26 15:18:15.262383 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:18:15.262362    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/c1324645-ef27-41da-851e-615da7eab3b0-config-volume\") pod \"dns-default-l4rks\" (UID: \"c1324645-ef27-41da-851e-615da7eab3b0\") " pod="openshift-dns/dns-default-l4rks"
May 26 15:18:15.273494 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:18:15.273475    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kxdvl\" (UniqueName: \"kubernetes.io/projected/c1324645-ef27-41da-851e-615da7eab3b0-kube-api-access-kxdvl\") pod \"dns-default-l4rks\" (UID: \"c1324645-ef27-41da-851e-615da7eab3b0\") " pod="openshift-dns/dns-default-l4rks"
May 26 15:18:15.361497 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:18:15.361468    2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ae574985-4900-4b23-bf74-7c72c939f9bd-metrics-certs\") pod \"network-metrics-daemon-npzrf\" (UID: \"ae574985-4900-4b23-bf74-7c72c939f9bd\") " pod="openshift-multus/network-metrics-daemon-npzrf"
May 26 15:18:15.361612 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:18:15.361520    2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-m9l98\" (UniqueName: \"kubernetes.io/projected/000947e2-0eeb-4d43-8dc4-6132e5e6cc13-kube-api-access-m9l98\") pod \"network-check-target-qr6zm\" (UID: \"000947e2-0eeb-4d43-8dc4-6132e5e6cc13\") " pod="openshift-network-diagnostics/network-check-target-qr6zm"
May 26 15:18:15.361662 ip-10-0-140-164 kubenswrapper[2581]: E0526 15:18:15.361624    2581 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
May 26 15:18:15.361662 ip-10-0-140-164 kubenswrapper[2581]: E0526 15:18:15.361652    2581 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
May 26 15:18:15.361738 ip-10-0-140-164 kubenswrapper[2581]: E0526 15:18:15.361665    2581 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
May 26 15:18:15.361738 ip-10-0-140-164 kubenswrapper[2581]: E0526 15:18:15.361674    2581 projected.go:194] Error preparing data for projected volume kube-api-access-m9l98 for pod openshift-network-diagnostics/network-check-target-qr6zm: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 26 15:18:15.361738 ip-10-0-140-164 kubenswrapper[2581]: E0526 15:18:15.361692    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ae574985-4900-4b23-bf74-7c72c939f9bd-metrics-certs podName:ae574985-4900-4b23-bf74-7c72c939f9bd nodeName:}" failed. No retries permitted until 2026-05-26 15:18:47.361674178 +0000 UTC m=+66.359377503 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ae574985-4900-4b23-bf74-7c72c939f9bd-metrics-certs") pod "network-metrics-daemon-npzrf" (UID: "ae574985-4900-4b23-bf74-7c72c939f9bd") : object "openshift-multus"/"metrics-daemon-secret" not registered
May 26 15:18:15.361738 ip-10-0-140-164 kubenswrapper[2581]: E0526 15:18:15.361715    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/000947e2-0eeb-4d43-8dc4-6132e5e6cc13-kube-api-access-m9l98 podName:000947e2-0eeb-4d43-8dc4-6132e5e6cc13 nodeName:}" failed. No retries permitted until 2026-05-26 15:18:47.361705223 +0000 UTC m=+66.359408532 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-m9l98" (UniqueName: "kubernetes.io/projected/000947e2-0eeb-4d43-8dc4-6132e5e6cc13-kube-api-access-m9l98") pod "network-check-target-qr6zm" (UID: "000947e2-0eeb-4d43-8dc4-6132e5e6cc13") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 26 15:18:15.636941 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:18:15.636898    2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-k56cd"
May 26 15:18:15.640525 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:18:15.640498    2581 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
May 26 15:18:15.664183 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:18:15.664163    2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/37c203f3-fea7-4b18-a713-d805bf7dd8d9-cert\") pod \"ingress-canary-kgzwq\" (UID: \"37c203f3-fea7-4b18-a713-d805bf7dd8d9\") " pod="openshift-ingress-canary/ingress-canary-kgzwq"
May 26 15:18:15.664304 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:18:15.664210    2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/676b1633-43dc-4fe0-bf8b-5f8247a3e6e2-registry-tls\") pod \"image-registry-797775bcb5-x7sns\" (UID: \"676b1633-43dc-4fe0-bf8b-5f8247a3e6e2\") " pod="openshift-image-registry/image-registry-797775bcb5-x7sns"
May 26 15:18:15.664360 ip-10-0-140-164 kubenswrapper[2581]: E0526 15:18:15.664299    2581 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
May 26 15:18:15.664360 ip-10-0-140-164 kubenswrapper[2581]: E0526 15:18:15.664319    2581 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
May 26 15:18:15.664360 ip-10-0-140-164 kubenswrapper[2581]: E0526 15:18:15.664331    2581 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-797775bcb5-x7sns: secret "image-registry-tls" not found
May 26 15:18:15.664360 ip-10-0-140-164 kubenswrapper[2581]: E0526 15:18:15.664357    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/37c203f3-fea7-4b18-a713-d805bf7dd8d9-cert podName:37c203f3-fea7-4b18-a713-d805bf7dd8d9 nodeName:}" failed. No retries permitted until 2026-05-26 15:18:16.664340415 +0000 UTC m=+35.662043731 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/37c203f3-fea7-4b18-a713-d805bf7dd8d9-cert") pod "ingress-canary-kgzwq" (UID: "37c203f3-fea7-4b18-a713-d805bf7dd8d9") : secret "canary-serving-cert" not found
May 26 15:18:15.664498 ip-10-0-140-164 kubenswrapper[2581]: E0526 15:18:15.664373    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/676b1633-43dc-4fe0-bf8b-5f8247a3e6e2-registry-tls podName:676b1633-43dc-4fe0-bf8b-5f8247a3e6e2 nodeName:}" failed. No retries permitted until 2026-05-26 15:18:16.66436272 +0000 UTC m=+35.662066031 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/676b1633-43dc-4fe0-bf8b-5f8247a3e6e2-registry-tls") pod "image-registry-797775bcb5-x7sns" (UID: "676b1633-43dc-4fe0-bf8b-5f8247a3e6e2") : secret "image-registry-tls" not found
May 26 15:18:15.765350 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:18:15.765327    2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c1324645-ef27-41da-851e-615da7eab3b0-metrics-tls\") pod \"dns-default-l4rks\" (UID: \"c1324645-ef27-41da-851e-615da7eab3b0\") " pod="openshift-dns/dns-default-l4rks"
May 26 15:18:15.765454 ip-10-0-140-164 kubenswrapper[2581]: E0526 15:18:15.765414    2581 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
May 26 15:18:15.765454 ip-10-0-140-164 kubenswrapper[2581]: E0526 15:18:15.765454    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c1324645-ef27-41da-851e-615da7eab3b0-metrics-tls podName:c1324645-ef27-41da-851e-615da7eab3b0 nodeName:}" failed. No retries permitted until 2026-05-26 15:18:16.765441467 +0000 UTC m=+35.763144777 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/c1324645-ef27-41da-851e-615da7eab3b0-metrics-tls") pod "dns-default-l4rks" (UID: "c1324645-ef27-41da-851e-615da7eab3b0") : secret "dns-default-metrics-tls" not found
May 26 15:18:16.637451 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:18:16.637394    2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qr6zm"
May 26 15:18:16.637546 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:18:16.637399    2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-npzrf"
May 26 15:18:16.645500 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:18:16.645478    2581 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-9rgw2\""
May 26 15:18:16.645500 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:18:16.645497    2581 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
May 26 15:18:16.645926 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:18:16.645503    2581 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
May 26 15:18:16.645926 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:18:16.645511    2581 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-nc4qx\""
May 26 15:18:16.645926 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:18:16.645604    2581 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
May 26 15:18:16.672040 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:18:16.672021    2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/37c203f3-fea7-4b18-a713-d805bf7dd8d9-cert\") pod \"ingress-canary-kgzwq\" (UID: \"37c203f3-fea7-4b18-a713-d805bf7dd8d9\") " pod="openshift-ingress-canary/ingress-canary-kgzwq"
May 26 15:18:16.672126 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:18:16.672068    2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/676b1633-43dc-4fe0-bf8b-5f8247a3e6e2-registry-tls\") pod \"image-registry-797775bcb5-x7sns\" (UID: \"676b1633-43dc-4fe0-bf8b-5f8247a3e6e2\") " pod="openshift-image-registry/image-registry-797775bcb5-x7sns"
May 26 15:18:16.672176 ip-10-0-140-164 kubenswrapper[2581]: E0526 15:18:16.672163    2581 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
May 26 15:18:16.672214 ip-10-0-140-164 kubenswrapper[2581]: E0526 15:18:16.672203    2581 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
May 26 15:18:16.672262 ip-10-0-140-164 kubenswrapper[2581]: E0526 15:18:16.672219    2581 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-797775bcb5-x7sns: secret "image-registry-tls" not found
May 26 15:18:16.672262 ip-10-0-140-164 kubenswrapper[2581]: E0526 15:18:16.672224    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/37c203f3-fea7-4b18-a713-d805bf7dd8d9-cert podName:37c203f3-fea7-4b18-a713-d805bf7dd8d9 nodeName:}" failed. No retries permitted until 2026-05-26 15:18:18.672206726 +0000 UTC m=+37.669910038 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/37c203f3-fea7-4b18-a713-d805bf7dd8d9-cert") pod "ingress-canary-kgzwq" (UID: "37c203f3-fea7-4b18-a713-d805bf7dd8d9") : secret "canary-serving-cert" not found
May 26 15:18:16.672262 ip-10-0-140-164 kubenswrapper[2581]: E0526 15:18:16.672250    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/676b1633-43dc-4fe0-bf8b-5f8247a3e6e2-registry-tls podName:676b1633-43dc-4fe0-bf8b-5f8247a3e6e2 nodeName:}" failed. No retries permitted until 2026-05-26 15:18:18.672240958 +0000 UTC m=+37.669944267 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/676b1633-43dc-4fe0-bf8b-5f8247a3e6e2-registry-tls") pod "image-registry-797775bcb5-x7sns" (UID: "676b1633-43dc-4fe0-bf8b-5f8247a3e6e2") : secret "image-registry-tls" not found
May 26 15:18:16.773374 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:18:16.773349    2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c1324645-ef27-41da-851e-615da7eab3b0-metrics-tls\") pod \"dns-default-l4rks\" (UID: \"c1324645-ef27-41da-851e-615da7eab3b0\") " pod="openshift-dns/dns-default-l4rks"
May 26 15:18:16.773478 ip-10-0-140-164 kubenswrapper[2581]: E0526 15:18:16.773437    2581 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
May 26 15:18:16.773539 ip-10-0-140-164 kubenswrapper[2581]: E0526 15:18:16.773483    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c1324645-ef27-41da-851e-615da7eab3b0-metrics-tls podName:c1324645-ef27-41da-851e-615da7eab3b0 nodeName:}" failed. No retries permitted until 2026-05-26 15:18:18.773467601 +0000 UTC m=+37.771170914 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/c1324645-ef27-41da-851e-615da7eab3b0-metrics-tls") pod "dns-default-l4rks" (UID: "c1324645-ef27-41da-851e-615da7eab3b0") : secret "dns-default-metrics-tls" not found
May 26 15:18:16.784171 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:18:16.784148    2581 generic.go:358] "Generic (PLEG): container finished" podID="afbaeb5e-924a-4076-a161-94955178994c" containerID="b054bfcccbbc9ae2e2a0c6f58be162f8e03ce4fd30d108177751148157e7d665" exitCode=0
May 26 15:18:16.784283 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:18:16.784186    2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-bglww" event={"ID":"afbaeb5e-924a-4076-a161-94955178994c","Type":"ContainerDied","Data":"b054bfcccbbc9ae2e2a0c6f58be162f8e03ce4fd30d108177751148157e7d665"}
May 26 15:18:17.789005 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:18:17.788973    2581 generic.go:358] "Generic (PLEG): container finished" podID="afbaeb5e-924a-4076-a161-94955178994c" containerID="da6cdac3b59d1a0cda0648ae06cb23b7f20fff4723424f41f585357e4c85497e" exitCode=0
May 26 15:18:17.789414 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:18:17.789032    2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-bglww" event={"ID":"afbaeb5e-924a-4076-a161-94955178994c","Type":"ContainerDied","Data":"da6cdac3b59d1a0cda0648ae06cb23b7f20fff4723424f41f585357e4c85497e"}
May 26 15:18:18.686989 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:18:18.686957    2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/676b1633-43dc-4fe0-bf8b-5f8247a3e6e2-registry-tls\") pod \"image-registry-797775bcb5-x7sns\" (UID: \"676b1633-43dc-4fe0-bf8b-5f8247a3e6e2\") " pod="openshift-image-registry/image-registry-797775bcb5-x7sns"
May 26 15:18:18.687130 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:18:18.687025    2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/37c203f3-fea7-4b18-a713-d805bf7dd8d9-cert\") pod \"ingress-canary-kgzwq\" (UID: \"37c203f3-fea7-4b18-a713-d805bf7dd8d9\") " pod="openshift-ingress-canary/ingress-canary-kgzwq"
May 26 15:18:18.687130 ip-10-0-140-164 kubenswrapper[2581]: E0526 15:18:18.687100    2581 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
May 26 15:18:18.687130 ip-10-0-140-164 kubenswrapper[2581]: E0526 15:18:18.687115    2581 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
May 26 15:18:18.687130 ip-10-0-140-164 kubenswrapper[2581]: E0526 15:18:18.687121    2581 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-797775bcb5-x7sns: secret "image-registry-tls" not found
May 26 15:18:18.687299 ip-10-0-140-164 kubenswrapper[2581]: E0526 15:18:18.687167    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/37c203f3-fea7-4b18-a713-d805bf7dd8d9-cert podName:37c203f3-fea7-4b18-a713-d805bf7dd8d9 nodeName:}" failed. No retries permitted until 2026-05-26 15:18:22.687152626 +0000 UTC m=+41.684855937 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/37c203f3-fea7-4b18-a713-d805bf7dd8d9-cert") pod "ingress-canary-kgzwq" (UID: "37c203f3-fea7-4b18-a713-d805bf7dd8d9") : secret "canary-serving-cert" not found
May 26 15:18:18.687299 ip-10-0-140-164 kubenswrapper[2581]: E0526 15:18:18.687179    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/676b1633-43dc-4fe0-bf8b-5f8247a3e6e2-registry-tls podName:676b1633-43dc-4fe0-bf8b-5f8247a3e6e2 nodeName:}" failed. No retries permitted until 2026-05-26 15:18:22.687173625 +0000 UTC m=+41.684876935 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/676b1633-43dc-4fe0-bf8b-5f8247a3e6e2-registry-tls") pod "image-registry-797775bcb5-x7sns" (UID: "676b1633-43dc-4fe0-bf8b-5f8247a3e6e2") : secret "image-registry-tls" not found
May 26 15:18:18.788111 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:18:18.788084    2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c1324645-ef27-41da-851e-615da7eab3b0-metrics-tls\") pod \"dns-default-l4rks\" (UID: \"c1324645-ef27-41da-851e-615da7eab3b0\") " pod="openshift-dns/dns-default-l4rks"
May 26 15:18:18.788247 ip-10-0-140-164 kubenswrapper[2581]: E0526 15:18:18.788192    2581 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
May 26 15:18:18.788247 ip-10-0-140-164 kubenswrapper[2581]: E0526 15:18:18.788235    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c1324645-ef27-41da-851e-615da7eab3b0-metrics-tls podName:c1324645-ef27-41da-851e-615da7eab3b0 nodeName:}" failed. No retries permitted until 2026-05-26 15:18:22.788222903 +0000 UTC m=+41.785926213 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/c1324645-ef27-41da-851e-615da7eab3b0-metrics-tls") pod "dns-default-l4rks" (UID: "c1324645-ef27-41da-851e-615da7eab3b0") : secret "dns-default-metrics-tls" not found
May 26 15:18:18.794776 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:18:18.794754    2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-bglww" event={"ID":"afbaeb5e-924a-4076-a161-94955178994c","Type":"ContainerStarted","Data":"efbc859666e64da437fd0481d4606cbc31140a04914a36d26549dcf628cd3681"}
May 26 15:18:18.819854 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:18:18.819785    2581 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-bglww" podStartSLOduration=5.000277302 podStartE2EDuration="36.819771352s" podCreationTimestamp="2026-05-26 15:17:42 +0000 UTC" firstStartedPulling="2026-05-26 15:17:44.22340265 +0000 UTC m=+3.221105974" lastFinishedPulling="2026-05-26 15:18:16.04289671 +0000 UTC m=+35.040600024" observedRunningTime="2026-05-26 15:18:18.817782497 +0000 UTC m=+37.815485828" watchObservedRunningTime="2026-05-26 15:18:18.819771352 +0000 UTC m=+37.817474740"
May 26 15:18:22.713174 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:18:22.713130    2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/37c203f3-fea7-4b18-a713-d805bf7dd8d9-cert\") pod \"ingress-canary-kgzwq\" (UID: \"37c203f3-fea7-4b18-a713-d805bf7dd8d9\") " pod="openshift-ingress-canary/ingress-canary-kgzwq"
May 26 15:18:22.713681 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:18:22.713200    2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/676b1633-43dc-4fe0-bf8b-5f8247a3e6e2-registry-tls\") pod \"image-registry-797775bcb5-x7sns\" (UID: \"676b1633-43dc-4fe0-bf8b-5f8247a3e6e2\") " pod="openshift-image-registry/image-registry-797775bcb5-x7sns"
May 26 15:18:22.713681 ip-10-0-140-164 kubenswrapper[2581]: E0526 15:18:22.713290    2581 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
May 26 15:18:22.713681 ip-10-0-140-164 kubenswrapper[2581]: E0526 15:18:22.713354    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/37c203f3-fea7-4b18-a713-d805bf7dd8d9-cert podName:37c203f3-fea7-4b18-a713-d805bf7dd8d9 nodeName:}" failed. No retries permitted until 2026-05-26 15:18:30.713338313 +0000 UTC m=+49.711041623 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/37c203f3-fea7-4b18-a713-d805bf7dd8d9-cert") pod "ingress-canary-kgzwq" (UID: "37c203f3-fea7-4b18-a713-d805bf7dd8d9") : secret "canary-serving-cert" not found
May 26 15:18:22.713681 ip-10-0-140-164 kubenswrapper[2581]: E0526 15:18:22.713359    2581 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
May 26 15:18:22.713681 ip-10-0-140-164 kubenswrapper[2581]: E0526 15:18:22.713379    2581 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-797775bcb5-x7sns: secret "image-registry-tls" not found
May 26 15:18:22.713681 ip-10-0-140-164 kubenswrapper[2581]: E0526 15:18:22.713435    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/676b1633-43dc-4fe0-bf8b-5f8247a3e6e2-registry-tls podName:676b1633-43dc-4fe0-bf8b-5f8247a3e6e2 nodeName:}" failed. No retries permitted until 2026-05-26 15:18:30.713416958 +0000 UTC m=+49.711120268 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/676b1633-43dc-4fe0-bf8b-5f8247a3e6e2-registry-tls") pod "image-registry-797775bcb5-x7sns" (UID: "676b1633-43dc-4fe0-bf8b-5f8247a3e6e2") : secret "image-registry-tls" not found
May 26 15:18:22.813780 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:18:22.813747    2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c1324645-ef27-41da-851e-615da7eab3b0-metrics-tls\") pod \"dns-default-l4rks\" (UID: \"c1324645-ef27-41da-851e-615da7eab3b0\") " pod="openshift-dns/dns-default-l4rks"
May 26 15:18:22.813920 ip-10-0-140-164 kubenswrapper[2581]: E0526 15:18:22.813858    2581 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
May 26 15:18:22.813920 ip-10-0-140-164 kubenswrapper[2581]: E0526 15:18:22.813905    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c1324645-ef27-41da-851e-615da7eab3b0-metrics-tls podName:c1324645-ef27-41da-851e-615da7eab3b0 nodeName:}" failed. No retries permitted until 2026-05-26 15:18:30.813890388 +0000 UTC m=+49.811593728 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/c1324645-ef27-41da-851e-615da7eab3b0-metrics-tls") pod "dns-default-l4rks" (UID: "c1324645-ef27-41da-851e-615da7eab3b0") : secret "dns-default-metrics-tls" not found
May 26 15:18:30.772051 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:18:30.772016    2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/37c203f3-fea7-4b18-a713-d805bf7dd8d9-cert\") pod \"ingress-canary-kgzwq\" (UID: \"37c203f3-fea7-4b18-a713-d805bf7dd8d9\") " pod="openshift-ingress-canary/ingress-canary-kgzwq"
May 26 15:18:30.772671 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:18:30.772072    2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/676b1633-43dc-4fe0-bf8b-5f8247a3e6e2-registry-tls\") pod \"image-registry-797775bcb5-x7sns\" (UID: \"676b1633-43dc-4fe0-bf8b-5f8247a3e6e2\") " pod="openshift-image-registry/image-registry-797775bcb5-x7sns"
May 26 15:18:30.772671 ip-10-0-140-164 kubenswrapper[2581]: E0526 15:18:30.772163    2581 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
May 26 15:18:30.772671 ip-10-0-140-164 kubenswrapper[2581]: E0526 15:18:30.772172    2581 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
May 26 15:18:30.772671 ip-10-0-140-164 kubenswrapper[2581]: E0526 15:18:30.772187    2581 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-797775bcb5-x7sns: secret "image-registry-tls" not found
May 26 15:18:30.772671 ip-10-0-140-164 kubenswrapper[2581]: E0526 15:18:30.772238    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/37c203f3-fea7-4b18-a713-d805bf7dd8d9-cert podName:37c203f3-fea7-4b18-a713-d805bf7dd8d9 nodeName:}" failed. No retries permitted until 2026-05-26 15:18:46.772221854 +0000 UTC m=+65.769925163 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/37c203f3-fea7-4b18-a713-d805bf7dd8d9-cert") pod "ingress-canary-kgzwq" (UID: "37c203f3-fea7-4b18-a713-d805bf7dd8d9") : secret "canary-serving-cert" not found
May 26 15:18:30.772671 ip-10-0-140-164 kubenswrapper[2581]: E0526 15:18:30.772255    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/676b1633-43dc-4fe0-bf8b-5f8247a3e6e2-registry-tls podName:676b1633-43dc-4fe0-bf8b-5f8247a3e6e2 nodeName:}" failed. No retries permitted until 2026-05-26 15:18:46.772248093 +0000 UTC m=+65.769951403 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/676b1633-43dc-4fe0-bf8b-5f8247a3e6e2-registry-tls") pod "image-registry-797775bcb5-x7sns" (UID: "676b1633-43dc-4fe0-bf8b-5f8247a3e6e2") : secret "image-registry-tls" not found
May 26 15:18:30.872646 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:18:30.872619    2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c1324645-ef27-41da-851e-615da7eab3b0-metrics-tls\") pod \"dns-default-l4rks\" (UID: \"c1324645-ef27-41da-851e-615da7eab3b0\") " pod="openshift-dns/dns-default-l4rks"
May 26 15:18:30.872787 ip-10-0-140-164 kubenswrapper[2581]: E0526 15:18:30.872721    2581 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
May 26 15:18:30.872787 ip-10-0-140-164 kubenswrapper[2581]: E0526 15:18:30.872771    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c1324645-ef27-41da-851e-615da7eab3b0-metrics-tls podName:c1324645-ef27-41da-851e-615da7eab3b0 nodeName:}" failed. No retries permitted until 2026-05-26 15:18:46.872758173 +0000 UTC m=+65.870461483 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/c1324645-ef27-41da-851e-615da7eab3b0-metrics-tls") pod "dns-default-l4rks" (UID: "c1324645-ef27-41da-851e-615da7eab3b0") : secret "dns-default-metrics-tls" not found
May 26 15:18:31.611145 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:18:31.611118    2581 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-69d8c686fd-56j6f"]
May 26 15:18:31.642162 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:18:31.642141    2581 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-69d8c686fd-56j6f"]
May 26 15:18:31.642324 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:18:31.642309    2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-69d8c686fd-56j6f"
May 26 15:18:31.645929 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:18:31.645908    2581 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\""
May 26 15:18:31.646203 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:18:31.645953    2581 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"work-manager-hub-kubeconfig\""
May 26 15:18:31.646507 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:18:31.646487    2581 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\""
May 26 15:18:31.646651 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:18:31.646622    2581 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\""
May 26 15:18:31.779602 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:18:31.779570    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a090c84c-fb22-44f8-b638-4cc52f5253ac-tmp\") pod \"klusterlet-addon-workmgr-69d8c686fd-56j6f\" (UID: \"a090c84c-fb22-44f8-b638-4cc52f5253ac\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-69d8c686fd-56j6f"
May 26 15:18:31.779888 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:18:31.779615    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qpmdw\" (UniqueName: \"kubernetes.io/projected/a090c84c-fb22-44f8-b638-4cc52f5253ac-kube-api-access-qpmdw\") pod \"klusterlet-addon-workmgr-69d8c686fd-56j6f\" (UID: \"a090c84c-fb22-44f8-b638-4cc52f5253ac\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-69d8c686fd-56j6f"
May 26 15:18:31.779888 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:18:31.779643    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/a090c84c-fb22-44f8-b638-4cc52f5253ac-klusterlet-config\") pod \"klusterlet-addon-workmgr-69d8c686fd-56j6f\" (UID: \"a090c84c-fb22-44f8-b638-4cc52f5253ac\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-69d8c686fd-56j6f"
May 26 15:18:31.880822 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:18:31.880763    2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/a090c84c-fb22-44f8-b638-4cc52f5253ac-klusterlet-config\") pod \"klusterlet-addon-workmgr-69d8c686fd-56j6f\" (UID: \"a090c84c-fb22-44f8-b638-4cc52f5253ac\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-69d8c686fd-56j6f"
May 26 15:18:31.880920 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:18:31.880883    2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a090c84c-fb22-44f8-b638-4cc52f5253ac-tmp\") pod \"klusterlet-addon-workmgr-69d8c686fd-56j6f\" (UID: \"a090c84c-fb22-44f8-b638-4cc52f5253ac\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-69d8c686fd-56j6f"
May 26 15:18:31.880980 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:18:31.880928    2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-qpmdw\" (UniqueName: \"kubernetes.io/projected/a090c84c-fb22-44f8-b638-4cc52f5253ac-kube-api-access-qpmdw\") pod \"klusterlet-addon-workmgr-69d8c686fd-56j6f\" (UID: \"a090c84c-fb22-44f8-b638-4cc52f5253ac\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-69d8c686fd-56j6f"
May 26 15:18:31.881287 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:18:31.881242    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a090c84c-fb22-44f8-b638-4cc52f5253ac-tmp\") pod \"klusterlet-addon-workmgr-69d8c686fd-56j6f\" (UID: \"a090c84c-fb22-44f8-b638-4cc52f5253ac\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-69d8c686fd-56j6f"
May 26 15:18:31.884460 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:18:31.884443    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/a090c84c-fb22-44f8-b638-4cc52f5253ac-klusterlet-config\") pod \"klusterlet-addon-workmgr-69d8c686fd-56j6f\" (UID: \"a090c84c-fb22-44f8-b638-4cc52f5253ac\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-69d8c686fd-56j6f"
May 26 15:18:31.889898 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:18:31.889881    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qpmdw\" (UniqueName: \"kubernetes.io/projected/a090c84c-fb22-44f8-b638-4cc52f5253ac-kube-api-access-qpmdw\") pod \"klusterlet-addon-workmgr-69d8c686fd-56j6f\" (UID: \"a090c84c-fb22-44f8-b638-4cc52f5253ac\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-69d8c686fd-56j6f"
May 26 15:18:31.954551 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:18:31.954527    2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-69d8c686fd-56j6f"
May 26 15:18:32.121463 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:18:32.121430    2581 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-69d8c686fd-56j6f"]
May 26 15:18:32.124454 ip-10-0-140-164 kubenswrapper[2581]: W0526 15:18:32.124428    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda090c84c_fb22_44f8_b638_4cc52f5253ac.slice/crio-653e4d4076ba0c02e42293d36e9fd6c5ae484d8efac7957ccd4285c914f1bc38 WatchSource:0}: Error finding container 653e4d4076ba0c02e42293d36e9fd6c5ae484d8efac7957ccd4285c914f1bc38: Status 404 returned error can't find the container with id 653e4d4076ba0c02e42293d36e9fd6c5ae484d8efac7957ccd4285c914f1bc38
May 26 15:18:32.819588 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:18:32.819556    2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-69d8c686fd-56j6f" event={"ID":"a090c84c-fb22-44f8-b638-4cc52f5253ac","Type":"ContainerStarted","Data":"653e4d4076ba0c02e42293d36e9fd6c5ae484d8efac7957ccd4285c914f1bc38"}
May 26 15:18:36.828742 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:18:36.828678    2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-69d8c686fd-56j6f" event={"ID":"a090c84c-fb22-44f8-b638-4cc52f5253ac","Type":"ContainerStarted","Data":"08b79ba30df63ba7f8ac05ca0d441b61d82f70e9768584edb3ea4d9e9112240e"}
May 26 15:18:36.829037 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:18:36.828910    2581 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-69d8c686fd-56j6f"
May 26 15:18:36.830200 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:18:36.830180    2581 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-69d8c686fd-56j6f"
May 26 15:18:36.846095 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:18:36.846055    2581 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-69d8c686fd-56j6f" podStartSLOduration=1.403628015 podStartE2EDuration="5.846044775s" podCreationTimestamp="2026-05-26 15:18:31 +0000 UTC" firstStartedPulling="2026-05-26 15:18:32.126312944 +0000 UTC m=+51.124016254" lastFinishedPulling="2026-05-26 15:18:36.568729701 +0000 UTC m=+55.566433014" observedRunningTime="2026-05-26 15:18:36.844988145 +0000 UTC m=+55.842691482" watchObservedRunningTime="2026-05-26 15:18:36.846044775 +0000 UTC m=+55.843748103"
May 26 15:18:42.785606 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:18:42.785575    2581 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-gjh9c"
May 26 15:18:46.786376 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:18:46.786337    2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/37c203f3-fea7-4b18-a713-d805bf7dd8d9-cert\") pod \"ingress-canary-kgzwq\" (UID: \"37c203f3-fea7-4b18-a713-d805bf7dd8d9\") " pod="openshift-ingress-canary/ingress-canary-kgzwq"
May 26 15:18:46.786817 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:18:46.786409    2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/676b1633-43dc-4fe0-bf8b-5f8247a3e6e2-registry-tls\") pod \"image-registry-797775bcb5-x7sns\" (UID: \"676b1633-43dc-4fe0-bf8b-5f8247a3e6e2\") " pod="openshift-image-registry/image-registry-797775bcb5-x7sns"
May 26 15:18:46.786817 ip-10-0-140-164 kubenswrapper[2581]: E0526 15:18:46.786488    2581 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
May 26 15:18:46.786817 ip-10-0-140-164 kubenswrapper[2581]: E0526 15:18:46.786556    2581 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
May 26 15:18:46.786817 ip-10-0-140-164 kubenswrapper[2581]: E0526 15:18:46.786576    2581 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-797775bcb5-x7sns: secret "image-registry-tls" not found
May 26 15:18:46.786817 ip-10-0-140-164 kubenswrapper[2581]: E0526 15:18:46.786580    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/37c203f3-fea7-4b18-a713-d805bf7dd8d9-cert podName:37c203f3-fea7-4b18-a713-d805bf7dd8d9 nodeName:}" failed. No retries permitted until 2026-05-26 15:19:18.786560597 +0000 UTC m=+97.784263907 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/37c203f3-fea7-4b18-a713-d805bf7dd8d9-cert") pod "ingress-canary-kgzwq" (UID: "37c203f3-fea7-4b18-a713-d805bf7dd8d9") : secret "canary-serving-cert" not found
May 26 15:18:46.786817 ip-10-0-140-164 kubenswrapper[2581]: E0526 15:18:46.786638    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/676b1633-43dc-4fe0-bf8b-5f8247a3e6e2-registry-tls podName:676b1633-43dc-4fe0-bf8b-5f8247a3e6e2 nodeName:}" failed. No retries permitted until 2026-05-26 15:19:18.78662279 +0000 UTC m=+97.784326100 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/676b1633-43dc-4fe0-bf8b-5f8247a3e6e2-registry-tls") pod "image-registry-797775bcb5-x7sns" (UID: "676b1633-43dc-4fe0-bf8b-5f8247a3e6e2") : secret "image-registry-tls" not found
May 26 15:18:46.887046 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:18:46.887017    2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c1324645-ef27-41da-851e-615da7eab3b0-metrics-tls\") pod \"dns-default-l4rks\" (UID: \"c1324645-ef27-41da-851e-615da7eab3b0\") " pod="openshift-dns/dns-default-l4rks"
May 26 15:18:46.887170 ip-10-0-140-164 kubenswrapper[2581]: E0526 15:18:46.887154    2581 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
May 26 15:18:46.887244 ip-10-0-140-164 kubenswrapper[2581]: E0526 15:18:46.887221    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c1324645-ef27-41da-851e-615da7eab3b0-metrics-tls podName:c1324645-ef27-41da-851e-615da7eab3b0 nodeName:}" failed. No retries permitted until 2026-05-26 15:19:18.887208917 +0000 UTC m=+97.884912228 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/c1324645-ef27-41da-851e-615da7eab3b0-metrics-tls") pod "dns-default-l4rks" (UID: "c1324645-ef27-41da-851e-615da7eab3b0") : secret "dns-default-metrics-tls" not found
May 26 15:18:47.289778 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:18:47.289751    2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/be858157-7e73-43be-81e8-aa5e9344923e-original-pull-secret\") pod \"global-pull-secret-syncer-k56cd\" (UID: \"be858157-7e73-43be-81e8-aa5e9344923e\") " pod="kube-system/global-pull-secret-syncer-k56cd"
May 26 15:18:47.292661 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:18:47.292645    2581 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
May 26 15:18:47.303161 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:18:47.303134    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/be858157-7e73-43be-81e8-aa5e9344923e-original-pull-secret\") pod \"global-pull-secret-syncer-k56cd\" (UID: \"be858157-7e73-43be-81e8-aa5e9344923e\") " pod="kube-system/global-pull-secret-syncer-k56cd"
May 26 15:18:47.390605 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:18:47.390572    2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ae574985-4900-4b23-bf74-7c72c939f9bd-metrics-certs\") pod \"network-metrics-daemon-npzrf\" (UID: \"ae574985-4900-4b23-bf74-7c72c939f9bd\") " pod="openshift-multus/network-metrics-daemon-npzrf"
May 26 15:18:47.390724 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:18:47.390625    2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-m9l98\" (UniqueName: \"kubernetes.io/projected/000947e2-0eeb-4d43-8dc4-6132e5e6cc13-kube-api-access-m9l98\") pod \"network-check-target-qr6zm\" (UID: \"000947e2-0eeb-4d43-8dc4-6132e5e6cc13\") " pod="openshift-network-diagnostics/network-check-target-qr6zm"
May 26 15:18:47.393488 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:18:47.393470    2581 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
May 26 15:18:47.393621 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:18:47.393602    2581 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
May 26 15:18:47.401587 ip-10-0-140-164 kubenswrapper[2581]: E0526 15:18:47.401566    2581 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
May 26 15:18:47.401666 ip-10-0-140-164 kubenswrapper[2581]: E0526 15:18:47.401618    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ae574985-4900-4b23-bf74-7c72c939f9bd-metrics-certs podName:ae574985-4900-4b23-bf74-7c72c939f9bd nodeName:}" failed. No retries permitted until 2026-05-26 15:19:51.40160432 +0000 UTC m=+130.399307631 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ae574985-4900-4b23-bf74-7c72c939f9bd-metrics-certs") pod "network-metrics-daemon-npzrf" (UID: "ae574985-4900-4b23-bf74-7c72c939f9bd") : secret "metrics-daemon-secret" not found
May 26 15:18:47.403694 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:18:47.403679    2581 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
May 26 15:18:47.414101 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:18:47.414082    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-m9l98\" (UniqueName: \"kubernetes.io/projected/000947e2-0eeb-4d43-8dc4-6132e5e6cc13-kube-api-access-m9l98\") pod \"network-check-target-qr6zm\" (UID: \"000947e2-0eeb-4d43-8dc4-6132e5e6cc13\") " pod="openshift-network-diagnostics/network-check-target-qr6zm"
May 26 15:18:47.448057 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:18:47.448041    2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-k56cd"
May 26 15:18:47.549575 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:18:47.549550    2581 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-9rgw2\""
May 26 15:18:47.556817 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:18:47.556688    2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qr6zm"
May 26 15:18:47.588046 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:18:47.588009    2581 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-k56cd"]
May 26 15:18:47.592591 ip-10-0-140-164 kubenswrapper[2581]: W0526 15:18:47.592567    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbe858157_7e73_43be_81e8_aa5e9344923e.slice/crio-cc5defde7fd1de9f06aa20c741a3f9611301f46b34a71b53f6274baaf8bb5796 WatchSource:0}: Error finding container cc5defde7fd1de9f06aa20c741a3f9611301f46b34a71b53f6274baaf8bb5796: Status 404 returned error can't find the container with id cc5defde7fd1de9f06aa20c741a3f9611301f46b34a71b53f6274baaf8bb5796
May 26 15:18:47.678363 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:18:47.678336    2581 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-qr6zm"]
May 26 15:18:47.681403 ip-10-0-140-164 kubenswrapper[2581]: W0526 15:18:47.681368    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod000947e2_0eeb_4d43_8dc4_6132e5e6cc13.slice/crio-dbe179da12a5da869907575af7597d9fce49535ee4b009a81a3d3f35fd327aba WatchSource:0}: Error finding container dbe179da12a5da869907575af7597d9fce49535ee4b009a81a3d3f35fd327aba: Status 404 returned error can't find the container with id dbe179da12a5da869907575af7597d9fce49535ee4b009a81a3d3f35fd327aba
May 26 15:18:47.848783 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:18:47.848717    2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-qr6zm" event={"ID":"000947e2-0eeb-4d43-8dc4-6132e5e6cc13","Type":"ContainerStarted","Data":"dbe179da12a5da869907575af7597d9fce49535ee4b009a81a3d3f35fd327aba"}
May 26 15:18:47.849750 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:18:47.849729    2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-k56cd" event={"ID":"be858157-7e73-43be-81e8-aa5e9344923e","Type":"ContainerStarted","Data":"cc5defde7fd1de9f06aa20c741a3f9611301f46b34a71b53f6274baaf8bb5796"}
May 26 15:18:52.861046 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:18:52.861007    2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-k56cd" event={"ID":"be858157-7e73-43be-81e8-aa5e9344923e","Type":"ContainerStarted","Data":"46acfb8ab75a8841abeb14d769daacdeaa1476aa707b6b6fd84f779b07aaedd8"}
May 26 15:18:52.862661 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:18:52.862629    2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-qr6zm" event={"ID":"000947e2-0eeb-4d43-8dc4-6132e5e6cc13","Type":"ContainerStarted","Data":"c098d5a5e37f7c6ec68574dfe14f97f555762fc9d4dc52abdc431cfc733f60d3"}
May 26 15:18:52.862846 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:18:52.862764    2581 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-qr6zm"
May 26 15:18:52.886008 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:18:52.885960    2581 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-k56cd" podStartSLOduration=66.218946987 podStartE2EDuration="1m10.885946038s" podCreationTimestamp="2026-05-26 15:17:42 +0000 UTC" firstStartedPulling="2026-05-26 15:18:47.595322255 +0000 UTC m=+66.593025565" lastFinishedPulling="2026-05-26 15:18:52.262321293 +0000 UTC m=+71.260024616" observedRunningTime="2026-05-26 15:18:52.885257588 +0000 UTC m=+71.882960921" watchObservedRunningTime="2026-05-26 15:18:52.885946038 +0000 UTC m=+71.883649370"
May 26 15:18:52.900744 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:18:52.900699    2581 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-qr6zm" podStartSLOduration=67.324792431 podStartE2EDuration="1m11.900686248s" podCreationTimestamp="2026-05-26 15:17:41 +0000 UTC" firstStartedPulling="2026-05-26 15:18:47.683206705 +0000 UTC m=+66.680910015" lastFinishedPulling="2026-05-26 15:18:52.259100521 +0000 UTC m=+71.256803832" observedRunningTime="2026-05-26 15:18:52.900586465 +0000 UTC m=+71.898289815" watchObservedRunningTime="2026-05-26 15:18:52.900686248 +0000 UTC m=+71.898389579"
May 26 15:19:18.811366 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:19:18.811329    2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/37c203f3-fea7-4b18-a713-d805bf7dd8d9-cert\") pod \"ingress-canary-kgzwq\" (UID: \"37c203f3-fea7-4b18-a713-d805bf7dd8d9\") " pod="openshift-ingress-canary/ingress-canary-kgzwq"
May 26 15:19:18.811883 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:19:18.811391    2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/676b1633-43dc-4fe0-bf8b-5f8247a3e6e2-registry-tls\") pod \"image-registry-797775bcb5-x7sns\" (UID: \"676b1633-43dc-4fe0-bf8b-5f8247a3e6e2\") " pod="openshift-image-registry/image-registry-797775bcb5-x7sns"
May 26 15:19:18.811883 ip-10-0-140-164 kubenswrapper[2581]: E0526 15:19:18.811467    2581 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
May 26 15:19:18.811883 ip-10-0-140-164 kubenswrapper[2581]: E0526 15:19:18.811523    2581 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
May 26 15:19:18.811883 ip-10-0-140-164 kubenswrapper[2581]: E0526 15:19:18.811538    2581 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-797775bcb5-x7sns: secret "image-registry-tls" not found
May 26 15:19:18.811883 ip-10-0-140-164 kubenswrapper[2581]: E0526 15:19:18.811545    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/37c203f3-fea7-4b18-a713-d805bf7dd8d9-cert podName:37c203f3-fea7-4b18-a713-d805bf7dd8d9 nodeName:}" failed. No retries permitted until 2026-05-26 15:20:22.811526744 +0000 UTC m=+161.809230053 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/37c203f3-fea7-4b18-a713-d805bf7dd8d9-cert") pod "ingress-canary-kgzwq" (UID: "37c203f3-fea7-4b18-a713-d805bf7dd8d9") : secret "canary-serving-cert" not found
May 26 15:19:18.811883 ip-10-0-140-164 kubenswrapper[2581]: E0526 15:19:18.811604    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/676b1633-43dc-4fe0-bf8b-5f8247a3e6e2-registry-tls podName:676b1633-43dc-4fe0-bf8b-5f8247a3e6e2 nodeName:}" failed. No retries permitted until 2026-05-26 15:20:22.811584368 +0000 UTC m=+161.809287697 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/676b1633-43dc-4fe0-bf8b-5f8247a3e6e2-registry-tls") pod "image-registry-797775bcb5-x7sns" (UID: "676b1633-43dc-4fe0-bf8b-5f8247a3e6e2") : secret "image-registry-tls" not found
May 26 15:19:18.911678 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:19:18.911648    2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c1324645-ef27-41da-851e-615da7eab3b0-metrics-tls\") pod \"dns-default-l4rks\" (UID: \"c1324645-ef27-41da-851e-615da7eab3b0\") " pod="openshift-dns/dns-default-l4rks"
May 26 15:19:18.911797 ip-10-0-140-164 kubenswrapper[2581]: E0526 15:19:18.911740    2581 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
May 26 15:19:18.911797 ip-10-0-140-164 kubenswrapper[2581]: E0526 15:19:18.911782    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c1324645-ef27-41da-851e-615da7eab3b0-metrics-tls podName:c1324645-ef27-41da-851e-615da7eab3b0 nodeName:}" failed. No retries permitted until 2026-05-26 15:20:22.911770726 +0000 UTC m=+161.909474035 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/c1324645-ef27-41da-851e-615da7eab3b0-metrics-tls") pod "dns-default-l4rks" (UID: "c1324645-ef27-41da-851e-615da7eab3b0") : secret "dns-default-metrics-tls" not found
May 26 15:19:23.866781 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:19:23.866744    2581 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-qr6zm"
May 26 15:19:36.801719 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:19:36.801685    2581 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-6586767b64-jdqqn"]
May 26 15:19:36.803842 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:19:36.803824    2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-6586767b64-jdqqn"
May 26 15:19:36.806812 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:19:36.806789    2581 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-dt4h4\""
May 26 15:19:36.807025 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:19:36.807011    2581 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
May 26 15:19:36.807183 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:19:36.807164    2581 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\""
May 26 15:19:36.807336 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:19:36.807312    2581 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\""
May 26 15:19:36.807694 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:19:36.807677    2581 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\""
May 26 15:19:36.807857 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:19:36.807837    2581 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\""
May 26 15:19:36.807929 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:19:36.807876    2581 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
May 26 15:19:36.812788 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:19:36.812765    2581 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-7f44b6dd87-bzvwj"]
May 26 15:19:36.814583 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:19:36.814566    2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-7f44b6dd87-bzvwj"
May 26 15:19:36.817390 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:19:36.817359    2581 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-9htzc\""
May 26 15:19:36.818643 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:19:36.818625    2581 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-6586767b64-jdqqn"]
May 26 15:19:36.824653 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:19:36.824632    2581 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-7f44b6dd87-bzvwj"]
May 26 15:19:36.933424 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:19:36.933404    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-txmpc\" (UniqueName: \"kubernetes.io/projected/7e643816-5795-4bd4-9145-753987fb638e-kube-api-access-txmpc\") pod \"network-check-source-7f44b6dd87-bzvwj\" (UID: \"7e643816-5795-4bd4-9145-753987fb638e\") " pod="openshift-network-diagnostics/network-check-source-7f44b6dd87-bzvwj"
May 26 15:19:36.933520 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:19:36.933436    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d4359b58-cee4-4040-9a23-d1545122d3c6-metrics-certs\") pod \"router-default-6586767b64-jdqqn\" (UID: \"d4359b58-cee4-4040-9a23-d1545122d3c6\") " pod="openshift-ingress/router-default-6586767b64-jdqqn"
May 26 15:19:36.933561 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:19:36.933545    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d4359b58-cee4-4040-9a23-d1545122d3c6-service-ca-bundle\") pod \"router-default-6586767b64-jdqqn\" (UID: \"d4359b58-cee4-4040-9a23-d1545122d3c6\") " pod="openshift-ingress/router-default-6586767b64-jdqqn"
May 26 15:19:36.933595 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:19:36.933570    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vclkm\" (UniqueName: \"kubernetes.io/projected/d4359b58-cee4-4040-9a23-d1545122d3c6-kube-api-access-vclkm\") pod \"router-default-6586767b64-jdqqn\" (UID: \"d4359b58-cee4-4040-9a23-d1545122d3c6\") " pod="openshift-ingress/router-default-6586767b64-jdqqn"
May 26 15:19:36.933595 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:19:36.933588    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/d4359b58-cee4-4040-9a23-d1545122d3c6-stats-auth\") pod \"router-default-6586767b64-jdqqn\" (UID: \"d4359b58-cee4-4040-9a23-d1545122d3c6\") " pod="openshift-ingress/router-default-6586767b64-jdqqn"
May 26 15:19:36.933659 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:19:36.933619    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/d4359b58-cee4-4040-9a23-d1545122d3c6-default-certificate\") pod \"router-default-6586767b64-jdqqn\" (UID: \"d4359b58-cee4-4040-9a23-d1545122d3c6\") " pod="openshift-ingress/router-default-6586767b64-jdqqn"
May 26 15:19:37.034021 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:19:37.033989    2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d4359b58-cee4-4040-9a23-d1545122d3c6-service-ca-bundle\") pod \"router-default-6586767b64-jdqqn\" (UID: \"d4359b58-cee4-4040-9a23-d1545122d3c6\") " pod="openshift-ingress/router-default-6586767b64-jdqqn"
May 26 15:19:37.034021 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:19:37.034027    2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-vclkm\" (UniqueName: \"kubernetes.io/projected/d4359b58-cee4-4040-9a23-d1545122d3c6-kube-api-access-vclkm\") pod \"router-default-6586767b64-jdqqn\" (UID: \"d4359b58-cee4-4040-9a23-d1545122d3c6\") " pod="openshift-ingress/router-default-6586767b64-jdqqn"
May 26 15:19:37.034134 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:19:37.034052    2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/d4359b58-cee4-4040-9a23-d1545122d3c6-stats-auth\") pod \"router-default-6586767b64-jdqqn\" (UID: \"d4359b58-cee4-4040-9a23-d1545122d3c6\") " pod="openshift-ingress/router-default-6586767b64-jdqqn"
May 26 15:19:37.034213 ip-10-0-140-164 kubenswrapper[2581]: E0526 15:19:37.034173    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/d4359b58-cee4-4040-9a23-d1545122d3c6-service-ca-bundle podName:d4359b58-cee4-4040-9a23-d1545122d3c6 nodeName:}" failed. No retries permitted until 2026-05-26 15:19:37.534152931 +0000 UTC m=+116.531856259 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/d4359b58-cee4-4040-9a23-d1545122d3c6-service-ca-bundle") pod "router-default-6586767b64-jdqqn" (UID: "d4359b58-cee4-4040-9a23-d1545122d3c6") : configmap references non-existent config key: service-ca.crt
May 26 15:19:37.034213 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:19:37.034198    2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/d4359b58-cee4-4040-9a23-d1545122d3c6-default-certificate\") pod \"router-default-6586767b64-jdqqn\" (UID: \"d4359b58-cee4-4040-9a23-d1545122d3c6\") " pod="openshift-ingress/router-default-6586767b64-jdqqn"
May 26 15:19:37.034313 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:19:37.034241    2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-txmpc\" (UniqueName: \"kubernetes.io/projected/7e643816-5795-4bd4-9145-753987fb638e-kube-api-access-txmpc\") pod \"network-check-source-7f44b6dd87-bzvwj\" (UID: \"7e643816-5795-4bd4-9145-753987fb638e\") " pod="openshift-network-diagnostics/network-check-source-7f44b6dd87-bzvwj"
May 26 15:19:37.034313 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:19:37.034294    2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d4359b58-cee4-4040-9a23-d1545122d3c6-metrics-certs\") pod \"router-default-6586767b64-jdqqn\" (UID: \"d4359b58-cee4-4040-9a23-d1545122d3c6\") " pod="openshift-ingress/router-default-6586767b64-jdqqn"
May 26 15:19:37.034419 ip-10-0-140-164 kubenswrapper[2581]: E0526 15:19:37.034404    2581 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
May 26 15:19:37.034463 ip-10-0-140-164 kubenswrapper[2581]: E0526 15:19:37.034454    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d4359b58-cee4-4040-9a23-d1545122d3c6-metrics-certs podName:d4359b58-cee4-4040-9a23-d1545122d3c6 nodeName:}" failed. No retries permitted until 2026-05-26 15:19:37.534440755 +0000 UTC m=+116.532144083 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d4359b58-cee4-4040-9a23-d1545122d3c6-metrics-certs") pod "router-default-6586767b64-jdqqn" (UID: "d4359b58-cee4-4040-9a23-d1545122d3c6") : secret "router-metrics-certs-default" not found
May 26 15:19:37.036700 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:19:37.036680    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/d4359b58-cee4-4040-9a23-d1545122d3c6-stats-auth\") pod \"router-default-6586767b64-jdqqn\" (UID: \"d4359b58-cee4-4040-9a23-d1545122d3c6\") " pod="openshift-ingress/router-default-6586767b64-jdqqn"
May 26 15:19:37.036700 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:19:37.036698    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/d4359b58-cee4-4040-9a23-d1545122d3c6-default-certificate\") pod \"router-default-6586767b64-jdqqn\" (UID: \"d4359b58-cee4-4040-9a23-d1545122d3c6\") " pod="openshift-ingress/router-default-6586767b64-jdqqn"
May 26 15:19:37.043490 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:19:37.043470    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vclkm\" (UniqueName: \"kubernetes.io/projected/d4359b58-cee4-4040-9a23-d1545122d3c6-kube-api-access-vclkm\") pod \"router-default-6586767b64-jdqqn\" (UID: \"d4359b58-cee4-4040-9a23-d1545122d3c6\") " pod="openshift-ingress/router-default-6586767b64-jdqqn"
May 26 15:19:37.043633 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:19:37.043614    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-txmpc\" (UniqueName: \"kubernetes.io/projected/7e643816-5795-4bd4-9145-753987fb638e-kube-api-access-txmpc\") pod \"network-check-source-7f44b6dd87-bzvwj\" (UID: \"7e643816-5795-4bd4-9145-753987fb638e\") " pod="openshift-network-diagnostics/network-check-source-7f44b6dd87-bzvwj"
May 26 15:19:37.123014 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:19:37.122965    2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-7f44b6dd87-bzvwj"
May 26 15:19:37.242008 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:19:37.241980    2581 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-7f44b6dd87-bzvwj"]
May 26 15:19:37.244566 ip-10-0-140-164 kubenswrapper[2581]: W0526 15:19:37.244541    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7e643816_5795_4bd4_9145_753987fb638e.slice/crio-86eab8af36a246a5f29c428c2af157d4fda55f464e6b81a4aa95257b94293a7c WatchSource:0}: Error finding container 86eab8af36a246a5f29c428c2af157d4fda55f464e6b81a4aa95257b94293a7c: Status 404 returned error can't find the container with id 86eab8af36a246a5f29c428c2af157d4fda55f464e6b81a4aa95257b94293a7c
May 26 15:19:37.537243 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:19:37.537212    2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d4359b58-cee4-4040-9a23-d1545122d3c6-metrics-certs\") pod \"router-default-6586767b64-jdqqn\" (UID: \"d4359b58-cee4-4040-9a23-d1545122d3c6\") " pod="openshift-ingress/router-default-6586767b64-jdqqn"
May 26 15:19:37.537358 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:19:37.537332    2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d4359b58-cee4-4040-9a23-d1545122d3c6-service-ca-bundle\") pod \"router-default-6586767b64-jdqqn\" (UID: \"d4359b58-cee4-4040-9a23-d1545122d3c6\") " pod="openshift-ingress/router-default-6586767b64-jdqqn"
May 26 15:19:37.537406 ip-10-0-140-164 kubenswrapper[2581]: E0526 15:19:37.537374    2581 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
May 26 15:19:37.537480 ip-10-0-140-164 kubenswrapper[2581]: E0526 15:19:37.537435    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d4359b58-cee4-4040-9a23-d1545122d3c6-metrics-certs podName:d4359b58-cee4-4040-9a23-d1545122d3c6 nodeName:}" failed. No retries permitted until 2026-05-26 15:19:38.53741774 +0000 UTC m=+117.535121064 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d4359b58-cee4-4040-9a23-d1545122d3c6-metrics-certs") pod "router-default-6586767b64-jdqqn" (UID: "d4359b58-cee4-4040-9a23-d1545122d3c6") : secret "router-metrics-certs-default" not found
May 26 15:19:37.537480 ip-10-0-140-164 kubenswrapper[2581]: E0526 15:19:37.537450    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/d4359b58-cee4-4040-9a23-d1545122d3c6-service-ca-bundle podName:d4359b58-cee4-4040-9a23-d1545122d3c6 nodeName:}" failed. No retries permitted until 2026-05-26 15:19:38.537443512 +0000 UTC m=+117.535146824 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/d4359b58-cee4-4040-9a23-d1545122d3c6-service-ca-bundle") pod "router-default-6586767b64-jdqqn" (UID: "d4359b58-cee4-4040-9a23-d1545122d3c6") : configmap references non-existent config key: service-ca.crt
May 26 15:19:37.947325 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:19:37.947254    2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-7f44b6dd87-bzvwj" event={"ID":"7e643816-5795-4bd4-9145-753987fb638e","Type":"ContainerStarted","Data":"621276f6cd8ed9c57998c8df2f21aeceb747f84ffadf981af64ee2d3680b4c6a"}
May 26 15:19:37.947325 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:19:37.947305    2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-7f44b6dd87-bzvwj" event={"ID":"7e643816-5795-4bd4-9145-753987fb638e","Type":"ContainerStarted","Data":"86eab8af36a246a5f29c428c2af157d4fda55f464e6b81a4aa95257b94293a7c"}
May 26 15:19:37.964840 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:19:37.964801    2581 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-7f44b6dd87-bzvwj" podStartSLOduration=1.9647881329999999 podStartE2EDuration="1.964788133s" podCreationTimestamp="2026-05-26 15:19:36 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-26 15:19:37.964127423 +0000 UTC m=+116.961830755" watchObservedRunningTime="2026-05-26 15:19:37.964788133 +0000 UTC m=+116.962491465"
May 26 15:19:38.543966 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:19:38.543929    2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d4359b58-cee4-4040-9a23-d1545122d3c6-metrics-certs\") pod \"router-default-6586767b64-jdqqn\" (UID: \"d4359b58-cee4-4040-9a23-d1545122d3c6\") " pod="openshift-ingress/router-default-6586767b64-jdqqn"
May 26 15:19:38.544121 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:19:38.544023    2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d4359b58-cee4-4040-9a23-d1545122d3c6-service-ca-bundle\") pod \"router-default-6586767b64-jdqqn\" (UID: \"d4359b58-cee4-4040-9a23-d1545122d3c6\") " pod="openshift-ingress/router-default-6586767b64-jdqqn"
May 26 15:19:38.544121 ip-10-0-140-164 kubenswrapper[2581]: E0526 15:19:38.544092    2581 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
May 26 15:19:38.544194 ip-10-0-140-164 kubenswrapper[2581]: E0526 15:19:38.544158    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/d4359b58-cee4-4040-9a23-d1545122d3c6-service-ca-bundle podName:d4359b58-cee4-4040-9a23-d1545122d3c6 nodeName:}" failed. No retries permitted until 2026-05-26 15:19:40.544138791 +0000 UTC m=+119.541842117 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/d4359b58-cee4-4040-9a23-d1545122d3c6-service-ca-bundle") pod "router-default-6586767b64-jdqqn" (UID: "d4359b58-cee4-4040-9a23-d1545122d3c6") : configmap references non-existent config key: service-ca.crt
May 26 15:19:38.544194 ip-10-0-140-164 kubenswrapper[2581]: E0526 15:19:38.544176    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d4359b58-cee4-4040-9a23-d1545122d3c6-metrics-certs podName:d4359b58-cee4-4040-9a23-d1545122d3c6 nodeName:}" failed. No retries permitted until 2026-05-26 15:19:40.544167571 +0000 UTC m=+119.541870882 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d4359b58-cee4-4040-9a23-d1545122d3c6-metrics-certs") pod "router-default-6586767b64-jdqqn" (UID: "d4359b58-cee4-4040-9a23-d1545122d3c6") : secret "router-metrics-certs-default" not found
May 26 15:19:40.559584 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:19:40.559534    2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d4359b58-cee4-4040-9a23-d1545122d3c6-service-ca-bundle\") pod \"router-default-6586767b64-jdqqn\" (UID: \"d4359b58-cee4-4040-9a23-d1545122d3c6\") " pod="openshift-ingress/router-default-6586767b64-jdqqn"
May 26 15:19:40.559945 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:19:40.559601    2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d4359b58-cee4-4040-9a23-d1545122d3c6-metrics-certs\") pod \"router-default-6586767b64-jdqqn\" (UID: \"d4359b58-cee4-4040-9a23-d1545122d3c6\") " pod="openshift-ingress/router-default-6586767b64-jdqqn"
May 26 15:19:40.559945 ip-10-0-140-164 kubenswrapper[2581]: E0526 15:19:40.559693    2581 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
May 26 15:19:40.559945 ip-10-0-140-164 kubenswrapper[2581]: E0526 15:19:40.559723    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/d4359b58-cee4-4040-9a23-d1545122d3c6-service-ca-bundle podName:d4359b58-cee4-4040-9a23-d1545122d3c6 nodeName:}" failed. No retries permitted until 2026-05-26 15:19:44.559703085 +0000 UTC m=+123.557406398 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/d4359b58-cee4-4040-9a23-d1545122d3c6-service-ca-bundle") pod "router-default-6586767b64-jdqqn" (UID: "d4359b58-cee4-4040-9a23-d1545122d3c6") : configmap references non-existent config key: service-ca.crt
May 26 15:19:40.559945 ip-10-0-140-164 kubenswrapper[2581]: E0526 15:19:40.559752    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d4359b58-cee4-4040-9a23-d1545122d3c6-metrics-certs podName:d4359b58-cee4-4040-9a23-d1545122d3c6 nodeName:}" failed. No retries permitted until 2026-05-26 15:19:44.559743949 +0000 UTC m=+123.557447259 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d4359b58-cee4-4040-9a23-d1545122d3c6-metrics-certs") pod "router-default-6586767b64-jdqqn" (UID: "d4359b58-cee4-4040-9a23-d1545122d3c6") : secret "router-metrics-certs-default" not found
May 26 15:19:43.939670 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:19:43.939636    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-6j49h_9f965e2e-8e40-4ab4-b3cd-0d52ba317cf2/dns-node-resolver/0.log"
May 26 15:19:44.586930 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:19:44.586880    2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d4359b58-cee4-4040-9a23-d1545122d3c6-service-ca-bundle\") pod \"router-default-6586767b64-jdqqn\" (UID: \"d4359b58-cee4-4040-9a23-d1545122d3c6\") " pod="openshift-ingress/router-default-6586767b64-jdqqn"
May 26 15:19:44.587130 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:19:44.586967    2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d4359b58-cee4-4040-9a23-d1545122d3c6-metrics-certs\") pod \"router-default-6586767b64-jdqqn\" (UID: \"d4359b58-cee4-4040-9a23-d1545122d3c6\") " pod="openshift-ingress/router-default-6586767b64-jdqqn"
May 26 15:19:44.587130 ip-10-0-140-164 kubenswrapper[2581]: E0526 15:19:44.587044    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/d4359b58-cee4-4040-9a23-d1545122d3c6-service-ca-bundle podName:d4359b58-cee4-4040-9a23-d1545122d3c6 nodeName:}" failed. No retries permitted until 2026-05-26 15:19:52.587024104 +0000 UTC m=+131.584727414 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/d4359b58-cee4-4040-9a23-d1545122d3c6-service-ca-bundle") pod "router-default-6586767b64-jdqqn" (UID: "d4359b58-cee4-4040-9a23-d1545122d3c6") : configmap references non-existent config key: service-ca.crt
May 26 15:19:44.587130 ip-10-0-140-164 kubenswrapper[2581]: E0526 15:19:44.587113    2581 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
May 26 15:19:44.587334 ip-10-0-140-164 kubenswrapper[2581]: E0526 15:19:44.587182    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d4359b58-cee4-4040-9a23-d1545122d3c6-metrics-certs podName:d4359b58-cee4-4040-9a23-d1545122d3c6 nodeName:}" failed. No retries permitted until 2026-05-26 15:19:52.587162954 +0000 UTC m=+131.584866319 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d4359b58-cee4-4040-9a23-d1545122d3c6-metrics-certs") pod "router-default-6586767b64-jdqqn" (UID: "d4359b58-cee4-4040-9a23-d1545122d3c6") : secret "router-metrics-certs-default" not found
May 26 15:19:45.138878 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:19:45.138849    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-khnr9_706d11ce-61db-4788-83f2-2ffbea860487/node-ca/0.log"
May 26 15:19:45.337478 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:19:45.337437    2581 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-67d667c7d-vlbpz"]
May 26 15:19:45.339564 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:19:45.339544    2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-67d667c7d-vlbpz"
May 26 15:19:45.342074 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:19:45.342051    2581 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\""
May 26 15:19:45.342216 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:19:45.342194    2581 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\""
May 26 15:19:45.342468 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:19:45.342438    2581 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\""
May 26 15:19:45.343403 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:19:45.343384    2581 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\""
May 26 15:19:45.343507 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:19:45.343430    2581 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-twhds\""
May 26 15:19:45.351893 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:19:45.351870    2581 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-67d667c7d-vlbpz"]
May 26 15:19:45.493751 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:19:45.493728    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/962955c0-08cb-489f-a073-30ab949b0350-signing-cabundle\") pod \"service-ca-67d667c7d-vlbpz\" (UID: \"962955c0-08cb-489f-a073-30ab949b0350\") " pod="openshift-service-ca/service-ca-67d667c7d-vlbpz"
May 26 15:19:45.493848 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:19:45.493759    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/962955c0-08cb-489f-a073-30ab949b0350-signing-key\") pod \"service-ca-67d667c7d-vlbpz\" (UID: \"962955c0-08cb-489f-a073-30ab949b0350\") " pod="openshift-service-ca/service-ca-67d667c7d-vlbpz"
May 26 15:19:45.493890 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:19:45.493865    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fwnhq\" (UniqueName: \"kubernetes.io/projected/962955c0-08cb-489f-a073-30ab949b0350-kube-api-access-fwnhq\") pod \"service-ca-67d667c7d-vlbpz\" (UID: \"962955c0-08cb-489f-a073-30ab949b0350\") " pod="openshift-service-ca/service-ca-67d667c7d-vlbpz"
May 26 15:19:45.594502 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:19:45.594476    2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/962955c0-08cb-489f-a073-30ab949b0350-signing-cabundle\") pod \"service-ca-67d667c7d-vlbpz\" (UID: \"962955c0-08cb-489f-a073-30ab949b0350\") " pod="openshift-service-ca/service-ca-67d667c7d-vlbpz"
May 26 15:19:45.594589 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:19:45.594505    2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/962955c0-08cb-489f-a073-30ab949b0350-signing-key\") pod \"service-ca-67d667c7d-vlbpz\" (UID: \"962955c0-08cb-489f-a073-30ab949b0350\") " pod="openshift-service-ca/service-ca-67d667c7d-vlbpz"
May 26 15:19:45.594589 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:19:45.594563    2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-fwnhq\" (UniqueName: \"kubernetes.io/projected/962955c0-08cb-489f-a073-30ab949b0350-kube-api-access-fwnhq\") pod \"service-ca-67d667c7d-vlbpz\" (UID: \"962955c0-08cb-489f-a073-30ab949b0350\") " pod="openshift-service-ca/service-ca-67d667c7d-vlbpz"
May 26 15:19:45.595142 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:19:45.595119    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/962955c0-08cb-489f-a073-30ab949b0350-signing-cabundle\") pod \"service-ca-67d667c7d-vlbpz\" (UID: \"962955c0-08cb-489f-a073-30ab949b0350\") " pod="openshift-service-ca/service-ca-67d667c7d-vlbpz"
May 26 15:19:45.597380 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:19:45.597361    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/962955c0-08cb-489f-a073-30ab949b0350-signing-key\") pod \"service-ca-67d667c7d-vlbpz\" (UID: \"962955c0-08cb-489f-a073-30ab949b0350\") " pod="openshift-service-ca/service-ca-67d667c7d-vlbpz"
May 26 15:19:45.603850 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:19:45.603826    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fwnhq\" (UniqueName: \"kubernetes.io/projected/962955c0-08cb-489f-a073-30ab949b0350-kube-api-access-fwnhq\") pod \"service-ca-67d667c7d-vlbpz\" (UID: \"962955c0-08cb-489f-a073-30ab949b0350\") " pod="openshift-service-ca/service-ca-67d667c7d-vlbpz"
May 26 15:19:45.649671 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:19:45.649649    2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-67d667c7d-vlbpz"
May 26 15:19:45.780120 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:19:45.780058    2581 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-67d667c7d-vlbpz"]
May 26 15:19:45.783217 ip-10-0-140-164 kubenswrapper[2581]: W0526 15:19:45.783188    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod962955c0_08cb_489f_a073_30ab949b0350.slice/crio-1171168f3f7fc808c30430ac31b25d6ca188fd4080bd78b1f6304291970ddc15 WatchSource:0}: Error finding container 1171168f3f7fc808c30430ac31b25d6ca188fd4080bd78b1f6304291970ddc15: Status 404 returned error can't find the container with id 1171168f3f7fc808c30430ac31b25d6ca188fd4080bd78b1f6304291970ddc15
May 26 15:19:45.962426 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:19:45.962395    2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-67d667c7d-vlbpz" event={"ID":"962955c0-08cb-489f-a073-30ab949b0350","Type":"ContainerStarted","Data":"1171168f3f7fc808c30430ac31b25d6ca188fd4080bd78b1f6304291970ddc15"}
May 26 15:19:48.969570 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:19:48.969535    2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-67d667c7d-vlbpz" event={"ID":"962955c0-08cb-489f-a073-30ab949b0350","Type":"ContainerStarted","Data":"017b3df092e006a76f2ecfd7099c68420e19e36d70ef9dbb6b1de254c2036fe2"}
May 26 15:19:51.440218 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:19:51.440182    2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ae574985-4900-4b23-bf74-7c72c939f9bd-metrics-certs\") pod \"network-metrics-daemon-npzrf\" (UID: \"ae574985-4900-4b23-bf74-7c72c939f9bd\") " pod="openshift-multus/network-metrics-daemon-npzrf"
May 26 15:19:51.440659 ip-10-0-140-164 kubenswrapper[2581]: E0526 15:19:51.440346    2581 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
May 26 15:19:51.440659 ip-10-0-140-164 kubenswrapper[2581]: E0526 15:19:51.440408    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ae574985-4900-4b23-bf74-7c72c939f9bd-metrics-certs podName:ae574985-4900-4b23-bf74-7c72c939f9bd nodeName:}" failed. No retries permitted until 2026-05-26 15:21:53.440389496 +0000 UTC m=+252.438092807 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ae574985-4900-4b23-bf74-7c72c939f9bd-metrics-certs") pod "network-metrics-daemon-npzrf" (UID: "ae574985-4900-4b23-bf74-7c72c939f9bd") : secret "metrics-daemon-secret" not found
May 26 15:19:52.647984 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:19:52.647956    2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d4359b58-cee4-4040-9a23-d1545122d3c6-metrics-certs\") pod \"router-default-6586767b64-jdqqn\" (UID: \"d4359b58-cee4-4040-9a23-d1545122d3c6\") " pod="openshift-ingress/router-default-6586767b64-jdqqn"
May 26 15:19:52.648371 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:19:52.648037    2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d4359b58-cee4-4040-9a23-d1545122d3c6-service-ca-bundle\") pod \"router-default-6586767b64-jdqqn\" (UID: \"d4359b58-cee4-4040-9a23-d1545122d3c6\") " pod="openshift-ingress/router-default-6586767b64-jdqqn"
May 26 15:19:52.648371 ip-10-0-140-164 kubenswrapper[2581]: E0526 15:19:52.648117    2581 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
May 26 15:19:52.648371 ip-10-0-140-164 kubenswrapper[2581]: E0526 15:19:52.648165    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d4359b58-cee4-4040-9a23-d1545122d3c6-metrics-certs podName:d4359b58-cee4-4040-9a23-d1545122d3c6 nodeName:}" failed. No retries permitted until 2026-05-26 15:20:08.648147365 +0000 UTC m=+147.645850677 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d4359b58-cee4-4040-9a23-d1545122d3c6-metrics-certs") pod "router-default-6586767b64-jdqqn" (UID: "d4359b58-cee4-4040-9a23-d1545122d3c6") : secret "router-metrics-certs-default" not found
May 26 15:19:52.648371 ip-10-0-140-164 kubenswrapper[2581]: E0526 15:19:52.648181    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/d4359b58-cee4-4040-9a23-d1545122d3c6-service-ca-bundle podName:d4359b58-cee4-4040-9a23-d1545122d3c6 nodeName:}" failed. No retries permitted until 2026-05-26 15:20:08.648173031 +0000 UTC m=+147.645876345 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/d4359b58-cee4-4040-9a23-d1545122d3c6-service-ca-bundle") pod "router-default-6586767b64-jdqqn" (UID: "d4359b58-cee4-4040-9a23-d1545122d3c6") : configmap references non-existent config key: service-ca.crt
May 26 15:20:05.573901 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:20:05.573830    2581 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-service-ca/service-ca-67d667c7d-vlbpz" podStartSLOduration=18.079522305 podStartE2EDuration="20.573812786s" podCreationTimestamp="2026-05-26 15:19:45 +0000 UTC" firstStartedPulling="2026-05-26 15:19:45.78509944 +0000 UTC m=+124.782802750" lastFinishedPulling="2026-05-26 15:19:48.279389919 +0000 UTC m=+127.277093231" observedRunningTime="2026-05-26 15:19:48.986110362 +0000 UTC m=+127.983813696" watchObservedRunningTime="2026-05-26 15:20:05.573812786 +0000 UTC m=+144.571516129"
May 26 15:20:05.574647 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:20:05.574625    2581 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-8lknj"]
May 26 15:20:05.577425 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:20:05.577398    2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-8lknj"
May 26 15:20:05.580481 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:20:05.580453    2581 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-h445q\""
May 26 15:20:05.581679 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:20:05.581651    2581 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
May 26 15:20:05.581802 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:20:05.581655    2581 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
May 26 15:20:05.581802 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:20:05.581689    2581 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
May 26 15:20:05.581913 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:20:05.581852    2581 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
May 26 15:20:05.596803 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:20:05.596766    2581 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-8lknj"]
May 26 15:20:05.740156 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:20:05.740131    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/25d91a97-694b-459e-8b9e-aa7773e68e60-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-8lknj\" (UID: \"25d91a97-694b-459e-8b9e-aa7773e68e60\") " pod="openshift-insights/insights-runtime-extractor-8lknj"
May 26 15:20:05.740255 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:20:05.740169    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/25d91a97-694b-459e-8b9e-aa7773e68e60-crio-socket\") pod \"insights-runtime-extractor-8lknj\" (UID: \"25d91a97-694b-459e-8b9e-aa7773e68e60\") " pod="openshift-insights/insights-runtime-extractor-8lknj"
May 26 15:20:05.740255 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:20:05.740203    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/25d91a97-694b-459e-8b9e-aa7773e68e60-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-8lknj\" (UID: \"25d91a97-694b-459e-8b9e-aa7773e68e60\") " pod="openshift-insights/insights-runtime-extractor-8lknj"
May 26 15:20:05.740357 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:20:05.740286    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/25d91a97-694b-459e-8b9e-aa7773e68e60-data-volume\") pod \"insights-runtime-extractor-8lknj\" (UID: \"25d91a97-694b-459e-8b9e-aa7773e68e60\") " pod="openshift-insights/insights-runtime-extractor-8lknj"
May 26 15:20:05.740357 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:20:05.740345    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s7vtt\" (UniqueName: \"kubernetes.io/projected/25d91a97-694b-459e-8b9e-aa7773e68e60-kube-api-access-s7vtt\") pod \"insights-runtime-extractor-8lknj\" (UID: \"25d91a97-694b-459e-8b9e-aa7773e68e60\") " pod="openshift-insights/insights-runtime-extractor-8lknj"
May 26 15:20:05.840680 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:20:05.840618    2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/25d91a97-694b-459e-8b9e-aa7773e68e60-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-8lknj\" (UID: \"25d91a97-694b-459e-8b9e-aa7773e68e60\") " pod="openshift-insights/insights-runtime-extractor-8lknj"
May 26 15:20:05.840680 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:20:05.840660    2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/25d91a97-694b-459e-8b9e-aa7773e68e60-crio-socket\") pod \"insights-runtime-extractor-8lknj\" (UID: \"25d91a97-694b-459e-8b9e-aa7773e68e60\") " pod="openshift-insights/insights-runtime-extractor-8lknj"
May 26 15:20:05.840841 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:20:05.840689    2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/25d91a97-694b-459e-8b9e-aa7773e68e60-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-8lknj\" (UID: \"25d91a97-694b-459e-8b9e-aa7773e68e60\") " pod="openshift-insights/insights-runtime-extractor-8lknj"
May 26 15:20:05.840841 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:20:05.840761    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/25d91a97-694b-459e-8b9e-aa7773e68e60-crio-socket\") pod \"insights-runtime-extractor-8lknj\" (UID: \"25d91a97-694b-459e-8b9e-aa7773e68e60\") " pod="openshift-insights/insights-runtime-extractor-8lknj"
May 26 15:20:05.840841 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:20:05.840820    2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/25d91a97-694b-459e-8b9e-aa7773e68e60-data-volume\") pod \"insights-runtime-extractor-8lknj\" (UID: \"25d91a97-694b-459e-8b9e-aa7773e68e60\") " pod="openshift-insights/insights-runtime-extractor-8lknj"
May 26 15:20:05.840994 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:20:05.840864    2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-s7vtt\" (UniqueName: \"kubernetes.io/projected/25d91a97-694b-459e-8b9e-aa7773e68e60-kube-api-access-s7vtt\") pod \"insights-runtime-extractor-8lknj\" (UID: \"25d91a97-694b-459e-8b9e-aa7773e68e60\") " pod="openshift-insights/insights-runtime-extractor-8lknj"
May 26 15:20:05.841146 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:20:05.841121    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/25d91a97-694b-459e-8b9e-aa7773e68e60-data-volume\") pod \"insights-runtime-extractor-8lknj\" (UID: \"25d91a97-694b-459e-8b9e-aa7773e68e60\") " pod="openshift-insights/insights-runtime-extractor-8lknj"
May 26 15:20:05.841308 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:20:05.841260    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/25d91a97-694b-459e-8b9e-aa7773e68e60-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-8lknj\" (UID: \"25d91a97-694b-459e-8b9e-aa7773e68e60\") " pod="openshift-insights/insights-runtime-extractor-8lknj"
May 26 15:20:05.843299 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:20:05.843261    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/25d91a97-694b-459e-8b9e-aa7773e68e60-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-8lknj\" (UID: \"25d91a97-694b-459e-8b9e-aa7773e68e60\") " pod="openshift-insights/insights-runtime-extractor-8lknj"
May 26 15:20:05.850619 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:20:05.850592    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-s7vtt\" (UniqueName: \"kubernetes.io/projected/25d91a97-694b-459e-8b9e-aa7773e68e60-kube-api-access-s7vtt\") pod \"insights-runtime-extractor-8lknj\" (UID: \"25d91a97-694b-459e-8b9e-aa7773e68e60\") " pod="openshift-insights/insights-runtime-extractor-8lknj"
May 26 15:20:05.888314 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:20:05.888289    2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-8lknj"
May 26 15:20:06.016245 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:20:06.016220    2581 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-8lknj"]
May 26 15:20:06.018930 ip-10-0-140-164 kubenswrapper[2581]: W0526 15:20:06.018900    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod25d91a97_694b_459e_8b9e_aa7773e68e60.slice/crio-a28c9794b39643c95b9b2717708d1e9c5eb064561de37a85a5f5ea5f04ccfbb5 WatchSource:0}: Error finding container a28c9794b39643c95b9b2717708d1e9c5eb064561de37a85a5f5ea5f04ccfbb5: Status 404 returned error can't find the container with id a28c9794b39643c95b9b2717708d1e9c5eb064561de37a85a5f5ea5f04ccfbb5
May 26 15:20:07.018387 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:20:07.018359    2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-8lknj" event={"ID":"25d91a97-694b-459e-8b9e-aa7773e68e60","Type":"ContainerStarted","Data":"8385faffaa630005ea19306fa003dc72137096eab62f53729b6f9a017744ed98"}
May 26 15:20:07.018662 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:20:07.018397    2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-8lknj" event={"ID":"25d91a97-694b-459e-8b9e-aa7773e68e60","Type":"ContainerStarted","Data":"757764f6b62115ec36420cd1da2adf5da777bbfaa89007013f0302941a936755"}
May 26 15:20:07.018662 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:20:07.018412    2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-8lknj" event={"ID":"25d91a97-694b-459e-8b9e-aa7773e68e60","Type":"ContainerStarted","Data":"a28c9794b39643c95b9b2717708d1e9c5eb064561de37a85a5f5ea5f04ccfbb5"}
May 26 15:20:08.658876 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:20:08.658849    2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d4359b58-cee4-4040-9a23-d1545122d3c6-service-ca-bundle\") pod \"router-default-6586767b64-jdqqn\" (UID: \"d4359b58-cee4-4040-9a23-d1545122d3c6\") " pod="openshift-ingress/router-default-6586767b64-jdqqn"
May 26 15:20:08.659236 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:20:08.658913    2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d4359b58-cee4-4040-9a23-d1545122d3c6-metrics-certs\") pod \"router-default-6586767b64-jdqqn\" (UID: \"d4359b58-cee4-4040-9a23-d1545122d3c6\") " pod="openshift-ingress/router-default-6586767b64-jdqqn"
May 26 15:20:08.659531 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:20:08.659509    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d4359b58-cee4-4040-9a23-d1545122d3c6-service-ca-bundle\") pod \"router-default-6586767b64-jdqqn\" (UID: \"d4359b58-cee4-4040-9a23-d1545122d3c6\") " pod="openshift-ingress/router-default-6586767b64-jdqqn"
May 26 15:20:08.661004 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:20:08.660984    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d4359b58-cee4-4040-9a23-d1545122d3c6-metrics-certs\") pod \"router-default-6586767b64-jdqqn\" (UID: \"d4359b58-cee4-4040-9a23-d1545122d3c6\") " pod="openshift-ingress/router-default-6586767b64-jdqqn"
May 26 15:20:08.916589 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:20:08.916563    2581 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-dt4h4\""
May 26 15:20:08.923427 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:20:08.923407    2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-6586767b64-jdqqn"
May 26 15:20:09.025761 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:20:09.025734    2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-8lknj" event={"ID":"25d91a97-694b-459e-8b9e-aa7773e68e60","Type":"ContainerStarted","Data":"0c8aab7ce473e55828e28598d555b72f0a1c41f1dc2014de8f8cc1e003deda20"}
May 26 15:20:09.045137 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:20:09.045095    2581 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-8lknj" podStartSLOduration=1.667372795 podStartE2EDuration="4.045082979s" podCreationTimestamp="2026-05-26 15:20:05 +0000 UTC" firstStartedPulling="2026-05-26 15:20:06.078882223 +0000 UTC m=+145.076585534" lastFinishedPulling="2026-05-26 15:20:08.456592409 +0000 UTC m=+147.454295718" observedRunningTime="2026-05-26 15:20:09.044121799 +0000 UTC m=+148.041825131" watchObservedRunningTime="2026-05-26 15:20:09.045082979 +0000 UTC m=+148.042786334"
May 26 15:20:09.054644 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:20:09.054624    2581 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-6586767b64-jdqqn"]
May 26 15:20:09.058373 ip-10-0-140-164 kubenswrapper[2581]: W0526 15:20:09.058350    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd4359b58_cee4_4040_9a23_d1545122d3c6.slice/crio-1a6f17647883de0e2dee58d862cfd871a4a9d0c5597f0e07e732bd761fc91f41 WatchSource:0}: Error finding container 1a6f17647883de0e2dee58d862cfd871a4a9d0c5597f0e07e732bd761fc91f41: Status 404 returned error can't find the container with id 1a6f17647883de0e2dee58d862cfd871a4a9d0c5597f0e07e732bd761fc91f41
May 26 15:20:10.029904 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:20:10.029861    2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-6586767b64-jdqqn" event={"ID":"d4359b58-cee4-4040-9a23-d1545122d3c6","Type":"ContainerStarted","Data":"a4a5e9208a3ccb5ad778bab7a245a2a79e1321b2dd9112581535659e896345a0"}
May 26 15:20:10.030261 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:20:10.029911    2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-6586767b64-jdqqn" event={"ID":"d4359b58-cee4-4040-9a23-d1545122d3c6","Type":"ContainerStarted","Data":"1a6f17647883de0e2dee58d862cfd871a4a9d0c5597f0e07e732bd761fc91f41"}
May 26 15:20:10.850598 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:20:10.850547    2581 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress/router-default-6586767b64-jdqqn" podStartSLOduration=34.850529348 podStartE2EDuration="34.850529348s" podCreationTimestamp="2026-05-26 15:19:36 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-26 15:20:10.052712874 +0000 UTC m=+149.050416207" watchObservedRunningTime="2026-05-26 15:20:10.850529348 +0000 UTC m=+149.848232680"
May 26 15:20:10.850837 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:20:10.850709    2581 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-console/console-bc69b9575-wpg95"]
May 26 15:20:10.853650 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:20:10.853633    2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-bc69b9575-wpg95"
May 26 15:20:10.856915 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:20:10.856892    2581 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
May 26 15:20:10.857078 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:20:10.857029    2581 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
May 26 15:20:10.858108 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:20:10.858091    2581 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
May 26 15:20:10.858192 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:20:10.858096    2581 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-47bk2\""
May 26 15:20:10.858351 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:20:10.858326    2581 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
May 26 15:20:10.858460 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:20:10.858375    2581 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
May 26 15:20:10.858566 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:20:10.858551    2581 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
May 26 15:20:10.858634 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:20:10.858564    2581 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
May 26 15:20:10.862626 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:20:10.862605    2581 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-bc69b9575-wpg95"]
May 26 15:20:10.924387 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:20:10.924363    2581 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-6586767b64-jdqqn"
May 26 15:20:10.927761 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:20:10.927741    2581 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-6586767b64-jdqqn"
May 26 15:20:10.975398 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:20:10.975372    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f9d78be8-b369-4bc4-a010-7164d68b5168-console-config\") pod \"console-bc69b9575-wpg95\" (UID: \"f9d78be8-b369-4bc4-a010-7164d68b5168\") " pod="openshift-console/console-bc69b9575-wpg95"
May 26 15:20:10.975500 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:20:10.975402    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f9d78be8-b369-4bc4-a010-7164d68b5168-oauth-serving-cert\") pod \"console-bc69b9575-wpg95\" (UID: \"f9d78be8-b369-4bc4-a010-7164d68b5168\") " pod="openshift-console/console-bc69b9575-wpg95"
May 26 15:20:10.975561 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:20:10.975541    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f9d78be8-b369-4bc4-a010-7164d68b5168-service-ca\") pod \"console-bc69b9575-wpg95\" (UID: \"f9d78be8-b369-4bc4-a010-7164d68b5168\") " pod="openshift-console/console-bc69b9575-wpg95"
May 26 15:20:10.975615 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:20:10.975584    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f9d78be8-b369-4bc4-a010-7164d68b5168-console-serving-cert\") pod \"console-bc69b9575-wpg95\" (UID: \"f9d78be8-b369-4bc4-a010-7164d68b5168\") " pod="openshift-console/console-bc69b9575-wpg95"
May 26 15:20:10.975666 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:20:10.975632    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f9d78be8-b369-4bc4-a010-7164d68b5168-console-oauth-config\") pod \"console-bc69b9575-wpg95\" (UID: \"f9d78be8-b369-4bc4-a010-7164d68b5168\") " pod="openshift-console/console-bc69b9575-wpg95"
May 26 15:20:10.975718 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:20:10.975672    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-84blt\" (UniqueName: \"kubernetes.io/projected/f9d78be8-b369-4bc4-a010-7164d68b5168-kube-api-access-84blt\") pod \"console-bc69b9575-wpg95\" (UID: \"f9d78be8-b369-4bc4-a010-7164d68b5168\") " pod="openshift-console/console-bc69b9575-wpg95"
May 26 15:20:11.031949 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:20:11.031928    2581 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-6586767b64-jdqqn"
May 26 15:20:11.033100 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:20:11.033080    2581 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-6586767b64-jdqqn"
May 26 15:20:11.076479 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:20:11.076457    2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f9d78be8-b369-4bc4-a010-7164d68b5168-console-serving-cert\") pod \"console-bc69b9575-wpg95\" (UID: \"f9d78be8-b369-4bc4-a010-7164d68b5168\") " pod="openshift-console/console-bc69b9575-wpg95"
May 26 15:20:11.076583 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:20:11.076509    2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f9d78be8-b369-4bc4-a010-7164d68b5168-console-oauth-config\") pod \"console-bc69b9575-wpg95\" (UID: \"f9d78be8-b369-4bc4-a010-7164d68b5168\") " pod="openshift-console/console-bc69b9575-wpg95"
May 26 15:20:11.076583 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:20:11.076537    2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-84blt\" (UniqueName: \"kubernetes.io/projected/f9d78be8-b369-4bc4-a010-7164d68b5168-kube-api-access-84blt\") pod \"console-bc69b9575-wpg95\" (UID: \"f9d78be8-b369-4bc4-a010-7164d68b5168\") " pod="openshift-console/console-bc69b9575-wpg95"
May 26 15:20:11.076583 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:20:11.076569    2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f9d78be8-b369-4bc4-a010-7164d68b5168-console-config\") pod \"console-bc69b9575-wpg95\" (UID: \"f9d78be8-b369-4bc4-a010-7164d68b5168\") " pod="openshift-console/console-bc69b9575-wpg95"
May 26 15:20:11.076746 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:20:11.076602    2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f9d78be8-b369-4bc4-a010-7164d68b5168-oauth-serving-cert\") pod \"console-bc69b9575-wpg95\" (UID: \"f9d78be8-b369-4bc4-a010-7164d68b5168\") " pod="openshift-console/console-bc69b9575-wpg95"
May 26 15:20:11.076746 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:20:11.076698    2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f9d78be8-b369-4bc4-a010-7164d68b5168-service-ca\") pod \"console-bc69b9575-wpg95\" (UID: \"f9d78be8-b369-4bc4-a010-7164d68b5168\") " pod="openshift-console/console-bc69b9575-wpg95"
May 26 15:20:11.077394 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:20:11.077374    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f9d78be8-b369-4bc4-a010-7164d68b5168-service-ca\") pod \"console-bc69b9575-wpg95\" (UID: \"f9d78be8-b369-4bc4-a010-7164d68b5168\") " pod="openshift-console/console-bc69b9575-wpg95"
May 26 15:20:11.077616 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:20:11.077594    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f9d78be8-b369-4bc4-a010-7164d68b5168-console-config\") pod \"console-bc69b9575-wpg95\" (UID: \"f9d78be8-b369-4bc4-a010-7164d68b5168\") " pod="openshift-console/console-bc69b9575-wpg95"
May 26 15:20:11.077665 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:20:11.077623    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f9d78be8-b369-4bc4-a010-7164d68b5168-oauth-serving-cert\") pod \"console-bc69b9575-wpg95\" (UID: \"f9d78be8-b369-4bc4-a010-7164d68b5168\") " pod="openshift-console/console-bc69b9575-wpg95"
May 26 15:20:11.079414 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:20:11.079391    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f9d78be8-b369-4bc4-a010-7164d68b5168-console-serving-cert\") pod \"console-bc69b9575-wpg95\" (UID: \"f9d78be8-b369-4bc4-a010-7164d68b5168\") " pod="openshift-console/console-bc69b9575-wpg95"
May 26 15:20:11.079612 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:20:11.079569    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f9d78be8-b369-4bc4-a010-7164d68b5168-console-oauth-config\") pod \"console-bc69b9575-wpg95\" (UID: \"f9d78be8-b369-4bc4-a010-7164d68b5168\") " pod="openshift-console/console-bc69b9575-wpg95"
May 26 15:20:11.091920 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:20:11.091898    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-84blt\" (UniqueName: \"kubernetes.io/projected/f9d78be8-b369-4bc4-a010-7164d68b5168-kube-api-access-84blt\") pod \"console-bc69b9575-wpg95\" (UID: \"f9d78be8-b369-4bc4-a010-7164d68b5168\") " pod="openshift-console/console-bc69b9575-wpg95"
May 26 15:20:11.163904 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:20:11.163874    2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-bc69b9575-wpg95"
May 26 15:20:11.286187 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:20:11.286160    2581 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-bc69b9575-wpg95"]
May 26 15:20:11.289430 ip-10-0-140-164 kubenswrapper[2581]: W0526 15:20:11.289404    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf9d78be8_b369_4bc4_a010_7164d68b5168.slice/crio-a6614e75a5f11791a4718472987880187e7ebfb56c774ea386311381f70f3242 WatchSource:0}: Error finding container a6614e75a5f11791a4718472987880187e7ebfb56c774ea386311381f70f3242: Status 404 returned error can't find the container with id a6614e75a5f11791a4718472987880187e7ebfb56c774ea386311381f70f3242
May 26 15:20:12.035664 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:20:12.035623    2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-bc69b9575-wpg95" event={"ID":"f9d78be8-b369-4bc4-a010-7164d68b5168","Type":"ContainerStarted","Data":"a6614e75a5f11791a4718472987880187e7ebfb56c774ea386311381f70f3242"}
May 26 15:20:15.045146 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:20:15.045110    2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-bc69b9575-wpg95" event={"ID":"f9d78be8-b369-4bc4-a010-7164d68b5168","Type":"ContainerStarted","Data":"dfc9892999241bf045b313dbc7122733a20822997051d59b86ae29f82096a041"}
May 26 15:20:15.066486 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:20:15.066435    2581 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-console/console-bc69b9575-wpg95" podStartSLOduration=2.07416015 podStartE2EDuration="5.066419003s" podCreationTimestamp="2026-05-26 15:20:10 +0000 UTC" firstStartedPulling="2026-05-26 15:20:11.291161512 +0000 UTC m=+150.288864823" lastFinishedPulling="2026-05-26 15:20:14.283420366 +0000 UTC m=+153.281123676" observedRunningTime="2026-05-26 15:20:15.065355534 +0000 UTC m=+154.063058867" watchObservedRunningTime="2026-05-26 15:20:15.066419003 +0000 UTC m=+154.064122335"
May 26 15:20:17.911600 ip-10-0-140-164 kubenswrapper[2581]: E0526 15:20:17.911564    2581 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[registry-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-image-registry/image-registry-797775bcb5-x7sns" podUID="676b1633-43dc-4fe0-bf8b-5f8247a3e6e2"
May 26 15:20:17.928372 ip-10-0-140-164 kubenswrapper[2581]: E0526 15:20:17.928340    2581 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[cert], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-ingress-canary/ingress-canary-kgzwq" podUID="37c203f3-fea7-4b18-a713-d805bf7dd8d9"
May 26 15:20:18.028184 ip-10-0-140-164 kubenswrapper[2581]: E0526 15:20:18.028156    2581 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-l4rks" podUID="c1324645-ef27-41da-851e-615da7eab3b0"
May 26 15:20:18.051741 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:20:18.051716    2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-l4rks"
May 26 15:20:18.051837 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:20:18.051716    2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-797775bcb5-x7sns"
May 26 15:20:18.051900 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:20:18.051717    2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-kgzwq"
May 26 15:20:19.040133 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:20:19.040097    2581 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-console/console-c455f768d-2g4gp"]
May 26 15:20:19.042855 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:20:19.042834    2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-c455f768d-2g4gp"
May 26 15:20:19.052138 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:20:19.052096    2581 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\""
May 26 15:20:19.053122 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:20:19.053099    2581 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-c455f768d-2g4gp"]
May 26 15:20:19.236133 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:20:19.236105    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/28f55293-5c36-419f-b5ba-53c1905d302c-console-oauth-config\") pod \"console-c455f768d-2g4gp\" (UID: \"28f55293-5c36-419f-b5ba-53c1905d302c\") " pod="openshift-console/console-c455f768d-2g4gp"
May 26 15:20:19.236250 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:20:19.236140    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/28f55293-5c36-419f-b5ba-53c1905d302c-console-config\") pod \"console-c455f768d-2g4gp\" (UID: \"28f55293-5c36-419f-b5ba-53c1905d302c\") " pod="openshift-console/console-c455f768d-2g4gp"
May 26 15:20:19.236250 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:20:19.236236    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/28f55293-5c36-419f-b5ba-53c1905d302c-service-ca\") pod \"console-c455f768d-2g4gp\" (UID: \"28f55293-5c36-419f-b5ba-53c1905d302c\") " pod="openshift-console/console-c455f768d-2g4gp"
May 26 15:20:19.236385 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:20:19.236295    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/28f55293-5c36-419f-b5ba-53c1905d302c-console-serving-cert\") pod \"console-c455f768d-2g4gp\" (UID: \"28f55293-5c36-419f-b5ba-53c1905d302c\") " pod="openshift-console/console-c455f768d-2g4gp"
May 26 15:20:19.236385 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:20:19.236323    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/28f55293-5c36-419f-b5ba-53c1905d302c-oauth-serving-cert\") pod \"console-c455f768d-2g4gp\" (UID: \"28f55293-5c36-419f-b5ba-53c1905d302c\") " pod="openshift-console/console-c455f768d-2g4gp"
May 26 15:20:19.236385 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:20:19.236367    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dpchx\" (UniqueName: \"kubernetes.io/projected/28f55293-5c36-419f-b5ba-53c1905d302c-kube-api-access-dpchx\") pod \"console-c455f768d-2g4gp\" (UID: \"28f55293-5c36-419f-b5ba-53c1905d302c\") " pod="openshift-console/console-c455f768d-2g4gp"
May 26 15:20:19.236486 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:20:19.236385    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/28f55293-5c36-419f-b5ba-53c1905d302c-trusted-ca-bundle\") pod \"console-c455f768d-2g4gp\" (UID: \"28f55293-5c36-419f-b5ba-53c1905d302c\") " pod="openshift-console/console-c455f768d-2g4gp"
May 26 15:20:19.337586 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:20:19.337537    2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/28f55293-5c36-419f-b5ba-53c1905d302c-trusted-ca-bundle\") pod \"console-c455f768d-2g4gp\" (UID: \"28f55293-5c36-419f-b5ba-53c1905d302c\") " pod="openshift-console/console-c455f768d-2g4gp"
May 26 15:20:19.337586 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:20:19.337581    2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/28f55293-5c36-419f-b5ba-53c1905d302c-console-oauth-config\") pod \"console-c455f768d-2g4gp\" (UID: \"28f55293-5c36-419f-b5ba-53c1905d302c\") " pod="openshift-console/console-c455f768d-2g4gp"
May 26 15:20:19.337692 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:20:19.337598    2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/28f55293-5c36-419f-b5ba-53c1905d302c-console-config\") pod \"console-c455f768d-2g4gp\" (UID: \"28f55293-5c36-419f-b5ba-53c1905d302c\") " pod="openshift-console/console-c455f768d-2g4gp"
May 26 15:20:19.337692 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:20:19.337665    2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/28f55293-5c36-419f-b5ba-53c1905d302c-service-ca\") pod \"console-c455f768d-2g4gp\" (UID: \"28f55293-5c36-419f-b5ba-53c1905d302c\") " pod="openshift-console/console-c455f768d-2g4gp"
May 26 15:20:19.337780 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:20:19.337692    2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/28f55293-5c36-419f-b5ba-53c1905d302c-console-serving-cert\") pod \"console-c455f768d-2g4gp\" (UID: \"28f55293-5c36-419f-b5ba-53c1905d302c\") " pod="openshift-console/console-c455f768d-2g4gp"
May 26 15:20:19.337780 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:20:19.337715    2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/28f55293-5c36-419f-b5ba-53c1905d302c-oauth-serving-cert\") pod \"console-c455f768d-2g4gp\" (UID: \"28f55293-5c36-419f-b5ba-53c1905d302c\") " pod="openshift-console/console-c455f768d-2g4gp"
May 26 15:20:19.337780 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:20:19.337748    2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-dpchx\" (UniqueName: \"kubernetes.io/projected/28f55293-5c36-419f-b5ba-53c1905d302c-kube-api-access-dpchx\") pod \"console-c455f768d-2g4gp\" (UID: \"28f55293-5c36-419f-b5ba-53c1905d302c\") " pod="openshift-console/console-c455f768d-2g4gp"
May 26 15:20:19.338483 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:20:19.338395    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/28f55293-5c36-419f-b5ba-53c1905d302c-console-config\") pod \"console-c455f768d-2g4gp\" (UID: \"28f55293-5c36-419f-b5ba-53c1905d302c\") " pod="openshift-console/console-c455f768d-2g4gp"
May 26 15:20:19.338483 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:20:19.338395    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/28f55293-5c36-419f-b5ba-53c1905d302c-service-ca\") pod \"console-c455f768d-2g4gp\" (UID: \"28f55293-5c36-419f-b5ba-53c1905d302c\") " pod="openshift-console/console-c455f768d-2g4gp"
May 26 15:20:19.338483 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:20:19.338473    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/28f55293-5c36-419f-b5ba-53c1905d302c-trusted-ca-bundle\") pod \"console-c455f768d-2g4gp\" (UID: \"28f55293-5c36-419f-b5ba-53c1905d302c\") " pod="openshift-console/console-c455f768d-2g4gp"
May 26 15:20:19.338483 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:20:19.338484    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/28f55293-5c36-419f-b5ba-53c1905d302c-oauth-serving-cert\") pod \"console-c455f768d-2g4gp\" (UID: \"28f55293-5c36-419f-b5ba-53c1905d302c\") " pod="openshift-console/console-c455f768d-2g4gp"
May 26 15:20:19.340203 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:20:19.340186    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/28f55293-5c36-419f-b5ba-53c1905d302c-console-serving-cert\") pod \"console-c455f768d-2g4gp\" (UID: \"28f55293-5c36-419f-b5ba-53c1905d302c\") " pod="openshift-console/console-c455f768d-2g4gp"
May 26 15:20:19.340296 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:20:19.340254    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/28f55293-5c36-419f-b5ba-53c1905d302c-console-oauth-config\") pod \"console-c455f768d-2g4gp\" (UID: \"28f55293-5c36-419f-b5ba-53c1905d302c\") " pod="openshift-console/console-c455f768d-2g4gp"
May 26 15:20:19.347342 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:20:19.347317    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dpchx\" (UniqueName: \"kubernetes.io/projected/28f55293-5c36-419f-b5ba-53c1905d302c-kube-api-access-dpchx\") pod \"console-c455f768d-2g4gp\" (UID: \"28f55293-5c36-419f-b5ba-53c1905d302c\") " pod="openshift-console/console-c455f768d-2g4gp"
May 26 15:20:19.352149 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:20:19.352122    2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-c455f768d-2g4gp"
May 26 15:20:19.485183 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:20:19.485152    2581 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-c455f768d-2g4gp"]
May 26 15:20:19.488024 ip-10-0-140-164 kubenswrapper[2581]: W0526 15:20:19.487988    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod28f55293_5c36_419f_b5ba_53c1905d302c.slice/crio-3e4f0a53b44b9f26d7e98d20c1b8b9b1daab0e8df7f107a5eb4f6cf769098157 WatchSource:0}: Error finding container 3e4f0a53b44b9f26d7e98d20c1b8b9b1daab0e8df7f107a5eb4f6cf769098157: Status 404 returned error can't find the container with id 3e4f0a53b44b9f26d7e98d20c1b8b9b1daab0e8df7f107a5eb4f6cf769098157
May 26 15:20:19.652376 ip-10-0-140-164 kubenswrapper[2581]: E0526 15:20:19.652307    2581 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-npzrf" podUID="ae574985-4900-4b23-bf74-7c72c939f9bd"
May 26 15:20:20.057719 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:20:20.057688    2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-c455f768d-2g4gp" event={"ID":"28f55293-5c36-419f-b5ba-53c1905d302c","Type":"ContainerStarted","Data":"790e1705cfdda090fceb78c4ae7bee4519f75375f8e2a2194d82de03bae62d0d"}
May 26 15:20:20.058129 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:20:20.057723    2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-c455f768d-2g4gp" event={"ID":"28f55293-5c36-419f-b5ba-53c1905d302c","Type":"ContainerStarted","Data":"3e4f0a53b44b9f26d7e98d20c1b8b9b1daab0e8df7f107a5eb4f6cf769098157"}
May 26 15:20:20.084110 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:20:20.084066    2581 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-console/console-c455f768d-2g4gp" podStartSLOduration=1.084053002 podStartE2EDuration="1.084053002s" podCreationTimestamp="2026-05-26 15:20:19 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-26 15:20:20.083694536 +0000 UTC m=+159.081397869" watchObservedRunningTime="2026-05-26 15:20:20.084053002 +0000 UTC m=+159.081756333"
May 26 15:20:20.522136 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:20:20.522105    2581 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-b8c4b"]
May 26 15:20:20.525125 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:20:20.525105    2581 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-54fd6bc5c4-ktdc2"]
May 26 15:20:20.525318 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:20:20.525299    2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-b8c4b"
May 26 15:20:20.527543 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:20:20.527525    2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-ktdc2"
May 26 15:20:20.528124 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:20:20.528105    2581 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
May 26 15:20:20.528863 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:20:20.528834    2581 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
May 26 15:20:20.528967 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:20:20.528838    2581 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
May 26 15:20:20.528967 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:20:20.528882    2581 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
May 26 15:20:20.530533 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:20:20.529449    2581 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-2vq2q\""
May 26 15:20:20.532136 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:20:20.531319    2581 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
May 26 15:20:20.532987 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:20:20.532400    2581 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\""
May 26 15:20:20.532987 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:20:20.532676    2581 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
May 26 15:20:20.532987 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:20:20.532873    2581 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\""
May 26 15:20:20.534801 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:20:20.533211    2581 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-dhfzp\""
May 26 15:20:20.534801 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:20:20.533727    2581 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\""
May 26 15:20:20.552403 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:20:20.552378    2581 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-54fd6bc5c4-ktdc2"]
May 26 15:20:20.648430 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:20:20.648400    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/404ea169-f680-4d99-95f6-e080f07a8c1c-sys\") pod \"node-exporter-b8c4b\" (UID: \"404ea169-f680-4d99-95f6-e080f07a8c1c\") " pod="openshift-monitoring/node-exporter-b8c4b"
May 26 15:20:20.648430 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:20:20.648431    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/404ea169-f680-4d99-95f6-e080f07a8c1c-root\") pod \"node-exporter-b8c4b\" (UID: \"404ea169-f680-4d99-95f6-e080f07a8c1c\") " pod="openshift-monitoring/node-exporter-b8c4b"
May 26 15:20:20.648601 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:20:20.648455    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/404ea169-f680-4d99-95f6-e080f07a8c1c-metrics-client-ca\") pod \"node-exporter-b8c4b\" (UID: \"404ea169-f680-4d99-95f6-e080f07a8c1c\") " pod="openshift-monitoring/node-exporter-b8c4b"
May 26 15:20:20.648601 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:20:20.648511    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/404ea169-f680-4d99-95f6-e080f07a8c1c-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-b8c4b\" (UID: \"404ea169-f680-4d99-95f6-e080f07a8c1c\") " pod="openshift-monitoring/node-exporter-b8c4b"
May 26 15:20:20.648601 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:20:20.648542    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/b0344c87-ad7a-4941-83d8-af9aaba6a98d-kube-state-metrics-tls\") pod \"kube-state-metrics-54fd6bc5c4-ktdc2\" (UID: \"b0344c87-ad7a-4941-83d8-af9aaba6a98d\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-ktdc2"
May 26 15:20:20.648601 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:20:20.648594    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/b0344c87-ad7a-4941-83d8-af9aaba6a98d-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-54fd6bc5c4-ktdc2\" (UID: \"b0344c87-ad7a-4941-83d8-af9aaba6a98d\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-ktdc2"
May 26 15:20:20.648743 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:20:20.648611    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zvflb\" (UniqueName: \"kubernetes.io/projected/b0344c87-ad7a-4941-83d8-af9aaba6a98d-kube-api-access-zvflb\") pod \"kube-state-metrics-54fd6bc5c4-ktdc2\" (UID: \"b0344c87-ad7a-4941-83d8-af9aaba6a98d\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-ktdc2"
May 26 15:20:20.648743 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:20:20.648631    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/404ea169-f680-4d99-95f6-e080f07a8c1c-node-exporter-tls\") pod \"node-exporter-b8c4b\" (UID: \"404ea169-f680-4d99-95f6-e080f07a8c1c\") " pod="openshift-monitoring/node-exporter-b8c4b"
May 26 15:20:20.648743 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:20:20.648655    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b0344c87-ad7a-4941-83d8-af9aaba6a98d-metrics-client-ca\") pod \"kube-state-metrics-54fd6bc5c4-ktdc2\" (UID: \"b0344c87-ad7a-4941-83d8-af9aaba6a98d\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-ktdc2"
May 26 15:20:20.648743 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:20:20.648673    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/404ea169-f680-4d99-95f6-e080f07a8c1c-node-exporter-textfile\") pod \"node-exporter-b8c4b\" (UID: \"404ea169-f680-4d99-95f6-e080f07a8c1c\") " pod="openshift-monitoring/node-exporter-b8c4b"
May 26 15:20:20.648743 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:20:20.648687    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bh5lm\" (UniqueName: \"kubernetes.io/projected/404ea169-f680-4d99-95f6-e080f07a8c1c-kube-api-access-bh5lm\") pod \"node-exporter-b8c4b\" (UID: \"404ea169-f680-4d99-95f6-e080f07a8c1c\") " pod="openshift-monitoring/node-exporter-b8c4b"
May 26 15:20:20.648743 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:20:20.648706    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/b0344c87-ad7a-4941-83d8-af9aaba6a98d-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-54fd6bc5c4-ktdc2\" (UID: \"b0344c87-ad7a-4941-83d8-af9aaba6a98d\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-ktdc2"
May 26 15:20:20.648906 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:20:20.648780    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/404ea169-f680-4d99-95f6-e080f07a8c1c-node-exporter-wtmp\") pod \"node-exporter-b8c4b\" (UID: \"404ea169-f680-4d99-95f6-e080f07a8c1c\") " pod="openshift-monitoring/node-exporter-b8c4b"
May 26 15:20:20.648906 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:20:20.648817    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/b0344c87-ad7a-4941-83d8-af9aaba6a98d-volume-directive-shadow\") pod \"kube-state-metrics-54fd6bc5c4-ktdc2\" (UID: \"b0344c87-ad7a-4941-83d8-af9aaba6a98d\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-ktdc2"
May 26 15:20:20.648906 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:20:20.648851    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/404ea169-f680-4d99-95f6-e080f07a8c1c-node-exporter-accelerators-collector-config\") pod \"node-exporter-b8c4b\" (UID: \"404ea169-f680-4d99-95f6-e080f07a8c1c\") " pod="openshift-monitoring/node-exporter-b8c4b"
May 26 15:20:20.749431 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:20:20.749405    2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/b0344c87-ad7a-4941-83d8-af9aaba6a98d-kube-state-metrics-tls\") pod \"kube-state-metrics-54fd6bc5c4-ktdc2\" (UID: \"b0344c87-ad7a-4941-83d8-af9aaba6a98d\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-ktdc2"
May 26 15:20:20.749522 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:20:20.749448    2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/b0344c87-ad7a-4941-83d8-af9aaba6a98d-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-54fd6bc5c4-ktdc2\" (UID: \"b0344c87-ad7a-4941-83d8-af9aaba6a98d\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-ktdc2"
May 26 15:20:20.749522 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:20:20.749475    2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-zvflb\" (UniqueName: \"kubernetes.io/projected/b0344c87-ad7a-4941-83d8-af9aaba6a98d-kube-api-access-zvflb\") pod \"kube-state-metrics-54fd6bc5c4-ktdc2\" (UID: \"b0344c87-ad7a-4941-83d8-af9aaba6a98d\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-ktdc2"
May 26 15:20:20.749522 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:20:20.749502    2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/404ea169-f680-4d99-95f6-e080f07a8c1c-node-exporter-tls\") pod \"node-exporter-b8c4b\" (UID: \"404ea169-f680-4d99-95f6-e080f07a8c1c\") " pod="openshift-monitoring/node-exporter-b8c4b"
May 26 15:20:20.749682 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:20:20.749526    2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b0344c87-ad7a-4941-83d8-af9aaba6a98d-metrics-client-ca\") pod \"kube-state-metrics-54fd6bc5c4-ktdc2\" (UID: \"b0344c87-ad7a-4941-83d8-af9aaba6a98d\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-ktdc2"
May 26 15:20:20.749682 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:20:20.749585    2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/404ea169-f680-4d99-95f6-e080f07a8c1c-node-exporter-textfile\") pod \"node-exporter-b8c4b\" (UID: \"404ea169-f680-4d99-95f6-e080f07a8c1c\") " pod="openshift-monitoring/node-exporter-b8c4b"
May 26 15:20:20.749682 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:20:20.749618    2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-bh5lm\" (UniqueName: \"kubernetes.io/projected/404ea169-f680-4d99-95f6-e080f07a8c1c-kube-api-access-bh5lm\") pod \"node-exporter-b8c4b\" (UID: \"404ea169-f680-4d99-95f6-e080f07a8c1c\") " pod="openshift-monitoring/node-exporter-b8c4b"
May 26 15:20:20.749682 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:20:20.749652    2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/b0344c87-ad7a-4941-83d8-af9aaba6a98d-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-54fd6bc5c4-ktdc2\" (UID: \"b0344c87-ad7a-4941-83d8-af9aaba6a98d\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-ktdc2"
May 26 15:20:20.749873 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:20:20.749709    2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/404ea169-f680-4d99-95f6-e080f07a8c1c-node-exporter-wtmp\") pod \"node-exporter-b8c4b\" (UID: \"404ea169-f680-4d99-95f6-e080f07a8c1c\") " pod="openshift-monitoring/node-exporter-b8c4b"
May 26 15:20:20.749873 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:20:20.749738    2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/b0344c87-ad7a-4941-83d8-af9aaba6a98d-volume-directive-shadow\") pod \"kube-state-metrics-54fd6bc5c4-ktdc2\" (UID: \"b0344c87-ad7a-4941-83d8-af9aaba6a98d\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-ktdc2"
May 26 15:20:20.749873 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:20:20.749788    2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/404ea169-f680-4d99-95f6-e080f07a8c1c-node-exporter-accelerators-collector-config\") pod \"node-exporter-b8c4b\" (UID: \"404ea169-f680-4d99-95f6-e080f07a8c1c\") " pod="openshift-monitoring/node-exporter-b8c4b"
May 26 15:20:20.749873 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:20:20.749848    2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/404ea169-f680-4d99-95f6-e080f07a8c1c-sys\") pod \"node-exporter-b8c4b\" (UID: \"404ea169-f680-4d99-95f6-e080f07a8c1c\") " pod="openshift-monitoring/node-exporter-b8c4b"
May 26 15:20:20.750066 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:20:20.749885    2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/404ea169-f680-4d99-95f6-e080f07a8c1c-root\") pod \"node-exporter-b8c4b\" (UID: \"404ea169-f680-4d99-95f6-e080f07a8c1c\") " pod="openshift-monitoring/node-exporter-b8c4b"
May 26 15:20:20.750066 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:20:20.749936    2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/404ea169-f680-4d99-95f6-e080f07a8c1c-metrics-client-ca\") pod \"node-exporter-b8c4b\" (UID: \"404ea169-f680-4d99-95f6-e080f07a8c1c\") " pod="openshift-monitoring/node-exporter-b8c4b"
May 26 15:20:20.750066 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:20:20.749943    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/404ea169-f680-4d99-95f6-e080f07a8c1c-node-exporter-wtmp\") pod \"node-exporter-b8c4b\" (UID: \"404ea169-f680-4d99-95f6-e080f07a8c1c\") " pod="openshift-monitoring/node-exporter-b8c4b"
May 26 15:20:20.750066 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:20:20.750011    2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/404ea169-f680-4d99-95f6-e080f07a8c1c-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-b8c4b\" (UID: \"404ea169-f680-4d99-95f6-e080f07a8c1c\") " pod="openshift-monitoring/node-exporter-b8c4b"
May 26 15:20:20.750312 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:20:20.750264    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/b0344c87-ad7a-4941-83d8-af9aaba6a98d-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-54fd6bc5c4-ktdc2\" (UID: \"b0344c87-ad7a-4941-83d8-af9aaba6a98d\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-ktdc2"
May 26 15:20:20.750382 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:20:20.750363    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b0344c87-ad7a-4941-83d8-af9aaba6a98d-metrics-client-ca\") pod \"kube-state-metrics-54fd6bc5c4-ktdc2\" (UID: \"b0344c87-ad7a-4941-83d8-af9aaba6a98d\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-ktdc2"
May 26 15:20:20.750602 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:20:20.750584    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/404ea169-f680-4d99-95f6-e080f07a8c1c-metrics-client-ca\") pod \"node-exporter-b8c4b\" (UID: \"404ea169-f680-4d99-95f6-e080f07a8c1c\") " pod="openshift-monitoring/node-exporter-b8c4b"
May 26 15:20:20.750681 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:20:20.750671    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/404ea169-f680-4d99-95f6-e080f07a8c1c-sys\") pod \"node-exporter-b8c4b\" (UID: \"404ea169-f680-4d99-95f6-e080f07a8c1c\") " pod="openshift-monitoring/node-exporter-b8c4b"
May 26 15:20:20.750739 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:20:20.750719    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/404ea169-f680-4d99-95f6-e080f07a8c1c-root\") pod \"node-exporter-b8c4b\" (UID: \"404ea169-f680-4d99-95f6-e080f07a8c1c\") " pod="openshift-monitoring/node-exporter-b8c4b"
May 26 15:20:20.750786 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:20:20.750722    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/404ea169-f680-4d99-95f6-e080f07a8c1c-node-exporter-accelerators-collector-config\") pod \"node-exporter-b8c4b\" (UID: \"404ea169-f680-4d99-95f6-e080f07a8c1c\") " pod="openshift-monitoring/node-exporter-b8c4b"
May 26 15:20:20.750876 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:20:20.750852    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/b0344c87-ad7a-4941-83d8-af9aaba6a98d-volume-directive-shadow\") pod \"kube-state-metrics-54fd6bc5c4-ktdc2\" (UID: \"b0344c87-ad7a-4941-83d8-af9aaba6a98d\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-ktdc2"
May 26 15:20:20.751247 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:20:20.751224    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/404ea169-f680-4d99-95f6-e080f07a8c1c-node-exporter-textfile\") pod \"node-exporter-b8c4b\" (UID: \"404ea169-f680-4d99-95f6-e080f07a8c1c\") " pod="openshift-monitoring/node-exporter-b8c4b"
May 26 15:20:20.752455 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:20:20.752426    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/404ea169-f680-4d99-95f6-e080f07a8c1c-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-b8c4b\" (UID: \"404ea169-f680-4d99-95f6-e080f07a8c1c\") " pod="openshift-monitoring/node-exporter-b8c4b"
May 26 15:20:20.752690 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:20:20.752671    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/404ea169-f680-4d99-95f6-e080f07a8c1c-node-exporter-tls\") pod \"node-exporter-b8c4b\" (UID: \"404ea169-f680-4d99-95f6-e080f07a8c1c\") " pod="openshift-monitoring/node-exporter-b8c4b"
May 26 15:20:20.752782 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:20:20.752762    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/b0344c87-ad7a-4941-83d8-af9aaba6a98d-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-54fd6bc5c4-ktdc2\" (UID: \"b0344c87-ad7a-4941-83d8-af9aaba6a98d\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-ktdc2"
May 26 15:20:20.752846 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:20:20.752800    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/b0344c87-ad7a-4941-83d8-af9aaba6a98d-kube-state-metrics-tls\") pod \"kube-state-metrics-54fd6bc5c4-ktdc2\" (UID: \"b0344c87-ad7a-4941-83d8-af9aaba6a98d\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-ktdc2"
May 26 15:20:20.759142 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:20:20.759118    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bh5lm\" (UniqueName: \"kubernetes.io/projected/404ea169-f680-4d99-95f6-e080f07a8c1c-kube-api-access-bh5lm\") pod \"node-exporter-b8c4b\" (UID: \"404ea169-f680-4d99-95f6-e080f07a8c1c\") " pod="openshift-monitoring/node-exporter-b8c4b"
May 26 15:20:20.759403 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:20:20.759386    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zvflb\" (UniqueName: \"kubernetes.io/projected/b0344c87-ad7a-4941-83d8-af9aaba6a98d-kube-api-access-zvflb\") pod \"kube-state-metrics-54fd6bc5c4-ktdc2\" (UID: \"b0344c87-ad7a-4941-83d8-af9aaba6a98d\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-ktdc2"
May 26 15:20:20.842216 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:20:20.842168    2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-b8c4b"
May 26 15:20:20.846795 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:20:20.846774    2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-ktdc2"
May 26 15:20:20.851897 ip-10-0-140-164 kubenswrapper[2581]: W0526 15:20:20.851869    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod404ea169_f680_4d99_95f6_e080f07a8c1c.slice/crio-5c7d675077b0fb9edb466f7e63878b39d6636f152089f5a683f8ea518488f527 WatchSource:0}: Error finding container 5c7d675077b0fb9edb466f7e63878b39d6636f152089f5a683f8ea518488f527: Status 404 returned error can't find the container with id 5c7d675077b0fb9edb466f7e63878b39d6636f152089f5a683f8ea518488f527
May 26 15:20:20.978364 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:20:20.978336    2581 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-54fd6bc5c4-ktdc2"]
May 26 15:20:20.981185 ip-10-0-140-164 kubenswrapper[2581]: W0526 15:20:20.981162    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb0344c87_ad7a_4941_83d8_af9aaba6a98d.slice/crio-f80a4c690929f16ba0b2ae180cfcb8165215b65bc239a410f0f88ba4afd0c16c WatchSource:0}: Error finding container f80a4c690929f16ba0b2ae180cfcb8165215b65bc239a410f0f88ba4afd0c16c: Status 404 returned error can't find the container with id f80a4c690929f16ba0b2ae180cfcb8165215b65bc239a410f0f88ba4afd0c16c
May 26 15:20:21.061313 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:20:21.061263    2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-ktdc2" event={"ID":"b0344c87-ad7a-4941-83d8-af9aaba6a98d","Type":"ContainerStarted","Data":"f80a4c690929f16ba0b2ae180cfcb8165215b65bc239a410f0f88ba4afd0c16c"}
May 26 15:20:21.062245 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:20:21.062222    2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-b8c4b" event={"ID":"404ea169-f680-4d99-95f6-e080f07a8c1c","Type":"ContainerStarted","Data":"5c7d675077b0fb9edb466f7e63878b39d6636f152089f5a683f8ea518488f527"}
May 26 15:20:21.164902 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:20:21.164841    2581 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-bc69b9575-wpg95"
May 26 15:20:21.164902 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:20:21.164888    2581 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-bc69b9575-wpg95"
May 26 15:20:21.169337 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:20:21.169319    2581 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-bc69b9575-wpg95"
May 26 15:20:22.067394 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:20:22.067362    2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-b8c4b" event={"ID":"404ea169-f680-4d99-95f6-e080f07a8c1c","Type":"ContainerStarted","Data":"2bd6b1abdd67d069f2f0757fbdb45c6d0921dda1d5aa77be4a69011d78253e26"}
May 26 15:20:22.071190 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:20:22.071168    2581 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-bc69b9575-wpg95"
May 26 15:20:22.871504 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:20:22.871467    2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/676b1633-43dc-4fe0-bf8b-5f8247a3e6e2-registry-tls\") pod \"image-registry-797775bcb5-x7sns\" (UID: \"676b1633-43dc-4fe0-bf8b-5f8247a3e6e2\") " pod="openshift-image-registry/image-registry-797775bcb5-x7sns"
May 26 15:20:22.871658 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:20:22.871609    2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/37c203f3-fea7-4b18-a713-d805bf7dd8d9-cert\") pod \"ingress-canary-kgzwq\" (UID: \"37c203f3-fea7-4b18-a713-d805bf7dd8d9\") " pod="openshift-ingress-canary/ingress-canary-kgzwq"
May 26 15:20:22.873999 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:20:22.873968    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/676b1633-43dc-4fe0-bf8b-5f8247a3e6e2-registry-tls\") pod \"image-registry-797775bcb5-x7sns\" (UID: \"676b1633-43dc-4fe0-bf8b-5f8247a3e6e2\") " pod="openshift-image-registry/image-registry-797775bcb5-x7sns"
May 26 15:20:22.874117 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:20:22.874090    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/37c203f3-fea7-4b18-a713-d805bf7dd8d9-cert\") pod \"ingress-canary-kgzwq\" (UID: \"37c203f3-fea7-4b18-a713-d805bf7dd8d9\") " pod="openshift-ingress-canary/ingress-canary-kgzwq"
May 26 15:20:22.972473 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:20:22.972442    2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c1324645-ef27-41da-851e-615da7eab3b0-metrics-tls\") pod \"dns-default-l4rks\" (UID: \"c1324645-ef27-41da-851e-615da7eab3b0\") " pod="openshift-dns/dns-default-l4rks"
May 26 15:20:22.974724 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:20:22.974707    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c1324645-ef27-41da-851e-615da7eab3b0-metrics-tls\") pod \"dns-default-l4rks\" (UID: \"c1324645-ef27-41da-851e-615da7eab3b0\") " pod="openshift-dns/dns-default-l4rks"
May 26 15:20:23.071506 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:20:23.071478    2581 generic.go:358] "Generic (PLEG): container finished" podID="404ea169-f680-4d99-95f6-e080f07a8c1c" containerID="2bd6b1abdd67d069f2f0757fbdb45c6d0921dda1d5aa77be4a69011d78253e26" exitCode=0
May 26 15:20:23.071905 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:20:23.071565    2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-b8c4b" event={"ID":"404ea169-f680-4d99-95f6-e080f07a8c1c","Type":"ContainerDied","Data":"2bd6b1abdd67d069f2f0757fbdb45c6d0921dda1d5aa77be4a69011d78253e26"}
May 26 15:20:23.073478 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:20:23.073456    2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-ktdc2" event={"ID":"b0344c87-ad7a-4941-83d8-af9aaba6a98d","Type":"ContainerStarted","Data":"97cb458154b50900f2b8365ea01c8b01856770e6b8cd255fc6bb22efec2884fa"}
May 26 15:20:23.073568 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:20:23.073483    2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-ktdc2" event={"ID":"b0344c87-ad7a-4941-83d8-af9aaba6a98d","Type":"ContainerStarted","Data":"7879a15a9853958f1cc72d65f5ca087f9c17195b0e934ba112382532e69ef929"}
May 26 15:20:23.073568 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:20:23.073493    2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-ktdc2" event={"ID":"b0344c87-ad7a-4941-83d8-af9aaba6a98d","Type":"ContainerStarted","Data":"5f896fcc63e1e1128c964ef5a636c40d60f1370db10142a1a546677e64e9f5d9"}
May 26 15:20:23.116541 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:20:23.116504    2581 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-ktdc2" podStartSLOduration=1.721770824 podStartE2EDuration="3.116491591s" podCreationTimestamp="2026-05-26 15:20:20 +0000 UTC" firstStartedPulling="2026-05-26 15:20:20.982948742 +0000 UTC m=+159.980652052" lastFinishedPulling="2026-05-26 15:20:22.377669508 +0000 UTC m=+161.375372819" observedRunningTime="2026-05-26 15:20:23.116041544 +0000 UTC m=+162.113744878" watchObservedRunningTime="2026-05-26 15:20:23.116491591 +0000 UTC m=+162.114194923"
May 26 15:20:23.154927 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:20:23.154902    2581 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-kdpdq\""
May 26 15:20:23.155049 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:20:23.155029    2581 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-m8xk4\""
May 26 15:20:23.155123 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:20:23.155099    2581 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-lcntx\""
May 26 15:20:23.163336 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:20:23.163307    2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-l4rks"
May 26 15:20:23.163435 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:20:23.163370    2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-797775bcb5-x7sns"
May 26 15:20:23.163486 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:20:23.163453    2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-kgzwq"
May 26 15:20:23.314630 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:20:23.314578    2581 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-l4rks"]
May 26 15:20:23.320528 ip-10-0-140-164 kubenswrapper[2581]: W0526 15:20:23.320492    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc1324645_ef27_41da_851e_615da7eab3b0.slice/crio-4f431d3ea872a5685e8d159ff3d3a3ed3cff435ad0597c1744626ae6c9e9c5f7 WatchSource:0}: Error finding container 4f431d3ea872a5685e8d159ff3d3a3ed3cff435ad0597c1744626ae6c9e9c5f7: Status 404 returned error can't find the container with id 4f431d3ea872a5685e8d159ff3d3a3ed3cff435ad0597c1744626ae6c9e9c5f7
May 26 15:20:23.538226 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:20:23.538136    2581 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-kgzwq"]
May 26 15:20:23.540401 ip-10-0-140-164 kubenswrapper[2581]: W0526 15:20:23.540371    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod37c203f3_fea7_4b18_a713_d805bf7dd8d9.slice/crio-26fa99d49595c0b31b184bf7916e11f465e433e132ef75522e081760477bf69f WatchSource:0}: Error finding container 26fa99d49595c0b31b184bf7916e11f465e433e132ef75522e081760477bf69f: Status 404 returned error can't find the container with id 26fa99d49595c0b31b184bf7916e11f465e433e132ef75522e081760477bf69f
May 26 15:20:23.544788 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:20:23.544687    2581 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-797775bcb5-x7sns"]
May 26 15:20:23.551553 ip-10-0-140-164 kubenswrapper[2581]: W0526 15:20:23.551520    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod676b1633_43dc_4fe0_bf8b_5f8247a3e6e2.slice/crio-a0f22bca26565d11449a7991adb881f0b85d0e34e268013aa1a3aa7ca12b694a WatchSource:0}: Error finding container a0f22bca26565d11449a7991adb881f0b85d0e34e268013aa1a3aa7ca12b694a: Status 404 returned error can't find the container with id a0f22bca26565d11449a7991adb881f0b85d0e34e268013aa1a3aa7ca12b694a
May 26 15:20:24.078959 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:20:24.078923    2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-kgzwq" event={"ID":"37c203f3-fea7-4b18-a713-d805bf7dd8d9","Type":"ContainerStarted","Data":"26fa99d49595c0b31b184bf7916e11f465e433e132ef75522e081760477bf69f"}
May 26 15:20:24.081523 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:20:24.081375    2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-797775bcb5-x7sns" event={"ID":"676b1633-43dc-4fe0-bf8b-5f8247a3e6e2","Type":"ContainerStarted","Data":"06ce511e4a972ff24e911e6044034d916e045d93cac3a6a8987d4e564ae829c0"}
May 26 15:20:24.081523 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:20:24.081409    2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-797775bcb5-x7sns" event={"ID":"676b1633-43dc-4fe0-bf8b-5f8247a3e6e2","Type":"ContainerStarted","Data":"a0f22bca26565d11449a7991adb881f0b85d0e34e268013aa1a3aa7ca12b694a"}
May 26 15:20:24.082340 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:20:24.082157    2581 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-797775bcb5-x7sns"
May 26 15:20:24.083740 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:20:24.083715    2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-l4rks" event={"ID":"c1324645-ef27-41da-851e-615da7eab3b0","Type":"ContainerStarted","Data":"4f431d3ea872a5685e8d159ff3d3a3ed3cff435ad0597c1744626ae6c9e9c5f7"}
May 26 15:20:24.086566 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:20:24.086531    2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-b8c4b" event={"ID":"404ea169-f680-4d99-95f6-e080f07a8c1c","Type":"ContainerStarted","Data":"72b78d78564ee720f8ece8169168455c5b1c0785c3679713703278fc748f3d44"}
May 26 15:20:24.086693 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:20:24.086577    2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-b8c4b" event={"ID":"404ea169-f680-4d99-95f6-e080f07a8c1c","Type":"ContainerStarted","Data":"b07b47b688b907b840c73f7f7de33fac5ee7b2409f4717cdf7e1eee608698b22"}
May 26 15:20:24.104822 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:20:24.104601    2581 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-image-registry/image-registry-797775bcb5-x7sns" podStartSLOduration=162.104585328 podStartE2EDuration="2m42.104585328s" podCreationTimestamp="2026-05-26 15:17:42 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-26 15:20:24.104426478 +0000 UTC m=+163.102129812" watchObservedRunningTime="2026-05-26 15:20:24.104585328 +0000 UTC m=+163.102288663"
May 26 15:20:24.127648 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:20:24.127597    2581 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-b8c4b" podStartSLOduration=3.114933352 podStartE2EDuration="4.127581558s" podCreationTimestamp="2026-05-26 15:20:20 +0000 UTC" firstStartedPulling="2026-05-26 15:20:20.853568819 +0000 UTC m=+159.851272130" lastFinishedPulling="2026-05-26 15:20:21.86621701 +0000 UTC m=+160.863920336" observedRunningTime="2026-05-26 15:20:24.127434551 +0000 UTC m=+163.125137884" watchObservedRunningTime="2026-05-26 15:20:24.127581558 +0000 UTC m=+163.125284903"
May 26 15:20:25.090562 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:20:25.090483    2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-l4rks" event={"ID":"c1324645-ef27-41da-851e-615da7eab3b0","Type":"ContainerStarted","Data":"2bf2c581f0f2bec238a74e9d72c3460cd5b40ae4cd8e1951d112b4d960965154"}
May 26 15:20:25.090562 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:20:25.090528    2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-l4rks" event={"ID":"c1324645-ef27-41da-851e-615da7eab3b0","Type":"ContainerStarted","Data":"c0dd4eb3349e4af3e26524d572a0bd27f940f4b21278413c07bd7f50e8608023"}
May 26 15:20:25.110915 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:20:25.110873    2581 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-dns/dns-default-l4rks" podStartSLOduration=129.682554306 podStartE2EDuration="2m11.11086067s" podCreationTimestamp="2026-05-26 15:18:14 +0000 UTC" firstStartedPulling="2026-05-26 15:20:23.322375029 +0000 UTC m=+162.320078345" lastFinishedPulling="2026-05-26 15:20:24.750681398 +0000 UTC m=+163.748384709" observedRunningTime="2026-05-26 15:20:25.109037209 +0000 UTC m=+164.106740540" watchObservedRunningTime="2026-05-26 15:20:25.11086067 +0000 UTC m=+164.108564001"
May 26 15:20:25.318798 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:20:25.318764    2581 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-665c9c8584-j84dx"]
May 26 15:20:25.321092 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:20:25.321069    2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-665c9c8584-j84dx"
May 26 15:20:25.324853 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:20:25.324385    2581 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\""
May 26 15:20:25.324853 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:20:25.324432    2581 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"default-dockercfg-vmxf6\""
May 26 15:20:25.329995 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:20:25.329966    2581 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-665c9c8584-j84dx"]
May 26 15:20:25.396811 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:20:25.396738    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/026e0a6c-81b3-491b-814d-e995000a1f31-monitoring-plugin-cert\") pod \"monitoring-plugin-665c9c8584-j84dx\" (UID: \"026e0a6c-81b3-491b-814d-e995000a1f31\") " pod="openshift-monitoring/monitoring-plugin-665c9c8584-j84dx"
May 26 15:20:25.497873 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:20:25.497836    2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/026e0a6c-81b3-491b-814d-e995000a1f31-monitoring-plugin-cert\") pod \"monitoring-plugin-665c9c8584-j84dx\" (UID: \"026e0a6c-81b3-491b-814d-e995000a1f31\") " pod="openshift-monitoring/monitoring-plugin-665c9c8584-j84dx"
May 26 15:20:25.501848 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:20:25.501795    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/026e0a6c-81b3-491b-814d-e995000a1f31-monitoring-plugin-cert\") pod \"monitoring-plugin-665c9c8584-j84dx\" (UID: \"026e0a6c-81b3-491b-814d-e995000a1f31\") " pod="openshift-monitoring/monitoring-plugin-665c9c8584-j84dx"
May 26 15:20:25.635851 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:20:25.635816    2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-665c9c8584-j84dx"
May 26 15:20:25.855216 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:20:25.855188    2581 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-665c9c8584-j84dx"]
May 26 15:20:25.858169 ip-10-0-140-164 kubenswrapper[2581]: W0526 15:20:25.858142    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod026e0a6c_81b3_491b_814d_e995000a1f31.slice/crio-d5b538cb105ccdcdbb96c4eb397e9597921f2d2b719b7d1ac7dd357d2aeb2ab4 WatchSource:0}: Error finding container d5b538cb105ccdcdbb96c4eb397e9597921f2d2b719b7d1ac7dd357d2aeb2ab4: Status 404 returned error can't find the container with id d5b538cb105ccdcdbb96c4eb397e9597921f2d2b719b7d1ac7dd357d2aeb2ab4
May 26 15:20:26.094596 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:20:26.094562    2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-kgzwq" event={"ID":"37c203f3-fea7-4b18-a713-d805bf7dd8d9","Type":"ContainerStarted","Data":"a467a03c54b5512184768aca9e2910c3d430303fb47037ec0b25c93df57eb5a6"}
May 26 15:20:26.095659 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:20:26.095634    2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-665c9c8584-j84dx" event={"ID":"026e0a6c-81b3-491b-814d-e995000a1f31","Type":"ContainerStarted","Data":"d5b538cb105ccdcdbb96c4eb397e9597921f2d2b719b7d1ac7dd357d2aeb2ab4"}
May 26 15:20:26.095957 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:20:26.095934    2581 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-l4rks"
May 26 15:20:26.113146 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:20:26.113107    2581 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-kgzwq" podStartSLOduration=129.886868237 podStartE2EDuration="2m12.113093248s" podCreationTimestamp="2026-05-26 15:18:14 +0000 UTC" firstStartedPulling="2026-05-26 15:20:23.542497071 +0000 UTC m=+162.540200395" lastFinishedPulling="2026-05-26 15:20:25.768722095 +0000 UTC m=+164.766425406" observedRunningTime="2026-05-26 15:20:26.112364073 +0000 UTC m=+165.110067417" watchObservedRunningTime="2026-05-26 15:20:26.113093248 +0000 UTC m=+165.110796574"
May 26 15:20:26.946854 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:20:26.946817    2581 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-c455f768d-2g4gp"]
May 26 15:20:27.556007 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:20:27.555975    2581 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-797775bcb5-x7sns"]
May 26 15:20:28.102556 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:20:28.102515    2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-665c9c8584-j84dx" event={"ID":"026e0a6c-81b3-491b-814d-e995000a1f31","Type":"ContainerStarted","Data":"f01bea18a8ee17acb02898c2a60908f04b7ef7c07cb22fca3b72872257bea346"}
May 26 15:20:28.102787 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:20:28.102771    2581 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-665c9c8584-j84dx"
May 26 15:20:28.108032 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:20:28.108009    2581 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-665c9c8584-j84dx"
May 26 15:20:28.119956 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:20:28.119915    2581 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-665c9c8584-j84dx" podStartSLOduration=1.790924889 podStartE2EDuration="3.119902842s" podCreationTimestamp="2026-05-26 15:20:25 +0000 UTC" firstStartedPulling="2026-05-26 15:20:25.861365587 +0000 UTC m=+164.859068896" lastFinishedPulling="2026-05-26 15:20:27.190343525 +0000 UTC m=+166.188046849" observedRunningTime="2026-05-26 15:20:28.119007205 +0000 UTC m=+167.116710553" watchObservedRunningTime="2026-05-26 15:20:28.119902842 +0000 UTC m=+167.117606174"
May 26 15:20:29.352355 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:20:29.352322    2581 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-c455f768d-2g4gp"
May 26 15:20:31.642375 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:20:31.641546    2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-npzrf"
May 26 15:20:36.101787 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:20:36.101753    2581 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-l4rks"
May 26 15:20:37.751827 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:20:37.751794    2581 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-bc69b9575-wpg95"]
May 26 15:20:47.562707 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:20:47.562674    2581 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-797775bcb5-x7sns"
May 26 15:20:51.968597 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:20:51.968547    2581 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-console/console-c455f768d-2g4gp" podUID="28f55293-5c36-419f-b5ba-53c1905d302c" containerName="console" containerID="cri-o://790e1705cfdda090fceb78c4ae7bee4519f75375f8e2a2194d82de03bae62d0d" gracePeriod=15
May 26 15:20:52.172573 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:20:52.172551    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-c455f768d-2g4gp_28f55293-5c36-419f-b5ba-53c1905d302c/console/0.log"
May 26 15:20:52.172693 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:20:52.172587    2581 generic.go:358] "Generic (PLEG): container finished" podID="28f55293-5c36-419f-b5ba-53c1905d302c" containerID="790e1705cfdda090fceb78c4ae7bee4519f75375f8e2a2194d82de03bae62d0d" exitCode=2
May 26 15:20:52.172693 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:20:52.172618    2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-c455f768d-2g4gp" event={"ID":"28f55293-5c36-419f-b5ba-53c1905d302c","Type":"ContainerDied","Data":"790e1705cfdda090fceb78c4ae7bee4519f75375f8e2a2194d82de03bae62d0d"}
May 26 15:20:52.207953 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:20:52.207935    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-c455f768d-2g4gp_28f55293-5c36-419f-b5ba-53c1905d302c/console/0.log"
May 26 15:20:52.208052 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:20:52.208000    2581 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-c455f768d-2g4gp"
May 26 15:20:52.287227 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:20:52.287200    2581 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/28f55293-5c36-419f-b5ba-53c1905d302c-console-oauth-config\") pod \"28f55293-5c36-419f-b5ba-53c1905d302c\" (UID: \"28f55293-5c36-419f-b5ba-53c1905d302c\") "
May 26 15:20:52.287375 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:20:52.287237    2581 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dpchx\" (UniqueName: \"kubernetes.io/projected/28f55293-5c36-419f-b5ba-53c1905d302c-kube-api-access-dpchx\") pod \"28f55293-5c36-419f-b5ba-53c1905d302c\" (UID: \"28f55293-5c36-419f-b5ba-53c1905d302c\") "
May 26 15:20:52.287375 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:20:52.287284    2581 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/28f55293-5c36-419f-b5ba-53c1905d302c-console-serving-cert\") pod \"28f55293-5c36-419f-b5ba-53c1905d302c\" (UID: \"28f55293-5c36-419f-b5ba-53c1905d302c\") "
May 26 15:20:52.287375 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:20:52.287320    2581 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/28f55293-5c36-419f-b5ba-53c1905d302c-oauth-serving-cert\") pod \"28f55293-5c36-419f-b5ba-53c1905d302c\" (UID: \"28f55293-5c36-419f-b5ba-53c1905d302c\") "
May 26 15:20:52.287375 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:20:52.287341    2581 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/28f55293-5c36-419f-b5ba-53c1905d302c-service-ca\") pod \"28f55293-5c36-419f-b5ba-53c1905d302c\" (UID: \"28f55293-5c36-419f-b5ba-53c1905d302c\") "
May 26 15:20:52.287375 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:20:52.287360    2581 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/28f55293-5c36-419f-b5ba-53c1905d302c-console-config\") pod \"28f55293-5c36-419f-b5ba-53c1905d302c\" (UID: \"28f55293-5c36-419f-b5ba-53c1905d302c\") "
May 26 15:20:52.287375 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:20:52.287377    2581 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/28f55293-5c36-419f-b5ba-53c1905d302c-trusted-ca-bundle\") pod \"28f55293-5c36-419f-b5ba-53c1905d302c\" (UID: \"28f55293-5c36-419f-b5ba-53c1905d302c\") "
May 26 15:20:52.287846 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:20:52.287812    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/28f55293-5c36-419f-b5ba-53c1905d302c-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "28f55293-5c36-419f-b5ba-53c1905d302c" (UID: "28f55293-5c36-419f-b5ba-53c1905d302c"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 26 15:20:52.288041 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:20:52.287860    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/28f55293-5c36-419f-b5ba-53c1905d302c-console-config" (OuterVolumeSpecName: "console-config") pod "28f55293-5c36-419f-b5ba-53c1905d302c" (UID: "28f55293-5c36-419f-b5ba-53c1905d302c"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 26 15:20:52.288041 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:20:52.287857    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/28f55293-5c36-419f-b5ba-53c1905d302c-service-ca" (OuterVolumeSpecName: "service-ca") pod "28f55293-5c36-419f-b5ba-53c1905d302c" (UID: "28f55293-5c36-419f-b5ba-53c1905d302c"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 26 15:20:52.288041 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:20:52.287920    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/28f55293-5c36-419f-b5ba-53c1905d302c-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "28f55293-5c36-419f-b5ba-53c1905d302c" (UID: "28f55293-5c36-419f-b5ba-53c1905d302c"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 26 15:20:52.289520 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:20:52.289498    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/28f55293-5c36-419f-b5ba-53c1905d302c-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "28f55293-5c36-419f-b5ba-53c1905d302c" (UID: "28f55293-5c36-419f-b5ba-53c1905d302c"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 26 15:20:52.290015 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:20:52.289987    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/28f55293-5c36-419f-b5ba-53c1905d302c-kube-api-access-dpchx" (OuterVolumeSpecName: "kube-api-access-dpchx") pod "28f55293-5c36-419f-b5ba-53c1905d302c" (UID: "28f55293-5c36-419f-b5ba-53c1905d302c"). InnerVolumeSpecName "kube-api-access-dpchx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 26 15:20:52.290015 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:20:52.290005    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/28f55293-5c36-419f-b5ba-53c1905d302c-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "28f55293-5c36-419f-b5ba-53c1905d302c" (UID: "28f55293-5c36-419f-b5ba-53c1905d302c"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 26 15:20:52.388105 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:20:52.388075    2581 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/28f55293-5c36-419f-b5ba-53c1905d302c-service-ca\") on node \"ip-10-0-140-164.ec2.internal\" DevicePath \"\""
May 26 15:20:52.388105 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:20:52.388105    2581 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/28f55293-5c36-419f-b5ba-53c1905d302c-console-config\") on node \"ip-10-0-140-164.ec2.internal\" DevicePath \"\""
May 26 15:20:52.388221 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:20:52.388114    2581 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/28f55293-5c36-419f-b5ba-53c1905d302c-trusted-ca-bundle\") on node \"ip-10-0-140-164.ec2.internal\" DevicePath \"\""
May 26 15:20:52.388221 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:20:52.388124    2581 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/28f55293-5c36-419f-b5ba-53c1905d302c-console-oauth-config\") on node \"ip-10-0-140-164.ec2.internal\" DevicePath \"\""
May 26 15:20:52.388221 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:20:52.388133    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dpchx\" (UniqueName: \"kubernetes.io/projected/28f55293-5c36-419f-b5ba-53c1905d302c-kube-api-access-dpchx\") on node \"ip-10-0-140-164.ec2.internal\" DevicePath \"\""
May 26 15:20:52.388221 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:20:52.388142    2581 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/28f55293-5c36-419f-b5ba-53c1905d302c-console-serving-cert\") on node \"ip-10-0-140-164.ec2.internal\" DevicePath \"\""
May 26 15:20:52.388221 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:20:52.388151    2581 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/28f55293-5c36-419f-b5ba-53c1905d302c-oauth-serving-cert\") on node \"ip-10-0-140-164.ec2.internal\" DevicePath \"\""
May 26 15:20:52.575200 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:20:52.575128    2581 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-image-registry/image-registry-797775bcb5-x7sns" podUID="676b1633-43dc-4fe0-bf8b-5f8247a3e6e2" containerName="registry" containerID="cri-o://06ce511e4a972ff24e911e6044034d916e045d93cac3a6a8987d4e564ae829c0" gracePeriod=30
May 26 15:20:52.796323 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:20:52.796245    2581 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-797775bcb5-x7sns"
May 26 15:20:52.892509 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:20:52.892447    2581 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/676b1633-43dc-4fe0-bf8b-5f8247a3e6e2-trusted-ca\") pod \"676b1633-43dc-4fe0-bf8b-5f8247a3e6e2\" (UID: \"676b1633-43dc-4fe0-bf8b-5f8247a3e6e2\") "
May 26 15:20:52.892509 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:20:52.892493    2581 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/676b1633-43dc-4fe0-bf8b-5f8247a3e6e2-registry-certificates\") pod \"676b1633-43dc-4fe0-bf8b-5f8247a3e6e2\" (UID: \"676b1633-43dc-4fe0-bf8b-5f8247a3e6e2\") "
May 26 15:20:52.892693 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:20:52.892518    2581 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/676b1633-43dc-4fe0-bf8b-5f8247a3e6e2-bound-sa-token\") pod \"676b1633-43dc-4fe0-bf8b-5f8247a3e6e2\" (UID: \"676b1633-43dc-4fe0-bf8b-5f8247a3e6e2\") "
May 26 15:20:52.892693 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:20:52.892554    2581 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/676b1633-43dc-4fe0-bf8b-5f8247a3e6e2-image-registry-private-configuration\") pod \"676b1633-43dc-4fe0-bf8b-5f8247a3e6e2\" (UID: \"676b1633-43dc-4fe0-bf8b-5f8247a3e6e2\") "
May 26 15:20:52.892693 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:20:52.892586    2581 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/676b1633-43dc-4fe0-bf8b-5f8247a3e6e2-ca-trust-extracted\") pod \"676b1633-43dc-4fe0-bf8b-5f8247a3e6e2\" (UID: \"676b1633-43dc-4fe0-bf8b-5f8247a3e6e2\") "
May 26 15:20:52.892693 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:20:52.892651    2581 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/676b1633-43dc-4fe0-bf8b-5f8247a3e6e2-installation-pull-secrets\") pod \"676b1633-43dc-4fe0-bf8b-5f8247a3e6e2\" (UID: \"676b1633-43dc-4fe0-bf8b-5f8247a3e6e2\") "
May 26 15:20:52.892870 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:20:52.892744    2581 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8l2zf\" (UniqueName: \"kubernetes.io/projected/676b1633-43dc-4fe0-bf8b-5f8247a3e6e2-kube-api-access-8l2zf\") pod \"676b1633-43dc-4fe0-bf8b-5f8247a3e6e2\" (UID: \"676b1633-43dc-4fe0-bf8b-5f8247a3e6e2\") "
May 26 15:20:52.892870 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:20:52.892828    2581 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/676b1633-43dc-4fe0-bf8b-5f8247a3e6e2-registry-tls\") pod \"676b1633-43dc-4fe0-bf8b-5f8247a3e6e2\" (UID: \"676b1633-43dc-4fe0-bf8b-5f8247a3e6e2\") "
May 26 15:20:52.892973 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:20:52.892922    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/676b1633-43dc-4fe0-bf8b-5f8247a3e6e2-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "676b1633-43dc-4fe0-bf8b-5f8247a3e6e2" (UID: "676b1633-43dc-4fe0-bf8b-5f8247a3e6e2"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 26 15:20:52.893025 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:20:52.892962    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/676b1633-43dc-4fe0-bf8b-5f8247a3e6e2-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "676b1633-43dc-4fe0-bf8b-5f8247a3e6e2" (UID: "676b1633-43dc-4fe0-bf8b-5f8247a3e6e2"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 26 15:20:52.893129 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:20:52.893106    2581 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/676b1633-43dc-4fe0-bf8b-5f8247a3e6e2-trusted-ca\") on node \"ip-10-0-140-164.ec2.internal\" DevicePath \"\""
May 26 15:20:52.893183 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:20:52.893130    2581 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/676b1633-43dc-4fe0-bf8b-5f8247a3e6e2-registry-certificates\") on node \"ip-10-0-140-164.ec2.internal\" DevicePath \"\""
May 26 15:20:52.895094 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:20:52.895060    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/676b1633-43dc-4fe0-bf8b-5f8247a3e6e2-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "676b1633-43dc-4fe0-bf8b-5f8247a3e6e2" (UID: "676b1633-43dc-4fe0-bf8b-5f8247a3e6e2"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 26 15:20:52.895295 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:20:52.895253    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/676b1633-43dc-4fe0-bf8b-5f8247a3e6e2-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "676b1633-43dc-4fe0-bf8b-5f8247a3e6e2" (UID: "676b1633-43dc-4fe0-bf8b-5f8247a3e6e2"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 26 15:20:52.895353 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:20:52.895302    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/676b1633-43dc-4fe0-bf8b-5f8247a3e6e2-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "676b1633-43dc-4fe0-bf8b-5f8247a3e6e2" (UID: "676b1633-43dc-4fe0-bf8b-5f8247a3e6e2"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 26 15:20:52.895521 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:20:52.895494    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/676b1633-43dc-4fe0-bf8b-5f8247a3e6e2-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "676b1633-43dc-4fe0-bf8b-5f8247a3e6e2" (UID: "676b1633-43dc-4fe0-bf8b-5f8247a3e6e2"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 26 15:20:52.895627 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:20:52.895605    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/676b1633-43dc-4fe0-bf8b-5f8247a3e6e2-kube-api-access-8l2zf" (OuterVolumeSpecName: "kube-api-access-8l2zf") pod "676b1633-43dc-4fe0-bf8b-5f8247a3e6e2" (UID: "676b1633-43dc-4fe0-bf8b-5f8247a3e6e2"). InnerVolumeSpecName "kube-api-access-8l2zf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 26 15:20:52.900849 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:20:52.900828    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/676b1633-43dc-4fe0-bf8b-5f8247a3e6e2-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "676b1633-43dc-4fe0-bf8b-5f8247a3e6e2" (UID: "676b1633-43dc-4fe0-bf8b-5f8247a3e6e2"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 26 15:20:52.993462 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:20:52.993437    2581 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/676b1633-43dc-4fe0-bf8b-5f8247a3e6e2-bound-sa-token\") on node \"ip-10-0-140-164.ec2.internal\" DevicePath \"\""
May 26 15:20:52.993462 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:20:52.993461    2581 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/676b1633-43dc-4fe0-bf8b-5f8247a3e6e2-image-registry-private-configuration\") on node \"ip-10-0-140-164.ec2.internal\" DevicePath \"\""
May 26 15:20:52.993737 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:20:52.993471    2581 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/676b1633-43dc-4fe0-bf8b-5f8247a3e6e2-ca-trust-extracted\") on node \"ip-10-0-140-164.ec2.internal\" DevicePath \"\""
May 26 15:20:52.993737 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:20:52.993482    2581 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/676b1633-43dc-4fe0-bf8b-5f8247a3e6e2-installation-pull-secrets\") on node \"ip-10-0-140-164.ec2.internal\" DevicePath \"\""
May 26 15:20:52.993737 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:20:52.993491    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8l2zf\" (UniqueName: \"kubernetes.io/projected/676b1633-43dc-4fe0-bf8b-5f8247a3e6e2-kube-api-access-8l2zf\") on node \"ip-10-0-140-164.ec2.internal\" DevicePath \"\""
May 26 15:20:52.993737 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:20:52.993500    2581 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/676b1633-43dc-4fe0-bf8b-5f8247a3e6e2-registry-tls\") on node \"ip-10-0-140-164.ec2.internal\" DevicePath \"\""
May 26 15:20:53.176722 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:20:53.176670    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-c455f768d-2g4gp_28f55293-5c36-419f-b5ba-53c1905d302c/console/0.log"
May 26 15:20:53.176813 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:20:53.176793    2581 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-c455f768d-2g4gp"
May 26 15:20:53.176864 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:20:53.176807    2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-c455f768d-2g4gp" event={"ID":"28f55293-5c36-419f-b5ba-53c1905d302c","Type":"ContainerDied","Data":"3e4f0a53b44b9f26d7e98d20c1b8b9b1daab0e8df7f107a5eb4f6cf769098157"}
May 26 15:20:53.176864 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:20:53.176858    2581 scope.go:117] "RemoveContainer" containerID="790e1705cfdda090fceb78c4ae7bee4519f75375f8e2a2194d82de03bae62d0d"
May 26 15:20:53.178166 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:20:53.177949    2581 generic.go:358] "Generic (PLEG): container finished" podID="676b1633-43dc-4fe0-bf8b-5f8247a3e6e2" containerID="06ce511e4a972ff24e911e6044034d916e045d93cac3a6a8987d4e564ae829c0" exitCode=0
May 26 15:20:53.178166 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:20:53.177992    2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-797775bcb5-x7sns" event={"ID":"676b1633-43dc-4fe0-bf8b-5f8247a3e6e2","Type":"ContainerDied","Data":"06ce511e4a972ff24e911e6044034d916e045d93cac3a6a8987d4e564ae829c0"}
May 26 15:20:53.178166 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:20:53.178015    2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-797775bcb5-x7sns" event={"ID":"676b1633-43dc-4fe0-bf8b-5f8247a3e6e2","Type":"ContainerDied","Data":"a0f22bca26565d11449a7991adb881f0b85d0e34e268013aa1a3aa7ca12b694a"}
May 26 15:20:53.178166 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:20:53.178038    2581 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-797775bcb5-x7sns"
May 26 15:20:53.184951 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:20:53.184935    2581 scope.go:117] "RemoveContainer" containerID="06ce511e4a972ff24e911e6044034d916e045d93cac3a6a8987d4e564ae829c0"
May 26 15:20:53.192704 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:20:53.192688    2581 scope.go:117] "RemoveContainer" containerID="06ce511e4a972ff24e911e6044034d916e045d93cac3a6a8987d4e564ae829c0"
May 26 15:20:53.192974 ip-10-0-140-164 kubenswrapper[2581]: E0526 15:20:53.192950    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"06ce511e4a972ff24e911e6044034d916e045d93cac3a6a8987d4e564ae829c0\": container with ID starting with 06ce511e4a972ff24e911e6044034d916e045d93cac3a6a8987d4e564ae829c0 not found: ID does not exist" containerID="06ce511e4a972ff24e911e6044034d916e045d93cac3a6a8987d4e564ae829c0"
May 26 15:20:53.193033 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:20:53.192983    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"06ce511e4a972ff24e911e6044034d916e045d93cac3a6a8987d4e564ae829c0"} err="failed to get container status \"06ce511e4a972ff24e911e6044034d916e045d93cac3a6a8987d4e564ae829c0\": rpc error: code = NotFound desc = could not find container \"06ce511e4a972ff24e911e6044034d916e045d93cac3a6a8987d4e564ae829c0\": container with ID starting with 06ce511e4a972ff24e911e6044034d916e045d93cac3a6a8987d4e564ae829c0 not found: ID does not exist"
May 26 15:20:53.203130 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:20:53.203108    2581 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-c455f768d-2g4gp"]
May 26 15:20:53.206909 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:20:53.206892    2581 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-c455f768d-2g4gp"]
May 26 15:20:53.218531 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:20:53.218503    2581 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-797775bcb5-x7sns"]
May 26 15:20:53.227424 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:20:53.227406    2581 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-797775bcb5-x7sns"]
May 26 15:20:53.640962 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:20:53.640932    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="28f55293-5c36-419f-b5ba-53c1905d302c" path="/var/lib/kubelet/pods/28f55293-5c36-419f-b5ba-53c1905d302c/volumes"
May 26 15:20:53.641351 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:20:53.641335    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="676b1633-43dc-4fe0-bf8b-5f8247a3e6e2" path="/var/lib/kubelet/pods/676b1633-43dc-4fe0-bf8b-5f8247a3e6e2/volumes"
May 26 15:21:02.773656 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:21:02.773608    2581 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-console/console-bc69b9575-wpg95" podUID="f9d78be8-b369-4bc4-a010-7164d68b5168" containerName="console" containerID="cri-o://dfc9892999241bf045b313dbc7122733a20822997051d59b86ae29f82096a041" gracePeriod=15
May 26 15:21:03.031997 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:21:03.031941    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-bc69b9575-wpg95_f9d78be8-b369-4bc4-a010-7164d68b5168/console/0.log"
May 26 15:21:03.032092 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:21:03.032002    2581 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-bc69b9575-wpg95"
May 26 15:21:03.161496 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:21:03.161468    2581 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f9d78be8-b369-4bc4-a010-7164d68b5168-console-config\") pod \"f9d78be8-b369-4bc4-a010-7164d68b5168\" (UID: \"f9d78be8-b369-4bc4-a010-7164d68b5168\") "
May 26 15:21:03.161625 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:21:03.161512    2581 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f9d78be8-b369-4bc4-a010-7164d68b5168-service-ca\") pod \"f9d78be8-b369-4bc4-a010-7164d68b5168\" (UID: \"f9d78be8-b369-4bc4-a010-7164d68b5168\") "
May 26 15:21:03.161625 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:21:03.161533    2581 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f9d78be8-b369-4bc4-a010-7164d68b5168-oauth-serving-cert\") pod \"f9d78be8-b369-4bc4-a010-7164d68b5168\" (UID: \"f9d78be8-b369-4bc4-a010-7164d68b5168\") "
May 26 15:21:03.161742 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:21:03.161650    2581 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f9d78be8-b369-4bc4-a010-7164d68b5168-console-oauth-config\") pod \"f9d78be8-b369-4bc4-a010-7164d68b5168\" (UID: \"f9d78be8-b369-4bc4-a010-7164d68b5168\") "
May 26 15:21:03.161742 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:21:03.161723    2581 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f9d78be8-b369-4bc4-a010-7164d68b5168-console-serving-cert\") pod \"f9d78be8-b369-4bc4-a010-7164d68b5168\" (UID: \"f9d78be8-b369-4bc4-a010-7164d68b5168\") "
May 26 15:21:03.161844 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:21:03.161759    2581 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-84blt\" (UniqueName: \"kubernetes.io/projected/f9d78be8-b369-4bc4-a010-7164d68b5168-kube-api-access-84blt\") pod \"f9d78be8-b369-4bc4-a010-7164d68b5168\" (UID: \"f9d78be8-b369-4bc4-a010-7164d68b5168\") "
May 26 15:21:03.161896 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:21:03.161868    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f9d78be8-b369-4bc4-a010-7164d68b5168-console-config" (OuterVolumeSpecName: "console-config") pod "f9d78be8-b369-4bc4-a010-7164d68b5168" (UID: "f9d78be8-b369-4bc4-a010-7164d68b5168"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 26 15:21:03.161896 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:21:03.161881    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f9d78be8-b369-4bc4-a010-7164d68b5168-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "f9d78be8-b369-4bc4-a010-7164d68b5168" (UID: "f9d78be8-b369-4bc4-a010-7164d68b5168"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 26 15:21:03.161980 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:21:03.161897    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f9d78be8-b369-4bc4-a010-7164d68b5168-service-ca" (OuterVolumeSpecName: "service-ca") pod "f9d78be8-b369-4bc4-a010-7164d68b5168" (UID: "f9d78be8-b369-4bc4-a010-7164d68b5168"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 26 15:21:03.162019 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:21:03.161999    2581 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f9d78be8-b369-4bc4-a010-7164d68b5168-console-config\") on node \"ip-10-0-140-164.ec2.internal\" DevicePath \"\""
May 26 15:21:03.162050 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:21:03.162018    2581 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f9d78be8-b369-4bc4-a010-7164d68b5168-service-ca\") on node \"ip-10-0-140-164.ec2.internal\" DevicePath \"\""
May 26 15:21:03.162050 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:21:03.162032    2581 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f9d78be8-b369-4bc4-a010-7164d68b5168-oauth-serving-cert\") on node \"ip-10-0-140-164.ec2.internal\" DevicePath \"\""
May 26 15:21:03.163909 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:21:03.163881    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f9d78be8-b369-4bc4-a010-7164d68b5168-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "f9d78be8-b369-4bc4-a010-7164d68b5168" (UID: "f9d78be8-b369-4bc4-a010-7164d68b5168"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 26 15:21:03.164027 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:21:03.163906    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f9d78be8-b369-4bc4-a010-7164d68b5168-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "f9d78be8-b369-4bc4-a010-7164d68b5168" (UID: "f9d78be8-b369-4bc4-a010-7164d68b5168"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 26 15:21:03.164027 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:21:03.163964    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f9d78be8-b369-4bc4-a010-7164d68b5168-kube-api-access-84blt" (OuterVolumeSpecName: "kube-api-access-84blt") pod "f9d78be8-b369-4bc4-a010-7164d68b5168" (UID: "f9d78be8-b369-4bc4-a010-7164d68b5168"). InnerVolumeSpecName "kube-api-access-84blt". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 26 15:21:03.207373 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:21:03.207351    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-bc69b9575-wpg95_f9d78be8-b369-4bc4-a010-7164d68b5168/console/0.log"
May 26 15:21:03.207476 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:21:03.207392    2581 generic.go:358] "Generic (PLEG): container finished" podID="f9d78be8-b369-4bc4-a010-7164d68b5168" containerID="dfc9892999241bf045b313dbc7122733a20822997051d59b86ae29f82096a041" exitCode=2
May 26 15:21:03.207476 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:21:03.207454    2581 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-bc69b9575-wpg95"
May 26 15:21:03.207558 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:21:03.207483    2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-bc69b9575-wpg95" event={"ID":"f9d78be8-b369-4bc4-a010-7164d68b5168","Type":"ContainerDied","Data":"dfc9892999241bf045b313dbc7122733a20822997051d59b86ae29f82096a041"}
May 26 15:21:03.207558 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:21:03.207527    2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-bc69b9575-wpg95" event={"ID":"f9d78be8-b369-4bc4-a010-7164d68b5168","Type":"ContainerDied","Data":"a6614e75a5f11791a4718472987880187e7ebfb56c774ea386311381f70f3242"}
May 26 15:21:03.207558 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:21:03.207548    2581 scope.go:117] "RemoveContainer" containerID="dfc9892999241bf045b313dbc7122733a20822997051d59b86ae29f82096a041"
May 26 15:21:03.215799 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:21:03.215779    2581 scope.go:117] "RemoveContainer" containerID="dfc9892999241bf045b313dbc7122733a20822997051d59b86ae29f82096a041"
May 26 15:21:03.216037 ip-10-0-140-164 kubenswrapper[2581]: E0526 15:21:03.216018    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"dfc9892999241bf045b313dbc7122733a20822997051d59b86ae29f82096a041\": container with ID starting with dfc9892999241bf045b313dbc7122733a20822997051d59b86ae29f82096a041 not found: ID does not exist" containerID="dfc9892999241bf045b313dbc7122733a20822997051d59b86ae29f82096a041"
May 26 15:21:03.216100 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:21:03.216044    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dfc9892999241bf045b313dbc7122733a20822997051d59b86ae29f82096a041"} err="failed to get container status \"dfc9892999241bf045b313dbc7122733a20822997051d59b86ae29f82096a041\": rpc error: code = NotFound desc = could not find container \"dfc9892999241bf045b313dbc7122733a20822997051d59b86ae29f82096a041\": container with ID starting with dfc9892999241bf045b313dbc7122733a20822997051d59b86ae29f82096a041 not found: ID does not exist"
May 26 15:21:03.231905 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:21:03.230575    2581 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-bc69b9575-wpg95"]
May 26 15:21:03.234758 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:21:03.234738    2581 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-bc69b9575-wpg95"]
May 26 15:21:03.262837 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:21:03.262817    2581 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f9d78be8-b369-4bc4-a010-7164d68b5168-console-oauth-config\") on node \"ip-10-0-140-164.ec2.internal\" DevicePath \"\""
May 26 15:21:03.262908 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:21:03.262836    2581 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f9d78be8-b369-4bc4-a010-7164d68b5168-console-serving-cert\") on node \"ip-10-0-140-164.ec2.internal\" DevicePath \"\""
May 26 15:21:03.262908 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:21:03.262848    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-84blt\" (UniqueName: \"kubernetes.io/projected/f9d78be8-b369-4bc4-a010-7164d68b5168-kube-api-access-84blt\") on node \"ip-10-0-140-164.ec2.internal\" DevicePath \"\""
May 26 15:21:03.641430 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:21:03.641397    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f9d78be8-b369-4bc4-a010-7164d68b5168" path="/var/lib/kubelet/pods/f9d78be8-b369-4bc4-a010-7164d68b5168/volumes"
May 26 15:21:44.920153 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:21:44.920107    2581 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-fcf4cdf6d-gvlbr"]
May 26 15:21:44.920701 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:21:44.920544    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f9d78be8-b369-4bc4-a010-7164d68b5168" containerName="console"
May 26 15:21:44.920701 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:21:44.920562    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="f9d78be8-b369-4bc4-a010-7164d68b5168" containerName="console"
May 26 15:21:44.920701 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:21:44.920589    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="28f55293-5c36-419f-b5ba-53c1905d302c" containerName="console"
May 26 15:21:44.920701 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:21:44.920598    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="28f55293-5c36-419f-b5ba-53c1905d302c" containerName="console"
May 26 15:21:44.920701 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:21:44.920608    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="676b1633-43dc-4fe0-bf8b-5f8247a3e6e2" containerName="registry"
May 26 15:21:44.920701 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:21:44.920616    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="676b1633-43dc-4fe0-bf8b-5f8247a3e6e2" containerName="registry"
May 26 15:21:44.920701 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:21:44.920678    2581 memory_manager.go:356] "RemoveStaleState removing state" podUID="28f55293-5c36-419f-b5ba-53c1905d302c" containerName="console"
May 26 15:21:44.920701 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:21:44.920690    2581 memory_manager.go:356] "RemoveStaleState removing state" podUID="f9d78be8-b369-4bc4-a010-7164d68b5168" containerName="console"
May 26 15:21:44.920701 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:21:44.920699    2581 memory_manager.go:356] "RemoveStaleState removing state" podUID="676b1633-43dc-4fe0-bf8b-5f8247a3e6e2" containerName="registry"
May 26 15:21:44.925516 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:21:44.925492    2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-fcf4cdf6d-gvlbr"
May 26 15:21:44.928050 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:21:44.928025    2581 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\""
May 26 15:21:44.928194 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:21:44.928024    2581 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\""
May 26 15:21:44.928194 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:21:44.928074    2581 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\""
May 26 15:21:44.928386 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:21:44.928373    2581 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\""
May 26 15:21:44.928481 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:21:44.928454    2581 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-2w6hj\""
May 26 15:21:44.928539 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:21:44.928464    2581 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\""
May 26 15:21:44.933263 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:21:44.933242    2581 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\""
May 26 15:21:44.936244 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:21:44.936221    2581 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-fcf4cdf6d-gvlbr"]
May 26 15:21:45.063517 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:21:45.063492    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/d5631af4-503f-41e4-a88d-2723d9085094-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-fcf4cdf6d-gvlbr\" (UID: \"d5631af4-503f-41e4-a88d-2723d9085094\") " pod="openshift-monitoring/telemeter-client-fcf4cdf6d-gvlbr"
May 26 15:21:45.063631 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:21:45.063523    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d5631af4-503f-41e4-a88d-2723d9085094-metrics-client-ca\") pod \"telemeter-client-fcf4cdf6d-gvlbr\" (UID: \"d5631af4-503f-41e4-a88d-2723d9085094\") " pod="openshift-monitoring/telemeter-client-fcf4cdf6d-gvlbr"
May 26 15:21:45.063631 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:21:45.063546    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d5631af4-503f-41e4-a88d-2723d9085094-telemeter-trusted-ca-bundle\") pod \"telemeter-client-fcf4cdf6d-gvlbr\" (UID: \"d5631af4-503f-41e4-a88d-2723d9085094\") " pod="openshift-monitoring/telemeter-client-fcf4cdf6d-gvlbr"
May 26 15:21:45.063631 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:21:45.063565    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d5631af4-503f-41e4-a88d-2723d9085094-serving-certs-ca-bundle\") pod \"telemeter-client-fcf4cdf6d-gvlbr\" (UID: \"d5631af4-503f-41e4-a88d-2723d9085094\") " pod="openshift-monitoring/telemeter-client-fcf4cdf6d-gvlbr"
May 26 15:21:45.063631 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:21:45.063616    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mc7s9\" (UniqueName: \"kubernetes.io/projected/d5631af4-503f-41e4-a88d-2723d9085094-kube-api-access-mc7s9\") pod \"telemeter-client-fcf4cdf6d-gvlbr\" (UID: \"d5631af4-503f-41e4-a88d-2723d9085094\") " pod="openshift-monitoring/telemeter-client-fcf4cdf6d-gvlbr"
May 26 15:21:45.063779 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:21:45.063677    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/d5631af4-503f-41e4-a88d-2723d9085094-telemeter-client-tls\") pod \"telemeter-client-fcf4cdf6d-gvlbr\" (UID: \"d5631af4-503f-41e4-a88d-2723d9085094\") " pod="openshift-monitoring/telemeter-client-fcf4cdf6d-gvlbr"
May 26 15:21:45.063779 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:21:45.063696    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/d5631af4-503f-41e4-a88d-2723d9085094-federate-client-tls\") pod \"telemeter-client-fcf4cdf6d-gvlbr\" (UID: \"d5631af4-503f-41e4-a88d-2723d9085094\") " pod="openshift-monitoring/telemeter-client-fcf4cdf6d-gvlbr"
May 26 15:21:45.063779 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:21:45.063716    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/d5631af4-503f-41e4-a88d-2723d9085094-secret-telemeter-client\") pod \"telemeter-client-fcf4cdf6d-gvlbr\" (UID: \"d5631af4-503f-41e4-a88d-2723d9085094\") " pod="openshift-monitoring/telemeter-client-fcf4cdf6d-gvlbr"
May 26 15:21:45.164008 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:21:45.163983    2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/d5631af4-503f-41e4-a88d-2723d9085094-telemeter-client-tls\") pod \"telemeter-client-fcf4cdf6d-gvlbr\" (UID: \"d5631af4-503f-41e4-a88d-2723d9085094\") " pod="openshift-monitoring/telemeter-client-fcf4cdf6d-gvlbr"
May 26 15:21:45.164122 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:21:45.164011    2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/d5631af4-503f-41e4-a88d-2723d9085094-federate-client-tls\") pod \"telemeter-client-fcf4cdf6d-gvlbr\" (UID: \"d5631af4-503f-41e4-a88d-2723d9085094\") " pod="openshift-monitoring/telemeter-client-fcf4cdf6d-gvlbr"
May 26 15:21:45.164122 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:21:45.164033    2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/d5631af4-503f-41e4-a88d-2723d9085094-secret-telemeter-client\") pod \"telemeter-client-fcf4cdf6d-gvlbr\" (UID: \"d5631af4-503f-41e4-a88d-2723d9085094\") " pod="openshift-monitoring/telemeter-client-fcf4cdf6d-gvlbr"
May 26 15:21:45.164122 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:21:45.164059    2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/d5631af4-503f-41e4-a88d-2723d9085094-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-fcf4cdf6d-gvlbr\" (UID: \"d5631af4-503f-41e4-a88d-2723d9085094\") " pod="openshift-monitoring/telemeter-client-fcf4cdf6d-gvlbr"
May 26 15:21:45.164294 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:21:45.164188    2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d5631af4-503f-41e4-a88d-2723d9085094-metrics-client-ca\") pod \"telemeter-client-fcf4cdf6d-gvlbr\" (UID: \"d5631af4-503f-41e4-a88d-2723d9085094\") " pod="openshift-monitoring/telemeter-client-fcf4cdf6d-gvlbr"
May 26 15:21:45.164294 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:21:45.164233    2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d5631af4-503f-41e4-a88d-2723d9085094-telemeter-trusted-ca-bundle\") pod \"telemeter-client-fcf4cdf6d-gvlbr\" (UID: \"d5631af4-503f-41e4-a88d-2723d9085094\") " pod="openshift-monitoring/telemeter-client-fcf4cdf6d-gvlbr"
May 26 15:21:45.164294 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:21:45.164261    2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d5631af4-503f-41e4-a88d-2723d9085094-serving-certs-ca-bundle\") pod \"telemeter-client-fcf4cdf6d-gvlbr\" (UID: \"d5631af4-503f-41e4-a88d-2723d9085094\") " pod="openshift-monitoring/telemeter-client-fcf4cdf6d-gvlbr"
May 26 15:21:45.164432 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:21:45.164314    2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-mc7s9\" (UniqueName: \"kubernetes.io/projected/d5631af4-503f-41e4-a88d-2723d9085094-kube-api-access-mc7s9\") pod \"telemeter-client-fcf4cdf6d-gvlbr\" (UID: \"d5631af4-503f-41e4-a88d-2723d9085094\") " pod="openshift-monitoring/telemeter-client-fcf4cdf6d-gvlbr"
May 26 15:21:45.165237 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:21:45.165204    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d5631af4-503f-41e4-a88d-2723d9085094-serving-certs-ca-bundle\") pod \"telemeter-client-fcf4cdf6d-gvlbr\" (UID: \"d5631af4-503f-41e4-a88d-2723d9085094\") " pod="openshift-monitoring/telemeter-client-fcf4cdf6d-gvlbr"
May 26 15:21:45.165617 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:21:45.165583    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d5631af4-503f-41e4-a88d-2723d9085094-metrics-client-ca\") pod \"telemeter-client-fcf4cdf6d-gvlbr\" (UID: \"d5631af4-503f-41e4-a88d-2723d9085094\") " pod="openshift-monitoring/telemeter-client-fcf4cdf6d-gvlbr"
May 26 15:21:45.165740 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:21:45.165712    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d5631af4-503f-41e4-a88d-2723d9085094-telemeter-trusted-ca-bundle\") pod \"telemeter-client-fcf4cdf6d-gvlbr\" (UID: \"d5631af4-503f-41e4-a88d-2723d9085094\") " pod="openshift-monitoring/telemeter-client-fcf4cdf6d-gvlbr"
May 26 15:21:45.166902 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:21:45.166873    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/d5631af4-503f-41e4-a88d-2723d9085094-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-fcf4cdf6d-gvlbr\" (UID: \"d5631af4-503f-41e4-a88d-2723d9085094\") " pod="openshift-monitoring/telemeter-client-fcf4cdf6d-gvlbr"
May 26 15:21:45.167130 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:21:45.167110    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/d5631af4-503f-41e4-a88d-2723d9085094-telemeter-client-tls\") pod \"telemeter-client-fcf4cdf6d-gvlbr\" (UID: \"d5631af4-503f-41e4-a88d-2723d9085094\") " pod="openshift-monitoring/telemeter-client-fcf4cdf6d-gvlbr"
May 26 15:21:45.167210 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:21:45.167153    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/d5631af4-503f-41e4-a88d-2723d9085094-federate-client-tls\") pod \"telemeter-client-fcf4cdf6d-gvlbr\" (UID: \"d5631af4-503f-41e4-a88d-2723d9085094\") " pod="openshift-monitoring/telemeter-client-fcf4cdf6d-gvlbr"
May 26 15:21:45.167296 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:21:45.167236    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/d5631af4-503f-41e4-a88d-2723d9085094-secret-telemeter-client\") pod \"telemeter-client-fcf4cdf6d-gvlbr\" (UID: \"d5631af4-503f-41e4-a88d-2723d9085094\") " pod="openshift-monitoring/telemeter-client-fcf4cdf6d-gvlbr"
May 26 15:21:45.175251 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:21:45.175196    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mc7s9\" (UniqueName: \"kubernetes.io/projected/d5631af4-503f-41e4-a88d-2723d9085094-kube-api-access-mc7s9\") pod \"telemeter-client-fcf4cdf6d-gvlbr\" (UID: \"d5631af4-503f-41e4-a88d-2723d9085094\") " pod="openshift-monitoring/telemeter-client-fcf4cdf6d-gvlbr"
May 26 15:21:45.236379 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:21:45.236347    2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-fcf4cdf6d-gvlbr"
May 26 15:21:45.367085 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:21:45.367031    2581 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-fcf4cdf6d-gvlbr"]
May 26 15:21:45.369157 ip-10-0-140-164 kubenswrapper[2581]: W0526 15:21:45.369134    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd5631af4_503f_41e4_a88d_2723d9085094.slice/crio-6ae332b0bc61ef81174bf427d9922ff75758363f056e9b8d5a0137e1680ccf86 WatchSource:0}: Error finding container 6ae332b0bc61ef81174bf427d9922ff75758363f056e9b8d5a0137e1680ccf86: Status 404 returned error can't find the container with id 6ae332b0bc61ef81174bf427d9922ff75758363f056e9b8d5a0137e1680ccf86
May 26 15:21:46.335005 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:21:46.334975    2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-fcf4cdf6d-gvlbr" event={"ID":"d5631af4-503f-41e4-a88d-2723d9085094","Type":"ContainerStarted","Data":"6ae332b0bc61ef81174bf427d9922ff75758363f056e9b8d5a0137e1680ccf86"}
May 26 15:21:48.342963 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:21:48.342922    2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-fcf4cdf6d-gvlbr" event={"ID":"d5631af4-503f-41e4-a88d-2723d9085094","Type":"ContainerStarted","Data":"978e2034f98babca3fe54fd196c6d9c60ef327e7b17690b0b15caf4de200b17a"}
May 26 15:21:49.347784 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:21:49.347744    2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-fcf4cdf6d-gvlbr" event={"ID":"d5631af4-503f-41e4-a88d-2723d9085094","Type":"ContainerStarted","Data":"3cff26c85e74ba641ba7fd2dd0f2ddac6365abd3ca53a2bd47d90620e7f65810"}
May 26 15:21:49.347784 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:21:49.347787    2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-fcf4cdf6d-gvlbr" event={"ID":"d5631af4-503f-41e4-a88d-2723d9085094","Type":"ContainerStarted","Data":"59127e3b24689f45c9279e3dac97567535d67320e4837d957cb27dc3bd83a8c9"}
May 26 15:21:49.373739 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:21:49.373669    2581 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-fcf4cdf6d-gvlbr" podStartSLOduration=2.071393805 podStartE2EDuration="5.373652655s" podCreationTimestamp="2026-05-26 15:21:44 +0000 UTC" firstStartedPulling="2026-05-26 15:21:45.370774065 +0000 UTC m=+244.368477375" lastFinishedPulling="2026-05-26 15:21:48.673032908 +0000 UTC m=+247.670736225" observedRunningTime="2026-05-26 15:21:49.373012598 +0000 UTC m=+248.370715930" watchObservedRunningTime="2026-05-26 15:21:49.373652655 +0000 UTC m=+248.371355988"
May 26 15:21:50.675476 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:21:50.675445    2581 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-console/console-75468cf5f7-czswm"]
May 26 15:21:50.678637 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:21:50.678615    2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-75468cf5f7-czswm"
May 26 15:21:50.682259 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:21:50.682226    2581 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-47bk2\""
May 26 15:21:50.682391 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:21:50.682264    2581 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
May 26 15:21:50.682391 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:21:50.682327    2581 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
May 26 15:21:50.682567 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:21:50.682553    2581 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
May 26 15:21:50.683527 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:21:50.683495    2581 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
May 26 15:21:50.683622 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:21:50.683532    2581 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
May 26 15:21:50.683676 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:21:50.683640    2581 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
May 26 15:21:50.683676 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:21:50.683649    2581 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
May 26 15:21:50.687183 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:21:50.687165    2581 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\""
May 26 15:21:50.693678 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:21:50.693657    2581 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-75468cf5f7-czswm"]
May 26 15:21:50.805290 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:21:50.805245    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d77606d9-51d6-489b-9d08-9bbd808af5e3-console-config\") pod \"console-75468cf5f7-czswm\" (UID: \"d77606d9-51d6-489b-9d08-9bbd808af5e3\") " pod="openshift-console/console-75468cf5f7-czswm"
May 26 15:21:50.805391 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:21:50.805321    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sx99w\" (UniqueName: \"kubernetes.io/projected/d77606d9-51d6-489b-9d08-9bbd808af5e3-kube-api-access-sx99w\") pod \"console-75468cf5f7-czswm\" (UID: \"d77606d9-51d6-489b-9d08-9bbd808af5e3\") " pod="openshift-console/console-75468cf5f7-czswm"
May 26 15:21:50.805391 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:21:50.805351    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d77606d9-51d6-489b-9d08-9bbd808af5e3-console-serving-cert\") pod \"console-75468cf5f7-czswm\" (UID: \"d77606d9-51d6-489b-9d08-9bbd808af5e3\") " pod="openshift-console/console-75468cf5f7-czswm"
May 26 15:21:50.805391 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:21:50.805367    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d77606d9-51d6-489b-9d08-9bbd808af5e3-trusted-ca-bundle\") pod \"console-75468cf5f7-czswm\" (UID: \"d77606d9-51d6-489b-9d08-9bbd808af5e3\") " pod="openshift-console/console-75468cf5f7-czswm"
May 26 15:21:50.805501 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:21:50.805445    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d77606d9-51d6-489b-9d08-9bbd808af5e3-console-oauth-config\") pod \"console-75468cf5f7-czswm\" (UID: \"d77606d9-51d6-489b-9d08-9bbd808af5e3\") " pod="openshift-console/console-75468cf5f7-czswm"
May 26 15:21:50.805501 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:21:50.805478    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d77606d9-51d6-489b-9d08-9bbd808af5e3-service-ca\") pod \"console-75468cf5f7-czswm\" (UID: \"d77606d9-51d6-489b-9d08-9bbd808af5e3\") " pod="openshift-console/console-75468cf5f7-czswm"
May 26 15:21:50.805569 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:21:50.805502    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d77606d9-51d6-489b-9d08-9bbd808af5e3-oauth-serving-cert\") pod \"console-75468cf5f7-czswm\" (UID: \"d77606d9-51d6-489b-9d08-9bbd808af5e3\") " pod="openshift-console/console-75468cf5f7-czswm"
May 26 15:21:50.906260 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:21:50.906231    2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d77606d9-51d6-489b-9d08-9bbd808af5e3-console-config\") pod \"console-75468cf5f7-czswm\" (UID: \"d77606d9-51d6-489b-9d08-9bbd808af5e3\") " pod="openshift-console/console-75468cf5f7-czswm"
May 26 15:21:50.906364 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:21:50.906288    2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-sx99w\" (UniqueName: \"kubernetes.io/projected/d77606d9-51d6-489b-9d08-9bbd808af5e3-kube-api-access-sx99w\") pod \"console-75468cf5f7-czswm\" (UID: \"d77606d9-51d6-489b-9d08-9bbd808af5e3\") " pod="openshift-console/console-75468cf5f7-czswm"
May 26 15:21:50.906364 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:21:50.906317    2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d77606d9-51d6-489b-9d08-9bbd808af5e3-console-serving-cert\") pod \"console-75468cf5f7-czswm\" (UID: \"d77606d9-51d6-489b-9d08-9bbd808af5e3\") " pod="openshift-console/console-75468cf5f7-czswm"
May 26 15:21:50.906364 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:21:50.906332    2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d77606d9-51d6-489b-9d08-9bbd808af5e3-trusted-ca-bundle\") pod \"console-75468cf5f7-czswm\" (UID: \"d77606d9-51d6-489b-9d08-9bbd808af5e3\") " pod="openshift-console/console-75468cf5f7-czswm"
May 26 15:21:50.906364 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:21:50.906364    2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d77606d9-51d6-489b-9d08-9bbd808af5e3-console-oauth-config\") pod \"console-75468cf5f7-czswm\" (UID: \"d77606d9-51d6-489b-9d08-9bbd808af5e3\") " pod="openshift-console/console-75468cf5f7-czswm"
May 26 15:21:50.906519 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:21:50.906379    2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d77606d9-51d6-489b-9d08-9bbd808af5e3-service-ca\") pod \"console-75468cf5f7-czswm\" (UID: \"d77606d9-51d6-489b-9d08-9bbd808af5e3\") " pod="openshift-console/console-75468cf5f7-czswm"
May 26 15:21:50.906519 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:21:50.906411    2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d77606d9-51d6-489b-9d08-9bbd808af5e3-oauth-serving-cert\") pod \"console-75468cf5f7-czswm\" (UID: \"d77606d9-51d6-489b-9d08-9bbd808af5e3\") " pod="openshift-console/console-75468cf5f7-czswm"
May 26 15:21:50.909948 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:21:50.907447    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d77606d9-51d6-489b-9d08-9bbd808af5e3-console-config\") pod \"console-75468cf5f7-czswm\" (UID: \"d77606d9-51d6-489b-9d08-9bbd808af5e3\") " pod="openshift-console/console-75468cf5f7-czswm"
May 26 15:21:50.909948 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:21:50.907873    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d77606d9-51d6-489b-9d08-9bbd808af5e3-service-ca\") pod \"console-75468cf5f7-czswm\" (UID: \"d77606d9-51d6-489b-9d08-9bbd808af5e3\") " pod="openshift-console/console-75468cf5f7-czswm"
May 26 15:21:50.909948 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:21:50.907916    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d77606d9-51d6-489b-9d08-9bbd808af5e3-trusted-ca-bundle\") pod \"console-75468cf5f7-czswm\" (UID: \"d77606d9-51d6-489b-9d08-9bbd808af5e3\") " pod="openshift-console/console-75468cf5f7-czswm"
May 26 15:21:50.909948 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:21:50.908355    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d77606d9-51d6-489b-9d08-9bbd808af5e3-oauth-serving-cert\") pod \"console-75468cf5f7-czswm\" (UID: \"d77606d9-51d6-489b-9d08-9bbd808af5e3\") " pod="openshift-console/console-75468cf5f7-czswm"
May 26 15:21:50.910192 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:21:50.910164    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d77606d9-51d6-489b-9d08-9bbd808af5e3-console-serving-cert\") pod \"console-75468cf5f7-czswm\" (UID: \"d77606d9-51d6-489b-9d08-9bbd808af5e3\") " pod="openshift-console/console-75468cf5f7-czswm"
May 26 15:21:50.912908 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:21:50.910450    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d77606d9-51d6-489b-9d08-9bbd808af5e3-console-oauth-config\") pod \"console-75468cf5f7-czswm\" (UID: \"d77606d9-51d6-489b-9d08-9bbd808af5e3\") " pod="openshift-console/console-75468cf5f7-czswm"
May 26 15:21:50.915628 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:21:50.915605    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sx99w\" (UniqueName: \"kubernetes.io/projected/d77606d9-51d6-489b-9d08-9bbd808af5e3-kube-api-access-sx99w\") pod \"console-75468cf5f7-czswm\" (UID: \"d77606d9-51d6-489b-9d08-9bbd808af5e3\") " pod="openshift-console/console-75468cf5f7-czswm"
May 26 15:21:50.989400 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:21:50.989340    2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-75468cf5f7-czswm"
May 26 15:21:51.110704 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:21:51.110679    2581 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-75468cf5f7-czswm"]
May 26 15:21:51.113055 ip-10-0-140-164 kubenswrapper[2581]: W0526 15:21:51.113029    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd77606d9_51d6_489b_9d08_9bbd808af5e3.slice/crio-50e4bd36e79ae5a1c3d40cc82ddc52291a41183a167b409b4420ba5d44288f3b WatchSource:0}: Error finding container 50e4bd36e79ae5a1c3d40cc82ddc52291a41183a167b409b4420ba5d44288f3b: Status 404 returned error can't find the container with id 50e4bd36e79ae5a1c3d40cc82ddc52291a41183a167b409b4420ba5d44288f3b
May 26 15:21:51.354053 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:21:51.354013    2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-75468cf5f7-czswm" event={"ID":"d77606d9-51d6-489b-9d08-9bbd808af5e3","Type":"ContainerStarted","Data":"fae5ed2d7c02acd8bf375d5e2ec30e7fdfd344184ce2181876d3d36b754887b5"}
May 26 15:21:51.354053 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:21:51.354053    2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-75468cf5f7-czswm" event={"ID":"d77606d9-51d6-489b-9d08-9bbd808af5e3","Type":"ContainerStarted","Data":"50e4bd36e79ae5a1c3d40cc82ddc52291a41183a167b409b4420ba5d44288f3b"}
May 26 15:21:51.373389 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:21:51.373345    2581 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-console/console-75468cf5f7-czswm" podStartSLOduration=1.373331094 podStartE2EDuration="1.373331094s" podCreationTimestamp="2026-05-26 15:21:50 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-26 15:21:51.372883625 +0000 UTC m=+250.370586957" watchObservedRunningTime="2026-05-26 15:21:51.373331094 +0000 UTC m=+250.371034427"
May 26 15:21:53.527325 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:21:53.527284    2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ae574985-4900-4b23-bf74-7c72c939f9bd-metrics-certs\") pod \"network-metrics-daemon-npzrf\" (UID: \"ae574985-4900-4b23-bf74-7c72c939f9bd\") " pod="openshift-multus/network-metrics-daemon-npzrf"
May 26 15:21:53.529874 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:21:53.529847    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ae574985-4900-4b23-bf74-7c72c939f9bd-metrics-certs\") pod \"network-metrics-daemon-npzrf\" (UID: \"ae574985-4900-4b23-bf74-7c72c939f9bd\") " pod="openshift-multus/network-metrics-daemon-npzrf"
May 26 15:21:53.545596 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:21:53.545571    2581 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-nc4qx\""
May 26 15:21:53.553504 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:21:53.553489    2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-npzrf"
May 26 15:21:53.676913 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:21:53.676880    2581 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-npzrf"]
May 26 15:21:53.680013 ip-10-0-140-164 kubenswrapper[2581]: W0526 15:21:53.679976    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podae574985_4900_4b23_bf74_7c72c939f9bd.slice/crio-306f6e22e9986e2adc9a4ee4985ee4803607270c22bb01106d08376117ea4a03 WatchSource:0}: Error finding container 306f6e22e9986e2adc9a4ee4985ee4803607270c22bb01106d08376117ea4a03: Status 404 returned error can't find the container with id 306f6e22e9986e2adc9a4ee4985ee4803607270c22bb01106d08376117ea4a03
May 26 15:21:54.363927 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:21:54.363890    2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-npzrf" event={"ID":"ae574985-4900-4b23-bf74-7c72c939f9bd","Type":"ContainerStarted","Data":"306f6e22e9986e2adc9a4ee4985ee4803607270c22bb01106d08376117ea4a03"}
May 26 15:21:55.368756 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:21:55.368715    2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-npzrf" event={"ID":"ae574985-4900-4b23-bf74-7c72c939f9bd","Type":"ContainerStarted","Data":"33a0872e65cf31cb4698fc0844939904abb36985d9c6d7ee124ff0248693932f"}
May 26 15:21:55.368756 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:21:55.368758    2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-npzrf" event={"ID":"ae574985-4900-4b23-bf74-7c72c939f9bd","Type":"ContainerStarted","Data":"deaf3a154be773631adc4fe59d881307887ea7a68811935d01e6b78ffc633b26"}
May 26 15:21:55.386285 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:21:55.386231    2581 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-npzrf" podStartSLOduration=252.334883791 podStartE2EDuration="4m13.386215915s" podCreationTimestamp="2026-05-26 15:17:42 +0000 UTC" firstStartedPulling="2026-05-26 15:21:53.681915056 +0000 UTC m=+252.679618366" lastFinishedPulling="2026-05-26 15:21:54.733247179 +0000 UTC m=+253.730950490" observedRunningTime="2026-05-26 15:21:55.385445313 +0000 UTC m=+254.383148645" watchObservedRunningTime="2026-05-26 15:21:55.386215915 +0000 UTC m=+254.383919247"
May 26 15:22:00.990376 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:22:00.990324    2581 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-75468cf5f7-czswm"
May 26 15:22:00.990797 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:22:00.990389    2581 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-75468cf5f7-czswm"
May 26 15:22:00.995121 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:22:00.995101    2581 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-75468cf5f7-czswm"
May 26 15:22:01.390463 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:22:01.390431    2581 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-75468cf5f7-czswm"
May 26 15:22:01.518025 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:22:01.517994    2581 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-console/console-57bcfb696-sk7rg"]
May 26 15:22:01.521214 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:22:01.521190    2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-57bcfb696-sk7rg"
May 26 15:22:01.534143 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:22:01.534111    2581 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-57bcfb696-sk7rg"]
May 26 15:22:01.578158 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:22:01.578135    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d644ea72-00d5-49f9-9263-af4f023589e9-console-serving-cert\") pod \"console-57bcfb696-sk7rg\" (UID: \"d644ea72-00d5-49f9-9263-af4f023589e9\") " pod="openshift-console/console-57bcfb696-sk7rg"
May 26 15:22:01.578312 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:22:01.578165    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d644ea72-00d5-49f9-9263-af4f023589e9-service-ca\") pod \"console-57bcfb696-sk7rg\" (UID: \"d644ea72-00d5-49f9-9263-af4f023589e9\") " pod="openshift-console/console-57bcfb696-sk7rg"
May 26 15:22:01.578312 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:22:01.578196    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d644ea72-00d5-49f9-9263-af4f023589e9-trusted-ca-bundle\") pod \"console-57bcfb696-sk7rg\" (UID: \"d644ea72-00d5-49f9-9263-af4f023589e9\") " pod="openshift-console/console-57bcfb696-sk7rg"
May 26 15:22:01.578430 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:22:01.578348    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d644ea72-00d5-49f9-9263-af4f023589e9-console-oauth-config\") pod \"console-57bcfb696-sk7rg\" (UID: \"d644ea72-00d5-49f9-9263-af4f023589e9\") " pod="openshift-console/console-57bcfb696-sk7rg"
May 26 15:22:01.578430 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:22:01.578383    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d644ea72-00d5-49f9-9263-af4f023589e9-console-config\") pod \"console-57bcfb696-sk7rg\" (UID: \"d644ea72-00d5-49f9-9263-af4f023589e9\") " pod="openshift-console/console-57bcfb696-sk7rg"
May 26 15:22:01.578430 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:22:01.578401    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k7rrs\" (UniqueName: \"kubernetes.io/projected/d644ea72-00d5-49f9-9263-af4f023589e9-kube-api-access-k7rrs\") pod \"console-57bcfb696-sk7rg\" (UID: \"d644ea72-00d5-49f9-9263-af4f023589e9\") " pod="openshift-console/console-57bcfb696-sk7rg"
May 26 15:22:01.578589 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:22:01.578463    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d644ea72-00d5-49f9-9263-af4f023589e9-oauth-serving-cert\") pod \"console-57bcfb696-sk7rg\" (UID: \"d644ea72-00d5-49f9-9263-af4f023589e9\") " pod="openshift-console/console-57bcfb696-sk7rg"
May 26 15:22:01.678820 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:22:01.678763    2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d644ea72-00d5-49f9-9263-af4f023589e9-console-serving-cert\") pod \"console-57bcfb696-sk7rg\" (UID: \"d644ea72-00d5-49f9-9263-af4f023589e9\") " pod="openshift-console/console-57bcfb696-sk7rg"
May 26 15:22:01.678820 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:22:01.678799    2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d644ea72-00d5-49f9-9263-af4f023589e9-service-ca\") pod \"console-57bcfb696-sk7rg\" (UID: \"d644ea72-00d5-49f9-9263-af4f023589e9\") " pod="openshift-console/console-57bcfb696-sk7rg"
May 26 15:22:01.678988 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:22:01.678826    2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d644ea72-00d5-49f9-9263-af4f023589e9-trusted-ca-bundle\") pod \"console-57bcfb696-sk7rg\" (UID: \"d644ea72-00d5-49f9-9263-af4f023589e9\") " pod="openshift-console/console-57bcfb696-sk7rg"
May 26 15:22:01.678988 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:22:01.678853    2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d644ea72-00d5-49f9-9263-af4f023589e9-console-oauth-config\") pod \"console-57bcfb696-sk7rg\" (UID: \"d644ea72-00d5-49f9-9263-af4f023589e9\") " pod="openshift-console/console-57bcfb696-sk7rg"
May 26 15:22:01.678988 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:22:01.678876    2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d644ea72-00d5-49f9-9263-af4f023589e9-console-config\") pod \"console-57bcfb696-sk7rg\" (UID: \"d644ea72-00d5-49f9-9263-af4f023589e9\") " pod="openshift-console/console-57bcfb696-sk7rg"
May 26 15:22:01.678988 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:22:01.678900    2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-k7rrs\" (UniqueName: \"kubernetes.io/projected/d644ea72-00d5-49f9-9263-af4f023589e9-kube-api-access-k7rrs\") pod \"console-57bcfb696-sk7rg\" (UID: \"d644ea72-00d5-49f9-9263-af4f023589e9\") " pod="openshift-console/console-57bcfb696-sk7rg"
May 26 15:22:01.678988 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:22:01.678969    2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d644ea72-00d5-49f9-9263-af4f023589e9-oauth-serving-cert\") pod \"console-57bcfb696-sk7rg\" (UID: \"d644ea72-00d5-49f9-9263-af4f023589e9\") " pod="openshift-console/console-57bcfb696-sk7rg"
May 26 15:22:01.679672 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:22:01.679644    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d644ea72-00d5-49f9-9263-af4f023589e9-service-ca\") pod \"console-57bcfb696-sk7rg\" (UID: \"d644ea72-00d5-49f9-9263-af4f023589e9\") " pod="openshift-console/console-57bcfb696-sk7rg"
May 26 15:22:01.679790 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:22:01.679704    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d644ea72-00d5-49f9-9263-af4f023589e9-trusted-ca-bundle\") pod \"console-57bcfb696-sk7rg\" (UID: \"d644ea72-00d5-49f9-9263-af4f023589e9\") " pod="openshift-console/console-57bcfb696-sk7rg"
May 26 15:22:01.679790 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:22:01.679709    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d644ea72-00d5-49f9-9263-af4f023589e9-oauth-serving-cert\") pod \"console-57bcfb696-sk7rg\" (UID: \"d644ea72-00d5-49f9-9263-af4f023589e9\") " pod="openshift-console/console-57bcfb696-sk7rg"
May 26 15:22:01.679897 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:22:01.679872    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d644ea72-00d5-49f9-9263-af4f023589e9-console-config\") pod \"console-57bcfb696-sk7rg\" (UID: \"d644ea72-00d5-49f9-9263-af4f023589e9\") " pod="openshift-console/console-57bcfb696-sk7rg"
May 26 15:22:01.681256 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:22:01.681236    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d644ea72-00d5-49f9-9263-af4f023589e9-console-serving-cert\") pod \"console-57bcfb696-sk7rg\" (UID: \"d644ea72-00d5-49f9-9263-af4f023589e9\") " pod="openshift-console/console-57bcfb696-sk7rg"
May 26 15:22:01.681385 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:22:01.681345    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d644ea72-00d5-49f9-9263-af4f023589e9-console-oauth-config\") pod \"console-57bcfb696-sk7rg\" (UID: \"d644ea72-00d5-49f9-9263-af4f023589e9\") " pod="openshift-console/console-57bcfb696-sk7rg"
May 26 15:22:01.689544 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:22:01.689522    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-k7rrs\" (UniqueName: \"kubernetes.io/projected/d644ea72-00d5-49f9-9263-af4f023589e9-kube-api-access-k7rrs\") pod \"console-57bcfb696-sk7rg\" (UID: \"d644ea72-00d5-49f9-9263-af4f023589e9\") " pod="openshift-console/console-57bcfb696-sk7rg"
May 26 15:22:01.830944 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:22:01.830917    2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-57bcfb696-sk7rg"
May 26 15:22:01.956111 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:22:01.956089    2581 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-57bcfb696-sk7rg"]
May 26 15:22:01.958502 ip-10-0-140-164 kubenswrapper[2581]: W0526 15:22:01.958477    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd644ea72_00d5_49f9_9263_af4f023589e9.slice/crio-8fcc105d4432683883deca5aa4373600dad9201a89a498d2317a23f63577ba8d WatchSource:0}: Error finding container 8fcc105d4432683883deca5aa4373600dad9201a89a498d2317a23f63577ba8d: Status 404 returned error can't find the container with id 8fcc105d4432683883deca5aa4373600dad9201a89a498d2317a23f63577ba8d
May 26 15:22:02.389390 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:22:02.389349    2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-57bcfb696-sk7rg" event={"ID":"d644ea72-00d5-49f9-9263-af4f023589e9","Type":"ContainerStarted","Data":"014482cf084ff0134cbeff876008a0440d25fdda67575b5bc817040363b42eec"}
May 26 15:22:02.389762 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:22:02.389394    2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-57bcfb696-sk7rg" event={"ID":"d644ea72-00d5-49f9-9263-af4f023589e9","Type":"ContainerStarted","Data":"8fcc105d4432683883deca5aa4373600dad9201a89a498d2317a23f63577ba8d"}
May 26 15:22:02.408531 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:22:02.408488    2581 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-console/console-57bcfb696-sk7rg" podStartSLOduration=1.408474049 podStartE2EDuration="1.408474049s" podCreationTimestamp="2026-05-26 15:22:01 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-26 15:22:02.407674738 +0000 UTC m=+261.405378071" watchObservedRunningTime="2026-05-26 15:22:02.408474049 +0000 UTC m=+261.406177379"
May 26 15:22:11.831827 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:22:11.831793    2581 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-57bcfb696-sk7rg"
May 26 15:22:11.831827 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:22:11.831829    2581 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-57bcfb696-sk7rg"
May 26 15:22:11.836402 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:22:11.836380    2581 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-57bcfb696-sk7rg"
May 26 15:22:12.424795 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:22:12.424771    2581 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-57bcfb696-sk7rg"
May 26 15:22:12.470891 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:22:12.470862    2581 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-75468cf5f7-czswm"]
May 26 15:22:37.494419 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:22:37.494345    2581 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-console/console-75468cf5f7-czswm" podUID="d77606d9-51d6-489b-9d08-9bbd808af5e3" containerName="console" containerID="cri-o://fae5ed2d7c02acd8bf375d5e2ec30e7fdfd344184ce2181876d3d36b754887b5" gracePeriod=15
May 26 15:22:37.731904 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:22:37.731883    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-75468cf5f7-czswm_d77606d9-51d6-489b-9d08-9bbd808af5e3/console/0.log"
May 26 15:22:37.732008 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:22:37.731947    2581 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-75468cf5f7-czswm"
May 26 15:22:37.826701 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:22:37.826649    2581 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d77606d9-51d6-489b-9d08-9bbd808af5e3-trusted-ca-bundle\") pod \"d77606d9-51d6-489b-9d08-9bbd808af5e3\" (UID: \"d77606d9-51d6-489b-9d08-9bbd808af5e3\") "
May 26 15:22:37.826701 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:22:37.826694    2581 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-sx99w\" (UniqueName: \"kubernetes.io/projected/d77606d9-51d6-489b-9d08-9bbd808af5e3-kube-api-access-sx99w\") pod \"d77606d9-51d6-489b-9d08-9bbd808af5e3\" (UID: \"d77606d9-51d6-489b-9d08-9bbd808af5e3\") "
May 26 15:22:37.826863 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:22:37.826722    2581 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d77606d9-51d6-489b-9d08-9bbd808af5e3-oauth-serving-cert\") pod \"d77606d9-51d6-489b-9d08-9bbd808af5e3\" (UID: \"d77606d9-51d6-489b-9d08-9bbd808af5e3\") "
May 26 15:22:37.826863 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:22:37.826743    2581 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d77606d9-51d6-489b-9d08-9bbd808af5e3-console-oauth-config\") pod \"d77606d9-51d6-489b-9d08-9bbd808af5e3\" (UID: \"d77606d9-51d6-489b-9d08-9bbd808af5e3\") "
May 26 15:22:37.826863 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:22:37.826770    2581 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d77606d9-51d6-489b-9d08-9bbd808af5e3-service-ca\") pod \"d77606d9-51d6-489b-9d08-9bbd808af5e3\" (UID: \"d77606d9-51d6-489b-9d08-9bbd808af5e3\") "
May 26 15:22:37.826863 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:22:37.826788    2581 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d77606d9-51d6-489b-9d08-9bbd808af5e3-console-config\") pod \"d77606d9-51d6-489b-9d08-9bbd808af5e3\" (UID: \"d77606d9-51d6-489b-9d08-9bbd808af5e3\") "
May 26 15:22:37.826863 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:22:37.826804    2581 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d77606d9-51d6-489b-9d08-9bbd808af5e3-console-serving-cert\") pod \"d77606d9-51d6-489b-9d08-9bbd808af5e3\" (UID: \"d77606d9-51d6-489b-9d08-9bbd808af5e3\") "
May 26 15:22:37.827193 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:22:37.827165    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d77606d9-51d6-489b-9d08-9bbd808af5e3-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "d77606d9-51d6-489b-9d08-9bbd808af5e3" (UID: "d77606d9-51d6-489b-9d08-9bbd808af5e3"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 26 15:22:37.827349 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:22:37.827309    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d77606d9-51d6-489b-9d08-9bbd808af5e3-console-config" (OuterVolumeSpecName: "console-config") pod "d77606d9-51d6-489b-9d08-9bbd808af5e3" (UID: "d77606d9-51d6-489b-9d08-9bbd808af5e3"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 26 15:22:37.827706 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:22:37.827327    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d77606d9-51d6-489b-9d08-9bbd808af5e3-service-ca" (OuterVolumeSpecName: "service-ca") pod "d77606d9-51d6-489b-9d08-9bbd808af5e3" (UID: "d77606d9-51d6-489b-9d08-9bbd808af5e3"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 26 15:22:37.827911 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:22:37.827717    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d77606d9-51d6-489b-9d08-9bbd808af5e3-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "d77606d9-51d6-489b-9d08-9bbd808af5e3" (UID: "d77606d9-51d6-489b-9d08-9bbd808af5e3"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 26 15:22:37.833179 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:22:37.833042    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d77606d9-51d6-489b-9d08-9bbd808af5e3-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "d77606d9-51d6-489b-9d08-9bbd808af5e3" (UID: "d77606d9-51d6-489b-9d08-9bbd808af5e3"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 26 15:22:37.833589 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:22:37.833564    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d77606d9-51d6-489b-9d08-9bbd808af5e3-kube-api-access-sx99w" (OuterVolumeSpecName: "kube-api-access-sx99w") pod "d77606d9-51d6-489b-9d08-9bbd808af5e3" (UID: "d77606d9-51d6-489b-9d08-9bbd808af5e3"). InnerVolumeSpecName "kube-api-access-sx99w". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 26 15:22:37.833667 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:22:37.833583    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d77606d9-51d6-489b-9d08-9bbd808af5e3-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "d77606d9-51d6-489b-9d08-9bbd808af5e3" (UID: "d77606d9-51d6-489b-9d08-9bbd808af5e3"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 26 15:22:37.928225 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:22:37.928204    2581 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d77606d9-51d6-489b-9d08-9bbd808af5e3-service-ca\") on node \"ip-10-0-140-164.ec2.internal\" DevicePath \"\""
May 26 15:22:37.928225 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:22:37.928223    2581 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d77606d9-51d6-489b-9d08-9bbd808af5e3-console-config\") on node \"ip-10-0-140-164.ec2.internal\" DevicePath \"\""
May 26 15:22:37.928380 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:22:37.928232    2581 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d77606d9-51d6-489b-9d08-9bbd808af5e3-console-serving-cert\") on node \"ip-10-0-140-164.ec2.internal\" DevicePath \"\""
May 26 15:22:37.928380 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:22:37.928241    2581 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d77606d9-51d6-489b-9d08-9bbd808af5e3-trusted-ca-bundle\") on node \"ip-10-0-140-164.ec2.internal\" DevicePath \"\""
May 26 15:22:37.928380 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:22:37.928280    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-sx99w\" (UniqueName: \"kubernetes.io/projected/d77606d9-51d6-489b-9d08-9bbd808af5e3-kube-api-access-sx99w\") on node \"ip-10-0-140-164.ec2.internal\" DevicePath \"\""
May 26 15:22:37.928380 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:22:37.928290    2581 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d77606d9-51d6-489b-9d08-9bbd808af5e3-oauth-serving-cert\") on node \"ip-10-0-140-164.ec2.internal\" DevicePath \"\""
May 26 15:22:37.928380 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:22:37.928298    2581 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d77606d9-51d6-489b-9d08-9bbd808af5e3-console-oauth-config\") on node \"ip-10-0-140-164.ec2.internal\" DevicePath \"\""
May 26 15:22:38.505642 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:22:38.505613    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-75468cf5f7-czswm_d77606d9-51d6-489b-9d08-9bbd808af5e3/console/0.log"
May 26 15:22:38.505993 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:22:38.505655    2581 generic.go:358] "Generic (PLEG): container finished" podID="d77606d9-51d6-489b-9d08-9bbd808af5e3" containerID="fae5ed2d7c02acd8bf375d5e2ec30e7fdfd344184ce2181876d3d36b754887b5" exitCode=2
May 26 15:22:38.505993 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:22:38.505762    2581 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-75468cf5f7-czswm"
May 26 15:22:38.505993 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:22:38.505761    2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-75468cf5f7-czswm" event={"ID":"d77606d9-51d6-489b-9d08-9bbd808af5e3","Type":"ContainerDied","Data":"fae5ed2d7c02acd8bf375d5e2ec30e7fdfd344184ce2181876d3d36b754887b5"}
May 26 15:22:38.505993 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:22:38.505886    2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-75468cf5f7-czswm" event={"ID":"d77606d9-51d6-489b-9d08-9bbd808af5e3","Type":"ContainerDied","Data":"50e4bd36e79ae5a1c3d40cc82ddc52291a41183a167b409b4420ba5d44288f3b"}
May 26 15:22:38.505993 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:22:38.505904    2581 scope.go:117] "RemoveContainer" containerID="fae5ed2d7c02acd8bf375d5e2ec30e7fdfd344184ce2181876d3d36b754887b5"
May 26 15:22:38.515253 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:22:38.515235    2581 scope.go:117] "RemoveContainer" containerID="fae5ed2d7c02acd8bf375d5e2ec30e7fdfd344184ce2181876d3d36b754887b5"
May 26 15:22:38.515589 ip-10-0-140-164 kubenswrapper[2581]: E0526 15:22:38.515566    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fae5ed2d7c02acd8bf375d5e2ec30e7fdfd344184ce2181876d3d36b754887b5\": container with ID starting with fae5ed2d7c02acd8bf375d5e2ec30e7fdfd344184ce2181876d3d36b754887b5 not found: ID does not exist" containerID="fae5ed2d7c02acd8bf375d5e2ec30e7fdfd344184ce2181876d3d36b754887b5"
May 26 15:22:38.515647 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:22:38.515598    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fae5ed2d7c02acd8bf375d5e2ec30e7fdfd344184ce2181876d3d36b754887b5"} err="failed to get container status \"fae5ed2d7c02acd8bf375d5e2ec30e7fdfd344184ce2181876d3d36b754887b5\": rpc error: code = NotFound desc = could not find container \"fae5ed2d7c02acd8bf375d5e2ec30e7fdfd344184ce2181876d3d36b754887b5\": container with ID starting with fae5ed2d7c02acd8bf375d5e2ec30e7fdfd344184ce2181876d3d36b754887b5 not found: ID does not exist"
May 26 15:22:38.526644 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:22:38.526617    2581 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-75468cf5f7-czswm"]
May 26 15:22:38.529070 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:22:38.529043    2581 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-75468cf5f7-czswm"]
May 26 15:22:39.640255 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:22:39.640223    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d77606d9-51d6-489b-9d08-9bbd808af5e3" path="/var/lib/kubelet/pods/d77606d9-51d6-489b-9d08-9bbd808af5e3/volumes"
May 26 15:22:41.513169 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:22:41.513136    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-gjh9c_a02c2727-c53c-48c3-aba7-acde4eef632c/ovn-acl-logging/0.log"
May 26 15:22:41.513623 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:22:41.513577    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-gjh9c_a02c2727-c53c-48c3-aba7-acde4eef632c/ovn-acl-logging/0.log"
May 26 15:22:41.516605 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:22:41.516587    2581 kubelet.go:1628] "Image garbage collection succeeded"
May 26 15:24:07.708890 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:24:07.708854    2581 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["feast-operator-system/feast-operator-controller-manager-f8449b7dc-tk86j"]
May 26 15:24:07.709368 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:24:07.709112    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d77606d9-51d6-489b-9d08-9bbd808af5e3" containerName="console"
May 26 15:24:07.709368 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:24:07.709123    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="d77606d9-51d6-489b-9d08-9bbd808af5e3" containerName="console"
May 26 15:24:07.709368 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:24:07.709181    2581 memory_manager.go:356] "RemoveStaleState removing state" podUID="d77606d9-51d6-489b-9d08-9bbd808af5e3" containerName="console"
May 26 15:24:07.711956 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:24:07.711934    2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="feast-operator-system/feast-operator-controller-manager-f8449b7dc-tk86j"
May 26 15:24:07.714567 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:24:07.714544    2581 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"feast-operator-system\"/\"openshift-service-ca.crt\""
May 26 15:24:07.714655 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:24:07.714544    2581 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"feast-operator-system\"/\"kube-root-ca.crt\""
May 26 15:24:07.714655 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:24:07.714580    2581 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"feast-operator-system\"/\"feast-operator-controller-manager-dockercfg-2qwqf\""
May 26 15:24:07.720868 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:24:07.720844    2581 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["feast-operator-system/feast-operator-controller-manager-f8449b7dc-tk86j"]
May 26 15:24:07.725398 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:24:07.725376    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6whr8\" (UniqueName: \"kubernetes.io/projected/2d094d26-c035-49a3-a559-82389c31193b-kube-api-access-6whr8\") pod \"feast-operator-controller-manager-f8449b7dc-tk86j\" (UID: \"2d094d26-c035-49a3-a559-82389c31193b\") " pod="feast-operator-system/feast-operator-controller-manager-f8449b7dc-tk86j"
May 26 15:24:07.826553 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:24:07.826527    2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-6whr8\" (UniqueName: \"kubernetes.io/projected/2d094d26-c035-49a3-a559-82389c31193b-kube-api-access-6whr8\") pod \"feast-operator-controller-manager-f8449b7dc-tk86j\" (UID: \"2d094d26-c035-49a3-a559-82389c31193b\") " pod="feast-operator-system/feast-operator-controller-manager-f8449b7dc-tk86j"
May 26 15:24:07.835027 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:24:07.834997    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6whr8\" (UniqueName: \"kubernetes.io/projected/2d094d26-c035-49a3-a559-82389c31193b-kube-api-access-6whr8\") pod \"feast-operator-controller-manager-f8449b7dc-tk86j\" (UID: \"2d094d26-c035-49a3-a559-82389c31193b\") " pod="feast-operator-system/feast-operator-controller-manager-f8449b7dc-tk86j"
May 26 15:24:08.024448 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:24:08.024425    2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="feast-operator-system/feast-operator-controller-manager-f8449b7dc-tk86j"
May 26 15:24:08.148769 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:24:08.148742    2581 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["feast-operator-system/feast-operator-controller-manager-f8449b7dc-tk86j"]
May 26 15:24:08.151666 ip-10-0-140-164 kubenswrapper[2581]: W0526 15:24:08.151634    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2d094d26_c035_49a3_a559_82389c31193b.slice/crio-9f36a075e906dd5eaca3dcbe789c6632fb2c4c54fd15b53a960726e2357654a2 WatchSource:0}: Error finding container 9f36a075e906dd5eaca3dcbe789c6632fb2c4c54fd15b53a960726e2357654a2: Status 404 returned error can't find the container with id 9f36a075e906dd5eaca3dcbe789c6632fb2c4c54fd15b53a960726e2357654a2
May 26 15:24:08.153494 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:24:08.153477    2581 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
May 26 15:24:08.763218 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:24:08.763189    2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="feast-operator-system/feast-operator-controller-manager-f8449b7dc-tk86j" event={"ID":"2d094d26-c035-49a3-a559-82389c31193b","Type":"ContainerStarted","Data":"9f36a075e906dd5eaca3dcbe789c6632fb2c4c54fd15b53a960726e2357654a2"}
May 26 15:24:11.772318 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:24:11.772263    2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="feast-operator-system/feast-operator-controller-manager-f8449b7dc-tk86j" event={"ID":"2d094d26-c035-49a3-a559-82389c31193b","Type":"ContainerStarted","Data":"5cf184f393883e2f79f8979107eb04a8ac114e9b1f0d3027ba472d76148a03a9"}
May 26 15:24:11.772690 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:24:11.772443    2581 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="feast-operator-system/feast-operator-controller-manager-f8449b7dc-tk86j"
May 26 15:24:11.788530 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:24:11.788489    2581 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="feast-operator-system/feast-operator-controller-manager-f8449b7dc-tk86j" podStartSLOduration=1.491823107 podStartE2EDuration="4.788476823s" podCreationTimestamp="2026-05-26 15:24:07 +0000 UTC" firstStartedPulling="2026-05-26 15:24:08.153609454 +0000 UTC m=+387.151312765" lastFinishedPulling="2026-05-26 15:24:11.450263167 +0000 UTC m=+390.447966481" observedRunningTime="2026-05-26 15:24:11.787369687 +0000 UTC m=+390.785073021" watchObservedRunningTime="2026-05-26 15:24:11.788476823 +0000 UTC m=+390.786180155"
May 26 15:24:22.777833 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:24:22.777797    2581 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="feast-operator-system/feast-operator-controller-manager-f8449b7dc-tk86j"
May 26 15:24:50.992964 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:24:50.992929    2581 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["test-ns-feast/feast-simple-feast-setup-655999bffb-7z6bq"]
May 26 15:24:51.000078 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:24:51.000055    2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-655999bffb-7z6bq"
May 26 15:24:51.003110 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:24:51.003087    2581 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast\"/\"kube-root-ca.crt\""
May 26 15:24:51.003249 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:24:51.003228    2581 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-intra-comm\""
May 26 15:24:51.003249 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:24:51.003244    2581 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-ui-tls\""
May 26 15:24:51.003403 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:24:51.003196    2581 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-online-tls\""
May 26 15:24:51.003541 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:24:51.003524    2581 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-offline-tls\""
May 26 15:24:51.003949 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:24:51.003538    2581 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-registry-tls\""
May 26 15:24:51.004241 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:24:51.004221    2581 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast\"/\"openshift-service-ca.crt\""
May 26 15:24:51.004491 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:24:51.004476    2581 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-dockercfg-prf5q\""
May 26 15:24:51.009654 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:24:51.009631    2581 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-655999bffb-7z6bq"]
May 26 15:24:51.126771 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:24:51.126732    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/9a4dc740-20ca-4204-8c09-944d66fd84af-ui-tls\") pod \"feast-simple-feast-setup-655999bffb-7z6bq\" (UID: \"9a4dc740-20ca-4204-8c09-944d66fd84af\") " pod="test-ns-feast/feast-simple-feast-setup-655999bffb-7z6bq"
May 26 15:24:51.126892 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:24:51.126772    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ssfbm\" (UniqueName: \"kubernetes.io/projected/9a4dc740-20ca-4204-8c09-944d66fd84af-kube-api-access-ssfbm\") pod \"feast-simple-feast-setup-655999bffb-7z6bq\" (UID: \"9a4dc740-20ca-4204-8c09-944d66fd84af\") " pod="test-ns-feast/feast-simple-feast-setup-655999bffb-7z6bq"
May 26 15:24:51.126892 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:24:51.126833    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/9a4dc740-20ca-4204-8c09-944d66fd84af-feast-data\") pod \"feast-simple-feast-setup-655999bffb-7z6bq\" (UID: \"9a4dc740-20ca-4204-8c09-944d66fd84af\") " pod="test-ns-feast/feast-simple-feast-setup-655999bffb-7z6bq"
May 26 15:24:51.126892 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:24:51.126862    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/9a4dc740-20ca-4204-8c09-944d66fd84af-registry-tls\") pod \"feast-simple-feast-setup-655999bffb-7z6bq\" (UID: \"9a4dc740-20ca-4204-8c09-944d66fd84af\") " pod="test-ns-feast/feast-simple-feast-setup-655999bffb-7z6bq"
May 26 15:24:51.127020 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:24:51.126923    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/9a4dc740-20ca-4204-8c09-944d66fd84af-offline-tls\") pod \"feast-simple-feast-setup-655999bffb-7z6bq\" (UID: \"9a4dc740-20ca-4204-8c09-944d66fd84af\") " pod="test-ns-feast/feast-simple-feast-setup-655999bffb-7z6bq"
May 26 15:24:51.127020 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:24:51.126958    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/9a4dc740-20ca-4204-8c09-944d66fd84af-online-tls\") pod \"feast-simple-feast-setup-655999bffb-7z6bq\" (UID: \"9a4dc740-20ca-4204-8c09-944d66fd84af\") " pod="test-ns-feast/feast-simple-feast-setup-655999bffb-7z6bq"
May 26 15:24:51.227555 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:24:51.227528    2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/9a4dc740-20ca-4204-8c09-944d66fd84af-ui-tls\") pod \"feast-simple-feast-setup-655999bffb-7z6bq\" (UID: \"9a4dc740-20ca-4204-8c09-944d66fd84af\") " pod="test-ns-feast/feast-simple-feast-setup-655999bffb-7z6bq"
May 26 15:24:51.227664 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:24:51.227559    2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-ssfbm\" (UniqueName: \"kubernetes.io/projected/9a4dc740-20ca-4204-8c09-944d66fd84af-kube-api-access-ssfbm\") pod \"feast-simple-feast-setup-655999bffb-7z6bq\" (UID: \"9a4dc740-20ca-4204-8c09-944d66fd84af\") " pod="test-ns-feast/feast-simple-feast-setup-655999bffb-7z6bq"
May 26 15:24:51.227664 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:24:51.227585    2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/9a4dc740-20ca-4204-8c09-944d66fd84af-feast-data\") pod \"feast-simple-feast-setup-655999bffb-7z6bq\" (UID: \"9a4dc740-20ca-4204-8c09-944d66fd84af\") " pod="test-ns-feast/feast-simple-feast-setup-655999bffb-7z6bq"
May 26 15:24:51.227664 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:24:51.227607    2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/9a4dc740-20ca-4204-8c09-944d66fd84af-registry-tls\") pod \"feast-simple-feast-setup-655999bffb-7z6bq\" (UID: \"9a4dc740-20ca-4204-8c09-944d66fd84af\") " pod="test-ns-feast/feast-simple-feast-setup-655999bffb-7z6bq"
May 26 15:24:51.227664 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:24:51.227646    2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/9a4dc740-20ca-4204-8c09-944d66fd84af-offline-tls\") pod \"feast-simple-feast-setup-655999bffb-7z6bq\" (UID: \"9a4dc740-20ca-4204-8c09-944d66fd84af\") " pod="test-ns-feast/feast-simple-feast-setup-655999bffb-7z6bq"
May 26 15:24:51.227860 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:24:51.227679    2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/9a4dc740-20ca-4204-8c09-944d66fd84af-online-tls\") pod \"feast-simple-feast-setup-655999bffb-7z6bq\" (UID: \"9a4dc740-20ca-4204-8c09-944d66fd84af\") " pod="test-ns-feast/feast-simple-feast-setup-655999bffb-7z6bq"
May 26 15:24:51.227860 ip-10-0-140-164 kubenswrapper[2581]: E0526 15:24:51.227718    2581 secret.go:189] Couldn't get secret test-ns-feast/feast-simple-feast-setup-registry-tls: secret "feast-simple-feast-setup-registry-tls" not found
May 26 15:24:51.227860 ip-10-0-140-164 kubenswrapper[2581]: E0526 15:24:51.227777    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9a4dc740-20ca-4204-8c09-944d66fd84af-registry-tls podName:9a4dc740-20ca-4204-8c09-944d66fd84af nodeName:}" failed. No retries permitted until 2026-05-26 15:24:51.72775875 +0000 UTC m=+430.725462082 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/secret/9a4dc740-20ca-4204-8c09-944d66fd84af-registry-tls") pod "feast-simple-feast-setup-655999bffb-7z6bq" (UID: "9a4dc740-20ca-4204-8c09-944d66fd84af") : secret "feast-simple-feast-setup-registry-tls" not found
May 26 15:24:51.228071 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:24:51.227977    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/9a4dc740-20ca-4204-8c09-944d66fd84af-feast-data\") pod \"feast-simple-feast-setup-655999bffb-7z6bq\" (UID: \"9a4dc740-20ca-4204-8c09-944d66fd84af\") " pod="test-ns-feast/feast-simple-feast-setup-655999bffb-7z6bq"
May 26 15:24:51.230298 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:24:51.230237    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/9a4dc740-20ca-4204-8c09-944d66fd84af-offline-tls\") pod \"feast-simple-feast-setup-655999bffb-7z6bq\" (UID: \"9a4dc740-20ca-4204-8c09-944d66fd84af\") " pod="test-ns-feast/feast-simple-feast-setup-655999bffb-7z6bq"
May 26 15:24:51.230298 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:24:51.230295    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/9a4dc740-20ca-4204-8c09-944d66fd84af-online-tls\") pod \"feast-simple-feast-setup-655999bffb-7z6bq\" (UID: \"9a4dc740-20ca-4204-8c09-944d66fd84af\") " pod="test-ns-feast/feast-simple-feast-setup-655999bffb-7z6bq"
May 26 15:24:51.230451 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:24:51.230387    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/9a4dc740-20ca-4204-8c09-944d66fd84af-ui-tls\") pod \"feast-simple-feast-setup-655999bffb-7z6bq\" (UID: \"9a4dc740-20ca-4204-8c09-944d66fd84af\") " pod="test-ns-feast/feast-simple-feast-setup-655999bffb-7z6bq"
May 26 15:24:51.235745 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:24:51.235727    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ssfbm\" (UniqueName: \"kubernetes.io/projected/9a4dc740-20ca-4204-8c09-944d66fd84af-kube-api-access-ssfbm\") pod \"feast-simple-feast-setup-655999bffb-7z6bq\" (UID: \"9a4dc740-20ca-4204-8c09-944d66fd84af\") " pod="test-ns-feast/feast-simple-feast-setup-655999bffb-7z6bq"
May 26 15:24:51.732808 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:24:51.732734    2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/9a4dc740-20ca-4204-8c09-944d66fd84af-registry-tls\") pod \"feast-simple-feast-setup-655999bffb-7z6bq\" (UID: \"9a4dc740-20ca-4204-8c09-944d66fd84af\") " pod="test-ns-feast/feast-simple-feast-setup-655999bffb-7z6bq"
May 26 15:24:51.735245 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:24:51.735223    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/9a4dc740-20ca-4204-8c09-944d66fd84af-registry-tls\") pod \"feast-simple-feast-setup-655999bffb-7z6bq\" (UID: \"9a4dc740-20ca-4204-8c09-944d66fd84af\") " pod="test-ns-feast/feast-simple-feast-setup-655999bffb-7z6bq"
May 26 15:24:51.919601 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:24:51.919569    2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-655999bffb-7z6bq"
May 26 15:24:52.060326 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:24:52.060297    2581 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-655999bffb-7z6bq"]
May 26 15:24:52.061558 ip-10-0-140-164 kubenswrapper[2581]: W0526 15:24:52.061532    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod9a4dc740_20ca_4204_8c09_944d66fd84af.slice/crio-d0333f1f400e7d52b115638739a9554266c50ed1bf7a484898f1a4a83aedc2c0 WatchSource:0}: Error finding container d0333f1f400e7d52b115638739a9554266c50ed1bf7a484898f1a4a83aedc2c0: Status 404 returned error can't find the container with id d0333f1f400e7d52b115638739a9554266c50ed1bf7a484898f1a4a83aedc2c0
May 26 15:24:52.890141 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:24:52.890082    2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-655999bffb-7z6bq" event={"ID":"9a4dc740-20ca-4204-8c09-944d66fd84af","Type":"ContainerStarted","Data":"d0333f1f400e7d52b115638739a9554266c50ed1bf7a484898f1a4a83aedc2c0"}
May 26 15:25:23.983167 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:25:23.983081    2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-655999bffb-7z6bq" event={"ID":"9a4dc740-20ca-4204-8c09-944d66fd84af","Type":"ContainerStarted","Data":"7f44ce9bb94b0e7fe5cefeffc12c9abf6ce8f9041697dbea18eaed698c67e252"}
May 26 15:25:28.997789 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:25:28.997753    2581 generic.go:358] "Generic (PLEG): container finished" podID="9a4dc740-20ca-4204-8c09-944d66fd84af" containerID="7f44ce9bb94b0e7fe5cefeffc12c9abf6ce8f9041697dbea18eaed698c67e252" exitCode=0
May 26 15:25:28.998225 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:25:28.997839    2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-655999bffb-7z6bq" event={"ID":"9a4dc740-20ca-4204-8c09-944d66fd84af","Type":"ContainerDied","Data":"7f44ce9bb94b0e7fe5cefeffc12c9abf6ce8f9041697dbea18eaed698c67e252"}
May 26 15:25:30.002585 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:25:30.002549    2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-655999bffb-7z6bq" event={"ID":"9a4dc740-20ca-4204-8c09-944d66fd84af","Type":"ContainerStarted","Data":"af44b6d7d25f61c39ae04d5698eb286118f5db02b888c616d5e1dc38ba74c2d4"}
May 26 15:25:35.017652 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:25:35.017613    2581 generic.go:358] "Generic (PLEG): container finished" podID="9a4dc740-20ca-4204-8c09-944d66fd84af" containerID="af44b6d7d25f61c39ae04d5698eb286118f5db02b888c616d5e1dc38ba74c2d4" exitCode=0
May 26 15:25:35.018153 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:25:35.017693    2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-655999bffb-7z6bq" event={"ID":"9a4dc740-20ca-4204-8c09-944d66fd84af","Type":"ContainerDied","Data":"af44b6d7d25f61c39ae04d5698eb286118f5db02b888c616d5e1dc38ba74c2d4"}
May 26 15:25:36.025009 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:25:36.024969    2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-655999bffb-7z6bq" event={"ID":"9a4dc740-20ca-4204-8c09-944d66fd84af","Type":"ContainerStarted","Data":"4871cc2acf6423e734bd85cf672da047532f3abf90ae2e6e760af262e6ac329d"}
May 26 15:25:36.025589 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:25:36.025556    2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-655999bffb-7z6bq" event={"ID":"9a4dc740-20ca-4204-8c09-944d66fd84af","Type":"ContainerStarted","Data":"8edab7c2add6c1635bee754f64ce1cb20d14b91054b9f9ba995d7634843e91cb"}
May 26 15:25:36.025589 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:25:36.025590    2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-655999bffb-7z6bq" event={"ID":"9a4dc740-20ca-4204-8c09-944d66fd84af","Type":"ContainerStarted","Data":"6b7de40c15d6e128d1bbdc1ec1307304adc674d20974294b3438b6f3c8b0a0b1"}
May 26 15:25:36.025589 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:25:36.025604    2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-655999bffb-7z6bq" event={"ID":"9a4dc740-20ca-4204-8c09-944d66fd84af","Type":"ContainerStarted","Data":"ec31e694c5ee99d4b407adf2c666187f804b7845c139238be7f22fdcfa88e2fc"}
May 26 15:25:36.080829 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:25:36.080741    2581 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="test-ns-feast/feast-simple-feast-setup-655999bffb-7z6bq" podStartSLOduration=14.589363202 podStartE2EDuration="46.080721791s" podCreationTimestamp="2026-05-26 15:24:50 +0000 UTC" firstStartedPulling="2026-05-26 15:24:52.063295274 +0000 UTC m=+431.060998585" lastFinishedPulling="2026-05-26 15:25:23.554653862 +0000 UTC m=+462.552357174" observedRunningTime="2026-05-26 15:25:36.078784979 +0000 UTC m=+475.076488339" watchObservedRunningTime="2026-05-26 15:25:36.080721791 +0000 UTC m=+475.078425125"
May 26 15:25:36.920870 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:25:36.920830    2581 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-655999bffb-7z6bq"
May 26 15:25:36.921061 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:25:36.920889    2581 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-655999bffb-7z6bq"
May 26 15:25:36.921061 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:25:36.920904    2581 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-655999bffb-7z6bq"
May 26 15:25:36.921061 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:25:36.920916    2581 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-655999bffb-7z6bq"
May 26 15:25:36.923041 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:25:36.922924    2581 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-655999bffb-7z6bq" podUID="9a4dc740-20ca-4204-8c09-944d66fd84af" containerName="registry" probeResult="failure" output="dial tcp 10.132.0.22:6571: connect: connection refused"
May 26 15:25:36.923041 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:25:36.922964    2581 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-655999bffb-7z6bq" podUID="9a4dc740-20ca-4204-8c09-944d66fd84af" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.22:8443: connect: connection refused"
May 26 15:25:36.923041 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:25:36.922955    2581 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-655999bffb-7z6bq" podUID="9a4dc740-20ca-4204-8c09-944d66fd84af" containerName="offline" probeResult="failure" output="dial tcp 10.132.0.22:8816: connect: connection refused"
May 26 15:25:36.923041 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:25:36.922964    2581 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-655999bffb-7z6bq" podUID="9a4dc740-20ca-4204-8c09-944d66fd84af" containerName="online" probeResult="failure" output="Get \"https://10.132.0.22:6567/health\": dial tcp 10.132.0.22:6567: connect: connection refused"
May 26 15:25:39.920769 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:25:39.920381    2581 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-655999bffb-7z6bq" podUID="9a4dc740-20ca-4204-8c09-944d66fd84af" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.22:8443: connect: connection refused"
May 26 15:25:39.920769 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:25:39.920381    2581 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-655999bffb-7z6bq" podUID="9a4dc740-20ca-4204-8c09-944d66fd84af" containerName="registry" probeResult="failure" output="dial tcp 10.132.0.22:6571: connect: connection refused"
May 26 15:25:39.920769 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:25:39.920383    2581 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-655999bffb-7z6bq" podUID="9a4dc740-20ca-4204-8c09-944d66fd84af" containerName="offline" probeResult="failure" output="dial tcp 10.132.0.22:8816: connect: connection refused"
May 26 15:25:39.920769 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:25:39.920658    2581 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-655999bffb-7z6bq" podUID="9a4dc740-20ca-4204-8c09-944d66fd84af" containerName="online" probeResult="failure" output="Get \"https://10.132.0.22:6567/health\": dial tcp 10.132.0.22:6567: connect: connection refused"
May 26 15:25:41.920397 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:25:41.920358    2581 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-655999bffb-7z6bq"
May 26 15:25:41.920397 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:25:41.920402    2581 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-655999bffb-7z6bq"
May 26 15:25:41.920789 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:25:41.920411    2581 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-655999bffb-7z6bq"
May 26 15:25:41.920789 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:25:41.920418    2581 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-655999bffb-7z6bq"
May 26 15:25:42.921375 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:25:42.921348    2581 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-655999bffb-7z6bq"
May 26 15:25:42.921821 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:25:42.921445    2581 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-655999bffb-7z6bq"
May 26 15:25:42.921821 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:25:42.921660    2581 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-655999bffb-7z6bq"
May 26 15:25:42.922304 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:25:42.922264    2581 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-655999bffb-7z6bq"
May 26 15:25:42.922423 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:25:42.922330    2581 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-655999bffb-7z6bq"
May 26 15:25:42.922483 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:25:42.922420    2581 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-655999bffb-7z6bq"
May 26 15:25:42.926117 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:25:42.926096    2581 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-655999bffb-7z6bq"
May 26 15:25:43.050689 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:25:43.050668    2581 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-655999bffb-7z6bq"
May 26 15:26:44.336407 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:26:44.336317    2581 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-655999bffb-7z6bq"]
May 26 15:26:44.336878 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:26:44.336759    2581 kuberuntime_container.go:864] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-655999bffb-7z6bq" podUID="9a4dc740-20ca-4204-8c09-944d66fd84af" containerName="registry" containerID="cri-o://ec31e694c5ee99d4b407adf2c666187f804b7845c139238be7f22fdcfa88e2fc" gracePeriod=30
May 26 15:26:44.336953 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:26:44.336874    2581 kuberuntime_container.go:864] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-655999bffb-7z6bq" podUID="9a4dc740-20ca-4204-8c09-944d66fd84af" containerName="offline" containerID="cri-o://8edab7c2add6c1635bee754f64ce1cb20d14b91054b9f9ba995d7634843e91cb" gracePeriod=30
May 26 15:26:44.336953 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:26:44.336888    2581 kuberuntime_container.go:864] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-655999bffb-7z6bq" podUID="9a4dc740-20ca-4204-8c09-944d66fd84af" containerName="online" containerID="cri-o://6b7de40c15d6e128d1bbdc1ec1307304adc674d20974294b3438b6f3c8b0a0b1" gracePeriod=30
May 26 15:26:44.337054 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:26:44.336934    2581 kuberuntime_container.go:864] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-655999bffb-7z6bq" podUID="9a4dc740-20ca-4204-8c09-944d66fd84af" containerName="ui" containerID="cri-o://4871cc2acf6423e734bd85cf672da047532f3abf90ae2e6e760af262e6ac329d" gracePeriod=30
May 26 15:26:44.613377 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:26:44.613264    2581 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["test-ns-feast/feast-simple-feast-setup-655999bffb-4frpq"]
May 26 15:26:44.617726 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:26:44.617700    2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-655999bffb-4frpq"
May 26 15:26:44.620414 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:26:44.620391    2581 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-dockercfg-8xxlx\""
May 26 15:26:44.633104 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:26:44.633079    2581 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-655999bffb-4frpq"]
May 26 15:26:44.762842 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:26:44.762798    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/60b1c233-ec4c-46db-b137-fb41ad4bc50f-offline-tls\") pod \"feast-simple-feast-setup-655999bffb-4frpq\" (UID: \"60b1c233-ec4c-46db-b137-fb41ad4bc50f\") " pod="test-ns-feast/feast-simple-feast-setup-655999bffb-4frpq"
May 26 15:26:44.763027 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:26:44.762861    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/60b1c233-ec4c-46db-b137-fb41ad4bc50f-registry-tls\") pod \"feast-simple-feast-setup-655999bffb-4frpq\" (UID: \"60b1c233-ec4c-46db-b137-fb41ad4bc50f\") " pod="test-ns-feast/feast-simple-feast-setup-655999bffb-4frpq"
May 26 15:26:44.763027 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:26:44.762916    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/60b1c233-ec4c-46db-b137-fb41ad4bc50f-feast-data\") pod \"feast-simple-feast-setup-655999bffb-4frpq\" (UID: \"60b1c233-ec4c-46db-b137-fb41ad4bc50f\") " pod="test-ns-feast/feast-simple-feast-setup-655999bffb-4frpq"
May 26 15:26:44.763127 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:26:44.763045    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m26t4\" (UniqueName: \"kubernetes.io/projected/60b1c233-ec4c-46db-b137-fb41ad4bc50f-kube-api-access-m26t4\") pod \"feast-simple-feast-setup-655999bffb-4frpq\" (UID: \"60b1c233-ec4c-46db-b137-fb41ad4bc50f\") " pod="test-ns-feast/feast-simple-feast-setup-655999bffb-4frpq"
May 26 15:26:44.763127 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:26:44.763100    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/60b1c233-ec4c-46db-b137-fb41ad4bc50f-ui-tls\") pod \"feast-simple-feast-setup-655999bffb-4frpq\" (UID: \"60b1c233-ec4c-46db-b137-fb41ad4bc50f\") " pod="test-ns-feast/feast-simple-feast-setup-655999bffb-4frpq"
May 26 15:26:44.763219 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:26:44.763140    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/60b1c233-ec4c-46db-b137-fb41ad4bc50f-online-tls\") pod \"feast-simple-feast-setup-655999bffb-4frpq\" (UID: \"60b1c233-ec4c-46db-b137-fb41ad4bc50f\") " pod="test-ns-feast/feast-simple-feast-setup-655999bffb-4frpq"
May 26 15:26:44.864354 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:26:44.864257    2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/60b1c233-ec4c-46db-b137-fb41ad4bc50f-registry-tls\") pod \"feast-simple-feast-setup-655999bffb-4frpq\" (UID: \"60b1c233-ec4c-46db-b137-fb41ad4bc50f\") " pod="test-ns-feast/feast-simple-feast-setup-655999bffb-4frpq"
May 26 15:26:44.864354 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:26:44.864338    2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/60b1c233-ec4c-46db-b137-fb41ad4bc50f-feast-data\") pod \"feast-simple-feast-setup-655999bffb-4frpq\" (UID: \"60b1c233-ec4c-46db-b137-fb41ad4bc50f\") " pod="test-ns-feast/feast-simple-feast-setup-655999bffb-4frpq"
May 26 15:26:44.864545 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:26:44.864393    2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-m26t4\" (UniqueName: \"kubernetes.io/projected/60b1c233-ec4c-46db-b137-fb41ad4bc50f-kube-api-access-m26t4\") pod \"feast-simple-feast-setup-655999bffb-4frpq\" (UID: \"60b1c233-ec4c-46db-b137-fb41ad4bc50f\") " pod="test-ns-feast/feast-simple-feast-setup-655999bffb-4frpq"
May 26 15:26:44.864545 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:26:44.864432    2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/60b1c233-ec4c-46db-b137-fb41ad4bc50f-ui-tls\") pod \"feast-simple-feast-setup-655999bffb-4frpq\" (UID: \"60b1c233-ec4c-46db-b137-fb41ad4bc50f\") " pod="test-ns-feast/feast-simple-feast-setup-655999bffb-4frpq"
May 26 15:26:44.864545 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:26:44.864467    2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/60b1c233-ec4c-46db-b137-fb41ad4bc50f-online-tls\") pod \"feast-simple-feast-setup-655999bffb-4frpq\" (UID: \"60b1c233-ec4c-46db-b137-fb41ad4bc50f\") " pod="test-ns-feast/feast-simple-feast-setup-655999bffb-4frpq"
May 26 15:26:44.864545 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:26:44.864504    2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/60b1c233-ec4c-46db-b137-fb41ad4bc50f-offline-tls\") pod \"feast-simple-feast-setup-655999bffb-4frpq\" (UID: \"60b1c233-ec4c-46db-b137-fb41ad4bc50f\") " pod="test-ns-feast/feast-simple-feast-setup-655999bffb-4frpq"
May 26 15:26:44.864732 ip-10-0-140-164 kubenswrapper[2581]: E0526 15:26:44.864586    2581 secret.go:189] Couldn't get secret test-ns-feast/feast-simple-feast-setup-ui-tls: secret "feast-simple-feast-setup-ui-tls" not found
May 26 15:26:44.864732 ip-10-0-140-164 kubenswrapper[2581]: E0526 15:26:44.864663    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/60b1c233-ec4c-46db-b137-fb41ad4bc50f-ui-tls podName:60b1c233-ec4c-46db-b137-fb41ad4bc50f nodeName:}" failed. No retries permitted until 2026-05-26 15:26:45.364638053 +0000 UTC m=+544.362341383 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "ui-tls" (UniqueName: "kubernetes.io/secret/60b1c233-ec4c-46db-b137-fb41ad4bc50f-ui-tls") pod "feast-simple-feast-setup-655999bffb-4frpq" (UID: "60b1c233-ec4c-46db-b137-fb41ad4bc50f") : secret "feast-simple-feast-setup-ui-tls" not found
May 26 15:26:44.864858 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:26:44.864820    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/60b1c233-ec4c-46db-b137-fb41ad4bc50f-feast-data\") pod \"feast-simple-feast-setup-655999bffb-4frpq\" (UID: \"60b1c233-ec4c-46db-b137-fb41ad4bc50f\") " pod="test-ns-feast/feast-simple-feast-setup-655999bffb-4frpq"
May 26 15:26:44.866982 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:26:44.866959    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/60b1c233-ec4c-46db-b137-fb41ad4bc50f-registry-tls\") pod \"feast-simple-feast-setup-655999bffb-4frpq\" (UID: \"60b1c233-ec4c-46db-b137-fb41ad4bc50f\") " pod="test-ns-feast/feast-simple-feast-setup-655999bffb-4frpq"
May 26 15:26:44.867105 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:26:44.867007    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/60b1c233-ec4c-46db-b137-fb41ad4bc50f-online-tls\") pod \"feast-simple-feast-setup-655999bffb-4frpq\" (UID: \"60b1c233-ec4c-46db-b137-fb41ad4bc50f\") " pod="test-ns-feast/feast-simple-feast-setup-655999bffb-4frpq"
May 26 15:26:44.867105 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:26:44.867014    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/60b1c233-ec4c-46db-b137-fb41ad4bc50f-offline-tls\") pod \"feast-simple-feast-setup-655999bffb-4frpq\" (UID: \"60b1c233-ec4c-46db-b137-fb41ad4bc50f\") " pod="test-ns-feast/feast-simple-feast-setup-655999bffb-4frpq"
May 26 15:26:44.877053 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:26:44.877014    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-m26t4\" (UniqueName: \"kubernetes.io/projected/60b1c233-ec4c-46db-b137-fb41ad4bc50f-kube-api-access-m26t4\") pod \"feast-simple-feast-setup-655999bffb-4frpq\" (UID: \"60b1c233-ec4c-46db-b137-fb41ad4bc50f\") " pod="test-ns-feast/feast-simple-feast-setup-655999bffb-4frpq"
May 26 15:26:45.234672 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:26:45.234602    2581 generic.go:358] "Generic (PLEG): container finished" podID="9a4dc740-20ca-4204-8c09-944d66fd84af" containerID="4871cc2acf6423e734bd85cf672da047532f3abf90ae2e6e760af262e6ac329d" exitCode=0
May 26 15:26:45.234672 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:26:45.234632    2581 generic.go:358] "Generic (PLEG): container finished" podID="9a4dc740-20ca-4204-8c09-944d66fd84af" containerID="6b7de40c15d6e128d1bbdc1ec1307304adc674d20974294b3438b6f3c8b0a0b1" exitCode=0
May 26 15:26:45.234798 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:26:45.234683    2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-655999bffb-7z6bq" event={"ID":"9a4dc740-20ca-4204-8c09-944d66fd84af","Type":"ContainerDied","Data":"4871cc2acf6423e734bd85cf672da047532f3abf90ae2e6e760af262e6ac329d"}
May 26 15:26:45.234798 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:26:45.234719    2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-655999bffb-7z6bq" event={"ID":"9a4dc740-20ca-4204-8c09-944d66fd84af","Type":"ContainerDied","Data":"6b7de40c15d6e128d1bbdc1ec1307304adc674d20974294b3438b6f3c8b0a0b1"}
May 26 15:26:45.368741 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:26:45.368714    2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/60b1c233-ec4c-46db-b137-fb41ad4bc50f-ui-tls\") pod \"feast-simple-feast-setup-655999bffb-4frpq\" (UID: \"60b1c233-ec4c-46db-b137-fb41ad4bc50f\") " pod="test-ns-feast/feast-simple-feast-setup-655999bffb-4frpq"
May 26 15:26:45.371101 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:26:45.371077    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/60b1c233-ec4c-46db-b137-fb41ad4bc50f-ui-tls\") pod \"feast-simple-feast-setup-655999bffb-4frpq\" (UID: \"60b1c233-ec4c-46db-b137-fb41ad4bc50f\") " pod="test-ns-feast/feast-simple-feast-setup-655999bffb-4frpq"
May 26 15:26:45.527150 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:26:45.527127    2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-655999bffb-4frpq"
May 26 15:26:45.661874 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:26:45.661847    2581 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-655999bffb-4frpq"]
May 26 15:26:45.662858 ip-10-0-140-164 kubenswrapper[2581]: W0526 15:26:45.662831    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod60b1c233_ec4c_46db_b137_fb41ad4bc50f.slice/crio-e367cf76b3b00bb67e65a4fa647358d9b90aae912d2fde7dfa686df1130791cb WatchSource:0}: Error finding container e367cf76b3b00bb67e65a4fa647358d9b90aae912d2fde7dfa686df1130791cb: Status 404 returned error can't find the container with id e367cf76b3b00bb67e65a4fa647358d9b90aae912d2fde7dfa686df1130791cb
May 26 15:26:46.238756 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:26:46.238721    2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-655999bffb-4frpq" event={"ID":"60b1c233-ec4c-46db-b137-fb41ad4bc50f","Type":"ContainerStarted","Data":"cdd563917dffb933e95645abdd8c77e55b6d5df7558a0c0311d0dcd3a562b4db"}
May 26 15:26:46.238756 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:26:46.238756    2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-655999bffb-4frpq" event={"ID":"60b1c233-ec4c-46db-b137-fb41ad4bc50f","Type":"ContainerStarted","Data":"e367cf76b3b00bb67e65a4fa647358d9b90aae912d2fde7dfa686df1130791cb"}
May 26 15:26:50.252008 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:26:50.251978    2581 generic.go:358] "Generic (PLEG): container finished" podID="60b1c233-ec4c-46db-b137-fb41ad4bc50f" containerID="cdd563917dffb933e95645abdd8c77e55b6d5df7558a0c0311d0dcd3a562b4db" exitCode=0
May 26 15:26:50.252342 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:26:50.252042    2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-655999bffb-4frpq" event={"ID":"60b1c233-ec4c-46db-b137-fb41ad4bc50f","Type":"ContainerDied","Data":"cdd563917dffb933e95645abdd8c77e55b6d5df7558a0c0311d0dcd3a562b4db"}
May 26 15:26:51.256667 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:26:51.256633    2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-655999bffb-4frpq" event={"ID":"60b1c233-ec4c-46db-b137-fb41ad4bc50f","Type":"ContainerStarted","Data":"e74c46f9263ddc956a4692ab50b17f20bbf406ceceb08baa081990429478f7f0"}
May 26 15:26:52.922661 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:26:52.922621    2581 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-655999bffb-7z6bq" podUID="9a4dc740-20ca-4204-8c09-944d66fd84af" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.22:8443: connect: connection refused"
May 26 15:26:53.047989 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:26:53.047951    2581 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-655999bffb-7z6bq" podUID="9a4dc740-20ca-4204-8c09-944d66fd84af" containerName="online" probeResult="failure" output="Get \"https://10.132.0.22:6567/health\": dial tcp 10.132.0.22:6567: connect: connection refused"
May 26 15:26:56.272998 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:26:56.272959    2581 generic.go:358] "Generic (PLEG): container finished" podID="60b1c233-ec4c-46db-b137-fb41ad4bc50f" containerID="e74c46f9263ddc956a4692ab50b17f20bbf406ceceb08baa081990429478f7f0" exitCode=0
May 26 15:26:56.273391 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:26:56.273035    2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-655999bffb-4frpq" event={"ID":"60b1c233-ec4c-46db-b137-fb41ad4bc50f","Type":"ContainerDied","Data":"e74c46f9263ddc956a4692ab50b17f20bbf406ceceb08baa081990429478f7f0"}
May 26 15:26:57.280763 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:26:57.280723    2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-655999bffb-4frpq" event={"ID":"60b1c233-ec4c-46db-b137-fb41ad4bc50f","Type":"ContainerStarted","Data":"8a73c3581e13843b72e6782148932d9983d530fd33734006dd44160122145e91"}
May 26 15:26:57.281223 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:26:57.280773    2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-655999bffb-4frpq" event={"ID":"60b1c233-ec4c-46db-b137-fb41ad4bc50f","Type":"ContainerStarted","Data":"2178b66944b3776e437ede3594d90d4ace32029a6566f7503aaa89f4efe6040d"}
May 26 15:26:57.281223 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:26:57.280789    2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-655999bffb-4frpq" event={"ID":"60b1c233-ec4c-46db-b137-fb41ad4bc50f","Type":"ContainerStarted","Data":"b59ae1bd24ac1dd6e61f747c9ee8f32d6dbeb48893faf5e4672bd4e077f701b1"}
May 26 15:26:57.281223 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:26:57.280801    2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-655999bffb-4frpq" event={"ID":"60b1c233-ec4c-46db-b137-fb41ad4bc50f","Type":"ContainerStarted","Data":"400bc554324210f1c86dbc784f314a62f7352e3c8541e40acb4f53d34c0c84cc"}
May 26 15:26:57.309910 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:26:57.309846    2581 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="test-ns-feast/feast-simple-feast-setup-655999bffb-4frpq" podStartSLOduration=13.309811917 podStartE2EDuration="13.309811917s" podCreationTimestamp="2026-05-26 15:26:44 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-26 15:26:57.307854611 +0000 UTC m=+556.305557944" watchObservedRunningTime="2026-05-26 15:26:57.309811917 +0000 UTC m=+556.307515250"
May 26 15:26:57.528306 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:26:57.528190    2581 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-655999bffb-4frpq"
May 26 15:26:57.528306 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:26:57.528240    2581 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-655999bffb-4frpq"
May 26 15:26:57.528306 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:26:57.528255    2581 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-655999bffb-4frpq"
May 26 15:26:57.528306 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:26:57.528287    2581 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-655999bffb-4frpq"
May 26 15:26:57.530652 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:26:57.530524    2581 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-655999bffb-4frpq" podUID="60b1c233-ec4c-46db-b137-fb41ad4bc50f" containerName="offline" probeResult="failure" output="dial tcp 10.132.0.23:8816: connect: connection refused"
May 26 15:26:57.530652 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:26:57.530553    2581 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-655999bffb-4frpq" podUID="60b1c233-ec4c-46db-b137-fb41ad4bc50f" containerName="registry" probeResult="failure" output="dial tcp 10.132.0.23:6571: connect: connection refused"
May 26 15:26:57.530652 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:26:57.530566    2581 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-655999bffb-4frpq" podUID="60b1c233-ec4c-46db-b137-fb41ad4bc50f" containerName="online" probeResult="failure" output="Get \"https://10.132.0.23:6567/health\": dial tcp 10.132.0.23:6567: connect: connection refused"
May 26 15:26:57.530652 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:26:57.530586    2581 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-655999bffb-4frpq" podUID="60b1c233-ec4c-46db-b137-fb41ad4bc50f" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.23:8443: connect: connection refused"
May 26 15:27:00.528052 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:27:00.527990    2581 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-655999bffb-4frpq" podUID="60b1c233-ec4c-46db-b137-fb41ad4bc50f" containerName="registry" probeResult="failure" output="dial tcp 10.132.0.23:6571: connect: connection refused"
May 26 15:27:00.528594 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:27:00.527988    2581 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-655999bffb-4frpq" podUID="60b1c233-ec4c-46db-b137-fb41ad4bc50f" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.23:8443: connect: connection refused"
May 26 15:27:00.528594 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:27:00.527989    2581 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-655999bffb-4frpq" podUID="60b1c233-ec4c-46db-b137-fb41ad4bc50f" containerName="offline" probeResult="failure" output="dial tcp 10.132.0.23:8816: connect: connection refused"
May 26 15:27:00.528594 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:27:00.528006    2581 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-655999bffb-4frpq" podUID="60b1c233-ec4c-46db-b137-fb41ad4bc50f" containerName="online" probeResult="failure" output="Get \"https://10.132.0.23:6567/health\": dial tcp 10.132.0.23:6567: connect: connection refused"
May 26 15:27:02.922542 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:27:02.922492    2581 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-655999bffb-7z6bq" podUID="9a4dc740-20ca-4204-8c09-944d66fd84af" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.22:8443: connect: connection refused"
May 26 15:27:03.048725 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:27:03.048686    2581 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-655999bffb-7z6bq" podUID="9a4dc740-20ca-4204-8c09-944d66fd84af" containerName="online" probeResult="failure" output="Get \"https://10.132.0.22:6567/health\": dial tcp 10.132.0.22:6567: connect: connection refused"
May 26 15:27:03.528966 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:27:03.528932    2581 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-655999bffb-4frpq"
May 26 15:27:03.529131 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:27:03.529088    2581 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-655999bffb-4frpq"
May 26 15:27:03.529473 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:27:03.529443    2581 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-655999bffb-4frpq"
May 26 15:27:03.529638 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:27:03.529558    2581 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-655999bffb-4frpq"
May 26 15:27:03.529638 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:27:03.529593    2581 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-655999bffb-4frpq"
May 26 15:27:03.529638 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:27:03.529604    2581 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-655999bffb-4frpq"
May 26 15:27:03.529955 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:27:03.529928    2581 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-655999bffb-4frpq"
May 26 15:27:03.530053 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:27:03.530014    2581 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-655999bffb-4frpq"
May 26 15:27:03.530144 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:27:03.530121    2581 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-655999bffb-4frpq"
May 26 15:27:03.533718 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:27:03.533700    2581 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-655999bffb-4frpq"
May 26 15:27:04.305416 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:27:04.305389    2581 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-655999bffb-4frpq"
May 26 15:27:04.308456 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:27:04.308435    2581 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-655999bffb-4frpq"
May 26 15:27:12.922872 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:27:12.922830    2581 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-655999bffb-7z6bq" podUID="9a4dc740-20ca-4204-8c09-944d66fd84af" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.22:8443: connect: connection refused"
May 26 15:27:12.923245 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:27:12.922976    2581 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-655999bffb-7z6bq"
May 26 15:27:13.048199 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:27:13.048167    2581 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-655999bffb-7z6bq" podUID="9a4dc740-20ca-4204-8c09-944d66fd84af" containerName="online" probeResult="failure" output="Get \"https://10.132.0.22:6567/health\": dial tcp 10.132.0.22:6567: connect: connection refused"
May 26 15:27:13.048371 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:27:13.048320    2581 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-655999bffb-7z6bq"
May 26 15:27:14.980257 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:27:14.980237    2581 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-655999bffb-7z6bq"
May 26 15:27:15.099214 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:27:15.099185    2581 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/9a4dc740-20ca-4204-8c09-944d66fd84af-registry-tls\") pod \"9a4dc740-20ca-4204-8c09-944d66fd84af\" (UID: \"9a4dc740-20ca-4204-8c09-944d66fd84af\") "
May 26 15:27:15.099369 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:27:15.099249    2581 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/9a4dc740-20ca-4204-8c09-944d66fd84af-online-tls\") pod \"9a4dc740-20ca-4204-8c09-944d66fd84af\" (UID: \"9a4dc740-20ca-4204-8c09-944d66fd84af\") "
May 26 15:27:15.099369 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:27:15.099311    2581 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/9a4dc740-20ca-4204-8c09-944d66fd84af-ui-tls\") pod \"9a4dc740-20ca-4204-8c09-944d66fd84af\" (UID: \"9a4dc740-20ca-4204-8c09-944d66fd84af\") "
May 26 15:27:15.099369 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:27:15.099336    2581 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/9a4dc740-20ca-4204-8c09-944d66fd84af-offline-tls\") pod \"9a4dc740-20ca-4204-8c09-944d66fd84af\" (UID: \"9a4dc740-20ca-4204-8c09-944d66fd84af\") "
May 26 15:27:15.099541 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:27:15.099383    2581 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/9a4dc740-20ca-4204-8c09-944d66fd84af-feast-data\") pod \"9a4dc740-20ca-4204-8c09-944d66fd84af\" (UID: \"9a4dc740-20ca-4204-8c09-944d66fd84af\") "
May 26 15:27:15.099541 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:27:15.099449    2581 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ssfbm\" (UniqueName: \"kubernetes.io/projected/9a4dc740-20ca-4204-8c09-944d66fd84af-kube-api-access-ssfbm\") pod \"9a4dc740-20ca-4204-8c09-944d66fd84af\" (UID: \"9a4dc740-20ca-4204-8c09-944d66fd84af\") "
May 26 15:27:15.099952 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:27:15.099920    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9a4dc740-20ca-4204-8c09-944d66fd84af-feast-data" (OuterVolumeSpecName: "feast-data") pod "9a4dc740-20ca-4204-8c09-944d66fd84af" (UID: "9a4dc740-20ca-4204-8c09-944d66fd84af"). InnerVolumeSpecName "feast-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 26 15:27:15.101632 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:27:15.101599    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9a4dc740-20ca-4204-8c09-944d66fd84af-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "9a4dc740-20ca-4204-8c09-944d66fd84af" (UID: "9a4dc740-20ca-4204-8c09-944d66fd84af"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 26 15:27:15.101764 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:27:15.101664    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9a4dc740-20ca-4204-8c09-944d66fd84af-online-tls" (OuterVolumeSpecName: "online-tls") pod "9a4dc740-20ca-4204-8c09-944d66fd84af" (UID: "9a4dc740-20ca-4204-8c09-944d66fd84af"). InnerVolumeSpecName "online-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 26 15:27:15.101865 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:27:15.101848    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9a4dc740-20ca-4204-8c09-944d66fd84af-kube-api-access-ssfbm" (OuterVolumeSpecName: "kube-api-access-ssfbm") pod "9a4dc740-20ca-4204-8c09-944d66fd84af" (UID: "9a4dc740-20ca-4204-8c09-944d66fd84af"). InnerVolumeSpecName "kube-api-access-ssfbm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 26 15:27:15.102031 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:27:15.102014    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9a4dc740-20ca-4204-8c09-944d66fd84af-offline-tls" (OuterVolumeSpecName: "offline-tls") pod "9a4dc740-20ca-4204-8c09-944d66fd84af" (UID: "9a4dc740-20ca-4204-8c09-944d66fd84af"). InnerVolumeSpecName "offline-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 26 15:27:15.102071 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:27:15.102036    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9a4dc740-20ca-4204-8c09-944d66fd84af-ui-tls" (OuterVolumeSpecName: "ui-tls") pod "9a4dc740-20ca-4204-8c09-944d66fd84af" (UID: "9a4dc740-20ca-4204-8c09-944d66fd84af"). InnerVolumeSpecName "ui-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 26 15:27:15.200542 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:27:15.200517    2581 reconciler_common.go:299] "Volume detached for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/9a4dc740-20ca-4204-8c09-944d66fd84af-online-tls\") on node \"ip-10-0-140-164.ec2.internal\" DevicePath \"\""
May 26 15:27:15.200542 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:27:15.200537    2581 reconciler_common.go:299] "Volume detached for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/9a4dc740-20ca-4204-8c09-944d66fd84af-ui-tls\") on node \"ip-10-0-140-164.ec2.internal\" DevicePath \"\""
May 26 15:27:15.200656 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:27:15.200546    2581 reconciler_common.go:299] "Volume detached for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/9a4dc740-20ca-4204-8c09-944d66fd84af-offline-tls\") on node \"ip-10-0-140-164.ec2.internal\" DevicePath \"\""
May 26 15:27:15.200656 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:27:15.200554    2581 reconciler_common.go:299] "Volume detached for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/9a4dc740-20ca-4204-8c09-944d66fd84af-feast-data\") on node \"ip-10-0-140-164.ec2.internal\" DevicePath \"\""
May 26 15:27:15.200656 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:27:15.200562    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ssfbm\" (UniqueName: \"kubernetes.io/projected/9a4dc740-20ca-4204-8c09-944d66fd84af-kube-api-access-ssfbm\") on node \"ip-10-0-140-164.ec2.internal\" DevicePath \"\""
May 26 15:27:15.200656 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:27:15.200571    2581 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/9a4dc740-20ca-4204-8c09-944d66fd84af-registry-tls\") on node \"ip-10-0-140-164.ec2.internal\" DevicePath \"\""
May 26 15:27:15.341434 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:27:15.341412    2581 generic.go:358] "Generic (PLEG): container finished" podID="9a4dc740-20ca-4204-8c09-944d66fd84af" containerID="8edab7c2add6c1635bee754f64ce1cb20d14b91054b9f9ba995d7634843e91cb" exitCode=137
May 26 15:27:15.341434 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:27:15.341432    2581 generic.go:358] "Generic (PLEG): container finished" podID="9a4dc740-20ca-4204-8c09-944d66fd84af" containerID="ec31e694c5ee99d4b407adf2c666187f804b7845c139238be7f22fdcfa88e2fc" exitCode=137
May 26 15:27:15.341570 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:27:15.341459    2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-655999bffb-7z6bq" event={"ID":"9a4dc740-20ca-4204-8c09-944d66fd84af","Type":"ContainerDied","Data":"8edab7c2add6c1635bee754f64ce1cb20d14b91054b9f9ba995d7634843e91cb"}
May 26 15:27:15.341570 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:27:15.341482    2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-655999bffb-7z6bq" event={"ID":"9a4dc740-20ca-4204-8c09-944d66fd84af","Type":"ContainerDied","Data":"ec31e694c5ee99d4b407adf2c666187f804b7845c139238be7f22fdcfa88e2fc"}
May 26 15:27:15.341570 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:27:15.341492    2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-655999bffb-7z6bq" event={"ID":"9a4dc740-20ca-4204-8c09-944d66fd84af","Type":"ContainerDied","Data":"d0333f1f400e7d52b115638739a9554266c50ed1bf7a484898f1a4a83aedc2c0"}
May 26 15:27:15.341570 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:27:15.341493    2581 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-655999bffb-7z6bq"
May 26 15:27:15.341570 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:27:15.341513    2581 scope.go:117] "RemoveContainer" containerID="4871cc2acf6423e734bd85cf672da047532f3abf90ae2e6e760af262e6ac329d"
May 26 15:27:15.352751 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:27:15.352723    2581 scope.go:117] "RemoveContainer" containerID="8edab7c2add6c1635bee754f64ce1cb20d14b91054b9f9ba995d7634843e91cb"
May 26 15:27:15.360044 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:27:15.360027    2581 scope.go:117] "RemoveContainer" containerID="6b7de40c15d6e128d1bbdc1ec1307304adc674d20974294b3438b6f3c8b0a0b1"
May 26 15:27:15.365316 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:27:15.365295    2581 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-655999bffb-7z6bq"]
May 26 15:27:15.367868 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:27:15.367845    2581 scope.go:117] "RemoveContainer" containerID="ec31e694c5ee99d4b407adf2c666187f804b7845c139238be7f22fdcfa88e2fc"
May 26 15:27:15.368521 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:27:15.368500    2581 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-655999bffb-7z6bq"]
May 26 15:27:15.374497 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:27:15.374482    2581 scope.go:117] "RemoveContainer" containerID="af44b6d7d25f61c39ae04d5698eb286118f5db02b888c616d5e1dc38ba74c2d4"
May 26 15:27:15.381101 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:27:15.381069    2581 scope.go:117] "RemoveContainer" containerID="7f44ce9bb94b0e7fe5cefeffc12c9abf6ce8f9041697dbea18eaed698c67e252"
May 26 15:27:15.387333 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:27:15.387319    2581 scope.go:117] "RemoveContainer" containerID="4871cc2acf6423e734bd85cf672da047532f3abf90ae2e6e760af262e6ac329d"
May 26 15:27:15.387573 ip-10-0-140-164 kubenswrapper[2581]: E0526 15:27:15.387554    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4871cc2acf6423e734bd85cf672da047532f3abf90ae2e6e760af262e6ac329d\": container with ID starting with 4871cc2acf6423e734bd85cf672da047532f3abf90ae2e6e760af262e6ac329d not found: ID does not exist" containerID="4871cc2acf6423e734bd85cf672da047532f3abf90ae2e6e760af262e6ac329d"
May 26 15:27:15.387635 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:27:15.387585    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4871cc2acf6423e734bd85cf672da047532f3abf90ae2e6e760af262e6ac329d"} err="failed to get container status \"4871cc2acf6423e734bd85cf672da047532f3abf90ae2e6e760af262e6ac329d\": rpc error: code = NotFound desc = could not find container \"4871cc2acf6423e734bd85cf672da047532f3abf90ae2e6e760af262e6ac329d\": container with ID starting with 4871cc2acf6423e734bd85cf672da047532f3abf90ae2e6e760af262e6ac329d not found: ID does not exist"
May 26 15:27:15.387635 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:27:15.387609    2581 scope.go:117] "RemoveContainer" containerID="8edab7c2add6c1635bee754f64ce1cb20d14b91054b9f9ba995d7634843e91cb"
May 26 15:27:15.387854 ip-10-0-140-164 kubenswrapper[2581]: E0526 15:27:15.387837    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8edab7c2add6c1635bee754f64ce1cb20d14b91054b9f9ba995d7634843e91cb\": container with ID starting with 8edab7c2add6c1635bee754f64ce1cb20d14b91054b9f9ba995d7634843e91cb not found: ID does not exist" containerID="8edab7c2add6c1635bee754f64ce1cb20d14b91054b9f9ba995d7634843e91cb"
May 26 15:27:15.387893 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:27:15.387863    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8edab7c2add6c1635bee754f64ce1cb20d14b91054b9f9ba995d7634843e91cb"} err="failed to get container status \"8edab7c2add6c1635bee754f64ce1cb20d14b91054b9f9ba995d7634843e91cb\": rpc error: code = NotFound desc = could not find container \"8edab7c2add6c1635bee754f64ce1cb20d14b91054b9f9ba995d7634843e91cb\": container with ID starting with 8edab7c2add6c1635bee754f64ce1cb20d14b91054b9f9ba995d7634843e91cb not found: ID does not exist"
May 26 15:27:15.387893 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:27:15.387878    2581 scope.go:117] "RemoveContainer" containerID="6b7de40c15d6e128d1bbdc1ec1307304adc674d20974294b3438b6f3c8b0a0b1"
May 26 15:27:15.388081 ip-10-0-140-164 kubenswrapper[2581]: E0526 15:27:15.388065    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6b7de40c15d6e128d1bbdc1ec1307304adc674d20974294b3438b6f3c8b0a0b1\": container with ID starting with 6b7de40c15d6e128d1bbdc1ec1307304adc674d20974294b3438b6f3c8b0a0b1 not found: ID does not exist" containerID="6b7de40c15d6e128d1bbdc1ec1307304adc674d20974294b3438b6f3c8b0a0b1"
May 26 15:27:15.388125 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:27:15.388085    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6b7de40c15d6e128d1bbdc1ec1307304adc674d20974294b3438b6f3c8b0a0b1"} err="failed to get container status \"6b7de40c15d6e128d1bbdc1ec1307304adc674d20974294b3438b6f3c8b0a0b1\": rpc error: code = NotFound desc = could not find container \"6b7de40c15d6e128d1bbdc1ec1307304adc674d20974294b3438b6f3c8b0a0b1\": container with ID starting with 6b7de40c15d6e128d1bbdc1ec1307304adc674d20974294b3438b6f3c8b0a0b1 not found: ID does not exist"
May 26 15:27:15.388125 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:27:15.388100    2581 scope.go:117] "RemoveContainer" containerID="ec31e694c5ee99d4b407adf2c666187f804b7845c139238be7f22fdcfa88e2fc"
May 26 15:27:15.388314 ip-10-0-140-164 kubenswrapper[2581]: E0526 15:27:15.388293    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ec31e694c5ee99d4b407adf2c666187f804b7845c139238be7f22fdcfa88e2fc\": container with ID starting with ec31e694c5ee99d4b407adf2c666187f804b7845c139238be7f22fdcfa88e2fc not found: ID does not exist" containerID="ec31e694c5ee99d4b407adf2c666187f804b7845c139238be7f22fdcfa88e2fc"
May 26 15:27:15.388382 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:27:15.388323    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ec31e694c5ee99d4b407adf2c666187f804b7845c139238be7f22fdcfa88e2fc"} err="failed to get container status \"ec31e694c5ee99d4b407adf2c666187f804b7845c139238be7f22fdcfa88e2fc\": rpc error: code = NotFound desc = could not find container \"ec31e694c5ee99d4b407adf2c666187f804b7845c139238be7f22fdcfa88e2fc\": container with ID starting with ec31e694c5ee99d4b407adf2c666187f804b7845c139238be7f22fdcfa88e2fc not found: ID does not exist"
May 26 15:27:15.388382 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:27:15.388343    2581 scope.go:117] "RemoveContainer" containerID="af44b6d7d25f61c39ae04d5698eb286118f5db02b888c616d5e1dc38ba74c2d4"
May 26 15:27:15.388567 ip-10-0-140-164 kubenswrapper[2581]: E0526 15:27:15.388551    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"af44b6d7d25f61c39ae04d5698eb286118f5db02b888c616d5e1dc38ba74c2d4\": container with ID starting with af44b6d7d25f61c39ae04d5698eb286118f5db02b888c616d5e1dc38ba74c2d4 not found: ID does not exist" containerID="af44b6d7d25f61c39ae04d5698eb286118f5db02b888c616d5e1dc38ba74c2d4"
May 26 15:27:15.388638 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:27:15.388572    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"af44b6d7d25f61c39ae04d5698eb286118f5db02b888c616d5e1dc38ba74c2d4"} err="failed to get container status \"af44b6d7d25f61c39ae04d5698eb286118f5db02b888c616d5e1dc38ba74c2d4\": rpc error: code = NotFound desc = could not find container \"af44b6d7d25f61c39ae04d5698eb286118f5db02b888c616d5e1dc38ba74c2d4\": container with ID starting with af44b6d7d25f61c39ae04d5698eb286118f5db02b888c616d5e1dc38ba74c2d4 not found: ID does not exist"
May 26 15:27:15.388638 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:27:15.388590    2581 scope.go:117] "RemoveContainer" containerID="7f44ce9bb94b0e7fe5cefeffc12c9abf6ce8f9041697dbea18eaed698c67e252"
May 26 15:27:15.388794 ip-10-0-140-164 kubenswrapper[2581]: E0526 15:27:15.388777    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7f44ce9bb94b0e7fe5cefeffc12c9abf6ce8f9041697dbea18eaed698c67e252\": container with ID starting with 7f44ce9bb94b0e7fe5cefeffc12c9abf6ce8f9041697dbea18eaed698c67e252 not found: ID does not exist" containerID="7f44ce9bb94b0e7fe5cefeffc12c9abf6ce8f9041697dbea18eaed698c67e252"
May 26 15:27:15.388834 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:27:15.388799    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7f44ce9bb94b0e7fe5cefeffc12c9abf6ce8f9041697dbea18eaed698c67e252"} err="failed to get container status \"7f44ce9bb94b0e7fe5cefeffc12c9abf6ce8f9041697dbea18eaed698c67e252\": rpc error: code = NotFound desc = could not find container \"7f44ce9bb94b0e7fe5cefeffc12c9abf6ce8f9041697dbea18eaed698c67e252\": container with ID starting with 7f44ce9bb94b0e7fe5cefeffc12c9abf6ce8f9041697dbea18eaed698c67e252 not found: ID does not exist"
May 26 15:27:15.388834 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:27:15.388813    2581 scope.go:117] "RemoveContainer" containerID="4871cc2acf6423e734bd85cf672da047532f3abf90ae2e6e760af262e6ac329d"
May 26 15:27:15.388998 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:27:15.388980    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4871cc2acf6423e734bd85cf672da047532f3abf90ae2e6e760af262e6ac329d"} err="failed to get container status \"4871cc2acf6423e734bd85cf672da047532f3abf90ae2e6e760af262e6ac329d\": rpc error: code = NotFound desc = could not find container \"4871cc2acf6423e734bd85cf672da047532f3abf90ae2e6e760af262e6ac329d\": container with ID starting with 4871cc2acf6423e734bd85cf672da047532f3abf90ae2e6e760af262e6ac329d not found: ID does not exist"
May 26 15:27:15.389056 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:27:15.389000    2581 scope.go:117] "RemoveContainer" containerID="8edab7c2add6c1635bee754f64ce1cb20d14b91054b9f9ba995d7634843e91cb"
May 26 15:27:15.389214 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:27:15.389193    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8edab7c2add6c1635bee754f64ce1cb20d14b91054b9f9ba995d7634843e91cb"} err="failed to get container status \"8edab7c2add6c1635bee754f64ce1cb20d14b91054b9f9ba995d7634843e91cb\": rpc error: code = NotFound desc = could not find container \"8edab7c2add6c1635bee754f64ce1cb20d14b91054b9f9ba995d7634843e91cb\": container with ID starting with 8edab7c2add6c1635bee754f64ce1cb20d14b91054b9f9ba995d7634843e91cb not found: ID does not exist"
May 26 15:27:15.389355 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:27:15.389216    2581 scope.go:117] "RemoveContainer" containerID="6b7de40c15d6e128d1bbdc1ec1307304adc674d20974294b3438b6f3c8b0a0b1"
May 26 15:27:15.389460 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:27:15.389444    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6b7de40c15d6e128d1bbdc1ec1307304adc674d20974294b3438b6f3c8b0a0b1"} err="failed to get container status \"6b7de40c15d6e128d1bbdc1ec1307304adc674d20974294b3438b6f3c8b0a0b1\": rpc error: code = NotFound desc = could not find container \"6b7de40c15d6e128d1bbdc1ec1307304adc674d20974294b3438b6f3c8b0a0b1\": container with ID starting with 6b7de40c15d6e128d1bbdc1ec1307304adc674d20974294b3438b6f3c8b0a0b1 not found: ID does not exist"
May 26 15:27:15.389508 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:27:15.389461    2581 scope.go:117] "RemoveContainer" containerID="ec31e694c5ee99d4b407adf2c666187f804b7845c139238be7f22fdcfa88e2fc"
May 26 15:27:15.389652 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:27:15.389635    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ec31e694c5ee99d4b407adf2c666187f804b7845c139238be7f22fdcfa88e2fc"} err="failed to get container status \"ec31e694c5ee99d4b407adf2c666187f804b7845c139238be7f22fdcfa88e2fc\": rpc error: code = NotFound desc = could not find container \"ec31e694c5ee99d4b407adf2c666187f804b7845c139238be7f22fdcfa88e2fc\": container with ID starting with ec31e694c5ee99d4b407adf2c666187f804b7845c139238be7f22fdcfa88e2fc not found: ID does not exist"
May 26 15:27:15.389712 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:27:15.389655    2581 scope.go:117] "RemoveContainer" containerID="af44b6d7d25f61c39ae04d5698eb286118f5db02b888c616d5e1dc38ba74c2d4"
May 26 15:27:15.389846 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:27:15.389828    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"af44b6d7d25f61c39ae04d5698eb286118f5db02b888c616d5e1dc38ba74c2d4"} err="failed to get container status \"af44b6d7d25f61c39ae04d5698eb286118f5db02b888c616d5e1dc38ba74c2d4\": rpc error: code = NotFound desc = could not find container \"af44b6d7d25f61c39ae04d5698eb286118f5db02b888c616d5e1dc38ba74c2d4\": container with ID starting with af44b6d7d25f61c39ae04d5698eb286118f5db02b888c616d5e1dc38ba74c2d4 not found: ID does not exist"
May 26 15:27:15.389893 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:27:15.389846    2581 scope.go:117] "RemoveContainer" containerID="7f44ce9bb94b0e7fe5cefeffc12c9abf6ce8f9041697dbea18eaed698c67e252"
May 26 15:27:15.390037 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:27:15.390023    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7f44ce9bb94b0e7fe5cefeffc12c9abf6ce8f9041697dbea18eaed698c67e252"} err="failed to get container status \"7f44ce9bb94b0e7fe5cefeffc12c9abf6ce8f9041697dbea18eaed698c67e252\": rpc error: code = NotFound desc = could not find container \"7f44ce9bb94b0e7fe5cefeffc12c9abf6ce8f9041697dbea18eaed698c67e252\": container with ID starting with 7f44ce9bb94b0e7fe5cefeffc12c9abf6ce8f9041697dbea18eaed698c67e252 not found: ID does not exist"
May 26 15:27:15.640530 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:27:15.640481    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9a4dc740-20ca-4204-8c09-944d66fd84af" path="/var/lib/kubelet/pods/9a4dc740-20ca-4204-8c09-944d66fd84af/volumes"
May 26 15:27:41.535139 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:27:41.535107    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-gjh9c_a02c2727-c53c-48c3-aba7-acde4eef632c/ovn-acl-logging/0.log"
May 26 15:27:41.536608 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:27:41.536588    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-gjh9c_a02c2727-c53c-48c3-aba7-acde4eef632c/ovn-acl-logging/0.log"
May 26 15:28:06.538564 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:28:06.538475    2581 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-c6b77b8d6-w9zjk"]
May 26 15:28:06.538974 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:28:06.538853    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9a4dc740-20ca-4204-8c09-944d66fd84af" containerName="offline"
May 26 15:28:06.538974 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:28:06.538869    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="9a4dc740-20ca-4204-8c09-944d66fd84af" containerName="offline"
May 26 15:28:06.538974 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:28:06.538890    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9a4dc740-20ca-4204-8c09-944d66fd84af" containerName="feast-init"
May 26 15:28:06.538974 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:28:06.538898    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="9a4dc740-20ca-4204-8c09-944d66fd84af" containerName="feast-init"
May 26 15:28:06.538974 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:28:06.538916    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9a4dc740-20ca-4204-8c09-944d66fd84af" containerName="feast-apply"
May 26 15:28:06.538974 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:28:06.538925    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="9a4dc740-20ca-4204-8c09-944d66fd84af" containerName="feast-apply"
May 26 15:28:06.538974 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:28:06.538938    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9a4dc740-20ca-4204-8c09-944d66fd84af" containerName="registry"
May 26 15:28:06.538974 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:28:06.538945    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="9a4dc740-20ca-4204-8c09-944d66fd84af" containerName="registry"
May 26 15:28:06.538974 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:28:06.538960    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9a4dc740-20ca-4204-8c09-944d66fd84af" containerName="online"
May 26 15:28:06.538974 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:28:06.538967    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="9a4dc740-20ca-4204-8c09-944d66fd84af" containerName="online"
May 26 15:28:06.538974 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:28:06.538978    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9a4dc740-20ca-4204-8c09-944d66fd84af" containerName="ui"
May 26 15:28:06.539580 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:28:06.538987    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="9a4dc740-20ca-4204-8c09-944d66fd84af" containerName="ui"
May 26 15:28:06.539580 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:28:06.539057    2581 memory_manager.go:356] "RemoveStaleState removing state" podUID="9a4dc740-20ca-4204-8c09-944d66fd84af" containerName="online"
May 26 15:28:06.539580 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:28:06.539067    2581 memory_manager.go:356] "RemoveStaleState removing state" podUID="9a4dc740-20ca-4204-8c09-944d66fd84af" containerName="offline"
May 26 15:28:06.539580 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:28:06.539077    2581 memory_manager.go:356] "RemoveStaleState removing state" podUID="9a4dc740-20ca-4204-8c09-944d66fd84af" containerName="registry"
May 26 15:28:06.539580 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:28:06.539088    2581 memory_manager.go:356] "RemoveStaleState removing state" podUID="9a4dc740-20ca-4204-8c09-944d66fd84af" containerName="ui"
May 26 15:28:06.542417 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:28:06.542397    2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c6b77b8d6-w9zjk"
May 26 15:28:06.545495 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:28:06.545474    2581 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-online-tls\""
May 26 15:28:06.545652 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:28:06.545637    2581 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-ui-tls\""
May 26 15:28:06.545725 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:28:06.545662    2581 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-offline-tls\""
May 26 15:28:06.545783 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:28:06.545769    2581 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-remote-registry\"/\"openshift-service-ca.crt\""
May 26 15:28:06.545839 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:28:06.545808    2581 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-client-ca\""
May 26 15:28:06.546106 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:28:06.546080    2581 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-dockercfg-cqf68\""
May 26 15:28:06.546106 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:28:06.546096    2581 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-remote-registry\"/\"kube-root-ca.crt\""
May 26 15:28:06.546234 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:28:06.546086    2581 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-intra-comm\""
May 26 15:28:06.553230 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:28:06.553206    2581 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-c6b77b8d6-w9zjk"]
May 26 15:28:06.655457 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:28:06.655432    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/5c911176-1cbe-419b-80a2-b234ce795d3a-offline-tls\") pod \"feast-simple-feast-remote-setup-c6b77b8d6-w9zjk\" (UID: \"5c911176-1cbe-419b-80a2-b234ce795d3a\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c6b77b8d6-w9zjk"
May 26 15:28:06.655564 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:28:06.655499    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lrxsp\" (UniqueName: \"kubernetes.io/projected/5c911176-1cbe-419b-80a2-b234ce795d3a-kube-api-access-lrxsp\") pod \"feast-simple-feast-remote-setup-c6b77b8d6-w9zjk\" (UID: \"5c911176-1cbe-419b-80a2-b234ce795d3a\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c6b77b8d6-w9zjk"
May 26 15:28:06.655564 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:28:06.655531    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/5c911176-1cbe-419b-80a2-b234ce795d3a-feast-data\") pod \"feast-simple-feast-remote-setup-c6b77b8d6-w9zjk\" (UID: \"5c911176-1cbe-419b-80a2-b234ce795d3a\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c6b77b8d6-w9zjk"
May 26 15:28:06.655636 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:28:06.655616    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/configmap/5c911176-1cbe-419b-80a2-b234ce795d3a-registry-tls\") pod \"feast-simple-feast-remote-setup-c6b77b8d6-w9zjk\" (UID: \"5c911176-1cbe-419b-80a2-b234ce795d3a\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c6b77b8d6-w9zjk"
May 26 15:28:06.655689 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:28:06.655673    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/5c911176-1cbe-419b-80a2-b234ce795d3a-ui-tls\") pod \"feast-simple-feast-remote-setup-c6b77b8d6-w9zjk\" (UID: \"5c911176-1cbe-419b-80a2-b234ce795d3a\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c6b77b8d6-w9zjk"
May 26 15:28:06.655723 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:28:06.655712    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/5c911176-1cbe-419b-80a2-b234ce795d3a-online-tls\") pod \"feast-simple-feast-remote-setup-c6b77b8d6-w9zjk\" (UID: \"5c911176-1cbe-419b-80a2-b234ce795d3a\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c6b77b8d6-w9zjk"
May 26 15:28:06.756312 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:28:06.756284    2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/5c911176-1cbe-419b-80a2-b234ce795d3a-offline-tls\") pod \"feast-simple-feast-remote-setup-c6b77b8d6-w9zjk\" (UID: \"5c911176-1cbe-419b-80a2-b234ce795d3a\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c6b77b8d6-w9zjk"
May 26 15:28:06.756424 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:28:06.756344    2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-lrxsp\" (UniqueName: \"kubernetes.io/projected/5c911176-1cbe-419b-80a2-b234ce795d3a-kube-api-access-lrxsp\") pod \"feast-simple-feast-remote-setup-c6b77b8d6-w9zjk\" (UID: \"5c911176-1cbe-419b-80a2-b234ce795d3a\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c6b77b8d6-w9zjk"
May 26 15:28:06.756424 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:28:06.756378    2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/5c911176-1cbe-419b-80a2-b234ce795d3a-feast-data\") pod \"feast-simple-feast-remote-setup-c6b77b8d6-w9zjk\" (UID: \"5c911176-1cbe-419b-80a2-b234ce795d3a\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c6b77b8d6-w9zjk"
May 26 15:28:06.756536 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:28:06.756424    2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/configmap/5c911176-1cbe-419b-80a2-b234ce795d3a-registry-tls\") pod \"feast-simple-feast-remote-setup-c6b77b8d6-w9zjk\" (UID: \"5c911176-1cbe-419b-80a2-b234ce795d3a\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c6b77b8d6-w9zjk"
May 26 15:28:06.756536 ip-10-0-140-164 kubenswrapper[2581]: E0526 15:28:06.756466    2581 secret.go:189] Couldn't get secret test-ns-remote-registry/feast-simple-feast-remote-setup-offline-tls: secret "feast-simple-feast-remote-setup-offline-tls" not found
May 26 15:28:06.756643 ip-10-0-140-164 kubenswrapper[2581]: E0526 15:28:06.756540    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5c911176-1cbe-419b-80a2-b234ce795d3a-offline-tls podName:5c911176-1cbe-419b-80a2-b234ce795d3a nodeName:}" failed. No retries permitted until 2026-05-26 15:28:07.256520725 +0000 UTC m=+626.254224049 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "offline-tls" (UniqueName: "kubernetes.io/secret/5c911176-1cbe-419b-80a2-b234ce795d3a-offline-tls") pod "feast-simple-feast-remote-setup-c6b77b8d6-w9zjk" (UID: "5c911176-1cbe-419b-80a2-b234ce795d3a") : secret "feast-simple-feast-remote-setup-offline-tls" not found
May 26 15:28:06.756643 ip-10-0-140-164 kubenswrapper[2581]: E0526 15:28:06.756543    2581 secret.go:189] Couldn't get secret test-ns-remote-registry/feast-simple-feast-remote-setup-ui-tls: secret "feast-simple-feast-remote-setup-ui-tls" not found
May 26 15:28:06.756643 ip-10-0-140-164 kubenswrapper[2581]: E0526 15:28:06.756579    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5c911176-1cbe-419b-80a2-b234ce795d3a-ui-tls podName:5c911176-1cbe-419b-80a2-b234ce795d3a nodeName:}" failed. No retries permitted until 2026-05-26 15:28:07.25656851 +0000 UTC m=+626.254271823 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "ui-tls" (UniqueName: "kubernetes.io/secret/5c911176-1cbe-419b-80a2-b234ce795d3a-ui-tls") pod "feast-simple-feast-remote-setup-c6b77b8d6-w9zjk" (UID: "5c911176-1cbe-419b-80a2-b234ce795d3a") : secret "feast-simple-feast-remote-setup-ui-tls" not found
May 26 15:28:06.756643 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:28:06.756467    2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/5c911176-1cbe-419b-80a2-b234ce795d3a-ui-tls\") pod \"feast-simple-feast-remote-setup-c6b77b8d6-w9zjk\" (UID: \"5c911176-1cbe-419b-80a2-b234ce795d3a\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c6b77b8d6-w9zjk"
May 26 15:28:06.756643 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:28:06.756616    2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/5c911176-1cbe-419b-80a2-b234ce795d3a-online-tls\") pod \"feast-simple-feast-remote-setup-c6b77b8d6-w9zjk\" (UID: \"5c911176-1cbe-419b-80a2-b234ce795d3a\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c6b77b8d6-w9zjk"
May 26 15:28:06.756919 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:28:06.756890    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/5c911176-1cbe-419b-80a2-b234ce795d3a-feast-data\") pod \"feast-simple-feast-remote-setup-c6b77b8d6-w9zjk\" (UID: \"5c911176-1cbe-419b-80a2-b234ce795d3a\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c6b77b8d6-w9zjk"
May 26 15:28:06.757169 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:28:06.757146    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/configmap/5c911176-1cbe-419b-80a2-b234ce795d3a-registry-tls\") pod \"feast-simple-feast-remote-setup-c6b77b8d6-w9zjk\" (UID: \"5c911176-1cbe-419b-80a2-b234ce795d3a\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c6b77b8d6-w9zjk"
May 26 15:28:06.759081 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:28:06.759059    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/5c911176-1cbe-419b-80a2-b234ce795d3a-online-tls\") pod \"feast-simple-feast-remote-setup-c6b77b8d6-w9zjk\" (UID: \"5c911176-1cbe-419b-80a2-b234ce795d3a\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c6b77b8d6-w9zjk"
May 26 15:28:06.765924 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:28:06.765901    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lrxsp\" (UniqueName: \"kubernetes.io/projected/5c911176-1cbe-419b-80a2-b234ce795d3a-kube-api-access-lrxsp\") pod \"feast-simple-feast-remote-setup-c6b77b8d6-w9zjk\" (UID: \"5c911176-1cbe-419b-80a2-b234ce795d3a\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c6b77b8d6-w9zjk"
May 26 15:28:07.259330 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:28:07.259293    2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/5c911176-1cbe-419b-80a2-b234ce795d3a-ui-tls\") pod \"feast-simple-feast-remote-setup-c6b77b8d6-w9zjk\" (UID: \"5c911176-1cbe-419b-80a2-b234ce795d3a\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c6b77b8d6-w9zjk"
May 26 15:28:07.259474 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:28:07.259351    2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/5c911176-1cbe-419b-80a2-b234ce795d3a-offline-tls\") pod \"feast-simple-feast-remote-setup-c6b77b8d6-w9zjk\" (UID: \"5c911176-1cbe-419b-80a2-b234ce795d3a\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c6b77b8d6-w9zjk"
May 26 15:28:07.261856 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:28:07.261834    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/5c911176-1cbe-419b-80a2-b234ce795d3a-ui-tls\") pod \"feast-simple-feast-remote-setup-c6b77b8d6-w9zjk\" (UID: \"5c911176-1cbe-419b-80a2-b234ce795d3a\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c6b77b8d6-w9zjk"
May 26 15:28:07.261962 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:28:07.261883    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/5c911176-1cbe-419b-80a2-b234ce795d3a-offline-tls\") pod \"feast-simple-feast-remote-setup-c6b77b8d6-w9zjk\" (UID: \"5c911176-1cbe-419b-80a2-b234ce795d3a\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c6b77b8d6-w9zjk"
May 26 15:28:07.453581 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:28:07.453545    2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c6b77b8d6-w9zjk"
May 26 15:28:07.589239 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:28:07.589213    2581 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-c6b77b8d6-w9zjk"]
May 26 15:28:07.590580 ip-10-0-140-164 kubenswrapper[2581]: W0526 15:28:07.590541    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod5c911176_1cbe_419b_80a2_b234ce795d3a.slice/crio-5d7d0aeed6030395e07a986cacedd1684b512b75f6cb46ce9c848b011dbcf2c4 WatchSource:0}: Error finding container 5d7d0aeed6030395e07a986cacedd1684b512b75f6cb46ce9c848b011dbcf2c4: Status 404 returned error can't find the container with id 5d7d0aeed6030395e07a986cacedd1684b512b75f6cb46ce9c848b011dbcf2c4
May 26 15:28:08.507167 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:28:08.507125    2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c6b77b8d6-w9zjk" event={"ID":"5c911176-1cbe-419b-80a2-b234ce795d3a","Type":"ContainerStarted","Data":"f9b3cf2d3b3808edd6252ff1266c4a6b7fa82daac3d030697c0101f8b586becc"}
May 26 15:28:08.507167 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:28:08.507164    2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c6b77b8d6-w9zjk" event={"ID":"5c911176-1cbe-419b-80a2-b234ce795d3a","Type":"ContainerStarted","Data":"5d7d0aeed6030395e07a986cacedd1684b512b75f6cb46ce9c848b011dbcf2c4"}
May 26 15:28:12.522712 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:28:12.522680    2581 generic.go:358] "Generic (PLEG): container finished" podID="5c911176-1cbe-419b-80a2-b234ce795d3a" containerID="f9b3cf2d3b3808edd6252ff1266c4a6b7fa82daac3d030697c0101f8b586becc" exitCode=0
May 26 15:28:12.523116 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:28:12.522753    2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c6b77b8d6-w9zjk" event={"ID":"5c911176-1cbe-419b-80a2-b234ce795d3a","Type":"ContainerDied","Data":"f9b3cf2d3b3808edd6252ff1266c4a6b7fa82daac3d030697c0101f8b586becc"}
May 26 15:28:13.528020 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:28:13.527970    2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c6b77b8d6-w9zjk" event={"ID":"5c911176-1cbe-419b-80a2-b234ce795d3a","Type":"ContainerStarted","Data":"43d4695207528bd5bb56bf8772a472625820e83a65dcfc9730122e1c70107c78"}
May 26 15:28:18.545852 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:28:18.545812    2581 generic.go:358] "Generic (PLEG): container finished" podID="5c911176-1cbe-419b-80a2-b234ce795d3a" containerID="43d4695207528bd5bb56bf8772a472625820e83a65dcfc9730122e1c70107c78" exitCode=0
May 26 15:28:18.546235 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:28:18.545866    2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c6b77b8d6-w9zjk" event={"ID":"5c911176-1cbe-419b-80a2-b234ce795d3a","Type":"ContainerDied","Data":"43d4695207528bd5bb56bf8772a472625820e83a65dcfc9730122e1c70107c78"}
May 26 15:28:19.552378 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:28:19.552340    2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c6b77b8d6-w9zjk" event={"ID":"5c911176-1cbe-419b-80a2-b234ce795d3a","Type":"ContainerStarted","Data":"83fe2eb83064d1eb5a935d0ebd300833af71b3484fbb0a382903640f11ae1126"}
May 26 15:28:19.552378 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:28:19.552387    2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c6b77b8d6-w9zjk" event={"ID":"5c911176-1cbe-419b-80a2-b234ce795d3a","Type":"ContainerStarted","Data":"92a406e8ee5a09aff8b0f3dec42ac6153774de91b7a8dcf2efd70d316649eb8a"}
May 26 15:28:19.552894 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:28:19.552400    2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c6b77b8d6-w9zjk" event={"ID":"5c911176-1cbe-419b-80a2-b234ce795d3a","Type":"ContainerStarted","Data":"56745646ee40fdd78449162992ced073538ceeb3350ffe5aed6b9e0b887f30ea"}
May 26 15:28:19.580567 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:28:19.580511    2581 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c6b77b8d6-w9zjk" podStartSLOduration=13.580491083 podStartE2EDuration="13.580491083s" podCreationTimestamp="2026-05-26 15:28:06 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-26 15:28:19.577330687 +0000 UTC m=+638.575034021" watchObservedRunningTime="2026-05-26 15:28:19.580491083 +0000 UTC m=+638.578194416"
May 26 15:28:22.453693 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:28:22.453656    2581 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c6b77b8d6-w9zjk"
May 26 15:28:22.453693 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:28:22.453705    2581 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c6b77b8d6-w9zjk"
May 26 15:28:22.456398 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:28:22.453720    2581 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c6b77b8d6-w9zjk"
May 26 15:28:22.456398 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:28:22.455944    2581 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c6b77b8d6-w9zjk" podUID="5c911176-1cbe-419b-80a2-b234ce795d3a" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.24:8443: connect: connection refused"
May 26 15:28:22.456398 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:28:22.455983    2581 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c6b77b8d6-w9zjk" podUID="5c911176-1cbe-419b-80a2-b234ce795d3a" containerName="online" probeResult="failure" output="Get \"https://10.132.0.24:6567/health\": dial tcp 10.132.0.24:6567: connect: connection refused"
May 26 15:28:22.456398 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:28:22.456013    2581 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c6b77b8d6-w9zjk" podUID="5c911176-1cbe-419b-80a2-b234ce795d3a" containerName="offline" probeResult="failure" output="dial tcp 10.132.0.24:8816: connect: connection refused"
May 26 15:28:25.454766 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:28:25.454729    2581 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c6b77b8d6-w9zjk"
May 26 15:28:25.455298 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:28:25.455229    2581 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c6b77b8d6-w9zjk"
May 26 15:28:25.455386 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:28:25.455303    2581 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c6b77b8d6-w9zjk"
May 26 15:28:25.455742 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:28:25.455719    2581 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c6b77b8d6-w9zjk"
May 26 15:28:25.459407 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:28:25.459377    2581 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c6b77b8d6-w9zjk"
May 26 15:28:25.570632 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:28:25.570601    2581 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c6b77b8d6-w9zjk"
May 26 15:28:25.570632 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:28:25.570634    2581 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c6b77b8d6-w9zjk"
May 26 15:28:25.570983 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:28:25.570962    2581 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c6b77b8d6-w9zjk"
May 26 15:28:25.573339 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:28:25.573321    2581 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c6b77b8d6-w9zjk"
May 26 15:29:27.799384 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:29:27.799161    2581 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-c6b77b8d6-w9zjk"]
May 26 15:29:27.799862 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:29:27.799758    2581 kuberuntime_container.go:864] "Killing container with a grace period" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c6b77b8d6-w9zjk" podUID="5c911176-1cbe-419b-80a2-b234ce795d3a" containerName="online" containerID="cri-o://56745646ee40fdd78449162992ced073538ceeb3350ffe5aed6b9e0b887f30ea" gracePeriod=30
May 26 15:29:27.800045 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:29:27.799990    2581 kuberuntime_container.go:864] "Killing container with a grace period" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c6b77b8d6-w9zjk" podUID="5c911176-1cbe-419b-80a2-b234ce795d3a" containerName="ui" containerID="cri-o://83fe2eb83064d1eb5a935d0ebd300833af71b3484fbb0a382903640f11ae1126" gracePeriod=30
May 26 15:29:27.800158 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:29:27.800033    2581 kuberuntime_container.go:864] "Killing container with a grace period" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c6b77b8d6-w9zjk" podUID="5c911176-1cbe-419b-80a2-b234ce795d3a" containerName="offline" containerID="cri-o://92a406e8ee5a09aff8b0f3dec42ac6153774de91b7a8dcf2efd70d316649eb8a" gracePeriod=30
May 26 15:29:27.916960 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:29:27.916920    2581 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-655999bffb-4frpq"]
May 26 15:29:27.917320 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:29:27.917293    2581 kuberuntime_container.go:864] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-655999bffb-4frpq" podUID="60b1c233-ec4c-46db-b137-fb41ad4bc50f" containerName="registry" containerID="cri-o://400bc554324210f1c86dbc784f314a62f7352e3c8541e40acb4f53d34c0c84cc" gracePeriod=30
May 26 15:29:27.917431 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:29:27.917353    2581 kuberuntime_container.go:864] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-655999bffb-4frpq" podUID="60b1c233-ec4c-46db-b137-fb41ad4bc50f" containerName="ui" containerID="cri-o://8a73c3581e13843b72e6782148932d9983d530fd33734006dd44160122145e91" gracePeriod=30
May 26 15:29:27.917431 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:29:27.917390    2581 kuberuntime_container.go:864] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-655999bffb-4frpq" podUID="60b1c233-ec4c-46db-b137-fb41ad4bc50f" containerName="offline" containerID="cri-o://2178b66944b3776e437ede3594d90d4ace32029a6566f7503aaa89f4efe6040d" gracePeriod=30
May 26 15:29:27.917538 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:29:27.917430    2581 kuberuntime_container.go:864] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-655999bffb-4frpq" podUID="60b1c233-ec4c-46db-b137-fb41ad4bc50f" containerName="online" containerID="cri-o://b59ae1bd24ac1dd6e61f747c9ee8f32d6dbeb48893faf5e4672bd4e077f701b1" gracePeriod=30
May 26 15:29:28.770088 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:29:28.770058    2581 generic.go:358] "Generic (PLEG): container finished" podID="60b1c233-ec4c-46db-b137-fb41ad4bc50f" containerID="8a73c3581e13843b72e6782148932d9983d530fd33734006dd44160122145e91" exitCode=0
May 26 15:29:28.770088 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:29:28.770082    2581 generic.go:358] "Generic (PLEG): container finished" podID="60b1c233-ec4c-46db-b137-fb41ad4bc50f" containerID="b59ae1bd24ac1dd6e61f747c9ee8f32d6dbeb48893faf5e4672bd4e077f701b1" exitCode=0
May 26 15:29:28.770235 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:29:28.770128    2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-655999bffb-4frpq" event={"ID":"60b1c233-ec4c-46db-b137-fb41ad4bc50f","Type":"ContainerDied","Data":"8a73c3581e13843b72e6782148932d9983d530fd33734006dd44160122145e91"}
May 26 15:29:28.770235 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:29:28.770161    2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-655999bffb-4frpq" event={"ID":"60b1c233-ec4c-46db-b137-fb41ad4bc50f","Type":"ContainerDied","Data":"b59ae1bd24ac1dd6e61f747c9ee8f32d6dbeb48893faf5e4672bd4e077f701b1"}
May 26 15:29:28.772561 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:29:28.772541    2581 generic.go:358] "Generic (PLEG): container finished" podID="5c911176-1cbe-419b-80a2-b234ce795d3a" containerID="83fe2eb83064d1eb5a935d0ebd300833af71b3484fbb0a382903640f11ae1126" exitCode=0
May 26 15:29:28.772561 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:29:28.772557    2581 generic.go:358] "Generic (PLEG): container finished" podID="5c911176-1cbe-419b-80a2-b234ce795d3a" containerID="56745646ee40fdd78449162992ced073538ceeb3350ffe5aed6b9e0b887f30ea" exitCode=0
May 26 15:29:28.772678 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:29:28.772610    2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c6b77b8d6-w9zjk" event={"ID":"5c911176-1cbe-419b-80a2-b234ce795d3a","Type":"ContainerDied","Data":"83fe2eb83064d1eb5a935d0ebd300833af71b3484fbb0a382903640f11ae1126"}
May 26 15:29:28.772678 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:29:28.772633    2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c6b77b8d6-w9zjk" event={"ID":"5c911176-1cbe-419b-80a2-b234ce795d3a","Type":"ContainerDied","Data":"56745646ee40fdd78449162992ced073538ceeb3350ffe5aed6b9e0b887f30ea"}
May 26 15:29:33.529662 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:29:33.529615    2581 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-655999bffb-4frpq" podUID="60b1c233-ec4c-46db-b137-fb41ad4bc50f" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.23:8443: connect: connection refused"
May 26 15:29:34.306030 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:29:34.305977    2581 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-655999bffb-4frpq" podUID="60b1c233-ec4c-46db-b137-fb41ad4bc50f" containerName="online" probeResult="failure" output="Get \"https://10.132.0.23:6567/health\": dial tcp 10.132.0.23:6567: connect: connection refused"
May 26 15:29:35.455720 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:29:35.455677    2581 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c6b77b8d6-w9zjk" podUID="5c911176-1cbe-419b-80a2-b234ce795d3a" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.24:8443: connect: connection refused"
May 26 15:29:35.571382 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:29:35.571346    2581 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c6b77b8d6-w9zjk" podUID="5c911176-1cbe-419b-80a2-b234ce795d3a" containerName="online" probeResult="failure" output="Get \"https://10.132.0.24:6567/health\": dial tcp 10.132.0.24:6567: connect: connection refused"
May 26 15:29:43.529758 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:29:43.529707    2581 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-655999bffb-4frpq" podUID="60b1c233-ec4c-46db-b137-fb41ad4bc50f" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.23:8443: connect: connection refused"
May 26 15:29:44.305839 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:29:44.305799    2581 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-655999bffb-4frpq" podUID="60b1c233-ec4c-46db-b137-fb41ad4bc50f" containerName="online" probeResult="failure" output="Get \"https://10.132.0.23:6567/health\": dial tcp 10.132.0.23:6567: connect: connection refused"
May 26 15:29:45.456321 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:29:45.456256    2581 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c6b77b8d6-w9zjk" podUID="5c911176-1cbe-419b-80a2-b234ce795d3a" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.24:8443: connect: connection refused"
May 26 15:29:45.571263 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:29:45.571224    2581 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c6b77b8d6-w9zjk" podUID="5c911176-1cbe-419b-80a2-b234ce795d3a" containerName="online" probeResult="failure" output="Get \"https://10.132.0.24:6567/health\": dial tcp 10.132.0.24:6567: connect: connection refused"
May 26 15:29:53.530308 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:29:53.530239    2581 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-655999bffb-4frpq" podUID="60b1c233-ec4c-46db-b137-fb41ad4bc50f" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.23:8443: connect: connection refused"
May 26 15:29:53.530775 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:29:53.530403    2581 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-655999bffb-4frpq"
May 26 15:29:54.305794 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:29:54.305756    2581 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-655999bffb-4frpq" podUID="60b1c233-ec4c-46db-b137-fb41ad4bc50f" containerName="online" probeResult="failure" output="Get \"https://10.132.0.23:6567/health\": dial tcp 10.132.0.23:6567: connect: connection refused"
May 26 15:29:54.305965 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:29:54.305863    2581 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-655999bffb-4frpq"
May 26 15:29:55.456400 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:29:55.456352    2581 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c6b77b8d6-w9zjk" podUID="5c911176-1cbe-419b-80a2-b234ce795d3a" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.24:8443: connect: connection refused"
May 26 15:29:55.456867 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:29:55.456512    2581 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c6b77b8d6-w9zjk"
May 26 15:29:55.571728 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:29:55.571689    2581 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c6b77b8d6-w9zjk" podUID="5c911176-1cbe-419b-80a2-b234ce795d3a" containerName="online" probeResult="failure" output="Get \"https://10.132.0.24:6567/health\": dial tcp 10.132.0.24:6567: connect: connection refused"
May 26 15:29:55.571895 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:29:55.571807    2581 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c6b77b8d6-w9zjk"
May 26 15:29:57.855387 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:29:57.855359    2581 generic.go:358] "Generic (PLEG): container finished" podID="5c911176-1cbe-419b-80a2-b234ce795d3a" containerID="92a406e8ee5a09aff8b0f3dec42ac6153774de91b7a8dcf2efd70d316649eb8a" exitCode=137
May 26 15:29:57.855671 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:29:57.855427    2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c6b77b8d6-w9zjk" event={"ID":"5c911176-1cbe-419b-80a2-b234ce795d3a","Type":"ContainerDied","Data":"92a406e8ee5a09aff8b0f3dec42ac6153774de91b7a8dcf2efd70d316649eb8a"}
May 26 15:29:58.453311 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:29:58.453263    2581 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c6b77b8d6-w9zjk"
May 26 15:29:58.551579 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:29:58.551555    2581 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/configmap/5c911176-1cbe-419b-80a2-b234ce795d3a-registry-tls\") pod \"5c911176-1cbe-419b-80a2-b234ce795d3a\" (UID: \"5c911176-1cbe-419b-80a2-b234ce795d3a\") "
May 26 15:29:58.551713 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:29:58.551615    2581 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/5c911176-1cbe-419b-80a2-b234ce795d3a-online-tls\") pod \"5c911176-1cbe-419b-80a2-b234ce795d3a\" (UID: \"5c911176-1cbe-419b-80a2-b234ce795d3a\") "
May 26 15:29:58.551713 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:29:58.551642    2581 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lrxsp\" (UniqueName: \"kubernetes.io/projected/5c911176-1cbe-419b-80a2-b234ce795d3a-kube-api-access-lrxsp\") pod \"5c911176-1cbe-419b-80a2-b234ce795d3a\" (UID: \"5c911176-1cbe-419b-80a2-b234ce795d3a\") "
May 26 15:29:58.551713 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:29:58.551662    2581 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/5c911176-1cbe-419b-80a2-b234ce795d3a-feast-data\") pod \"5c911176-1cbe-419b-80a2-b234ce795d3a\" (UID: \"5c911176-1cbe-419b-80a2-b234ce795d3a\") "
May 26 15:29:58.551876 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:29:58.551740    2581 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/5c911176-1cbe-419b-80a2-b234ce795d3a-offline-tls\") pod \"5c911176-1cbe-419b-80a2-b234ce795d3a\" (UID: \"5c911176-1cbe-419b-80a2-b234ce795d3a\") "
May 26 15:29:58.551876 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:29:58.551763    2581 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/5c911176-1cbe-419b-80a2-b234ce795d3a-ui-tls\") pod \"5c911176-1cbe-419b-80a2-b234ce795d3a\" (UID: \"5c911176-1cbe-419b-80a2-b234ce795d3a\") "
May 26 15:29:58.552049 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:29:58.552006    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5c911176-1cbe-419b-80a2-b234ce795d3a-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "5c911176-1cbe-419b-80a2-b234ce795d3a" (UID: "5c911176-1cbe-419b-80a2-b234ce795d3a"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 26 15:29:58.552216 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:29:58.552189    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5c911176-1cbe-419b-80a2-b234ce795d3a-feast-data" (OuterVolumeSpecName: "feast-data") pod "5c911176-1cbe-419b-80a2-b234ce795d3a" (UID: "5c911176-1cbe-419b-80a2-b234ce795d3a"). InnerVolumeSpecName "feast-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 26 15:29:58.554292 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:29:58.554241    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5c911176-1cbe-419b-80a2-b234ce795d3a-kube-api-access-lrxsp" (OuterVolumeSpecName: "kube-api-access-lrxsp") pod "5c911176-1cbe-419b-80a2-b234ce795d3a" (UID: "5c911176-1cbe-419b-80a2-b234ce795d3a"). InnerVolumeSpecName "kube-api-access-lrxsp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 26 15:29:58.554292 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:29:58.554257    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5c911176-1cbe-419b-80a2-b234ce795d3a-online-tls" (OuterVolumeSpecName: "online-tls") pod "5c911176-1cbe-419b-80a2-b234ce795d3a" (UID: "5c911176-1cbe-419b-80a2-b234ce795d3a"). InnerVolumeSpecName "online-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 26 15:29:58.554432 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:29:58.554344    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5c911176-1cbe-419b-80a2-b234ce795d3a-ui-tls" (OuterVolumeSpecName: "ui-tls") pod "5c911176-1cbe-419b-80a2-b234ce795d3a" (UID: "5c911176-1cbe-419b-80a2-b234ce795d3a"). InnerVolumeSpecName "ui-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 26 15:29:58.554432 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:29:58.554387    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5c911176-1cbe-419b-80a2-b234ce795d3a-offline-tls" (OuterVolumeSpecName: "offline-tls") pod "5c911176-1cbe-419b-80a2-b234ce795d3a" (UID: "5c911176-1cbe-419b-80a2-b234ce795d3a"). InnerVolumeSpecName "offline-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 26 15:29:58.555374 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:29:58.555359    2581 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-655999bffb-4frpq"
May 26 15:29:58.653201 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:29:58.653148    2581 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-m26t4\" (UniqueName: \"kubernetes.io/projected/60b1c233-ec4c-46db-b137-fb41ad4bc50f-kube-api-access-m26t4\") pod \"60b1c233-ec4c-46db-b137-fb41ad4bc50f\" (UID: \"60b1c233-ec4c-46db-b137-fb41ad4bc50f\") "
May 26 15:29:58.653201 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:29:58.653182    2581 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/60b1c233-ec4c-46db-b137-fb41ad4bc50f-feast-data\") pod \"60b1c233-ec4c-46db-b137-fb41ad4bc50f\" (UID: \"60b1c233-ec4c-46db-b137-fb41ad4bc50f\") "
May 26 15:29:58.653201 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:29:58.653198    2581 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/60b1c233-ec4c-46db-b137-fb41ad4bc50f-online-tls\") pod \"60b1c233-ec4c-46db-b137-fb41ad4bc50f\" (UID: \"60b1c233-ec4c-46db-b137-fb41ad4bc50f\") "
May 26 15:29:58.653424 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:29:58.653243    2581 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/60b1c233-ec4c-46db-b137-fb41ad4bc50f-offline-tls\") pod \"60b1c233-ec4c-46db-b137-fb41ad4bc50f\" (UID: \"60b1c233-ec4c-46db-b137-fb41ad4bc50f\") "
May 26 15:29:58.653424 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:29:58.653264    2581 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/60b1c233-ec4c-46db-b137-fb41ad4bc50f-ui-tls\") pod \"60b1c233-ec4c-46db-b137-fb41ad4bc50f\" (UID: \"60b1c233-ec4c-46db-b137-fb41ad4bc50f\") "
May 26 15:29:58.653424 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:29:58.653313    2581 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/60b1c233-ec4c-46db-b137-fb41ad4bc50f-registry-tls\") pod \"60b1c233-ec4c-46db-b137-fb41ad4bc50f\" (UID: \"60b1c233-ec4c-46db-b137-fb41ad4bc50f\") "
May 26 15:29:58.653590 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:29:58.653489    2581 reconciler_common.go:299] "Volume detached for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/5c911176-1cbe-419b-80a2-b234ce795d3a-offline-tls\") on node \"ip-10-0-140-164.ec2.internal\" DevicePath \"\""
May 26 15:29:58.653590 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:29:58.653508    2581 reconciler_common.go:299] "Volume detached for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/5c911176-1cbe-419b-80a2-b234ce795d3a-ui-tls\") on node \"ip-10-0-140-164.ec2.internal\" DevicePath \"\""
May 26 15:29:58.653590 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:29:58.653522    2581 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/configmap/5c911176-1cbe-419b-80a2-b234ce795d3a-registry-tls\") on node \"ip-10-0-140-164.ec2.internal\" DevicePath \"\""
May 26 15:29:58.653590 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:29:58.653537    2581 reconciler_common.go:299] "Volume detached for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/5c911176-1cbe-419b-80a2-b234ce795d3a-online-tls\") on node \"ip-10-0-140-164.ec2.internal\" DevicePath \"\""
May 26 15:29:58.653590 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:29:58.653552    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lrxsp\" (UniqueName: \"kubernetes.io/projected/5c911176-1cbe-419b-80a2-b234ce795d3a-kube-api-access-lrxsp\") on node \"ip-10-0-140-164.ec2.internal\" DevicePath \"\""
May 26 15:29:58.653590 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:29:58.653566    2581 reconciler_common.go:299] "Volume detached for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/5c911176-1cbe-419b-80a2-b234ce795d3a-feast-data\") on node \"ip-10-0-140-164.ec2.internal\" DevicePath \"\""
May 26 15:29:58.654046 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:29:58.653727    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/60b1c233-ec4c-46db-b137-fb41ad4bc50f-feast-data" (OuterVolumeSpecName: "feast-data") pod "60b1c233-ec4c-46db-b137-fb41ad4bc50f" (UID: "60b1c233-ec4c-46db-b137-fb41ad4bc50f"). InnerVolumeSpecName "feast-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 26 15:29:58.655181 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:29:58.655155    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/60b1c233-ec4c-46db-b137-fb41ad4bc50f-kube-api-access-m26t4" (OuterVolumeSpecName: "kube-api-access-m26t4") pod "60b1c233-ec4c-46db-b137-fb41ad4bc50f" (UID: "60b1c233-ec4c-46db-b137-fb41ad4bc50f"). InnerVolumeSpecName "kube-api-access-m26t4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 26 15:29:58.655398 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:29:58.655369    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/60b1c233-ec4c-46db-b137-fb41ad4bc50f-online-tls" (OuterVolumeSpecName: "online-tls") pod "60b1c233-ec4c-46db-b137-fb41ad4bc50f" (UID: "60b1c233-ec4c-46db-b137-fb41ad4bc50f"). InnerVolumeSpecName "online-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 26 15:29:58.655483 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:29:58.655433    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/60b1c233-ec4c-46db-b137-fb41ad4bc50f-offline-tls" (OuterVolumeSpecName: "offline-tls") pod "60b1c233-ec4c-46db-b137-fb41ad4bc50f" (UID: "60b1c233-ec4c-46db-b137-fb41ad4bc50f"). InnerVolumeSpecName "offline-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 26 15:29:58.655899 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:29:58.655883    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/60b1c233-ec4c-46db-b137-fb41ad4bc50f-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "60b1c233-ec4c-46db-b137-fb41ad4bc50f" (UID: "60b1c233-ec4c-46db-b137-fb41ad4bc50f"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 26 15:29:58.655934 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:29:58.655902    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/60b1c233-ec4c-46db-b137-fb41ad4bc50f-ui-tls" (OuterVolumeSpecName: "ui-tls") pod "60b1c233-ec4c-46db-b137-fb41ad4bc50f" (UID: "60b1c233-ec4c-46db-b137-fb41ad4bc50f"). InnerVolumeSpecName "ui-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 26 15:29:58.754150 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:29:58.754127    2581 reconciler_common.go:299] "Volume detached for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/60b1c233-ec4c-46db-b137-fb41ad4bc50f-offline-tls\") on node \"ip-10-0-140-164.ec2.internal\" DevicePath \"\""
May 26 15:29:58.754150 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:29:58.754149    2581 reconciler_common.go:299] "Volume detached for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/60b1c233-ec4c-46db-b137-fb41ad4bc50f-ui-tls\") on node \"ip-10-0-140-164.ec2.internal\" DevicePath \"\""
May 26 15:29:58.754287 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:29:58.754159    2581 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/60b1c233-ec4c-46db-b137-fb41ad4bc50f-registry-tls\") on node \"ip-10-0-140-164.ec2.internal\" DevicePath \"\""
May 26 15:29:58.754287 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:29:58.754167    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-m26t4\" (UniqueName: \"kubernetes.io/projected/60b1c233-ec4c-46db-b137-fb41ad4bc50f-kube-api-access-m26t4\") on node \"ip-10-0-140-164.ec2.internal\" DevicePath \"\""
May 26 15:29:58.754287 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:29:58.754177    2581 reconciler_common.go:299] "Volume detached for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/60b1c233-ec4c-46db-b137-fb41ad4bc50f-feast-data\") on node \"ip-10-0-140-164.ec2.internal\" DevicePath \"\""
May 26 15:29:58.754287 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:29:58.754185    2581 reconciler_common.go:299] "Volume detached for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/60b1c233-ec4c-46db-b137-fb41ad4bc50f-online-tls\") on node \"ip-10-0-140-164.ec2.internal\" DevicePath \"\""
May 26 15:29:58.861317 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:29:58.861287    2581 generic.go:358] "Generic (PLEG): container finished" podID="60b1c233-ec4c-46db-b137-fb41ad4bc50f" containerID="2178b66944b3776e437ede3594d90d4ace32029a6566f7503aaa89f4efe6040d" exitCode=137
May 26 15:29:58.861317 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:29:58.861312    2581 generic.go:358] "Generic (PLEG): container finished" podID="60b1c233-ec4c-46db-b137-fb41ad4bc50f" containerID="400bc554324210f1c86dbc784f314a62f7352e3c8541e40acb4f53d34c0c84cc" exitCode=137
May 26 15:29:58.861671 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:29:58.861364    2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-655999bffb-4frpq" event={"ID":"60b1c233-ec4c-46db-b137-fb41ad4bc50f","Type":"ContainerDied","Data":"2178b66944b3776e437ede3594d90d4ace32029a6566f7503aaa89f4efe6040d"}
May 26 15:29:58.861671 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:29:58.861398    2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-655999bffb-4frpq" event={"ID":"60b1c233-ec4c-46db-b137-fb41ad4bc50f","Type":"ContainerDied","Data":"400bc554324210f1c86dbc784f314a62f7352e3c8541e40acb4f53d34c0c84cc"}
May 26 15:29:58.861671 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:29:58.861410    2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-655999bffb-4frpq" event={"ID":"60b1c233-ec4c-46db-b137-fb41ad4bc50f","Type":"ContainerDied","Data":"e367cf76b3b00bb67e65a4fa647358d9b90aae912d2fde7dfa686df1130791cb"}
May 26 15:29:58.861671 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:29:58.861373    2581 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-655999bffb-4frpq"
May 26 15:29:58.861671 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:29:58.861426    2581 scope.go:117] "RemoveContainer" containerID="8a73c3581e13843b72e6782148932d9983d530fd33734006dd44160122145e91"
May 26 15:29:58.864128 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:29:58.864107    2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c6b77b8d6-w9zjk" event={"ID":"5c911176-1cbe-419b-80a2-b234ce795d3a","Type":"ContainerDied","Data":"5d7d0aeed6030395e07a986cacedd1684b512b75f6cb46ce9c848b011dbcf2c4"}
May 26 15:29:58.864207 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:29:58.864180    2581 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c6b77b8d6-w9zjk"
May 26 15:29:58.870777 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:29:58.870746    2581 scope.go:117] "RemoveContainer" containerID="2178b66944b3776e437ede3594d90d4ace32029a6566f7503aaa89f4efe6040d"
May 26 15:29:58.878195 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:29:58.878173    2581 scope.go:117] "RemoveContainer" containerID="b59ae1bd24ac1dd6e61f747c9ee8f32d6dbeb48893faf5e4672bd4e077f701b1"
May 26 15:29:58.885038 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:29:58.885022    2581 scope.go:117] "RemoveContainer" containerID="400bc554324210f1c86dbc784f314a62f7352e3c8541e40acb4f53d34c0c84cc"
May 26 15:29:58.889193 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:29:58.889168    2581 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-655999bffb-4frpq"]
May 26 15:29:58.892230 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:29:58.892207    2581 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-655999bffb-4frpq"]
May 26 15:29:58.893753 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:29:58.893732    2581 scope.go:117] "RemoveContainer" containerID="e74c46f9263ddc956a4692ab50b17f20bbf406ceceb08baa081990429478f7f0"
May 26 15:29:58.900370 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:29:58.900352    2581 scope.go:117] "RemoveContainer" containerID="cdd563917dffb933e95645abdd8c77e55b6d5df7558a0c0311d0dcd3a562b4db"
May 26 15:29:58.904077 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:29:58.904032    2581 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-c6b77b8d6-w9zjk"]
May 26 15:29:58.907540 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:29:58.907474    2581 scope.go:117] "RemoveContainer" containerID="8a73c3581e13843b72e6782148932d9983d530fd33734006dd44160122145e91"
May 26 15:29:58.908007 ip-10-0-140-164 kubenswrapper[2581]: E0526 15:29:58.907979    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8a73c3581e13843b72e6782148932d9983d530fd33734006dd44160122145e91\": container with ID starting with 8a73c3581e13843b72e6782148932d9983d530fd33734006dd44160122145e91 not found: ID does not exist" containerID="8a73c3581e13843b72e6782148932d9983d530fd33734006dd44160122145e91"
May 26 15:29:58.908112 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:29:58.908014    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8a73c3581e13843b72e6782148932d9983d530fd33734006dd44160122145e91"} err="failed to get container status \"8a73c3581e13843b72e6782148932d9983d530fd33734006dd44160122145e91\": rpc error: code = NotFound desc = could not find container \"8a73c3581e13843b72e6782148932d9983d530fd33734006dd44160122145e91\": container with ID starting with 8a73c3581e13843b72e6782148932d9983d530fd33734006dd44160122145e91 not found: ID does not exist"
May 26 15:29:58.908112 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:29:58.908031    2581 scope.go:117] "RemoveContainer" containerID="2178b66944b3776e437ede3594d90d4ace32029a6566f7503aaa89f4efe6040d"
May 26 15:29:58.908399 ip-10-0-140-164 kubenswrapper[2581]: E0526 15:29:58.908377    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2178b66944b3776e437ede3594d90d4ace32029a6566f7503aaa89f4efe6040d\": container with ID starting with 2178b66944b3776e437ede3594d90d4ace32029a6566f7503aaa89f4efe6040d not found: ID does not exist" containerID="2178b66944b3776e437ede3594d90d4ace32029a6566f7503aaa89f4efe6040d"
May 26 15:29:58.908484 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:29:58.908408    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2178b66944b3776e437ede3594d90d4ace32029a6566f7503aaa89f4efe6040d"} err="failed to get container status \"2178b66944b3776e437ede3594d90d4ace32029a6566f7503aaa89f4efe6040d\": rpc error: code = NotFound desc = could not find container \"2178b66944b3776e437ede3594d90d4ace32029a6566f7503aaa89f4efe6040d\": container with ID starting with 2178b66944b3776e437ede3594d90d4ace32029a6566f7503aaa89f4efe6040d not found: ID does not exist"
May 26 15:29:58.908484 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:29:58.908431    2581 scope.go:117] "RemoveContainer" containerID="b59ae1bd24ac1dd6e61f747c9ee8f32d6dbeb48893faf5e4672bd4e077f701b1"
May 26 15:29:58.908733 ip-10-0-140-164 kubenswrapper[2581]: E0526 15:29:58.908714    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b59ae1bd24ac1dd6e61f747c9ee8f32d6dbeb48893faf5e4672bd4e077f701b1\": container with ID starting with b59ae1bd24ac1dd6e61f747c9ee8f32d6dbeb48893faf5e4672bd4e077f701b1 not found: ID does not exist" containerID="b59ae1bd24ac1dd6e61f747c9ee8f32d6dbeb48893faf5e4672bd4e077f701b1"
May 26 15:29:58.908847 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:29:58.908739    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b59ae1bd24ac1dd6e61f747c9ee8f32d6dbeb48893faf5e4672bd4e077f701b1"} err="failed to get container status \"b59ae1bd24ac1dd6e61f747c9ee8f32d6dbeb48893faf5e4672bd4e077f701b1\": rpc error: code = NotFound desc = could not find container \"b59ae1bd24ac1dd6e61f747c9ee8f32d6dbeb48893faf5e4672bd4e077f701b1\": container with ID starting with b59ae1bd24ac1dd6e61f747c9ee8f32d6dbeb48893faf5e4672bd4e077f701b1 not found: ID does not exist"
May 26 15:29:58.908847 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:29:58.908759    2581 scope.go:117] "RemoveContainer" containerID="400bc554324210f1c86dbc784f314a62f7352e3c8541e40acb4f53d34c0c84cc"
May 26 15:29:58.909048 ip-10-0-140-164 kubenswrapper[2581]: E0526 15:29:58.909031    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"400bc554324210f1c86dbc784f314a62f7352e3c8541e40acb4f53d34c0c84cc\": container with ID starting with 400bc554324210f1c86dbc784f314a62f7352e3c8541e40acb4f53d34c0c84cc not found: ID does not exist" containerID="400bc554324210f1c86dbc784f314a62f7352e3c8541e40acb4f53d34c0c84cc"
May 26 15:29:58.909096 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:29:58.909053    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"400bc554324210f1c86dbc784f314a62f7352e3c8541e40acb4f53d34c0c84cc"} err="failed to get container status \"400bc554324210f1c86dbc784f314a62f7352e3c8541e40acb4f53d34c0c84cc\": rpc error: code = NotFound desc = could not find container \"400bc554324210f1c86dbc784f314a62f7352e3c8541e40acb4f53d34c0c84cc\": container with ID starting with 400bc554324210f1c86dbc784f314a62f7352e3c8541e40acb4f53d34c0c84cc not found: ID does not exist"
May 26 15:29:58.909096 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:29:58.909068    2581 scope.go:117] "RemoveContainer" containerID="e74c46f9263ddc956a4692ab50b17f20bbf406ceceb08baa081990429478f7f0"
May 26 15:29:58.909347 ip-10-0-140-164 kubenswrapper[2581]: E0526 15:29:58.909327    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e74c46f9263ddc956a4692ab50b17f20bbf406ceceb08baa081990429478f7f0\": container with ID starting with e74c46f9263ddc956a4692ab50b17f20bbf406ceceb08baa081990429478f7f0 not found: ID does not exist" containerID="e74c46f9263ddc956a4692ab50b17f20bbf406ceceb08baa081990429478f7f0"
May 26 15:29:58.909420 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:29:58.909350    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e74c46f9263ddc956a4692ab50b17f20bbf406ceceb08baa081990429478f7f0"} err="failed to get container status \"e74c46f9263ddc956a4692ab50b17f20bbf406ceceb08baa081990429478f7f0\": rpc error: code = NotFound desc = could not find container \"e74c46f9263ddc956a4692ab50b17f20bbf406ceceb08baa081990429478f7f0\": container with ID starting with e74c46f9263ddc956a4692ab50b17f20bbf406ceceb08baa081990429478f7f0 not found: ID does not exist"
May 26 15:29:58.909420 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:29:58.909368    2581 scope.go:117] "RemoveContainer" containerID="cdd563917dffb933e95645abdd8c77e55b6d5df7558a0c0311d0dcd3a562b4db"
May 26 15:29:58.909639 ip-10-0-140-164 kubenswrapper[2581]: E0526 15:29:58.909615    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cdd563917dffb933e95645abdd8c77e55b6d5df7558a0c0311d0dcd3a562b4db\": container with ID starting with cdd563917dffb933e95645abdd8c77e55b6d5df7558a0c0311d0dcd3a562b4db not found: ID does not exist" containerID="cdd563917dffb933e95645abdd8c77e55b6d5df7558a0c0311d0dcd3a562b4db"
May 26 15:29:58.909756 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:29:58.909642    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cdd563917dffb933e95645abdd8c77e55b6d5df7558a0c0311d0dcd3a562b4db"} err="failed to get container status \"cdd563917dffb933e95645abdd8c77e55b6d5df7558a0c0311d0dcd3a562b4db\": rpc error: code = NotFound desc = could not find container \"cdd563917dffb933e95645abdd8c77e55b6d5df7558a0c0311d0dcd3a562b4db\": container with ID starting with cdd563917dffb933e95645abdd8c77e55b6d5df7558a0c0311d0dcd3a562b4db not found: ID does not exist"
May 26 15:29:58.909756 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:29:58.909670    2581 scope.go:117] "RemoveContainer" containerID="8a73c3581e13843b72e6782148932d9983d530fd33734006dd44160122145e91"
May 26 15:29:58.909756 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:29:58.909651    2581 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-c6b77b8d6-w9zjk"]
May 26 15:29:58.909988 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:29:58.909964    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8a73c3581e13843b72e6782148932d9983d530fd33734006dd44160122145e91"} err="failed to get container status \"8a73c3581e13843b72e6782148932d9983d530fd33734006dd44160122145e91\": rpc error: code = NotFound desc = could not find container \"8a73c3581e13843b72e6782148932d9983d530fd33734006dd44160122145e91\": container with ID starting with 8a73c3581e13843b72e6782148932d9983d530fd33734006dd44160122145e91 not found: ID does not exist"
May 26 15:29:58.909988 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:29:58.909989    2581 scope.go:117] "RemoveContainer" containerID="2178b66944b3776e437ede3594d90d4ace32029a6566f7503aaa89f4efe6040d"
May 26 15:29:58.910256 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:29:58.910231    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2178b66944b3776e437ede3594d90d4ace32029a6566f7503aaa89f4efe6040d"} err="failed to get container status \"2178b66944b3776e437ede3594d90d4ace32029a6566f7503aaa89f4efe6040d\": rpc error: code = NotFound desc = could not find container \"2178b66944b3776e437ede3594d90d4ace32029a6566f7503aaa89f4efe6040d\": container with ID starting with 2178b66944b3776e437ede3594d90d4ace32029a6566f7503aaa89f4efe6040d not found: ID does not exist"
May 26 15:29:58.910374 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:29:58.910259    2581 scope.go:117] "RemoveContainer" containerID="b59ae1bd24ac1dd6e61f747c9ee8f32d6dbeb48893faf5e4672bd4e077f701b1"
May 26 15:29:58.910524 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:29:58.910496    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b59ae1bd24ac1dd6e61f747c9ee8f32d6dbeb48893faf5e4672bd4e077f701b1"} err="failed to get container status \"b59ae1bd24ac1dd6e61f747c9ee8f32d6dbeb48893faf5e4672bd4e077f701b1\": rpc error: code = NotFound desc = could not find container \"b59ae1bd24ac1dd6e61f747c9ee8f32d6dbeb48893faf5e4672bd4e077f701b1\": container with ID starting with b59ae1bd24ac1dd6e61f747c9ee8f32d6dbeb48893faf5e4672bd4e077f701b1 not found: ID does not exist"
May 26 15:29:58.910524 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:29:58.910514    2581 scope.go:117] "RemoveContainer" containerID="400bc554324210f1c86dbc784f314a62f7352e3c8541e40acb4f53d34c0c84cc"
May 26 15:29:58.910780 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:29:58.910758    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"400bc554324210f1c86dbc784f314a62f7352e3c8541e40acb4f53d34c0c84cc"} err="failed to get container status \"400bc554324210f1c86dbc784f314a62f7352e3c8541e40acb4f53d34c0c84cc\": rpc error: code = NotFound desc = could not find container \"400bc554324210f1c86dbc784f314a62f7352e3c8541e40acb4f53d34c0c84cc\": container with ID starting with 400bc554324210f1c86dbc784f314a62f7352e3c8541e40acb4f53d34c0c84cc not found: ID does not exist"
May 26 15:29:58.910848 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:29:58.910782    2581 scope.go:117] "RemoveContainer" containerID="e74c46f9263ddc956a4692ab50b17f20bbf406ceceb08baa081990429478f7f0"
May 26 15:29:58.911029 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:29:58.911008    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e74c46f9263ddc956a4692ab50b17f20bbf406ceceb08baa081990429478f7f0"} err="failed to get container status \"e74c46f9263ddc956a4692ab50b17f20bbf406ceceb08baa081990429478f7f0\": rpc error: code = NotFound desc = could not find container \"e74c46f9263ddc956a4692ab50b17f20bbf406ceceb08baa081990429478f7f0\": container with ID starting with e74c46f9263ddc956a4692ab50b17f20bbf406ceceb08baa081990429478f7f0 not found: ID does not exist"
May 26 15:29:58.911081 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:29:58.911030    2581 scope.go:117] "RemoveContainer" containerID="cdd563917dffb933e95645abdd8c77e55b6d5df7558a0c0311d0dcd3a562b4db"
May 26 15:29:58.911262 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:29:58.911245    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cdd563917dffb933e95645abdd8c77e55b6d5df7558a0c0311d0dcd3a562b4db"} err="failed to get container status \"cdd563917dffb933e95645abdd8c77e55b6d5df7558a0c0311d0dcd3a562b4db\": rpc error: code = NotFound desc = could not find container \"cdd563917dffb933e95645abdd8c77e55b6d5df7558a0c0311d0dcd3a562b4db\": container with ID starting with cdd563917dffb933e95645abdd8c77e55b6d5df7558a0c0311d0dcd3a562b4db not found: ID does not exist"
May 26 15:29:58.911262 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:29:58.911263    2581 scope.go:117] "RemoveContainer" containerID="83fe2eb83064d1eb5a935d0ebd300833af71b3484fbb0a382903640f11ae1126"
May 26 15:29:58.918081 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:29:58.918066    2581 scope.go:117] "RemoveContainer" containerID="92a406e8ee5a09aff8b0f3dec42ac6153774de91b7a8dcf2efd70d316649eb8a"
May 26 15:29:58.926589 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:29:58.926564    2581 scope.go:117] "RemoveContainer" containerID="56745646ee40fdd78449162992ced073538ceeb3350ffe5aed6b9e0b887f30ea"
May 26 15:29:58.933136 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:29:58.933122    2581 scope.go:117] "RemoveContainer" containerID="43d4695207528bd5bb56bf8772a472625820e83a65dcfc9730122e1c70107c78"
May 26 15:29:58.939561 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:29:58.939547    2581 scope.go:117] "RemoveContainer" containerID="f9b3cf2d3b3808edd6252ff1266c4a6b7fa82daac3d030697c0101f8b586becc"
May 26 15:29:59.641141 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:29:59.641113    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5c911176-1cbe-419b-80a2-b234ce795d3a" path="/var/lib/kubelet/pods/5c911176-1cbe-419b-80a2-b234ce795d3a/volumes"
May 26 15:29:59.641642 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:29:59.641626    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="60b1c233-ec4c-46db-b137-fb41ad4bc50f" path="/var/lib/kubelet/pods/60b1c233-ec4c-46db-b137-fb41ad4bc50f/volumes"
May 26 15:30:10.952371 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:30:10.952331    2581 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["test-ns-feast/postgres-7c7656cc6d-9fzwr"]
May 26 15:30:10.952796 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:30:10.952722    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5c911176-1cbe-419b-80a2-b234ce795d3a" containerName="offline"
May 26 15:30:10.952796 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:30:10.952739    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="5c911176-1cbe-419b-80a2-b234ce795d3a" containerName="offline"
May 26 15:30:10.952796 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:30:10.952749    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5c911176-1cbe-419b-80a2-b234ce795d3a" containerName="feast-apply"
May 26 15:30:10.952796 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:30:10.952755    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="5c911176-1cbe-419b-80a2-b234ce795d3a" containerName="feast-apply"
May 26 15:30:10.952796 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:30:10.952762    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="60b1c233-ec4c-46db-b137-fb41ad4bc50f" containerName="feast-init"
May 26 15:30:10.952796 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:30:10.952768    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="60b1c233-ec4c-46db-b137-fb41ad4bc50f" containerName="feast-init"
May 26 15:30:10.952796 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:30:10.952774    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5c911176-1cbe-419b-80a2-b234ce795d3a" containerName="feast-init"
May 26 15:30:10.952796 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:30:10.952779    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="5c911176-1cbe-419b-80a2-b234ce795d3a" containerName="feast-init"
May 26 15:30:10.952796 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:30:10.952790    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="60b1c233-ec4c-46db-b137-fb41ad4bc50f" containerName="ui"
May 26 15:30:10.952796 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:30:10.952796    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="60b1c233-ec4c-46db-b137-fb41ad4bc50f" containerName="ui"
May 26 15:30:10.952796 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:30:10.952801    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5c911176-1cbe-419b-80a2-b234ce795d3a" containerName="ui"
May 26 15:30:10.952796 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:30:10.952806    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="5c911176-1cbe-419b-80a2-b234ce795d3a" containerName="ui"
May 26 15:30:10.953346 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:30:10.952813    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="60b1c233-ec4c-46db-b137-fb41ad4bc50f" containerName="registry"
May 26 15:30:10.953346 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:30:10.952820    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="60b1c233-ec4c-46db-b137-fb41ad4bc50f" containerName="registry"
May 26 15:30:10.953346 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:30:10.952827    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="60b1c233-ec4c-46db-b137-fb41ad4bc50f" containerName="online"
May 26 15:30:10.953346 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:30:10.952832    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="60b1c233-ec4c-46db-b137-fb41ad4bc50f" containerName="online"
May 26 15:30:10.953346 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:30:10.952837    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5c911176-1cbe-419b-80a2-b234ce795d3a" containerName="online"
May 26 15:30:10.953346 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:30:10.952842    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="5c911176-1cbe-419b-80a2-b234ce795d3a" containerName="online"
May 26 15:30:10.953346 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:30:10.952849    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="60b1c233-ec4c-46db-b137-fb41ad4bc50f" containerName="feast-apply"
May 26 15:30:10.953346 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:30:10.952854    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="60b1c233-ec4c-46db-b137-fb41ad4bc50f" containerName="feast-apply"
May 26 15:30:10.953346 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:30:10.952859    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="60b1c233-ec4c-46db-b137-fb41ad4bc50f" containerName="offline"
May 26 15:30:10.953346 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:30:10.952863    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="60b1c233-ec4c-46db-b137-fb41ad4bc50f" containerName="offline"
May 26 15:30:10.953346 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:30:10.952906    2581 memory_manager.go:356] "RemoveStaleState removing state" podUID="60b1c233-ec4c-46db-b137-fb41ad4bc50f" containerName="online"
May 26 15:30:10.953346 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:30:10.952914    2581 memory_manager.go:356] "RemoveStaleState removing state" podUID="60b1c233-ec4c-46db-b137-fb41ad4bc50f" containerName="registry"
May 26 15:30:10.953346 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:30:10.952922    2581 memory_manager.go:356] "RemoveStaleState removing state" podUID="5c911176-1cbe-419b-80a2-b234ce795d3a" containerName="ui"
May 26 15:30:10.953346 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:30:10.952927    2581 memory_manager.go:356] "RemoveStaleState removing state" podUID="60b1c233-ec4c-46db-b137-fb41ad4bc50f" containerName="ui"
May 26 15:30:10.953346 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:30:10.952933    2581 memory_manager.go:356] "RemoveStaleState removing state" podUID="5c911176-1cbe-419b-80a2-b234ce795d3a" containerName="online"
May 26 15:30:10.953346 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:30:10.952940    2581 memory_manager.go:356] "RemoveStaleState removing state" podUID="60b1c233-ec4c-46db-b137-fb41ad4bc50f" containerName="offline"
May 26 15:30:10.953346 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:30:10.952945    2581 memory_manager.go:356] "RemoveStaleState removing state" podUID="5c911176-1cbe-419b-80a2-b234ce795d3a" containerName="offline"
May 26 15:30:10.958086 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:30:10.958061    2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/postgres-7c7656cc6d-9fzwr"
May 26 15:30:10.961606 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:30:10.961577    2581 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast\"/\"openshift-service-ca.crt\""
May 26 15:30:10.962661 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:30:10.962638    2581 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"postgres-secret\""
May 26 15:30:10.962894 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:30:10.962683    2581 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast\"/\"kube-root-ca.crt\""
May 26 15:30:10.963007 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:30:10.962747    2581 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"default-dockercfg-cwnwc\""
May 26 15:30:10.963309 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:30:10.963215    2581 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/postgres-7c7656cc6d-9fzwr"]
May 26 15:30:10.995480 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:30:10.995454    2581 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["test-ns-feast/redis-854544c579-dlcnk"]
May 26 15:30:10.998558 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:30:10.998540    2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/redis-854544c579-dlcnk"
May 26 15:30:11.008221 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:30:11.008195    2581 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/redis-854544c579-dlcnk"]
May 26 15:30:11.133145 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:30:11.133126    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"postgresdata\" (UniqueName: \"kubernetes.io/empty-dir/6c525c8b-56ba-42b7-85de-6f058df69229-postgresdata\") pod \"postgres-7c7656cc6d-9fzwr\" (UID: \"6c525c8b-56ba-42b7-85de-6f058df69229\") " pod="test-ns-feast/postgres-7c7656cc6d-9fzwr"
May 26 15:30:11.133233 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:30:11.133154    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6tbms\" (UniqueName: \"kubernetes.io/projected/6c525c8b-56ba-42b7-85de-6f058df69229-kube-api-access-6tbms\") pod \"postgres-7c7656cc6d-9fzwr\" (UID: \"6c525c8b-56ba-42b7-85de-6f058df69229\") " pod="test-ns-feast/postgres-7c7656cc6d-9fzwr"
May 26 15:30:11.133233 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:30:11.133186    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2p5nz\" (UniqueName: \"kubernetes.io/projected/5f377874-c46f-43be-9a7c-d13693f0aaa3-kube-api-access-2p5nz\") pod \"redis-854544c579-dlcnk\" (UID: \"5f377874-c46f-43be-9a7c-d13693f0aaa3\") " pod="test-ns-feast/redis-854544c579-dlcnk"
May 26 15:30:11.234448 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:30:11.234389    2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"postgresdata\" (UniqueName: \"kubernetes.io/empty-dir/6c525c8b-56ba-42b7-85de-6f058df69229-postgresdata\") pod \"postgres-7c7656cc6d-9fzwr\" (UID: \"6c525c8b-56ba-42b7-85de-6f058df69229\") " pod="test-ns-feast/postgres-7c7656cc6d-9fzwr"
May 26 15:30:11.234448 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:30:11.234421    2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-6tbms\" (UniqueName: \"kubernetes.io/projected/6c525c8b-56ba-42b7-85de-6f058df69229-kube-api-access-6tbms\") pod \"postgres-7c7656cc6d-9fzwr\" (UID: \"6c525c8b-56ba-42b7-85de-6f058df69229\") " pod="test-ns-feast/postgres-7c7656cc6d-9fzwr"
May 26 15:30:11.234579 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:30:11.234453    2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-2p5nz\" (UniqueName: \"kubernetes.io/projected/5f377874-c46f-43be-9a7c-d13693f0aaa3-kube-api-access-2p5nz\") pod \"redis-854544c579-dlcnk\" (UID: \"5f377874-c46f-43be-9a7c-d13693f0aaa3\") " pod="test-ns-feast/redis-854544c579-dlcnk"
May 26 15:30:11.234741 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:30:11.234723    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"postgresdata\" (UniqueName: \"kubernetes.io/empty-dir/6c525c8b-56ba-42b7-85de-6f058df69229-postgresdata\") pod \"postgres-7c7656cc6d-9fzwr\" (UID: \"6c525c8b-56ba-42b7-85de-6f058df69229\") " pod="test-ns-feast/postgres-7c7656cc6d-9fzwr"
May 26 15:30:11.243560 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:30:11.243534    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6tbms\" (UniqueName: \"kubernetes.io/projected/6c525c8b-56ba-42b7-85de-6f058df69229-kube-api-access-6tbms\") pod \"postgres-7c7656cc6d-9fzwr\" (UID: \"6c525c8b-56ba-42b7-85de-6f058df69229\") " pod="test-ns-feast/postgres-7c7656cc6d-9fzwr"
May 26 15:30:11.243560 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:30:11.243543    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2p5nz\" (UniqueName: \"kubernetes.io/projected/5f377874-c46f-43be-9a7c-d13693f0aaa3-kube-api-access-2p5nz\") pod \"redis-854544c579-dlcnk\" (UID: \"5f377874-c46f-43be-9a7c-d13693f0aaa3\") " pod="test-ns-feast/redis-854544c579-dlcnk"
May 26 15:30:11.277386 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:30:11.277365    2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/postgres-7c7656cc6d-9fzwr"
May 26 15:30:11.309045 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:30:11.309016    2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/redis-854544c579-dlcnk"
May 26 15:30:11.421236 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:30:11.421206    2581 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/postgres-7c7656cc6d-9fzwr"]
May 26 15:30:11.424565 ip-10-0-140-164 kubenswrapper[2581]: W0526 15:30:11.424542    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod6c525c8b_56ba_42b7_85de_6f058df69229.slice/crio-f9e2f050d858da5282611355c74a42df8e336451c146f254d5262ce0738ec72c WatchSource:0}: Error finding container f9e2f050d858da5282611355c74a42df8e336451c146f254d5262ce0738ec72c: Status 404 returned error can't find the container with id f9e2f050d858da5282611355c74a42df8e336451c146f254d5262ce0738ec72c
May 26 15:30:11.426253 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:30:11.426237    2581 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
May 26 15:30:11.439946 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:30:11.439917    2581 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/redis-854544c579-dlcnk"]
May 26 15:30:11.907505 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:30:11.907467    2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/redis-854544c579-dlcnk" event={"ID":"5f377874-c46f-43be-9a7c-d13693f0aaa3","Type":"ContainerStarted","Data":"459736ab5a45cc96f25dd69cd2b61403e152c925d4fa1dcf91b648b85a85291e"}
May 26 15:30:11.908391 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:30:11.908368    2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/postgres-7c7656cc6d-9fzwr" event={"ID":"6c525c8b-56ba-42b7-85de-6f058df69229","Type":"ContainerStarted","Data":"f9e2f050d858da5282611355c74a42df8e336451c146f254d5262ce0738ec72c"}
May 26 15:30:13.916100 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:30:13.916057    2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/redis-854544c579-dlcnk" event={"ID":"5f377874-c46f-43be-9a7c-d13693f0aaa3","Type":"ContainerStarted","Data":"af41d776800870a3af8c34ae3c96b18f42205174c94b2628cc8bc815325ee8e5"}
May 26 15:30:13.933597 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:30:13.933541    2581 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="test-ns-feast/redis-854544c579-dlcnk" podStartSLOduration=2.213852149 podStartE2EDuration="3.933522317s" podCreationTimestamp="2026-05-26 15:30:10 +0000 UTC" firstStartedPulling="2026-05-26 15:30:11.445710953 +0000 UTC m=+750.443414264" lastFinishedPulling="2026-05-26 15:30:13.165381122 +0000 UTC m=+752.163084432" observedRunningTime="2026-05-26 15:30:13.931677156 +0000 UTC m=+752.929380500" watchObservedRunningTime="2026-05-26 15:30:13.933522317 +0000 UTC m=+752.931225664"
May 26 15:30:18.932479 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:30:18.932436    2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/postgres-7c7656cc6d-9fzwr" event={"ID":"6c525c8b-56ba-42b7-85de-6f058df69229","Type":"ContainerStarted","Data":"ab8df2da54b18ab7f84c39a71f4cadd6da0a5b53665fe3cfa8bd509c2fa84721"}
May 26 15:30:18.949348 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:30:18.949264    2581 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="test-ns-feast/postgres-7c7656cc6d-9fzwr" podStartSLOduration=2.332575582 podStartE2EDuration="8.94924722s" podCreationTimestamp="2026-05-26 15:30:10 +0000 UTC" firstStartedPulling="2026-05-26 15:30:11.426427421 +0000 UTC m=+750.424130731" lastFinishedPulling="2026-05-26 15:30:18.043099056 +0000 UTC m=+757.040802369" observedRunningTime="2026-05-26 15:30:18.948345213 +0000 UTC m=+757.946048545" watchObservedRunningTime="2026-05-26 15:30:18.94924722 +0000 UTC m=+757.946950555"
May 26 15:30:21.821307 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:30:21.821252    2581 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["test-ns-feast/feast-credit-scoring-5cb8956c45-xtwhq"]
May 26 15:30:21.828330 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:30:21.828307    2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-credit-scoring-5cb8956c45-xtwhq"
May 26 15:30:21.832754 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:30:21.832732    2581 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-credit-scoring-online-tls\""
May 26 15:30:21.832754 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:30:21.832746    2581 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast\"/\"feast-credit-scoring-intra-comm\""
May 26 15:30:21.832908 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:30:21.832811    2581 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-credit-scoring-dockercfg-fxqqw\""
May 26 15:30:21.833024 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:30:21.833009    2581 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-credit-scoring-offline-tls\""
May 26 15:30:21.833095 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:30:21.833021    2581 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-credit-scoring-registry-tls\""
May 26 15:30:21.853325 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:30:21.853298    2581 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/feast-credit-scoring-5cb8956c45-xtwhq"]
May 26 15:30:22.012657 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:30:22.012625    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/5ec81244-4d7e-43b0-aa8f-56e400efcd19-registry-tls\") pod \"feast-credit-scoring-5cb8956c45-xtwhq\" (UID: \"5ec81244-4d7e-43b0-aa8f-56e400efcd19\") " pod="test-ns-feast/feast-credit-scoring-5cb8956c45-xtwhq"
May 26 15:30:22.012806 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:30:22.012666    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/5ec81244-4d7e-43b0-aa8f-56e400efcd19-feast-data\") pod \"feast-credit-scoring-5cb8956c45-xtwhq\" (UID: \"5ec81244-4d7e-43b0-aa8f-56e400efcd19\") " pod="test-ns-feast/feast-credit-scoring-5cb8956c45-xtwhq"
May 26 15:30:22.012806 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:30:22.012697    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mj6rf\" (UniqueName: \"kubernetes.io/projected/5ec81244-4d7e-43b0-aa8f-56e400efcd19-kube-api-access-mj6rf\") pod \"feast-credit-scoring-5cb8956c45-xtwhq\" (UID: \"5ec81244-4d7e-43b0-aa8f-56e400efcd19\") " pod="test-ns-feast/feast-credit-scoring-5cb8956c45-xtwhq"
May 26 15:30:22.012806 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:30:22.012780    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/5ec81244-4d7e-43b0-aa8f-56e400efcd19-online-tls\") pod \"feast-credit-scoring-5cb8956c45-xtwhq\" (UID: \"5ec81244-4d7e-43b0-aa8f-56e400efcd19\") " pod="test-ns-feast/feast-credit-scoring-5cb8956c45-xtwhq"
May 26 15:30:22.012944 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:30:22.012821    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/5ec81244-4d7e-43b0-aa8f-56e400efcd19-offline-tls\") pod \"feast-credit-scoring-5cb8956c45-xtwhq\" (UID: \"5ec81244-4d7e-43b0-aa8f-56e400efcd19\") " pod="test-ns-feast/feast-credit-scoring-5cb8956c45-xtwhq"
May 26 15:30:22.113579 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:30:22.113508    2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/5ec81244-4d7e-43b0-aa8f-56e400efcd19-online-tls\") pod \"feast-credit-scoring-5cb8956c45-xtwhq\" (UID: \"5ec81244-4d7e-43b0-aa8f-56e400efcd19\") " pod="test-ns-feast/feast-credit-scoring-5cb8956c45-xtwhq"
May 26 15:30:22.113705 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:30:22.113621    2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/5ec81244-4d7e-43b0-aa8f-56e400efcd19-offline-tls\") pod \"feast-credit-scoring-5cb8956c45-xtwhq\" (UID: \"5ec81244-4d7e-43b0-aa8f-56e400efcd19\") " pod="test-ns-feast/feast-credit-scoring-5cb8956c45-xtwhq"
May 26 15:30:22.113769 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:30:22.113712    2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/5ec81244-4d7e-43b0-aa8f-56e400efcd19-registry-tls\") pod \"feast-credit-scoring-5cb8956c45-xtwhq\" (UID: \"5ec81244-4d7e-43b0-aa8f-56e400efcd19\") " pod="test-ns-feast/feast-credit-scoring-5cb8956c45-xtwhq"
May 26 15:30:22.113769 ip-10-0-140-164 kubenswrapper[2581]: E0526 15:30:22.113747    2581 secret.go:189] Couldn't get secret test-ns-feast/feast-credit-scoring-offline-tls: secret "feast-credit-scoring-offline-tls" not found
May 26 15:30:22.113769 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:30:22.113761    2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/5ec81244-4d7e-43b0-aa8f-56e400efcd19-feast-data\") pod \"feast-credit-scoring-5cb8956c45-xtwhq\" (UID: \"5ec81244-4d7e-43b0-aa8f-56e400efcd19\") " pod="test-ns-feast/feast-credit-scoring-5cb8956c45-xtwhq"
May 26 15:30:22.113907 ip-10-0-140-164 kubenswrapper[2581]: E0526 15:30:22.113798    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5ec81244-4d7e-43b0-aa8f-56e400efcd19-offline-tls podName:5ec81244-4d7e-43b0-aa8f-56e400efcd19 nodeName:}" failed. No retries permitted until 2026-05-26 15:30:22.613782512 +0000 UTC m=+761.611485848 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "offline-tls" (UniqueName: "kubernetes.io/secret/5ec81244-4d7e-43b0-aa8f-56e400efcd19-offline-tls") pod "feast-credit-scoring-5cb8956c45-xtwhq" (UID: "5ec81244-4d7e-43b0-aa8f-56e400efcd19") : secret "feast-credit-scoring-offline-tls" not found
May 26 15:30:22.113907 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:30:22.113814    2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-mj6rf\" (UniqueName: \"kubernetes.io/projected/5ec81244-4d7e-43b0-aa8f-56e400efcd19-kube-api-access-mj6rf\") pod \"feast-credit-scoring-5cb8956c45-xtwhq\" (UID: \"5ec81244-4d7e-43b0-aa8f-56e400efcd19\") " pod="test-ns-feast/feast-credit-scoring-5cb8956c45-xtwhq"
May 26 15:30:22.114131 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:30:22.114111    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/5ec81244-4d7e-43b0-aa8f-56e400efcd19-feast-data\") pod \"feast-credit-scoring-5cb8956c45-xtwhq\" (UID: \"5ec81244-4d7e-43b0-aa8f-56e400efcd19\") " pod="test-ns-feast/feast-credit-scoring-5cb8956c45-xtwhq"
May 26 15:30:22.116212 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:30:22.116188    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/5ec81244-4d7e-43b0-aa8f-56e400efcd19-registry-tls\") pod \"feast-credit-scoring-5cb8956c45-xtwhq\" (UID: \"5ec81244-4d7e-43b0-aa8f-56e400efcd19\") " pod="test-ns-feast/feast-credit-scoring-5cb8956c45-xtwhq"
May 26 15:30:22.116385 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:30:22.116366    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/5ec81244-4d7e-43b0-aa8f-56e400efcd19-online-tls\") pod \"feast-credit-scoring-5cb8956c45-xtwhq\" (UID: \"5ec81244-4d7e-43b0-aa8f-56e400efcd19\") " pod="test-ns-feast/feast-credit-scoring-5cb8956c45-xtwhq"
May 26 15:30:22.125419 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:30:22.125396    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mj6rf\" (UniqueName: \"kubernetes.io/projected/5ec81244-4d7e-43b0-aa8f-56e400efcd19-kube-api-access-mj6rf\") pod \"feast-credit-scoring-5cb8956c45-xtwhq\" (UID: \"5ec81244-4d7e-43b0-aa8f-56e400efcd19\") " pod="test-ns-feast/feast-credit-scoring-5cb8956c45-xtwhq"
May 26 15:30:22.617399 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:30:22.617373    2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/5ec81244-4d7e-43b0-aa8f-56e400efcd19-offline-tls\") pod \"feast-credit-scoring-5cb8956c45-xtwhq\" (UID: \"5ec81244-4d7e-43b0-aa8f-56e400efcd19\") " pod="test-ns-feast/feast-credit-scoring-5cb8956c45-xtwhq"
May 26 15:30:22.619723 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:30:22.619701    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/5ec81244-4d7e-43b0-aa8f-56e400efcd19-offline-tls\") pod \"feast-credit-scoring-5cb8956c45-xtwhq\" (UID: \"5ec81244-4d7e-43b0-aa8f-56e400efcd19\") " pod="test-ns-feast/feast-credit-scoring-5cb8956c45-xtwhq"
May 26 15:30:22.739170 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:30:22.739141    2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-credit-scoring-5cb8956c45-xtwhq"
May 26 15:30:22.874755 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:30:22.874683    2581 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/feast-credit-scoring-5cb8956c45-xtwhq"]
May 26 15:30:22.876878 ip-10-0-140-164 kubenswrapper[2581]: W0526 15:30:22.876855    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5ec81244_4d7e_43b0_aa8f_56e400efcd19.slice/crio-f211d6309e569f1b1b0c4e05f5e71a7d8b05bbc6e9c7967c8eb3dcfbea998e35 WatchSource:0}: Error finding container f211d6309e569f1b1b0c4e05f5e71a7d8b05bbc6e9c7967c8eb3dcfbea998e35: Status 404 returned error can't find the container with id f211d6309e569f1b1b0c4e05f5e71a7d8b05bbc6e9c7967c8eb3dcfbea998e35
May 26 15:30:22.944891 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:30:22.944868    2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-credit-scoring-5cb8956c45-xtwhq" event={"ID":"5ec81244-4d7e-43b0-aa8f-56e400efcd19","Type":"ContainerStarted","Data":"f3551325630fcc1c6d0f5a7d11e742ddce5812160f2ef60037e40874f92f3641"}
May 26 15:30:22.944972 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:30:22.944902    2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-credit-scoring-5cb8956c45-xtwhq" event={"ID":"5ec81244-4d7e-43b0-aa8f-56e400efcd19","Type":"ContainerStarted","Data":"f211d6309e569f1b1b0c4e05f5e71a7d8b05bbc6e9c7967c8eb3dcfbea998e35"}
May 26 15:30:23.948412 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:30:23.948377    2581 generic.go:358] "Generic (PLEG): container finished" podID="5ec81244-4d7e-43b0-aa8f-56e400efcd19" containerID="f3551325630fcc1c6d0f5a7d11e742ddce5812160f2ef60037e40874f92f3641" exitCode=0
May 26 15:30:23.948688 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:30:23.948426    2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-credit-scoring-5cb8956c45-xtwhq" event={"ID":"5ec81244-4d7e-43b0-aa8f-56e400efcd19","Type":"ContainerDied","Data":"f3551325630fcc1c6d0f5a7d11e742ddce5812160f2ef60037e40874f92f3641"}
May 26 15:30:24.953516 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:30:24.953480    2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-credit-scoring-5cb8956c45-xtwhq" event={"ID":"5ec81244-4d7e-43b0-aa8f-56e400efcd19","Type":"ContainerStarted","Data":"cc062f7664319f9c2df7d8644f4557064e5c69fd5405719d8b4fb480343b3660"}
May 26 15:30:30.978318 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:30:30.978252    2581 generic.go:358] "Generic (PLEG): container finished" podID="5ec81244-4d7e-43b0-aa8f-56e400efcd19" containerID="cc062f7664319f9c2df7d8644f4557064e5c69fd5405719d8b4fb480343b3660" exitCode=0
May 26 15:30:30.978693 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:30:30.978334    2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-credit-scoring-5cb8956c45-xtwhq" event={"ID":"5ec81244-4d7e-43b0-aa8f-56e400efcd19","Type":"ContainerDied","Data":"cc062f7664319f9c2df7d8644f4557064e5c69fd5405719d8b4fb480343b3660"}
May 26 15:30:31.984673 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:30:31.984632    2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-credit-scoring-5cb8956c45-xtwhq" event={"ID":"5ec81244-4d7e-43b0-aa8f-56e400efcd19","Type":"ContainerStarted","Data":"933269cad3bdf949ea0b92976bbbb5ac55fe9b4f8004e52450aa960b5c55ddba"}
May 26 15:30:31.985062 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:30:31.984690    2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-credit-scoring-5cb8956c45-xtwhq" event={"ID":"5ec81244-4d7e-43b0-aa8f-56e400efcd19","Type":"ContainerStarted","Data":"50b8a1f27830c62eee2e98af0bffb4a730b894e64f5282a7149760228dd832a5"}
May 26 15:30:31.985062 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:30:31.984707    2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-credit-scoring-5cb8956c45-xtwhq" event={"ID":"5ec81244-4d7e-43b0-aa8f-56e400efcd19","Type":"ContainerStarted","Data":"e97c42b2b8452a8f99f3bf0e2f982d6016d06e10401f0b136bbaef681d2d6864"}
May 26 15:30:32.014167 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:30:32.014105    2581 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="test-ns-feast/feast-credit-scoring-5cb8956c45-xtwhq" podStartSLOduration=11.014084337 podStartE2EDuration="11.014084337s" podCreationTimestamp="2026-05-26 15:30:21 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-26 15:30:32.011885887 +0000 UTC m=+771.009589230" watchObservedRunningTime="2026-05-26 15:30:32.014084337 +0000 UTC m=+771.011787673"
May 26 15:30:32.739804 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:30:32.739767    2581 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-credit-scoring-5cb8956c45-xtwhq"
May 26 15:30:32.739965 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:30:32.739821    2581 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-credit-scoring-5cb8956c45-xtwhq"
May 26 15:30:32.739965 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:30:32.739839    2581 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-credit-scoring-5cb8956c45-xtwhq"
May 26 15:30:34.739871 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:30:34.739837    2581 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-credit-scoring-5cb8956c45-xtwhq"
May 26 15:30:34.740422 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:30:34.740393    2581 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-credit-scoring-5cb8956c45-xtwhq"
May 26 15:30:34.740422 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:30:34.740420    2581 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-credit-scoring-5cb8956c45-xtwhq"
May 26 15:30:34.741494 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:30:34.741455    2581 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-credit-scoring-5cb8956c45-xtwhq" podUID="5ec81244-4d7e-43b0-aa8f-56e400efcd19" containerName="offline" probeResult="failure" output="dial tcp 10.132.0.27:8816: connect: connection refused"
May 26 15:30:34.741608 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:30:34.741491    2581 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-credit-scoring-5cb8956c45-xtwhq" podUID="5ec81244-4d7e-43b0-aa8f-56e400efcd19" containerName="registry" probeResult="failure" output="dial tcp 10.132.0.27:6571: connect: connection refused"
May 26 15:30:34.741608 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:30:34.741526    2581 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-credit-scoring-5cb8956c45-xtwhq" podUID="5ec81244-4d7e-43b0-aa8f-56e400efcd19" containerName="online" probeResult="failure" output="Get \"https://10.132.0.27:6567/health\": dial tcp 10.132.0.27:6567: connect: connection refused"
May 26 15:30:37.740314 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:30:37.740245    2581 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-credit-scoring-5cb8956c45-xtwhq" podUID="5ec81244-4d7e-43b0-aa8f-56e400efcd19" containerName="registry" probeResult="failure" output="dial tcp 10.132.0.27:6571: connect: connection refused"
May 26 15:30:37.741239 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:30:37.741214    2581 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-credit-scoring-5cb8956c45-xtwhq"
May 26 15:30:37.742200 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:30:37.742180    2581 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-credit-scoring-5cb8956c45-xtwhq"
May 26 15:30:37.745861 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:30:37.745841    2581 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-credit-scoring-5cb8956c45-xtwhq"
May 26 15:30:38.008162 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:30:38.008132    2581 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-credit-scoring-5cb8956c45-xtwhq"
May 26 15:30:40.739881 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:30:40.739834    2581 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-credit-scoring-5cb8956c45-xtwhq" podUID="5ec81244-4d7e-43b0-aa8f-56e400efcd19" containerName="registry" probeResult="failure" output="dial tcp 10.132.0.27:6571: connect: connection refused"
May 26 15:30:43.739925 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:30:43.739897    2581 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-credit-scoring-5cb8956c45-xtwhq"
May 26 15:30:43.740630 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:30:43.740605    2581 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-credit-scoring-5cb8956c45-xtwhq"
May 26 15:31:45.922373 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:31:45.922339    2581 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["test-ns-feast/feast-credit-scoring-5cb8956c45-xtwhq"]
May 26 15:31:45.922959 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:31:45.922655    2581 kuberuntime_container.go:864] "Killing container with a grace period" pod="test-ns-feast/feast-credit-scoring-5cb8956c45-xtwhq" podUID="5ec81244-4d7e-43b0-aa8f-56e400efcd19" containerName="registry" containerID="cri-o://e97c42b2b8452a8f99f3bf0e2f982d6016d06e10401f0b136bbaef681d2d6864" gracePeriod=30
May 26 15:31:45.922959 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:31:45.922695    2581 kuberuntime_container.go:864] "Killing container with a grace period" pod="test-ns-feast/feast-credit-scoring-5cb8956c45-xtwhq" podUID="5ec81244-4d7e-43b0-aa8f-56e400efcd19" containerName="offline" containerID="cri-o://933269cad3bdf949ea0b92976bbbb5ac55fe9b4f8004e52450aa960b5c55ddba" gracePeriod=30
May 26 15:31:45.922959 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:31:45.922771    2581 kuberuntime_container.go:864] "Killing container with a grace period" pod="test-ns-feast/feast-credit-scoring-5cb8956c45-xtwhq" podUID="5ec81244-4d7e-43b0-aa8f-56e400efcd19" containerName="online" containerID="cri-o://50b8a1f27830c62eee2e98af0bffb4a730b894e64f5282a7149760228dd832a5" gracePeriod=30
May 26 15:31:45.938616 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:31:45.938578    2581 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["test-ns-feast/postgres-7c7656cc6d-9fzwr"]
May 26 15:31:45.938820 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:31:45.938799    2581 kuberuntime_container.go:864] "Killing container with a grace period" pod="test-ns-feast/postgres-7c7656cc6d-9fzwr" podUID="6c525c8b-56ba-42b7-85de-6f058df69229" containerName="postgres" containerID="cri-o://ab8df2da54b18ab7f84c39a71f4cadd6da0a5b53665fe3cfa8bd509c2fa84721" gracePeriod=30
May 26 15:31:45.943038 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:31:45.943017    2581 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["test-ns-feast/redis-854544c579-dlcnk"]
May 26 15:31:45.943184 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:31:45.943167    2581 kuberuntime_container.go:864] "Killing container with a grace period" pod="test-ns-feast/redis-854544c579-dlcnk" podUID="5f377874-c46f-43be-9a7c-d13693f0aaa3" containerName="redis" containerID="cri-o://af41d776800870a3af8c34ae3c96b18f42205174c94b2628cc8bc815325ee8e5" gracePeriod=30
May 26 15:31:46.199421 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:31:46.199393    2581 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/postgres-7c7656cc6d-9fzwr"
May 26 15:31:46.202823 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:31:46.202801    2581 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/redis-854544c579-dlcnk"
May 26 15:31:46.204972 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:31:46.204948    2581 generic.go:358] "Generic (PLEG): container finished" podID="5f377874-c46f-43be-9a7c-d13693f0aaa3" containerID="af41d776800870a3af8c34ae3c96b18f42205174c94b2628cc8bc815325ee8e5" exitCode=0
May 26 15:31:46.205062 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:31:46.204988    2581 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/redis-854544c579-dlcnk"
May 26 15:31:46.205062 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:31:46.205021    2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/redis-854544c579-dlcnk" event={"ID":"5f377874-c46f-43be-9a7c-d13693f0aaa3","Type":"ContainerDied","Data":"af41d776800870a3af8c34ae3c96b18f42205174c94b2628cc8bc815325ee8e5"}
May 26 15:31:46.205062 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:31:46.205055    2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/redis-854544c579-dlcnk" event={"ID":"5f377874-c46f-43be-9a7c-d13693f0aaa3","Type":"ContainerDied","Data":"459736ab5a45cc96f25dd69cd2b61403e152c925d4fa1dcf91b648b85a85291e"}
May 26 15:31:46.205189 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:31:46.205071    2581 scope.go:117] "RemoveContainer" containerID="af41d776800870a3af8c34ae3c96b18f42205174c94b2628cc8bc815325ee8e5"
May 26 15:31:46.206044 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:31:46.206026    2581 generic.go:358] "Generic (PLEG): container finished" podID="6c525c8b-56ba-42b7-85de-6f058df69229" containerID="ab8df2da54b18ab7f84c39a71f4cadd6da0a5b53665fe3cfa8bd509c2fa84721" exitCode=0
May 26 15:31:46.206144 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:31:46.206076    2581 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/postgres-7c7656cc6d-9fzwr"
May 26 15:31:46.206144 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:31:46.206091    2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/postgres-7c7656cc6d-9fzwr" event={"ID":"6c525c8b-56ba-42b7-85de-6f058df69229","Type":"ContainerDied","Data":"ab8df2da54b18ab7f84c39a71f4cadd6da0a5b53665fe3cfa8bd509c2fa84721"}
May 26 15:31:46.206144 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:31:46.206124    2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/postgres-7c7656cc6d-9fzwr" event={"ID":"6c525c8b-56ba-42b7-85de-6f058df69229","Type":"ContainerDied","Data":"f9e2f050d858da5282611355c74a42df8e336451c146f254d5262ce0738ec72c"}
May 26 15:31:46.212399 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:31:46.212381    2581 scope.go:117] "RemoveContainer" containerID="af41d776800870a3af8c34ae3c96b18f42205174c94b2628cc8bc815325ee8e5"
May 26 15:31:46.212658 ip-10-0-140-164 kubenswrapper[2581]: E0526 15:31:46.212641    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"af41d776800870a3af8c34ae3c96b18f42205174c94b2628cc8bc815325ee8e5\": container with ID starting with af41d776800870a3af8c34ae3c96b18f42205174c94b2628cc8bc815325ee8e5 not found: ID does not exist" containerID="af41d776800870a3af8c34ae3c96b18f42205174c94b2628cc8bc815325ee8e5"
May 26 15:31:46.212709 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:31:46.212666    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"af41d776800870a3af8c34ae3c96b18f42205174c94b2628cc8bc815325ee8e5"} err="failed to get container status \"af41d776800870a3af8c34ae3c96b18f42205174c94b2628cc8bc815325ee8e5\": rpc error: code = NotFound desc = could not find container \"af41d776800870a3af8c34ae3c96b18f42205174c94b2628cc8bc815325ee8e5\": container with ID starting with af41d776800870a3af8c34ae3c96b18f42205174c94b2628cc8bc815325ee8e5 not found: ID does not exist"
May 26 15:31:46.212709 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:31:46.212682    2581 scope.go:117] "RemoveContainer" containerID="ab8df2da54b18ab7f84c39a71f4cadd6da0a5b53665fe3cfa8bd509c2fa84721"
May 26 15:31:46.221999 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:31:46.221975    2581 scope.go:117] "RemoveContainer" containerID="ab8df2da54b18ab7f84c39a71f4cadd6da0a5b53665fe3cfa8bd509c2fa84721"
May 26 15:31:46.222311 ip-10-0-140-164 kubenswrapper[2581]: E0526 15:31:46.222286    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ab8df2da54b18ab7f84c39a71f4cadd6da0a5b53665fe3cfa8bd509c2fa84721\": container with ID starting with ab8df2da54b18ab7f84c39a71f4cadd6da0a5b53665fe3cfa8bd509c2fa84721 not found: ID does not exist" containerID="ab8df2da54b18ab7f84c39a71f4cadd6da0a5b53665fe3cfa8bd509c2fa84721"
May 26 15:31:46.222406 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:31:46.222318    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ab8df2da54b18ab7f84c39a71f4cadd6da0a5b53665fe3cfa8bd509c2fa84721"} err="failed to get container status \"ab8df2da54b18ab7f84c39a71f4cadd6da0a5b53665fe3cfa8bd509c2fa84721\": rpc error: code = NotFound desc = could not find container \"ab8df2da54b18ab7f84c39a71f4cadd6da0a5b53665fe3cfa8bd509c2fa84721\": container with ID starting with ab8df2da54b18ab7f84c39a71f4cadd6da0a5b53665fe3cfa8bd509c2fa84721 not found: ID does not exist"
May 26 15:31:46.346903 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:31:46.346871    2581 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"postgresdata\" (UniqueName: \"kubernetes.io/empty-dir/6c525c8b-56ba-42b7-85de-6f058df69229-postgresdata\") pod \"6c525c8b-56ba-42b7-85de-6f058df69229\" (UID: \"6c525c8b-56ba-42b7-85de-6f058df69229\") "
May 26 15:31:46.347080 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:31:46.346932    2581 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6tbms\" (UniqueName: \"kubernetes.io/projected/6c525c8b-56ba-42b7-85de-6f058df69229-kube-api-access-6tbms\") pod \"6c525c8b-56ba-42b7-85de-6f058df69229\" (UID: \"6c525c8b-56ba-42b7-85de-6f058df69229\") "
May 26 15:31:46.347080 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:31:46.346992    2581 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2p5nz\" (UniqueName: \"kubernetes.io/projected/5f377874-c46f-43be-9a7c-d13693f0aaa3-kube-api-access-2p5nz\") pod \"5f377874-c46f-43be-9a7c-d13693f0aaa3\" (UID: \"5f377874-c46f-43be-9a7c-d13693f0aaa3\") "
May 26 15:31:46.349244 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:31:46.349211    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6c525c8b-56ba-42b7-85de-6f058df69229-kube-api-access-6tbms" (OuterVolumeSpecName: "kube-api-access-6tbms") pod "6c525c8b-56ba-42b7-85de-6f058df69229" (UID: "6c525c8b-56ba-42b7-85de-6f058df69229"). InnerVolumeSpecName "kube-api-access-6tbms". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 26 15:31:46.349370 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:31:46.349248    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5f377874-c46f-43be-9a7c-d13693f0aaa3-kube-api-access-2p5nz" (OuterVolumeSpecName: "kube-api-access-2p5nz") pod "5f377874-c46f-43be-9a7c-d13693f0aaa3" (UID: "5f377874-c46f-43be-9a7c-d13693f0aaa3"). InnerVolumeSpecName "kube-api-access-2p5nz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 26 15:31:46.381790 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:31:46.381747    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6c525c8b-56ba-42b7-85de-6f058df69229-postgresdata" (OuterVolumeSpecName: "postgresdata") pod "6c525c8b-56ba-42b7-85de-6f058df69229" (UID: "6c525c8b-56ba-42b7-85de-6f058df69229"). InnerVolumeSpecName "postgresdata". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 26 15:31:46.448116 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:31:46.448027    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2p5nz\" (UniqueName: \"kubernetes.io/projected/5f377874-c46f-43be-9a7c-d13693f0aaa3-kube-api-access-2p5nz\") on node \"ip-10-0-140-164.ec2.internal\" DevicePath \"\""
May 26 15:31:46.448116 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:31:46.448061    2581 reconciler_common.go:299] "Volume detached for volume \"postgresdata\" (UniqueName: \"kubernetes.io/empty-dir/6c525c8b-56ba-42b7-85de-6f058df69229-postgresdata\") on node \"ip-10-0-140-164.ec2.internal\" DevicePath \"\""
May 26 15:31:46.448116 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:31:46.448071    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6tbms\" (UniqueName: \"kubernetes.io/projected/6c525c8b-56ba-42b7-85de-6f058df69229-kube-api-access-6tbms\") on node \"ip-10-0-140-164.ec2.internal\" DevicePath \"\""
May 26 15:31:46.528937 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:31:46.528910    2581 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["test-ns-feast/redis-854544c579-dlcnk"]
May 26 15:31:46.532746 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:31:46.532725    2581 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["test-ns-feast/redis-854544c579-dlcnk"]
May 26 15:31:46.543640 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:31:46.543614    2581 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["test-ns-feast/postgres-7c7656cc6d-9fzwr"]
May 26 15:31:46.546324 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:31:46.546305    2581 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["test-ns-feast/postgres-7c7656cc6d-9fzwr"]
May 26 15:31:47.213746 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:31:47.213708    2581 generic.go:358] "Generic (PLEG): container finished" podID="5ec81244-4d7e-43b0-aa8f-56e400efcd19" containerID="50b8a1f27830c62eee2e98af0bffb4a730b894e64f5282a7149760228dd832a5" exitCode=0
May 26 15:31:47.214071 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:31:47.213761    2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-credit-scoring-5cb8956c45-xtwhq" event={"ID":"5ec81244-4d7e-43b0-aa8f-56e400efcd19","Type":"ContainerDied","Data":"50b8a1f27830c62eee2e98af0bffb4a730b894e64f5282a7149760228dd832a5"}
May 26 15:31:47.641326 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:31:47.641292    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5f377874-c46f-43be-9a7c-d13693f0aaa3" path="/var/lib/kubelet/pods/5f377874-c46f-43be-9a7c-d13693f0aaa3/volumes"
May 26 15:31:47.641651 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:31:47.641636    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6c525c8b-56ba-42b7-85de-6f058df69229" path="/var/lib/kubelet/pods/6c525c8b-56ba-42b7-85de-6f058df69229/volumes"
May 26 15:31:48.005279 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:31:48.005245    2581 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-credit-scoring-5cb8956c45-xtwhq" podUID="5ec81244-4d7e-43b0-aa8f-56e400efcd19" containerName="online" probeResult="failure" output="Get \"https://10.132.0.27:6567/health\": dial tcp 10.132.0.27:6567: connect: connection refused"
May 26 15:31:58.004838 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:31:58.004794    2581 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-credit-scoring-5cb8956c45-xtwhq" podUID="5ec81244-4d7e-43b0-aa8f-56e400efcd19" containerName="online" probeResult="failure" output="Get \"https://10.132.0.27:6567/health\": dial tcp 10.132.0.27:6567: connect: connection refused"
May 26 15:32:08.004661 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:32:08.004614    2581 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-credit-scoring-5cb8956c45-xtwhq" podUID="5ec81244-4d7e-43b0-aa8f-56e400efcd19" containerName="online" probeResult="failure" output="Get \"https://10.132.0.27:6567/health\": dial tcp 10.132.0.27:6567: connect: connection refused"
May 26 15:32:08.005070 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:32:08.004758    2581 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-credit-scoring-5cb8956c45-xtwhq"
May 26 15:32:16.306867 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:32:16.306835    2581 generic.go:358] "Generic (PLEG): container finished" podID="5ec81244-4d7e-43b0-aa8f-56e400efcd19" containerID="933269cad3bdf949ea0b92976bbbb5ac55fe9b4f8004e52450aa960b5c55ddba" exitCode=137
May 26 15:32:16.306867 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:32:16.306861    2581 generic.go:358] "Generic (PLEG): container finished" podID="5ec81244-4d7e-43b0-aa8f-56e400efcd19" containerID="e97c42b2b8452a8f99f3bf0e2f982d6016d06e10401f0b136bbaef681d2d6864" exitCode=137
May 26 15:32:16.307205 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:32:16.306903    2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-credit-scoring-5cb8956c45-xtwhq" event={"ID":"5ec81244-4d7e-43b0-aa8f-56e400efcd19","Type":"ContainerDied","Data":"933269cad3bdf949ea0b92976bbbb5ac55fe9b4f8004e52450aa960b5c55ddba"}
May 26 15:32:16.307205 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:32:16.306932    2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-credit-scoring-5cb8956c45-xtwhq" event={"ID":"5ec81244-4d7e-43b0-aa8f-56e400efcd19","Type":"ContainerDied","Data":"e97c42b2b8452a8f99f3bf0e2f982d6016d06e10401f0b136bbaef681d2d6864"}
May 26 15:32:16.565614 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:32:16.565591    2581 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-credit-scoring-5cb8956c45-xtwhq"
May 26 15:32:16.646457 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:32:16.646432    2581 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/5ec81244-4d7e-43b0-aa8f-56e400efcd19-online-tls\") pod \"5ec81244-4d7e-43b0-aa8f-56e400efcd19\" (UID: \"5ec81244-4d7e-43b0-aa8f-56e400efcd19\") "
May 26 15:32:16.646599 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:32:16.646472    2581 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/5ec81244-4d7e-43b0-aa8f-56e400efcd19-registry-tls\") pod \"5ec81244-4d7e-43b0-aa8f-56e400efcd19\" (UID: \"5ec81244-4d7e-43b0-aa8f-56e400efcd19\") "
May 26 15:32:16.646599 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:32:16.646516    2581 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/5ec81244-4d7e-43b0-aa8f-56e400efcd19-offline-tls\") pod \"5ec81244-4d7e-43b0-aa8f-56e400efcd19\" (UID: \"5ec81244-4d7e-43b0-aa8f-56e400efcd19\") "
May 26 15:32:16.646599 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:32:16.646546    2581 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mj6rf\" (UniqueName: \"kubernetes.io/projected/5ec81244-4d7e-43b0-aa8f-56e400efcd19-kube-api-access-mj6rf\") pod \"5ec81244-4d7e-43b0-aa8f-56e400efcd19\" (UID: \"5ec81244-4d7e-43b0-aa8f-56e400efcd19\") "
May 26 15:32:16.646599 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:32:16.646576    2581 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/5ec81244-4d7e-43b0-aa8f-56e400efcd19-feast-data\") pod \"5ec81244-4d7e-43b0-aa8f-56e400efcd19\" (UID: \"5ec81244-4d7e-43b0-aa8f-56e400efcd19\") "
May 26 15:32:16.648644 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:32:16.648617    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5ec81244-4d7e-43b0-aa8f-56e400efcd19-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "5ec81244-4d7e-43b0-aa8f-56e400efcd19" (UID: "5ec81244-4d7e-43b0-aa8f-56e400efcd19"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 26 15:32:16.648748 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:32:16.648689    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5ec81244-4d7e-43b0-aa8f-56e400efcd19-online-tls" (OuterVolumeSpecName: "online-tls") pod "5ec81244-4d7e-43b0-aa8f-56e400efcd19" (UID: "5ec81244-4d7e-43b0-aa8f-56e400efcd19"). InnerVolumeSpecName "online-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 26 15:32:16.648748 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:32:16.648705    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5ec81244-4d7e-43b0-aa8f-56e400efcd19-offline-tls" (OuterVolumeSpecName: "offline-tls") pod "5ec81244-4d7e-43b0-aa8f-56e400efcd19" (UID: "5ec81244-4d7e-43b0-aa8f-56e400efcd19"). InnerVolumeSpecName "offline-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 26 15:32:16.648991 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:32:16.648974    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5ec81244-4d7e-43b0-aa8f-56e400efcd19-kube-api-access-mj6rf" (OuterVolumeSpecName: "kube-api-access-mj6rf") pod "5ec81244-4d7e-43b0-aa8f-56e400efcd19" (UID: "5ec81244-4d7e-43b0-aa8f-56e400efcd19"). InnerVolumeSpecName "kube-api-access-mj6rf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 26 15:32:16.655400 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:32:16.655378    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5ec81244-4d7e-43b0-aa8f-56e400efcd19-feast-data" (OuterVolumeSpecName: "feast-data") pod "5ec81244-4d7e-43b0-aa8f-56e400efcd19" (UID: "5ec81244-4d7e-43b0-aa8f-56e400efcd19"). InnerVolumeSpecName "feast-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 26 15:32:16.747427 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:32:16.747403    2581 reconciler_common.go:299] "Volume detached for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/5ec81244-4d7e-43b0-aa8f-56e400efcd19-online-tls\") on node \"ip-10-0-140-164.ec2.internal\" DevicePath \"\""
May 26 15:32:16.747427 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:32:16.747423    2581 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/5ec81244-4d7e-43b0-aa8f-56e400efcd19-registry-tls\") on node \"ip-10-0-140-164.ec2.internal\" DevicePath \"\""
May 26 15:32:16.747592 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:32:16.747431    2581 reconciler_common.go:299] "Volume detached for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/5ec81244-4d7e-43b0-aa8f-56e400efcd19-offline-tls\") on node \"ip-10-0-140-164.ec2.internal\" DevicePath \"\""
May 26 15:32:16.747592 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:32:16.747440    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mj6rf\" (UniqueName: \"kubernetes.io/projected/5ec81244-4d7e-43b0-aa8f-56e400efcd19-kube-api-access-mj6rf\") on node \"ip-10-0-140-164.ec2.internal\" DevicePath \"\""
May 26 15:32:16.747592 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:32:16.747448    2581 reconciler_common.go:299] "Volume detached for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/5ec81244-4d7e-43b0-aa8f-56e400efcd19-feast-data\") on node \"ip-10-0-140-164.ec2.internal\" DevicePath \"\""
May 26 15:32:17.314109 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:32:17.314072    2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-credit-scoring-5cb8956c45-xtwhq" event={"ID":"5ec81244-4d7e-43b0-aa8f-56e400efcd19","Type":"ContainerDied","Data":"f211d6309e569f1b1b0c4e05f5e71a7d8b05bbc6e9c7967c8eb3dcfbea998e35"}
May 26 15:32:17.314109 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:32:17.314117    2581 scope.go:117] "RemoveContainer" containerID="933269cad3bdf949ea0b92976bbbb5ac55fe9b4f8004e52450aa960b5c55ddba"
May 26 15:32:17.314932 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:32:17.314155    2581 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-credit-scoring-5cb8956c45-xtwhq"
May 26 15:32:17.322612 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:32:17.322596    2581 scope.go:117] "RemoveContainer" containerID="50b8a1f27830c62eee2e98af0bffb4a730b894e64f5282a7149760228dd832a5"
May 26 15:32:17.329751 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:32:17.329735    2581 scope.go:117] "RemoveContainer" containerID="e97c42b2b8452a8f99f3bf0e2f982d6016d06e10401f0b136bbaef681d2d6864"
May 26 15:32:17.336548 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:32:17.336525    2581 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["test-ns-feast/feast-credit-scoring-5cb8956c45-xtwhq"]
May 26 15:32:17.337998 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:32:17.337979    2581 scope.go:117] "RemoveContainer" containerID="cc062f7664319f9c2df7d8644f4557064e5c69fd5405719d8b4fb480343b3660"
May 26 15:32:17.339873 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:32:17.339854    2581 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["test-ns-feast/feast-credit-scoring-5cb8956c45-xtwhq"]
May 26 15:32:17.345007 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:32:17.344988    2581 scope.go:117] "RemoveContainer" containerID="f3551325630fcc1c6d0f5a7d11e742ddce5812160f2ef60037e40874f92f3641"
May 26 15:32:17.641247 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:32:17.641165    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5ec81244-4d7e-43b0-aa8f-56e400efcd19" path="/var/lib/kubelet/pods/5ec81244-4d7e-43b0-aa8f-56e400efcd19/volumes"
May 26 15:32:41.555034 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:32:41.554962    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-gjh9c_a02c2727-c53c-48c3-aba7-acde4eef632c/ovn-acl-logging/0.log"
May 26 15:32:41.557312 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:32:41.557293    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-gjh9c_a02c2727-c53c-48c3-aba7-acde4eef632c/ovn-acl-logging/0.log"
May 26 15:33:51.910448 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:33:51.910357    2581 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["test-ns-feast-rest/redis-854544c579-b8zkk"]
May 26 15:33:51.912892 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:33:51.910785    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6c525c8b-56ba-42b7-85de-6f058df69229" containerName="postgres"
May 26 15:33:51.912892 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:33:51.910804    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="6c525c8b-56ba-42b7-85de-6f058df69229" containerName="postgres"
May 26 15:33:51.912892 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:33:51.910816    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5ec81244-4d7e-43b0-aa8f-56e400efcd19" containerName="feast-init"
May 26 15:33:51.912892 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:33:51.910823    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="5ec81244-4d7e-43b0-aa8f-56e400efcd19" containerName="feast-init"
May 26 15:33:51.912892 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:33:51.910834    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5ec81244-4d7e-43b0-aa8f-56e400efcd19" containerName="registry"
May 26 15:33:51.912892 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:33:51.910842    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="5ec81244-4d7e-43b0-aa8f-56e400efcd19" containerName="registry"
May 26 15:33:51.912892 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:33:51.910888    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5ec81244-4d7e-43b0-aa8f-56e400efcd19" containerName="online"
May 26 15:33:51.912892 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:33:51.910893    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="5ec81244-4d7e-43b0-aa8f-56e400efcd19" containerName="online"
May 26 15:33:51.912892 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:33:51.910904    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5ec81244-4d7e-43b0-aa8f-56e400efcd19" containerName="offline"
May 26 15:33:51.912892 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:33:51.910909    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="5ec81244-4d7e-43b0-aa8f-56e400efcd19" containerName="offline"
May 26 15:33:51.912892 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:33:51.910917    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5ec81244-4d7e-43b0-aa8f-56e400efcd19" containerName="feast-apply"
May 26 15:33:51.912892 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:33:51.910921    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="5ec81244-4d7e-43b0-aa8f-56e400efcd19" containerName="feast-apply"
May 26 15:33:51.912892 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:33:51.910928    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5f377874-c46f-43be-9a7c-d13693f0aaa3" containerName="redis"
May 26 15:33:51.912892 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:33:51.910933    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="5f377874-c46f-43be-9a7c-d13693f0aaa3" containerName="redis"
May 26 15:33:51.912892 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:33:51.910988    2581 memory_manager.go:356] "RemoveStaleState removing state" podUID="5ec81244-4d7e-43b0-aa8f-56e400efcd19" containerName="offline"
May 26 15:33:51.912892 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:33:51.910998    2581 memory_manager.go:356] "RemoveStaleState removing state" podUID="5ec81244-4d7e-43b0-aa8f-56e400efcd19" containerName="online"
May 26 15:33:51.912892 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:33:51.911009    2581 memory_manager.go:356] "RemoveStaleState removing state" podUID="5ec81244-4d7e-43b0-aa8f-56e400efcd19" containerName="registry"
May 26 15:33:51.912892 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:33:51.911019    2581 memory_manager.go:356] "RemoveStaleState removing state" podUID="5f377874-c46f-43be-9a7c-d13693f0aaa3" containerName="redis"
May 26 15:33:51.912892 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:33:51.911028    2581 memory_manager.go:356] "RemoveStaleState removing state" podUID="6c525c8b-56ba-42b7-85de-6f058df69229" containerName="postgres"
May 26 15:33:51.913846 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:33:51.913830    2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast-rest/redis-854544c579-b8zkk"
May 26 15:33:51.916409 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:33:51.916378    2581 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast-rest\"/\"default-dockercfg-4l7kr\""
May 26 15:33:51.916556 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:33:51.916384    2581 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast-rest\"/\"openshift-service-ca.crt\""
May 26 15:33:51.916556 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:33:51.916484    2581 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast-rest\"/\"kube-root-ca.crt\""
May 26 15:33:51.929977 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:33:51.929945    2581 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["test-ns-feast-rest/redis-854544c579-b8zkk"]
May 26 15:33:51.987122 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:33:51.987092    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c84xw\" (UniqueName: \"kubernetes.io/projected/733ea3e5-fd77-460b-95e7-0a8b1aa15b0b-kube-api-access-c84xw\") pod \"redis-854544c579-b8zkk\" (UID: \"733ea3e5-fd77-460b-95e7-0a8b1aa15b0b\") " pod="test-ns-feast-rest/redis-854544c579-b8zkk"
May 26 15:33:52.088357 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:33:52.088329    2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-c84xw\" (UniqueName: \"kubernetes.io/projected/733ea3e5-fd77-460b-95e7-0a8b1aa15b0b-kube-api-access-c84xw\") pod \"redis-854544c579-b8zkk\" (UID: \"733ea3e5-fd77-460b-95e7-0a8b1aa15b0b\") " pod="test-ns-feast-rest/redis-854544c579-b8zkk"
May 26 15:33:52.096652 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:33:52.096628    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-c84xw\" (UniqueName: \"kubernetes.io/projected/733ea3e5-fd77-460b-95e7-0a8b1aa15b0b-kube-api-access-c84xw\") pod \"redis-854544c579-b8zkk\" (UID: \"733ea3e5-fd77-460b-95e7-0a8b1aa15b0b\") " pod="test-ns-feast-rest/redis-854544c579-b8zkk"
May 26 15:33:52.237230 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:33:52.237167    2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast-rest/redis-854544c579-b8zkk"
May 26 15:33:52.363789 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:33:52.363758    2581 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["test-ns-feast-rest/redis-854544c579-b8zkk"]
May 26 15:33:52.367552 ip-10-0-140-164 kubenswrapper[2581]: W0526 15:33:52.367526    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod733ea3e5_fd77_460b_95e7_0a8b1aa15b0b.slice/crio-b22453828db22024ff8acdd73fb778ca5e2f0aebb28b8330fc543b0868f2a987 WatchSource:0}: Error finding container b22453828db22024ff8acdd73fb778ca5e2f0aebb28b8330fc543b0868f2a987: Status 404 returned error can't find the container with id b22453828db22024ff8acdd73fb778ca5e2f0aebb28b8330fc543b0868f2a987
May 26 15:33:52.593402 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:33:52.593367    2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/redis-854544c579-b8zkk" event={"ID":"733ea3e5-fd77-460b-95e7-0a8b1aa15b0b","Type":"ContainerStarted","Data":"a45a454cce88a59354ff43207c978de00053af23302ec0dfc42b0993885caaae"}
May 26 15:33:52.593495 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:33:52.593408    2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/redis-854544c579-b8zkk" event={"ID":"733ea3e5-fd77-460b-95e7-0a8b1aa15b0b","Type":"ContainerStarted","Data":"b22453828db22024ff8acdd73fb778ca5e2f0aebb28b8330fc543b0868f2a987"}
May 26 15:33:52.609191 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:33:52.609137    2581 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="test-ns-feast-rest/redis-854544c579-b8zkk" podStartSLOduration=1.609123401 podStartE2EDuration="1.609123401s" podCreationTimestamp="2026-05-26 15:33:51 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-26 15:33:52.608785947 +0000 UTC m=+971.606489279" watchObservedRunningTime="2026-05-26 15:33:52.609123401 +0000 UTC m=+971.606826744"
May 26 15:33:57.357838 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:33:57.357792    2581 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["test-ns-feast-rest/postgres-7c7656cc6d-cv8fl"]
May 26 15:33:57.361062 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:33:57.361038    2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast-rest/postgres-7c7656cc6d-cv8fl"
May 26 15:33:57.363758 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:33:57.363726    2581 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast-rest\"/\"postgres-secret\""
May 26 15:33:57.368893 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:33:57.368863    2581 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["test-ns-feast-rest/postgres-7c7656cc6d-cv8fl"]
May 26 15:33:57.528928 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:33:57.528897    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2xm29\" (UniqueName: \"kubernetes.io/projected/4a707893-9d1d-4b01-9b35-cb578b337bff-kube-api-access-2xm29\") pod \"postgres-7c7656cc6d-cv8fl\" (UID: \"4a707893-9d1d-4b01-9b35-cb578b337bff\") " pod="test-ns-feast-rest/postgres-7c7656cc6d-cv8fl"
May 26 15:33:57.529042 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:33:57.528957    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"postgresdata\" (UniqueName: \"kubernetes.io/empty-dir/4a707893-9d1d-4b01-9b35-cb578b337bff-postgresdata\") pod \"postgres-7c7656cc6d-cv8fl\" (UID: \"4a707893-9d1d-4b01-9b35-cb578b337bff\") " pod="test-ns-feast-rest/postgres-7c7656cc6d-cv8fl"
May 26 15:33:57.629761 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:33:57.629693    2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"postgresdata\" (UniqueName: \"kubernetes.io/empty-dir/4a707893-9d1d-4b01-9b35-cb578b337bff-postgresdata\") pod \"postgres-7c7656cc6d-cv8fl\" (UID: \"4a707893-9d1d-4b01-9b35-cb578b337bff\") " pod="test-ns-feast-rest/postgres-7c7656cc6d-cv8fl"
May 26 15:33:57.629761 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:33:57.629737    2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-2xm29\" (UniqueName: \"kubernetes.io/projected/4a707893-9d1d-4b01-9b35-cb578b337bff-kube-api-access-2xm29\") pod \"postgres-7c7656cc6d-cv8fl\" (UID: \"4a707893-9d1d-4b01-9b35-cb578b337bff\") " pod="test-ns-feast-rest/postgres-7c7656cc6d-cv8fl"
May 26 15:33:57.630122 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:33:57.630104    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"postgresdata\" (UniqueName: \"kubernetes.io/empty-dir/4a707893-9d1d-4b01-9b35-cb578b337bff-postgresdata\") pod \"postgres-7c7656cc6d-cv8fl\" (UID: \"4a707893-9d1d-4b01-9b35-cb578b337bff\") " pod="test-ns-feast-rest/postgres-7c7656cc6d-cv8fl"
May 26 15:33:57.638636 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:33:57.638609    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2xm29\" (UniqueName: \"kubernetes.io/projected/4a707893-9d1d-4b01-9b35-cb578b337bff-kube-api-access-2xm29\") pod \"postgres-7c7656cc6d-cv8fl\" (UID: \"4a707893-9d1d-4b01-9b35-cb578b337bff\") " pod="test-ns-feast-rest/postgres-7c7656cc6d-cv8fl"
May 26 15:33:57.673134 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:33:57.673109    2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast-rest/postgres-7c7656cc6d-cv8fl"
May 26 15:33:57.800068 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:33:57.800040    2581 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["test-ns-feast-rest/postgres-7c7656cc6d-cv8fl"]
May 26 15:33:57.802884 ip-10-0-140-164 kubenswrapper[2581]: W0526 15:33:57.802861    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod4a707893_9d1d_4b01_9b35_cb578b337bff.slice/crio-fd0881d603d7584adbe3120452d743bdcf18a6fae78616d913ffa9c355b63f22 WatchSource:0}: Error finding container fd0881d603d7584adbe3120452d743bdcf18a6fae78616d913ffa9c355b63f22: Status 404 returned error can't find the container with id fd0881d603d7584adbe3120452d743bdcf18a6fae78616d913ffa9c355b63f22
May 26 15:33:58.613066 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:33:58.613029    2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/postgres-7c7656cc6d-cv8fl" event={"ID":"4a707893-9d1d-4b01-9b35-cb578b337bff","Type":"ContainerStarted","Data":"b9584152306054ddede8ccf3a09c546ea2adc961c334c9a57b6bed1be3044057"}
May 26 15:33:58.613066 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:33:58.613065    2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/postgres-7c7656cc6d-cv8fl" event={"ID":"4a707893-9d1d-4b01-9b35-cb578b337bff","Type":"ContainerStarted","Data":"fd0881d603d7584adbe3120452d743bdcf18a6fae78616d913ffa9c355b63f22"}
May 26 15:33:58.643342 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:33:58.643289    2581 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="test-ns-feast-rest/postgres-7c7656cc6d-cv8fl" podStartSLOduration=1.6432563409999998 podStartE2EDuration="1.643256341s" podCreationTimestamp="2026-05-26 15:33:57 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-26 15:33:58.643012716 +0000 UTC m=+977.640716084" watchObservedRunningTime="2026-05-26 15:33:58.643256341 +0000 UTC m=+977.640959674"
May 26 15:34:02.955062 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:34:02.955000    2581 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["test-ns-feast-rest/feast-credit-scoring-69456bc6cf-5xr6r"]
May 26 15:34:02.958447 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:34:02.958429    2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast-rest/feast-credit-scoring-69456bc6cf-5xr6r"
May 26 15:34:02.961564 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:34:02.961543    2581 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast-rest\"/\"feast-credit-scoring-registry-tls\""
May 26 15:34:02.961848 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:34:02.961833    2581 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast-rest\"/\"feast-credit-scoring-intra-comm\""
May 26 15:34:02.962214 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:34:02.962194    2581 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast-rest\"/\"feast-credit-scoring-online-tls\""
May 26 15:34:02.962390 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:34:02.962362    2581 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast-rest\"/\"feast-credit-scoring-dockercfg-n9hjs\""
May 26 15:34:02.970340 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:34:02.970315    2581 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["test-ns-feast-rest/feast-credit-scoring-69456bc6cf-5xr6r"]
May 26 15:34:03.076063 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:34:03.076036    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ksjdn\" (UniqueName: \"kubernetes.io/projected/60bef1ac-7254-4747-9cef-91d39d794501-kube-api-access-ksjdn\") pod \"feast-credit-scoring-69456bc6cf-5xr6r\" (UID: \"60bef1ac-7254-4747-9cef-91d39d794501\") " pod="test-ns-feast-rest/feast-credit-scoring-69456bc6cf-5xr6r"
May 26 15:34:03.076170 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:34:03.076079    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/60bef1ac-7254-4747-9cef-91d39d794501-online-tls\") pod \"feast-credit-scoring-69456bc6cf-5xr6r\" (UID: \"60bef1ac-7254-4747-9cef-91d39d794501\") " pod="test-ns-feast-rest/feast-credit-scoring-69456bc6cf-5xr6r"
May 26 15:34:03.076170 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:34:03.076136    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/60bef1ac-7254-4747-9cef-91d39d794501-registry-tls\") pod \"feast-credit-scoring-69456bc6cf-5xr6r\" (UID: \"60bef1ac-7254-4747-9cef-91d39d794501\") " pod="test-ns-feast-rest/feast-credit-scoring-69456bc6cf-5xr6r"
May 26 15:34:03.076256 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:34:03.076190    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/60bef1ac-7254-4747-9cef-91d39d794501-feast-data\") pod \"feast-credit-scoring-69456bc6cf-5xr6r\" (UID: \"60bef1ac-7254-4747-9cef-91d39d794501\") " pod="test-ns-feast-rest/feast-credit-scoring-69456bc6cf-5xr6r"
May 26 15:34:03.177028 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:34:03.177005    2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/60bef1ac-7254-4747-9cef-91d39d794501-registry-tls\") pod \"feast-credit-scoring-69456bc6cf-5xr6r\" (UID: \"60bef1ac-7254-4747-9cef-91d39d794501\") " pod="test-ns-feast-rest/feast-credit-scoring-69456bc6cf-5xr6r"
May 26 15:34:03.177119 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:34:03.177042    2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/60bef1ac-7254-4747-9cef-91d39d794501-feast-data\") pod \"feast-credit-scoring-69456bc6cf-5xr6r\" (UID: \"60bef1ac-7254-4747-9cef-91d39d794501\") " pod="test-ns-feast-rest/feast-credit-scoring-69456bc6cf-5xr6r"
May 26 15:34:03.177119 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:34:03.177103    2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-ksjdn\" (UniqueName: \"kubernetes.io/projected/60bef1ac-7254-4747-9cef-91d39d794501-kube-api-access-ksjdn\") pod \"feast-credit-scoring-69456bc6cf-5xr6r\" (UID: \"60bef1ac-7254-4747-9cef-91d39d794501\") " pod="test-ns-feast-rest/feast-credit-scoring-69456bc6cf-5xr6r"
May 26 15:34:03.177186 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:34:03.177140    2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/60bef1ac-7254-4747-9cef-91d39d794501-online-tls\") pod \"feast-credit-scoring-69456bc6cf-5xr6r\" (UID: \"60bef1ac-7254-4747-9cef-91d39d794501\") " pod="test-ns-feast-rest/feast-credit-scoring-69456bc6cf-5xr6r"
May 26 15:34:03.177250 ip-10-0-140-164 kubenswrapper[2581]: E0526 15:34:03.177235    2581 secret.go:189] Couldn't get secret test-ns-feast-rest/feast-credit-scoring-online-tls: secret "feast-credit-scoring-online-tls" not found
May 26 15:34:03.177334 ip-10-0-140-164 kubenswrapper[2581]: E0526 15:34:03.177323    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/60bef1ac-7254-4747-9cef-91d39d794501-online-tls podName:60bef1ac-7254-4747-9cef-91d39d794501 nodeName:}" failed. No retries permitted until 2026-05-26 15:34:03.677302185 +0000 UTC m=+982.675005510 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "online-tls" (UniqueName: "kubernetes.io/secret/60bef1ac-7254-4747-9cef-91d39d794501-online-tls") pod "feast-credit-scoring-69456bc6cf-5xr6r" (UID: "60bef1ac-7254-4747-9cef-91d39d794501") : secret "feast-credit-scoring-online-tls" not found
May 26 15:34:03.177523 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:34:03.177496    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/60bef1ac-7254-4747-9cef-91d39d794501-feast-data\") pod \"feast-credit-scoring-69456bc6cf-5xr6r\" (UID: \"60bef1ac-7254-4747-9cef-91d39d794501\") " pod="test-ns-feast-rest/feast-credit-scoring-69456bc6cf-5xr6r"
May 26 15:34:03.179644 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:34:03.179628    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/60bef1ac-7254-4747-9cef-91d39d794501-registry-tls\") pod \"feast-credit-scoring-69456bc6cf-5xr6r\" (UID: \"60bef1ac-7254-4747-9cef-91d39d794501\") " pod="test-ns-feast-rest/feast-credit-scoring-69456bc6cf-5xr6r"
May 26 15:34:03.187976 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:34:03.187956    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ksjdn\" (UniqueName: \"kubernetes.io/projected/60bef1ac-7254-4747-9cef-91d39d794501-kube-api-access-ksjdn\") pod \"feast-credit-scoring-69456bc6cf-5xr6r\" (UID: \"60bef1ac-7254-4747-9cef-91d39d794501\") " pod="test-ns-feast-rest/feast-credit-scoring-69456bc6cf-5xr6r"
May 26 15:34:03.681517 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:34:03.681486    2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/60bef1ac-7254-4747-9cef-91d39d794501-online-tls\") pod \"feast-credit-scoring-69456bc6cf-5xr6r\" (UID: \"60bef1ac-7254-4747-9cef-91d39d794501\") " pod="test-ns-feast-rest/feast-credit-scoring-69456bc6cf-5xr6r"
May 26 15:34:03.683835 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:34:03.683816    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/60bef1ac-7254-4747-9cef-91d39d794501-online-tls\") pod \"feast-credit-scoring-69456bc6cf-5xr6r\" (UID: \"60bef1ac-7254-4747-9cef-91d39d794501\") " pod="test-ns-feast-rest/feast-credit-scoring-69456bc6cf-5xr6r"
May 26 15:34:03.867515 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:34:03.867490    2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast-rest/feast-credit-scoring-69456bc6cf-5xr6r"
May 26 15:34:03.998146 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:34:03.998097    2581 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["test-ns-feast-rest/feast-credit-scoring-69456bc6cf-5xr6r"]
May 26 15:34:04.000846 ip-10-0-140-164 kubenswrapper[2581]: W0526 15:34:04.000813    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod60bef1ac_7254_4747_9cef_91d39d794501.slice/crio-f82eeeab17bde3eadc5bce5d7fe4308ed0940c5d0d839fa06db59448cef0fa81 WatchSource:0}: Error finding container f82eeeab17bde3eadc5bce5d7fe4308ed0940c5d0d839fa06db59448cef0fa81: Status 404 returned error can't find the container with id f82eeeab17bde3eadc5bce5d7fe4308ed0940c5d0d839fa06db59448cef0fa81
May 26 15:34:04.631393 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:34:04.631354    2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-credit-scoring-69456bc6cf-5xr6r" event={"ID":"60bef1ac-7254-4747-9cef-91d39d794501","Type":"ContainerStarted","Data":"9e294b225539af8e1761b134ce4ee08434ec6774b5b4cd025e938aba597e3569"}
May 26 15:34:04.631393 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:34:04.631393    2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-credit-scoring-69456bc6cf-5xr6r" event={"ID":"60bef1ac-7254-4747-9cef-91d39d794501","Type":"ContainerStarted","Data":"f82eeeab17bde3eadc5bce5d7fe4308ed0940c5d0d839fa06db59448cef0fa81"}
May 26 15:34:05.636959 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:34:05.636924    2581 generic.go:358] "Generic (PLEG): container finished" podID="60bef1ac-7254-4747-9cef-91d39d794501" containerID="9e294b225539af8e1761b134ce4ee08434ec6774b5b4cd025e938aba597e3569" exitCode=0
May 26 15:34:05.640789 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:34:05.640763    2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-credit-scoring-69456bc6cf-5xr6r" event={"ID":"60bef1ac-7254-4747-9cef-91d39d794501","Type":"ContainerDied","Data":"9e294b225539af8e1761b134ce4ee08434ec6774b5b4cd025e938aba597e3569"}
May 26 15:34:06.641424 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:34:06.641391    2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-credit-scoring-69456bc6cf-5xr6r" event={"ID":"60bef1ac-7254-4747-9cef-91d39d794501","Type":"ContainerStarted","Data":"1ede6a15ac0d4c2f151cb8496698a335bb85945035b3429b405b503b46389215"}
May 26 15:34:12.659537 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:34:12.659503    2581 generic.go:358] "Generic (PLEG): container finished" podID="60bef1ac-7254-4747-9cef-91d39d794501" containerID="1ede6a15ac0d4c2f151cb8496698a335bb85945035b3429b405b503b46389215" exitCode=0
May 26 15:34:12.659921 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:34:12.659576    2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-credit-scoring-69456bc6cf-5xr6r" event={"ID":"60bef1ac-7254-4747-9cef-91d39d794501","Type":"ContainerDied","Data":"1ede6a15ac0d4c2f151cb8496698a335bb85945035b3429b405b503b46389215"}
May 26 15:34:13.665161 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:34:13.665118    2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-credit-scoring-69456bc6cf-5xr6r" event={"ID":"60bef1ac-7254-4747-9cef-91d39d794501","Type":"ContainerStarted","Data":"feefd27f715e912ef9bc3282396b845d3b280a3e8d0cb13f8883a5850cc438e3"}
May 26 15:34:13.665161 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:34:13.665164    2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-credit-scoring-69456bc6cf-5xr6r" event={"ID":"60bef1ac-7254-4747-9cef-91d39d794501","Type":"ContainerStarted","Data":"493b838b99270dd399b1558cf8c85a9e1ebed2247faa99515e50ee21d9ae73b2"}
May 26 15:34:13.691346 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:34:13.691260    2581 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="test-ns-feast-rest/feast-credit-scoring-69456bc6cf-5xr6r" podStartSLOduration=11.691242562 podStartE2EDuration="11.691242562s" podCreationTimestamp="2026-05-26 15:34:02 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-26 15:34:13.68896907 +0000 UTC m=+992.686672403" watchObservedRunningTime="2026-05-26 15:34:13.691242562 +0000 UTC m=+992.688945896"
May 26 15:34:13.867741 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:34:13.867706    2581 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast-rest/feast-credit-scoring-69456bc6cf-5xr6r"
May 26 15:34:13.867918 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:34:13.867784    2581 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast-rest/feast-credit-scoring-69456bc6cf-5xr6r"
May 26 15:34:15.868135 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:34:15.868101    2581 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast-rest/feast-credit-scoring-69456bc6cf-5xr6r"
May 26 15:34:15.868135 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:34:15.868145    2581 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast-rest/feast-credit-scoring-69456bc6cf-5xr6r"
May 26 15:34:15.869839 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:34:15.869800    2581 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast-rest/feast-credit-scoring-69456bc6cf-5xr6r" podUID="60bef1ac-7254-4747-9cef-91d39d794501" containerName="registry" probeResult="failure" output="dial tcp 10.132.0.30:6571: connect: connection refused"
May 26 15:34:15.870051 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:34:15.869843    2581 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast-rest/feast-credit-scoring-69456bc6cf-5xr6r" podUID="60bef1ac-7254-4747-9cef-91d39d794501" containerName="online" probeResult="failure" output="Get \"https://10.132.0.30:6567/health\": dial tcp 10.132.0.30:6567: connect: connection refused"
May 26 15:34:18.868190 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:34:18.868143    2581 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast-rest/feast-credit-scoring-69456bc6cf-5xr6r" podUID="60bef1ac-7254-4747-9cef-91d39d794501" containerName="registry" probeResult="failure" output="dial tcp 10.132.0.30:6571: connect: connection refused"
May 26 15:34:18.873360 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:34:18.873334    2581 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast-rest/feast-credit-scoring-69456bc6cf-5xr6r"
May 26 15:34:18.876419 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:34:18.876392    2581 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast-rest/feast-credit-scoring-69456bc6cf-5xr6r"
May 26 15:34:21.867926 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:34:21.867881    2581 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast-rest/feast-credit-scoring-69456bc6cf-5xr6r" podUID="60bef1ac-7254-4747-9cef-91d39d794501" containerName="registry" probeResult="failure" output="dial tcp 10.132.0.30:6571: connect: connection refused"
May 26 15:34:24.869001 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:34:24.868969    2581 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast-rest/feast-credit-scoring-69456bc6cf-5xr6r"
May 26 15:34:24.869861 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:34:24.869840    2581 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast-rest/feast-credit-scoring-69456bc6cf-5xr6r"
May 26 15:34:28.907814 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:34:28.907744    2581 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["test-ns-feast-rest/feast-driver-ranking-5cdf999fb8-d4xwq"]
May 26 15:34:28.911100 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:34:28.911080    2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast-rest/feast-driver-ranking-5cdf999fb8-d4xwq"
May 26 15:34:28.914976 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:34:28.914948    2581 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast-rest\"/\"feast-driver-ranking-intra-comm\""
May 26 15:34:28.915340 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:34:28.914971    2581 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast-rest\"/\"feast-driver-ranking-online-tls\""
May 26 15:34:28.915634 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:34:28.915051    2581 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast-rest\"/\"feast-driver-ranking-dockercfg-z2q8n\""
May 26 15:34:28.916417 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:34:28.916384    2581 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast-rest\"/\"feast-driver-ranking-registry-tls\""
May 26 15:34:28.922599 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:34:28.922575    2581 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["test-ns-feast-rest/feast-driver-ranking-5cdf999fb8-d4xwq"]
May 26 15:34:28.965795 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:34:28.965771    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/e024c3e1-fca3-40ac-8227-2073d799d65a-feast-data\") pod \"feast-driver-ranking-5cdf999fb8-d4xwq\" (UID: \"e024c3e1-fca3-40ac-8227-2073d799d65a\") " pod="test-ns-feast-rest/feast-driver-ranking-5cdf999fb8-d4xwq"
May 26 15:34:28.965906 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:34:28.965802    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/e024c3e1-fca3-40ac-8227-2073d799d65a-online-tls\") pod \"feast-driver-ranking-5cdf999fb8-d4xwq\" (UID: \"e024c3e1-fca3-40ac-8227-2073d799d65a\") " pod="test-ns-feast-rest/feast-driver-ranking-5cdf999fb8-d4xwq"
May 26 15:34:28.965906 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:34:28.965823    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xvzd5\" (UniqueName: \"kubernetes.io/projected/e024c3e1-fca3-40ac-8227-2073d799d65a-kube-api-access-xvzd5\") pod \"feast-driver-ranking-5cdf999fb8-d4xwq\" (UID: \"e024c3e1-fca3-40ac-8227-2073d799d65a\") " pod="test-ns-feast-rest/feast-driver-ranking-5cdf999fb8-d4xwq"
May 26 15:34:28.965906 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:34:28.965888    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/e024c3e1-fca3-40ac-8227-2073d799d65a-registry-tls\") pod \"feast-driver-ranking-5cdf999fb8-d4xwq\" (UID: \"e024c3e1-fca3-40ac-8227-2073d799d65a\") " pod="test-ns-feast-rest/feast-driver-ranking-5cdf999fb8-d4xwq"
May 26 15:34:29.066569 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:34:29.066548    2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/e024c3e1-fca3-40ac-8227-2073d799d65a-online-tls\") pod \"feast-driver-ranking-5cdf999fb8-d4xwq\" (UID: \"e024c3e1-fca3-40ac-8227-2073d799d65a\") " pod="test-ns-feast-rest/feast-driver-ranking-5cdf999fb8-d4xwq"
May 26 15:34:29.066674 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:34:29.066580    2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-xvzd5\" (UniqueName: \"kubernetes.io/projected/e024c3e1-fca3-40ac-8227-2073d799d65a-kube-api-access-xvzd5\") pod \"feast-driver-ranking-5cdf999fb8-d4xwq\" (UID: \"e024c3e1-fca3-40ac-8227-2073d799d65a\") " pod="test-ns-feast-rest/feast-driver-ranking-5cdf999fb8-d4xwq"
May 26 15:34:29.066674 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:34:29.066603    2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/e024c3e1-fca3-40ac-8227-2073d799d65a-registry-tls\") pod \"feast-driver-ranking-5cdf999fb8-d4xwq\" (UID: \"e024c3e1-fca3-40ac-8227-2073d799d65a\") " pod="test-ns-feast-rest/feast-driver-ranking-5cdf999fb8-d4xwq"
May 26 15:34:29.066674 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:34:29.066669    2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/e024c3e1-fca3-40ac-8227-2073d799d65a-feast-data\") pod \"feast-driver-ranking-5cdf999fb8-d4xwq\" (UID: \"e024c3e1-fca3-40ac-8227-2073d799d65a\") " pod="test-ns-feast-rest/feast-driver-ranking-5cdf999fb8-d4xwq"
May 26 15:34:29.066999 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:34:29.066982    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/e024c3e1-fca3-40ac-8227-2073d799d65a-feast-data\") pod \"feast-driver-ranking-5cdf999fb8-d4xwq\" (UID: \"e024c3e1-fca3-40ac-8227-2073d799d65a\") " pod="test-ns-feast-rest/feast-driver-ranking-5cdf999fb8-d4xwq"
May 26 15:34:29.068998 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:34:29.068978    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/e024c3e1-fca3-40ac-8227-2073d799d65a-registry-tls\") pod \"feast-driver-ranking-5cdf999fb8-d4xwq\" (UID: \"e024c3e1-fca3-40ac-8227-2073d799d65a\") " pod="test-ns-feast-rest/feast-driver-ranking-5cdf999fb8-d4xwq"
May 26 15:34:29.069083 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:34:29.069048    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/e024c3e1-fca3-40ac-8227-2073d799d65a-online-tls\") pod \"feast-driver-ranking-5cdf999fb8-d4xwq\" (UID: \"e024c3e1-fca3-40ac-8227-2073d799d65a\") " pod="test-ns-feast-rest/feast-driver-ranking-5cdf999fb8-d4xwq"
May 26 15:34:29.078123 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:34:29.078096    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xvzd5\" (UniqueName: \"kubernetes.io/projected/e024c3e1-fca3-40ac-8227-2073d799d65a-kube-api-access-xvzd5\") pod \"feast-driver-ranking-5cdf999fb8-d4xwq\" (UID: \"e024c3e1-fca3-40ac-8227-2073d799d65a\") " pod="test-ns-feast-rest/feast-driver-ranking-5cdf999fb8-d4xwq"
May 26 15:34:29.226394 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:34:29.226331    2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast-rest/feast-driver-ranking-5cdf999fb8-d4xwq"
May 26 15:34:29.355463 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:34:29.355436    2581 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["test-ns-feast-rest/feast-driver-ranking-5cdf999fb8-d4xwq"]
May 26 15:34:29.357875 ip-10-0-140-164 kubenswrapper[2581]: W0526 15:34:29.357841    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode024c3e1_fca3_40ac_8227_2073d799d65a.slice/crio-81a038f4426fc3cdbdee3317d49393cc6f9f8ee0a10232c8ca4805d0d6b0e824 WatchSource:0}: Error finding container 81a038f4426fc3cdbdee3317d49393cc6f9f8ee0a10232c8ca4805d0d6b0e824: Status 404 returned error can't find the container with id 81a038f4426fc3cdbdee3317d49393cc6f9f8ee0a10232c8ca4805d0d6b0e824
May 26 15:34:29.711147 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:34:29.711111    2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-driver-ranking-5cdf999fb8-d4xwq" event={"ID":"e024c3e1-fca3-40ac-8227-2073d799d65a","Type":"ContainerStarted","Data":"f00cbcc7383a35ed8077270da1d56a4a0792a98a5cb4cc2aa4f68940f02a3b82"}
May 26 15:34:29.711338 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:34:29.711150    2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-driver-ranking-5cdf999fb8-d4xwq" event={"ID":"e024c3e1-fca3-40ac-8227-2073d799d65a","Type":"ContainerStarted","Data":"81a038f4426fc3cdbdee3317d49393cc6f9f8ee0a10232c8ca4805d0d6b0e824"}
May 26 15:34:34.728092 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:34:34.728056    2581 generic.go:358] "Generic (PLEG): container finished" podID="e024c3e1-fca3-40ac-8227-2073d799d65a" containerID="f00cbcc7383a35ed8077270da1d56a4a0792a98a5cb4cc2aa4f68940f02a3b82" exitCode=0
May 26 15:34:34.728492 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:34:34.728135    2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-driver-ranking-5cdf999fb8-d4xwq" event={"ID":"e024c3e1-fca3-40ac-8227-2073d799d65a","Type":"ContainerDied","Data":"f00cbcc7383a35ed8077270da1d56a4a0792a98a5cb4cc2aa4f68940f02a3b82"}
May 26 15:34:35.732847 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:34:35.732811    2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-driver-ranking-5cdf999fb8-d4xwq" event={"ID":"e024c3e1-fca3-40ac-8227-2073d799d65a","Type":"ContainerStarted","Data":"a4c0d9adc17054c4e3ae600d22cf716d54f3d326285719c7f1098bf601673d33"}
May 26 15:34:41.750936 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:34:41.750907    2581 generic.go:358] "Generic (PLEG): container finished" podID="e024c3e1-fca3-40ac-8227-2073d799d65a" containerID="a4c0d9adc17054c4e3ae600d22cf716d54f3d326285719c7f1098bf601673d33" exitCode=0
May 26 15:34:41.751245 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:34:41.750978    2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-driver-ranking-5cdf999fb8-d4xwq" event={"ID":"e024c3e1-fca3-40ac-8227-2073d799d65a","Type":"ContainerDied","Data":"a4c0d9adc17054c4e3ae600d22cf716d54f3d326285719c7f1098bf601673d33"}
May 26 15:34:41.754548 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:34:41.754530    2581 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast-rest\"/\"feast-driver-ranking-intra-comm\""
May 26 15:34:42.759817 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:34:42.759784    2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-driver-ranking-5cdf999fb8-d4xwq" event={"ID":"e024c3e1-fca3-40ac-8227-2073d799d65a","Type":"ContainerStarted","Data":"dec5456f87dc95cc799b2e724c27376246977a93684757d8a9ff6238c09f1699"}
May 26 15:34:42.759817 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:34:42.759825    2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-driver-ranking-5cdf999fb8-d4xwq" event={"ID":"e024c3e1-fca3-40ac-8227-2073d799d65a","Type":"ContainerStarted","Data":"adaf38fe05ae77124ca621bce2f68d849305880e4ff875745e912307c3226944"}
May 26 15:34:42.784582 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:34:42.784532    2581 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="test-ns-feast-rest/feast-driver-ranking-5cdf999fb8-d4xwq" podStartSLOduration=14.784517331 podStartE2EDuration="14.784517331s" podCreationTimestamp="2026-05-26 15:34:28 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-26 15:34:42.782900947 +0000 UTC m=+1021.780604280" watchObservedRunningTime="2026-05-26 15:34:42.784517331 +0000 UTC m=+1021.782220664"
May 26 15:34:44.227288 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:34:44.227227    2581 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast-rest/feast-driver-ranking-5cdf999fb8-d4xwq"
May 26 15:34:44.227777 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:34:44.227309    2581 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast-rest/feast-driver-ranking-5cdf999fb8-d4xwq"
May 26 15:34:44.228855 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:34:44.228823    2581 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast-rest/feast-driver-ranking-5cdf999fb8-d4xwq" podUID="e024c3e1-fca3-40ac-8227-2073d799d65a" containerName="registry" probeResult="failure" output="dial tcp 10.132.0.31:6571: connect: connection refused"
May 26 15:34:44.228981 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:34:44.228845    2581 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast-rest/feast-driver-ranking-5cdf999fb8-d4xwq" podUID="e024c3e1-fca3-40ac-8227-2073d799d65a" containerName="online" probeResult="failure" output="Get \"https://10.132.0.31:6567/health\": dial tcp 10.132.0.31:6567: connect: connection refused"
May 26 15:34:47.228326 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:34:47.228260    2581 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast-rest/feast-driver-ranking-5cdf999fb8-d4xwq" podUID="e024c3e1-fca3-40ac-8227-2073d799d65a" containerName="registry" probeResult="failure" output="dial tcp 10.132.0.31:6571: connect: connection refused"
May 26 15:34:47.821352 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:34:47.821321    2581 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast-rest/feast-driver-ranking-5cdf999fb8-d4xwq"
May 26 15:34:47.821800 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:34:47.821773    2581 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast-rest/feast-driver-ranking-5cdf999fb8-d4xwq"
May 26 15:34:47.824533 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:34:47.824510    2581 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast-rest/feast-driver-ranking-5cdf999fb8-d4xwq"
May 26 15:34:49.226483 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:34:49.226431    2581 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast-rest/feast-driver-ranking-5cdf999fb8-d4xwq"
May 26 15:34:50.227054 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:34:50.227007    2581 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast-rest/feast-driver-ranking-5cdf999fb8-d4xwq" podUID="e024c3e1-fca3-40ac-8227-2073d799d65a" containerName="registry" probeResult="failure" output="dial tcp 10.132.0.31:6571: connect: connection refused"
May 26 15:34:53.227506 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:34:53.227477    2581 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast-rest/feast-driver-ranking-5cdf999fb8-d4xwq"
May 26 15:34:53.228114 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:34:53.228096    2581 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast-rest/feast-driver-ranking-5cdf999fb8-d4xwq"
May 26 15:36:08.109848 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:36:08.109819    2581 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["feast-operator-system/feast-operator-controller-manager-f8449b7dc-tk86j"]
May 26 15:36:08.110383 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:36:08.110039    2581 kuberuntime_container.go:864] "Killing container with a grace period" pod="feast-operator-system/feast-operator-controller-manager-f8449b7dc-tk86j" podUID="2d094d26-c035-49a3-a559-82389c31193b" containerName="manager" containerID="cri-o://5cf184f393883e2f79f8979107eb04a8ac114e9b1f0d3027ba472d76148a03a9" gracePeriod=10
May 26 15:36:08.367517 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:36:08.367484    2581 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="feast-operator-system/feast-operator-controller-manager-f8449b7dc-tk86j"
May 26 15:36:08.479906 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:36:08.479873    2581 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6whr8\" (UniqueName: \"kubernetes.io/projected/2d094d26-c035-49a3-a559-82389c31193b-kube-api-access-6whr8\") pod \"2d094d26-c035-49a3-a559-82389c31193b\" (UID: \"2d094d26-c035-49a3-a559-82389c31193b\") "
May 26 15:36:08.482090 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:36:08.482054    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2d094d26-c035-49a3-a559-82389c31193b-kube-api-access-6whr8" (OuterVolumeSpecName: "kube-api-access-6whr8") pod "2d094d26-c035-49a3-a559-82389c31193b" (UID: "2d094d26-c035-49a3-a559-82389c31193b"). InnerVolumeSpecName "kube-api-access-6whr8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 26 15:36:08.546748 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:36:08.546717    2581 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["test-ns-feast-rest/feast-credit-scoring-69456bc6cf-5xr6r"]
May 26 15:36:08.547084 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:36:08.547052    2581 kuberuntime_container.go:864] "Killing container with a grace period" pod="test-ns-feast-rest/feast-credit-scoring-69456bc6cf-5xr6r" podUID="60bef1ac-7254-4747-9cef-91d39d794501" containerName="registry" containerID="cri-o://493b838b99270dd399b1558cf8c85a9e1ebed2247faa99515e50ee21d9ae73b2" gracePeriod=30
May 26 15:36:08.547241 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:36:08.547120    2581 kuberuntime_container.go:864] "Killing container with a grace period" pod="test-ns-feast-rest/feast-credit-scoring-69456bc6cf-5xr6r" podUID="60bef1ac-7254-4747-9cef-91d39d794501" containerName="online" containerID="cri-o://feefd27f715e912ef9bc3282396b845d3b280a3e8d0cb13f8883a5850cc438e3" gracePeriod=30
May 26 15:36:08.553214 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:36:08.553183    2581 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["test-ns-feast-rest/feast-driver-ranking-5cdf999fb8-d4xwq"]
May 26 15:36:08.553627 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:36:08.553597    2581 kuberuntime_container.go:864] "Killing container with a grace period" pod="test-ns-feast-rest/feast-driver-ranking-5cdf999fb8-d4xwq" podUID="e024c3e1-fca3-40ac-8227-2073d799d65a" containerName="registry" containerID="cri-o://adaf38fe05ae77124ca621bce2f68d849305880e4ff875745e912307c3226944" gracePeriod=30
May 26 15:36:08.553761 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:36:08.553698    2581 kuberuntime_container.go:864] "Killing container with a grace period" pod="test-ns-feast-rest/feast-driver-ranking-5cdf999fb8-d4xwq" podUID="e024c3e1-fca3-40ac-8227-2073d799d65a" containerName="online" containerID="cri-o://dec5456f87dc95cc799b2e724c27376246977a93684757d8a9ff6238c09f1699" gracePeriod=30
May 26 15:36:08.580906 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:36:08.580885    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6whr8\" (UniqueName: \"kubernetes.io/projected/2d094d26-c035-49a3-a559-82389c31193b-kube-api-access-6whr8\") on node \"ip-10-0-140-164.ec2.internal\" DevicePath \"\""
May 26 15:36:08.874329 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:36:08.874247    2581 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast-rest/feast-credit-scoring-69456bc6cf-5xr6r" podUID="60bef1ac-7254-4747-9cef-91d39d794501" containerName="online" probeResult="failure" output="Get \"https://10.132.0.30:6567/health\": dial tcp 10.132.0.30:6567: connect: connection refused"
May 26 15:36:09.013300 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:36:09.013247    2581 generic.go:358] "Generic (PLEG): container finished" podID="2d094d26-c035-49a3-a559-82389c31193b" containerID="5cf184f393883e2f79f8979107eb04a8ac114e9b1f0d3027ba472d76148a03a9" exitCode=0
May 26 15:36:09.013514 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:36:09.013331    2581 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="feast-operator-system/feast-operator-controller-manager-f8449b7dc-tk86j"
May 26 15:36:09.013514 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:36:09.013333    2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="feast-operator-system/feast-operator-controller-manager-f8449b7dc-tk86j" event={"ID":"2d094d26-c035-49a3-a559-82389c31193b","Type":"ContainerDied","Data":"5cf184f393883e2f79f8979107eb04a8ac114e9b1f0d3027ba472d76148a03a9"}
May 26 15:36:09.013514 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:36:09.013433    2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="feast-operator-system/feast-operator-controller-manager-f8449b7dc-tk86j" event={"ID":"2d094d26-c035-49a3-a559-82389c31193b","Type":"ContainerDied","Data":"9f36a075e906dd5eaca3dcbe789c6632fb2c4c54fd15b53a960726e2357654a2"}
May 26 15:36:09.013514 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:36:09.013454    2581 scope.go:117] "RemoveContainer" containerID="5cf184f393883e2f79f8979107eb04a8ac114e9b1f0d3027ba472d76148a03a9"
May 26 15:36:09.022926 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:36:09.022895    2581 scope.go:117] "RemoveContainer" containerID="5cf184f393883e2f79f8979107eb04a8ac114e9b1f0d3027ba472d76148a03a9"
May 26 15:36:09.023193 ip-10-0-140-164 kubenswrapper[2581]: E0526 15:36:09.023174    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5cf184f393883e2f79f8979107eb04a8ac114e9b1f0d3027ba472d76148a03a9\": container with ID starting with 5cf184f393883e2f79f8979107eb04a8ac114e9b1f0d3027ba472d76148a03a9 not found: ID does not exist" containerID="5cf184f393883e2f79f8979107eb04a8ac114e9b1f0d3027ba472d76148a03a9"
May 26 15:36:09.023322 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:36:09.023199    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5cf184f393883e2f79f8979107eb04a8ac114e9b1f0d3027ba472d76148a03a9"} err="failed to get container status \"5cf184f393883e2f79f8979107eb04a8ac114e9b1f0d3027ba472d76148a03a9\": rpc error: code = NotFound desc = could not find container \"5cf184f393883e2f79f8979107eb04a8ac114e9b1f0d3027ba472d76148a03a9\": container with ID starting with 5cf184f393883e2f79f8979107eb04a8ac114e9b1f0d3027ba472d76148a03a9 not found: ID does not exist"
May 26 15:36:09.039339 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:36:09.039295    2581 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["feast-operator-system/feast-operator-controller-manager-f8449b7dc-tk86j"]
May 26 15:36:09.044113 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:36:09.044087    2581 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["feast-operator-system/feast-operator-controller-manager-f8449b7dc-tk86j"]
May 26 15:36:09.412629 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:36:09.412601    2581 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["test-ns-feast-rest/postgres-7c7656cc6d-cv8fl"]
May 26 15:36:09.412965 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:36:09.412804    2581 kuberuntime_container.go:864] "Killing container with a grace period" pod="test-ns-feast-rest/postgres-7c7656cc6d-cv8fl" podUID="4a707893-9d1d-4b01-9b35-cb578b337bff" containerName="postgres" containerID="cri-o://b9584152306054ddede8ccf3a09c546ea2adc961c334c9a57b6bed1be3044057" gracePeriod=30
May 26 15:36:09.418149 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:36:09.417794    2581 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["test-ns-feast-rest/redis-854544c579-b8zkk"]
May 26 15:36:09.418149 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:36:09.418021    2581 kuberuntime_container.go:864] "Killing container with a grace period" pod="test-ns-feast-rest/redis-854544c579-b8zkk" podUID="733ea3e5-fd77-460b-95e7-0a8b1aa15b0b" containerName="redis" containerID="cri-o://a45a454cce88a59354ff43207c978de00053af23302ec0dfc42b0993885caaae" gracePeriod=30
May 26 15:36:09.642145 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:36:09.642114    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2d094d26-c035-49a3-a559-82389c31193b" path="/var/lib/kubelet/pods/2d094d26-c035-49a3-a559-82389c31193b/volumes"
May 26 15:36:09.648913 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:36:09.648893    2581 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast-rest/postgres-7c7656cc6d-cv8fl"
May 26 15:36:09.691174 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:36:09.691139    2581 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2xm29\" (UniqueName: \"kubernetes.io/projected/4a707893-9d1d-4b01-9b35-cb578b337bff-kube-api-access-2xm29\") pod \"4a707893-9d1d-4b01-9b35-cb578b337bff\" (UID: \"4a707893-9d1d-4b01-9b35-cb578b337bff\") "
May 26 15:36:09.691341 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:36:09.691224    2581 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"postgresdata\" (UniqueName: \"kubernetes.io/empty-dir/4a707893-9d1d-4b01-9b35-cb578b337bff-postgresdata\") pod \"4a707893-9d1d-4b01-9b35-cb578b337bff\" (UID: \"4a707893-9d1d-4b01-9b35-cb578b337bff\") "
May 26 15:36:09.693649 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:36:09.693623    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4a707893-9d1d-4b01-9b35-cb578b337bff-kube-api-access-2xm29" (OuterVolumeSpecName: "kube-api-access-2xm29") pod "4a707893-9d1d-4b01-9b35-cb578b337bff" (UID: "4a707893-9d1d-4b01-9b35-cb578b337bff"). InnerVolumeSpecName "kube-api-access-2xm29". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 26 15:36:09.723855 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:36:09.723825    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4a707893-9d1d-4b01-9b35-cb578b337bff-postgresdata" (OuterVolumeSpecName: "postgresdata") pod "4a707893-9d1d-4b01-9b35-cb578b337bff" (UID: "4a707893-9d1d-4b01-9b35-cb578b337bff"). InnerVolumeSpecName "postgresdata". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 26 15:36:09.768993 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:36:09.768970    2581 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast-rest/redis-854544c579-b8zkk"
May 26 15:36:09.792821 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:36:09.792751    2581 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-c84xw\" (UniqueName: \"kubernetes.io/projected/733ea3e5-fd77-460b-95e7-0a8b1aa15b0b-kube-api-access-c84xw\") pod \"733ea3e5-fd77-460b-95e7-0a8b1aa15b0b\" (UID: \"733ea3e5-fd77-460b-95e7-0a8b1aa15b0b\") "
May 26 15:36:09.792983 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:36:09.792966    2581 reconciler_common.go:299] "Volume detached for volume \"postgresdata\" (UniqueName: \"kubernetes.io/empty-dir/4a707893-9d1d-4b01-9b35-cb578b337bff-postgresdata\") on node \"ip-10-0-140-164.ec2.internal\" DevicePath \"\""
May 26 15:36:09.793057 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:36:09.792990    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2xm29\" (UniqueName: \"kubernetes.io/projected/4a707893-9d1d-4b01-9b35-cb578b337bff-kube-api-access-2xm29\") on node \"ip-10-0-140-164.ec2.internal\" DevicePath \"\""
May 26 15:36:09.794747 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:36:09.794722    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/733ea3e5-fd77-460b-95e7-0a8b1aa15b0b-kube-api-access-c84xw" (OuterVolumeSpecName: "kube-api-access-c84xw") pod "733ea3e5-fd77-460b-95e7-0a8b1aa15b0b" (UID: "733ea3e5-fd77-460b-95e7-0a8b1aa15b0b"). InnerVolumeSpecName "kube-api-access-c84xw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 26 15:36:09.893323 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:36:09.893299    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-c84xw\" (UniqueName: \"kubernetes.io/projected/733ea3e5-fd77-460b-95e7-0a8b1aa15b0b-kube-api-access-c84xw\") on node \"ip-10-0-140-164.ec2.internal\" DevicePath \"\""
May 26 15:36:10.023464 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:36:10.023434    2581 generic.go:358] "Generic (PLEG): container finished" podID="733ea3e5-fd77-460b-95e7-0a8b1aa15b0b" containerID="a45a454cce88a59354ff43207c978de00053af23302ec0dfc42b0993885caaae" exitCode=0
May 26 15:36:10.023593 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:36:10.023513    2581 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast-rest/redis-854544c579-b8zkk"
May 26 15:36:10.023593 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:36:10.023520    2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/redis-854544c579-b8zkk" event={"ID":"733ea3e5-fd77-460b-95e7-0a8b1aa15b0b","Type":"ContainerDied","Data":"a45a454cce88a59354ff43207c978de00053af23302ec0dfc42b0993885caaae"}
May 26 15:36:10.023593 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:36:10.023573    2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/redis-854544c579-b8zkk" event={"ID":"733ea3e5-fd77-460b-95e7-0a8b1aa15b0b","Type":"ContainerDied","Data":"b22453828db22024ff8acdd73fb778ca5e2f0aebb28b8330fc543b0868f2a987"}
May 26 15:36:10.023731 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:36:10.023596    2581 scope.go:117] "RemoveContainer" containerID="a45a454cce88a59354ff43207c978de00053af23302ec0dfc42b0993885caaae"
May 26 15:36:10.024856 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:36:10.024830    2581 generic.go:358] "Generic (PLEG): container finished" podID="4a707893-9d1d-4b01-9b35-cb578b337bff" containerID="b9584152306054ddede8ccf3a09c546ea2adc961c334c9a57b6bed1be3044057" exitCode=0
May 26 15:36:10.024966 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:36:10.024920    2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/postgres-7c7656cc6d-cv8fl" event={"ID":"4a707893-9d1d-4b01-9b35-cb578b337bff","Type":"ContainerDied","Data":"b9584152306054ddede8ccf3a09c546ea2adc961c334c9a57b6bed1be3044057"}
May 26 15:36:10.024966 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:36:10.024943    2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/postgres-7c7656cc6d-cv8fl" event={"ID":"4a707893-9d1d-4b01-9b35-cb578b337bff","Type":"ContainerDied","Data":"fd0881d603d7584adbe3120452d743bdcf18a6fae78616d913ffa9c355b63f22"}
May 26 15:36:10.025168 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:36:10.025146    2581 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast-rest/postgres-7c7656cc6d-cv8fl"
May 26 15:36:10.027582 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:36:10.027549    2581 generic.go:358] "Generic (PLEG): container finished" podID="60bef1ac-7254-4747-9cef-91d39d794501" containerID="feefd27f715e912ef9bc3282396b845d3b280a3e8d0cb13f8883a5850cc438e3" exitCode=0
May 26 15:36:10.027687 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:36:10.027610    2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-credit-scoring-69456bc6cf-5xr6r" event={"ID":"60bef1ac-7254-4747-9cef-91d39d794501","Type":"ContainerDied","Data":"feefd27f715e912ef9bc3282396b845d3b280a3e8d0cb13f8883a5850cc438e3"}
May 26 15:36:10.031010 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:36:10.030411    2581 generic.go:358] "Generic (PLEG): container finished" podID="e024c3e1-fca3-40ac-8227-2073d799d65a" containerID="dec5456f87dc95cc799b2e724c27376246977a93684757d8a9ff6238c09f1699" exitCode=0
May 26 15:36:10.031010 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:36:10.030505    2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-driver-ranking-5cdf999fb8-d4xwq" event={"ID":"e024c3e1-fca3-40ac-8227-2073d799d65a","Type":"ContainerDied","Data":"dec5456f87dc95cc799b2e724c27376246977a93684757d8a9ff6238c09f1699"}
May 26 15:36:10.034221 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:36:10.034202    2581 scope.go:117] "RemoveContainer" containerID="a45a454cce88a59354ff43207c978de00053af23302ec0dfc42b0993885caaae"
May 26 15:36:10.034548 ip-10-0-140-164 kubenswrapper[2581]: E0526 15:36:10.034524    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a45a454cce88a59354ff43207c978de00053af23302ec0dfc42b0993885caaae\": container with ID starting with a45a454cce88a59354ff43207c978de00053af23302ec0dfc42b0993885caaae not found: ID does not exist" containerID="a45a454cce88a59354ff43207c978de00053af23302ec0dfc42b0993885caaae"
May 26 15:36:10.034640 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:36:10.034560    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a45a454cce88a59354ff43207c978de00053af23302ec0dfc42b0993885caaae"} err="failed to get container status \"a45a454cce88a59354ff43207c978de00053af23302ec0dfc42b0993885caaae\": rpc error: code = NotFound desc = could not find container \"a45a454cce88a59354ff43207c978de00053af23302ec0dfc42b0993885caaae\": container with ID starting with a45a454cce88a59354ff43207c978de00053af23302ec0dfc42b0993885caaae not found: ID does not exist"
May 26 15:36:10.034640 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:36:10.034586    2581 scope.go:117] "RemoveContainer" containerID="b9584152306054ddede8ccf3a09c546ea2adc961c334c9a57b6bed1be3044057"
May 26 15:36:10.041874 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:36:10.041856    2581 scope.go:117] "RemoveContainer" containerID="b9584152306054ddede8ccf3a09c546ea2adc961c334c9a57b6bed1be3044057"
May 26 15:36:10.042119 ip-10-0-140-164 kubenswrapper[2581]: E0526 15:36:10.042103    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b9584152306054ddede8ccf3a09c546ea2adc961c334c9a57b6bed1be3044057\": container with ID starting with b9584152306054ddede8ccf3a09c546ea2adc961c334c9a57b6bed1be3044057 not found: ID does not exist" containerID="b9584152306054ddede8ccf3a09c546ea2adc961c334c9a57b6bed1be3044057"
May 26 15:36:10.042176 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:36:10.042125    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b9584152306054ddede8ccf3a09c546ea2adc961c334c9a57b6bed1be3044057"} err="failed to get container status \"b9584152306054ddede8ccf3a09c546ea2adc961c334c9a57b6bed1be3044057\": rpc error: code = NotFound desc = could not find container \"b9584152306054ddede8ccf3a09c546ea2adc961c334c9a57b6bed1be3044057\": container with ID starting with b9584152306054ddede8ccf3a09c546ea2adc961c334c9a57b6bed1be3044057 not found: ID does not exist"
May 26 15:36:10.054379 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:36:10.054335    2581 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["test-ns-feast-rest/redis-854544c579-b8zkk"]
May 26 15:36:10.060420 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:36:10.060401    2581 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["test-ns-feast-rest/redis-854544c579-b8zkk"]
May 26 15:36:10.078134 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:36:10.078115    2581 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["test-ns-feast-rest/postgres-7c7656cc6d-cv8fl"]
May 26 15:36:10.081453 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:36:10.081434    2581 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["test-ns-feast-rest/postgres-7c7656cc6d-cv8fl"]
May 26 15:36:11.641361 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:36:11.641329    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4a707893-9d1d-4b01-9b35-cb578b337bff" path="/var/lib/kubelet/pods/4a707893-9d1d-4b01-9b35-cb578b337bff/volumes"
May 26 15:36:11.641836 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:36:11.641741    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="733ea3e5-fd77-460b-95e7-0a8b1aa15b0b" path="/var/lib/kubelet/pods/733ea3e5-fd77-460b-95e7-0a8b1aa15b0b/volumes"
May 26 15:36:17.822190 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:36:17.822140    2581 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast-rest/feast-driver-ranking-5cdf999fb8-d4xwq" podUID="e024c3e1-fca3-40ac-8227-2073d799d65a" containerName="online" probeResult="failure" output="Get \"https://10.132.0.31:6567/health\": dial tcp 10.132.0.31:6567: connect: connection refused"
May 26 15:36:18.874060 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:36:18.874016    2581 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast-rest/feast-credit-scoring-69456bc6cf-5xr6r" podUID="60bef1ac-7254-4747-9cef-91d39d794501" containerName="online" probeResult="failure" output="Get \"https://10.132.0.30:6567/health\": dial tcp 10.132.0.30:6567: connect: connection refused"
May 26 15:36:27.822639 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:36:27.822600    2581 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast-rest/feast-driver-ranking-5cdf999fb8-d4xwq" podUID="e024c3e1-fca3-40ac-8227-2073d799d65a" containerName="online" probeResult="failure" output="Get \"https://10.132.0.31:6567/health\": dial tcp 10.132.0.31:6567: connect: connection refused"
May 26 15:36:28.874140 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:36:28.874097    2581 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast-rest/feast-credit-scoring-69456bc6cf-5xr6r" podUID="60bef1ac-7254-4747-9cef-91d39d794501" containerName="online" probeResult="failure" output="Get \"https://10.132.0.30:6567/health\": dial tcp 10.132.0.30:6567: connect: connection refused"
May 26 15:36:28.874519 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:36:28.874209    2581 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast-rest/feast-credit-scoring-69456bc6cf-5xr6r"
May 26 15:36:37.822358 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:36:37.822307    2581 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast-rest/feast-driver-ranking-5cdf999fb8-d4xwq" podUID="e024c3e1-fca3-40ac-8227-2073d799d65a" containerName="online" probeResult="failure" output="Get \"https://10.132.0.31:6567/health\": dial tcp 10.132.0.31:6567: connect: connection refused"
May 26 15:36:37.822795 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:36:37.822427    2581 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast-rest/feast-driver-ranking-5cdf999fb8-d4xwq"
May 26 15:36:38.874093 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:36:38.874026    2581 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast-rest/feast-credit-scoring-69456bc6cf-5xr6r" podUID="60bef1ac-7254-4747-9cef-91d39d794501" containerName="online" probeResult="failure" output="Get \"https://10.132.0.30:6567/health\": dial tcp 10.132.0.30:6567: connect: connection refused"
May 26 15:36:39.119519 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:36:39.119484    2581 generic.go:358] "Generic (PLEG): container finished" podID="60bef1ac-7254-4747-9cef-91d39d794501" containerID="493b838b99270dd399b1558cf8c85a9e1ebed2247faa99515e50ee21d9ae73b2" exitCode=137
May 26 15:36:39.119652 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:36:39.119564    2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-credit-scoring-69456bc6cf-5xr6r" event={"ID":"60bef1ac-7254-4747-9cef-91d39d794501","Type":"ContainerDied","Data":"493b838b99270dd399b1558cf8c85a9e1ebed2247faa99515e50ee21d9ae73b2"}
May 26 15:36:39.122343 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:36:39.122316    2581 generic.go:358] "Generic (PLEG): container finished" podID="e024c3e1-fca3-40ac-8227-2073d799d65a" containerID="adaf38fe05ae77124ca621bce2f68d849305880e4ff875745e912307c3226944" exitCode=137
May 26 15:36:39.122488 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:36:39.122465    2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-driver-ranking-5cdf999fb8-d4xwq" event={"ID":"e024c3e1-fca3-40ac-8227-2073d799d65a","Type":"ContainerDied","Data":"adaf38fe05ae77124ca621bce2f68d849305880e4ff875745e912307c3226944"}
May 26 15:36:39.217777 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:36:39.217755    2581 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast-rest/feast-credit-scoring-69456bc6cf-5xr6r"
May 26 15:36:39.220668 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:36:39.220651    2581 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast-rest/feast-driver-ranking-5cdf999fb8-d4xwq"
May 26 15:36:39.304647 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:36:39.304623    2581 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/e024c3e1-fca3-40ac-8227-2073d799d65a-feast-data\") pod \"e024c3e1-fca3-40ac-8227-2073d799d65a\" (UID: \"e024c3e1-fca3-40ac-8227-2073d799d65a\") "
May 26 15:36:39.304758 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:36:39.304659    2581 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ksjdn\" (UniqueName: \"kubernetes.io/projected/60bef1ac-7254-4747-9cef-91d39d794501-kube-api-access-ksjdn\") pod \"60bef1ac-7254-4747-9cef-91d39d794501\" (UID: \"60bef1ac-7254-4747-9cef-91d39d794501\") "
May 26 15:36:39.304758 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:36:39.304682    2581 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/60bef1ac-7254-4747-9cef-91d39d794501-registry-tls\") pod \"60bef1ac-7254-4747-9cef-91d39d794501\" (UID: \"60bef1ac-7254-4747-9cef-91d39d794501\") "
May 26 15:36:39.304758 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:36:39.304709    2581 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/60bef1ac-7254-4747-9cef-91d39d794501-feast-data\") pod \"60bef1ac-7254-4747-9cef-91d39d794501\" (UID: \"60bef1ac-7254-4747-9cef-91d39d794501\") "
May 26 15:36:39.304758 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:36:39.304732    2581 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/e024c3e1-fca3-40ac-8227-2073d799d65a-online-tls\") pod \"e024c3e1-fca3-40ac-8227-2073d799d65a\" (UID: \"e024c3e1-fca3-40ac-8227-2073d799d65a\") "
May 26 15:36:39.304953 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:36:39.304792    2581 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xvzd5\" (UniqueName: \"kubernetes.io/projected/e024c3e1-fca3-40ac-8227-2073d799d65a-kube-api-access-xvzd5\") pod \"e024c3e1-fca3-40ac-8227-2073d799d65a\" (UID: \"e024c3e1-fca3-40ac-8227-2073d799d65a\") "
May 26 15:36:39.304953 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:36:39.304828    2581 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/60bef1ac-7254-4747-9cef-91d39d794501-online-tls\") pod \"60bef1ac-7254-4747-9cef-91d39d794501\" (UID: \"60bef1ac-7254-4747-9cef-91d39d794501\") "
May 26 15:36:39.304953 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:36:39.304854    2581 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/e024c3e1-fca3-40ac-8227-2073d799d65a-registry-tls\") pod \"e024c3e1-fca3-40ac-8227-2073d799d65a\" (UID: \"e024c3e1-fca3-40ac-8227-2073d799d65a\") "
May 26 15:36:39.305191 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:36:39.305159    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e024c3e1-fca3-40ac-8227-2073d799d65a-feast-data" (OuterVolumeSpecName: "feast-data") pod "e024c3e1-fca3-40ac-8227-2073d799d65a" (UID: "e024c3e1-fca3-40ac-8227-2073d799d65a"). InnerVolumeSpecName "feast-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 26 15:36:39.307000 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:36:39.306970    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/60bef1ac-7254-4747-9cef-91d39d794501-kube-api-access-ksjdn" (OuterVolumeSpecName: "kube-api-access-ksjdn") pod "60bef1ac-7254-4747-9cef-91d39d794501" (UID: "60bef1ac-7254-4747-9cef-91d39d794501"). InnerVolumeSpecName "kube-api-access-ksjdn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 26 15:36:39.307550 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:36:39.307519    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e024c3e1-fca3-40ac-8227-2073d799d65a-kube-api-access-xvzd5" (OuterVolumeSpecName: "kube-api-access-xvzd5") pod "e024c3e1-fca3-40ac-8227-2073d799d65a" (UID: "e024c3e1-fca3-40ac-8227-2073d799d65a"). InnerVolumeSpecName "kube-api-access-xvzd5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 26 15:36:39.307660 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:36:39.307552    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e024c3e1-fca3-40ac-8227-2073d799d65a-online-tls" (OuterVolumeSpecName: "online-tls") pod "e024c3e1-fca3-40ac-8227-2073d799d65a" (UID: "e024c3e1-fca3-40ac-8227-2073d799d65a"). InnerVolumeSpecName "online-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 26 15:36:39.307660 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:36:39.307584    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/60bef1ac-7254-4747-9cef-91d39d794501-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "60bef1ac-7254-4747-9cef-91d39d794501" (UID: "60bef1ac-7254-4747-9cef-91d39d794501"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 26 15:36:39.307660 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:36:39.307599    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e024c3e1-fca3-40ac-8227-2073d799d65a-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "e024c3e1-fca3-40ac-8227-2073d799d65a" (UID: "e024c3e1-fca3-40ac-8227-2073d799d65a"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 26 15:36:39.307811 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:36:39.307666    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/60bef1ac-7254-4747-9cef-91d39d794501-online-tls" (OuterVolumeSpecName: "online-tls") pod "60bef1ac-7254-4747-9cef-91d39d794501" (UID: "60bef1ac-7254-4747-9cef-91d39d794501"). InnerVolumeSpecName "online-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 26 15:36:39.314871 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:36:39.314845    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/60bef1ac-7254-4747-9cef-91d39d794501-feast-data" (OuterVolumeSpecName: "feast-data") pod "60bef1ac-7254-4747-9cef-91d39d794501" (UID: "60bef1ac-7254-4747-9cef-91d39d794501"). InnerVolumeSpecName "feast-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 26 15:36:39.405705 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:36:39.405655    2581 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/60bef1ac-7254-4747-9cef-91d39d794501-registry-tls\") on node \"ip-10-0-140-164.ec2.internal\" DevicePath \"\""
May 26 15:36:39.405705 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:36:39.405677    2581 reconciler_common.go:299] "Volume detached for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/60bef1ac-7254-4747-9cef-91d39d794501-feast-data\") on node \"ip-10-0-140-164.ec2.internal\" DevicePath \"\""
May 26 15:36:39.405705 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:36:39.405686    2581 reconciler_common.go:299] "Volume detached for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/e024c3e1-fca3-40ac-8227-2073d799d65a-online-tls\") on node \"ip-10-0-140-164.ec2.internal\" DevicePath \"\""
May 26 15:36:39.405705 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:36:39.405694    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xvzd5\" (UniqueName: \"kubernetes.io/projected/e024c3e1-fca3-40ac-8227-2073d799d65a-kube-api-access-xvzd5\") on node \"ip-10-0-140-164.ec2.internal\" DevicePath \"\""
May 26 15:36:39.405705 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:36:39.405703    2581 reconciler_common.go:299] "Volume detached for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/60bef1ac-7254-4747-9cef-91d39d794501-online-tls\") on node \"ip-10-0-140-164.ec2.internal\" DevicePath \"\""
May 26 15:36:39.405899 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:36:39.405711    2581 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/e024c3e1-fca3-40ac-8227-2073d799d65a-registry-tls\") on node \"ip-10-0-140-164.ec2.internal\" DevicePath \"\""
May 26 15:36:39.405899 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:36:39.405720    2581 reconciler_common.go:299] "Volume detached for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/e024c3e1-fca3-40ac-8227-2073d799d65a-feast-data\") on node \"ip-10-0-140-164.ec2.internal\" DevicePath \"\""
May 26 15:36:39.405899 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:36:39.405728    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ksjdn\" (UniqueName: \"kubernetes.io/projected/60bef1ac-7254-4747-9cef-91d39d794501-kube-api-access-ksjdn\") on node \"ip-10-0-140-164.ec2.internal\" DevicePath \"\""
May 26 15:36:40.132496 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:36:40.132455    2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-driver-ranking-5cdf999fb8-d4xwq" event={"ID":"e024c3e1-fca3-40ac-8227-2073d799d65a","Type":"ContainerDied","Data":"81a038f4426fc3cdbdee3317d49393cc6f9f8ee0a10232c8ca4805d0d6b0e824"}
May 26 15:36:40.132496 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:36:40.132481    2581 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast-rest/feast-driver-ranking-5cdf999fb8-d4xwq"
May 26 15:36:40.132970 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:36:40.132512    2581 scope.go:117] "RemoveContainer" containerID="dec5456f87dc95cc799b2e724c27376246977a93684757d8a9ff6238c09f1699"
May 26 15:36:40.136812 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:36:40.136694    2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-credit-scoring-69456bc6cf-5xr6r" event={"ID":"60bef1ac-7254-4747-9cef-91d39d794501","Type":"ContainerDied","Data":"f82eeeab17bde3eadc5bce5d7fe4308ed0940c5d0d839fa06db59448cef0fa81"}
May 26 15:36:40.136938 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:36:40.136853    2581 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast-rest/feast-credit-scoring-69456bc6cf-5xr6r"
May 26 15:36:40.142054 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:36:40.142034    2581 scope.go:117] "RemoveContainer" containerID="adaf38fe05ae77124ca621bce2f68d849305880e4ff875745e912307c3226944"
May 26 15:36:40.150143 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:36:40.150125    2581 scope.go:117] "RemoveContainer" containerID="a4c0d9adc17054c4e3ae600d22cf716d54f3d326285719c7f1098bf601673d33"
May 26 15:36:40.156233 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:36:40.156212    2581 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["test-ns-feast-rest/feast-driver-ranking-5cdf999fb8-d4xwq"]
May 26 15:36:40.160407 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:36:40.160344    2581 scope.go:117] "RemoveContainer" containerID="f00cbcc7383a35ed8077270da1d56a4a0792a98a5cb4cc2aa4f68940f02a3b82"
May 26 15:36:40.162815 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:36:40.162791    2581 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["test-ns-feast-rest/feast-driver-ranking-5cdf999fb8-d4xwq"]
May 26 15:36:40.170315 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:36:40.170120    2581 scope.go:117] "RemoveContainer" containerID="feefd27f715e912ef9bc3282396b845d3b280a3e8d0cb13f8883a5850cc438e3"
May 26 15:36:40.174296 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:36:40.174262    2581 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["test-ns-feast-rest/feast-credit-scoring-69456bc6cf-5xr6r"]
May 26 15:36:40.178465 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:36:40.178390    2581 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["test-ns-feast-rest/feast-credit-scoring-69456bc6cf-5xr6r"]
May 26 15:36:40.178529 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:36:40.178489    2581 scope.go:117] "RemoveContainer" containerID="493b838b99270dd399b1558cf8c85a9e1ebed2247faa99515e50ee21d9ae73b2"
May 26 15:36:40.185428 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:36:40.185402    2581 scope.go:117] "RemoveContainer" containerID="1ede6a15ac0d4c2f151cb8496698a335bb85945035b3429b405b503b46389215"
May 26 15:36:40.191650 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:36:40.191634    2581 scope.go:117] "RemoveContainer" containerID="9e294b225539af8e1761b134ce4ee08434ec6774b5b4cd025e938aba597e3569"
May 26 15:36:41.640904 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:36:41.640879    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="60bef1ac-7254-4747-9cef-91d39d794501" path="/var/lib/kubelet/pods/60bef1ac-7254-4747-9cef-91d39d794501/volumes"
May 26 15:36:41.641384 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:36:41.641368    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e024c3e1-fca3-40ac-8227-2073d799d65a" path="/var/lib/kubelet/pods/e024c3e1-fca3-40ac-8227-2073d799d65a/volumes"
May 26 15:37:41.576615 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:37:41.576571    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-gjh9c_a02c2727-c53c-48c3-aba7-acde4eef632c/ovn-acl-logging/0.log"
May 26 15:37:41.579901 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:37:41.579878    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-gjh9c_a02c2727-c53c-48c3-aba7-acde4eef632c/ovn-acl-logging/0.log"
May 26 15:42:41.595283 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:42:41.595234    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-gjh9c_a02c2727-c53c-48c3-aba7-acde4eef632c/ovn-acl-logging/0.log"
May 26 15:42:41.602096 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:42:41.602072    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-gjh9c_a02c2727-c53c-48c3-aba7-acde4eef632c/ovn-acl-logging/0.log"
May 26 15:47:20.314217 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:47:20.314181    2581 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-must-gather-h77lq/must-gather-mrgq9"]
May 26 15:47:20.314698 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:47:20.314450    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="60bef1ac-7254-4747-9cef-91d39d794501" containerName="online"
May 26 15:47:20.314698 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:47:20.314461    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="60bef1ac-7254-4747-9cef-91d39d794501" containerName="online"
May 26 15:47:20.314698 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:47:20.314469    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e024c3e1-fca3-40ac-8227-2073d799d65a" containerName="feast-init"
May 26 15:47:20.314698 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:47:20.314475    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="e024c3e1-fca3-40ac-8227-2073d799d65a" containerName="feast-init"
May 26 15:47:20.314698 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:47:20.314484    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="60bef1ac-7254-4747-9cef-91d39d794501" containerName="feast-init"
May 26 15:47:20.314698 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:47:20.314490    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="60bef1ac-7254-4747-9cef-91d39d794501" containerName="feast-init"
May 26 15:47:20.314698 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:47:20.314498    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="733ea3e5-fd77-460b-95e7-0a8b1aa15b0b" containerName="redis"
May 26 15:47:20.314698 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:47:20.314503    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="733ea3e5-fd77-460b-95e7-0a8b1aa15b0b" containerName="redis"
May 26 15:47:20.314698 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:47:20.314510    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2d094d26-c035-49a3-a559-82389c31193b" containerName="manager"
May 26 15:47:20.314698 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:47:20.314515    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="2d094d26-c035-49a3-a559-82389c31193b" containerName="manager"
May 26 15:47:20.314698 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:47:20.314521    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="60bef1ac-7254-4747-9cef-91d39d794501" containerName="registry"
May 26 15:47:20.314698 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:47:20.314526    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="60bef1ac-7254-4747-9cef-91d39d794501" containerName="registry"
May 26 15:47:20.314698 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:47:20.314533    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4a707893-9d1d-4b01-9b35-cb578b337bff" containerName="postgres"
May 26 15:47:20.314698 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:47:20.314538    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="4a707893-9d1d-4b01-9b35-cb578b337bff" containerName="postgres"
May 26 15:47:20.314698 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:47:20.314546    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e024c3e1-fca3-40ac-8227-2073d799d65a" containerName="online"
May 26 15:47:20.314698 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:47:20.314550    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="e024c3e1-fca3-40ac-8227-2073d799d65a" containerName="online"
May 26 15:47:20.314698 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:47:20.314557    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="60bef1ac-7254-4747-9cef-91d39d794501" containerName="feast-apply"
May 26 15:47:20.314698 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:47:20.314562    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="60bef1ac-7254-4747-9cef-91d39d794501" containerName="feast-apply"
May 26 15:47:20.314698 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:47:20.314571    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e024c3e1-fca3-40ac-8227-2073d799d65a" containerName="feast-apply"
May 26 15:47:20.314698 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:47:20.314576    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="e024c3e1-fca3-40ac-8227-2073d799d65a" containerName="feast-apply"
May 26 15:47:20.314698 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:47:20.314582    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e024c3e1-fca3-40ac-8227-2073d799d65a" containerName="registry"
May 26 15:47:20.314698 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:47:20.314587    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="e024c3e1-fca3-40ac-8227-2073d799d65a" containerName="registry"
May 26 15:47:20.314698 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:47:20.314624    2581 memory_manager.go:356] "RemoveStaleState removing state" podUID="60bef1ac-7254-4747-9cef-91d39d794501" containerName="registry"
May 26 15:47:20.314698 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:47:20.314633    2581 memory_manager.go:356] "RemoveStaleState removing state" podUID="e024c3e1-fca3-40ac-8227-2073d799d65a" containerName="online"
May 26 15:47:20.314698 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:47:20.314639    2581 memory_manager.go:356] "RemoveStaleState removing state" podUID="733ea3e5-fd77-460b-95e7-0a8b1aa15b0b" containerName="redis"
May 26 15:47:20.314698 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:47:20.314645    2581 memory_manager.go:356] "RemoveStaleState removing state" podUID="e024c3e1-fca3-40ac-8227-2073d799d65a" containerName="registry"
May 26 15:47:20.314698 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:47:20.314652    2581 memory_manager.go:356] "RemoveStaleState removing state" podUID="4a707893-9d1d-4b01-9b35-cb578b337bff" containerName="postgres"
May 26 15:47:20.314698 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:47:20.314659    2581 memory_manager.go:356] "RemoveStaleState removing state" podUID="2d094d26-c035-49a3-a559-82389c31193b" containerName="manager"
May 26 15:47:20.314698 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:47:20.314665    2581 memory_manager.go:356] "RemoveStaleState removing state" podUID="60bef1ac-7254-4747-9cef-91d39d794501" containerName="online"
May 26 15:47:20.317529 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:47:20.317512    2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-h77lq/must-gather-mrgq9"
May 26 15:47:20.320798 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:47:20.320771    2581 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-h77lq\"/\"default-dockercfg-pfnvz\""
May 26 15:47:20.320945 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:47:20.320898    2581 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-h77lq\"/\"kube-root-ca.crt\""
May 26 15:47:20.321672 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:47:20.321653    2581 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-h77lq\"/\"openshift-service-ca.crt\""
May 26 15:47:20.328700 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:47:20.328677    2581 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-h77lq/must-gather-mrgq9"]
May 26 15:47:20.438681 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:47:20.438651    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s9b5d\" (UniqueName: \"kubernetes.io/projected/9644270b-e043-430d-b9c6-31bdca276e57-kube-api-access-s9b5d\") pod \"must-gather-mrgq9\" (UID: \"9644270b-e043-430d-b9c6-31bdca276e57\") " pod="openshift-must-gather-h77lq/must-gather-mrgq9"
May 26 15:47:20.438804 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:47:20.438740    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/9644270b-e043-430d-b9c6-31bdca276e57-must-gather-output\") pod \"must-gather-mrgq9\" (UID: \"9644270b-e043-430d-b9c6-31bdca276e57\") " pod="openshift-must-gather-h77lq/must-gather-mrgq9"
May 26 15:47:20.539299 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:47:20.539258    2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/9644270b-e043-430d-b9c6-31bdca276e57-must-gather-output\") pod \"must-gather-mrgq9\" (UID: \"9644270b-e043-430d-b9c6-31bdca276e57\") " pod="openshift-must-gather-h77lq/must-gather-mrgq9"
May 26 15:47:20.539406 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:47:20.539326    2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-s9b5d\" (UniqueName: \"kubernetes.io/projected/9644270b-e043-430d-b9c6-31bdca276e57-kube-api-access-s9b5d\") pod \"must-gather-mrgq9\" (UID: \"9644270b-e043-430d-b9c6-31bdca276e57\") " pod="openshift-must-gather-h77lq/must-gather-mrgq9"
May 26 15:47:20.539623 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:47:20.539605    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/9644270b-e043-430d-b9c6-31bdca276e57-must-gather-output\") pod \"must-gather-mrgq9\" (UID: \"9644270b-e043-430d-b9c6-31bdca276e57\") " pod="openshift-must-gather-h77lq/must-gather-mrgq9"
May 26 15:47:20.546962 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:47:20.546940    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-s9b5d\" (UniqueName: \"kubernetes.io/projected/9644270b-e043-430d-b9c6-31bdca276e57-kube-api-access-s9b5d\") pod \"must-gather-mrgq9\" (UID: \"9644270b-e043-430d-b9c6-31bdca276e57\") " pod="openshift-must-gather-h77lq/must-gather-mrgq9"
May 26 15:47:20.636941 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:47:20.636889    2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-h77lq/must-gather-mrgq9"
May 26 15:47:20.757935 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:47:20.757908    2581 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-h77lq/must-gather-mrgq9"]
May 26 15:47:20.761644 ip-10-0-140-164 kubenswrapper[2581]: W0526 15:47:20.761614    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod9644270b_e043_430d_b9c6_31bdca276e57.slice/crio-f89a7a2485b76e0a10c1703eb515b29b85c07b24bacbdad08fe2d06c6589e3b9 WatchSource:0}: Error finding container f89a7a2485b76e0a10c1703eb515b29b85c07b24bacbdad08fe2d06c6589e3b9: Status 404 returned error can't find the container with id f89a7a2485b76e0a10c1703eb515b29b85c07b24bacbdad08fe2d06c6589e3b9
May 26 15:47:20.763245 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:47:20.763226    2581 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
May 26 15:47:20.968598 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:47:20.968539    2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-h77lq/must-gather-mrgq9" event={"ID":"9644270b-e043-430d-b9c6-31bdca276e57","Type":"ContainerStarted","Data":"f89a7a2485b76e0a10c1703eb515b29b85c07b24bacbdad08fe2d06c6589e3b9"}
May 26 15:47:26.990835 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:47:26.990807    2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-h77lq/must-gather-mrgq9" event={"ID":"9644270b-e043-430d-b9c6-31bdca276e57","Type":"ContainerStarted","Data":"824c5699b99190a34c3e36685af0b9ac8df07440df864bbe225c21c0a7d39e0d"}
May 26 15:47:27.996197 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:47:27.996151    2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-h77lq/must-gather-mrgq9" event={"ID":"9644270b-e043-430d-b9c6-31bdca276e57","Type":"ContainerStarted","Data":"64ccef6554d0a9b547694e7be24beee79b74c99ee03f037e670d9cd50b86ee5e"}
May 26 15:47:28.012541 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:47:28.012485    2581 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-must-gather-h77lq/must-gather-mrgq9" podStartSLOduration=1.993536276 podStartE2EDuration="8.012472434s" podCreationTimestamp="2026-05-26 15:47:20 +0000 UTC" firstStartedPulling="2026-05-26 15:47:20.76337993 +0000 UTC m=+1779.761083239" lastFinishedPulling="2026-05-26 15:47:26.782316087 +0000 UTC m=+1785.780019397" observedRunningTime="2026-05-26 15:47:28.012024193 +0000 UTC m=+1787.009727526" watchObservedRunningTime="2026-05-26 15:47:28.012472434 +0000 UTC m=+1787.010175766"
May 26 15:47:37.022712 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:47:37.022666    2581 generic.go:358] "Generic (PLEG): container finished" podID="9644270b-e043-430d-b9c6-31bdca276e57" containerID="824c5699b99190a34c3e36685af0b9ac8df07440df864bbe225c21c0a7d39e0d" exitCode=0
May 26 15:47:37.023136 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:47:37.022725    2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-h77lq/must-gather-mrgq9" event={"ID":"9644270b-e043-430d-b9c6-31bdca276e57","Type":"ContainerDied","Data":"824c5699b99190a34c3e36685af0b9ac8df07440df864bbe225c21c0a7d39e0d"}
May 26 15:47:37.023136 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:47:37.023053    2581 scope.go:117] "RemoveContainer" containerID="824c5699b99190a34c3e36685af0b9ac8df07440df864bbe225c21c0a7d39e0d"
May 26 15:47:37.227714 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:47:37.227693    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-must-gather-h77lq_must-gather-mrgq9_9644270b-e043-430d-b9c6-31bdca276e57/gather/0.log"
May 26 15:47:37.714798 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:47:37.714730    2581 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-must-gather-g8fq7/must-gather-ct9p8"]
May 26 15:47:37.716926 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:47:37.716906    2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-g8fq7/must-gather-ct9p8"
May 26 15:47:37.719468 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:47:37.719443    2581 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-g8fq7\"/\"default-dockercfg-rbl2g\""
May 26 15:47:37.719468 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:47:37.719461    2581 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-g8fq7\"/\"openshift-service-ca.crt\""
May 26 15:47:37.719635 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:47:37.719471    2581 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-g8fq7\"/\"kube-root-ca.crt\""
May 26 15:47:37.728465 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:47:37.728443    2581 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-g8fq7/must-gather-ct9p8"]
May 26 15:47:37.780261 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:47:37.780234    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c7ltc\" (UniqueName: \"kubernetes.io/projected/193bd5ca-b266-4e87-94b7-ffc526f0141a-kube-api-access-c7ltc\") pod \"must-gather-ct9p8\" (UID: \"193bd5ca-b266-4e87-94b7-ffc526f0141a\") " pod="openshift-must-gather-g8fq7/must-gather-ct9p8"
May 26 15:47:37.780362 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:47:37.780284    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/193bd5ca-b266-4e87-94b7-ffc526f0141a-must-gather-output\") pod \"must-gather-ct9p8\" (UID: \"193bd5ca-b266-4e87-94b7-ffc526f0141a\") " pod="openshift-must-gather-g8fq7/must-gather-ct9p8"
May 26 15:47:37.881145 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:47:37.881119    2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-c7ltc\" (UniqueName: \"kubernetes.io/projected/193bd5ca-b266-4e87-94b7-ffc526f0141a-kube-api-access-c7ltc\") pod \"must-gather-ct9p8\" (UID: \"193bd5ca-b266-4e87-94b7-ffc526f0141a\") " pod="openshift-must-gather-g8fq7/must-gather-ct9p8"
May 26 15:47:37.881252 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:47:37.881157    2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/193bd5ca-b266-4e87-94b7-ffc526f0141a-must-gather-output\") pod \"must-gather-ct9p8\" (UID: \"193bd5ca-b266-4e87-94b7-ffc526f0141a\") " pod="openshift-must-gather-g8fq7/must-gather-ct9p8"
May 26 15:47:37.881499 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:47:37.881479    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/193bd5ca-b266-4e87-94b7-ffc526f0141a-must-gather-output\") pod \"must-gather-ct9p8\" (UID: \"193bd5ca-b266-4e87-94b7-ffc526f0141a\") " pod="openshift-must-gather-g8fq7/must-gather-ct9p8"
May 26 15:47:37.890322 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:47:37.890296    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-c7ltc\" (UniqueName: \"kubernetes.io/projected/193bd5ca-b266-4e87-94b7-ffc526f0141a-kube-api-access-c7ltc\") pod \"must-gather-ct9p8\" (UID: \"193bd5ca-b266-4e87-94b7-ffc526f0141a\") " pod="openshift-must-gather-g8fq7/must-gather-ct9p8"
May 26 15:47:38.025440 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:47:38.025418    2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-g8fq7/must-gather-ct9p8"
May 26 15:47:38.149951 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:47:38.149885    2581 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-g8fq7/must-gather-ct9p8"]
May 26 15:47:38.152132 ip-10-0-140-164 kubenswrapper[2581]: W0526 15:47:38.152098    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod193bd5ca_b266_4e87_94b7_ffc526f0141a.slice/crio-d7de4b927487264c9a5399c61595ec2a06f1f8cf70f233a00a354753550aec13 WatchSource:0}: Error finding container d7de4b927487264c9a5399c61595ec2a06f1f8cf70f233a00a354753550aec13: Status 404 returned error can't find the container with id d7de4b927487264c9a5399c61595ec2a06f1f8cf70f233a00a354753550aec13
May 26 15:47:39.035526 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:47:39.035484    2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-g8fq7/must-gather-ct9p8" event={"ID":"193bd5ca-b266-4e87-94b7-ffc526f0141a","Type":"ContainerStarted","Data":"dfd08f75098940cb5d43abcd532864bd30bb26efcc2950b6c533da068b8439f2"}
May 26 15:47:39.035929 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:47:39.035539    2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-g8fq7/must-gather-ct9p8" event={"ID":"193bd5ca-b266-4e87-94b7-ffc526f0141a","Type":"ContainerStarted","Data":"213d8e81575c0d8a7c01e1bec26b8ae7329a2d706b0f469e6e2b9cf7f5009a16"}
May 26 15:47:39.035929 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:47:39.035553    2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-g8fq7/must-gather-ct9p8" event={"ID":"193bd5ca-b266-4e87-94b7-ffc526f0141a","Type":"ContainerStarted","Data":"d7de4b927487264c9a5399c61595ec2a06f1f8cf70f233a00a354753550aec13"}
May 26 15:47:39.051700 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:47:39.051655    2581 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-must-gather-g8fq7/must-gather-ct9p8" podStartSLOduration=1.362290417 podStartE2EDuration="2.051642007s" podCreationTimestamp="2026-05-26 15:47:37 +0000 UTC" firstStartedPulling="2026-05-26 15:47:38.153833135 +0000 UTC m=+1797.151536445" lastFinishedPulling="2026-05-26 15:47:38.843184706 +0000 UTC m=+1797.840888035" observedRunningTime="2026-05-26 15:47:39.049996199 +0000 UTC m=+1798.047699534" watchObservedRunningTime="2026-05-26 15:47:39.051642007 +0000 UTC m=+1798.049345339"
May 26 15:47:40.176433 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:47:40.176397    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-k56cd_be858157-7e73-43be-81e8-aa5e9344923e/global-pull-secret-syncer/0.log"
May 26 15:47:40.276592 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:47:40.276559    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-5nngw_66fc90a9-1fd5-46e0-aa1a-895166fc81b8/konnectivity-agent/0.log"
May 26 15:47:40.340944 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:47:40.340909    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-140-164.ec2.internal_55d5a722a2f6ce4004954f6d492eeaa9/haproxy/0.log"
May 26 15:47:41.643290 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:47:41.642595    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-gjh9c_a02c2727-c53c-48c3-aba7-acde4eef632c/ovn-acl-logging/0.log"
May 26 15:47:41.646125 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:47:41.644972    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-gjh9c_a02c2727-c53c-48c3-aba7-acde4eef632c/ovn-acl-logging/0.log"
May 26 15:47:42.558842 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:47:42.558804    2581 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-must-gather-h77lq/must-gather-mrgq9"]
May 26 15:47:42.559133 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:47:42.559090    2581 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-must-gather-h77lq/must-gather-mrgq9" podUID="9644270b-e043-430d-b9c6-31bdca276e57" containerName="copy" containerID="cri-o://64ccef6554d0a9b547694e7be24beee79b74c99ee03f037e670d9cd50b86ee5e" gracePeriod=2
May 26 15:47:42.562688 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:47:42.562653    2581 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-must-gather-h77lq/must-gather-mrgq9"]
May 26 15:47:42.562908 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:47:42.562873    2581 status_manager.go:895] "Failed to get status for pod" podUID="9644270b-e043-430d-b9c6-31bdca276e57" pod="openshift-must-gather-h77lq/must-gather-mrgq9" err="pods \"must-gather-mrgq9\" is forbidden: User \"system:node:ip-10-0-140-164.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-must-gather-h77lq\": no relationship found between node 'ip-10-0-140-164.ec2.internal' and this object"
May 26 15:47:42.906301 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:47:42.905723    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-must-gather-h77lq_must-gather-mrgq9_9644270b-e043-430d-b9c6-31bdca276e57/copy/0.log"
May 26 15:47:42.929846 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:47:42.929810    2581 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-h77lq/must-gather-mrgq9"
May 26 15:47:42.933516 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:47:42.933483    2581 status_manager.go:895] "Failed to get status for pod" podUID="9644270b-e043-430d-b9c6-31bdca276e57" pod="openshift-must-gather-h77lq/must-gather-mrgq9" err="pods \"must-gather-mrgq9\" is forbidden: User \"system:node:ip-10-0-140-164.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-must-gather-h77lq\": no relationship found between node 'ip-10-0-140-164.ec2.internal' and this object"
May 26 15:47:43.047371 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:47:43.047329    2581 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/9644270b-e043-430d-b9c6-31bdca276e57-must-gather-output\") pod \"9644270b-e043-430d-b9c6-31bdca276e57\" (UID: \"9644270b-e043-430d-b9c6-31bdca276e57\") "
May 26 15:47:43.047554 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:47:43.047433    2581 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-s9b5d\" (UniqueName: \"kubernetes.io/projected/9644270b-e043-430d-b9c6-31bdca276e57-kube-api-access-s9b5d\") pod \"9644270b-e043-430d-b9c6-31bdca276e57\" (UID: \"9644270b-e043-430d-b9c6-31bdca276e57\") "
May 26 15:47:43.048934 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:47:43.048883    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9644270b-e043-430d-b9c6-31bdca276e57-must-gather-output" (OuterVolumeSpecName: "must-gather-output") pod "9644270b-e043-430d-b9c6-31bdca276e57" (UID: "9644270b-e043-430d-b9c6-31bdca276e57"). InnerVolumeSpecName "must-gather-output". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 26 15:47:43.057017 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:47:43.056023    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-must-gather-h77lq_must-gather-mrgq9_9644270b-e043-430d-b9c6-31bdca276e57/copy/0.log"
May 26 15:47:43.057017 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:47:43.056433    2581 generic.go:358] "Generic (PLEG): container finished" podID="9644270b-e043-430d-b9c6-31bdca276e57" containerID="64ccef6554d0a9b547694e7be24beee79b74c99ee03f037e670d9cd50b86ee5e" exitCode=143
May 26 15:47:43.057017 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:47:43.056587    2581 scope.go:117] "RemoveContainer" containerID="64ccef6554d0a9b547694e7be24beee79b74c99ee03f037e670d9cd50b86ee5e"
May 26 15:47:43.057017 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:47:43.056733    2581 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-h77lq/must-gather-mrgq9"
May 26 15:47:43.058775 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:47:43.058162    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9644270b-e043-430d-b9c6-31bdca276e57-kube-api-access-s9b5d" (OuterVolumeSpecName: "kube-api-access-s9b5d") pod "9644270b-e043-430d-b9c6-31bdca276e57" (UID: "9644270b-e043-430d-b9c6-31bdca276e57"). InnerVolumeSpecName "kube-api-access-s9b5d". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 26 15:47:43.059409 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:47:43.059362    2581 status_manager.go:895] "Failed to get status for pod" podUID="9644270b-e043-430d-b9c6-31bdca276e57" pod="openshift-must-gather-h77lq/must-gather-mrgq9" err="pods \"must-gather-mrgq9\" is forbidden: User \"system:node:ip-10-0-140-164.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-must-gather-h77lq\": no relationship found between node 'ip-10-0-140-164.ec2.internal' and this object"
May 26 15:47:43.072081 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:47:43.072056    2581 scope.go:117] "RemoveContainer" containerID="824c5699b99190a34c3e36685af0b9ac8df07440df864bbe225c21c0a7d39e0d"
May 26 15:47:43.092433 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:47:43.092410    2581 scope.go:117] "RemoveContainer" containerID="64ccef6554d0a9b547694e7be24beee79b74c99ee03f037e670d9cd50b86ee5e"
May 26 15:47:43.092873 ip-10-0-140-164 kubenswrapper[2581]: E0526 15:47:43.092842    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"64ccef6554d0a9b547694e7be24beee79b74c99ee03f037e670d9cd50b86ee5e\": container with ID starting with 64ccef6554d0a9b547694e7be24beee79b74c99ee03f037e670d9cd50b86ee5e not found: ID does not exist" containerID="64ccef6554d0a9b547694e7be24beee79b74c99ee03f037e670d9cd50b86ee5e"
May 26 15:47:43.092959 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:47:43.092900    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"64ccef6554d0a9b547694e7be24beee79b74c99ee03f037e670d9cd50b86ee5e"} err="failed to get container status \"64ccef6554d0a9b547694e7be24beee79b74c99ee03f037e670d9cd50b86ee5e\": rpc error: code = NotFound desc = could not find container \"64ccef6554d0a9b547694e7be24beee79b74c99ee03f037e670d9cd50b86ee5e\": container with ID starting with 64ccef6554d0a9b547694e7be24beee79b74c99ee03f037e670d9cd50b86ee5e not found: ID does not exist"
May 26 15:47:43.092959 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:47:43.092927    2581 scope.go:117] "RemoveContainer" containerID="824c5699b99190a34c3e36685af0b9ac8df07440df864bbe225c21c0a7d39e0d"
May 26 15:47:43.093310 ip-10-0-140-164 kubenswrapper[2581]: E0526 15:47:43.093256    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"824c5699b99190a34c3e36685af0b9ac8df07440df864bbe225c21c0a7d39e0d\": container with ID starting with 824c5699b99190a34c3e36685af0b9ac8df07440df864bbe225c21c0a7d39e0d not found: ID does not exist" containerID="824c5699b99190a34c3e36685af0b9ac8df07440df864bbe225c21c0a7d39e0d"
May 26 15:47:43.093387 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:47:43.093318    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"824c5699b99190a34c3e36685af0b9ac8df07440df864bbe225c21c0a7d39e0d"} err="failed to get container status \"824c5699b99190a34c3e36685af0b9ac8df07440df864bbe225c21c0a7d39e0d\": rpc error: code = NotFound desc = could not find container \"824c5699b99190a34c3e36685af0b9ac8df07440df864bbe225c21c0a7d39e0d\": container with ID starting with 824c5699b99190a34c3e36685af0b9ac8df07440df864bbe225c21c0a7d39e0d not found: ID does not exist"
May 26 15:47:43.148102 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:47:43.148014    2581 reconciler_common.go:299] "Volume detached for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/9644270b-e043-430d-b9c6-31bdca276e57-must-gather-output\") on node \"ip-10-0-140-164.ec2.internal\" DevicePath \"\""
May 26 15:47:43.148102 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:47:43.148052    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-s9b5d\" (UniqueName: \"kubernetes.io/projected/9644270b-e043-430d-b9c6-31bdca276e57-kube-api-access-s9b5d\") on node \"ip-10-0-140-164.ec2.internal\" DevicePath \"\""
May 26 15:47:43.372289 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:47:43.371313    2581 status_manager.go:895] "Failed to get status for pod" podUID="9644270b-e043-430d-b9c6-31bdca276e57" pod="openshift-must-gather-h77lq/must-gather-mrgq9" err="pods \"must-gather-mrgq9\" is forbidden: User \"system:node:ip-10-0-140-164.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-must-gather-h77lq\": no relationship found between node 'ip-10-0-140-164.ec2.internal' and this object"
May 26 15:47:43.643521 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:47:43.643070    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9644270b-e043-430d-b9c6-31bdca276e57" path="/var/lib/kubelet/pods/9644270b-e043-430d-b9c6-31bdca276e57/volumes"
May 26 15:47:43.718718 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:47:43.718671    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-54fd6bc5c4-ktdc2_b0344c87-ad7a-4941-83d8-af9aaba6a98d/kube-state-metrics/0.log"
May 26 15:47:43.736602 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:47:43.736560    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-54fd6bc5c4-ktdc2_b0344c87-ad7a-4941-83d8-af9aaba6a98d/kube-rbac-proxy-main/0.log"
May 26 15:47:43.758407 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:47:43.758373    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-54fd6bc5c4-ktdc2_b0344c87-ad7a-4941-83d8-af9aaba6a98d/kube-rbac-proxy-self/0.log"
May 26 15:47:43.817075 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:47:43.817049    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-665c9c8584-j84dx_026e0a6c-81b3-491b-814d-e995000a1f31/monitoring-plugin/0.log"
May 26 15:47:43.850118 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:47:43.850087    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-b8c4b_404ea169-f680-4d99-95f6-e080f07a8c1c/node-exporter/0.log"
May 26 15:47:43.870819 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:47:43.870741    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-b8c4b_404ea169-f680-4d99-95f6-e080f07a8c1c/kube-rbac-proxy/0.log"
May 26 15:47:43.892907 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:47:43.892881    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-b8c4b_404ea169-f680-4d99-95f6-e080f07a8c1c/init-textfile/0.log"
May 26 15:47:44.376373 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:47:44.376341    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-fcf4cdf6d-gvlbr_d5631af4-503f-41e4-a88d-2723d9085094/telemeter-client/0.log"
May 26 15:47:44.396110 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:47:44.396056    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-fcf4cdf6d-gvlbr_d5631af4-503f-41e4-a88d-2723d9085094/reload/0.log"
May 26 15:47:44.417153 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:47:44.417123    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-fcf4cdf6d-gvlbr_d5631af4-503f-41e4-a88d-2723d9085094/kube-rbac-proxy/0.log"
May 26 15:47:46.404568 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:47:46.404537    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-57bcfb696-sk7rg_d644ea72-00d5-49f9-9263-af4f023589e9/console/0.log"
May 26 15:47:46.689093 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:47:46.689002    2581 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-must-gather-g8fq7/perf-node-gather-daemonset-2x7ff"]
May 26 15:47:46.689412 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:47:46.689396    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9644270b-e043-430d-b9c6-31bdca276e57" containerName="gather"
May 26 15:47:46.689472 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:47:46.689417    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="9644270b-e043-430d-b9c6-31bdca276e57" containerName="gather"
May 26 15:47:46.689472 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:47:46.689434    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9644270b-e043-430d-b9c6-31bdca276e57" containerName="copy"
May 26 15:47:46.689472 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:47:46.689442    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="9644270b-e043-430d-b9c6-31bdca276e57" containerName="copy"
May 26 15:47:46.689580 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:47:46.689509    2581 memory_manager.go:356] "RemoveStaleState removing state" podUID="9644270b-e043-430d-b9c6-31bdca276e57" containerName="gather"
May 26 15:47:46.689580 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:47:46.689520    2581 memory_manager.go:356] "RemoveStaleState removing state" podUID="9644270b-e043-430d-b9c6-31bdca276e57" containerName="copy"
May 26 15:47:46.692951 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:47:46.692918    2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-g8fq7/perf-node-gather-daemonset-2x7ff"
May 26 15:47:46.703223 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:47:46.703176    2581 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-g8fq7/perf-node-gather-daemonset-2x7ff"]
May 26 15:47:46.782687 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:47:46.782655    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/32c7884f-e4a5-4deb-913a-e488cd83103c-proc\") pod \"perf-node-gather-daemonset-2x7ff\" (UID: \"32c7884f-e4a5-4deb-913a-e488cd83103c\") " pod="openshift-must-gather-g8fq7/perf-node-gather-daemonset-2x7ff"
May 26 15:47:46.782687 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:47:46.782693    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/32c7884f-e4a5-4deb-913a-e488cd83103c-lib-modules\") pod \"perf-node-gather-daemonset-2x7ff\" (UID: \"32c7884f-e4a5-4deb-913a-e488cd83103c\") " pod="openshift-must-gather-g8fq7/perf-node-gather-daemonset-2x7ff"
May 26 15:47:46.782920 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:47:46.782713    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/32c7884f-e4a5-4deb-913a-e488cd83103c-sys\") pod \"perf-node-gather-daemonset-2x7ff\" (UID: \"32c7884f-e4a5-4deb-913a-e488cd83103c\") " pod="openshift-must-gather-g8fq7/perf-node-gather-daemonset-2x7ff"
May 26 15:47:46.782920 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:47:46.782801    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2h7h4\" (UniqueName: \"kubernetes.io/projected/32c7884f-e4a5-4deb-913a-e488cd83103c-kube-api-access-2h7h4\") pod \"perf-node-gather-daemonset-2x7ff\" (UID: \"32c7884f-e4a5-4deb-913a-e488cd83103c\") " pod="openshift-must-gather-g8fq7/perf-node-gather-daemonset-2x7ff"
May 26 15:47:46.782920 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:47:46.782855    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/32c7884f-e4a5-4deb-913a-e488cd83103c-podres\") pod \"perf-node-gather-daemonset-2x7ff\" (UID: \"32c7884f-e4a5-4deb-913a-e488cd83103c\") " pod="openshift-must-gather-g8fq7/perf-node-gather-daemonset-2x7ff"
May 26 15:47:46.883619 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:47:46.883586    2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/32c7884f-e4a5-4deb-913a-e488cd83103c-podres\") pod \"perf-node-gather-daemonset-2x7ff\" (UID: \"32c7884f-e4a5-4deb-913a-e488cd83103c\") " pod="openshift-must-gather-g8fq7/perf-node-gather-daemonset-2x7ff"
May 26 15:47:46.883799 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:47:46.883643    2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/32c7884f-e4a5-4deb-913a-e488cd83103c-proc\") pod \"perf-node-gather-daemonset-2x7ff\" (UID: \"32c7884f-e4a5-4deb-913a-e488cd83103c\") " pod="openshift-must-gather-g8fq7/perf-node-gather-daemonset-2x7ff"
May 26 15:47:46.883799 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:47:46.883661    2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/32c7884f-e4a5-4deb-913a-e488cd83103c-lib-modules\") pod \"perf-node-gather-daemonset-2x7ff\" (UID: \"32c7884f-e4a5-4deb-913a-e488cd83103c\") " pod="openshift-must-gather-g8fq7/perf-node-gather-daemonset-2x7ff"
May 26 15:47:46.883799 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:47:46.883681    2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/32c7884f-e4a5-4deb-913a-e488cd83103c-sys\") pod \"perf-node-gather-daemonset-2x7ff\" (UID: \"32c7884f-e4a5-4deb-913a-e488cd83103c\") " pod="openshift-must-gather-g8fq7/perf-node-gather-daemonset-2x7ff"
May 26 15:47:46.883799 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:47:46.883703    2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-2h7h4\" (UniqueName: \"kubernetes.io/projected/32c7884f-e4a5-4deb-913a-e488cd83103c-kube-api-access-2h7h4\") pod \"perf-node-gather-daemonset-2x7ff\" (UID: \"32c7884f-e4a5-4deb-913a-e488cd83103c\") " pod="openshift-must-gather-g8fq7/perf-node-gather-daemonset-2x7ff"
May 26 15:47:46.883799 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:47:46.883729    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/32c7884f-e4a5-4deb-913a-e488cd83103c-proc\") pod \"perf-node-gather-daemonset-2x7ff\" (UID: \"32c7884f-e4a5-4deb-913a-e488cd83103c\") " pod="openshift-must-gather-g8fq7/perf-node-gather-daemonset-2x7ff"
May 26 15:47:46.883799 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:47:46.883744    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/32c7884f-e4a5-4deb-913a-e488cd83103c-podres\") pod \"perf-node-gather-daemonset-2x7ff\" (UID: \"32c7884f-e4a5-4deb-913a-e488cd83103c\") " pod="openshift-must-gather-g8fq7/perf-node-gather-daemonset-2x7ff"
May 26 15:47:46.883799 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:47:46.883800    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/32c7884f-e4a5-4deb-913a-e488cd83103c-sys\") pod \"perf-node-gather-daemonset-2x7ff\" (UID: \"32c7884f-e4a5-4deb-913a-e488cd83103c\") " pod="openshift-must-gather-g8fq7/perf-node-gather-daemonset-2x7ff"
May 26 15:47:46.884045 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:47:46.883857    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/32c7884f-e4a5-4deb-913a-e488cd83103c-lib-modules\") pod \"perf-node-gather-daemonset-2x7ff\" (UID: \"32c7884f-e4a5-4deb-913a-e488cd83103c\") " pod="openshift-must-gather-g8fq7/perf-node-gather-daemonset-2x7ff"
May 26 15:47:46.892591 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:47:46.892567    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2h7h4\" (UniqueName: \"kubernetes.io/projected/32c7884f-e4a5-4deb-913a-e488cd83103c-kube-api-access-2h7h4\") pod \"perf-node-gather-daemonset-2x7ff\" (UID: \"32c7884f-e4a5-4deb-913a-e488cd83103c\") " pod="openshift-must-gather-g8fq7/perf-node-gather-daemonset-2x7ff"
May 26 15:47:47.004473 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:47:47.004322    2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-g8fq7/perf-node-gather-daemonset-2x7ff"
May 26 15:47:47.157221 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:47:47.157196    2581 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-g8fq7/perf-node-gather-daemonset-2x7ff"]
May 26 15:47:47.444170 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:47:47.444094    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-l4rks_c1324645-ef27-41da-851e-615da7eab3b0/dns/0.log"
May 26 15:47:47.462970 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:47:47.462938    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-l4rks_c1324645-ef27-41da-851e-615da7eab3b0/kube-rbac-proxy/0.log"
May 26 15:47:47.529397 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:47:47.529376    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-6j49h_9f965e2e-8e40-4ab4-b3cd-0d52ba317cf2/dns-node-resolver/0.log"
May 26 15:47:47.973426 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:47:47.973400    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-khnr9_706d11ce-61db-4788-83f2-2ffbea860487/node-ca/0.log"
May 26 15:47:48.074155 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:47:48.074114    2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-g8fq7/perf-node-gather-daemonset-2x7ff" event={"ID":"32c7884f-e4a5-4deb-913a-e488cd83103c","Type":"ContainerStarted","Data":"aea59ecc3026c39bac507531239a106cdfe3c64827740f8f8bb06a04b561f9af"}
May 26 15:47:48.074343 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:47:48.074161    2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-g8fq7/perf-node-gather-daemonset-2x7ff" event={"ID":"32c7884f-e4a5-4deb-913a-e488cd83103c","Type":"ContainerStarted","Data":"d0e2225400095f43aea84c6325d6b2ae66baac1131f7436c7cb1daba54353fcd"}
May 26 15:47:48.074343 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:47:48.074251    2581 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-g8fq7/perf-node-gather-daemonset-2x7ff"
May 26 15:47:48.090727 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:47:48.090677    2581 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-must-gather-g8fq7/perf-node-gather-daemonset-2x7ff" podStartSLOduration=2.090664932 podStartE2EDuration="2.090664932s" podCreationTimestamp="2026-05-26 15:47:46 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-26 15:47:48.08910562 +0000 UTC m=+1807.086808952" watchObservedRunningTime="2026-05-26 15:47:48.090664932 +0000 UTC m=+1807.088368329"
May 26 15:47:48.596870 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:47:48.596846    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-6586767b64-jdqqn_d4359b58-cee4-4040-9a23-d1545122d3c6/router/0.log"
May 26 15:47:48.904156 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:47:48.904066    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-kgzwq_37c203f3-fea7-4b18-a713-d805bf7dd8d9/serve-healthcheck-canary/0.log"
May 26 15:47:49.324157 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:47:49.324130    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-8lknj_25d91a97-694b-459e-8b9e-aa7773e68e60/kube-rbac-proxy/0.log"
May 26 15:47:49.344472 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:47:49.344449    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-8lknj_25d91a97-694b-459e-8b9e-aa7773e68e60/exporter/0.log"
May 26 15:47:49.366643 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:47:49.366619    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-8lknj_25d91a97-694b-459e-8b9e-aa7773e68e60/extractor/0.log"
May 26 15:47:54.087722 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:47:54.087694    2581 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-g8fq7/perf-node-gather-daemonset-2x7ff"
May 26 15:47:54.475128 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:47:54.475053    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-bglww_afbaeb5e-924a-4076-a161-94955178994c/kube-multus-additional-cni-plugins/0.log"
May 26 15:47:54.497530 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:47:54.497501    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-bglww_afbaeb5e-924a-4076-a161-94955178994c/egress-router-binary-copy/0.log"
May 26 15:47:54.517192 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:47:54.517169    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-bglww_afbaeb5e-924a-4076-a161-94955178994c/cni-plugins/0.log"
May 26 15:47:54.536066 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:47:54.536040    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-bglww_afbaeb5e-924a-4076-a161-94955178994c/bond-cni-plugin/0.log"
May 26 15:47:54.561405 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:47:54.561378    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-bglww_afbaeb5e-924a-4076-a161-94955178994c/routeoverride-cni/0.log"
May 26 15:47:54.584453 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:47:54.584433    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-bglww_afbaeb5e-924a-4076-a161-94955178994c/whereabouts-cni-bincopy/0.log"
May 26 15:47:54.604330 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:47:54.604304    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-bglww_afbaeb5e-924a-4076-a161-94955178994c/whereabouts-cni/0.log"
May 26 15:47:54.816529 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:47:54.816409    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-x5ptz_d861eb05-53c3-4d05-8dce-5a7c60573358/kube-multus/0.log"
May 26 15:47:54.837378 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:47:54.837330    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-npzrf_ae574985-4900-4b23-bf74-7c72c939f9bd/network-metrics-daemon/0.log"
May 26 15:47:54.860568 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:47:54.860517    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-npzrf_ae574985-4900-4b23-bf74-7c72c939f9bd/kube-rbac-proxy/0.log"
May 26 15:47:56.281714 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:47:56.281684    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-gjh9c_a02c2727-c53c-48c3-aba7-acde4eef632c/ovn-controller/0.log"
May 26 15:47:56.297773 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:47:56.297757    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-gjh9c_a02c2727-c53c-48c3-aba7-acde4eef632c/ovn-acl-logging/0.log"
May 26 15:47:56.307094 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:47:56.307058    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-gjh9c_a02c2727-c53c-48c3-aba7-acde4eef632c/ovn-acl-logging/1.log"
May 26 15:47:56.324855 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:47:56.324831    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-gjh9c_a02c2727-c53c-48c3-aba7-acde4eef632c/kube-rbac-proxy-node/0.log"
May 26 15:47:56.342926 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:47:56.342904    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-gjh9c_a02c2727-c53c-48c3-aba7-acde4eef632c/kube-rbac-proxy-ovn-metrics/0.log"
May 26 15:47:56.359511 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:47:56.359450    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-gjh9c_a02c2727-c53c-48c3-aba7-acde4eef632c/northd/0.log"
May 26 15:47:56.377469 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:47:56.377449    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-gjh9c_a02c2727-c53c-48c3-aba7-acde4eef632c/nbdb/0.log"
May 26 15:47:56.395654 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:47:56.395633    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-gjh9c_a02c2727-c53c-48c3-aba7-acde4eef632c/sbdb/0.log"
May 26 15:47:56.497696 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:47:56.497672    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-gjh9c_a02c2727-c53c-48c3-aba7-acde4eef632c/ovnkube-controller/0.log"
May 26 15:47:57.377097 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:47:57.377009    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-diagnostics_network-check-source-7f44b6dd87-bzvwj_7e643816-5795-4bd4-9145-753987fb638e/check-endpoints/0.log"
May 26 15:47:57.463852 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:47:57.463826    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-diagnostics_network-check-target-qr6zm_000947e2-0eeb-4d43-8dc4-6132e5e6cc13/network-check-target-container/0.log"
May 26 15:47:58.253805 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:47:58.253776    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-operator_iptables-alerter-nprns_efa65a4e-8688-4521-bf81-8938e3041f72/iptables-alerter/0.log"
May 26 15:47:58.787240 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:47:58.787209    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-node-tuning-operator_tuned-9rvq6_1817fb6f-f287-4f86-b684-9b9132f3561a/tuned/0.log"
May 26 15:48:01.496963 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:48:01.496937    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-service-ca_service-ca-67d667c7d-vlbpz_962955c0-08cb-489f-a073-30ab949b0350/service-ca-controller/0.log"
May 26 15:48:01.952398 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:48:01.952327    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-csi-drivers_aws-ebs-csi-driver-node-vsvmw_07693aae-634c-4a2f-ac21-fb1bf39c239a/csi-driver/0.log"
May 26 15:48:01.975928 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:48:01.975903    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-csi-drivers_aws-ebs-csi-driver-node-vsvmw_07693aae-634c-4a2f-ac21-fb1bf39c239a/csi-node-driver-registrar/0.log"
May 26 15:48:01.997803 ip-10-0-140-164 kubenswrapper[2581]: I0526 15:48:01.997781    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-csi-drivers_aws-ebs-csi-driver-node-vsvmw_07693aae-634c-4a2f-ac21-fb1bf39c239a/csi-liveness-probe/0.log"