May 27 23:30:28.035044 ip-10-0-132-191 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory
May 27 23:30:28.035053 ip-10-0-132-191 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory
May 27 23:30:28.035061 ip-10-0-132-191 systemd[1]: kubelet.service: Failed with result 'resources'.
May 27 23:30:28.035310 ip-10-0-132-191 systemd[1]: Failed to start Kubernetes Kubelet.
May 27 23:30:38.256682 ip-10-0-132-191 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found.
May 27 23:30:38.256697 ip-10-0-132-191 systemd[1]: kubelet.service: Failed with result 'resources'.
-- Boot 8ac75d56436a4a5f93e142aa75ba7d40 --
May 27 23:33:04.443498 ip-10-0-132-191 systemd[1]: Starting Kubernetes Kubelet...
May 27 23:33:04.944911 ip-10-0-132-191 kubenswrapper[2557]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
May 27 23:33:04.944911 ip-10-0-132-191 kubenswrapper[2557]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
May 27 23:33:04.944911 ip-10-0-132-191 kubenswrapper[2557]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
May 27 23:33:04.944911 ip-10-0-132-191 kubenswrapper[2557]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
May 27 23:33:04.944911 ip-10-0-132-191 kubenswrapper[2557]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
May 27 23:33:04.945883 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:04.945782    2557 server.go:212] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
May 27 23:33:04.951013 ip-10-0-132-191 kubenswrapper[2557]: W0527 23:33:04.950990    2557 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
May 27 23:33:04.951013 ip-10-0-132-191 kubenswrapper[2557]: W0527 23:33:04.951009    2557 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
May 27 23:33:04.951013 ip-10-0-132-191 kubenswrapper[2557]: W0527 23:33:04.951013    2557 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
May 27 23:33:04.951013 ip-10-0-132-191 kubenswrapper[2557]: W0527 23:33:04.951016    2557 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
May 27 23:33:04.951013 ip-10-0-132-191 kubenswrapper[2557]: W0527 23:33:04.951019    2557 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
May 27 23:33:04.951226 ip-10-0-132-191 kubenswrapper[2557]: W0527 23:33:04.951022    2557 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
May 27 23:33:04.951226 ip-10-0-132-191 kubenswrapper[2557]: W0527 23:33:04.951026    2557 feature_gate.go:328] unrecognized feature gate: DualReplica
May 27 23:33:04.951226 ip-10-0-132-191 kubenswrapper[2557]: W0527 23:33:04.951029    2557 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
May 27 23:33:04.951226 ip-10-0-132-191 kubenswrapper[2557]: W0527 23:33:04.951032    2557 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
May 27 23:33:04.951226 ip-10-0-132-191 kubenswrapper[2557]: W0527 23:33:04.951035    2557 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
May 27 23:33:04.951226 ip-10-0-132-191 kubenswrapper[2557]: W0527 23:33:04.951038    2557 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS
May 27 23:33:04.951226 ip-10-0-132-191 kubenswrapper[2557]: W0527 23:33:04.951041    2557 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
May 27 23:33:04.951226 ip-10-0-132-191 kubenswrapper[2557]: W0527 23:33:04.951043    2557 feature_gate.go:328] unrecognized feature gate: NewOLM
May 27 23:33:04.951226 ip-10-0-132-191 kubenswrapper[2557]: W0527 23:33:04.951046    2557 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
May 27 23:33:04.951226 ip-10-0-132-191 kubenswrapper[2557]: W0527 23:33:04.951050    2557 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
May 27 23:33:04.951226 ip-10-0-132-191 kubenswrapper[2557]: W0527 23:33:04.951054    2557 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
May 27 23:33:04.951226 ip-10-0-132-191 kubenswrapper[2557]: W0527 23:33:04.951058    2557 feature_gate.go:328] unrecognized feature gate: PinnedImages
May 27 23:33:04.951226 ip-10-0-132-191 kubenswrapper[2557]: W0527 23:33:04.951063    2557 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
May 27 23:33:04.951226 ip-10-0-132-191 kubenswrapper[2557]: W0527 23:33:04.951066    2557 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
May 27 23:33:04.951226 ip-10-0-132-191 kubenswrapper[2557]: W0527 23:33:04.951074    2557 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
May 27 23:33:04.951226 ip-10-0-132-191 kubenswrapper[2557]: W0527 23:33:04.951080    2557 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
May 27 23:33:04.951226 ip-10-0-132-191 kubenswrapper[2557]: W0527 23:33:04.951093    2557 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
May 27 23:33:04.951226 ip-10-0-132-191 kubenswrapper[2557]: W0527 23:33:04.951096    2557 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
May 27 23:33:04.951226 ip-10-0-132-191 kubenswrapper[2557]: W0527 23:33:04.951099    2557 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
May 27 23:33:04.951226 ip-10-0-132-191 kubenswrapper[2557]: W0527 23:33:04.951101    2557 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
May 27 23:33:04.951708 ip-10-0-132-191 kubenswrapper[2557]: W0527 23:33:04.951104    2557 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI
May 27 23:33:04.951708 ip-10-0-132-191 kubenswrapper[2557]: W0527 23:33:04.951106    2557 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
May 27 23:33:04.951708 ip-10-0-132-191 kubenswrapper[2557]: W0527 23:33:04.951109    2557 feature_gate.go:328] unrecognized feature gate: SignatureStores
May 27 23:33:04.951708 ip-10-0-132-191 kubenswrapper[2557]: W0527 23:33:04.951111    2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
May 27 23:33:04.951708 ip-10-0-132-191 kubenswrapper[2557]: W0527 23:33:04.951114    2557 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
May 27 23:33:04.951708 ip-10-0-132-191 kubenswrapper[2557]: W0527 23:33:04.951117    2557 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
May 27 23:33:04.951708 ip-10-0-132-191 kubenswrapper[2557]: W0527 23:33:04.951120    2557 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
May 27 23:33:04.951708 ip-10-0-132-191 kubenswrapper[2557]: W0527 23:33:04.951122    2557 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
May 27 23:33:04.951708 ip-10-0-132-191 kubenswrapper[2557]: W0527 23:33:04.951142    2557 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
May 27 23:33:04.951708 ip-10-0-132-191 kubenswrapper[2557]: W0527 23:33:04.951145    2557 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController
May 27 23:33:04.951708 ip-10-0-132-191 kubenswrapper[2557]: W0527 23:33:04.951148    2557 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
May 27 23:33:04.951708 ip-10-0-132-191 kubenswrapper[2557]: W0527 23:33:04.951150    2557 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
May 27 23:33:04.951708 ip-10-0-132-191 kubenswrapper[2557]: W0527 23:33:04.951153    2557 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
May 27 23:33:04.951708 ip-10-0-132-191 kubenswrapper[2557]: W0527 23:33:04.951157    2557 feature_gate.go:328] unrecognized feature gate: Example
May 27 23:33:04.951708 ip-10-0-132-191 kubenswrapper[2557]: W0527 23:33:04.951160    2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
May 27 23:33:04.951708 ip-10-0-132-191 kubenswrapper[2557]: W0527 23:33:04.951163    2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
May 27 23:33:04.951708 ip-10-0-132-191 kubenswrapper[2557]: W0527 23:33:04.951165    2557 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
May 27 23:33:04.951708 ip-10-0-132-191 kubenswrapper[2557]: W0527 23:33:04.951168    2557 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations
May 27 23:33:04.951708 ip-10-0-132-191 kubenswrapper[2557]: W0527 23:33:04.951171    2557 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
May 27 23:33:04.951708 ip-10-0-132-191 kubenswrapper[2557]: W0527 23:33:04.951174    2557 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
May 27 23:33:04.952273 ip-10-0-132-191 kubenswrapper[2557]: W0527 23:33:04.951177    2557 feature_gate.go:328] unrecognized feature gate: OVNObservability
May 27 23:33:04.952273 ip-10-0-132-191 kubenswrapper[2557]: W0527 23:33:04.951180    2557 feature_gate.go:328] unrecognized feature gate: GatewayAPI
May 27 23:33:04.952273 ip-10-0-132-191 kubenswrapper[2557]: W0527 23:33:04.951183    2557 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
May 27 23:33:04.952273 ip-10-0-132-191 kubenswrapper[2557]: W0527 23:33:04.951186    2557 feature_gate.go:328] unrecognized feature gate: Example2
May 27 23:33:04.952273 ip-10-0-132-191 kubenswrapper[2557]: W0527 23:33:04.951188    2557 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
May 27 23:33:04.952273 ip-10-0-132-191 kubenswrapper[2557]: W0527 23:33:04.951191    2557 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
May 27 23:33:04.952273 ip-10-0-132-191 kubenswrapper[2557]: W0527 23:33:04.951194    2557 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
May 27 23:33:04.952273 ip-10-0-132-191 kubenswrapper[2557]: W0527 23:33:04.951196    2557 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
May 27 23:33:04.952273 ip-10-0-132-191 kubenswrapper[2557]: W0527 23:33:04.951199    2557 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
May 27 23:33:04.952273 ip-10-0-132-191 kubenswrapper[2557]: W0527 23:33:04.951202    2557 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
May 27 23:33:04.952273 ip-10-0-132-191 kubenswrapper[2557]: W0527 23:33:04.951205    2557 feature_gate.go:328] unrecognized feature gate: InsightsConfig
May 27 23:33:04.952273 ip-10-0-132-191 kubenswrapper[2557]: W0527 23:33:04.951207    2557 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
May 27 23:33:04.952273 ip-10-0-132-191 kubenswrapper[2557]: W0527 23:33:04.951210    2557 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
May 27 23:33:04.952273 ip-10-0-132-191 kubenswrapper[2557]: W0527 23:33:04.951213    2557 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
May 27 23:33:04.952273 ip-10-0-132-191 kubenswrapper[2557]: W0527 23:33:04.951215    2557 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
May 27 23:33:04.952273 ip-10-0-132-191 kubenswrapper[2557]: W0527 23:33:04.951219    2557 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
May 27 23:33:04.952273 ip-10-0-132-191 kubenswrapper[2557]: W0527 23:33:04.951223    2557 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
May 27 23:33:04.952273 ip-10-0-132-191 kubenswrapper[2557]: W0527 23:33:04.951226    2557 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
May 27 23:33:04.952273 ip-10-0-132-191 kubenswrapper[2557]: W0527 23:33:04.951231    2557 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
May 27 23:33:04.952273 ip-10-0-132-191 kubenswrapper[2557]: W0527 23:33:04.951235    2557 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
May 27 23:33:04.952747 ip-10-0-132-191 kubenswrapper[2557]: W0527 23:33:04.951240    2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
May 27 23:33:04.952747 ip-10-0-132-191 kubenswrapper[2557]: W0527 23:33:04.951243    2557 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
May 27 23:33:04.952747 ip-10-0-132-191 kubenswrapper[2557]: W0527 23:33:04.951246    2557 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
May 27 23:33:04.952747 ip-10-0-132-191 kubenswrapper[2557]: W0527 23:33:04.951249    2557 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
May 27 23:33:04.952747 ip-10-0-132-191 kubenswrapper[2557]: W0527 23:33:04.951252    2557 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
May 27 23:33:04.952747 ip-10-0-132-191 kubenswrapper[2557]: W0527 23:33:04.951255    2557 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
May 27 23:33:04.952747 ip-10-0-132-191 kubenswrapper[2557]: W0527 23:33:04.951257    2557 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
May 27 23:33:04.952747 ip-10-0-132-191 kubenswrapper[2557]: W0527 23:33:04.951260    2557 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
May 27 23:33:04.952747 ip-10-0-132-191 kubenswrapper[2557]: W0527 23:33:04.951263    2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
May 27 23:33:04.952747 ip-10-0-132-191 kubenswrapper[2557]: W0527 23:33:04.951265    2557 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
May 27 23:33:04.952747 ip-10-0-132-191 kubenswrapper[2557]: W0527 23:33:04.951268    2557 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
May 27 23:33:04.952747 ip-10-0-132-191 kubenswrapper[2557]: W0527 23:33:04.951271    2557 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
May 27 23:33:04.952747 ip-10-0-132-191 kubenswrapper[2557]: W0527 23:33:04.951273    2557 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
May 27 23:33:04.952747 ip-10-0-132-191 kubenswrapper[2557]: W0527 23:33:04.951283    2557 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
May 27 23:33:04.952747 ip-10-0-132-191 kubenswrapper[2557]: W0527 23:33:04.951286    2557 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
May 27 23:33:04.952747 ip-10-0-132-191 kubenswrapper[2557]: W0527 23:33:04.951289    2557 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
May 27 23:33:04.952747 ip-10-0-132-191 kubenswrapper[2557]: W0527 23:33:04.951291    2557 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
May 27 23:33:04.952747 ip-10-0-132-191 kubenswrapper[2557]: W0527 23:33:04.951295    2557 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
May 27 23:33:04.952747 ip-10-0-132-191 kubenswrapper[2557]: W0527 23:33:04.951298    2557 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
May 27 23:33:04.952747 ip-10-0-132-191 kubenswrapper[2557]: W0527 23:33:04.951301    2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
May 27 23:33:04.953236 ip-10-0-132-191 kubenswrapper[2557]: W0527 23:33:04.951304    2557 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
May 27 23:33:04.953236 ip-10-0-132-191 kubenswrapper[2557]: W0527 23:33:04.951695    2557 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
May 27 23:33:04.953236 ip-10-0-132-191 kubenswrapper[2557]: W0527 23:33:04.951700    2557 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
May 27 23:33:04.953236 ip-10-0-132-191 kubenswrapper[2557]: W0527 23:33:04.951702    2557 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations
May 27 23:33:04.953236 ip-10-0-132-191 kubenswrapper[2557]: W0527 23:33:04.951705    2557 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
May 27 23:33:04.953236 ip-10-0-132-191 kubenswrapper[2557]: W0527 23:33:04.951708    2557 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
May 27 23:33:04.953236 ip-10-0-132-191 kubenswrapper[2557]: W0527 23:33:04.951711    2557 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
May 27 23:33:04.953236 ip-10-0-132-191 kubenswrapper[2557]: W0527 23:33:04.951713    2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
May 27 23:33:04.953236 ip-10-0-132-191 kubenswrapper[2557]: W0527 23:33:04.951716    2557 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
May 27 23:33:04.953236 ip-10-0-132-191 kubenswrapper[2557]: W0527 23:33:04.951719    2557 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
May 27 23:33:04.953236 ip-10-0-132-191 kubenswrapper[2557]: W0527 23:33:04.951722    2557 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
May 27 23:33:04.953236 ip-10-0-132-191 kubenswrapper[2557]: W0527 23:33:04.951724    2557 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
May 27 23:33:04.953236 ip-10-0-132-191 kubenswrapper[2557]: W0527 23:33:04.951727    2557 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
May 27 23:33:04.953236 ip-10-0-132-191 kubenswrapper[2557]: W0527 23:33:04.951731    2557 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
May 27 23:33:04.953236 ip-10-0-132-191 kubenswrapper[2557]: W0527 23:33:04.951735    2557 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
May 27 23:33:04.953236 ip-10-0-132-191 kubenswrapper[2557]: W0527 23:33:04.951738    2557 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
May 27 23:33:04.953236 ip-10-0-132-191 kubenswrapper[2557]: W0527 23:33:04.951741    2557 feature_gate.go:328] unrecognized feature gate: OVNObservability
May 27 23:33:04.953236 ip-10-0-132-191 kubenswrapper[2557]: W0527 23:33:04.951744    2557 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
May 27 23:33:04.953236 ip-10-0-132-191 kubenswrapper[2557]: W0527 23:33:04.951747    2557 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
May 27 23:33:04.953776 ip-10-0-132-191 kubenswrapper[2557]: W0527 23:33:04.951750    2557 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
May 27 23:33:04.953776 ip-10-0-132-191 kubenswrapper[2557]: W0527 23:33:04.951753    2557 feature_gate.go:328] unrecognized feature gate: GatewayAPI
May 27 23:33:04.953776 ip-10-0-132-191 kubenswrapper[2557]: W0527 23:33:04.951756    2557 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
May 27 23:33:04.953776 ip-10-0-132-191 kubenswrapper[2557]: W0527 23:33:04.951758    2557 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
May 27 23:33:04.953776 ip-10-0-132-191 kubenswrapper[2557]: W0527 23:33:04.951761    2557 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
May 27 23:33:04.953776 ip-10-0-132-191 kubenswrapper[2557]: W0527 23:33:04.951763    2557 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
May 27 23:33:04.953776 ip-10-0-132-191 kubenswrapper[2557]: W0527 23:33:04.951767    2557 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
May 27 23:33:04.953776 ip-10-0-132-191 kubenswrapper[2557]: W0527 23:33:04.951769    2557 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
May 27 23:33:04.953776 ip-10-0-132-191 kubenswrapper[2557]: W0527 23:33:04.951772    2557 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
May 27 23:33:04.953776 ip-10-0-132-191 kubenswrapper[2557]: W0527 23:33:04.951774    2557 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
May 27 23:33:04.953776 ip-10-0-132-191 kubenswrapper[2557]: W0527 23:33:04.951777    2557 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
May 27 23:33:04.953776 ip-10-0-132-191 kubenswrapper[2557]: W0527 23:33:04.951779    2557 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
May 27 23:33:04.953776 ip-10-0-132-191 kubenswrapper[2557]: W0527 23:33:04.951782    2557 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
May 27 23:33:04.953776 ip-10-0-132-191 kubenswrapper[2557]: W0527 23:33:04.951784    2557 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
May 27 23:33:04.953776 ip-10-0-132-191 kubenswrapper[2557]: W0527 23:33:04.951786    2557 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
May 27 23:33:04.953776 ip-10-0-132-191 kubenswrapper[2557]: W0527 23:33:04.951789    2557 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
May 27 23:33:04.953776 ip-10-0-132-191 kubenswrapper[2557]: W0527 23:33:04.951792    2557 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
May 27 23:33:04.953776 ip-10-0-132-191 kubenswrapper[2557]: W0527 23:33:04.951795    2557 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
May 27 23:33:04.953776 ip-10-0-132-191 kubenswrapper[2557]: W0527 23:33:04.951798    2557 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
May 27 23:33:04.953776 ip-10-0-132-191 kubenswrapper[2557]: W0527 23:33:04.951800    2557 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
May 27 23:33:04.954285 ip-10-0-132-191 kubenswrapper[2557]: W0527 23:33:04.951802    2557 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
May 27 23:33:04.954285 ip-10-0-132-191 kubenswrapper[2557]: W0527 23:33:04.951805    2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
May 27 23:33:04.954285 ip-10-0-132-191 kubenswrapper[2557]: W0527 23:33:04.951807    2557 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
May 27 23:33:04.954285 ip-10-0-132-191 kubenswrapper[2557]: W0527 23:33:04.951810    2557 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
May 27 23:33:04.954285 ip-10-0-132-191 kubenswrapper[2557]: W0527 23:33:04.951812    2557 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
May 27 23:33:04.954285 ip-10-0-132-191 kubenswrapper[2557]: W0527 23:33:04.951815    2557 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
May 27 23:33:04.954285 ip-10-0-132-191 kubenswrapper[2557]: W0527 23:33:04.951817    2557 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
May 27 23:33:04.954285 ip-10-0-132-191 kubenswrapper[2557]: W0527 23:33:04.951820    2557 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
May 27 23:33:04.954285 ip-10-0-132-191 kubenswrapper[2557]: W0527 23:33:04.951822    2557 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
May 27 23:33:04.954285 ip-10-0-132-191 kubenswrapper[2557]: W0527 23:33:04.951825    2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
May 27 23:33:04.954285 ip-10-0-132-191 kubenswrapper[2557]: W0527 23:33:04.951828    2557 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
May 27 23:33:04.954285 ip-10-0-132-191 kubenswrapper[2557]: W0527 23:33:04.951830    2557 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
May 27 23:33:04.954285 ip-10-0-132-191 kubenswrapper[2557]: W0527 23:33:04.951833    2557 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS
May 27 23:33:04.954285 ip-10-0-132-191 kubenswrapper[2557]: W0527 23:33:04.951835    2557 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
May 27 23:33:04.954285 ip-10-0-132-191 kubenswrapper[2557]: W0527 23:33:04.951838    2557 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
May 27 23:33:04.954285 ip-10-0-132-191 kubenswrapper[2557]: W0527 23:33:04.951841    2557 feature_gate.go:328] unrecognized feature gate: NewOLM
May 27 23:33:04.954285 ip-10-0-132-191 kubenswrapper[2557]: W0527 23:33:04.951843    2557 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
May 27 23:33:04.954285 ip-10-0-132-191 kubenswrapper[2557]: W0527 23:33:04.951846    2557 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
May 27 23:33:04.954285 ip-10-0-132-191 kubenswrapper[2557]: W0527 23:33:04.951848    2557 feature_gate.go:328] unrecognized feature gate: InsightsConfig
May 27 23:33:04.954285 ip-10-0-132-191 kubenswrapper[2557]: W0527 23:33:04.951851    2557 feature_gate.go:328] unrecognized feature gate: SignatureStores
May 27 23:33:04.954811 ip-10-0-132-191 kubenswrapper[2557]: W0527 23:33:04.951853    2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
May 27 23:33:04.954811 ip-10-0-132-191 kubenswrapper[2557]: W0527 23:33:04.951856    2557 feature_gate.go:328] unrecognized feature gate: Example
May 27 23:33:04.954811 ip-10-0-132-191 kubenswrapper[2557]: W0527 23:33:04.951858    2557 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
May 27 23:33:04.954811 ip-10-0-132-191 kubenswrapper[2557]: W0527 23:33:04.951861    2557 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
May 27 23:33:04.954811 ip-10-0-132-191 kubenswrapper[2557]: W0527 23:33:04.951863    2557 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
May 27 23:33:04.954811 ip-10-0-132-191 kubenswrapper[2557]: W0527 23:33:04.951866    2557 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
May 27 23:33:04.954811 ip-10-0-132-191 kubenswrapper[2557]: W0527 23:33:04.951868    2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
May 27 23:33:04.954811 ip-10-0-132-191 kubenswrapper[2557]: W0527 23:33:04.951873    2557 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
May 27 23:33:04.954811 ip-10-0-132-191 kubenswrapper[2557]: W0527 23:33:04.951875    2557 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
May 27 23:33:04.954811 ip-10-0-132-191 kubenswrapper[2557]: W0527 23:33:04.951878    2557 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
May 27 23:33:04.954811 ip-10-0-132-191 kubenswrapper[2557]: W0527 23:33:04.951880    2557 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
May 27 23:33:04.954811 ip-10-0-132-191 kubenswrapper[2557]: W0527 23:33:04.951882    2557 feature_gate.go:328] unrecognized feature gate: PinnedImages
May 27 23:33:04.954811 ip-10-0-132-191 kubenswrapper[2557]: W0527 23:33:04.951886    2557 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
May 27 23:33:04.954811 ip-10-0-132-191 kubenswrapper[2557]: W0527 23:33:04.951889    2557 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
May 27 23:33:04.954811 ip-10-0-132-191 kubenswrapper[2557]: W0527 23:33:04.951891    2557 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
May 27 23:33:04.954811 ip-10-0-132-191 kubenswrapper[2557]: W0527 23:33:04.951894    2557 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
May 27 23:33:04.954811 ip-10-0-132-191 kubenswrapper[2557]: W0527 23:33:04.951897    2557 feature_gate.go:328] unrecognized feature gate: Example2
May 27 23:33:04.954811 ip-10-0-132-191 kubenswrapper[2557]: W0527 23:33:04.951899    2557 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
May 27 23:33:04.954811 ip-10-0-132-191 kubenswrapper[2557]: W0527 23:33:04.951901    2557 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
May 27 23:33:04.955282 ip-10-0-132-191 kubenswrapper[2557]: W0527 23:33:04.951904    2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
May 27 23:33:04.955282 ip-10-0-132-191 kubenswrapper[2557]: W0527 23:33:04.951906    2557 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI
May 27 23:33:04.955282 ip-10-0-132-191 kubenswrapper[2557]: W0527 23:33:04.951909    2557 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
May 27 23:33:04.955282 ip-10-0-132-191 kubenswrapper[2557]: W0527 23:33:04.951912    2557 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
May 27 23:33:04.955282 ip-10-0-132-191 kubenswrapper[2557]: W0527 23:33:04.951915    2557 feature_gate.go:328] unrecognized feature gate: DualReplica
May 27 23:33:04.955282 ip-10-0-132-191 kubenswrapper[2557]: W0527 23:33:04.951917    2557 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
May 27 23:33:04.955282 ip-10-0-132-191 kubenswrapper[2557]: W0527 23:33:04.951920    2557 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController
May 27 23:33:04.955282 ip-10-0-132-191 kubenswrapper[2557]: W0527 23:33:04.951922    2557 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
May 27 23:33:04.955282 ip-10-0-132-191 kubenswrapper[2557]: W0527 23:33:04.951925    2557 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
May 27 23:33:04.955282 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:04.952010    2557 flags.go:64] FLAG: --address="0.0.0.0"
May 27 23:33:04.955282 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:04.952018    2557 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
May 27 23:33:04.955282 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:04.952024    2557 flags.go:64] FLAG: --anonymous-auth="true"
May 27 23:33:04.955282 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:04.952029    2557 flags.go:64] FLAG: --application-metrics-count-limit="100"
May 27 23:33:04.955282 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:04.952034    2557 flags.go:64] FLAG: --authentication-token-webhook="false"
May 27 23:33:04.955282 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:04.952038    2557 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
May 27 23:33:04.955282 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:04.952042    2557 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
May 27 23:33:04.955282 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:04.952047    2557 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
May 27 23:33:04.955282 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:04.952050    2557 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
May 27 23:33:04.955282 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:04.952053    2557 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
May 27 23:33:04.955282 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:04.952056    2557 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
May 27 23:33:04.955282 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:04.952060    2557 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
May 27 23:33:04.955282 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:04.952064    2557 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
May 27 23:33:04.955816 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:04.952067    2557 flags.go:64] FLAG: --cgroup-root=""
May 27 23:33:04.955816 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:04.952070    2557 flags.go:64] FLAG: --cgroups-per-qos="true"
May 27 23:33:04.955816 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:04.952074    2557 flags.go:64] FLAG: --client-ca-file=""
May 27 23:33:04.955816 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:04.952077    2557 flags.go:64] FLAG: --cloud-config=""
May 27 23:33:04.955816 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:04.952080    2557 flags.go:64] FLAG: --cloud-provider="external"
May 27 23:33:04.955816 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:04.952083    2557 flags.go:64] FLAG: --cluster-dns="[]"
May 27 23:33:04.955816 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:04.952088    2557 flags.go:64] FLAG: --cluster-domain=""
May 27 23:33:04.955816 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:04.952091    2557 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
May 27 23:33:04.955816 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:04.952094    2557 flags.go:64] FLAG: --config-dir=""
May 27 23:33:04.955816 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:04.952097    2557 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
May 27 23:33:04.955816 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:04.952101    2557 flags.go:64] FLAG: --container-log-max-files="5"
May 27 23:33:04.955816 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:04.952105    2557 flags.go:64] FLAG: --container-log-max-size="10Mi"
May 27 23:33:04.955816 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:04.952108    2557 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
May 27 23:33:04.955816 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:04.952112    2557 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
May 27 23:33:04.955816 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:04.952115    2557 flags.go:64] FLAG: --containerd-namespace="k8s.io"
May 27 23:33:04.955816 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:04.952118    2557 flags.go:64] FLAG: --contention-profiling="false"
May 27 23:33:04.955816 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:04.952121    2557 flags.go:64] FLAG: --cpu-cfs-quota="true"
May 27 23:33:04.955816 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:04.952140    2557 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
May 27 23:33:04.955816 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:04.952144    2557 flags.go:64] FLAG: --cpu-manager-policy="none"
May 27 23:33:04.955816 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:04.952147    2557 flags.go:64] FLAG: --cpu-manager-policy-options=""
May 27 23:33:04.955816 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:04.952152    2557 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
May 27 23:33:04.955816 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:04.952155    2557 flags.go:64] FLAG: --enable-controller-attach-detach="true"
May 27 23:33:04.955816 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:04.952158    2557 flags.go:64] FLAG: --enable-debugging-handlers="true"
May 27 23:33:04.955816 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:04.952161    2557 flags.go:64] FLAG: --enable-load-reader="false"
May 27 23:33:04.955816 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:04.952164    2557 flags.go:64] FLAG: --enable-server="true"
May 27 23:33:04.956449 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:04.952167    2557 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
May 27 23:33:04.956449 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:04.952172    2557 flags.go:64] FLAG: --event-burst="100"
May 27 23:33:04.956449 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:04.952175    2557 flags.go:64] FLAG: --event-qps="50"
May 27 23:33:04.956449 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:04.952178    2557 flags.go:64] FLAG: --event-storage-age-limit="default=0"
May 27 23:33:04.956449 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:04.952181    2557 flags.go:64] FLAG: --event-storage-event-limit="default=0"
May 27 23:33:04.956449 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:04.952184    2557 flags.go:64] FLAG: --eviction-hard=""
May 27 23:33:04.956449 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:04.952188    2557 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
May 27 23:33:04.956449 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:04.952191    2557 flags.go:64] FLAG: --eviction-minimum-reclaim=""
May 27 23:33:04.956449 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:04.952194    2557 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
May 27 23:33:04.956449 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:04.952197    2557 flags.go:64] FLAG: --eviction-soft=""
May 27 23:33:04.956449 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:04.952200    2557 flags.go:64] FLAG: --eviction-soft-grace-period=""
May 27 23:33:04.956449 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:04.952203    2557 flags.go:64] FLAG: --exit-on-lock-contention="false"
May 27 23:33:04.956449 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:04.952206    2557 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
May 27 23:33:04.956449 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:04.952208    2557 flags.go:64] FLAG: --experimental-mounter-path=""
May 27 23:33:04.956449 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:04.952211    2557 flags.go:64] FLAG: --fail-cgroupv1="false"
May 27 23:33:04.956449 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:04.952214    2557 flags.go:64] FLAG: --fail-swap-on="true"
May 27 23:33:04.956449 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:04.952217    2557 flags.go:64] FLAG: --feature-gates=""
May 27 23:33:04.956449 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:04.952221    2557 flags.go:64] FLAG: --file-check-frequency="20s"
May 27 23:33:04.956449 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:04.952224    2557 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
May 27 23:33:04.956449 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:04.952227    2557 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
May 27 23:33:04.956449 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:04.952230    2557 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
May 27 23:33:04.956449 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:04.952233    2557 flags.go:64] FLAG: --healthz-port="10248"
May 27 23:33:04.956449 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:04.952236    2557 flags.go:64] FLAG: --help="false"
May 27 23:33:04.956449 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:04.952239    2557 flags.go:64] FLAG: --hostname-override="ip-10-0-132-191.ec2.internal"
May 27 23:33:04.956449 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:04.952242    2557 flags.go:64] FLAG: --housekeeping-interval="10s"
May 27 23:33:04.957055 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:04.952245    2557 flags.go:64] FLAG: --http-check-frequency="20s"
May 27 23:33:04.957055 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:04.952248    2557 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
May 27 23:33:04.957055 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:04.952251    2557 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
May 27 23:33:04.957055 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:04.952255    2557 flags.go:64] FLAG: --image-gc-high-threshold="85"
May 27 23:33:04.957055 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:04.952257    2557 flags.go:64] FLAG: --image-gc-low-threshold="80"
May 27 23:33:04.957055 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:04.952260    2557 flags.go:64] FLAG: --image-service-endpoint=""
May 27 23:33:04.957055 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:04.952263    2557 flags.go:64] FLAG: --kernel-memcg-notification="false"
May 27 23:33:04.957055 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:04.952266    2557 flags.go:64] FLAG: --kube-api-burst="100"
May 27 23:33:04.957055 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:04.952269    2557 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
May 27 23:33:04.957055 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:04.952272    2557 flags.go:64] FLAG: --kube-api-qps="50"
May 27 23:33:04.957055 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:04.952275    2557 flags.go:64] FLAG: --kube-reserved=""
May 27 23:33:04.957055 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:04.952278    2557 flags.go:64] FLAG: --kube-reserved-cgroup=""
May 27 23:33:04.957055 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:04.952281    2557 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
May 27 23:33:04.957055 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:04.952285    2557 flags.go:64] FLAG: --kubelet-cgroups=""
May 27 23:33:04.957055 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:04.952288    2557 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
May 27 23:33:04.957055 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:04.952291    2557 flags.go:64] FLAG: --lock-file=""
May 27 23:33:04.957055 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:04.952293    2557 flags.go:64] FLAG: --log-cadvisor-usage="false"
May 27 23:33:04.957055 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:04.952297    2557 flags.go:64] FLAG: --log-flush-frequency="5s"
May 27 23:33:04.957055 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:04.952300    2557 flags.go:64] FLAG: --log-json-info-buffer-size="0"
May 27 23:33:04.957055 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:04.952305    2557 flags.go:64] FLAG: --log-json-split-stream="false"
May 27 23:33:04.957055 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:04.952307    2557 flags.go:64] FLAG: --log-text-info-buffer-size="0"
May 27 23:33:04.957055 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:04.952310    2557 flags.go:64] FLAG: --log-text-split-stream="false"
May 27 23:33:04.957055 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:04.952313    2557 flags.go:64] FLAG: --logging-format="text"
May 27 23:33:04.957613 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:04.952316    2557 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
May 27 23:33:04.957613 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:04.952319    2557 flags.go:64] FLAG: --make-iptables-util-chains="true"
May 27 23:33:04.957613 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:04.952322    2557 flags.go:64] FLAG: --manifest-url=""
May 27 23:33:04.957613 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:04.952325    2557 flags.go:64] FLAG: --manifest-url-header=""
May 27 23:33:04.957613 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:04.952330    2557 flags.go:64] FLAG: --max-housekeeping-interval="15s"
May 27 23:33:04.957613 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:04.952333    2557 flags.go:64] FLAG: --max-open-files="1000000"
May 27 23:33:04.957613 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:04.952338    2557 flags.go:64] FLAG: --max-pods="110"
May 27 23:33:04.957613 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:04.952341    2557 flags.go:64] FLAG: --maximum-dead-containers="-1"
May 27 23:33:04.957613 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:04.952344    2557 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
May 27 23:33:04.957613 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:04.952347    2557 flags.go:64] FLAG: --memory-manager-policy="None"
May 27 23:33:04.957613 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:04.952350    2557 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
May 27 23:33:04.957613 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:04.952353    2557 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
May 27 23:33:04.957613 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:04.952356    2557 flags.go:64] FLAG: --node-ip="0.0.0.0"
May 27 23:33:04.957613 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:04.952359    2557 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
May 27 23:33:04.957613 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:04.952367    2557 flags.go:64] FLAG: --node-status-max-images="50"
May 27 23:33:04.957613 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:04.952370    2557 flags.go:64] FLAG: --node-status-update-frequency="10s"
May 27 23:33:04.957613 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:04.952373    2557 flags.go:64] FLAG: --oom-score-adj="-999"
May 27 23:33:04.957613 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:04.952377    2557 flags.go:64] FLAG: --pod-cidr=""
May 27 23:33:04.957613 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:04.952383    2557 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:afe88671bf163c42b467d159dc6f0b784dbe28b1ed44e171edc9c06fd99cc6fc"
May 27 23:33:04.957613 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:04.952389    2557 flags.go:64] FLAG: --pod-manifest-path=""
May 27 23:33:04.957613 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:04.952392    2557 flags.go:64] FLAG: --pod-max-pids="-1"
May 27 23:33:04.957613 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:04.952395    2557 flags.go:64] FLAG: --pods-per-core="0"
May 27 23:33:04.957613 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:04.952398    2557 flags.go:64] FLAG: --port="10250"
May 27 23:33:04.957613 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:04.952401    2557 flags.go:64] FLAG: --protect-kernel-defaults="false"
May 27 23:33:04.958197 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:04.952404    2557 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-090b7fdedee01da93"
May 27 23:33:04.958197 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:04.952407    2557 flags.go:64] FLAG: --qos-reserved=""
May 27 23:33:04.958197 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:04.952410    2557 flags.go:64] FLAG: --read-only-port="10255"
May 27 23:33:04.958197 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:04.952413    2557 flags.go:64] FLAG: --register-node="true"
May 27 23:33:04.958197 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:04.952416    2557 flags.go:64] FLAG: --register-schedulable="true"
May 27 23:33:04.958197 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:04.952419    2557 flags.go:64] FLAG: --register-with-taints=""
May 27 23:33:04.958197 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:04.952422    2557 flags.go:64] FLAG: --registry-burst="10"
May 27 23:33:04.958197 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:04.952425    2557 flags.go:64] FLAG: --registry-qps="5"
May 27 23:33:04.958197 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:04.952428    2557 flags.go:64] FLAG: --reserved-cpus=""
May 27 23:33:04.958197 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:04.952431    2557 flags.go:64] FLAG: --reserved-memory=""
May 27 23:33:04.958197 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:04.952434    2557 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
May 27 23:33:04.958197 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:04.952438    2557 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
May 27 23:33:04.958197 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:04.952441    2557 flags.go:64] FLAG: --rotate-certificates="false"
May 27 23:33:04.958197 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:04.952444    2557 flags.go:64] FLAG: --rotate-server-certificates="false"
May 27 23:33:04.958197 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:04.952446    2557 flags.go:64] FLAG: --runonce="false"
May 27 23:33:04.958197 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:04.952449    2557 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
May 27 23:33:04.958197 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:04.952452    2557 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
May 27 23:33:04.958197 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:04.952455    2557 flags.go:64] FLAG: --seccomp-default="false"
May 27 23:33:04.958197 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:04.952458    2557 flags.go:64] FLAG: --serialize-image-pulls="true"
May 27 23:33:04.958197 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:04.952461    2557 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
May 27 23:33:04.958197 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:04.952464    2557 flags.go:64] FLAG: --storage-driver-db="cadvisor"
May 27 23:33:04.958197 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:04.952467    2557 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
May 27 23:33:04.958197 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:04.952469    2557 flags.go:64] FLAG: --storage-driver-password="root"
May 27 23:33:04.958197 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:04.952472    2557 flags.go:64] FLAG: --storage-driver-secure="false"
May 27 23:33:04.958197 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:04.952475    2557 flags.go:64] FLAG: --storage-driver-table="stats"
May 27 23:33:04.958197 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:04.952478    2557 flags.go:64] FLAG: --storage-driver-user="root"
May 27 23:33:04.958815 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:04.952482    2557 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
May 27 23:33:04.958815 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:04.952485    2557 flags.go:64] FLAG: --sync-frequency="1m0s"
May 27 23:33:04.958815 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:04.952488    2557 flags.go:64] FLAG: --system-cgroups=""
May 27 23:33:04.958815 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:04.952491    2557 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
May 27 23:33:04.958815 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:04.952496    2557 flags.go:64] FLAG: --system-reserved-cgroup=""
May 27 23:33:04.958815 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:04.952499    2557 flags.go:64] FLAG: --tls-cert-file=""
May 27 23:33:04.958815 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:04.952503    2557 flags.go:64] FLAG: --tls-cipher-suites="[]"
May 27 23:33:04.958815 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:04.952507    2557 flags.go:64] FLAG: --tls-min-version=""
May 27 23:33:04.958815 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:04.952510    2557 flags.go:64] FLAG: --tls-private-key-file=""
May 27 23:33:04.958815 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:04.952513    2557 flags.go:64] FLAG: --topology-manager-policy="none"
May 27 23:33:04.958815 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:04.952516    2557 flags.go:64] FLAG: --topology-manager-policy-options=""
May 27 23:33:04.958815 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:04.952518    2557 flags.go:64] FLAG: --topology-manager-scope="container"
May 27 23:33:04.958815 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:04.952521    2557 flags.go:64] FLAG: --v="2"
May 27 23:33:04.958815 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:04.952525    2557 flags.go:64] FLAG: --version="false"
May 27 23:33:04.958815 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:04.952529    2557 flags.go:64] FLAG: --vmodule=""
May 27 23:33:04.958815 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:04.952534    2557 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
May 27 23:33:04.958815 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:04.952537    2557 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
May 27 23:33:04.958815 ip-10-0-132-191 kubenswrapper[2557]: W0527 23:33:04.952629    2557 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
May 27 23:33:04.958815 ip-10-0-132-191 kubenswrapper[2557]: W0527 23:33:04.952632    2557 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
May 27 23:33:04.958815 ip-10-0-132-191 kubenswrapper[2557]: W0527 23:33:04.952636    2557 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
May 27 23:33:04.958815 ip-10-0-132-191 kubenswrapper[2557]: W0527 23:33:04.952639    2557 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
May 27 23:33:04.958815 ip-10-0-132-191 kubenswrapper[2557]: W0527 23:33:04.952642    2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
May 27 23:33:04.958815 ip-10-0-132-191 kubenswrapper[2557]: W0527 23:33:04.952645    2557 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
May 27 23:33:04.958815 ip-10-0-132-191 kubenswrapper[2557]: W0527 23:33:04.952648    2557 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
May 27 23:33:04.959394 ip-10-0-132-191 kubenswrapper[2557]: W0527 23:33:04.952651    2557 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
May 27 23:33:04.959394 ip-10-0-132-191 kubenswrapper[2557]: W0527 23:33:04.952653    2557 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
May 27 23:33:04.959394 ip-10-0-132-191 kubenswrapper[2557]: W0527 23:33:04.952656    2557 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
May 27 23:33:04.959394 ip-10-0-132-191 kubenswrapper[2557]: W0527 23:33:04.952659    2557 feature_gate.go:328] unrecognized feature gate: Example
May 27 23:33:04.959394 ip-10-0-132-191 kubenswrapper[2557]: W0527 23:33:04.952662    2557 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
May 27 23:33:04.959394 ip-10-0-132-191 kubenswrapper[2557]: W0527 23:33:04.952664    2557 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
May 27 23:33:04.959394 ip-10-0-132-191 kubenswrapper[2557]: W0527 23:33:04.952667    2557 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
May 27 23:33:04.959394 ip-10-0-132-191 kubenswrapper[2557]: W0527 23:33:04.952669    2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
May 27 23:33:04.959394 ip-10-0-132-191 kubenswrapper[2557]: W0527 23:33:04.952674    2557 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI
May 27 23:33:04.959394 ip-10-0-132-191 kubenswrapper[2557]: W0527 23:33:04.952680    2557 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
May 27 23:33:04.959394 ip-10-0-132-191 kubenswrapper[2557]: W0527 23:33:04.952683    2557 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
May 27 23:33:04.959394 ip-10-0-132-191 kubenswrapper[2557]: W0527 23:33:04.952686    2557 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
May 27 23:33:04.959394 ip-10-0-132-191 kubenswrapper[2557]: W0527 23:33:04.952688    2557 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
May 27 23:33:04.959394 ip-10-0-132-191 kubenswrapper[2557]: W0527 23:33:04.952691    2557 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
May 27 23:33:04.959394 ip-10-0-132-191 kubenswrapper[2557]: W0527 23:33:04.952694    2557 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
May 27 23:33:04.959394 ip-10-0-132-191 kubenswrapper[2557]: W0527 23:33:04.952696    2557 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
May 27 23:33:04.959394 ip-10-0-132-191 kubenswrapper[2557]: W0527 23:33:04.952699    2557 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
May 27 23:33:04.959394 ip-10-0-132-191 kubenswrapper[2557]: W0527 23:33:04.952702    2557 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
May 27 23:33:04.959394 ip-10-0-132-191 kubenswrapper[2557]: W0527 23:33:04.952704    2557 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
May 27 23:33:04.959394 ip-10-0-132-191 kubenswrapper[2557]: W0527 23:33:04.952707    2557 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
May 27 23:33:04.959888 ip-10-0-132-191 kubenswrapper[2557]: W0527 23:33:04.952709    2557 feature_gate.go:328] unrecognized feature gate: OVNObservability
May 27 23:33:04.959888 ip-10-0-132-191 kubenswrapper[2557]: W0527 23:33:04.952712    2557 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
May 27 23:33:04.959888 ip-10-0-132-191 kubenswrapper[2557]: W0527 23:33:04.952714    2557 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
May 27 23:33:04.959888 ip-10-0-132-191 kubenswrapper[2557]: W0527 23:33:04.952720    2557 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
May 27 23:33:04.959888 ip-10-0-132-191 kubenswrapper[2557]: W0527 23:33:04.952722    2557 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
May 27 23:33:04.959888 ip-10-0-132-191 kubenswrapper[2557]: W0527 23:33:04.952725    2557 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
May 27 23:33:04.959888 ip-10-0-132-191 kubenswrapper[2557]: W0527 23:33:04.952727    2557 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
May 27 23:33:04.959888 ip-10-0-132-191 kubenswrapper[2557]: W0527 23:33:04.952730    2557 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
May 27 23:33:04.959888 ip-10-0-132-191 kubenswrapper[2557]: W0527 23:33:04.952732    2557 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
May 27 23:33:04.959888 ip-10-0-132-191 kubenswrapper[2557]: W0527 23:33:04.952735    2557 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
May 27 23:33:04.959888 ip-10-0-132-191 kubenswrapper[2557]: W0527 23:33:04.952738    2557 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
May 27 23:33:04.959888 ip-10-0-132-191 kubenswrapper[2557]: W0527 23:33:04.952740    2557 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
May 27 23:33:04.959888 ip-10-0-132-191 kubenswrapper[2557]: W0527 23:33:04.952743    2557 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
May 27 23:33:04.959888 ip-10-0-132-191 kubenswrapper[2557]: W0527 23:33:04.952746    2557 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
May 27 23:33:04.959888 ip-10-0-132-191 kubenswrapper[2557]: W0527 23:33:04.952748    2557 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
May 27 23:33:04.959888 ip-10-0-132-191 kubenswrapper[2557]: W0527 23:33:04.952751    2557 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations
May 27 23:33:04.959888 ip-10-0-132-191 kubenswrapper[2557]: W0527 23:33:04.952754    2557 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
May 27 23:33:04.959888 ip-10-0-132-191 kubenswrapper[2557]: W0527 23:33:04.952757    2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
May 27 23:33:04.959888 ip-10-0-132-191 kubenswrapper[2557]: W0527 23:33:04.952759    2557 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
May 27 23:33:04.959888 ip-10-0-132-191 kubenswrapper[2557]: W0527 23:33:04.952762    2557 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
May 27 23:33:04.960448 ip-10-0-132-191 kubenswrapper[2557]: W0527 23:33:04.952765    2557 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
May 27 23:33:04.960448 ip-10-0-132-191 kubenswrapper[2557]: W0527 23:33:04.952768    2557 feature_gate.go:328] unrecognized feature gate: SignatureStores
May 27 23:33:04.960448 ip-10-0-132-191 kubenswrapper[2557]: W0527 23:33:04.952771    2557 feature_gate.go:328] unrecognized feature gate: InsightsConfig
May 27 23:33:04.960448 ip-10-0-132-191 kubenswrapper[2557]: W0527 23:33:04.952774    2557 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
May 27 23:33:04.960448 ip-10-0-132-191 kubenswrapper[2557]: W0527 23:33:04.952777    2557 feature_gate.go:328] unrecognized feature gate: PinnedImages
May 27 23:33:04.960448 ip-10-0-132-191 kubenswrapper[2557]: W0527 23:33:04.952779    2557 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
May 27 23:33:04.960448 ip-10-0-132-191 kubenswrapper[2557]: W0527 23:33:04.952782    2557 feature_gate.go:328] unrecognized feature gate: NewOLM
May 27 23:33:04.960448 ip-10-0-132-191 kubenswrapper[2557]: W0527 23:33:04.952785    2557 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
May 27 23:33:04.960448 ip-10-0-132-191 kubenswrapper[2557]: W0527 23:33:04.952787    2557 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
May 27 23:33:04.960448 ip-10-0-132-191 kubenswrapper[2557]: W0527 23:33:04.952790    2557 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController
May 27 23:33:04.960448 ip-10-0-132-191 kubenswrapper[2557]: W0527 23:33:04.952793    2557 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
May 27 23:33:04.960448 ip-10-0-132-191 kubenswrapper[2557]: W0527 23:33:04.952796    2557 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
May 27 23:33:04.960448 ip-10-0-132-191 kubenswrapper[2557]: W0527 23:33:04.952798    2557 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
May 27 23:33:04.960448 ip-10-0-132-191 kubenswrapper[2557]: W0527 23:33:04.952801    2557 feature_gate.go:328] unrecognized feature gate: Example2
May 27 23:33:04.960448 ip-10-0-132-191 kubenswrapper[2557]: W0527 23:33:04.952803    2557 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
May 27 23:33:04.960448 ip-10-0-132-191 kubenswrapper[2557]: W0527 23:33:04.952807    2557 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
May 27 23:33:04.960448 ip-10-0-132-191 kubenswrapper[2557]: W0527 23:33:04.952810    2557 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
May 27 23:33:04.960448 ip-10-0-132-191 kubenswrapper[2557]: W0527 23:33:04.952813    2557 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
May 27 23:33:04.960448 ip-10-0-132-191 kubenswrapper[2557]: W0527 23:33:04.952816    2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
May 27 23:33:04.960448 ip-10-0-132-191 kubenswrapper[2557]: W0527 23:33:04.952818    2557 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
May 27 23:33:04.960938 ip-10-0-132-191 kubenswrapper[2557]: W0527 23:33:04.952821    2557 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
May 27 23:33:04.960938 ip-10-0-132-191 kubenswrapper[2557]: W0527 23:33:04.952824    2557 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
May 27 23:33:04.960938 ip-10-0-132-191 kubenswrapper[2557]: W0527 23:33:04.952827    2557 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
May 27 23:33:04.960938 ip-10-0-132-191 kubenswrapper[2557]: W0527 23:33:04.952829    2557 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
May 27 23:33:04.960938 ip-10-0-132-191 kubenswrapper[2557]: W0527 23:33:04.952832    2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
May 27 23:33:04.960938 ip-10-0-132-191 kubenswrapper[2557]: W0527 23:33:04.952835    2557 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
May 27 23:33:04.960938 ip-10-0-132-191 kubenswrapper[2557]: W0527 23:33:04.952837    2557 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
May 27 23:33:04.960938 ip-10-0-132-191 kubenswrapper[2557]: W0527 23:33:04.952840    2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
May 27 23:33:04.960938 ip-10-0-132-191 kubenswrapper[2557]: W0527 23:33:04.952844    2557 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
May 27 23:33:04.960938 ip-10-0-132-191 kubenswrapper[2557]: W0527 23:33:04.952848    2557 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
May 27 23:33:04.960938 ip-10-0-132-191 kubenswrapper[2557]: W0527 23:33:04.952851    2557 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS
May 27 23:33:04.960938 ip-10-0-132-191 kubenswrapper[2557]: W0527 23:33:04.952853    2557 feature_gate.go:328] unrecognized feature gate: DualReplica
May 27 23:33:04.960938 ip-10-0-132-191 kubenswrapper[2557]: W0527 23:33:04.952857    2557 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
May 27 23:33:04.960938 ip-10-0-132-191 kubenswrapper[2557]: W0527 23:33:04.952862    2557 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
May 27 23:33:04.960938 ip-10-0-132-191 kubenswrapper[2557]: W0527 23:33:04.952865    2557 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
May 27 23:33:04.960938 ip-10-0-132-191 kubenswrapper[2557]: W0527 23:33:04.952868    2557 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
May 27 23:33:04.960938 ip-10-0-132-191 kubenswrapper[2557]: W0527 23:33:04.952871    2557 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
May 27 23:33:04.960938 ip-10-0-132-191 kubenswrapper[2557]: W0527 23:33:04.952873    2557 feature_gate.go:328] unrecognized feature gate: GatewayAPI
May 27 23:33:04.960938 ip-10-0-132-191 kubenswrapper[2557]: W0527 23:33:04.952876    2557 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
May 27 23:33:04.961412 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:04.952884    2557 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]}
May 27 23:33:04.961412 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:04.959684    2557 server.go:530] "Kubelet version" kubeletVersion="v1.33.11"
May 27 23:33:04.961412 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:04.959701    2557 server.go:532] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
May 27 23:33:04.961412 ip-10-0-132-191 kubenswrapper[2557]: W0527 23:33:04.959750    2557 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
May 27 23:33:04.961412 ip-10-0-132-191 kubenswrapper[2557]: W0527 23:33:04.959755    2557 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
May 27 23:33:04.961412 ip-10-0-132-191 kubenswrapper[2557]: W0527 23:33:04.959758    2557 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI
May 27 23:33:04.961412 ip-10-0-132-191 kubenswrapper[2557]: W0527 23:33:04.959761    2557 feature_gate.go:328] unrecognized feature gate: DualReplica
May 27 23:33:04.961412 ip-10-0-132-191 kubenswrapper[2557]: W0527 23:33:04.959764    2557 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
May 27 23:33:04.961412 ip-10-0-132-191 kubenswrapper[2557]: W0527 23:33:04.959767    2557 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS
May 27 23:33:04.961412 ip-10-0-132-191 kubenswrapper[2557]: W0527 23:33:04.959770    2557 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
May 27 23:33:04.961412 ip-10-0-132-191 kubenswrapper[2557]: W0527 23:33:04.959773    2557 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
May 27 23:33:04.961412 ip-10-0-132-191 kubenswrapper[2557]: W0527 23:33:04.959775    2557 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations
May 27 23:33:04.961412 ip-10-0-132-191 kubenswrapper[2557]: W0527 23:33:04.959778    2557 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
May 27 23:33:04.961412 ip-10-0-132-191 kubenswrapper[2557]: W0527 23:33:04.959781    2557 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
May 27 23:33:04.961412 ip-10-0-132-191 kubenswrapper[2557]: W0527 23:33:04.959783    2557 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
May 27 23:33:04.961412 ip-10-0-132-191 kubenswrapper[2557]: W0527 23:33:04.959786    2557 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
May 27 23:33:04.961809 ip-10-0-132-191 kubenswrapper[2557]: W0527 23:33:04.959788    2557 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
May 27 23:33:04.961809 ip-10-0-132-191 kubenswrapper[2557]: W0527 23:33:04.959791    2557 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
May 27 23:33:04.961809 ip-10-0-132-191 kubenswrapper[2557]: W0527 23:33:04.959794    2557 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
May 27 23:33:04.961809 ip-10-0-132-191 kubenswrapper[2557]: W0527 23:33:04.959798    2557 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
May 27 23:33:04.961809 ip-10-0-132-191 kubenswrapper[2557]: W0527 23:33:04.959800    2557 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
May 27 23:33:04.961809 ip-10-0-132-191 kubenswrapper[2557]: W0527 23:33:04.959803    2557 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
May 27 23:33:04.961809 ip-10-0-132-191 kubenswrapper[2557]: W0527 23:33:04.959806    2557 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
May 27 23:33:04.961809 ip-10-0-132-191 kubenswrapper[2557]: W0527 23:33:04.959809    2557 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
May 27 23:33:04.961809 ip-10-0-132-191 kubenswrapper[2557]: W0527 23:33:04.959812    2557 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
May 27 23:33:04.961809 ip-10-0-132-191 kubenswrapper[2557]: W0527 23:33:04.959814    2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
May 27 23:33:04.961809 ip-10-0-132-191 kubenswrapper[2557]: W0527 23:33:04.959817    2557 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
May 27 23:33:04.961809 ip-10-0-132-191 kubenswrapper[2557]: W0527 23:33:04.959821    2557 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
May 27 23:33:04.961809 ip-10-0-132-191 kubenswrapper[2557]: W0527 23:33:04.959825    2557 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
May 27 23:33:04.961809 ip-10-0-132-191 kubenswrapper[2557]: W0527 23:33:04.959828    2557 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
May 27 23:33:04.961809 ip-10-0-132-191 kubenswrapper[2557]: W0527 23:33:04.959831    2557 feature_gate.go:328] unrecognized feature gate: NewOLM
May 27 23:33:04.961809 ip-10-0-132-191 kubenswrapper[2557]: W0527 23:33:04.959833    2557 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
May 27 23:33:04.961809 ip-10-0-132-191 kubenswrapper[2557]: W0527 23:33:04.959836    2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
May 27 23:33:04.961809 ip-10-0-132-191 kubenswrapper[2557]: W0527 23:33:04.959839    2557 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
May 27 23:33:04.961809 ip-10-0-132-191 kubenswrapper[2557]: W0527 23:33:04.959843    2557 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
May 27 23:33:04.961809 ip-10-0-132-191 kubenswrapper[2557]: W0527 23:33:04.959846    2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
May 27 23:33:04.962304 ip-10-0-132-191 kubenswrapper[2557]: W0527 23:33:04.959849    2557 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
May 27 23:33:04.962304 ip-10-0-132-191 kubenswrapper[2557]: W0527 23:33:04.959851    2557 feature_gate.go:328] unrecognized feature gate: SignatureStores
May 27 23:33:04.962304 ip-10-0-132-191 kubenswrapper[2557]: W0527 23:33:04.959854    2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
May 27 23:33:04.962304 ip-10-0-132-191 kubenswrapper[2557]: W0527 23:33:04.959857    2557 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
May 27 23:33:04.962304 ip-10-0-132-191 kubenswrapper[2557]: W0527 23:33:04.959859    2557 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
May 27 23:33:04.962304 ip-10-0-132-191 kubenswrapper[2557]: W0527 23:33:04.959862    2557 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
May 27 23:33:04.962304 ip-10-0-132-191 kubenswrapper[2557]: W0527 23:33:04.959865    2557 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
May 27 23:33:04.962304 ip-10-0-132-191 kubenswrapper[2557]: W0527 23:33:04.959868    2557 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
May 27 23:33:04.962304 ip-10-0-132-191 kubenswrapper[2557]: W0527 23:33:04.959870    2557 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
May 27 23:33:04.962304 ip-10-0-132-191 kubenswrapper[2557]: W0527 23:33:04.959874    2557 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
May 27 23:33:04.962304 ip-10-0-132-191 kubenswrapper[2557]: W0527 23:33:04.959879    2557 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
May 27 23:33:04.962304 ip-10-0-132-191 kubenswrapper[2557]: W0527 23:33:04.959882    2557 feature_gate.go:328] unrecognized feature gate: Example
May 27 23:33:04.962304 ip-10-0-132-191 kubenswrapper[2557]: W0527 23:33:04.959884    2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
May 27 23:33:04.962304 ip-10-0-132-191 kubenswrapper[2557]: W0527 23:33:04.959887    2557 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
May 27 23:33:04.962304 ip-10-0-132-191 kubenswrapper[2557]: W0527 23:33:04.959890    2557 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
May 27 23:33:04.962304 ip-10-0-132-191 kubenswrapper[2557]: W0527 23:33:04.959893    2557 feature_gate.go:328] unrecognized feature gate: OVNObservability
May 27 23:33:04.962304 ip-10-0-132-191 kubenswrapper[2557]: W0527 23:33:04.959895    2557 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
May 27 23:33:04.962304 ip-10-0-132-191 kubenswrapper[2557]: W0527 23:33:04.959898    2557 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
May 27 23:33:04.962304 ip-10-0-132-191 kubenswrapper[2557]: W0527 23:33:04.959901    2557 feature_gate.go:328] unrecognized feature gate: InsightsConfig
May 27 23:33:04.962746 ip-10-0-132-191 kubenswrapper[2557]: W0527 23:33:04.959904    2557 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
May 27 23:33:04.962746 ip-10-0-132-191 kubenswrapper[2557]: W0527 23:33:04.959906    2557 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
May 27 23:33:04.962746 ip-10-0-132-191 kubenswrapper[2557]: W0527 23:33:04.959909    2557 feature_gate.go:328] unrecognized feature gate: PinnedImages
May 27 23:33:04.962746 ip-10-0-132-191 kubenswrapper[2557]: W0527 23:33:04.959911    2557 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
May 27 23:33:04.962746 ip-10-0-132-191 kubenswrapper[2557]: W0527 23:33:04.959914    2557 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
May 27 23:33:04.962746 ip-10-0-132-191 kubenswrapper[2557]: W0527 23:33:04.959916    2557 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
May 27 23:33:04.962746 ip-10-0-132-191 kubenswrapper[2557]: W0527 23:33:04.959919    2557 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
May 27 23:33:04.962746 ip-10-0-132-191 kubenswrapper[2557]: W0527 23:33:04.959921    2557 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
May 27 23:33:04.962746 ip-10-0-132-191 kubenswrapper[2557]: W0527 23:33:04.959924    2557 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
May 27 23:33:04.962746 ip-10-0-132-191 kubenswrapper[2557]: W0527 23:33:04.959926    2557 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
May 27 23:33:04.962746 ip-10-0-132-191 kubenswrapper[2557]: W0527 23:33:04.959929    2557 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
May 27 23:33:04.962746 ip-10-0-132-191 kubenswrapper[2557]: W0527 23:33:04.959933    2557 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
May 27 23:33:04.962746 ip-10-0-132-191 kubenswrapper[2557]: W0527 23:33:04.959936    2557 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
May 27 23:33:04.962746 ip-10-0-132-191 kubenswrapper[2557]: W0527 23:33:04.959939    2557 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
May 27 23:33:04.962746 ip-10-0-132-191 kubenswrapper[2557]: W0527 23:33:04.959942    2557 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
May 27 23:33:04.962746 ip-10-0-132-191 kubenswrapper[2557]: W0527 23:33:04.959944    2557 feature_gate.go:328] unrecognized feature gate: Example2
May 27 23:33:04.962746 ip-10-0-132-191 kubenswrapper[2557]: W0527 23:33:04.959947    2557 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController
May 27 23:33:04.962746 ip-10-0-132-191 kubenswrapper[2557]: W0527 23:33:04.959950    2557 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
May 27 23:33:04.962746 ip-10-0-132-191 kubenswrapper[2557]: W0527 23:33:04.959952    2557 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
May 27 23:33:04.962746 ip-10-0-132-191 kubenswrapper[2557]: W0527 23:33:04.959955    2557 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
May 27 23:33:04.963283 ip-10-0-132-191 kubenswrapper[2557]: W0527 23:33:04.959957    2557 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
May 27 23:33:04.963283 ip-10-0-132-191 kubenswrapper[2557]: W0527 23:33:04.959960    2557 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
May 27 23:33:04.963283 ip-10-0-132-191 kubenswrapper[2557]: W0527 23:33:04.959963    2557 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
May 27 23:33:04.963283 ip-10-0-132-191 kubenswrapper[2557]: W0527 23:33:04.959965    2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
May 27 23:33:04.963283 ip-10-0-132-191 kubenswrapper[2557]: W0527 23:33:04.959968    2557 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
May 27 23:33:04.963283 ip-10-0-132-191 kubenswrapper[2557]: W0527 23:33:04.959970    2557 feature_gate.go:328] unrecognized feature gate: GatewayAPI
May 27 23:33:04.963283 ip-10-0-132-191 kubenswrapper[2557]: W0527 23:33:04.959973    2557 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
May 27 23:33:04.963283 ip-10-0-132-191 kubenswrapper[2557]: W0527 23:33:04.959987    2557 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
May 27 23:33:04.963283 ip-10-0-132-191 kubenswrapper[2557]: W0527 23:33:04.959990    2557 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
May 27 23:33:04.963283 ip-10-0-132-191 kubenswrapper[2557]: W0527 23:33:04.959993    2557 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
May 27 23:33:04.963283 ip-10-0-132-191 kubenswrapper[2557]: W0527 23:33:04.959996    2557 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
May 27 23:33:04.963283 ip-10-0-132-191 kubenswrapper[2557]: W0527 23:33:04.959998    2557 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
May 27 23:33:04.963283 ip-10-0-132-191 kubenswrapper[2557]: W0527 23:33:04.960001    2557 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
May 27 23:33:04.963283 ip-10-0-132-191 kubenswrapper[2557]: W0527 23:33:04.960004    2557 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
May 27 23:33:04.963283 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:04.960009    2557 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]}
May 27 23:33:04.963656 ip-10-0-132-191 kubenswrapper[2557]: W0527 23:33:04.960121    2557 feature_gate.go:328] unrecognized feature gate: InsightsConfig
May 27 23:33:04.963656 ip-10-0-132-191 kubenswrapper[2557]: W0527 23:33:04.960141    2557 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
May 27 23:33:04.963656 ip-10-0-132-191 kubenswrapper[2557]: W0527 23:33:04.960145    2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
May 27 23:33:04.963656 ip-10-0-132-191 kubenswrapper[2557]: W0527 23:33:04.960149    2557 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
May 27 23:33:04.963656 ip-10-0-132-191 kubenswrapper[2557]: W0527 23:33:04.960152    2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
May 27 23:33:04.963656 ip-10-0-132-191 kubenswrapper[2557]: W0527 23:33:04.960155    2557 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
May 27 23:33:04.963656 ip-10-0-132-191 kubenswrapper[2557]: W0527 23:33:04.960161    2557 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
May 27 23:33:04.963656 ip-10-0-132-191 kubenswrapper[2557]: W0527 23:33:04.960164    2557 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
May 27 23:33:04.963656 ip-10-0-132-191 kubenswrapper[2557]: W0527 23:33:04.960167    2557 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
May 27 23:33:04.963656 ip-10-0-132-191 kubenswrapper[2557]: W0527 23:33:04.960171    2557 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
May 27 23:33:04.963656 ip-10-0-132-191 kubenswrapper[2557]: W0527 23:33:04.960177    2557 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
May 27 23:33:04.963656 ip-10-0-132-191 kubenswrapper[2557]: W0527 23:33:04.960180    2557 feature_gate.go:328] unrecognized feature gate: Example2
May 27 23:33:04.963656 ip-10-0-132-191 kubenswrapper[2557]: W0527 23:33:04.960183    2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
May 27 23:33:04.963656 ip-10-0-132-191 kubenswrapper[2557]: W0527 23:33:04.960185    2557 feature_gate.go:328] unrecognized feature gate: Example
May 27 23:33:04.963656 ip-10-0-132-191 kubenswrapper[2557]: W0527 23:33:04.960188    2557 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI
May 27 23:33:04.963656 ip-10-0-132-191 kubenswrapper[2557]: W0527 23:33:04.960190    2557 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
May 27 23:33:04.963656 ip-10-0-132-191 kubenswrapper[2557]: W0527 23:33:04.960193    2557 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS
May 27 23:33:04.963656 ip-10-0-132-191 kubenswrapper[2557]: W0527 23:33:04.960195    2557 feature_gate.go:328] unrecognized feature gate: NewOLM
May 27 23:33:04.963656 ip-10-0-132-191 kubenswrapper[2557]: W0527 23:33:04.960198    2557 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
May 27 23:33:04.963656 ip-10-0-132-191 kubenswrapper[2557]: W0527 23:33:04.960201    2557 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
May 27 23:33:04.964298 ip-10-0-132-191 kubenswrapper[2557]: W0527 23:33:04.960204    2557 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
May 27 23:33:04.964298 ip-10-0-132-191 kubenswrapper[2557]: W0527 23:33:04.960207    2557 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
May 27 23:33:04.964298 ip-10-0-132-191 kubenswrapper[2557]: W0527 23:33:04.960209    2557 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
May 27 23:33:04.964298 ip-10-0-132-191 kubenswrapper[2557]: W0527 23:33:04.960211    2557 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
May 27 23:33:04.964298 ip-10-0-132-191 kubenswrapper[2557]: W0527 23:33:04.960214    2557 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
May 27 23:33:04.964298 ip-10-0-132-191 kubenswrapper[2557]: W0527 23:33:04.960216    2557 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
May 27 23:33:04.964298 ip-10-0-132-191 kubenswrapper[2557]: W0527 23:33:04.960219    2557 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
May 27 23:33:04.964298 ip-10-0-132-191 kubenswrapper[2557]: W0527 23:33:04.960221    2557 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
May 27 23:33:04.964298 ip-10-0-132-191 kubenswrapper[2557]: W0527 23:33:04.960224    2557 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
May 27 23:33:04.964298 ip-10-0-132-191 kubenswrapper[2557]: W0527 23:33:04.960226    2557 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
May 27 23:33:04.964298 ip-10-0-132-191 kubenswrapper[2557]: W0527 23:33:04.960229    2557 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
May 27 23:33:04.964298 ip-10-0-132-191 kubenswrapper[2557]: W0527 23:33:04.960231    2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
May 27 23:33:04.964298 ip-10-0-132-191 kubenswrapper[2557]: W0527 23:33:04.960234    2557 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
May 27 23:33:04.964298 ip-10-0-132-191 kubenswrapper[2557]: W0527 23:33:04.960236    2557 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
May 27 23:33:04.964298 ip-10-0-132-191 kubenswrapper[2557]: W0527 23:33:04.960239    2557 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
May 27 23:33:04.964298 ip-10-0-132-191 kubenswrapper[2557]: W0527 23:33:04.960241    2557 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
May 27 23:33:04.964298 ip-10-0-132-191 kubenswrapper[2557]: W0527 23:33:04.960243    2557 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
May 27 23:33:04.964298 ip-10-0-132-191 kubenswrapper[2557]: W0527 23:33:04.960246    2557 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
May 27 23:33:04.964298 ip-10-0-132-191 kubenswrapper[2557]: W0527 23:33:04.960249    2557 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
May 27 23:33:04.964298 ip-10-0-132-191 kubenswrapper[2557]: W0527 23:33:04.960251    2557 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
May 27 23:33:04.964773 ip-10-0-132-191 kubenswrapper[2557]: W0527 23:33:04.960255    2557 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
May 27 23:33:04.964773 ip-10-0-132-191 kubenswrapper[2557]: W0527 23:33:04.960259    2557 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
May 27 23:33:04.964773 ip-10-0-132-191 kubenswrapper[2557]: W0527 23:33:04.960262    2557 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
May 27 23:33:04.964773 ip-10-0-132-191 kubenswrapper[2557]: W0527 23:33:04.960265    2557 feature_gate.go:328] unrecognized feature gate: OVNObservability
May 27 23:33:04.964773 ip-10-0-132-191 kubenswrapper[2557]: W0527 23:33:04.960268    2557 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController
May 27 23:33:04.964773 ip-10-0-132-191 kubenswrapper[2557]: W0527 23:33:04.960271    2557 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
May 27 23:33:04.964773 ip-10-0-132-191 kubenswrapper[2557]: W0527 23:33:04.960273    2557 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
May 27 23:33:04.964773 ip-10-0-132-191 kubenswrapper[2557]: W0527 23:33:04.960276    2557 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
May 27 23:33:04.964773 ip-10-0-132-191 kubenswrapper[2557]: W0527 23:33:04.960278    2557 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
May 27 23:33:04.964773 ip-10-0-132-191 kubenswrapper[2557]: W0527 23:33:04.960281    2557 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
May 27 23:33:04.964773 ip-10-0-132-191 kubenswrapper[2557]: W0527 23:33:04.960283    2557 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
May 27 23:33:04.964773 ip-10-0-132-191 kubenswrapper[2557]: W0527 23:33:04.960286    2557 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
May 27 23:33:04.964773 ip-10-0-132-191 kubenswrapper[2557]: W0527 23:33:04.960288    2557 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
May 27 23:33:04.964773 ip-10-0-132-191 kubenswrapper[2557]: W0527 23:33:04.960291    2557 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
May 27 23:33:04.964773 ip-10-0-132-191 kubenswrapper[2557]: W0527 23:33:04.960293    2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
May 27 23:33:04.964773 ip-10-0-132-191 kubenswrapper[2557]: W0527 23:33:04.960296    2557 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
May 27 23:33:04.964773 ip-10-0-132-191 kubenswrapper[2557]: W0527 23:33:04.960298    2557 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
May 27 23:33:04.964773 ip-10-0-132-191 kubenswrapper[2557]: W0527 23:33:04.960301    2557 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
May 27 23:33:04.964773 ip-10-0-132-191 kubenswrapper[2557]: W0527 23:33:04.960304    2557 feature_gate.go:328] unrecognized feature gate: DualReplica
May 27 23:33:04.965256 ip-10-0-132-191 kubenswrapper[2557]: W0527 23:33:04.960306    2557 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
May 27 23:33:04.965256 ip-10-0-132-191 kubenswrapper[2557]: W0527 23:33:04.960309    2557 feature_gate.go:328] unrecognized feature gate: GatewayAPI
May 27 23:33:04.965256 ip-10-0-132-191 kubenswrapper[2557]: W0527 23:33:04.960311    2557 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
May 27 23:33:04.965256 ip-10-0-132-191 kubenswrapper[2557]: W0527 23:33:04.960314    2557 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
May 27 23:33:04.965256 ip-10-0-132-191 kubenswrapper[2557]: W0527 23:33:04.960317    2557 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
May 27 23:33:04.965256 ip-10-0-132-191 kubenswrapper[2557]: W0527 23:33:04.960319    2557 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
May 27 23:33:04.965256 ip-10-0-132-191 kubenswrapper[2557]: W0527 23:33:04.960322    2557 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
May 27 23:33:04.965256 ip-10-0-132-191 kubenswrapper[2557]: W0527 23:33:04.960324    2557 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
May 27 23:33:04.965256 ip-10-0-132-191 kubenswrapper[2557]: W0527 23:33:04.960326    2557 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations
May 27 23:33:04.965256 ip-10-0-132-191 kubenswrapper[2557]: W0527 23:33:04.960329    2557 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
May 27 23:33:04.965256 ip-10-0-132-191 kubenswrapper[2557]: W0527 23:33:04.960332    2557 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
May 27 23:33:04.965256 ip-10-0-132-191 kubenswrapper[2557]: W0527 23:33:04.960334    2557 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
May 27 23:33:04.965256 ip-10-0-132-191 kubenswrapper[2557]: W0527 23:33:04.960337    2557 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
May 27 23:33:04.965256 ip-10-0-132-191 kubenswrapper[2557]: W0527 23:33:04.960339    2557 feature_gate.go:328] unrecognized feature gate: SignatureStores
May 27 23:33:04.965256 ip-10-0-132-191 kubenswrapper[2557]: W0527 23:33:04.960342    2557 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
May 27 23:33:04.965256 ip-10-0-132-191 kubenswrapper[2557]: W0527 23:33:04.960345    2557 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
May 27 23:33:04.965256 ip-10-0-132-191 kubenswrapper[2557]: W0527 23:33:04.960347    2557 feature_gate.go:328] unrecognized feature gate: PinnedImages
May 27 23:33:04.965256 ip-10-0-132-191 kubenswrapper[2557]: W0527 23:33:04.960356    2557 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
May 27 23:33:04.965256 ip-10-0-132-191 kubenswrapper[2557]: W0527 23:33:04.960358    2557 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
May 27 23:33:04.965256 ip-10-0-132-191 kubenswrapper[2557]: W0527 23:33:04.960361    2557 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
May 27 23:33:04.965747 ip-10-0-132-191 kubenswrapper[2557]: W0527 23:33:04.960364    2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
May 27 23:33:04.965747 ip-10-0-132-191 kubenswrapper[2557]: W0527 23:33:04.960366    2557 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
May 27 23:33:04.965747 ip-10-0-132-191 kubenswrapper[2557]: W0527 23:33:04.960369    2557 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
May 27 23:33:04.965747 ip-10-0-132-191 kubenswrapper[2557]: W0527 23:33:04.960371    2557 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
May 27 23:33:04.965747 ip-10-0-132-191 kubenswrapper[2557]: W0527 23:33:04.960374    2557 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
May 27 23:33:04.965747 ip-10-0-132-191 kubenswrapper[2557]: W0527 23:33:04.960376    2557 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
May 27 23:33:04.965747 ip-10-0-132-191 kubenswrapper[2557]: W0527 23:33:04.960379    2557 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
May 27 23:33:04.965747 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:04.960383    2557 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]}
May 27 23:33:04.965747 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:04.961325    2557 server.go:962] "Client rotation is on, will bootstrap in background"
May 27 23:33:04.966804 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:04.966790    2557 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
May 27 23:33:04.967905 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:04.967893    2557 server.go:1019] "Starting client certificate rotation"
May 27 23:33:04.968018 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:04.968002    2557 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
May 27 23:33:04.969025 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:04.969014    2557 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
May 27 23:33:04.998878 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:04.998862    2557 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
May 27 23:33:05.001032 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:05.001009    2557 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
May 27 23:33:05.015116 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:05.015093    2557 log.go:25] "Validated CRI v1 runtime API"
May 27 23:33:05.020541 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:05.020524    2557 log.go:25] "Validated CRI v1 image API"
May 27 23:33:05.022699 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:05.022684    2557 server.go:1452] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
May 27 23:33:05.025198 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:05.025174    2557 fs.go:135] Filesystem UUIDs: map[412691d2-63e3-4269-b235-0897b61e9a3e:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2 e7fbd448-18bb-42fe-8f50-234c0c3e1954:/dev/nvme0n1p3]
May 27 23:33:05.025251 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:05.025198    2557 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
May 27 23:33:05.029587 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:05.029452    2557 manager.go:217] Machine: {Timestamp:2026-05-27 23:33:05.02891099 +0000 UTC m=+0.448446992 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3098496 MemoryCapacity:33164492800 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec272efa159021200839ed7ec6b96eb5 SystemUUID:ec272efa-1590-2120-0839-ed7ec6b96eb5 BootID:8ac75d56-436a-4a5f-93e1-42aa75ba7d40 Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632898560 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6103040 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582246400 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:34:d1:b7:87:71 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:34:d1:b7:87:71 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:ee:cc:34:93:8d:e3 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164492800 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
May 27 23:33:05.030153 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:05.030142    2557 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
May 27 23:33:05.030253 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:05.030239    2557 manager.go:233] Version: {KernelVersion:5.14.0-570.114.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260512-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
May 27 23:33:05.033331 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:05.033311    2557 reflector.go:430] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
May 27 23:33:05.034140 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:05.034100    2557 container_manager_linux.go:270] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
May 27 23:33:05.034323 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:05.034150    2557 container_manager_linux.go:275] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-132-191.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
May 27 23:33:05.034401 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:05.034334    2557 topology_manager.go:138] "Creating topology manager with none policy"
May 27 23:33:05.034401 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:05.034347    2557 container_manager_linux.go:306] "Creating device plugin manager"
May 27 23:33:05.034401 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:05.034358    2557 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
May 27 23:33:05.036202 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:05.036189    2557 server.go:72] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
May 27 23:33:05.037788 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:05.037775    2557 state_mem.go:36] "Initialized new in-memory state store"
May 27 23:33:05.037925 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:05.037914    2557 server.go:1267] "Using root directory" path="/var/lib/kubelet"
May 27 23:33:05.040718 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:05.040707    2557 kubelet.go:491] "Attempting to sync node with API server"
May 27 23:33:05.040783 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:05.040726    2557 kubelet.go:386] "Adding static pod path" path="/etc/kubernetes/manifests"
May 27 23:33:05.040783 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:05.040742    2557 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
May 27 23:33:05.040783 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:05.040757    2557 kubelet.go:397] "Adding apiserver pod source"
May 27 23:33:05.040783 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:05.040769    2557 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
May 27 23:33:05.042610 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:05.042595    2557 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
May 27 23:33:05.042680 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:05.042622    2557 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
May 27 23:33:05.046085 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:05.046066    2557 kuberuntime_manager.go:279] "Container runtime initialized" containerRuntime="cri-o" version="1.33.11-2.rhaos4.20.gitb2a8320.el9" apiVersion="v1"
May 27 23:33:05.048142 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:05.048110    2557 kubelet.go:953] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
May 27 23:33:05.049081 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:05.049069    2557 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
May 27 23:33:05.049152 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:05.049085    2557 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
May 27 23:33:05.049152 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:05.049091    2557 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
May 27 23:33:05.049152 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:05.049097    2557 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
May 27 23:33:05.049152 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:05.049106    2557 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
May 27 23:33:05.049152 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:05.049112    2557 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/secret"
May 27 23:33:05.049152 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:05.049118    2557 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
May 27 23:33:05.049152 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:05.049137    2557 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
May 27 23:33:05.049152 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:05.049148    2557 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/fc"
May 27 23:33:05.049152 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:05.049154    2557 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
May 27 23:33:05.049418 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:05.049163    2557 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/projected"
May 27 23:33:05.049698 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:05.049690    2557 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
May 27 23:33:05.050812 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:05.050802    2557 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/csi"
May 27 23:33:05.050812 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:05.050812    2557 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/image"
May 27 23:33:05.053832 ip-10-0-132-191 kubenswrapper[2557]: E0527 23:33:05.053789    2557 reflector.go:200] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-132-191.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
May 27 23:33:05.053919 ip-10-0-132-191 kubenswrapper[2557]: E0527 23:33:05.053859    2557 reflector.go:200] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
May 27 23:33:05.054560 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:05.054544    2557 watchdog_linux.go:99] "Systemd watchdog is not enabled"
May 27 23:33:05.054631 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:05.054584    2557 server.go:1295] "Started kubelet"
May 27 23:33:05.055216 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:05.055146    2557 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
May 27 23:33:05.055382 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:05.055107    2557 ratelimit.go:55] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
May 27 23:33:05.055475 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:05.055416    2557 server_v1.go:47] "podresources" method="list" useActivePods=true
May 27 23:33:05.055652 ip-10-0-132-191 systemd[1]: Started Kubernetes Kubelet.
May 27 23:33:05.056805 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:05.056786    2557 server.go:255] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
May 27 23:33:05.059387 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:05.059367    2557 server.go:317] "Adding debug handlers to kubelet server"
May 27 23:33:05.063958 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:05.063937    2557 csi_plugin.go:988] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-132-191.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
May 27 23:33:05.065036 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:05.065018    2557 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
May 27 23:33:05.065036 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:05.065029    2557 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
May 27 23:33:05.065194 ip-10-0-132-191 kubenswrapper[2557]: E0527 23:33:05.064017    2557 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-132-191.ec2.internal.18b390295c172be6  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-132-191.ec2.internal,UID:ip-10-0-132-191.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-132-191.ec2.internal,},FirstTimestamp:2026-05-27 23:33:05.054559206 +0000 UTC m=+0.474095210,LastTimestamp:2026-05-27 23:33:05.054559206 +0000 UTC m=+0.474095210,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-132-191.ec2.internal,}"
May 27 23:33:05.065194 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:05.065186    2557 volume_manager.go:295] "The desired_state_of_world populator starts"
May 27 23:33:05.065311 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:05.065198    2557 volume_manager.go:297] "Starting Kubelet Volume Manager"
May 27 23:33:05.065311 ip-10-0-132-191 kubenswrapper[2557]: E0527 23:33:05.065220    2557 kubelet.go:1618] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
May 27 23:33:05.065311 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:05.065288    2557 desired_state_of_world_populator.go:150] "Desired state populator starts to run"
May 27 23:33:05.065466 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:05.065342    2557 reconstruct.go:97] "Volume reconstruction finished"
May 27 23:33:05.065466 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:05.065351    2557 reconciler.go:26] "Reconciler: start to sync state"
May 27 23:33:05.065964 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:05.065948    2557 factory.go:55] Registering systemd factory
May 27 23:33:05.066024 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:05.065970    2557 factory.go:223] Registration of the systemd container factory successfully
May 27 23:33:05.066252 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:05.066229    2557 factory.go:153] Registering CRI-O factory
May 27 23:33:05.066252 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:05.066246    2557 factory.go:223] Registration of the crio container factory successfully
May 27 23:33:05.066359 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:05.066297    2557 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
May 27 23:33:05.066359 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:05.066318    2557 factory.go:103] Registering Raw factory
May 27 23:33:05.066359 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:05.066339    2557 manager.go:1196] Started watching for new ooms in manager
May 27 23:33:05.066500 ip-10-0-132-191 kubenswrapper[2557]: E0527 23:33:05.066458    2557 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-132-191.ec2.internal\" not found"
May 27 23:33:05.066958 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:05.066943    2557 manager.go:319] Starting recovery of all containers
May 27 23:33:05.069361 ip-10-0-132-191 kubenswrapper[2557]: E0527 23:33:05.069332    2557 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-132-191.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
May 27 23:33:05.069462 ip-10-0-132-191 kubenswrapper[2557]: E0527 23:33:05.069419    2557 reflector.go:200] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
May 27 23:33:05.076810 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:05.076642    2557 manager.go:324] Recovery completed
May 27 23:33:05.081308 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:05.081295    2557 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach"
May 27 23:33:05.083382 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:05.083360    2557 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-132-191.ec2.internal" event="NodeHasSufficientMemory"
May 27 23:33:05.083437 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:05.083397    2557 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-132-191.ec2.internal" event="NodeHasNoDiskPressure"
May 27 23:33:05.083437 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:05.083409    2557 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-132-191.ec2.internal" event="NodeHasSufficientPID"
May 27 23:33:05.083931 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:05.083918    2557 cpu_manager.go:222] "Starting CPU manager" policy="none"
May 27 23:33:05.083931 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:05.083931    2557 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
May 27 23:33:05.084016 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:05.083946    2557 state_mem.go:36] "Initialized new in-memory state store"
May 27 23:33:05.085758 ip-10-0-132-191 kubenswrapper[2557]: E0527 23:33:05.085686    2557 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-132-191.ec2.internal.18b390295dcefef9  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-132-191.ec2.internal,UID:ip-10-0-132-191.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-132-191.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-132-191.ec2.internal,},FirstTimestamp:2026-05-27 23:33:05.083383545 +0000 UTC m=+0.502919548,LastTimestamp:2026-05-27 23:33:05.083383545 +0000 UTC m=+0.502919548,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-132-191.ec2.internal,}"
May 27 23:33:05.087410 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:05.087397    2557 policy_none.go:49] "None policy: Start"
May 27 23:33:05.087474 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:05.087414    2557 memory_manager.go:186] "Starting memorymanager" policy="None"
May 27 23:33:05.087474 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:05.087425    2557 state_mem.go:35] "Initializing new in-memory state store"
May 27 23:33:05.089329 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:05.089312    2557 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-4h9j7"
May 27 23:33:05.093100 ip-10-0-132-191 kubenswrapper[2557]: E0527 23:33:05.093016    2557 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-132-191.ec2.internal.18b390295dcf4c84  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-132-191.ec2.internal,UID:ip-10-0-132-191.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-132-191.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-132-191.ec2.internal,},FirstTimestamp:2026-05-27 23:33:05.083403396 +0000 UTC m=+0.502939398,LastTimestamp:2026-05-27 23:33:05.083403396 +0000 UTC m=+0.502939398,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-132-191.ec2.internal,}"
May 27 23:33:05.097304 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:05.097286    2557 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-4h9j7"
May 27 23:33:05.147057 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:05.121621    2557 manager.go:341] "Starting Device Plugin manager"
May 27 23:33:05.147057 ip-10-0-132-191 kubenswrapper[2557]: E0527 23:33:05.121651    2557 manager.go:517] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
May 27 23:33:05.147057 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:05.121661    2557 server.go:85] "Starting device plugin registration server"
May 27 23:33:05.147057 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:05.121903    2557 eviction_manager.go:189] "Eviction manager: starting control loop"
May 27 23:33:05.147057 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:05.121913    2557 container_log_manager.go:189] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
May 27 23:33:05.147057 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:05.121993    2557 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
May 27 23:33:05.147057 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:05.122072    2557 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
May 27 23:33:05.147057 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:05.122081    2557 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
May 27 23:33:05.147057 ip-10-0-132-191 kubenswrapper[2557]: E0527 23:33:05.122604    2557 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
May 27 23:33:05.147057 ip-10-0-132-191 kubenswrapper[2557]: E0527 23:33:05.122638    2557 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-132-191.ec2.internal\" not found"
May 27 23:33:05.196670 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:05.196594    2557 kubelet_network_linux.go:49] "Initialized iptables rules." protocol="IPv4"
May 27 23:33:05.197834 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:05.197817    2557 kubelet_network_linux.go:49] "Initialized iptables rules." protocol="IPv6"
May 27 23:33:05.197919 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:05.197851    2557 status_manager.go:230] "Starting to sync pod status with apiserver"
May 27 23:33:05.197919 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:05.197877    2557 watchdog_linux.go:127] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
May 27 23:33:05.197919 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:05.197888    2557 kubelet.go:2451] "Starting kubelet main sync loop"
May 27 23:33:05.198048 ip-10-0-132-191 kubenswrapper[2557]: E0527 23:33:05.197934    2557 kubelet.go:2475] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
May 27 23:33:05.201817 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:05.201797    2557 reflector.go:430] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
May 27 23:33:05.222038 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:05.222014    2557 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach"
May 27 23:33:05.224756 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:05.224739    2557 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-132-191.ec2.internal" event="NodeHasSufficientMemory"
May 27 23:33:05.224858 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:05.224775    2557 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-132-191.ec2.internal" event="NodeHasNoDiskPressure"
May 27 23:33:05.224858 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:05.224790    2557 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-132-191.ec2.internal" event="NodeHasSufficientPID"
May 27 23:33:05.224858 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:05.224820    2557 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-132-191.ec2.internal"
May 27 23:33:05.231813 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:05.231794    2557 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-132-191.ec2.internal"
May 27 23:33:05.231883 ip-10-0-132-191 kubenswrapper[2557]: E0527 23:33:05.231815    2557 kubelet_node_status.go:597] "Error updating node status, will retry" err="error getting node \"ip-10-0-132-191.ec2.internal\": node \"ip-10-0-132-191.ec2.internal\" not found"
May 27 23:33:05.245501 ip-10-0-132-191 kubenswrapper[2557]: E0527 23:33:05.245477    2557 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-132-191.ec2.internal\" not found"
May 27 23:33:05.298366 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:05.298326    2557 kubelet.go:2537] "SyncLoop ADD" source="file" pods=["kube-system/kube-apiserver-proxy-ip-10-0-132-191.ec2.internal","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-191.ec2.internal"]
May 27 23:33:05.298488 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:05.298409    2557 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach"
May 27 23:33:05.300244 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:05.300228    2557 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-132-191.ec2.internal" event="NodeHasSufficientMemory"
May 27 23:33:05.300306 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:05.300258    2557 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-132-191.ec2.internal" event="NodeHasNoDiskPressure"
May 27 23:33:05.300306 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:05.300268    2557 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-132-191.ec2.internal" event="NodeHasSufficientPID"
May 27 23:33:05.301512 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:05.301500    2557 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach"
May 27 23:33:05.301656 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:05.301642    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-191.ec2.internal"
May 27 23:33:05.301692 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:05.301671    2557 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach"
May 27 23:33:05.302284 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:05.302268    2557 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-132-191.ec2.internal" event="NodeHasSufficientMemory"
May 27 23:33:05.302369 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:05.302301    2557 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-132-191.ec2.internal" event="NodeHasNoDiskPressure"
May 27 23:33:05.302369 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:05.302311    2557 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-132-191.ec2.internal" event="NodeHasSufficientPID"
May 27 23:33:05.302369 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:05.302273    2557 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-132-191.ec2.internal" event="NodeHasSufficientMemory"
May 27 23:33:05.302369 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:05.302366    2557 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-132-191.ec2.internal" event="NodeHasNoDiskPressure"
May 27 23:33:05.302511 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:05.302382    2557 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-132-191.ec2.internal" event="NodeHasSufficientPID"
May 27 23:33:05.303548 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:05.303532    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-191.ec2.internal"
May 27 23:33:05.303590 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:05.303567    2557 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach"
May 27 23:33:05.304244 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:05.304225    2557 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-132-191.ec2.internal" event="NodeHasSufficientMemory"
May 27 23:33:05.304334 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:05.304255    2557 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-132-191.ec2.internal" event="NodeHasNoDiskPressure"
May 27 23:33:05.304334 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:05.304302    2557 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-132-191.ec2.internal" event="NodeHasSufficientPID"
May 27 23:33:05.320655 ip-10-0-132-191 kubenswrapper[2557]: E0527 23:33:05.320635    2557 kubelet.go:3336] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-132-191.ec2.internal\" not found" node="ip-10-0-132-191.ec2.internal"
May 27 23:33:05.324629 ip-10-0-132-191 kubenswrapper[2557]: E0527 23:33:05.324615    2557 kubelet.go:3336] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-132-191.ec2.internal\" not found" node="ip-10-0-132-191.ec2.internal"
May 27 23:33:05.346050 ip-10-0-132-191 kubenswrapper[2557]: E0527 23:33:05.346032    2557 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-132-191.ec2.internal\" not found"
May 27 23:33:05.366623 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:05.366606    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/af860e09fcfbe100abf198b53983e8cd-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-132-191.ec2.internal\" (UID: \"af860e09fcfbe100abf198b53983e8cd\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-191.ec2.internal"
May 27 23:33:05.366684 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:05.366631    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/af860e09fcfbe100abf198b53983e8cd-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-132-191.ec2.internal\" (UID: \"af860e09fcfbe100abf198b53983e8cd\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-191.ec2.internal"
May 27 23:33:05.366684 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:05.366649    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/25522b04fdc0994697c03f613fe7f724-config\") pod \"kube-apiserver-proxy-ip-10-0-132-191.ec2.internal\" (UID: \"25522b04fdc0994697c03f613fe7f724\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-132-191.ec2.internal"
May 27 23:33:05.446658 ip-10-0-132-191 kubenswrapper[2557]: E0527 23:33:05.446632    2557 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-132-191.ec2.internal\" not found"
May 27 23:33:05.466997 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:05.466939    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/af860e09fcfbe100abf198b53983e8cd-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-132-191.ec2.internal\" (UID: \"af860e09fcfbe100abf198b53983e8cd\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-191.ec2.internal"
May 27 23:33:05.466997 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:05.466972    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/af860e09fcfbe100abf198b53983e8cd-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-132-191.ec2.internal\" (UID: \"af860e09fcfbe100abf198b53983e8cd\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-191.ec2.internal"
May 27 23:33:05.466997 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:05.466991    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/25522b04fdc0994697c03f613fe7f724-config\") pod \"kube-apiserver-proxy-ip-10-0-132-191.ec2.internal\" (UID: \"25522b04fdc0994697c03f613fe7f724\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-132-191.ec2.internal"
May 27 23:33:05.467153 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:05.467047    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/af860e09fcfbe100abf198b53983e8cd-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-132-191.ec2.internal\" (UID: \"af860e09fcfbe100abf198b53983e8cd\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-191.ec2.internal"
May 27 23:33:05.467153 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:05.467047    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/25522b04fdc0994697c03f613fe7f724-config\") pod \"kube-apiserver-proxy-ip-10-0-132-191.ec2.internal\" (UID: \"25522b04fdc0994697c03f613fe7f724\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-132-191.ec2.internal"
May 27 23:33:05.467153 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:05.467112    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/af860e09fcfbe100abf198b53983e8cd-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-132-191.ec2.internal\" (UID: \"af860e09fcfbe100abf198b53983e8cd\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-191.ec2.internal"
May 27 23:33:05.547386 ip-10-0-132-191 kubenswrapper[2557]: E0527 23:33:05.547356    2557 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-132-191.ec2.internal\" not found"
May 27 23:33:05.624878 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:05.624836    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-191.ec2.internal"
May 27 23:33:05.627610 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:05.627591    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-191.ec2.internal"
May 27 23:33:05.648472 ip-10-0-132-191 kubenswrapper[2557]: E0527 23:33:05.648449    2557 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-132-191.ec2.internal\" not found"
May 27 23:33:05.748977 ip-10-0-132-191 kubenswrapper[2557]: E0527 23:33:05.748889    2557 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-132-191.ec2.internal\" not found"
May 27 23:33:05.849385 ip-10-0-132-191 kubenswrapper[2557]: E0527 23:33:05.849352    2557 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-132-191.ec2.internal\" not found"
May 27 23:33:05.949968 ip-10-0-132-191 kubenswrapper[2557]: E0527 23:33:05.949938    2557 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-132-191.ec2.internal\" not found"
May 27 23:33:05.968260 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:05.968229    2557 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
May 27 23:33:05.968400 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:05.968381    2557 reflector.go:556] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
May 27 23:33:06.050992 ip-10-0-132-191 kubenswrapper[2557]: E0527 23:33:06.050911    2557 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-132-191.ec2.internal\" not found"
May 27 23:33:06.065705 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:06.065685    2557 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
May 27 23:33:06.081180 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:06.081160    2557 reflector.go:430] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
May 27 23:33:06.099794 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:06.099755    2557 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-05-26 23:28:05 +0000 UTC" deadline="2028-03-11 14:42:28.425890856 +0000 UTC"
May 27 23:33:06.099794 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:06.099790    2557 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="15687h9m22.326103669s"
May 27 23:33:06.102891 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:06.102872    2557 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-phjgc"
May 27 23:33:06.110909 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:06.110889    2557 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-phjgc"
May 27 23:33:06.151641 ip-10-0-132-191 kubenswrapper[2557]: E0527 23:33:06.151611    2557 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-132-191.ec2.internal\" not found"
May 27 23:33:06.252357 ip-10-0-132-191 kubenswrapper[2557]: E0527 23:33:06.252326    2557 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-132-191.ec2.internal\" not found"
May 27 23:33:06.265353 ip-10-0-132-191 kubenswrapper[2557]: W0527 23:33:06.265317    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaf860e09fcfbe100abf198b53983e8cd.slice/crio-813c02e3e2f77dad9b147b4c8e316f35e7926b148c5ccf70ddfc88eadf56ef59 WatchSource:0}: Error finding container 813c02e3e2f77dad9b147b4c8e316f35e7926b148c5ccf70ddfc88eadf56ef59: Status 404 returned error can't find the container with id 813c02e3e2f77dad9b147b4c8e316f35e7926b148c5ccf70ddfc88eadf56ef59
May 27 23:33:06.265579 ip-10-0-132-191 kubenswrapper[2557]: W0527 23:33:06.265558    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod25522b04fdc0994697c03f613fe7f724.slice/crio-04a83cce87dea3231a8d0e956fe12097d8ab015e4381394b5e089534231d86c7 WatchSource:0}: Error finding container 04a83cce87dea3231a8d0e956fe12097d8ab015e4381394b5e089534231d86c7: Status 404 returned error can't find the container with id 04a83cce87dea3231a8d0e956fe12097d8ab015e4381394b5e089534231d86c7
May 27 23:33:06.268425 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:06.268409    2557 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
May 27 23:33:06.273488 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:06.273470    2557 reflector.go:430] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
May 27 23:33:06.352676 ip-10-0-132-191 kubenswrapper[2557]: E0527 23:33:06.352579    2557 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-132-191.ec2.internal\" not found"
May 27 23:33:06.453096 ip-10-0-132-191 kubenswrapper[2557]: E0527 23:33:06.453066    2557 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-132-191.ec2.internal\" not found"
May 27 23:33:06.544185 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:06.544154    2557 reflector.go:430] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
May 27 23:33:06.553471 ip-10-0-132-191 kubenswrapper[2557]: E0527 23:33:06.553449    2557 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-132-191.ec2.internal\" not found"
May 27 23:33:06.562276 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:06.562248    2557 reflector.go:430] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
May 27 23:33:06.565741 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:06.565725    2557 kubelet.go:3340] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-191.ec2.internal"
May 27 23:33:06.579851 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:06.579828    2557 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
May 27 23:33:06.581291 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:06.581276    2557 kubelet.go:3340] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-191.ec2.internal"
May 27 23:33:06.588019 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:06.588000    2557 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
May 27 23:33:06.821501 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:06.821281    2557 reflector.go:430] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
May 27 23:33:07.042545 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:07.042518    2557 apiserver.go:52] "Watching apiserver"
May 27 23:33:07.053816 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:07.053379    2557 reflector.go:430] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
May 27 23:33:07.055496 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:07.055462    2557 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kube-system/kube-apiserver-proxy-ip-10-0-132-191.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5sm8c","openshift-dns/node-resolver-jbbwx","openshift-image-registry/node-ca-6bgmn","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-191.ec2.internal","openshift-multus/multus-additional-cni-plugins-7p5w7","openshift-multus/network-metrics-daemon-zvbqn","openshift-network-diagnostics/network-check-target-tsxk6","kube-system/konnectivity-agent-54c79","openshift-cluster-node-tuning-operator/tuned-hdrgr","openshift-multus/multus-h2jmf","openshift-network-operator/iptables-alerter-nh9z4","openshift-ovn-kubernetes/ovnkube-node-s7vdp"]
May 27 23:33:07.059937 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:07.059908    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zvbqn"
May 27 23:33:07.060078 ip-10-0-132-191 kubenswrapper[2557]: E0527 23:33:07.060050    2557 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zvbqn" podUID="c4d68b58-b4f3-4f03-a21c-321ca3eebe68"
May 27 23:33:07.062285 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:07.062264    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5sm8c"
May 27 23:33:07.064212 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:07.064193    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-jbbwx"
May 27 23:33:07.064310 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:07.064285    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-6bgmn"
May 27 23:33:07.064975 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:07.064959    2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
May 27 23:33:07.064975 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:07.064970    2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
May 27 23:33:07.065156 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:07.065061    2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
May 27 23:33:07.065281 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:07.065192    2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-vtwgm\""
May 27 23:33:07.066436 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:07.066404    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-7p5w7"
May 27 23:33:07.066915 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:07.066894    2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
May 27 23:33:07.067022 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:07.066950    2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
May 27 23:33:07.067022 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:07.067016    2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-8c6dc\""
May 27 23:33:07.067186 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:07.067080    2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
May 27 23:33:07.067988 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:07.067802    2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
May 27 23:33:07.067988 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:07.067820    2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-kstcf\""
May 27 23:33:07.067988 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:07.067806    2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
May 27 23:33:07.068486 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:07.068468    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tsxk6"
May 27 23:33:07.068569 ip-10-0-132-191 kubenswrapper[2557]: E0527 23:33:07.068525    2557 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tsxk6" podUID="4af77c1c-1265-4e74-b12f-28d888f58380"
May 27 23:33:07.068792 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:07.068773    2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
May 27 23:33:07.068886 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:07.068825    2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
May 27 23:33:07.069347 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:07.069182    2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-z55wv\""
May 27 23:33:07.069347 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:07.069201    2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
May 27 23:33:07.069347 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:07.069209    2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
May 27 23:33:07.069559 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:07.069450    2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
May 27 23:33:07.070908 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:07.070889    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-54c79"
May 27 23:33:07.073123 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:07.073077    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-hdrgr"
May 27 23:33:07.073380 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:07.073355    2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
May 27 23:33:07.073548 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:07.073518    2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
May 27 23:33:07.073675 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:07.073664    2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-ftztt\""
May 27 23:33:07.074782 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:07.074763    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b6wz5\" (UniqueName: \"kubernetes.io/projected/5dce51c2-4758-48af-a087-58d37df3b392-kube-api-access-b6wz5\") pod \"aws-ebs-csi-driver-node-5sm8c\" (UID: \"5dce51c2-4758-48af-a087-58d37df3b392\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5sm8c"
May 27 23:33:07.074869 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:07.074791    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/9d47bc2b-bc9c-4887-99e0-c05ffb6c8d0b-hosts-file\") pod \"node-resolver-jbbwx\" (UID: \"9d47bc2b-bc9c-4887-99e0-c05ffb6c8d0b\") " pod="openshift-dns/node-resolver-jbbwx"
May 27 23:33:07.074869 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:07.074807    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9d47bc2b-bc9c-4887-99e0-c05ffb6c8d0b-tmp-dir\") pod \"node-resolver-jbbwx\" (UID: \"9d47bc2b-bc9c-4887-99e0-c05ffb6c8d0b\") " pod="openshift-dns/node-resolver-jbbwx"
May 27 23:33:07.074869 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:07.074827    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zpphc\" (UniqueName: \"kubernetes.io/projected/1a2fc634-3712-40ee-bfce-e8aaee0791f2-kube-api-access-zpphc\") pod \"multus-additional-cni-plugins-7p5w7\" (UID: \"1a2fc634-3712-40ee-bfce-e8aaee0791f2\") " pod="openshift-multus/multus-additional-cni-plugins-7p5w7"
May 27 23:33:07.074869 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:07.074848    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c4d68b58-b4f3-4f03-a21c-321ca3eebe68-metrics-certs\") pod \"network-metrics-daemon-zvbqn\" (UID: \"c4d68b58-b4f3-4f03-a21c-321ca3eebe68\") " pod="openshift-multus/network-metrics-daemon-zvbqn"
May 27 23:33:07.075068 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:07.074870    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/5dce51c2-4758-48af-a087-58d37df3b392-sys-fs\") pod \"aws-ebs-csi-driver-node-5sm8c\" (UID: \"5dce51c2-4758-48af-a087-58d37df3b392\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5sm8c"
May 27 23:33:07.075068 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:07.074894    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-srztq\" (UniqueName: \"kubernetes.io/projected/479d4fa9-d4cb-4d0e-82d4-eb0ec77dbc90-kube-api-access-srztq\") pod \"node-ca-6bgmn\" (UID: \"479d4fa9-d4cb-4d0e-82d4-eb0ec77dbc90\") " pod="openshift-image-registry/node-ca-6bgmn"
May 27 23:33:07.075068 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:07.074914    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/1a2fc634-3712-40ee-bfce-e8aaee0791f2-cnibin\") pod \"multus-additional-cni-plugins-7p5w7\" (UID: \"1a2fc634-3712-40ee-bfce-e8aaee0791f2\") " pod="openshift-multus/multus-additional-cni-plugins-7p5w7"
May 27 23:33:07.075068 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:07.074958    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/1a2fc634-3712-40ee-bfce-e8aaee0791f2-tuning-conf-dir\") pod \"multus-additional-cni-plugins-7p5w7\" (UID: \"1a2fc634-3712-40ee-bfce-e8aaee0791f2\") " pod="openshift-multus/multus-additional-cni-plugins-7p5w7"
May 27 23:33:07.075068 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:07.074992    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/5dce51c2-4758-48af-a087-58d37df3b392-kubelet-dir\") pod \"aws-ebs-csi-driver-node-5sm8c\" (UID: \"5dce51c2-4758-48af-a087-58d37df3b392\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5sm8c"
May 27 23:33:07.075068 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:07.075019    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/5dce51c2-4758-48af-a087-58d37df3b392-device-dir\") pod \"aws-ebs-csi-driver-node-5sm8c\" (UID: \"5dce51c2-4758-48af-a087-58d37df3b392\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5sm8c"
May 27 23:33:07.075068 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:07.075046    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vwdj7\" (UniqueName: \"kubernetes.io/projected/9d47bc2b-bc9c-4887-99e0-c05ffb6c8d0b-kube-api-access-vwdj7\") pod \"node-resolver-jbbwx\" (UID: \"9d47bc2b-bc9c-4887-99e0-c05ffb6c8d0b\") " pod="openshift-dns/node-resolver-jbbwx"
May 27 23:33:07.075474 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:07.075086    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/479d4fa9-d4cb-4d0e-82d4-eb0ec77dbc90-host\") pod \"node-ca-6bgmn\" (UID: \"479d4fa9-d4cb-4d0e-82d4-eb0ec77dbc90\") " pod="openshift-image-registry/node-ca-6bgmn"
May 27 23:33:07.075474 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:07.075114    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/479d4fa9-d4cb-4d0e-82d4-eb0ec77dbc90-serviceca\") pod \"node-ca-6bgmn\" (UID: \"479d4fa9-d4cb-4d0e-82d4-eb0ec77dbc90\") " pod="openshift-image-registry/node-ca-6bgmn"
May 27 23:33:07.075474 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:07.075150    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/1a2fc634-3712-40ee-bfce-e8aaee0791f2-os-release\") pod \"multus-additional-cni-plugins-7p5w7\" (UID: \"1a2fc634-3712-40ee-bfce-e8aaee0791f2\") " pod="openshift-multus/multus-additional-cni-plugins-7p5w7"
May 27 23:33:07.075474 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:07.075188    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7zws9\" (UniqueName: \"kubernetes.io/projected/c4d68b58-b4f3-4f03-a21c-321ca3eebe68-kube-api-access-7zws9\") pod \"network-metrics-daemon-zvbqn\" (UID: \"c4d68b58-b4f3-4f03-a21c-321ca3eebe68\") " pod="openshift-multus/network-metrics-daemon-zvbqn"
May 27 23:33:07.075474 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:07.075222    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/5dce51c2-4758-48af-a087-58d37df3b392-socket-dir\") pod \"aws-ebs-csi-driver-node-5sm8c\" (UID: \"5dce51c2-4758-48af-a087-58d37df3b392\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5sm8c"
May 27 23:33:07.075474 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:07.075257    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/5dce51c2-4758-48af-a087-58d37df3b392-registration-dir\") pod \"aws-ebs-csi-driver-node-5sm8c\" (UID: \"5dce51c2-4758-48af-a087-58d37df3b392\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5sm8c"
May 27 23:33:07.075474 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:07.075297    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/5dce51c2-4758-48af-a087-58d37df3b392-etc-selinux\") pod \"aws-ebs-csi-driver-node-5sm8c\" (UID: \"5dce51c2-4758-48af-a087-58d37df3b392\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5sm8c"
May 27 23:33:07.075474 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:07.075336    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/1a2fc634-3712-40ee-bfce-e8aaee0791f2-system-cni-dir\") pod \"multus-additional-cni-plugins-7p5w7\" (UID: \"1a2fc634-3712-40ee-bfce-e8aaee0791f2\") " pod="openshift-multus/multus-additional-cni-plugins-7p5w7"
May 27 23:33:07.075474 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:07.075360    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/1a2fc634-3712-40ee-bfce-e8aaee0791f2-cni-binary-copy\") pod \"multus-additional-cni-plugins-7p5w7\" (UID: \"1a2fc634-3712-40ee-bfce-e8aaee0791f2\") " pod="openshift-multus/multus-additional-cni-plugins-7p5w7"
May 27 23:33:07.075474 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:07.075395    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-h2jmf"
May 27 23:33:07.075474 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:07.075418    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/1a2fc634-3712-40ee-bfce-e8aaee0791f2-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-7p5w7\" (UID: \"1a2fc634-3712-40ee-bfce-e8aaee0791f2\") " pod="openshift-multus/multus-additional-cni-plugins-7p5w7"
May 27 23:33:07.075474 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:07.075448    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/1a2fc634-3712-40ee-bfce-e8aaee0791f2-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-7p5w7\" (UID: \"1a2fc634-3712-40ee-bfce-e8aaee0791f2\") " pod="openshift-multus/multus-additional-cni-plugins-7p5w7"
May 27 23:33:07.076095 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:07.075544    2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-b2q82\""
May 27 23:33:07.076095 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:07.075741    2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
May 27 23:33:07.076095 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:07.076084    2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
May 27 23:33:07.077793 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:07.077777    2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-5nqwg\""
May 27 23:33:07.077889 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:07.077829    2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
May 27 23:33:07.078211 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:07.078193    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-nh9z4"
May 27 23:33:07.080613 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:07.080593    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-s7vdp"
May 27 23:33:07.081197 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:07.081152    2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
May 27 23:33:07.081272 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:07.081251    2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-2z4kc\""
May 27 23:33:07.081388 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:07.081371    2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
May 27 23:33:07.081460 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:07.081442    2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
May 27 23:33:07.084202 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:07.083959    2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
May 27 23:33:07.085244 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:07.085061    2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
May 27 23:33:07.085244 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:07.085141    2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
May 27 23:33:07.085244 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:07.085153    2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
May 27 23:33:07.086154 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:07.085639    2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
May 27 23:33:07.086154 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:07.085886    2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
May 27 23:33:07.087964 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:07.086792    2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-5bhl7\""
May 27 23:33:07.111491 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:07.111467    2557 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-05-26 23:28:06 +0000 UTC" deadline="2027-12-09 17:41:12.447403053 +0000 UTC"
May 27 23:33:07.111491 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:07.111490    2557 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13458h8m5.335915376s"
May 27 23:33:07.166679 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:07.166654    2557 desired_state_of_world_populator.go:158] "Finished populating initial desired state of world"
May 27 23:33:07.175690 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:07.175663    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/5069fad8-69ff-40c6-993b-7d41b872d190-cnibin\") pod \"multus-h2jmf\" (UID: \"5069fad8-69ff-40c6-993b-7d41b872d190\") " pod="openshift-multus/multus-h2jmf"
May 27 23:33:07.175814 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:07.175727    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/5069fad8-69ff-40c6-993b-7d41b872d190-cni-binary-copy\") pod \"multus-h2jmf\" (UID: \"5069fad8-69ff-40c6-993b-7d41b872d190\") " pod="openshift-multus/multus-h2jmf"
May 27 23:33:07.175814 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:07.175756    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/1b1ca6ef-cc5e-418f-b5a3-acf3a5d38e44-host-cni-netd\") pod \"ovnkube-node-s7vdp\" (UID: \"1b1ca6ef-cc5e-418f-b5a3-acf3a5d38e44\") " pod="openshift-ovn-kubernetes/ovnkube-node-s7vdp"
May 27 23:33:07.175814 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:07.175784    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/1a2fc634-3712-40ee-bfce-e8aaee0791f2-tuning-conf-dir\") pod \"multus-additional-cni-plugins-7p5w7\" (UID: \"1a2fc634-3712-40ee-bfce-e8aaee0791f2\") " pod="openshift-multus/multus-additional-cni-plugins-7p5w7"
May 27 23:33:07.175814 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:07.175808    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/5dce51c2-4758-48af-a087-58d37df3b392-kubelet-dir\") pod \"aws-ebs-csi-driver-node-5sm8c\" (UID: \"5dce51c2-4758-48af-a087-58d37df3b392\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5sm8c"
May 27 23:33:07.176015 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:07.175847    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-vwdj7\" (UniqueName: \"kubernetes.io/projected/9d47bc2b-bc9c-4887-99e0-c05ffb6c8d0b-kube-api-access-vwdj7\") pod \"node-resolver-jbbwx\" (UID: \"9d47bc2b-bc9c-4887-99e0-c05ffb6c8d0b\") " pod="openshift-dns/node-resolver-jbbwx"
May 27 23:33:07.176015 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:07.175881    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5069fad8-69ff-40c6-993b-7d41b872d190-system-cni-dir\") pod \"multus-h2jmf\" (UID: \"5069fad8-69ff-40c6-993b-7d41b872d190\") " pod="openshift-multus/multus-h2jmf"
May 27 23:33:07.176015 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:07.175903    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/1b1ca6ef-cc5e-418f-b5a3-acf3a5d38e44-node-log\") pod \"ovnkube-node-s7vdp\" (UID: \"1b1ca6ef-cc5e-418f-b5a3-acf3a5d38e44\") " pod="openshift-ovn-kubernetes/ovnkube-node-s7vdp"
May 27 23:33:07.176015 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:07.175928    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/1b1ca6ef-cc5e-418f-b5a3-acf3a5d38e44-log-socket\") pod \"ovnkube-node-s7vdp\" (UID: \"1b1ca6ef-cc5e-418f-b5a3-acf3a5d38e44\") " pod="openshift-ovn-kubernetes/ovnkube-node-s7vdp"
May 27 23:33:07.176015 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:07.175962    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/1b1ca6ef-cc5e-418f-b5a3-acf3a5d38e44-ovn-node-metrics-cert\") pod \"ovnkube-node-s7vdp\" (UID: \"1b1ca6ef-cc5e-418f-b5a3-acf3a5d38e44\") " pod="openshift-ovn-kubernetes/ovnkube-node-s7vdp"
May 27 23:33:07.176015 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:07.175989    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/471894d3-91bc-4805-914b-a761d2f21f31-konnectivity-ca\") pod \"konnectivity-agent-54c79\" (UID: \"471894d3-91bc-4805-914b-a761d2f21f31\") " pod="kube-system/konnectivity-agent-54c79"
May 27 23:33:07.176015 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:07.175997    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/1a2fc634-3712-40ee-bfce-e8aaee0791f2-tuning-conf-dir\") pod \"multus-additional-cni-plugins-7p5w7\" (UID: \"1a2fc634-3712-40ee-bfce-e8aaee0791f2\") " pod="openshift-multus/multus-additional-cni-plugins-7p5w7"
May 27 23:33:07.176363 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:07.176019    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/5dce51c2-4758-48af-a087-58d37df3b392-socket-dir\") pod \"aws-ebs-csi-driver-node-5sm8c\" (UID: \"5dce51c2-4758-48af-a087-58d37df3b392\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5sm8c"
May 27 23:33:07.176363 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:07.176046    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/5dce51c2-4758-48af-a087-58d37df3b392-registration-dir\") pod \"aws-ebs-csi-driver-node-5sm8c\" (UID: \"5dce51c2-4758-48af-a087-58d37df3b392\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5sm8c"
May 27 23:33:07.176363 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:07.176074    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1b1ca6ef-cc5e-418f-b5a3-acf3a5d38e44-host-run-ovn-kubernetes\") pod \"ovnkube-node-s7vdp\" (UID: \"1b1ca6ef-cc5e-418f-b5a3-acf3a5d38e44\") " pod="openshift-ovn-kubernetes/ovnkube-node-s7vdp"
May 27 23:33:07.176363 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:07.176100    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/471894d3-91bc-4805-914b-a761d2f21f31-agent-certs\") pod \"konnectivity-agent-54c79\" (UID: \"471894d3-91bc-4805-914b-a761d2f21f31\") " pod="kube-system/konnectivity-agent-54c79"
May 27 23:33:07.176363 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:07.176123    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/74b39582-8199-4302-bd86-7b31f474872b-etc-kubernetes\") pod \"tuned-hdrgr\" (UID: \"74b39582-8199-4302-bd86-7b31f474872b\") " pod="openshift-cluster-node-tuning-operator/tuned-hdrgr"
May 27 23:33:07.176363 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:07.176188    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/5dce51c2-4758-48af-a087-58d37df3b392-registration-dir\") pod \"aws-ebs-csi-driver-node-5sm8c\" (UID: \"5dce51c2-4758-48af-a087-58d37df3b392\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5sm8c"
May 27 23:33:07.176363 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:07.176209    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/74b39582-8199-4302-bd86-7b31f474872b-etc-systemd\") pod \"tuned-hdrgr\" (UID: \"74b39582-8199-4302-bd86-7b31f474872b\") " pod="openshift-cluster-node-tuning-operator/tuned-hdrgr"
May 27 23:33:07.176363 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:07.176243    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/5dce51c2-4758-48af-a087-58d37df3b392-socket-dir\") pod \"aws-ebs-csi-driver-node-5sm8c\" (UID: \"5dce51c2-4758-48af-a087-58d37df3b392\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5sm8c"
May 27 23:33:07.176363 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:07.176254    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9d47bc2b-bc9c-4887-99e0-c05ffb6c8d0b-tmp-dir\") pod \"node-resolver-jbbwx\" (UID: \"9d47bc2b-bc9c-4887-99e0-c05ffb6c8d0b\") " pod="openshift-dns/node-resolver-jbbwx"
May 27 23:33:07.176363 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:07.176210    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/5dce51c2-4758-48af-a087-58d37df3b392-kubelet-dir\") pod \"aws-ebs-csi-driver-node-5sm8c\" (UID: \"5dce51c2-4758-48af-a087-58d37df3b392\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5sm8c"
May 27 23:33:07.176363 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:07.176315    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qzzjd\" (UniqueName: \"kubernetes.io/projected/4af77c1c-1265-4e74-b12f-28d888f58380-kube-api-access-qzzjd\") pod \"network-check-target-tsxk6\" (UID: \"4af77c1c-1265-4e74-b12f-28d888f58380\") " pod="openshift-network-diagnostics/network-check-target-tsxk6"
May 27 23:33:07.176363 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:07.176359    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/5069fad8-69ff-40c6-993b-7d41b872d190-host-run-multus-certs\") pod \"multus-h2jmf\" (UID: \"5069fad8-69ff-40c6-993b-7d41b872d190\") " pod="openshift-multus/multus-h2jmf"
May 27 23:33:07.176900 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:07.176384    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/85aeda21-db1b-47a0-abe6-9d2036fc6405-host-slash\") pod \"iptables-alerter-nh9z4\" (UID: \"85aeda21-db1b-47a0-abe6-9d2036fc6405\") " pod="openshift-network-operator/iptables-alerter-nh9z4"
May 27 23:33:07.176900 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:07.176407    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/5069fad8-69ff-40c6-993b-7d41b872d190-os-release\") pod \"multus-h2jmf\" (UID: \"5069fad8-69ff-40c6-993b-7d41b872d190\") " pod="openshift-multus/multus-h2jmf"
May 27 23:33:07.176900 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:07.176460    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/1b1ca6ef-cc5e-418f-b5a3-acf3a5d38e44-host-run-netns\") pod \"ovnkube-node-s7vdp\" (UID: \"1b1ca6ef-cc5e-418f-b5a3-acf3a5d38e44\") " pod="openshift-ovn-kubernetes/ovnkube-node-s7vdp"
May 27 23:33:07.176900 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:07.176482    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/1b1ca6ef-cc5e-418f-b5a3-acf3a5d38e44-run-openvswitch\") pod \"ovnkube-node-s7vdp\" (UID: \"1b1ca6ef-cc5e-418f-b5a3-acf3a5d38e44\") " pod="openshift-ovn-kubernetes/ovnkube-node-s7vdp"
May 27 23:33:07.176900 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:07.176517    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/1b1ca6ef-cc5e-418f-b5a3-acf3a5d38e44-ovnkube-script-lib\") pod \"ovnkube-node-s7vdp\" (UID: \"1b1ca6ef-cc5e-418f-b5a3-acf3a5d38e44\") " pod="openshift-ovn-kubernetes/ovnkube-node-s7vdp"
May 27 23:33:07.176900 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:07.176541    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/74b39582-8199-4302-bd86-7b31f474872b-lib-modules\") pod \"tuned-hdrgr\" (UID: \"74b39582-8199-4302-bd86-7b31f474872b\") " pod="openshift-cluster-node-tuning-operator/tuned-hdrgr"
May 27 23:33:07.176900 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:07.176569    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/479d4fa9-d4cb-4d0e-82d4-eb0ec77dbc90-serviceca\") pod \"node-ca-6bgmn\" (UID: \"479d4fa9-d4cb-4d0e-82d4-eb0ec77dbc90\") " pod="openshift-image-registry/node-ca-6bgmn"
May 27 23:33:07.176900 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:07.176595    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tjxqv\" (UniqueName: \"kubernetes.io/projected/85aeda21-db1b-47a0-abe6-9d2036fc6405-kube-api-access-tjxqv\") pod \"iptables-alerter-nh9z4\" (UID: \"85aeda21-db1b-47a0-abe6-9d2036fc6405\") " pod="openshift-network-operator/iptables-alerter-nh9z4"
May 27 23:33:07.176900 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:07.176596    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9d47bc2b-bc9c-4887-99e0-c05ffb6c8d0b-tmp-dir\") pod \"node-resolver-jbbwx\" (UID: \"9d47bc2b-bc9c-4887-99e0-c05ffb6c8d0b\") " pod="openshift-dns/node-resolver-jbbwx"
May 27 23:33:07.176900 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:07.176620    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5069fad8-69ff-40c6-993b-7d41b872d190-etc-kubernetes\") pod \"multus-h2jmf\" (UID: \"5069fad8-69ff-40c6-993b-7d41b872d190\") " pod="openshift-multus/multus-h2jmf"
May 27 23:33:07.176900 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:07.176647    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/1b1ca6ef-cc5e-418f-b5a3-acf3a5d38e44-run-ovn\") pod \"ovnkube-node-s7vdp\" (UID: \"1b1ca6ef-cc5e-418f-b5a3-acf3a5d38e44\") " pod="openshift-ovn-kubernetes/ovnkube-node-s7vdp"
May 27 23:33:07.176900 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:07.176671    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/74b39582-8199-4302-bd86-7b31f474872b-etc-sysctl-d\") pod \"tuned-hdrgr\" (UID: \"74b39582-8199-4302-bd86-7b31f474872b\") " pod="openshift-cluster-node-tuning-operator/tuned-hdrgr"
May 27 23:33:07.176900 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:07.176699    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/1a2fc634-3712-40ee-bfce-e8aaee0791f2-os-release\") pod \"multus-additional-cni-plugins-7p5w7\" (UID: \"1a2fc634-3712-40ee-bfce-e8aaee0791f2\") " pod="openshift-multus/multus-additional-cni-plugins-7p5w7"
May 27 23:33:07.176900 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:07.176725    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/85aeda21-db1b-47a0-abe6-9d2036fc6405-iptables-alerter-script\") pod \"iptables-alerter-nh9z4\" (UID: \"85aeda21-db1b-47a0-abe6-9d2036fc6405\") " pod="openshift-network-operator/iptables-alerter-nh9z4"
May 27 23:33:07.176900 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:07.176746    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/1b1ca6ef-cc5e-418f-b5a3-acf3a5d38e44-host-slash\") pod \"ovnkube-node-s7vdp\" (UID: \"1b1ca6ef-cc5e-418f-b5a3-acf3a5d38e44\") " pod="openshift-ovn-kubernetes/ovnkube-node-s7vdp"
May 27 23:33:07.176900 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:07.176782    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/1a2fc634-3712-40ee-bfce-e8aaee0791f2-cni-binary-copy\") pod \"multus-additional-cni-plugins-7p5w7\" (UID: \"1a2fc634-3712-40ee-bfce-e8aaee0791f2\") " pod="openshift-multus/multus-additional-cni-plugins-7p5w7"
May 27 23:33:07.176900 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:07.176809    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/1a2fc634-3712-40ee-bfce-e8aaee0791f2-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-7p5w7\" (UID: \"1a2fc634-3712-40ee-bfce-e8aaee0791f2\") " pod="openshift-multus/multus-additional-cni-plugins-7p5w7"
May 27 23:33:07.177650 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:07.176811    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/1a2fc634-3712-40ee-bfce-e8aaee0791f2-os-release\") pod \"multus-additional-cni-plugins-7p5w7\" (UID: \"1a2fc634-3712-40ee-bfce-e8aaee0791f2\") " pod="openshift-multus/multus-additional-cni-plugins-7p5w7"
May 27 23:33:07.177650 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:07.176834    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-b6wz5\" (UniqueName: \"kubernetes.io/projected/5dce51c2-4758-48af-a087-58d37df3b392-kube-api-access-b6wz5\") pod \"aws-ebs-csi-driver-node-5sm8c\" (UID: \"5dce51c2-4758-48af-a087-58d37df3b392\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5sm8c"
May 27 23:33:07.177650 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:07.176860    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/5069fad8-69ff-40c6-993b-7d41b872d190-host-var-lib-cni-bin\") pod \"multus-h2jmf\" (UID: \"5069fad8-69ff-40c6-993b-7d41b872d190\") " pod="openshift-multus/multus-h2jmf"
May 27 23:33:07.177650 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:07.176885    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/1b1ca6ef-cc5e-418f-b5a3-acf3a5d38e44-etc-openvswitch\") pod \"ovnkube-node-s7vdp\" (UID: \"1b1ca6ef-cc5e-418f-b5a3-acf3a5d38e44\") " pod="openshift-ovn-kubernetes/ovnkube-node-s7vdp"
May 27 23:33:07.177650 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:07.176930    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4clzj\" (UniqueName: \"kubernetes.io/projected/1b1ca6ef-cc5e-418f-b5a3-acf3a5d38e44-kube-api-access-4clzj\") pod \"ovnkube-node-s7vdp\" (UID: \"1b1ca6ef-cc5e-418f-b5a3-acf3a5d38e44\") " pod="openshift-ovn-kubernetes/ovnkube-node-s7vdp"
May 27 23:33:07.177650 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:07.176953    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/74b39582-8199-4302-bd86-7b31f474872b-etc-modprobe-d\") pod \"tuned-hdrgr\" (UID: \"74b39582-8199-4302-bd86-7b31f474872b\") " pod="openshift-cluster-node-tuning-operator/tuned-hdrgr"
May 27 23:33:07.177650 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:07.176974    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/74b39582-8199-4302-bd86-7b31f474872b-sys\") pod \"tuned-hdrgr\" (UID: \"74b39582-8199-4302-bd86-7b31f474872b\") " pod="openshift-cluster-node-tuning-operator/tuned-hdrgr"
May 27 23:33:07.177650 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:07.176997    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/5069fad8-69ff-40c6-993b-7d41b872d190-host-run-k8s-cni-cncf-io\") pod \"multus-h2jmf\" (UID: \"5069fad8-69ff-40c6-993b-7d41b872d190\") " pod="openshift-multus/multus-h2jmf"
May 27 23:33:07.177650 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:07.177021    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/1b1ca6ef-cc5e-418f-b5a3-acf3a5d38e44-run-systemd\") pod \"ovnkube-node-s7vdp\" (UID: \"1b1ca6ef-cc5e-418f-b5a3-acf3a5d38e44\") " pod="openshift-ovn-kubernetes/ovnkube-node-s7vdp"
May 27 23:33:07.177650 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:07.177027    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/479d4fa9-d4cb-4d0e-82d4-eb0ec77dbc90-serviceca\") pod \"node-ca-6bgmn\" (UID: \"479d4fa9-d4cb-4d0e-82d4-eb0ec77dbc90\") " pod="openshift-image-registry/node-ca-6bgmn"
May 27 23:33:07.177650 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:07.177046    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/1a2fc634-3712-40ee-bfce-e8aaee0791f2-cnibin\") pod \"multus-additional-cni-plugins-7p5w7\" (UID: \"1a2fc634-3712-40ee-bfce-e8aaee0791f2\") " pod="openshift-multus/multus-additional-cni-plugins-7p5w7"
May 27 23:33:07.177650 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:07.177080    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/5069fad8-69ff-40c6-993b-7d41b872d190-host-var-lib-cni-multus\") pod \"multus-h2jmf\" (UID: \"5069fad8-69ff-40c6-993b-7d41b872d190\") " pod="openshift-multus/multus-h2jmf"
May 27 23:33:07.177650 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:07.177104    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/5069fad8-69ff-40c6-993b-7d41b872d190-hostroot\") pod \"multus-h2jmf\" (UID: \"5069fad8-69ff-40c6-993b-7d41b872d190\") " pod="openshift-multus/multus-h2jmf"
May 27 23:33:07.177650 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:07.177152    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/5069fad8-69ff-40c6-993b-7d41b872d190-multus-conf-dir\") pod \"multus-h2jmf\" (UID: \"5069fad8-69ff-40c6-993b-7d41b872d190\") " pod="openshift-multus/multus-h2jmf"
May 27 23:33:07.177650 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:07.177177    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/1b1ca6ef-cc5e-418f-b5a3-acf3a5d38e44-host-kubelet\") pod \"ovnkube-node-s7vdp\" (UID: \"1b1ca6ef-cc5e-418f-b5a3-acf3a5d38e44\") " pod="openshift-ovn-kubernetes/ovnkube-node-s7vdp"
May 27 23:33:07.177650 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:07.177200    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/1b1ca6ef-cc5e-418f-b5a3-acf3a5d38e44-var-lib-openvswitch\") pod \"ovnkube-node-s7vdp\" (UID: \"1b1ca6ef-cc5e-418f-b5a3-acf3a5d38e44\") " pod="openshift-ovn-kubernetes/ovnkube-node-s7vdp"
May 27 23:33:07.177650 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:07.177223    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5069fad8-69ff-40c6-993b-7d41b872d190-multus-cni-dir\") pod \"multus-h2jmf\" (UID: \"5069fad8-69ff-40c6-993b-7d41b872d190\") " pod="openshift-multus/multus-h2jmf"
May 27 23:33:07.178408 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:07.177318    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/1a2fc634-3712-40ee-bfce-e8aaee0791f2-cnibin\") pod \"multus-additional-cni-plugins-7p5w7\" (UID: \"1a2fc634-3712-40ee-bfce-e8aaee0791f2\") " pod="openshift-multus/multus-additional-cni-plugins-7p5w7"
May 27 23:33:07.178408 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:07.177375    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/5069fad8-69ff-40c6-993b-7d41b872d190-multus-daemon-config\") pod \"multus-h2jmf\" (UID: \"5069fad8-69ff-40c6-993b-7d41b872d190\") " pod="openshift-multus/multus-h2jmf"
May 27 23:33:07.178408 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:07.177402    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/1b1ca6ef-cc5e-418f-b5a3-acf3a5d38e44-ovnkube-config\") pod \"ovnkube-node-s7vdp\" (UID: \"1b1ca6ef-cc5e-418f-b5a3-acf3a5d38e44\") " pod="openshift-ovn-kubernetes/ovnkube-node-s7vdp"
May 27 23:33:07.178408 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:07.177438    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/9d47bc2b-bc9c-4887-99e0-c05ffb6c8d0b-hosts-file\") pod \"node-resolver-jbbwx\" (UID: \"9d47bc2b-bc9c-4887-99e0-c05ffb6c8d0b\") " pod="openshift-dns/node-resolver-jbbwx"
May 27 23:33:07.178408 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:07.177462    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/74b39582-8199-4302-bd86-7b31f474872b-host\") pod \"tuned-hdrgr\" (UID: \"74b39582-8199-4302-bd86-7b31f474872b\") " pod="openshift-cluster-node-tuning-operator/tuned-hdrgr"
May 27 23:33:07.178408 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:07.177485    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qtk58\" (UniqueName: \"kubernetes.io/projected/74b39582-8199-4302-bd86-7b31f474872b-kube-api-access-qtk58\") pod \"tuned-hdrgr\" (UID: \"74b39582-8199-4302-bd86-7b31f474872b\") " pod="openshift-cluster-node-tuning-operator/tuned-hdrgr"
May 27 23:33:07.178408 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:07.177518    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/9d47bc2b-bc9c-4887-99e0-c05ffb6c8d0b-hosts-file\") pod \"node-resolver-jbbwx\" (UID: \"9d47bc2b-bc9c-4887-99e0-c05ffb6c8d0b\") " pod="openshift-dns/node-resolver-jbbwx"
May 27 23:33:07.178408 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:07.177531    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-srztq\" (UniqueName: \"kubernetes.io/projected/479d4fa9-d4cb-4d0e-82d4-eb0ec77dbc90-kube-api-access-srztq\") pod \"node-ca-6bgmn\" (UID: \"479d4fa9-d4cb-4d0e-82d4-eb0ec77dbc90\") " pod="openshift-image-registry/node-ca-6bgmn"
May 27 23:33:07.178408 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:07.177579    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zs4dk\" (UniqueName: \"kubernetes.io/projected/5069fad8-69ff-40c6-993b-7d41b872d190-kube-api-access-zs4dk\") pod \"multus-h2jmf\" (UID: \"5069fad8-69ff-40c6-993b-7d41b872d190\") " pod="openshift-multus/multus-h2jmf"
May 27 23:33:07.178408 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:07.177587    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/1a2fc634-3712-40ee-bfce-e8aaee0791f2-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-7p5w7\" (UID: \"1a2fc634-3712-40ee-bfce-e8aaee0791f2\") " pod="openshift-multus/multus-additional-cni-plugins-7p5w7"
May 27 23:33:07.178408 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:07.177610    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/1b1ca6ef-cc5e-418f-b5a3-acf3a5d38e44-host-cni-bin\") pod \"ovnkube-node-s7vdp\" (UID: \"1b1ca6ef-cc5e-418f-b5a3-acf3a5d38e44\") " pod="openshift-ovn-kubernetes/ovnkube-node-s7vdp"
May 27 23:33:07.178408 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:07.177648    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/5dce51c2-4758-48af-a087-58d37df3b392-device-dir\") pod \"aws-ebs-csi-driver-node-5sm8c\" (UID: \"5dce51c2-4758-48af-a087-58d37df3b392\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5sm8c"
May 27 23:33:07.178408 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:07.177649    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/1a2fc634-3712-40ee-bfce-e8aaee0791f2-cni-binary-copy\") pod \"multus-additional-cni-plugins-7p5w7\" (UID: \"1a2fc634-3712-40ee-bfce-e8aaee0791f2\") " pod="openshift-multus/multus-additional-cni-plugins-7p5w7"
May 27 23:33:07.178408 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:07.177664    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/479d4fa9-d4cb-4d0e-82d4-eb0ec77dbc90-host\") pod \"node-ca-6bgmn\" (UID: \"479d4fa9-d4cb-4d0e-82d4-eb0ec77dbc90\") " pod="openshift-image-registry/node-ca-6bgmn"
May 27 23:33:07.178408 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:07.177694    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/5069fad8-69ff-40c6-993b-7d41b872d190-multus-socket-dir-parent\") pod \"multus-h2jmf\" (UID: \"5069fad8-69ff-40c6-993b-7d41b872d190\") " pod="openshift-multus/multus-h2jmf"
May 27 23:33:07.178408 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:07.177713    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/5dce51c2-4758-48af-a087-58d37df3b392-device-dir\") pod \"aws-ebs-csi-driver-node-5sm8c\" (UID: \"5dce51c2-4758-48af-a087-58d37df3b392\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5sm8c"
May 27 23:33:07.178408 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:07.177749    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/479d4fa9-d4cb-4d0e-82d4-eb0ec77dbc90-host\") pod \"node-ca-6bgmn\" (UID: \"479d4fa9-d4cb-4d0e-82d4-eb0ec77dbc90\") " pod="openshift-image-registry/node-ca-6bgmn"
May 27 23:33:07.179001 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:07.177771    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/5069fad8-69ff-40c6-993b-7d41b872d190-host-run-netns\") pod \"multus-h2jmf\" (UID: \"5069fad8-69ff-40c6-993b-7d41b872d190\") " pod="openshift-multus/multus-h2jmf"
May 27 23:33:07.179001 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:07.177794    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/5069fad8-69ff-40c6-993b-7d41b872d190-host-var-lib-kubelet\") pod \"multus-h2jmf\" (UID: \"5069fad8-69ff-40c6-993b-7d41b872d190\") " pod="openshift-multus/multus-h2jmf"
May 27 23:33:07.179001 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:07.177814    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/1b1ca6ef-cc5e-418f-b5a3-acf3a5d38e44-systemd-units\") pod \"ovnkube-node-s7vdp\" (UID: \"1b1ca6ef-cc5e-418f-b5a3-acf3a5d38e44\") " pod="openshift-ovn-kubernetes/ovnkube-node-s7vdp"
May 27 23:33:07.179001 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:07.177828    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/74b39582-8199-4302-bd86-7b31f474872b-etc-sysconfig\") pod \"tuned-hdrgr\" (UID: \"74b39582-8199-4302-bd86-7b31f474872b\") " pod="openshift-cluster-node-tuning-operator/tuned-hdrgr"
May 27 23:33:07.179001 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:07.177842    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/74b39582-8199-4302-bd86-7b31f474872b-etc-tuned\") pod \"tuned-hdrgr\" (UID: \"74b39582-8199-4302-bd86-7b31f474872b\") " pod="openshift-cluster-node-tuning-operator/tuned-hdrgr"
May 27 23:33:07.179001 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:07.177867    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-7zws9\" (UniqueName: \"kubernetes.io/projected/c4d68b58-b4f3-4f03-a21c-321ca3eebe68-kube-api-access-7zws9\") pod \"network-metrics-daemon-zvbqn\" (UID: \"c4d68b58-b4f3-4f03-a21c-321ca3eebe68\") " pod="openshift-multus/network-metrics-daemon-zvbqn"
May 27 23:33:07.179001 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:07.177894    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/5dce51c2-4758-48af-a087-58d37df3b392-etc-selinux\") pod \"aws-ebs-csi-driver-node-5sm8c\" (UID: \"5dce51c2-4758-48af-a087-58d37df3b392\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5sm8c"
May 27 23:33:07.179001 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:07.177912    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/74b39582-8199-4302-bd86-7b31f474872b-run\") pod \"tuned-hdrgr\" (UID: \"74b39582-8199-4302-bd86-7b31f474872b\") " pod="openshift-cluster-node-tuning-operator/tuned-hdrgr"
May 27 23:33:07.179001 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:07.177929    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/74b39582-8199-4302-bd86-7b31f474872b-var-lib-kubelet\") pod \"tuned-hdrgr\" (UID: \"74b39582-8199-4302-bd86-7b31f474872b\") " pod="openshift-cluster-node-tuning-operator/tuned-hdrgr"
May 27 23:33:07.179001 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:07.177944    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/74b39582-8199-4302-bd86-7b31f474872b-tmp\") pod \"tuned-hdrgr\" (UID: \"74b39582-8199-4302-bd86-7b31f474872b\") " pod="openshift-cluster-node-tuning-operator/tuned-hdrgr"
May 27 23:33:07.179001 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:07.177967    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/1a2fc634-3712-40ee-bfce-e8aaee0791f2-system-cni-dir\") pod \"multus-additional-cni-plugins-7p5w7\" (UID: \"1a2fc634-3712-40ee-bfce-e8aaee0791f2\") " pod="openshift-multus/multus-additional-cni-plugins-7p5w7"
May 27 23:33:07.179001 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:07.177999    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/1a2fc634-3712-40ee-bfce-e8aaee0791f2-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-7p5w7\" (UID: \"1a2fc634-3712-40ee-bfce-e8aaee0791f2\") " pod="openshift-multus/multus-additional-cni-plugins-7p5w7"
May 27 23:33:07.179001 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:07.178018    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1b1ca6ef-cc5e-418f-b5a3-acf3a5d38e44-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-s7vdp\" (UID: \"1b1ca6ef-cc5e-418f-b5a3-acf3a5d38e44\") " pod="openshift-ovn-kubernetes/ovnkube-node-s7vdp"
May 27 23:33:07.179001 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:07.178040    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/1b1ca6ef-cc5e-418f-b5a3-acf3a5d38e44-env-overrides\") pod \"ovnkube-node-s7vdp\" (UID: \"1b1ca6ef-cc5e-418f-b5a3-acf3a5d38e44\") " pod="openshift-ovn-kubernetes/ovnkube-node-s7vdp"
May 27 23:33:07.179001 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:07.178055    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/74b39582-8199-4302-bd86-7b31f474872b-etc-sysctl-conf\") pod \"tuned-hdrgr\" (UID: \"74b39582-8199-4302-bd86-7b31f474872b\") " pod="openshift-cluster-node-tuning-operator/tuned-hdrgr"
May 27 23:33:07.179001 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:07.178073    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-zpphc\" (UniqueName: \"kubernetes.io/projected/1a2fc634-3712-40ee-bfce-e8aaee0791f2-kube-api-access-zpphc\") pod \"multus-additional-cni-plugins-7p5w7\" (UID: \"1a2fc634-3712-40ee-bfce-e8aaee0791f2\") " pod="openshift-multus/multus-additional-cni-plugins-7p5w7"
May 27 23:33:07.179590 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:07.178081    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/5dce51c2-4758-48af-a087-58d37df3b392-etc-selinux\") pod \"aws-ebs-csi-driver-node-5sm8c\" (UID: \"5dce51c2-4758-48af-a087-58d37df3b392\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5sm8c"
May 27 23:33:07.179590 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:07.178097    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/1a2fc634-3712-40ee-bfce-e8aaee0791f2-system-cni-dir\") pod \"multus-additional-cni-plugins-7p5w7\" (UID: \"1a2fc634-3712-40ee-bfce-e8aaee0791f2\") " pod="openshift-multus/multus-additional-cni-plugins-7p5w7"
May 27 23:33:07.179590 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:07.178089    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c4d68b58-b4f3-4f03-a21c-321ca3eebe68-metrics-certs\") pod \"network-metrics-daemon-zvbqn\" (UID: \"c4d68b58-b4f3-4f03-a21c-321ca3eebe68\") " pod="openshift-multus/network-metrics-daemon-zvbqn"
May 27 23:33:07.179590 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:07.178160    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/5dce51c2-4758-48af-a087-58d37df3b392-sys-fs\") pod \"aws-ebs-csi-driver-node-5sm8c\" (UID: \"5dce51c2-4758-48af-a087-58d37df3b392\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5sm8c"
May 27 23:33:07.179590 ip-10-0-132-191 kubenswrapper[2557]: E0527 23:33:07.178168    2557 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
May 27 23:33:07.179590 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:07.178271    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/5dce51c2-4758-48af-a087-58d37df3b392-sys-fs\") pod \"aws-ebs-csi-driver-node-5sm8c\" (UID: \"5dce51c2-4758-48af-a087-58d37df3b392\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5sm8c"
May 27 23:33:07.179590 ip-10-0-132-191 kubenswrapper[2557]: E0527 23:33:07.178364    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c4d68b58-b4f3-4f03-a21c-321ca3eebe68-metrics-certs podName:c4d68b58-b4f3-4f03-a21c-321ca3eebe68 nodeName:}" failed. No retries permitted until 2026-05-27 23:33:07.678327261 +0000 UTC m=+3.097863280 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c4d68b58-b4f3-4f03-a21c-321ca3eebe68-metrics-certs") pod "network-metrics-daemon-zvbqn" (UID: "c4d68b58-b4f3-4f03-a21c-321ca3eebe68") : object "openshift-multus"/"metrics-daemon-secret" not registered
May 27 23:33:07.179590 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:07.178549    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/1a2fc634-3712-40ee-bfce-e8aaee0791f2-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-7p5w7\" (UID: \"1a2fc634-3712-40ee-bfce-e8aaee0791f2\") " pod="openshift-multus/multus-additional-cni-plugins-7p5w7"
May 27 23:33:07.182096 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:07.182072    2557 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
May 27 23:33:07.185576 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:07.185553    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vwdj7\" (UniqueName: \"kubernetes.io/projected/9d47bc2b-bc9c-4887-99e0-c05ffb6c8d0b-kube-api-access-vwdj7\") pod \"node-resolver-jbbwx\" (UID: \"9d47bc2b-bc9c-4887-99e0-c05ffb6c8d0b\") " pod="openshift-dns/node-resolver-jbbwx"
May 27 23:33:07.185691 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:07.185558    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-b6wz5\" (UniqueName: \"kubernetes.io/projected/5dce51c2-4758-48af-a087-58d37df3b392-kube-api-access-b6wz5\") pod \"aws-ebs-csi-driver-node-5sm8c\" (UID: \"5dce51c2-4758-48af-a087-58d37df3b392\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5sm8c"
May 27 23:33:07.189616 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:07.189594    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zpphc\" (UniqueName: \"kubernetes.io/projected/1a2fc634-3712-40ee-bfce-e8aaee0791f2-kube-api-access-zpphc\") pod \"multus-additional-cni-plugins-7p5w7\" (UID: \"1a2fc634-3712-40ee-bfce-e8aaee0791f2\") " pod="openshift-multus/multus-additional-cni-plugins-7p5w7"
May 27 23:33:07.189698 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:07.189616    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-srztq\" (UniqueName: \"kubernetes.io/projected/479d4fa9-d4cb-4d0e-82d4-eb0ec77dbc90-kube-api-access-srztq\") pod \"node-ca-6bgmn\" (UID: \"479d4fa9-d4cb-4d0e-82d4-eb0ec77dbc90\") " pod="openshift-image-registry/node-ca-6bgmn"
May 27 23:33:07.190186 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:07.190159    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7zws9\" (UniqueName: \"kubernetes.io/projected/c4d68b58-b4f3-4f03-a21c-321ca3eebe68-kube-api-access-7zws9\") pod \"network-metrics-daemon-zvbqn\" (UID: \"c4d68b58-b4f3-4f03-a21c-321ca3eebe68\") " pod="openshift-multus/network-metrics-daemon-zvbqn"
May 27 23:33:07.202242 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:07.202201    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-191.ec2.internal" event={"ID":"af860e09fcfbe100abf198b53983e8cd","Type":"ContainerStarted","Data":"813c02e3e2f77dad9b147b4c8e316f35e7926b148c5ccf70ddfc88eadf56ef59"}
May 27 23:33:07.203229 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:07.203204    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-191.ec2.internal" event={"ID":"25522b04fdc0994697c03f613fe7f724","Type":"ContainerStarted","Data":"04a83cce87dea3231a8d0e956fe12097d8ab015e4381394b5e089534231d86c7"}
May 27 23:33:07.279163 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:07.279116    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-qzzjd\" (UniqueName: \"kubernetes.io/projected/4af77c1c-1265-4e74-b12f-28d888f58380-kube-api-access-qzzjd\") pod \"network-check-target-tsxk6\" (UID: \"4af77c1c-1265-4e74-b12f-28d888f58380\") " pod="openshift-network-diagnostics/network-check-target-tsxk6"
May 27 23:33:07.279163 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:07.279161    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/5069fad8-69ff-40c6-993b-7d41b872d190-host-run-multus-certs\") pod \"multus-h2jmf\" (UID: \"5069fad8-69ff-40c6-993b-7d41b872d190\") " pod="openshift-multus/multus-h2jmf"
May 27 23:33:07.279388 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:07.279178    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/85aeda21-db1b-47a0-abe6-9d2036fc6405-host-slash\") pod \"iptables-alerter-nh9z4\" (UID: \"85aeda21-db1b-47a0-abe6-9d2036fc6405\") " pod="openshift-network-operator/iptables-alerter-nh9z4"
May 27 23:33:07.279388 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:07.279197    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/5069fad8-69ff-40c6-993b-7d41b872d190-os-release\") pod \"multus-h2jmf\" (UID: \"5069fad8-69ff-40c6-993b-7d41b872d190\") " pod="openshift-multus/multus-h2jmf"
May 27 23:33:07.279388 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:07.279222    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/1b1ca6ef-cc5e-418f-b5a3-acf3a5d38e44-host-run-netns\") pod \"ovnkube-node-s7vdp\" (UID: \"1b1ca6ef-cc5e-418f-b5a3-acf3a5d38e44\") " pod="openshift-ovn-kubernetes/ovnkube-node-s7vdp"
May 27 23:33:07.279388 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:07.279245    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/1b1ca6ef-cc5e-418f-b5a3-acf3a5d38e44-run-openvswitch\") pod \"ovnkube-node-s7vdp\" (UID: \"1b1ca6ef-cc5e-418f-b5a3-acf3a5d38e44\") " pod="openshift-ovn-kubernetes/ovnkube-node-s7vdp"
May 27 23:33:07.279388 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:07.279255    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/85aeda21-db1b-47a0-abe6-9d2036fc6405-host-slash\") pod \"iptables-alerter-nh9z4\" (UID: \"85aeda21-db1b-47a0-abe6-9d2036fc6405\") " pod="openshift-network-operator/iptables-alerter-nh9z4"
May 27 23:33:07.279388 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:07.279270    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/1b1ca6ef-cc5e-418f-b5a3-acf3a5d38e44-ovnkube-script-lib\") pod \"ovnkube-node-s7vdp\" (UID: \"1b1ca6ef-cc5e-418f-b5a3-acf3a5d38e44\") " pod="openshift-ovn-kubernetes/ovnkube-node-s7vdp"
May 27 23:33:07.279388 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:07.279293    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/74b39582-8199-4302-bd86-7b31f474872b-lib-modules\") pod \"tuned-hdrgr\" (UID: \"74b39582-8199-4302-bd86-7b31f474872b\") " pod="openshift-cluster-node-tuning-operator/tuned-hdrgr"
May 27 23:33:07.279388 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:07.279317    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/1b1ca6ef-cc5e-418f-b5a3-acf3a5d38e44-run-openvswitch\") pod \"ovnkube-node-s7vdp\" (UID: \"1b1ca6ef-cc5e-418f-b5a3-acf3a5d38e44\") " pod="openshift-ovn-kubernetes/ovnkube-node-s7vdp"
May 27 23:33:07.279388 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:07.279313    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/5069fad8-69ff-40c6-993b-7d41b872d190-os-release\") pod \"multus-h2jmf\" (UID: \"5069fad8-69ff-40c6-993b-7d41b872d190\") " pod="openshift-multus/multus-h2jmf"
May 27 23:33:07.279388 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:07.279319    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-tjxqv\" (UniqueName: \"kubernetes.io/projected/85aeda21-db1b-47a0-abe6-9d2036fc6405-kube-api-access-tjxqv\") pod \"iptables-alerter-nh9z4\" (UID: \"85aeda21-db1b-47a0-abe6-9d2036fc6405\") " pod="openshift-network-operator/iptables-alerter-nh9z4"
May 27 23:33:07.279388 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:07.279355    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/1b1ca6ef-cc5e-418f-b5a3-acf3a5d38e44-host-run-netns\") pod \"ovnkube-node-s7vdp\" (UID: \"1b1ca6ef-cc5e-418f-b5a3-acf3a5d38e44\") " pod="openshift-ovn-kubernetes/ovnkube-node-s7vdp"
May 27 23:33:07.279388 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:07.279368    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5069fad8-69ff-40c6-993b-7d41b872d190-etc-kubernetes\") pod \"multus-h2jmf\" (UID: \"5069fad8-69ff-40c6-993b-7d41b872d190\") " pod="openshift-multus/multus-h2jmf"
May 27 23:33:07.279388 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:07.279396    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/1b1ca6ef-cc5e-418f-b5a3-acf3a5d38e44-run-ovn\") pod \"ovnkube-node-s7vdp\" (UID: \"1b1ca6ef-cc5e-418f-b5a3-acf3a5d38e44\") " pod="openshift-ovn-kubernetes/ovnkube-node-s7vdp"
May 27 23:33:07.280009 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:07.279422    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/74b39582-8199-4302-bd86-7b31f474872b-etc-sysctl-d\") pod \"tuned-hdrgr\" (UID: \"74b39582-8199-4302-bd86-7b31f474872b\") " pod="openshift-cluster-node-tuning-operator/tuned-hdrgr"
May 27 23:33:07.280009 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:07.279464    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/1b1ca6ef-cc5e-418f-b5a3-acf3a5d38e44-run-ovn\") pod \"ovnkube-node-s7vdp\" (UID: \"1b1ca6ef-cc5e-418f-b5a3-acf3a5d38e44\") " pod="openshift-ovn-kubernetes/ovnkube-node-s7vdp"
May 27 23:33:07.280009 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:07.279475    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5069fad8-69ff-40c6-993b-7d41b872d190-etc-kubernetes\") pod \"multus-h2jmf\" (UID: \"5069fad8-69ff-40c6-993b-7d41b872d190\") " pod="openshift-multus/multus-h2jmf"
May 27 23:33:07.280009 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:07.279487    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/74b39582-8199-4302-bd86-7b31f474872b-lib-modules\") pod \"tuned-hdrgr\" (UID: \"74b39582-8199-4302-bd86-7b31f474872b\") " pod="openshift-cluster-node-tuning-operator/tuned-hdrgr"
May 27 23:33:07.280009 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:07.279517    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/85aeda21-db1b-47a0-abe6-9d2036fc6405-iptables-alerter-script\") pod \"iptables-alerter-nh9z4\" (UID: \"85aeda21-db1b-47a0-abe6-9d2036fc6405\") " pod="openshift-network-operator/iptables-alerter-nh9z4"
May 27 23:33:07.280009 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:07.279547    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/1b1ca6ef-cc5e-418f-b5a3-acf3a5d38e44-host-slash\") pod \"ovnkube-node-s7vdp\" (UID: \"1b1ca6ef-cc5e-418f-b5a3-acf3a5d38e44\") " pod="openshift-ovn-kubernetes/ovnkube-node-s7vdp"
May 27 23:33:07.280009 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:07.279586    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/74b39582-8199-4302-bd86-7b31f474872b-etc-sysctl-d\") pod \"tuned-hdrgr\" (UID: \"74b39582-8199-4302-bd86-7b31f474872b\") " pod="openshift-cluster-node-tuning-operator/tuned-hdrgr"
May 27 23:33:07.280009 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:07.279631    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/5069fad8-69ff-40c6-993b-7d41b872d190-host-var-lib-cni-bin\") pod \"multus-h2jmf\" (UID: \"5069fad8-69ff-40c6-993b-7d41b872d190\") " pod="openshift-multus/multus-h2jmf"
May 27 23:33:07.280009 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:07.279651    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/5069fad8-69ff-40c6-993b-7d41b872d190-host-run-multus-certs\") pod \"multus-h2jmf\" (UID: \"5069fad8-69ff-40c6-993b-7d41b872d190\") " pod="openshift-multus/multus-h2jmf"
May 27 23:33:07.280009 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:07.279688    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/1b1ca6ef-cc5e-418f-b5a3-acf3a5d38e44-host-slash\") pod \"ovnkube-node-s7vdp\" (UID: \"1b1ca6ef-cc5e-418f-b5a3-acf3a5d38e44\") " pod="openshift-ovn-kubernetes/ovnkube-node-s7vdp"
May 27 23:33:07.280009 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:07.279681    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/1b1ca6ef-cc5e-418f-b5a3-acf3a5d38e44-etc-openvswitch\") pod \"ovnkube-node-s7vdp\" (UID: \"1b1ca6ef-cc5e-418f-b5a3-acf3a5d38e44\") " pod="openshift-ovn-kubernetes/ovnkube-node-s7vdp"
May 27 23:33:07.280009 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:07.279718    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/5069fad8-69ff-40c6-993b-7d41b872d190-host-var-lib-cni-bin\") pod \"multus-h2jmf\" (UID: \"5069fad8-69ff-40c6-993b-7d41b872d190\") " pod="openshift-multus/multus-h2jmf"
May 27 23:33:07.280009 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:07.279720    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/1b1ca6ef-cc5e-418f-b5a3-acf3a5d38e44-etc-openvswitch\") pod \"ovnkube-node-s7vdp\" (UID: \"1b1ca6ef-cc5e-418f-b5a3-acf3a5d38e44\") " pod="openshift-ovn-kubernetes/ovnkube-node-s7vdp"
May 27 23:33:07.280009 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:07.279738    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-4clzj\" (UniqueName: \"kubernetes.io/projected/1b1ca6ef-cc5e-418f-b5a3-acf3a5d38e44-kube-api-access-4clzj\") pod \"ovnkube-node-s7vdp\" (UID: \"1b1ca6ef-cc5e-418f-b5a3-acf3a5d38e44\") " pod="openshift-ovn-kubernetes/ovnkube-node-s7vdp"
May 27 23:33:07.280009 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:07.279765    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/74b39582-8199-4302-bd86-7b31f474872b-etc-modprobe-d\") pod \"tuned-hdrgr\" (UID: \"74b39582-8199-4302-bd86-7b31f474872b\") " pod="openshift-cluster-node-tuning-operator/tuned-hdrgr"
May 27 23:33:07.280009 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:07.279787    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/74b39582-8199-4302-bd86-7b31f474872b-sys\") pod \"tuned-hdrgr\" (UID: \"74b39582-8199-4302-bd86-7b31f474872b\") " pod="openshift-cluster-node-tuning-operator/tuned-hdrgr"
May 27 23:33:07.280009 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:07.279811    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/5069fad8-69ff-40c6-993b-7d41b872d190-host-run-k8s-cni-cncf-io\") pod \"multus-h2jmf\" (UID: \"5069fad8-69ff-40c6-993b-7d41b872d190\") " pod="openshift-multus/multus-h2jmf"
May 27 23:33:07.280009 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:07.279834    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/1b1ca6ef-cc5e-418f-b5a3-acf3a5d38e44-run-systemd\") pod \"ovnkube-node-s7vdp\" (UID: \"1b1ca6ef-cc5e-418f-b5a3-acf3a5d38e44\") " pod="openshift-ovn-kubernetes/ovnkube-node-s7vdp"
May 27 23:33:07.280863 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:07.279857    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/5069fad8-69ff-40c6-993b-7d41b872d190-host-var-lib-cni-multus\") pod \"multus-h2jmf\" (UID: \"5069fad8-69ff-40c6-993b-7d41b872d190\") " pod="openshift-multus/multus-h2jmf"
May 27 23:33:07.280863 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:07.279877    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/5069fad8-69ff-40c6-993b-7d41b872d190-hostroot\") pod \"multus-h2jmf\" (UID: \"5069fad8-69ff-40c6-993b-7d41b872d190\") " pod="openshift-multus/multus-h2jmf"
May 27 23:33:07.280863 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:07.279883    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/74b39582-8199-4302-bd86-7b31f474872b-etc-modprobe-d\") pod \"tuned-hdrgr\" (UID: \"74b39582-8199-4302-bd86-7b31f474872b\") " pod="openshift-cluster-node-tuning-operator/tuned-hdrgr"
May 27 23:33:07.280863 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:07.279902    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/5069fad8-69ff-40c6-993b-7d41b872d190-multus-conf-dir\") pod \"multus-h2jmf\" (UID: \"5069fad8-69ff-40c6-993b-7d41b872d190\") " pod="openshift-multus/multus-h2jmf"
May 27 23:33:07.280863 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:07.279927    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/1b1ca6ef-cc5e-418f-b5a3-acf3a5d38e44-host-kubelet\") pod \"ovnkube-node-s7vdp\" (UID: \"1b1ca6ef-cc5e-418f-b5a3-acf3a5d38e44\") " pod="openshift-ovn-kubernetes/ovnkube-node-s7vdp"
May 27 23:33:07.280863 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:07.279930    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/1b1ca6ef-cc5e-418f-b5a3-acf3a5d38e44-run-systemd\") pod \"ovnkube-node-s7vdp\" (UID: \"1b1ca6ef-cc5e-418f-b5a3-acf3a5d38e44\") " pod="openshift-ovn-kubernetes/ovnkube-node-s7vdp"
May 27 23:33:07.280863 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:07.279949    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/1b1ca6ef-cc5e-418f-b5a3-acf3a5d38e44-var-lib-openvswitch\") pod \"ovnkube-node-s7vdp\" (UID: \"1b1ca6ef-cc5e-418f-b5a3-acf3a5d38e44\") " pod="openshift-ovn-kubernetes/ovnkube-node-s7vdp"
May 27 23:33:07.280863 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:07.279984    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5069fad8-69ff-40c6-993b-7d41b872d190-multus-cni-dir\") pod \"multus-h2jmf\" (UID: \"5069fad8-69ff-40c6-993b-7d41b872d190\") " pod="openshift-multus/multus-h2jmf"
May 27 23:33:07.280863 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:07.279987    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/74b39582-8199-4302-bd86-7b31f474872b-sys\") pod \"tuned-hdrgr\" (UID: \"74b39582-8199-4302-bd86-7b31f474872b\") " pod="openshift-cluster-node-tuning-operator/tuned-hdrgr"
May 27 23:33:07.280863 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:07.279994    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/1b1ca6ef-cc5e-418f-b5a3-acf3a5d38e44-ovnkube-script-lib\") pod \"ovnkube-node-s7vdp\" (UID: \"1b1ca6ef-cc5e-418f-b5a3-acf3a5d38e44\") " pod="openshift-ovn-kubernetes/ovnkube-node-s7vdp"
May 27 23:33:07.280863 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:07.280008    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/5069fad8-69ff-40c6-993b-7d41b872d190-multus-daemon-config\") pod \"multus-h2jmf\" (UID: \"5069fad8-69ff-40c6-993b-7d41b872d190\") " pod="openshift-multus/multus-h2jmf"
May 27 23:33:07.280863 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:07.280045    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/5069fad8-69ff-40c6-993b-7d41b872d190-host-var-lib-cni-multus\") pod \"multus-h2jmf\" (UID: \"5069fad8-69ff-40c6-993b-7d41b872d190\") " pod="openshift-multus/multus-h2jmf"
May 27 23:33:07.280863 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:07.280050    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/5069fad8-69ff-40c6-993b-7d41b872d190-multus-conf-dir\") pod \"multus-h2jmf\" (UID: \"5069fad8-69ff-40c6-993b-7d41b872d190\") " pod="openshift-multus/multus-h2jmf"
May 27 23:33:07.280863 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:07.280059    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/5069fad8-69ff-40c6-993b-7d41b872d190-hostroot\") pod \"multus-h2jmf\" (UID: \"5069fad8-69ff-40c6-993b-7d41b872d190\") " pod="openshift-multus/multus-h2jmf"
May 27 23:33:07.280863 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:07.280054    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/1b1ca6ef-cc5e-418f-b5a3-acf3a5d38e44-ovnkube-config\") pod \"ovnkube-node-s7vdp\" (UID: \"1b1ca6ef-cc5e-418f-b5a3-acf3a5d38e44\") " pod="openshift-ovn-kubernetes/ovnkube-node-s7vdp"
May 27 23:33:07.280863 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:07.280086    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/85aeda21-db1b-47a0-abe6-9d2036fc6405-iptables-alerter-script\") pod \"iptables-alerter-nh9z4\" (UID: \"85aeda21-db1b-47a0-abe6-9d2036fc6405\") " pod="openshift-network-operator/iptables-alerter-nh9z4"
May 27 23:33:07.280863 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:07.280026    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/5069fad8-69ff-40c6-993b-7d41b872d190-host-run-k8s-cni-cncf-io\") pod \"multus-h2jmf\" (UID: \"5069fad8-69ff-40c6-993b-7d41b872d190\") " pod="openshift-multus/multus-h2jmf"
May 27 23:33:07.280863 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:07.280101    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/74b39582-8199-4302-bd86-7b31f474872b-host\") pod \"tuned-hdrgr\" (UID: \"74b39582-8199-4302-bd86-7b31f474872b\") " pod="openshift-cluster-node-tuning-operator/tuned-hdrgr"
May 27 23:33:07.281703 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:07.280108    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/1b1ca6ef-cc5e-418f-b5a3-acf3a5d38e44-var-lib-openvswitch\") pod \"ovnkube-node-s7vdp\" (UID: \"1b1ca6ef-cc5e-418f-b5a3-acf3a5d38e44\") " pod="openshift-ovn-kubernetes/ovnkube-node-s7vdp"
May 27 23:33:07.281703 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:07.280111    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5069fad8-69ff-40c6-993b-7d41b872d190-multus-cni-dir\") pod \"multus-h2jmf\" (UID: \"5069fad8-69ff-40c6-993b-7d41b872d190\") " pod="openshift-multus/multus-h2jmf"
May 27 23:33:07.281703 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:07.280150    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-qtk58\" (UniqueName: \"kubernetes.io/projected/74b39582-8199-4302-bd86-7b31f474872b-kube-api-access-qtk58\") pod \"tuned-hdrgr\" (UID: \"74b39582-8199-4302-bd86-7b31f474872b\") " pod="openshift-cluster-node-tuning-operator/tuned-hdrgr"
May 27 23:33:07.281703 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:07.280157    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/74b39582-8199-4302-bd86-7b31f474872b-host\") pod \"tuned-hdrgr\" (UID: \"74b39582-8199-4302-bd86-7b31f474872b\") " pod="openshift-cluster-node-tuning-operator/tuned-hdrgr"
May 27 23:33:07.281703 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:07.280157    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/1b1ca6ef-cc5e-418f-b5a3-acf3a5d38e44-host-kubelet\") pod \"ovnkube-node-s7vdp\" (UID: \"1b1ca6ef-cc5e-418f-b5a3-acf3a5d38e44\") " pod="openshift-ovn-kubernetes/ovnkube-node-s7vdp"
May 27 23:33:07.281703 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:07.280174    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-zs4dk\" (UniqueName: \"kubernetes.io/projected/5069fad8-69ff-40c6-993b-7d41b872d190-kube-api-access-zs4dk\") pod \"multus-h2jmf\" (UID: \"5069fad8-69ff-40c6-993b-7d41b872d190\") " pod="openshift-multus/multus-h2jmf"
May 27 23:33:07.281703 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:07.280204    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/1b1ca6ef-cc5e-418f-b5a3-acf3a5d38e44-host-cni-bin\") pod \"ovnkube-node-s7vdp\" (UID: \"1b1ca6ef-cc5e-418f-b5a3-acf3a5d38e44\") " pod="openshift-ovn-kubernetes/ovnkube-node-s7vdp"
May 27 23:33:07.281703 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:07.280263    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/5069fad8-69ff-40c6-993b-7d41b872d190-multus-socket-dir-parent\") pod \"multus-h2jmf\" (UID: \"5069fad8-69ff-40c6-993b-7d41b872d190\") " pod="openshift-multus/multus-h2jmf"
May 27 23:33:07.281703 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:07.280291    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/5069fad8-69ff-40c6-993b-7d41b872d190-host-run-netns\") pod \"multus-h2jmf\" (UID: \"5069fad8-69ff-40c6-993b-7d41b872d190\") " pod="openshift-multus/multus-h2jmf"
May 27 23:33:07.281703 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:07.280334    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/5069fad8-69ff-40c6-993b-7d41b872d190-host-var-lib-kubelet\") pod \"multus-h2jmf\" (UID: \"5069fad8-69ff-40c6-993b-7d41b872d190\") " pod="openshift-multus/multus-h2jmf"
May 27 23:33:07.281703 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:07.280336    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/1b1ca6ef-cc5e-418f-b5a3-acf3a5d38e44-host-cni-bin\") pod \"ovnkube-node-s7vdp\" (UID: \"1b1ca6ef-cc5e-418f-b5a3-acf3a5d38e44\") " pod="openshift-ovn-kubernetes/ovnkube-node-s7vdp"
May 27 23:33:07.281703 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:07.280375    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/1b1ca6ef-cc5e-418f-b5a3-acf3a5d38e44-systemd-units\") pod \"ovnkube-node-s7vdp\" (UID: \"1b1ca6ef-cc5e-418f-b5a3-acf3a5d38e44\") " pod="openshift-ovn-kubernetes/ovnkube-node-s7vdp"
May 27 23:33:07.281703 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:07.280395    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/5069fad8-69ff-40c6-993b-7d41b872d190-multus-socket-dir-parent\") pod \"multus-h2jmf\" (UID: \"5069fad8-69ff-40c6-993b-7d41b872d190\") " pod="openshift-multus/multus-h2jmf"
May 27 23:33:07.281703 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:07.280402    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/74b39582-8199-4302-bd86-7b31f474872b-etc-sysconfig\") pod \"tuned-hdrgr\" (UID: \"74b39582-8199-4302-bd86-7b31f474872b\") " pod="openshift-cluster-node-tuning-operator/tuned-hdrgr"
May 27 23:33:07.281703 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:07.280438    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/74b39582-8199-4302-bd86-7b31f474872b-etc-tuned\") pod \"tuned-hdrgr\" (UID: \"74b39582-8199-4302-bd86-7b31f474872b\") " pod="openshift-cluster-node-tuning-operator/tuned-hdrgr"
May 27 23:33:07.281703 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:07.280443    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/5069fad8-69ff-40c6-993b-7d41b872d190-host-var-lib-kubelet\") pod \"multus-h2jmf\" (UID: \"5069fad8-69ff-40c6-993b-7d41b872d190\") " pod="openshift-multus/multus-h2jmf"
May 27 23:33:07.281703 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:07.280463    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/74b39582-8199-4302-bd86-7b31f474872b-run\") pod \"tuned-hdrgr\" (UID: \"74b39582-8199-4302-bd86-7b31f474872b\") " pod="openshift-cluster-node-tuning-operator/tuned-hdrgr"
May 27 23:33:07.281703 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:07.280485    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/5069fad8-69ff-40c6-993b-7d41b872d190-host-run-netns\") pod \"multus-h2jmf\" (UID: \"5069fad8-69ff-40c6-993b-7d41b872d190\") " pod="openshift-multus/multus-h2jmf"
May 27 23:33:07.282462 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:07.280486    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/74b39582-8199-4302-bd86-7b31f474872b-var-lib-kubelet\") pod \"tuned-hdrgr\" (UID: \"74b39582-8199-4302-bd86-7b31f474872b\") " pod="openshift-cluster-node-tuning-operator/tuned-hdrgr"
May 27 23:33:07.282462 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:07.280512    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/1b1ca6ef-cc5e-418f-b5a3-acf3a5d38e44-systemd-units\") pod \"ovnkube-node-s7vdp\" (UID: \"1b1ca6ef-cc5e-418f-b5a3-acf3a5d38e44\") " pod="openshift-ovn-kubernetes/ovnkube-node-s7vdp"
May 27 23:33:07.282462 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:07.280531    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/74b39582-8199-4302-bd86-7b31f474872b-var-lib-kubelet\") pod \"tuned-hdrgr\" (UID: \"74b39582-8199-4302-bd86-7b31f474872b\") " pod="openshift-cluster-node-tuning-operator/tuned-hdrgr"
May 27 23:33:07.282462 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:07.280522    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/74b39582-8199-4302-bd86-7b31f474872b-tmp\") pod \"tuned-hdrgr\" (UID: \"74b39582-8199-4302-bd86-7b31f474872b\") " pod="openshift-cluster-node-tuning-operator/tuned-hdrgr"
May 27 23:33:07.282462 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:07.280530    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/74b39582-8199-4302-bd86-7b31f474872b-etc-sysconfig\") pod \"tuned-hdrgr\" (UID: \"74b39582-8199-4302-bd86-7b31f474872b\") " pod="openshift-cluster-node-tuning-operator/tuned-hdrgr"
May 27 23:33:07.282462 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:07.280554    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/1b1ca6ef-cc5e-418f-b5a3-acf3a5d38e44-ovnkube-config\") pod \"ovnkube-node-s7vdp\" (UID: \"1b1ca6ef-cc5e-418f-b5a3-acf3a5d38e44\") " pod="openshift-ovn-kubernetes/ovnkube-node-s7vdp"
May 27 23:33:07.282462 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:07.280570    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/74b39582-8199-4302-bd86-7b31f474872b-run\") pod \"tuned-hdrgr\" (UID: \"74b39582-8199-4302-bd86-7b31f474872b\") " pod="openshift-cluster-node-tuning-operator/tuned-hdrgr"
May 27 23:33:07.282462 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:07.280612    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/5069fad8-69ff-40c6-993b-7d41b872d190-multus-daemon-config\") pod \"multus-h2jmf\" (UID: \"5069fad8-69ff-40c6-993b-7d41b872d190\") " pod="openshift-multus/multus-h2jmf"
May 27 23:33:07.282462 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:07.280647    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1b1ca6ef-cc5e-418f-b5a3-acf3a5d38e44-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-s7vdp\" (UID: \"1b1ca6ef-cc5e-418f-b5a3-acf3a5d38e44\") " pod="openshift-ovn-kubernetes/ovnkube-node-s7vdp"
May 27 23:33:07.282462 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:07.280685    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1b1ca6ef-cc5e-418f-b5a3-acf3a5d38e44-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-s7vdp\" (UID: \"1b1ca6ef-cc5e-418f-b5a3-acf3a5d38e44\") " pod="openshift-ovn-kubernetes/ovnkube-node-s7vdp"
May 27 23:33:07.282462 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:07.280691    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/1b1ca6ef-cc5e-418f-b5a3-acf3a5d38e44-env-overrides\") pod \"ovnkube-node-s7vdp\" (UID: \"1b1ca6ef-cc5e-418f-b5a3-acf3a5d38e44\") " pod="openshift-ovn-kubernetes/ovnkube-node-s7vdp"
May 27 23:33:07.282462 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:07.280721    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/74b39582-8199-4302-bd86-7b31f474872b-etc-sysctl-conf\") pod \"tuned-hdrgr\" (UID: \"74b39582-8199-4302-bd86-7b31f474872b\") " pod="openshift-cluster-node-tuning-operator/tuned-hdrgr"
May 27 23:33:07.282462 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:07.280763    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/5069fad8-69ff-40c6-993b-7d41b872d190-cnibin\") pod \"multus-h2jmf\" (UID: \"5069fad8-69ff-40c6-993b-7d41b872d190\") " pod="openshift-multus/multus-h2jmf"
May 27 23:33:07.282462 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:07.280788    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/5069fad8-69ff-40c6-993b-7d41b872d190-cni-binary-copy\") pod \"multus-h2jmf\" (UID: \"5069fad8-69ff-40c6-993b-7d41b872d190\") " pod="openshift-multus/multus-h2jmf"
May 27 23:33:07.282462 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:07.280811    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/1b1ca6ef-cc5e-418f-b5a3-acf3a5d38e44-host-cni-netd\") pod \"ovnkube-node-s7vdp\" (UID: \"1b1ca6ef-cc5e-418f-b5a3-acf3a5d38e44\") " pod="openshift-ovn-kubernetes/ovnkube-node-s7vdp"
May 27 23:33:07.282462 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:07.280837    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5069fad8-69ff-40c6-993b-7d41b872d190-system-cni-dir\") pod \"multus-h2jmf\" (UID: \"5069fad8-69ff-40c6-993b-7d41b872d190\") " pod="openshift-multus/multus-h2jmf"
May 27 23:33:07.282462 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:07.280858    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/1b1ca6ef-cc5e-418f-b5a3-acf3a5d38e44-node-log\") pod \"ovnkube-node-s7vdp\" (UID: \"1b1ca6ef-cc5e-418f-b5a3-acf3a5d38e44\") " pod="openshift-ovn-kubernetes/ovnkube-node-s7vdp"
May 27 23:33:07.282462 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:07.280857    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/5069fad8-69ff-40c6-993b-7d41b872d190-cnibin\") pod \"multus-h2jmf\" (UID: \"5069fad8-69ff-40c6-993b-7d41b872d190\") " pod="openshift-multus/multus-h2jmf"
May 27 23:33:07.283199 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:07.280905    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/1b1ca6ef-cc5e-418f-b5a3-acf3a5d38e44-node-log\") pod \"ovnkube-node-s7vdp\" (UID: \"1b1ca6ef-cc5e-418f-b5a3-acf3a5d38e44\") " pod="openshift-ovn-kubernetes/ovnkube-node-s7vdp"
May 27 23:33:07.283199 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:07.280909    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/74b39582-8199-4302-bd86-7b31f474872b-etc-sysctl-conf\") pod \"tuned-hdrgr\" (UID: \"74b39582-8199-4302-bd86-7b31f474872b\") " pod="openshift-cluster-node-tuning-operator/tuned-hdrgr"
May 27 23:33:07.283199 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:07.280914    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/1b1ca6ef-cc5e-418f-b5a3-acf3a5d38e44-host-cni-netd\") pod \"ovnkube-node-s7vdp\" (UID: \"1b1ca6ef-cc5e-418f-b5a3-acf3a5d38e44\") " pod="openshift-ovn-kubernetes/ovnkube-node-s7vdp"
May 27 23:33:07.283199 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:07.280953    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5069fad8-69ff-40c6-993b-7d41b872d190-system-cni-dir\") pod \"multus-h2jmf\" (UID: \"5069fad8-69ff-40c6-993b-7d41b872d190\") " pod="openshift-multus/multus-h2jmf"
May 27 23:33:07.283199 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:07.280958    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/1b1ca6ef-cc5e-418f-b5a3-acf3a5d38e44-log-socket\") pod \"ovnkube-node-s7vdp\" (UID: \"1b1ca6ef-cc5e-418f-b5a3-acf3a5d38e44\") " pod="openshift-ovn-kubernetes/ovnkube-node-s7vdp"
May 27 23:33:07.283199 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:07.280976    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/1b1ca6ef-cc5e-418f-b5a3-acf3a5d38e44-ovn-node-metrics-cert\") pod \"ovnkube-node-s7vdp\" (UID: \"1b1ca6ef-cc5e-418f-b5a3-acf3a5d38e44\") " pod="openshift-ovn-kubernetes/ovnkube-node-s7vdp"
May 27 23:33:07.283199 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:07.280999    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/471894d3-91bc-4805-914b-a761d2f21f31-konnectivity-ca\") pod \"konnectivity-agent-54c79\" (UID: \"471894d3-91bc-4805-914b-a761d2f21f31\") " pod="kube-system/konnectivity-agent-54c79"
May 27 23:33:07.283199 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:07.281022    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/1b1ca6ef-cc5e-418f-b5a3-acf3a5d38e44-log-socket\") pod \"ovnkube-node-s7vdp\" (UID: \"1b1ca6ef-cc5e-418f-b5a3-acf3a5d38e44\") " pod="openshift-ovn-kubernetes/ovnkube-node-s7vdp"
May 27 23:33:07.283199 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:07.281026    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1b1ca6ef-cc5e-418f-b5a3-acf3a5d38e44-host-run-ovn-kubernetes\") pod \"ovnkube-node-s7vdp\" (UID: \"1b1ca6ef-cc5e-418f-b5a3-acf3a5d38e44\") " pod="openshift-ovn-kubernetes/ovnkube-node-s7vdp"
May 27 23:33:07.283199 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:07.281049    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/1b1ca6ef-cc5e-418f-b5a3-acf3a5d38e44-env-overrides\") pod \"ovnkube-node-s7vdp\" (UID: \"1b1ca6ef-cc5e-418f-b5a3-acf3a5d38e44\") " pod="openshift-ovn-kubernetes/ovnkube-node-s7vdp"
May 27 23:33:07.283199 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:07.281059    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1b1ca6ef-cc5e-418f-b5a3-acf3a5d38e44-host-run-ovn-kubernetes\") pod \"ovnkube-node-s7vdp\" (UID: \"1b1ca6ef-cc5e-418f-b5a3-acf3a5d38e44\") " pod="openshift-ovn-kubernetes/ovnkube-node-s7vdp"
May 27 23:33:07.283199 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:07.281149    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/471894d3-91bc-4805-914b-a761d2f21f31-agent-certs\") pod \"konnectivity-agent-54c79\" (UID: \"471894d3-91bc-4805-914b-a761d2f21f31\") " pod="kube-system/konnectivity-agent-54c79"
May 27 23:33:07.283199 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:07.281194    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/74b39582-8199-4302-bd86-7b31f474872b-etc-kubernetes\") pod \"tuned-hdrgr\" (UID: \"74b39582-8199-4302-bd86-7b31f474872b\") " pod="openshift-cluster-node-tuning-operator/tuned-hdrgr"
May 27 23:33:07.283199 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:07.281218    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/74b39582-8199-4302-bd86-7b31f474872b-etc-systemd\") pod \"tuned-hdrgr\" (UID: \"74b39582-8199-4302-bd86-7b31f474872b\") " pod="openshift-cluster-node-tuning-operator/tuned-hdrgr"
May 27 23:33:07.283199 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:07.281291    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/74b39582-8199-4302-bd86-7b31f474872b-etc-systemd\") pod \"tuned-hdrgr\" (UID: \"74b39582-8199-4302-bd86-7b31f474872b\") " pod="openshift-cluster-node-tuning-operator/tuned-hdrgr"
May 27 23:33:07.283199 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:07.281334    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/74b39582-8199-4302-bd86-7b31f474872b-etc-kubernetes\") pod \"tuned-hdrgr\" (UID: \"74b39582-8199-4302-bd86-7b31f474872b\") " pod="openshift-cluster-node-tuning-operator/tuned-hdrgr"
May 27 23:33:07.283199 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:07.281400    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/5069fad8-69ff-40c6-993b-7d41b872d190-cni-binary-copy\") pod \"multus-h2jmf\" (UID: \"5069fad8-69ff-40c6-993b-7d41b872d190\") " pod="openshift-multus/multus-h2jmf"
May 27 23:33:07.283199 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:07.281781    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/471894d3-91bc-4805-914b-a761d2f21f31-konnectivity-ca\") pod \"konnectivity-agent-54c79\" (UID: \"471894d3-91bc-4805-914b-a761d2f21f31\") " pod="kube-system/konnectivity-agent-54c79"
May 27 23:33:07.284119 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:07.283169    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/74b39582-8199-4302-bd86-7b31f474872b-tmp\") pod \"tuned-hdrgr\" (UID: \"74b39582-8199-4302-bd86-7b31f474872b\") " pod="openshift-cluster-node-tuning-operator/tuned-hdrgr"
May 27 23:33:07.284119 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:07.283369    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/74b39582-8199-4302-bd86-7b31f474872b-etc-tuned\") pod \"tuned-hdrgr\" (UID: \"74b39582-8199-4302-bd86-7b31f474872b\") " pod="openshift-cluster-node-tuning-operator/tuned-hdrgr"
May 27 23:33:07.284119 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:07.283588    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/1b1ca6ef-cc5e-418f-b5a3-acf3a5d38e44-ovn-node-metrics-cert\") pod \"ovnkube-node-s7vdp\" (UID: \"1b1ca6ef-cc5e-418f-b5a3-acf3a5d38e44\") " pod="openshift-ovn-kubernetes/ovnkube-node-s7vdp"
May 27 23:33:07.284119 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:07.283858    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/471894d3-91bc-4805-914b-a761d2f21f31-agent-certs\") pod \"konnectivity-agent-54c79\" (UID: \"471894d3-91bc-4805-914b-a761d2f21f31\") " pod="kube-system/konnectivity-agent-54c79"
May 27 23:33:07.286633 ip-10-0-132-191 kubenswrapper[2557]: E0527 23:33:07.286342    2557 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
May 27 23:33:07.286633 ip-10-0-132-191 kubenswrapper[2557]: E0527 23:33:07.286364    2557 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
May 27 23:33:07.286633 ip-10-0-132-191 kubenswrapper[2557]: E0527 23:33:07.286378    2557 projected.go:194] Error preparing data for projected volume kube-api-access-qzzjd for pod openshift-network-diagnostics/network-check-target-tsxk6: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 27 23:33:07.286633 ip-10-0-132-191 kubenswrapper[2557]: E0527 23:33:07.286454    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4af77c1c-1265-4e74-b12f-28d888f58380-kube-api-access-qzzjd podName:4af77c1c-1265-4e74-b12f-28d888f58380 nodeName:}" failed. No retries permitted until 2026-05-27 23:33:07.786435866 +0000 UTC m=+3.205971880 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-qzzjd" (UniqueName: "kubernetes.io/projected/4af77c1c-1265-4e74-b12f-28d888f58380-kube-api-access-qzzjd") pod "network-check-target-tsxk6" (UID: "4af77c1c-1265-4e74-b12f-28d888f58380") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 27 23:33:07.288597 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:07.288577    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qtk58\" (UniqueName: \"kubernetes.io/projected/74b39582-8199-4302-bd86-7b31f474872b-kube-api-access-qtk58\") pod \"tuned-hdrgr\" (UID: \"74b39582-8199-4302-bd86-7b31f474872b\") " pod="openshift-cluster-node-tuning-operator/tuned-hdrgr"
May 27 23:33:07.288698 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:07.288614    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tjxqv\" (UniqueName: \"kubernetes.io/projected/85aeda21-db1b-47a0-abe6-9d2036fc6405-kube-api-access-tjxqv\") pod \"iptables-alerter-nh9z4\" (UID: \"85aeda21-db1b-47a0-abe6-9d2036fc6405\") " pod="openshift-network-operator/iptables-alerter-nh9z4"
May 27 23:33:07.288820 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:07.288802    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zs4dk\" (UniqueName: \"kubernetes.io/projected/5069fad8-69ff-40c6-993b-7d41b872d190-kube-api-access-zs4dk\") pod \"multus-h2jmf\" (UID: \"5069fad8-69ff-40c6-993b-7d41b872d190\") " pod="openshift-multus/multus-h2jmf"
May 27 23:33:07.288976 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:07.288954    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4clzj\" (UniqueName: \"kubernetes.io/projected/1b1ca6ef-cc5e-418f-b5a3-acf3a5d38e44-kube-api-access-4clzj\") pod \"ovnkube-node-s7vdp\" (UID: \"1b1ca6ef-cc5e-418f-b5a3-acf3a5d38e44\") " pod="openshift-ovn-kubernetes/ovnkube-node-s7vdp"
May 27 23:33:07.372866 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:07.372789    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5sm8c"
May 27 23:33:07.380531 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:07.380506    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-jbbwx"
May 27 23:33:07.391158 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:07.391123    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-6bgmn"
May 27 23:33:07.394684 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:07.394666    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-7p5w7"
May 27 23:33:07.401229 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:07.401204    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-54c79"
May 27 23:33:07.413809 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:07.413785    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-hdrgr"
May 27 23:33:07.419365 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:07.419348    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-h2jmf"
May 27 23:33:07.426918 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:07.426898    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-nh9z4"
May 27 23:33:07.432575 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:07.432557    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-s7vdp"
May 27 23:33:07.683325 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:07.683250    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c4d68b58-b4f3-4f03-a21c-321ca3eebe68-metrics-certs\") pod \"network-metrics-daemon-zvbqn\" (UID: \"c4d68b58-b4f3-4f03-a21c-321ca3eebe68\") " pod="openshift-multus/network-metrics-daemon-zvbqn"
May 27 23:33:07.683491 ip-10-0-132-191 kubenswrapper[2557]: E0527 23:33:07.683411    2557 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
May 27 23:33:07.683491 ip-10-0-132-191 kubenswrapper[2557]: E0527 23:33:07.683483    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c4d68b58-b4f3-4f03-a21c-321ca3eebe68-metrics-certs podName:c4d68b58-b4f3-4f03-a21c-321ca3eebe68 nodeName:}" failed. No retries permitted until 2026-05-27 23:33:08.683464879 +0000 UTC m=+4.103000883 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c4d68b58-b4f3-4f03-a21c-321ca3eebe68-metrics-certs") pod "network-metrics-daemon-zvbqn" (UID: "c4d68b58-b4f3-4f03-a21c-321ca3eebe68") : object "openshift-multus"/"metrics-daemon-secret" not registered
May 27 23:33:07.848669 ip-10-0-132-191 kubenswrapper[2557]: W0527 23:33:07.848639    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod471894d3_91bc_4805_914b_a761d2f21f31.slice/crio-2585945387d0fc052007831dcc2fadbdbcff595473741e4e5ce2078c15c06e81 WatchSource:0}: Error finding container 2585945387d0fc052007831dcc2fadbdbcff595473741e4e5ce2078c15c06e81: Status 404 returned error can't find the container with id 2585945387d0fc052007831dcc2fadbdbcff595473741e4e5ce2078c15c06e81
May 27 23:33:07.850368 ip-10-0-132-191 kubenswrapper[2557]: W0527 23:33:07.850343    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5069fad8_69ff_40c6_993b_7d41b872d190.slice/crio-1d6e96c6d4961e0a9a09b866645fc682d23b2f36c3d1d96139a990cd9305b551 WatchSource:0}: Error finding container 1d6e96c6d4961e0a9a09b866645fc682d23b2f36c3d1d96139a990cd9305b551: Status 404 returned error can't find the container with id 1d6e96c6d4961e0a9a09b866645fc682d23b2f36c3d1d96139a990cd9305b551
May 27 23:33:07.854021 ip-10-0-132-191 kubenswrapper[2557]: W0527 23:33:07.853998    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod74b39582_8199_4302_bd86_7b31f474872b.slice/crio-c1774f11e92f0530f43b131b089530147c490181dc32a955d05a448b6eab3607 WatchSource:0}: Error finding container c1774f11e92f0530f43b131b089530147c490181dc32a955d05a448b6eab3607: Status 404 returned error can't find the container with id c1774f11e92f0530f43b131b089530147c490181dc32a955d05a448b6eab3607
May 27 23:33:07.854935 ip-10-0-132-191 kubenswrapper[2557]: W0527 23:33:07.854891    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1b1ca6ef_cc5e_418f_b5a3_acf3a5d38e44.slice/crio-3fe5b5ffeeb5214c6b1af852f9ff54e8e11cf8fe061f34e6d4dbe6d487baf8da WatchSource:0}: Error finding container 3fe5b5ffeeb5214c6b1af852f9ff54e8e11cf8fe061f34e6d4dbe6d487baf8da: Status 404 returned error can't find the container with id 3fe5b5ffeeb5214c6b1af852f9ff54e8e11cf8fe061f34e6d4dbe6d487baf8da
May 27 23:33:07.855806 ip-10-0-132-191 kubenswrapper[2557]: W0527 23:33:07.855763    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5dce51c2_4758_48af_a087_58d37df3b392.slice/crio-b5c9b134caa89567b64051285899a2a9cf76db0ebbbc650fcaeba52f5ae3b8b9 WatchSource:0}: Error finding container b5c9b134caa89567b64051285899a2a9cf76db0ebbbc650fcaeba52f5ae3b8b9: Status 404 returned error can't find the container with id b5c9b134caa89567b64051285899a2a9cf76db0ebbbc650fcaeba52f5ae3b8b9
May 27 23:33:07.856728 ip-10-0-132-191 kubenswrapper[2557]: W0527 23:33:07.856677    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod85aeda21_db1b_47a0_abe6_9d2036fc6405.slice/crio-90999498d74499dfe07a9d682f411f3909ccc2c675122daf89944940e3dd8694 WatchSource:0}: Error finding container 90999498d74499dfe07a9d682f411f3909ccc2c675122daf89944940e3dd8694: Status 404 returned error can't find the container with id 90999498d74499dfe07a9d682f411f3909ccc2c675122daf89944940e3dd8694
May 27 23:33:07.858766 ip-10-0-132-191 kubenswrapper[2557]: W0527 23:33:07.858590    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod479d4fa9_d4cb_4d0e_82d4_eb0ec77dbc90.slice/crio-9f7ebba32280de47a3f44197cb4ea420311781c68978abd9298036073ea0580c WatchSource:0}: Error finding container 9f7ebba32280de47a3f44197cb4ea420311781c68978abd9298036073ea0580c: Status 404 returned error can't find the container with id 9f7ebba32280de47a3f44197cb4ea420311781c68978abd9298036073ea0580c
May 27 23:33:07.859020 ip-10-0-132-191 kubenswrapper[2557]: W0527 23:33:07.858922    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1a2fc634_3712_40ee_bfce_e8aaee0791f2.slice/crio-5d3596f48b40f2f6d9e853832c0692eb7cb2a331d540c08a5d5d122666aa11ff WatchSource:0}: Error finding container 5d3596f48b40f2f6d9e853832c0692eb7cb2a331d540c08a5d5d122666aa11ff: Status 404 returned error can't find the container with id 5d3596f48b40f2f6d9e853832c0692eb7cb2a331d540c08a5d5d122666aa11ff
May 27 23:33:07.860105 ip-10-0-132-191 kubenswrapper[2557]: W0527 23:33:07.859868    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9d47bc2b_bc9c_4887_99e0_c05ffb6c8d0b.slice/crio-e3ba66895c3899eab7d45db8afa66e396d9ab9df68b9e600031ed79e1a7a3b28 WatchSource:0}: Error finding container e3ba66895c3899eab7d45db8afa66e396d9ab9df68b9e600031ed79e1a7a3b28: Status 404 returned error can't find the container with id e3ba66895c3899eab7d45db8afa66e396d9ab9df68b9e600031ed79e1a7a3b28
May 27 23:33:07.884748 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:07.884730    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-qzzjd\" (UniqueName: \"kubernetes.io/projected/4af77c1c-1265-4e74-b12f-28d888f58380-kube-api-access-qzzjd\") pod \"network-check-target-tsxk6\" (UID: \"4af77c1c-1265-4e74-b12f-28d888f58380\") " pod="openshift-network-diagnostics/network-check-target-tsxk6"
May 27 23:33:07.884886 ip-10-0-132-191 kubenswrapper[2557]: E0527 23:33:07.884871    2557 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
May 27 23:33:07.884928 ip-10-0-132-191 kubenswrapper[2557]: E0527 23:33:07.884889    2557 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
May 27 23:33:07.884928 ip-10-0-132-191 kubenswrapper[2557]: E0527 23:33:07.884899    2557 projected.go:194] Error preparing data for projected volume kube-api-access-qzzjd for pod openshift-network-diagnostics/network-check-target-tsxk6: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 27 23:33:07.884989 ip-10-0-132-191 kubenswrapper[2557]: E0527 23:33:07.884940    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4af77c1c-1265-4e74-b12f-28d888f58380-kube-api-access-qzzjd podName:4af77c1c-1265-4e74-b12f-28d888f58380 nodeName:}" failed. No retries permitted until 2026-05-27 23:33:08.884925831 +0000 UTC m=+4.304461821 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-qzzjd" (UniqueName: "kubernetes.io/projected/4af77c1c-1265-4e74-b12f-28d888f58380-kube-api-access-qzzjd") pod "network-check-target-tsxk6" (UID: "4af77c1c-1265-4e74-b12f-28d888f58380") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 27 23:33:08.112509 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:08.112274    2557 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-05-26 23:28:06 +0000 UTC" deadline="2028-02-13 13:27:24.113759654 +0000 UTC"
May 27 23:33:08.112509 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:08.112507    2557 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15037h54m16.001256713s"
May 27 23:33:08.198224 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:08.198200    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zvbqn"
May 27 23:33:08.198334 ip-10-0-132-191 kubenswrapper[2557]: E0527 23:33:08.198311    2557 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zvbqn" podUID="c4d68b58-b4f3-4f03-a21c-321ca3eebe68"
May 27 23:33:08.206172 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:08.206094    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-54c79" event={"ID":"471894d3-91bc-4805-914b-a761d2f21f31","Type":"ContainerStarted","Data":"2585945387d0fc052007831dcc2fadbdbcff595473741e4e5ce2078c15c06e81"}
May 27 23:33:08.208421 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:08.208389    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-191.ec2.internal" event={"ID":"af860e09fcfbe100abf198b53983e8cd","Type":"ContainerStarted","Data":"3650abd9f18e400b955e98080e02cb4986dcee873907cb820a5e3ce19524971f"}
May 27 23:33:08.209463 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:08.209437    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-6bgmn" event={"ID":"479d4fa9-d4cb-4d0e-82d4-eb0ec77dbc90","Type":"ContainerStarted","Data":"9f7ebba32280de47a3f44197cb4ea420311781c68978abd9298036073ea0580c"}
May 27 23:33:08.210169 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:08.210140    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-nh9z4" event={"ID":"85aeda21-db1b-47a0-abe6-9d2036fc6405","Type":"ContainerStarted","Data":"90999498d74499dfe07a9d682f411f3909ccc2c675122daf89944940e3dd8694"}
May 27 23:33:08.210966 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:08.210941    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-s7vdp" event={"ID":"1b1ca6ef-cc5e-418f-b5a3-acf3a5d38e44","Type":"ContainerStarted","Data":"3fe5b5ffeeb5214c6b1af852f9ff54e8e11cf8fe061f34e6d4dbe6d487baf8da"}
May 27 23:33:08.211787 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:08.211769    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-h2jmf" event={"ID":"5069fad8-69ff-40c6-993b-7d41b872d190","Type":"ContainerStarted","Data":"1d6e96c6d4961e0a9a09b866645fc682d23b2f36c3d1d96139a990cd9305b551"}
May 27 23:33:08.213005 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:08.212983    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-191.ec2.internal" event={"ID":"25522b04fdc0994697c03f613fe7f724","Type":"ContainerStarted","Data":"931c91d2dc8536c7238bd9b8728789c38468e1b1b8e421219c18020ae6654d50"}
May 27 23:33:08.213772 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:08.213752    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-jbbwx" event={"ID":"9d47bc2b-bc9c-4887-99e0-c05ffb6c8d0b","Type":"ContainerStarted","Data":"e3ba66895c3899eab7d45db8afa66e396d9ab9df68b9e600031ed79e1a7a3b28"}
May 27 23:33:08.214419 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:08.214398    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-7p5w7" event={"ID":"1a2fc634-3712-40ee-bfce-e8aaee0791f2","Type":"ContainerStarted","Data":"5d3596f48b40f2f6d9e853832c0692eb7cb2a331d540c08a5d5d122666aa11ff"}
May 27 23:33:08.214963 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:08.214947    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5sm8c" event={"ID":"5dce51c2-4758-48af-a087-58d37df3b392","Type":"ContainerStarted","Data":"b5c9b134caa89567b64051285899a2a9cf76db0ebbbc650fcaeba52f5ae3b8b9"}
May 27 23:33:08.215588 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:08.215572    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-hdrgr" event={"ID":"74b39582-8199-4302-bd86-7b31f474872b","Type":"ContainerStarted","Data":"c1774f11e92f0530f43b131b089530147c490181dc32a955d05a448b6eab3607"}
May 27 23:33:08.694462 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:08.693824    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c4d68b58-b4f3-4f03-a21c-321ca3eebe68-metrics-certs\") pod \"network-metrics-daemon-zvbqn\" (UID: \"c4d68b58-b4f3-4f03-a21c-321ca3eebe68\") " pod="openshift-multus/network-metrics-daemon-zvbqn"
May 27 23:33:08.694462 ip-10-0-132-191 kubenswrapper[2557]: E0527 23:33:08.694013    2557 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
May 27 23:33:08.694462 ip-10-0-132-191 kubenswrapper[2557]: E0527 23:33:08.694078    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c4d68b58-b4f3-4f03-a21c-321ca3eebe68-metrics-certs podName:c4d68b58-b4f3-4f03-a21c-321ca3eebe68 nodeName:}" failed. No retries permitted until 2026-05-27 23:33:10.694058872 +0000 UTC m=+6.113594867 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c4d68b58-b4f3-4f03-a21c-321ca3eebe68-metrics-certs") pod "network-metrics-daemon-zvbqn" (UID: "c4d68b58-b4f3-4f03-a21c-321ca3eebe68") : object "openshift-multus"/"metrics-daemon-secret" not registered
May 27 23:33:08.895903 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:08.895255    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-qzzjd\" (UniqueName: \"kubernetes.io/projected/4af77c1c-1265-4e74-b12f-28d888f58380-kube-api-access-qzzjd\") pod \"network-check-target-tsxk6\" (UID: \"4af77c1c-1265-4e74-b12f-28d888f58380\") " pod="openshift-network-diagnostics/network-check-target-tsxk6"
May 27 23:33:08.895903 ip-10-0-132-191 kubenswrapper[2557]: E0527 23:33:08.895468    2557 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
May 27 23:33:08.895903 ip-10-0-132-191 kubenswrapper[2557]: E0527 23:33:08.895490    2557 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
May 27 23:33:08.895903 ip-10-0-132-191 kubenswrapper[2557]: E0527 23:33:08.895503    2557 projected.go:194] Error preparing data for projected volume kube-api-access-qzzjd for pod openshift-network-diagnostics/network-check-target-tsxk6: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 27 23:33:08.895903 ip-10-0-132-191 kubenswrapper[2557]: E0527 23:33:08.895563    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4af77c1c-1265-4e74-b12f-28d888f58380-kube-api-access-qzzjd podName:4af77c1c-1265-4e74-b12f-28d888f58380 nodeName:}" failed. No retries permitted until 2026-05-27 23:33:10.895544776 +0000 UTC m=+6.315080784 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-qzzjd" (UniqueName: "kubernetes.io/projected/4af77c1c-1265-4e74-b12f-28d888f58380-kube-api-access-qzzjd") pod "network-check-target-tsxk6" (UID: "4af77c1c-1265-4e74-b12f-28d888f58380") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 27 23:33:09.198170 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:09.198139    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tsxk6"
May 27 23:33:09.198697 ip-10-0-132-191 kubenswrapper[2557]: E0527 23:33:09.198269    2557 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tsxk6" podUID="4af77c1c-1265-4e74-b12f-28d888f58380"
May 27 23:33:09.226994 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:09.226955    2557 generic.go:358] "Generic (PLEG): container finished" podID="af860e09fcfbe100abf198b53983e8cd" containerID="3650abd9f18e400b955e98080e02cb4986dcee873907cb820a5e3ce19524971f" exitCode=0
May 27 23:33:09.227238 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:09.227218    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-191.ec2.internal" event={"ID":"af860e09fcfbe100abf198b53983e8cd","Type":"ContainerDied","Data":"3650abd9f18e400b955e98080e02cb4986dcee873907cb820a5e3ce19524971f"}
May 27 23:33:09.242991 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:09.242943    2557 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-191.ec2.internal" podStartSLOduration=3.242922851 podStartE2EDuration="3.242922851s" podCreationTimestamp="2026-05-27 23:33:06 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-27 23:33:08.234777661 +0000 UTC m=+3.654313699" watchObservedRunningTime="2026-05-27 23:33:09.242922851 +0000 UTC m=+4.662458864"
May 27 23:33:09.463270 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:09.463241    2557 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kube-system/global-pull-secret-syncer-gz67s"]
May 27 23:33:09.467098 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:09.467076    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gz67s"
May 27 23:33:09.467224 ip-10-0-132-191 kubenswrapper[2557]: E0527 23:33:09.467168    2557 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gz67s" podUID="c2d45389-8733-498a-a898-6cc40f57fbac"
May 27 23:33:09.500270 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:09.500238    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/c2d45389-8733-498a-a898-6cc40f57fbac-kubelet-config\") pod \"global-pull-secret-syncer-gz67s\" (UID: \"c2d45389-8733-498a-a898-6cc40f57fbac\") " pod="kube-system/global-pull-secret-syncer-gz67s"
May 27 23:33:09.500433 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:09.500278    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/c2d45389-8733-498a-a898-6cc40f57fbac-dbus\") pod \"global-pull-secret-syncer-gz67s\" (UID: \"c2d45389-8733-498a-a898-6cc40f57fbac\") " pod="kube-system/global-pull-secret-syncer-gz67s"
May 27 23:33:09.500433 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:09.500333    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c2d45389-8733-498a-a898-6cc40f57fbac-original-pull-secret\") pod \"global-pull-secret-syncer-gz67s\" (UID: \"c2d45389-8733-498a-a898-6cc40f57fbac\") " pod="kube-system/global-pull-secret-syncer-gz67s"
May 27 23:33:09.601543 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:09.600878    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c2d45389-8733-498a-a898-6cc40f57fbac-original-pull-secret\") pod \"global-pull-secret-syncer-gz67s\" (UID: \"c2d45389-8733-498a-a898-6cc40f57fbac\") " pod="kube-system/global-pull-secret-syncer-gz67s"
May 27 23:33:09.601543 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:09.600969    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/c2d45389-8733-498a-a898-6cc40f57fbac-kubelet-config\") pod \"global-pull-secret-syncer-gz67s\" (UID: \"c2d45389-8733-498a-a898-6cc40f57fbac\") " pod="kube-system/global-pull-secret-syncer-gz67s"
May 27 23:33:09.601543 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:09.600994    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/c2d45389-8733-498a-a898-6cc40f57fbac-dbus\") pod \"global-pull-secret-syncer-gz67s\" (UID: \"c2d45389-8733-498a-a898-6cc40f57fbac\") " pod="kube-system/global-pull-secret-syncer-gz67s"
May 27 23:33:09.601543 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:09.601232    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/c2d45389-8733-498a-a898-6cc40f57fbac-dbus\") pod \"global-pull-secret-syncer-gz67s\" (UID: \"c2d45389-8733-498a-a898-6cc40f57fbac\") " pod="kube-system/global-pull-secret-syncer-gz67s"
May 27 23:33:09.601543 ip-10-0-132-191 kubenswrapper[2557]: E0527 23:33:09.601251    2557 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
May 27 23:33:09.601543 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:09.601299    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/c2d45389-8733-498a-a898-6cc40f57fbac-kubelet-config\") pod \"global-pull-secret-syncer-gz67s\" (UID: \"c2d45389-8733-498a-a898-6cc40f57fbac\") " pod="kube-system/global-pull-secret-syncer-gz67s"
May 27 23:33:09.601543 ip-10-0-132-191 kubenswrapper[2557]: E0527 23:33:09.601323    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c2d45389-8733-498a-a898-6cc40f57fbac-original-pull-secret podName:c2d45389-8733-498a-a898-6cc40f57fbac nodeName:}" failed. No retries permitted until 2026-05-27 23:33:10.101302247 +0000 UTC m=+5.520838243 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/c2d45389-8733-498a-a898-6cc40f57fbac-original-pull-secret") pod "global-pull-secret-syncer-gz67s" (UID: "c2d45389-8733-498a-a898-6cc40f57fbac") : object "kube-system"/"original-pull-secret" not registered
May 27 23:33:10.105703 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:10.105665    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c2d45389-8733-498a-a898-6cc40f57fbac-original-pull-secret\") pod \"global-pull-secret-syncer-gz67s\" (UID: \"c2d45389-8733-498a-a898-6cc40f57fbac\") " pod="kube-system/global-pull-secret-syncer-gz67s"
May 27 23:33:10.105884 ip-10-0-132-191 kubenswrapper[2557]: E0527 23:33:10.105823    2557 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
May 27 23:33:10.105946 ip-10-0-132-191 kubenswrapper[2557]: E0527 23:33:10.105908    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c2d45389-8733-498a-a898-6cc40f57fbac-original-pull-secret podName:c2d45389-8733-498a-a898-6cc40f57fbac nodeName:}" failed. No retries permitted until 2026-05-27 23:33:11.105888876 +0000 UTC m=+6.525424871 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/c2d45389-8733-498a-a898-6cc40f57fbac-original-pull-secret") pod "global-pull-secret-syncer-gz67s" (UID: "c2d45389-8733-498a-a898-6cc40f57fbac") : object "kube-system"/"original-pull-secret" not registered
May 27 23:33:10.199623 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:10.199098    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zvbqn"
May 27 23:33:10.199623 ip-10-0-132-191 kubenswrapper[2557]: E0527 23:33:10.199264    2557 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zvbqn" podUID="c4d68b58-b4f3-4f03-a21c-321ca3eebe68"
May 27 23:33:10.245385 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:10.245349    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-191.ec2.internal" event={"ID":"af860e09fcfbe100abf198b53983e8cd","Type":"ContainerStarted","Data":"c9afb194d990917781819f55e594b1cbb4733fad95945f590c063ceabf669360"}
May 27 23:33:10.712042 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:10.711916    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c4d68b58-b4f3-4f03-a21c-321ca3eebe68-metrics-certs\") pod \"network-metrics-daemon-zvbqn\" (UID: \"c4d68b58-b4f3-4f03-a21c-321ca3eebe68\") " pod="openshift-multus/network-metrics-daemon-zvbqn"
May 27 23:33:10.712235 ip-10-0-132-191 kubenswrapper[2557]: E0527 23:33:10.712108    2557 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
May 27 23:33:10.712235 ip-10-0-132-191 kubenswrapper[2557]: E0527 23:33:10.712196    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c4d68b58-b4f3-4f03-a21c-321ca3eebe68-metrics-certs podName:c4d68b58-b4f3-4f03-a21c-321ca3eebe68 nodeName:}" failed. No retries permitted until 2026-05-27 23:33:14.712179156 +0000 UTC m=+10.131715146 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c4d68b58-b4f3-4f03-a21c-321ca3eebe68-metrics-certs") pod "network-metrics-daemon-zvbqn" (UID: "c4d68b58-b4f3-4f03-a21c-321ca3eebe68") : object "openshift-multus"/"metrics-daemon-secret" not registered
May 27 23:33:10.913048 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:10.913001    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-qzzjd\" (UniqueName: \"kubernetes.io/projected/4af77c1c-1265-4e74-b12f-28d888f58380-kube-api-access-qzzjd\") pod \"network-check-target-tsxk6\" (UID: \"4af77c1c-1265-4e74-b12f-28d888f58380\") " pod="openshift-network-diagnostics/network-check-target-tsxk6"
May 27 23:33:10.913276 ip-10-0-132-191 kubenswrapper[2557]: E0527 23:33:10.913249    2557 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
May 27 23:33:10.913351 ip-10-0-132-191 kubenswrapper[2557]: E0527 23:33:10.913284    2557 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
May 27 23:33:10.913351 ip-10-0-132-191 kubenswrapper[2557]: E0527 23:33:10.913298    2557 projected.go:194] Error preparing data for projected volume kube-api-access-qzzjd for pod openshift-network-diagnostics/network-check-target-tsxk6: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 27 23:33:10.913454 ip-10-0-132-191 kubenswrapper[2557]: E0527 23:33:10.913366    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4af77c1c-1265-4e74-b12f-28d888f58380-kube-api-access-qzzjd podName:4af77c1c-1265-4e74-b12f-28d888f58380 nodeName:}" failed. No retries permitted until 2026-05-27 23:33:14.913348706 +0000 UTC m=+10.332884709 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-qzzjd" (UniqueName: "kubernetes.io/projected/4af77c1c-1265-4e74-b12f-28d888f58380-kube-api-access-qzzjd") pod "network-check-target-tsxk6" (UID: "4af77c1c-1265-4e74-b12f-28d888f58380") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 27 23:33:11.115112 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:11.115069    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c2d45389-8733-498a-a898-6cc40f57fbac-original-pull-secret\") pod \"global-pull-secret-syncer-gz67s\" (UID: \"c2d45389-8733-498a-a898-6cc40f57fbac\") " pod="kube-system/global-pull-secret-syncer-gz67s"
May 27 23:33:11.115316 ip-10-0-132-191 kubenswrapper[2557]: E0527 23:33:11.115304    2557 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
May 27 23:33:11.115386 ip-10-0-132-191 kubenswrapper[2557]: E0527 23:33:11.115370    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c2d45389-8733-498a-a898-6cc40f57fbac-original-pull-secret podName:c2d45389-8733-498a-a898-6cc40f57fbac nodeName:}" failed. No retries permitted until 2026-05-27 23:33:13.115350799 +0000 UTC m=+8.534886789 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/c2d45389-8733-498a-a898-6cc40f57fbac-original-pull-secret") pod "global-pull-secret-syncer-gz67s" (UID: "c2d45389-8733-498a-a898-6cc40f57fbac") : object "kube-system"/"original-pull-secret" not registered
May 27 23:33:11.199297 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:11.199245    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gz67s"
May 27 23:33:11.199481 ip-10-0-132-191 kubenswrapper[2557]: E0527 23:33:11.199375    2557 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gz67s" podUID="c2d45389-8733-498a-a898-6cc40f57fbac"
May 27 23:33:11.200348 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:11.199928    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tsxk6"
May 27 23:33:11.200348 ip-10-0-132-191 kubenswrapper[2557]: E0527 23:33:11.200039    2557 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tsxk6" podUID="4af77c1c-1265-4e74-b12f-28d888f58380"
May 27 23:33:12.199014 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:12.198600    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zvbqn"
May 27 23:33:12.199014 ip-10-0-132-191 kubenswrapper[2557]: E0527 23:33:12.198822    2557 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zvbqn" podUID="c4d68b58-b4f3-4f03-a21c-321ca3eebe68"
May 27 23:33:13.133116 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:13.133039    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c2d45389-8733-498a-a898-6cc40f57fbac-original-pull-secret\") pod \"global-pull-secret-syncer-gz67s\" (UID: \"c2d45389-8733-498a-a898-6cc40f57fbac\") " pod="kube-system/global-pull-secret-syncer-gz67s"
May 27 23:33:13.133538 ip-10-0-132-191 kubenswrapper[2557]: E0527 23:33:13.133214    2557 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
May 27 23:33:13.133538 ip-10-0-132-191 kubenswrapper[2557]: E0527 23:33:13.133293    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c2d45389-8733-498a-a898-6cc40f57fbac-original-pull-secret podName:c2d45389-8733-498a-a898-6cc40f57fbac nodeName:}" failed. No retries permitted until 2026-05-27 23:33:17.133271748 +0000 UTC m=+12.552807741 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/c2d45389-8733-498a-a898-6cc40f57fbac-original-pull-secret") pod "global-pull-secret-syncer-gz67s" (UID: "c2d45389-8733-498a-a898-6cc40f57fbac") : object "kube-system"/"original-pull-secret" not registered
May 27 23:33:13.198548 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:13.198514    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gz67s"
May 27 23:33:13.198718 ip-10-0-132-191 kubenswrapper[2557]: E0527 23:33:13.198639    2557 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gz67s" podUID="c2d45389-8733-498a-a898-6cc40f57fbac"
May 27 23:33:13.198874 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:13.198851    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tsxk6"
May 27 23:33:13.198980 ip-10-0-132-191 kubenswrapper[2557]: E0527 23:33:13.198957    2557 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tsxk6" podUID="4af77c1c-1265-4e74-b12f-28d888f58380"
May 27 23:33:14.198876 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:14.198843    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zvbqn"
May 27 23:33:14.199376 ip-10-0-132-191 kubenswrapper[2557]: E0527 23:33:14.198980    2557 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zvbqn" podUID="c4d68b58-b4f3-4f03-a21c-321ca3eebe68"
May 27 23:33:14.747477 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:14.747435    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c4d68b58-b4f3-4f03-a21c-321ca3eebe68-metrics-certs\") pod \"network-metrics-daemon-zvbqn\" (UID: \"c4d68b58-b4f3-4f03-a21c-321ca3eebe68\") " pod="openshift-multus/network-metrics-daemon-zvbqn"
May 27 23:33:14.747657 ip-10-0-132-191 kubenswrapper[2557]: E0527 23:33:14.747618    2557 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
May 27 23:33:14.747733 ip-10-0-132-191 kubenswrapper[2557]: E0527 23:33:14.747681    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c4d68b58-b4f3-4f03-a21c-321ca3eebe68-metrics-certs podName:c4d68b58-b4f3-4f03-a21c-321ca3eebe68 nodeName:}" failed. No retries permitted until 2026-05-27 23:33:22.747663078 +0000 UTC m=+18.167199071 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c4d68b58-b4f3-4f03-a21c-321ca3eebe68-metrics-certs") pod "network-metrics-daemon-zvbqn" (UID: "c4d68b58-b4f3-4f03-a21c-321ca3eebe68") : object "openshift-multus"/"metrics-daemon-secret" not registered
May 27 23:33:14.949151 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:14.949043    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-qzzjd\" (UniqueName: \"kubernetes.io/projected/4af77c1c-1265-4e74-b12f-28d888f58380-kube-api-access-qzzjd\") pod \"network-check-target-tsxk6\" (UID: \"4af77c1c-1265-4e74-b12f-28d888f58380\") " pod="openshift-network-diagnostics/network-check-target-tsxk6"
May 27 23:33:14.949314 ip-10-0-132-191 kubenswrapper[2557]: E0527 23:33:14.949258    2557 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
May 27 23:33:14.949314 ip-10-0-132-191 kubenswrapper[2557]: E0527 23:33:14.949283    2557 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
May 27 23:33:14.949314 ip-10-0-132-191 kubenswrapper[2557]: E0527 23:33:14.949298    2557 projected.go:194] Error preparing data for projected volume kube-api-access-qzzjd for pod openshift-network-diagnostics/network-check-target-tsxk6: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 27 23:33:14.949478 ip-10-0-132-191 kubenswrapper[2557]: E0527 23:33:14.949392    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4af77c1c-1265-4e74-b12f-28d888f58380-kube-api-access-qzzjd podName:4af77c1c-1265-4e74-b12f-28d888f58380 nodeName:}" failed. No retries permitted until 2026-05-27 23:33:22.94937226 +0000 UTC m=+18.368908252 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-qzzjd" (UniqueName: "kubernetes.io/projected/4af77c1c-1265-4e74-b12f-28d888f58380-kube-api-access-qzzjd") pod "network-check-target-tsxk6" (UID: "4af77c1c-1265-4e74-b12f-28d888f58380") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 27 23:33:15.200261 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:15.199774    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tsxk6"
May 27 23:33:15.200261 ip-10-0-132-191 kubenswrapper[2557]: E0527 23:33:15.199884    2557 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tsxk6" podUID="4af77c1c-1265-4e74-b12f-28d888f58380"
May 27 23:33:15.200261 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:15.199975    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gz67s"
May 27 23:33:15.200261 ip-10-0-132-191 kubenswrapper[2557]: E0527 23:33:15.200089    2557 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gz67s" podUID="c2d45389-8733-498a-a898-6cc40f57fbac"
May 27 23:33:16.199074 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:16.199031    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zvbqn"
May 27 23:33:16.199271 ip-10-0-132-191 kubenswrapper[2557]: E0527 23:33:16.199186    2557 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zvbqn" podUID="c4d68b58-b4f3-4f03-a21c-321ca3eebe68"
May 27 23:33:17.166327 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:17.166284    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c2d45389-8733-498a-a898-6cc40f57fbac-original-pull-secret\") pod \"global-pull-secret-syncer-gz67s\" (UID: \"c2d45389-8733-498a-a898-6cc40f57fbac\") " pod="kube-system/global-pull-secret-syncer-gz67s"
May 27 23:33:17.166793 ip-10-0-132-191 kubenswrapper[2557]: E0527 23:33:17.166446    2557 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
May 27 23:33:17.166793 ip-10-0-132-191 kubenswrapper[2557]: E0527 23:33:17.166526    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c2d45389-8733-498a-a898-6cc40f57fbac-original-pull-secret podName:c2d45389-8733-498a-a898-6cc40f57fbac nodeName:}" failed. No retries permitted until 2026-05-27 23:33:25.166504142 +0000 UTC m=+20.586040133 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/c2d45389-8733-498a-a898-6cc40f57fbac-original-pull-secret") pod "global-pull-secret-syncer-gz67s" (UID: "c2d45389-8733-498a-a898-6cc40f57fbac") : object "kube-system"/"original-pull-secret" not registered
May 27 23:33:17.198420 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:17.198325    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gz67s"
May 27 23:33:17.198560 ip-10-0-132-191 kubenswrapper[2557]: E0527 23:33:17.198457    2557 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gz67s" podUID="c2d45389-8733-498a-a898-6cc40f57fbac"
May 27 23:33:17.198560 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:17.198521    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tsxk6"
May 27 23:33:17.198676 ip-10-0-132-191 kubenswrapper[2557]: E0527 23:33:17.198616    2557 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tsxk6" podUID="4af77c1c-1265-4e74-b12f-28d888f58380"
May 27 23:33:18.198745 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:18.198710    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zvbqn"
May 27 23:33:18.199177 ip-10-0-132-191 kubenswrapper[2557]: E0527 23:33:18.198826    2557 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zvbqn" podUID="c4d68b58-b4f3-4f03-a21c-321ca3eebe68"
May 27 23:33:19.198619 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:19.198587    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tsxk6"
May 27 23:33:19.198805 ip-10-0-132-191 kubenswrapper[2557]: E0527 23:33:19.198715    2557 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tsxk6" podUID="4af77c1c-1265-4e74-b12f-28d888f58380"
May 27 23:33:19.198805 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:19.198777    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gz67s"
May 27 23:33:19.199199 ip-10-0-132-191 kubenswrapper[2557]: E0527 23:33:19.198893    2557 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gz67s" podUID="c2d45389-8733-498a-a898-6cc40f57fbac"
May 27 23:33:20.198398 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:20.198364    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zvbqn"
May 27 23:33:20.198582 ip-10-0-132-191 kubenswrapper[2557]: E0527 23:33:20.198499    2557 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zvbqn" podUID="c4d68b58-b4f3-4f03-a21c-321ca3eebe68"
May 27 23:33:21.198255 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:21.198212    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tsxk6"
May 27 23:33:21.198704 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:21.198217    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gz67s"
May 27 23:33:21.198704 ip-10-0-132-191 kubenswrapper[2557]: E0527 23:33:21.198352    2557 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tsxk6" podUID="4af77c1c-1265-4e74-b12f-28d888f58380"
May 27 23:33:21.198704 ip-10-0-132-191 kubenswrapper[2557]: E0527 23:33:21.198467    2557 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gz67s" podUID="c2d45389-8733-498a-a898-6cc40f57fbac"
May 27 23:33:22.198365 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:22.198338    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zvbqn"
May 27 23:33:22.198729 ip-10-0-132-191 kubenswrapper[2557]: E0527 23:33:22.198441    2557 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zvbqn" podUID="c4d68b58-b4f3-4f03-a21c-321ca3eebe68"
May 27 23:33:22.807942 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:22.807897    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c4d68b58-b4f3-4f03-a21c-321ca3eebe68-metrics-certs\") pod \"network-metrics-daemon-zvbqn\" (UID: \"c4d68b58-b4f3-4f03-a21c-321ca3eebe68\") " pod="openshift-multus/network-metrics-daemon-zvbqn"
May 27 23:33:22.808109 ip-10-0-132-191 kubenswrapper[2557]: E0527 23:33:22.808073    2557 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
May 27 23:33:22.808176 ip-10-0-132-191 kubenswrapper[2557]: E0527 23:33:22.808165    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c4d68b58-b4f3-4f03-a21c-321ca3eebe68-metrics-certs podName:c4d68b58-b4f3-4f03-a21c-321ca3eebe68 nodeName:}" failed. No retries permitted until 2026-05-27 23:33:38.808144029 +0000 UTC m=+34.227680037 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c4d68b58-b4f3-4f03-a21c-321ca3eebe68-metrics-certs") pod "network-metrics-daemon-zvbqn" (UID: "c4d68b58-b4f3-4f03-a21c-321ca3eebe68") : object "openshift-multus"/"metrics-daemon-secret" not registered
May 27 23:33:23.009557 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:23.009517    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-qzzjd\" (UniqueName: \"kubernetes.io/projected/4af77c1c-1265-4e74-b12f-28d888f58380-kube-api-access-qzzjd\") pod \"network-check-target-tsxk6\" (UID: \"4af77c1c-1265-4e74-b12f-28d888f58380\") " pod="openshift-network-diagnostics/network-check-target-tsxk6"
May 27 23:33:23.009727 ip-10-0-132-191 kubenswrapper[2557]: E0527 23:33:23.009656    2557 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
May 27 23:33:23.009727 ip-10-0-132-191 kubenswrapper[2557]: E0527 23:33:23.009672    2557 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
May 27 23:33:23.009727 ip-10-0-132-191 kubenswrapper[2557]: E0527 23:33:23.009681    2557 projected.go:194] Error preparing data for projected volume kube-api-access-qzzjd for pod openshift-network-diagnostics/network-check-target-tsxk6: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 27 23:33:23.009859 ip-10-0-132-191 kubenswrapper[2557]: E0527 23:33:23.009735    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4af77c1c-1265-4e74-b12f-28d888f58380-kube-api-access-qzzjd podName:4af77c1c-1265-4e74-b12f-28d888f58380 nodeName:}" failed. No retries permitted until 2026-05-27 23:33:39.009718718 +0000 UTC m=+34.429254708 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-qzzjd" (UniqueName: "kubernetes.io/projected/4af77c1c-1265-4e74-b12f-28d888f58380-kube-api-access-qzzjd") pod "network-check-target-tsxk6" (UID: "4af77c1c-1265-4e74-b12f-28d888f58380") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 27 23:33:23.198857 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:23.198817    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tsxk6"
May 27 23:33:23.199336 ip-10-0-132-191 kubenswrapper[2557]: E0527 23:33:23.198954    2557 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tsxk6" podUID="4af77c1c-1265-4e74-b12f-28d888f58380"
May 27 23:33:23.199336 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:23.199000    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gz67s"
May 27 23:33:23.199336 ip-10-0-132-191 kubenswrapper[2557]: E0527 23:33:23.199105    2557 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gz67s" podUID="c2d45389-8733-498a-a898-6cc40f57fbac"
May 27 23:33:24.198261 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:24.198225    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zvbqn"
May 27 23:33:24.198446 ip-10-0-132-191 kubenswrapper[2557]: E0527 23:33:24.198377    2557 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zvbqn" podUID="c4d68b58-b4f3-4f03-a21c-321ca3eebe68"
May 27 23:33:25.198961 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:25.198921    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tsxk6"
May 27 23:33:25.199427 ip-10-0-132-191 kubenswrapper[2557]: E0527 23:33:25.199016    2557 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tsxk6" podUID="4af77c1c-1265-4e74-b12f-28d888f58380"
May 27 23:33:25.199427 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:25.199421    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gz67s"
May 27 23:33:25.199542 ip-10-0-132-191 kubenswrapper[2557]: E0527 23:33:25.199525    2557 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gz67s" podUID="c2d45389-8733-498a-a898-6cc40f57fbac"
May 27 23:33:25.228345 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:25.228314    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c2d45389-8733-498a-a898-6cc40f57fbac-original-pull-secret\") pod \"global-pull-secret-syncer-gz67s\" (UID: \"c2d45389-8733-498a-a898-6cc40f57fbac\") " pod="kube-system/global-pull-secret-syncer-gz67s"
May 27 23:33:25.228506 ip-10-0-132-191 kubenswrapper[2557]: E0527 23:33:25.228480    2557 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
May 27 23:33:25.228571 ip-10-0-132-191 kubenswrapper[2557]: E0527 23:33:25.228549    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c2d45389-8733-498a-a898-6cc40f57fbac-original-pull-secret podName:c2d45389-8733-498a-a898-6cc40f57fbac nodeName:}" failed. No retries permitted until 2026-05-27 23:33:41.228529486 +0000 UTC m=+36.648065493 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/c2d45389-8733-498a-a898-6cc40f57fbac-original-pull-secret") pod "global-pull-secret-syncer-gz67s" (UID: "c2d45389-8733-498a-a898-6cc40f57fbac") : object "kube-system"/"original-pull-secret" not registered
May 27 23:33:26.198844 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:26.198791    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zvbqn"
May 27 23:33:26.198951 ip-10-0-132-191 kubenswrapper[2557]: E0527 23:33:26.198911    2557 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zvbqn" podUID="c4d68b58-b4f3-4f03-a21c-321ca3eebe68"
May 27 23:33:26.273718 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:26.273686    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5sm8c" event={"ID":"5dce51c2-4758-48af-a087-58d37df3b392","Type":"ContainerStarted","Data":"72bfd17b2911272ee7798da8eb76ed4121486fd921f6c977840417428ab6f02c"}
May 27 23:33:26.275169 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:26.275141    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-54c79" event={"ID":"471894d3-91bc-4805-914b-a761d2f21f31","Type":"ContainerStarted","Data":"b2ab966a7e0420e353268b525276a2decf6858fbd1bba112fc0c4fa323b711d5"}
May 27 23:33:26.278086 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:26.277546    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-6bgmn" event={"ID":"479d4fa9-d4cb-4d0e-82d4-eb0ec77dbc90","Type":"ContainerStarted","Data":"b821dd6b3b60f0522182f0295b640ef45fca15aaa34f55dee4d7da3835464556"}
May 27 23:33:26.292910 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:26.292862    2557 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-191.ec2.internal" podStartSLOduration=20.292845694 podStartE2EDuration="20.292845694s" podCreationTimestamp="2026-05-27 23:33:06 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-27 23:33:10.261504513 +0000 UTC m=+5.681040527" watchObservedRunningTime="2026-05-27 23:33:26.292845694 +0000 UTC m=+21.712381707"
May 27 23:33:26.293246 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:26.293204    2557 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/konnectivity-agent-54c79" podStartSLOduration=3.28488952 podStartE2EDuration="21.293193469s" podCreationTimestamp="2026-05-27 23:33:05 +0000 UTC" firstStartedPulling="2026-05-27 23:33:07.852352876 +0000 UTC m=+3.271888881" lastFinishedPulling="2026-05-27 23:33:25.860656827 +0000 UTC m=+21.280192830" observedRunningTime="2026-05-27 23:33:26.292469266 +0000 UTC m=+21.712005277" watchObservedRunningTime="2026-05-27 23:33:26.293193469 +0000 UTC m=+21.712729482"
May 27 23:33:26.309498 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:26.309459    2557 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-image-registry/node-ca-6bgmn" podStartSLOduration=3.372557895 podStartE2EDuration="21.309447018s" podCreationTimestamp="2026-05-27 23:33:05 +0000 UTC" firstStartedPulling="2026-05-27 23:33:07.883208392 +0000 UTC m=+3.302744391" lastFinishedPulling="2026-05-27 23:33:25.820097511 +0000 UTC m=+21.239633514" observedRunningTime="2026-05-27 23:33:26.308892381 +0000 UTC m=+21.728428389" watchObservedRunningTime="2026-05-27 23:33:26.309447018 +0000 UTC m=+21.728983030"
May 27 23:33:27.198949 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:27.198780    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gz67s"
May 27 23:33:27.199062 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:27.198802    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tsxk6"
May 27 23:33:27.199145 ip-10-0-132-191 kubenswrapper[2557]: E0527 23:33:27.199054    2557 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gz67s" podUID="c2d45389-8733-498a-a898-6cc40f57fbac"
May 27 23:33:27.199213 ip-10-0-132-191 kubenswrapper[2557]: E0527 23:33:27.199121    2557 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tsxk6" podUID="4af77c1c-1265-4e74-b12f-28d888f58380"
May 27 23:33:27.230073 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:27.230053    2557 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
May 27 23:33:27.280257 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:27.280226    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-nh9z4" event={"ID":"85aeda21-db1b-47a0-abe6-9d2036fc6405","Type":"ContainerStarted","Data":"2bddf1554f773267bf56ea7626051f33c9eab0180299f066482107020a513714"}
May 27 23:33:27.282737 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:27.282714    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-s7vdp" event={"ID":"1b1ca6ef-cc5e-418f-b5a3-acf3a5d38e44","Type":"ContainerStarted","Data":"2fd9c464d7cf21f9d059b422c460ed6aaab9604db077ac49aadeb45d1600d383"}
May 27 23:33:27.282831 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:27.282742    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-s7vdp" event={"ID":"1b1ca6ef-cc5e-418f-b5a3-acf3a5d38e44","Type":"ContainerStarted","Data":"59ae04adbab85b737522b720d9f039c7eabbe09cf43d53454580c4e4c3d61f77"}
May 27 23:33:27.282831 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:27.282755    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-s7vdp" event={"ID":"1b1ca6ef-cc5e-418f-b5a3-acf3a5d38e44","Type":"ContainerStarted","Data":"ea2b5abde6e06a0cb2dd79e235c53334ef5a6a6658d6a3c0deb9d7b8fa729253"}
May 27 23:33:27.282831 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:27.282769    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-s7vdp" event={"ID":"1b1ca6ef-cc5e-418f-b5a3-acf3a5d38e44","Type":"ContainerStarted","Data":"b9b8313c4df6c508567b34636f43f242602b1450a0060a8a61734ff5eda08edb"}
May 27 23:33:27.282831 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:27.282780    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-s7vdp" event={"ID":"1b1ca6ef-cc5e-418f-b5a3-acf3a5d38e44","Type":"ContainerStarted","Data":"22ea114249b2a94008e7e2f5efcaaecb6b927bd342500ef2d00a62536cb369f7"}
May 27 23:33:27.282831 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:27.282795    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-s7vdp" event={"ID":"1b1ca6ef-cc5e-418f-b5a3-acf3a5d38e44","Type":"ContainerStarted","Data":"6ac5cf54cbcc1c104d5ab466fab258e53db9df34a6b3d9f2aadb15fb89a7c46f"}
May 27 23:33:27.284025 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:27.284003    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-h2jmf" event={"ID":"5069fad8-69ff-40c6-993b-7d41b872d190","Type":"ContainerStarted","Data":"b55833768a652f2a6ea4562c042f67adbd97af61c74ce949f51e62c07972b710"}
May 27 23:33:27.285099 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:27.285080    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-jbbwx" event={"ID":"9d47bc2b-bc9c-4887-99e0-c05ffb6c8d0b","Type":"ContainerStarted","Data":"549fabfbda3f005e9c40d629a1eb1d205ac3de37641112da280d815a93dea4b0"}
May 27 23:33:27.286333 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:27.286313    2557 generic.go:358] "Generic (PLEG): container finished" podID="1a2fc634-3712-40ee-bfce-e8aaee0791f2" containerID="f809bfca4bc485a2311359b36b2c28c79a4d92c0177d9a8e84d225ea2c324160" exitCode=0
May 27 23:33:27.286429 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:27.286366    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-7p5w7" event={"ID":"1a2fc634-3712-40ee-bfce-e8aaee0791f2","Type":"ContainerDied","Data":"f809bfca4bc485a2311359b36b2c28c79a4d92c0177d9a8e84d225ea2c324160"}
May 27 23:33:27.287827 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:27.287803    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5sm8c" event={"ID":"5dce51c2-4758-48af-a087-58d37df3b392","Type":"ContainerStarted","Data":"4d89fc9c78d80691b29ef8759f8b8e2a6fb42081d37cfaf870815ff67e09f2a6"}
May 27 23:33:27.289068 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:27.289044    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-hdrgr" event={"ID":"74b39582-8199-4302-bd86-7b31f474872b","Type":"ContainerStarted","Data":"bc63b257f8a1f1dd388bac5a5c9f8b4fc7fa4541a3061917404aa43711ca3508"}
May 27 23:33:27.324371 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:27.324337    2557 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/multus-h2jmf" podStartSLOduration=3.914436256 podStartE2EDuration="22.324325047s" podCreationTimestamp="2026-05-27 23:33:05 +0000 UTC" firstStartedPulling="2026-05-27 23:33:07.854202481 +0000 UTC m=+3.273738485" lastFinishedPulling="2026-05-27 23:33:26.264091284 +0000 UTC m=+21.683627276" observedRunningTime="2026-05-27 23:33:27.323964355 +0000 UTC m=+22.743500356" watchObservedRunningTime="2026-05-27 23:33:27.324325047 +0000 UTC m=+22.743861059"
May 27 23:33:27.324478 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:27.324424    2557 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-nh9z4" podStartSLOduration=4.30377425 podStartE2EDuration="22.324419819s" podCreationTimestamp="2026-05-27 23:33:05 +0000 UTC" firstStartedPulling="2026-05-27 23:33:07.858654334 +0000 UTC m=+3.278190332" lastFinishedPulling="2026-05-27 23:33:25.879299911 +0000 UTC m=+21.298835901" observedRunningTime="2026-05-27 23:33:27.306702778 +0000 UTC m=+22.726238789" watchObservedRunningTime="2026-05-27 23:33:27.324419819 +0000 UTC m=+22.743955831"
May 27 23:33:27.337953 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:27.337916    2557 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-dns/node-resolver-jbbwx" podStartSLOduration=4.335425202 podStartE2EDuration="22.337901755s" podCreationTimestamp="2026-05-27 23:33:05 +0000 UTC" firstStartedPulling="2026-05-27 23:33:07.883255878 +0000 UTC m=+3.302791869" lastFinishedPulling="2026-05-27 23:33:25.885732433 +0000 UTC m=+21.305268422" observedRunningTime="2026-05-27 23:33:27.337827473 +0000 UTC m=+22.757363478" watchObservedRunningTime="2026-05-27 23:33:27.337901755 +0000 UTC m=+22.757437768"
May 27 23:33:27.378992 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:27.378952    2557 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-hdrgr" podStartSLOduration=4.353892937 podStartE2EDuration="22.378939863s" podCreationTimestamp="2026-05-27 23:33:05 +0000 UTC" firstStartedPulling="2026-05-27 23:33:07.855810912 +0000 UTC m=+3.275346901" lastFinishedPulling="2026-05-27 23:33:25.880857834 +0000 UTC m=+21.300393827" observedRunningTime="2026-05-27 23:33:27.378806965 +0000 UTC m=+22.798342977" watchObservedRunningTime="2026-05-27 23:33:27.378939863 +0000 UTC m=+22.798475872"
May 27 23:33:28.140335 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:28.140251    2557 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-05-27T23:33:27.230070064Z","UUID":"8d4d4dfc-1706-44b5-b185-3097ec2fd3e8","Handler":null,"Name":"","Endpoint":""}
May 27 23:33:28.142247 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:28.142218    2557 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
May 27 23:33:28.142247 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:28.142245    2557 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
May 27 23:33:28.198627 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:28.198598    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zvbqn"
May 27 23:33:28.198763 ip-10-0-132-191 kubenswrapper[2557]: E0527 23:33:28.198729    2557 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zvbqn" podUID="c4d68b58-b4f3-4f03-a21c-321ca3eebe68"
May 27 23:33:28.292848 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:28.292817    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5sm8c" event={"ID":"5dce51c2-4758-48af-a087-58d37df3b392","Type":"ContainerStarted","Data":"eae3859e029e05baf0b9c6d020035665b7936b859c7d7a3e5d24b501c78d666e"}
May 27 23:33:28.313301 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:28.313259    2557 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5sm8c" podStartSLOduration=3.015389958 podStartE2EDuration="23.313245959s" podCreationTimestamp="2026-05-27 23:33:05 +0000 UTC" firstStartedPulling="2026-05-27 23:33:07.857803747 +0000 UTC m=+3.277339739" lastFinishedPulling="2026-05-27 23:33:28.155659745 +0000 UTC m=+23.575195740" observedRunningTime="2026-05-27 23:33:28.313178114 +0000 UTC m=+23.732714126" watchObservedRunningTime="2026-05-27 23:33:28.313245959 +0000 UTC m=+23.732781970"
May 27 23:33:29.198433 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:29.198409    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gz67s"
May 27 23:33:29.198568 ip-10-0-132-191 kubenswrapper[2557]: E0527 23:33:29.198515    2557 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gz67s" podUID="c2d45389-8733-498a-a898-6cc40f57fbac"
May 27 23:33:29.198629 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:29.198600    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tsxk6"
May 27 23:33:29.198728 ip-10-0-132-191 kubenswrapper[2557]: E0527 23:33:29.198704    2557 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tsxk6" podUID="4af77c1c-1265-4e74-b12f-28d888f58380"
May 27 23:33:29.297881 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:29.297845    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-s7vdp" event={"ID":"1b1ca6ef-cc5e-418f-b5a3-acf3a5d38e44","Type":"ContainerStarted","Data":"7caac9ae5d6b237a68ff1116b369e7e72e3c690a49df63aa9ee3f771952e12e8"}
May 27 23:33:30.136080 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:30.135881    2557 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-54c79"
May 27 23:33:30.136558 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:30.136526    2557 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-54c79"
May 27 23:33:30.199138 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:30.199097    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zvbqn"
May 27 23:33:30.199302 ip-10-0-132-191 kubenswrapper[2557]: E0527 23:33:30.199258    2557 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zvbqn" podUID="c4d68b58-b4f3-4f03-a21c-321ca3eebe68"
May 27 23:33:31.198947 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:31.198910    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gz67s"
May 27 23:33:31.199557 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:31.198910    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tsxk6"
May 27 23:33:31.199557 ip-10-0-132-191 kubenswrapper[2557]: E0527 23:33:31.199029    2557 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gz67s" podUID="c2d45389-8733-498a-a898-6cc40f57fbac"
May 27 23:33:31.199557 ip-10-0-132-191 kubenswrapper[2557]: E0527 23:33:31.199097    2557 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tsxk6" podUID="4af77c1c-1265-4e74-b12f-28d888f58380"
May 27 23:33:31.307020 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:31.306987    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-s7vdp" event={"ID":"1b1ca6ef-cc5e-418f-b5a3-acf3a5d38e44","Type":"ContainerStarted","Data":"b79285a9afaff9259519337cca44d93c91aed831d39f084fe81a864c021f1fcf"}
May 27 23:33:31.308469 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:31.308319    2557 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-s7vdp"
May 27 23:33:31.308469 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:31.308348    2557 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-s7vdp"
May 27 23:33:31.328697 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:31.328432    2557 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-s7vdp"
May 27 23:33:31.330843 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:31.330523    2557 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-s7vdp"
May 27 23:33:31.340761 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:31.339788    2557 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-s7vdp" podStartSLOduration=8.290640365 podStartE2EDuration="26.339769732s" podCreationTimestamp="2026-05-27 23:33:05 +0000 UTC" firstStartedPulling="2026-05-27 23:33:07.856933479 +0000 UTC m=+3.276469474" lastFinishedPulling="2026-05-27 23:33:25.906062847 +0000 UTC m=+21.325598841" observedRunningTime="2026-05-27 23:33:31.339738115 +0000 UTC m=+26.759274165" watchObservedRunningTime="2026-05-27 23:33:31.339769732 +0000 UTC m=+26.759305728"
May 27 23:33:32.198868 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:32.198836    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zvbqn"
May 27 23:33:32.199023 ip-10-0-132-191 kubenswrapper[2557]: E0527 23:33:32.198958    2557 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zvbqn" podUID="c4d68b58-b4f3-4f03-a21c-321ca3eebe68"
May 27 23:33:32.309569 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:32.309384    2557 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness"
May 27 23:33:33.199032 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:33.199006    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gz67s"
May 27 23:33:33.199374 ip-10-0-132-191 kubenswrapper[2557]: E0527 23:33:33.199101    2557 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gz67s" podUID="c2d45389-8733-498a-a898-6cc40f57fbac"
May 27 23:33:33.199374 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:33.199160    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tsxk6"
May 27 23:33:33.199374 ip-10-0-132-191 kubenswrapper[2557]: E0527 23:33:33.199266    2557 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tsxk6" podUID="4af77c1c-1265-4e74-b12f-28d888f58380"
May 27 23:33:33.254041 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:33.254015    2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-gz67s"]
May 27 23:33:33.254835 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:33.254811    2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-zvbqn"]
May 27 23:33:33.254953 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:33.254939    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zvbqn"
May 27 23:33:33.255069 ip-10-0-132-191 kubenswrapper[2557]: E0527 23:33:33.255051    2557 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zvbqn" podUID="c4d68b58-b4f3-4f03-a21c-321ca3eebe68"
May 27 23:33:33.256297 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:33.256277    2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-tsxk6"]
May 27 23:33:33.312800 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:33.312773    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tsxk6"
May 27 23:33:33.312953 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:33.312825    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-7p5w7" event={"ID":"1a2fc634-3712-40ee-bfce-e8aaee0791f2","Type":"ContainerStarted","Data":"d906ef526e274de7ea04741962eb48d4d81afb25094257d8a0dae6e264eec90a"}
May 27 23:33:33.312953 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:33.312877    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gz67s"
May 27 23:33:33.312953 ip-10-0-132-191 kubenswrapper[2557]: E0527 23:33:33.312889    2557 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tsxk6" podUID="4af77c1c-1265-4e74-b12f-28d888f58380"
May 27 23:33:33.313116 ip-10-0-132-191 kubenswrapper[2557]: E0527 23:33:33.313078    2557 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gz67s" podUID="c2d45389-8733-498a-a898-6cc40f57fbac"
May 27 23:33:33.313384 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:33.313276    2557 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness"
May 27 23:33:34.316219 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:34.316183    2557 generic.go:358] "Generic (PLEG): container finished" podID="1a2fc634-3712-40ee-bfce-e8aaee0791f2" containerID="d906ef526e274de7ea04741962eb48d4d81afb25094257d8a0dae6e264eec90a" exitCode=0
May 27 23:33:34.316676 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:34.316241    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-7p5w7" event={"ID":"1a2fc634-3712-40ee-bfce-e8aaee0791f2","Type":"ContainerDied","Data":"d906ef526e274de7ea04741962eb48d4d81afb25094257d8a0dae6e264eec90a"}
May 27 23:33:34.854139 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:34.854096    2557 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-s7vdp"
May 27 23:33:34.889327 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:34.889301    2557 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-54c79"
May 27 23:33:34.889444 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:34.889413    2557 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness"
May 27 23:33:34.889807 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:34.889790    2557 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-54c79"
May 27 23:33:35.199629 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:35.199561    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gz67s"
May 27 23:33:35.199778 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:35.199670    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tsxk6"
May 27 23:33:35.199778 ip-10-0-132-191 kubenswrapper[2557]: E0527 23:33:35.199691    2557 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gz67s" podUID="c2d45389-8733-498a-a898-6cc40f57fbac"
May 27 23:33:35.199778 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:35.199737    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zvbqn"
May 27 23:33:35.199778 ip-10-0-132-191 kubenswrapper[2557]: E0527 23:33:35.199740    2557 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tsxk6" podUID="4af77c1c-1265-4e74-b12f-28d888f58380"
May 27 23:33:35.200000 ip-10-0-132-191 kubenswrapper[2557]: E0527 23:33:35.199843    2557 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zvbqn" podUID="c4d68b58-b4f3-4f03-a21c-321ca3eebe68"
May 27 23:33:36.321927 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:36.321685    2557 generic.go:358] "Generic (PLEG): container finished" podID="1a2fc634-3712-40ee-bfce-e8aaee0791f2" containerID="a6f053d850d869c5837b02d74a9c9db063574fe40fb51a78c1de9ebdf4411e8b" exitCode=0
May 27 23:33:36.322330 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:36.321772    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-7p5w7" event={"ID":"1a2fc634-3712-40ee-bfce-e8aaee0791f2","Type":"ContainerDied","Data":"a6f053d850d869c5837b02d74a9c9db063574fe40fb51a78c1de9ebdf4411e8b"}
May 27 23:33:37.198366 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:37.198328    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zvbqn"
May 27 23:33:37.198597 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:37.198328    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gz67s"
May 27 23:33:37.198597 ip-10-0-132-191 kubenswrapper[2557]: E0527 23:33:37.198468    2557 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zvbqn" podUID="c4d68b58-b4f3-4f03-a21c-321ca3eebe68"
May 27 23:33:37.198597 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:37.198328    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tsxk6"
May 27 23:33:37.198597 ip-10-0-132-191 kubenswrapper[2557]: E0527 23:33:37.198539    2557 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gz67s" podUID="c2d45389-8733-498a-a898-6cc40f57fbac"
May 27 23:33:37.198597 ip-10-0-132-191 kubenswrapper[2557]: E0527 23:33:37.198580    2557 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tsxk6" podUID="4af77c1c-1265-4e74-b12f-28d888f58380"
May 27 23:33:38.327805 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:38.327770    2557 generic.go:358] "Generic (PLEG): container finished" podID="1a2fc634-3712-40ee-bfce-e8aaee0791f2" containerID="b26ed74a0a48db7e930b9b748ce892e96e46b3d96f5d5731a640393cd0fa8b17" exitCode=0
May 27 23:33:38.328425 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:38.327817    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-7p5w7" event={"ID":"1a2fc634-3712-40ee-bfce-e8aaee0791f2","Type":"ContainerDied","Data":"b26ed74a0a48db7e930b9b748ce892e96e46b3d96f5d5731a640393cd0fa8b17"}
May 27 23:33:38.839653 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:38.839613    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c4d68b58-b4f3-4f03-a21c-321ca3eebe68-metrics-certs\") pod \"network-metrics-daemon-zvbqn\" (UID: \"c4d68b58-b4f3-4f03-a21c-321ca3eebe68\") " pod="openshift-multus/network-metrics-daemon-zvbqn"
May 27 23:33:38.839822 ip-10-0-132-191 kubenswrapper[2557]: E0527 23:33:38.839783    2557 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
May 27 23:33:38.839888 ip-10-0-132-191 kubenswrapper[2557]: E0527 23:33:38.839869    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c4d68b58-b4f3-4f03-a21c-321ca3eebe68-metrics-certs podName:c4d68b58-b4f3-4f03-a21c-321ca3eebe68 nodeName:}" failed. No retries permitted until 2026-05-27 23:34:10.839844754 +0000 UTC m=+66.259380747 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c4d68b58-b4f3-4f03-a21c-321ca3eebe68-metrics-certs") pod "network-metrics-daemon-zvbqn" (UID: "c4d68b58-b4f3-4f03-a21c-321ca3eebe68") : object "openshift-multus"/"metrics-daemon-secret" not registered
May 27 23:33:39.041181 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:39.041141    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-qzzjd\" (UniqueName: \"kubernetes.io/projected/4af77c1c-1265-4e74-b12f-28d888f58380-kube-api-access-qzzjd\") pod \"network-check-target-tsxk6\" (UID: \"4af77c1c-1265-4e74-b12f-28d888f58380\") " pod="openshift-network-diagnostics/network-check-target-tsxk6"
May 27 23:33:39.041361 ip-10-0-132-191 kubenswrapper[2557]: E0527 23:33:39.041262    2557 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
May 27 23:33:39.041361 ip-10-0-132-191 kubenswrapper[2557]: E0527 23:33:39.041289    2557 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
May 27 23:33:39.041361 ip-10-0-132-191 kubenswrapper[2557]: E0527 23:33:39.041300    2557 projected.go:194] Error preparing data for projected volume kube-api-access-qzzjd for pod openshift-network-diagnostics/network-check-target-tsxk6: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 27 23:33:39.041361 ip-10-0-132-191 kubenswrapper[2557]: E0527 23:33:39.041362    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4af77c1c-1265-4e74-b12f-28d888f58380-kube-api-access-qzzjd podName:4af77c1c-1265-4e74-b12f-28d888f58380 nodeName:}" failed. No retries permitted until 2026-05-27 23:34:11.041345824 +0000 UTC m=+66.460881817 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-qzzjd" (UniqueName: "kubernetes.io/projected/4af77c1c-1265-4e74-b12f-28d888f58380-kube-api-access-qzzjd") pod "network-check-target-tsxk6" (UID: "4af77c1c-1265-4e74-b12f-28d888f58380") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 27 23:33:39.198900 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:39.198827    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gz67s"
May 27 23:33:39.198900 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:39.198887    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zvbqn"
May 27 23:33:39.199092 ip-10-0-132-191 kubenswrapper[2557]: E0527 23:33:39.198995    2557 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zvbqn" podUID="c4d68b58-b4f3-4f03-a21c-321ca3eebe68"
May 27 23:33:39.199193 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:39.199168    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tsxk6"
May 27 23:33:39.199317 ip-10-0-132-191 kubenswrapper[2557]: E0527 23:33:39.199279    2557 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gz67s" podUID="c2d45389-8733-498a-a898-6cc40f57fbac"
May 27 23:33:39.199383 ip-10-0-132-191 kubenswrapper[2557]: E0527 23:33:39.199338    2557 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tsxk6" podUID="4af77c1c-1265-4e74-b12f-28d888f58380"
May 27 23:33:39.901751 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:39.901671    2557 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-132-191.ec2.internal" event="NodeReady"
May 27 23:33:39.902247 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:39.901840    2557 kubelet_node_status.go:550] "Fast updating node status as it just became ready"
May 27 23:33:39.935287 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:39.935254    2557 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7b7db96d88-22q6v"]
May 27 23:33:39.954608 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:39.953346    2557 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-84dd97d74c-mmfqg"]
May 27 23:33:39.963502 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:39.963470    2557 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-77d97f4457-gt2t8"]
May 27 23:33:39.963677 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:39.963532    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7b7db96d88-22q6v"
May 27 23:33:39.963740 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:39.963673    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-84dd97d74c-mmfqg"
May 27 23:33:39.966979 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:39.966958    2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\""
May 27 23:33:39.967108 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:39.966991    2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-dockercfg-mvzp2\""
May 27 23:33:39.967583 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:39.967402    2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"work-manager-hub-kubeconfig\""
May 27 23:33:39.967583 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:39.967410    2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\""
May 27 23:33:39.968457 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:39.968430    2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\""
May 27 23:33:39.968659 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:39.968644    2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-hub-kubeconfig\""
May 27 23:33:39.977508 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:39.977488    2557 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-67898895db-qdh8p"]
May 27 23:33:39.977627 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:39.977607    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-77d97f4457-gt2t8"
May 27 23:33:39.980402 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:39.980374    2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
May 27 23:33:39.980402 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:39.980380    2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
May 27 23:33:39.980545 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:39.980491    2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-wvqkk\""
May 27 23:33:39.980617 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:39.980601    2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
May 27 23:33:39.995522 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:39.995504    2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7b7db96d88-22q6v"]
May 27 23:33:39.995626 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:39.995527    2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-84dd97d74c-mmfqg"]
May 27 23:33:39.995626 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:39.995535    2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-67898895db-qdh8p"]
May 27 23:33:39.995626 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:39.995544    2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-77d97f4457-gt2t8"]
May 27 23:33:39.995626 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:39.995553    2557 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-5h2hp"]
May 27 23:33:39.995784 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:39.995677    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-67898895db-qdh8p"
May 27 23:33:39.998526 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:39.998390    2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-open-cluster-management.io-proxy-agent-signer-client-cert\""
May 27 23:33:39.998526 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:39.998417    2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-ca\""
May 27 23:33:39.998526 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:39.998441    2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
May 27 23:33:39.998526 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:39.998493    2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-service-proxy-server-certificates\""
May 27 23:33:39.998803 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:39.998788    2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-hub-kubeconfig\""
May 27 23:33:40.017108 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:40.017083    2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-5h2hp"]
May 27 23:33:40.017244 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:40.017214    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-5h2hp"
May 27 23:33:40.019887 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:40.019865    2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
May 27 23:33:40.020005 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:40.019897    2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-lstvz\""
May 27 23:33:40.020005 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:40.019927    2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
May 27 23:33:40.020113 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:40.019870    2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
May 27 23:33:40.052704 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:40.052225    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/a112e1d0-b4a6-4e2a-8400-130d5e93312e-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-7b7db96d88-22q6v\" (UID: \"a112e1d0-b4a6-4e2a-8400-130d5e93312e\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7b7db96d88-22q6v"
May 27 23:33:40.052704 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:40.052355    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9h227\" (UniqueName: \"kubernetes.io/projected/a112e1d0-b4a6-4e2a-8400-130d5e93312e-kube-api-access-9h227\") pod \"managed-serviceaccount-addon-agent-7b7db96d88-22q6v\" (UID: \"a112e1d0-b4a6-4e2a-8400-130d5e93312e\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7b7db96d88-22q6v"
May 27 23:33:40.055803 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:40.055784    2557 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-lbgbp"]
May 27 23:33:40.073338 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:40.073295    2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-lbgbp"]
May 27 23:33:40.073470 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:40.073436    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-lbgbp"
May 27 23:33:40.076206 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:40.076185    2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-szgzp\""
May 27 23:33:40.076323 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:40.076237    2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
May 27 23:33:40.076402 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:40.076242    2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
May 27 23:33:40.153775 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:40.153680    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/c1877802-a24c-4e88-ab77-ccd86f39c196-hub\") pod \"cluster-proxy-proxy-agent-67898895db-qdh8p\" (UID: \"c1877802-a24c-4e88-ab77-ccd86f39c196\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-67898895db-qdh8p"
May 27 23:33:40.153775 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:40.153732    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ocpservice-ca\" (UniqueName: \"kubernetes.io/configmap/c1877802-a24c-4e88-ab77-ccd86f39c196-ocpservice-ca\") pod \"cluster-proxy-proxy-agent-67898895db-qdh8p\" (UID: \"c1877802-a24c-4e88-ab77-ccd86f39c196\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-67898895db-qdh8p"
May 27 23:33:40.153992 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:40.153801    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/be0f2a6c-ac7b-49cd-9b76-f915fb621154-ca-trust-extracted\") pod \"image-registry-77d97f4457-gt2t8\" (UID: \"be0f2a6c-ac7b-49cd-9b76-f915fb621154\") " pod="openshift-image-registry/image-registry-77d97f4457-gt2t8"
May 27 23:33:40.153992 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:40.153844    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/be0f2a6c-ac7b-49cd-9b76-f915fb621154-trusted-ca\") pod \"image-registry-77d97f4457-gt2t8\" (UID: \"be0f2a6c-ac7b-49cd-9b76-f915fb621154\") " pod="openshift-image-registry/image-registry-77d97f4457-gt2t8"
May 27 23:33:40.153992 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:40.153870    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gld7v\" (UniqueName: \"kubernetes.io/projected/b43c1b7d-e8dd-47eb-8e80-92e5120ae59c-kube-api-access-gld7v\") pod \"ingress-canary-5h2hp\" (UID: \"b43c1b7d-e8dd-47eb-8e80-92e5120ae59c\") " pod="openshift-ingress-canary/ingress-canary-5h2hp"
May 27 23:33:40.153992 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:40.153905    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/a112e1d0-b4a6-4e2a-8400-130d5e93312e-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-7b7db96d88-22q6v\" (UID: \"a112e1d0-b4a6-4e2a-8400-130d5e93312e\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7b7db96d88-22q6v"
May 27 23:33:40.153992 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:40.153931    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kp9m4\" (UniqueName: \"kubernetes.io/projected/be0f2a6c-ac7b-49cd-9b76-f915fb621154-kube-api-access-kp9m4\") pod \"image-registry-77d97f4457-gt2t8\" (UID: \"be0f2a6c-ac7b-49cd-9b76-f915fb621154\") " pod="openshift-image-registry/image-registry-77d97f4457-gt2t8"
May 27 23:33:40.153992 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:40.153960    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jfbmt\" (UniqueName: \"kubernetes.io/projected/c1877802-a24c-4e88-ab77-ccd86f39c196-kube-api-access-jfbmt\") pod \"cluster-proxy-proxy-agent-67898895db-qdh8p\" (UID: \"c1877802-a24c-4e88-ab77-ccd86f39c196\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-67898895db-qdh8p"
May 27 23:33:40.153992 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:40.153990    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/be0f2a6c-ac7b-49cd-9b76-f915fb621154-bound-sa-token\") pod \"image-registry-77d97f4457-gt2t8\" (UID: \"be0f2a6c-ac7b-49cd-9b76-f915fb621154\") " pod="openshift-image-registry/image-registry-77d97f4457-gt2t8"
May 27 23:33:40.154288 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:40.154047    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/c1877802-a24c-4e88-ab77-ccd86f39c196-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-67898895db-qdh8p\" (UID: \"c1877802-a24c-4e88-ab77-ccd86f39c196\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-67898895db-qdh8p"
May 27 23:33:40.154288 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:40.154087    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/c1877802-a24c-4e88-ab77-ccd86f39c196-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-67898895db-qdh8p\" (UID: \"c1877802-a24c-4e88-ab77-ccd86f39c196\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-67898895db-qdh8p"
May 27 23:33:40.154288 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:40.154115    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m46fd\" (UniqueName: \"kubernetes.io/projected/29c8dcc2-2720-4899-8957-ce8476c86626-kube-api-access-m46fd\") pod \"klusterlet-addon-workmgr-84dd97d74c-mmfqg\" (UID: \"29c8dcc2-2720-4899-8957-ce8476c86626\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-84dd97d74c-mmfqg"
May 27 23:33:40.154288 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:40.154196    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/be0f2a6c-ac7b-49cd-9b76-f915fb621154-registry-tls\") pod \"image-registry-77d97f4457-gt2t8\" (UID: \"be0f2a6c-ac7b-49cd-9b76-f915fb621154\") " pod="openshift-image-registry/image-registry-77d97f4457-gt2t8"
May 27 23:33:40.154288 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:40.154260    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-9h227\" (UniqueName: \"kubernetes.io/projected/a112e1d0-b4a6-4e2a-8400-130d5e93312e-kube-api-access-9h227\") pod \"managed-serviceaccount-addon-agent-7b7db96d88-22q6v\" (UID: \"a112e1d0-b4a6-4e2a-8400-130d5e93312e\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7b7db96d88-22q6v"
May 27 23:33:40.154497 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:40.154296    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/be0f2a6c-ac7b-49cd-9b76-f915fb621154-image-registry-private-configuration\") pod \"image-registry-77d97f4457-gt2t8\" (UID: \"be0f2a6c-ac7b-49cd-9b76-f915fb621154\") " pod="openshift-image-registry/image-registry-77d97f4457-gt2t8"
May 27 23:33:40.154497 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:40.154315    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/29c8dcc2-2720-4899-8957-ce8476c86626-tmp\") pod \"klusterlet-addon-workmgr-84dd97d74c-mmfqg\" (UID: \"29c8dcc2-2720-4899-8957-ce8476c86626\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-84dd97d74c-mmfqg"
May 27 23:33:40.154497 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:40.154338    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/29c8dcc2-2720-4899-8957-ce8476c86626-klusterlet-config\") pod \"klusterlet-addon-workmgr-84dd97d74c-mmfqg\" (UID: \"29c8dcc2-2720-4899-8957-ce8476c86626\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-84dd97d74c-mmfqg"
May 27 23:33:40.154497 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:40.154366    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b43c1b7d-e8dd-47eb-8e80-92e5120ae59c-cert\") pod \"ingress-canary-5h2hp\" (UID: \"b43c1b7d-e8dd-47eb-8e80-92e5120ae59c\") " pod="openshift-ingress-canary/ingress-canary-5h2hp"
May 27 23:33:40.154497 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:40.154391    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/be0f2a6c-ac7b-49cd-9b76-f915fb621154-registry-certificates\") pod \"image-registry-77d97f4457-gt2t8\" (UID: \"be0f2a6c-ac7b-49cd-9b76-f915fb621154\") " pod="openshift-image-registry/image-registry-77d97f4457-gt2t8"
May 27 23:33:40.154497 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:40.154433    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/be0f2a6c-ac7b-49cd-9b76-f915fb621154-installation-pull-secrets\") pod \"image-registry-77d97f4457-gt2t8\" (UID: \"be0f2a6c-ac7b-49cd-9b76-f915fb621154\") " pod="openshift-image-registry/image-registry-77d97f4457-gt2t8"
May 27 23:33:40.154497 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:40.154470    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/c1877802-a24c-4e88-ab77-ccd86f39c196-ca\") pod \"cluster-proxy-proxy-agent-67898895db-qdh8p\" (UID: \"c1877802-a24c-4e88-ab77-ccd86f39c196\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-67898895db-qdh8p"
May 27 23:33:40.159254 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:40.159231    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/a112e1d0-b4a6-4e2a-8400-130d5e93312e-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-7b7db96d88-22q6v\" (UID: \"a112e1d0-b4a6-4e2a-8400-130d5e93312e\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7b7db96d88-22q6v"
May 27 23:33:40.162563 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:40.162538    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9h227\" (UniqueName: \"kubernetes.io/projected/a112e1d0-b4a6-4e2a-8400-130d5e93312e-kube-api-access-9h227\") pod \"managed-serviceaccount-addon-agent-7b7db96d88-22q6v\" (UID: \"a112e1d0-b4a6-4e2a-8400-130d5e93312e\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7b7db96d88-22q6v"
May 27 23:33:40.255823 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:40.255785    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/be0f2a6c-ac7b-49cd-9b76-f915fb621154-registry-tls\") pod \"image-registry-77d97f4457-gt2t8\" (UID: \"be0f2a6c-ac7b-49cd-9b76-f915fb621154\") " pod="openshift-image-registry/image-registry-77d97f4457-gt2t8"
May 27 23:33:40.256017 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:40.255841    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/be0f2a6c-ac7b-49cd-9b76-f915fb621154-image-registry-private-configuration\") pod \"image-registry-77d97f4457-gt2t8\" (UID: \"be0f2a6c-ac7b-49cd-9b76-f915fb621154\") " pod="openshift-image-registry/image-registry-77d97f4457-gt2t8"
May 27 23:33:40.256017 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:40.255871    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/29c8dcc2-2720-4899-8957-ce8476c86626-tmp\") pod \"klusterlet-addon-workmgr-84dd97d74c-mmfqg\" (UID: \"29c8dcc2-2720-4899-8957-ce8476c86626\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-84dd97d74c-mmfqg"
May 27 23:33:40.256017 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:40.255897    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/29c8dcc2-2720-4899-8957-ce8476c86626-klusterlet-config\") pod \"klusterlet-addon-workmgr-84dd97d74c-mmfqg\" (UID: \"29c8dcc2-2720-4899-8957-ce8476c86626\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-84dd97d74c-mmfqg"
May 27 23:33:40.256017 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:40.255924    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b43c1b7d-e8dd-47eb-8e80-92e5120ae59c-cert\") pod \"ingress-canary-5h2hp\" (UID: \"b43c1b7d-e8dd-47eb-8e80-92e5120ae59c\") " pod="openshift-ingress-canary/ingress-canary-5h2hp"
May 27 23:33:40.256017 ip-10-0-132-191 kubenswrapper[2557]: E0527 23:33:40.255960    2557 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
May 27 23:33:40.256017 ip-10-0-132-191 kubenswrapper[2557]: E0527 23:33:40.255977    2557 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-77d97f4457-gt2t8: secret "image-registry-tls" not found
May 27 23:33:40.256323 ip-10-0-132-191 kubenswrapper[2557]: E0527 23:33:40.256038    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/be0f2a6c-ac7b-49cd-9b76-f915fb621154-registry-tls podName:be0f2a6c-ac7b-49cd-9b76-f915fb621154 nodeName:}" failed. No retries permitted until 2026-05-27 23:33:40.756018856 +0000 UTC m=+36.175554860 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/be0f2a6c-ac7b-49cd-9b76-f915fb621154-registry-tls") pod "image-registry-77d97f4457-gt2t8" (UID: "be0f2a6c-ac7b-49cd-9b76-f915fb621154") : secret "image-registry-tls" not found
May 27 23:33:40.256323 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:40.255964    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/be0f2a6c-ac7b-49cd-9b76-f915fb621154-registry-certificates\") pod \"image-registry-77d97f4457-gt2t8\" (UID: \"be0f2a6c-ac7b-49cd-9b76-f915fb621154\") " pod="openshift-image-registry/image-registry-77d97f4457-gt2t8"
May 27 23:33:40.256323 ip-10-0-132-191 kubenswrapper[2557]: E0527 23:33:40.256150    2557 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
May 27 23:33:40.256323 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:40.256155    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/be0f2a6c-ac7b-49cd-9b76-f915fb621154-installation-pull-secrets\") pod \"image-registry-77d97f4457-gt2t8\" (UID: \"be0f2a6c-ac7b-49cd-9b76-f915fb621154\") " pod="openshift-image-registry/image-registry-77d97f4457-gt2t8"
May 27 23:33:40.256323 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:40.256203    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/c1877802-a24c-4e88-ab77-ccd86f39c196-ca\") pod \"cluster-proxy-proxy-agent-67898895db-qdh8p\" (UID: \"c1877802-a24c-4e88-ab77-ccd86f39c196\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-67898895db-qdh8p"
May 27 23:33:40.256323 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:40.256232    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/c1877802-a24c-4e88-ab77-ccd86f39c196-hub\") pod \"cluster-proxy-proxy-agent-67898895db-qdh8p\" (UID: \"c1877802-a24c-4e88-ab77-ccd86f39c196\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-67898895db-qdh8p"
May 27 23:33:40.256323 ip-10-0-132-191 kubenswrapper[2557]: E0527 23:33:40.256257    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b43c1b7d-e8dd-47eb-8e80-92e5120ae59c-cert podName:b43c1b7d-e8dd-47eb-8e80-92e5120ae59c nodeName:}" failed. No retries permitted until 2026-05-27 23:33:40.756235042 +0000 UTC m=+36.175771032 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/b43c1b7d-e8dd-47eb-8e80-92e5120ae59c-cert") pod "ingress-canary-5h2hp" (UID: "b43c1b7d-e8dd-47eb-8e80-92e5120ae59c") : secret "canary-serving-cert" not found
May 27 23:33:40.256323 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:40.256294    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ocpservice-ca\" (UniqueName: \"kubernetes.io/configmap/c1877802-a24c-4e88-ab77-ccd86f39c196-ocpservice-ca\") pod \"cluster-proxy-proxy-agent-67898895db-qdh8p\" (UID: \"c1877802-a24c-4e88-ab77-ccd86f39c196\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-67898895db-qdh8p"
May 27 23:33:40.256721 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:40.256534    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/be0f2a6c-ac7b-49cd-9b76-f915fb621154-ca-trust-extracted\") pod \"image-registry-77d97f4457-gt2t8\" (UID: \"be0f2a6c-ac7b-49cd-9b76-f915fb621154\") " pod="openshift-image-registry/image-registry-77d97f4457-gt2t8"
May 27 23:33:40.256721 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:40.256574    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/be0f2a6c-ac7b-49cd-9b76-f915fb621154-trusted-ca\") pod \"image-registry-77d97f4457-gt2t8\" (UID: \"be0f2a6c-ac7b-49cd-9b76-f915fb621154\") " pod="openshift-image-registry/image-registry-77d97f4457-gt2t8"
May 27 23:33:40.256721 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:40.256602    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-gld7v\" (UniqueName: \"kubernetes.io/projected/b43c1b7d-e8dd-47eb-8e80-92e5120ae59c-kube-api-access-gld7v\") pod \"ingress-canary-5h2hp\" (UID: \"b43c1b7d-e8dd-47eb-8e80-92e5120ae59c\") " pod="openshift-ingress-canary/ingress-canary-5h2hp"
May 27 23:33:40.256721 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:40.256617    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/be0f2a6c-ac7b-49cd-9b76-f915fb621154-registry-certificates\") pod \"image-registry-77d97f4457-gt2t8\" (UID: \"be0f2a6c-ac7b-49cd-9b76-f915fb621154\") " pod="openshift-image-registry/image-registry-77d97f4457-gt2t8"
May 27 23:33:40.256721 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:40.256633    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/ce63e7a9-c155-4635-a015-13d077ba097b-config-volume\") pod \"dns-default-lbgbp\" (UID: \"ce63e7a9-c155-4635-a015-13d077ba097b\") " pod="openshift-dns/dns-default-lbgbp"
May 27 23:33:40.256721 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:40.256672    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bcbfp\" (UniqueName: \"kubernetes.io/projected/ce63e7a9-c155-4635-a015-13d077ba097b-kube-api-access-bcbfp\") pod \"dns-default-lbgbp\" (UID: \"ce63e7a9-c155-4635-a015-13d077ba097b\") " pod="openshift-dns/dns-default-lbgbp"
May 27 23:33:40.256721 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:40.256716    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-kp9m4\" (UniqueName: \"kubernetes.io/projected/be0f2a6c-ac7b-49cd-9b76-f915fb621154-kube-api-access-kp9m4\") pod \"image-registry-77d97f4457-gt2t8\" (UID: \"be0f2a6c-ac7b-49cd-9b76-f915fb621154\") " pod="openshift-image-registry/image-registry-77d97f4457-gt2t8"
May 27 23:33:40.257053 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:40.256743    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ce63e7a9-c155-4635-a015-13d077ba097b-tmp-dir\") pod \"dns-default-lbgbp\" (UID: \"ce63e7a9-c155-4635-a015-13d077ba097b\") " pod="openshift-dns/dns-default-lbgbp"
May 27 23:33:40.257053 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:40.256776    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-jfbmt\" (UniqueName: \"kubernetes.io/projected/c1877802-a24c-4e88-ab77-ccd86f39c196-kube-api-access-jfbmt\") pod \"cluster-proxy-proxy-agent-67898895db-qdh8p\" (UID: \"c1877802-a24c-4e88-ab77-ccd86f39c196\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-67898895db-qdh8p"
May 27 23:33:40.257053 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:40.256808    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/be0f2a6c-ac7b-49cd-9b76-f915fb621154-bound-sa-token\") pod \"image-registry-77d97f4457-gt2t8\" (UID: \"be0f2a6c-ac7b-49cd-9b76-f915fb621154\") " pod="openshift-image-registry/image-registry-77d97f4457-gt2t8"
May 27 23:33:40.257053 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:40.256833    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ce63e7a9-c155-4635-a015-13d077ba097b-metrics-tls\") pod \"dns-default-lbgbp\" (UID: \"ce63e7a9-c155-4635-a015-13d077ba097b\") " pod="openshift-dns/dns-default-lbgbp"
May 27 23:33:40.257053 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:40.256878    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/c1877802-a24c-4e88-ab77-ccd86f39c196-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-67898895db-qdh8p\" (UID: \"c1877802-a24c-4e88-ab77-ccd86f39c196\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-67898895db-qdh8p"
May 27 23:33:40.257053 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:40.256936    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/c1877802-a24c-4e88-ab77-ccd86f39c196-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-67898895db-qdh8p\" (UID: \"c1877802-a24c-4e88-ab77-ccd86f39c196\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-67898895db-qdh8p"
May 27 23:33:40.257053 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:40.256971    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-m46fd\" (UniqueName: \"kubernetes.io/projected/29c8dcc2-2720-4899-8957-ce8476c86626-kube-api-access-m46fd\") pod \"klusterlet-addon-workmgr-84dd97d74c-mmfqg\" (UID: \"29c8dcc2-2720-4899-8957-ce8476c86626\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-84dd97d74c-mmfqg"
May 27 23:33:40.257053 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:40.256990    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/be0f2a6c-ac7b-49cd-9b76-f915fb621154-ca-trust-extracted\") pod \"image-registry-77d97f4457-gt2t8\" (UID: \"be0f2a6c-ac7b-49cd-9b76-f915fb621154\") " pod="openshift-image-registry/image-registry-77d97f4457-gt2t8"
May 27 23:33:40.257480 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:40.257207    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ocpservice-ca\" (UniqueName: \"kubernetes.io/configmap/c1877802-a24c-4e88-ab77-ccd86f39c196-ocpservice-ca\") pod \"cluster-proxy-proxy-agent-67898895db-qdh8p\" (UID: \"c1877802-a24c-4e88-ab77-ccd86f39c196\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-67898895db-qdh8p"
May 27 23:33:40.258567 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:40.257955    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/be0f2a6c-ac7b-49cd-9b76-f915fb621154-trusted-ca\") pod \"image-registry-77d97f4457-gt2t8\" (UID: \"be0f2a6c-ac7b-49cd-9b76-f915fb621154\") " pod="openshift-image-registry/image-registry-77d97f4457-gt2t8"
May 27 23:33:40.258567 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:40.258514    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/29c8dcc2-2720-4899-8957-ce8476c86626-tmp\") pod \"klusterlet-addon-workmgr-84dd97d74c-mmfqg\" (UID: \"29c8dcc2-2720-4899-8957-ce8476c86626\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-84dd97d74c-mmfqg"
May 27 23:33:40.259401 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:40.259256    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/29c8dcc2-2720-4899-8957-ce8476c86626-klusterlet-config\") pod \"klusterlet-addon-workmgr-84dd97d74c-mmfqg\" (UID: \"29c8dcc2-2720-4899-8957-ce8476c86626\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-84dd97d74c-mmfqg"
May 27 23:33:40.259869 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:40.259680    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca\" (UniqueName: \"kubernetes.io/secret/c1877802-a24c-4e88-ab77-ccd86f39c196-ca\") pod \"cluster-proxy-proxy-agent-67898895db-qdh8p\" (UID: \"c1877802-a24c-4e88-ab77-ccd86f39c196\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-67898895db-qdh8p"
May 27 23:33:40.260482 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:40.260149    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/be0f2a6c-ac7b-49cd-9b76-f915fb621154-image-registry-private-configuration\") pod \"image-registry-77d97f4457-gt2t8\" (UID: \"be0f2a6c-ac7b-49cd-9b76-f915fb621154\") " pod="openshift-image-registry/image-registry-77d97f4457-gt2t8"
May 27 23:33:40.260482 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:40.260149    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/c1877802-a24c-4e88-ab77-ccd86f39c196-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-67898895db-qdh8p\" (UID: \"c1877802-a24c-4e88-ab77-ccd86f39c196\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-67898895db-qdh8p"
May 27 23:33:40.260482 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:40.260443    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/c1877802-a24c-4e88-ab77-ccd86f39c196-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-67898895db-qdh8p\" (UID: \"c1877802-a24c-4e88-ab77-ccd86f39c196\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-67898895db-qdh8p"
May 27 23:33:40.261283 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:40.261258    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/be0f2a6c-ac7b-49cd-9b76-f915fb621154-installation-pull-secrets\") pod \"image-registry-77d97f4457-gt2t8\" (UID: \"be0f2a6c-ac7b-49cd-9b76-f915fb621154\") " pod="openshift-image-registry/image-registry-77d97f4457-gt2t8"
May 27 23:33:40.261461 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:40.261445    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub\" (UniqueName: \"kubernetes.io/secret/c1877802-a24c-4e88-ab77-ccd86f39c196-hub\") pod \"cluster-proxy-proxy-agent-67898895db-qdh8p\" (UID: \"c1877802-a24c-4e88-ab77-ccd86f39c196\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-67898895db-qdh8p"
May 27 23:33:40.267076 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:40.267025    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jfbmt\" (UniqueName: \"kubernetes.io/projected/c1877802-a24c-4e88-ab77-ccd86f39c196-kube-api-access-jfbmt\") pod \"cluster-proxy-proxy-agent-67898895db-qdh8p\" (UID: \"c1877802-a24c-4e88-ab77-ccd86f39c196\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-67898895db-qdh8p"
May 27 23:33:40.267650 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:40.267629    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/be0f2a6c-ac7b-49cd-9b76-f915fb621154-bound-sa-token\") pod \"image-registry-77d97f4457-gt2t8\" (UID: \"be0f2a6c-ac7b-49cd-9b76-f915fb621154\") " pod="openshift-image-registry/image-registry-77d97f4457-gt2t8"
May 27 23:33:40.267836 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:40.267777    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gld7v\" (UniqueName: \"kubernetes.io/projected/b43c1b7d-e8dd-47eb-8e80-92e5120ae59c-kube-api-access-gld7v\") pod \"ingress-canary-5h2hp\" (UID: \"b43c1b7d-e8dd-47eb-8e80-92e5120ae59c\") " pod="openshift-ingress-canary/ingress-canary-5h2hp"
May 27 23:33:40.268320 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:40.268300    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kp9m4\" (UniqueName: \"kubernetes.io/projected/be0f2a6c-ac7b-49cd-9b76-f915fb621154-kube-api-access-kp9m4\") pod \"image-registry-77d97f4457-gt2t8\" (UID: \"be0f2a6c-ac7b-49cd-9b76-f915fb621154\") " pod="openshift-image-registry/image-registry-77d97f4457-gt2t8"
May 27 23:33:40.268540 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:40.268516    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-m46fd\" (UniqueName: \"kubernetes.io/projected/29c8dcc2-2720-4899-8957-ce8476c86626-kube-api-access-m46fd\") pod \"klusterlet-addon-workmgr-84dd97d74c-mmfqg\" (UID: \"29c8dcc2-2720-4899-8957-ce8476c86626\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-84dd97d74c-mmfqg"
May 27 23:33:40.283109 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:40.283088    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7b7db96d88-22q6v"
May 27 23:33:40.289784 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:40.289758    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-84dd97d74c-mmfqg"
May 27 23:33:40.305142 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:40.305108    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-67898895db-qdh8p"
May 27 23:33:40.359218 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:40.358489    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ce63e7a9-c155-4635-a015-13d077ba097b-tmp-dir\") pod \"dns-default-lbgbp\" (UID: \"ce63e7a9-c155-4635-a015-13d077ba097b\") " pod="openshift-dns/dns-default-lbgbp"
May 27 23:33:40.359218 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:40.358532    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ce63e7a9-c155-4635-a015-13d077ba097b-metrics-tls\") pod \"dns-default-lbgbp\" (UID: \"ce63e7a9-c155-4635-a015-13d077ba097b\") " pod="openshift-dns/dns-default-lbgbp"
May 27 23:33:40.359218 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:40.358626    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/ce63e7a9-c155-4635-a015-13d077ba097b-config-volume\") pod \"dns-default-lbgbp\" (UID: \"ce63e7a9-c155-4635-a015-13d077ba097b\") " pod="openshift-dns/dns-default-lbgbp"
May 27 23:33:40.359218 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:40.358644    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-bcbfp\" (UniqueName: \"kubernetes.io/projected/ce63e7a9-c155-4635-a015-13d077ba097b-kube-api-access-bcbfp\") pod \"dns-default-lbgbp\" (UID: \"ce63e7a9-c155-4635-a015-13d077ba097b\") " pod="openshift-dns/dns-default-lbgbp"
May 27 23:33:40.359518 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:40.359256    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ce63e7a9-c155-4635-a015-13d077ba097b-tmp-dir\") pod \"dns-default-lbgbp\" (UID: \"ce63e7a9-c155-4635-a015-13d077ba097b\") " pod="openshift-dns/dns-default-lbgbp"
May 27 23:33:40.359518 ip-10-0-132-191 kubenswrapper[2557]: E0527 23:33:40.359381    2557 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
May 27 23:33:40.359518 ip-10-0-132-191 kubenswrapper[2557]: E0527 23:33:40.359454    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ce63e7a9-c155-4635-a015-13d077ba097b-metrics-tls podName:ce63e7a9-c155-4635-a015-13d077ba097b nodeName:}" failed. No retries permitted until 2026-05-27 23:33:40.859431099 +0000 UTC m=+36.278967093 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/ce63e7a9-c155-4635-a015-13d077ba097b-metrics-tls") pod "dns-default-lbgbp" (UID: "ce63e7a9-c155-4635-a015-13d077ba097b") : secret "dns-default-metrics-tls" not found
May 27 23:33:40.360226 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:40.360195    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/ce63e7a9-c155-4635-a015-13d077ba097b-config-volume\") pod \"dns-default-lbgbp\" (UID: \"ce63e7a9-c155-4635-a015-13d077ba097b\") " pod="openshift-dns/dns-default-lbgbp"
May 27 23:33:40.368863 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:40.368830    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bcbfp\" (UniqueName: \"kubernetes.io/projected/ce63e7a9-c155-4635-a015-13d077ba097b-kube-api-access-bcbfp\") pod \"dns-default-lbgbp\" (UID: \"ce63e7a9-c155-4635-a015-13d077ba097b\") " pod="openshift-dns/dns-default-lbgbp"
May 27 23:33:40.460721 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:40.460665    2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7b7db96d88-22q6v"]
May 27 23:33:40.463373 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:40.463232    2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-67898895db-qdh8p"]
May 27 23:33:40.465907 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:40.465883    2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-84dd97d74c-mmfqg"]
May 27 23:33:40.467363 ip-10-0-132-191 kubenswrapper[2557]: W0527 23:33:40.467333    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poda112e1d0_b4a6_4e2a_8400_130d5e93312e.slice/crio-7679873b965fd2e8f9547bc7ca858653cc7f7af1ac76760588b9cc8639cd3305 WatchSource:0}: Error finding container 7679873b965fd2e8f9547bc7ca858653cc7f7af1ac76760588b9cc8639cd3305: Status 404 returned error can't find the container with id 7679873b965fd2e8f9547bc7ca858653cc7f7af1ac76760588b9cc8639cd3305
May 27 23:33:40.468468 ip-10-0-132-191 kubenswrapper[2557]: W0527 23:33:40.468434    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podc1877802_a24c_4e88_ab77_ccd86f39c196.slice/crio-267ed7bcae02626bccf0f537465569d99c38112e87c9a1d617a3fb29867bf62f WatchSource:0}: Error finding container 267ed7bcae02626bccf0f537465569d99c38112e87c9a1d617a3fb29867bf62f: Status 404 returned error can't find the container with id 267ed7bcae02626bccf0f537465569d99c38112e87c9a1d617a3fb29867bf62f
May 27 23:33:40.470891 ip-10-0-132-191 kubenswrapper[2557]: W0527 23:33:40.470869    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod29c8dcc2_2720_4899_8957_ce8476c86626.slice/crio-47245311ae0ad3243b6f68da1197a2ac1cfc5adaaafd485d7158ed518dfbc8ee WatchSource:0}: Error finding container 47245311ae0ad3243b6f68da1197a2ac1cfc5adaaafd485d7158ed518dfbc8ee: Status 404 returned error can't find the container with id 47245311ae0ad3243b6f68da1197a2ac1cfc5adaaafd485d7158ed518dfbc8ee
May 27 23:33:40.761300 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:40.761186    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b43c1b7d-e8dd-47eb-8e80-92e5120ae59c-cert\") pod \"ingress-canary-5h2hp\" (UID: \"b43c1b7d-e8dd-47eb-8e80-92e5120ae59c\") " pod="openshift-ingress-canary/ingress-canary-5h2hp"
May 27 23:33:40.761473 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:40.761302    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/be0f2a6c-ac7b-49cd-9b76-f915fb621154-registry-tls\") pod \"image-registry-77d97f4457-gt2t8\" (UID: \"be0f2a6c-ac7b-49cd-9b76-f915fb621154\") " pod="openshift-image-registry/image-registry-77d97f4457-gt2t8"
May 27 23:33:40.761473 ip-10-0-132-191 kubenswrapper[2557]: E0527 23:33:40.761362    2557 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
May 27 23:33:40.761473 ip-10-0-132-191 kubenswrapper[2557]: E0527 23:33:40.761397    2557 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
May 27 23:33:40.761473 ip-10-0-132-191 kubenswrapper[2557]: E0527 23:33:40.761412    2557 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-77d97f4457-gt2t8: secret "image-registry-tls" not found
May 27 23:33:40.761473 ip-10-0-132-191 kubenswrapper[2557]: E0527 23:33:40.761432    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b43c1b7d-e8dd-47eb-8e80-92e5120ae59c-cert podName:b43c1b7d-e8dd-47eb-8e80-92e5120ae59c nodeName:}" failed. No retries permitted until 2026-05-27 23:33:41.761415161 +0000 UTC m=+37.180951153 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/b43c1b7d-e8dd-47eb-8e80-92e5120ae59c-cert") pod "ingress-canary-5h2hp" (UID: "b43c1b7d-e8dd-47eb-8e80-92e5120ae59c") : secret "canary-serving-cert" not found
May 27 23:33:40.761473 ip-10-0-132-191 kubenswrapper[2557]: E0527 23:33:40.761453    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/be0f2a6c-ac7b-49cd-9b76-f915fb621154-registry-tls podName:be0f2a6c-ac7b-49cd-9b76-f915fb621154 nodeName:}" failed. No retries permitted until 2026-05-27 23:33:41.761439195 +0000 UTC m=+37.180975184 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/be0f2a6c-ac7b-49cd-9b76-f915fb621154-registry-tls") pod "image-registry-77d97f4457-gt2t8" (UID: "be0f2a6c-ac7b-49cd-9b76-f915fb621154") : secret "image-registry-tls" not found
May 27 23:33:40.862491 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:40.862454    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ce63e7a9-c155-4635-a015-13d077ba097b-metrics-tls\") pod \"dns-default-lbgbp\" (UID: \"ce63e7a9-c155-4635-a015-13d077ba097b\") " pod="openshift-dns/dns-default-lbgbp"
May 27 23:33:40.862657 ip-10-0-132-191 kubenswrapper[2557]: E0527 23:33:40.862596    2557 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
May 27 23:33:40.862717 ip-10-0-132-191 kubenswrapper[2557]: E0527 23:33:40.862662    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ce63e7a9-c155-4635-a015-13d077ba097b-metrics-tls podName:ce63e7a9-c155-4635-a015-13d077ba097b nodeName:}" failed. No retries permitted until 2026-05-27 23:33:41.862643687 +0000 UTC m=+37.282179677 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/ce63e7a9-c155-4635-a015-13d077ba097b-metrics-tls") pod "dns-default-lbgbp" (UID: "ce63e7a9-c155-4635-a015-13d077ba097b") : secret "dns-default-metrics-tls" not found
May 27 23:33:41.198146 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:41.198091    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zvbqn"
May 27 23:33:41.198788 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:41.198091    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gz67s"
May 27 23:33:41.198788 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:41.198091    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tsxk6"
May 27 23:33:41.201417 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:41.201364    2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
May 27 23:33:41.201562 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:41.201425    2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
May 27 23:33:41.202645 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:41.202621    2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
May 27 23:33:41.202763 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:41.202733    2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-8jlf4\""
May 27 23:33:41.202763 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:41.202731    2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-ptj7k\""
May 27 23:33:41.202865 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:41.202847    2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
May 27 23:33:41.266851 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:41.266777    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c2d45389-8733-498a-a898-6cc40f57fbac-original-pull-secret\") pod \"global-pull-secret-syncer-gz67s\" (UID: \"c2d45389-8733-498a-a898-6cc40f57fbac\") " pod="kube-system/global-pull-secret-syncer-gz67s"
May 27 23:33:41.270229 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:41.270204    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c2d45389-8733-498a-a898-6cc40f57fbac-original-pull-secret\") pod \"global-pull-secret-syncer-gz67s\" (UID: \"c2d45389-8733-498a-a898-6cc40f57fbac\") " pod="kube-system/global-pull-secret-syncer-gz67s"
May 27 23:33:41.337576 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:41.337536    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-67898895db-qdh8p" event={"ID":"c1877802-a24c-4e88-ab77-ccd86f39c196","Type":"ContainerStarted","Data":"267ed7bcae02626bccf0f537465569d99c38112e87c9a1d617a3fb29867bf62f"}
May 27 23:33:41.341533 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:41.340688    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-84dd97d74c-mmfqg" event={"ID":"29c8dcc2-2720-4899-8957-ce8476c86626","Type":"ContainerStarted","Data":"47245311ae0ad3243b6f68da1197a2ac1cfc5adaaafd485d7158ed518dfbc8ee"}
May 27 23:33:41.342100 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:41.342074    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7b7db96d88-22q6v" event={"ID":"a112e1d0-b4a6-4e2a-8400-130d5e93312e","Type":"ContainerStarted","Data":"7679873b965fd2e8f9547bc7ca858653cc7f7af1ac76760588b9cc8639cd3305"}
May 27 23:33:41.520801 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:41.520231    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gz67s"
May 27 23:33:41.729096 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:41.729050    2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-gz67s"]
May 27 23:33:41.736782 ip-10-0-132-191 kubenswrapper[2557]: W0527 23:33:41.736749    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc2d45389_8733_498a_a898_6cc40f57fbac.slice/crio-af1dbbef20b8ff65a1eea94d05b9e9e3345018aa1a3f6a46a991551271c85aec WatchSource:0}: Error finding container af1dbbef20b8ff65a1eea94d05b9e9e3345018aa1a3f6a46a991551271c85aec: Status 404 returned error can't find the container with id af1dbbef20b8ff65a1eea94d05b9e9e3345018aa1a3f6a46a991551271c85aec
May 27 23:33:41.771701 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:41.771405    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/be0f2a6c-ac7b-49cd-9b76-f915fb621154-registry-tls\") pod \"image-registry-77d97f4457-gt2t8\" (UID: \"be0f2a6c-ac7b-49cd-9b76-f915fb621154\") " pod="openshift-image-registry/image-registry-77d97f4457-gt2t8"
May 27 23:33:41.771701 ip-10-0-132-191 kubenswrapper[2557]: E0527 23:33:41.771441    2557 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
May 27 23:33:41.771701 ip-10-0-132-191 kubenswrapper[2557]: E0527 23:33:41.771462    2557 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-77d97f4457-gt2t8: secret "image-registry-tls" not found
May 27 23:33:41.771701 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:41.771491    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b43c1b7d-e8dd-47eb-8e80-92e5120ae59c-cert\") pod \"ingress-canary-5h2hp\" (UID: \"b43c1b7d-e8dd-47eb-8e80-92e5120ae59c\") " pod="openshift-ingress-canary/ingress-canary-5h2hp"
May 27 23:33:41.771701 ip-10-0-132-191 kubenswrapper[2557]: E0527 23:33:41.771521    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/be0f2a6c-ac7b-49cd-9b76-f915fb621154-registry-tls podName:be0f2a6c-ac7b-49cd-9b76-f915fb621154 nodeName:}" failed. No retries permitted until 2026-05-27 23:33:43.771501462 +0000 UTC m=+39.191037456 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/be0f2a6c-ac7b-49cd-9b76-f915fb621154-registry-tls") pod "image-registry-77d97f4457-gt2t8" (UID: "be0f2a6c-ac7b-49cd-9b76-f915fb621154") : secret "image-registry-tls" not found
May 27 23:33:41.771701 ip-10-0-132-191 kubenswrapper[2557]: E0527 23:33:41.771578    2557 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
May 27 23:33:41.771701 ip-10-0-132-191 kubenswrapper[2557]: E0527 23:33:41.771628    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b43c1b7d-e8dd-47eb-8e80-92e5120ae59c-cert podName:b43c1b7d-e8dd-47eb-8e80-92e5120ae59c nodeName:}" failed. No retries permitted until 2026-05-27 23:33:43.771612658 +0000 UTC m=+39.191148661 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/b43c1b7d-e8dd-47eb-8e80-92e5120ae59c-cert") pod "ingress-canary-5h2hp" (UID: "b43c1b7d-e8dd-47eb-8e80-92e5120ae59c") : secret "canary-serving-cert" not found
May 27 23:33:41.873310 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:41.872698    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ce63e7a9-c155-4635-a015-13d077ba097b-metrics-tls\") pod \"dns-default-lbgbp\" (UID: \"ce63e7a9-c155-4635-a015-13d077ba097b\") " pod="openshift-dns/dns-default-lbgbp"
May 27 23:33:41.873310 ip-10-0-132-191 kubenswrapper[2557]: E0527 23:33:41.872843    2557 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
May 27 23:33:41.873310 ip-10-0-132-191 kubenswrapper[2557]: E0527 23:33:41.872902    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ce63e7a9-c155-4635-a015-13d077ba097b-metrics-tls podName:ce63e7a9-c155-4635-a015-13d077ba097b nodeName:}" failed. No retries permitted until 2026-05-27 23:33:43.872884166 +0000 UTC m=+39.292420162 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/ce63e7a9-c155-4635-a015-13d077ba097b-metrics-tls") pod "dns-default-lbgbp" (UID: "ce63e7a9-c155-4635-a015-13d077ba097b") : secret "dns-default-metrics-tls" not found
May 27 23:33:42.348238 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:42.348121    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-gz67s" event={"ID":"c2d45389-8733-498a-a898-6cc40f57fbac","Type":"ContainerStarted","Data":"af1dbbef20b8ff65a1eea94d05b9e9e3345018aa1a3f6a46a991551271c85aec"}
May 27 23:33:43.793284 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:43.792691    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/be0f2a6c-ac7b-49cd-9b76-f915fb621154-registry-tls\") pod \"image-registry-77d97f4457-gt2t8\" (UID: \"be0f2a6c-ac7b-49cd-9b76-f915fb621154\") " pod="openshift-image-registry/image-registry-77d97f4457-gt2t8"
May 27 23:33:43.793284 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:43.792758    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b43c1b7d-e8dd-47eb-8e80-92e5120ae59c-cert\") pod \"ingress-canary-5h2hp\" (UID: \"b43c1b7d-e8dd-47eb-8e80-92e5120ae59c\") " pod="openshift-ingress-canary/ingress-canary-5h2hp"
May 27 23:33:43.793284 ip-10-0-132-191 kubenswrapper[2557]: E0527 23:33:43.792841    2557 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
May 27 23:33:43.793284 ip-10-0-132-191 kubenswrapper[2557]: E0527 23:33:43.792865    2557 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-77d97f4457-gt2t8: secret "image-registry-tls" not found
May 27 23:33:43.793284 ip-10-0-132-191 kubenswrapper[2557]: E0527 23:33:43.792868    2557 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
May 27 23:33:43.793284 ip-10-0-132-191 kubenswrapper[2557]: E0527 23:33:43.792923    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b43c1b7d-e8dd-47eb-8e80-92e5120ae59c-cert podName:b43c1b7d-e8dd-47eb-8e80-92e5120ae59c nodeName:}" failed. No retries permitted until 2026-05-27 23:33:47.792907015 +0000 UTC m=+43.212443004 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/b43c1b7d-e8dd-47eb-8e80-92e5120ae59c-cert") pod "ingress-canary-5h2hp" (UID: "b43c1b7d-e8dd-47eb-8e80-92e5120ae59c") : secret "canary-serving-cert" not found
May 27 23:33:43.793284 ip-10-0-132-191 kubenswrapper[2557]: E0527 23:33:43.792939    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/be0f2a6c-ac7b-49cd-9b76-f915fb621154-registry-tls podName:be0f2a6c-ac7b-49cd-9b76-f915fb621154 nodeName:}" failed. No retries permitted until 2026-05-27 23:33:47.792933216 +0000 UTC m=+43.212469206 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/be0f2a6c-ac7b-49cd-9b76-f915fb621154-registry-tls") pod "image-registry-77d97f4457-gt2t8" (UID: "be0f2a6c-ac7b-49cd-9b76-f915fb621154") : secret "image-registry-tls" not found
May 27 23:33:43.893567 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:43.893523    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ce63e7a9-c155-4635-a015-13d077ba097b-metrics-tls\") pod \"dns-default-lbgbp\" (UID: \"ce63e7a9-c155-4635-a015-13d077ba097b\") " pod="openshift-dns/dns-default-lbgbp"
May 27 23:33:43.893724 ip-10-0-132-191 kubenswrapper[2557]: E0527 23:33:43.893663    2557 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
May 27 23:33:43.893776 ip-10-0-132-191 kubenswrapper[2557]: E0527 23:33:43.893733    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ce63e7a9-c155-4635-a015-13d077ba097b-metrics-tls podName:ce63e7a9-c155-4635-a015-13d077ba097b nodeName:}" failed. No retries permitted until 2026-05-27 23:33:47.893711234 +0000 UTC m=+43.313247245 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/ce63e7a9-c155-4635-a015-13d077ba097b-metrics-tls") pod "dns-default-lbgbp" (UID: "ce63e7a9-c155-4635-a015-13d077ba097b") : secret "dns-default-metrics-tls" not found
May 27 23:33:47.830229 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:47.830179    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/be0f2a6c-ac7b-49cd-9b76-f915fb621154-registry-tls\") pod \"image-registry-77d97f4457-gt2t8\" (UID: \"be0f2a6c-ac7b-49cd-9b76-f915fb621154\") " pod="openshift-image-registry/image-registry-77d97f4457-gt2t8"
May 27 23:33:47.830759 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:47.830263    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b43c1b7d-e8dd-47eb-8e80-92e5120ae59c-cert\") pod \"ingress-canary-5h2hp\" (UID: \"b43c1b7d-e8dd-47eb-8e80-92e5120ae59c\") " pod="openshift-ingress-canary/ingress-canary-5h2hp"
May 27 23:33:47.830759 ip-10-0-132-191 kubenswrapper[2557]: E0527 23:33:47.830364    2557 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
May 27 23:33:47.830759 ip-10-0-132-191 kubenswrapper[2557]: E0527 23:33:47.830384    2557 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-77d97f4457-gt2t8: secret "image-registry-tls" not found
May 27 23:33:47.830759 ip-10-0-132-191 kubenswrapper[2557]: E0527 23:33:47.830401    2557 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
May 27 23:33:47.830759 ip-10-0-132-191 kubenswrapper[2557]: E0527 23:33:47.830463    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/be0f2a6c-ac7b-49cd-9b76-f915fb621154-registry-tls podName:be0f2a6c-ac7b-49cd-9b76-f915fb621154 nodeName:}" failed. No retries permitted until 2026-05-27 23:33:55.830446916 +0000 UTC m=+51.249982909 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/be0f2a6c-ac7b-49cd-9b76-f915fb621154-registry-tls") pod "image-registry-77d97f4457-gt2t8" (UID: "be0f2a6c-ac7b-49cd-9b76-f915fb621154") : secret "image-registry-tls" not found
May 27 23:33:47.830759 ip-10-0-132-191 kubenswrapper[2557]: E0527 23:33:47.830481    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b43c1b7d-e8dd-47eb-8e80-92e5120ae59c-cert podName:b43c1b7d-e8dd-47eb-8e80-92e5120ae59c nodeName:}" failed. No retries permitted until 2026-05-27 23:33:55.830473814 +0000 UTC m=+51.250009804 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/b43c1b7d-e8dd-47eb-8e80-92e5120ae59c-cert") pod "ingress-canary-5h2hp" (UID: "b43c1b7d-e8dd-47eb-8e80-92e5120ae59c") : secret "canary-serving-cert" not found
May 27 23:33:47.931305 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:47.931265    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ce63e7a9-c155-4635-a015-13d077ba097b-metrics-tls\") pod \"dns-default-lbgbp\" (UID: \"ce63e7a9-c155-4635-a015-13d077ba097b\") " pod="openshift-dns/dns-default-lbgbp"
May 27 23:33:47.931496 ip-10-0-132-191 kubenswrapper[2557]: E0527 23:33:47.931439    2557 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
May 27 23:33:47.931562 ip-10-0-132-191 kubenswrapper[2557]: E0527 23:33:47.931539    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ce63e7a9-c155-4635-a015-13d077ba097b-metrics-tls podName:ce63e7a9-c155-4635-a015-13d077ba097b nodeName:}" failed. No retries permitted until 2026-05-27 23:33:55.931516132 +0000 UTC m=+51.351052122 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/ce63e7a9-c155-4635-a015-13d077ba097b-metrics-tls") pod "dns-default-lbgbp" (UID: "ce63e7a9-c155-4635-a015-13d077ba097b") : secret "dns-default-metrics-tls" not found
May 27 23:33:52.370302 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:52.370265    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-84dd97d74c-mmfqg" event={"ID":"29c8dcc2-2720-4899-8957-ce8476c86626","Type":"ContainerStarted","Data":"23d1aa3576e1bb9b3f6adfa90f0634fd8bba4047630c92042565c40c85101f83"}
May 27 23:33:52.370757 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:52.370478    2557 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-84dd97d74c-mmfqg"
May 27 23:33:52.371635 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:52.371604    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7b7db96d88-22q6v" event={"ID":"a112e1d0-b4a6-4e2a-8400-130d5e93312e","Type":"ContainerStarted","Data":"176f22ab32caffb73e32b570f23949da1d72b74852582585c6e3871a7fd6c189"}
May 27 23:33:52.372427 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:52.372406    2557 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-84dd97d74c-mmfqg"
May 27 23:33:52.372922 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:52.372904    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-gz67s" event={"ID":"c2d45389-8733-498a-a898-6cc40f57fbac","Type":"ContainerStarted","Data":"632aa2cb4e364043c1a7add7372f4d7314e1bb0e51b30c044580c649a50ca0d1"}
May 27 23:33:52.375090 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:52.375070    2557 generic.go:358] "Generic (PLEG): container finished" podID="1a2fc634-3712-40ee-bfce-e8aaee0791f2" containerID="397e560f8ce243d07c94a9a3b1e2816df3e3d26da528776b5cb937cab14654da" exitCode=0
May 27 23:33:52.375181 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:52.375121    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-7p5w7" event={"ID":"1a2fc634-3712-40ee-bfce-e8aaee0791f2","Type":"ContainerDied","Data":"397e560f8ce243d07c94a9a3b1e2816df3e3d26da528776b5cb937cab14654da"}
May 27 23:33:52.391023 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:52.390974    2557 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-84dd97d74c-mmfqg" podStartSLOduration=22.914135213 podStartE2EDuration="34.390957925s" podCreationTimestamp="2026-05-27 23:33:18 +0000 UTC" firstStartedPulling="2026-05-27 23:33:40.47252329 +0000 UTC m=+35.892059293" lastFinishedPulling="2026-05-27 23:33:51.949346012 +0000 UTC m=+47.368882005" observedRunningTime="2026-05-27 23:33:52.389636737 +0000 UTC m=+47.809172751" watchObservedRunningTime="2026-05-27 23:33:52.390957925 +0000 UTC m=+47.810493939"
May 27 23:33:52.404789 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:52.404743    2557 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-gz67s" podStartSLOduration=33.19492577 podStartE2EDuration="43.404729615s" podCreationTimestamp="2026-05-27 23:33:09 +0000 UTC" firstStartedPulling="2026-05-27 23:33:41.740314205 +0000 UTC m=+37.159850197" lastFinishedPulling="2026-05-27 23:33:51.950118042 +0000 UTC m=+47.369654042" observedRunningTime="2026-05-27 23:33:52.403812329 +0000 UTC m=+47.823348344" watchObservedRunningTime="2026-05-27 23:33:52.404729615 +0000 UTC m=+47.824265626"
May 27 23:33:52.441046 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:52.441001    2557 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7b7db96d88-22q6v" podStartSLOduration=22.953902763 podStartE2EDuration="34.440986775s" podCreationTimestamp="2026-05-27 23:33:18 +0000 UTC" firstStartedPulling="2026-05-27 23:33:40.469724921 +0000 UTC m=+35.889260912" lastFinishedPulling="2026-05-27 23:33:51.956808934 +0000 UTC m=+47.376344924" observedRunningTime="2026-05-27 23:33:52.440541946 +0000 UTC m=+47.860077959" watchObservedRunningTime="2026-05-27 23:33:52.440986775 +0000 UTC m=+47.860522786"
May 27 23:33:53.378856 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:53.378811    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-67898895db-qdh8p" event={"ID":"c1877802-a24c-4e88-ab77-ccd86f39c196","Type":"ContainerStarted","Data":"452651624dc712722020393db5ad356ba7d44b782cb0741508a66c02d46fdee0"}
May 27 23:33:53.381334 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:53.381308    2557 generic.go:358] "Generic (PLEG): container finished" podID="1a2fc634-3712-40ee-bfce-e8aaee0791f2" containerID="ee51ed921d1a1eefffb4571f712f665817793c2b4fe14ae6ac2b1898c20db98b" exitCode=0
May 27 23:33:53.381458 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:53.381372    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-7p5w7" event={"ID":"1a2fc634-3712-40ee-bfce-e8aaee0791f2","Type":"ContainerDied","Data":"ee51ed921d1a1eefffb4571f712f665817793c2b4fe14ae6ac2b1898c20db98b"}
May 27 23:33:54.385922 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:54.385887    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-7p5w7" event={"ID":"1a2fc634-3712-40ee-bfce-e8aaee0791f2","Type":"ContainerStarted","Data":"49102961eeb42ea8b94d89643aa53b4cde725f9f82773ba7df83c94573d56055"}
May 27 23:33:54.410280 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:54.410233    2557 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-7p5w7" podStartSLOduration=5.345144602 podStartE2EDuration="49.410219109s" podCreationTimestamp="2026-05-27 23:33:05 +0000 UTC" firstStartedPulling="2026-05-27 23:33:07.883207381 +0000 UTC m=+3.302743371" lastFinishedPulling="2026-05-27 23:33:51.948281879 +0000 UTC m=+47.367817878" observedRunningTime="2026-05-27 23:33:54.408497359 +0000 UTC m=+49.828033365" watchObservedRunningTime="2026-05-27 23:33:54.410219109 +0000 UTC m=+49.829755168"
May 27 23:33:55.896865 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:55.896825    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/be0f2a6c-ac7b-49cd-9b76-f915fb621154-registry-tls\") pod \"image-registry-77d97f4457-gt2t8\" (UID: \"be0f2a6c-ac7b-49cd-9b76-f915fb621154\") " pod="openshift-image-registry/image-registry-77d97f4457-gt2t8"
May 27 23:33:55.896865 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:55.896871    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b43c1b7d-e8dd-47eb-8e80-92e5120ae59c-cert\") pod \"ingress-canary-5h2hp\" (UID: \"b43c1b7d-e8dd-47eb-8e80-92e5120ae59c\") " pod="openshift-ingress-canary/ingress-canary-5h2hp"
May 27 23:33:55.897309 ip-10-0-132-191 kubenswrapper[2557]: E0527 23:33:55.896971    2557 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
May 27 23:33:55.897309 ip-10-0-132-191 kubenswrapper[2557]: E0527 23:33:55.896975    2557 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
May 27 23:33:55.897309 ip-10-0-132-191 kubenswrapper[2557]: E0527 23:33:55.896994    2557 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-77d97f4457-gt2t8: secret "image-registry-tls" not found
May 27 23:33:55.897309 ip-10-0-132-191 kubenswrapper[2557]: E0527 23:33:55.897029    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b43c1b7d-e8dd-47eb-8e80-92e5120ae59c-cert podName:b43c1b7d-e8dd-47eb-8e80-92e5120ae59c nodeName:}" failed. No retries permitted until 2026-05-27 23:34:11.897013355 +0000 UTC m=+67.316549349 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/b43c1b7d-e8dd-47eb-8e80-92e5120ae59c-cert") pod "ingress-canary-5h2hp" (UID: "b43c1b7d-e8dd-47eb-8e80-92e5120ae59c") : secret "canary-serving-cert" not found
May 27 23:33:55.897309 ip-10-0-132-191 kubenswrapper[2557]: E0527 23:33:55.897045    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/be0f2a6c-ac7b-49cd-9b76-f915fb621154-registry-tls podName:be0f2a6c-ac7b-49cd-9b76-f915fb621154 nodeName:}" failed. No retries permitted until 2026-05-27 23:34:11.897036913 +0000 UTC m=+67.316572903 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/be0f2a6c-ac7b-49cd-9b76-f915fb621154-registry-tls") pod "image-registry-77d97f4457-gt2t8" (UID: "be0f2a6c-ac7b-49cd-9b76-f915fb621154") : secret "image-registry-tls" not found
May 27 23:33:55.997413 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:33:55.997377    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ce63e7a9-c155-4635-a015-13d077ba097b-metrics-tls\") pod \"dns-default-lbgbp\" (UID: \"ce63e7a9-c155-4635-a015-13d077ba097b\") " pod="openshift-dns/dns-default-lbgbp"
May 27 23:33:55.997543 ip-10-0-132-191 kubenswrapper[2557]: E0527 23:33:55.997526    2557 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
May 27 23:33:55.997596 ip-10-0-132-191 kubenswrapper[2557]: E0527 23:33:55.997586    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ce63e7a9-c155-4635-a015-13d077ba097b-metrics-tls podName:ce63e7a9-c155-4635-a015-13d077ba097b nodeName:}" failed. No retries permitted until 2026-05-27 23:34:11.997571101 +0000 UTC m=+67.417107091 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/ce63e7a9-c155-4635-a015-13d077ba097b-metrics-tls") pod "dns-default-lbgbp" (UID: "ce63e7a9-c155-4635-a015-13d077ba097b") : secret "dns-default-metrics-tls" not found
May 27 23:34:02.403519 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:34:02.403480    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-67898895db-qdh8p" event={"ID":"c1877802-a24c-4e88-ab77-ccd86f39c196","Type":"ContainerStarted","Data":"11b3a41af3fea23c39954e2805946fa26ada50a778098c9f47770a4d96d4e0b0"}
May 27 23:34:02.403519 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:34:02.403520    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-67898895db-qdh8p" event={"ID":"c1877802-a24c-4e88-ab77-ccd86f39c196","Type":"ContainerStarted","Data":"e93d339696174fe3c89a9ac4eaf098beec4ecab3c43b64b79103c7bfa3b9d314"}
May 27 23:34:02.424348 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:34:02.424298    2557 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-67898895db-qdh8p" podStartSLOduration=23.027855799 podStartE2EDuration="44.424285854s" podCreationTimestamp="2026-05-27 23:33:18 +0000 UTC" firstStartedPulling="2026-05-27 23:33:40.47025794 +0000 UTC m=+35.889793946" lastFinishedPulling="2026-05-27 23:34:01.866688001 +0000 UTC m=+57.286224001" observedRunningTime="2026-05-27 23:34:02.423002076 +0000 UTC m=+57.842538085" watchObservedRunningTime="2026-05-27 23:34:02.424285854 +0000 UTC m=+57.843821860"
May 27 23:34:04.864601 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:34:04.864575    2557 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-s7vdp"
May 27 23:34:10.920154 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:34:10.920079    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c4d68b58-b4f3-4f03-a21c-321ca3eebe68-metrics-certs\") pod \"network-metrics-daemon-zvbqn\" (UID: \"c4d68b58-b4f3-4f03-a21c-321ca3eebe68\") " pod="openshift-multus/network-metrics-daemon-zvbqn"
May 27 23:34:10.923195 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:34:10.923174    2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
May 27 23:34:10.930576 ip-10-0-132-191 kubenswrapper[2557]: E0527 23:34:10.930554    2557 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
May 27 23:34:10.930626 ip-10-0-132-191 kubenswrapper[2557]: E0527 23:34:10.930614    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c4d68b58-b4f3-4f03-a21c-321ca3eebe68-metrics-certs podName:c4d68b58-b4f3-4f03-a21c-321ca3eebe68 nodeName:}" failed. No retries permitted until 2026-05-27 23:35:14.930598298 +0000 UTC m=+130.350134288 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c4d68b58-b4f3-4f03-a21c-321ca3eebe68-metrics-certs") pod "network-metrics-daemon-zvbqn" (UID: "c4d68b58-b4f3-4f03-a21c-321ca3eebe68") : secret "metrics-daemon-secret" not found
May 27 23:34:11.121742 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:34:11.121708    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-qzzjd\" (UniqueName: \"kubernetes.io/projected/4af77c1c-1265-4e74-b12f-28d888f58380-kube-api-access-qzzjd\") pod \"network-check-target-tsxk6\" (UID: \"4af77c1c-1265-4e74-b12f-28d888f58380\") " pod="openshift-network-diagnostics/network-check-target-tsxk6"
May 27 23:34:11.125030 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:34:11.125012    2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
May 27 23:34:11.135430 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:34:11.135410    2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
May 27 23:34:11.145548 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:34:11.145529    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qzzjd\" (UniqueName: \"kubernetes.io/projected/4af77c1c-1265-4e74-b12f-28d888f58380-kube-api-access-qzzjd\") pod \"network-check-target-tsxk6\" (UID: \"4af77c1c-1265-4e74-b12f-28d888f58380\") " pod="openshift-network-diagnostics/network-check-target-tsxk6"
May 27 23:34:11.231144 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:34:11.231050    2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-ptj7k\""
May 27 23:34:11.238414 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:34:11.238383    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tsxk6"
May 27 23:34:11.361147 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:34:11.361103    2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-tsxk6"]
May 27 23:34:11.364290 ip-10-0-132-191 kubenswrapper[2557]: W0527 23:34:11.364261    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4af77c1c_1265_4e74_b12f_28d888f58380.slice/crio-d9a0392608adf826643d7526b9b76b623895c79fe4abffb222a72e3847cca61e WatchSource:0}: Error finding container d9a0392608adf826643d7526b9b76b623895c79fe4abffb222a72e3847cca61e: Status 404 returned error can't find the container with id d9a0392608adf826643d7526b9b76b623895c79fe4abffb222a72e3847cca61e
May 27 23:34:11.429917 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:34:11.429878    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-tsxk6" event={"ID":"4af77c1c-1265-4e74-b12f-28d888f58380","Type":"ContainerStarted","Data":"d9a0392608adf826643d7526b9b76b623895c79fe4abffb222a72e3847cca61e"}
May 27 23:34:11.927471 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:34:11.927434    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/be0f2a6c-ac7b-49cd-9b76-f915fb621154-registry-tls\") pod \"image-registry-77d97f4457-gt2t8\" (UID: \"be0f2a6c-ac7b-49cd-9b76-f915fb621154\") " pod="openshift-image-registry/image-registry-77d97f4457-gt2t8"
May 27 23:34:11.927471 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:34:11.927479    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b43c1b7d-e8dd-47eb-8e80-92e5120ae59c-cert\") pod \"ingress-canary-5h2hp\" (UID: \"b43c1b7d-e8dd-47eb-8e80-92e5120ae59c\") " pod="openshift-ingress-canary/ingress-canary-5h2hp"
May 27 23:34:11.927988 ip-10-0-132-191 kubenswrapper[2557]: E0527 23:34:11.927586    2557 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
May 27 23:34:11.927988 ip-10-0-132-191 kubenswrapper[2557]: E0527 23:34:11.927654    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b43c1b7d-e8dd-47eb-8e80-92e5120ae59c-cert podName:b43c1b7d-e8dd-47eb-8e80-92e5120ae59c nodeName:}" failed. No retries permitted until 2026-05-27 23:34:43.927638285 +0000 UTC m=+99.347174275 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/b43c1b7d-e8dd-47eb-8e80-92e5120ae59c-cert") pod "ingress-canary-5h2hp" (UID: "b43c1b7d-e8dd-47eb-8e80-92e5120ae59c") : secret "canary-serving-cert" not found
May 27 23:34:11.927988 ip-10-0-132-191 kubenswrapper[2557]: E0527 23:34:11.927590    2557 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
May 27 23:34:11.927988 ip-10-0-132-191 kubenswrapper[2557]: E0527 23:34:11.927680    2557 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-77d97f4457-gt2t8: secret "image-registry-tls" not found
May 27 23:34:11.927988 ip-10-0-132-191 kubenswrapper[2557]: E0527 23:34:11.927720    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/be0f2a6c-ac7b-49cd-9b76-f915fb621154-registry-tls podName:be0f2a6c-ac7b-49cd-9b76-f915fb621154 nodeName:}" failed. No retries permitted until 2026-05-27 23:34:43.927709022 +0000 UTC m=+99.347245025 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/be0f2a6c-ac7b-49cd-9b76-f915fb621154-registry-tls") pod "image-registry-77d97f4457-gt2t8" (UID: "be0f2a6c-ac7b-49cd-9b76-f915fb621154") : secret "image-registry-tls" not found
May 27 23:34:12.028368 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:34:12.028329    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ce63e7a9-c155-4635-a015-13d077ba097b-metrics-tls\") pod \"dns-default-lbgbp\" (UID: \"ce63e7a9-c155-4635-a015-13d077ba097b\") " pod="openshift-dns/dns-default-lbgbp"
May 27 23:34:12.028533 ip-10-0-132-191 kubenswrapper[2557]: E0527 23:34:12.028467    2557 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
May 27 23:34:12.028585 ip-10-0-132-191 kubenswrapper[2557]: E0527 23:34:12.028537    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ce63e7a9-c155-4635-a015-13d077ba097b-metrics-tls podName:ce63e7a9-c155-4635-a015-13d077ba097b nodeName:}" failed. No retries permitted until 2026-05-27 23:34:44.028521623 +0000 UTC m=+99.448057613 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/ce63e7a9-c155-4635-a015-13d077ba097b-metrics-tls") pod "dns-default-lbgbp" (UID: "ce63e7a9-c155-4635-a015-13d077ba097b") : secret "dns-default-metrics-tls" not found
May 27 23:34:15.441699 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:34:15.441665    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-tsxk6" event={"ID":"4af77c1c-1265-4e74-b12f-28d888f58380","Type":"ContainerStarted","Data":"e3ee7f4dbc3f705188f1c1229d769ec0836dd95920c30fab2449d0b05b16dfd9"}
May 27 23:34:15.442069 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:34:15.441823    2557 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-tsxk6"
May 27 23:34:15.460413 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:34:15.460369    2557 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-tsxk6" podStartSLOduration=67.074710958 podStartE2EDuration="1m10.460356288s" podCreationTimestamp="2026-05-27 23:33:05 +0000 UTC" firstStartedPulling="2026-05-27 23:34:11.366022067 +0000 UTC m=+66.785558060" lastFinishedPulling="2026-05-27 23:34:14.7516674 +0000 UTC m=+70.171203390" observedRunningTime="2026-05-27 23:34:15.458990147 +0000 UTC m=+70.878526160" watchObservedRunningTime="2026-05-27 23:34:15.460356288 +0000 UTC m=+70.879892353"
May 27 23:34:43.956745 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:34:43.956703    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/be0f2a6c-ac7b-49cd-9b76-f915fb621154-registry-tls\") pod \"image-registry-77d97f4457-gt2t8\" (UID: \"be0f2a6c-ac7b-49cd-9b76-f915fb621154\") " pod="openshift-image-registry/image-registry-77d97f4457-gt2t8"
May 27 23:34:43.957200 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:34:43.956750    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b43c1b7d-e8dd-47eb-8e80-92e5120ae59c-cert\") pod \"ingress-canary-5h2hp\" (UID: \"b43c1b7d-e8dd-47eb-8e80-92e5120ae59c\") " pod="openshift-ingress-canary/ingress-canary-5h2hp"
May 27 23:34:43.957200 ip-10-0-132-191 kubenswrapper[2557]: E0527 23:34:43.956854    2557 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
May 27 23:34:43.957200 ip-10-0-132-191 kubenswrapper[2557]: E0527 23:34:43.956858    2557 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
May 27 23:34:43.957200 ip-10-0-132-191 kubenswrapper[2557]: E0527 23:34:43.956875    2557 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-77d97f4457-gt2t8: secret "image-registry-tls" not found
May 27 23:34:43.957200 ip-10-0-132-191 kubenswrapper[2557]: E0527 23:34:43.956932    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b43c1b7d-e8dd-47eb-8e80-92e5120ae59c-cert podName:b43c1b7d-e8dd-47eb-8e80-92e5120ae59c nodeName:}" failed. No retries permitted until 2026-05-27 23:35:47.956913377 +0000 UTC m=+163.376449367 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/b43c1b7d-e8dd-47eb-8e80-92e5120ae59c-cert") pod "ingress-canary-5h2hp" (UID: "b43c1b7d-e8dd-47eb-8e80-92e5120ae59c") : secret "canary-serving-cert" not found
May 27 23:34:43.957200 ip-10-0-132-191 kubenswrapper[2557]: E0527 23:34:43.956947    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/be0f2a6c-ac7b-49cd-9b76-f915fb621154-registry-tls podName:be0f2a6c-ac7b-49cd-9b76-f915fb621154 nodeName:}" failed. No retries permitted until 2026-05-27 23:35:47.956940185 +0000 UTC m=+163.376476175 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/be0f2a6c-ac7b-49cd-9b76-f915fb621154-registry-tls") pod "image-registry-77d97f4457-gt2t8" (UID: "be0f2a6c-ac7b-49cd-9b76-f915fb621154") : secret "image-registry-tls" not found
May 27 23:34:44.057067 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:34:44.057030    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ce63e7a9-c155-4635-a015-13d077ba097b-metrics-tls\") pod \"dns-default-lbgbp\" (UID: \"ce63e7a9-c155-4635-a015-13d077ba097b\") " pod="openshift-dns/dns-default-lbgbp"
May 27 23:34:44.057291 ip-10-0-132-191 kubenswrapper[2557]: E0527 23:34:44.057182    2557 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
May 27 23:34:44.057291 ip-10-0-132-191 kubenswrapper[2557]: E0527 23:34:44.057242    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ce63e7a9-c155-4635-a015-13d077ba097b-metrics-tls podName:ce63e7a9-c155-4635-a015-13d077ba097b nodeName:}" failed. No retries permitted until 2026-05-27 23:35:48.057226172 +0000 UTC m=+163.476762163 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/ce63e7a9-c155-4635-a015-13d077ba097b-metrics-tls") pod "dns-default-lbgbp" (UID: "ce63e7a9-c155-4635-a015-13d077ba097b") : secret "dns-default-metrics-tls" not found
May 27 23:34:46.446790 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:34:46.446752    2557 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-tsxk6"
May 27 23:35:04.798744 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:35:04.798711    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-jbbwx_9d47bc2b-bc9c-4887-99e0-c05ffb6c8d0b/dns-node-resolver/0.log"
May 27 23:35:05.198490 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:35:05.198457    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-6bgmn_479d4fa9-d4cb-4d0e-82d4-eb0ec77dbc90/node-ca/0.log"
May 27 23:35:14.980489 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:35:14.980447    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c4d68b58-b4f3-4f03-a21c-321ca3eebe68-metrics-certs\") pod \"network-metrics-daemon-zvbqn\" (UID: \"c4d68b58-b4f3-4f03-a21c-321ca3eebe68\") " pod="openshift-multus/network-metrics-daemon-zvbqn"
May 27 23:35:14.980999 ip-10-0-132-191 kubenswrapper[2557]: E0527 23:35:14.980594    2557 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
May 27 23:35:14.980999 ip-10-0-132-191 kubenswrapper[2557]: E0527 23:35:14.980671    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c4d68b58-b4f3-4f03-a21c-321ca3eebe68-metrics-certs podName:c4d68b58-b4f3-4f03-a21c-321ca3eebe68 nodeName:}" failed. No retries permitted until 2026-05-27 23:37:16.980654338 +0000 UTC m=+252.400190329 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c4d68b58-b4f3-4f03-a21c-321ca3eebe68-metrics-certs") pod "network-metrics-daemon-zvbqn" (UID: "c4d68b58-b4f3-4f03-a21c-321ca3eebe68") : secret "metrics-daemon-secret" not found
May 27 23:35:35.969350 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:35:35.969318    2557 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-pp5wm"]
May 27 23:35:35.971512 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:35:35.971496    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-pp5wm"
May 27 23:35:35.974537 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:35:35.974511    2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
May 27 23:35:35.975635 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:35:35.975616    2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
May 27 23:35:35.975635 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:35:35.975625    2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
May 27 23:35:35.975802 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:35:35.975680    2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
May 27 23:35:35.975930 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:35:35.975913    2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-xkpcw\""
May 27 23:35:35.985561 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:35:35.985538    2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-pp5wm"]
May 27 23:35:36.044444 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:35:36.044412    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/a4cbc2b6-9839-4554-8926-9f826a1d2f98-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-pp5wm\" (UID: \"a4cbc2b6-9839-4554-8926-9f826a1d2f98\") " pod="openshift-insights/insights-runtime-extractor-pp5wm"
May 27 23:35:36.044444 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:35:36.044446    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/a4cbc2b6-9839-4554-8926-9f826a1d2f98-crio-socket\") pod \"insights-runtime-extractor-pp5wm\" (UID: \"a4cbc2b6-9839-4554-8926-9f826a1d2f98\") " pod="openshift-insights/insights-runtime-extractor-pp5wm"
May 27 23:35:36.044643 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:35:36.044494    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vzjvg\" (UniqueName: \"kubernetes.io/projected/a4cbc2b6-9839-4554-8926-9f826a1d2f98-kube-api-access-vzjvg\") pod \"insights-runtime-extractor-pp5wm\" (UID: \"a4cbc2b6-9839-4554-8926-9f826a1d2f98\") " pod="openshift-insights/insights-runtime-extractor-pp5wm"
May 27 23:35:36.044643 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:35:36.044547    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/a4cbc2b6-9839-4554-8926-9f826a1d2f98-data-volume\") pod \"insights-runtime-extractor-pp5wm\" (UID: \"a4cbc2b6-9839-4554-8926-9f826a1d2f98\") " pod="openshift-insights/insights-runtime-extractor-pp5wm"
May 27 23:35:36.044643 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:35:36.044595    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/a4cbc2b6-9839-4554-8926-9f826a1d2f98-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-pp5wm\" (UID: \"a4cbc2b6-9839-4554-8926-9f826a1d2f98\") " pod="openshift-insights/insights-runtime-extractor-pp5wm"
May 27 23:35:36.145527 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:35:36.145496    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-vzjvg\" (UniqueName: \"kubernetes.io/projected/a4cbc2b6-9839-4554-8926-9f826a1d2f98-kube-api-access-vzjvg\") pod \"insights-runtime-extractor-pp5wm\" (UID: \"a4cbc2b6-9839-4554-8926-9f826a1d2f98\") " pod="openshift-insights/insights-runtime-extractor-pp5wm"
May 27 23:35:36.145692 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:35:36.145560    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/a4cbc2b6-9839-4554-8926-9f826a1d2f98-data-volume\") pod \"insights-runtime-extractor-pp5wm\" (UID: \"a4cbc2b6-9839-4554-8926-9f826a1d2f98\") " pod="openshift-insights/insights-runtime-extractor-pp5wm"
May 27 23:35:36.145692 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:35:36.145579    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/a4cbc2b6-9839-4554-8926-9f826a1d2f98-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-pp5wm\" (UID: \"a4cbc2b6-9839-4554-8926-9f826a1d2f98\") " pod="openshift-insights/insights-runtime-extractor-pp5wm"
May 27 23:35:36.145692 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:35:36.145606    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/a4cbc2b6-9839-4554-8926-9f826a1d2f98-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-pp5wm\" (UID: \"a4cbc2b6-9839-4554-8926-9f826a1d2f98\") " pod="openshift-insights/insights-runtime-extractor-pp5wm"
May 27 23:35:36.145810 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:35:36.145719    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/a4cbc2b6-9839-4554-8926-9f826a1d2f98-crio-socket\") pod \"insights-runtime-extractor-pp5wm\" (UID: \"a4cbc2b6-9839-4554-8926-9f826a1d2f98\") " pod="openshift-insights/insights-runtime-extractor-pp5wm"
May 27 23:35:36.145865 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:35:36.145813    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/a4cbc2b6-9839-4554-8926-9f826a1d2f98-crio-socket\") pod \"insights-runtime-extractor-pp5wm\" (UID: \"a4cbc2b6-9839-4554-8926-9f826a1d2f98\") " pod="openshift-insights/insights-runtime-extractor-pp5wm"
May 27 23:35:36.145912 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:35:36.145893    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/a4cbc2b6-9839-4554-8926-9f826a1d2f98-data-volume\") pod \"insights-runtime-extractor-pp5wm\" (UID: \"a4cbc2b6-9839-4554-8926-9f826a1d2f98\") " pod="openshift-insights/insights-runtime-extractor-pp5wm"
May 27 23:35:36.146122 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:35:36.146105    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/a4cbc2b6-9839-4554-8926-9f826a1d2f98-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-pp5wm\" (UID: \"a4cbc2b6-9839-4554-8926-9f826a1d2f98\") " pod="openshift-insights/insights-runtime-extractor-pp5wm"
May 27 23:35:36.147775 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:35:36.147753    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/a4cbc2b6-9839-4554-8926-9f826a1d2f98-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-pp5wm\" (UID: \"a4cbc2b6-9839-4554-8926-9f826a1d2f98\") " pod="openshift-insights/insights-runtime-extractor-pp5wm"
May 27 23:35:36.158512 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:35:36.158483    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vzjvg\" (UniqueName: \"kubernetes.io/projected/a4cbc2b6-9839-4554-8926-9f826a1d2f98-kube-api-access-vzjvg\") pod \"insights-runtime-extractor-pp5wm\" (UID: \"a4cbc2b6-9839-4554-8926-9f826a1d2f98\") " pod="openshift-insights/insights-runtime-extractor-pp5wm"
May 27 23:35:36.280983 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:35:36.280895    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-pp5wm"
May 27 23:35:36.402581 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:35:36.402552    2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-pp5wm"]
May 27 23:35:36.406300 ip-10-0-132-191 kubenswrapper[2557]: W0527 23:35:36.406274    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda4cbc2b6_9839_4554_8926_9f826a1d2f98.slice/crio-d2170c17f54d0915e5c8b3ae06a7d368f511f486d93020f6babb984cf84bcede WatchSource:0}: Error finding container d2170c17f54d0915e5c8b3ae06a7d368f511f486d93020f6babb984cf84bcede: Status 404 returned error can't find the container with id d2170c17f54d0915e5c8b3ae06a7d368f511f486d93020f6babb984cf84bcede
May 27 23:35:36.629940 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:35:36.629902    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-pp5wm" event={"ID":"a4cbc2b6-9839-4554-8926-9f826a1d2f98","Type":"ContainerStarted","Data":"90409df82312412629ea8652fee2772c86ebcbf5e8ecbb5b68e6881c7419292b"}
May 27 23:35:36.629940 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:35:36.629938    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-pp5wm" event={"ID":"a4cbc2b6-9839-4554-8926-9f826a1d2f98","Type":"ContainerStarted","Data":"d2170c17f54d0915e5c8b3ae06a7d368f511f486d93020f6babb984cf84bcede"}
May 27 23:35:37.637091 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:35:37.637053    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-pp5wm" event={"ID":"a4cbc2b6-9839-4554-8926-9f826a1d2f98","Type":"ContainerStarted","Data":"8229bdcb752b3f2ad14cf609fcf750dfd918e04efe4c8b35954e97320e6c4df7"}
May 27 23:35:38.641447 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:35:38.641398    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-pp5wm" event={"ID":"a4cbc2b6-9839-4554-8926-9f826a1d2f98","Type":"ContainerStarted","Data":"9b513d87c74f50246dc473b1720aa0989a468ef2872b5a47986e35ff06a4ab11"}
May 27 23:35:38.666553 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:35:38.666502    2557 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-pp5wm" podStartSLOduration=1.5698955730000002 podStartE2EDuration="3.666488124s" podCreationTimestamp="2026-05-27 23:35:35 +0000 UTC" firstStartedPulling="2026-05-27 23:35:36.454700219 +0000 UTC m=+151.874236209" lastFinishedPulling="2026-05-27 23:35:38.551292767 +0000 UTC m=+153.970828760" observedRunningTime="2026-05-27 23:35:38.665009841 +0000 UTC m=+154.084545867" watchObservedRunningTime="2026-05-27 23:35:38.666488124 +0000 UTC m=+154.086024135"
May 27 23:35:42.995712 ip-10-0-132-191 kubenswrapper[2557]: E0527 23:35:42.995667    2557 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[registry-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-image-registry/image-registry-77d97f4457-gt2t8" podUID="be0f2a6c-ac7b-49cd-9b76-f915fb621154"
May 27 23:35:43.050155 ip-10-0-132-191 kubenswrapper[2557]: E0527 23:35:43.050089    2557 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[cert], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-ingress-canary/ingress-canary-5h2hp" podUID="b43c1b7d-e8dd-47eb-8e80-92e5120ae59c"
May 27 23:35:43.084301 ip-10-0-132-191 kubenswrapper[2557]: E0527 23:35:43.084265    2557 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-lbgbp" podUID="ce63e7a9-c155-4635-a015-13d077ba097b"
May 27 23:35:43.652589 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:35:43.652561    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-77d97f4457-gt2t8"
May 27 23:35:43.652761 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:35:43.652719    2557 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-xbf6b"]
May 27 23:35:43.657366 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:35:43.657340    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-xbf6b"
May 27 23:35:43.662539 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:35:43.662508    2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
May 27 23:35:43.662679 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:35:43.662649    2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-pbz7x\""
May 27 23:35:43.663669 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:35:43.663653    2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
May 27 23:35:43.663854 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:35:43.663837    2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
May 27 23:35:43.663937 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:35:43.663859    2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
May 27 23:35:43.664008 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:35:43.663988    2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
May 27 23:35:43.664357 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:35:43.664080    2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
May 27 23:35:43.807286 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:35:43.807252    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/56080086-b221-4e2c-b0a0-8b6882cfa69c-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-xbf6b\" (UID: \"56080086-b221-4e2c-b0a0-8b6882cfa69c\") " pod="openshift-monitoring/node-exporter-xbf6b"
May 27 23:35:43.807473 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:35:43.807369    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/56080086-b221-4e2c-b0a0-8b6882cfa69c-node-exporter-accelerators-collector-config\") pod \"node-exporter-xbf6b\" (UID: \"56080086-b221-4e2c-b0a0-8b6882cfa69c\") " pod="openshift-monitoring/node-exporter-xbf6b"
May 27 23:35:43.807473 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:35:43.807409    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/56080086-b221-4e2c-b0a0-8b6882cfa69c-metrics-client-ca\") pod \"node-exporter-xbf6b\" (UID: \"56080086-b221-4e2c-b0a0-8b6882cfa69c\") " pod="openshift-monitoring/node-exporter-xbf6b"
May 27 23:35:43.807543 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:35:43.807488    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/56080086-b221-4e2c-b0a0-8b6882cfa69c-node-exporter-wtmp\") pod \"node-exporter-xbf6b\" (UID: \"56080086-b221-4e2c-b0a0-8b6882cfa69c\") " pod="openshift-monitoring/node-exporter-xbf6b"
May 27 23:35:43.807543 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:35:43.807528    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/56080086-b221-4e2c-b0a0-8b6882cfa69c-root\") pod \"node-exporter-xbf6b\" (UID: \"56080086-b221-4e2c-b0a0-8b6882cfa69c\") " pod="openshift-monitoring/node-exporter-xbf6b"
May 27 23:35:43.807606 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:35:43.807581    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/56080086-b221-4e2c-b0a0-8b6882cfa69c-node-exporter-tls\") pod \"node-exporter-xbf6b\" (UID: \"56080086-b221-4e2c-b0a0-8b6882cfa69c\") " pod="openshift-monitoring/node-exporter-xbf6b"
May 27 23:35:43.807668 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:35:43.807646    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z6wcw\" (UniqueName: \"kubernetes.io/projected/56080086-b221-4e2c-b0a0-8b6882cfa69c-kube-api-access-z6wcw\") pod \"node-exporter-xbf6b\" (UID: \"56080086-b221-4e2c-b0a0-8b6882cfa69c\") " pod="openshift-monitoring/node-exporter-xbf6b"
May 27 23:35:43.807802 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:35:43.807785    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/56080086-b221-4e2c-b0a0-8b6882cfa69c-sys\") pod \"node-exporter-xbf6b\" (UID: \"56080086-b221-4e2c-b0a0-8b6882cfa69c\") " pod="openshift-monitoring/node-exporter-xbf6b"
May 27 23:35:43.807846 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:35:43.807818    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/56080086-b221-4e2c-b0a0-8b6882cfa69c-node-exporter-textfile\") pod \"node-exporter-xbf6b\" (UID: \"56080086-b221-4e2c-b0a0-8b6882cfa69c\") " pod="openshift-monitoring/node-exporter-xbf6b"
May 27 23:35:43.908294 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:35:43.908184    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/56080086-b221-4e2c-b0a0-8b6882cfa69c-node-exporter-tls\") pod \"node-exporter-xbf6b\" (UID: \"56080086-b221-4e2c-b0a0-8b6882cfa69c\") " pod="openshift-monitoring/node-exporter-xbf6b"
May 27 23:35:43.908294 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:35:43.908269    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-z6wcw\" (UniqueName: \"kubernetes.io/projected/56080086-b221-4e2c-b0a0-8b6882cfa69c-kube-api-access-z6wcw\") pod \"node-exporter-xbf6b\" (UID: \"56080086-b221-4e2c-b0a0-8b6882cfa69c\") " pod="openshift-monitoring/node-exporter-xbf6b"
May 27 23:35:43.908531 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:35:43.908335    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/56080086-b221-4e2c-b0a0-8b6882cfa69c-sys\") pod \"node-exporter-xbf6b\" (UID: \"56080086-b221-4e2c-b0a0-8b6882cfa69c\") " pod="openshift-monitoring/node-exporter-xbf6b"
May 27 23:35:43.908531 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:35:43.908355    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/56080086-b221-4e2c-b0a0-8b6882cfa69c-node-exporter-textfile\") pod \"node-exporter-xbf6b\" (UID: \"56080086-b221-4e2c-b0a0-8b6882cfa69c\") " pod="openshift-monitoring/node-exporter-xbf6b"
May 27 23:35:43.908531 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:35:43.908381    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/56080086-b221-4e2c-b0a0-8b6882cfa69c-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-xbf6b\" (UID: \"56080086-b221-4e2c-b0a0-8b6882cfa69c\") " pod="openshift-monitoring/node-exporter-xbf6b"
May 27 23:35:43.908531 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:35:43.908420    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/56080086-b221-4e2c-b0a0-8b6882cfa69c-node-exporter-accelerators-collector-config\") pod \"node-exporter-xbf6b\" (UID: \"56080086-b221-4e2c-b0a0-8b6882cfa69c\") " pod="openshift-monitoring/node-exporter-xbf6b"
May 27 23:35:43.908531 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:35:43.908448    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/56080086-b221-4e2c-b0a0-8b6882cfa69c-metrics-client-ca\") pod \"node-exporter-xbf6b\" (UID: \"56080086-b221-4e2c-b0a0-8b6882cfa69c\") " pod="openshift-monitoring/node-exporter-xbf6b"
May 27 23:35:43.908531 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:35:43.908462    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/56080086-b221-4e2c-b0a0-8b6882cfa69c-sys\") pod \"node-exporter-xbf6b\" (UID: \"56080086-b221-4e2c-b0a0-8b6882cfa69c\") " pod="openshift-monitoring/node-exporter-xbf6b"
May 27 23:35:43.908531 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:35:43.908496    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/56080086-b221-4e2c-b0a0-8b6882cfa69c-node-exporter-wtmp\") pod \"node-exporter-xbf6b\" (UID: \"56080086-b221-4e2c-b0a0-8b6882cfa69c\") " pod="openshift-monitoring/node-exporter-xbf6b"
May 27 23:35:43.908847 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:35:43.908526    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/56080086-b221-4e2c-b0a0-8b6882cfa69c-root\") pod \"node-exporter-xbf6b\" (UID: \"56080086-b221-4e2c-b0a0-8b6882cfa69c\") " pod="openshift-monitoring/node-exporter-xbf6b"
May 27 23:35:43.908847 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:35:43.908637    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/56080086-b221-4e2c-b0a0-8b6882cfa69c-root\") pod \"node-exporter-xbf6b\" (UID: \"56080086-b221-4e2c-b0a0-8b6882cfa69c\") " pod="openshift-monitoring/node-exporter-xbf6b"
May 27 23:35:43.908847 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:35:43.908679    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/56080086-b221-4e2c-b0a0-8b6882cfa69c-node-exporter-wtmp\") pod \"node-exporter-xbf6b\" (UID: \"56080086-b221-4e2c-b0a0-8b6882cfa69c\") " pod="openshift-monitoring/node-exporter-xbf6b"
May 27 23:35:43.908847 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:35:43.908730    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/56080086-b221-4e2c-b0a0-8b6882cfa69c-node-exporter-textfile\") pod \"node-exporter-xbf6b\" (UID: \"56080086-b221-4e2c-b0a0-8b6882cfa69c\") " pod="openshift-monitoring/node-exporter-xbf6b"
May 27 23:35:43.909037 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:35:43.908982    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/56080086-b221-4e2c-b0a0-8b6882cfa69c-metrics-client-ca\") pod \"node-exporter-xbf6b\" (UID: \"56080086-b221-4e2c-b0a0-8b6882cfa69c\") " pod="openshift-monitoring/node-exporter-xbf6b"
May 27 23:35:43.909178 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:35:43.909153    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/56080086-b221-4e2c-b0a0-8b6882cfa69c-node-exporter-accelerators-collector-config\") pod \"node-exporter-xbf6b\" (UID: \"56080086-b221-4e2c-b0a0-8b6882cfa69c\") " pod="openshift-monitoring/node-exporter-xbf6b"
May 27 23:35:43.910550 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:35:43.910530    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/56080086-b221-4e2c-b0a0-8b6882cfa69c-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-xbf6b\" (UID: \"56080086-b221-4e2c-b0a0-8b6882cfa69c\") " pod="openshift-monitoring/node-exporter-xbf6b"
May 27 23:35:43.910642 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:35:43.910623    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/56080086-b221-4e2c-b0a0-8b6882cfa69c-node-exporter-tls\") pod \"node-exporter-xbf6b\" (UID: \"56080086-b221-4e2c-b0a0-8b6882cfa69c\") " pod="openshift-monitoring/node-exporter-xbf6b"
May 27 23:35:43.916977 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:35:43.916951    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-z6wcw\" (UniqueName: \"kubernetes.io/projected/56080086-b221-4e2c-b0a0-8b6882cfa69c-kube-api-access-z6wcw\") pod \"node-exporter-xbf6b\" (UID: \"56080086-b221-4e2c-b0a0-8b6882cfa69c\") " pod="openshift-monitoring/node-exporter-xbf6b"
May 27 23:35:43.967215 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:35:43.967181    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-xbf6b"
May 27 23:35:43.976853 ip-10-0-132-191 kubenswrapper[2557]: W0527 23:35:43.976828    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod56080086_b221_4e2c_b0a0_8b6882cfa69c.slice/crio-462bd0b060dccda6fc4d16c6ebfd36b235a923d6462ae76743bfea7713333566 WatchSource:0}: Error finding container 462bd0b060dccda6fc4d16c6ebfd36b235a923d6462ae76743bfea7713333566: Status 404 returned error can't find the container with id 462bd0b060dccda6fc4d16c6ebfd36b235a923d6462ae76743bfea7713333566
May 27 23:35:44.212289 ip-10-0-132-191 kubenswrapper[2557]: E0527 23:35:44.212195    2557 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-zvbqn" podUID="c4d68b58-b4f3-4f03-a21c-321ca3eebe68"
May 27 23:35:44.656273 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:35:44.656233    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-xbf6b" event={"ID":"56080086-b221-4e2c-b0a0-8b6882cfa69c","Type":"ContainerStarted","Data":"462bd0b060dccda6fc4d16c6ebfd36b235a923d6462ae76743bfea7713333566"}
May 27 23:35:45.660475 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:35:45.660440    2557 generic.go:358] "Generic (PLEG): container finished" podID="56080086-b221-4e2c-b0a0-8b6882cfa69c" containerID="aba3e5ccd07fd61474446e66c807f4d3b4c535157408cf817d9b40a692176481" exitCode=0
May 27 23:35:45.660952 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:35:45.660482    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-xbf6b" event={"ID":"56080086-b221-4e2c-b0a0-8b6882cfa69c","Type":"ContainerDied","Data":"aba3e5ccd07fd61474446e66c807f4d3b4c535157408cf817d9b40a692176481"}
May 27 23:35:46.667611 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:35:46.667531    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-xbf6b" event={"ID":"56080086-b221-4e2c-b0a0-8b6882cfa69c","Type":"ContainerStarted","Data":"25069a638b5c17f768ea380a0717b9a8a294003d5a6eb1645136c16bef527fb1"}
May 27 23:35:46.667611 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:35:46.667568    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-xbf6b" event={"ID":"56080086-b221-4e2c-b0a0-8b6882cfa69c","Type":"ContainerStarted","Data":"6c2ddd587129decd3e679023bac03c6c51bb3af65901c60c3b78338c8e286e1d"}
May 27 23:35:48.044308 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:35:48.044271    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/be0f2a6c-ac7b-49cd-9b76-f915fb621154-registry-tls\") pod \"image-registry-77d97f4457-gt2t8\" (UID: \"be0f2a6c-ac7b-49cd-9b76-f915fb621154\") " pod="openshift-image-registry/image-registry-77d97f4457-gt2t8"
May 27 23:35:48.044308 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:35:48.044312    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b43c1b7d-e8dd-47eb-8e80-92e5120ae59c-cert\") pod \"ingress-canary-5h2hp\" (UID: \"b43c1b7d-e8dd-47eb-8e80-92e5120ae59c\") " pod="openshift-ingress-canary/ingress-canary-5h2hp"
May 27 23:35:48.046767 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:35:48.046740    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b43c1b7d-e8dd-47eb-8e80-92e5120ae59c-cert\") pod \"ingress-canary-5h2hp\" (UID: \"b43c1b7d-e8dd-47eb-8e80-92e5120ae59c\") " pod="openshift-ingress-canary/ingress-canary-5h2hp"
May 27 23:35:48.046881 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:35:48.046792    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/be0f2a6c-ac7b-49cd-9b76-f915fb621154-registry-tls\") pod \"image-registry-77d97f4457-gt2t8\" (UID: \"be0f2a6c-ac7b-49cd-9b76-f915fb621154\") " pod="openshift-image-registry/image-registry-77d97f4457-gt2t8"
May 27 23:35:48.145388 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:35:48.145355    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ce63e7a9-c155-4635-a015-13d077ba097b-metrics-tls\") pod \"dns-default-lbgbp\" (UID: \"ce63e7a9-c155-4635-a015-13d077ba097b\") " pod="openshift-dns/dns-default-lbgbp"
May 27 23:35:48.147591 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:35:48.147560    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ce63e7a9-c155-4635-a015-13d077ba097b-metrics-tls\") pod \"dns-default-lbgbp\" (UID: \"ce63e7a9-c155-4635-a015-13d077ba097b\") " pod="openshift-dns/dns-default-lbgbp"
May 27 23:35:48.156477 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:35:48.156460    2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-wvqkk\""
May 27 23:35:48.164013 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:35:48.163989    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-77d97f4457-gt2t8"
May 27 23:35:48.288959 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:35:48.288907    2557 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-xbf6b" podStartSLOduration=4.471966078 podStartE2EDuration="5.288890168s" podCreationTimestamp="2026-05-27 23:35:43 +0000 UTC" firstStartedPulling="2026-05-27 23:35:43.978379095 +0000 UTC m=+159.397915085" lastFinishedPulling="2026-05-27 23:35:44.795303182 +0000 UTC m=+160.214839175" observedRunningTime="2026-05-27 23:35:46.688632292 +0000 UTC m=+162.108168304" watchObservedRunningTime="2026-05-27 23:35:48.288890168 +0000 UTC m=+163.708426204"
May 27 23:35:48.289755 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:35:48.289734    2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-77d97f4457-gt2t8"]
May 27 23:35:48.293334 ip-10-0-132-191 kubenswrapper[2557]: W0527 23:35:48.293309    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbe0f2a6c_ac7b_49cd_9b76_f915fb621154.slice/crio-de6b109f171d8c7e48bdf6cf2ebf9cbad2b47f66f8981e338fe2263fe1ba2363 WatchSource:0}: Error finding container de6b109f171d8c7e48bdf6cf2ebf9cbad2b47f66f8981e338fe2263fe1ba2363: Status 404 returned error can't find the container with id de6b109f171d8c7e48bdf6cf2ebf9cbad2b47f66f8981e338fe2263fe1ba2363
May 27 23:35:48.673280 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:35:48.673245    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-77d97f4457-gt2t8" event={"ID":"be0f2a6c-ac7b-49cd-9b76-f915fb621154","Type":"ContainerStarted","Data":"8ff5189ad24c4e596f8f9562700def2705d094e2b78a19da1957bf562fbff037"}
May 27 23:35:48.673280 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:35:48.673282    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-77d97f4457-gt2t8" event={"ID":"be0f2a6c-ac7b-49cd-9b76-f915fb621154","Type":"ContainerStarted","Data":"de6b109f171d8c7e48bdf6cf2ebf9cbad2b47f66f8981e338fe2263fe1ba2363"}
May 27 23:35:48.673475 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:35:48.673375    2557 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-77d97f4457-gt2t8"
May 27 23:35:48.696748 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:35:48.696702    2557 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-image-registry/image-registry-77d97f4457-gt2t8" podStartSLOduration=163.696686297 podStartE2EDuration="2m43.696686297s" podCreationTimestamp="2026-05-27 23:33:05 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-27 23:35:48.696041777 +0000 UTC m=+164.115577790" watchObservedRunningTime="2026-05-27 23:35:48.696686297 +0000 UTC m=+164.116222311"
May 27 23:35:52.371741 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:35:52.371679    2557 prober.go:120] "Probe failed" probeType="Readiness" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-84dd97d74c-mmfqg" podUID="29c8dcc2-2720-4899-8957-ce8476c86626" containerName="acm-agent" probeResult="failure" output="Get \"http://10.132.0.7:8000/readyz\": dial tcp 10.132.0.7:8000: connect: connection refused"
May 27 23:35:52.684252 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:35:52.684216    2557 generic.go:358] "Generic (PLEG): container finished" podID="29c8dcc2-2720-4899-8957-ce8476c86626" containerID="23d1aa3576e1bb9b3f6adfa90f0634fd8bba4047630c92042565c40c85101f83" exitCode=1
May 27 23:35:52.684442 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:35:52.684290    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-84dd97d74c-mmfqg" event={"ID":"29c8dcc2-2720-4899-8957-ce8476c86626","Type":"ContainerDied","Data":"23d1aa3576e1bb9b3f6adfa90f0634fd8bba4047630c92042565c40c85101f83"}
May 27 23:35:52.684662 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:35:52.684644    2557 scope.go:117] "RemoveContainer" containerID="23d1aa3576e1bb9b3f6adfa90f0634fd8bba4047630c92042565c40c85101f83"
May 27 23:35:52.685558 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:35:52.685522    2557 generic.go:358] "Generic (PLEG): container finished" podID="a112e1d0-b4a6-4e2a-8400-130d5e93312e" containerID="176f22ab32caffb73e32b570f23949da1d72b74852582585c6e3871a7fd6c189" exitCode=255
May 27 23:35:52.685624 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:35:52.685550    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7b7db96d88-22q6v" event={"ID":"a112e1d0-b4a6-4e2a-8400-130d5e93312e","Type":"ContainerDied","Data":"176f22ab32caffb73e32b570f23949da1d72b74852582585c6e3871a7fd6c189"}
May 27 23:35:52.685848 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:35:52.685834    2557 scope.go:117] "RemoveContainer" containerID="176f22ab32caffb73e32b570f23949da1d72b74852582585c6e3871a7fd6c189"
May 27 23:35:53.199027 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:35:53.198989    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-5h2hp"
May 27 23:35:53.201878 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:35:53.201855    2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-lstvz\""
May 27 23:35:53.210288 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:35:53.210263    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-5h2hp"
May 27 23:35:53.331310 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:35:53.331277    2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-5h2hp"]
May 27 23:35:53.336355 ip-10-0-132-191 kubenswrapper[2557]: W0527 23:35:53.336319    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb43c1b7d_e8dd_47eb_8e80_92e5120ae59c.slice/crio-84c7f2f4b5af4f4411e5a010f8254c6e0a885e85c3c2e3e1f9ab0fff398a52b2 WatchSource:0}: Error finding container 84c7f2f4b5af4f4411e5a010f8254c6e0a885e85c3c2e3e1f9ab0fff398a52b2: Status 404 returned error can't find the container with id 84c7f2f4b5af4f4411e5a010f8254c6e0a885e85c3c2e3e1f9ab0fff398a52b2
May 27 23:35:53.690079 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:35:53.690040    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-84dd97d74c-mmfqg" event={"ID":"29c8dcc2-2720-4899-8957-ce8476c86626","Type":"ContainerStarted","Data":"a335dc501c79f42f68e46af134bb554f779cc227349a7d671929a657cff14619"}
May 27 23:35:53.690547 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:35:53.690372    2557 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-84dd97d74c-mmfqg"
May 27 23:35:53.690945 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:35:53.690926    2557 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-84dd97d74c-mmfqg"
May 27 23:35:53.691744 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:35:53.691723    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7b7db96d88-22q6v" event={"ID":"a112e1d0-b4a6-4e2a-8400-130d5e93312e","Type":"ContainerStarted","Data":"fd14519b4d86b58abedb25a207461a153f7f3a85997c3146e6d7c3f4c7510fdc"}
May 27 23:35:53.692714 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:35:53.692691    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-5h2hp" event={"ID":"b43c1b7d-e8dd-47eb-8e80-92e5120ae59c","Type":"ContainerStarted","Data":"84c7f2f4b5af4f4411e5a010f8254c6e0a885e85c3c2e3e1f9ab0fff398a52b2"}
May 27 23:35:55.200718 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:35:55.200631    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-lbgbp"
May 27 23:35:55.204578 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:35:55.204559    2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-szgzp\""
May 27 23:35:55.211735 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:35:55.211718    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-lbgbp"
May 27 23:35:55.340917 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:35:55.339157    2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-lbgbp"]
May 27 23:35:55.698822 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:35:55.698787    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-5h2hp" event={"ID":"b43c1b7d-e8dd-47eb-8e80-92e5120ae59c","Type":"ContainerStarted","Data":"7e692be877d19ffaf2b9cbb048aab3ecf167f3421f49201654780dc7a5f4ba07"}
May 27 23:35:55.699839 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:35:55.699813    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-lbgbp" event={"ID":"ce63e7a9-c155-4635-a015-13d077ba097b","Type":"ContainerStarted","Data":"843a9eb21a5b5f9f34fcd9004394554117ea8f104d7c33dc3b21fab317429da5"}
May 27 23:35:55.721814 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:35:55.721751    2557 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-5h2hp" podStartSLOduration=135.112904182 podStartE2EDuration="2m16.721739935s" podCreationTimestamp="2026-05-27 23:33:39 +0000 UTC" firstStartedPulling="2026-05-27 23:35:53.338053134 +0000 UTC m=+168.757589124" lastFinishedPulling="2026-05-27 23:35:54.946888879 +0000 UTC m=+170.366424877" observedRunningTime="2026-05-27 23:35:55.721592595 +0000 UTC m=+171.141128608" watchObservedRunningTime="2026-05-27 23:35:55.721739935 +0000 UTC m=+171.141275946"
May 27 23:35:56.704377 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:35:56.704325    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-lbgbp" event={"ID":"ce63e7a9-c155-4635-a015-13d077ba097b","Type":"ContainerStarted","Data":"31cba9c27daf6dcad1682e807edb4ddd4f33e05ed37fec3d15da28bbb0a794bc"}
May 27 23:35:57.198600 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:35:57.198567    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zvbqn"
May 27 23:35:57.708202 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:35:57.708166    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-lbgbp" event={"ID":"ce63e7a9-c155-4635-a015-13d077ba097b","Type":"ContainerStarted","Data":"36f4b37ebeaabd0b6838394f18d399b395a44260086b76b39c4aabe07beb4397"}
May 27 23:35:57.708607 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:35:57.708380    2557 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-lbgbp"
May 27 23:35:57.728567 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:35:57.728509    2557 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-dns/dns-default-lbgbp" podStartSLOduration=136.522404624 podStartE2EDuration="2m17.728495393s" podCreationTimestamp="2026-05-27 23:33:40 +0000 UTC" firstStartedPulling="2026-05-27 23:35:55.344791263 +0000 UTC m=+170.764327253" lastFinishedPulling="2026-05-27 23:35:56.550882032 +0000 UTC m=+171.970418022" observedRunningTime="2026-05-27 23:35:57.726882819 +0000 UTC m=+173.146418831" watchObservedRunningTime="2026-05-27 23:35:57.728495393 +0000 UTC m=+173.148031404"
May 27 23:36:07.713196 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:36:07.713161    2557 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-lbgbp"
May 27 23:36:08.168851 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:36:08.168813    2557 patch_prober.go:28] interesting pod/image-registry-77d97f4457-gt2t8 container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
May 27 23:36:08.169015 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:36:08.168865    2557 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-77d97f4457-gt2t8" podUID="be0f2a6c-ac7b-49cd-9b76-f915fb621154" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
May 27 23:36:09.679688 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:36:09.679658    2557 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-77d97f4457-gt2t8"
May 27 23:36:20.306076 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:36:20.306036    2557 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-67898895db-qdh8p" podUID="c1877802-a24c-4e88-ab77-ccd86f39c196" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500"
May 27 23:36:23.230840 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:36:23.230801    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-5h2hp_b43c1b7d-e8dd-47eb-8e80-92e5120ae59c/serve-healthcheck-canary/0.log"
May 27 23:36:26.311301 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:36:26.311270    2557 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-77d97f4457-gt2t8"]
May 27 23:36:30.305980 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:36:30.305937    2557 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-67898895db-qdh8p" podUID="c1877802-a24c-4e88-ab77-ccd86f39c196" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500"
May 27 23:36:40.306356 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:36:40.306315    2557 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-67898895db-qdh8p" podUID="c1877802-a24c-4e88-ab77-ccd86f39c196" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500"
May 27 23:36:40.306808 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:36:40.306384    2557 kubelet.go:2658] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-67898895db-qdh8p"
May 27 23:36:40.306867 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:36:40.306835    2557 kuberuntime_manager.go:1107] "Message for Container of pod" containerName="service-proxy" containerStatusID={"Type":"cri-o","ID":"11b3a41af3fea23c39954e2805946fa26ada50a778098c9f47770a4d96d4e0b0"} pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-67898895db-qdh8p" containerMessage="Container service-proxy failed liveness probe, will be restarted"
May 27 23:36:40.306910 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:36:40.306885    2557 kuberuntime_container.go:864] "Killing container with a grace period" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-67898895db-qdh8p" podUID="c1877802-a24c-4e88-ab77-ccd86f39c196" containerName="service-proxy" containerID="cri-o://11b3a41af3fea23c39954e2805946fa26ada50a778098c9f47770a4d96d4e0b0" gracePeriod=30
May 27 23:36:40.826334 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:36:40.826298    2557 generic.go:358] "Generic (PLEG): container finished" podID="c1877802-a24c-4e88-ab77-ccd86f39c196" containerID="11b3a41af3fea23c39954e2805946fa26ada50a778098c9f47770a4d96d4e0b0" exitCode=2
May 27 23:36:40.826500 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:36:40.826363    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-67898895db-qdh8p" event={"ID":"c1877802-a24c-4e88-ab77-ccd86f39c196","Type":"ContainerDied","Data":"11b3a41af3fea23c39954e2805946fa26ada50a778098c9f47770a4d96d4e0b0"}
May 27 23:36:40.826500 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:36:40.826399    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-67898895db-qdh8p" event={"ID":"c1877802-a24c-4e88-ab77-ccd86f39c196","Type":"ContainerStarted","Data":"f39e51500b8e17765c7d9631b6021104459c79339afa7e089ea4967cc34f3831"}
May 27 23:36:51.328935 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:36:51.328873    2557 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-image-registry/image-registry-77d97f4457-gt2t8" podUID="be0f2a6c-ac7b-49cd-9b76-f915fb621154" containerName="registry" containerID="cri-o://8ff5189ad24c4e596f8f9562700def2705d094e2b78a19da1957bf562fbff037" gracePeriod=30
May 27 23:36:52.564712 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:36:52.564689    2557 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-77d97f4457-gt2t8"
May 27 23:36:52.747620 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:36:52.747536    2557 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kp9m4\" (UniqueName: \"kubernetes.io/projected/be0f2a6c-ac7b-49cd-9b76-f915fb621154-kube-api-access-kp9m4\") pod \"be0f2a6c-ac7b-49cd-9b76-f915fb621154\" (UID: \"be0f2a6c-ac7b-49cd-9b76-f915fb621154\") "
May 27 23:36:52.747620 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:36:52.747576    2557 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/be0f2a6c-ac7b-49cd-9b76-f915fb621154-registry-certificates\") pod \"be0f2a6c-ac7b-49cd-9b76-f915fb621154\" (UID: \"be0f2a6c-ac7b-49cd-9b76-f915fb621154\") "
May 27 23:36:52.747620 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:36:52.747596    2557 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/be0f2a6c-ac7b-49cd-9b76-f915fb621154-bound-sa-token\") pod \"be0f2a6c-ac7b-49cd-9b76-f915fb621154\" (UID: \"be0f2a6c-ac7b-49cd-9b76-f915fb621154\") "
May 27 23:36:52.747902 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:36:52.747633    2557 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/be0f2a6c-ac7b-49cd-9b76-f915fb621154-ca-trust-extracted\") pod \"be0f2a6c-ac7b-49cd-9b76-f915fb621154\" (UID: \"be0f2a6c-ac7b-49cd-9b76-f915fb621154\") "
May 27 23:36:52.747902 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:36:52.747650    2557 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/be0f2a6c-ac7b-49cd-9b76-f915fb621154-registry-tls\") pod \"be0f2a6c-ac7b-49cd-9b76-f915fb621154\" (UID: \"be0f2a6c-ac7b-49cd-9b76-f915fb621154\") "
May 27 23:36:52.747902 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:36:52.747666    2557 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/be0f2a6c-ac7b-49cd-9b76-f915fb621154-image-registry-private-configuration\") pod \"be0f2a6c-ac7b-49cd-9b76-f915fb621154\" (UID: \"be0f2a6c-ac7b-49cd-9b76-f915fb621154\") "
May 27 23:36:52.747902 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:36:52.747694    2557 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/be0f2a6c-ac7b-49cd-9b76-f915fb621154-trusted-ca\") pod \"be0f2a6c-ac7b-49cd-9b76-f915fb621154\" (UID: \"be0f2a6c-ac7b-49cd-9b76-f915fb621154\") "
May 27 23:36:52.747902 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:36:52.747745    2557 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/be0f2a6c-ac7b-49cd-9b76-f915fb621154-installation-pull-secrets\") pod \"be0f2a6c-ac7b-49cd-9b76-f915fb621154\" (UID: \"be0f2a6c-ac7b-49cd-9b76-f915fb621154\") "
May 27 23:36:52.748173 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:36:52.748120    2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/be0f2a6c-ac7b-49cd-9b76-f915fb621154-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "be0f2a6c-ac7b-49cd-9b76-f915fb621154" (UID: "be0f2a6c-ac7b-49cd-9b76-f915fb621154"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 27 23:36:52.748277 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:36:52.748248    2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/be0f2a6c-ac7b-49cd-9b76-f915fb621154-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "be0f2a6c-ac7b-49cd-9b76-f915fb621154" (UID: "be0f2a6c-ac7b-49cd-9b76-f915fb621154"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 27 23:36:52.750235 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:36:52.750167    2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/be0f2a6c-ac7b-49cd-9b76-f915fb621154-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "be0f2a6c-ac7b-49cd-9b76-f915fb621154" (UID: "be0f2a6c-ac7b-49cd-9b76-f915fb621154"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 27 23:36:52.750235 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:36:52.750173    2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/be0f2a6c-ac7b-49cd-9b76-f915fb621154-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "be0f2a6c-ac7b-49cd-9b76-f915fb621154" (UID: "be0f2a6c-ac7b-49cd-9b76-f915fb621154"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 27 23:36:52.750235 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:36:52.750216    2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/be0f2a6c-ac7b-49cd-9b76-f915fb621154-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "be0f2a6c-ac7b-49cd-9b76-f915fb621154" (UID: "be0f2a6c-ac7b-49cd-9b76-f915fb621154"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 27 23:36:52.750411 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:36:52.750245    2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/be0f2a6c-ac7b-49cd-9b76-f915fb621154-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "be0f2a6c-ac7b-49cd-9b76-f915fb621154" (UID: "be0f2a6c-ac7b-49cd-9b76-f915fb621154"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 27 23:36:52.750448 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:36:52.750416    2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/be0f2a6c-ac7b-49cd-9b76-f915fb621154-kube-api-access-kp9m4" (OuterVolumeSpecName: "kube-api-access-kp9m4") pod "be0f2a6c-ac7b-49cd-9b76-f915fb621154" (UID: "be0f2a6c-ac7b-49cd-9b76-f915fb621154"). InnerVolumeSpecName "kube-api-access-kp9m4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 27 23:36:52.756220 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:36:52.756197    2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/be0f2a6c-ac7b-49cd-9b76-f915fb621154-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "be0f2a6c-ac7b-49cd-9b76-f915fb621154" (UID: "be0f2a6c-ac7b-49cd-9b76-f915fb621154"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 27 23:36:52.848437 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:36:52.848395    2557 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/be0f2a6c-ac7b-49cd-9b76-f915fb621154-installation-pull-secrets\") on node \"ip-10-0-132-191.ec2.internal\" DevicePath \"\""
May 27 23:36:52.848437 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:36:52.848432    2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kp9m4\" (UniqueName: \"kubernetes.io/projected/be0f2a6c-ac7b-49cd-9b76-f915fb621154-kube-api-access-kp9m4\") on node \"ip-10-0-132-191.ec2.internal\" DevicePath \"\""
May 27 23:36:52.848437 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:36:52.848442    2557 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/be0f2a6c-ac7b-49cd-9b76-f915fb621154-registry-certificates\") on node \"ip-10-0-132-191.ec2.internal\" DevicePath \"\""
May 27 23:36:52.848616 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:36:52.848452    2557 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/be0f2a6c-ac7b-49cd-9b76-f915fb621154-bound-sa-token\") on node \"ip-10-0-132-191.ec2.internal\" DevicePath \"\""
May 27 23:36:52.848616 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:36:52.848461    2557 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/be0f2a6c-ac7b-49cd-9b76-f915fb621154-ca-trust-extracted\") on node \"ip-10-0-132-191.ec2.internal\" DevicePath \"\""
May 27 23:36:52.848616 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:36:52.848469    2557 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/be0f2a6c-ac7b-49cd-9b76-f915fb621154-registry-tls\") on node \"ip-10-0-132-191.ec2.internal\" DevicePath \"\""
May 27 23:36:52.848616 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:36:52.848480    2557 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/be0f2a6c-ac7b-49cd-9b76-f915fb621154-image-registry-private-configuration\") on node \"ip-10-0-132-191.ec2.internal\" DevicePath \"\""
May 27 23:36:52.848616 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:36:52.848489    2557 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/be0f2a6c-ac7b-49cd-9b76-f915fb621154-trusted-ca\") on node \"ip-10-0-132-191.ec2.internal\" DevicePath \"\""
May 27 23:36:52.856266 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:36:52.856238    2557 generic.go:358] "Generic (PLEG): container finished" podID="be0f2a6c-ac7b-49cd-9b76-f915fb621154" containerID="8ff5189ad24c4e596f8f9562700def2705d094e2b78a19da1957bf562fbff037" exitCode=0
May 27 23:36:52.856369 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:36:52.856296    2557 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-77d97f4457-gt2t8"
May 27 23:36:52.856369 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:36:52.856320    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-77d97f4457-gt2t8" event={"ID":"be0f2a6c-ac7b-49cd-9b76-f915fb621154","Type":"ContainerDied","Data":"8ff5189ad24c4e596f8f9562700def2705d094e2b78a19da1957bf562fbff037"}
May 27 23:36:52.856369 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:36:52.856354    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-77d97f4457-gt2t8" event={"ID":"be0f2a6c-ac7b-49cd-9b76-f915fb621154","Type":"ContainerDied","Data":"de6b109f171d8c7e48bdf6cf2ebf9cbad2b47f66f8981e338fe2263fe1ba2363"}
May 27 23:36:52.856369 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:36:52.856370    2557 scope.go:117] "RemoveContainer" containerID="8ff5189ad24c4e596f8f9562700def2705d094e2b78a19da1957bf562fbff037"
May 27 23:36:52.864311 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:36:52.864213    2557 scope.go:117] "RemoveContainer" containerID="8ff5189ad24c4e596f8f9562700def2705d094e2b78a19da1957bf562fbff037"
May 27 23:36:52.864486 ip-10-0-132-191 kubenswrapper[2557]: E0527 23:36:52.864462    2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8ff5189ad24c4e596f8f9562700def2705d094e2b78a19da1957bf562fbff037\": container with ID starting with 8ff5189ad24c4e596f8f9562700def2705d094e2b78a19da1957bf562fbff037 not found: ID does not exist" containerID="8ff5189ad24c4e596f8f9562700def2705d094e2b78a19da1957bf562fbff037"
May 27 23:36:52.864619 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:36:52.864586    2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8ff5189ad24c4e596f8f9562700def2705d094e2b78a19da1957bf562fbff037"} err="failed to get container status \"8ff5189ad24c4e596f8f9562700def2705d094e2b78a19da1957bf562fbff037\": rpc error: code = NotFound desc = could not find container \"8ff5189ad24c4e596f8f9562700def2705d094e2b78a19da1957bf562fbff037\": container with ID starting with 8ff5189ad24c4e596f8f9562700def2705d094e2b78a19da1957bf562fbff037 not found: ID does not exist"
May 27 23:36:52.879625 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:36:52.879603    2557 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-77d97f4457-gt2t8"]
May 27 23:36:52.883530 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:36:52.883512    2557 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-77d97f4457-gt2t8"]
May 27 23:36:53.201808 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:36:53.201781    2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="be0f2a6c-ac7b-49cd-9b76-f915fb621154" path="/var/lib/kubelet/pods/be0f2a6c-ac7b-49cd-9b76-f915fb621154/volumes"
May 27 23:37:17.018229 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:37:17.018117    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c4d68b58-b4f3-4f03-a21c-321ca3eebe68-metrics-certs\") pod \"network-metrics-daemon-zvbqn\" (UID: \"c4d68b58-b4f3-4f03-a21c-321ca3eebe68\") " pod="openshift-multus/network-metrics-daemon-zvbqn"
May 27 23:37:17.020344 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:37:17.020320    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c4d68b58-b4f3-4f03-a21c-321ca3eebe68-metrics-certs\") pod \"network-metrics-daemon-zvbqn\" (UID: \"c4d68b58-b4f3-4f03-a21c-321ca3eebe68\") " pod="openshift-multus/network-metrics-daemon-zvbqn"
May 27 23:37:17.306457 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:37:17.306379    2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-8jlf4\""
May 27 23:37:17.309709 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:37:17.309694    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zvbqn"
May 27 23:37:17.439103 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:37:17.439075    2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-zvbqn"]
May 27 23:37:17.442195 ip-10-0-132-191 kubenswrapper[2557]: W0527 23:37:17.442167    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc4d68b58_b4f3_4f03_a21c_321ca3eebe68.slice/crio-fe5a79c2985e1fbf3068018a77b447867ef0c4f66c3deb91d56270f55087aac1 WatchSource:0}: Error finding container fe5a79c2985e1fbf3068018a77b447867ef0c4f66c3deb91d56270f55087aac1: Status 404 returned error can't find the container with id fe5a79c2985e1fbf3068018a77b447867ef0c4f66c3deb91d56270f55087aac1
May 27 23:37:17.921446 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:37:17.921403    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-zvbqn" event={"ID":"c4d68b58-b4f3-4f03-a21c-321ca3eebe68","Type":"ContainerStarted","Data":"fe5a79c2985e1fbf3068018a77b447867ef0c4f66c3deb91d56270f55087aac1"}
May 27 23:37:18.925170 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:37:18.925120    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-zvbqn" event={"ID":"c4d68b58-b4f3-4f03-a21c-321ca3eebe68","Type":"ContainerStarted","Data":"b6d208bdfde280fcaf282fc416f121c6ed450f131e882a2f3fb2027a0b1c8ba7"}
May 27 23:37:18.925170 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:37:18.925171    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-zvbqn" event={"ID":"c4d68b58-b4f3-4f03-a21c-321ca3eebe68","Type":"ContainerStarted","Data":"ace648b4db6fe4de4673f1cd558a9f46bf53a83401533de1b26f572d63074497"}
May 27 23:37:18.944931 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:37:18.944888    2557 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-zvbqn" podStartSLOduration=252.891341845 podStartE2EDuration="4m13.944874073s" podCreationTimestamp="2026-05-27 23:33:05 +0000 UTC" firstStartedPulling="2026-05-27 23:37:17.44381249 +0000 UTC m=+252.863348491" lastFinishedPulling="2026-05-27 23:37:18.497344726 +0000 UTC m=+253.916880719" observedRunningTime="2026-05-27 23:37:18.942997503 +0000 UTC m=+254.362533496" watchObservedRunningTime="2026-05-27 23:37:18.944874073 +0000 UTC m=+254.364410085"
May 27 23:38:05.081047 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:38:05.081014    2557 kubelet.go:1628] "Image garbage collection succeeded"
May 27 23:44:59.121580 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:44:59.121543    2557 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["test-ns-feast/redis-854544c579-f5kh4"]
May 27 23:44:59.122009 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:44:59.121757    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="be0f2a6c-ac7b-49cd-9b76-f915fb621154" containerName="registry"
May 27 23:44:59.122009 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:44:59.121768    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="be0f2a6c-ac7b-49cd-9b76-f915fb621154" containerName="registry"
May 27 23:44:59.122009 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:44:59.121819    2557 memory_manager.go:356] "RemoveStaleState removing state" podUID="be0f2a6c-ac7b-49cd-9b76-f915fb621154" containerName="registry"
May 27 23:44:59.124486 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:44:59.124470    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/redis-854544c579-f5kh4"
May 27 23:44:59.127300 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:44:59.127276    2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast\"/\"kube-root-ca.crt\""
May 27 23:44:59.127442 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:44:59.127276    2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast\"/\"openshift-service-ca.crt\""
May 27 23:44:59.127442 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:44:59.127280    2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"default-dockercfg-msr2f\""
May 27 23:44:59.130938 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:44:59.130749    2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/redis-854544c579-f5kh4"]
May 27 23:44:59.169806 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:44:59.169772    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g25gf\" (UniqueName: \"kubernetes.io/projected/e1cd4e12-f0f1-441f-9309-01a777054e56-kube-api-access-g25gf\") pod \"redis-854544c579-f5kh4\" (UID: \"e1cd4e12-f0f1-441f-9309-01a777054e56\") " pod="test-ns-feast/redis-854544c579-f5kh4"
May 27 23:44:59.270475 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:44:59.270434    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-g25gf\" (UniqueName: \"kubernetes.io/projected/e1cd4e12-f0f1-441f-9309-01a777054e56-kube-api-access-g25gf\") pod \"redis-854544c579-f5kh4\" (UID: \"e1cd4e12-f0f1-441f-9309-01a777054e56\") " pod="test-ns-feast/redis-854544c579-f5kh4"
May 27 23:44:59.279150 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:44:59.279097    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-g25gf\" (UniqueName: \"kubernetes.io/projected/e1cd4e12-f0f1-441f-9309-01a777054e56-kube-api-access-g25gf\") pod \"redis-854544c579-f5kh4\" (UID: \"e1cd4e12-f0f1-441f-9309-01a777054e56\") " pod="test-ns-feast/redis-854544c579-f5kh4"
May 27 23:44:59.435380 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:44:59.435294    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/redis-854544c579-f5kh4"
May 27 23:44:59.557543 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:44:59.557505    2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/redis-854544c579-f5kh4"]
May 27 23:44:59.560380 ip-10-0-132-191 kubenswrapper[2557]: W0527 23:44:59.560356    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pode1cd4e12_f0f1_441f_9309_01a777054e56.slice/crio-01cc7ad41762e499573d0e0028289e2662b53e498ba73f07b07f0071d6a9f977 WatchSource:0}: Error finding container 01cc7ad41762e499573d0e0028289e2662b53e498ba73f07b07f0071d6a9f977: Status 404 returned error can't find the container with id 01cc7ad41762e499573d0e0028289e2662b53e498ba73f07b07f0071d6a9f977
May 27 23:44:59.562089 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:44:59.562071    2557 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
May 27 23:45:00.076778 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:45:00.076740    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/redis-854544c579-f5kh4" event={"ID":"e1cd4e12-f0f1-441f-9309-01a777054e56","Type":"ContainerStarted","Data":"01cc7ad41762e499573d0e0028289e2662b53e498ba73f07b07f0071d6a9f977"}
May 27 23:45:02.082661 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:45:02.082623    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/redis-854544c579-f5kh4" event={"ID":"e1cd4e12-f0f1-441f-9309-01a777054e56","Type":"ContainerStarted","Data":"6bc9f8b9c469c46ac0b2d4a4b8750b07506c80030a964be4ef31efaf6e03c3c4"}
May 27 23:45:02.102380 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:45:02.102327    2557 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="test-ns-feast/redis-854544c579-f5kh4" podStartSLOduration=1.575447319 podStartE2EDuration="3.102314796s" podCreationTimestamp="2026-05-27 23:44:59 +0000 UTC" firstStartedPulling="2026-05-27 23:44:59.562218568 +0000 UTC m=+714.981754557" lastFinishedPulling="2026-05-27 23:45:01.089086043 +0000 UTC m=+716.508622034" observedRunningTime="2026-05-27 23:45:02.100767554 +0000 UTC m=+717.520303589" watchObservedRunningTime="2026-05-27 23:45:02.102314796 +0000 UTC m=+717.521850807"
May 27 23:46:33.703085 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:46:33.703010    2557 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["test-ns-feast/redis-854544c579-f5kh4"]
May 27 23:46:33.703591 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:46:33.703227    2557 kuberuntime_container.go:864] "Killing container with a grace period" pod="test-ns-feast/redis-854544c579-f5kh4" podUID="e1cd4e12-f0f1-441f-9309-01a777054e56" containerName="redis" containerID="cri-o://6bc9f8b9c469c46ac0b2d4a4b8750b07506c80030a964be4ef31efaf6e03c3c4" gracePeriod=30
May 27 23:46:34.039099 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:46:34.039077    2557 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/redis-854544c579-f5kh4"
May 27 23:46:34.101257 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:46:34.101224    2557 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-g25gf\" (UniqueName: \"kubernetes.io/projected/e1cd4e12-f0f1-441f-9309-01a777054e56-kube-api-access-g25gf\") pod \"e1cd4e12-f0f1-441f-9309-01a777054e56\" (UID: \"e1cd4e12-f0f1-441f-9309-01a777054e56\") "
May 27 23:46:34.103237 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:46:34.103211    2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e1cd4e12-f0f1-441f-9309-01a777054e56-kube-api-access-g25gf" (OuterVolumeSpecName: "kube-api-access-g25gf") pod "e1cd4e12-f0f1-441f-9309-01a777054e56" (UID: "e1cd4e12-f0f1-441f-9309-01a777054e56"). InnerVolumeSpecName "kube-api-access-g25gf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 27 23:46:34.202287 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:46:34.202261    2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-g25gf\" (UniqueName: \"kubernetes.io/projected/e1cd4e12-f0f1-441f-9309-01a777054e56-kube-api-access-g25gf\") on node \"ip-10-0-132-191.ec2.internal\" DevicePath \"\""
May 27 23:46:34.307857 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:46:34.307798    2557 generic.go:358] "Generic (PLEG): container finished" podID="e1cd4e12-f0f1-441f-9309-01a777054e56" containerID="6bc9f8b9c469c46ac0b2d4a4b8750b07506c80030a964be4ef31efaf6e03c3c4" exitCode=0
May 27 23:46:34.307857 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:46:34.307849    2557 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/redis-854544c579-f5kh4"
May 27 23:46:34.307857 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:46:34.307853    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/redis-854544c579-f5kh4" event={"ID":"e1cd4e12-f0f1-441f-9309-01a777054e56","Type":"ContainerDied","Data":"6bc9f8b9c469c46ac0b2d4a4b8750b07506c80030a964be4ef31efaf6e03c3c4"}
May 27 23:46:34.308021 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:46:34.307876    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/redis-854544c579-f5kh4" event={"ID":"e1cd4e12-f0f1-441f-9309-01a777054e56","Type":"ContainerDied","Data":"01cc7ad41762e499573d0e0028289e2662b53e498ba73f07b07f0071d6a9f977"}
May 27 23:46:34.308021 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:46:34.307890    2557 scope.go:117] "RemoveContainer" containerID="6bc9f8b9c469c46ac0b2d4a4b8750b07506c80030a964be4ef31efaf6e03c3c4"
May 27 23:46:34.314936 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:46:34.314919    2557 scope.go:117] "RemoveContainer" containerID="6bc9f8b9c469c46ac0b2d4a4b8750b07506c80030a964be4ef31efaf6e03c3c4"
May 27 23:46:34.315320 ip-10-0-132-191 kubenswrapper[2557]: E0527 23:46:34.315190    2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6bc9f8b9c469c46ac0b2d4a4b8750b07506c80030a964be4ef31efaf6e03c3c4\": container with ID starting with 6bc9f8b9c469c46ac0b2d4a4b8750b07506c80030a964be4ef31efaf6e03c3c4 not found: ID does not exist" containerID="6bc9f8b9c469c46ac0b2d4a4b8750b07506c80030a964be4ef31efaf6e03c3c4"
May 27 23:46:34.315320 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:46:34.315221    2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6bc9f8b9c469c46ac0b2d4a4b8750b07506c80030a964be4ef31efaf6e03c3c4"} err="failed to get container status \"6bc9f8b9c469c46ac0b2d4a4b8750b07506c80030a964be4ef31efaf6e03c3c4\": rpc error: code = NotFound desc = could not find container \"6bc9f8b9c469c46ac0b2d4a4b8750b07506c80030a964be4ef31efaf6e03c3c4\": container with ID starting with 6bc9f8b9c469c46ac0b2d4a4b8750b07506c80030a964be4ef31efaf6e03c3c4 not found: ID does not exist"
May 27 23:46:34.327767 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:46:34.327747    2557 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["test-ns-feast/redis-854544c579-f5kh4"]
May 27 23:46:34.329922 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:46:34.329902    2557 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["test-ns-feast/redis-854544c579-f5kh4"]
May 27 23:46:35.201985 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:46:35.201950    2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e1cd4e12-f0f1-441f-9309-01a777054e56" path="/var/lib/kubelet/pods/e1cd4e12-f0f1-441f-9309-01a777054e56/volumes"
May 27 23:51:21.721672 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:51:21.721639    2557 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["feast-operator-system/feast-operator-controller-manager-cf99db75-q2mt6"]
May 27 23:51:21.722169 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:51:21.721867    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e1cd4e12-f0f1-441f-9309-01a777054e56" containerName="redis"
May 27 23:51:21.722169 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:51:21.721877    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="e1cd4e12-f0f1-441f-9309-01a777054e56" containerName="redis"
May 27 23:51:21.722169 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:51:21.721917    2557 memory_manager.go:356] "RemoveStaleState removing state" podUID="e1cd4e12-f0f1-441f-9309-01a777054e56" containerName="redis"
May 27 23:51:21.724538 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:51:21.724520    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="feast-operator-system/feast-operator-controller-manager-cf99db75-q2mt6"
May 27 23:51:21.727489 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:51:21.727459    2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"feast-operator-system\"/\"openshift-service-ca.crt\""
May 27 23:51:21.727629 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:51:21.727527    2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"feast-operator-system\"/\"kube-root-ca.crt\""
May 27 23:51:21.728842 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:51:21.728826    2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"feast-operator-system\"/\"feast-operator-controller-manager-dockercfg-78kkl\""
May 27 23:51:21.733639 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:51:21.733618    2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["feast-operator-system/feast-operator-controller-manager-cf99db75-q2mt6"]
May 27 23:51:21.818496 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:51:21.818450    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7q2w9\" (UniqueName: \"kubernetes.io/projected/98f4e66b-5469-46f0-b66d-56ec5af49b22-kube-api-access-7q2w9\") pod \"feast-operator-controller-manager-cf99db75-q2mt6\" (UID: \"98f4e66b-5469-46f0-b66d-56ec5af49b22\") " pod="feast-operator-system/feast-operator-controller-manager-cf99db75-q2mt6"
May 27 23:51:21.919515 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:51:21.919468    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-7q2w9\" (UniqueName: \"kubernetes.io/projected/98f4e66b-5469-46f0-b66d-56ec5af49b22-kube-api-access-7q2w9\") pod \"feast-operator-controller-manager-cf99db75-q2mt6\" (UID: \"98f4e66b-5469-46f0-b66d-56ec5af49b22\") " pod="feast-operator-system/feast-operator-controller-manager-cf99db75-q2mt6"
May 27 23:51:21.930171 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:51:21.930119    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7q2w9\" (UniqueName: \"kubernetes.io/projected/98f4e66b-5469-46f0-b66d-56ec5af49b22-kube-api-access-7q2w9\") pod \"feast-operator-controller-manager-cf99db75-q2mt6\" (UID: \"98f4e66b-5469-46f0-b66d-56ec5af49b22\") " pod="feast-operator-system/feast-operator-controller-manager-cf99db75-q2mt6"
May 27 23:51:22.034677 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:51:22.034580    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="feast-operator-system/feast-operator-controller-manager-cf99db75-q2mt6"
May 27 23:51:22.163257 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:51:22.163222    2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["feast-operator-system/feast-operator-controller-manager-cf99db75-q2mt6"]
May 27 23:51:22.166527 ip-10-0-132-191 kubenswrapper[2557]: W0527 23:51:22.166496    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod98f4e66b_5469_46f0_b66d_56ec5af49b22.slice/crio-7310df4393bb6a17cbec81986b4e00b814934c469c89f832b5c939e8de3b3338 WatchSource:0}: Error finding container 7310df4393bb6a17cbec81986b4e00b814934c469c89f832b5c939e8de3b3338: Status 404 returned error can't find the container with id 7310df4393bb6a17cbec81986b4e00b814934c469c89f832b5c939e8de3b3338
May 27 23:51:22.168198 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:51:22.168182    2557 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
May 27 23:51:23.017028 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:51:23.016989    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="feast-operator-system/feast-operator-controller-manager-cf99db75-q2mt6" event={"ID":"98f4e66b-5469-46f0-b66d-56ec5af49b22","Type":"ContainerStarted","Data":"7310df4393bb6a17cbec81986b4e00b814934c469c89f832b5c939e8de3b3338"}
May 27 23:51:25.029117 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:51:25.029079    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="feast-operator-system/feast-operator-controller-manager-cf99db75-q2mt6" event={"ID":"98f4e66b-5469-46f0-b66d-56ec5af49b22","Type":"ContainerStarted","Data":"35952a92192ee53f288c05f6a60d6225fabd3aa79171532b0618477bd0491633"}
May 27 23:51:25.029506 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:51:25.029245    2557 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="feast-operator-system/feast-operator-controller-manager-cf99db75-q2mt6"
May 27 23:51:25.047374 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:51:25.047328    2557 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="feast-operator-system/feast-operator-controller-manager-cf99db75-q2mt6" podStartSLOduration=1.366308618 podStartE2EDuration="4.047315417s" podCreationTimestamp="2026-05-27 23:51:21 +0000 UTC" firstStartedPulling="2026-05-27 23:51:22.16830824 +0000 UTC m=+1097.587844229" lastFinishedPulling="2026-05-27 23:51:24.849315038 +0000 UTC m=+1100.268851028" observedRunningTime="2026-05-27 23:51:25.04585115 +0000 UTC m=+1100.465387163" watchObservedRunningTime="2026-05-27 23:51:25.047315417 +0000 UTC m=+1100.466851428"
May 27 23:51:36.034451 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:51:36.034414    2557 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="feast-operator-system/feast-operator-controller-manager-cf99db75-q2mt6"
May 27 23:51:38.415677 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:51:38.415639    2557 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["test-ns-feast/feast-simple-feast-setup-664fcfcc58-lrsnz"]
May 27 23:51:38.420938 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:51:38.420914    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-lrsnz"
May 27 23:51:38.423683 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:51:38.423659    2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-ui-tls\""
May 27 23:51:38.423803 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:51:38.423659    2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-online-tls\""
May 27 23:51:38.423803 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:51:38.423789    2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-registry-tls\""
May 27 23:51:38.423924 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:51:38.423796    2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-dockercfg-m8dp8\""
May 27 23:51:38.423924 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:51:38.423868    2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-offline-tls\""
May 27 23:51:38.424015 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:51:38.423991    2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast\"/\"kube-root-ca.crt\""
May 27 23:51:38.424093 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:51:38.424073    2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast\"/\"openshift-service-ca.crt\""
May 27 23:51:38.429518 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:51:38.429495    2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-664fcfcc58-lrsnz"]
May 27 23:51:38.544933 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:51:38.544902    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/49329b31-b874-4e4d-8cd2-37f249b68110-offline-tls\") pod \"feast-simple-feast-setup-664fcfcc58-lrsnz\" (UID: \"49329b31-b874-4e4d-8cd2-37f249b68110\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-lrsnz"
May 27 23:51:38.545106 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:51:38.544942    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g6lpw\" (UniqueName: \"kubernetes.io/projected/49329b31-b874-4e4d-8cd2-37f249b68110-kube-api-access-g6lpw\") pod \"feast-simple-feast-setup-664fcfcc58-lrsnz\" (UID: \"49329b31-b874-4e4d-8cd2-37f249b68110\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-lrsnz"
May 27 23:51:38.545106 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:51:38.544978    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/49329b31-b874-4e4d-8cd2-37f249b68110-online-tls\") pod \"feast-simple-feast-setup-664fcfcc58-lrsnz\" (UID: \"49329b31-b874-4e4d-8cd2-37f249b68110\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-lrsnz"
May 27 23:51:38.545106 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:51:38.545030    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/49329b31-b874-4e4d-8cd2-37f249b68110-registry-tls\") pod \"feast-simple-feast-setup-664fcfcc58-lrsnz\" (UID: \"49329b31-b874-4e4d-8cd2-37f249b68110\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-lrsnz"
May 27 23:51:38.545106 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:51:38.545062    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/49329b31-b874-4e4d-8cd2-37f249b68110-feast-data\") pod \"feast-simple-feast-setup-664fcfcc58-lrsnz\" (UID: \"49329b31-b874-4e4d-8cd2-37f249b68110\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-lrsnz"
May 27 23:51:38.545106 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:51:38.545086    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/49329b31-b874-4e4d-8cd2-37f249b68110-ui-tls\") pod \"feast-simple-feast-setup-664fcfcc58-lrsnz\" (UID: \"49329b31-b874-4e4d-8cd2-37f249b68110\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-lrsnz"
May 27 23:51:38.645433 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:51:38.645401    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/49329b31-b874-4e4d-8cd2-37f249b68110-online-tls\") pod \"feast-simple-feast-setup-664fcfcc58-lrsnz\" (UID: \"49329b31-b874-4e4d-8cd2-37f249b68110\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-lrsnz"
May 27 23:51:38.645433 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:51:38.645432    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/49329b31-b874-4e4d-8cd2-37f249b68110-registry-tls\") pod \"feast-simple-feast-setup-664fcfcc58-lrsnz\" (UID: \"49329b31-b874-4e4d-8cd2-37f249b68110\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-lrsnz"
May 27 23:51:38.645655 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:51:38.645448    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/49329b31-b874-4e4d-8cd2-37f249b68110-feast-data\") pod \"feast-simple-feast-setup-664fcfcc58-lrsnz\" (UID: \"49329b31-b874-4e4d-8cd2-37f249b68110\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-lrsnz"
May 27 23:51:38.645655 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:51:38.645465    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/49329b31-b874-4e4d-8cd2-37f249b68110-ui-tls\") pod \"feast-simple-feast-setup-664fcfcc58-lrsnz\" (UID: \"49329b31-b874-4e4d-8cd2-37f249b68110\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-lrsnz"
May 27 23:51:38.645655 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:51:38.645495    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/49329b31-b874-4e4d-8cd2-37f249b68110-offline-tls\") pod \"feast-simple-feast-setup-664fcfcc58-lrsnz\" (UID: \"49329b31-b874-4e4d-8cd2-37f249b68110\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-lrsnz"
May 27 23:51:38.645655 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:51:38.645524    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-g6lpw\" (UniqueName: \"kubernetes.io/projected/49329b31-b874-4e4d-8cd2-37f249b68110-kube-api-access-g6lpw\") pod \"feast-simple-feast-setup-664fcfcc58-lrsnz\" (UID: \"49329b31-b874-4e4d-8cd2-37f249b68110\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-lrsnz"
May 27 23:51:38.645655 ip-10-0-132-191 kubenswrapper[2557]: E0527 23:51:38.645566    2557 secret.go:189] Couldn't get secret test-ns-feast/feast-simple-feast-setup-ui-tls: secret "feast-simple-feast-setup-ui-tls" not found
May 27 23:51:38.645655 ip-10-0-132-191 kubenswrapper[2557]: E0527 23:51:38.645648    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/49329b31-b874-4e4d-8cd2-37f249b68110-ui-tls podName:49329b31-b874-4e4d-8cd2-37f249b68110 nodeName:}" failed. No retries permitted until 2026-05-27 23:51:39.145631403 +0000 UTC m=+1114.565167393 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "ui-tls" (UniqueName: "kubernetes.io/secret/49329b31-b874-4e4d-8cd2-37f249b68110-ui-tls") pod "feast-simple-feast-setup-664fcfcc58-lrsnz" (UID: "49329b31-b874-4e4d-8cd2-37f249b68110") : secret "feast-simple-feast-setup-ui-tls" not found
May 27 23:51:38.645854 ip-10-0-132-191 kubenswrapper[2557]: E0527 23:51:38.645565    2557 secret.go:189] Couldn't get secret test-ns-feast/feast-simple-feast-setup-online-tls: secret "feast-simple-feast-setup-online-tls" not found
May 27 23:51:38.645854 ip-10-0-132-191 kubenswrapper[2557]: E0527 23:51:38.645775    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/49329b31-b874-4e4d-8cd2-37f249b68110-online-tls podName:49329b31-b874-4e4d-8cd2-37f249b68110 nodeName:}" failed. No retries permitted until 2026-05-27 23:51:39.145764365 +0000 UTC m=+1114.565300382 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "online-tls" (UniqueName: "kubernetes.io/secret/49329b31-b874-4e4d-8cd2-37f249b68110-online-tls") pod "feast-simple-feast-setup-664fcfcc58-lrsnz" (UID: "49329b31-b874-4e4d-8cd2-37f249b68110") : secret "feast-simple-feast-setup-online-tls" not found
May 27 23:51:38.645926 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:51:38.645870    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/49329b31-b874-4e4d-8cd2-37f249b68110-feast-data\") pod \"feast-simple-feast-setup-664fcfcc58-lrsnz\" (UID: \"49329b31-b874-4e4d-8cd2-37f249b68110\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-lrsnz"
May 27 23:51:38.647896 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:51:38.647874    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/49329b31-b874-4e4d-8cd2-37f249b68110-registry-tls\") pod \"feast-simple-feast-setup-664fcfcc58-lrsnz\" (UID: \"49329b31-b874-4e4d-8cd2-37f249b68110\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-lrsnz"
May 27 23:51:38.647987 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:51:38.647902    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/49329b31-b874-4e4d-8cd2-37f249b68110-offline-tls\") pod \"feast-simple-feast-setup-664fcfcc58-lrsnz\" (UID: \"49329b31-b874-4e4d-8cd2-37f249b68110\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-lrsnz"
May 27 23:51:38.654452 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:51:38.654423    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-g6lpw\" (UniqueName: \"kubernetes.io/projected/49329b31-b874-4e4d-8cd2-37f249b68110-kube-api-access-g6lpw\") pod \"feast-simple-feast-setup-664fcfcc58-lrsnz\" (UID: \"49329b31-b874-4e4d-8cd2-37f249b68110\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-lrsnz"
May 27 23:51:39.149477 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:51:39.149441    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/49329b31-b874-4e4d-8cd2-37f249b68110-online-tls\") pod \"feast-simple-feast-setup-664fcfcc58-lrsnz\" (UID: \"49329b31-b874-4e4d-8cd2-37f249b68110\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-lrsnz"
May 27 23:51:39.149477 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:51:39.149483    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/49329b31-b874-4e4d-8cd2-37f249b68110-ui-tls\") pod \"feast-simple-feast-setup-664fcfcc58-lrsnz\" (UID: \"49329b31-b874-4e4d-8cd2-37f249b68110\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-lrsnz"
May 27 23:51:39.151898 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:51:39.151865    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/49329b31-b874-4e4d-8cd2-37f249b68110-online-tls\") pod \"feast-simple-feast-setup-664fcfcc58-lrsnz\" (UID: \"49329b31-b874-4e4d-8cd2-37f249b68110\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-lrsnz"
May 27 23:51:39.152030 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:51:39.152006    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/49329b31-b874-4e4d-8cd2-37f249b68110-ui-tls\") pod \"feast-simple-feast-setup-664fcfcc58-lrsnz\" (UID: \"49329b31-b874-4e4d-8cd2-37f249b68110\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-lrsnz"
May 27 23:51:39.330103 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:51:39.330062    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-lrsnz"
May 27 23:51:39.458619 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:51:39.458593    2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-664fcfcc58-lrsnz"]
May 27 23:51:39.459839 ip-10-0-132-191 kubenswrapper[2557]: W0527 23:51:39.459811    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod49329b31_b874_4e4d_8cd2_37f249b68110.slice/crio-42081b2901009ad46257883ff53a4fd6d9354254b86873a85c58e7a208c8b98b WatchSource:0}: Error finding container 42081b2901009ad46257883ff53a4fd6d9354254b86873a85c58e7a208c8b98b: Status 404 returned error can't find the container with id 42081b2901009ad46257883ff53a4fd6d9354254b86873a85c58e7a208c8b98b
May 27 23:51:40.067896 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:51:40.067860    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-lrsnz" event={"ID":"49329b31-b874-4e4d-8cd2-37f249b68110","Type":"ContainerStarted","Data":"42081b2901009ad46257883ff53a4fd6d9354254b86873a85c58e7a208c8b98b"}
May 27 23:51:55.111816 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:51:55.111779    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-lrsnz" event={"ID":"49329b31-b874-4e4d-8cd2-37f249b68110","Type":"ContainerStarted","Data":"251c5a23fed6b99f378f24e12617664e87dc408a7a5afea7914f31624d171f32"}
May 27 23:51:59.123789 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:51:59.123751    2557 generic.go:358] "Generic (PLEG): container finished" podID="49329b31-b874-4e4d-8cd2-37f249b68110" containerID="251c5a23fed6b99f378f24e12617664e87dc408a7a5afea7914f31624d171f32" exitCode=0
May 27 23:51:59.124197 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:51:59.123819    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-lrsnz" event={"ID":"49329b31-b874-4e4d-8cd2-37f249b68110","Type":"ContainerDied","Data":"251c5a23fed6b99f378f24e12617664e87dc408a7a5afea7914f31624d171f32"}
May 27 23:52:00.128248 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:52:00.128207    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-lrsnz" event={"ID":"49329b31-b874-4e4d-8cd2-37f249b68110","Type":"ContainerStarted","Data":"53c72864a9638cdbbae12ea4a3433de283eb013b4589af3c79de754df727f962"}
May 27 23:52:06.146893 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:52:06.146859    2557 generic.go:358] "Generic (PLEG): container finished" podID="49329b31-b874-4e4d-8cd2-37f249b68110" containerID="53c72864a9638cdbbae12ea4a3433de283eb013b4589af3c79de754df727f962" exitCode=0
May 27 23:52:06.146893 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:52:06.146900    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-lrsnz" event={"ID":"49329b31-b874-4e4d-8cd2-37f249b68110","Type":"ContainerDied","Data":"53c72864a9638cdbbae12ea4a3433de283eb013b4589af3c79de754df727f962"}
May 27 23:52:07.154818 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:52:07.154778    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-lrsnz" event={"ID":"49329b31-b874-4e4d-8cd2-37f249b68110","Type":"ContainerStarted","Data":"682c8d5eae399cd0a8aa93a5dc44e1157bef05ab4369902afe86c893fc9a3c74"}
May 27 23:52:07.154818 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:52:07.154823    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-lrsnz" event={"ID":"49329b31-b874-4e4d-8cd2-37f249b68110","Type":"ContainerStarted","Data":"33b49d47f9d950a21cb1d4232d22bc3f6d6821be2c83efe10ecf67461391b0e4"}
May 27 23:52:07.155370 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:52:07.154837    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-lrsnz" event={"ID":"49329b31-b874-4e4d-8cd2-37f249b68110","Type":"ContainerStarted","Data":"81ebe1818cac0d2cb9def5883bb7789c230277414d0339b160c16a5b59f6bd96"}
May 27 23:52:07.155370 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:52:07.154850    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-lrsnz" event={"ID":"49329b31-b874-4e4d-8cd2-37f249b68110","Type":"ContainerStarted","Data":"be293f72266d4194713776ffdd334bfe45503ac00f6acd25f03995362c3dfff2"}
May 27 23:52:07.185475 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:52:07.185407    2557 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-lrsnz" podStartSLOduration=14.581836097 podStartE2EDuration="29.1853844s" podCreationTimestamp="2026-05-27 23:51:38 +0000 UTC" firstStartedPulling="2026-05-27 23:51:39.461524355 +0000 UTC m=+1114.881060348" lastFinishedPulling="2026-05-27 23:51:54.06507266 +0000 UTC m=+1129.484608651" observedRunningTime="2026-05-27 23:52:07.184527764 +0000 UTC m=+1142.604063778" watchObservedRunningTime="2026-05-27 23:52:07.1853844 +0000 UTC m=+1142.604920413"
May 27 23:52:09.331392 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:52:09.331347    2557 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-lrsnz"
May 27 23:52:09.331858 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:52:09.331405    2557 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-lrsnz"
May 27 23:52:09.331858 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:52:09.331421    2557 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-lrsnz"
May 27 23:52:09.331858 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:52:09.331434    2557 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-lrsnz"
May 27 23:52:09.331858 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:52:09.331448    2557 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-lrsnz"
May 27 23:52:09.331858 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:52:09.331463    2557 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-lrsnz"
May 27 23:52:09.331858 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:52:09.331476    2557 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-lrsnz"
May 27 23:52:09.331858 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:52:09.331489    2557 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-lrsnz"
May 27 23:52:09.333663 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:52:09.333549    2557 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-lrsnz" podUID="49329b31-b874-4e4d-8cd2-37f249b68110" containerName="offline" probeResult="failure" output="dial tcp 10.132.0.15:8816: connect: connection refused"
May 27 23:52:09.333663 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:52:09.333573    2557 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-lrsnz" podUID="49329b31-b874-4e4d-8cd2-37f249b68110" containerName="registry" probeResult="failure" output="dial tcp 10.132.0.15:6571: connect: connection refused"
May 27 23:52:09.333663 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:52:09.333596    2557 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-lrsnz" podUID="49329b31-b874-4e4d-8cd2-37f249b68110" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.15:8443: connect: connection refused"
May 27 23:52:09.333663 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:52:09.333605    2557 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-lrsnz" podUID="49329b31-b874-4e4d-8cd2-37f249b68110" containerName="online" probeResult="failure" output="Get \"https://10.132.0.15:6567/health\": dial tcp 10.132.0.15:6567: connect: connection refused"
May 27 23:52:12.331423 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:52:12.331387    2557 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-lrsnz"
May 27 23:52:12.331955 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:52:12.331505    2557 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-lrsnz"
May 27 23:52:12.331955 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:52:12.331784    2557 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-lrsnz"
May 27 23:52:12.332554 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:52:12.332530    2557 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-lrsnz"
May 27 23:52:12.332692 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:52:12.332675    2557 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-lrsnz"
May 27 23:52:12.332758 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:52:12.332744    2557 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-lrsnz"
May 27 23:52:12.336029 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:52:12.336010    2557 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-lrsnz"
May 27 23:52:13.184669 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:52:13.184639    2557 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-lrsnz"
May 27 23:53:15.758021 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:53:15.757984    2557 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-664fcfcc58-lrsnz"]
May 27 23:53:15.758546 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:53:15.758388    2557 kuberuntime_container.go:864] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-lrsnz" podUID="49329b31-b874-4e4d-8cd2-37f249b68110" containerName="registry" containerID="cri-o://be293f72266d4194713776ffdd334bfe45503ac00f6acd25f03995362c3dfff2" gracePeriod=30
May 27 23:53:15.758546 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:53:15.758419    2557 kuberuntime_container.go:864] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-lrsnz" podUID="49329b31-b874-4e4d-8cd2-37f249b68110" containerName="ui" containerID="cri-o://682c8d5eae399cd0a8aa93a5dc44e1157bef05ab4369902afe86c893fc9a3c74" gracePeriod=30
May 27 23:53:15.758546 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:53:15.758485    2557 kuberuntime_container.go:864] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-lrsnz" podUID="49329b31-b874-4e4d-8cd2-37f249b68110" containerName="offline" containerID="cri-o://33b49d47f9d950a21cb1d4232d22bc3f6d6821be2c83efe10ecf67461391b0e4" gracePeriod=30
May 27 23:53:15.758546 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:53:15.758529    2557 kuberuntime_container.go:864] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-lrsnz" podUID="49329b31-b874-4e4d-8cd2-37f249b68110" containerName="online" containerID="cri-o://81ebe1818cac0d2cb9def5883bb7789c230277414d0339b160c16a5b59f6bd96" gracePeriod=30
May 27 23:53:16.045203 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:53:16.045096    2557 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["test-ns-feast/feast-simple-feast-setup-664fcfcc58-xsbrl"]
May 27 23:53:16.047603 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:53:16.047573    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-xsbrl"
May 27 23:53:16.050385 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:53:16.050362    2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-dockercfg-wzxjp\""
May 27 23:53:16.060756 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:53:16.060734    2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-664fcfcc58-xsbrl"]
May 27 23:53:16.166937 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:53:16.166904    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/91fbb8ad-b71b-4688-a82a-7ad7291e01db-offline-tls\") pod \"feast-simple-feast-setup-664fcfcc58-xsbrl\" (UID: \"91fbb8ad-b71b-4688-a82a-7ad7291e01db\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-xsbrl"
May 27 23:53:16.166937 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:53:16.166944    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/91fbb8ad-b71b-4688-a82a-7ad7291e01db-online-tls\") pod \"feast-simple-feast-setup-664fcfcc58-xsbrl\" (UID: \"91fbb8ad-b71b-4688-a82a-7ad7291e01db\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-xsbrl"
May 27 23:53:16.167226 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:53:16.166973    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/91fbb8ad-b71b-4688-a82a-7ad7291e01db-ui-tls\") pod \"feast-simple-feast-setup-664fcfcc58-xsbrl\" (UID: \"91fbb8ad-b71b-4688-a82a-7ad7291e01db\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-xsbrl"
May 27 23:53:16.167226 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:53:16.167051    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z8n8x\" (UniqueName: \"kubernetes.io/projected/91fbb8ad-b71b-4688-a82a-7ad7291e01db-kube-api-access-z8n8x\") pod \"feast-simple-feast-setup-664fcfcc58-xsbrl\" (UID: \"91fbb8ad-b71b-4688-a82a-7ad7291e01db\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-xsbrl"
May 27 23:53:16.167226 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:53:16.167103    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/91fbb8ad-b71b-4688-a82a-7ad7291e01db-registry-tls\") pod \"feast-simple-feast-setup-664fcfcc58-xsbrl\" (UID: \"91fbb8ad-b71b-4688-a82a-7ad7291e01db\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-xsbrl"
May 27 23:53:16.167226 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:53:16.167163    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/91fbb8ad-b71b-4688-a82a-7ad7291e01db-feast-data\") pod \"feast-simple-feast-setup-664fcfcc58-xsbrl\" (UID: \"91fbb8ad-b71b-4688-a82a-7ad7291e01db\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-xsbrl"
May 27 23:53:16.267992 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:53:16.267951    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/91fbb8ad-b71b-4688-a82a-7ad7291e01db-ui-tls\") pod \"feast-simple-feast-setup-664fcfcc58-xsbrl\" (UID: \"91fbb8ad-b71b-4688-a82a-7ad7291e01db\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-xsbrl"
May 27 23:53:16.267992 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:53:16.267994    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-z8n8x\" (UniqueName: \"kubernetes.io/projected/91fbb8ad-b71b-4688-a82a-7ad7291e01db-kube-api-access-z8n8x\") pod \"feast-simple-feast-setup-664fcfcc58-xsbrl\" (UID: \"91fbb8ad-b71b-4688-a82a-7ad7291e01db\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-xsbrl"
May 27 23:53:16.268279 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:53:16.268022    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/91fbb8ad-b71b-4688-a82a-7ad7291e01db-registry-tls\") pod \"feast-simple-feast-setup-664fcfcc58-xsbrl\" (UID: \"91fbb8ad-b71b-4688-a82a-7ad7291e01db\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-xsbrl"
May 27 23:53:16.268279 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:53:16.268038    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/91fbb8ad-b71b-4688-a82a-7ad7291e01db-feast-data\") pod \"feast-simple-feast-setup-664fcfcc58-xsbrl\" (UID: \"91fbb8ad-b71b-4688-a82a-7ad7291e01db\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-xsbrl"
May 27 23:53:16.268279 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:53:16.268092    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/91fbb8ad-b71b-4688-a82a-7ad7291e01db-offline-tls\") pod \"feast-simple-feast-setup-664fcfcc58-xsbrl\" (UID: \"91fbb8ad-b71b-4688-a82a-7ad7291e01db\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-xsbrl"
May 27 23:53:16.268447 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:53:16.268421    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/91fbb8ad-b71b-4688-a82a-7ad7291e01db-online-tls\") pod \"feast-simple-feast-setup-664fcfcc58-xsbrl\" (UID: \"91fbb8ad-b71b-4688-a82a-7ad7291e01db\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-xsbrl"
May 27 23:53:16.268546 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:53:16.268521    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/91fbb8ad-b71b-4688-a82a-7ad7291e01db-feast-data\") pod \"feast-simple-feast-setup-664fcfcc58-xsbrl\" (UID: \"91fbb8ad-b71b-4688-a82a-7ad7291e01db\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-xsbrl"
May 27 23:53:16.268611 ip-10-0-132-191 kubenswrapper[2557]: E0527 23:53:16.268575    2557 secret.go:189] Couldn't get secret test-ns-feast/feast-simple-feast-setup-online-tls: secret "feast-simple-feast-setup-online-tls" not found
May 27 23:53:16.268737 ip-10-0-132-191 kubenswrapper[2557]: E0527 23:53:16.268680    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/91fbb8ad-b71b-4688-a82a-7ad7291e01db-online-tls podName:91fbb8ad-b71b-4688-a82a-7ad7291e01db nodeName:}" failed. No retries permitted until 2026-05-27 23:53:16.768657296 +0000 UTC m=+1212.188193287 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "online-tls" (UniqueName: "kubernetes.io/secret/91fbb8ad-b71b-4688-a82a-7ad7291e01db-online-tls") pod "feast-simple-feast-setup-664fcfcc58-xsbrl" (UID: "91fbb8ad-b71b-4688-a82a-7ad7291e01db") : secret "feast-simple-feast-setup-online-tls" not found
May 27 23:53:16.270649 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:53:16.270624    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/91fbb8ad-b71b-4688-a82a-7ad7291e01db-ui-tls\") pod \"feast-simple-feast-setup-664fcfcc58-xsbrl\" (UID: \"91fbb8ad-b71b-4688-a82a-7ad7291e01db\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-xsbrl"
May 27 23:53:16.270763 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:53:16.270624    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/91fbb8ad-b71b-4688-a82a-7ad7291e01db-offline-tls\") pod \"feast-simple-feast-setup-664fcfcc58-xsbrl\" (UID: \"91fbb8ad-b71b-4688-a82a-7ad7291e01db\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-xsbrl"
May 27 23:53:16.270763 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:53:16.270665    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/91fbb8ad-b71b-4688-a82a-7ad7291e01db-registry-tls\") pod \"feast-simple-feast-setup-664fcfcc58-xsbrl\" (UID: \"91fbb8ad-b71b-4688-a82a-7ad7291e01db\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-xsbrl"
May 27 23:53:16.279100 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:53:16.279075    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-z8n8x\" (UniqueName: \"kubernetes.io/projected/91fbb8ad-b71b-4688-a82a-7ad7291e01db-kube-api-access-z8n8x\") pod \"feast-simple-feast-setup-664fcfcc58-xsbrl\" (UID: \"91fbb8ad-b71b-4688-a82a-7ad7291e01db\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-xsbrl"
May 27 23:53:16.344275 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:53:16.344242    2557 generic.go:358] "Generic (PLEG): container finished" podID="49329b31-b874-4e4d-8cd2-37f249b68110" containerID="682c8d5eae399cd0a8aa93a5dc44e1157bef05ab4369902afe86c893fc9a3c74" exitCode=0
May 27 23:53:16.344440 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:53:16.344313    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-lrsnz" event={"ID":"49329b31-b874-4e4d-8cd2-37f249b68110","Type":"ContainerDied","Data":"682c8d5eae399cd0a8aa93a5dc44e1157bef05ab4369902afe86c893fc9a3c74"}
May 27 23:53:16.772401 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:53:16.772324    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/91fbb8ad-b71b-4688-a82a-7ad7291e01db-online-tls\") pod \"feast-simple-feast-setup-664fcfcc58-xsbrl\" (UID: \"91fbb8ad-b71b-4688-a82a-7ad7291e01db\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-xsbrl"
May 27 23:53:16.774553 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:53:16.774534    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/91fbb8ad-b71b-4688-a82a-7ad7291e01db-online-tls\") pod \"feast-simple-feast-setup-664fcfcc58-xsbrl\" (UID: \"91fbb8ad-b71b-4688-a82a-7ad7291e01db\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-xsbrl"
May 27 23:53:16.956815 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:53:16.956785    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-xsbrl"
May 27 23:53:17.085360 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:53:17.085247    2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-664fcfcc58-xsbrl"]
May 27 23:53:17.087699 ip-10-0-132-191 kubenswrapper[2557]: W0527 23:53:17.087675    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod91fbb8ad_b71b_4688_a82a_7ad7291e01db.slice/crio-81c21afebe709ab04e8dd708cc5384d18f46b8355c770e4951d9116e3eef33db WatchSource:0}: Error finding container 81c21afebe709ab04e8dd708cc5384d18f46b8355c770e4951d9116e3eef33db: Status 404 returned error can't find the container with id 81c21afebe709ab04e8dd708cc5384d18f46b8355c770e4951d9116e3eef33db
May 27 23:53:17.350412 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:53:17.350377    2557 generic.go:358] "Generic (PLEG): container finished" podID="49329b31-b874-4e4d-8cd2-37f249b68110" containerID="81ebe1818cac0d2cb9def5883bb7789c230277414d0339b160c16a5b59f6bd96" exitCode=0
May 27 23:53:17.350581 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:53:17.350491    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-lrsnz" event={"ID":"49329b31-b874-4e4d-8cd2-37f249b68110","Type":"ContainerDied","Data":"81ebe1818cac0d2cb9def5883bb7789c230277414d0339b160c16a5b59f6bd96"}
May 27 23:53:17.352262 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:53:17.352233    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-xsbrl" event={"ID":"91fbb8ad-b71b-4688-a82a-7ad7291e01db","Type":"ContainerStarted","Data":"2f5d13ea0cc7c4993419acdf13f2e0dfecc5957f1bc0430363a3c4971ff3219e"}
May 27 23:53:17.352320 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:53:17.352273    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-xsbrl" event={"ID":"91fbb8ad-b71b-4688-a82a-7ad7291e01db","Type":"ContainerStarted","Data":"81c21afebe709ab04e8dd708cc5384d18f46b8355c770e4951d9116e3eef33db"}
May 27 23:53:22.333151 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:53:22.333078    2557 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-lrsnz" podUID="49329b31-b874-4e4d-8cd2-37f249b68110" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.15:8443: connect: connection refused"
May 27 23:53:22.365692 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:53:22.365661    2557 generic.go:358] "Generic (PLEG): container finished" podID="91fbb8ad-b71b-4688-a82a-7ad7291e01db" containerID="2f5d13ea0cc7c4993419acdf13f2e0dfecc5957f1bc0430363a3c4971ff3219e" exitCode=0
May 27 23:53:22.365811 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:53:22.365733    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-xsbrl" event={"ID":"91fbb8ad-b71b-4688-a82a-7ad7291e01db","Type":"ContainerDied","Data":"2f5d13ea0cc7c4993419acdf13f2e0dfecc5957f1bc0430363a3c4971ff3219e"}
May 27 23:53:23.182693 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:53:23.182650    2557 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-lrsnz" podUID="49329b31-b874-4e4d-8cd2-37f249b68110" containerName="online" probeResult="failure" output="Get \"https://10.132.0.15:6567/health\": dial tcp 10.132.0.15:6567: connect: connection refused"
May 27 23:53:23.370307 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:53:23.370272    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-xsbrl" event={"ID":"91fbb8ad-b71b-4688-a82a-7ad7291e01db","Type":"ContainerStarted","Data":"e38688d6121e87d23ae1080900057973414c244d0c799611335cc31f6f773c94"}
May 27 23:53:28.385263 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:53:28.385232    2557 generic.go:358] "Generic (PLEG): container finished" podID="91fbb8ad-b71b-4688-a82a-7ad7291e01db" containerID="e38688d6121e87d23ae1080900057973414c244d0c799611335cc31f6f773c94" exitCode=0
May 27 23:53:28.385650 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:53:28.385285    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-xsbrl" event={"ID":"91fbb8ad-b71b-4688-a82a-7ad7291e01db","Type":"ContainerDied","Data":"e38688d6121e87d23ae1080900057973414c244d0c799611335cc31f6f773c94"}
May 27 23:53:29.391619 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:53:29.391575    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-xsbrl" event={"ID":"91fbb8ad-b71b-4688-a82a-7ad7291e01db","Type":"ContainerStarted","Data":"5c32c32b689cb7781eb61b7f0e93d51e8e1990fff9cdc0e9cfaf4dd072536d82"}
May 27 23:53:29.392114 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:53:29.391629    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-xsbrl" event={"ID":"91fbb8ad-b71b-4688-a82a-7ad7291e01db","Type":"ContainerStarted","Data":"20ec258ca4523542e1dbd57cd398094556faba03080619800adba63449dc9a7c"}
May 27 23:53:29.392114 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:53:29.391647    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-xsbrl" event={"ID":"91fbb8ad-b71b-4688-a82a-7ad7291e01db","Type":"ContainerStarted","Data":"7acbee21eacb84278b80532b148ffd9fa018df933ae27508831e6801894be9c8"}
May 27 23:53:29.392114 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:53:29.391661    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-xsbrl" event={"ID":"91fbb8ad-b71b-4688-a82a-7ad7291e01db","Type":"ContainerStarted","Data":"5c09ee7497926d566442dd7f85234f47918b97b108e9839230477de7908e8370"}
May 27 23:53:29.418493 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:53:29.418433    2557 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-xsbrl" podStartSLOduration=13.418413494 podStartE2EDuration="13.418413494s" podCreationTimestamp="2026-05-27 23:53:16 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-27 23:53:29.415688266 +0000 UTC m=+1224.835224324" watchObservedRunningTime="2026-05-27 23:53:29.418413494 +0000 UTC m=+1224.837949507"
May 27 23:53:31.957829 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:53:31.957764    2557 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-xsbrl"
May 27 23:53:31.957829 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:53:31.957812    2557 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-xsbrl"
May 27 23:53:31.957829 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:53:31.957826    2557 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-xsbrl"
May 27 23:53:31.957829 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:53:31.957839    2557 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-xsbrl"
May 27 23:53:31.959701 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:53:31.959657    2557 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-xsbrl" podUID="91fbb8ad-b71b-4688-a82a-7ad7291e01db" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.16:8443: connect: connection refused"
May 27 23:53:31.959849 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:53:31.959729    2557 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-xsbrl" podUID="91fbb8ad-b71b-4688-a82a-7ad7291e01db" containerName="online" probeResult="failure" output="Get \"https://10.132.0.16:6567/health\": dial tcp 10.132.0.16:6567: connect: connection refused"
May 27 23:53:31.959849 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:53:31.959674    2557 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-xsbrl" podUID="91fbb8ad-b71b-4688-a82a-7ad7291e01db" containerName="offline" probeResult="failure" output="dial tcp 10.132.0.16:8816: connect: connection refused"
May 27 23:53:31.959849 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:53:31.959675    2557 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-xsbrl" podUID="91fbb8ad-b71b-4688-a82a-7ad7291e01db" containerName="registry" probeResult="failure" output="dial tcp 10.132.0.16:6571: connect: connection refused"
May 27 23:53:32.332857 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:53:32.332492    2557 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-lrsnz" podUID="49329b31-b874-4e4d-8cd2-37f249b68110" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.15:8443: connect: connection refused"
May 27 23:53:33.182116 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:53:33.182062    2557 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-lrsnz" podUID="49329b31-b874-4e4d-8cd2-37f249b68110" containerName="online" probeResult="failure" output="Get \"https://10.132.0.15:6567/health\": dial tcp 10.132.0.15:6567: connect: connection refused"
May 27 23:53:34.958373 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:53:34.958326    2557 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-xsbrl"
May 27 23:53:34.958754 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:53:34.958488    2557 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-xsbrl"
May 27 23:53:34.958754 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:53:34.958734    2557 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-xsbrl"
May 27 23:53:34.959147 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:53:34.959111    2557 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-xsbrl"
May 27 23:53:34.959299 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:53:34.959284    2557 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-xsbrl"
May 27 23:53:34.959415 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:53:34.959397    2557 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-xsbrl"
May 27 23:53:34.959512 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:53:34.959462    2557 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-xsbrl"
May 27 23:53:34.959512 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:53:34.959493    2557 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-xsbrl"
May 27 23:53:34.959620 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:53:34.959600    2557 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-xsbrl"
May 27 23:53:34.962922 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:53:34.962905    2557 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-xsbrl"
May 27 23:53:35.413529 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:53:35.413504    2557 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-xsbrl"
May 27 23:53:35.416506 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:53:35.416485    2557 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-xsbrl"
May 27 23:53:42.332840 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:53:42.332790    2557 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-lrsnz" podUID="49329b31-b874-4e4d-8cd2-37f249b68110" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.15:8443: connect: connection refused"
May 27 23:53:42.333306 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:53:42.332917    2557 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-lrsnz"
May 27 23:53:43.181820 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:53:43.181776    2557 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-lrsnz" podUID="49329b31-b874-4e4d-8cd2-37f249b68110" containerName="online" probeResult="failure" output="Get \"https://10.132.0.15:6567/health\": dial tcp 10.132.0.15:6567: connect: connection refused"
May 27 23:53:43.182001 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:53:43.181908    2557 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-lrsnz"
May 27 23:53:46.399497 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:53:46.399474    2557 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-lrsnz"
May 27 23:53:46.443526 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:53:46.443494    2557 generic.go:358] "Generic (PLEG): container finished" podID="49329b31-b874-4e4d-8cd2-37f249b68110" containerID="33b49d47f9d950a21cb1d4232d22bc3f6d6821be2c83efe10ecf67461391b0e4" exitCode=137
May 27 23:53:46.443526 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:53:46.443521    2557 generic.go:358] "Generic (PLEG): container finished" podID="49329b31-b874-4e4d-8cd2-37f249b68110" containerID="be293f72266d4194713776ffdd334bfe45503ac00f6acd25f03995362c3dfff2" exitCode=137
May 27 23:53:46.443709 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:53:46.443573    2557 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-lrsnz"
May 27 23:53:46.443709 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:53:46.443573    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-lrsnz" event={"ID":"49329b31-b874-4e4d-8cd2-37f249b68110","Type":"ContainerDied","Data":"33b49d47f9d950a21cb1d4232d22bc3f6d6821be2c83efe10ecf67461391b0e4"}
May 27 23:53:46.443709 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:53:46.443613    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-lrsnz" event={"ID":"49329b31-b874-4e4d-8cd2-37f249b68110","Type":"ContainerDied","Data":"be293f72266d4194713776ffdd334bfe45503ac00f6acd25f03995362c3dfff2"}
May 27 23:53:46.443709 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:53:46.443629    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-lrsnz" event={"ID":"49329b31-b874-4e4d-8cd2-37f249b68110","Type":"ContainerDied","Data":"42081b2901009ad46257883ff53a4fd6d9354254b86873a85c58e7a208c8b98b"}
May 27 23:53:46.443709 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:53:46.443649    2557 scope.go:117] "RemoveContainer" containerID="682c8d5eae399cd0a8aa93a5dc44e1157bef05ab4369902afe86c893fc9a3c74"
May 27 23:53:46.451571 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:53:46.451553    2557 scope.go:117] "RemoveContainer" containerID="33b49d47f9d950a21cb1d4232d22bc3f6d6821be2c83efe10ecf67461391b0e4"
May 27 23:53:46.458247 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:53:46.458227    2557 scope.go:117] "RemoveContainer" containerID="81ebe1818cac0d2cb9def5883bb7789c230277414d0339b160c16a5b59f6bd96"
May 27 23:53:46.464621 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:53:46.464606    2557 scope.go:117] "RemoveContainer" containerID="be293f72266d4194713776ffdd334bfe45503ac00f6acd25f03995362c3dfff2"
May 27 23:53:46.477709 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:53:46.477688    2557 scope.go:117] "RemoveContainer" containerID="53c72864a9638cdbbae12ea4a3433de283eb013b4589af3c79de754df727f962"
May 27 23:53:46.484147 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:53:46.484118    2557 scope.go:117] "RemoveContainer" containerID="251c5a23fed6b99f378f24e12617664e87dc408a7a5afea7914f31624d171f32"
May 27 23:53:46.490418 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:53:46.490401    2557 scope.go:117] "RemoveContainer" containerID="682c8d5eae399cd0a8aa93a5dc44e1157bef05ab4369902afe86c893fc9a3c74"
May 27 23:53:46.490653 ip-10-0-132-191 kubenswrapper[2557]: E0527 23:53:46.490636    2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"682c8d5eae399cd0a8aa93a5dc44e1157bef05ab4369902afe86c893fc9a3c74\": container with ID starting with 682c8d5eae399cd0a8aa93a5dc44e1157bef05ab4369902afe86c893fc9a3c74 not found: ID does not exist" containerID="682c8d5eae399cd0a8aa93a5dc44e1157bef05ab4369902afe86c893fc9a3c74"
May 27 23:53:46.490696 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:53:46.490661    2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"682c8d5eae399cd0a8aa93a5dc44e1157bef05ab4369902afe86c893fc9a3c74"} err="failed to get container status \"682c8d5eae399cd0a8aa93a5dc44e1157bef05ab4369902afe86c893fc9a3c74\": rpc error: code = NotFound desc = could not find container \"682c8d5eae399cd0a8aa93a5dc44e1157bef05ab4369902afe86c893fc9a3c74\": container with ID starting with 682c8d5eae399cd0a8aa93a5dc44e1157bef05ab4369902afe86c893fc9a3c74 not found: ID does not exist"
May 27 23:53:46.490696 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:53:46.490682    2557 scope.go:117] "RemoveContainer" containerID="33b49d47f9d950a21cb1d4232d22bc3f6d6821be2c83efe10ecf67461391b0e4"
May 27 23:53:46.490870 ip-10-0-132-191 kubenswrapper[2557]: E0527 23:53:46.490851    2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"33b49d47f9d950a21cb1d4232d22bc3f6d6821be2c83efe10ecf67461391b0e4\": container with ID starting with 33b49d47f9d950a21cb1d4232d22bc3f6d6821be2c83efe10ecf67461391b0e4 not found: ID does not exist" containerID="33b49d47f9d950a21cb1d4232d22bc3f6d6821be2c83efe10ecf67461391b0e4"
May 27 23:53:46.490914 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:53:46.490877    2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"33b49d47f9d950a21cb1d4232d22bc3f6d6821be2c83efe10ecf67461391b0e4"} err="failed to get container status \"33b49d47f9d950a21cb1d4232d22bc3f6d6821be2c83efe10ecf67461391b0e4\": rpc error: code = NotFound desc = could not find container \"33b49d47f9d950a21cb1d4232d22bc3f6d6821be2c83efe10ecf67461391b0e4\": container with ID starting with 33b49d47f9d950a21cb1d4232d22bc3f6d6821be2c83efe10ecf67461391b0e4 not found: ID does not exist"
May 27 23:53:46.490914 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:53:46.490895    2557 scope.go:117] "RemoveContainer" containerID="81ebe1818cac0d2cb9def5883bb7789c230277414d0339b160c16a5b59f6bd96"
May 27 23:53:46.491091 ip-10-0-132-191 kubenswrapper[2557]: E0527 23:53:46.491075    2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"81ebe1818cac0d2cb9def5883bb7789c230277414d0339b160c16a5b59f6bd96\": container with ID starting with 81ebe1818cac0d2cb9def5883bb7789c230277414d0339b160c16a5b59f6bd96 not found: ID does not exist" containerID="81ebe1818cac0d2cb9def5883bb7789c230277414d0339b160c16a5b59f6bd96"
May 27 23:53:46.491147 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:53:46.491095    2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"81ebe1818cac0d2cb9def5883bb7789c230277414d0339b160c16a5b59f6bd96"} err="failed to get container status \"81ebe1818cac0d2cb9def5883bb7789c230277414d0339b160c16a5b59f6bd96\": rpc error: code = NotFound desc = could not find container \"81ebe1818cac0d2cb9def5883bb7789c230277414d0339b160c16a5b59f6bd96\": container with ID starting with 81ebe1818cac0d2cb9def5883bb7789c230277414d0339b160c16a5b59f6bd96 not found: ID does not exist"
May 27 23:53:46.491147 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:53:46.491108    2557 scope.go:117] "RemoveContainer" containerID="be293f72266d4194713776ffdd334bfe45503ac00f6acd25f03995362c3dfff2"
May 27 23:53:46.491344 ip-10-0-132-191 kubenswrapper[2557]: E0527 23:53:46.491330    2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"be293f72266d4194713776ffdd334bfe45503ac00f6acd25f03995362c3dfff2\": container with ID starting with be293f72266d4194713776ffdd334bfe45503ac00f6acd25f03995362c3dfff2 not found: ID does not exist" containerID="be293f72266d4194713776ffdd334bfe45503ac00f6acd25f03995362c3dfff2"
May 27 23:53:46.491390 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:53:46.491347    2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"be293f72266d4194713776ffdd334bfe45503ac00f6acd25f03995362c3dfff2"} err="failed to get container status \"be293f72266d4194713776ffdd334bfe45503ac00f6acd25f03995362c3dfff2\": rpc error: code = NotFound desc = could not find container \"be293f72266d4194713776ffdd334bfe45503ac00f6acd25f03995362c3dfff2\": container with ID starting with be293f72266d4194713776ffdd334bfe45503ac00f6acd25f03995362c3dfff2 not found: ID does not exist"
May 27 23:53:46.491390 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:53:46.491359    2557 scope.go:117] "RemoveContainer" containerID="53c72864a9638cdbbae12ea4a3433de283eb013b4589af3c79de754df727f962"
May 27 23:53:46.491597 ip-10-0-132-191 kubenswrapper[2557]: E0527 23:53:46.491580    2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"53c72864a9638cdbbae12ea4a3433de283eb013b4589af3c79de754df727f962\": container with ID starting with 53c72864a9638cdbbae12ea4a3433de283eb013b4589af3c79de754df727f962 not found: ID does not exist" containerID="53c72864a9638cdbbae12ea4a3433de283eb013b4589af3c79de754df727f962"
May 27 23:53:46.491656 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:53:46.491606    2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"53c72864a9638cdbbae12ea4a3433de283eb013b4589af3c79de754df727f962"} err="failed to get container status \"53c72864a9638cdbbae12ea4a3433de283eb013b4589af3c79de754df727f962\": rpc error: code = NotFound desc = could not find container \"53c72864a9638cdbbae12ea4a3433de283eb013b4589af3c79de754df727f962\": container with ID starting with 53c72864a9638cdbbae12ea4a3433de283eb013b4589af3c79de754df727f962 not found: ID does not exist"
May 27 23:53:46.491656 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:53:46.491627    2557 scope.go:117] "RemoveContainer" containerID="251c5a23fed6b99f378f24e12617664e87dc408a7a5afea7914f31624d171f32"
May 27 23:53:46.491826 ip-10-0-132-191 kubenswrapper[2557]: E0527 23:53:46.491809    2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"251c5a23fed6b99f378f24e12617664e87dc408a7a5afea7914f31624d171f32\": container with ID starting with 251c5a23fed6b99f378f24e12617664e87dc408a7a5afea7914f31624d171f32 not found: ID does not exist" containerID="251c5a23fed6b99f378f24e12617664e87dc408a7a5afea7914f31624d171f32"
May 27 23:53:46.491866 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:53:46.491830    2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"251c5a23fed6b99f378f24e12617664e87dc408a7a5afea7914f31624d171f32"} err="failed to get container status \"251c5a23fed6b99f378f24e12617664e87dc408a7a5afea7914f31624d171f32\": rpc error: code = NotFound desc = could not find container \"251c5a23fed6b99f378f24e12617664e87dc408a7a5afea7914f31624d171f32\": container with ID starting with 251c5a23fed6b99f378f24e12617664e87dc408a7a5afea7914f31624d171f32 not found: ID does not exist"
May 27 23:53:46.491866 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:53:46.491843    2557 scope.go:117] "RemoveContainer" containerID="682c8d5eae399cd0a8aa93a5dc44e1157bef05ab4369902afe86c893fc9a3c74"
May 27 23:53:46.492062 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:53:46.492042    2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"682c8d5eae399cd0a8aa93a5dc44e1157bef05ab4369902afe86c893fc9a3c74"} err="failed to get container status \"682c8d5eae399cd0a8aa93a5dc44e1157bef05ab4369902afe86c893fc9a3c74\": rpc error: code = NotFound desc = could not find container \"682c8d5eae399cd0a8aa93a5dc44e1157bef05ab4369902afe86c893fc9a3c74\": container with ID starting with 682c8d5eae399cd0a8aa93a5dc44e1157bef05ab4369902afe86c893fc9a3c74 not found: ID does not exist"
May 27 23:53:46.492112 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:53:46.492063    2557 scope.go:117] "RemoveContainer" containerID="33b49d47f9d950a21cb1d4232d22bc3f6d6821be2c83efe10ecf67461391b0e4"
May 27 23:53:46.492301 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:53:46.492284    2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"33b49d47f9d950a21cb1d4232d22bc3f6d6821be2c83efe10ecf67461391b0e4"} err="failed to get container status \"33b49d47f9d950a21cb1d4232d22bc3f6d6821be2c83efe10ecf67461391b0e4\": rpc error: code = NotFound desc = could not find container \"33b49d47f9d950a21cb1d4232d22bc3f6d6821be2c83efe10ecf67461391b0e4\": container with ID starting with 33b49d47f9d950a21cb1d4232d22bc3f6d6821be2c83efe10ecf67461391b0e4 not found: ID does not exist"
May 27 23:53:46.492370 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:53:46.492303    2557 scope.go:117] "RemoveContainer" containerID="81ebe1818cac0d2cb9def5883bb7789c230277414d0339b160c16a5b59f6bd96"
May 27 23:53:46.492517 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:53:46.492501    2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"81ebe1818cac0d2cb9def5883bb7789c230277414d0339b160c16a5b59f6bd96"} err="failed to get container status \"81ebe1818cac0d2cb9def5883bb7789c230277414d0339b160c16a5b59f6bd96\": rpc error: code = NotFound desc = could not find container \"81ebe1818cac0d2cb9def5883bb7789c230277414d0339b160c16a5b59f6bd96\": container with ID starting with 81ebe1818cac0d2cb9def5883bb7789c230277414d0339b160c16a5b59f6bd96 not found: ID does not exist"
May 27 23:53:46.492568 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:53:46.492517    2557 scope.go:117] "RemoveContainer" containerID="be293f72266d4194713776ffdd334bfe45503ac00f6acd25f03995362c3dfff2"
May 27 23:53:46.492694 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:53:46.492677    2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"be293f72266d4194713776ffdd334bfe45503ac00f6acd25f03995362c3dfff2"} err="failed to get container status \"be293f72266d4194713776ffdd334bfe45503ac00f6acd25f03995362c3dfff2\": rpc error: code = NotFound desc = could not find container \"be293f72266d4194713776ffdd334bfe45503ac00f6acd25f03995362c3dfff2\": container with ID starting with be293f72266d4194713776ffdd334bfe45503ac00f6acd25f03995362c3dfff2 not found: ID does not exist"
May 27 23:53:46.492739 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:53:46.492694    2557 scope.go:117] "RemoveContainer" containerID="53c72864a9638cdbbae12ea4a3433de283eb013b4589af3c79de754df727f962"
May 27 23:53:46.492910 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:53:46.492893    2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"53c72864a9638cdbbae12ea4a3433de283eb013b4589af3c79de754df727f962"} err="failed to get container status \"53c72864a9638cdbbae12ea4a3433de283eb013b4589af3c79de754df727f962\": rpc error: code = NotFound desc = could not find container \"53c72864a9638cdbbae12ea4a3433de283eb013b4589af3c79de754df727f962\": container with ID starting with 53c72864a9638cdbbae12ea4a3433de283eb013b4589af3c79de754df727f962 not found: ID does not exist"
May 27 23:53:46.492970 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:53:46.492911    2557 scope.go:117] "RemoveContainer" containerID="251c5a23fed6b99f378f24e12617664e87dc408a7a5afea7914f31624d171f32"
May 27 23:53:46.493105 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:53:46.493088    2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"251c5a23fed6b99f378f24e12617664e87dc408a7a5afea7914f31624d171f32"} err="failed to get container status \"251c5a23fed6b99f378f24e12617664e87dc408a7a5afea7914f31624d171f32\": rpc error: code = NotFound desc = could not find container \"251c5a23fed6b99f378f24e12617664e87dc408a7a5afea7914f31624d171f32\": container with ID starting with 251c5a23fed6b99f378f24e12617664e87dc408a7a5afea7914f31624d171f32 not found: ID does not exist"
May 27 23:53:46.494321 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:53:46.494304    2557 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-g6lpw\" (UniqueName: \"kubernetes.io/projected/49329b31-b874-4e4d-8cd2-37f249b68110-kube-api-access-g6lpw\") pod \"49329b31-b874-4e4d-8cd2-37f249b68110\" (UID: \"49329b31-b874-4e4d-8cd2-37f249b68110\") "
May 27 23:53:46.494392 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:53:46.494372    2557 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/49329b31-b874-4e4d-8cd2-37f249b68110-feast-data\") pod \"49329b31-b874-4e4d-8cd2-37f249b68110\" (UID: \"49329b31-b874-4e4d-8cd2-37f249b68110\") "
May 27 23:53:46.494447 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:53:46.494400    2557 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/49329b31-b874-4e4d-8cd2-37f249b68110-ui-tls\") pod \"49329b31-b874-4e4d-8cd2-37f249b68110\" (UID: \"49329b31-b874-4e4d-8cd2-37f249b68110\") "
May 27 23:53:46.494447 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:53:46.494430    2557 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/49329b31-b874-4e4d-8cd2-37f249b68110-registry-tls\") pod \"49329b31-b874-4e4d-8cd2-37f249b68110\" (UID: \"49329b31-b874-4e4d-8cd2-37f249b68110\") "
May 27 23:53:46.494538 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:53:46.494468    2557 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/49329b31-b874-4e4d-8cd2-37f249b68110-online-tls\") pod \"49329b31-b874-4e4d-8cd2-37f249b68110\" (UID: \"49329b31-b874-4e4d-8cd2-37f249b68110\") "
May 27 23:53:46.494538 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:53:46.494518    2557 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/49329b31-b874-4e4d-8cd2-37f249b68110-offline-tls\") pod \"49329b31-b874-4e4d-8cd2-37f249b68110\" (UID: \"49329b31-b874-4e4d-8cd2-37f249b68110\") "
May 27 23:53:46.494866 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:53:46.494840    2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/49329b31-b874-4e4d-8cd2-37f249b68110-feast-data" (OuterVolumeSpecName: "feast-data") pod "49329b31-b874-4e4d-8cd2-37f249b68110" (UID: "49329b31-b874-4e4d-8cd2-37f249b68110"). InnerVolumeSpecName "feast-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 27 23:53:46.496512 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:53:46.496490    2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/49329b31-b874-4e4d-8cd2-37f249b68110-kube-api-access-g6lpw" (OuterVolumeSpecName: "kube-api-access-g6lpw") pod "49329b31-b874-4e4d-8cd2-37f249b68110" (UID: "49329b31-b874-4e4d-8cd2-37f249b68110"). InnerVolumeSpecName "kube-api-access-g6lpw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 27 23:53:46.496672 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:53:46.496649    2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/49329b31-b874-4e4d-8cd2-37f249b68110-online-tls" (OuterVolumeSpecName: "online-tls") pod "49329b31-b874-4e4d-8cd2-37f249b68110" (UID: "49329b31-b874-4e4d-8cd2-37f249b68110"). InnerVolumeSpecName "online-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 27 23:53:46.496729 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:53:46.496675    2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/49329b31-b874-4e4d-8cd2-37f249b68110-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "49329b31-b874-4e4d-8cd2-37f249b68110" (UID: "49329b31-b874-4e4d-8cd2-37f249b68110"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 27 23:53:46.496895 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:53:46.496874    2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/49329b31-b874-4e4d-8cd2-37f249b68110-ui-tls" (OuterVolumeSpecName: "ui-tls") pod "49329b31-b874-4e4d-8cd2-37f249b68110" (UID: "49329b31-b874-4e4d-8cd2-37f249b68110"). InnerVolumeSpecName "ui-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 27 23:53:46.497055 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:53:46.497033    2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/49329b31-b874-4e4d-8cd2-37f249b68110-offline-tls" (OuterVolumeSpecName: "offline-tls") pod "49329b31-b874-4e4d-8cd2-37f249b68110" (UID: "49329b31-b874-4e4d-8cd2-37f249b68110"). InnerVolumeSpecName "offline-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 27 23:53:46.595826 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:53:46.595788    2557 reconciler_common.go:299] "Volume detached for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/49329b31-b874-4e4d-8cd2-37f249b68110-offline-tls\") on node \"ip-10-0-132-191.ec2.internal\" DevicePath \"\""
May 27 23:53:46.595826 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:53:46.595826    2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-g6lpw\" (UniqueName: \"kubernetes.io/projected/49329b31-b874-4e4d-8cd2-37f249b68110-kube-api-access-g6lpw\") on node \"ip-10-0-132-191.ec2.internal\" DevicePath \"\""
May 27 23:53:46.596040 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:53:46.595842    2557 reconciler_common.go:299] "Volume detached for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/49329b31-b874-4e4d-8cd2-37f249b68110-feast-data\") on node \"ip-10-0-132-191.ec2.internal\" DevicePath \"\""
May 27 23:53:46.596040 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:53:46.595854    2557 reconciler_common.go:299] "Volume detached for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/49329b31-b874-4e4d-8cd2-37f249b68110-ui-tls\") on node \"ip-10-0-132-191.ec2.internal\" DevicePath \"\""
May 27 23:53:46.596040 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:53:46.595865    2557 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/49329b31-b874-4e4d-8cd2-37f249b68110-registry-tls\") on node \"ip-10-0-132-191.ec2.internal\" DevicePath \"\""
May 27 23:53:46.596040 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:53:46.595876    2557 reconciler_common.go:299] "Volume detached for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/49329b31-b874-4e4d-8cd2-37f249b68110-online-tls\") on node \"ip-10-0-132-191.ec2.internal\" DevicePath \"\""
May 27 23:53:46.766083 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:53:46.766047    2557 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-664fcfcc58-lrsnz"]
May 27 23:53:46.770249 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:53:46.770224    2557 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-664fcfcc58-lrsnz"]
May 27 23:53:47.201591 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:53:47.201554    2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="49329b31-b874-4e4d-8cd2-37f249b68110" path="/var/lib/kubelet/pods/49329b31-b874-4e4d-8cd2-37f249b68110/volumes"
May 27 23:54:37.750008 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:54:37.749972    2557 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-4x724"]
May 27 23:54:37.750566 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:54:37.750247    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="49329b31-b874-4e4d-8cd2-37f249b68110" containerName="offline"
May 27 23:54:37.750566 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:54:37.750260    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="49329b31-b874-4e4d-8cd2-37f249b68110" containerName="offline"
May 27 23:54:37.750566 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:54:37.750275    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="49329b31-b874-4e4d-8cd2-37f249b68110" containerName="feast-init"
May 27 23:54:37.750566 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:54:37.750283    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="49329b31-b874-4e4d-8cd2-37f249b68110" containerName="feast-init"
May 27 23:54:37.750566 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:54:37.750295    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="49329b31-b874-4e4d-8cd2-37f249b68110" containerName="feast-apply"
May 27 23:54:37.750566 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:54:37.750301    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="49329b31-b874-4e4d-8cd2-37f249b68110" containerName="feast-apply"
May 27 23:54:37.750566 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:54:37.750310    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="49329b31-b874-4e4d-8cd2-37f249b68110" containerName="ui"
May 27 23:54:37.750566 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:54:37.750316    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="49329b31-b874-4e4d-8cd2-37f249b68110" containerName="ui"
May 27 23:54:37.750566 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:54:37.750321    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="49329b31-b874-4e4d-8cd2-37f249b68110" containerName="online"
May 27 23:54:37.750566 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:54:37.750326    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="49329b31-b874-4e4d-8cd2-37f249b68110" containerName="online"
May 27 23:54:37.750566 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:54:37.750332    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="49329b31-b874-4e4d-8cd2-37f249b68110" containerName="registry"
May 27 23:54:37.750566 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:54:37.750337    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="49329b31-b874-4e4d-8cd2-37f249b68110" containerName="registry"
May 27 23:54:37.750566 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:54:37.750385    2557 memory_manager.go:356] "RemoveStaleState removing state" podUID="49329b31-b874-4e4d-8cd2-37f249b68110" containerName="offline"
May 27 23:54:37.750566 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:54:37.750393    2557 memory_manager.go:356] "RemoveStaleState removing state" podUID="49329b31-b874-4e4d-8cd2-37f249b68110" containerName="ui"
May 27 23:54:37.750566 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:54:37.750400    2557 memory_manager.go:356] "RemoveStaleState removing state" podUID="49329b31-b874-4e4d-8cd2-37f249b68110" containerName="online"
May 27 23:54:37.750566 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:54:37.750408    2557 memory_manager.go:356] "RemoveStaleState removing state" podUID="49329b31-b874-4e4d-8cd2-37f249b68110" containerName="registry"
May 27 23:54:37.753664 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:54:37.753646    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-4x724"
May 27 23:54:37.756425 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:54:37.756404    2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-ui-tls\""
May 27 23:54:37.756795 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:54:37.756772    2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-offline-tls\""
May 27 23:54:37.756898 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:54:37.756841    2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-remote-registry\"/\"kube-root-ca.crt\""
May 27 23:54:37.756898 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:54:37.756843    2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-client-ca\""
May 27 23:54:37.756898 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:54:37.756886    2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-remote-registry\"/\"openshift-service-ca.crt\""
May 27 23:54:37.756898 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:54:37.756892    2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-online-tls\""
May 27 23:54:37.757162 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:54:37.756911    2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-dockercfg-tp2fv\""
May 27 23:54:37.765973 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:54:37.765951    2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-4x724"]
May 27 23:54:37.850587 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:54:37.850551    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/f6906682-26d7-4524-bbf6-e4f5919126be-online-tls\") pod \"feast-simple-feast-remote-setup-5cff94746b-4x724\" (UID: \"f6906682-26d7-4524-bbf6-e4f5919126be\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-4x724"
May 27 23:54:37.850587 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:54:37.850587    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/f6906682-26d7-4524-bbf6-e4f5919126be-ui-tls\") pod \"feast-simple-feast-remote-setup-5cff94746b-4x724\" (UID: \"f6906682-26d7-4524-bbf6-e4f5919126be\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-4x724"
May 27 23:54:37.850805 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:54:37.850613    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/f6906682-26d7-4524-bbf6-e4f5919126be-offline-tls\") pod \"feast-simple-feast-remote-setup-5cff94746b-4x724\" (UID: \"f6906682-26d7-4524-bbf6-e4f5919126be\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-4x724"
May 27 23:54:37.850805 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:54:37.850662    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zc9hl\" (UniqueName: \"kubernetes.io/projected/f6906682-26d7-4524-bbf6-e4f5919126be-kube-api-access-zc9hl\") pod \"feast-simple-feast-remote-setup-5cff94746b-4x724\" (UID: \"f6906682-26d7-4524-bbf6-e4f5919126be\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-4x724"
May 27 23:54:37.850805 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:54:37.850718    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/f6906682-26d7-4524-bbf6-e4f5919126be-feast-data\") pod \"feast-simple-feast-remote-setup-5cff94746b-4x724\" (UID: \"f6906682-26d7-4524-bbf6-e4f5919126be\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-4x724"
May 27 23:54:37.850805 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:54:37.850739    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/configmap/f6906682-26d7-4524-bbf6-e4f5919126be-registry-tls\") pod \"feast-simple-feast-remote-setup-5cff94746b-4x724\" (UID: \"f6906682-26d7-4524-bbf6-e4f5919126be\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-4x724"
May 27 23:54:37.951148 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:54:37.951096    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/f6906682-26d7-4524-bbf6-e4f5919126be-feast-data\") pod \"feast-simple-feast-remote-setup-5cff94746b-4x724\" (UID: \"f6906682-26d7-4524-bbf6-e4f5919126be\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-4x724"
May 27 23:54:37.951338 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:54:37.951164    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/configmap/f6906682-26d7-4524-bbf6-e4f5919126be-registry-tls\") pod \"feast-simple-feast-remote-setup-5cff94746b-4x724\" (UID: \"f6906682-26d7-4524-bbf6-e4f5919126be\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-4x724"
May 27 23:54:37.951338 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:54:37.951212    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/f6906682-26d7-4524-bbf6-e4f5919126be-online-tls\") pod \"feast-simple-feast-remote-setup-5cff94746b-4x724\" (UID: \"f6906682-26d7-4524-bbf6-e4f5919126be\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-4x724"
May 27 23:54:37.951338 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:54:37.951232    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/f6906682-26d7-4524-bbf6-e4f5919126be-ui-tls\") pod \"feast-simple-feast-remote-setup-5cff94746b-4x724\" (UID: \"f6906682-26d7-4524-bbf6-e4f5919126be\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-4x724"
May 27 23:54:37.951338 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:54:37.951256    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/f6906682-26d7-4524-bbf6-e4f5919126be-offline-tls\") pod \"feast-simple-feast-remote-setup-5cff94746b-4x724\" (UID: \"f6906682-26d7-4524-bbf6-e4f5919126be\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-4x724"
May 27 23:54:37.951338 ip-10-0-132-191 kubenswrapper[2557]: E0527 23:54:37.951330    2557 secret.go:189] Couldn't get secret test-ns-remote-registry/feast-simple-feast-remote-setup-online-tls: secret "feast-simple-feast-remote-setup-online-tls" not found
May 27 23:54:37.951607 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:54:37.951359    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-zc9hl\" (UniqueName: \"kubernetes.io/projected/f6906682-26d7-4524-bbf6-e4f5919126be-kube-api-access-zc9hl\") pod \"feast-simple-feast-remote-setup-5cff94746b-4x724\" (UID: \"f6906682-26d7-4524-bbf6-e4f5919126be\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-4x724"
May 27 23:54:37.951607 ip-10-0-132-191 kubenswrapper[2557]: E0527 23:54:37.951405    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f6906682-26d7-4524-bbf6-e4f5919126be-online-tls podName:f6906682-26d7-4524-bbf6-e4f5919126be nodeName:}" failed. No retries permitted until 2026-05-27 23:54:38.451387726 +0000 UTC m=+1293.870923722 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "online-tls" (UniqueName: "kubernetes.io/secret/f6906682-26d7-4524-bbf6-e4f5919126be-online-tls") pod "feast-simple-feast-remote-setup-5cff94746b-4x724" (UID: "f6906682-26d7-4524-bbf6-e4f5919126be") : secret "feast-simple-feast-remote-setup-online-tls" not found
May 27 23:54:37.951607 ip-10-0-132-191 kubenswrapper[2557]: E0527 23:54:37.951422    2557 secret.go:189] Couldn't get secret test-ns-remote-registry/feast-simple-feast-remote-setup-offline-tls: secret "feast-simple-feast-remote-setup-offline-tls" not found
May 27 23:54:37.951607 ip-10-0-132-191 kubenswrapper[2557]: E0527 23:54:37.951493    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f6906682-26d7-4524-bbf6-e4f5919126be-offline-tls podName:f6906682-26d7-4524-bbf6-e4f5919126be nodeName:}" failed. No retries permitted until 2026-05-27 23:54:38.451474113 +0000 UTC m=+1293.871010104 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "offline-tls" (UniqueName: "kubernetes.io/secret/f6906682-26d7-4524-bbf6-e4f5919126be-offline-tls") pod "feast-simple-feast-remote-setup-5cff94746b-4x724" (UID: "f6906682-26d7-4524-bbf6-e4f5919126be") : secret "feast-simple-feast-remote-setup-offline-tls" not found
May 27 23:54:37.951607 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:54:37.951574    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/f6906682-26d7-4524-bbf6-e4f5919126be-feast-data\") pod \"feast-simple-feast-remote-setup-5cff94746b-4x724\" (UID: \"f6906682-26d7-4524-bbf6-e4f5919126be\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-4x724"
May 27 23:54:37.951928 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:54:37.951910    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/configmap/f6906682-26d7-4524-bbf6-e4f5919126be-registry-tls\") pod \"feast-simple-feast-remote-setup-5cff94746b-4x724\" (UID: \"f6906682-26d7-4524-bbf6-e4f5919126be\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-4x724"
May 27 23:54:37.953636 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:54:37.953620    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/f6906682-26d7-4524-bbf6-e4f5919126be-ui-tls\") pod \"feast-simple-feast-remote-setup-5cff94746b-4x724\" (UID: \"f6906682-26d7-4524-bbf6-e4f5919126be\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-4x724"
May 27 23:54:37.963266 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:54:37.963243    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zc9hl\" (UniqueName: \"kubernetes.io/projected/f6906682-26d7-4524-bbf6-e4f5919126be-kube-api-access-zc9hl\") pod \"feast-simple-feast-remote-setup-5cff94746b-4x724\" (UID: \"f6906682-26d7-4524-bbf6-e4f5919126be\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-4x724"
May 27 23:54:38.454802 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:54:38.454760    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/f6906682-26d7-4524-bbf6-e4f5919126be-online-tls\") pod \"feast-simple-feast-remote-setup-5cff94746b-4x724\" (UID: \"f6906682-26d7-4524-bbf6-e4f5919126be\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-4x724"
May 27 23:54:38.454802 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:54:38.454801    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/f6906682-26d7-4524-bbf6-e4f5919126be-offline-tls\") pod \"feast-simple-feast-remote-setup-5cff94746b-4x724\" (UID: \"f6906682-26d7-4524-bbf6-e4f5919126be\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-4x724"
May 27 23:54:38.457195 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:54:38.457168    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/f6906682-26d7-4524-bbf6-e4f5919126be-online-tls\") pod \"feast-simple-feast-remote-setup-5cff94746b-4x724\" (UID: \"f6906682-26d7-4524-bbf6-e4f5919126be\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-4x724"
May 27 23:54:38.457195 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:54:38.457191    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/f6906682-26d7-4524-bbf6-e4f5919126be-offline-tls\") pod \"feast-simple-feast-remote-setup-5cff94746b-4x724\" (UID: \"f6906682-26d7-4524-bbf6-e4f5919126be\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-4x724"
May 27 23:54:38.662171 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:54:38.662122    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-4x724"
May 27 23:54:38.793155 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:54:38.793114    2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-4x724"]
May 27 23:54:38.794727 ip-10-0-132-191 kubenswrapper[2557]: W0527 23:54:38.794700    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podf6906682_26d7_4524_bbf6_e4f5919126be.slice/crio-bbda2fba4268bb57555d048ab5c8312aeacfedb4bf6fe7ab1364314d2a4b5728 WatchSource:0}: Error finding container bbda2fba4268bb57555d048ab5c8312aeacfedb4bf6fe7ab1364314d2a4b5728: Status 404 returned error can't find the container with id bbda2fba4268bb57555d048ab5c8312aeacfedb4bf6fe7ab1364314d2a4b5728
May 27 23:54:39.580519 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:54:39.580486    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-4x724" event={"ID":"f6906682-26d7-4524-bbf6-e4f5919126be","Type":"ContainerStarted","Data":"45a85719403119f190e8f5798cb2b4bd37133370891ac1a05c9f2f29effc4f9d"}
May 27 23:54:39.580519 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:54:39.580521    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-4x724" event={"ID":"f6906682-26d7-4524-bbf6-e4f5919126be","Type":"ContainerStarted","Data":"bbda2fba4268bb57555d048ab5c8312aeacfedb4bf6fe7ab1364314d2a4b5728"}
May 27 23:54:43.591678 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:54:43.591645    2557 generic.go:358] "Generic (PLEG): container finished" podID="f6906682-26d7-4524-bbf6-e4f5919126be" containerID="45a85719403119f190e8f5798cb2b4bd37133370891ac1a05c9f2f29effc4f9d" exitCode=0
May 27 23:54:43.592038 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:54:43.591717    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-4x724" event={"ID":"f6906682-26d7-4524-bbf6-e4f5919126be","Type":"ContainerDied","Data":"45a85719403119f190e8f5798cb2b4bd37133370891ac1a05c9f2f29effc4f9d"}
May 27 23:54:44.595499 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:54:44.595466    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-4x724" event={"ID":"f6906682-26d7-4524-bbf6-e4f5919126be","Type":"ContainerStarted","Data":"e87d736cbe3a72512f7159c542e7b3a5b59bf4d185d2909492d19d010b36c4ad"}
May 27 23:54:49.608583 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:54:49.608550    2557 generic.go:358] "Generic (PLEG): container finished" podID="f6906682-26d7-4524-bbf6-e4f5919126be" containerID="e87d736cbe3a72512f7159c542e7b3a5b59bf4d185d2909492d19d010b36c4ad" exitCode=0
May 27 23:54:49.608987 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:54:49.608631    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-4x724" event={"ID":"f6906682-26d7-4524-bbf6-e4f5919126be","Type":"ContainerDied","Data":"e87d736cbe3a72512f7159c542e7b3a5b59bf4d185d2909492d19d010b36c4ad"}
May 27 23:54:50.614468 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:54:50.614430    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-4x724" event={"ID":"f6906682-26d7-4524-bbf6-e4f5919126be","Type":"ContainerStarted","Data":"b70b105fb98b11506c37683259a8b839e2ee9a1cc019a7098e2bdc35d20a7a3b"}
May 27 23:54:50.614468 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:54:50.614467    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-4x724" event={"ID":"f6906682-26d7-4524-bbf6-e4f5919126be","Type":"ContainerStarted","Data":"df833bb43e43d52da4a22775d76259a25fd6efca219922757847649761c4b452"}
May 27 23:54:50.614468 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:54:50.614476    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-4x724" event={"ID":"f6906682-26d7-4524-bbf6-e4f5919126be","Type":"ContainerStarted","Data":"2ae69fcad224ae9359fb7d216bcc1c6281b9212d67297738d84804e89ef0eebc"}
May 27 23:54:50.638610 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:54:50.638562    2557 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-4x724" podStartSLOduration=13.638545439 podStartE2EDuration="13.638545439s" podCreationTimestamp="2026-05-27 23:54:37 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-27 23:54:50.638392509 +0000 UTC m=+1306.057928522" watchObservedRunningTime="2026-05-27 23:54:50.638545439 +0000 UTC m=+1306.058081452"
May 27 23:54:50.662592 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:54:50.662566    2557 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-4x724"
May 27 23:54:50.662747 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:54:50.662601    2557 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-4x724"
May 27 23:54:50.662747 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:54:50.662614    2557 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-4x724"
May 27 23:54:50.664215 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:54:50.664178    2557 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-4x724" podUID="f6906682-26d7-4524-bbf6-e4f5919126be" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.17:8443: connect: connection refused"
May 27 23:54:50.664339 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:54:50.664210    2557 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-4x724" podUID="f6906682-26d7-4524-bbf6-e4f5919126be" containerName="offline" probeResult="failure" output="dial tcp 10.132.0.17:8816: connect: connection refused"
May 27 23:54:50.664339 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:54:50.664221    2557 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-4x724" podUID="f6906682-26d7-4524-bbf6-e4f5919126be" containerName="online" probeResult="failure" output="Get \"https://10.132.0.17:6567/health\": dial tcp 10.132.0.17:6567: connect: connection refused"
May 27 23:54:53.663028 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:54:53.662978    2557 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-4x724" podUID="f6906682-26d7-4524-bbf6-e4f5919126be" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.17:8443: connect: connection refused"
May 27 23:54:53.663501 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:54:53.662982    2557 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-4x724" podUID="f6906682-26d7-4524-bbf6-e4f5919126be" containerName="online" probeResult="failure" output="Get \"https://10.132.0.17:6567/health\": dial tcp 10.132.0.17:6567: connect: connection refused"
May 27 23:54:53.663501 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:54:53.662998    2557 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-4x724" podUID="f6906682-26d7-4524-bbf6-e4f5919126be" containerName="offline" probeResult="failure" output="dial tcp 10.132.0.17:8816: connect: connection refused"
May 27 23:54:56.663307 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:54:56.663280    2557 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-4x724"
May 27 23:54:56.663789 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:54:56.663388    2557 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-4x724"
May 27 23:54:56.663789 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:54:56.663774    2557 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-4x724"
May 27 23:54:56.663894 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:54:56.663805    2557 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-4x724"
May 27 23:54:56.664024 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:54:56.664002    2557 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-4x724"
May 27 23:54:56.664171 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:54:56.664152    2557 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-4x724"
May 27 23:54:56.667598 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:54:56.667577    2557 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-4x724"
May 27 23:54:57.635631 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:54:57.635595    2557 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-4x724"
May 27 23:54:57.638499 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:54:57.638477    2557 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-4x724"
May 27 23:55:59.051649 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:55:59.051613    2557 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-4x724"]
May 27 23:55:59.052459 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:55:59.052398    2557 kuberuntime_container.go:864] "Killing container with a grace period" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-4x724" podUID="f6906682-26d7-4524-bbf6-e4f5919126be" containerName="offline" containerID="cri-o://df833bb43e43d52da4a22775d76259a25fd6efca219922757847649761c4b452" gracePeriod=30
May 27 23:55:59.052586 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:55:59.052347    2557 kuberuntime_container.go:864] "Killing container with a grace period" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-4x724" podUID="f6906682-26d7-4524-bbf6-e4f5919126be" containerName="online" containerID="cri-o://2ae69fcad224ae9359fb7d216bcc1c6281b9212d67297738d84804e89ef0eebc" gracePeriod=30
May 27 23:55:59.052586 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:55:59.052398    2557 kuberuntime_container.go:864] "Killing container with a grace period" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-4x724" podUID="f6906682-26d7-4524-bbf6-e4f5919126be" containerName="ui" containerID="cri-o://b70b105fb98b11506c37683259a8b839e2ee9a1cc019a7098e2bdc35d20a7a3b" gracePeriod=30
May 27 23:55:59.197512 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:55:59.197471    2557 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-664fcfcc58-xsbrl"]
May 27 23:55:59.198040 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:55:59.197830    2557 kuberuntime_container.go:864] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-xsbrl" podUID="91fbb8ad-b71b-4688-a82a-7ad7291e01db" containerName="registry" containerID="cri-o://5c09ee7497926d566442dd7f85234f47918b97b108e9839230477de7908e8370" gracePeriod=30
May 27 23:55:59.198040 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:55:59.197881    2557 kuberuntime_container.go:864] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-xsbrl" podUID="91fbb8ad-b71b-4688-a82a-7ad7291e01db" containerName="offline" containerID="cri-o://20ec258ca4523542e1dbd57cd398094556faba03080619800adba63449dc9a7c" gracePeriod=30
May 27 23:55:59.198040 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:55:59.197939    2557 kuberuntime_container.go:864] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-xsbrl" podUID="91fbb8ad-b71b-4688-a82a-7ad7291e01db" containerName="ui" containerID="cri-o://5c32c32b689cb7781eb61b7f0e93d51e8e1990fff9cdc0e9cfaf4dd072536d82" gracePeriod=30
May 27 23:55:59.198040 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:55:59.197886    2557 kuberuntime_container.go:864] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-xsbrl" podUID="91fbb8ad-b71b-4688-a82a-7ad7291e01db" containerName="online" containerID="cri-o://7acbee21eacb84278b80532b148ffd9fa018df933ae27508831e6801894be9c8" gracePeriod=30
May 27 23:55:59.803822 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:55:59.803791    2557 generic.go:358] "Generic (PLEG): container finished" podID="f6906682-26d7-4524-bbf6-e4f5919126be" containerID="b70b105fb98b11506c37683259a8b839e2ee9a1cc019a7098e2bdc35d20a7a3b" exitCode=0
May 27 23:55:59.803822 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:55:59.803817    2557 generic.go:358] "Generic (PLEG): container finished" podID="f6906682-26d7-4524-bbf6-e4f5919126be" containerID="2ae69fcad224ae9359fb7d216bcc1c6281b9212d67297738d84804e89ef0eebc" exitCode=0
May 27 23:55:59.804037 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:55:59.803861    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-4x724" event={"ID":"f6906682-26d7-4524-bbf6-e4f5919126be","Type":"ContainerDied","Data":"b70b105fb98b11506c37683259a8b839e2ee9a1cc019a7098e2bdc35d20a7a3b"}
May 27 23:55:59.804037 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:55:59.803893    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-4x724" event={"ID":"f6906682-26d7-4524-bbf6-e4f5919126be","Type":"ContainerDied","Data":"2ae69fcad224ae9359fb7d216bcc1c6281b9212d67297738d84804e89ef0eebc"}
May 27 23:55:59.806537 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:55:59.806474    2557 generic.go:358] "Generic (PLEG): container finished" podID="91fbb8ad-b71b-4688-a82a-7ad7291e01db" containerID="5c32c32b689cb7781eb61b7f0e93d51e8e1990fff9cdc0e9cfaf4dd072536d82" exitCode=0
May 27 23:55:59.806537 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:55:59.806522    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-xsbrl" event={"ID":"91fbb8ad-b71b-4688-a82a-7ad7291e01db","Type":"ContainerDied","Data":"5c32c32b689cb7781eb61b7f0e93d51e8e1990fff9cdc0e9cfaf4dd072536d82"}
May 27 23:56:00.811573 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:56:00.811531    2557 generic.go:358] "Generic (PLEG): container finished" podID="91fbb8ad-b71b-4688-a82a-7ad7291e01db" containerID="7acbee21eacb84278b80532b148ffd9fa018df933ae27508831e6801894be9c8" exitCode=0
May 27 23:56:00.811929 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:56:00.811582    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-xsbrl" event={"ID":"91fbb8ad-b71b-4688-a82a-7ad7291e01db","Type":"ContainerDied","Data":"7acbee21eacb84278b80532b148ffd9fa018df933ae27508831e6801894be9c8"}
May 27 23:56:04.959404 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:56:04.959361    2557 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-xsbrl" podUID="91fbb8ad-b71b-4688-a82a-7ad7291e01db" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.16:8443: connect: connection refused"
May 27 23:56:05.414089 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:56:05.414056    2557 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-xsbrl" podUID="91fbb8ad-b71b-4688-a82a-7ad7291e01db" containerName="online" probeResult="failure" output="Get \"https://10.132.0.16:6567/health\": dial tcp 10.132.0.16:6567: connect: connection refused"
May 27 23:56:06.664797 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:56:06.664753    2557 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-4x724" podUID="f6906682-26d7-4524-bbf6-e4f5919126be" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.17:8443: connect: connection refused"
May 27 23:56:07.636385 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:56:07.636349    2557 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-4x724" podUID="f6906682-26d7-4524-bbf6-e4f5919126be" containerName="online" probeResult="failure" output="Get \"https://10.132.0.17:6567/health\": dial tcp 10.132.0.17:6567: connect: connection refused"
May 27 23:56:14.959693 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:56:14.959639    2557 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-xsbrl" podUID="91fbb8ad-b71b-4688-a82a-7ad7291e01db" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.16:8443: connect: connection refused"
May 27 23:56:15.414334 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:56:15.414293    2557 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-xsbrl" podUID="91fbb8ad-b71b-4688-a82a-7ad7291e01db" containerName="online" probeResult="failure" output="Get \"https://10.132.0.16:6567/health\": dial tcp 10.132.0.16:6567: connect: connection refused"
May 27 23:56:16.664452 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:56:16.664402    2557 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-4x724" podUID="f6906682-26d7-4524-bbf6-e4f5919126be" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.17:8443: connect: connection refused"
May 27 23:56:17.636321 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:56:17.636272    2557 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-4x724" podUID="f6906682-26d7-4524-bbf6-e4f5919126be" containerName="online" probeResult="failure" output="Get \"https://10.132.0.17:6567/health\": dial tcp 10.132.0.17:6567: connect: connection refused"
May 27 23:56:24.960111 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:56:24.960064    2557 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-xsbrl" podUID="91fbb8ad-b71b-4688-a82a-7ad7291e01db" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.16:8443: connect: connection refused"
May 27 23:56:24.960673 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:56:24.960231    2557 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-xsbrl"
May 27 23:56:25.414019 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:56:25.413979    2557 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-xsbrl" podUID="91fbb8ad-b71b-4688-a82a-7ad7291e01db" containerName="online" probeResult="failure" output="Get \"https://10.132.0.16:6567/health\": dial tcp 10.132.0.16:6567: connect: connection refused"
May 27 23:56:25.414209 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:56:25.414087    2557 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-xsbrl"
May 27 23:56:26.663870 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:56:26.663830    2557 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-4x724" podUID="f6906682-26d7-4524-bbf6-e4f5919126be" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.17:8443: connect: connection refused"
May 27 23:56:26.664291 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:56:26.663944    2557 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-4x724"
May 27 23:56:27.636725 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:56:27.636681    2557 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-4x724" podUID="f6906682-26d7-4524-bbf6-e4f5919126be" containerName="online" probeResult="failure" output="Get \"https://10.132.0.17:6567/health\": dial tcp 10.132.0.17:6567: connect: connection refused"
May 27 23:56:27.636927 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:56:27.636874    2557 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-4x724"
May 27 23:56:29.693445 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:56:29.693422    2557 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-4x724"
May 27 23:56:29.738495 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:56:29.738466    2557 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/f6906682-26d7-4524-bbf6-e4f5919126be-feast-data\") pod \"f6906682-26d7-4524-bbf6-e4f5919126be\" (UID: \"f6906682-26d7-4524-bbf6-e4f5919126be\") "
May 27 23:56:29.738658 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:56:29.738522    2557 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/f6906682-26d7-4524-bbf6-e4f5919126be-online-tls\") pod \"f6906682-26d7-4524-bbf6-e4f5919126be\" (UID: \"f6906682-26d7-4524-bbf6-e4f5919126be\") "
May 27 23:56:29.738658 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:56:29.738551    2557 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/f6906682-26d7-4524-bbf6-e4f5919126be-offline-tls\") pod \"f6906682-26d7-4524-bbf6-e4f5919126be\" (UID: \"f6906682-26d7-4524-bbf6-e4f5919126be\") "
May 27 23:56:29.738658 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:56:29.738578    2557 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/configmap/f6906682-26d7-4524-bbf6-e4f5919126be-registry-tls\") pod \"f6906682-26d7-4524-bbf6-e4f5919126be\" (UID: \"f6906682-26d7-4524-bbf6-e4f5919126be\") "
May 27 23:56:29.738658 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:56:29.738604    2557 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/f6906682-26d7-4524-bbf6-e4f5919126be-ui-tls\") pod \"f6906682-26d7-4524-bbf6-e4f5919126be\" (UID: \"f6906682-26d7-4524-bbf6-e4f5919126be\") "
May 27 23:56:29.738658 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:56:29.738633    2557 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zc9hl\" (UniqueName: \"kubernetes.io/projected/f6906682-26d7-4524-bbf6-e4f5919126be-kube-api-access-zc9hl\") pod \"f6906682-26d7-4524-bbf6-e4f5919126be\" (UID: \"f6906682-26d7-4524-bbf6-e4f5919126be\") "
May 27 23:56:29.739006 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:56:29.738975    2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f6906682-26d7-4524-bbf6-e4f5919126be-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "f6906682-26d7-4524-bbf6-e4f5919126be" (UID: "f6906682-26d7-4524-bbf6-e4f5919126be"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 27 23:56:29.739113 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:56:29.739086    2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f6906682-26d7-4524-bbf6-e4f5919126be-feast-data" (OuterVolumeSpecName: "feast-data") pod "f6906682-26d7-4524-bbf6-e4f5919126be" (UID: "f6906682-26d7-4524-bbf6-e4f5919126be"). InnerVolumeSpecName "feast-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 27 23:56:29.740870 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:56:29.740841    2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f6906682-26d7-4524-bbf6-e4f5919126be-ui-tls" (OuterVolumeSpecName: "ui-tls") pod "f6906682-26d7-4524-bbf6-e4f5919126be" (UID: "f6906682-26d7-4524-bbf6-e4f5919126be"). InnerVolumeSpecName "ui-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 27 23:56:29.740975 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:56:29.740884    2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f6906682-26d7-4524-bbf6-e4f5919126be-offline-tls" (OuterVolumeSpecName: "offline-tls") pod "f6906682-26d7-4524-bbf6-e4f5919126be" (UID: "f6906682-26d7-4524-bbf6-e4f5919126be"). InnerVolumeSpecName "offline-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 27 23:56:29.740975 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:56:29.740909    2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f6906682-26d7-4524-bbf6-e4f5919126be-kube-api-access-zc9hl" (OuterVolumeSpecName: "kube-api-access-zc9hl") pod "f6906682-26d7-4524-bbf6-e4f5919126be" (UID: "f6906682-26d7-4524-bbf6-e4f5919126be"). InnerVolumeSpecName "kube-api-access-zc9hl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 27 23:56:29.741082 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:56:29.741065    2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f6906682-26d7-4524-bbf6-e4f5919126be-online-tls" (OuterVolumeSpecName: "online-tls") pod "f6906682-26d7-4524-bbf6-e4f5919126be" (UID: "f6906682-26d7-4524-bbf6-e4f5919126be"). InnerVolumeSpecName "online-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 27 23:56:29.827923 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:56:29.827898    2557 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-xsbrl"
May 27 23:56:29.839752 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:56:29.839734    2557 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-z8n8x\" (UniqueName: \"kubernetes.io/projected/91fbb8ad-b71b-4688-a82a-7ad7291e01db-kube-api-access-z8n8x\") pod \"91fbb8ad-b71b-4688-a82a-7ad7291e01db\" (UID: \"91fbb8ad-b71b-4688-a82a-7ad7291e01db\") "
May 27 23:56:29.839858 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:56:29.839762    2557 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/91fbb8ad-b71b-4688-a82a-7ad7291e01db-registry-tls\") pod \"91fbb8ad-b71b-4688-a82a-7ad7291e01db\" (UID: \"91fbb8ad-b71b-4688-a82a-7ad7291e01db\") "
May 27 23:56:29.839858 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:56:29.839781    2557 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/91fbb8ad-b71b-4688-a82a-7ad7291e01db-online-tls\") pod \"91fbb8ad-b71b-4688-a82a-7ad7291e01db\" (UID: \"91fbb8ad-b71b-4688-a82a-7ad7291e01db\") "
May 27 23:56:29.839858 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:56:29.839798    2557 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/91fbb8ad-b71b-4688-a82a-7ad7291e01db-offline-tls\") pod \"91fbb8ad-b71b-4688-a82a-7ad7291e01db\" (UID: \"91fbb8ad-b71b-4688-a82a-7ad7291e01db\") "
May 27 23:56:29.839858 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:56:29.839819    2557 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/91fbb8ad-b71b-4688-a82a-7ad7291e01db-feast-data\") pod \"91fbb8ad-b71b-4688-a82a-7ad7291e01db\" (UID: \"91fbb8ad-b71b-4688-a82a-7ad7291e01db\") "
May 27 23:56:29.839858 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:56:29.839839    2557 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/91fbb8ad-b71b-4688-a82a-7ad7291e01db-ui-tls\") pod \"91fbb8ad-b71b-4688-a82a-7ad7291e01db\" (UID: \"91fbb8ad-b71b-4688-a82a-7ad7291e01db\") "
May 27 23:56:29.840114 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:56:29.840039    2557 reconciler_common.go:299] "Volume detached for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/f6906682-26d7-4524-bbf6-e4f5919126be-online-tls\") on node \"ip-10-0-132-191.ec2.internal\" DevicePath \"\""
May 27 23:56:29.840114 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:56:29.840057    2557 reconciler_common.go:299] "Volume detached for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/f6906682-26d7-4524-bbf6-e4f5919126be-offline-tls\") on node \"ip-10-0-132-191.ec2.internal\" DevicePath \"\""
May 27 23:56:29.840114 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:56:29.840069    2557 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/configmap/f6906682-26d7-4524-bbf6-e4f5919126be-registry-tls\") on node \"ip-10-0-132-191.ec2.internal\" DevicePath \"\""
May 27 23:56:29.840114 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:56:29.840084    2557 reconciler_common.go:299] "Volume detached for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/f6906682-26d7-4524-bbf6-e4f5919126be-ui-tls\") on node \"ip-10-0-132-191.ec2.internal\" DevicePath \"\""
May 27 23:56:29.840114 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:56:29.840108    2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zc9hl\" (UniqueName: \"kubernetes.io/projected/f6906682-26d7-4524-bbf6-e4f5919126be-kube-api-access-zc9hl\") on node \"ip-10-0-132-191.ec2.internal\" DevicePath \"\""
May 27 23:56:29.840376 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:56:29.840139    2557 reconciler_common.go:299] "Volume detached for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/f6906682-26d7-4524-bbf6-e4f5919126be-feast-data\") on node \"ip-10-0-132-191.ec2.internal\" DevicePath \"\""
May 27 23:56:29.840429 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:56:29.840371    2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/91fbb8ad-b71b-4688-a82a-7ad7291e01db-feast-data" (OuterVolumeSpecName: "feast-data") pod "91fbb8ad-b71b-4688-a82a-7ad7291e01db" (UID: "91fbb8ad-b71b-4688-a82a-7ad7291e01db"). InnerVolumeSpecName "feast-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 27 23:56:29.841911 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:56:29.841890    2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/91fbb8ad-b71b-4688-a82a-7ad7291e01db-online-tls" (OuterVolumeSpecName: "online-tls") pod "91fbb8ad-b71b-4688-a82a-7ad7291e01db" (UID: "91fbb8ad-b71b-4688-a82a-7ad7291e01db"). InnerVolumeSpecName "online-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 27 23:56:29.842006 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:56:29.841931    2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/91fbb8ad-b71b-4688-a82a-7ad7291e01db-ui-tls" (OuterVolumeSpecName: "ui-tls") pod "91fbb8ad-b71b-4688-a82a-7ad7291e01db" (UID: "91fbb8ad-b71b-4688-a82a-7ad7291e01db"). InnerVolumeSpecName "ui-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 27 23:56:29.842006 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:56:29.841968    2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/91fbb8ad-b71b-4688-a82a-7ad7291e01db-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "91fbb8ad-b71b-4688-a82a-7ad7291e01db" (UID: "91fbb8ad-b71b-4688-a82a-7ad7291e01db"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 27 23:56:29.842310 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:56:29.842284    2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/91fbb8ad-b71b-4688-a82a-7ad7291e01db-kube-api-access-z8n8x" (OuterVolumeSpecName: "kube-api-access-z8n8x") pod "91fbb8ad-b71b-4688-a82a-7ad7291e01db" (UID: "91fbb8ad-b71b-4688-a82a-7ad7291e01db"). InnerVolumeSpecName "kube-api-access-z8n8x". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 27 23:56:29.842310 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:56:29.842285    2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/91fbb8ad-b71b-4688-a82a-7ad7291e01db-offline-tls" (OuterVolumeSpecName: "offline-tls") pod "91fbb8ad-b71b-4688-a82a-7ad7291e01db" (UID: "91fbb8ad-b71b-4688-a82a-7ad7291e01db"). InnerVolumeSpecName "offline-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 27 23:56:29.887343 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:56:29.887309    2557 generic.go:358] "Generic (PLEG): container finished" podID="91fbb8ad-b71b-4688-a82a-7ad7291e01db" containerID="20ec258ca4523542e1dbd57cd398094556faba03080619800adba63449dc9a7c" exitCode=137
May 27 23:56:29.887343 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:56:29.887337    2557 generic.go:358] "Generic (PLEG): container finished" podID="91fbb8ad-b71b-4688-a82a-7ad7291e01db" containerID="5c09ee7497926d566442dd7f85234f47918b97b108e9839230477de7908e8370" exitCode=137
May 27 23:56:29.887571 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:56:29.887374    2557 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-xsbrl"
May 27 23:56:29.887571 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:56:29.887389    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-xsbrl" event={"ID":"91fbb8ad-b71b-4688-a82a-7ad7291e01db","Type":"ContainerDied","Data":"20ec258ca4523542e1dbd57cd398094556faba03080619800adba63449dc9a7c"}
May 27 23:56:29.887571 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:56:29.887426    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-xsbrl" event={"ID":"91fbb8ad-b71b-4688-a82a-7ad7291e01db","Type":"ContainerDied","Data":"5c09ee7497926d566442dd7f85234f47918b97b108e9839230477de7908e8370"}
May 27 23:56:29.887571 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:56:29.887445    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-xsbrl" event={"ID":"91fbb8ad-b71b-4688-a82a-7ad7291e01db","Type":"ContainerDied","Data":"81c21afebe709ab04e8dd708cc5384d18f46b8355c770e4951d9116e3eef33db"}
May 27 23:56:29.887571 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:56:29.887461    2557 scope.go:117] "RemoveContainer" containerID="5c32c32b689cb7781eb61b7f0e93d51e8e1990fff9cdc0e9cfaf4dd072536d82"
May 27 23:56:29.889755 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:56:29.889717    2557 generic.go:358] "Generic (PLEG): container finished" podID="f6906682-26d7-4524-bbf6-e4f5919126be" containerID="df833bb43e43d52da4a22775d76259a25fd6efca219922757847649761c4b452" exitCode=137
May 27 23:56:29.889755 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:56:29.889745    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-4x724" event={"ID":"f6906682-26d7-4524-bbf6-e4f5919126be","Type":"ContainerDied","Data":"df833bb43e43d52da4a22775d76259a25fd6efca219922757847649761c4b452"}
May 27 23:56:29.889922 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:56:29.889771    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-4x724" event={"ID":"f6906682-26d7-4524-bbf6-e4f5919126be","Type":"ContainerDied","Data":"bbda2fba4268bb57555d048ab5c8312aeacfedb4bf6fe7ab1364314d2a4b5728"}
May 27 23:56:29.889922 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:56:29.889794    2557 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-4x724"
May 27 23:56:29.898290 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:56:29.898268    2557 scope.go:117] "RemoveContainer" containerID="20ec258ca4523542e1dbd57cd398094556faba03080619800adba63449dc9a7c"
May 27 23:56:29.905228 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:56:29.905213    2557 scope.go:117] "RemoveContainer" containerID="7acbee21eacb84278b80532b148ffd9fa018df933ae27508831e6801894be9c8"
May 27 23:56:29.912194 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:56:29.912168    2557 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-664fcfcc58-xsbrl"]
May 27 23:56:29.912693 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:56:29.912681    2557 scope.go:117] "RemoveContainer" containerID="5c09ee7497926d566442dd7f85234f47918b97b108e9839230477de7908e8370"
May 27 23:56:29.917595 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:56:29.917575    2557 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-664fcfcc58-xsbrl"]
May 27 23:56:29.919895 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:56:29.919859    2557 scope.go:117] "RemoveContainer" containerID="e38688d6121e87d23ae1080900057973414c244d0c799611335cc31f6f773c94"
May 27 23:56:29.926028 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:56:29.926010    2557 scope.go:117] "RemoveContainer" containerID="2f5d13ea0cc7c4993419acdf13f2e0dfecc5957f1bc0430363a3c4971ff3219e"
May 27 23:56:29.929942 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:56:29.929921    2557 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-4x724"]
May 27 23:56:29.933167 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:56:29.933113    2557 scope.go:117] "RemoveContainer" containerID="5c32c32b689cb7781eb61b7f0e93d51e8e1990fff9cdc0e9cfaf4dd072536d82"
May 27 23:56:29.933418 ip-10-0-132-191 kubenswrapper[2557]: E0527 23:56:29.933392    2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5c32c32b689cb7781eb61b7f0e93d51e8e1990fff9cdc0e9cfaf4dd072536d82\": container with ID starting with 5c32c32b689cb7781eb61b7f0e93d51e8e1990fff9cdc0e9cfaf4dd072536d82 not found: ID does not exist" containerID="5c32c32b689cb7781eb61b7f0e93d51e8e1990fff9cdc0e9cfaf4dd072536d82"
May 27 23:56:29.933484 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:56:29.933429    2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5c32c32b689cb7781eb61b7f0e93d51e8e1990fff9cdc0e9cfaf4dd072536d82"} err="failed to get container status \"5c32c32b689cb7781eb61b7f0e93d51e8e1990fff9cdc0e9cfaf4dd072536d82\": rpc error: code = NotFound desc = could not find container \"5c32c32b689cb7781eb61b7f0e93d51e8e1990fff9cdc0e9cfaf4dd072536d82\": container with ID starting with 5c32c32b689cb7781eb61b7f0e93d51e8e1990fff9cdc0e9cfaf4dd072536d82 not found: ID does not exist"
May 27 23:56:29.933484 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:56:29.933454    2557 scope.go:117] "RemoveContainer" containerID="20ec258ca4523542e1dbd57cd398094556faba03080619800adba63449dc9a7c"
May 27 23:56:29.933484 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:56:29.933473    2557 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-4x724"]
May 27 23:56:29.933715 ip-10-0-132-191 kubenswrapper[2557]: E0527 23:56:29.933698    2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"20ec258ca4523542e1dbd57cd398094556faba03080619800adba63449dc9a7c\": container with ID starting with 20ec258ca4523542e1dbd57cd398094556faba03080619800adba63449dc9a7c not found: ID does not exist" containerID="20ec258ca4523542e1dbd57cd398094556faba03080619800adba63449dc9a7c"
May 27 23:56:29.933775 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:56:29.933720    2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"20ec258ca4523542e1dbd57cd398094556faba03080619800adba63449dc9a7c"} err="failed to get container status \"20ec258ca4523542e1dbd57cd398094556faba03080619800adba63449dc9a7c\": rpc error: code = NotFound desc = could not find container \"20ec258ca4523542e1dbd57cd398094556faba03080619800adba63449dc9a7c\": container with ID starting with 20ec258ca4523542e1dbd57cd398094556faba03080619800adba63449dc9a7c not found: ID does not exist"
May 27 23:56:29.933775 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:56:29.933734    2557 scope.go:117] "RemoveContainer" containerID="7acbee21eacb84278b80532b148ffd9fa018df933ae27508831e6801894be9c8"
May 27 23:56:29.933947 ip-10-0-132-191 kubenswrapper[2557]: E0527 23:56:29.933931    2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7acbee21eacb84278b80532b148ffd9fa018df933ae27508831e6801894be9c8\": container with ID starting with 7acbee21eacb84278b80532b148ffd9fa018df933ae27508831e6801894be9c8 not found: ID does not exist" containerID="7acbee21eacb84278b80532b148ffd9fa018df933ae27508831e6801894be9c8"
May 27 23:56:29.933999 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:56:29.933949    2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7acbee21eacb84278b80532b148ffd9fa018df933ae27508831e6801894be9c8"} err="failed to get container status \"7acbee21eacb84278b80532b148ffd9fa018df933ae27508831e6801894be9c8\": rpc error: code = NotFound desc = could not find container \"7acbee21eacb84278b80532b148ffd9fa018df933ae27508831e6801894be9c8\": container with ID starting with 7acbee21eacb84278b80532b148ffd9fa018df933ae27508831e6801894be9c8 not found: ID does not exist"
May 27 23:56:29.933999 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:56:29.933962    2557 scope.go:117] "RemoveContainer" containerID="5c09ee7497926d566442dd7f85234f47918b97b108e9839230477de7908e8370"
May 27 23:56:29.934195 ip-10-0-132-191 kubenswrapper[2557]: E0527 23:56:29.934176    2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5c09ee7497926d566442dd7f85234f47918b97b108e9839230477de7908e8370\": container with ID starting with 5c09ee7497926d566442dd7f85234f47918b97b108e9839230477de7908e8370 not found: ID does not exist" containerID="5c09ee7497926d566442dd7f85234f47918b97b108e9839230477de7908e8370"
May 27 23:56:29.934234 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:56:29.934200    2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5c09ee7497926d566442dd7f85234f47918b97b108e9839230477de7908e8370"} err="failed to get container status \"5c09ee7497926d566442dd7f85234f47918b97b108e9839230477de7908e8370\": rpc error: code = NotFound desc = could not find container \"5c09ee7497926d566442dd7f85234f47918b97b108e9839230477de7908e8370\": container with ID starting with 5c09ee7497926d566442dd7f85234f47918b97b108e9839230477de7908e8370 not found: ID does not exist"
May 27 23:56:29.934234 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:56:29.934214    2557 scope.go:117] "RemoveContainer" containerID="e38688d6121e87d23ae1080900057973414c244d0c799611335cc31f6f773c94"
May 27 23:56:29.934424 ip-10-0-132-191 kubenswrapper[2557]: E0527 23:56:29.934406    2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e38688d6121e87d23ae1080900057973414c244d0c799611335cc31f6f773c94\": container with ID starting with e38688d6121e87d23ae1080900057973414c244d0c799611335cc31f6f773c94 not found: ID does not exist" containerID="e38688d6121e87d23ae1080900057973414c244d0c799611335cc31f6f773c94"
May 27 23:56:29.934482 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:56:29.934432    2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e38688d6121e87d23ae1080900057973414c244d0c799611335cc31f6f773c94"} err="failed to get container status \"e38688d6121e87d23ae1080900057973414c244d0c799611335cc31f6f773c94\": rpc error: code = NotFound desc = could not find container \"e38688d6121e87d23ae1080900057973414c244d0c799611335cc31f6f773c94\": container with ID starting with e38688d6121e87d23ae1080900057973414c244d0c799611335cc31f6f773c94 not found: ID does not exist"
May 27 23:56:29.934482 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:56:29.934456    2557 scope.go:117] "RemoveContainer" containerID="2f5d13ea0cc7c4993419acdf13f2e0dfecc5957f1bc0430363a3c4971ff3219e"
May 27 23:56:29.934693 ip-10-0-132-191 kubenswrapper[2557]: E0527 23:56:29.934674    2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2f5d13ea0cc7c4993419acdf13f2e0dfecc5957f1bc0430363a3c4971ff3219e\": container with ID starting with 2f5d13ea0cc7c4993419acdf13f2e0dfecc5957f1bc0430363a3c4971ff3219e not found: ID does not exist" containerID="2f5d13ea0cc7c4993419acdf13f2e0dfecc5957f1bc0430363a3c4971ff3219e"
May 27 23:56:29.934729 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:56:29.934697    2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2f5d13ea0cc7c4993419acdf13f2e0dfecc5957f1bc0430363a3c4971ff3219e"} err="failed to get container status \"2f5d13ea0cc7c4993419acdf13f2e0dfecc5957f1bc0430363a3c4971ff3219e\": rpc error: code = NotFound desc = could not find container \"2f5d13ea0cc7c4993419acdf13f2e0dfecc5957f1bc0430363a3c4971ff3219e\": container with ID starting with 2f5d13ea0cc7c4993419acdf13f2e0dfecc5957f1bc0430363a3c4971ff3219e not found: ID does not exist"
May 27 23:56:29.934729 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:56:29.934726    2557 scope.go:117] "RemoveContainer" containerID="5c32c32b689cb7781eb61b7f0e93d51e8e1990fff9cdc0e9cfaf4dd072536d82"
May 27 23:56:29.934924 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:56:29.934910    2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5c32c32b689cb7781eb61b7f0e93d51e8e1990fff9cdc0e9cfaf4dd072536d82"} err="failed to get container status \"5c32c32b689cb7781eb61b7f0e93d51e8e1990fff9cdc0e9cfaf4dd072536d82\": rpc error: code = NotFound desc = could not find container \"5c32c32b689cb7781eb61b7f0e93d51e8e1990fff9cdc0e9cfaf4dd072536d82\": container with ID starting with 5c32c32b689cb7781eb61b7f0e93d51e8e1990fff9cdc0e9cfaf4dd072536d82 not found: ID does not exist"
May 27 23:56:29.934967 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:56:29.934924    2557 scope.go:117] "RemoveContainer" containerID="20ec258ca4523542e1dbd57cd398094556faba03080619800adba63449dc9a7c"
May 27 23:56:29.935137 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:56:29.935108    2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"20ec258ca4523542e1dbd57cd398094556faba03080619800adba63449dc9a7c"} err="failed to get container status \"20ec258ca4523542e1dbd57cd398094556faba03080619800adba63449dc9a7c\": rpc error: code = NotFound desc = could not find container \"20ec258ca4523542e1dbd57cd398094556faba03080619800adba63449dc9a7c\": container with ID starting with 20ec258ca4523542e1dbd57cd398094556faba03080619800adba63449dc9a7c not found: ID does not exist"
May 27 23:56:29.935208 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:56:29.935149    2557 scope.go:117] "RemoveContainer" containerID="7acbee21eacb84278b80532b148ffd9fa018df933ae27508831e6801894be9c8"
May 27 23:56:29.935356 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:56:29.935341    2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7acbee21eacb84278b80532b148ffd9fa018df933ae27508831e6801894be9c8"} err="failed to get container status \"7acbee21eacb84278b80532b148ffd9fa018df933ae27508831e6801894be9c8\": rpc error: code = NotFound desc = could not find container \"7acbee21eacb84278b80532b148ffd9fa018df933ae27508831e6801894be9c8\": container with ID starting with 7acbee21eacb84278b80532b148ffd9fa018df933ae27508831e6801894be9c8 not found: ID does not exist"
May 27 23:56:29.935402 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:56:29.935356    2557 scope.go:117] "RemoveContainer" containerID="5c09ee7497926d566442dd7f85234f47918b97b108e9839230477de7908e8370"
May 27 23:56:29.935537 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:56:29.935519    2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5c09ee7497926d566442dd7f85234f47918b97b108e9839230477de7908e8370"} err="failed to get container status \"5c09ee7497926d566442dd7f85234f47918b97b108e9839230477de7908e8370\": rpc error: code = NotFound desc = could not find container \"5c09ee7497926d566442dd7f85234f47918b97b108e9839230477de7908e8370\": container with ID starting with 5c09ee7497926d566442dd7f85234f47918b97b108e9839230477de7908e8370 not found: ID does not exist"
May 27 23:56:29.935597 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:56:29.935538    2557 scope.go:117] "RemoveContainer" containerID="e38688d6121e87d23ae1080900057973414c244d0c799611335cc31f6f773c94"
May 27 23:56:29.935764 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:56:29.935742    2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e38688d6121e87d23ae1080900057973414c244d0c799611335cc31f6f773c94"} err="failed to get container status \"e38688d6121e87d23ae1080900057973414c244d0c799611335cc31f6f773c94\": rpc error: code = NotFound desc = could not find container \"e38688d6121e87d23ae1080900057973414c244d0c799611335cc31f6f773c94\": container with ID starting with e38688d6121e87d23ae1080900057973414c244d0c799611335cc31f6f773c94 not found: ID does not exist"
May 27 23:56:29.935809 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:56:29.935766    2557 scope.go:117] "RemoveContainer" containerID="2f5d13ea0cc7c4993419acdf13f2e0dfecc5957f1bc0430363a3c4971ff3219e"
May 27 23:56:29.935953 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:56:29.935937    2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2f5d13ea0cc7c4993419acdf13f2e0dfecc5957f1bc0430363a3c4971ff3219e"} err="failed to get container status \"2f5d13ea0cc7c4993419acdf13f2e0dfecc5957f1bc0430363a3c4971ff3219e\": rpc error: code = NotFound desc = could not find container \"2f5d13ea0cc7c4993419acdf13f2e0dfecc5957f1bc0430363a3c4971ff3219e\": container with ID starting with 2f5d13ea0cc7c4993419acdf13f2e0dfecc5957f1bc0430363a3c4971ff3219e not found: ID does not exist"
May 27 23:56:29.935953 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:56:29.935952    2557 scope.go:117] "RemoveContainer" containerID="b70b105fb98b11506c37683259a8b839e2ee9a1cc019a7098e2bdc35d20a7a3b"
May 27 23:56:29.940929 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:56:29.940910    2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-z8n8x\" (UniqueName: \"kubernetes.io/projected/91fbb8ad-b71b-4688-a82a-7ad7291e01db-kube-api-access-z8n8x\") on node \"ip-10-0-132-191.ec2.internal\" DevicePath \"\""
May 27 23:56:29.941001 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:56:29.940931    2557 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/91fbb8ad-b71b-4688-a82a-7ad7291e01db-registry-tls\") on node \"ip-10-0-132-191.ec2.internal\" DevicePath \"\""
May 27 23:56:29.941001 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:56:29.940941    2557 reconciler_common.go:299] "Volume detached for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/91fbb8ad-b71b-4688-a82a-7ad7291e01db-online-tls\") on node \"ip-10-0-132-191.ec2.internal\" DevicePath \"\""
May 27 23:56:29.941001 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:56:29.940949    2557 reconciler_common.go:299] "Volume detached for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/91fbb8ad-b71b-4688-a82a-7ad7291e01db-offline-tls\") on node \"ip-10-0-132-191.ec2.internal\" DevicePath \"\""
May 27 23:56:29.941001 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:56:29.940957    2557 reconciler_common.go:299] "Volume detached for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/91fbb8ad-b71b-4688-a82a-7ad7291e01db-feast-data\") on node \"ip-10-0-132-191.ec2.internal\" DevicePath \"\""
May 27 23:56:29.941001 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:56:29.940966    2557 reconciler_common.go:299] "Volume detached for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/91fbb8ad-b71b-4688-a82a-7ad7291e01db-ui-tls\") on node \"ip-10-0-132-191.ec2.internal\" DevicePath \"\""
May 27 23:56:29.942597 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:56:29.942580    2557 scope.go:117] "RemoveContainer" containerID="df833bb43e43d52da4a22775d76259a25fd6efca219922757847649761c4b452"
May 27 23:56:29.948820 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:56:29.948801    2557 scope.go:117] "RemoveContainer" containerID="2ae69fcad224ae9359fb7d216bcc1c6281b9212d67297738d84804e89ef0eebc"
May 27 23:56:29.955014 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:56:29.954996    2557 scope.go:117] "RemoveContainer" containerID="e87d736cbe3a72512f7159c542e7b3a5b59bf4d185d2909492d19d010b36c4ad"
May 27 23:56:29.961249 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:56:29.961233    2557 scope.go:117] "RemoveContainer" containerID="45a85719403119f190e8f5798cb2b4bd37133370891ac1a05c9f2f29effc4f9d"
May 27 23:56:29.967424 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:56:29.967407    2557 scope.go:117] "RemoveContainer" containerID="b70b105fb98b11506c37683259a8b839e2ee9a1cc019a7098e2bdc35d20a7a3b"
May 27 23:56:29.967655 ip-10-0-132-191 kubenswrapper[2557]: E0527 23:56:29.967638    2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b70b105fb98b11506c37683259a8b839e2ee9a1cc019a7098e2bdc35d20a7a3b\": container with ID starting with b70b105fb98b11506c37683259a8b839e2ee9a1cc019a7098e2bdc35d20a7a3b not found: ID does not exist" containerID="b70b105fb98b11506c37683259a8b839e2ee9a1cc019a7098e2bdc35d20a7a3b"
May 27 23:56:29.967710 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:56:29.967661    2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b70b105fb98b11506c37683259a8b839e2ee9a1cc019a7098e2bdc35d20a7a3b"} err="failed to get container status \"b70b105fb98b11506c37683259a8b839e2ee9a1cc019a7098e2bdc35d20a7a3b\": rpc error: code = NotFound desc = could not find container \"b70b105fb98b11506c37683259a8b839e2ee9a1cc019a7098e2bdc35d20a7a3b\": container with ID starting with b70b105fb98b11506c37683259a8b839e2ee9a1cc019a7098e2bdc35d20a7a3b not found: ID does not exist"
May 27 23:56:29.967710 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:56:29.967681    2557 scope.go:117] "RemoveContainer" containerID="df833bb43e43d52da4a22775d76259a25fd6efca219922757847649761c4b452"
May 27 23:56:29.967910 ip-10-0-132-191 kubenswrapper[2557]: E0527 23:56:29.967894    2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"df833bb43e43d52da4a22775d76259a25fd6efca219922757847649761c4b452\": container with ID starting with df833bb43e43d52da4a22775d76259a25fd6efca219922757847649761c4b452 not found: ID does not exist" containerID="df833bb43e43d52da4a22775d76259a25fd6efca219922757847649761c4b452"
May 27 23:56:29.967955 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:56:29.967915    2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"df833bb43e43d52da4a22775d76259a25fd6efca219922757847649761c4b452"} err="failed to get container status \"df833bb43e43d52da4a22775d76259a25fd6efca219922757847649761c4b452\": rpc error: code = NotFound desc = could not find container \"df833bb43e43d52da4a22775d76259a25fd6efca219922757847649761c4b452\": container with ID starting with df833bb43e43d52da4a22775d76259a25fd6efca219922757847649761c4b452 not found: ID does not exist"
May 27 23:56:29.967955 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:56:29.967935    2557 scope.go:117] "RemoveContainer" containerID="2ae69fcad224ae9359fb7d216bcc1c6281b9212d67297738d84804e89ef0eebc"
May 27 23:56:29.968172 ip-10-0-132-191 kubenswrapper[2557]: E0527 23:56:29.968148    2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2ae69fcad224ae9359fb7d216bcc1c6281b9212d67297738d84804e89ef0eebc\": container with ID starting with 2ae69fcad224ae9359fb7d216bcc1c6281b9212d67297738d84804e89ef0eebc not found: ID does not exist" containerID="2ae69fcad224ae9359fb7d216bcc1c6281b9212d67297738d84804e89ef0eebc"
May 27 23:56:29.968225 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:56:29.968176    2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2ae69fcad224ae9359fb7d216bcc1c6281b9212d67297738d84804e89ef0eebc"} err="failed to get container status \"2ae69fcad224ae9359fb7d216bcc1c6281b9212d67297738d84804e89ef0eebc\": rpc error: code = NotFound desc = could not find container \"2ae69fcad224ae9359fb7d216bcc1c6281b9212d67297738d84804e89ef0eebc\": container with ID starting with 2ae69fcad224ae9359fb7d216bcc1c6281b9212d67297738d84804e89ef0eebc not found: ID does not exist"
May 27 23:56:29.968225 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:56:29.968191    2557 scope.go:117] "RemoveContainer" containerID="e87d736cbe3a72512f7159c542e7b3a5b59bf4d185d2909492d19d010b36c4ad"
May 27 23:56:29.968405 ip-10-0-132-191 kubenswrapper[2557]: E0527 23:56:29.968389    2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e87d736cbe3a72512f7159c542e7b3a5b59bf4d185d2909492d19d010b36c4ad\": container with ID starting with e87d736cbe3a72512f7159c542e7b3a5b59bf4d185d2909492d19d010b36c4ad not found: ID does not exist" containerID="e87d736cbe3a72512f7159c542e7b3a5b59bf4d185d2909492d19d010b36c4ad"
May 27 23:56:29.968448 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:56:29.968409    2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e87d736cbe3a72512f7159c542e7b3a5b59bf4d185d2909492d19d010b36c4ad"} err="failed to get container status \"e87d736cbe3a72512f7159c542e7b3a5b59bf4d185d2909492d19d010b36c4ad\": rpc error: code = NotFound desc = could not find container \"e87d736cbe3a72512f7159c542e7b3a5b59bf4d185d2909492d19d010b36c4ad\": container with ID starting with e87d736cbe3a72512f7159c542e7b3a5b59bf4d185d2909492d19d010b36c4ad not found: ID does not exist"
May 27 23:56:29.968448 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:56:29.968431    2557 scope.go:117] "RemoveContainer" containerID="45a85719403119f190e8f5798cb2b4bd37133370891ac1a05c9f2f29effc4f9d"
May 27 23:56:29.968653 ip-10-0-132-191 kubenswrapper[2557]: E0527 23:56:29.968638    2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"45a85719403119f190e8f5798cb2b4bd37133370891ac1a05c9f2f29effc4f9d\": container with ID starting with 45a85719403119f190e8f5798cb2b4bd37133370891ac1a05c9f2f29effc4f9d not found: ID does not exist" containerID="45a85719403119f190e8f5798cb2b4bd37133370891ac1a05c9f2f29effc4f9d"
May 27 23:56:29.968705 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:56:29.968656    2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"45a85719403119f190e8f5798cb2b4bd37133370891ac1a05c9f2f29effc4f9d"} err="failed to get container status \"45a85719403119f190e8f5798cb2b4bd37133370891ac1a05c9f2f29effc4f9d\": rpc error: code = NotFound desc = could not find container \"45a85719403119f190e8f5798cb2b4bd37133370891ac1a05c9f2f29effc4f9d\": container with ID starting with 45a85719403119f190e8f5798cb2b4bd37133370891ac1a05c9f2f29effc4f9d not found: ID does not exist"
May 27 23:56:31.205654 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:56:31.202635    2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="91fbb8ad-b71b-4688-a82a-7ad7291e01db" path="/var/lib/kubelet/pods/91fbb8ad-b71b-4688-a82a-7ad7291e01db/volumes"
May 27 23:56:31.205654 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:56:31.203505    2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f6906682-26d7-4524-bbf6-e4f5919126be" path="/var/lib/kubelet/pods/f6906682-26d7-4524-bbf6-e4f5919126be/volumes"
May 27 23:56:48.021584 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:56:48.021497    2557 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["feast-operator-system/feast-operator-controller-manager-cf99db75-q2mt6"]
May 27 23:56:48.021975 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:56:48.021716    2557 kuberuntime_container.go:864] "Killing container with a grace period" pod="feast-operator-system/feast-operator-controller-manager-cf99db75-q2mt6" podUID="98f4e66b-5469-46f0-b66d-56ec5af49b22" containerName="manager" containerID="cri-o://35952a92192ee53f288c05f6a60d6225fabd3aa79171532b0618477bd0491633" gracePeriod=10
May 27 23:56:48.255087 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:56:48.255065    2557 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="feast-operator-system/feast-operator-controller-manager-cf99db75-q2mt6"
May 27 23:56:48.363317 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:56:48.363292    2557 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7q2w9\" (UniqueName: \"kubernetes.io/projected/98f4e66b-5469-46f0-b66d-56ec5af49b22-kube-api-access-7q2w9\") pod \"98f4e66b-5469-46f0-b66d-56ec5af49b22\" (UID: \"98f4e66b-5469-46f0-b66d-56ec5af49b22\") "
May 27 23:56:48.365347 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:56:48.365316    2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/98f4e66b-5469-46f0-b66d-56ec5af49b22-kube-api-access-7q2w9" (OuterVolumeSpecName: "kube-api-access-7q2w9") pod "98f4e66b-5469-46f0-b66d-56ec5af49b22" (UID: "98f4e66b-5469-46f0-b66d-56ec5af49b22"). InnerVolumeSpecName "kube-api-access-7q2w9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 27 23:56:48.464070 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:56:48.464040    2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7q2w9\" (UniqueName: \"kubernetes.io/projected/98f4e66b-5469-46f0-b66d-56ec5af49b22-kube-api-access-7q2w9\") on node \"ip-10-0-132-191.ec2.internal\" DevicePath \"\""
May 27 23:56:48.940105 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:56:48.940064    2557 generic.go:358] "Generic (PLEG): container finished" podID="98f4e66b-5469-46f0-b66d-56ec5af49b22" containerID="35952a92192ee53f288c05f6a60d6225fabd3aa79171532b0618477bd0491633" exitCode=0
May 27 23:56:48.940308 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:56:48.940154    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="feast-operator-system/feast-operator-controller-manager-cf99db75-q2mt6" event={"ID":"98f4e66b-5469-46f0-b66d-56ec5af49b22","Type":"ContainerDied","Data":"35952a92192ee53f288c05f6a60d6225fabd3aa79171532b0618477bd0491633"}
May 27 23:56:48.940308 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:56:48.940205    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="feast-operator-system/feast-operator-controller-manager-cf99db75-q2mt6" event={"ID":"98f4e66b-5469-46f0-b66d-56ec5af49b22","Type":"ContainerDied","Data":"7310df4393bb6a17cbec81986b4e00b814934c469c89f832b5c939e8de3b3338"}
May 27 23:56:48.940308 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:56:48.940225    2557 scope.go:117] "RemoveContainer" containerID="35952a92192ee53f288c05f6a60d6225fabd3aa79171532b0618477bd0491633"
May 27 23:56:48.940308 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:56:48.940172    2557 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="feast-operator-system/feast-operator-controller-manager-cf99db75-q2mt6"
May 27 23:56:48.947169 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:56:48.947151    2557 scope.go:117] "RemoveContainer" containerID="35952a92192ee53f288c05f6a60d6225fabd3aa79171532b0618477bd0491633"
May 27 23:56:48.947441 ip-10-0-132-191 kubenswrapper[2557]: E0527 23:56:48.947422    2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"35952a92192ee53f288c05f6a60d6225fabd3aa79171532b0618477bd0491633\": container with ID starting with 35952a92192ee53f288c05f6a60d6225fabd3aa79171532b0618477bd0491633 not found: ID does not exist" containerID="35952a92192ee53f288c05f6a60d6225fabd3aa79171532b0618477bd0491633"
May 27 23:56:48.947508 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:56:48.947448    2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"35952a92192ee53f288c05f6a60d6225fabd3aa79171532b0618477bd0491633"} err="failed to get container status \"35952a92192ee53f288c05f6a60d6225fabd3aa79171532b0618477bd0491633\": rpc error: code = NotFound desc = could not find container \"35952a92192ee53f288c05f6a60d6225fabd3aa79171532b0618477bd0491633\": container with ID starting with 35952a92192ee53f288c05f6a60d6225fabd3aa79171532b0618477bd0491633 not found: ID does not exist"
May 27 23:56:48.962552 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:56:48.962527    2557 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["feast-operator-system/feast-operator-controller-manager-cf99db75-q2mt6"]
May 27 23:56:48.966692 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:56:48.966672    2557 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["feast-operator-system/feast-operator-controller-manager-cf99db75-q2mt6"]
May 27 23:56:49.202008 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:56:49.201937    2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="98f4e66b-5469-46f0-b66d-56ec5af49b22" path="/var/lib/kubelet/pods/98f4e66b-5469-46f0-b66d-56ec5af49b22/volumes"
May 27 23:56:52.294836 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:56:52.294804    2557 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["feast-operator-system/feast-operator-controller-manager-cf99db75-tlbg5"]
May 27 23:56:52.295206 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:56:52.295001    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f6906682-26d7-4524-bbf6-e4f5919126be" containerName="online"
May 27 23:56:52.295206 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:56:52.295011    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="f6906682-26d7-4524-bbf6-e4f5919126be" containerName="online"
May 27 23:56:52.295206 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:56:52.295022    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="91fbb8ad-b71b-4688-a82a-7ad7291e01db" containerName="registry"
May 27 23:56:52.295206 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:56:52.295029    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="91fbb8ad-b71b-4688-a82a-7ad7291e01db" containerName="registry"
May 27 23:56:52.295206 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:56:52.295036    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f6906682-26d7-4524-bbf6-e4f5919126be" containerName="offline"
May 27 23:56:52.295206 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:56:52.295042    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="f6906682-26d7-4524-bbf6-e4f5919126be" containerName="offline"
May 27 23:56:52.295206 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:56:52.295048    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f6906682-26d7-4524-bbf6-e4f5919126be" containerName="feast-apply"
May 27 23:56:52.295206 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:56:52.295053    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="f6906682-26d7-4524-bbf6-e4f5919126be" containerName="feast-apply"
May 27 23:56:52.295206 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:56:52.295058    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="91fbb8ad-b71b-4688-a82a-7ad7291e01db" containerName="feast-init"
May 27 23:56:52.295206 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:56:52.295063    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="91fbb8ad-b71b-4688-a82a-7ad7291e01db" containerName="feast-init"
May 27 23:56:52.295206 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:56:52.295070    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f6906682-26d7-4524-bbf6-e4f5919126be" containerName="feast-init"
May 27 23:56:52.295206 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:56:52.295076    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="f6906682-26d7-4524-bbf6-e4f5919126be" containerName="feast-init"
May 27 23:56:52.295206 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:56:52.295081    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="91fbb8ad-b71b-4688-a82a-7ad7291e01db" containerName="ui"
May 27 23:56:52.295206 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:56:52.295086    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="91fbb8ad-b71b-4688-a82a-7ad7291e01db" containerName="ui"
May 27 23:56:52.295206 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:56:52.295093    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="91fbb8ad-b71b-4688-a82a-7ad7291e01db" containerName="online"
May 27 23:56:52.295206 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:56:52.295097    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="91fbb8ad-b71b-4688-a82a-7ad7291e01db" containerName="online"
May 27 23:56:52.295206 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:56:52.295108    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="91fbb8ad-b71b-4688-a82a-7ad7291e01db" containerName="offline"
May 27 23:56:52.295206 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:56:52.295113    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="91fbb8ad-b71b-4688-a82a-7ad7291e01db" containerName="offline"
May 27 23:56:52.295206 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:56:52.295119    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f6906682-26d7-4524-bbf6-e4f5919126be" containerName="ui"
May 27 23:56:52.295206 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:56:52.295124    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="f6906682-26d7-4524-bbf6-e4f5919126be" containerName="ui"
May 27 23:56:52.295206 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:56:52.295148    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="98f4e66b-5469-46f0-b66d-56ec5af49b22" containerName="manager"
May 27 23:56:52.295206 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:56:52.295153    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="98f4e66b-5469-46f0-b66d-56ec5af49b22" containerName="manager"
May 27 23:56:52.295206 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:56:52.295158    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="91fbb8ad-b71b-4688-a82a-7ad7291e01db" containerName="feast-apply"
May 27 23:56:52.295206 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:56:52.295163    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="91fbb8ad-b71b-4688-a82a-7ad7291e01db" containerName="feast-apply"
May 27 23:56:52.295206 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:56:52.295196    2557 memory_manager.go:356] "RemoveStaleState removing state" podUID="f6906682-26d7-4524-bbf6-e4f5919126be" containerName="ui"
May 27 23:56:52.295206 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:56:52.295202    2557 memory_manager.go:356] "RemoveStaleState removing state" podUID="f6906682-26d7-4524-bbf6-e4f5919126be" containerName="online"
May 27 23:56:52.295206 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:56:52.295210    2557 memory_manager.go:356] "RemoveStaleState removing state" podUID="f6906682-26d7-4524-bbf6-e4f5919126be" containerName="offline"
May 27 23:56:52.295206 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:56:52.295215    2557 memory_manager.go:356] "RemoveStaleState removing state" podUID="91fbb8ad-b71b-4688-a82a-7ad7291e01db" containerName="registry"
May 27 23:56:52.295206 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:56:52.295221    2557 memory_manager.go:356] "RemoveStaleState removing state" podUID="91fbb8ad-b71b-4688-a82a-7ad7291e01db" containerName="online"
May 27 23:56:52.296015 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:56:52.295228    2557 memory_manager.go:356] "RemoveStaleState removing state" podUID="98f4e66b-5469-46f0-b66d-56ec5af49b22" containerName="manager"
May 27 23:56:52.296015 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:56:52.295233    2557 memory_manager.go:356] "RemoveStaleState removing state" podUID="91fbb8ad-b71b-4688-a82a-7ad7291e01db" containerName="ui"
May 27 23:56:52.296015 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:56:52.295239    2557 memory_manager.go:356] "RemoveStaleState removing state" podUID="91fbb8ad-b71b-4688-a82a-7ad7291e01db" containerName="offline"
May 27 23:56:52.299288 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:56:52.299270    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="feast-operator-system/feast-operator-controller-manager-cf99db75-tlbg5"
May 27 23:56:52.301973 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:56:52.301957    2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"feast-operator-system\"/\"openshift-service-ca.crt\""
May 27 23:56:52.303219 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:56:52.303202    2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"feast-operator-system\"/\"feast-operator-controller-manager-dockercfg-78kkl\""
May 27 23:56:52.303275 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:56:52.303236    2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"feast-operator-system\"/\"kube-root-ca.crt\""
May 27 23:56:52.306754 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:56:52.306734    2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["feast-operator-system/feast-operator-controller-manager-cf99db75-tlbg5"]
May 27 23:56:52.389710 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:56:52.389666    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cpk67\" (UniqueName: \"kubernetes.io/projected/5d1ea8d1-ae33-482c-8b66-d3244b62da4f-kube-api-access-cpk67\") pod \"feast-operator-controller-manager-cf99db75-tlbg5\" (UID: \"5d1ea8d1-ae33-482c-8b66-d3244b62da4f\") " pod="feast-operator-system/feast-operator-controller-manager-cf99db75-tlbg5"
May 27 23:56:52.490773 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:56:52.490729    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-cpk67\" (UniqueName: \"kubernetes.io/projected/5d1ea8d1-ae33-482c-8b66-d3244b62da4f-kube-api-access-cpk67\") pod \"feast-operator-controller-manager-cf99db75-tlbg5\" (UID: \"5d1ea8d1-ae33-482c-8b66-d3244b62da4f\") " pod="feast-operator-system/feast-operator-controller-manager-cf99db75-tlbg5"
May 27 23:56:52.501769 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:56:52.501746    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cpk67\" (UniqueName: \"kubernetes.io/projected/5d1ea8d1-ae33-482c-8b66-d3244b62da4f-kube-api-access-cpk67\") pod \"feast-operator-controller-manager-cf99db75-tlbg5\" (UID: \"5d1ea8d1-ae33-482c-8b66-d3244b62da4f\") " pod="feast-operator-system/feast-operator-controller-manager-cf99db75-tlbg5"
May 27 23:56:52.609510 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:56:52.609478    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="feast-operator-system/feast-operator-controller-manager-cf99db75-tlbg5"
May 27 23:56:52.727212 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:56:52.727183    2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["feast-operator-system/feast-operator-controller-manager-cf99db75-tlbg5"]
May 27 23:56:52.729917 ip-10-0-132-191 kubenswrapper[2557]: W0527 23:56:52.729887    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5d1ea8d1_ae33_482c_8b66_d3244b62da4f.slice/crio-6f46bf6fb6c15115e1a1375654e4a05003cbf0fc5177a72f6d1650425cff757e WatchSource:0}: Error finding container 6f46bf6fb6c15115e1a1375654e4a05003cbf0fc5177a72f6d1650425cff757e: Status 404 returned error can't find the container with id 6f46bf6fb6c15115e1a1375654e4a05003cbf0fc5177a72f6d1650425cff757e
May 27 23:56:52.731662 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:56:52.731647    2557 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
May 27 23:56:52.954315 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:56:52.954223    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="feast-operator-system/feast-operator-controller-manager-cf99db75-tlbg5" event={"ID":"5d1ea8d1-ae33-482c-8b66-d3244b62da4f","Type":"ContainerStarted","Data":"b2fdb34b3757c09e88e464c28e9bd766fe211bacba2440c9d04bf428f6a74486"}
May 27 23:56:52.954315 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:56:52.954265    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="feast-operator-system/feast-operator-controller-manager-cf99db75-tlbg5" event={"ID":"5d1ea8d1-ae33-482c-8b66-d3244b62da4f","Type":"ContainerStarted","Data":"6f46bf6fb6c15115e1a1375654e4a05003cbf0fc5177a72f6d1650425cff757e"}
May 27 23:56:52.954506 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:56:52.954353    2557 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="feast-operator-system/feast-operator-controller-manager-cf99db75-tlbg5"
May 27 23:56:52.971430 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:56:52.971385    2557 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="feast-operator-system/feast-operator-controller-manager-cf99db75-tlbg5" podStartSLOduration=0.971373326 podStartE2EDuration="971.373326ms" podCreationTimestamp="2026-05-27 23:56:52 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-27 23:56:52.970321659 +0000 UTC m=+1428.389857671" watchObservedRunningTime="2026-05-27 23:56:52.971373326 +0000 UTC m=+1428.390909337"
May 27 23:57:03.959783 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:57:03.959745    2557 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="feast-operator-system/feast-operator-controller-manager-cf99db75-tlbg5"
May 27 23:57:09.595242 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:57:09.595204    2557 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["test-ns-feast/feast-simple-feast-setup-664fcfcc58-st4rs"]
May 27 23:57:09.599992 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:57:09.599974    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-st4rs"
May 27 23:57:09.602801 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:57:09.602775    2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-ui-tls\""
May 27 23:57:09.602975 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:57:09.602798    2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-dockercfg-z25wb\""
May 27 23:57:09.602975 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:57:09.602806    2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast\"/\"openshift-service-ca.crt\""
May 27 23:57:09.603092 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:57:09.602989    2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-offline-tls\""
May 27 23:57:09.603092 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:57:09.603003    2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-online-tls\""
May 27 23:57:09.603092 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:57:09.603052    2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-registry-tls\""
May 27 23:57:09.603260 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:57:09.603240    2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast\"/\"kube-root-ca.crt\""
May 27 23:57:09.609667 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:57:09.609638    2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-664fcfcc58-st4rs"]
May 27 23:57:09.703634 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:57:09.703609    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/feb775ce-5fcf-450c-af13-0a6a505bc273-online-tls\") pod \"feast-simple-feast-setup-664fcfcc58-st4rs\" (UID: \"feb775ce-5fcf-450c-af13-0a6a505bc273\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-st4rs"
May 27 23:57:09.703634 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:57:09.703636    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5q2xv\" (UniqueName: \"kubernetes.io/projected/feb775ce-5fcf-450c-af13-0a6a505bc273-kube-api-access-5q2xv\") pod \"feast-simple-feast-setup-664fcfcc58-st4rs\" (UID: \"feb775ce-5fcf-450c-af13-0a6a505bc273\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-st4rs"
May 27 23:57:09.703771 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:57:09.703666    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/feb775ce-5fcf-450c-af13-0a6a505bc273-feast-data\") pod \"feast-simple-feast-setup-664fcfcc58-st4rs\" (UID: \"feb775ce-5fcf-450c-af13-0a6a505bc273\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-st4rs"
May 27 23:57:09.703771 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:57:09.703690    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/feb775ce-5fcf-450c-af13-0a6a505bc273-ui-tls\") pod \"feast-simple-feast-setup-664fcfcc58-st4rs\" (UID: \"feb775ce-5fcf-450c-af13-0a6a505bc273\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-st4rs"
May 27 23:57:09.703771 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:57:09.703751    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/feb775ce-5fcf-450c-af13-0a6a505bc273-registry-tls\") pod \"feast-simple-feast-setup-664fcfcc58-st4rs\" (UID: \"feb775ce-5fcf-450c-af13-0a6a505bc273\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-st4rs"
May 27 23:57:09.703860 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:57:09.703777    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/feb775ce-5fcf-450c-af13-0a6a505bc273-offline-tls\") pod \"feast-simple-feast-setup-664fcfcc58-st4rs\" (UID: \"feb775ce-5fcf-450c-af13-0a6a505bc273\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-st4rs"
May 27 23:57:09.804775 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:57:09.804751    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/feb775ce-5fcf-450c-af13-0a6a505bc273-online-tls\") pod \"feast-simple-feast-setup-664fcfcc58-st4rs\" (UID: \"feb775ce-5fcf-450c-af13-0a6a505bc273\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-st4rs"
May 27 23:57:09.804890 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:57:09.804780    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-5q2xv\" (UniqueName: \"kubernetes.io/projected/feb775ce-5fcf-450c-af13-0a6a505bc273-kube-api-access-5q2xv\") pod \"feast-simple-feast-setup-664fcfcc58-st4rs\" (UID: \"feb775ce-5fcf-450c-af13-0a6a505bc273\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-st4rs"
May 27 23:57:09.804890 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:57:09.804803    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/feb775ce-5fcf-450c-af13-0a6a505bc273-feast-data\") pod \"feast-simple-feast-setup-664fcfcc58-st4rs\" (UID: \"feb775ce-5fcf-450c-af13-0a6a505bc273\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-st4rs"
May 27 23:57:09.804890 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:57:09.804824    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/feb775ce-5fcf-450c-af13-0a6a505bc273-ui-tls\") pod \"feast-simple-feast-setup-664fcfcc58-st4rs\" (UID: \"feb775ce-5fcf-450c-af13-0a6a505bc273\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-st4rs"
May 27 23:57:09.804890 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:57:09.804863    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/feb775ce-5fcf-450c-af13-0a6a505bc273-registry-tls\") pod \"feast-simple-feast-setup-664fcfcc58-st4rs\" (UID: \"feb775ce-5fcf-450c-af13-0a6a505bc273\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-st4rs"
May 27 23:57:09.804890 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:57:09.804889    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/feb775ce-5fcf-450c-af13-0a6a505bc273-offline-tls\") pod \"feast-simple-feast-setup-664fcfcc58-st4rs\" (UID: \"feb775ce-5fcf-450c-af13-0a6a505bc273\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-st4rs"
May 27 23:57:09.805165 ip-10-0-132-191 kubenswrapper[2557]: E0527 23:57:09.805007    2557 secret.go:189] Couldn't get secret test-ns-feast/feast-simple-feast-setup-registry-tls: secret "feast-simple-feast-setup-registry-tls" not found
May 27 23:57:09.805165 ip-10-0-132-191 kubenswrapper[2557]: E0527 23:57:09.805069    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/feb775ce-5fcf-450c-af13-0a6a505bc273-registry-tls podName:feb775ce-5fcf-450c-af13-0a6a505bc273 nodeName:}" failed. No retries permitted until 2026-05-27 23:57:10.305051491 +0000 UTC m=+1445.724587481 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/secret/feb775ce-5fcf-450c-af13-0a6a505bc273-registry-tls") pod "feast-simple-feast-setup-664fcfcc58-st4rs" (UID: "feb775ce-5fcf-450c-af13-0a6a505bc273") : secret "feast-simple-feast-setup-registry-tls" not found
May 27 23:57:09.805282 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:57:09.805256    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/feb775ce-5fcf-450c-af13-0a6a505bc273-feast-data\") pod \"feast-simple-feast-setup-664fcfcc58-st4rs\" (UID: \"feb775ce-5fcf-450c-af13-0a6a505bc273\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-st4rs"
May 27 23:57:09.807302 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:57:09.807281    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/feb775ce-5fcf-450c-af13-0a6a505bc273-offline-tls\") pod \"feast-simple-feast-setup-664fcfcc58-st4rs\" (UID: \"feb775ce-5fcf-450c-af13-0a6a505bc273\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-st4rs"
May 27 23:57:09.807434 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:57:09.807300    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/feb775ce-5fcf-450c-af13-0a6a505bc273-online-tls\") pod \"feast-simple-feast-setup-664fcfcc58-st4rs\" (UID: \"feb775ce-5fcf-450c-af13-0a6a505bc273\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-st4rs"
May 27 23:57:09.807434 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:57:09.807311    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/feb775ce-5fcf-450c-af13-0a6a505bc273-ui-tls\") pod \"feast-simple-feast-setup-664fcfcc58-st4rs\" (UID: \"feb775ce-5fcf-450c-af13-0a6a505bc273\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-st4rs"
May 27 23:57:09.815378 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:57:09.815355    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5q2xv\" (UniqueName: \"kubernetes.io/projected/feb775ce-5fcf-450c-af13-0a6a505bc273-kube-api-access-5q2xv\") pod \"feast-simple-feast-setup-664fcfcc58-st4rs\" (UID: \"feb775ce-5fcf-450c-af13-0a6a505bc273\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-st4rs"
May 27 23:57:10.307687 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:57:10.307652    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/feb775ce-5fcf-450c-af13-0a6a505bc273-registry-tls\") pod \"feast-simple-feast-setup-664fcfcc58-st4rs\" (UID: \"feb775ce-5fcf-450c-af13-0a6a505bc273\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-st4rs"
May 27 23:57:10.310046 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:57:10.310021    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/feb775ce-5fcf-450c-af13-0a6a505bc273-registry-tls\") pod \"feast-simple-feast-setup-664fcfcc58-st4rs\" (UID: \"feb775ce-5fcf-450c-af13-0a6a505bc273\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-st4rs"
May 27 23:57:10.509634 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:57:10.509589    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-st4rs"
May 27 23:57:10.654458 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:57:10.654433    2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-664fcfcc58-st4rs"]
May 27 23:57:10.656352 ip-10-0-132-191 kubenswrapper[2557]: W0527 23:57:10.656322    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podfeb775ce_5fcf_450c_af13_0a6a505bc273.slice/crio-6db990e4a10288a6ac5e3ec40d5c4b2345057de0cf0715d71c3561edeef9ac43 WatchSource:0}: Error finding container 6db990e4a10288a6ac5e3ec40d5c4b2345057de0cf0715d71c3561edeef9ac43: Status 404 returned error can't find the container with id 6db990e4a10288a6ac5e3ec40d5c4b2345057de0cf0715d71c3561edeef9ac43
May 27 23:57:11.001043 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:57:11.001007    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-st4rs" event={"ID":"feb775ce-5fcf-450c-af13-0a6a505bc273","Type":"ContainerStarted","Data":"dc9ece941c1382f4b147e7679030b1c9392546a79d7b9bfd5582f2f1cd7084f8"}
May 27 23:57:11.001043 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:57:11.001045    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-st4rs" event={"ID":"feb775ce-5fcf-450c-af13-0a6a505bc273","Type":"ContainerStarted","Data":"6db990e4a10288a6ac5e3ec40d5c4b2345057de0cf0715d71c3561edeef9ac43"}
May 27 23:57:16.014939 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:57:16.014907    2557 generic.go:358] "Generic (PLEG): container finished" podID="feb775ce-5fcf-450c-af13-0a6a505bc273" containerID="dc9ece941c1382f4b147e7679030b1c9392546a79d7b9bfd5582f2f1cd7084f8" exitCode=0
May 27 23:57:16.015330 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:57:16.014980    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-st4rs" event={"ID":"feb775ce-5fcf-450c-af13-0a6a505bc273","Type":"ContainerDied","Data":"dc9ece941c1382f4b147e7679030b1c9392546a79d7b9bfd5582f2f1cd7084f8"}
May 27 23:57:17.019320 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:57:17.019284    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-st4rs" event={"ID":"feb775ce-5fcf-450c-af13-0a6a505bc273","Type":"ContainerStarted","Data":"0b6c615a316f6f7d445cacfc3e17b4f34532c119757ed9c869dc81a28efc7e2b"}
May 27 23:57:22.033722 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:57:22.033687    2557 generic.go:358] "Generic (PLEG): container finished" podID="feb775ce-5fcf-450c-af13-0a6a505bc273" containerID="0b6c615a316f6f7d445cacfc3e17b4f34532c119757ed9c869dc81a28efc7e2b" exitCode=0
May 27 23:57:22.034114 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:57:22.033727    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-st4rs" event={"ID":"feb775ce-5fcf-450c-af13-0a6a505bc273","Type":"ContainerDied","Data":"0b6c615a316f6f7d445cacfc3e17b4f34532c119757ed9c869dc81a28efc7e2b"}
May 27 23:57:23.045202 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:57:23.045159    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-st4rs" event={"ID":"feb775ce-5fcf-450c-af13-0a6a505bc273","Type":"ContainerStarted","Data":"e0f648ebb14fee0eae9c365e8f0d151691e9211849323d8255e9740d4e5ef317"}
May 27 23:57:23.045681 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:57:23.045216    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-st4rs" event={"ID":"feb775ce-5fcf-450c-af13-0a6a505bc273","Type":"ContainerStarted","Data":"23a273e49635c2e5a9480e4655f5331fb6054897bf34de2e364279a06aaba28b"}
May 27 23:57:23.045681 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:57:23.045232    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-st4rs" event={"ID":"feb775ce-5fcf-450c-af13-0a6a505bc273","Type":"ContainerStarted","Data":"ffd8ec76e18f238a906b91224051bc14ae05730a85961a4ff9cbc14e7a5ddc0b"}
May 27 23:57:23.045681 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:57:23.045244    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-st4rs" event={"ID":"feb775ce-5fcf-450c-af13-0a6a505bc273","Type":"ContainerStarted","Data":"c9f8ecdef0c15fd2c246b3a86eb1c028626caeffb97c0aedc5447668a34a780b"}
May 27 23:57:23.070308 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:57:23.070247    2557 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-st4rs" podStartSLOduration=14.070213366 podStartE2EDuration="14.070213366s" podCreationTimestamp="2026-05-27 23:57:09 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-27 23:57:23.069799334 +0000 UTC m=+1458.489335346" watchObservedRunningTime="2026-05-27 23:57:23.070213366 +0000 UTC m=+1458.489749379"
May 27 23:57:25.510693 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:57:25.510656    2557 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-st4rs"
May 27 23:57:25.511171 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:57:25.510705    2557 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-st4rs"
May 27 23:57:25.511171 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:57:25.510720    2557 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-st4rs"
May 27 23:57:25.511171 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:57:25.510756    2557 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-st4rs"
May 27 23:57:25.512814 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:57:25.512741    2557 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-st4rs" podUID="feb775ce-5fcf-450c-af13-0a6a505bc273" containerName="offline" probeResult="failure" output="dial tcp 10.132.0.19:8816: connect: connection refused"
May 27 23:57:25.513286 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:57:25.513233    2557 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-st4rs" podUID="feb775ce-5fcf-450c-af13-0a6a505bc273" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.19:8443: connect: connection refused"
May 27 23:57:25.513408 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:57:25.512799    2557 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-st4rs" podUID="feb775ce-5fcf-450c-af13-0a6a505bc273" containerName="online" probeResult="failure" output="Get \"https://10.132.0.19:6567/health\": dial tcp 10.132.0.19:6567: connect: connection refused"
May 27 23:57:25.514035 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:57:25.512792    2557 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-st4rs" podUID="feb775ce-5fcf-450c-af13-0a6a505bc273" containerName="registry" probeResult="failure" output="dial tcp 10.132.0.19:6571: connect: connection refused"
May 27 23:57:28.511091 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:57:28.511060    2557 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-st4rs"
May 27 23:57:28.511600 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:57:28.511521    2557 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-st4rs"
May 27 23:57:28.511600 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:57:28.511558    2557 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-st4rs"
May 27 23:57:28.511600 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:57:28.511572    2557 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-st4rs"
May 27 23:57:28.511600 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:57:28.511583    2557 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-st4rs"
May 27 23:57:28.511600 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:57:28.511596    2557 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-st4rs"
May 27 23:57:28.511873 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:57:28.511857    2557 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-st4rs"
May 27 23:57:28.512032 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:57:28.512014    2557 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-st4rs"
May 27 23:57:28.515521 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:57:28.515504    2557 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-st4rs"
May 27 23:57:29.063198 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:57:29.063166    2557 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-st4rs"
May 27 23:57:29.063516 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:57:29.063496    2557 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-st4rs"
May 27 23:57:29.066187 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:57:29.066166    2557 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-st4rs"
May 27 23:58:30.381391 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:58:30.381306    2557 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-664fcfcc58-st4rs"]
May 27 23:58:30.381845 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:58:30.381744    2557 kuberuntime_container.go:864] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-st4rs" podUID="feb775ce-5fcf-450c-af13-0a6a505bc273" containerName="registry" containerID="cri-o://c9f8ecdef0c15fd2c246b3a86eb1c028626caeffb97c0aedc5447668a34a780b" gracePeriod=30
May 27 23:58:30.381915 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:58:30.381868    2557 kuberuntime_container.go:864] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-st4rs" podUID="feb775ce-5fcf-450c-af13-0a6a505bc273" containerName="online" containerID="cri-o://ffd8ec76e18f238a906b91224051bc14ae05730a85961a4ff9cbc14e7a5ddc0b" gracePeriod=30
May 27 23:58:30.381967 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:58:30.381859    2557 kuberuntime_container.go:864] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-st4rs" podUID="feb775ce-5fcf-450c-af13-0a6a505bc273" containerName="ui" containerID="cri-o://e0f648ebb14fee0eae9c365e8f0d151691e9211849323d8255e9740d4e5ef317" gracePeriod=30
May 27 23:58:30.382017 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:58:30.381864    2557 kuberuntime_container.go:864] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-st4rs" podUID="feb775ce-5fcf-450c-af13-0a6a505bc273" containerName="offline" containerID="cri-o://23a273e49635c2e5a9480e4655f5331fb6054897bf34de2e364279a06aaba28b" gracePeriod=30
May 27 23:58:30.788782 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:58:30.788698    2557 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["test-ns-feast/feast-simple-feast-setup-664fcfcc58-xbg6d"]
May 27 23:58:30.798569 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:58:30.798540    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-xbg6d"
May 27 23:58:30.802226 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:58:30.802198    2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-dockercfg-gcf22\""
May 27 23:58:30.821286 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:58:30.821253    2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-664fcfcc58-xbg6d"]
May 27 23:58:30.867982 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:58:30.867953    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/e8839fc2-3372-4cf9-bc32-a459899c54df-feast-data\") pod \"feast-simple-feast-setup-664fcfcc58-xbg6d\" (UID: \"e8839fc2-3372-4cf9-bc32-a459899c54df\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-xbg6d"
May 27 23:58:30.868150 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:58:30.867988    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/e8839fc2-3372-4cf9-bc32-a459899c54df-online-tls\") pod \"feast-simple-feast-setup-664fcfcc58-xbg6d\" (UID: \"e8839fc2-3372-4cf9-bc32-a459899c54df\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-xbg6d"
May 27 23:58:30.868150 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:58:30.868014    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/e8839fc2-3372-4cf9-bc32-a459899c54df-registry-tls\") pod \"feast-simple-feast-setup-664fcfcc58-xbg6d\" (UID: \"e8839fc2-3372-4cf9-bc32-a459899c54df\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-xbg6d"
May 27 23:58:30.868150 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:58:30.868060    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/e8839fc2-3372-4cf9-bc32-a459899c54df-offline-tls\") pod \"feast-simple-feast-setup-664fcfcc58-xbg6d\" (UID: \"e8839fc2-3372-4cf9-bc32-a459899c54df\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-xbg6d"
May 27 23:58:30.868150 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:58:30.868117    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h72sv\" (UniqueName: \"kubernetes.io/projected/e8839fc2-3372-4cf9-bc32-a459899c54df-kube-api-access-h72sv\") pod \"feast-simple-feast-setup-664fcfcc58-xbg6d\" (UID: \"e8839fc2-3372-4cf9-bc32-a459899c54df\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-xbg6d"
May 27 23:58:30.868352 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:58:30.868161    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/e8839fc2-3372-4cf9-bc32-a459899c54df-ui-tls\") pod \"feast-simple-feast-setup-664fcfcc58-xbg6d\" (UID: \"e8839fc2-3372-4cf9-bc32-a459899c54df\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-xbg6d"
May 27 23:58:30.968935 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:58:30.968898    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/e8839fc2-3372-4cf9-bc32-a459899c54df-ui-tls\") pod \"feast-simple-feast-setup-664fcfcc58-xbg6d\" (UID: \"e8839fc2-3372-4cf9-bc32-a459899c54df\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-xbg6d"
May 27 23:58:30.968935 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:58:30.968949    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/e8839fc2-3372-4cf9-bc32-a459899c54df-feast-data\") pod \"feast-simple-feast-setup-664fcfcc58-xbg6d\" (UID: \"e8839fc2-3372-4cf9-bc32-a459899c54df\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-xbg6d"
May 27 23:58:30.969220 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:58:30.968968    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/e8839fc2-3372-4cf9-bc32-a459899c54df-online-tls\") pod \"feast-simple-feast-setup-664fcfcc58-xbg6d\" (UID: \"e8839fc2-3372-4cf9-bc32-a459899c54df\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-xbg6d"
May 27 23:58:30.969220 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:58:30.968992    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/e8839fc2-3372-4cf9-bc32-a459899c54df-registry-tls\") pod \"feast-simple-feast-setup-664fcfcc58-xbg6d\" (UID: \"e8839fc2-3372-4cf9-bc32-a459899c54df\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-xbg6d"
May 27 23:58:30.969220 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:58:30.969009    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/e8839fc2-3372-4cf9-bc32-a459899c54df-offline-tls\") pod \"feast-simple-feast-setup-664fcfcc58-xbg6d\" (UID: \"e8839fc2-3372-4cf9-bc32-a459899c54df\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-xbg6d"
May 27 23:58:30.969220 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:58:30.969045    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-h72sv\" (UniqueName: \"kubernetes.io/projected/e8839fc2-3372-4cf9-bc32-a459899c54df-kube-api-access-h72sv\") pod \"feast-simple-feast-setup-664fcfcc58-xbg6d\" (UID: \"e8839fc2-3372-4cf9-bc32-a459899c54df\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-xbg6d"
May 27 23:58:30.969220 ip-10-0-132-191 kubenswrapper[2557]: E0527 23:58:30.969094    2557 secret.go:189] Couldn't get secret test-ns-feast/feast-simple-feast-setup-registry-tls: secret "feast-simple-feast-setup-registry-tls" not found
May 27 23:58:30.969220 ip-10-0-132-191 kubenswrapper[2557]: E0527 23:58:30.969193    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e8839fc2-3372-4cf9-bc32-a459899c54df-registry-tls podName:e8839fc2-3372-4cf9-bc32-a459899c54df nodeName:}" failed. No retries permitted until 2026-05-27 23:58:31.46917034 +0000 UTC m=+1526.888706350 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/secret/e8839fc2-3372-4cf9-bc32-a459899c54df-registry-tls") pod "feast-simple-feast-setup-664fcfcc58-xbg6d" (UID: "e8839fc2-3372-4cf9-bc32-a459899c54df") : secret "feast-simple-feast-setup-registry-tls" not found
May 27 23:58:30.969220 ip-10-0-132-191 kubenswrapper[2557]: E0527 23:58:30.969101    2557 secret.go:189] Couldn't get secret test-ns-feast/feast-simple-feast-setup-online-tls: secret "feast-simple-feast-setup-online-tls" not found
May 27 23:58:30.969682 ip-10-0-132-191 kubenswrapper[2557]: E0527 23:58:30.969316    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e8839fc2-3372-4cf9-bc32-a459899c54df-online-tls podName:e8839fc2-3372-4cf9-bc32-a459899c54df nodeName:}" failed. No retries permitted until 2026-05-27 23:58:31.469294411 +0000 UTC m=+1526.888830416 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "online-tls" (UniqueName: "kubernetes.io/secret/e8839fc2-3372-4cf9-bc32-a459899c54df-online-tls") pod "feast-simple-feast-setup-664fcfcc58-xbg6d" (UID: "e8839fc2-3372-4cf9-bc32-a459899c54df") : secret "feast-simple-feast-setup-online-tls" not found
May 27 23:58:30.969682 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:58:30.969573    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/e8839fc2-3372-4cf9-bc32-a459899c54df-feast-data\") pod \"feast-simple-feast-setup-664fcfcc58-xbg6d\" (UID: \"e8839fc2-3372-4cf9-bc32-a459899c54df\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-xbg6d"
May 27 23:58:30.971454 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:58:30.971430    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/e8839fc2-3372-4cf9-bc32-a459899c54df-ui-tls\") pod \"feast-simple-feast-setup-664fcfcc58-xbg6d\" (UID: \"e8839fc2-3372-4cf9-bc32-a459899c54df\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-xbg6d"
May 27 23:58:30.971592 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:58:30.971572    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/e8839fc2-3372-4cf9-bc32-a459899c54df-offline-tls\") pod \"feast-simple-feast-setup-664fcfcc58-xbg6d\" (UID: \"e8839fc2-3372-4cf9-bc32-a459899c54df\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-xbg6d"
May 27 23:58:30.977312 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:58:30.977288    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-h72sv\" (UniqueName: \"kubernetes.io/projected/e8839fc2-3372-4cf9-bc32-a459899c54df-kube-api-access-h72sv\") pod \"feast-simple-feast-setup-664fcfcc58-xbg6d\" (UID: \"e8839fc2-3372-4cf9-bc32-a459899c54df\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-xbg6d"
May 27 23:58:31.216639 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:58:31.216605    2557 generic.go:358] "Generic (PLEG): container finished" podID="feb775ce-5fcf-450c-af13-0a6a505bc273" containerID="e0f648ebb14fee0eae9c365e8f0d151691e9211849323d8255e9740d4e5ef317" exitCode=0
May 27 23:58:31.216639 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:58:31.216630    2557 generic.go:358] "Generic (PLEG): container finished" podID="feb775ce-5fcf-450c-af13-0a6a505bc273" containerID="ffd8ec76e18f238a906b91224051bc14ae05730a85961a4ff9cbc14e7a5ddc0b" exitCode=0
May 27 23:58:31.216830 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:58:31.216653    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-st4rs" event={"ID":"feb775ce-5fcf-450c-af13-0a6a505bc273","Type":"ContainerDied","Data":"e0f648ebb14fee0eae9c365e8f0d151691e9211849323d8255e9740d4e5ef317"}
May 27 23:58:31.216830 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:58:31.216678    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-st4rs" event={"ID":"feb775ce-5fcf-450c-af13-0a6a505bc273","Type":"ContainerDied","Data":"ffd8ec76e18f238a906b91224051bc14ae05730a85961a4ff9cbc14e7a5ddc0b"}
May 27 23:58:31.475512 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:58:31.475475    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/e8839fc2-3372-4cf9-bc32-a459899c54df-online-tls\") pod \"feast-simple-feast-setup-664fcfcc58-xbg6d\" (UID: \"e8839fc2-3372-4cf9-bc32-a459899c54df\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-xbg6d"
May 27 23:58:31.475512 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:58:31.475519    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/e8839fc2-3372-4cf9-bc32-a459899c54df-registry-tls\") pod \"feast-simple-feast-setup-664fcfcc58-xbg6d\" (UID: \"e8839fc2-3372-4cf9-bc32-a459899c54df\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-xbg6d"
May 27 23:58:31.477977 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:58:31.477951    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/e8839fc2-3372-4cf9-bc32-a459899c54df-registry-tls\") pod \"feast-simple-feast-setup-664fcfcc58-xbg6d\" (UID: \"e8839fc2-3372-4cf9-bc32-a459899c54df\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-xbg6d"
May 27 23:58:31.478063 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:58:31.478012    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/e8839fc2-3372-4cf9-bc32-a459899c54df-online-tls\") pod \"feast-simple-feast-setup-664fcfcc58-xbg6d\" (UID: \"e8839fc2-3372-4cf9-bc32-a459899c54df\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-xbg6d"
May 27 23:58:31.707545 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:58:31.707494    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-xbg6d"
May 27 23:58:31.836343 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:58:31.836153    2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-664fcfcc58-xbg6d"]
May 27 23:58:31.839025 ip-10-0-132-191 kubenswrapper[2557]: W0527 23:58:31.838998    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pode8839fc2_3372_4cf9_bc32_a459899c54df.slice/crio-6788f3d69c63b5d45c0ec175661202b7e69eae274c879ef2f4a0be184e07eedb WatchSource:0}: Error finding container 6788f3d69c63b5d45c0ec175661202b7e69eae274c879ef2f4a0be184e07eedb: Status 404 returned error can't find the container with id 6788f3d69c63b5d45c0ec175661202b7e69eae274c879ef2f4a0be184e07eedb
May 27 23:58:32.221281 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:58:32.221242    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-xbg6d" event={"ID":"e8839fc2-3372-4cf9-bc32-a459899c54df","Type":"ContainerStarted","Data":"97d41e826347d911cae7cfc5823dc120a79e68783c5f08cec5552aab5a3a5ff6"}
May 27 23:58:32.221281 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:58:32.221283    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-xbg6d" event={"ID":"e8839fc2-3372-4cf9-bc32-a459899c54df","Type":"ContainerStarted","Data":"6788f3d69c63b5d45c0ec175661202b7e69eae274c879ef2f4a0be184e07eedb"}
May 27 23:58:37.237078 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:58:37.237044    2557 generic.go:358] "Generic (PLEG): container finished" podID="e8839fc2-3372-4cf9-bc32-a459899c54df" containerID="97d41e826347d911cae7cfc5823dc120a79e68783c5f08cec5552aab5a3a5ff6" exitCode=0
May 27 23:58:37.237533 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:58:37.237122    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-xbg6d" event={"ID":"e8839fc2-3372-4cf9-bc32-a459899c54df","Type":"ContainerDied","Data":"97d41e826347d911cae7cfc5823dc120a79e68783c5f08cec5552aab5a3a5ff6"}
May 27 23:58:38.242018 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:58:38.241985    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-xbg6d" event={"ID":"e8839fc2-3372-4cf9-bc32-a459899c54df","Type":"ContainerStarted","Data":"246abb4a8408d65f221d39117ae908e798149de91af15a84a2b0331cfcd8c941"}
May 27 23:58:38.512605 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:58:38.512504    2557 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-st4rs" podUID="feb775ce-5fcf-450c-af13-0a6a505bc273" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.19:8443: connect: connection refused"
May 27 23:58:39.063983 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:58:39.063933    2557 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-st4rs" podUID="feb775ce-5fcf-450c-af13-0a6a505bc273" containerName="online" probeResult="failure" output="Get \"https://10.132.0.19:6567/health\": dial tcp 10.132.0.19:6567: connect: connection refused"
May 27 23:58:43.256460 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:58:43.256424    2557 generic.go:358] "Generic (PLEG): container finished" podID="e8839fc2-3372-4cf9-bc32-a459899c54df" containerID="246abb4a8408d65f221d39117ae908e798149de91af15a84a2b0331cfcd8c941" exitCode=0
May 27 23:58:43.256850 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:58:43.256496    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-xbg6d" event={"ID":"e8839fc2-3372-4cf9-bc32-a459899c54df","Type":"ContainerDied","Data":"246abb4a8408d65f221d39117ae908e798149de91af15a84a2b0331cfcd8c941"}
May 27 23:58:44.263148 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:58:44.263096    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-xbg6d" event={"ID":"e8839fc2-3372-4cf9-bc32-a459899c54df","Type":"ContainerStarted","Data":"dc920140ecad3965d31f6cda4befbfadd69fa4fadc7cc696f79173715272c4ef"}
May 27 23:58:44.263631 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:58:44.263167    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-xbg6d" event={"ID":"e8839fc2-3372-4cf9-bc32-a459899c54df","Type":"ContainerStarted","Data":"cf22c6927305f6e5d52fc2ed79e620002aa975a6906193383db4a7dcd3e038f0"}
May 27 23:58:44.263631 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:58:44.263185    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-xbg6d" event={"ID":"e8839fc2-3372-4cf9-bc32-a459899c54df","Type":"ContainerStarted","Data":"b8b2a811e08dcb7ad7ab4b2b52081a70eeb8b81be39c5f9c5cbf0b8302506801"}
May 27 23:58:44.263631 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:58:44.263202    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-xbg6d" event={"ID":"e8839fc2-3372-4cf9-bc32-a459899c54df","Type":"ContainerStarted","Data":"6ced0dfc02983b2cc8666841886b14f766eba1a9c4f14a48af998e04834146ee"}
May 27 23:58:44.296070 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:58:44.296006    2557 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-xbg6d" podStartSLOduration=14.295986109 podStartE2EDuration="14.295986109s" podCreationTimestamp="2026-05-27 23:58:30 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-27 23:58:44.294422637 +0000 UTC m=+1539.713958671" watchObservedRunningTime="2026-05-27 23:58:44.295986109 +0000 UTC m=+1539.715522122"
May 27 23:58:46.708012 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:58:46.707975    2557 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-xbg6d"
May 27 23:58:46.708507 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:58:46.708042    2557 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-xbg6d"
May 27 23:58:46.708507 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:58:46.708060    2557 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-xbg6d"
May 27 23:58:46.708904 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:58:46.708071    2557 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-xbg6d"
May 27 23:58:46.710173 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:58:46.710138    2557 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-xbg6d" podUID="e8839fc2-3372-4cf9-bc32-a459899c54df" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.20:8443: connect: connection refused"
May 27 23:58:46.710291 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:58:46.710163    2557 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-xbg6d" podUID="e8839fc2-3372-4cf9-bc32-a459899c54df" containerName="offline" probeResult="failure" output="dial tcp 10.132.0.20:8816: connect: connection refused"
May 27 23:58:46.710291 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:58:46.710221    2557 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-xbg6d" podUID="e8839fc2-3372-4cf9-bc32-a459899c54df" containerName="online" probeResult="failure" output="Get \"https://10.132.0.20:6567/health\": dial tcp 10.132.0.20:6567: connect: connection refused"
May 27 23:58:46.710437 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:58:46.710163    2557 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-xbg6d" podUID="e8839fc2-3372-4cf9-bc32-a459899c54df" containerName="registry" probeResult="failure" output="dial tcp 10.132.0.20:6571: connect: connection refused"
May 27 23:58:48.512143 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:58:48.512071    2557 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-st4rs" podUID="feb775ce-5fcf-450c-af13-0a6a505bc273" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.19:8443: connect: connection refused"
May 27 23:58:49.064285 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:58:49.064234    2557 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-st4rs" podUID="feb775ce-5fcf-450c-af13-0a6a505bc273" containerName="online" probeResult="failure" output="Get \"https://10.132.0.19:6567/health\": dial tcp 10.132.0.19:6567: connect: connection refused"
May 27 23:58:49.708382 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:58:49.708348    2557 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-xbg6d"
May 27 23:58:49.708832 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:58:49.708530    2557 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-xbg6d"
May 27 23:58:49.708897 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:58:49.708824    2557 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-xbg6d"
May 27 23:58:49.709166 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:58:49.709120    2557 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-xbg6d"
May 27 23:58:49.709348 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:58:49.709326    2557 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-xbg6d"
May 27 23:58:49.709453 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:58:49.709352    2557 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-xbg6d"
May 27 23:58:49.709453 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:58:49.709410    2557 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-xbg6d"
May 27 23:58:49.709555 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:58:49.709528    2557 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-xbg6d"
May 27 23:58:49.709642 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:58:49.709626    2557 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-xbg6d"
May 27 23:58:49.713258 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:58:49.713238    2557 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-xbg6d"
May 27 23:58:50.280744 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:58:50.280713    2557 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-xbg6d"
May 27 23:58:50.283639 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:58:50.283616    2557 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-xbg6d"
May 27 23:58:58.512193 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:58:58.512152    2557 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-st4rs" podUID="feb775ce-5fcf-450c-af13-0a6a505bc273" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.19:8443: connect: connection refused"
May 27 23:58:58.512655 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:58:58.512282    2557 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-st4rs"
May 27 23:58:59.064056 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:58:59.064005    2557 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-st4rs" podUID="feb775ce-5fcf-450c-af13-0a6a505bc273" containerName="online" probeResult="failure" output="Get \"https://10.132.0.19:6567/health\": dial tcp 10.132.0.19:6567: connect: connection refused"
May 27 23:58:59.064243 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:58:59.064171    2557 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-st4rs"
May 27 23:59:01.012659 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:59:01.012636    2557 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-st4rs"
May 27 23:59:01.111458 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:59:01.111431    2557 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/feb775ce-5fcf-450c-af13-0a6a505bc273-ui-tls\") pod \"feb775ce-5fcf-450c-af13-0a6a505bc273\" (UID: \"feb775ce-5fcf-450c-af13-0a6a505bc273\") "
May 27 23:59:01.111626 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:59:01.111479    2557 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/feb775ce-5fcf-450c-af13-0a6a505bc273-registry-tls\") pod \"feb775ce-5fcf-450c-af13-0a6a505bc273\" (UID: \"feb775ce-5fcf-450c-af13-0a6a505bc273\") "
May 27 23:59:01.111626 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:59:01.111501    2557 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/feb775ce-5fcf-450c-af13-0a6a505bc273-feast-data\") pod \"feb775ce-5fcf-450c-af13-0a6a505bc273\" (UID: \"feb775ce-5fcf-450c-af13-0a6a505bc273\") "
May 27 23:59:01.111626 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:59:01.111525    2557 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5q2xv\" (UniqueName: \"kubernetes.io/projected/feb775ce-5fcf-450c-af13-0a6a505bc273-kube-api-access-5q2xv\") pod \"feb775ce-5fcf-450c-af13-0a6a505bc273\" (UID: \"feb775ce-5fcf-450c-af13-0a6a505bc273\") "
May 27 23:59:01.111626 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:59:01.111561    2557 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/feb775ce-5fcf-450c-af13-0a6a505bc273-offline-tls\") pod \"feb775ce-5fcf-450c-af13-0a6a505bc273\" (UID: \"feb775ce-5fcf-450c-af13-0a6a505bc273\") "
May 27 23:59:01.111626 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:59:01.111595    2557 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/feb775ce-5fcf-450c-af13-0a6a505bc273-online-tls\") pod \"feb775ce-5fcf-450c-af13-0a6a505bc273\" (UID: \"feb775ce-5fcf-450c-af13-0a6a505bc273\") "
May 27 23:59:01.112140 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:59:01.112083    2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/feb775ce-5fcf-450c-af13-0a6a505bc273-feast-data" (OuterVolumeSpecName: "feast-data") pod "feb775ce-5fcf-450c-af13-0a6a505bc273" (UID: "feb775ce-5fcf-450c-af13-0a6a505bc273"). InnerVolumeSpecName "feast-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 27 23:59:01.113893 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:59:01.113865    2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/feb775ce-5fcf-450c-af13-0a6a505bc273-offline-tls" (OuterVolumeSpecName: "offline-tls") pod "feb775ce-5fcf-450c-af13-0a6a505bc273" (UID: "feb775ce-5fcf-450c-af13-0a6a505bc273"). InnerVolumeSpecName "offline-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 27 23:59:01.113994 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:59:01.113948    2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/feb775ce-5fcf-450c-af13-0a6a505bc273-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "feb775ce-5fcf-450c-af13-0a6a505bc273" (UID: "feb775ce-5fcf-450c-af13-0a6a505bc273"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 27 23:59:01.114037 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:59:01.113996    2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/feb775ce-5fcf-450c-af13-0a6a505bc273-online-tls" (OuterVolumeSpecName: "online-tls") pod "feb775ce-5fcf-450c-af13-0a6a505bc273" (UID: "feb775ce-5fcf-450c-af13-0a6a505bc273"). InnerVolumeSpecName "online-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 27 23:59:01.114037 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:59:01.114012    2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/feb775ce-5fcf-450c-af13-0a6a505bc273-ui-tls" (OuterVolumeSpecName: "ui-tls") pod "feb775ce-5fcf-450c-af13-0a6a505bc273" (UID: "feb775ce-5fcf-450c-af13-0a6a505bc273"). InnerVolumeSpecName "ui-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 27 23:59:01.114037 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:59:01.114012    2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/feb775ce-5fcf-450c-af13-0a6a505bc273-kube-api-access-5q2xv" (OuterVolumeSpecName: "kube-api-access-5q2xv") pod "feb775ce-5fcf-450c-af13-0a6a505bc273" (UID: "feb775ce-5fcf-450c-af13-0a6a505bc273"). InnerVolumeSpecName "kube-api-access-5q2xv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 27 23:59:01.212653 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:59:01.212634    2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5q2xv\" (UniqueName: \"kubernetes.io/projected/feb775ce-5fcf-450c-af13-0a6a505bc273-kube-api-access-5q2xv\") on node \"ip-10-0-132-191.ec2.internal\" DevicePath \"\""
May 27 23:59:01.212757 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:59:01.212655    2557 reconciler_common.go:299] "Volume detached for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/feb775ce-5fcf-450c-af13-0a6a505bc273-offline-tls\") on node \"ip-10-0-132-191.ec2.internal\" DevicePath \"\""
May 27 23:59:01.212757 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:59:01.212667    2557 reconciler_common.go:299] "Volume detached for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/feb775ce-5fcf-450c-af13-0a6a505bc273-online-tls\") on node \"ip-10-0-132-191.ec2.internal\" DevicePath \"\""
May 27 23:59:01.212757 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:59:01.212675    2557 reconciler_common.go:299] "Volume detached for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/feb775ce-5fcf-450c-af13-0a6a505bc273-ui-tls\") on node \"ip-10-0-132-191.ec2.internal\" DevicePath \"\""
May 27 23:59:01.212757 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:59:01.212683    2557 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/feb775ce-5fcf-450c-af13-0a6a505bc273-registry-tls\") on node \"ip-10-0-132-191.ec2.internal\" DevicePath \"\""
May 27 23:59:01.212757 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:59:01.212690    2557 reconciler_common.go:299] "Volume detached for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/feb775ce-5fcf-450c-af13-0a6a505bc273-feast-data\") on node \"ip-10-0-132-191.ec2.internal\" DevicePath \"\""
May 27 23:59:01.307970 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:59:01.307938    2557 generic.go:358] "Generic (PLEG): container finished" podID="feb775ce-5fcf-450c-af13-0a6a505bc273" containerID="23a273e49635c2e5a9480e4655f5331fb6054897bf34de2e364279a06aaba28b" exitCode=137
May 27 23:59:01.307970 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:59:01.307963    2557 generic.go:358] "Generic (PLEG): container finished" podID="feb775ce-5fcf-450c-af13-0a6a505bc273" containerID="c9f8ecdef0c15fd2c246b3a86eb1c028626caeffb97c0aedc5447668a34a780b" exitCode=137
May 27 23:59:01.308165 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:59:01.308005    2557 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-st4rs"
May 27 23:59:01.308165 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:59:01.308019    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-st4rs" event={"ID":"feb775ce-5fcf-450c-af13-0a6a505bc273","Type":"ContainerDied","Data":"23a273e49635c2e5a9480e4655f5331fb6054897bf34de2e364279a06aaba28b"}
May 27 23:59:01.308165 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:59:01.308062    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-st4rs" event={"ID":"feb775ce-5fcf-450c-af13-0a6a505bc273","Type":"ContainerDied","Data":"c9f8ecdef0c15fd2c246b3a86eb1c028626caeffb97c0aedc5447668a34a780b"}
May 27 23:59:01.308165 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:59:01.308073    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-st4rs" event={"ID":"feb775ce-5fcf-450c-af13-0a6a505bc273","Type":"ContainerDied","Data":"6db990e4a10288a6ac5e3ec40d5c4b2345057de0cf0715d71c3561edeef9ac43"}
May 27 23:59:01.308165 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:59:01.308087    2557 scope.go:117] "RemoveContainer" containerID="e0f648ebb14fee0eae9c365e8f0d151691e9211849323d8255e9740d4e5ef317"
May 27 23:59:01.316598 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:59:01.316579    2557 scope.go:117] "RemoveContainer" containerID="23a273e49635c2e5a9480e4655f5331fb6054897bf34de2e364279a06aaba28b"
May 27 23:59:01.325070 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:59:01.325052    2557 scope.go:117] "RemoveContainer" containerID="ffd8ec76e18f238a906b91224051bc14ae05730a85961a4ff9cbc14e7a5ddc0b"
May 27 23:59:01.329898 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:59:01.329876    2557 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-664fcfcc58-st4rs"]
May 27 23:59:01.332838 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:59:01.332824    2557 scope.go:117] "RemoveContainer" containerID="c9f8ecdef0c15fd2c246b3a86eb1c028626caeffb97c0aedc5447668a34a780b"
May 27 23:59:01.335601 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:59:01.335576    2557 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-664fcfcc58-st4rs"]
May 27 23:59:01.339639 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:59:01.339624    2557 scope.go:117] "RemoveContainer" containerID="0b6c615a316f6f7d445cacfc3e17b4f34532c119757ed9c869dc81a28efc7e2b"
May 27 23:59:01.345850 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:59:01.345834    2557 scope.go:117] "RemoveContainer" containerID="dc9ece941c1382f4b147e7679030b1c9392546a79d7b9bfd5582f2f1cd7084f8"
May 27 23:59:01.351826 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:59:01.351810    2557 scope.go:117] "RemoveContainer" containerID="e0f648ebb14fee0eae9c365e8f0d151691e9211849323d8255e9740d4e5ef317"
May 27 23:59:01.352081 ip-10-0-132-191 kubenswrapper[2557]: E0527 23:59:01.352063    2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e0f648ebb14fee0eae9c365e8f0d151691e9211849323d8255e9740d4e5ef317\": container with ID starting with e0f648ebb14fee0eae9c365e8f0d151691e9211849323d8255e9740d4e5ef317 not found: ID does not exist" containerID="e0f648ebb14fee0eae9c365e8f0d151691e9211849323d8255e9740d4e5ef317"
May 27 23:59:01.352147 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:59:01.352090    2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e0f648ebb14fee0eae9c365e8f0d151691e9211849323d8255e9740d4e5ef317"} err="failed to get container status \"e0f648ebb14fee0eae9c365e8f0d151691e9211849323d8255e9740d4e5ef317\": rpc error: code = NotFound desc = could not find container \"e0f648ebb14fee0eae9c365e8f0d151691e9211849323d8255e9740d4e5ef317\": container with ID starting with e0f648ebb14fee0eae9c365e8f0d151691e9211849323d8255e9740d4e5ef317 not found: ID does not exist"
May 27 23:59:01.352147 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:59:01.352108    2557 scope.go:117] "RemoveContainer" containerID="23a273e49635c2e5a9480e4655f5331fb6054897bf34de2e364279a06aaba28b"
May 27 23:59:01.352352 ip-10-0-132-191 kubenswrapper[2557]: E0527 23:59:01.352336    2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"23a273e49635c2e5a9480e4655f5331fb6054897bf34de2e364279a06aaba28b\": container with ID starting with 23a273e49635c2e5a9480e4655f5331fb6054897bf34de2e364279a06aaba28b not found: ID does not exist" containerID="23a273e49635c2e5a9480e4655f5331fb6054897bf34de2e364279a06aaba28b"
May 27 23:59:01.352391 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:59:01.352358    2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"23a273e49635c2e5a9480e4655f5331fb6054897bf34de2e364279a06aaba28b"} err="failed to get container status \"23a273e49635c2e5a9480e4655f5331fb6054897bf34de2e364279a06aaba28b\": rpc error: code = NotFound desc = could not find container \"23a273e49635c2e5a9480e4655f5331fb6054897bf34de2e364279a06aaba28b\": container with ID starting with 23a273e49635c2e5a9480e4655f5331fb6054897bf34de2e364279a06aaba28b not found: ID does not exist"
May 27 23:59:01.352391 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:59:01.352374    2557 scope.go:117] "RemoveContainer" containerID="ffd8ec76e18f238a906b91224051bc14ae05730a85961a4ff9cbc14e7a5ddc0b"
May 27 23:59:01.352605 ip-10-0-132-191 kubenswrapper[2557]: E0527 23:59:01.352590    2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ffd8ec76e18f238a906b91224051bc14ae05730a85961a4ff9cbc14e7a5ddc0b\": container with ID starting with ffd8ec76e18f238a906b91224051bc14ae05730a85961a4ff9cbc14e7a5ddc0b not found: ID does not exist" containerID="ffd8ec76e18f238a906b91224051bc14ae05730a85961a4ff9cbc14e7a5ddc0b"
May 27 23:59:01.352653 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:59:01.352610    2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ffd8ec76e18f238a906b91224051bc14ae05730a85961a4ff9cbc14e7a5ddc0b"} err="failed to get container status \"ffd8ec76e18f238a906b91224051bc14ae05730a85961a4ff9cbc14e7a5ddc0b\": rpc error: code = NotFound desc = could not find container \"ffd8ec76e18f238a906b91224051bc14ae05730a85961a4ff9cbc14e7a5ddc0b\": container with ID starting with ffd8ec76e18f238a906b91224051bc14ae05730a85961a4ff9cbc14e7a5ddc0b not found: ID does not exist"
May 27 23:59:01.352653 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:59:01.352625    2557 scope.go:117] "RemoveContainer" containerID="c9f8ecdef0c15fd2c246b3a86eb1c028626caeffb97c0aedc5447668a34a780b"
May 27 23:59:01.352846 ip-10-0-132-191 kubenswrapper[2557]: E0527 23:59:01.352830    2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c9f8ecdef0c15fd2c246b3a86eb1c028626caeffb97c0aedc5447668a34a780b\": container with ID starting with c9f8ecdef0c15fd2c246b3a86eb1c028626caeffb97c0aedc5447668a34a780b not found: ID does not exist" containerID="c9f8ecdef0c15fd2c246b3a86eb1c028626caeffb97c0aedc5447668a34a780b"
May 27 23:59:01.352883 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:59:01.352853    2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c9f8ecdef0c15fd2c246b3a86eb1c028626caeffb97c0aedc5447668a34a780b"} err="failed to get container status \"c9f8ecdef0c15fd2c246b3a86eb1c028626caeffb97c0aedc5447668a34a780b\": rpc error: code = NotFound desc = could not find container \"c9f8ecdef0c15fd2c246b3a86eb1c028626caeffb97c0aedc5447668a34a780b\": container with ID starting with c9f8ecdef0c15fd2c246b3a86eb1c028626caeffb97c0aedc5447668a34a780b not found: ID does not exist"
May 27 23:59:01.352883 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:59:01.352870    2557 scope.go:117] "RemoveContainer" containerID="0b6c615a316f6f7d445cacfc3e17b4f34532c119757ed9c869dc81a28efc7e2b"
May 27 23:59:01.353076 ip-10-0-132-191 kubenswrapper[2557]: E0527 23:59:01.353060    2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0b6c615a316f6f7d445cacfc3e17b4f34532c119757ed9c869dc81a28efc7e2b\": container with ID starting with 0b6c615a316f6f7d445cacfc3e17b4f34532c119757ed9c869dc81a28efc7e2b not found: ID does not exist" containerID="0b6c615a316f6f7d445cacfc3e17b4f34532c119757ed9c869dc81a28efc7e2b"
May 27 23:59:01.353111 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:59:01.353083    2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0b6c615a316f6f7d445cacfc3e17b4f34532c119757ed9c869dc81a28efc7e2b"} err="failed to get container status \"0b6c615a316f6f7d445cacfc3e17b4f34532c119757ed9c869dc81a28efc7e2b\": rpc error: code = NotFound desc = could not find container \"0b6c615a316f6f7d445cacfc3e17b4f34532c119757ed9c869dc81a28efc7e2b\": container with ID starting with 0b6c615a316f6f7d445cacfc3e17b4f34532c119757ed9c869dc81a28efc7e2b not found: ID does not exist"
May 27 23:59:01.353111 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:59:01.353095    2557 scope.go:117] "RemoveContainer" containerID="dc9ece941c1382f4b147e7679030b1c9392546a79d7b9bfd5582f2f1cd7084f8"
May 27 23:59:01.353338 ip-10-0-132-191 kubenswrapper[2557]: E0527 23:59:01.353321    2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"dc9ece941c1382f4b147e7679030b1c9392546a79d7b9bfd5582f2f1cd7084f8\": container with ID starting with dc9ece941c1382f4b147e7679030b1c9392546a79d7b9bfd5582f2f1cd7084f8 not found: ID does not exist" containerID="dc9ece941c1382f4b147e7679030b1c9392546a79d7b9bfd5582f2f1cd7084f8"
May 27 23:59:01.353396 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:59:01.353344    2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dc9ece941c1382f4b147e7679030b1c9392546a79d7b9bfd5582f2f1cd7084f8"} err="failed to get container status \"dc9ece941c1382f4b147e7679030b1c9392546a79d7b9bfd5582f2f1cd7084f8\": rpc error: code = NotFound desc = could not find container \"dc9ece941c1382f4b147e7679030b1c9392546a79d7b9bfd5582f2f1cd7084f8\": container with ID starting with dc9ece941c1382f4b147e7679030b1c9392546a79d7b9bfd5582f2f1cd7084f8 not found: ID does not exist"
May 27 23:59:01.353396 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:59:01.353357    2557 scope.go:117] "RemoveContainer" containerID="e0f648ebb14fee0eae9c365e8f0d151691e9211849323d8255e9740d4e5ef317"
May 27 23:59:01.353575 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:59:01.353556    2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e0f648ebb14fee0eae9c365e8f0d151691e9211849323d8255e9740d4e5ef317"} err="failed to get container status \"e0f648ebb14fee0eae9c365e8f0d151691e9211849323d8255e9740d4e5ef317\": rpc error: code = NotFound desc = could not find container \"e0f648ebb14fee0eae9c365e8f0d151691e9211849323d8255e9740d4e5ef317\": container with ID starting with e0f648ebb14fee0eae9c365e8f0d151691e9211849323d8255e9740d4e5ef317 not found: ID does not exist"
May 27 23:59:01.353630 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:59:01.353577    2557 scope.go:117] "RemoveContainer" containerID="23a273e49635c2e5a9480e4655f5331fb6054897bf34de2e364279a06aaba28b"
May 27 23:59:01.353790 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:59:01.353770    2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"23a273e49635c2e5a9480e4655f5331fb6054897bf34de2e364279a06aaba28b"} err="failed to get container status \"23a273e49635c2e5a9480e4655f5331fb6054897bf34de2e364279a06aaba28b\": rpc error: code = NotFound desc = could not find container \"23a273e49635c2e5a9480e4655f5331fb6054897bf34de2e364279a06aaba28b\": container with ID starting with 23a273e49635c2e5a9480e4655f5331fb6054897bf34de2e364279a06aaba28b not found: ID does not exist"
May 27 23:59:01.353865 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:59:01.353791    2557 scope.go:117] "RemoveContainer" containerID="ffd8ec76e18f238a906b91224051bc14ae05730a85961a4ff9cbc14e7a5ddc0b"
May 27 23:59:01.354016 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:59:01.353999    2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ffd8ec76e18f238a906b91224051bc14ae05730a85961a4ff9cbc14e7a5ddc0b"} err="failed to get container status \"ffd8ec76e18f238a906b91224051bc14ae05730a85961a4ff9cbc14e7a5ddc0b\": rpc error: code = NotFound desc = could not find container \"ffd8ec76e18f238a906b91224051bc14ae05730a85961a4ff9cbc14e7a5ddc0b\": container with ID starting with ffd8ec76e18f238a906b91224051bc14ae05730a85961a4ff9cbc14e7a5ddc0b not found: ID does not exist"
May 27 23:59:01.354064 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:59:01.354016    2557 scope.go:117] "RemoveContainer" containerID="c9f8ecdef0c15fd2c246b3a86eb1c028626caeffb97c0aedc5447668a34a780b"
May 27 23:59:01.354243 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:59:01.354226    2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c9f8ecdef0c15fd2c246b3a86eb1c028626caeffb97c0aedc5447668a34a780b"} err="failed to get container status \"c9f8ecdef0c15fd2c246b3a86eb1c028626caeffb97c0aedc5447668a34a780b\": rpc error: code = NotFound desc = could not find container \"c9f8ecdef0c15fd2c246b3a86eb1c028626caeffb97c0aedc5447668a34a780b\": container with ID starting with c9f8ecdef0c15fd2c246b3a86eb1c028626caeffb97c0aedc5447668a34a780b not found: ID does not exist"
May 27 23:59:01.354293 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:59:01.354244    2557 scope.go:117] "RemoveContainer" containerID="0b6c615a316f6f7d445cacfc3e17b4f34532c119757ed9c869dc81a28efc7e2b"
May 27 23:59:01.354466 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:59:01.354445    2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0b6c615a316f6f7d445cacfc3e17b4f34532c119757ed9c869dc81a28efc7e2b"} err="failed to get container status \"0b6c615a316f6f7d445cacfc3e17b4f34532c119757ed9c869dc81a28efc7e2b\": rpc error: code = NotFound desc = could not find container \"0b6c615a316f6f7d445cacfc3e17b4f34532c119757ed9c869dc81a28efc7e2b\": container with ID starting with 0b6c615a316f6f7d445cacfc3e17b4f34532c119757ed9c869dc81a28efc7e2b not found: ID does not exist"
May 27 23:59:01.354466 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:59:01.354464    2557 scope.go:117] "RemoveContainer" containerID="dc9ece941c1382f4b147e7679030b1c9392546a79d7b9bfd5582f2f1cd7084f8"
May 27 23:59:01.354648 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:59:01.354632    2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dc9ece941c1382f4b147e7679030b1c9392546a79d7b9bfd5582f2f1cd7084f8"} err="failed to get container status \"dc9ece941c1382f4b147e7679030b1c9392546a79d7b9bfd5582f2f1cd7084f8\": rpc error: code = NotFound desc = could not find container \"dc9ece941c1382f4b147e7679030b1c9392546a79d7b9bfd5582f2f1cd7084f8\": container with ID starting with dc9ece941c1382f4b147e7679030b1c9392546a79d7b9bfd5582f2f1cd7084f8 not found: ID does not exist"
May 27 23:59:03.202090 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:59:03.202056    2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="feb775ce-5fcf-450c-af13-0a6a505bc273" path="/var/lib/kubelet/pods/feb775ce-5fcf-450c-af13-0a6a505bc273/volumes"
May 27 23:59:52.133470 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:59:52.133437    2557 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-4jg55"]
May 27 23:59:52.133874 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:59:52.133689    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="feb775ce-5fcf-450c-af13-0a6a505bc273" containerName="registry"
May 27 23:59:52.133874 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:59:52.133704    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="feb775ce-5fcf-450c-af13-0a6a505bc273" containerName="registry"
May 27 23:59:52.133874 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:59:52.133712    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="feb775ce-5fcf-450c-af13-0a6a505bc273" containerName="ui"
May 27 23:59:52.133874 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:59:52.133718    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="feb775ce-5fcf-450c-af13-0a6a505bc273" containerName="ui"
May 27 23:59:52.133874 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:59:52.133729    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="feb775ce-5fcf-450c-af13-0a6a505bc273" containerName="feast-init"
May 27 23:59:52.133874 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:59:52.133734    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="feb775ce-5fcf-450c-af13-0a6a505bc273" containerName="feast-init"
May 27 23:59:52.133874 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:59:52.133742    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="feb775ce-5fcf-450c-af13-0a6a505bc273" containerName="offline"
May 27 23:59:52.133874 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:59:52.133747    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="feb775ce-5fcf-450c-af13-0a6a505bc273" containerName="offline"
May 27 23:59:52.133874 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:59:52.133755    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="feb775ce-5fcf-450c-af13-0a6a505bc273" containerName="feast-apply"
May 27 23:59:52.133874 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:59:52.133761    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="feb775ce-5fcf-450c-af13-0a6a505bc273" containerName="feast-apply"
May 27 23:59:52.133874 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:59:52.133777    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="feb775ce-5fcf-450c-af13-0a6a505bc273" containerName="online"
May 27 23:59:52.133874 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:59:52.133783    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="feb775ce-5fcf-450c-af13-0a6a505bc273" containerName="online"
May 27 23:59:52.133874 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:59:52.133829    2557 memory_manager.go:356] "RemoveStaleState removing state" podUID="feb775ce-5fcf-450c-af13-0a6a505bc273" containerName="registry"
May 27 23:59:52.133874 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:59:52.133838    2557 memory_manager.go:356] "RemoveStaleState removing state" podUID="feb775ce-5fcf-450c-af13-0a6a505bc273" containerName="online"
May 27 23:59:52.133874 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:59:52.133847    2557 memory_manager.go:356] "RemoveStaleState removing state" podUID="feb775ce-5fcf-450c-af13-0a6a505bc273" containerName="offline"
May 27 23:59:52.133874 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:59:52.133857    2557 memory_manager.go:356] "RemoveStaleState removing state" podUID="feb775ce-5fcf-450c-af13-0a6a505bc273" containerName="ui"
May 27 23:59:52.136911 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:59:52.136892    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-4jg55"
May 27 23:59:52.140017 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:59:52.139990    2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-client-ca\""
May 27 23:59:52.140017 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:59:52.140010    2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-remote-registry\"/\"kube-root-ca.crt\""
May 27 23:59:52.140211 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:59:52.140021    2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-remote-registry\"/\"openshift-service-ca.crt\""
May 27 23:59:52.140211 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:59:52.140042    2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-dockercfg-wsczw\""
May 27 23:59:52.140211 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:59:52.140043    2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-offline-tls\""
May 27 23:59:52.140211 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:59:52.140051    2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-online-tls\""
May 27 23:59:52.140431 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:59:52.140301    2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-ui-tls\""
May 27 23:59:52.150033 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:59:52.150013    2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-4jg55"]
May 27 23:59:52.255296 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:59:52.255264    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/7b9ccd54-a8a2-4773-bda5-d386a6c14513-online-tls\") pod \"feast-simple-feast-remote-setup-5cff94746b-4jg55\" (UID: \"7b9ccd54-a8a2-4773-bda5-d386a6c14513\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-4jg55"
May 27 23:59:52.255296 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:59:52.255294    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/7b9ccd54-a8a2-4773-bda5-d386a6c14513-ui-tls\") pod \"feast-simple-feast-remote-setup-5cff94746b-4jg55\" (UID: \"7b9ccd54-a8a2-4773-bda5-d386a6c14513\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-4jg55"
May 27 23:59:52.255498 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:59:52.255324    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/configmap/7b9ccd54-a8a2-4773-bda5-d386a6c14513-registry-tls\") pod \"feast-simple-feast-remote-setup-5cff94746b-4jg55\" (UID: \"7b9ccd54-a8a2-4773-bda5-d386a6c14513\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-4jg55"
May 27 23:59:52.255498 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:59:52.255406    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/7b9ccd54-a8a2-4773-bda5-d386a6c14513-offline-tls\") pod \"feast-simple-feast-remote-setup-5cff94746b-4jg55\" (UID: \"7b9ccd54-a8a2-4773-bda5-d386a6c14513\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-4jg55"
May 27 23:59:52.255498 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:59:52.255431    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/7b9ccd54-a8a2-4773-bda5-d386a6c14513-feast-data\") pod \"feast-simple-feast-remote-setup-5cff94746b-4jg55\" (UID: \"7b9ccd54-a8a2-4773-bda5-d386a6c14513\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-4jg55"
May 27 23:59:52.255498 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:59:52.255463    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qfttc\" (UniqueName: \"kubernetes.io/projected/7b9ccd54-a8a2-4773-bda5-d386a6c14513-kube-api-access-qfttc\") pod \"feast-simple-feast-remote-setup-5cff94746b-4jg55\" (UID: \"7b9ccd54-a8a2-4773-bda5-d386a6c14513\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-4jg55"
May 27 23:59:52.356253 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:59:52.356215    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/7b9ccd54-a8a2-4773-bda5-d386a6c14513-offline-tls\") pod \"feast-simple-feast-remote-setup-5cff94746b-4jg55\" (UID: \"7b9ccd54-a8a2-4773-bda5-d386a6c14513\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-4jg55"
May 27 23:59:52.356253 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:59:52.356255    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/7b9ccd54-a8a2-4773-bda5-d386a6c14513-feast-data\") pod \"feast-simple-feast-remote-setup-5cff94746b-4jg55\" (UID: \"7b9ccd54-a8a2-4773-bda5-d386a6c14513\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-4jg55"
May 27 23:59:52.356471 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:59:52.356293    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-qfttc\" (UniqueName: \"kubernetes.io/projected/7b9ccd54-a8a2-4773-bda5-d386a6c14513-kube-api-access-qfttc\") pod \"feast-simple-feast-remote-setup-5cff94746b-4jg55\" (UID: \"7b9ccd54-a8a2-4773-bda5-d386a6c14513\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-4jg55"
May 27 23:59:52.356471 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:59:52.356326    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/7b9ccd54-a8a2-4773-bda5-d386a6c14513-online-tls\") pod \"feast-simple-feast-remote-setup-5cff94746b-4jg55\" (UID: \"7b9ccd54-a8a2-4773-bda5-d386a6c14513\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-4jg55"
May 27 23:59:52.356471 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:59:52.356351    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/7b9ccd54-a8a2-4773-bda5-d386a6c14513-ui-tls\") pod \"feast-simple-feast-remote-setup-5cff94746b-4jg55\" (UID: \"7b9ccd54-a8a2-4773-bda5-d386a6c14513\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-4jg55"
May 27 23:59:52.356471 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:59:52.356392    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/configmap/7b9ccd54-a8a2-4773-bda5-d386a6c14513-registry-tls\") pod \"feast-simple-feast-remote-setup-5cff94746b-4jg55\" (UID: \"7b9ccd54-a8a2-4773-bda5-d386a6c14513\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-4jg55"
May 27 23:59:52.356471 ip-10-0-132-191 kubenswrapper[2557]: E0527 23:59:52.356449    2557 secret.go:189] Couldn't get secret test-ns-remote-registry/feast-simple-feast-remote-setup-online-tls: secret "feast-simple-feast-remote-setup-online-tls" not found
May 27 23:59:52.356701 ip-10-0-132-191 kubenswrapper[2557]: E0527 23:59:52.356526    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7b9ccd54-a8a2-4773-bda5-d386a6c14513-online-tls podName:7b9ccd54-a8a2-4773-bda5-d386a6c14513 nodeName:}" failed. No retries permitted until 2026-05-27 23:59:52.856503253 +0000 UTC m=+1608.276039263 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "online-tls" (UniqueName: "kubernetes.io/secret/7b9ccd54-a8a2-4773-bda5-d386a6c14513-online-tls") pod "feast-simple-feast-remote-setup-5cff94746b-4jg55" (UID: "7b9ccd54-a8a2-4773-bda5-d386a6c14513") : secret "feast-simple-feast-remote-setup-online-tls" not found
May 27 23:59:52.356810 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:59:52.356785    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/7b9ccd54-a8a2-4773-bda5-d386a6c14513-feast-data\") pod \"feast-simple-feast-remote-setup-5cff94746b-4jg55\" (UID: \"7b9ccd54-a8a2-4773-bda5-d386a6c14513\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-4jg55"
May 27 23:59:52.357065 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:59:52.357041    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/configmap/7b9ccd54-a8a2-4773-bda5-d386a6c14513-registry-tls\") pod \"feast-simple-feast-remote-setup-5cff94746b-4jg55\" (UID: \"7b9ccd54-a8a2-4773-bda5-d386a6c14513\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-4jg55"
May 27 23:59:52.358786 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:59:52.358765    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/7b9ccd54-a8a2-4773-bda5-d386a6c14513-ui-tls\") pod \"feast-simple-feast-remote-setup-5cff94746b-4jg55\" (UID: \"7b9ccd54-a8a2-4773-bda5-d386a6c14513\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-4jg55"
May 27 23:59:52.358874 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:59:52.358832    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/7b9ccd54-a8a2-4773-bda5-d386a6c14513-offline-tls\") pod \"feast-simple-feast-remote-setup-5cff94746b-4jg55\" (UID: \"7b9ccd54-a8a2-4773-bda5-d386a6c14513\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-4jg55"
May 27 23:59:52.367964 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:59:52.367939    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qfttc\" (UniqueName: \"kubernetes.io/projected/7b9ccd54-a8a2-4773-bda5-d386a6c14513-kube-api-access-qfttc\") pod \"feast-simple-feast-remote-setup-5cff94746b-4jg55\" (UID: \"7b9ccd54-a8a2-4773-bda5-d386a6c14513\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-4jg55"
May 27 23:59:52.860770 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:59:52.860737    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/7b9ccd54-a8a2-4773-bda5-d386a6c14513-online-tls\") pod \"feast-simple-feast-remote-setup-5cff94746b-4jg55\" (UID: \"7b9ccd54-a8a2-4773-bda5-d386a6c14513\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-4jg55"
May 27 23:59:52.860936 ip-10-0-132-191 kubenswrapper[2557]: E0527 23:59:52.860872    2557 secret.go:189] Couldn't get secret test-ns-remote-registry/feast-simple-feast-remote-setup-online-tls: secret "feast-simple-feast-remote-setup-online-tls" not found
May 27 23:59:52.860936 ip-10-0-132-191 kubenswrapper[2557]: E0527 23:59:52.860932    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7b9ccd54-a8a2-4773-bda5-d386a6c14513-online-tls podName:7b9ccd54-a8a2-4773-bda5-d386a6c14513 nodeName:}" failed. No retries permitted until 2026-05-27 23:59:53.860917453 +0000 UTC m=+1609.280453444 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "online-tls" (UniqueName: "kubernetes.io/secret/7b9ccd54-a8a2-4773-bda5-d386a6c14513-online-tls") pod "feast-simple-feast-remote-setup-5cff94746b-4jg55" (UID: "7b9ccd54-a8a2-4773-bda5-d386a6c14513") : secret "feast-simple-feast-remote-setup-online-tls" not found
May 27 23:59:53.869233 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:59:53.869202    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/7b9ccd54-a8a2-4773-bda5-d386a6c14513-online-tls\") pod \"feast-simple-feast-remote-setup-5cff94746b-4jg55\" (UID: \"7b9ccd54-a8a2-4773-bda5-d386a6c14513\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-4jg55"
May 27 23:59:53.871622 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:59:53.871599    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/7b9ccd54-a8a2-4773-bda5-d386a6c14513-online-tls\") pod \"feast-simple-feast-remote-setup-5cff94746b-4jg55\" (UID: \"7b9ccd54-a8a2-4773-bda5-d386a6c14513\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-4jg55"
May 27 23:59:53.946005 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:59:53.945973    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-4jg55"
May 27 23:59:54.076397 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:59:54.076369    2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-4jg55"]
May 27 23:59:54.078210 ip-10-0-132-191 kubenswrapper[2557]: W0527 23:59:54.078177    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod7b9ccd54_a8a2_4773_bda5_d386a6c14513.slice/crio-2c440539bd17bdaea88f9c44896d5aa585387f709190523b97975e7f37d081e7 WatchSource:0}: Error finding container 2c440539bd17bdaea88f9c44896d5aa585387f709190523b97975e7f37d081e7: Status 404 returned error can't find the container with id 2c440539bd17bdaea88f9c44896d5aa585387f709190523b97975e7f37d081e7
May 27 23:59:54.443153 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:59:54.443040    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-4jg55" event={"ID":"7b9ccd54-a8a2-4773-bda5-d386a6c14513","Type":"ContainerStarted","Data":"b0a5989c2de0f283536ff5c27af55614026b24b81a21b2953931282cc114373f"}
May 27 23:59:54.443153 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:59:54.443081    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-4jg55" event={"ID":"7b9ccd54-a8a2-4773-bda5-d386a6c14513","Type":"ContainerStarted","Data":"2c440539bd17bdaea88f9c44896d5aa585387f709190523b97975e7f37d081e7"}
May 27 23:59:59.457211 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:59:59.457176    2557 generic.go:358] "Generic (PLEG): container finished" podID="7b9ccd54-a8a2-4773-bda5-d386a6c14513" containerID="b0a5989c2de0f283536ff5c27af55614026b24b81a21b2953931282cc114373f" exitCode=0
May 27 23:59:59.457581 ip-10-0-132-191 kubenswrapper[2557]: I0527 23:59:59.457217    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-4jg55" event={"ID":"7b9ccd54-a8a2-4773-bda5-d386a6c14513","Type":"ContainerDied","Data":"b0a5989c2de0f283536ff5c27af55614026b24b81a21b2953931282cc114373f"}
May 28 00:00:00.461435 ip-10-0-132-191 kubenswrapper[2557]: I0528 00:00:00.461403    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-4jg55" event={"ID":"7b9ccd54-a8a2-4773-bda5-d386a6c14513","Type":"ContainerStarted","Data":"3eb4483fa474f86cf23b2d4621f88c5be1511dd7b0ed13626b222a23c93a0d0b"}
May 28 00:00:05.476848 ip-10-0-132-191 kubenswrapper[2557]: I0528 00:00:05.476810    2557 generic.go:358] "Generic (PLEG): container finished" podID="7b9ccd54-a8a2-4773-bda5-d386a6c14513" containerID="3eb4483fa474f86cf23b2d4621f88c5be1511dd7b0ed13626b222a23c93a0d0b" exitCode=0
May 28 00:00:05.477265 ip-10-0-132-191 kubenswrapper[2557]: I0528 00:00:05.476875    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-4jg55" event={"ID":"7b9ccd54-a8a2-4773-bda5-d386a6c14513","Type":"ContainerDied","Data":"3eb4483fa474f86cf23b2d4621f88c5be1511dd7b0ed13626b222a23c93a0d0b"}
May 28 00:00:06.483378 ip-10-0-132-191 kubenswrapper[2557]: I0528 00:00:06.483336    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-4jg55" event={"ID":"7b9ccd54-a8a2-4773-bda5-d386a6c14513","Type":"ContainerStarted","Data":"682d8b2beea148c5b8bea909ec52e545a07b3bc076b1422aa60ee90ed6061c38"}
May 28 00:00:06.483378 ip-10-0-132-191 kubenswrapper[2557]: I0528 00:00:06.483380    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-4jg55" event={"ID":"7b9ccd54-a8a2-4773-bda5-d386a6c14513","Type":"ContainerStarted","Data":"a69d1a2b910248e2b98be89a7308784076e4dbffc038adca7d74f60dbca63b6d"}
May 28 00:00:06.483378 ip-10-0-132-191 kubenswrapper[2557]: I0528 00:00:06.483389    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-4jg55" event={"ID":"7b9ccd54-a8a2-4773-bda5-d386a6c14513","Type":"ContainerStarted","Data":"1ee065d28983b46630a6052941a5152999a1fe00e62cc69f4c304337fb2a3677"}
May 28 00:00:06.515525 ip-10-0-132-191 kubenswrapper[2557]: I0528 00:00:06.515478    2557 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-4jg55" podStartSLOduration=14.515458321 podStartE2EDuration="14.515458321s" podCreationTimestamp="2026-05-27 23:59:52 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-28 00:00:06.512901942 +0000 UTC m=+1621.932437955" watchObservedRunningTime="2026-05-28 00:00:06.515458321 +0000 UTC m=+1621.934994334"
May 28 00:00:08.946624 ip-10-0-132-191 kubenswrapper[2557]: I0528 00:00:08.946576    2557 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-4jg55"
May 28 00:00:08.946624 ip-10-0-132-191 kubenswrapper[2557]: I0528 00:00:08.946626    2557 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-4jg55"
May 28 00:00:08.947193 ip-10-0-132-191 kubenswrapper[2557]: I0528 00:00:08.946642    2557 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-4jg55"
May 28 00:00:08.948609 ip-10-0-132-191 kubenswrapper[2557]: I0528 00:00:08.948574    2557 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-4jg55" podUID="7b9ccd54-a8a2-4773-bda5-d386a6c14513" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.21:8443: connect: connection refused"
May 28 00:00:08.948852 ip-10-0-132-191 kubenswrapper[2557]: I0528 00:00:08.948582    2557 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-4jg55" podUID="7b9ccd54-a8a2-4773-bda5-d386a6c14513" containerName="offline" probeResult="failure" output="dial tcp 10.132.0.21:8816: connect: connection refused"
May 28 00:00:08.948945 ip-10-0-132-191 kubenswrapper[2557]: I0528 00:00:08.948604    2557 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-4jg55" podUID="7b9ccd54-a8a2-4773-bda5-d386a6c14513" containerName="online" probeResult="failure" output="Get \"https://10.132.0.21:6567/health\": dial tcp 10.132.0.21:6567: connect: connection refused"
May 28 00:00:11.947804 ip-10-0-132-191 kubenswrapper[2557]: I0528 00:00:11.947769    2557 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-4jg55"
May 28 00:00:11.948316 ip-10-0-132-191 kubenswrapper[2557]: I0528 00:00:11.948030    2557 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-4jg55"
May 28 00:00:11.948417 ip-10-0-132-191 kubenswrapper[2557]: I0528 00:00:11.948396    2557 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-4jg55"
May 28 00:00:11.948530 ip-10-0-132-191 kubenswrapper[2557]: I0528 00:00:11.948429    2557 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-4jg55"
May 28 00:00:11.948681 ip-10-0-132-191 kubenswrapper[2557]: I0528 00:00:11.948665    2557 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-4jg55"
May 28 00:00:11.948737 ip-10-0-132-191 kubenswrapper[2557]: I0528 00:00:11.948716    2557 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-4jg55"
May 28 00:00:11.952033 ip-10-0-132-191 kubenswrapper[2557]: I0528 00:00:11.952013    2557 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-4jg55"
May 28 00:00:12.502577 ip-10-0-132-191 kubenswrapper[2557]: I0528 00:00:12.502547    2557 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-4jg55"
May 28 00:00:12.505690 ip-10-0-132-191 kubenswrapper[2557]: I0528 00:00:12.505668    2557 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-4jg55"
May 28 00:01:15.125560 ip-10-0-132-191 kubenswrapper[2557]: I0528 00:01:15.125516    2557 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-4jg55"]
May 28 00:01:15.126106 ip-10-0-132-191 kubenswrapper[2557]: I0528 00:01:15.125833    2557 kuberuntime_container.go:864] "Killing container with a grace period" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-4jg55" podUID="7b9ccd54-a8a2-4773-bda5-d386a6c14513" containerName="online" containerID="cri-o://1ee065d28983b46630a6052941a5152999a1fe00e62cc69f4c304337fb2a3677" gracePeriod=30
May 28 00:01:15.126106 ip-10-0-132-191 kubenswrapper[2557]: I0528 00:01:15.125896    2557 kuberuntime_container.go:864] "Killing container with a grace period" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-4jg55" podUID="7b9ccd54-a8a2-4773-bda5-d386a6c14513" containerName="ui" containerID="cri-o://682d8b2beea148c5b8bea909ec52e545a07b3bc076b1422aa60ee90ed6061c38" gracePeriod=30
May 28 00:01:15.126106 ip-10-0-132-191 kubenswrapper[2557]: I0528 00:01:15.125901    2557 kuberuntime_container.go:864] "Killing container with a grace period" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-4jg55" podUID="7b9ccd54-a8a2-4773-bda5-d386a6c14513" containerName="offline" containerID="cri-o://a69d1a2b910248e2b98be89a7308784076e4dbffc038adca7d74f60dbca63b6d" gracePeriod=30
May 28 00:01:15.272409 ip-10-0-132-191 kubenswrapper[2557]: I0528 00:01:15.272373    2557 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-664fcfcc58-xbg6d"]
May 28 00:01:15.273059 ip-10-0-132-191 kubenswrapper[2557]: I0528 00:01:15.272808    2557 kuberuntime_container.go:864] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-xbg6d" podUID="e8839fc2-3372-4cf9-bc32-a459899c54df" containerName="registry" containerID="cri-o://6ced0dfc02983b2cc8666841886b14f766eba1a9c4f14a48af998e04834146ee" gracePeriod=30
May 28 00:01:15.273059 ip-10-0-132-191 kubenswrapper[2557]: I0528 00:01:15.272862    2557 kuberuntime_container.go:864] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-xbg6d" podUID="e8839fc2-3372-4cf9-bc32-a459899c54df" containerName="ui" containerID="cri-o://dc920140ecad3965d31f6cda4befbfadd69fa4fadc7cc696f79173715272c4ef" gracePeriod=30
May 28 00:01:15.273059 ip-10-0-132-191 kubenswrapper[2557]: I0528 00:01:15.272937    2557 kuberuntime_container.go:864] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-xbg6d" podUID="e8839fc2-3372-4cf9-bc32-a459899c54df" containerName="online" containerID="cri-o://b8b2a811e08dcb7ad7ab4b2b52081a70eeb8b81be39c5f9c5cbf0b8302506801" gracePeriod=30
May 28 00:01:15.273059 ip-10-0-132-191 kubenswrapper[2557]: I0528 00:01:15.272900    2557 kuberuntime_container.go:864] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-xbg6d" podUID="e8839fc2-3372-4cf9-bc32-a459899c54df" containerName="offline" containerID="cri-o://cf22c6927305f6e5d52fc2ed79e620002aa975a6906193383db4a7dcd3e038f0" gracePeriod=30
May 28 00:01:15.673911 ip-10-0-132-191 kubenswrapper[2557]: I0528 00:01:15.673860    2557 generic.go:358] "Generic (PLEG): container finished" podID="7b9ccd54-a8a2-4773-bda5-d386a6c14513" containerID="682d8b2beea148c5b8bea909ec52e545a07b3bc076b1422aa60ee90ed6061c38" exitCode=0
May 28 00:01:15.673911 ip-10-0-132-191 kubenswrapper[2557]: I0528 00:01:15.673892    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-4jg55" event={"ID":"7b9ccd54-a8a2-4773-bda5-d386a6c14513","Type":"ContainerDied","Data":"682d8b2beea148c5b8bea909ec52e545a07b3bc076b1422aa60ee90ed6061c38"}
May 28 00:01:16.679676 ip-10-0-132-191 kubenswrapper[2557]: I0528 00:01:16.679591    2557 generic.go:358] "Generic (PLEG): container finished" podID="e8839fc2-3372-4cf9-bc32-a459899c54df" containerID="dc920140ecad3965d31f6cda4befbfadd69fa4fadc7cc696f79173715272c4ef" exitCode=0
May 28 00:01:16.679676 ip-10-0-132-191 kubenswrapper[2557]: I0528 00:01:16.679618    2557 generic.go:358] "Generic (PLEG): container finished" podID="e8839fc2-3372-4cf9-bc32-a459899c54df" containerID="b8b2a811e08dcb7ad7ab4b2b52081a70eeb8b81be39c5f9c5cbf0b8302506801" exitCode=0
May 28 00:01:16.679676 ip-10-0-132-191 kubenswrapper[2557]: I0528 00:01:16.679656    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-xbg6d" event={"ID":"e8839fc2-3372-4cf9-bc32-a459899c54df","Type":"ContainerDied","Data":"dc920140ecad3965d31f6cda4befbfadd69fa4fadc7cc696f79173715272c4ef"}
May 28 00:01:16.680183 ip-10-0-132-191 kubenswrapper[2557]: I0528 00:01:16.679693    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-xbg6d" event={"ID":"e8839fc2-3372-4cf9-bc32-a459899c54df","Type":"ContainerDied","Data":"b8b2a811e08dcb7ad7ab4b2b52081a70eeb8b81be39c5f9c5cbf0b8302506801"}
May 28 00:01:16.682079 ip-10-0-132-191 kubenswrapper[2557]: I0528 00:01:16.681977    2557 generic.go:358] "Generic (PLEG): container finished" podID="7b9ccd54-a8a2-4773-bda5-d386a6c14513" containerID="1ee065d28983b46630a6052941a5152999a1fe00e62cc69f4c304337fb2a3677" exitCode=0
May 28 00:01:16.682079 ip-10-0-132-191 kubenswrapper[2557]: I0528 00:01:16.682041    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-4jg55" event={"ID":"7b9ccd54-a8a2-4773-bda5-d386a6c14513","Type":"ContainerDied","Data":"1ee065d28983b46630a6052941a5152999a1fe00e62cc69f4c304337fb2a3677"}
May 28 00:01:19.709588 ip-10-0-132-191 kubenswrapper[2557]: I0528 00:01:19.709530    2557 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-xbg6d" podUID="e8839fc2-3372-4cf9-bc32-a459899c54df" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.20:8443: connect: connection refused"
May 28 00:01:20.281058 ip-10-0-132-191 kubenswrapper[2557]: I0528 00:01:20.281018    2557 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-xbg6d" podUID="e8839fc2-3372-4cf9-bc32-a459899c54df" containerName="online" probeResult="failure" output="Get \"https://10.132.0.20:6567/health\": dial tcp 10.132.0.20:6567: connect: connection refused"
May 28 00:01:21.948650 ip-10-0-132-191 kubenswrapper[2557]: I0528 00:01:21.948605    2557 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-4jg55" podUID="7b9ccd54-a8a2-4773-bda5-d386a6c14513" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.21:8443: connect: connection refused"
May 28 00:01:22.503351 ip-10-0-132-191 kubenswrapper[2557]: I0528 00:01:22.503313    2557 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-4jg55" podUID="7b9ccd54-a8a2-4773-bda5-d386a6c14513" containerName="online" probeResult="failure" output="Get \"https://10.132.0.21:6567/health\": dial tcp 10.132.0.21:6567: connect: connection refused"
May 28 00:01:29.710169 ip-10-0-132-191 kubenswrapper[2557]: I0528 00:01:29.710102    2557 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-xbg6d" podUID="e8839fc2-3372-4cf9-bc32-a459899c54df" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.20:8443: connect: connection refused"
May 28 00:01:30.281299 ip-10-0-132-191 kubenswrapper[2557]: I0528 00:01:30.281260    2557 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-xbg6d" podUID="e8839fc2-3372-4cf9-bc32-a459899c54df" containerName="online" probeResult="failure" output="Get \"https://10.132.0.20:6567/health\": dial tcp 10.132.0.20:6567: connect: connection refused"
May 28 00:01:31.948492 ip-10-0-132-191 kubenswrapper[2557]: I0528 00:01:31.948450    2557 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-4jg55" podUID="7b9ccd54-a8a2-4773-bda5-d386a6c14513" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.21:8443: connect: connection refused"
May 28 00:01:32.503310 ip-10-0-132-191 kubenswrapper[2557]: I0528 00:01:32.503265    2557 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-4jg55" podUID="7b9ccd54-a8a2-4773-bda5-d386a6c14513" containerName="online" probeResult="failure" output="Get \"https://10.132.0.21:6567/health\": dial tcp 10.132.0.21:6567: connect: connection refused"
May 28 00:01:39.709977 ip-10-0-132-191 kubenswrapper[2557]: I0528 00:01:39.709930    2557 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-xbg6d" podUID="e8839fc2-3372-4cf9-bc32-a459899c54df" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.20:8443: connect: connection refused"
May 28 00:01:39.710502 ip-10-0-132-191 kubenswrapper[2557]: I0528 00:01:39.710071    2557 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-xbg6d"
May 28 00:01:40.281845 ip-10-0-132-191 kubenswrapper[2557]: I0528 00:01:40.281787    2557 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-xbg6d" podUID="e8839fc2-3372-4cf9-bc32-a459899c54df" containerName="online" probeResult="failure" output="Get \"https://10.132.0.20:6567/health\": dial tcp 10.132.0.20:6567: connect: connection refused"
May 28 00:01:40.282038 ip-10-0-132-191 kubenswrapper[2557]: I0528 00:01:40.281945    2557 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-xbg6d"
May 28 00:01:41.949052 ip-10-0-132-191 kubenswrapper[2557]: I0528 00:01:41.949007    2557 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-4jg55" podUID="7b9ccd54-a8a2-4773-bda5-d386a6c14513" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.21:8443: connect: connection refused"
May 28 00:01:41.949524 ip-10-0-132-191 kubenswrapper[2557]: I0528 00:01:41.949171    2557 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-4jg55"
May 28 00:01:42.503472 ip-10-0-132-191 kubenswrapper[2557]: I0528 00:01:42.503426    2557 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-4jg55" podUID="7b9ccd54-a8a2-4773-bda5-d386a6c14513" containerName="online" probeResult="failure" output="Get \"https://10.132.0.21:6567/health\": dial tcp 10.132.0.21:6567: connect: connection refused"
May 28 00:01:42.503645 ip-10-0-132-191 kubenswrapper[2557]: I0528 00:01:42.503554    2557 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-4jg55"
May 28 00:01:45.306317 ip-10-0-132-191 kubenswrapper[2557]: I0528 00:01:45.306295    2557 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-4jg55"
May 28 00:01:45.387714 ip-10-0-132-191 kubenswrapper[2557]: I0528 00:01:45.387632    2557 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/7b9ccd54-a8a2-4773-bda5-d386a6c14513-online-tls\") pod \"7b9ccd54-a8a2-4773-bda5-d386a6c14513\" (UID: \"7b9ccd54-a8a2-4773-bda5-d386a6c14513\") "
May 28 00:01:45.387714 ip-10-0-132-191 kubenswrapper[2557]: I0528 00:01:45.387684    2557 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/7b9ccd54-a8a2-4773-bda5-d386a6c14513-ui-tls\") pod \"7b9ccd54-a8a2-4773-bda5-d386a6c14513\" (UID: \"7b9ccd54-a8a2-4773-bda5-d386a6c14513\") "
May 28 00:01:45.387714 ip-10-0-132-191 kubenswrapper[2557]: I0528 00:01:45.387710    2557 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qfttc\" (UniqueName: \"kubernetes.io/projected/7b9ccd54-a8a2-4773-bda5-d386a6c14513-kube-api-access-qfttc\") pod \"7b9ccd54-a8a2-4773-bda5-d386a6c14513\" (UID: \"7b9ccd54-a8a2-4773-bda5-d386a6c14513\") "
May 28 00:01:45.387981 ip-10-0-132-191 kubenswrapper[2557]: I0528 00:01:45.387879    2557 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/7b9ccd54-a8a2-4773-bda5-d386a6c14513-offline-tls\") pod \"7b9ccd54-a8a2-4773-bda5-d386a6c14513\" (UID: \"7b9ccd54-a8a2-4773-bda5-d386a6c14513\") "
May 28 00:01:45.387981 ip-10-0-132-191 kubenswrapper[2557]: I0528 00:01:45.387940    2557 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/7b9ccd54-a8a2-4773-bda5-d386a6c14513-feast-data\") pod \"7b9ccd54-a8a2-4773-bda5-d386a6c14513\" (UID: \"7b9ccd54-a8a2-4773-bda5-d386a6c14513\") "
May 28 00:01:45.388104 ip-10-0-132-191 kubenswrapper[2557]: I0528 00:01:45.388031    2557 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/configmap/7b9ccd54-a8a2-4773-bda5-d386a6c14513-registry-tls\") pod \"7b9ccd54-a8a2-4773-bda5-d386a6c14513\" (UID: \"7b9ccd54-a8a2-4773-bda5-d386a6c14513\") "
May 28 00:01:45.388398 ip-10-0-132-191 kubenswrapper[2557]: I0528 00:01:45.388348    2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7b9ccd54-a8a2-4773-bda5-d386a6c14513-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "7b9ccd54-a8a2-4773-bda5-d386a6c14513" (UID: "7b9ccd54-a8a2-4773-bda5-d386a6c14513"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 28 00:01:45.388507 ip-10-0-132-191 kubenswrapper[2557]: I0528 00:01:45.388435    2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7b9ccd54-a8a2-4773-bda5-d386a6c14513-feast-data" (OuterVolumeSpecName: "feast-data") pod "7b9ccd54-a8a2-4773-bda5-d386a6c14513" (UID: "7b9ccd54-a8a2-4773-bda5-d386a6c14513"). InnerVolumeSpecName "feast-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 28 00:01:45.390014 ip-10-0-132-191 kubenswrapper[2557]: I0528 00:01:45.389985    2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7b9ccd54-a8a2-4773-bda5-d386a6c14513-offline-tls" (OuterVolumeSpecName: "offline-tls") pod "7b9ccd54-a8a2-4773-bda5-d386a6c14513" (UID: "7b9ccd54-a8a2-4773-bda5-d386a6c14513"). InnerVolumeSpecName "offline-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 28 00:01:45.390107 ip-10-0-132-191 kubenswrapper[2557]: I0528 00:01:45.390051    2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7b9ccd54-a8a2-4773-bda5-d386a6c14513-online-tls" (OuterVolumeSpecName: "online-tls") pod "7b9ccd54-a8a2-4773-bda5-d386a6c14513" (UID: "7b9ccd54-a8a2-4773-bda5-d386a6c14513"). InnerVolumeSpecName "online-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 28 00:01:45.390107 ip-10-0-132-191 kubenswrapper[2557]: I0528 00:01:45.390059    2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7b9ccd54-a8a2-4773-bda5-d386a6c14513-kube-api-access-qfttc" (OuterVolumeSpecName: "kube-api-access-qfttc") pod "7b9ccd54-a8a2-4773-bda5-d386a6c14513" (UID: "7b9ccd54-a8a2-4773-bda5-d386a6c14513"). InnerVolumeSpecName "kube-api-access-qfttc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 28 00:01:45.390107 ip-10-0-132-191 kubenswrapper[2557]: I0528 00:01:45.390076    2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7b9ccd54-a8a2-4773-bda5-d386a6c14513-ui-tls" (OuterVolumeSpecName: "ui-tls") pod "7b9ccd54-a8a2-4773-bda5-d386a6c14513" (UID: "7b9ccd54-a8a2-4773-bda5-d386a6c14513"). InnerVolumeSpecName "ui-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 28 00:01:45.489473 ip-10-0-132-191 kubenswrapper[2557]: I0528 00:01:45.489450    2557 reconciler_common.go:299] "Volume detached for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/7b9ccd54-a8a2-4773-bda5-d386a6c14513-ui-tls\") on node \"ip-10-0-132-191.ec2.internal\" DevicePath \"\""
May 28 00:01:45.489473 ip-10-0-132-191 kubenswrapper[2557]: I0528 00:01:45.489471    2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qfttc\" (UniqueName: \"kubernetes.io/projected/7b9ccd54-a8a2-4773-bda5-d386a6c14513-kube-api-access-qfttc\") on node \"ip-10-0-132-191.ec2.internal\" DevicePath \"\""
May 28 00:01:45.489632 ip-10-0-132-191 kubenswrapper[2557]: I0528 00:01:45.489481    2557 reconciler_common.go:299] "Volume detached for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/7b9ccd54-a8a2-4773-bda5-d386a6c14513-offline-tls\") on node \"ip-10-0-132-191.ec2.internal\" DevicePath \"\""
May 28 00:01:45.489632 ip-10-0-132-191 kubenswrapper[2557]: I0528 00:01:45.489490    2557 reconciler_common.go:299] "Volume detached for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/7b9ccd54-a8a2-4773-bda5-d386a6c14513-feast-data\") on node \"ip-10-0-132-191.ec2.internal\" DevicePath \"\""
May 28 00:01:45.489632 ip-10-0-132-191 kubenswrapper[2557]: I0528 00:01:45.489499    2557 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/configmap/7b9ccd54-a8a2-4773-bda5-d386a6c14513-registry-tls\") on node \"ip-10-0-132-191.ec2.internal\" DevicePath \"\""
May 28 00:01:45.489632 ip-10-0-132-191 kubenswrapper[2557]: I0528 00:01:45.489506    2557 reconciler_common.go:299] "Volume detached for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/7b9ccd54-a8a2-4773-bda5-d386a6c14513-online-tls\") on node \"ip-10-0-132-191.ec2.internal\" DevicePath \"\""
May 28 00:01:45.760969 ip-10-0-132-191 kubenswrapper[2557]: I0528 00:01:45.760877    2557 generic.go:358] "Generic (PLEG): container finished" podID="e8839fc2-3372-4cf9-bc32-a459899c54df" containerID="cf22c6927305f6e5d52fc2ed79e620002aa975a6906193383db4a7dcd3e038f0" exitCode=137
May 28 00:01:45.760969 ip-10-0-132-191 kubenswrapper[2557]: I0528 00:01:45.760906    2557 generic.go:358] "Generic (PLEG): container finished" podID="e8839fc2-3372-4cf9-bc32-a459899c54df" containerID="6ced0dfc02983b2cc8666841886b14f766eba1a9c4f14a48af998e04834146ee" exitCode=137
May 28 00:01:45.760969 ip-10-0-132-191 kubenswrapper[2557]: I0528 00:01:45.760946    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-xbg6d" event={"ID":"e8839fc2-3372-4cf9-bc32-a459899c54df","Type":"ContainerDied","Data":"cf22c6927305f6e5d52fc2ed79e620002aa975a6906193383db4a7dcd3e038f0"}
May 28 00:01:45.761222 ip-10-0-132-191 kubenswrapper[2557]: I0528 00:01:45.760978    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-xbg6d" event={"ID":"e8839fc2-3372-4cf9-bc32-a459899c54df","Type":"ContainerDied","Data":"6ced0dfc02983b2cc8666841886b14f766eba1a9c4f14a48af998e04834146ee"}
May 28 00:01:45.763025 ip-10-0-132-191 kubenswrapper[2557]: I0528 00:01:45.763004    2557 generic.go:358] "Generic (PLEG): container finished" podID="7b9ccd54-a8a2-4773-bda5-d386a6c14513" containerID="a69d1a2b910248e2b98be89a7308784076e4dbffc038adca7d74f60dbca63b6d" exitCode=137
May 28 00:01:45.763160 ip-10-0-132-191 kubenswrapper[2557]: I0528 00:01:45.763032    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-4jg55" event={"ID":"7b9ccd54-a8a2-4773-bda5-d386a6c14513","Type":"ContainerDied","Data":"a69d1a2b910248e2b98be89a7308784076e4dbffc038adca7d74f60dbca63b6d"}
May 28 00:01:45.763160 ip-10-0-132-191 kubenswrapper[2557]: I0528 00:01:45.763051    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-4jg55" event={"ID":"7b9ccd54-a8a2-4773-bda5-d386a6c14513","Type":"ContainerDied","Data":"2c440539bd17bdaea88f9c44896d5aa585387f709190523b97975e7f37d081e7"}
May 28 00:01:45.763160 ip-10-0-132-191 kubenswrapper[2557]: I0528 00:01:45.763066    2557 scope.go:117] "RemoveContainer" containerID="682d8b2beea148c5b8bea909ec52e545a07b3bc076b1422aa60ee90ed6061c38"
May 28 00:01:45.763160 ip-10-0-132-191 kubenswrapper[2557]: I0528 00:01:45.763077    2557 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-4jg55"
May 28 00:01:45.771313 ip-10-0-132-191 kubenswrapper[2557]: I0528 00:01:45.771297    2557 scope.go:117] "RemoveContainer" containerID="a69d1a2b910248e2b98be89a7308784076e4dbffc038adca7d74f60dbca63b6d"
May 28 00:01:45.778595 ip-10-0-132-191 kubenswrapper[2557]: I0528 00:01:45.778579    2557 scope.go:117] "RemoveContainer" containerID="1ee065d28983b46630a6052941a5152999a1fe00e62cc69f4c304337fb2a3677"
May 28 00:01:45.785614 ip-10-0-132-191 kubenswrapper[2557]: I0528 00:01:45.785594    2557 scope.go:117] "RemoveContainer" containerID="3eb4483fa474f86cf23b2d4621f88c5be1511dd7b0ed13626b222a23c93a0d0b"
May 28 00:01:45.786294 ip-10-0-132-191 kubenswrapper[2557]: I0528 00:01:45.786273    2557 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-4jg55"]
May 28 00:01:45.791314 ip-10-0-132-191 kubenswrapper[2557]: I0528 00:01:45.791290    2557 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-4jg55"]
May 28 00:01:45.794317 ip-10-0-132-191 kubenswrapper[2557]: I0528 00:01:45.794302    2557 scope.go:117] "RemoveContainer" containerID="b0a5989c2de0f283536ff5c27af55614026b24b81a21b2953931282cc114373f"
May 28 00:01:45.802562 ip-10-0-132-191 kubenswrapper[2557]: I0528 00:01:45.802542    2557 scope.go:117] "RemoveContainer" containerID="682d8b2beea148c5b8bea909ec52e545a07b3bc076b1422aa60ee90ed6061c38"
May 28 00:01:45.803009 ip-10-0-132-191 kubenswrapper[2557]: E0528 00:01:45.802987    2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"682d8b2beea148c5b8bea909ec52e545a07b3bc076b1422aa60ee90ed6061c38\": container with ID starting with 682d8b2beea148c5b8bea909ec52e545a07b3bc076b1422aa60ee90ed6061c38 not found: ID does not exist" containerID="682d8b2beea148c5b8bea909ec52e545a07b3bc076b1422aa60ee90ed6061c38"
May 28 00:01:45.803102 ip-10-0-132-191 kubenswrapper[2557]: I0528 00:01:45.803015    2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"682d8b2beea148c5b8bea909ec52e545a07b3bc076b1422aa60ee90ed6061c38"} err="failed to get container status \"682d8b2beea148c5b8bea909ec52e545a07b3bc076b1422aa60ee90ed6061c38\": rpc error: code = NotFound desc = could not find container \"682d8b2beea148c5b8bea909ec52e545a07b3bc076b1422aa60ee90ed6061c38\": container with ID starting with 682d8b2beea148c5b8bea909ec52e545a07b3bc076b1422aa60ee90ed6061c38 not found: ID does not exist"
May 28 00:01:45.803102 ip-10-0-132-191 kubenswrapper[2557]: I0528 00:01:45.803032    2557 scope.go:117] "RemoveContainer" containerID="a69d1a2b910248e2b98be89a7308784076e4dbffc038adca7d74f60dbca63b6d"
May 28 00:01:45.803344 ip-10-0-132-191 kubenswrapper[2557]: E0528 00:01:45.803324    2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a69d1a2b910248e2b98be89a7308784076e4dbffc038adca7d74f60dbca63b6d\": container with ID starting with a69d1a2b910248e2b98be89a7308784076e4dbffc038adca7d74f60dbca63b6d not found: ID does not exist" containerID="a69d1a2b910248e2b98be89a7308784076e4dbffc038adca7d74f60dbca63b6d"
May 28 00:01:45.803391 ip-10-0-132-191 kubenswrapper[2557]: I0528 00:01:45.803349    2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a69d1a2b910248e2b98be89a7308784076e4dbffc038adca7d74f60dbca63b6d"} err="failed to get container status \"a69d1a2b910248e2b98be89a7308784076e4dbffc038adca7d74f60dbca63b6d\": rpc error: code = NotFound desc = could not find container \"a69d1a2b910248e2b98be89a7308784076e4dbffc038adca7d74f60dbca63b6d\": container with ID starting with a69d1a2b910248e2b98be89a7308784076e4dbffc038adca7d74f60dbca63b6d not found: ID does not exist"
May 28 00:01:45.803391 ip-10-0-132-191 kubenswrapper[2557]: I0528 00:01:45.803364    2557 scope.go:117] "RemoveContainer" containerID="1ee065d28983b46630a6052941a5152999a1fe00e62cc69f4c304337fb2a3677"
May 28 00:01:45.803658 ip-10-0-132-191 kubenswrapper[2557]: E0528 00:01:45.803641    2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1ee065d28983b46630a6052941a5152999a1fe00e62cc69f4c304337fb2a3677\": container with ID starting with 1ee065d28983b46630a6052941a5152999a1fe00e62cc69f4c304337fb2a3677 not found: ID does not exist" containerID="1ee065d28983b46630a6052941a5152999a1fe00e62cc69f4c304337fb2a3677"
May 28 00:01:45.803730 ip-10-0-132-191 kubenswrapper[2557]: I0528 00:01:45.803661    2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1ee065d28983b46630a6052941a5152999a1fe00e62cc69f4c304337fb2a3677"} err="failed to get container status \"1ee065d28983b46630a6052941a5152999a1fe00e62cc69f4c304337fb2a3677\": rpc error: code = NotFound desc = could not find container \"1ee065d28983b46630a6052941a5152999a1fe00e62cc69f4c304337fb2a3677\": container with ID starting with 1ee065d28983b46630a6052941a5152999a1fe00e62cc69f4c304337fb2a3677 not found: ID does not exist"
May 28 00:01:45.803730 ip-10-0-132-191 kubenswrapper[2557]: I0528 00:01:45.803681    2557 scope.go:117] "RemoveContainer" containerID="3eb4483fa474f86cf23b2d4621f88c5be1511dd7b0ed13626b222a23c93a0d0b"
May 28 00:01:45.803993 ip-10-0-132-191 kubenswrapper[2557]: E0528 00:01:45.803960    2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3eb4483fa474f86cf23b2d4621f88c5be1511dd7b0ed13626b222a23c93a0d0b\": container with ID starting with 3eb4483fa474f86cf23b2d4621f88c5be1511dd7b0ed13626b222a23c93a0d0b not found: ID does not exist" containerID="3eb4483fa474f86cf23b2d4621f88c5be1511dd7b0ed13626b222a23c93a0d0b"
May 28 00:01:45.804082 ip-10-0-132-191 kubenswrapper[2557]: I0528 00:01:45.803996    2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3eb4483fa474f86cf23b2d4621f88c5be1511dd7b0ed13626b222a23c93a0d0b"} err="failed to get container status \"3eb4483fa474f86cf23b2d4621f88c5be1511dd7b0ed13626b222a23c93a0d0b\": rpc error: code = NotFound desc = could not find container \"3eb4483fa474f86cf23b2d4621f88c5be1511dd7b0ed13626b222a23c93a0d0b\": container with ID starting with 3eb4483fa474f86cf23b2d4621f88c5be1511dd7b0ed13626b222a23c93a0d0b not found: ID does not exist"
May 28 00:01:45.804082 ip-10-0-132-191 kubenswrapper[2557]: I0528 00:01:45.804016    2557 scope.go:117] "RemoveContainer" containerID="b0a5989c2de0f283536ff5c27af55614026b24b81a21b2953931282cc114373f"
May 28 00:01:45.804420 ip-10-0-132-191 kubenswrapper[2557]: E0528 00:01:45.804391    2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b0a5989c2de0f283536ff5c27af55614026b24b81a21b2953931282cc114373f\": container with ID starting with b0a5989c2de0f283536ff5c27af55614026b24b81a21b2953931282cc114373f not found: ID does not exist" containerID="b0a5989c2de0f283536ff5c27af55614026b24b81a21b2953931282cc114373f"
May 28 00:01:45.804502 ip-10-0-132-191 kubenswrapper[2557]: I0528 00:01:45.804429    2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b0a5989c2de0f283536ff5c27af55614026b24b81a21b2953931282cc114373f"} err="failed to get container status \"b0a5989c2de0f283536ff5c27af55614026b24b81a21b2953931282cc114373f\": rpc error: code = NotFound desc = could not find container \"b0a5989c2de0f283536ff5c27af55614026b24b81a21b2953931282cc114373f\": container with ID starting with b0a5989c2de0f283536ff5c27af55614026b24b81a21b2953931282cc114373f not found: ID does not exist"
May 28 00:01:45.918908 ip-10-0-132-191 kubenswrapper[2557]: I0528 00:01:45.918886    2557 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-xbg6d"
May 28 00:01:45.993336 ip-10-0-132-191 kubenswrapper[2557]: I0528 00:01:45.993311    2557 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/e8839fc2-3372-4cf9-bc32-a459899c54df-registry-tls\") pod \"e8839fc2-3372-4cf9-bc32-a459899c54df\" (UID: \"e8839fc2-3372-4cf9-bc32-a459899c54df\") "
May 28 00:01:45.993475 ip-10-0-132-191 kubenswrapper[2557]: I0528 00:01:45.993344    2557 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/e8839fc2-3372-4cf9-bc32-a459899c54df-feast-data\") pod \"e8839fc2-3372-4cf9-bc32-a459899c54df\" (UID: \"e8839fc2-3372-4cf9-bc32-a459899c54df\") "
May 28 00:01:45.993475 ip-10-0-132-191 kubenswrapper[2557]: I0528 00:01:45.993388    2557 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/e8839fc2-3372-4cf9-bc32-a459899c54df-offline-tls\") pod \"e8839fc2-3372-4cf9-bc32-a459899c54df\" (UID: \"e8839fc2-3372-4cf9-bc32-a459899c54df\") "
May 28 00:01:45.993475 ip-10-0-132-191 kubenswrapper[2557]: I0528 00:01:45.993415    2557 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-h72sv\" (UniqueName: \"kubernetes.io/projected/e8839fc2-3372-4cf9-bc32-a459899c54df-kube-api-access-h72sv\") pod \"e8839fc2-3372-4cf9-bc32-a459899c54df\" (UID: \"e8839fc2-3372-4cf9-bc32-a459899c54df\") "
May 28 00:01:45.993475 ip-10-0-132-191 kubenswrapper[2557]: I0528 00:01:45.993430    2557 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/e8839fc2-3372-4cf9-bc32-a459899c54df-ui-tls\") pod \"e8839fc2-3372-4cf9-bc32-a459899c54df\" (UID: \"e8839fc2-3372-4cf9-bc32-a459899c54df\") "
May 28 00:01:45.993475 ip-10-0-132-191 kubenswrapper[2557]: I0528 00:01:45.993455    2557 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/e8839fc2-3372-4cf9-bc32-a459899c54df-online-tls\") pod \"e8839fc2-3372-4cf9-bc32-a459899c54df\" (UID: \"e8839fc2-3372-4cf9-bc32-a459899c54df\") "
May 28 00:01:45.994048 ip-10-0-132-191 kubenswrapper[2557]: I0528 00:01:45.993992    2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e8839fc2-3372-4cf9-bc32-a459899c54df-feast-data" (OuterVolumeSpecName: "feast-data") pod "e8839fc2-3372-4cf9-bc32-a459899c54df" (UID: "e8839fc2-3372-4cf9-bc32-a459899c54df"). InnerVolumeSpecName "feast-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 28 00:01:45.995411 ip-10-0-132-191 kubenswrapper[2557]: I0528 00:01:45.995381    2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e8839fc2-3372-4cf9-bc32-a459899c54df-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "e8839fc2-3372-4cf9-bc32-a459899c54df" (UID: "e8839fc2-3372-4cf9-bc32-a459899c54df"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 28 00:01:45.995517 ip-10-0-132-191 kubenswrapper[2557]: I0528 00:01:45.995432    2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e8839fc2-3372-4cf9-bc32-a459899c54df-ui-tls" (OuterVolumeSpecName: "ui-tls") pod "e8839fc2-3372-4cf9-bc32-a459899c54df" (UID: "e8839fc2-3372-4cf9-bc32-a459899c54df"). InnerVolumeSpecName "ui-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 28 00:01:45.995517 ip-10-0-132-191 kubenswrapper[2557]: I0528 00:01:45.995490    2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e8839fc2-3372-4cf9-bc32-a459899c54df-online-tls" (OuterVolumeSpecName: "online-tls") pod "e8839fc2-3372-4cf9-bc32-a459899c54df" (UID: "e8839fc2-3372-4cf9-bc32-a459899c54df"). InnerVolumeSpecName "online-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 28 00:01:45.995841 ip-10-0-132-191 kubenswrapper[2557]: I0528 00:01:45.995823    2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e8839fc2-3372-4cf9-bc32-a459899c54df-offline-tls" (OuterVolumeSpecName: "offline-tls") pod "e8839fc2-3372-4cf9-bc32-a459899c54df" (UID: "e8839fc2-3372-4cf9-bc32-a459899c54df"). InnerVolumeSpecName "offline-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 28 00:01:45.995841 ip-10-0-132-191 kubenswrapper[2557]: I0528 00:01:45.995828    2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e8839fc2-3372-4cf9-bc32-a459899c54df-kube-api-access-h72sv" (OuterVolumeSpecName: "kube-api-access-h72sv") pod "e8839fc2-3372-4cf9-bc32-a459899c54df" (UID: "e8839fc2-3372-4cf9-bc32-a459899c54df"). InnerVolumeSpecName "kube-api-access-h72sv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 28 00:01:46.094469 ip-10-0-132-191 kubenswrapper[2557]: I0528 00:01:46.094439    2557 reconciler_common.go:299] "Volume detached for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/e8839fc2-3372-4cf9-bc32-a459899c54df-offline-tls\") on node \"ip-10-0-132-191.ec2.internal\" DevicePath \"\""
May 28 00:01:46.094469 ip-10-0-132-191 kubenswrapper[2557]: I0528 00:01:46.094464    2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-h72sv\" (UniqueName: \"kubernetes.io/projected/e8839fc2-3372-4cf9-bc32-a459899c54df-kube-api-access-h72sv\") on node \"ip-10-0-132-191.ec2.internal\" DevicePath \"\""
May 28 00:01:46.094469 ip-10-0-132-191 kubenswrapper[2557]: I0528 00:01:46.094474    2557 reconciler_common.go:299] "Volume detached for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/e8839fc2-3372-4cf9-bc32-a459899c54df-ui-tls\") on node \"ip-10-0-132-191.ec2.internal\" DevicePath \"\""
May 28 00:01:46.094671 ip-10-0-132-191 kubenswrapper[2557]: I0528 00:01:46.094483    2557 reconciler_common.go:299] "Volume detached for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/e8839fc2-3372-4cf9-bc32-a459899c54df-online-tls\") on node \"ip-10-0-132-191.ec2.internal\" DevicePath \"\""
May 28 00:01:46.094671 ip-10-0-132-191 kubenswrapper[2557]: I0528 00:01:46.094491    2557 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/e8839fc2-3372-4cf9-bc32-a459899c54df-registry-tls\") on node \"ip-10-0-132-191.ec2.internal\" DevicePath \"\""
May 28 00:01:46.094671 ip-10-0-132-191 kubenswrapper[2557]: I0528 00:01:46.094501    2557 reconciler_common.go:299] "Volume detached for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/e8839fc2-3372-4cf9-bc32-a459899c54df-feast-data\") on node \"ip-10-0-132-191.ec2.internal\" DevicePath \"\""
May 28 00:01:46.768412 ip-10-0-132-191 kubenswrapper[2557]: I0528 00:01:46.768381    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-xbg6d" event={"ID":"e8839fc2-3372-4cf9-bc32-a459899c54df","Type":"ContainerDied","Data":"6788f3d69c63b5d45c0ec175661202b7e69eae274c879ef2f4a0be184e07eedb"}
May 28 00:01:46.768412 ip-10-0-132-191 kubenswrapper[2557]: I0528 00:01:46.768398    2557 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-xbg6d"
May 28 00:01:46.768900 ip-10-0-132-191 kubenswrapper[2557]: I0528 00:01:46.768430    2557 scope.go:117] "RemoveContainer" containerID="dc920140ecad3965d31f6cda4befbfadd69fa4fadc7cc696f79173715272c4ef"
May 28 00:01:46.776647 ip-10-0-132-191 kubenswrapper[2557]: I0528 00:01:46.776629    2557 scope.go:117] "RemoveContainer" containerID="cf22c6927305f6e5d52fc2ed79e620002aa975a6906193383db4a7dcd3e038f0"
May 28 00:01:46.783239 ip-10-0-132-191 kubenswrapper[2557]: I0528 00:01:46.783222    2557 scope.go:117] "RemoveContainer" containerID="b8b2a811e08dcb7ad7ab4b2b52081a70eeb8b81be39c5f9c5cbf0b8302506801"
May 28 00:01:46.789492 ip-10-0-132-191 kubenswrapper[2557]: I0528 00:01:46.789476    2557 scope.go:117] "RemoveContainer" containerID="6ced0dfc02983b2cc8666841886b14f766eba1a9c4f14a48af998e04834146ee"
May 28 00:01:46.791652 ip-10-0-132-191 kubenswrapper[2557]: I0528 00:01:46.791629    2557 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-664fcfcc58-xbg6d"]
May 28 00:01:46.795241 ip-10-0-132-191 kubenswrapper[2557]: I0528 00:01:46.795218    2557 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-664fcfcc58-xbg6d"]
May 28 00:01:46.796781 ip-10-0-132-191 kubenswrapper[2557]: I0528 00:01:46.796765    2557 scope.go:117] "RemoveContainer" containerID="246abb4a8408d65f221d39117ae908e798149de91af15a84a2b0331cfcd8c941"
May 28 00:01:46.802880 ip-10-0-132-191 kubenswrapper[2557]: I0528 00:01:46.802865    2557 scope.go:117] "RemoveContainer" containerID="97d41e826347d911cae7cfc5823dc120a79e68783c5f08cec5552aab5a3a5ff6"
May 28 00:01:47.202026 ip-10-0-132-191 kubenswrapper[2557]: I0528 00:01:47.201995    2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7b9ccd54-a8a2-4773-bda5-d386a6c14513" path="/var/lib/kubelet/pods/7b9ccd54-a8a2-4773-bda5-d386a6c14513/volumes"
May 28 00:01:47.202556 ip-10-0-132-191 kubenswrapper[2557]: I0528 00:01:47.202542    2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e8839fc2-3372-4cf9-bc32-a459899c54df" path="/var/lib/kubelet/pods/e8839fc2-3372-4cf9-bc32-a459899c54df/volumes"
May 28 00:02:22.567059 ip-10-0-132-191 kubenswrapper[2557]: I0528 00:02:22.567018    2557 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-must-gather-kklfx/must-gather-f8hjw"]
May 28 00:02:22.567596 ip-10-0-132-191 kubenswrapper[2557]: I0528 00:02:22.567337    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e8839fc2-3372-4cf9-bc32-a459899c54df" containerName="feast-apply"
May 28 00:02:22.567596 ip-10-0-132-191 kubenswrapper[2557]: I0528 00:02:22.567357    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="e8839fc2-3372-4cf9-bc32-a459899c54df" containerName="feast-apply"
May 28 00:02:22.567596 ip-10-0-132-191 kubenswrapper[2557]: I0528 00:02:22.567368    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7b9ccd54-a8a2-4773-bda5-d386a6c14513" containerName="feast-init"
May 28 00:02:22.567596 ip-10-0-132-191 kubenswrapper[2557]: I0528 00:02:22.567378    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="7b9ccd54-a8a2-4773-bda5-d386a6c14513" containerName="feast-init"
May 28 00:02:22.567596 ip-10-0-132-191 kubenswrapper[2557]: I0528 00:02:22.567396    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e8839fc2-3372-4cf9-bc32-a459899c54df" containerName="registry"
May 28 00:02:22.567596 ip-10-0-132-191 kubenswrapper[2557]: I0528 00:02:22.567405    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="e8839fc2-3372-4cf9-bc32-a459899c54df" containerName="registry"
May 28 00:02:22.567596 ip-10-0-132-191 kubenswrapper[2557]: I0528 00:02:22.567414    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7b9ccd54-a8a2-4773-bda5-d386a6c14513" containerName="ui"
May 28 00:02:22.567596 ip-10-0-132-191 kubenswrapper[2557]: I0528 00:02:22.567423    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="7b9ccd54-a8a2-4773-bda5-d386a6c14513" containerName="ui"
May 28 00:02:22.567596 ip-10-0-132-191 kubenswrapper[2557]: I0528 00:02:22.567434    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e8839fc2-3372-4cf9-bc32-a459899c54df" containerName="feast-init"
May 28 00:02:22.567596 ip-10-0-132-191 kubenswrapper[2557]: I0528 00:02:22.567443    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="e8839fc2-3372-4cf9-bc32-a459899c54df" containerName="feast-init"
May 28 00:02:22.567596 ip-10-0-132-191 kubenswrapper[2557]: I0528 00:02:22.567455    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e8839fc2-3372-4cf9-bc32-a459899c54df" containerName="online"
May 28 00:02:22.567596 ip-10-0-132-191 kubenswrapper[2557]: I0528 00:02:22.567462    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="e8839fc2-3372-4cf9-bc32-a459899c54df" containerName="online"
May 28 00:02:22.567596 ip-10-0-132-191 kubenswrapper[2557]: I0528 00:02:22.567472    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e8839fc2-3372-4cf9-bc32-a459899c54df" containerName="ui"
May 28 00:02:22.567596 ip-10-0-132-191 kubenswrapper[2557]: I0528 00:02:22.567479    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="e8839fc2-3372-4cf9-bc32-a459899c54df" containerName="ui"
May 28 00:02:22.567596 ip-10-0-132-191 kubenswrapper[2557]: I0528 00:02:22.567488    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7b9ccd54-a8a2-4773-bda5-d386a6c14513" containerName="feast-apply"
May 28 00:02:22.567596 ip-10-0-132-191 kubenswrapper[2557]: I0528 00:02:22.567497    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="7b9ccd54-a8a2-4773-bda5-d386a6c14513" containerName="feast-apply"
May 28 00:02:22.567596 ip-10-0-132-191 kubenswrapper[2557]: I0528 00:02:22.567510    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e8839fc2-3372-4cf9-bc32-a459899c54df" containerName="offline"
May 28 00:02:22.567596 ip-10-0-132-191 kubenswrapper[2557]: I0528 00:02:22.567517    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="e8839fc2-3372-4cf9-bc32-a459899c54df" containerName="offline"
May 28 00:02:22.567596 ip-10-0-132-191 kubenswrapper[2557]: I0528 00:02:22.567527    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7b9ccd54-a8a2-4773-bda5-d386a6c14513" containerName="online"
May 28 00:02:22.567596 ip-10-0-132-191 kubenswrapper[2557]: I0528 00:02:22.567536    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="7b9ccd54-a8a2-4773-bda5-d386a6c14513" containerName="online"
May 28 00:02:22.567596 ip-10-0-132-191 kubenswrapper[2557]: I0528 00:02:22.567546    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7b9ccd54-a8a2-4773-bda5-d386a6c14513" containerName="offline"
May 28 00:02:22.567596 ip-10-0-132-191 kubenswrapper[2557]: I0528 00:02:22.567554    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="7b9ccd54-a8a2-4773-bda5-d386a6c14513" containerName="offline"
May 28 00:02:22.568608 ip-10-0-132-191 kubenswrapper[2557]: I0528 00:02:22.567611    2557 memory_manager.go:356] "RemoveStaleState removing state" podUID="7b9ccd54-a8a2-4773-bda5-d386a6c14513" containerName="online"
May 28 00:02:22.568608 ip-10-0-132-191 kubenswrapper[2557]: I0528 00:02:22.567621    2557 memory_manager.go:356] "RemoveStaleState removing state" podUID="e8839fc2-3372-4cf9-bc32-a459899c54df" containerName="online"
May 28 00:02:22.568608 ip-10-0-132-191 kubenswrapper[2557]: I0528 00:02:22.567629    2557 memory_manager.go:356] "RemoveStaleState removing state" podUID="e8839fc2-3372-4cf9-bc32-a459899c54df" containerName="ui"
May 28 00:02:22.568608 ip-10-0-132-191 kubenswrapper[2557]: I0528 00:02:22.567638    2557 memory_manager.go:356] "RemoveStaleState removing state" podUID="7b9ccd54-a8a2-4773-bda5-d386a6c14513" containerName="offline"
May 28 00:02:22.568608 ip-10-0-132-191 kubenswrapper[2557]: I0528 00:02:22.567650    2557 memory_manager.go:356] "RemoveStaleState removing state" podUID="7b9ccd54-a8a2-4773-bda5-d386a6c14513" containerName="ui"
May 28 00:02:22.568608 ip-10-0-132-191 kubenswrapper[2557]: I0528 00:02:22.567661    2557 memory_manager.go:356] "RemoveStaleState removing state" podUID="e8839fc2-3372-4cf9-bc32-a459899c54df" containerName="registry"
May 28 00:02:22.568608 ip-10-0-132-191 kubenswrapper[2557]: I0528 00:02:22.567670    2557 memory_manager.go:356] "RemoveStaleState removing state" podUID="e8839fc2-3372-4cf9-bc32-a459899c54df" containerName="offline"
May 28 00:02:22.572079 ip-10-0-132-191 kubenswrapper[2557]: I0528 00:02:22.572057    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-kklfx/must-gather-f8hjw"
May 28 00:02:22.574873 ip-10-0-132-191 kubenswrapper[2557]: I0528 00:02:22.574852    2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-kklfx\"/\"openshift-service-ca.crt\""
May 28 00:02:22.576448 ip-10-0-132-191 kubenswrapper[2557]: I0528 00:02:22.576057    2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-kklfx\"/\"kube-root-ca.crt\""
May 28 00:02:22.576448 ip-10-0-132-191 kubenswrapper[2557]: I0528 00:02:22.576292    2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-kklfx\"/\"default-dockercfg-bnkxh\""
May 28 00:02:22.578167 ip-10-0-132-191 kubenswrapper[2557]: I0528 00:02:22.578145    2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-kklfx/must-gather-f8hjw"]
May 28 00:02:22.646352 ip-10-0-132-191 kubenswrapper[2557]: I0528 00:02:22.646323    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/c4410f44-68be-47f8-bdcd-b17498dc50f5-must-gather-output\") pod \"must-gather-f8hjw\" (UID: \"c4410f44-68be-47f8-bdcd-b17498dc50f5\") " pod="openshift-must-gather-kklfx/must-gather-f8hjw"
May 28 00:02:22.646448 ip-10-0-132-191 kubenswrapper[2557]: I0528 00:02:22.646379    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5sgc5\" (UniqueName: \"kubernetes.io/projected/c4410f44-68be-47f8-bdcd-b17498dc50f5-kube-api-access-5sgc5\") pod \"must-gather-f8hjw\" (UID: \"c4410f44-68be-47f8-bdcd-b17498dc50f5\") " pod="openshift-must-gather-kklfx/must-gather-f8hjw"
May 28 00:02:22.746953 ip-10-0-132-191 kubenswrapper[2557]: I0528 00:02:22.746916    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-5sgc5\" (UniqueName: \"kubernetes.io/projected/c4410f44-68be-47f8-bdcd-b17498dc50f5-kube-api-access-5sgc5\") pod \"must-gather-f8hjw\" (UID: \"c4410f44-68be-47f8-bdcd-b17498dc50f5\") " pod="openshift-must-gather-kklfx/must-gather-f8hjw"
May 28 00:02:22.747109 ip-10-0-132-191 kubenswrapper[2557]: I0528 00:02:22.746969    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/c4410f44-68be-47f8-bdcd-b17498dc50f5-must-gather-output\") pod \"must-gather-f8hjw\" (UID: \"c4410f44-68be-47f8-bdcd-b17498dc50f5\") " pod="openshift-must-gather-kklfx/must-gather-f8hjw"
May 28 00:02:22.747287 ip-10-0-132-191 kubenswrapper[2557]: I0528 00:02:22.747269    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/c4410f44-68be-47f8-bdcd-b17498dc50f5-must-gather-output\") pod \"must-gather-f8hjw\" (UID: \"c4410f44-68be-47f8-bdcd-b17498dc50f5\") " pod="openshift-must-gather-kklfx/must-gather-f8hjw"
May 28 00:02:22.755543 ip-10-0-132-191 kubenswrapper[2557]: I0528 00:02:22.755516    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5sgc5\" (UniqueName: \"kubernetes.io/projected/c4410f44-68be-47f8-bdcd-b17498dc50f5-kube-api-access-5sgc5\") pod \"must-gather-f8hjw\" (UID: \"c4410f44-68be-47f8-bdcd-b17498dc50f5\") " pod="openshift-must-gather-kklfx/must-gather-f8hjw"
May 28 00:02:22.881198 ip-10-0-132-191 kubenswrapper[2557]: I0528 00:02:22.881169    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-kklfx/must-gather-f8hjw"
May 28 00:02:23.001027 ip-10-0-132-191 kubenswrapper[2557]: I0528 00:02:23.000992    2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-kklfx/must-gather-f8hjw"]
May 28 00:02:23.003914 ip-10-0-132-191 kubenswrapper[2557]: W0528 00:02:23.003886    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podc4410f44_68be_47f8_bdcd_b17498dc50f5.slice/crio-d4442b70a3ded126b1e8079f33fb29e70bc352ece44718080b97302f25f4554e WatchSource:0}: Error finding container d4442b70a3ded126b1e8079f33fb29e70bc352ece44718080b97302f25f4554e: Status 404 returned error can't find the container with id d4442b70a3ded126b1e8079f33fb29e70bc352ece44718080b97302f25f4554e
May 28 00:02:23.005833 ip-10-0-132-191 kubenswrapper[2557]: I0528 00:02:23.005812    2557 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
May 28 00:02:23.863682 ip-10-0-132-191 kubenswrapper[2557]: I0528 00:02:23.863649    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-kklfx/must-gather-f8hjw" event={"ID":"c4410f44-68be-47f8-bdcd-b17498dc50f5","Type":"ContainerStarted","Data":"d4442b70a3ded126b1e8079f33fb29e70bc352ece44718080b97302f25f4554e"}
May 28 00:02:24.867529 ip-10-0-132-191 kubenswrapper[2557]: I0528 00:02:24.867489    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-kklfx/must-gather-f8hjw" event={"ID":"c4410f44-68be-47f8-bdcd-b17498dc50f5","Type":"ContainerStarted","Data":"52d248f3f2ce87de8cb100c419b3f3df1ee1c1ac4727753d673a347ea40debdf"}
May 28 00:02:24.867529 ip-10-0-132-191 kubenswrapper[2557]: I0528 00:02:24.867533    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-kklfx/must-gather-f8hjw" event={"ID":"c4410f44-68be-47f8-bdcd-b17498dc50f5","Type":"ContainerStarted","Data":"bacf644e4b175b147f2ea5e3382f42eaf7c2f33b2e4eddcd01d94d7008bc22e0"}
May 28 00:02:24.884047 ip-10-0-132-191 kubenswrapper[2557]: I0528 00:02:24.883993    2557 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-must-gather-kklfx/must-gather-f8hjw" podStartSLOduration=2.017927971 podStartE2EDuration="2.88397774s" podCreationTimestamp="2026-05-28 00:02:22 +0000 UTC" firstStartedPulling="2026-05-28 00:02:23.005940585 +0000 UTC m=+1758.425476575" lastFinishedPulling="2026-05-28 00:02:23.87199035 +0000 UTC m=+1759.291526344" observedRunningTime="2026-05-28 00:02:24.882755327 +0000 UTC m=+1760.302291340" watchObservedRunningTime="2026-05-28 00:02:24.88397774 +0000 UTC m=+1760.303513752"
May 28 00:02:25.180368 ip-10-0-132-191 kubenswrapper[2557]: I0528 00:02:25.180283    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-gz67s_c2d45389-8733-498a-a898-6cc40f57fbac/global-pull-secret-syncer/0.log"
May 28 00:02:25.343026 ip-10-0-132-191 kubenswrapper[2557]: I0528 00:02:25.343001    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-54c79_471894d3-91bc-4805-914b-a761d2f21f31/konnectivity-agent/0.log"
May 28 00:02:25.444730 ip-10-0-132-191 kubenswrapper[2557]: I0528 00:02:25.444651    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-132-191.ec2.internal_25522b04fdc0994697c03f613fe7f724/haproxy/0.log"
May 28 00:02:29.051580 ip-10-0-132-191 kubenswrapper[2557]: I0528 00:02:29.051515    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-xbf6b_56080086-b221-4e2c-b0a0-8b6882cfa69c/node-exporter/0.log"
May 28 00:02:29.079807 ip-10-0-132-191 kubenswrapper[2557]: I0528 00:02:29.079777    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-xbf6b_56080086-b221-4e2c-b0a0-8b6882cfa69c/kube-rbac-proxy/0.log"
May 28 00:02:29.103030 ip-10-0-132-191 kubenswrapper[2557]: I0528 00:02:29.103006    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-xbf6b_56080086-b221-4e2c-b0a0-8b6882cfa69c/init-textfile/0.log"
May 28 00:02:31.396892 ip-10-0-132-191 kubenswrapper[2557]: I0528 00:02:31.396844    2557 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-must-gather-kklfx/perf-node-gather-daemonset-bsrpz"]
May 28 00:02:31.400663 ip-10-0-132-191 kubenswrapper[2557]: I0528 00:02:31.400642    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-kklfx/perf-node-gather-daemonset-bsrpz"
May 28 00:02:31.408537 ip-10-0-132-191 kubenswrapper[2557]: I0528 00:02:31.408512    2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-kklfx/perf-node-gather-daemonset-bsrpz"]
May 28 00:02:31.522879 ip-10-0-132-191 kubenswrapper[2557]: I0528 00:02:31.522846    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/2740642d-943e-4a6d-ab6b-67f55813b17c-proc\") pod \"perf-node-gather-daemonset-bsrpz\" (UID: \"2740642d-943e-4a6d-ab6b-67f55813b17c\") " pod="openshift-must-gather-kklfx/perf-node-gather-daemonset-bsrpz"
May 28 00:02:31.523071 ip-10-0-132-191 kubenswrapper[2557]: I0528 00:02:31.522890    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/2740642d-943e-4a6d-ab6b-67f55813b17c-podres\") pod \"perf-node-gather-daemonset-bsrpz\" (UID: \"2740642d-943e-4a6d-ab6b-67f55813b17c\") " pod="openshift-must-gather-kklfx/perf-node-gather-daemonset-bsrpz"
May 28 00:02:31.523071 ip-10-0-132-191 kubenswrapper[2557]: I0528 00:02:31.522967    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/2740642d-943e-4a6d-ab6b-67f55813b17c-sys\") pod \"perf-node-gather-daemonset-bsrpz\" (UID: \"2740642d-943e-4a6d-ab6b-67f55813b17c\") " pod="openshift-must-gather-kklfx/perf-node-gather-daemonset-bsrpz"
May 28 00:02:31.523071 ip-10-0-132-191 kubenswrapper[2557]: I0528 00:02:31.523010    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wsp8x\" (UniqueName: \"kubernetes.io/projected/2740642d-943e-4a6d-ab6b-67f55813b17c-kube-api-access-wsp8x\") pod \"perf-node-gather-daemonset-bsrpz\" (UID: \"2740642d-943e-4a6d-ab6b-67f55813b17c\") " pod="openshift-must-gather-kklfx/perf-node-gather-daemonset-bsrpz"
May 28 00:02:31.523071 ip-10-0-132-191 kubenswrapper[2557]: I0528 00:02:31.523055    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/2740642d-943e-4a6d-ab6b-67f55813b17c-lib-modules\") pod \"perf-node-gather-daemonset-bsrpz\" (UID: \"2740642d-943e-4a6d-ab6b-67f55813b17c\") " pod="openshift-must-gather-kklfx/perf-node-gather-daemonset-bsrpz"
May 28 00:02:31.624085 ip-10-0-132-191 kubenswrapper[2557]: I0528 00:02:31.624053    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/2740642d-943e-4a6d-ab6b-67f55813b17c-podres\") pod \"perf-node-gather-daemonset-bsrpz\" (UID: \"2740642d-943e-4a6d-ab6b-67f55813b17c\") " pod="openshift-must-gather-kklfx/perf-node-gather-daemonset-bsrpz"
May 28 00:02:31.624085 ip-10-0-132-191 kubenswrapper[2557]: I0528 00:02:31.624097    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/2740642d-943e-4a6d-ab6b-67f55813b17c-sys\") pod \"perf-node-gather-daemonset-bsrpz\" (UID: \"2740642d-943e-4a6d-ab6b-67f55813b17c\") " pod="openshift-must-gather-kklfx/perf-node-gather-daemonset-bsrpz"
May 28 00:02:31.624295 ip-10-0-132-191 kubenswrapper[2557]: I0528 00:02:31.624120    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-wsp8x\" (UniqueName: \"kubernetes.io/projected/2740642d-943e-4a6d-ab6b-67f55813b17c-kube-api-access-wsp8x\") pod \"perf-node-gather-daemonset-bsrpz\" (UID: \"2740642d-943e-4a6d-ab6b-67f55813b17c\") " pod="openshift-must-gather-kklfx/perf-node-gather-daemonset-bsrpz"
May 28 00:02:31.624295 ip-10-0-132-191 kubenswrapper[2557]: I0528 00:02:31.624183    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/2740642d-943e-4a6d-ab6b-67f55813b17c-lib-modules\") pod \"perf-node-gather-daemonset-bsrpz\" (UID: \"2740642d-943e-4a6d-ab6b-67f55813b17c\") " pod="openshift-must-gather-kklfx/perf-node-gather-daemonset-bsrpz"
May 28 00:02:31.624295 ip-10-0-132-191 kubenswrapper[2557]: I0528 00:02:31.624208    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/2740642d-943e-4a6d-ab6b-67f55813b17c-sys\") pod \"perf-node-gather-daemonset-bsrpz\" (UID: \"2740642d-943e-4a6d-ab6b-67f55813b17c\") " pod="openshift-must-gather-kklfx/perf-node-gather-daemonset-bsrpz"
May 28 00:02:31.624295 ip-10-0-132-191 kubenswrapper[2557]: I0528 00:02:31.624236    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/2740642d-943e-4a6d-ab6b-67f55813b17c-proc\") pod \"perf-node-gather-daemonset-bsrpz\" (UID: \"2740642d-943e-4a6d-ab6b-67f55813b17c\") " pod="openshift-must-gather-kklfx/perf-node-gather-daemonset-bsrpz"
May 28 00:02:31.624295 ip-10-0-132-191 kubenswrapper[2557]: I0528 00:02:31.624236    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/2740642d-943e-4a6d-ab6b-67f55813b17c-podres\") pod \"perf-node-gather-daemonset-bsrpz\" (UID: \"2740642d-943e-4a6d-ab6b-67f55813b17c\") " pod="openshift-must-gather-kklfx/perf-node-gather-daemonset-bsrpz"
May 28 00:02:31.624451 ip-10-0-132-191 kubenswrapper[2557]: I0528 00:02:31.624310    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/2740642d-943e-4a6d-ab6b-67f55813b17c-proc\") pod \"perf-node-gather-daemonset-bsrpz\" (UID: \"2740642d-943e-4a6d-ab6b-67f55813b17c\") " pod="openshift-must-gather-kklfx/perf-node-gather-daemonset-bsrpz"
May 28 00:02:31.624451 ip-10-0-132-191 kubenswrapper[2557]: I0528 00:02:31.624354    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/2740642d-943e-4a6d-ab6b-67f55813b17c-lib-modules\") pod \"perf-node-gather-daemonset-bsrpz\" (UID: \"2740642d-943e-4a6d-ab6b-67f55813b17c\") " pod="openshift-must-gather-kklfx/perf-node-gather-daemonset-bsrpz"
May 28 00:02:31.632248 ip-10-0-132-191 kubenswrapper[2557]: I0528 00:02:31.632218    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wsp8x\" (UniqueName: \"kubernetes.io/projected/2740642d-943e-4a6d-ab6b-67f55813b17c-kube-api-access-wsp8x\") pod \"perf-node-gather-daemonset-bsrpz\" (UID: \"2740642d-943e-4a6d-ab6b-67f55813b17c\") " pod="openshift-must-gather-kklfx/perf-node-gather-daemonset-bsrpz"
May 28 00:02:31.711366 ip-10-0-132-191 kubenswrapper[2557]: I0528 00:02:31.711283    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-kklfx/perf-node-gather-daemonset-bsrpz"
May 28 00:02:32.039905 ip-10-0-132-191 kubenswrapper[2557]: I0528 00:02:32.039830    2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-kklfx/perf-node-gather-daemonset-bsrpz"]
May 28 00:02:32.043123 ip-10-0-132-191 kubenswrapper[2557]: W0528 00:02:32.043096    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod2740642d_943e_4a6d_ab6b_67f55813b17c.slice/crio-e45d387538551ea1ec80e8443b1181f0d11deb6fb13bba880bbab9cd61d24f79 WatchSource:0}: Error finding container e45d387538551ea1ec80e8443b1181f0d11deb6fb13bba880bbab9cd61d24f79: Status 404 returned error can't find the container with id e45d387538551ea1ec80e8443b1181f0d11deb6fb13bba880bbab9cd61d24f79
May 28 00:02:32.772727 ip-10-0-132-191 kubenswrapper[2557]: I0528 00:02:32.772697    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-lbgbp_ce63e7a9-c155-4635-a015-13d077ba097b/dns/0.log"
May 28 00:02:32.796316 ip-10-0-132-191 kubenswrapper[2557]: I0528 00:02:32.796287    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-lbgbp_ce63e7a9-c155-4635-a015-13d077ba097b/kube-rbac-proxy/0.log"
May 28 00:02:32.873935 ip-10-0-132-191 kubenswrapper[2557]: I0528 00:02:32.873906    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-jbbwx_9d47bc2b-bc9c-4887-99e0-c05ffb6c8d0b/dns-node-resolver/0.log"
May 28 00:02:32.893555 ip-10-0-132-191 kubenswrapper[2557]: I0528 00:02:32.893514    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-kklfx/perf-node-gather-daemonset-bsrpz" event={"ID":"2740642d-943e-4a6d-ab6b-67f55813b17c","Type":"ContainerStarted","Data":"53596fee7209a080f985f68fdd36e533f3e471d5076d13cd332f0a7042b6f900"}
May 28 00:02:32.893555 ip-10-0-132-191 kubenswrapper[2557]: I0528 00:02:32.893556    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-kklfx/perf-node-gather-daemonset-bsrpz" event={"ID":"2740642d-943e-4a6d-ab6b-67f55813b17c","Type":"ContainerStarted","Data":"e45d387538551ea1ec80e8443b1181f0d11deb6fb13bba880bbab9cd61d24f79"}
May 28 00:02:32.893811 ip-10-0-132-191 kubenswrapper[2557]: I0528 00:02:32.893612    2557 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-kklfx/perf-node-gather-daemonset-bsrpz"
May 28 00:02:32.910261 ip-10-0-132-191 kubenswrapper[2557]: I0528 00:02:32.910220    2557 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-must-gather-kklfx/perf-node-gather-daemonset-bsrpz" podStartSLOduration=1.910204959 podStartE2EDuration="1.910204959s" podCreationTimestamp="2026-05-28 00:02:31 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-28 00:02:32.90900697 +0000 UTC m=+1768.328542991" watchObservedRunningTime="2026-05-28 00:02:32.910204959 +0000 UTC m=+1768.329741001"
May 28 00:02:33.313825 ip-10-0-132-191 kubenswrapper[2557]: I0528 00:02:33.313795    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-6bgmn_479d4fa9-d4cb-4d0e-82d4-eb0ec77dbc90/node-ca/0.log"
May 28 00:02:34.408684 ip-10-0-132-191 kubenswrapper[2557]: I0528 00:02:34.408652    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-5h2hp_b43c1b7d-e8dd-47eb-8e80-92e5120ae59c/serve-healthcheck-canary/0.log"
May 28 00:02:34.845832 ip-10-0-132-191 kubenswrapper[2557]: I0528 00:02:34.845798    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-pp5wm_a4cbc2b6-9839-4554-8926-9f826a1d2f98/kube-rbac-proxy/0.log"
May 28 00:02:34.868251 ip-10-0-132-191 kubenswrapper[2557]: I0528 00:02:34.868227    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-pp5wm_a4cbc2b6-9839-4554-8926-9f826a1d2f98/exporter/0.log"
May 28 00:02:34.893856 ip-10-0-132-191 kubenswrapper[2557]: I0528 00:02:34.893824    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-pp5wm_a4cbc2b6-9839-4554-8926-9f826a1d2f98/extractor/0.log"
May 28 00:02:38.910430 ip-10-0-132-191 kubenswrapper[2557]: I0528 00:02:38.910405    2557 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-kklfx/perf-node-gather-daemonset-bsrpz"
May 28 00:02:40.573980 ip-10-0-132-191 kubenswrapper[2557]: I0528 00:02:40.573946    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-7p5w7_1a2fc634-3712-40ee-bfce-e8aaee0791f2/kube-multus-additional-cni-plugins/0.log"
May 28 00:02:40.599498 ip-10-0-132-191 kubenswrapper[2557]: I0528 00:02:40.599462    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-7p5w7_1a2fc634-3712-40ee-bfce-e8aaee0791f2/egress-router-binary-copy/0.log"
May 28 00:02:40.626322 ip-10-0-132-191 kubenswrapper[2557]: I0528 00:02:40.626298    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-7p5w7_1a2fc634-3712-40ee-bfce-e8aaee0791f2/cni-plugins/0.log"
May 28 00:02:40.651648 ip-10-0-132-191 kubenswrapper[2557]: I0528 00:02:40.651597    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-7p5w7_1a2fc634-3712-40ee-bfce-e8aaee0791f2/bond-cni-plugin/0.log"
May 28 00:02:40.679123 ip-10-0-132-191 kubenswrapper[2557]: I0528 00:02:40.679090    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-7p5w7_1a2fc634-3712-40ee-bfce-e8aaee0791f2/routeoverride-cni/0.log"
May 28 00:02:40.702530 ip-10-0-132-191 kubenswrapper[2557]: I0528 00:02:40.702501    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-7p5w7_1a2fc634-3712-40ee-bfce-e8aaee0791f2/whereabouts-cni-bincopy/0.log"
May 28 00:02:40.726486 ip-10-0-132-191 kubenswrapper[2557]: I0528 00:02:40.726460    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-7p5w7_1a2fc634-3712-40ee-bfce-e8aaee0791f2/whereabouts-cni/0.log"
May 28 00:02:41.155039 ip-10-0-132-191 kubenswrapper[2557]: I0528 00:02:41.155007    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-h2jmf_5069fad8-69ff-40c6-993b-7d41b872d190/kube-multus/0.log"
May 28 00:02:41.313079 ip-10-0-132-191 kubenswrapper[2557]: I0528 00:02:41.313005    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-zvbqn_c4d68b58-b4f3-4f03-a21c-321ca3eebe68/network-metrics-daemon/0.log"
May 28 00:02:41.338711 ip-10-0-132-191 kubenswrapper[2557]: I0528 00:02:41.338684    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-zvbqn_c4d68b58-b4f3-4f03-a21c-321ca3eebe68/kube-rbac-proxy/0.log"
May 28 00:02:42.665183 ip-10-0-132-191 kubenswrapper[2557]: I0528 00:02:42.665152    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-s7vdp_1b1ca6ef-cc5e-418f-b5a3-acf3a5d38e44/ovn-controller/0.log"
May 28 00:02:42.697786 ip-10-0-132-191 kubenswrapper[2557]: I0528 00:02:42.697761    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-s7vdp_1b1ca6ef-cc5e-418f-b5a3-acf3a5d38e44/ovn-acl-logging/0.log"
May 28 00:02:42.721687 ip-10-0-132-191 kubenswrapper[2557]: I0528 00:02:42.721658    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-s7vdp_1b1ca6ef-cc5e-418f-b5a3-acf3a5d38e44/kube-rbac-proxy-node/0.log"
May 28 00:02:42.745491 ip-10-0-132-191 kubenswrapper[2557]: I0528 00:02:42.745460    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-s7vdp_1b1ca6ef-cc5e-418f-b5a3-acf3a5d38e44/kube-rbac-proxy-ovn-metrics/0.log"
May 28 00:02:42.766049 ip-10-0-132-191 kubenswrapper[2557]: I0528 00:02:42.766023    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-s7vdp_1b1ca6ef-cc5e-418f-b5a3-acf3a5d38e44/northd/0.log"
May 28 00:02:42.789503 ip-10-0-132-191 kubenswrapper[2557]: I0528 00:02:42.789471    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-s7vdp_1b1ca6ef-cc5e-418f-b5a3-acf3a5d38e44/nbdb/0.log"
May 28 00:02:42.812310 ip-10-0-132-191 kubenswrapper[2557]: I0528 00:02:42.812247    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-s7vdp_1b1ca6ef-cc5e-418f-b5a3-acf3a5d38e44/sbdb/0.log"
May 28 00:02:42.986471 ip-10-0-132-191 kubenswrapper[2557]: I0528 00:02:42.986439    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-s7vdp_1b1ca6ef-cc5e-418f-b5a3-acf3a5d38e44/ovnkube-controller/0.log"
May 28 00:02:43.992625 ip-10-0-132-191 kubenswrapper[2557]: I0528 00:02:43.992600    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-diagnostics_network-check-target-tsxk6_4af77c1c-1265-4e74-b12f-28d888f58380/network-check-target-container/0.log"
May 28 00:02:44.882436 ip-10-0-132-191 kubenswrapper[2557]: I0528 00:02:44.882403    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-operator_iptables-alerter-nh9z4_85aeda21-db1b-47a0-abe6-9d2036fc6405/iptables-alerter/0.log"
May 28 00:02:45.564442 ip-10-0-132-191 kubenswrapper[2557]: I0528 00:02:45.564415    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-node-tuning-operator_tuned-hdrgr_74b39582-8199-4302-bd86-7b31f474872b/tuned/0.log"