Sep 17 07:19:42.066252 ip-10-0-132-17 systemd[1]: Starting Kubernetes Kubelet... Sep 17 07:19:42.520837 ip-10-0-132-17 kubenswrapper[2561]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Sep 17 07:19:42.520837 ip-10-0-132-17 kubenswrapper[2561]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Sep 17 07:19:42.520837 ip-10-0-132-17 kubenswrapper[2561]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Sep 17 07:19:42.520837 ip-10-0-132-17 kubenswrapper[2561]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Sep 17 07:19:42.520837 ip-10-0-132-17 kubenswrapper[2561]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Sep 17 07:19:42.522024 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:19:42.521895 2561 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Sep 17 07:19:42.527087 ip-10-0-132-17 kubenswrapper[2561]: W0917 07:19:42.527068 2561 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 17 07:19:42.527087 ip-10-0-132-17 kubenswrapper[2561]: W0917 07:19:42.527086 2561 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 17 07:19:42.527087 ip-10-0-132-17 kubenswrapper[2561]: W0917 07:19:42.527092 2561 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 17 07:19:42.527287 ip-10-0-132-17 kubenswrapper[2561]: W0917 07:19:42.527096 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 17 07:19:42.527287 ip-10-0-132-17 kubenswrapper[2561]: W0917 07:19:42.527102 2561 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 17 07:19:42.527287 ip-10-0-132-17 kubenswrapper[2561]: W0917 07:19:42.527106 2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 17 07:19:42.527287 ip-10-0-132-17 kubenswrapper[2561]: W0917 07:19:42.527110 2561 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 17 07:19:42.527287 ip-10-0-132-17 kubenswrapper[2561]: W0917 07:19:42.527114 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 17 07:19:42.527287 ip-10-0-132-17 kubenswrapper[2561]: W0917 07:19:42.527118 2561 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 17 07:19:42.527287 ip-10-0-132-17 kubenswrapper[2561]: W0917 07:19:42.527122 2561 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 17 07:19:42.527287 ip-10-0-132-17 kubenswrapper[2561]: W0917 07:19:42.527126 2561 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 17 07:19:42.527287 ip-10-0-132-17 kubenswrapper[2561]: W0917 07:19:42.527129 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 17 07:19:42.527287 ip-10-0-132-17 kubenswrapper[2561]: W0917 07:19:42.527135 2561 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 17 07:19:42.527287 ip-10-0-132-17 kubenswrapper[2561]: W0917 07:19:42.527139 2561 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 17 07:19:42.527287 ip-10-0-132-17 kubenswrapper[2561]: W0917 07:19:42.527143 2561 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 17 07:19:42.527287 ip-10-0-132-17 kubenswrapper[2561]: W0917 07:19:42.527147 2561 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 17 07:19:42.527287 ip-10-0-132-17 kubenswrapper[2561]: W0917 07:19:42.527151 2561 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 17 07:19:42.527287 ip-10-0-132-17 kubenswrapper[2561]: W0917 07:19:42.527156 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 17 07:19:42.527287 ip-10-0-132-17 kubenswrapper[2561]: W0917 07:19:42.527160 2561 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 17 07:19:42.527287 ip-10-0-132-17 kubenswrapper[2561]: W0917 07:19:42.527164 2561 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 17 07:19:42.527287 ip-10-0-132-17 kubenswrapper[2561]: W0917 07:19:42.527168 2561 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 17 07:19:42.527287 ip-10-0-132-17 kubenswrapper[2561]: W0917 07:19:42.527172 2561 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 17 07:19:42.528112 ip-10-0-132-17 kubenswrapper[2561]: W0917 07:19:42.527176 2561 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 17 07:19:42.528112 ip-10-0-132-17 kubenswrapper[2561]: W0917 07:19:42.527180 2561 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 17 07:19:42.528112 ip-10-0-132-17 kubenswrapper[2561]: W0917 07:19:42.527184 2561 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 17 07:19:42.528112 ip-10-0-132-17 kubenswrapper[2561]: W0917 07:19:42.527188 2561 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 17 07:19:42.528112 ip-10-0-132-17 kubenswrapper[2561]: W0917 07:19:42.527192 2561 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 17 07:19:42.528112 ip-10-0-132-17 kubenswrapper[2561]: W0917 07:19:42.527197 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 17 07:19:42.528112 ip-10-0-132-17 kubenswrapper[2561]: W0917 07:19:42.527201 2561 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 17 07:19:42.528112 ip-10-0-132-17 kubenswrapper[2561]: W0917 07:19:42.527206 2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 17 07:19:42.528112 ip-10-0-132-17 kubenswrapper[2561]: W0917 07:19:42.527210 2561 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 17 07:19:42.528112 ip-10-0-132-17 kubenswrapper[2561]: W0917 07:19:42.527214 2561 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 17 07:19:42.528112 ip-10-0-132-17 kubenswrapper[2561]: W0917 07:19:42.527218 2561 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 17 07:19:42.528112 ip-10-0-132-17 kubenswrapper[2561]: W0917 07:19:42.527222 2561 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 17 07:19:42.528112 ip-10-0-132-17 kubenswrapper[2561]: W0917 07:19:42.527227 2561 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 17 07:19:42.528112 ip-10-0-132-17 kubenswrapper[2561]: W0917 07:19:42.527231 2561 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 17 07:19:42.528112 ip-10-0-132-17 kubenswrapper[2561]: W0917 07:19:42.527236 2561 feature_gate.go:328] unrecognized feature gate: Example Sep 17 07:19:42.528112 ip-10-0-132-17 kubenswrapper[2561]: W0917 07:19:42.527240 2561 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 17 07:19:42.528112 ip-10-0-132-17 kubenswrapper[2561]: W0917 07:19:42.527244 2561 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 17 07:19:42.528112 ip-10-0-132-17 kubenswrapper[2561]: W0917 07:19:42.527248 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 17 07:19:42.528112 ip-10-0-132-17 kubenswrapper[2561]: W0917 07:19:42.527254 2561 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 17 07:19:42.528978 ip-10-0-132-17 kubenswrapper[2561]: W0917 07:19:42.527260 2561 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 17 07:19:42.528978 ip-10-0-132-17 kubenswrapper[2561]: W0917 07:19:42.527274 2561 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 17 07:19:42.528978 ip-10-0-132-17 kubenswrapper[2561]: W0917 07:19:42.527278 2561 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 17 07:19:42.528978 ip-10-0-132-17 kubenswrapper[2561]: W0917 07:19:42.527283 2561 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 17 07:19:42.528978 ip-10-0-132-17 kubenswrapper[2561]: W0917 07:19:42.527286 2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 17 07:19:42.528978 ip-10-0-132-17 kubenswrapper[2561]: W0917 07:19:42.527290 2561 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 17 07:19:42.528978 ip-10-0-132-17 kubenswrapper[2561]: W0917 07:19:42.527294 2561 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 17 07:19:42.528978 ip-10-0-132-17 kubenswrapper[2561]: W0917 07:19:42.527299 2561 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 17 07:19:42.528978 ip-10-0-132-17 kubenswrapper[2561]: W0917 07:19:42.527303 2561 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 17 07:19:42.528978 ip-10-0-132-17 kubenswrapper[2561]: W0917 07:19:42.527307 2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 17 07:19:42.528978 ip-10-0-132-17 kubenswrapper[2561]: W0917 07:19:42.527311 2561 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 17 07:19:42.528978 ip-10-0-132-17 kubenswrapper[2561]: W0917 07:19:42.527317 2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 17 07:19:42.528978 ip-10-0-132-17 kubenswrapper[2561]: W0917 07:19:42.527322 2561 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 17 07:19:42.528978 ip-10-0-132-17 kubenswrapper[2561]: W0917 07:19:42.527325 2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 17 07:19:42.528978 ip-10-0-132-17 kubenswrapper[2561]: W0917 07:19:42.527330 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 17 07:19:42.528978 ip-10-0-132-17 kubenswrapper[2561]: W0917 07:19:42.527335 2561 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 17 07:19:42.528978 ip-10-0-132-17 kubenswrapper[2561]: W0917 07:19:42.527339 2561 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 17 07:19:42.528978 ip-10-0-132-17 kubenswrapper[2561]: W0917 07:19:42.527344 2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 17 07:19:42.528978 ip-10-0-132-17 kubenswrapper[2561]: W0917 07:19:42.527348 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 17 07:19:42.528978 ip-10-0-132-17 kubenswrapper[2561]: W0917 07:19:42.527352 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 17 07:19:42.529819 ip-10-0-132-17 kubenswrapper[2561]: W0917 07:19:42.527356 2561 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 17 07:19:42.529819 ip-10-0-132-17 kubenswrapper[2561]: W0917 07:19:42.527361 2561 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 17 07:19:42.529819 ip-10-0-132-17 kubenswrapper[2561]: W0917 07:19:42.527364 2561 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 17 07:19:42.529819 ip-10-0-132-17 kubenswrapper[2561]: W0917 07:19:42.527369 2561 feature_gate.go:328] unrecognized feature gate: Example2 Sep 17 07:19:42.529819 ip-10-0-132-17 kubenswrapper[2561]: W0917 07:19:42.527373 2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 17 07:19:42.529819 ip-10-0-132-17 kubenswrapper[2561]: W0917 07:19:42.527376 2561 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 17 07:19:42.529819 ip-10-0-132-17 kubenswrapper[2561]: W0917 07:19:42.527381 2561 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 17 07:19:42.529819 ip-10-0-132-17 kubenswrapper[2561]: W0917 07:19:42.527385 2561 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 17 07:19:42.529819 ip-10-0-132-17 kubenswrapper[2561]: W0917 07:19:42.527389 2561 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 17 07:19:42.529819 ip-10-0-132-17 kubenswrapper[2561]: W0917 07:19:42.527393 2561 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 17 07:19:42.529819 ip-10-0-132-17 kubenswrapper[2561]: W0917 07:19:42.527398 2561 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 17 07:19:42.529819 ip-10-0-132-17 kubenswrapper[2561]: W0917 07:19:42.527402 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 17 07:19:42.529819 ip-10-0-132-17 kubenswrapper[2561]: W0917 07:19:42.527407 2561 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 17 07:19:42.529819 ip-10-0-132-17 kubenswrapper[2561]: W0917 07:19:42.527411 2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 17 07:19:42.529819 ip-10-0-132-17 kubenswrapper[2561]: W0917 07:19:42.527423 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 17 07:19:42.529819 ip-10-0-132-17 kubenswrapper[2561]: W0917 07:19:42.527427 2561 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 17 07:19:42.529819 ip-10-0-132-17 kubenswrapper[2561]: W0917 07:19:42.527431 2561 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 17 07:19:42.529819 ip-10-0-132-17 kubenswrapper[2561]: W0917 07:19:42.527435 2561 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 17 07:19:42.529819 ip-10-0-132-17 kubenswrapper[2561]: W0917 07:19:42.527439 2561 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 17 07:19:42.529819 ip-10-0-132-17 kubenswrapper[2561]: W0917 07:19:42.527443 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 17 07:19:42.529819 ip-10-0-132-17 kubenswrapper[2561]: W0917 07:19:42.527447 2561 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 17 07:19:42.530758 ip-10-0-132-17 kubenswrapper[2561]: W0917 07:19:42.527452 2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 17 07:19:42.530758 ip-10-0-132-17 kubenswrapper[2561]: W0917 07:19:42.527456 2561 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 17 07:19:42.530758 ip-10-0-132-17 kubenswrapper[2561]: W0917 07:19:42.527460 2561 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 17 07:19:42.530758 ip-10-0-132-17 kubenswrapper[2561]: W0917 07:19:42.527464 2561 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 17 07:19:42.530758 ip-10-0-132-17 kubenswrapper[2561]: W0917 07:19:42.527468 2561 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 17 07:19:42.530758 ip-10-0-132-17 kubenswrapper[2561]: W0917 07:19:42.527472 2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 17 07:19:42.530758 ip-10-0-132-17 kubenswrapper[2561]: W0917 07:19:42.527476 2561 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 17 07:19:42.530758 ip-10-0-132-17 kubenswrapper[2561]: W0917 07:19:42.527480 2561 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 17 07:19:42.530758 ip-10-0-132-17 kubenswrapper[2561]: W0917 07:19:42.527484 2561 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 17 07:19:42.530758 ip-10-0-132-17 kubenswrapper[2561]: W0917 07:19:42.527488 2561 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 17 07:19:42.530758 ip-10-0-132-17 kubenswrapper[2561]: W0917 07:19:42.527492 2561 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 17 07:19:42.530758 ip-10-0-132-17 kubenswrapper[2561]: W0917 07:19:42.527497 2561 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 17 07:19:42.530758 ip-10-0-132-17 kubenswrapper[2561]: W0917 07:19:42.527501 2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 17 07:19:42.530758 ip-10-0-132-17 kubenswrapper[2561]: W0917 07:19:42.527505 2561 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 17 07:19:42.530758 ip-10-0-132-17 kubenswrapper[2561]: W0917 07:19:42.527509 2561 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 17 07:19:42.530758 ip-10-0-132-17 kubenswrapper[2561]: W0917 07:19:42.527513 2561 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 17 07:19:42.530758 ip-10-0-132-17 kubenswrapper[2561]: W0917 07:19:42.527517 2561 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 17 07:19:42.530758 ip-10-0-132-17 kubenswrapper[2561]: W0917 07:19:42.528734 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 17 07:19:42.530758 ip-10-0-132-17 kubenswrapper[2561]: W0917 07:19:42.528748 2561 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 17 07:19:42.531600 ip-10-0-132-17 kubenswrapper[2561]: W0917 07:19:42.528754 2561 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 17 07:19:42.531600 ip-10-0-132-17 kubenswrapper[2561]: W0917 07:19:42.528759 2561 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 17 07:19:42.531600 ip-10-0-132-17 kubenswrapper[2561]: W0917 07:19:42.528765 2561 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 17 07:19:42.531600 ip-10-0-132-17 kubenswrapper[2561]: W0917 07:19:42.528769 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 17 07:19:42.531600 ip-10-0-132-17 kubenswrapper[2561]: W0917 07:19:42.528773 2561 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 17 07:19:42.531600 ip-10-0-132-17 kubenswrapper[2561]: W0917 07:19:42.528777 2561 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 17 07:19:42.531600 ip-10-0-132-17 kubenswrapper[2561]: W0917 07:19:42.528782 2561 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 17 07:19:42.531600 ip-10-0-132-17 kubenswrapper[2561]: W0917 07:19:42.528787 2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 17 07:19:42.531600 ip-10-0-132-17 kubenswrapper[2561]: W0917 07:19:42.528791 2561 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 17 07:19:42.531600 ip-10-0-132-17 kubenswrapper[2561]: W0917 07:19:42.528796 2561 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 17 07:19:42.531600 ip-10-0-132-17 kubenswrapper[2561]: W0917 07:19:42.528801 2561 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 17 07:19:42.531600 ip-10-0-132-17 kubenswrapper[2561]: W0917 07:19:42.528808 2561 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 17 07:19:42.531600 ip-10-0-132-17 kubenswrapper[2561]: W0917 07:19:42.528813 2561 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 17 07:19:42.531600 ip-10-0-132-17 kubenswrapper[2561]: W0917 07:19:42.528817 2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 17 07:19:42.531600 ip-10-0-132-17 kubenswrapper[2561]: W0917 07:19:42.528821 2561 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 17 07:19:42.531600 ip-10-0-132-17 kubenswrapper[2561]: W0917 07:19:42.528826 2561 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 17 07:19:42.531600 ip-10-0-132-17 kubenswrapper[2561]: W0917 07:19:42.528830 2561 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 17 07:19:42.531600 ip-10-0-132-17 kubenswrapper[2561]: W0917 07:19:42.528834 2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 17 07:19:42.531600 ip-10-0-132-17 kubenswrapper[2561]: W0917 07:19:42.528838 2561 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 17 07:19:42.532276 ip-10-0-132-17 kubenswrapper[2561]: W0917 07:19:42.528843 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 17 07:19:42.532276 ip-10-0-132-17 kubenswrapper[2561]: W0917 07:19:42.528847 2561 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 17 07:19:42.532276 ip-10-0-132-17 kubenswrapper[2561]: W0917 07:19:42.528851 2561 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 17 07:19:42.532276 ip-10-0-132-17 kubenswrapper[2561]: W0917 07:19:42.528856 2561 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 17 07:19:42.532276 ip-10-0-132-17 kubenswrapper[2561]: W0917 07:19:42.528860 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 17 07:19:42.532276 ip-10-0-132-17 kubenswrapper[2561]: W0917 07:19:42.528864 2561 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 17 07:19:42.532276 ip-10-0-132-17 kubenswrapper[2561]: W0917 07:19:42.528868 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 17 07:19:42.532276 ip-10-0-132-17 kubenswrapper[2561]: W0917 07:19:42.528872 2561 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 17 07:19:42.532276 ip-10-0-132-17 kubenswrapper[2561]: W0917 07:19:42.528876 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 17 07:19:42.532276 ip-10-0-132-17 kubenswrapper[2561]: W0917 07:19:42.528880 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 17 07:19:42.532276 ip-10-0-132-17 kubenswrapper[2561]: W0917 07:19:42.528885 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 17 07:19:42.532276 ip-10-0-132-17 kubenswrapper[2561]: W0917 07:19:42.528889 2561 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 17 07:19:42.532276 ip-10-0-132-17 kubenswrapper[2561]: W0917 07:19:42.528894 2561 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 17 07:19:42.532276 ip-10-0-132-17 kubenswrapper[2561]: W0917 07:19:42.528899 2561 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 17 07:19:42.532276 ip-10-0-132-17 kubenswrapper[2561]: W0917 07:19:42.528904 2561 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 17 07:19:42.532276 ip-10-0-132-17 kubenswrapper[2561]: W0917 07:19:42.528908 2561 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 17 07:19:42.532276 ip-10-0-132-17 kubenswrapper[2561]: W0917 07:19:42.528913 2561 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 17 07:19:42.532276 ip-10-0-132-17 kubenswrapper[2561]: W0917 07:19:42.528916 2561 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 17 07:19:42.532276 ip-10-0-132-17 kubenswrapper[2561]: W0917 07:19:42.528920 2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 17 07:19:42.532276 ip-10-0-132-17 kubenswrapper[2561]: W0917 07:19:42.528924 2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 17 07:19:42.532776 ip-10-0-132-17 kubenswrapper[2561]: W0917 07:19:42.528949 2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 17 07:19:42.532776 ip-10-0-132-17 kubenswrapper[2561]: W0917 07:19:42.528954 2561 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 17 07:19:42.532776 ip-10-0-132-17 kubenswrapper[2561]: W0917 07:19:42.528959 2561 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 17 07:19:42.532776 ip-10-0-132-17 kubenswrapper[2561]: W0917 07:19:42.528963 2561 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 17 07:19:42.532776 ip-10-0-132-17 kubenswrapper[2561]: W0917 07:19:42.528967 2561 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 17 07:19:42.532776 ip-10-0-132-17 kubenswrapper[2561]: W0917 07:19:42.528972 2561 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 17 07:19:42.532776 ip-10-0-132-17 kubenswrapper[2561]: W0917 07:19:42.528975 2561 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 17 07:19:42.532776 ip-10-0-132-17 kubenswrapper[2561]: W0917 07:19:42.528979 2561 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 17 07:19:42.532776 ip-10-0-132-17 kubenswrapper[2561]: W0917 07:19:42.528983 2561 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 17 07:19:42.532776 ip-10-0-132-17 kubenswrapper[2561]: W0917 07:19:42.528987 2561 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 17 07:19:42.532776 ip-10-0-132-17 kubenswrapper[2561]: W0917 07:19:42.528991 2561 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 17 07:19:42.532776 ip-10-0-132-17 kubenswrapper[2561]: W0917 07:19:42.528995 2561 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 17 07:19:42.532776 ip-10-0-132-17 kubenswrapper[2561]: W0917 07:19:42.528998 2561 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 17 07:19:42.532776 ip-10-0-132-17 kubenswrapper[2561]: W0917 07:19:42.529002 2561 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 17 07:19:42.532776 ip-10-0-132-17 kubenswrapper[2561]: W0917 07:19:42.529007 2561 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 17 07:19:42.532776 ip-10-0-132-17 kubenswrapper[2561]: W0917 07:19:42.529011 2561 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 17 07:19:42.532776 ip-10-0-132-17 kubenswrapper[2561]: W0917 07:19:42.529016 2561 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 17 07:19:42.532776 ip-10-0-132-17 kubenswrapper[2561]: W0917 07:19:42.529019 2561 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 17 07:19:42.532776 ip-10-0-132-17 kubenswrapper[2561]: W0917 07:19:42.529024 2561 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 17 07:19:42.532776 ip-10-0-132-17 kubenswrapper[2561]: W0917 07:19:42.529028 2561 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 17 07:19:42.533293 ip-10-0-132-17 kubenswrapper[2561]: W0917 07:19:42.529032 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 17 07:19:42.533293 ip-10-0-132-17 kubenswrapper[2561]: W0917 07:19:42.529036 2561 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 17 07:19:42.533293 ip-10-0-132-17 kubenswrapper[2561]: W0917 07:19:42.529040 2561 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 17 07:19:42.533293 ip-10-0-132-17 kubenswrapper[2561]: W0917 07:19:42.529044 2561 feature_gate.go:328] unrecognized feature gate: Example2 Sep 17 07:19:42.533293 ip-10-0-132-17 kubenswrapper[2561]: W0917 07:19:42.529048 2561 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 17 07:19:42.533293 ip-10-0-132-17 kubenswrapper[2561]: W0917 07:19:42.529052 2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 17 07:19:42.533293 ip-10-0-132-17 kubenswrapper[2561]: W0917 07:19:42.529057 2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 17 07:19:42.533293 ip-10-0-132-17 kubenswrapper[2561]: W0917 07:19:42.529061 2561 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 17 07:19:42.533293 ip-10-0-132-17 kubenswrapper[2561]: W0917 07:19:42.529066 2561 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 17 07:19:42.533293 ip-10-0-132-17 kubenswrapper[2561]: W0917 07:19:42.529070 2561 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 17 07:19:42.533293 ip-10-0-132-17 kubenswrapper[2561]: W0917 07:19:42.529074 2561 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 17 07:19:42.533293 ip-10-0-132-17 kubenswrapper[2561]: W0917 07:19:42.529079 2561 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 17 07:19:42.533293 ip-10-0-132-17 kubenswrapper[2561]: W0917 07:19:42.529083 2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 17 07:19:42.533293 ip-10-0-132-17 kubenswrapper[2561]: W0917 07:19:42.529087 2561 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 17 07:19:42.533293 ip-10-0-132-17 kubenswrapper[2561]: W0917 07:19:42.529093 2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 17 07:19:42.533293 ip-10-0-132-17 kubenswrapper[2561]: W0917 07:19:42.529097 2561 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 17 07:19:42.533293 ip-10-0-132-17 kubenswrapper[2561]: W0917 07:19:42.529101 2561 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 17 07:19:42.533293 ip-10-0-132-17 kubenswrapper[2561]: W0917 07:19:42.529105 2561 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 17 07:19:42.533293 ip-10-0-132-17 kubenswrapper[2561]: W0917 07:19:42.529109 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 17 07:19:42.533293 ip-10-0-132-17 kubenswrapper[2561]: W0917 07:19:42.529114 2561 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 17 07:19:42.533781 ip-10-0-132-17 kubenswrapper[2561]: W0917 07:19:42.529118 2561 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 17 07:19:42.533781 ip-10-0-132-17 kubenswrapper[2561]: W0917 07:19:42.529122 2561 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 17 07:19:42.533781 ip-10-0-132-17 kubenswrapper[2561]: W0917 07:19:42.529126 2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 17 07:19:42.533781 ip-10-0-132-17 kubenswrapper[2561]: W0917 07:19:42.529132 2561 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 17 07:19:42.533781 ip-10-0-132-17 kubenswrapper[2561]: W0917 07:19:42.529138 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 17 07:19:42.533781 ip-10-0-132-17 kubenswrapper[2561]: W0917 07:19:42.529143 2561 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 17 07:19:42.533781 ip-10-0-132-17 kubenswrapper[2561]: W0917 07:19:42.529148 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 17 07:19:42.533781 ip-10-0-132-17 kubenswrapper[2561]: W0917 07:19:42.529152 2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 17 07:19:42.533781 ip-10-0-132-17 kubenswrapper[2561]: W0917 07:19:42.529157 2561 feature_gate.go:328] unrecognized feature gate: Example Sep 17 07:19:42.533781 ip-10-0-132-17 kubenswrapper[2561]: W0917 07:19:42.529161 2561 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 17 07:19:42.533781 ip-10-0-132-17 kubenswrapper[2561]: W0917 07:19:42.529169 2561 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 17 07:19:42.533781 ip-10-0-132-17 kubenswrapper[2561]: W0917 07:19:42.529175 2561 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 17 07:19:42.533781 ip-10-0-132-17 kubenswrapper[2561]: W0917 07:19:42.529179 2561 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 17 07:19:42.533781 ip-10-0-132-17 kubenswrapper[2561]: W0917 07:19:42.529184 2561 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 17 07:19:42.533781 ip-10-0-132-17 kubenswrapper[2561]: W0917 07:19:42.529189 2561 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 17 07:19:42.533781 ip-10-0-132-17 kubenswrapper[2561]: W0917 07:19:42.529194 2561 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 17 07:19:42.533781 ip-10-0-132-17 kubenswrapper[2561]: W0917 07:19:42.529199 2561 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 17 07:19:42.533781 ip-10-0-132-17 kubenswrapper[2561]: W0917 07:19:42.529203 2561 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 17 07:19:42.533781 ip-10-0-132-17 kubenswrapper[2561]: W0917 07:19:42.529801 2561 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 17 07:19:42.534288 ip-10-0-132-17 kubenswrapper[2561]: W0917 07:19:42.529809 2561 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 17 07:19:42.534288 ip-10-0-132-17 kubenswrapper[2561]: W0917 07:19:42.529813 2561 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 17 07:19:42.534288 ip-10-0-132-17 kubenswrapper[2561]: W0917 07:19:42.529818 2561 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 17 07:19:42.534288 ip-10-0-132-17 kubenswrapper[2561]: W0917 07:19:42.529822 2561 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 17 07:19:42.534288 ip-10-0-132-17 kubenswrapper[2561]: W0917 07:19:42.529826 2561 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 17 07:19:42.534288 ip-10-0-132-17 kubenswrapper[2561]: W0917 07:19:42.529830 2561 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 17 07:19:42.534288 ip-10-0-132-17 kubenswrapper[2561]: W0917 07:19:42.529834 2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 17 07:19:42.534288 ip-10-0-132-17 kubenswrapper[2561]: W0917 07:19:42.529852 2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 17 07:19:42.534288 ip-10-0-132-17 kubenswrapper[2561]: W0917 07:19:42.529857 2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 17 07:19:42.534288 ip-10-0-132-17 kubenswrapper[2561]: W0917 07:19:42.529864 2561 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 17 07:19:42.534288 ip-10-0-132-17 kubenswrapper[2561]: W0917 07:19:42.529870 2561 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 17 07:19:42.534288 ip-10-0-132-17 kubenswrapper[2561]: W0917 07:19:42.529875 2561 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 17 07:19:42.534288 ip-10-0-132-17 kubenswrapper[2561]: W0917 07:19:42.529880 2561 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 17 07:19:42.534288 ip-10-0-132-17 kubenswrapper[2561]: W0917 07:19:42.529884 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 17 07:19:42.534288 ip-10-0-132-17 kubenswrapper[2561]: W0917 07:19:42.529889 2561 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 17 07:19:42.534288 ip-10-0-132-17 kubenswrapper[2561]: W0917 07:19:42.529892 2561 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 17 07:19:42.534288 ip-10-0-132-17 kubenswrapper[2561]: W0917 07:19:42.529896 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 17 07:19:42.534288 ip-10-0-132-17 kubenswrapper[2561]: W0917 07:19:42.529901 2561 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 17 07:19:42.534288 ip-10-0-132-17 kubenswrapper[2561]: W0917 07:19:42.529905 2561 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 17 07:19:42.534288 ip-10-0-132-17 kubenswrapper[2561]: W0917 07:19:42.529909 2561 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 17 07:19:42.534787 ip-10-0-132-17 kubenswrapper[2561]: W0917 07:19:42.529913 2561 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 17 07:19:42.534787 ip-10-0-132-17 kubenswrapper[2561]: W0917 07:19:42.529917 2561 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 17 07:19:42.534787 ip-10-0-132-17 kubenswrapper[2561]: W0917 07:19:42.529922 2561 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 17 07:19:42.534787 ip-10-0-132-17 kubenswrapper[2561]: W0917 07:19:42.529945 2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 17 07:19:42.534787 ip-10-0-132-17 kubenswrapper[2561]: W0917 07:19:42.529951 2561 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 17 07:19:42.534787 ip-10-0-132-17 kubenswrapper[2561]: W0917 07:19:42.529955 2561 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 17 07:19:42.534787 ip-10-0-132-17 kubenswrapper[2561]: W0917 07:19:42.529959 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 17 07:19:42.534787 ip-10-0-132-17 kubenswrapper[2561]: W0917 07:19:42.529963 2561 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 17 07:19:42.534787 ip-10-0-132-17 kubenswrapper[2561]: W0917 07:19:42.529968 2561 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 17 07:19:42.534787 ip-10-0-132-17 kubenswrapper[2561]: W0917 07:19:42.529972 2561 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 17 07:19:42.534787 ip-10-0-132-17 kubenswrapper[2561]: W0917 07:19:42.529976 2561 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 17 07:19:42.534787 ip-10-0-132-17 kubenswrapper[2561]: W0917 07:19:42.529980 2561 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 17 07:19:42.534787 ip-10-0-132-17 kubenswrapper[2561]: W0917 07:19:42.529984 2561 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 17 07:19:42.534787 ip-10-0-132-17 kubenswrapper[2561]: W0917 07:19:42.529988 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 17 07:19:42.534787 ip-10-0-132-17 kubenswrapper[2561]: W0917 07:19:42.529992 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 17 07:19:42.534787 ip-10-0-132-17 kubenswrapper[2561]: W0917 07:19:42.529997 2561 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 17 07:19:42.534787 ip-10-0-132-17 kubenswrapper[2561]: W0917 07:19:42.530000 2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 17 07:19:42.534787 ip-10-0-132-17 kubenswrapper[2561]: W0917 07:19:42.530005 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 17 07:19:42.534787 ip-10-0-132-17 kubenswrapper[2561]: W0917 07:19:42.530009 2561 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 17 07:19:42.534787 ip-10-0-132-17 kubenswrapper[2561]: W0917 07:19:42.530015 2561 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 17 07:19:42.535278 ip-10-0-132-17 kubenswrapper[2561]: W0917 07:19:42.530023 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 17 07:19:42.535278 ip-10-0-132-17 kubenswrapper[2561]: W0917 07:19:42.530028 2561 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 17 07:19:42.535278 ip-10-0-132-17 kubenswrapper[2561]: W0917 07:19:42.530032 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 17 07:19:42.535278 ip-10-0-132-17 kubenswrapper[2561]: W0917 07:19:42.530037 2561 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 17 07:19:42.535278 ip-10-0-132-17 kubenswrapper[2561]: W0917 07:19:42.530041 2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 17 07:19:42.535278 ip-10-0-132-17 kubenswrapper[2561]: W0917 07:19:42.530045 2561 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 17 07:19:42.535278 ip-10-0-132-17 kubenswrapper[2561]: W0917 07:19:42.530049 2561 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 17 07:19:42.535278 ip-10-0-132-17 kubenswrapper[2561]: W0917 07:19:42.530053 2561 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 17 07:19:42.535278 ip-10-0-132-17 kubenswrapper[2561]: W0917 07:19:42.530057 2561 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 17 07:19:42.535278 ip-10-0-132-17 kubenswrapper[2561]: W0917 07:19:42.530062 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 17 07:19:42.535278 ip-10-0-132-17 kubenswrapper[2561]: W0917 07:19:42.530067 2561 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 17 07:19:42.535278 ip-10-0-132-17 kubenswrapper[2561]: W0917 07:19:42.530071 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 17 07:19:42.535278 ip-10-0-132-17 kubenswrapper[2561]: W0917 07:19:42.530075 2561 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 17 07:19:42.535278 ip-10-0-132-17 kubenswrapper[2561]: W0917 07:19:42.530080 2561 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 17 07:19:42.535278 ip-10-0-132-17 kubenswrapper[2561]: W0917 07:19:42.530085 2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 17 07:19:42.535278 ip-10-0-132-17 kubenswrapper[2561]: W0917 07:19:42.530089 2561 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 17 07:19:42.535278 ip-10-0-132-17 kubenswrapper[2561]: W0917 07:19:42.530093 2561 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 17 07:19:42.535278 ip-10-0-132-17 kubenswrapper[2561]: W0917 07:19:42.530097 2561 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 17 07:19:42.535278 ip-10-0-132-17 kubenswrapper[2561]: W0917 07:19:42.530101 2561 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 17 07:19:42.535758 ip-10-0-132-17 kubenswrapper[2561]: W0917 07:19:42.530106 2561 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 17 07:19:42.535758 ip-10-0-132-17 kubenswrapper[2561]: W0917 07:19:42.530110 2561 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 17 07:19:42.535758 ip-10-0-132-17 kubenswrapper[2561]: W0917 07:19:42.530117 2561 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 17 07:19:42.535758 ip-10-0-132-17 kubenswrapper[2561]: W0917 07:19:42.530121 2561 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 17 07:19:42.535758 ip-10-0-132-17 kubenswrapper[2561]: W0917 07:19:42.530126 2561 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 17 07:19:42.535758 ip-10-0-132-17 kubenswrapper[2561]: W0917 07:19:42.530131 2561 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 17 07:19:42.535758 ip-10-0-132-17 kubenswrapper[2561]: W0917 07:19:42.530135 2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 17 07:19:42.535758 ip-10-0-132-17 kubenswrapper[2561]: W0917 07:19:42.530140 2561 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 17 07:19:42.535758 ip-10-0-132-17 kubenswrapper[2561]: W0917 07:19:42.530144 2561 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 17 07:19:42.535758 ip-10-0-132-17 kubenswrapper[2561]: W0917 07:19:42.530148 2561 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 17 07:19:42.535758 ip-10-0-132-17 kubenswrapper[2561]: W0917 07:19:42.530152 2561 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 17 07:19:42.535758 ip-10-0-132-17 kubenswrapper[2561]: W0917 07:19:42.530156 2561 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 17 07:19:42.535758 ip-10-0-132-17 kubenswrapper[2561]: W0917 07:19:42.530161 2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 17 07:19:42.535758 ip-10-0-132-17 kubenswrapper[2561]: W0917 07:19:42.530165 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 17 07:19:42.535758 ip-10-0-132-17 kubenswrapper[2561]: W0917 07:19:42.530170 2561 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 17 07:19:42.535758 ip-10-0-132-17 kubenswrapper[2561]: W0917 07:19:42.530174 2561 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 17 07:19:42.535758 ip-10-0-132-17 kubenswrapper[2561]: W0917 07:19:42.530180 2561 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 17 07:19:42.535758 ip-10-0-132-17 kubenswrapper[2561]: W0917 07:19:42.530185 2561 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 17 07:19:42.535758 ip-10-0-132-17 kubenswrapper[2561]: W0917 07:19:42.530189 2561 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 17 07:19:42.535758 ip-10-0-132-17 kubenswrapper[2561]: W0917 07:19:42.530193 2561 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 17 07:19:42.536256 ip-10-0-132-17 kubenswrapper[2561]: W0917 07:19:42.530197 2561 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 17 07:19:42.536256 ip-10-0-132-17 kubenswrapper[2561]: W0917 07:19:42.530201 2561 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 17 07:19:42.536256 ip-10-0-132-17 kubenswrapper[2561]: W0917 07:19:42.530205 2561 feature_gate.go:328] unrecognized feature gate: Example2 Sep 17 07:19:42.536256 ip-10-0-132-17 kubenswrapper[2561]: W0917 07:19:42.530210 2561 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 17 07:19:42.536256 ip-10-0-132-17 kubenswrapper[2561]: W0917 07:19:42.530214 2561 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 17 07:19:42.536256 ip-10-0-132-17 kubenswrapper[2561]: W0917 07:19:42.530218 2561 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 17 07:19:42.536256 ip-10-0-132-17 kubenswrapper[2561]: W0917 07:19:42.530222 2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 17 07:19:42.536256 ip-10-0-132-17 kubenswrapper[2561]: W0917 07:19:42.530228 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 17 07:19:42.536256 ip-10-0-132-17 kubenswrapper[2561]: W0917 07:19:42.530232 2561 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 17 07:19:42.536256 ip-10-0-132-17 kubenswrapper[2561]: W0917 07:19:42.530236 2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 17 07:19:42.536256 ip-10-0-132-17 kubenswrapper[2561]: W0917 07:19:42.530240 2561 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 17 07:19:42.536256 ip-10-0-132-17 kubenswrapper[2561]: W0917 07:19:42.530244 2561 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 17 07:19:42.536256 ip-10-0-132-17 kubenswrapper[2561]: W0917 07:19:42.530248 2561 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 17 07:19:42.536256 ip-10-0-132-17 kubenswrapper[2561]: W0917 07:19:42.530252 2561 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 17 07:19:42.536256 ip-10-0-132-17 kubenswrapper[2561]: W0917 07:19:42.530258 2561 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 17 07:19:42.536256 ip-10-0-132-17 kubenswrapper[2561]: W0917 07:19:42.530262 2561 feature_gate.go:328] unrecognized feature gate: Example Sep 17 07:19:42.536256 ip-10-0-132-17 kubenswrapper[2561]: W0917 07:19:42.530266 2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 17 07:19:42.536256 ip-10-0-132-17 kubenswrapper[2561]: W0917 07:19:42.530270 2561 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 17 07:19:42.536256 ip-10-0-132-17 kubenswrapper[2561]: W0917 07:19:42.530275 2561 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 17 07:19:42.536256 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:19:42.530389 2561 flags.go:64] FLAG: --address="0.0.0.0" Sep 17 07:19:42.536738 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:19:42.530438 2561 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Sep 17 07:19:42.536738 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:19:42.530448 2561 flags.go:64] FLAG: --anonymous-auth="true" Sep 17 07:19:42.536738 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:19:42.530456 2561 flags.go:64] FLAG: --application-metrics-count-limit="100" Sep 17 07:19:42.536738 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:19:42.530462 2561 flags.go:64] FLAG: --authentication-token-webhook="false" Sep 17 07:19:42.536738 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:19:42.530467 2561 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Sep 17 07:19:42.536738 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:19:42.530474 2561 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Sep 17 07:19:42.536738 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:19:42.530481 2561 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Sep 17 07:19:42.536738 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:19:42.530487 2561 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Sep 17 07:19:42.536738 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:19:42.530491 2561 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Sep 17 07:19:42.536738 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:19:42.530497 2561 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Sep 17 07:19:42.536738 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:19:42.530502 2561 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Sep 17 07:19:42.536738 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:19:42.530507 2561 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Sep 17 07:19:42.536738 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:19:42.530511 2561 flags.go:64] FLAG: --cgroup-root="" Sep 17 07:19:42.536738 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:19:42.530516 2561 flags.go:64] FLAG: --cgroups-per-qos="true" Sep 17 07:19:42.536738 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:19:42.530521 2561 flags.go:64] FLAG: --client-ca-file="" Sep 17 07:19:42.536738 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:19:42.530525 2561 flags.go:64] FLAG: --cloud-provider="external" Sep 17 07:19:42.536738 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:19:42.530529 2561 flags.go:64] FLAG: --cluster-dns="[]" Sep 17 07:19:42.536738 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:19:42.530539 2561 flags.go:64] FLAG: --cluster-domain="" Sep 17 07:19:42.536738 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:19:42.530544 2561 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Sep 17 07:19:42.536738 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:19:42.530550 2561 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Sep 17 07:19:42.536738 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:19:42.530555 2561 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Sep 17 07:19:42.536738 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:19:42.530560 2561 flags.go:64] FLAG: --container-log-max-files="5" Sep 17 07:19:42.536738 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:19:42.530567 2561 flags.go:64] FLAG: --container-log-max-size="10Mi" Sep 17 07:19:42.536738 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:19:42.530572 2561 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Sep 17 07:19:42.537369 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:19:42.530576 2561 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Sep 17 07:19:42.537369 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:19:42.530582 2561 flags.go:64] FLAG: --containerd-namespace="k8s.io" Sep 17 07:19:42.537369 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:19:42.530589 2561 flags.go:64] FLAG: --contention-profiling="false" Sep 17 07:19:42.537369 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:19:42.530593 2561 flags.go:64] FLAG: --cpu-cfs-quota="true" Sep 17 07:19:42.537369 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:19:42.530598 2561 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Sep 17 07:19:42.537369 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:19:42.530603 2561 flags.go:64] FLAG: --cpu-manager-policy="none" Sep 17 07:19:42.537369 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:19:42.530608 2561 flags.go:64] FLAG: --cpu-manager-policy-options="" Sep 17 07:19:42.537369 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:19:42.530614 2561 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Sep 17 07:19:42.537369 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:19:42.530619 2561 flags.go:64] FLAG: --enable-controller-attach-detach="true" Sep 17 07:19:42.537369 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:19:42.530623 2561 flags.go:64] FLAG: --enable-debugging-handlers="true" Sep 17 07:19:42.537369 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:19:42.530628 2561 flags.go:64] FLAG: --enable-load-reader="false" Sep 17 07:19:42.537369 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:19:42.530633 2561 flags.go:64] FLAG: --enable-server="true" Sep 17 07:19:42.537369 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:19:42.530637 2561 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Sep 17 07:19:42.537369 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:19:42.530644 2561 flags.go:64] FLAG: --event-burst="100" Sep 17 07:19:42.537369 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:19:42.530649 2561 flags.go:64] FLAG: --event-qps="50" Sep 17 07:19:42.537369 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:19:42.530654 2561 flags.go:64] FLAG: --event-storage-age-limit="default=0" Sep 17 07:19:42.537369 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:19:42.530659 2561 flags.go:64] FLAG: --event-storage-event-limit="default=0" Sep 17 07:19:42.537369 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:19:42.530664 2561 flags.go:64] FLAG: --eviction-hard="" Sep 17 07:19:42.537369 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:19:42.530670 2561 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Sep 17 07:19:42.537369 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:19:42.530674 2561 flags.go:64] FLAG: --eviction-minimum-reclaim="" Sep 17 07:19:42.537369 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:19:42.530679 2561 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Sep 17 07:19:42.537369 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:19:42.530684 2561 flags.go:64] FLAG: --eviction-soft="" Sep 17 07:19:42.537369 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:19:42.530688 2561 flags.go:64] FLAG: --eviction-soft-grace-period="" Sep 17 07:19:42.537369 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:19:42.530693 2561 flags.go:64] FLAG: --exit-on-lock-contention="false" Sep 17 07:19:42.537369 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:19:42.530698 2561 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Sep 17 07:19:42.538007 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:19:42.530702 2561 flags.go:64] FLAG: --experimental-mounter-path="" Sep 17 07:19:42.538007 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:19:42.530707 2561 flags.go:64] FLAG: --fail-cgroupv1="false" Sep 17 07:19:42.538007 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:19:42.530713 2561 flags.go:64] FLAG: --fail-swap-on="true" Sep 17 07:19:42.538007 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:19:42.530717 2561 flags.go:64] FLAG: --feature-gates="" Sep 17 07:19:42.538007 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:19:42.530723 2561 flags.go:64] FLAG: --file-check-frequency="20s" Sep 17 07:19:42.538007 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:19:42.530729 2561 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Sep 17 07:19:42.538007 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:19:42.530734 2561 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Sep 17 07:19:42.538007 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:19:42.530739 2561 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Sep 17 07:19:42.538007 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:19:42.530744 2561 flags.go:64] FLAG: --healthz-port="10248" Sep 17 07:19:42.538007 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:19:42.530751 2561 flags.go:64] FLAG: --help="false" Sep 17 07:19:42.538007 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:19:42.530755 2561 flags.go:64] FLAG: --hostname-override="ip-10-0-132-17.ec2.internal" Sep 17 07:19:42.538007 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:19:42.530760 2561 flags.go:64] FLAG: --housekeeping-interval="10s" Sep 17 07:19:42.538007 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:19:42.530764 2561 flags.go:64] FLAG: --http-check-frequency="20s" Sep 17 07:19:42.538007 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:19:42.530768 2561 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Sep 17 07:19:42.538007 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:19:42.530774 2561 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Sep 17 07:19:42.538007 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:19:42.530779 2561 flags.go:64] FLAG: --image-gc-high-threshold="85" Sep 17 07:19:42.538007 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:19:42.530783 2561 flags.go:64] FLAG: --image-gc-low-threshold="80" Sep 17 07:19:42.538007 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:19:42.530788 2561 flags.go:64] FLAG: --image-service-endpoint="" Sep 17 07:19:42.538007 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:19:42.530792 2561 flags.go:64] FLAG: --kernel-memcg-notification="false" Sep 17 07:19:42.538007 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:19:42.530797 2561 flags.go:64] FLAG: --kube-api-burst="100" Sep 17 07:19:42.538007 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:19:42.530801 2561 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Sep 17 07:19:42.538007 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:19:42.530806 2561 flags.go:64] FLAG: --kube-api-qps="50" Sep 17 07:19:42.538007 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:19:42.530811 2561 flags.go:64] FLAG: --kube-reserved="" Sep 17 07:19:42.538007 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:19:42.530816 2561 flags.go:64] FLAG: --kube-reserved-cgroup="" Sep 17 07:19:42.538608 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:19:42.530821 2561 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Sep 17 07:19:42.538608 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:19:42.530826 2561 flags.go:64] FLAG: --kubelet-cgroups="" Sep 17 07:19:42.538608 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:19:42.530831 2561 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Sep 17 07:19:42.538608 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:19:42.530836 2561 flags.go:64] FLAG: --lock-file="" Sep 17 07:19:42.538608 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:19:42.530841 2561 flags.go:64] FLAG: --log-cadvisor-usage="false" Sep 17 07:19:42.538608 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:19:42.530846 2561 flags.go:64] FLAG: --log-flush-frequency="5s" Sep 17 07:19:42.538608 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:19:42.530851 2561 flags.go:64] FLAG: --log-json-info-buffer-size="0" Sep 17 07:19:42.538608 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:19:42.530859 2561 flags.go:64] FLAG: --log-json-split-stream="false" Sep 17 07:19:42.538608 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:19:42.530864 2561 flags.go:64] FLAG: --log-text-info-buffer-size="0" Sep 17 07:19:42.538608 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:19:42.530868 2561 flags.go:64] FLAG: --log-text-split-stream="false" Sep 17 07:19:42.538608 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:19:42.530875 2561 flags.go:64] FLAG: --logging-format="text" Sep 17 07:19:42.538608 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:19:42.530879 2561 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Sep 17 07:19:42.538608 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:19:42.530885 2561 flags.go:64] FLAG: --make-iptables-util-chains="true" Sep 17 07:19:42.538608 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:19:42.530889 2561 flags.go:64] FLAG: --manifest-url="" Sep 17 07:19:42.538608 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:19:42.530894 2561 flags.go:64] FLAG: --manifest-url-header="" Sep 17 07:19:42.538608 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:19:42.530900 2561 flags.go:64] FLAG: --max-housekeeping-interval="15s" Sep 17 07:19:42.538608 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:19:42.530905 2561 flags.go:64] FLAG: --max-open-files="1000000" Sep 17 07:19:42.538608 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:19:42.530913 2561 flags.go:64] FLAG: --max-pods="110" Sep 17 07:19:42.538608 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:19:42.530918 2561 flags.go:64] FLAG: --maximum-dead-containers="-1" Sep 17 07:19:42.538608 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:19:42.530923 2561 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Sep 17 07:19:42.538608 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:19:42.530945 2561 flags.go:64] FLAG: --memory-manager-policy="None" Sep 17 07:19:42.538608 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:19:42.530951 2561 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Sep 17 07:19:42.538608 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:19:42.530955 2561 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Sep 17 07:19:42.538608 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:19:42.530960 2561 flags.go:64] FLAG: --node-ip="0.0.0.0" Sep 17 07:19:42.538608 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:19:42.530964 2561 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Sep 17 07:19:42.539240 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:19:42.530975 2561 flags.go:64] FLAG: --node-status-max-images="50" Sep 17 07:19:42.539240 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:19:42.530980 2561 flags.go:64] FLAG: --node-status-update-frequency="10s" Sep 17 07:19:42.539240 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:19:42.530985 2561 flags.go:64] FLAG: --oom-score-adj="-999" Sep 17 07:19:42.539240 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:19:42.530989 2561 flags.go:64] FLAG: --pod-cidr="" Sep 17 07:19:42.539240 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:19:42.530994 2561 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:eee392dbe3ac2ed4a38bca29ae3bd486f5b7780406c62c600154cd1906871b10" Sep 17 07:19:42.539240 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:19:42.531002 2561 flags.go:64] FLAG: --pod-manifest-path="" Sep 17 07:19:42.539240 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:19:42.531007 2561 flags.go:64] FLAG: --pod-max-pids="-1" Sep 17 07:19:42.539240 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:19:42.531011 2561 flags.go:64] FLAG: --pods-per-core="0" Sep 17 07:19:42.539240 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:19:42.531017 2561 flags.go:64] FLAG: --port="10250" Sep 17 07:19:42.539240 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:19:42.531021 2561 flags.go:64] FLAG: --protect-kernel-defaults="false" Sep 17 07:19:42.539240 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:19:42.531026 2561 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0fd82295dde54f53d" Sep 17 07:19:42.539240 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:19:42.531031 2561 flags.go:64] FLAG: --qos-reserved="" Sep 17 07:19:42.539240 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:19:42.531036 2561 flags.go:64] FLAG: --read-only-port="10255" Sep 17 07:19:42.539240 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:19:42.531040 2561 flags.go:64] FLAG: --register-node="true" Sep 17 07:19:42.539240 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:19:42.531045 2561 flags.go:64] FLAG: --register-with-taints="" Sep 17 07:19:42.539240 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:19:42.531051 2561 flags.go:64] FLAG: --registry-burst="10" Sep 17 07:19:42.539240 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:19:42.531055 2561 flags.go:64] FLAG: --registry-qps="5" Sep 17 07:19:42.539240 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:19:42.531062 2561 flags.go:64] FLAG: --reserved-cpus="" Sep 17 07:19:42.539240 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:19:42.531066 2561 flags.go:64] FLAG: --reserved-memory="" Sep 17 07:19:42.539240 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:19:42.531072 2561 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Sep 17 07:19:42.539240 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:19:42.531077 2561 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Sep 17 07:19:42.539240 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:19:42.531081 2561 flags.go:64] FLAG: --rotate-certificates="false" Sep 17 07:19:42.539240 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:19:42.531086 2561 flags.go:64] FLAG: --rotate-server-certificates="false" Sep 17 07:19:42.539240 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:19:42.531090 2561 flags.go:64] FLAG: --runonce="false" Sep 17 07:19:42.539240 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:19:42.531095 2561 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Sep 17 07:19:42.539850 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:19:42.531101 2561 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Sep 17 07:19:42.539850 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:19:42.531106 2561 flags.go:64] FLAG: --seccomp-default="false" Sep 17 07:19:42.539850 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:19:42.531111 2561 flags.go:64] FLAG: --serialize-image-pulls="true" Sep 17 07:19:42.539850 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:19:42.531115 2561 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Sep 17 07:19:42.539850 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:19:42.531120 2561 flags.go:64] FLAG: --storage-driver-db="cadvisor" Sep 17 07:19:42.539850 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:19:42.531125 2561 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Sep 17 07:19:42.539850 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:19:42.531130 2561 flags.go:64] FLAG: --storage-driver-password="root" Sep 17 07:19:42.539850 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:19:42.531134 2561 flags.go:64] FLAG: --storage-driver-secure="false" Sep 17 07:19:42.539850 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:19:42.531139 2561 flags.go:64] FLAG: --storage-driver-table="stats" Sep 17 07:19:42.539850 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:19:42.531143 2561 flags.go:64] FLAG: --storage-driver-user="root" Sep 17 07:19:42.539850 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:19:42.531148 2561 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Sep 17 07:19:42.539850 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:19:42.531153 2561 flags.go:64] FLAG: --sync-frequency="1m0s" Sep 17 07:19:42.539850 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:19:42.531158 2561 flags.go:64] FLAG: --system-cgroups="" Sep 17 07:19:42.539850 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:19:42.531162 2561 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Sep 17 07:19:42.539850 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:19:42.531171 2561 flags.go:64] FLAG: --system-reserved-cgroup="" Sep 17 07:19:42.539850 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:19:42.531175 2561 flags.go:64] FLAG: --tls-cert-file="" Sep 17 07:19:42.539850 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:19:42.531181 2561 flags.go:64] FLAG: --tls-cipher-suites="[]" Sep 17 07:19:42.539850 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:19:42.531186 2561 flags.go:64] FLAG: --tls-min-version="" Sep 17 07:19:42.539850 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:19:42.531191 2561 flags.go:64] FLAG: --tls-private-key-file="" Sep 17 07:19:42.539850 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:19:42.531195 2561 flags.go:64] FLAG: --topology-manager-policy="none" Sep 17 07:19:42.539850 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:19:42.531200 2561 flags.go:64] FLAG: --topology-manager-policy-options="" Sep 17 07:19:42.539850 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:19:42.531205 2561 flags.go:64] FLAG: --topology-manager-scope="container" Sep 17 07:19:42.539850 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:19:42.531210 2561 flags.go:64] FLAG: --v="2" Sep 17 07:19:42.539850 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:19:42.531216 2561 flags.go:64] FLAG: --version="false" Sep 17 07:19:42.539850 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:19:42.531223 2561 flags.go:64] FLAG: --vmodule="" Sep 17 07:19:42.540484 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:19:42.531228 2561 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Sep 17 07:19:42.540484 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:19:42.531234 2561 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Sep 17 07:19:42.540484 ip-10-0-132-17 kubenswrapper[2561]: W0917 07:19:42.531443 2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 17 07:19:42.540484 ip-10-0-132-17 kubenswrapper[2561]: W0917 07:19:42.531450 2561 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 17 07:19:42.540484 ip-10-0-132-17 kubenswrapper[2561]: W0917 07:19:42.531455 2561 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 17 07:19:42.540484 ip-10-0-132-17 kubenswrapper[2561]: W0917 07:19:42.531460 2561 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 17 07:19:42.540484 ip-10-0-132-17 kubenswrapper[2561]: W0917 07:19:42.531464 2561 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 17 07:19:42.540484 ip-10-0-132-17 kubenswrapper[2561]: W0917 07:19:42.531470 2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 17 07:19:42.540484 ip-10-0-132-17 kubenswrapper[2561]: W0917 07:19:42.531476 2561 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 17 07:19:42.540484 ip-10-0-132-17 kubenswrapper[2561]: W0917 07:19:42.531481 2561 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 17 07:19:42.540484 ip-10-0-132-17 kubenswrapper[2561]: W0917 07:19:42.531487 2561 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 17 07:19:42.540484 ip-10-0-132-17 kubenswrapper[2561]: W0917 07:19:42.531491 2561 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 17 07:19:42.540484 ip-10-0-132-17 kubenswrapper[2561]: W0917 07:19:42.531495 2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 17 07:19:42.540484 ip-10-0-132-17 kubenswrapper[2561]: W0917 07:19:42.531499 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 17 07:19:42.540484 ip-10-0-132-17 kubenswrapper[2561]: W0917 07:19:42.531504 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 17 07:19:42.540484 ip-10-0-132-17 kubenswrapper[2561]: W0917 07:19:42.531508 2561 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 17 07:19:42.540484 ip-10-0-132-17 kubenswrapper[2561]: W0917 07:19:42.531512 2561 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 17 07:19:42.540484 ip-10-0-132-17 kubenswrapper[2561]: W0917 07:19:42.531516 2561 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 17 07:19:42.540484 ip-10-0-132-17 kubenswrapper[2561]: W0917 07:19:42.531520 2561 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 17 07:19:42.540484 ip-10-0-132-17 kubenswrapper[2561]: W0917 07:19:42.531524 2561 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 17 07:19:42.541032 ip-10-0-132-17 kubenswrapper[2561]: W0917 07:19:42.531528 2561 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 17 07:19:42.541032 ip-10-0-132-17 kubenswrapper[2561]: W0917 07:19:42.531532 2561 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 17 07:19:42.541032 ip-10-0-132-17 kubenswrapper[2561]: W0917 07:19:42.531536 2561 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 17 07:19:42.541032 ip-10-0-132-17 kubenswrapper[2561]: W0917 07:19:42.531540 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 17 07:19:42.541032 ip-10-0-132-17 kubenswrapper[2561]: W0917 07:19:42.531550 2561 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 17 07:19:42.541032 ip-10-0-132-17 kubenswrapper[2561]: W0917 07:19:42.531554 2561 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 17 07:19:42.541032 ip-10-0-132-17 kubenswrapper[2561]: W0917 07:19:42.531558 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 17 07:19:42.541032 ip-10-0-132-17 kubenswrapper[2561]: W0917 07:19:42.531562 2561 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 17 07:19:42.541032 ip-10-0-132-17 kubenswrapper[2561]: W0917 07:19:42.531566 2561 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 17 07:19:42.541032 ip-10-0-132-17 kubenswrapper[2561]: W0917 07:19:42.531570 2561 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 17 07:19:42.541032 ip-10-0-132-17 kubenswrapper[2561]: W0917 07:19:42.531574 2561 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 17 07:19:42.541032 ip-10-0-132-17 kubenswrapper[2561]: W0917 07:19:42.531580 2561 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 17 07:19:42.541032 ip-10-0-132-17 kubenswrapper[2561]: W0917 07:19:42.531584 2561 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 17 07:19:42.541032 ip-10-0-132-17 kubenswrapper[2561]: W0917 07:19:42.531588 2561 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 17 07:19:42.541032 ip-10-0-132-17 kubenswrapper[2561]: W0917 07:19:42.531595 2561 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 17 07:19:42.541032 ip-10-0-132-17 kubenswrapper[2561]: W0917 07:19:42.531600 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 17 07:19:42.541032 ip-10-0-132-17 kubenswrapper[2561]: W0917 07:19:42.531604 2561 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 17 07:19:42.541032 ip-10-0-132-17 kubenswrapper[2561]: W0917 07:19:42.531609 2561 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 17 07:19:42.541032 ip-10-0-132-17 kubenswrapper[2561]: W0917 07:19:42.531613 2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 17 07:19:42.541496 ip-10-0-132-17 kubenswrapper[2561]: W0917 07:19:42.531618 2561 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 17 07:19:42.541496 ip-10-0-132-17 kubenswrapper[2561]: W0917 07:19:42.531622 2561 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 17 07:19:42.541496 ip-10-0-132-17 kubenswrapper[2561]: W0917 07:19:42.531626 2561 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 17 07:19:42.541496 ip-10-0-132-17 kubenswrapper[2561]: W0917 07:19:42.531631 2561 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 17 07:19:42.541496 ip-10-0-132-17 kubenswrapper[2561]: W0917 07:19:42.531635 2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 17 07:19:42.541496 ip-10-0-132-17 kubenswrapper[2561]: W0917 07:19:42.531639 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 17 07:19:42.541496 ip-10-0-132-17 kubenswrapper[2561]: W0917 07:19:42.531643 2561 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 17 07:19:42.541496 ip-10-0-132-17 kubenswrapper[2561]: W0917 07:19:42.531647 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 17 07:19:42.541496 ip-10-0-132-17 kubenswrapper[2561]: W0917 07:19:42.531651 2561 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 17 07:19:42.541496 ip-10-0-132-17 kubenswrapper[2561]: W0917 07:19:42.531655 2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 17 07:19:42.541496 ip-10-0-132-17 kubenswrapper[2561]: W0917 07:19:42.531659 2561 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 17 07:19:42.541496 ip-10-0-132-17 kubenswrapper[2561]: W0917 07:19:42.531663 2561 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 17 07:19:42.541496 ip-10-0-132-17 kubenswrapper[2561]: W0917 07:19:42.531667 2561 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 17 07:19:42.541496 ip-10-0-132-17 kubenswrapper[2561]: W0917 07:19:42.531671 2561 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 17 07:19:42.541496 ip-10-0-132-17 kubenswrapper[2561]: W0917 07:19:42.531676 2561 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 17 07:19:42.541496 ip-10-0-132-17 kubenswrapper[2561]: W0917 07:19:42.531680 2561 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 17 07:19:42.541496 ip-10-0-132-17 kubenswrapper[2561]: W0917 07:19:42.531684 2561 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 17 07:19:42.541496 ip-10-0-132-17 kubenswrapper[2561]: W0917 07:19:42.531688 2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 17 07:19:42.541496 ip-10-0-132-17 kubenswrapper[2561]: W0917 07:19:42.531693 2561 feature_gate.go:328] unrecognized feature gate: Example Sep 17 07:19:42.541496 ip-10-0-132-17 kubenswrapper[2561]: W0917 07:19:42.531698 2561 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 17 07:19:42.542006 ip-10-0-132-17 kubenswrapper[2561]: W0917 07:19:42.531702 2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 17 07:19:42.542006 ip-10-0-132-17 kubenswrapper[2561]: W0917 07:19:42.531706 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 17 07:19:42.542006 ip-10-0-132-17 kubenswrapper[2561]: W0917 07:19:42.531710 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 17 07:19:42.542006 ip-10-0-132-17 kubenswrapper[2561]: W0917 07:19:42.531714 2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 17 07:19:42.542006 ip-10-0-132-17 kubenswrapper[2561]: W0917 07:19:42.531718 2561 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 17 07:19:42.542006 ip-10-0-132-17 kubenswrapper[2561]: W0917 07:19:42.531722 2561 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 17 07:19:42.542006 ip-10-0-132-17 kubenswrapper[2561]: W0917 07:19:42.531726 2561 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 17 07:19:42.542006 ip-10-0-132-17 kubenswrapper[2561]: W0917 07:19:42.531730 2561 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 17 07:19:42.542006 ip-10-0-132-17 kubenswrapper[2561]: W0917 07:19:42.531734 2561 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 17 07:19:42.542006 ip-10-0-132-17 kubenswrapper[2561]: W0917 07:19:42.531738 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 17 07:19:42.542006 ip-10-0-132-17 kubenswrapper[2561]: W0917 07:19:42.531743 2561 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 17 07:19:42.542006 ip-10-0-132-17 kubenswrapper[2561]: W0917 07:19:42.531747 2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 17 07:19:42.542006 ip-10-0-132-17 kubenswrapper[2561]: W0917 07:19:42.531752 2561 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 17 07:19:42.542006 ip-10-0-132-17 kubenswrapper[2561]: W0917 07:19:42.531756 2561 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 17 07:19:42.542006 ip-10-0-132-17 kubenswrapper[2561]: W0917 07:19:42.531760 2561 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 17 07:19:42.542006 ip-10-0-132-17 kubenswrapper[2561]: W0917 07:19:42.531765 2561 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 17 07:19:42.542006 ip-10-0-132-17 kubenswrapper[2561]: W0917 07:19:42.531769 2561 feature_gate.go:328] unrecognized feature gate: Example2 Sep 17 07:19:42.542006 ip-10-0-132-17 kubenswrapper[2561]: W0917 07:19:42.531773 2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 17 07:19:42.542006 ip-10-0-132-17 kubenswrapper[2561]: W0917 07:19:42.531777 2561 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 17 07:19:42.542006 ip-10-0-132-17 kubenswrapper[2561]: W0917 07:19:42.531781 2561 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 17 07:19:42.542504 ip-10-0-132-17 kubenswrapper[2561]: W0917 07:19:42.531786 2561 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 17 07:19:42.542504 ip-10-0-132-17 kubenswrapper[2561]: W0917 07:19:42.531790 2561 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 17 07:19:42.542504 ip-10-0-132-17 kubenswrapper[2561]: W0917 07:19:42.531794 2561 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 17 07:19:42.542504 ip-10-0-132-17 kubenswrapper[2561]: W0917 07:19:42.531797 2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 17 07:19:42.542504 ip-10-0-132-17 kubenswrapper[2561]: W0917 07:19:42.531801 2561 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 17 07:19:42.542504 ip-10-0-132-17 kubenswrapper[2561]: W0917 07:19:42.531805 2561 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 17 07:19:42.542504 ip-10-0-132-17 kubenswrapper[2561]: W0917 07:19:42.531810 2561 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 17 07:19:42.542504 ip-10-0-132-17 kubenswrapper[2561]: W0917 07:19:42.531814 2561 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 17 07:19:42.542504 ip-10-0-132-17 kubenswrapper[2561]: W0917 07:19:42.531818 2561 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 17 07:19:42.542504 ip-10-0-132-17 kubenswrapper[2561]: W0917 07:19:42.531822 2561 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 17 07:19:42.542504 ip-10-0-132-17 kubenswrapper[2561]: W0917 07:19:42.531828 2561 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 17 07:19:42.542504 ip-10-0-132-17 kubenswrapper[2561]: W0917 07:19:42.531839 2561 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 17 07:19:42.542504 ip-10-0-132-17 kubenswrapper[2561]: W0917 07:19:42.531844 2561 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 17 07:19:42.542504 ip-10-0-132-17 kubenswrapper[2561]: W0917 07:19:42.531848 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 17 07:19:42.542504 ip-10-0-132-17 kubenswrapper[2561]: W0917 07:19:42.531853 2561 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 17 07:19:42.542504 ip-10-0-132-17 kubenswrapper[2561]: W0917 07:19:42.531857 2561 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 17 07:19:42.542504 ip-10-0-132-17 kubenswrapper[2561]: W0917 07:19:42.531862 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 17 07:19:42.542504 ip-10-0-132-17 kubenswrapper[2561]: W0917 07:19:42.531867 2561 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 17 07:19:42.542504 ip-10-0-132-17 kubenswrapper[2561]: W0917 07:19:42.531871 2561 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 17 07:19:42.542504 ip-10-0-132-17 kubenswrapper[2561]: W0917 07:19:42.531875 2561 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 17 07:19:42.543026 ip-10-0-132-17 kubenswrapper[2561]: W0917 07:19:42.531879 2561 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 17 07:19:42.543026 ip-10-0-132-17 kubenswrapper[2561]: W0917 07:19:42.531883 2561 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 17 07:19:42.543026 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:19:42.532686 2561 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Sep 17 07:19:42.543026 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:19:42.541196 2561 server.go:529] "Kubelet version" kubeletVersion="v1.34.9" Sep 17 07:19:42.543026 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:19:42.541214 2561 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Sep 17 07:19:42.543026 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:19:42.542126 2561 watchdog_linux.go:95] "Systemd watchdog is not enabled" Sep 17 07:19:42.543026 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:19:42.542135 2561 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Sep 17 07:19:42.543026 ip-10-0-132-17 kubenswrapper[2561]: W0917 07:19:42.542199 2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 17 07:19:42.543026 ip-10-0-132-17 kubenswrapper[2561]: W0917 07:19:42.542206 2561 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 17 07:19:42.543026 ip-10-0-132-17 kubenswrapper[2561]: W0917 07:19:42.542210 2561 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 17 07:19:42.543026 ip-10-0-132-17 kubenswrapper[2561]: W0917 07:19:42.542213 2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 17 07:19:42.543026 ip-10-0-132-17 kubenswrapper[2561]: W0917 07:19:42.542216 2561 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 17 07:19:42.543026 ip-10-0-132-17 kubenswrapper[2561]: W0917 07:19:42.542219 2561 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 17 07:19:42.543026 ip-10-0-132-17 kubenswrapper[2561]: W0917 07:19:42.542222 2561 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 17 07:19:42.543386 ip-10-0-132-17 kubenswrapper[2561]: W0917 07:19:42.542224 2561 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 17 07:19:42.543386 ip-10-0-132-17 kubenswrapper[2561]: W0917 07:19:42.542227 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 17 07:19:42.543386 ip-10-0-132-17 kubenswrapper[2561]: W0917 07:19:42.542229 2561 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 17 07:19:42.543386 ip-10-0-132-17 kubenswrapper[2561]: W0917 07:19:42.542232 2561 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 17 07:19:42.543386 ip-10-0-132-17 kubenswrapper[2561]: W0917 07:19:42.542235 2561 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 17 07:19:42.543386 ip-10-0-132-17 kubenswrapper[2561]: W0917 07:19:42.542237 2561 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 17 07:19:42.543386 ip-10-0-132-17 kubenswrapper[2561]: W0917 07:19:42.542240 2561 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 17 07:19:42.543386 ip-10-0-132-17 kubenswrapper[2561]: W0917 07:19:42.542243 2561 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 17 07:19:42.543386 ip-10-0-132-17 kubenswrapper[2561]: W0917 07:19:42.542245 2561 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 17 07:19:42.543386 ip-10-0-132-17 kubenswrapper[2561]: W0917 07:19:42.542248 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 17 07:19:42.543386 ip-10-0-132-17 kubenswrapper[2561]: W0917 07:19:42.542250 2561 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 17 07:19:42.543386 ip-10-0-132-17 kubenswrapper[2561]: W0917 07:19:42.542253 2561 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 17 07:19:42.543386 ip-10-0-132-17 kubenswrapper[2561]: W0917 07:19:42.542255 2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 17 07:19:42.543386 ip-10-0-132-17 kubenswrapper[2561]: W0917 07:19:42.542258 2561 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 17 07:19:42.543386 ip-10-0-132-17 kubenswrapper[2561]: W0917 07:19:42.542261 2561 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 17 07:19:42.543386 ip-10-0-132-17 kubenswrapper[2561]: W0917 07:19:42.542263 2561 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 17 07:19:42.543386 ip-10-0-132-17 kubenswrapper[2561]: W0917 07:19:42.542265 2561 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 17 07:19:42.543386 ip-10-0-132-17 kubenswrapper[2561]: W0917 07:19:42.542268 2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 17 07:19:42.543386 ip-10-0-132-17 kubenswrapper[2561]: W0917 07:19:42.542271 2561 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 17 07:19:42.543843 ip-10-0-132-17 kubenswrapper[2561]: W0917 07:19:42.542273 2561 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 17 07:19:42.543843 ip-10-0-132-17 kubenswrapper[2561]: W0917 07:19:42.542276 2561 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 17 07:19:42.543843 ip-10-0-132-17 kubenswrapper[2561]: W0917 07:19:42.542278 2561 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 17 07:19:42.543843 ip-10-0-132-17 kubenswrapper[2561]: W0917 07:19:42.542287 2561 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 17 07:19:42.543843 ip-10-0-132-17 kubenswrapper[2561]: W0917 07:19:42.542290 2561 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 17 07:19:42.543843 ip-10-0-132-17 kubenswrapper[2561]: W0917 07:19:42.542293 2561 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 17 07:19:42.543843 ip-10-0-132-17 kubenswrapper[2561]: W0917 07:19:42.542295 2561 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 17 07:19:42.543843 ip-10-0-132-17 kubenswrapper[2561]: W0917 07:19:42.542298 2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 17 07:19:42.543843 ip-10-0-132-17 kubenswrapper[2561]: W0917 07:19:42.542300 2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 17 07:19:42.543843 ip-10-0-132-17 kubenswrapper[2561]: W0917 07:19:42.542303 2561 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 17 07:19:42.543843 ip-10-0-132-17 kubenswrapper[2561]: W0917 07:19:42.542305 2561 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 17 07:19:42.543843 ip-10-0-132-17 kubenswrapper[2561]: W0917 07:19:42.542308 2561 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 17 07:19:42.543843 ip-10-0-132-17 kubenswrapper[2561]: W0917 07:19:42.542310 2561 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 17 07:19:42.543843 ip-10-0-132-17 kubenswrapper[2561]: W0917 07:19:42.542314 2561 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 17 07:19:42.543843 ip-10-0-132-17 kubenswrapper[2561]: W0917 07:19:42.542317 2561 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 17 07:19:42.543843 ip-10-0-132-17 kubenswrapper[2561]: W0917 07:19:42.542319 2561 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 17 07:19:42.543843 ip-10-0-132-17 kubenswrapper[2561]: W0917 07:19:42.542322 2561 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 17 07:19:42.543843 ip-10-0-132-17 kubenswrapper[2561]: W0917 07:19:42.542325 2561 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 17 07:19:42.543843 ip-10-0-132-17 kubenswrapper[2561]: W0917 07:19:42.542336 2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 17 07:19:42.544366 ip-10-0-132-17 kubenswrapper[2561]: W0917 07:19:42.542338 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 17 07:19:42.544366 ip-10-0-132-17 kubenswrapper[2561]: W0917 07:19:42.542341 2561 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 17 07:19:42.544366 ip-10-0-132-17 kubenswrapper[2561]: W0917 07:19:42.542344 2561 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 17 07:19:42.544366 ip-10-0-132-17 kubenswrapper[2561]: W0917 07:19:42.542346 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 17 07:19:42.544366 ip-10-0-132-17 kubenswrapper[2561]: W0917 07:19:42.542349 2561 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 17 07:19:42.544366 ip-10-0-132-17 kubenswrapper[2561]: W0917 07:19:42.542352 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 17 07:19:42.544366 ip-10-0-132-17 kubenswrapper[2561]: W0917 07:19:42.542354 2561 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 17 07:19:42.544366 ip-10-0-132-17 kubenswrapper[2561]: W0917 07:19:42.542357 2561 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 17 07:19:42.544366 ip-10-0-132-17 kubenswrapper[2561]: W0917 07:19:42.542360 2561 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 17 07:19:42.544366 ip-10-0-132-17 kubenswrapper[2561]: W0917 07:19:42.542362 2561 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 17 07:19:42.544366 ip-10-0-132-17 kubenswrapper[2561]: W0917 07:19:42.542365 2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 17 07:19:42.544366 ip-10-0-132-17 kubenswrapper[2561]: W0917 07:19:42.542368 2561 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 17 07:19:42.544366 ip-10-0-132-17 kubenswrapper[2561]: W0917 07:19:42.542371 2561 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 17 07:19:42.544366 ip-10-0-132-17 kubenswrapper[2561]: W0917 07:19:42.542373 2561 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 17 07:19:42.544366 ip-10-0-132-17 kubenswrapper[2561]: W0917 07:19:42.542376 2561 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 17 07:19:42.544366 ip-10-0-132-17 kubenswrapper[2561]: W0917 07:19:42.542378 2561 feature_gate.go:328] unrecognized feature gate: Example2 Sep 17 07:19:42.544366 ip-10-0-132-17 kubenswrapper[2561]: W0917 07:19:42.542381 2561 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 17 07:19:42.544366 ip-10-0-132-17 kubenswrapper[2561]: W0917 07:19:42.542389 2561 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 17 07:19:42.544366 ip-10-0-132-17 kubenswrapper[2561]: W0917 07:19:42.542392 2561 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 17 07:19:42.544366 ip-10-0-132-17 kubenswrapper[2561]: W0917 07:19:42.542395 2561 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 17 07:19:42.544366 ip-10-0-132-17 kubenswrapper[2561]: W0917 07:19:42.542397 2561 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 17 07:19:42.544869 ip-10-0-132-17 kubenswrapper[2561]: W0917 07:19:42.542400 2561 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 17 07:19:42.544869 ip-10-0-132-17 kubenswrapper[2561]: W0917 07:19:42.542402 2561 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 17 07:19:42.544869 ip-10-0-132-17 kubenswrapper[2561]: W0917 07:19:42.542405 2561 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 17 07:19:42.544869 ip-10-0-132-17 kubenswrapper[2561]: W0917 07:19:42.542408 2561 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 17 07:19:42.544869 ip-10-0-132-17 kubenswrapper[2561]: W0917 07:19:42.542410 2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 17 07:19:42.544869 ip-10-0-132-17 kubenswrapper[2561]: W0917 07:19:42.542413 2561 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 17 07:19:42.544869 ip-10-0-132-17 kubenswrapper[2561]: W0917 07:19:42.542415 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 17 07:19:42.544869 ip-10-0-132-17 kubenswrapper[2561]: W0917 07:19:42.542418 2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 17 07:19:42.544869 ip-10-0-132-17 kubenswrapper[2561]: W0917 07:19:42.542420 2561 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 17 07:19:42.544869 ip-10-0-132-17 kubenswrapper[2561]: W0917 07:19:42.542423 2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 17 07:19:42.544869 ip-10-0-132-17 kubenswrapper[2561]: W0917 07:19:42.542426 2561 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 17 07:19:42.544869 ip-10-0-132-17 kubenswrapper[2561]: W0917 07:19:42.542430 2561 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 17 07:19:42.544869 ip-10-0-132-17 kubenswrapper[2561]: W0917 07:19:42.542433 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 17 07:19:42.544869 ip-10-0-132-17 kubenswrapper[2561]: W0917 07:19:42.542436 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 17 07:19:42.544869 ip-10-0-132-17 kubenswrapper[2561]: W0917 07:19:42.542439 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 17 07:19:42.544869 ip-10-0-132-17 kubenswrapper[2561]: W0917 07:19:42.542442 2561 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 17 07:19:42.544869 ip-10-0-132-17 kubenswrapper[2561]: W0917 07:19:42.542444 2561 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 17 07:19:42.544869 ip-10-0-132-17 kubenswrapper[2561]: W0917 07:19:42.542447 2561 feature_gate.go:328] unrecognized feature gate: Example Sep 17 07:19:42.544869 ip-10-0-132-17 kubenswrapper[2561]: W0917 07:19:42.542449 2561 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 17 07:19:42.544869 ip-10-0-132-17 kubenswrapper[2561]: W0917 07:19:42.542452 2561 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 17 07:19:42.545378 ip-10-0-132-17 kubenswrapper[2561]: W0917 07:19:42.542454 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 17 07:19:42.545378 ip-10-0-132-17 kubenswrapper[2561]: W0917 07:19:42.542456 2561 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 17 07:19:42.545378 ip-10-0-132-17 kubenswrapper[2561]: W0917 07:19:42.542459 2561 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 17 07:19:42.545378 ip-10-0-132-17 kubenswrapper[2561]: W0917 07:19:42.542462 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 17 07:19:42.545378 ip-10-0-132-17 kubenswrapper[2561]: W0917 07:19:42.542465 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 17 07:19:42.545378 ip-10-0-132-17 kubenswrapper[2561]: W0917 07:19:42.542467 2561 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 17 07:19:42.545378 ip-10-0-132-17 kubenswrapper[2561]: W0917 07:19:42.542470 2561 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 17 07:19:42.545378 ip-10-0-132-17 kubenswrapper[2561]: W0917 07:19:42.542472 2561 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 17 07:19:42.545378 ip-10-0-132-17 kubenswrapper[2561]: W0917 07:19:42.542475 2561 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 17 07:19:42.545378 ip-10-0-132-17 kubenswrapper[2561]: W0917 07:19:42.542483 2561 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 17 07:19:42.545378 ip-10-0-132-17 kubenswrapper[2561]: W0917 07:19:42.542485 2561 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 17 07:19:42.545378 ip-10-0-132-17 kubenswrapper[2561]: W0917 07:19:42.542488 2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 17 07:19:42.545378 ip-10-0-132-17 kubenswrapper[2561]: W0917 07:19:42.542490 2561 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 17 07:19:42.545378 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:19:42.542495 2561 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Sep 17 07:19:42.545378 ip-10-0-132-17 kubenswrapper[2561]: W0917 07:19:42.542686 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 17 07:19:42.545750 ip-10-0-132-17 kubenswrapper[2561]: W0917 07:19:42.542692 2561 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 17 07:19:42.545750 ip-10-0-132-17 kubenswrapper[2561]: W0917 07:19:42.542696 2561 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 17 07:19:42.545750 ip-10-0-132-17 kubenswrapper[2561]: W0917 07:19:42.542699 2561 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 17 07:19:42.545750 ip-10-0-132-17 kubenswrapper[2561]: W0917 07:19:42.542703 2561 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 17 07:19:42.545750 ip-10-0-132-17 kubenswrapper[2561]: W0917 07:19:42.542707 2561 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 17 07:19:42.545750 ip-10-0-132-17 kubenswrapper[2561]: W0917 07:19:42.542709 2561 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 17 07:19:42.545750 ip-10-0-132-17 kubenswrapper[2561]: W0917 07:19:42.542713 2561 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 17 07:19:42.545750 ip-10-0-132-17 kubenswrapper[2561]: W0917 07:19:42.542717 2561 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 17 07:19:42.545750 ip-10-0-132-17 kubenswrapper[2561]: W0917 07:19:42.542721 2561 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 17 07:19:42.545750 ip-10-0-132-17 kubenswrapper[2561]: W0917 07:19:42.542724 2561 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 17 07:19:42.545750 ip-10-0-132-17 kubenswrapper[2561]: W0917 07:19:42.542726 2561 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 17 07:19:42.545750 ip-10-0-132-17 kubenswrapper[2561]: W0917 07:19:42.542729 2561 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 17 07:19:42.545750 ip-10-0-132-17 kubenswrapper[2561]: W0917 07:19:42.542731 2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 17 07:19:42.545750 ip-10-0-132-17 kubenswrapper[2561]: W0917 07:19:42.542734 2561 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 17 07:19:42.545750 ip-10-0-132-17 kubenswrapper[2561]: W0917 07:19:42.542736 2561 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 17 07:19:42.545750 ip-10-0-132-17 kubenswrapper[2561]: W0917 07:19:42.542739 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 17 07:19:42.545750 ip-10-0-132-17 kubenswrapper[2561]: W0917 07:19:42.542741 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 17 07:19:42.545750 ip-10-0-132-17 kubenswrapper[2561]: W0917 07:19:42.542744 2561 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 17 07:19:42.545750 ip-10-0-132-17 kubenswrapper[2561]: W0917 07:19:42.542746 2561 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 17 07:19:42.546323 ip-10-0-132-17 kubenswrapper[2561]: W0917 07:19:42.542749 2561 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 17 07:19:42.546323 ip-10-0-132-17 kubenswrapper[2561]: W0917 07:19:42.542751 2561 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 17 07:19:42.546323 ip-10-0-132-17 kubenswrapper[2561]: W0917 07:19:42.542754 2561 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 17 07:19:42.546323 ip-10-0-132-17 kubenswrapper[2561]: W0917 07:19:42.542757 2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 17 07:19:42.546323 ip-10-0-132-17 kubenswrapper[2561]: W0917 07:19:42.542759 2561 feature_gate.go:328] unrecognized feature gate: Example Sep 17 07:19:42.546323 ip-10-0-132-17 kubenswrapper[2561]: W0917 07:19:42.542761 2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 17 07:19:42.546323 ip-10-0-132-17 kubenswrapper[2561]: W0917 07:19:42.542764 2561 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 17 07:19:42.546323 ip-10-0-132-17 kubenswrapper[2561]: W0917 07:19:42.542766 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 17 07:19:42.546323 ip-10-0-132-17 kubenswrapper[2561]: W0917 07:19:42.542775 2561 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 17 07:19:42.546323 ip-10-0-132-17 kubenswrapper[2561]: W0917 07:19:42.542778 2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 17 07:19:42.546323 ip-10-0-132-17 kubenswrapper[2561]: W0917 07:19:42.542780 2561 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 17 07:19:42.546323 ip-10-0-132-17 kubenswrapper[2561]: W0917 07:19:42.542783 2561 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 17 07:19:42.546323 ip-10-0-132-17 kubenswrapper[2561]: W0917 07:19:42.542785 2561 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 17 07:19:42.546323 ip-10-0-132-17 kubenswrapper[2561]: W0917 07:19:42.542788 2561 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 17 07:19:42.546323 ip-10-0-132-17 kubenswrapper[2561]: W0917 07:19:42.542790 2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 17 07:19:42.546323 ip-10-0-132-17 kubenswrapper[2561]: W0917 07:19:42.542792 2561 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 17 07:19:42.546323 ip-10-0-132-17 kubenswrapper[2561]: W0917 07:19:42.542795 2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 17 07:19:42.546323 ip-10-0-132-17 kubenswrapper[2561]: W0917 07:19:42.542797 2561 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 17 07:19:42.546323 ip-10-0-132-17 kubenswrapper[2561]: W0917 07:19:42.542800 2561 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 17 07:19:42.546323 ip-10-0-132-17 kubenswrapper[2561]: W0917 07:19:42.542803 2561 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 17 07:19:42.546809 ip-10-0-132-17 kubenswrapper[2561]: W0917 07:19:42.542806 2561 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 17 07:19:42.546809 ip-10-0-132-17 kubenswrapper[2561]: W0917 07:19:42.542809 2561 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 17 07:19:42.546809 ip-10-0-132-17 kubenswrapper[2561]: W0917 07:19:42.542812 2561 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 17 07:19:42.546809 ip-10-0-132-17 kubenswrapper[2561]: W0917 07:19:42.542814 2561 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 17 07:19:42.546809 ip-10-0-132-17 kubenswrapper[2561]: W0917 07:19:42.542817 2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 17 07:19:42.546809 ip-10-0-132-17 kubenswrapper[2561]: W0917 07:19:42.542819 2561 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 17 07:19:42.546809 ip-10-0-132-17 kubenswrapper[2561]: W0917 07:19:42.542822 2561 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 17 07:19:42.546809 ip-10-0-132-17 kubenswrapper[2561]: W0917 07:19:42.542824 2561 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 17 07:19:42.546809 ip-10-0-132-17 kubenswrapper[2561]: W0917 07:19:42.542827 2561 feature_gate.go:328] unrecognized feature gate: Example2 Sep 17 07:19:42.546809 ip-10-0-132-17 kubenswrapper[2561]: W0917 07:19:42.542829 2561 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 17 07:19:42.546809 ip-10-0-132-17 kubenswrapper[2561]: W0917 07:19:42.542832 2561 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 17 07:19:42.546809 ip-10-0-132-17 kubenswrapper[2561]: W0917 07:19:42.542834 2561 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 17 07:19:42.546809 ip-10-0-132-17 kubenswrapper[2561]: W0917 07:19:42.542836 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 17 07:19:42.546809 ip-10-0-132-17 kubenswrapper[2561]: W0917 07:19:42.542839 2561 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 17 07:19:42.546809 ip-10-0-132-17 kubenswrapper[2561]: W0917 07:19:42.542841 2561 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 17 07:19:42.546809 ip-10-0-132-17 kubenswrapper[2561]: W0917 07:19:42.542844 2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 17 07:19:42.546809 ip-10-0-132-17 kubenswrapper[2561]: W0917 07:19:42.542846 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 17 07:19:42.546809 ip-10-0-132-17 kubenswrapper[2561]: W0917 07:19:42.542849 2561 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 17 07:19:42.546809 ip-10-0-132-17 kubenswrapper[2561]: W0917 07:19:42.542851 2561 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 17 07:19:42.546809 ip-10-0-132-17 kubenswrapper[2561]: W0917 07:19:42.542854 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 17 07:19:42.547316 ip-10-0-132-17 kubenswrapper[2561]: W0917 07:19:42.542856 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 17 07:19:42.547316 ip-10-0-132-17 kubenswrapper[2561]: W0917 07:19:42.542864 2561 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 17 07:19:42.547316 ip-10-0-132-17 kubenswrapper[2561]: W0917 07:19:42.542867 2561 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 17 07:19:42.547316 ip-10-0-132-17 kubenswrapper[2561]: W0917 07:19:42.542869 2561 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 17 07:19:42.547316 ip-10-0-132-17 kubenswrapper[2561]: W0917 07:19:42.542871 2561 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 17 07:19:42.547316 ip-10-0-132-17 kubenswrapper[2561]: W0917 07:19:42.542874 2561 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 17 07:19:42.547316 ip-10-0-132-17 kubenswrapper[2561]: W0917 07:19:42.542876 2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 17 07:19:42.547316 ip-10-0-132-17 kubenswrapper[2561]: W0917 07:19:42.542879 2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 17 07:19:42.547316 ip-10-0-132-17 kubenswrapper[2561]: W0917 07:19:42.542881 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 17 07:19:42.547316 ip-10-0-132-17 kubenswrapper[2561]: W0917 07:19:42.542883 2561 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 17 07:19:42.547316 ip-10-0-132-17 kubenswrapper[2561]: W0917 07:19:42.542886 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 17 07:19:42.547316 ip-10-0-132-17 kubenswrapper[2561]: W0917 07:19:42.542888 2561 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 17 07:19:42.547316 ip-10-0-132-17 kubenswrapper[2561]: W0917 07:19:42.542890 2561 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 17 07:19:42.547316 ip-10-0-132-17 kubenswrapper[2561]: W0917 07:19:42.542893 2561 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 17 07:19:42.547316 ip-10-0-132-17 kubenswrapper[2561]: W0917 07:19:42.542895 2561 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 17 07:19:42.547316 ip-10-0-132-17 kubenswrapper[2561]: W0917 07:19:42.542897 2561 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 17 07:19:42.547316 ip-10-0-132-17 kubenswrapper[2561]: W0917 07:19:42.542900 2561 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 17 07:19:42.547316 ip-10-0-132-17 kubenswrapper[2561]: W0917 07:19:42.542902 2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 17 07:19:42.547316 ip-10-0-132-17 kubenswrapper[2561]: W0917 07:19:42.542904 2561 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 17 07:19:42.547801 ip-10-0-132-17 kubenswrapper[2561]: W0917 07:19:42.542907 2561 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 17 07:19:42.547801 ip-10-0-132-17 kubenswrapper[2561]: W0917 07:19:42.542909 2561 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 17 07:19:42.547801 ip-10-0-132-17 kubenswrapper[2561]: W0917 07:19:42.542912 2561 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 17 07:19:42.547801 ip-10-0-132-17 kubenswrapper[2561]: W0917 07:19:42.542914 2561 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 17 07:19:42.547801 ip-10-0-132-17 kubenswrapper[2561]: W0917 07:19:42.542916 2561 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 17 07:19:42.547801 ip-10-0-132-17 kubenswrapper[2561]: W0917 07:19:42.542919 2561 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 17 07:19:42.547801 ip-10-0-132-17 kubenswrapper[2561]: W0917 07:19:42.542921 2561 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 17 07:19:42.547801 ip-10-0-132-17 kubenswrapper[2561]: W0917 07:19:42.542924 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 17 07:19:42.547801 ip-10-0-132-17 kubenswrapper[2561]: W0917 07:19:42.542942 2561 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 17 07:19:42.547801 ip-10-0-132-17 kubenswrapper[2561]: W0917 07:19:42.542945 2561 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 17 07:19:42.547801 ip-10-0-132-17 kubenswrapper[2561]: W0917 07:19:42.542948 2561 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 17 07:19:42.547801 ip-10-0-132-17 kubenswrapper[2561]: W0917 07:19:42.542951 2561 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 17 07:19:42.547801 ip-10-0-132-17 kubenswrapper[2561]: W0917 07:19:42.542953 2561 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 17 07:19:42.547801 ip-10-0-132-17 kubenswrapper[2561]: W0917 07:19:42.542956 2561 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 17 07:19:42.547801 ip-10-0-132-17 kubenswrapper[2561]: W0917 07:19:42.542958 2561 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 17 07:19:42.547801 ip-10-0-132-17 kubenswrapper[2561]: W0917 07:19:42.542967 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 17 07:19:42.547801 ip-10-0-132-17 kubenswrapper[2561]: W0917 07:19:42.542969 2561 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 17 07:19:42.547801 ip-10-0-132-17 kubenswrapper[2561]: W0917 07:19:42.542974 2561 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 17 07:19:42.547801 ip-10-0-132-17 kubenswrapper[2561]: W0917 07:19:42.542976 2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 17 07:19:42.547801 ip-10-0-132-17 kubenswrapper[2561]: W0917 07:19:42.542979 2561 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 17 07:19:42.548291 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:19:42.542983 2561 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Sep 17 07:19:42.548291 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:19:42.543110 2561 server.go:962] "Client rotation is on, will bootstrap in background" Sep 17 07:19:42.548291 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:19:42.545516 2561 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Sep 17 07:19:42.548291 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:19:42.546643 2561 server.go:1019] "Starting client certificate rotation" Sep 17 07:19:42.548291 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:19:42.546757 2561 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Sep 17 07:19:42.548291 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:19:42.547700 2561 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Sep 17 07:19:42.549672 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:19:42.549660 2561 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Sep 17 07:19:42.551062 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:19:42.551044 2561 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Sep 17 07:19:42.562281 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:19:42.562264 2561 log.go:25] "Validated CRI v1 runtime API" Sep 17 07:19:42.565978 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:19:42.565963 2561 log.go:25] "Validated CRI v1 image API" Sep 17 07:19:42.567598 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:19:42.567582 2561 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Sep 17 07:19:42.572447 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:19:42.572427 2561 fs.go:135] Filesystem UUIDs: map[571e0ea1-b5d6-4378-acbc-e35cb5cf7eed:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2 dd201556-5763-4404-a3b6-bf5317fefffc:/dev/nvme0n1p4] Sep 17 07:19:42.572532 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:19:42.572447 2561 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Sep 17 07:19:42.577792 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:19:42.577602 2561 manager.go:216] Machine: {Timestamp:2026-09-17 07:19:42.576089313 +0000 UTC m=+0.382035578 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3113964 MemoryCapacity:32812158976 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec20030a194323549d32a3252a097da9 SystemUUID:ec20030a-1943-2354-9d32-a3252a097da9 BootID:26109746-606a-4925-b61e-90895353bdac Filesystems:[{Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16406081536 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16406077440 Type:vfs Inodes:4005390 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6562435072 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:ff:ce:92:5b:89 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:ff:ce:92:5b:89 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:da:14:84:ad:c1:ec Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:32812158976 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:34603008 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Sep 17 07:19:42.577792 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:19:42.577781 2561 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Sep 17 07:19:42.577961 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:19:42.577875 2561 manager.go:232] Version: {KernelVersion:5.14.0-570.140.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260908-1 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Sep 17 07:19:42.580562 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:19:42.580542 2561 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Sep 17 07:19:42.580693 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:19:42.580565 2561 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-132-17.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Sep 17 07:19:42.581435 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:19:42.581422 2561 topology_manager.go:138] "Creating topology manager with none policy" Sep 17 07:19:42.581435 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:19:42.581437 2561 container_manager_linux.go:309] "Creating device plugin manager" Sep 17 07:19:42.581558 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:19:42.581444 2561 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Sep 17 07:19:42.581558 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:19:42.581456 2561 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Sep 17 07:19:42.582733 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:19:42.582722 2561 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Sep 17 07:19:42.583327 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:19:42.583309 2561 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Sep 17 07:19:42.587948 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:19:42.587921 2561 state_mem.go:36] "Initialized new in-memory state store" Sep 17 07:19:42.588069 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:19:42.588059 2561 server.go:1240] "Using root directory" path="/var/lib/kubelet" Sep 17 07:19:42.588104 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:19:42.588088 2561 kubelet.go:486] "Attempting to sync node with API server" Sep 17 07:19:42.588104 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:19:42.588098 2561 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Sep 17 07:19:42.588184 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:19:42.588116 2561 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Sep 17 07:19:42.588184 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:19:42.588125 2561 kubelet.go:398] "Adding apiserver pod source" Sep 17 07:19:42.588184 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:19:42.588134 2561 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Sep 17 07:19:42.588415 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:19:42.588405 2561 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Sep 17 07:19:42.588455 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:19:42.588423 2561 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Sep 17 07:19:42.592124 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:19:42.592109 2561 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.12-5.rhaos4.21.gitd1ec63c.el9" apiVersion="v1" Sep 17 07:19:42.594409 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:19:42.594395 2561 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Sep 17 07:19:42.594466 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:19:42.594426 2561 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Sep 17 07:19:42.597183 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:19:42.597167 2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Sep 17 07:19:42.597242 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:19:42.597190 2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Sep 17 07:19:42.597242 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:19:42.597199 2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Sep 17 07:19:42.597242 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:19:42.597220 2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Sep 17 07:19:42.597242 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:19:42.597233 2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Sep 17 07:19:42.597242 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:19:42.597241 2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Sep 17 07:19:42.597376 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:19:42.597260 2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Sep 17 07:19:42.597376 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:19:42.597268 2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Sep 17 07:19:42.597376 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:19:42.597284 2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Sep 17 07:19:42.597376 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:19:42.597292 2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Sep 17 07:19:42.597376 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:19:42.597311 2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Sep 17 07:19:42.597376 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:19:42.597320 2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Sep 17 07:19:42.598156 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:19:42.598145 2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Sep 17 07:19:42.598156 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:19:42.598157 2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Sep 17 07:19:42.600083 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:19:42.600056 2561 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-132-17.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Sep 17 07:19:42.600751 ip-10-0-132-17 kubenswrapper[2561]: E0917 07:19:42.600729 2561 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-132-17.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Sep 17 07:19:42.600792 ip-10-0-132-17 kubenswrapper[2561]: E0917 07:19:42.600729 2561 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Sep 17 07:19:42.601852 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:19:42.601836 2561 server.go:1268] "Started kubelet" Sep 17 07:19:42.601962 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:19:42.601872 2561 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Sep 17 07:19:42.602026 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:19:42.601943 2561 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Sep 17 07:19:42.602026 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:19:42.602009 2561 server_v1.go:49] "podresources" method="list" useActivePods=true Sep 17 07:19:42.602612 ip-10-0-132-17 systemd[1]: Started Kubernetes Kubelet. Sep 17 07:19:42.607132 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:19:42.607109 2561 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Sep 17 07:19:42.608192 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:19:42.608172 2561 server.go:310] "Adding debug handlers to kubelet server" Sep 17 07:19:42.608299 ip-10-0-132-17 kubenswrapper[2561]: E0917 07:19:42.608273 2561 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Sep 17 07:19:42.613803 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:19:42.613785 2561 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Sep 17 07:19:42.615025 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:19:42.615003 2561 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Sep 17 07:19:42.615258 ip-10-0-132-17 kubenswrapper[2561]: E0917 07:19:42.615234 2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-17.ec2.internal\" not found" Sep 17 07:19:42.615966 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:19:42.615919 2561 volume_manager.go:311] "The desired_state_of_world populator starts" Sep 17 07:19:42.615966 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:19:42.615961 2561 volume_manager.go:313] "Starting Kubelet Volume Manager" Sep 17 07:19:42.616109 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:19:42.615923 2561 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Sep 17 07:19:42.616109 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:19:42.616072 2561 reconstruct.go:97] "Volume reconstruction finished" Sep 17 07:19:42.616109 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:19:42.616096 2561 reconciler.go:29] "Reconciler: start to sync state" Sep 17 07:19:42.616840 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:19:42.616818 2561 factory.go:55] Registering systemd factory Sep 17 07:19:42.616840 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:19:42.616835 2561 factory.go:223] Registration of the systemd container factory successfully Sep 17 07:19:42.617071 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:19:42.617053 2561 factory.go:153] Registering CRI-O factory Sep 17 07:19:42.617150 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:19:42.617075 2561 factory.go:223] Registration of the crio container factory successfully Sep 17 07:19:42.617150 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:19:42.617128 2561 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Sep 17 07:19:42.617150 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:19:42.617147 2561 factory.go:103] Registering Raw factory Sep 17 07:19:42.617267 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:19:42.617163 2561 manager.go:1196] Started watching for new ooms in manager Sep 17 07:19:42.617559 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:19:42.617548 2561 manager.go:349] Starting recovery of all containers Sep 17 07:19:42.621449 ip-10-0-132-17 kubenswrapper[2561]: E0917 07:19:42.621410 2561 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-132-17.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Sep 17 07:19:42.621535 ip-10-0-132-17 kubenswrapper[2561]: E0917 07:19:42.621517 2561 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Sep 17 07:19:42.622448 ip-10-0-132-17 kubenswrapper[2561]: E0917 07:19:42.621250 2561 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-132-17.ec2.internal.18d60a9f9e82ebf3 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-132-17.ec2.internal,UID:ip-10-0-132-17.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-132-17.ec2.internal,},FirstTimestamp:2026-09-17 07:19:42.601808883 +0000 UTC m=+0.407755148,LastTimestamp:2026-09-17 07:19:42.601808883 +0000 UTC m=+0.407755148,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-132-17.ec2.internal,}" Sep 17 07:19:42.627751 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:19:42.627733 2561 manager.go:354] Recovery completed Sep 17 07:19:42.631697 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:19:42.631684 2561 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 17 07:19:42.633371 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:19:42.633356 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-17.ec2.internal" event="NodeHasSufficientMemory" Sep 17 07:19:42.633429 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:19:42.633384 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-17.ec2.internal" event="NodeHasNoDiskPressure" Sep 17 07:19:42.633429 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:19:42.633397 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-17.ec2.internal" event="NodeHasSufficientPID" Sep 17 07:19:42.634005 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:19:42.633987 2561 cpu_manager.go:222] "Starting CPU manager" policy="none" Sep 17 07:19:42.634005 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:19:42.634002 2561 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Sep 17 07:19:42.634118 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:19:42.634023 2561 state_mem.go:36] "Initialized new in-memory state store" Sep 17 07:19:42.634118 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:19:42.634032 2561 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 17 07:19:42.634798 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:19:42.634782 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-17.ec2.internal" event="NodeHasSufficientMemory" Sep 17 07:19:42.634885 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:19:42.634812 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-17.ec2.internal" event="NodeHasNoDiskPressure" Sep 17 07:19:42.634885 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:19:42.634825 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-17.ec2.internal" event="NodeHasSufficientPID" Sep 17 07:19:42.636052 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:19:42.636039 2561 policy_none.go:49] "None policy: Start" Sep 17 07:19:42.636052 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:19:42.636054 2561 memory_manager.go:187] "Starting memorymanager" policy="None" Sep 17 07:19:42.636155 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:19:42.636064 2561 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Sep 17 07:19:42.636155 ip-10-0-132-17 kubenswrapper[2561]: E0917 07:19:42.636038 2561 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-132-17.ec2.internal.18d60a9fa0648289 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-132-17.ec2.internal,UID:ip-10-0-132-17.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-132-17.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-132-17.ec2.internal,},FirstTimestamp:2026-09-17 07:19:42.633370249 +0000 UTC m=+0.439316517,LastTimestamp:2026-09-17 07:19:42.633370249 +0000 UTC m=+0.439316517,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-132-17.ec2.internal,}" Sep 17 07:19:42.637853 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:19:42.637840 2561 policy_none.go:47] "Start" Sep 17 07:19:42.645062 ip-10-0-132-17 kubenswrapper[2561]: E0917 07:19:42.645007 2561 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-132-17.ec2.internal.18d60a9fa064cd3d default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-132-17.ec2.internal,UID:ip-10-0-132-17.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-132-17.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-132-17.ec2.internal,},FirstTimestamp:2026-09-17 07:19:42.633389373 +0000 UTC m=+0.439335645,LastTimestamp:2026-09-17 07:19:42.633389373 +0000 UTC m=+0.439335645,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-132-17.ec2.internal,}" Sep 17 07:19:42.648882 ip-10-0-132-17 kubenswrapper[2561]: E0917 07:19:42.648824 2561 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-132-17.ec2.internal.18d60a9fa065034f default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-132-17.ec2.internal,UID:ip-10-0-132-17.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientPID,Message:Node ip-10-0-132-17.ec2.internal status is now: NodeHasSufficientPID,Source:EventSource{Component:kubelet,Host:ip-10-0-132-17.ec2.internal,},FirstTimestamp:2026-09-17 07:19:42.633403215 +0000 UTC m=+0.439349486,LastTimestamp:2026-09-17 07:19:42.633403215 +0000 UTC m=+0.439349486,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-132-17.ec2.internal,}" Sep 17 07:19:42.651156 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:19:42.651134 2561 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-pl8kl" Sep 17 07:19:42.655978 ip-10-0-132-17 kubenswrapper[2561]: E0917 07:19:42.655897 2561 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-132-17.ec2.internal.18d60a9fa0648289\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-132-17.ec2.internal.18d60a9fa0648289 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-132-17.ec2.internal,UID:ip-10-0-132-17.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-132-17.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-132-17.ec2.internal,},FirstTimestamp:2026-09-17 07:19:42.633370249 +0000 UTC m=+0.439316517,LastTimestamp:2026-09-17 07:19:42.634797388 +0000 UTC m=+0.440743655,Count:2,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-132-17.ec2.internal,}" Sep 17 07:19:42.660521 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:19:42.660503 2561 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-pl8kl" Sep 17 07:19:42.663155 ip-10-0-132-17 kubenswrapper[2561]: E0917 07:19:42.663068 2561 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-132-17.ec2.internal.18d60a9fa064cd3d\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-132-17.ec2.internal.18d60a9fa064cd3d default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-132-17.ec2.internal,UID:ip-10-0-132-17.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-132-17.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-132-17.ec2.internal,},FirstTimestamp:2026-09-17 07:19:42.633389373 +0000 UTC m=+0.439335645,LastTimestamp:2026-09-17 07:19:42.634818445 +0000 UTC m=+0.440764711,Count:2,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-132-17.ec2.internal,}" Sep 17 07:19:42.688269 ip-10-0-132-17 kubenswrapper[2561]: E0917 07:19:42.666139 2561 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-132-17.ec2.internal.18d60a9fa065034f\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-132-17.ec2.internal.18d60a9fa065034f default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-132-17.ec2.internal,UID:ip-10-0-132-17.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientPID,Message:Node ip-10-0-132-17.ec2.internal status is now: NodeHasSufficientPID,Source:EventSource{Component:kubelet,Host:ip-10-0-132-17.ec2.internal,},FirstTimestamp:2026-09-17 07:19:42.633403215 +0000 UTC m=+0.439349486,LastTimestamp:2026-09-17 07:19:42.634830668 +0000 UTC m=+0.440776934,Count:2,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-132-17.ec2.internal,}" Sep 17 07:19:42.688269 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:19:42.677382 2561 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Sep 17 07:19:42.688269 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:19:42.677482 2561 manager.go:337] "Starting Device Plugin manager" Sep 17 07:19:42.688269 ip-10-0-132-17 kubenswrapper[2561]: E0917 07:19:42.677522 2561 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Sep 17 07:19:42.688269 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:19:42.677536 2561 server.go:87] "Starting device plugin registration server" Sep 17 07:19:42.688269 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:19:42.677788 2561 eviction_manager.go:189] "Eviction manager: starting control loop" Sep 17 07:19:42.688269 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:19:42.677799 2561 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Sep 17 07:19:42.688269 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:19:42.678107 2561 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Sep 17 07:19:42.688269 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:19:42.678199 2561 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Sep 17 07:19:42.688269 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:19:42.678207 2561 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Sep 17 07:19:42.688269 ip-10-0-132-17 kubenswrapper[2561]: E0917 07:19:42.678489 2561 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Sep 17 07:19:42.688269 ip-10-0-132-17 kubenswrapper[2561]: E0917 07:19:42.678549 2561 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-132-17.ec2.internal\" not found" Sep 17 07:19:42.688269 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:19:42.678809 2561 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Sep 17 07:19:42.688269 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:19:42.678862 2561 status_manager.go:244] "Starting to sync pod status with apiserver" Sep 17 07:19:42.688269 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:19:42.678886 2561 kubelet.go:2448] "Starting kubelet main sync loop" Sep 17 07:19:42.688269 ip-10-0-132-17 kubenswrapper[2561]: E0917 07:19:42.678948 2561 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Sep 17 07:19:42.688269 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:19:42.681576 2561 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Sep 17 07:19:42.778098 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:19:42.778026 2561 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 17 07:19:42.778844 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:19:42.778827 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-17.ec2.internal" event="NodeHasSufficientMemory" Sep 17 07:19:42.778912 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:19:42.778854 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-17.ec2.internal" event="NodeHasNoDiskPressure" Sep 17 07:19:42.778912 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:19:42.778865 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-17.ec2.internal" event="NodeHasSufficientPID" Sep 17 07:19:42.778912 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:19:42.778888 2561 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-132-17.ec2.internal" Sep 17 07:19:42.779054 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:19:42.779037 2561 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-17.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-132-17.ec2.internal"] Sep 17 07:19:42.779114 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:19:42.779104 2561 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 17 07:19:42.779831 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:19:42.779815 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-17.ec2.internal" event="NodeHasSufficientMemory" Sep 17 07:19:42.779911 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:19:42.779840 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-17.ec2.internal" event="NodeHasNoDiskPressure" Sep 17 07:19:42.779911 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:19:42.779853 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-17.ec2.internal" event="NodeHasSufficientPID" Sep 17 07:19:42.782203 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:19:42.782192 2561 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 17 07:19:42.782375 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:19:42.782359 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-17.ec2.internal" Sep 17 07:19:42.782375 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:19:42.782395 2561 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 17 07:19:42.782953 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:19:42.782916 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-17.ec2.internal" event="NodeHasSufficientMemory" Sep 17 07:19:42.782953 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:19:42.782925 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-17.ec2.internal" event="NodeHasSufficientMemory" Sep 17 07:19:42.783070 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:19:42.782963 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-17.ec2.internal" event="NodeHasNoDiskPressure" Sep 17 07:19:42.783070 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:19:42.782967 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-17.ec2.internal" event="NodeHasNoDiskPressure" Sep 17 07:19:42.783070 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:19:42.782973 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-17.ec2.internal" event="NodeHasSufficientPID" Sep 17 07:19:42.783070 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:19:42.782978 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-17.ec2.internal" event="NodeHasSufficientPID" Sep 17 07:19:42.785297 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:19:42.785283 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-17.ec2.internal" Sep 17 07:19:42.785367 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:19:42.785308 2561 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 17 07:19:42.786073 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:19:42.786059 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-17.ec2.internal" event="NodeHasSufficientMemory" Sep 17 07:19:42.786140 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:19:42.786084 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-17.ec2.internal" event="NodeHasNoDiskPressure" Sep 17 07:19:42.786140 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:19:42.786095 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-17.ec2.internal" event="NodeHasSufficientPID" Sep 17 07:19:42.788478 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:19:42.788464 2561 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-132-17.ec2.internal" Sep 17 07:19:42.788537 ip-10-0-132-17 kubenswrapper[2561]: E0917 07:19:42.788492 2561 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-132-17.ec2.internal\": node \"ip-10-0-132-17.ec2.internal\" not found" Sep 17 07:19:42.806880 ip-10-0-132-17 kubenswrapper[2561]: E0917 07:19:42.806860 2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-17.ec2.internal\" not found" Sep 17 07:19:42.807537 ip-10-0-132-17 kubenswrapper[2561]: E0917 07:19:42.807522 2561 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-132-17.ec2.internal\" not found" node="ip-10-0-132-17.ec2.internal" Sep 17 07:19:42.811700 ip-10-0-132-17 kubenswrapper[2561]: E0917 07:19:42.811687 2561 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-132-17.ec2.internal\" not found" node="ip-10-0-132-17.ec2.internal" Sep 17 07:19:42.817743 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:19:42.817727 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/db9b3544cb38d600a3f64c8b5063a0c8-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-132-17.ec2.internal\" (UID: \"db9b3544cb38d600a3f64c8b5063a0c8\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-17.ec2.internal" Sep 17 07:19:42.817806 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:19:42.817748 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/db9b3544cb38d600a3f64c8b5063a0c8-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-132-17.ec2.internal\" (UID: \"db9b3544cb38d600a3f64c8b5063a0c8\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-17.ec2.internal" Sep 17 07:19:42.817806 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:19:42.817764 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/6cba30f3283a64fbc23b4dd01a869002-config\") pod \"kube-apiserver-proxy-ip-10-0-132-17.ec2.internal\" (UID: \"6cba30f3283a64fbc23b4dd01a869002\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-132-17.ec2.internal" Sep 17 07:19:42.907519 ip-10-0-132-17 kubenswrapper[2561]: E0917 07:19:42.907504 2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-17.ec2.internal\" not found" Sep 17 07:19:42.918019 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:19:42.917998 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/db9b3544cb38d600a3f64c8b5063a0c8-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-132-17.ec2.internal\" (UID: \"db9b3544cb38d600a3f64c8b5063a0c8\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-17.ec2.internal" Sep 17 07:19:42.918101 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:19:42.918031 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/db9b3544cb38d600a3f64c8b5063a0c8-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-132-17.ec2.internal\" (UID: \"db9b3544cb38d600a3f64c8b5063a0c8\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-17.ec2.internal" Sep 17 07:19:42.918101 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:19:42.918055 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/6cba30f3283a64fbc23b4dd01a869002-config\") pod \"kube-apiserver-proxy-ip-10-0-132-17.ec2.internal\" (UID: \"6cba30f3283a64fbc23b4dd01a869002\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-132-17.ec2.internal" Sep 17 07:19:42.918201 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:19:42.918098 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/db9b3544cb38d600a3f64c8b5063a0c8-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-132-17.ec2.internal\" (UID: \"db9b3544cb38d600a3f64c8b5063a0c8\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-17.ec2.internal" Sep 17 07:19:42.918201 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:19:42.918114 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/db9b3544cb38d600a3f64c8b5063a0c8-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-132-17.ec2.internal\" (UID: \"db9b3544cb38d600a3f64c8b5063a0c8\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-17.ec2.internal" Sep 17 07:19:42.918201 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:19:42.918130 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/6cba30f3283a64fbc23b4dd01a869002-config\") pod \"kube-apiserver-proxy-ip-10-0-132-17.ec2.internal\" (UID: \"6cba30f3283a64fbc23b4dd01a869002\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-132-17.ec2.internal" Sep 17 07:19:43.007612 ip-10-0-132-17 kubenswrapper[2561]: E0917 07:19:43.007584 2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-17.ec2.internal\" not found" Sep 17 07:19:43.108427 ip-10-0-132-17 kubenswrapper[2561]: E0917 07:19:43.108373 2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-17.ec2.internal\" not found" Sep 17 07:19:43.110520 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:19:43.110507 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-17.ec2.internal" Sep 17 07:19:43.116006 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:19:43.115763 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-17.ec2.internal" Sep 17 07:19:43.209358 ip-10-0-132-17 kubenswrapper[2561]: E0917 07:19:43.209332 2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-17.ec2.internal\" not found" Sep 17 07:19:43.309908 ip-10-0-132-17 kubenswrapper[2561]: E0917 07:19:43.309883 2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-17.ec2.internal\" not found" Sep 17 07:19:43.410474 ip-10-0-132-17 kubenswrapper[2561]: E0917 07:19:43.410419 2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-17.ec2.internal\" not found" Sep 17 07:19:43.511007 ip-10-0-132-17 kubenswrapper[2561]: E0917 07:19:43.510971 2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-17.ec2.internal\" not found" Sep 17 07:19:43.546443 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:19:43.546423 2561 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Sep 17 07:19:43.546822 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:19:43.546544 2561 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Sep 17 07:19:43.611809 ip-10-0-132-17 kubenswrapper[2561]: E0917 07:19:43.611788 2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-17.ec2.internal\" not found" Sep 17 07:19:43.655317 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:19:43.655294 2561 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Sep 17 07:19:43.666565 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:19:43.666500 2561 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-09-16 07:14:42 +0000 UTC" deadline="2028-05-04 04:00:53.915601547 +0000 UTC" Sep 17 07:19:43.666565 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:19:43.666528 2561 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="14276h41m10.24907703s" Sep 17 07:19:43.681469 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:19:43.681449 2561 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 17 07:19:43.682388 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:19:43.682373 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-17.ec2.internal" event="NodeHasSufficientMemory" Sep 17 07:19:43.682457 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:19:43.682408 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-17.ec2.internal" event="NodeHasNoDiskPressure" Sep 17 07:19:43.682457 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:19:43.682424 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-17.ec2.internal" event="NodeHasSufficientPID" Sep 17 07:19:43.712502 ip-10-0-132-17 kubenswrapper[2561]: E0917 07:19:43.712483 2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-17.ec2.internal\" not found" Sep 17 07:19:43.813082 ip-10-0-132-17 kubenswrapper[2561]: E0917 07:19:43.813056 2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-17.ec2.internal\" not found" Sep 17 07:19:43.878829 ip-10-0-132-17 kubenswrapper[2561]: W0917 07:19:43.878783 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6cba30f3283a64fbc23b4dd01a869002.slice/crio-10fce0767b532babc4e6bd95a6a6a22f1bf975407f895f16d63e771af592c3dd WatchSource:0}: Error finding container 10fce0767b532babc4e6bd95a6a6a22f1bf975407f895f16d63e771af592c3dd: Status 404 returned error can't find the container with id 10fce0767b532babc4e6bd95a6a6a22f1bf975407f895f16d63e771af592c3dd Sep 17 07:19:43.884455 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:19:43.884430 2561 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Sep 17 07:19:43.913786 ip-10-0-132-17 kubenswrapper[2561]: E0917 07:19:43.913766 2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-17.ec2.internal\" not found" Sep 17 07:19:44.014381 ip-10-0-132-17 kubenswrapper[2561]: E0917 07:19:44.014308 2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-17.ec2.internal\" not found" Sep 17 07:19:44.103532 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:19:44.103503 2561 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Sep 17 07:19:44.116471 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:19:44.116453 2561 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-17.ec2.internal" Sep 17 07:19:44.133527 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:19:44.133511 2561 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Sep 17 07:19:44.135307 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:19:44.135297 2561 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-17.ec2.internal" Sep 17 07:19:44.142545 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:19:44.142534 2561 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Sep 17 07:19:44.150104 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:19:44.150088 2561 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Sep 17 07:19:44.588835 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:19:44.588806 2561 apiserver.go:52] "Watching apiserver" Sep 17 07:19:44.595657 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:19:44.595636 2561 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Sep 17 07:19:44.596125 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:19:44.596099 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-operator/iptables-alerter-dp2bc","openshift-ovn-kubernetes/ovnkube-node-2frz9","kube-system/global-pull-secret-syncer-rs4vc","kube-system/konnectivity-agent-9skpb","kube-system/kube-apiserver-proxy-ip-10-0-132-17.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-77v6s","openshift-dns/node-resolver-8qgg7","openshift-image-registry/node-ca-pwnj9","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-17.ec2.internal","openshift-multus/multus-pj8tk","openshift-cluster-node-tuning-operator/tuned-885ch","openshift-multus/multus-additional-cni-plugins-4hbmd","openshift-multus/network-metrics-daemon-mcwtb","openshift-network-diagnostics/network-check-target-qzfhn"] Sep 17 07:19:44.598449 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:19:44.598425 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-dp2bc" Sep 17 07:19:44.600468 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:19:44.600449 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qzfhn" Sep 17 07:19:44.600551 ip-10-0-132-17 kubenswrapper[2561]: E0917 07:19:44.600518 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qzfhn" podUID="ea653065-69b3-4da2-b8d0-9518964204d9" Sep 17 07:19:44.601082 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:19:44.601064 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Sep 17 07:19:44.601202 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:19:44.601181 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-vx6rr\"" Sep 17 07:19:44.601293 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:19:44.601277 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Sep 17 07:19:44.601359 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:19:44.601343 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Sep 17 07:19:44.602561 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:19:44.602453 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mcwtb" Sep 17 07:19:44.602561 ip-10-0-132-17 kubenswrapper[2561]: E0917 07:19:44.602514 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mcwtb" podUID="e6c12e07-53e7-4f30-a8bf-c5d1a727d2fb" Sep 17 07:19:44.604393 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:19:44.604378 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-9skpb" Sep 17 07:19:44.606480 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:19:44.606463 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-4hbmd" Sep 17 07:19:44.608364 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:19:44.608348 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-klcmb\"" Sep 17 07:19:44.608560 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:19:44.608544 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Sep 17 07:19:44.608656 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:19:44.608620 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-pwnj9" Sep 17 07:19:44.609175 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:19:44.609156 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Sep 17 07:19:44.610271 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:19:44.610254 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Sep 17 07:19:44.610753 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:19:44.610737 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Sep 17 07:19:44.611070 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:19:44.611055 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-8qgg7" Sep 17 07:19:44.612687 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:19:44.612657 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-7sbtz\"" Sep 17 07:19:44.613780 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:19:44.613763 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-77v6s" Sep 17 07:19:44.613949 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:19:44.613913 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Sep 17 07:19:44.614340 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:19:44.614325 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Sep 17 07:19:44.614776 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:19:44.614759 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Sep 17 07:19:44.614865 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:19:44.614792 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Sep 17 07:19:44.615150 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:19:44.615038 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-bz7p5\"" Sep 17 07:19:44.615150 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:19:44.615074 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Sep 17 07:19:44.615261 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:19:44.615220 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Sep 17 07:19:44.615312 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:19:44.615294 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Sep 17 07:19:44.615947 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:19:44.615488 2561 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Sep 17 07:19:44.615947 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:19:44.615557 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-l4zmh\"" Sep 17 07:19:44.615947 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:19:44.615944 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Sep 17 07:19:44.616721 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:19:44.616704 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Sep 17 07:19:44.616721 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:19:44.616713 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-7rfgk\"" Sep 17 07:19:44.617027 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:19:44.617005 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Sep 17 07:19:44.617155 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:19:44.617140 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Sep 17 07:19:44.617442 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:19:44.617427 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-pj8tk" Sep 17 07:19:44.619185 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:19:44.618945 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-885ch" Sep 17 07:19:44.621037 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:19:44.621010 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-z5vrw\"" Sep 17 07:19:44.621248 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:19:44.621220 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Sep 17 07:19:44.621503 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:19:44.621484 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Sep 17 07:19:44.623859 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:19:44.623838 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rs4vc" Sep 17 07:19:44.623962 ip-10-0-132-17 kubenswrapper[2561]: E0917 07:19:44.623898 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rs4vc" podUID="f387de20-2724-46ab-9bca-b4b4a23711cf" Sep 17 07:19:44.624306 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:19:44.624290 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-6njvq\"" Sep 17 07:19:44.624555 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:19:44.624540 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Sep 17 07:19:44.626167 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:19:44.626151 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-2frz9" Sep 17 07:19:44.626714 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:19:44.626694 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/dfe039e6-328a-476c-805f-7b90b0401bc0-system-cni-dir\") pod \"multus-pj8tk\" (UID: \"dfe039e6-328a-476c-805f-7b90b0401bc0\") " pod="openshift-multus/multus-pj8tk" Sep 17 07:19:44.626798 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:19:44.626719 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/dfe039e6-328a-476c-805f-7b90b0401bc0-cnibin\") pod \"multus-pj8tk\" (UID: \"dfe039e6-328a-476c-805f-7b90b0401bc0\") " pod="openshift-multus/multus-pj8tk" Sep 17 07:19:44.626798 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:19:44.626734 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/dd6eae9b-928b-4509-b4cb-035eb209c15d-etc-systemd\") pod \"tuned-885ch\" (UID: \"dd6eae9b-928b-4509-b4cb-035eb209c15d\") " pod="openshift-cluster-node-tuning-operator/tuned-885ch" Sep 17 07:19:44.626798 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:19:44.626749 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/dc177633-60cf-4933-90f5-26d2619f7c82-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-4hbmd\" (UID: \"dc177633-60cf-4933-90f5-26d2619f7c82\") " pod="openshift-multus/multus-additional-cni-plugins-4hbmd" Sep 17 07:19:44.626798 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:19:44.626763 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rhgsz\" (UniqueName: \"kubernetes.io/projected/dc177633-60cf-4933-90f5-26d2619f7c82-kube-api-access-rhgsz\") pod \"multus-additional-cni-plugins-4hbmd\" (UID: \"dc177633-60cf-4933-90f5-26d2619f7c82\") " pod="openshift-multus/multus-additional-cni-plugins-4hbmd" Sep 17 07:19:44.626798 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:19:44.626776 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/dfe039e6-328a-476c-805f-7b90b0401bc0-host-var-lib-cni-multus\") pod \"multus-pj8tk\" (UID: \"dfe039e6-328a-476c-805f-7b90b0401bc0\") " pod="openshift-multus/multus-pj8tk" Sep 17 07:19:44.626798 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:19:44.626789 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/4d703673-6fad-4e54-82fd-c935ee6fed42-registration-dir\") pod \"aws-ebs-csi-driver-node-77v6s\" (UID: \"4d703673-6fad-4e54-82fd-c935ee6fed42\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-77v6s" Sep 17 07:19:44.626798 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:19:44.626801 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/dc177633-60cf-4933-90f5-26d2619f7c82-system-cni-dir\") pod \"multus-additional-cni-plugins-4hbmd\" (UID: \"dc177633-60cf-4933-90f5-26d2619f7c82\") " pod="openshift-multus/multus-additional-cni-plugins-4hbmd" Sep 17 07:19:44.627150 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:19:44.626814 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6zc8b\" (UniqueName: \"kubernetes.io/projected/dfe039e6-328a-476c-805f-7b90b0401bc0-kube-api-access-6zc8b\") pod \"multus-pj8tk\" (UID: \"dfe039e6-328a-476c-805f-7b90b0401bc0\") " pod="openshift-multus/multus-pj8tk" Sep 17 07:19:44.627150 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:19:44.626827 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/dd6eae9b-928b-4509-b4cb-035eb209c15d-sys\") pod \"tuned-885ch\" (UID: \"dd6eae9b-928b-4509-b4cb-035eb209c15d\") " pod="openshift-cluster-node-tuning-operator/tuned-885ch" Sep 17 07:19:44.627150 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:19:44.626839 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/dd6eae9b-928b-4509-b4cb-035eb209c15d-etc-sysctl-d\") pod \"tuned-885ch\" (UID: \"dd6eae9b-928b-4509-b4cb-035eb209c15d\") " pod="openshift-cluster-node-tuning-operator/tuned-885ch" Sep 17 07:19:44.627150 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:19:44.626904 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zsbc8\" (UniqueName: \"kubernetes.io/projected/4d703673-6fad-4e54-82fd-c935ee6fed42-kube-api-access-zsbc8\") pod \"aws-ebs-csi-driver-node-77v6s\" (UID: \"4d703673-6fad-4e54-82fd-c935ee6fed42\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-77v6s" Sep 17 07:19:44.627839 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:19:44.627705 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/dc177633-60cf-4933-90f5-26d2619f7c82-cni-binary-copy\") pod \"multus-additional-cni-plugins-4hbmd\" (UID: \"dc177633-60cf-4933-90f5-26d2619f7c82\") " pod="openshift-multus/multus-additional-cni-plugins-4hbmd" Sep 17 07:19:44.627839 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:19:44.627743 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qvrgh\" (UniqueName: \"kubernetes.io/projected/a4c6eeea-2ae6-4bb2-93ee-1b46b62da363-kube-api-access-qvrgh\") pod \"node-ca-pwnj9\" (UID: \"a4c6eeea-2ae6-4bb2-93ee-1b46b62da363\") " pod="openshift-image-registry/node-ca-pwnj9" Sep 17 07:19:44.627839 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:19:44.627770 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/dfe039e6-328a-476c-805f-7b90b0401bc0-cni-binary-copy\") pod \"multus-pj8tk\" (UID: \"dfe039e6-328a-476c-805f-7b90b0401bc0\") " pod="openshift-multus/multus-pj8tk" Sep 17 07:19:44.627839 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:19:44.627797 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/dfe039e6-328a-476c-805f-7b90b0401bc0-multus-socket-dir-parent\") pod \"multus-pj8tk\" (UID: \"dfe039e6-328a-476c-805f-7b90b0401bc0\") " pod="openshift-multus/multus-pj8tk" Sep 17 07:19:44.627839 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:19:44.627821 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/dfe039e6-328a-476c-805f-7b90b0401bc0-multus-daemon-config\") pod \"multus-pj8tk\" (UID: \"dfe039e6-328a-476c-805f-7b90b0401bc0\") " pod="openshift-multus/multus-pj8tk" Sep 17 07:19:44.628137 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:19:44.627841 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/dd6eae9b-928b-4509-b4cb-035eb209c15d-var-lib-kubelet\") pod \"tuned-885ch\" (UID: \"dd6eae9b-928b-4509-b4cb-035eb209c15d\") " pod="openshift-cluster-node-tuning-operator/tuned-885ch" Sep 17 07:19:44.628137 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:19:44.627869 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/96c5b8e5-2fc0-489b-8889-52bf66184838-agent-certs\") pod \"konnectivity-agent-9skpb\" (UID: \"96c5b8e5-2fc0-489b-8889-52bf66184838\") " pod="kube-system/konnectivity-agent-9skpb" Sep 17 07:19:44.628137 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:19:44.627895 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/dc177633-60cf-4933-90f5-26d2619f7c82-cnibin\") pod \"multus-additional-cni-plugins-4hbmd\" (UID: \"dc177633-60cf-4933-90f5-26d2619f7c82\") " pod="openshift-multus/multus-additional-cni-plugins-4hbmd" Sep 17 07:19:44.628137 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:19:44.627950 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/dc177633-60cf-4933-90f5-26d2619f7c82-tuning-conf-dir\") pod \"multus-additional-cni-plugins-4hbmd\" (UID: \"dc177633-60cf-4933-90f5-26d2619f7c82\") " pod="openshift-multus/multus-additional-cni-plugins-4hbmd" Sep 17 07:19:44.628137 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:19:44.627971 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/dfe039e6-328a-476c-805f-7b90b0401bc0-multus-cni-dir\") pod \"multus-pj8tk\" (UID: \"dfe039e6-328a-476c-805f-7b90b0401bc0\") " pod="openshift-multus/multus-pj8tk" Sep 17 07:19:44.628137 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:19:44.627984 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/dd6eae9b-928b-4509-b4cb-035eb209c15d-etc-modprobe-d\") pod \"tuned-885ch\" (UID: \"dd6eae9b-928b-4509-b4cb-035eb209c15d\") " pod="openshift-cluster-node-tuning-operator/tuned-885ch" Sep 17 07:19:44.628137 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:19:44.627996 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/dd6eae9b-928b-4509-b4cb-035eb209c15d-etc-kubernetes\") pod \"tuned-885ch\" (UID: \"dd6eae9b-928b-4509-b4cb-035eb209c15d\") " pod="openshift-cluster-node-tuning-operator/tuned-885ch" Sep 17 07:19:44.628137 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:19:44.628014 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/dd6eae9b-928b-4509-b4cb-035eb209c15d-tmp\") pod \"tuned-885ch\" (UID: \"dd6eae9b-928b-4509-b4cb-035eb209c15d\") " pod="openshift-cluster-node-tuning-operator/tuned-885ch" Sep 17 07:19:44.628137 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:19:44.628053 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/dfe039e6-328a-476c-805f-7b90b0401bc0-host-var-lib-cni-bin\") pod \"multus-pj8tk\" (UID: \"dfe039e6-328a-476c-805f-7b90b0401bc0\") " pod="openshift-multus/multus-pj8tk" Sep 17 07:19:44.628137 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:19:44.628091 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jww4t\" (UniqueName: \"kubernetes.io/projected/ea653065-69b3-4da2-b8d0-9518964204d9-kube-api-access-jww4t\") pod \"network-check-target-qzfhn\" (UID: \"ea653065-69b3-4da2-b8d0-9518964204d9\") " pod="openshift-network-diagnostics/network-check-target-qzfhn" Sep 17 07:19:44.628137 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:19:44.628118 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e6c12e07-53e7-4f30-a8bf-c5d1a727d2fb-metrics-certs\") pod \"network-metrics-daemon-mcwtb\" (UID: \"e6c12e07-53e7-4f30-a8bf-c5d1a727d2fb\") " pod="openshift-multus/network-metrics-daemon-mcwtb" Sep 17 07:19:44.628606 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:19:44.628147 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/dfe039e6-328a-476c-805f-7b90b0401bc0-etc-kubernetes\") pod \"multus-pj8tk\" (UID: \"dfe039e6-328a-476c-805f-7b90b0401bc0\") " pod="openshift-multus/multus-pj8tk" Sep 17 07:19:44.628606 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:19:44.628169 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/dd6eae9b-928b-4509-b4cb-035eb209c15d-etc-sysconfig\") pod \"tuned-885ch\" (UID: \"dd6eae9b-928b-4509-b4cb-035eb209c15d\") " pod="openshift-cluster-node-tuning-operator/tuned-885ch" Sep 17 07:19:44.628606 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:19:44.628198 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/4d703673-6fad-4e54-82fd-c935ee6fed42-etc-selinux\") pod \"aws-ebs-csi-driver-node-77v6s\" (UID: \"4d703673-6fad-4e54-82fd-c935ee6fed42\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-77v6s" Sep 17 07:19:44.628606 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:19:44.628220 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n8fzj\" (UniqueName: \"kubernetes.io/projected/e6c12e07-53e7-4f30-a8bf-c5d1a727d2fb-kube-api-access-n8fzj\") pod \"network-metrics-daemon-mcwtb\" (UID: \"e6c12e07-53e7-4f30-a8bf-c5d1a727d2fb\") " pod="openshift-multus/network-metrics-daemon-mcwtb" Sep 17 07:19:44.628606 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:19:44.628244 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/dfe039e6-328a-476c-805f-7b90b0401bc0-host-var-lib-kubelet\") pod \"multus-pj8tk\" (UID: \"dfe039e6-328a-476c-805f-7b90b0401bc0\") " pod="openshift-multus/multus-pj8tk" Sep 17 07:19:44.628606 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:19:44.628264 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-24ww4\" (UniqueName: \"kubernetes.io/projected/dd6eae9b-928b-4509-b4cb-035eb209c15d-kube-api-access-24ww4\") pod \"tuned-885ch\" (UID: \"dd6eae9b-928b-4509-b4cb-035eb209c15d\") " pod="openshift-cluster-node-tuning-operator/tuned-885ch" Sep 17 07:19:44.628606 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:19:44.628287 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/4d703673-6fad-4e54-82fd-c935ee6fed42-kubelet-dir\") pod \"aws-ebs-csi-driver-node-77v6s\" (UID: \"4d703673-6fad-4e54-82fd-c935ee6fed42\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-77v6s" Sep 17 07:19:44.628606 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:19:44.628319 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/dfe039e6-328a-476c-805f-7b90b0401bc0-multus-conf-dir\") pod \"multus-pj8tk\" (UID: \"dfe039e6-328a-476c-805f-7b90b0401bc0\") " pod="openshift-multus/multus-pj8tk" Sep 17 07:19:44.628606 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:19:44.628342 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/dd6eae9b-928b-4509-b4cb-035eb209c15d-run\") pod \"tuned-885ch\" (UID: \"dd6eae9b-928b-4509-b4cb-035eb209c15d\") " pod="openshift-cluster-node-tuning-operator/tuned-885ch" Sep 17 07:19:44.628606 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:19:44.628386 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/4d703673-6fad-4e54-82fd-c935ee6fed42-sys-fs\") pod \"aws-ebs-csi-driver-node-77v6s\" (UID: \"4d703673-6fad-4e54-82fd-c935ee6fed42\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-77v6s" Sep 17 07:19:44.628606 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:19:44.628415 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/4d703673-6fad-4e54-82fd-c935ee6fed42-device-dir\") pod \"aws-ebs-csi-driver-node-77v6s\" (UID: \"4d703673-6fad-4e54-82fd-c935ee6fed42\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-77v6s" Sep 17 07:19:44.628606 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:19:44.628391 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Sep 17 07:19:44.628606 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:19:44.628422 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Sep 17 07:19:44.628606 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:19:44.628471 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Sep 17 07:19:44.628606 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:19:44.628565 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/dfe039e6-328a-476c-805f-7b90b0401bc0-host-run-netns\") pod \"multus-pj8tk\" (UID: \"dfe039e6-328a-476c-805f-7b90b0401bc0\") " pod="openshift-multus/multus-pj8tk" Sep 17 07:19:44.628606 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:19:44.628597 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/e154eb37-bb6a-4aca-b364-ab985fa57261-hosts-file\") pod \"node-resolver-8qgg7\" (UID: \"e154eb37-bb6a-4aca-b364-ab985fa57261\") " pod="openshift-dns/node-resolver-8qgg7" Sep 17 07:19:44.629273 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:19:44.628617 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/a4c6eeea-2ae6-4bb2-93ee-1b46b62da363-host\") pod \"node-ca-pwnj9\" (UID: \"a4c6eeea-2ae6-4bb2-93ee-1b46b62da363\") " pod="openshift-image-registry/node-ca-pwnj9" Sep 17 07:19:44.629273 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:19:44.628647 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/dfe039e6-328a-476c-805f-7b90b0401bc0-host-run-multus-certs\") pod \"multus-pj8tk\" (UID: \"dfe039e6-328a-476c-805f-7b90b0401bc0\") " pod="openshift-multus/multus-pj8tk" Sep 17 07:19:44.629273 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:19:44.628708 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/dd6eae9b-928b-4509-b4cb-035eb209c15d-etc-sysctl-conf\") pod \"tuned-885ch\" (UID: \"dd6eae9b-928b-4509-b4cb-035eb209c15d\") " pod="openshift-cluster-node-tuning-operator/tuned-885ch" Sep 17 07:19:44.629273 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:19:44.628733 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/dd6eae9b-928b-4509-b4cb-035eb209c15d-lib-modules\") pod \"tuned-885ch\" (UID: \"dd6eae9b-928b-4509-b4cb-035eb209c15d\") " pod="openshift-cluster-node-tuning-operator/tuned-885ch" Sep 17 07:19:44.629273 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:19:44.628756 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/d0ad9040-c0ce-453f-813c-809ea9f53c56-iptables-alerter-script\") pod \"iptables-alerter-dp2bc\" (UID: \"d0ad9040-c0ce-453f-813c-809ea9f53c56\") " pod="openshift-network-operator/iptables-alerter-dp2bc" Sep 17 07:19:44.629273 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:19:44.628795 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-klxf5\" (UniqueName: \"kubernetes.io/projected/d0ad9040-c0ce-453f-813c-809ea9f53c56-kube-api-access-klxf5\") pod \"iptables-alerter-dp2bc\" (UID: \"d0ad9040-c0ce-453f-813c-809ea9f53c56\") " pod="openshift-network-operator/iptables-alerter-dp2bc" Sep 17 07:19:44.629273 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:19:44.628817 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Sep 17 07:19:44.629273 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:19:44.628827 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Sep 17 07:19:44.629273 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:19:44.628816 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/96c5b8e5-2fc0-489b-8889-52bf66184838-konnectivity-ca\") pod \"konnectivity-agent-9skpb\" (UID: \"96c5b8e5-2fc0-489b-8889-52bf66184838\") " pod="kube-system/konnectivity-agent-9skpb" Sep 17 07:19:44.629273 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:19:44.628989 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/4d703673-6fad-4e54-82fd-c935ee6fed42-socket-dir\") pod \"aws-ebs-csi-driver-node-77v6s\" (UID: \"4d703673-6fad-4e54-82fd-c935ee6fed42\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-77v6s" Sep 17 07:19:44.629273 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:19:44.629014 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/dfe039e6-328a-476c-805f-7b90b0401bc0-host-run-k8s-cni-cncf-io\") pod \"multus-pj8tk\" (UID: \"dfe039e6-328a-476c-805f-7b90b0401bc0\") " pod="openshift-multus/multus-pj8tk" Sep 17 07:19:44.629273 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:19:44.629046 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e154eb37-bb6a-4aca-b364-ab985fa57261-tmp-dir\") pod \"node-resolver-8qgg7\" (UID: \"e154eb37-bb6a-4aca-b364-ab985fa57261\") " pod="openshift-dns/node-resolver-8qgg7" Sep 17 07:19:44.629273 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:19:44.629056 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Sep 17 07:19:44.629273 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:19:44.629066 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/dd6eae9b-928b-4509-b4cb-035eb209c15d-host\") pod \"tuned-885ch\" (UID: \"dd6eae9b-928b-4509-b4cb-035eb209c15d\") " pod="openshift-cluster-node-tuning-operator/tuned-885ch" Sep 17 07:19:44.629273 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:19:44.629088 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/dd6eae9b-928b-4509-b4cb-035eb209c15d-etc-tuned\") pod \"tuned-885ch\" (UID: \"dd6eae9b-928b-4509-b4cb-035eb209c15d\") " pod="openshift-cluster-node-tuning-operator/tuned-885ch" Sep 17 07:19:44.629273 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:19:44.629129 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/dc177633-60cf-4933-90f5-26d2619f7c82-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-4hbmd\" (UID: \"dc177633-60cf-4933-90f5-26d2619f7c82\") " pod="openshift-multus/multus-additional-cni-plugins-4hbmd" Sep 17 07:19:44.629273 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:19:44.629149 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/a4c6eeea-2ae6-4bb2-93ee-1b46b62da363-serviceca\") pod \"node-ca-pwnj9\" (UID: \"a4c6eeea-2ae6-4bb2-93ee-1b46b62da363\") " pod="openshift-image-registry/node-ca-pwnj9" Sep 17 07:19:44.629273 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:19:44.629175 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/dfe039e6-328a-476c-805f-7b90b0401bc0-hostroot\") pod \"multus-pj8tk\" (UID: \"dfe039e6-328a-476c-805f-7b90b0401bc0\") " pod="openshift-multus/multus-pj8tk" Sep 17 07:19:44.630028 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:19:44.629200 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/d0ad9040-c0ce-453f-813c-809ea9f53c56-host-slash\") pod \"iptables-alerter-dp2bc\" (UID: \"d0ad9040-c0ce-453f-813c-809ea9f53c56\") " pod="openshift-network-operator/iptables-alerter-dp2bc" Sep 17 07:19:44.630028 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:19:44.629229 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t7lqp\" (UniqueName: \"kubernetes.io/projected/e154eb37-bb6a-4aca-b364-ab985fa57261-kube-api-access-t7lqp\") pod \"node-resolver-8qgg7\" (UID: \"e154eb37-bb6a-4aca-b364-ab985fa57261\") " pod="openshift-dns/node-resolver-8qgg7" Sep 17 07:19:44.630028 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:19:44.629358 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-wbdk4\"" Sep 17 07:19:44.633870 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:19:44.633836 2561 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Sep 17 07:19:44.654352 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:19:44.654333 2561 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-bhfxl" Sep 17 07:19:44.666215 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:19:44.666198 2561 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-bhfxl" Sep 17 07:19:44.685243 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:19:44.685196 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-17.ec2.internal" event={"ID":"6cba30f3283a64fbc23b4dd01a869002","Type":"ContainerStarted","Data":"10fce0767b532babc4e6bd95a6a6a22f1bf975407f895f16d63e771af592c3dd"} Sep 17 07:19:44.687129 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:19:44.687086 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-17.ec2.internal" event={"ID":"db9b3544cb38d600a3f64c8b5063a0c8","Type":"ContainerStarted","Data":"561234364cdd7f1098c1e2f2a91a13807e0485e990735defa1ec5581244d260b"} Sep 17 07:19:44.717237 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:19:44.717218 2561 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Sep 17 07:19:44.729773 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:19:44.729748 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e6c12e07-53e7-4f30-a8bf-c5d1a727d2fb-metrics-certs\") pod \"network-metrics-daemon-mcwtb\" (UID: \"e6c12e07-53e7-4f30-a8bf-c5d1a727d2fb\") " pod="openshift-multus/network-metrics-daemon-mcwtb" Sep 17 07:19:44.729890 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:19:44.729784 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/dfe039e6-328a-476c-805f-7b90b0401bc0-etc-kubernetes\") pod \"multus-pj8tk\" (UID: \"dfe039e6-328a-476c-805f-7b90b0401bc0\") " pod="openshift-multus/multus-pj8tk" Sep 17 07:19:44.729890 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:19:44.729805 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/dd6eae9b-928b-4509-b4cb-035eb209c15d-etc-sysconfig\") pod \"tuned-885ch\" (UID: \"dd6eae9b-928b-4509-b4cb-035eb209c15d\") " pod="openshift-cluster-node-tuning-operator/tuned-885ch" Sep 17 07:19:44.729890 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:19:44.729830 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/4d703673-6fad-4e54-82fd-c935ee6fed42-etc-selinux\") pod \"aws-ebs-csi-driver-node-77v6s\" (UID: \"4d703673-6fad-4e54-82fd-c935ee6fed42\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-77v6s" Sep 17 07:19:44.729890 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:19:44.729868 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n8fzj\" (UniqueName: \"kubernetes.io/projected/e6c12e07-53e7-4f30-a8bf-c5d1a727d2fb-kube-api-access-n8fzj\") pod \"network-metrics-daemon-mcwtb\" (UID: \"e6c12e07-53e7-4f30-a8bf-c5d1a727d2fb\") " pod="openshift-multus/network-metrics-daemon-mcwtb" Sep 17 07:19:44.730110 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:19:44.729903 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/dfe039e6-328a-476c-805f-7b90b0401bc0-etc-kubernetes\") pod \"multus-pj8tk\" (UID: \"dfe039e6-328a-476c-805f-7b90b0401bc0\") " pod="openshift-multus/multus-pj8tk" Sep 17 07:19:44.730110 ip-10-0-132-17 kubenswrapper[2561]: E0917 07:19:44.729914 2561 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 17 07:19:44.730110 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:19:44.729895 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/dfe039e6-328a-476c-805f-7b90b0401bc0-host-var-lib-kubelet\") pod \"multus-pj8tk\" (UID: \"dfe039e6-328a-476c-805f-7b90b0401bc0\") " pod="openshift-multus/multus-pj8tk" Sep 17 07:19:44.730110 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:19:44.729972 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/dd6eae9b-928b-4509-b4cb-035eb209c15d-etc-sysconfig\") pod \"tuned-885ch\" (UID: \"dd6eae9b-928b-4509-b4cb-035eb209c15d\") " pod="openshift-cluster-node-tuning-operator/tuned-885ch" Sep 17 07:19:44.730110 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:19:44.730007 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/dfe039e6-328a-476c-805f-7b90b0401bc0-host-var-lib-kubelet\") pod \"multus-pj8tk\" (UID: \"dfe039e6-328a-476c-805f-7b90b0401bc0\") " pod="openshift-multus/multus-pj8tk" Sep 17 07:19:44.730110 ip-10-0-132-17 kubenswrapper[2561]: E0917 07:19:44.730051 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e6c12e07-53e7-4f30-a8bf-c5d1a727d2fb-metrics-certs podName:e6c12e07-53e7-4f30-a8bf-c5d1a727d2fb nodeName:}" failed. No retries permitted until 2026-09-17 07:19:45.230010148 +0000 UTC m=+3.035956416 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e6c12e07-53e7-4f30-a8bf-c5d1a727d2fb-metrics-certs") pod "network-metrics-daemon-mcwtb" (UID: "e6c12e07-53e7-4f30-a8bf-c5d1a727d2fb") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 17 07:19:44.730110 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:19:44.730073 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-24ww4\" (UniqueName: \"kubernetes.io/projected/dd6eae9b-928b-4509-b4cb-035eb209c15d-kube-api-access-24ww4\") pod \"tuned-885ch\" (UID: \"dd6eae9b-928b-4509-b4cb-035eb209c15d\") " pod="openshift-cluster-node-tuning-operator/tuned-885ch" Sep 17 07:19:44.730110 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:19:44.730103 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/0b5240b1-13ea-4cee-b7f1-aa241ca58aa4-host-kubelet\") pod \"ovnkube-node-2frz9\" (UID: \"0b5240b1-13ea-4cee-b7f1-aa241ca58aa4\") " pod="openshift-ovn-kubernetes/ovnkube-node-2frz9" Sep 17 07:19:44.730465 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:19:44.730129 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/0b5240b1-13ea-4cee-b7f1-aa241ca58aa4-run-openvswitch\") pod \"ovnkube-node-2frz9\" (UID: \"0b5240b1-13ea-4cee-b7f1-aa241ca58aa4\") " pod="openshift-ovn-kubernetes/ovnkube-node-2frz9" Sep 17 07:19:44.730465 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:19:44.730163 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/0b5240b1-13ea-4cee-b7f1-aa241ca58aa4-log-socket\") pod \"ovnkube-node-2frz9\" (UID: \"0b5240b1-13ea-4cee-b7f1-aa241ca58aa4\") " pod="openshift-ovn-kubernetes/ovnkube-node-2frz9" Sep 17 07:19:44.730465 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:19:44.730141 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/4d703673-6fad-4e54-82fd-c935ee6fed42-etc-selinux\") pod \"aws-ebs-csi-driver-node-77v6s\" (UID: \"4d703673-6fad-4e54-82fd-c935ee6fed42\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-77v6s" Sep 17 07:19:44.730465 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:19:44.730193 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/4d703673-6fad-4e54-82fd-c935ee6fed42-kubelet-dir\") pod \"aws-ebs-csi-driver-node-77v6s\" (UID: \"4d703673-6fad-4e54-82fd-c935ee6fed42\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-77v6s" Sep 17 07:19:44.730465 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:19:44.730221 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/dfe039e6-328a-476c-805f-7b90b0401bc0-multus-conf-dir\") pod \"multus-pj8tk\" (UID: \"dfe039e6-328a-476c-805f-7b90b0401bc0\") " pod="openshift-multus/multus-pj8tk" Sep 17 07:19:44.730465 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:19:44.730241 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/dd6eae9b-928b-4509-b4cb-035eb209c15d-run\") pod \"tuned-885ch\" (UID: \"dd6eae9b-928b-4509-b4cb-035eb209c15d\") " pod="openshift-cluster-node-tuning-operator/tuned-885ch" Sep 17 07:19:44.730465 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:19:44.730259 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/4d703673-6fad-4e54-82fd-c935ee6fed42-kubelet-dir\") pod \"aws-ebs-csi-driver-node-77v6s\" (UID: \"4d703673-6fad-4e54-82fd-c935ee6fed42\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-77v6s" Sep 17 07:19:44.730465 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:19:44.730268 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0b5240b1-13ea-4cee-b7f1-aa241ca58aa4-host-run-ovn-kubernetes\") pod \"ovnkube-node-2frz9\" (UID: \"0b5240b1-13ea-4cee-b7f1-aa241ca58aa4\") " pod="openshift-ovn-kubernetes/ovnkube-node-2frz9" Sep 17 07:19:44.730465 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:19:44.730299 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0b5240b1-13ea-4cee-b7f1-aa241ca58aa4-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-2frz9\" (UID: \"0b5240b1-13ea-4cee-b7f1-aa241ca58aa4\") " pod="openshift-ovn-kubernetes/ovnkube-node-2frz9" Sep 17 07:19:44.730465 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:19:44.730326 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/0b5240b1-13ea-4cee-b7f1-aa241ca58aa4-ovnkube-script-lib\") pod \"ovnkube-node-2frz9\" (UID: \"0b5240b1-13ea-4cee-b7f1-aa241ca58aa4\") " pod="openshift-ovn-kubernetes/ovnkube-node-2frz9" Sep 17 07:19:44.730465 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:19:44.730344 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/dfe039e6-328a-476c-805f-7b90b0401bc0-multus-conf-dir\") pod \"multus-pj8tk\" (UID: \"dfe039e6-328a-476c-805f-7b90b0401bc0\") " pod="openshift-multus/multus-pj8tk" Sep 17 07:19:44.730465 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:19:44.730351 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/4d703673-6fad-4e54-82fd-c935ee6fed42-sys-fs\") pod \"aws-ebs-csi-driver-node-77v6s\" (UID: \"4d703673-6fad-4e54-82fd-c935ee6fed42\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-77v6s" Sep 17 07:19:44.730465 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:19:44.730376 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/4d703673-6fad-4e54-82fd-c935ee6fed42-device-dir\") pod \"aws-ebs-csi-driver-node-77v6s\" (UID: \"4d703673-6fad-4e54-82fd-c935ee6fed42\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-77v6s" Sep 17 07:19:44.730465 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:19:44.730393 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/dfe039e6-328a-476c-805f-7b90b0401bc0-host-run-netns\") pod \"multus-pj8tk\" (UID: \"dfe039e6-328a-476c-805f-7b90b0401bc0\") " pod="openshift-multus/multus-pj8tk" Sep 17 07:19:44.730465 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:19:44.730408 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/0b5240b1-13ea-4cee-b7f1-aa241ca58aa4-ovnkube-config\") pod \"ovnkube-node-2frz9\" (UID: \"0b5240b1-13ea-4cee-b7f1-aa241ca58aa4\") " pod="openshift-ovn-kubernetes/ovnkube-node-2frz9" Sep 17 07:19:44.730465 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:19:44.730409 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/4d703673-6fad-4e54-82fd-c935ee6fed42-sys-fs\") pod \"aws-ebs-csi-driver-node-77v6s\" (UID: \"4d703673-6fad-4e54-82fd-c935ee6fed42\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-77v6s" Sep 17 07:19:44.730465 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:19:44.730423 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/e154eb37-bb6a-4aca-b364-ab985fa57261-hosts-file\") pod \"node-resolver-8qgg7\" (UID: \"e154eb37-bb6a-4aca-b364-ab985fa57261\") " pod="openshift-dns/node-resolver-8qgg7" Sep 17 07:19:44.731116 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:19:44.730399 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/dd6eae9b-928b-4509-b4cb-035eb209c15d-run\") pod \"tuned-885ch\" (UID: \"dd6eae9b-928b-4509-b4cb-035eb209c15d\") " pod="openshift-cluster-node-tuning-operator/tuned-885ch" Sep 17 07:19:44.731116 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:19:44.730453 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/a4c6eeea-2ae6-4bb2-93ee-1b46b62da363-host\") pod \"node-ca-pwnj9\" (UID: \"a4c6eeea-2ae6-4bb2-93ee-1b46b62da363\") " pod="openshift-image-registry/node-ca-pwnj9" Sep 17 07:19:44.731116 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:19:44.730485 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/dfe039e6-328a-476c-805f-7b90b0401bc0-host-run-netns\") pod \"multus-pj8tk\" (UID: \"dfe039e6-328a-476c-805f-7b90b0401bc0\") " pod="openshift-multus/multus-pj8tk" Sep 17 07:19:44.731116 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:19:44.730501 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/dfe039e6-328a-476c-805f-7b90b0401bc0-host-run-multus-certs\") pod \"multus-pj8tk\" (UID: \"dfe039e6-328a-476c-805f-7b90b0401bc0\") " pod="openshift-multus/multus-pj8tk" Sep 17 07:19:44.731116 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:19:44.730549 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/a4c6eeea-2ae6-4bb2-93ee-1b46b62da363-host\") pod \"node-ca-pwnj9\" (UID: \"a4c6eeea-2ae6-4bb2-93ee-1b46b62da363\") " pod="openshift-image-registry/node-ca-pwnj9" Sep 17 07:19:44.731116 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:19:44.730558 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/dd6eae9b-928b-4509-b4cb-035eb209c15d-etc-sysctl-conf\") pod \"tuned-885ch\" (UID: \"dd6eae9b-928b-4509-b4cb-035eb209c15d\") " pod="openshift-cluster-node-tuning-operator/tuned-885ch" Sep 17 07:19:44.731116 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:19:44.730581 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/e154eb37-bb6a-4aca-b364-ab985fa57261-hosts-file\") pod \"node-resolver-8qgg7\" (UID: \"e154eb37-bb6a-4aca-b364-ab985fa57261\") " pod="openshift-dns/node-resolver-8qgg7" Sep 17 07:19:44.731116 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:19:44.730622 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/dd6eae9b-928b-4509-b4cb-035eb209c15d-lib-modules\") pod \"tuned-885ch\" (UID: \"dd6eae9b-928b-4509-b4cb-035eb209c15d\") " pod="openshift-cluster-node-tuning-operator/tuned-885ch" Sep 17 07:19:44.731116 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:19:44.730576 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/4d703673-6fad-4e54-82fd-c935ee6fed42-device-dir\") pod \"aws-ebs-csi-driver-node-77v6s\" (UID: \"4d703673-6fad-4e54-82fd-c935ee6fed42\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-77v6s" Sep 17 07:19:44.731116 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:19:44.730653 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/dfe039e6-328a-476c-805f-7b90b0401bc0-host-run-multus-certs\") pod \"multus-pj8tk\" (UID: \"dfe039e6-328a-476c-805f-7b90b0401bc0\") " pod="openshift-multus/multus-pj8tk" Sep 17 07:19:44.731116 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:19:44.730670 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/dd6eae9b-928b-4509-b4cb-035eb209c15d-etc-sysctl-conf\") pod \"tuned-885ch\" (UID: \"dd6eae9b-928b-4509-b4cb-035eb209c15d\") " pod="openshift-cluster-node-tuning-operator/tuned-885ch" Sep 17 07:19:44.731116 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:19:44.730687 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/d0ad9040-c0ce-453f-813c-809ea9f53c56-iptables-alerter-script\") pod \"iptables-alerter-dp2bc\" (UID: \"d0ad9040-c0ce-453f-813c-809ea9f53c56\") " pod="openshift-network-operator/iptables-alerter-dp2bc" Sep 17 07:19:44.731116 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:19:44.730708 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-klxf5\" (UniqueName: \"kubernetes.io/projected/d0ad9040-c0ce-453f-813c-809ea9f53c56-kube-api-access-klxf5\") pod \"iptables-alerter-dp2bc\" (UID: \"d0ad9040-c0ce-453f-813c-809ea9f53c56\") " pod="openshift-network-operator/iptables-alerter-dp2bc" Sep 17 07:19:44.731116 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:19:44.730738 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/f387de20-2724-46ab-9bca-b4b4a23711cf-dbus\") pod \"global-pull-secret-syncer-rs4vc\" (UID: \"f387de20-2724-46ab-9bca-b4b4a23711cf\") " pod="kube-system/global-pull-secret-syncer-rs4vc" Sep 17 07:19:44.731116 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:19:44.730757 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/96c5b8e5-2fc0-489b-8889-52bf66184838-konnectivity-ca\") pod \"konnectivity-agent-9skpb\" (UID: \"96c5b8e5-2fc0-489b-8889-52bf66184838\") " pod="kube-system/konnectivity-agent-9skpb" Sep 17 07:19:44.731116 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:19:44.730788 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/4d703673-6fad-4e54-82fd-c935ee6fed42-socket-dir\") pod \"aws-ebs-csi-driver-node-77v6s\" (UID: \"4d703673-6fad-4e54-82fd-c935ee6fed42\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-77v6s" Sep 17 07:19:44.731116 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:19:44.730821 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/dd6eae9b-928b-4509-b4cb-035eb209c15d-lib-modules\") pod \"tuned-885ch\" (UID: \"dd6eae9b-928b-4509-b4cb-035eb209c15d\") " pod="openshift-cluster-node-tuning-operator/tuned-885ch" Sep 17 07:19:44.731116 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:19:44.730830 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/dfe039e6-328a-476c-805f-7b90b0401bc0-host-run-k8s-cni-cncf-io\") pod \"multus-pj8tk\" (UID: \"dfe039e6-328a-476c-805f-7b90b0401bc0\") " pod="openshift-multus/multus-pj8tk" Sep 17 07:19:44.731906 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:19:44.730856 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/0b5240b1-13ea-4cee-b7f1-aa241ca58aa4-host-run-netns\") pod \"ovnkube-node-2frz9\" (UID: \"0b5240b1-13ea-4cee-b7f1-aa241ca58aa4\") " pod="openshift-ovn-kubernetes/ovnkube-node-2frz9" Sep 17 07:19:44.731906 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:19:44.730975 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/4d703673-6fad-4e54-82fd-c935ee6fed42-socket-dir\") pod \"aws-ebs-csi-driver-node-77v6s\" (UID: \"4d703673-6fad-4e54-82fd-c935ee6fed42\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-77v6s" Sep 17 07:19:44.731906 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:19:44.731018 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/dfe039e6-328a-476c-805f-7b90b0401bc0-host-run-k8s-cni-cncf-io\") pod \"multus-pj8tk\" (UID: \"dfe039e6-328a-476c-805f-7b90b0401bc0\") " pod="openshift-multus/multus-pj8tk" Sep 17 07:19:44.731906 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:19:44.730904 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/0b5240b1-13ea-4cee-b7f1-aa241ca58aa4-run-ovn\") pod \"ovnkube-node-2frz9\" (UID: \"0b5240b1-13ea-4cee-b7f1-aa241ca58aa4\") " pod="openshift-ovn-kubernetes/ovnkube-node-2frz9" Sep 17 07:19:44.731906 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:19:44.731051 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/0b5240b1-13ea-4cee-b7f1-aa241ca58aa4-host-cni-netd\") pod \"ovnkube-node-2frz9\" (UID: \"0b5240b1-13ea-4cee-b7f1-aa241ca58aa4\") " pod="openshift-ovn-kubernetes/ovnkube-node-2frz9" Sep 17 07:19:44.731906 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:19:44.731081 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tk9mc\" (UniqueName: \"kubernetes.io/projected/0b5240b1-13ea-4cee-b7f1-aa241ca58aa4-kube-api-access-tk9mc\") pod \"ovnkube-node-2frz9\" (UID: \"0b5240b1-13ea-4cee-b7f1-aa241ca58aa4\") " pod="openshift-ovn-kubernetes/ovnkube-node-2frz9" Sep 17 07:19:44.731906 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:19:44.731111 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e154eb37-bb6a-4aca-b364-ab985fa57261-tmp-dir\") pod \"node-resolver-8qgg7\" (UID: \"e154eb37-bb6a-4aca-b364-ab985fa57261\") " pod="openshift-dns/node-resolver-8qgg7" Sep 17 07:19:44.731906 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:19:44.731137 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/dd6eae9b-928b-4509-b4cb-035eb209c15d-host\") pod \"tuned-885ch\" (UID: \"dd6eae9b-928b-4509-b4cb-035eb209c15d\") " pod="openshift-cluster-node-tuning-operator/tuned-885ch" Sep 17 07:19:44.731906 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:19:44.731163 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/dd6eae9b-928b-4509-b4cb-035eb209c15d-etc-tuned\") pod \"tuned-885ch\" (UID: \"dd6eae9b-928b-4509-b4cb-035eb209c15d\") " pod="openshift-cluster-node-tuning-operator/tuned-885ch" Sep 17 07:19:44.731906 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:19:44.731186 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/0b5240b1-13ea-4cee-b7f1-aa241ca58aa4-host-slash\") pod \"ovnkube-node-2frz9\" (UID: \"0b5240b1-13ea-4cee-b7f1-aa241ca58aa4\") " pod="openshift-ovn-kubernetes/ovnkube-node-2frz9" Sep 17 07:19:44.731906 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:19:44.731213 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/dc177633-60cf-4933-90f5-26d2619f7c82-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-4hbmd\" (UID: \"dc177633-60cf-4933-90f5-26d2619f7c82\") " pod="openshift-multus/multus-additional-cni-plugins-4hbmd" Sep 17 07:19:44.731906 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:19:44.731252 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/a4c6eeea-2ae6-4bb2-93ee-1b46b62da363-serviceca\") pod \"node-ca-pwnj9\" (UID: \"a4c6eeea-2ae6-4bb2-93ee-1b46b62da363\") " pod="openshift-image-registry/node-ca-pwnj9" Sep 17 07:19:44.731906 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:19:44.731274 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/dfe039e6-328a-476c-805f-7b90b0401bc0-hostroot\") pod \"multus-pj8tk\" (UID: \"dfe039e6-328a-476c-805f-7b90b0401bc0\") " pod="openshift-multus/multus-pj8tk" Sep 17 07:19:44.731906 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:19:44.731329 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/d0ad9040-c0ce-453f-813c-809ea9f53c56-host-slash\") pod \"iptables-alerter-dp2bc\" (UID: \"d0ad9040-c0ce-453f-813c-809ea9f53c56\") " pod="openshift-network-operator/iptables-alerter-dp2bc" Sep 17 07:19:44.731906 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:19:44.731350 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t7lqp\" (UniqueName: \"kubernetes.io/projected/e154eb37-bb6a-4aca-b364-ab985fa57261-kube-api-access-t7lqp\") pod \"node-resolver-8qgg7\" (UID: \"e154eb37-bb6a-4aca-b364-ab985fa57261\") " pod="openshift-dns/node-resolver-8qgg7" Sep 17 07:19:44.731906 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:19:44.731370 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/dfe039e6-328a-476c-805f-7b90b0401bc0-system-cni-dir\") pod \"multus-pj8tk\" (UID: \"dfe039e6-328a-476c-805f-7b90b0401bc0\") " pod="openshift-multus/multus-pj8tk" Sep 17 07:19:44.731906 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:19:44.731391 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/dfe039e6-328a-476c-805f-7b90b0401bc0-cnibin\") pod \"multus-pj8tk\" (UID: \"dfe039e6-328a-476c-805f-7b90b0401bc0\") " pod="openshift-multus/multus-pj8tk" Sep 17 07:19:44.732352 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:19:44.731444 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e154eb37-bb6a-4aca-b364-ab985fa57261-tmp-dir\") pod \"node-resolver-8qgg7\" (UID: \"e154eb37-bb6a-4aca-b364-ab985fa57261\") " pod="openshift-dns/node-resolver-8qgg7" Sep 17 07:19:44.732352 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:19:44.731857 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/dd6eae9b-928b-4509-b4cb-035eb209c15d-etc-systemd\") pod \"tuned-885ch\" (UID: \"dd6eae9b-928b-4509-b4cb-035eb209c15d\") " pod="openshift-cluster-node-tuning-operator/tuned-885ch" Sep 17 07:19:44.732352 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:19:44.731803 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/96c5b8e5-2fc0-489b-8889-52bf66184838-konnectivity-ca\") pod \"konnectivity-agent-9skpb\" (UID: \"96c5b8e5-2fc0-489b-8889-52bf66184838\") " pod="kube-system/konnectivity-agent-9skpb" Sep 17 07:19:44.732352 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:19:44.731918 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f387de20-2724-46ab-9bca-b4b4a23711cf-original-pull-secret\") pod \"global-pull-secret-syncer-rs4vc\" (UID: \"f387de20-2724-46ab-9bca-b4b4a23711cf\") " pod="kube-system/global-pull-secret-syncer-rs4vc" Sep 17 07:19:44.732352 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:19:44.731701 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/dfe039e6-328a-476c-805f-7b90b0401bc0-cnibin\") pod \"multus-pj8tk\" (UID: \"dfe039e6-328a-476c-805f-7b90b0401bc0\") " pod="openshift-multus/multus-pj8tk" Sep 17 07:19:44.732352 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:19:44.731810 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/d0ad9040-c0ce-453f-813c-809ea9f53c56-iptables-alerter-script\") pod \"iptables-alerter-dp2bc\" (UID: \"d0ad9040-c0ce-453f-813c-809ea9f53c56\") " pod="openshift-network-operator/iptables-alerter-dp2bc" Sep 17 07:19:44.732352 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:19:44.732139 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/dfe039e6-328a-476c-805f-7b90b0401bc0-hostroot\") pod \"multus-pj8tk\" (UID: \"dfe039e6-328a-476c-805f-7b90b0401bc0\") " pod="openshift-multus/multus-pj8tk" Sep 17 07:19:44.732535 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:19:44.732446 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/a4c6eeea-2ae6-4bb2-93ee-1b46b62da363-serviceca\") pod \"node-ca-pwnj9\" (UID: \"a4c6eeea-2ae6-4bb2-93ee-1b46b62da363\") " pod="openshift-image-registry/node-ca-pwnj9" Sep 17 07:19:44.732564 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:19:44.732535 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/dd6eae9b-928b-4509-b4cb-035eb209c15d-etc-systemd\") pod \"tuned-885ch\" (UID: \"dd6eae9b-928b-4509-b4cb-035eb209c15d\") " pod="openshift-cluster-node-tuning-operator/tuned-885ch" Sep 17 07:19:44.732960 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:19:44.732917 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/dd6eae9b-928b-4509-b4cb-035eb209c15d-host\") pod \"tuned-885ch\" (UID: \"dd6eae9b-928b-4509-b4cb-035eb209c15d\") " pod="openshift-cluster-node-tuning-operator/tuned-885ch" Sep 17 07:19:44.733054 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:19:44.733002 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/d0ad9040-c0ce-453f-813c-809ea9f53c56-host-slash\") pod \"iptables-alerter-dp2bc\" (UID: \"d0ad9040-c0ce-453f-813c-809ea9f53c56\") " pod="openshift-network-operator/iptables-alerter-dp2bc" Sep 17 07:19:44.733054 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:19:44.732016 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/0b5240b1-13ea-4cee-b7f1-aa241ca58aa4-host-cni-bin\") pod \"ovnkube-node-2frz9\" (UID: \"0b5240b1-13ea-4cee-b7f1-aa241ca58aa4\") " pod="openshift-ovn-kubernetes/ovnkube-node-2frz9" Sep 17 07:19:44.733166 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:19:44.733091 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/dc177633-60cf-4933-90f5-26d2619f7c82-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-4hbmd\" (UID: \"dc177633-60cf-4933-90f5-26d2619f7c82\") " pod="openshift-multus/multus-additional-cni-plugins-4hbmd" Sep 17 07:19:44.733209 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:19:44.733135 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/dc177633-60cf-4933-90f5-26d2619f7c82-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-4hbmd\" (UID: \"dc177633-60cf-4933-90f5-26d2619f7c82\") " pod="openshift-multus/multus-additional-cni-plugins-4hbmd" Sep 17 07:19:44.733209 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:19:44.733198 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rhgsz\" (UniqueName: \"kubernetes.io/projected/dc177633-60cf-4933-90f5-26d2619f7c82-kube-api-access-rhgsz\") pod \"multus-additional-cni-plugins-4hbmd\" (UID: \"dc177633-60cf-4933-90f5-26d2619f7c82\") " pod="openshift-multus/multus-additional-cni-plugins-4hbmd" Sep 17 07:19:44.733294 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:19:44.733242 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/dfe039e6-328a-476c-805f-7b90b0401bc0-host-var-lib-cni-multus\") pod \"multus-pj8tk\" (UID: \"dfe039e6-328a-476c-805f-7b90b0401bc0\") " pod="openshift-multus/multus-pj8tk" Sep 17 07:19:44.733339 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:19:44.732826 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/dfe039e6-328a-476c-805f-7b90b0401bc0-system-cni-dir\") pod \"multus-pj8tk\" (UID: \"dfe039e6-328a-476c-805f-7b90b0401bc0\") " pod="openshift-multus/multus-pj8tk" Sep 17 07:19:44.733385 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:19:44.733356 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/0b5240b1-13ea-4cee-b7f1-aa241ca58aa4-systemd-units\") pod \"ovnkube-node-2frz9\" (UID: \"0b5240b1-13ea-4cee-b7f1-aa241ca58aa4\") " pod="openshift-ovn-kubernetes/ovnkube-node-2frz9" Sep 17 07:19:44.733433 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:19:44.733382 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/dfe039e6-328a-476c-805f-7b90b0401bc0-host-var-lib-cni-multus\") pod \"multus-pj8tk\" (UID: \"dfe039e6-328a-476c-805f-7b90b0401bc0\") " pod="openshift-multus/multus-pj8tk" Sep 17 07:19:44.733433 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:19:44.733388 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/0b5240b1-13ea-4cee-b7f1-aa241ca58aa4-etc-openvswitch\") pod \"ovnkube-node-2frz9\" (UID: \"0b5240b1-13ea-4cee-b7f1-aa241ca58aa4\") " pod="openshift-ovn-kubernetes/ovnkube-node-2frz9" Sep 17 07:19:44.733433 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:19:44.733370 2561 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Sep 17 07:19:44.733665 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:19:44.733645 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/dc177633-60cf-4933-90f5-26d2619f7c82-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-4hbmd\" (UID: \"dc177633-60cf-4933-90f5-26d2619f7c82\") " pod="openshift-multus/multus-additional-cni-plugins-4hbmd" Sep 17 07:19:44.733712 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:19:44.733648 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/4d703673-6fad-4e54-82fd-c935ee6fed42-registration-dir\") pod \"aws-ebs-csi-driver-node-77v6s\" (UID: \"4d703673-6fad-4e54-82fd-c935ee6fed42\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-77v6s" Sep 17 07:19:44.733757 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:19:44.733717 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/dc177633-60cf-4933-90f5-26d2619f7c82-system-cni-dir\") pod \"multus-additional-cni-plugins-4hbmd\" (UID: \"dc177633-60cf-4933-90f5-26d2619f7c82\") " pod="openshift-multus/multus-additional-cni-plugins-4hbmd" Sep 17 07:19:44.733757 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:19:44.733749 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6zc8b\" (UniqueName: \"kubernetes.io/projected/dfe039e6-328a-476c-805f-7b90b0401bc0-kube-api-access-6zc8b\") pod \"multus-pj8tk\" (UID: \"dfe039e6-328a-476c-805f-7b90b0401bc0\") " pod="openshift-multus/multus-pj8tk" Sep 17 07:19:44.733838 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:19:44.733816 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/dd6eae9b-928b-4509-b4cb-035eb209c15d-sys\") pod \"tuned-885ch\" (UID: \"dd6eae9b-928b-4509-b4cb-035eb209c15d\") " pod="openshift-cluster-node-tuning-operator/tuned-885ch" Sep 17 07:19:44.733889 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:19:44.733849 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/0b5240b1-13ea-4cee-b7f1-aa241ca58aa4-ovn-node-metrics-cert\") pod \"ovnkube-node-2frz9\" (UID: \"0b5240b1-13ea-4cee-b7f1-aa241ca58aa4\") " pod="openshift-ovn-kubernetes/ovnkube-node-2frz9" Sep 17 07:19:44.733889 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:19:44.733877 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/dd6eae9b-928b-4509-b4cb-035eb209c15d-etc-sysctl-d\") pod \"tuned-885ch\" (UID: \"dd6eae9b-928b-4509-b4cb-035eb209c15d\") " pod="openshift-cluster-node-tuning-operator/tuned-885ch" Sep 17 07:19:44.734000 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:19:44.733907 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/0b5240b1-13ea-4cee-b7f1-aa241ca58aa4-var-lib-openvswitch\") pod \"ovnkube-node-2frz9\" (UID: \"0b5240b1-13ea-4cee-b7f1-aa241ca58aa4\") " pod="openshift-ovn-kubernetes/ovnkube-node-2frz9" Sep 17 07:19:44.734000 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:19:44.733978 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zsbc8\" (UniqueName: \"kubernetes.io/projected/4d703673-6fad-4e54-82fd-c935ee6fed42-kube-api-access-zsbc8\") pod \"aws-ebs-csi-driver-node-77v6s\" (UID: \"4d703673-6fad-4e54-82fd-c935ee6fed42\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-77v6s" Sep 17 07:19:44.734094 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:19:44.734067 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/dc177633-60cf-4933-90f5-26d2619f7c82-cni-binary-copy\") pod \"multus-additional-cni-plugins-4hbmd\" (UID: \"dc177633-60cf-4933-90f5-26d2619f7c82\") " pod="openshift-multus/multus-additional-cni-plugins-4hbmd" Sep 17 07:19:44.734159 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:19:44.734134 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qvrgh\" (UniqueName: \"kubernetes.io/projected/a4c6eeea-2ae6-4bb2-93ee-1b46b62da363-kube-api-access-qvrgh\") pod \"node-ca-pwnj9\" (UID: \"a4c6eeea-2ae6-4bb2-93ee-1b46b62da363\") " pod="openshift-image-registry/node-ca-pwnj9" Sep 17 07:19:44.734203 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:19:44.734175 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/dfe039e6-328a-476c-805f-7b90b0401bc0-cni-binary-copy\") pod \"multus-pj8tk\" (UID: \"dfe039e6-328a-476c-805f-7b90b0401bc0\") " pod="openshift-multus/multus-pj8tk" Sep 17 07:19:44.734245 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:19:44.734201 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/dfe039e6-328a-476c-805f-7b90b0401bc0-multus-socket-dir-parent\") pod \"multus-pj8tk\" (UID: \"dfe039e6-328a-476c-805f-7b90b0401bc0\") " pod="openshift-multus/multus-pj8tk" Sep 17 07:19:44.734245 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:19:44.734221 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/dfe039e6-328a-476c-805f-7b90b0401bc0-multus-daemon-config\") pod \"multus-pj8tk\" (UID: \"dfe039e6-328a-476c-805f-7b90b0401bc0\") " pod="openshift-multus/multus-pj8tk" Sep 17 07:19:44.734329 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:19:44.734246 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/dd6eae9b-928b-4509-b4cb-035eb209c15d-var-lib-kubelet\") pod \"tuned-885ch\" (UID: \"dd6eae9b-928b-4509-b4cb-035eb209c15d\") " pod="openshift-cluster-node-tuning-operator/tuned-885ch" Sep 17 07:19:44.734329 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:19:44.734311 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/0b5240b1-13ea-4cee-b7f1-aa241ca58aa4-node-log\") pod \"ovnkube-node-2frz9\" (UID: \"0b5240b1-13ea-4cee-b7f1-aa241ca58aa4\") " pod="openshift-ovn-kubernetes/ovnkube-node-2frz9" Sep 17 07:19:44.734592 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:19:44.734566 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/96c5b8e5-2fc0-489b-8889-52bf66184838-agent-certs\") pod \"konnectivity-agent-9skpb\" (UID: \"96c5b8e5-2fc0-489b-8889-52bf66184838\") " pod="kube-system/konnectivity-agent-9skpb" Sep 17 07:19:44.734641 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:19:44.734623 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/dc177633-60cf-4933-90f5-26d2619f7c82-cnibin\") pod \"multus-additional-cni-plugins-4hbmd\" (UID: \"dc177633-60cf-4933-90f5-26d2619f7c82\") " pod="openshift-multus/multus-additional-cni-plugins-4hbmd" Sep 17 07:19:44.734692 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:19:44.734652 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/0b5240b1-13ea-4cee-b7f1-aa241ca58aa4-env-overrides\") pod \"ovnkube-node-2frz9\" (UID: \"0b5240b1-13ea-4cee-b7f1-aa241ca58aa4\") " pod="openshift-ovn-kubernetes/ovnkube-node-2frz9" Sep 17 07:19:44.734692 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:19:44.734680 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/dc177633-60cf-4933-90f5-26d2619f7c82-tuning-conf-dir\") pod \"multus-additional-cni-plugins-4hbmd\" (UID: \"dc177633-60cf-4933-90f5-26d2619f7c82\") " pod="openshift-multus/multus-additional-cni-plugins-4hbmd" Sep 17 07:19:44.734785 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:19:44.734705 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/dfe039e6-328a-476c-805f-7b90b0401bc0-multus-cni-dir\") pod \"multus-pj8tk\" (UID: \"dfe039e6-328a-476c-805f-7b90b0401bc0\") " pod="openshift-multus/multus-pj8tk" Sep 17 07:19:44.734785 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:19:44.734757 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/dd6eae9b-928b-4509-b4cb-035eb209c15d-etc-modprobe-d\") pod \"tuned-885ch\" (UID: \"dd6eae9b-928b-4509-b4cb-035eb209c15d\") " pod="openshift-cluster-node-tuning-operator/tuned-885ch" Sep 17 07:19:44.734873 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:19:44.734814 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/dd6eae9b-928b-4509-b4cb-035eb209c15d-etc-kubernetes\") pod \"tuned-885ch\" (UID: \"dd6eae9b-928b-4509-b4cb-035eb209c15d\") " pod="openshift-cluster-node-tuning-operator/tuned-885ch" Sep 17 07:19:44.734918 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:19:44.734873 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/dd6eae9b-928b-4509-b4cb-035eb209c15d-tmp\") pod \"tuned-885ch\" (UID: \"dd6eae9b-928b-4509-b4cb-035eb209c15d\") " pod="openshift-cluster-node-tuning-operator/tuned-885ch" Sep 17 07:19:44.734918 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:19:44.734902 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/dfe039e6-328a-476c-805f-7b90b0401bc0-host-var-lib-cni-bin\") pod \"multus-pj8tk\" (UID: \"dfe039e6-328a-476c-805f-7b90b0401bc0\") " pod="openshift-multus/multus-pj8tk" Sep 17 07:19:44.735030 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:19:44.734982 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jww4t\" (UniqueName: \"kubernetes.io/projected/ea653065-69b3-4da2-b8d0-9518964204d9-kube-api-access-jww4t\") pod \"network-check-target-qzfhn\" (UID: \"ea653065-69b3-4da2-b8d0-9518964204d9\") " pod="openshift-network-diagnostics/network-check-target-qzfhn" Sep 17 07:19:44.735030 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:19:44.735009 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/f387de20-2724-46ab-9bca-b4b4a23711cf-kubelet-config\") pod \"global-pull-secret-syncer-rs4vc\" (UID: \"f387de20-2724-46ab-9bca-b4b4a23711cf\") " pod="kube-system/global-pull-secret-syncer-rs4vc" Sep 17 07:19:44.735114 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:19:44.735063 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/0b5240b1-13ea-4cee-b7f1-aa241ca58aa4-run-systemd\") pod \"ovnkube-node-2frz9\" (UID: \"0b5240b1-13ea-4cee-b7f1-aa241ca58aa4\") " pod="openshift-ovn-kubernetes/ovnkube-node-2frz9" Sep 17 07:19:44.735240 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:19:44.735225 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/4d703673-6fad-4e54-82fd-c935ee6fed42-registration-dir\") pod \"aws-ebs-csi-driver-node-77v6s\" (UID: \"4d703673-6fad-4e54-82fd-c935ee6fed42\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-77v6s" Sep 17 07:19:44.735285 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:19:44.735262 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/dc177633-60cf-4933-90f5-26d2619f7c82-system-cni-dir\") pod \"multus-additional-cni-plugins-4hbmd\" (UID: \"dc177633-60cf-4933-90f5-26d2619f7c82\") " pod="openshift-multus/multus-additional-cni-plugins-4hbmd" Sep 17 07:19:44.735550 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:19:44.735534 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/dd6eae9b-928b-4509-b4cb-035eb209c15d-sys\") pod \"tuned-885ch\" (UID: \"dd6eae9b-928b-4509-b4cb-035eb209c15d\") " pod="openshift-cluster-node-tuning-operator/tuned-885ch" Sep 17 07:19:44.735642 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:19:44.735630 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/dd6eae9b-928b-4509-b4cb-035eb209c15d-etc-sysctl-d\") pod \"tuned-885ch\" (UID: \"dd6eae9b-928b-4509-b4cb-035eb209c15d\") " pod="openshift-cluster-node-tuning-operator/tuned-885ch" Sep 17 07:19:44.735755 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:19:44.735736 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/dfe039e6-328a-476c-805f-7b90b0401bc0-multus-socket-dir-parent\") pod \"multus-pj8tk\" (UID: \"dfe039e6-328a-476c-805f-7b90b0401bc0\") " pod="openshift-multus/multus-pj8tk" Sep 17 07:19:44.735813 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:19:44.735763 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/dd6eae9b-928b-4509-b4cb-035eb209c15d-var-lib-kubelet\") pod \"tuned-885ch\" (UID: \"dd6eae9b-928b-4509-b4cb-035eb209c15d\") " pod="openshift-cluster-node-tuning-operator/tuned-885ch" Sep 17 07:19:44.735813 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:19:44.735768 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/dfe039e6-328a-476c-805f-7b90b0401bc0-multus-cni-dir\") pod \"multus-pj8tk\" (UID: \"dfe039e6-328a-476c-805f-7b90b0401bc0\") " pod="openshift-multus/multus-pj8tk" Sep 17 07:19:44.735916 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:19:44.735826 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/dfe039e6-328a-476c-805f-7b90b0401bc0-host-var-lib-cni-bin\") pod \"multus-pj8tk\" (UID: \"dfe039e6-328a-476c-805f-7b90b0401bc0\") " pod="openshift-multus/multus-pj8tk" Sep 17 07:19:44.735916 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:19:44.735880 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/dc177633-60cf-4933-90f5-26d2619f7c82-tuning-conf-dir\") pod \"multus-additional-cni-plugins-4hbmd\" (UID: \"dc177633-60cf-4933-90f5-26d2619f7c82\") " pod="openshift-multus/multus-additional-cni-plugins-4hbmd" Sep 17 07:19:44.736048 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:19:44.736032 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/dd6eae9b-928b-4509-b4cb-035eb209c15d-etc-kubernetes\") pod \"tuned-885ch\" (UID: \"dd6eae9b-928b-4509-b4cb-035eb209c15d\") " pod="openshift-cluster-node-tuning-operator/tuned-885ch" Sep 17 07:19:44.736426 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:19:44.736313 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/dfe039e6-328a-476c-805f-7b90b0401bc0-cni-binary-copy\") pod \"multus-pj8tk\" (UID: \"dfe039e6-328a-476c-805f-7b90b0401bc0\") " pod="openshift-multus/multus-pj8tk" Sep 17 07:19:44.736426 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:19:44.736400 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/dc177633-60cf-4933-90f5-26d2619f7c82-cnibin\") pod \"multus-additional-cni-plugins-4hbmd\" (UID: \"dc177633-60cf-4933-90f5-26d2619f7c82\") " pod="openshift-multus/multus-additional-cni-plugins-4hbmd" Sep 17 07:19:44.736551 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:19:44.736517 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/dd6eae9b-928b-4509-b4cb-035eb209c15d-etc-modprobe-d\") pod \"tuned-885ch\" (UID: \"dd6eae9b-928b-4509-b4cb-035eb209c15d\") " pod="openshift-cluster-node-tuning-operator/tuned-885ch" Sep 17 07:19:44.736638 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:19:44.736622 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/dfe039e6-328a-476c-805f-7b90b0401bc0-multus-daemon-config\") pod \"multus-pj8tk\" (UID: \"dfe039e6-328a-476c-805f-7b90b0401bc0\") " pod="openshift-multus/multus-pj8tk" Sep 17 07:19:44.737098 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:19:44.737065 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/dc177633-60cf-4933-90f5-26d2619f7c82-cni-binary-copy\") pod \"multus-additional-cni-plugins-4hbmd\" (UID: \"dc177633-60cf-4933-90f5-26d2619f7c82\") " pod="openshift-multus/multus-additional-cni-plugins-4hbmd" Sep 17 07:19:44.738283 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:19:44.738112 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/dd6eae9b-928b-4509-b4cb-035eb209c15d-etc-tuned\") pod \"tuned-885ch\" (UID: \"dd6eae9b-928b-4509-b4cb-035eb209c15d\") " pod="openshift-cluster-node-tuning-operator/tuned-885ch" Sep 17 07:19:44.738283 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:19:44.738253 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/dd6eae9b-928b-4509-b4cb-035eb209c15d-tmp\") pod \"tuned-885ch\" (UID: \"dd6eae9b-928b-4509-b4cb-035eb209c15d\") " pod="openshift-cluster-node-tuning-operator/tuned-885ch" Sep 17 07:19:44.739316 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:19:44.739297 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/96c5b8e5-2fc0-489b-8889-52bf66184838-agent-certs\") pod \"konnectivity-agent-9skpb\" (UID: \"96c5b8e5-2fc0-489b-8889-52bf66184838\") " pod="kube-system/konnectivity-agent-9skpb" Sep 17 07:19:44.743428 ip-10-0-132-17 kubenswrapper[2561]: E0917 07:19:44.743409 2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 17 07:19:44.743528 ip-10-0-132-17 kubenswrapper[2561]: E0917 07:19:44.743433 2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 17 07:19:44.743528 ip-10-0-132-17 kubenswrapper[2561]: E0917 07:19:44.743446 2561 projected.go:196] Error preparing data for projected volume kube-api-access-jww4t for pod openshift-network-diagnostics/network-check-target-qzfhn: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 17 07:19:44.743528 ip-10-0-132-17 kubenswrapper[2561]: E0917 07:19:44.743499 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ea653065-69b3-4da2-b8d0-9518964204d9-kube-api-access-jww4t podName:ea653065-69b3-4da2-b8d0-9518964204d9 nodeName:}" failed. No retries permitted until 2026-09-17 07:19:45.243483003 +0000 UTC m=+3.049429275 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-jww4t" (UniqueName: "kubernetes.io/projected/ea653065-69b3-4da2-b8d0-9518964204d9-kube-api-access-jww4t") pod "network-check-target-qzfhn" (UID: "ea653065-69b3-4da2-b8d0-9518964204d9") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 17 07:19:44.747118 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:19:44.747052 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zsbc8\" (UniqueName: \"kubernetes.io/projected/4d703673-6fad-4e54-82fd-c935ee6fed42-kube-api-access-zsbc8\") pod \"aws-ebs-csi-driver-node-77v6s\" (UID: \"4d703673-6fad-4e54-82fd-c935ee6fed42\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-77v6s" Sep 17 07:19:44.747118 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:19:44.747050 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-24ww4\" (UniqueName: \"kubernetes.io/projected/dd6eae9b-928b-4509-b4cb-035eb209c15d-kube-api-access-24ww4\") pod \"tuned-885ch\" (UID: \"dd6eae9b-928b-4509-b4cb-035eb209c15d\") " pod="openshift-cluster-node-tuning-operator/tuned-885ch" Sep 17 07:19:44.747392 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:19:44.747363 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rhgsz\" (UniqueName: \"kubernetes.io/projected/dc177633-60cf-4933-90f5-26d2619f7c82-kube-api-access-rhgsz\") pod \"multus-additional-cni-plugins-4hbmd\" (UID: \"dc177633-60cf-4933-90f5-26d2619f7c82\") " pod="openshift-multus/multus-additional-cni-plugins-4hbmd" Sep 17 07:19:44.750173 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:19:44.750150 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qvrgh\" (UniqueName: \"kubernetes.io/projected/a4c6eeea-2ae6-4bb2-93ee-1b46b62da363-kube-api-access-qvrgh\") pod \"node-ca-pwnj9\" (UID: \"a4c6eeea-2ae6-4bb2-93ee-1b46b62da363\") " pod="openshift-image-registry/node-ca-pwnj9" Sep 17 07:19:44.751576 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:19:44.751443 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-klxf5\" (UniqueName: \"kubernetes.io/projected/d0ad9040-c0ce-453f-813c-809ea9f53c56-kube-api-access-klxf5\") pod \"iptables-alerter-dp2bc\" (UID: \"d0ad9040-c0ce-453f-813c-809ea9f53c56\") " pod="openshift-network-operator/iptables-alerter-dp2bc" Sep 17 07:19:44.751576 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:19:44.751529 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-n8fzj\" (UniqueName: \"kubernetes.io/projected/e6c12e07-53e7-4f30-a8bf-c5d1a727d2fb-kube-api-access-n8fzj\") pod \"network-metrics-daemon-mcwtb\" (UID: \"e6c12e07-53e7-4f30-a8bf-c5d1a727d2fb\") " pod="openshift-multus/network-metrics-daemon-mcwtb" Sep 17 07:19:44.751955 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:19:44.751915 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-t7lqp\" (UniqueName: \"kubernetes.io/projected/e154eb37-bb6a-4aca-b364-ab985fa57261-kube-api-access-t7lqp\") pod \"node-resolver-8qgg7\" (UID: \"e154eb37-bb6a-4aca-b364-ab985fa57261\") " pod="openshift-dns/node-resolver-8qgg7" Sep 17 07:19:44.753828 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:19:44.753806 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6zc8b\" (UniqueName: \"kubernetes.io/projected/dfe039e6-328a-476c-805f-7b90b0401bc0-kube-api-access-6zc8b\") pod \"multus-pj8tk\" (UID: \"dfe039e6-328a-476c-805f-7b90b0401bc0\") " pod="openshift-multus/multus-pj8tk" Sep 17 07:19:44.835945 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:19:44.835902 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/0b5240b1-13ea-4cee-b7f1-aa241ca58aa4-host-slash\") pod \"ovnkube-node-2frz9\" (UID: \"0b5240b1-13ea-4cee-b7f1-aa241ca58aa4\") " pod="openshift-ovn-kubernetes/ovnkube-node-2frz9" Sep 17 07:19:44.835945 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:19:44.835951 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f387de20-2724-46ab-9bca-b4b4a23711cf-original-pull-secret\") pod \"global-pull-secret-syncer-rs4vc\" (UID: \"f387de20-2724-46ab-9bca-b4b4a23711cf\") " pod="kube-system/global-pull-secret-syncer-rs4vc" Sep 17 07:19:44.836128 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:19:44.836015 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/0b5240b1-13ea-4cee-b7f1-aa241ca58aa4-host-slash\") pod \"ovnkube-node-2frz9\" (UID: \"0b5240b1-13ea-4cee-b7f1-aa241ca58aa4\") " pod="openshift-ovn-kubernetes/ovnkube-node-2frz9" Sep 17 07:19:44.836128 ip-10-0-132-17 kubenswrapper[2561]: E0917 07:19:44.836056 2561 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 17 07:19:44.836128 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:19:44.836060 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/0b5240b1-13ea-4cee-b7f1-aa241ca58aa4-host-cni-bin\") pod \"ovnkube-node-2frz9\" (UID: \"0b5240b1-13ea-4cee-b7f1-aa241ca58aa4\") " pod="openshift-ovn-kubernetes/ovnkube-node-2frz9" Sep 17 07:19:44.836128 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:19:44.836090 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/0b5240b1-13ea-4cee-b7f1-aa241ca58aa4-systemd-units\") pod \"ovnkube-node-2frz9\" (UID: \"0b5240b1-13ea-4cee-b7f1-aa241ca58aa4\") " pod="openshift-ovn-kubernetes/ovnkube-node-2frz9" Sep 17 07:19:44.836128 ip-10-0-132-17 kubenswrapper[2561]: E0917 07:19:44.836112 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f387de20-2724-46ab-9bca-b4b4a23711cf-original-pull-secret podName:f387de20-2724-46ab-9bca-b4b4a23711cf nodeName:}" failed. No retries permitted until 2026-09-17 07:19:45.336093178 +0000 UTC m=+3.142039432 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/f387de20-2724-46ab-9bca-b4b4a23711cf-original-pull-secret") pod "global-pull-secret-syncer-rs4vc" (UID: "f387de20-2724-46ab-9bca-b4b4a23711cf") : object "kube-system"/"original-pull-secret" not registered Sep 17 07:19:44.836128 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:19:44.836127 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/0b5240b1-13ea-4cee-b7f1-aa241ca58aa4-systemd-units\") pod \"ovnkube-node-2frz9\" (UID: \"0b5240b1-13ea-4cee-b7f1-aa241ca58aa4\") " pod="openshift-ovn-kubernetes/ovnkube-node-2frz9" Sep 17 07:19:44.836411 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:19:44.836136 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/0b5240b1-13ea-4cee-b7f1-aa241ca58aa4-etc-openvswitch\") pod \"ovnkube-node-2frz9\" (UID: \"0b5240b1-13ea-4cee-b7f1-aa241ca58aa4\") " pod="openshift-ovn-kubernetes/ovnkube-node-2frz9" Sep 17 07:19:44.836411 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:19:44.836142 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/0b5240b1-13ea-4cee-b7f1-aa241ca58aa4-host-cni-bin\") pod \"ovnkube-node-2frz9\" (UID: \"0b5240b1-13ea-4cee-b7f1-aa241ca58aa4\") " pod="openshift-ovn-kubernetes/ovnkube-node-2frz9" Sep 17 07:19:44.836411 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:19:44.836165 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/0b5240b1-13ea-4cee-b7f1-aa241ca58aa4-ovn-node-metrics-cert\") pod \"ovnkube-node-2frz9\" (UID: \"0b5240b1-13ea-4cee-b7f1-aa241ca58aa4\") " pod="openshift-ovn-kubernetes/ovnkube-node-2frz9" Sep 17 07:19:44.836411 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:19:44.836191 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/0b5240b1-13ea-4cee-b7f1-aa241ca58aa4-var-lib-openvswitch\") pod \"ovnkube-node-2frz9\" (UID: \"0b5240b1-13ea-4cee-b7f1-aa241ca58aa4\") " pod="openshift-ovn-kubernetes/ovnkube-node-2frz9" Sep 17 07:19:44.836411 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:19:44.836217 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/0b5240b1-13ea-4cee-b7f1-aa241ca58aa4-node-log\") pod \"ovnkube-node-2frz9\" (UID: \"0b5240b1-13ea-4cee-b7f1-aa241ca58aa4\") " pod="openshift-ovn-kubernetes/ovnkube-node-2frz9" Sep 17 07:19:44.836411 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:19:44.836252 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/0b5240b1-13ea-4cee-b7f1-aa241ca58aa4-env-overrides\") pod \"ovnkube-node-2frz9\" (UID: \"0b5240b1-13ea-4cee-b7f1-aa241ca58aa4\") " pod="openshift-ovn-kubernetes/ovnkube-node-2frz9" Sep 17 07:19:44.836411 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:19:44.836289 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/f387de20-2724-46ab-9bca-b4b4a23711cf-kubelet-config\") pod \"global-pull-secret-syncer-rs4vc\" (UID: \"f387de20-2724-46ab-9bca-b4b4a23711cf\") " pod="kube-system/global-pull-secret-syncer-rs4vc" Sep 17 07:19:44.836411 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:19:44.836307 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/0b5240b1-13ea-4cee-b7f1-aa241ca58aa4-run-systemd\") pod \"ovnkube-node-2frz9\" (UID: \"0b5240b1-13ea-4cee-b7f1-aa241ca58aa4\") " pod="openshift-ovn-kubernetes/ovnkube-node-2frz9" Sep 17 07:19:44.836411 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:19:44.836343 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/0b5240b1-13ea-4cee-b7f1-aa241ca58aa4-host-kubelet\") pod \"ovnkube-node-2frz9\" (UID: \"0b5240b1-13ea-4cee-b7f1-aa241ca58aa4\") " pod="openshift-ovn-kubernetes/ovnkube-node-2frz9" Sep 17 07:19:44.836411 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:19:44.836350 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/0b5240b1-13ea-4cee-b7f1-aa241ca58aa4-node-log\") pod \"ovnkube-node-2frz9\" (UID: \"0b5240b1-13ea-4cee-b7f1-aa241ca58aa4\") " pod="openshift-ovn-kubernetes/ovnkube-node-2frz9" Sep 17 07:19:44.836411 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:19:44.836168 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/0b5240b1-13ea-4cee-b7f1-aa241ca58aa4-etc-openvswitch\") pod \"ovnkube-node-2frz9\" (UID: \"0b5240b1-13ea-4cee-b7f1-aa241ca58aa4\") " pod="openshift-ovn-kubernetes/ovnkube-node-2frz9" Sep 17 07:19:44.836411 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:19:44.836365 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/0b5240b1-13ea-4cee-b7f1-aa241ca58aa4-run-openvswitch\") pod \"ovnkube-node-2frz9\" (UID: \"0b5240b1-13ea-4cee-b7f1-aa241ca58aa4\") " pod="openshift-ovn-kubernetes/ovnkube-node-2frz9" Sep 17 07:19:44.836411 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:19:44.836396 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/0b5240b1-13ea-4cee-b7f1-aa241ca58aa4-run-openvswitch\") pod \"ovnkube-node-2frz9\" (UID: \"0b5240b1-13ea-4cee-b7f1-aa241ca58aa4\") " pod="openshift-ovn-kubernetes/ovnkube-node-2frz9" Sep 17 07:19:44.836411 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:19:44.836398 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/0b5240b1-13ea-4cee-b7f1-aa241ca58aa4-log-socket\") pod \"ovnkube-node-2frz9\" (UID: \"0b5240b1-13ea-4cee-b7f1-aa241ca58aa4\") " pod="openshift-ovn-kubernetes/ovnkube-node-2frz9" Sep 17 07:19:44.836983 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:19:44.836439 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0b5240b1-13ea-4cee-b7f1-aa241ca58aa4-host-run-ovn-kubernetes\") pod \"ovnkube-node-2frz9\" (UID: \"0b5240b1-13ea-4cee-b7f1-aa241ca58aa4\") " pod="openshift-ovn-kubernetes/ovnkube-node-2frz9" Sep 17 07:19:44.836983 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:19:44.836465 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0b5240b1-13ea-4cee-b7f1-aa241ca58aa4-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-2frz9\" (UID: \"0b5240b1-13ea-4cee-b7f1-aa241ca58aa4\") " pod="openshift-ovn-kubernetes/ovnkube-node-2frz9" Sep 17 07:19:44.836983 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:19:44.836489 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/0b5240b1-13ea-4cee-b7f1-aa241ca58aa4-ovnkube-script-lib\") pod \"ovnkube-node-2frz9\" (UID: \"0b5240b1-13ea-4cee-b7f1-aa241ca58aa4\") " pod="openshift-ovn-kubernetes/ovnkube-node-2frz9" Sep 17 07:19:44.836983 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:19:44.836514 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/0b5240b1-13ea-4cee-b7f1-aa241ca58aa4-ovnkube-config\") pod \"ovnkube-node-2frz9\" (UID: \"0b5240b1-13ea-4cee-b7f1-aa241ca58aa4\") " pod="openshift-ovn-kubernetes/ovnkube-node-2frz9" Sep 17 07:19:44.836983 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:19:44.836513 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/0b5240b1-13ea-4cee-b7f1-aa241ca58aa4-var-lib-openvswitch\") pod \"ovnkube-node-2frz9\" (UID: \"0b5240b1-13ea-4cee-b7f1-aa241ca58aa4\") " pod="openshift-ovn-kubernetes/ovnkube-node-2frz9" Sep 17 07:19:44.836983 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:19:44.836543 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/f387de20-2724-46ab-9bca-b4b4a23711cf-dbus\") pod \"global-pull-secret-syncer-rs4vc\" (UID: \"f387de20-2724-46ab-9bca-b4b4a23711cf\") " pod="kube-system/global-pull-secret-syncer-rs4vc" Sep 17 07:19:44.836983 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:19:44.836564 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/0b5240b1-13ea-4cee-b7f1-aa241ca58aa4-log-socket\") pod \"ovnkube-node-2frz9\" (UID: \"0b5240b1-13ea-4cee-b7f1-aa241ca58aa4\") " pod="openshift-ovn-kubernetes/ovnkube-node-2frz9" Sep 17 07:19:44.836983 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:19:44.836568 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/0b5240b1-13ea-4cee-b7f1-aa241ca58aa4-host-run-netns\") pod \"ovnkube-node-2frz9\" (UID: \"0b5240b1-13ea-4cee-b7f1-aa241ca58aa4\") " pod="openshift-ovn-kubernetes/ovnkube-node-2frz9" Sep 17 07:19:44.836983 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:19:44.836606 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0b5240b1-13ea-4cee-b7f1-aa241ca58aa4-host-run-ovn-kubernetes\") pod \"ovnkube-node-2frz9\" (UID: \"0b5240b1-13ea-4cee-b7f1-aa241ca58aa4\") " pod="openshift-ovn-kubernetes/ovnkube-node-2frz9" Sep 17 07:19:44.836983 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:19:44.836614 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/0b5240b1-13ea-4cee-b7f1-aa241ca58aa4-run-ovn\") pod \"ovnkube-node-2frz9\" (UID: \"0b5240b1-13ea-4cee-b7f1-aa241ca58aa4\") " pod="openshift-ovn-kubernetes/ovnkube-node-2frz9" Sep 17 07:19:44.836983 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:19:44.836637 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/0b5240b1-13ea-4cee-b7f1-aa241ca58aa4-host-cni-netd\") pod \"ovnkube-node-2frz9\" (UID: \"0b5240b1-13ea-4cee-b7f1-aa241ca58aa4\") " pod="openshift-ovn-kubernetes/ovnkube-node-2frz9" Sep 17 07:19:44.836983 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:19:44.836641 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0b5240b1-13ea-4cee-b7f1-aa241ca58aa4-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-2frz9\" (UID: \"0b5240b1-13ea-4cee-b7f1-aa241ca58aa4\") " pod="openshift-ovn-kubernetes/ovnkube-node-2frz9" Sep 17 07:19:44.836983 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:19:44.836659 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tk9mc\" (UniqueName: \"kubernetes.io/projected/0b5240b1-13ea-4cee-b7f1-aa241ca58aa4-kube-api-access-tk9mc\") pod \"ovnkube-node-2frz9\" (UID: \"0b5240b1-13ea-4cee-b7f1-aa241ca58aa4\") " pod="openshift-ovn-kubernetes/ovnkube-node-2frz9" Sep 17 07:19:44.836983 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:19:44.836677 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/0b5240b1-13ea-4cee-b7f1-aa241ca58aa4-run-systemd\") pod \"ovnkube-node-2frz9\" (UID: \"0b5240b1-13ea-4cee-b7f1-aa241ca58aa4\") " pod="openshift-ovn-kubernetes/ovnkube-node-2frz9" Sep 17 07:19:44.836983 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:19:44.836722 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/f387de20-2724-46ab-9bca-b4b4a23711cf-kubelet-config\") pod \"global-pull-secret-syncer-rs4vc\" (UID: \"f387de20-2724-46ab-9bca-b4b4a23711cf\") " pod="kube-system/global-pull-secret-syncer-rs4vc" Sep 17 07:19:44.836983 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:19:44.836755 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/0b5240b1-13ea-4cee-b7f1-aa241ca58aa4-host-kubelet\") pod \"ovnkube-node-2frz9\" (UID: \"0b5240b1-13ea-4cee-b7f1-aa241ca58aa4\") " pod="openshift-ovn-kubernetes/ovnkube-node-2frz9" Sep 17 07:19:44.836983 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:19:44.836805 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/f387de20-2724-46ab-9bca-b4b4a23711cf-dbus\") pod \"global-pull-secret-syncer-rs4vc\" (UID: \"f387de20-2724-46ab-9bca-b4b4a23711cf\") " pod="kube-system/global-pull-secret-syncer-rs4vc" Sep 17 07:19:44.837712 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:19:44.836836 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/0b5240b1-13ea-4cee-b7f1-aa241ca58aa4-env-overrides\") pod \"ovnkube-node-2frz9\" (UID: \"0b5240b1-13ea-4cee-b7f1-aa241ca58aa4\") " pod="openshift-ovn-kubernetes/ovnkube-node-2frz9" Sep 17 07:19:44.837712 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:19:44.836956 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/0b5240b1-13ea-4cee-b7f1-aa241ca58aa4-host-run-netns\") pod \"ovnkube-node-2frz9\" (UID: \"0b5240b1-13ea-4cee-b7f1-aa241ca58aa4\") " pod="openshift-ovn-kubernetes/ovnkube-node-2frz9" Sep 17 07:19:44.837712 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:19:44.837002 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/0b5240b1-13ea-4cee-b7f1-aa241ca58aa4-run-ovn\") pod \"ovnkube-node-2frz9\" (UID: \"0b5240b1-13ea-4cee-b7f1-aa241ca58aa4\") " pod="openshift-ovn-kubernetes/ovnkube-node-2frz9" Sep 17 07:19:44.837712 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:19:44.837016 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/0b5240b1-13ea-4cee-b7f1-aa241ca58aa4-host-cni-netd\") pod \"ovnkube-node-2frz9\" (UID: \"0b5240b1-13ea-4cee-b7f1-aa241ca58aa4\") " pod="openshift-ovn-kubernetes/ovnkube-node-2frz9" Sep 17 07:19:44.837712 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:19:44.837337 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/0b5240b1-13ea-4cee-b7f1-aa241ca58aa4-ovnkube-script-lib\") pod \"ovnkube-node-2frz9\" (UID: \"0b5240b1-13ea-4cee-b7f1-aa241ca58aa4\") " pod="openshift-ovn-kubernetes/ovnkube-node-2frz9" Sep 17 07:19:44.837712 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:19:44.837455 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/0b5240b1-13ea-4cee-b7f1-aa241ca58aa4-ovnkube-config\") pod \"ovnkube-node-2frz9\" (UID: \"0b5240b1-13ea-4cee-b7f1-aa241ca58aa4\") " pod="openshift-ovn-kubernetes/ovnkube-node-2frz9" Sep 17 07:19:44.838808 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:19:44.838788 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/0b5240b1-13ea-4cee-b7f1-aa241ca58aa4-ovn-node-metrics-cert\") pod \"ovnkube-node-2frz9\" (UID: \"0b5240b1-13ea-4cee-b7f1-aa241ca58aa4\") " pod="openshift-ovn-kubernetes/ovnkube-node-2frz9" Sep 17 07:19:44.845047 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:19:44.844974 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tk9mc\" (UniqueName: \"kubernetes.io/projected/0b5240b1-13ea-4cee-b7f1-aa241ca58aa4-kube-api-access-tk9mc\") pod \"ovnkube-node-2frz9\" (UID: \"0b5240b1-13ea-4cee-b7f1-aa241ca58aa4\") " pod="openshift-ovn-kubernetes/ovnkube-node-2frz9" Sep 17 07:19:44.853460 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:19:44.853442 2561 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Sep 17 07:19:44.909032 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:19:44.909003 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-dp2bc" Sep 17 07:19:44.917758 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:19:44.917737 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-9skpb" Sep 17 07:19:44.918808 ip-10-0-132-17 kubenswrapper[2561]: W0917 07:19:44.918784 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd0ad9040_c0ce_453f_813c_809ea9f53c56.slice/crio-b9fb397d2467bd4623e58853d5f2eedf9db5eef93ffd1be6b0f44df869265b24 WatchSource:0}: Error finding container b9fb397d2467bd4623e58853d5f2eedf9db5eef93ffd1be6b0f44df869265b24: Status 404 returned error can't find the container with id b9fb397d2467bd4623e58853d5f2eedf9db5eef93ffd1be6b0f44df869265b24 Sep 17 07:19:44.927418 ip-10-0-132-17 kubenswrapper[2561]: W0917 07:19:44.927398 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod96c5b8e5_2fc0_489b_8889_52bf66184838.slice/crio-af064c21011f148c52acb28b165938bc329a45b25cdcafc293feeb1189271733 WatchSource:0}: Error finding container af064c21011f148c52acb28b165938bc329a45b25cdcafc293feeb1189271733: Status 404 returned error can't find the container with id af064c21011f148c52acb28b165938bc329a45b25cdcafc293feeb1189271733 Sep 17 07:19:44.928185 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:19:44.928166 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-4hbmd" Sep 17 07:19:44.934331 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:19:44.934311 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-pwnj9" Sep 17 07:19:44.937298 ip-10-0-132-17 kubenswrapper[2561]: W0917 07:19:44.937278 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddc177633_60cf_4933_90f5_26d2619f7c82.slice/crio-260a1b05bb391cb85df4b7462932cf6d67ffbbf26788ebfdfa149a81f3453877 WatchSource:0}: Error finding container 260a1b05bb391cb85df4b7462932cf6d67ffbbf26788ebfdfa149a81f3453877: Status 404 returned error can't find the container with id 260a1b05bb391cb85df4b7462932cf6d67ffbbf26788ebfdfa149a81f3453877 Sep 17 07:19:44.943084 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:19:44.943062 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-8qgg7" Sep 17 07:19:44.943985 ip-10-0-132-17 kubenswrapper[2561]: W0917 07:19:44.943948 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda4c6eeea_2ae6_4bb2_93ee_1b46b62da363.slice/crio-010bd6d8d6a5acb489fab88409cd17dece01dbe7a76d6c6426f4dce59ba86e23 WatchSource:0}: Error finding container 010bd6d8d6a5acb489fab88409cd17dece01dbe7a76d6c6426f4dce59ba86e23: Status 404 returned error can't find the container with id 010bd6d8d6a5acb489fab88409cd17dece01dbe7a76d6c6426f4dce59ba86e23 Sep 17 07:19:44.950263 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:19:44.950239 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-77v6s" Sep 17 07:19:44.954473 ip-10-0-132-17 kubenswrapper[2561]: W0917 07:19:44.954446 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode154eb37_bb6a_4aca_b364_ab985fa57261.slice/crio-ed0d296ea4dfbe4207e1e15356112f4be62b2f2ed931b9ff8d6d8ba324b4d357 WatchSource:0}: Error finding container ed0d296ea4dfbe4207e1e15356112f4be62b2f2ed931b9ff8d6d8ba324b4d357: Status 404 returned error can't find the container with id ed0d296ea4dfbe4207e1e15356112f4be62b2f2ed931b9ff8d6d8ba324b4d357 Sep 17 07:19:44.957875 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:19:44.957857 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-pj8tk" Sep 17 07:19:44.959819 ip-10-0-132-17 kubenswrapper[2561]: W0917 07:19:44.959799 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4d703673_6fad_4e54_82fd_c935ee6fed42.slice/crio-ae87b41cb3e429610c49d4aa49a618f1a37050ed51d6e43108f958ff581b1167 WatchSource:0}: Error finding container ae87b41cb3e429610c49d4aa49a618f1a37050ed51d6e43108f958ff581b1167: Status 404 returned error can't find the container with id ae87b41cb3e429610c49d4aa49a618f1a37050ed51d6e43108f958ff581b1167 Sep 17 07:19:44.965488 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:19:44.965470 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-885ch" Sep 17 07:19:44.967069 ip-10-0-132-17 kubenswrapper[2561]: W0917 07:19:44.967047 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddfe039e6_328a_476c_805f_7b90b0401bc0.slice/crio-2a27da4826f9c3056dd58339b604bfb10db57bc9bd1ec99942052029491ccde1 WatchSource:0}: Error finding container 2a27da4826f9c3056dd58339b604bfb10db57bc9bd1ec99942052029491ccde1: Status 404 returned error can't find the container with id 2a27da4826f9c3056dd58339b604bfb10db57bc9bd1ec99942052029491ccde1 Sep 17 07:19:44.974475 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:19:44.974456 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-2frz9" Sep 17 07:19:44.974779 ip-10-0-132-17 kubenswrapper[2561]: W0917 07:19:44.974758 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddd6eae9b_928b_4509_b4cb_035eb209c15d.slice/crio-2394c0b556e9c6967995294f7d44af4408c64de2af15df979ef8cdf4ea5a6ec9 WatchSource:0}: Error finding container 2394c0b556e9c6967995294f7d44af4408c64de2af15df979ef8cdf4ea5a6ec9: Status 404 returned error can't find the container with id 2394c0b556e9c6967995294f7d44af4408c64de2af15df979ef8cdf4ea5a6ec9 Sep 17 07:19:44.984536 ip-10-0-132-17 kubenswrapper[2561]: W0917 07:19:44.984496 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0b5240b1_13ea_4cee_b7f1_aa241ca58aa4.slice/crio-0ab5edeea6cecfebd40107431e168af9e0c2aef8d1884cbb147598abef46c880 WatchSource:0}: Error finding container 0ab5edeea6cecfebd40107431e168af9e0c2aef8d1884cbb147598abef46c880: Status 404 returned error can't find the container with id 0ab5edeea6cecfebd40107431e168af9e0c2aef8d1884cbb147598abef46c880 Sep 17 07:19:45.238619 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:19:45.238548 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e6c12e07-53e7-4f30-a8bf-c5d1a727d2fb-metrics-certs\") pod \"network-metrics-daemon-mcwtb\" (UID: \"e6c12e07-53e7-4f30-a8bf-c5d1a727d2fb\") " pod="openshift-multus/network-metrics-daemon-mcwtb" Sep 17 07:19:45.238769 ip-10-0-132-17 kubenswrapper[2561]: E0917 07:19:45.238705 2561 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 17 07:19:45.238825 ip-10-0-132-17 kubenswrapper[2561]: E0917 07:19:45.238773 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e6c12e07-53e7-4f30-a8bf-c5d1a727d2fb-metrics-certs podName:e6c12e07-53e7-4f30-a8bf-c5d1a727d2fb nodeName:}" failed. No retries permitted until 2026-09-17 07:19:46.238758497 +0000 UTC m=+4.044704750 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e6c12e07-53e7-4f30-a8bf-c5d1a727d2fb-metrics-certs") pod "network-metrics-daemon-mcwtb" (UID: "e6c12e07-53e7-4f30-a8bf-c5d1a727d2fb") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 17 07:19:45.339243 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:19:45.339202 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f387de20-2724-46ab-9bca-b4b4a23711cf-original-pull-secret\") pod \"global-pull-secret-syncer-rs4vc\" (UID: \"f387de20-2724-46ab-9bca-b4b4a23711cf\") " pod="kube-system/global-pull-secret-syncer-rs4vc" Sep 17 07:19:45.339391 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:19:45.339263 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jww4t\" (UniqueName: \"kubernetes.io/projected/ea653065-69b3-4da2-b8d0-9518964204d9-kube-api-access-jww4t\") pod \"network-check-target-qzfhn\" (UID: \"ea653065-69b3-4da2-b8d0-9518964204d9\") " pod="openshift-network-diagnostics/network-check-target-qzfhn" Sep 17 07:19:45.339436 ip-10-0-132-17 kubenswrapper[2561]: E0917 07:19:45.339428 2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 17 07:19:45.339475 ip-10-0-132-17 kubenswrapper[2561]: E0917 07:19:45.339451 2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 17 07:19:45.339475 ip-10-0-132-17 kubenswrapper[2561]: E0917 07:19:45.339471 2561 projected.go:196] Error preparing data for projected volume kube-api-access-jww4t for pod openshift-network-diagnostics/network-check-target-qzfhn: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 17 07:19:45.339533 ip-10-0-132-17 kubenswrapper[2561]: E0917 07:19:45.339519 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ea653065-69b3-4da2-b8d0-9518964204d9-kube-api-access-jww4t podName:ea653065-69b3-4da2-b8d0-9518964204d9 nodeName:}" failed. No retries permitted until 2026-09-17 07:19:46.339499739 +0000 UTC m=+4.145445992 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-jww4t" (UniqueName: "kubernetes.io/projected/ea653065-69b3-4da2-b8d0-9518964204d9-kube-api-access-jww4t") pod "network-check-target-qzfhn" (UID: "ea653065-69b3-4da2-b8d0-9518964204d9") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 17 07:19:45.339834 ip-10-0-132-17 kubenswrapper[2561]: E0917 07:19:45.339818 2561 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 17 07:19:45.339895 ip-10-0-132-17 kubenswrapper[2561]: E0917 07:19:45.339859 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f387de20-2724-46ab-9bca-b4b4a23711cf-original-pull-secret podName:f387de20-2724-46ab-9bca-b4b4a23711cf nodeName:}" failed. No retries permitted until 2026-09-17 07:19:46.339849677 +0000 UTC m=+4.145795930 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/f387de20-2724-46ab-9bca-b4b4a23711cf-original-pull-secret") pod "global-pull-secret-syncer-rs4vc" (UID: "f387de20-2724-46ab-9bca-b4b4a23711cf") : object "kube-system"/"original-pull-secret" not registered Sep 17 07:19:45.669963 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:19:45.669873 2561 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-16 07:14:44 +0000 UTC" deadline="2028-05-04 01:15:57.950090273 +0000 UTC" Sep 17 07:19:45.669963 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:19:45.669905 2561 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14273h56m12.280188919s" Sep 17 07:19:45.679151 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:19:45.679123 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qzfhn" Sep 17 07:19:45.679290 ip-10-0-132-17 kubenswrapper[2561]: E0917 07:19:45.679263 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qzfhn" podUID="ea653065-69b3-4da2-b8d0-9518964204d9" Sep 17 07:19:45.690818 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:19:45.690790 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-2frz9" event={"ID":"0b5240b1-13ea-4cee-b7f1-aa241ca58aa4","Type":"ContainerStarted","Data":"0ab5edeea6cecfebd40107431e168af9e0c2aef8d1884cbb147598abef46c880"} Sep 17 07:19:45.692245 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:19:45.692207 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-pj8tk" event={"ID":"dfe039e6-328a-476c-805f-7b90b0401bc0","Type":"ContainerStarted","Data":"2a27da4826f9c3056dd58339b604bfb10db57bc9bd1ec99942052029491ccde1"} Sep 17 07:19:45.693538 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:19:45.693512 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-77v6s" event={"ID":"4d703673-6fad-4e54-82fd-c935ee6fed42","Type":"ContainerStarted","Data":"ae87b41cb3e429610c49d4aa49a618f1a37050ed51d6e43108f958ff581b1167"} Sep 17 07:19:45.694761 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:19:45.694729 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-8qgg7" event={"ID":"e154eb37-bb6a-4aca-b364-ab985fa57261","Type":"ContainerStarted","Data":"ed0d296ea4dfbe4207e1e15356112f4be62b2f2ed931b9ff8d6d8ba324b4d357"} Sep 17 07:19:45.695988 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:19:45.695967 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-4hbmd" event={"ID":"dc177633-60cf-4933-90f5-26d2619f7c82","Type":"ContainerStarted","Data":"260a1b05bb391cb85df4b7462932cf6d67ffbbf26788ebfdfa149a81f3453877"} Sep 17 07:19:45.697175 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:19:45.697153 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-dp2bc" event={"ID":"d0ad9040-c0ce-453f-813c-809ea9f53c56","Type":"ContainerStarted","Data":"b9fb397d2467bd4623e58853d5f2eedf9db5eef93ffd1be6b0f44df869265b24"} Sep 17 07:19:45.698189 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:19:45.698171 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-885ch" event={"ID":"dd6eae9b-928b-4509-b4cb-035eb209c15d","Type":"ContainerStarted","Data":"2394c0b556e9c6967995294f7d44af4408c64de2af15df979ef8cdf4ea5a6ec9"} Sep 17 07:19:45.699306 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:19:45.699287 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-pwnj9" event={"ID":"a4c6eeea-2ae6-4bb2-93ee-1b46b62da363","Type":"ContainerStarted","Data":"010bd6d8d6a5acb489fab88409cd17dece01dbe7a76d6c6426f4dce59ba86e23"} Sep 17 07:19:45.700454 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:19:45.700434 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-9skpb" event={"ID":"96c5b8e5-2fc0-489b-8889-52bf66184838","Type":"ContainerStarted","Data":"af064c21011f148c52acb28b165938bc329a45b25cdcafc293feeb1189271733"} Sep 17 07:19:46.246789 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:19:46.246224 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e6c12e07-53e7-4f30-a8bf-c5d1a727d2fb-metrics-certs\") pod \"network-metrics-daemon-mcwtb\" (UID: \"e6c12e07-53e7-4f30-a8bf-c5d1a727d2fb\") " pod="openshift-multus/network-metrics-daemon-mcwtb" Sep 17 07:19:46.246789 ip-10-0-132-17 kubenswrapper[2561]: E0917 07:19:46.246368 2561 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 17 07:19:46.246789 ip-10-0-132-17 kubenswrapper[2561]: E0917 07:19:46.246435 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e6c12e07-53e7-4f30-a8bf-c5d1a727d2fb-metrics-certs podName:e6c12e07-53e7-4f30-a8bf-c5d1a727d2fb nodeName:}" failed. No retries permitted until 2026-09-17 07:19:48.246413557 +0000 UTC m=+6.052359813 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e6c12e07-53e7-4f30-a8bf-c5d1a727d2fb-metrics-certs") pod "network-metrics-daemon-mcwtb" (UID: "e6c12e07-53e7-4f30-a8bf-c5d1a727d2fb") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 17 07:19:46.347187 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:19:46.346671 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jww4t\" (UniqueName: \"kubernetes.io/projected/ea653065-69b3-4da2-b8d0-9518964204d9-kube-api-access-jww4t\") pod \"network-check-target-qzfhn\" (UID: \"ea653065-69b3-4da2-b8d0-9518964204d9\") " pod="openshift-network-diagnostics/network-check-target-qzfhn" Sep 17 07:19:46.347187 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:19:46.346747 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f387de20-2724-46ab-9bca-b4b4a23711cf-original-pull-secret\") pod \"global-pull-secret-syncer-rs4vc\" (UID: \"f387de20-2724-46ab-9bca-b4b4a23711cf\") " pod="kube-system/global-pull-secret-syncer-rs4vc" Sep 17 07:19:46.347187 ip-10-0-132-17 kubenswrapper[2561]: E0917 07:19:46.346857 2561 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 17 07:19:46.347187 ip-10-0-132-17 kubenswrapper[2561]: E0917 07:19:46.346905 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f387de20-2724-46ab-9bca-b4b4a23711cf-original-pull-secret podName:f387de20-2724-46ab-9bca-b4b4a23711cf nodeName:}" failed. No retries permitted until 2026-09-17 07:19:48.346890089 +0000 UTC m=+6.152836342 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/f387de20-2724-46ab-9bca-b4b4a23711cf-original-pull-secret") pod "global-pull-secret-syncer-rs4vc" (UID: "f387de20-2724-46ab-9bca-b4b4a23711cf") : object "kube-system"/"original-pull-secret" not registered Sep 17 07:19:46.347420 ip-10-0-132-17 kubenswrapper[2561]: E0917 07:19:46.347211 2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 17 07:19:46.347420 ip-10-0-132-17 kubenswrapper[2561]: E0917 07:19:46.347226 2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 17 07:19:46.347420 ip-10-0-132-17 kubenswrapper[2561]: E0917 07:19:46.347235 2561 projected.go:196] Error preparing data for projected volume kube-api-access-jww4t for pod openshift-network-diagnostics/network-check-target-qzfhn: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 17 07:19:46.347420 ip-10-0-132-17 kubenswrapper[2561]: E0917 07:19:46.347263 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ea653065-69b3-4da2-b8d0-9518964204d9-kube-api-access-jww4t podName:ea653065-69b3-4da2-b8d0-9518964204d9 nodeName:}" failed. No retries permitted until 2026-09-17 07:19:48.347254164 +0000 UTC m=+6.153200417 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-jww4t" (UniqueName: "kubernetes.io/projected/ea653065-69b3-4da2-b8d0-9518964204d9-kube-api-access-jww4t") pod "network-check-target-qzfhn" (UID: "ea653065-69b3-4da2-b8d0-9518964204d9") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 17 07:19:46.671002 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:19:46.670917 2561 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-16 07:14:44 +0000 UTC" deadline="2028-04-18 18:53:29.705345553 +0000 UTC" Sep 17 07:19:46.671002 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:19:46.670999 2561 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13907h33m43.034350586s" Sep 17 07:19:46.683110 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:19:46.683073 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rs4vc" Sep 17 07:19:46.683110 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:19:46.683072 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mcwtb" Sep 17 07:19:46.683306 ip-10-0-132-17 kubenswrapper[2561]: E0917 07:19:46.683210 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rs4vc" podUID="f387de20-2724-46ab-9bca-b4b4a23711cf" Sep 17 07:19:46.683373 ip-10-0-132-17 kubenswrapper[2561]: E0917 07:19:46.683345 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mcwtb" podUID="e6c12e07-53e7-4f30-a8bf-c5d1a727d2fb" Sep 17 07:19:46.718078 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:19:46.717279 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-17.ec2.internal" event={"ID":"6cba30f3283a64fbc23b4dd01a869002","Type":"ContainerStarted","Data":"88c943177ca536670d56a0f953eb0bf3b70d1204fd1621589c1af51d02fb60cc"} Sep 17 07:19:47.679639 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:19:47.679105 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qzfhn" Sep 17 07:19:47.679639 ip-10-0-132-17 kubenswrapper[2561]: E0917 07:19:47.679240 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qzfhn" podUID="ea653065-69b3-4da2-b8d0-9518964204d9" Sep 17 07:19:47.735876 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:19:47.735844 2561 generic.go:356] "Generic (PLEG): container finished" podID="db9b3544cb38d600a3f64c8b5063a0c8" containerID="998e07fde0afb50f5e676a22650413b824f2f3c7c524ff750916f7ce13625bad" exitCode=0 Sep 17 07:19:47.736075 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:19:47.736001 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-17.ec2.internal" event={"ID":"db9b3544cb38d600a3f64c8b5063a0c8","Type":"ContainerDied","Data":"998e07fde0afb50f5e676a22650413b824f2f3c7c524ff750916f7ce13625bad"} Sep 17 07:19:47.765064 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:19:47.764892 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-17.ec2.internal" podStartSLOduration=3.7648712460000002 podStartE2EDuration="3.764871246s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-17 07:19:44 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 07:19:46.749048855 +0000 UTC m=+4.554995133" watchObservedRunningTime="2026-09-17 07:19:47.764871246 +0000 UTC m=+5.570817522" Sep 17 07:19:48.262102 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:19:48.261748 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e6c12e07-53e7-4f30-a8bf-c5d1a727d2fb-metrics-certs\") pod \"network-metrics-daemon-mcwtb\" (UID: \"e6c12e07-53e7-4f30-a8bf-c5d1a727d2fb\") " pod="openshift-multus/network-metrics-daemon-mcwtb" Sep 17 07:19:48.262102 ip-10-0-132-17 kubenswrapper[2561]: E0917 07:19:48.262091 2561 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 17 07:19:48.262325 ip-10-0-132-17 kubenswrapper[2561]: E0917 07:19:48.262157 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e6c12e07-53e7-4f30-a8bf-c5d1a727d2fb-metrics-certs podName:e6c12e07-53e7-4f30-a8bf-c5d1a727d2fb nodeName:}" failed. No retries permitted until 2026-09-17 07:19:52.26214165 +0000 UTC m=+10.068087903 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e6c12e07-53e7-4f30-a8bf-c5d1a727d2fb-metrics-certs") pod "network-metrics-daemon-mcwtb" (UID: "e6c12e07-53e7-4f30-a8bf-c5d1a727d2fb") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 17 07:19:48.363724 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:19:48.362945 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jww4t\" (UniqueName: \"kubernetes.io/projected/ea653065-69b3-4da2-b8d0-9518964204d9-kube-api-access-jww4t\") pod \"network-check-target-qzfhn\" (UID: \"ea653065-69b3-4da2-b8d0-9518964204d9\") " pod="openshift-network-diagnostics/network-check-target-qzfhn" Sep 17 07:19:48.363724 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:19:48.363043 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f387de20-2724-46ab-9bca-b4b4a23711cf-original-pull-secret\") pod \"global-pull-secret-syncer-rs4vc\" (UID: \"f387de20-2724-46ab-9bca-b4b4a23711cf\") " pod="kube-system/global-pull-secret-syncer-rs4vc" Sep 17 07:19:48.363724 ip-10-0-132-17 kubenswrapper[2561]: E0917 07:19:48.363185 2561 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 17 07:19:48.363724 ip-10-0-132-17 kubenswrapper[2561]: E0917 07:19:48.363249 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f387de20-2724-46ab-9bca-b4b4a23711cf-original-pull-secret podName:f387de20-2724-46ab-9bca-b4b4a23711cf nodeName:}" failed. No retries permitted until 2026-09-17 07:19:52.363231613 +0000 UTC m=+10.169177879 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/f387de20-2724-46ab-9bca-b4b4a23711cf-original-pull-secret") pod "global-pull-secret-syncer-rs4vc" (UID: "f387de20-2724-46ab-9bca-b4b4a23711cf") : object "kube-system"/"original-pull-secret" not registered Sep 17 07:19:48.363724 ip-10-0-132-17 kubenswrapper[2561]: E0917 07:19:48.363653 2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 17 07:19:48.363724 ip-10-0-132-17 kubenswrapper[2561]: E0917 07:19:48.363671 2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 17 07:19:48.363724 ip-10-0-132-17 kubenswrapper[2561]: E0917 07:19:48.363683 2561 projected.go:196] Error preparing data for projected volume kube-api-access-jww4t for pod openshift-network-diagnostics/network-check-target-qzfhn: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 17 07:19:48.364232 ip-10-0-132-17 kubenswrapper[2561]: E0917 07:19:48.363881 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ea653065-69b3-4da2-b8d0-9518964204d9-kube-api-access-jww4t podName:ea653065-69b3-4da2-b8d0-9518964204d9 nodeName:}" failed. No retries permitted until 2026-09-17 07:19:52.363816145 +0000 UTC m=+10.169762398 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-jww4t" (UniqueName: "kubernetes.io/projected/ea653065-69b3-4da2-b8d0-9518964204d9-kube-api-access-jww4t") pod "network-check-target-qzfhn" (UID: "ea653065-69b3-4da2-b8d0-9518964204d9") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 17 07:19:48.682246 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:19:48.681640 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rs4vc" Sep 17 07:19:48.682246 ip-10-0-132-17 kubenswrapper[2561]: E0917 07:19:48.681768 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rs4vc" podUID="f387de20-2724-46ab-9bca-b4b4a23711cf" Sep 17 07:19:48.682246 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:19:48.682045 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mcwtb" Sep 17 07:19:48.682246 ip-10-0-132-17 kubenswrapper[2561]: E0917 07:19:48.682168 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mcwtb" podUID="e6c12e07-53e7-4f30-a8bf-c5d1a727d2fb" Sep 17 07:19:48.745339 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:19:48.745300 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-17.ec2.internal" event={"ID":"db9b3544cb38d600a3f64c8b5063a0c8","Type":"ContainerStarted","Data":"704866fd143a251be9256b80c41627fb7bde431b5ff6af27c86b19bc24d42a99"} Sep 17 07:19:48.766159 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:19:48.766101 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-17.ec2.internal" podStartSLOduration=4.766080461 podStartE2EDuration="4.766080461s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-17 07:19:44 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 07:19:48.765367819 +0000 UTC m=+6.571314095" watchObservedRunningTime="2026-09-17 07:19:48.766080461 +0000 UTC m=+6.572026737" Sep 17 07:19:49.679140 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:19:49.679099 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qzfhn" Sep 17 07:19:49.679320 ip-10-0-132-17 kubenswrapper[2561]: E0917 07:19:49.679237 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qzfhn" podUID="ea653065-69b3-4da2-b8d0-9518964204d9" Sep 17 07:19:50.681965 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:19:50.681795 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rs4vc" Sep 17 07:19:50.681965 ip-10-0-132-17 kubenswrapper[2561]: E0917 07:19:50.681925 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rs4vc" podUID="f387de20-2724-46ab-9bca-b4b4a23711cf" Sep 17 07:19:50.682460 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:19:50.682305 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mcwtb" Sep 17 07:19:50.682460 ip-10-0-132-17 kubenswrapper[2561]: E0917 07:19:50.682430 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mcwtb" podUID="e6c12e07-53e7-4f30-a8bf-c5d1a727d2fb" Sep 17 07:19:51.680166 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:19:51.680075 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qzfhn" Sep 17 07:19:51.680298 ip-10-0-132-17 kubenswrapper[2561]: E0917 07:19:51.680195 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qzfhn" podUID="ea653065-69b3-4da2-b8d0-9518964204d9" Sep 17 07:19:52.294026 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:19:52.293980 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e6c12e07-53e7-4f30-a8bf-c5d1a727d2fb-metrics-certs\") pod \"network-metrics-daemon-mcwtb\" (UID: \"e6c12e07-53e7-4f30-a8bf-c5d1a727d2fb\") " pod="openshift-multus/network-metrics-daemon-mcwtb" Sep 17 07:19:52.294491 ip-10-0-132-17 kubenswrapper[2561]: E0917 07:19:52.294157 2561 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 17 07:19:52.294491 ip-10-0-132-17 kubenswrapper[2561]: E0917 07:19:52.294232 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e6c12e07-53e7-4f30-a8bf-c5d1a727d2fb-metrics-certs podName:e6c12e07-53e7-4f30-a8bf-c5d1a727d2fb nodeName:}" failed. No retries permitted until 2026-09-17 07:20:00.29421203 +0000 UTC m=+18.100158287 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e6c12e07-53e7-4f30-a8bf-c5d1a727d2fb-metrics-certs") pod "network-metrics-daemon-mcwtb" (UID: "e6c12e07-53e7-4f30-a8bf-c5d1a727d2fb") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 17 07:19:52.395140 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:19:52.395100 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f387de20-2724-46ab-9bca-b4b4a23711cf-original-pull-secret\") pod \"global-pull-secret-syncer-rs4vc\" (UID: \"f387de20-2724-46ab-9bca-b4b4a23711cf\") " pod="kube-system/global-pull-secret-syncer-rs4vc" Sep 17 07:19:52.395319 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:19:52.395174 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jww4t\" (UniqueName: \"kubernetes.io/projected/ea653065-69b3-4da2-b8d0-9518964204d9-kube-api-access-jww4t\") pod \"network-check-target-qzfhn\" (UID: \"ea653065-69b3-4da2-b8d0-9518964204d9\") " pod="openshift-network-diagnostics/network-check-target-qzfhn" Sep 17 07:19:52.395319 ip-10-0-132-17 kubenswrapper[2561]: E0917 07:19:52.395242 2561 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 17 07:19:52.395319 ip-10-0-132-17 kubenswrapper[2561]: E0917 07:19:52.395316 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f387de20-2724-46ab-9bca-b4b4a23711cf-original-pull-secret podName:f387de20-2724-46ab-9bca-b4b4a23711cf nodeName:}" failed. No retries permitted until 2026-09-17 07:20:00.395294929 +0000 UTC m=+18.201241229 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/f387de20-2724-46ab-9bca-b4b4a23711cf-original-pull-secret") pod "global-pull-secret-syncer-rs4vc" (UID: "f387de20-2724-46ab-9bca-b4b4a23711cf") : object "kube-system"/"original-pull-secret" not registered Sep 17 07:19:52.395557 ip-10-0-132-17 kubenswrapper[2561]: E0917 07:19:52.395325 2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 17 07:19:52.395557 ip-10-0-132-17 kubenswrapper[2561]: E0917 07:19:52.395347 2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 17 07:19:52.395557 ip-10-0-132-17 kubenswrapper[2561]: E0917 07:19:52.395359 2561 projected.go:196] Error preparing data for projected volume kube-api-access-jww4t for pod openshift-network-diagnostics/network-check-target-qzfhn: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 17 07:19:52.395557 ip-10-0-132-17 kubenswrapper[2561]: E0917 07:19:52.395397 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ea653065-69b3-4da2-b8d0-9518964204d9-kube-api-access-jww4t podName:ea653065-69b3-4da2-b8d0-9518964204d9 nodeName:}" failed. No retries permitted until 2026-09-17 07:20:00.395385755 +0000 UTC m=+18.201332007 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-jww4t" (UniqueName: "kubernetes.io/projected/ea653065-69b3-4da2-b8d0-9518964204d9-kube-api-access-jww4t") pod "network-check-target-qzfhn" (UID: "ea653065-69b3-4da2-b8d0-9518964204d9") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 17 07:19:52.681759 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:19:52.681686 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rs4vc" Sep 17 07:19:52.681911 ip-10-0-132-17 kubenswrapper[2561]: E0917 07:19:52.681782 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rs4vc" podUID="f387de20-2724-46ab-9bca-b4b4a23711cf" Sep 17 07:19:52.681911 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:19:52.681833 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mcwtb" Sep 17 07:19:52.682059 ip-10-0-132-17 kubenswrapper[2561]: E0917 07:19:52.681972 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mcwtb" podUID="e6c12e07-53e7-4f30-a8bf-c5d1a727d2fb" Sep 17 07:19:53.679988 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:19:53.679955 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qzfhn" Sep 17 07:19:53.680454 ip-10-0-132-17 kubenswrapper[2561]: E0917 07:19:53.680069 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qzfhn" podUID="ea653065-69b3-4da2-b8d0-9518964204d9" Sep 17 07:19:54.679611 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:19:54.679574 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mcwtb" Sep 17 07:19:54.679611 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:19:54.679602 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rs4vc" Sep 17 07:19:54.679865 ip-10-0-132-17 kubenswrapper[2561]: E0917 07:19:54.679724 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mcwtb" podUID="e6c12e07-53e7-4f30-a8bf-c5d1a727d2fb" Sep 17 07:19:54.680140 ip-10-0-132-17 kubenswrapper[2561]: E0917 07:19:54.680119 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rs4vc" podUID="f387de20-2724-46ab-9bca-b4b4a23711cf" Sep 17 07:19:55.679831 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:19:55.679793 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qzfhn" Sep 17 07:19:55.680021 ip-10-0-132-17 kubenswrapper[2561]: E0917 07:19:55.679914 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qzfhn" podUID="ea653065-69b3-4da2-b8d0-9518964204d9" Sep 17 07:19:56.679996 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:19:56.679962 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rs4vc" Sep 17 07:19:56.680446 ip-10-0-132-17 kubenswrapper[2561]: E0917 07:19:56.680101 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rs4vc" podUID="f387de20-2724-46ab-9bca-b4b4a23711cf" Sep 17 07:19:56.680540 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:19:56.680515 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mcwtb" Sep 17 07:19:56.680672 ip-10-0-132-17 kubenswrapper[2561]: E0917 07:19:56.680627 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mcwtb" podUID="e6c12e07-53e7-4f30-a8bf-c5d1a727d2fb" Sep 17 07:19:57.679406 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:19:57.679375 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qzfhn" Sep 17 07:19:57.679628 ip-10-0-132-17 kubenswrapper[2561]: E0917 07:19:57.679492 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qzfhn" podUID="ea653065-69b3-4da2-b8d0-9518964204d9" Sep 17 07:19:58.679219 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:19:58.679186 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mcwtb" Sep 17 07:19:58.679655 ip-10-0-132-17 kubenswrapper[2561]: E0917 07:19:58.679329 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mcwtb" podUID="e6c12e07-53e7-4f30-a8bf-c5d1a727d2fb" Sep 17 07:19:58.679655 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:19:58.679365 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rs4vc" Sep 17 07:19:58.679655 ip-10-0-132-17 kubenswrapper[2561]: E0917 07:19:58.679442 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rs4vc" podUID="f387de20-2724-46ab-9bca-b4b4a23711cf" Sep 17 07:19:59.679144 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:19:59.679055 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qzfhn" Sep 17 07:19:59.679316 ip-10-0-132-17 kubenswrapper[2561]: E0917 07:19:59.679173 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qzfhn" podUID="ea653065-69b3-4da2-b8d0-9518964204d9" Sep 17 07:20:00.352852 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:20:00.352823 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e6c12e07-53e7-4f30-a8bf-c5d1a727d2fb-metrics-certs\") pod \"network-metrics-daemon-mcwtb\" (UID: \"e6c12e07-53e7-4f30-a8bf-c5d1a727d2fb\") " pod="openshift-multus/network-metrics-daemon-mcwtb" Sep 17 07:20:00.353028 ip-10-0-132-17 kubenswrapper[2561]: E0917 07:20:00.352998 2561 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 17 07:20:00.353072 ip-10-0-132-17 kubenswrapper[2561]: E0917 07:20:00.353063 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e6c12e07-53e7-4f30-a8bf-c5d1a727d2fb-metrics-certs podName:e6c12e07-53e7-4f30-a8bf-c5d1a727d2fb nodeName:}" failed. No retries permitted until 2026-09-17 07:20:16.353048281 +0000 UTC m=+34.158994534 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e6c12e07-53e7-4f30-a8bf-c5d1a727d2fb-metrics-certs") pod "network-metrics-daemon-mcwtb" (UID: "e6c12e07-53e7-4f30-a8bf-c5d1a727d2fb") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 17 07:20:00.454119 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:20:00.454082 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f387de20-2724-46ab-9bca-b4b4a23711cf-original-pull-secret\") pod \"global-pull-secret-syncer-rs4vc\" (UID: \"f387de20-2724-46ab-9bca-b4b4a23711cf\") " pod="kube-system/global-pull-secret-syncer-rs4vc" Sep 17 07:20:00.454289 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:20:00.454149 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jww4t\" (UniqueName: \"kubernetes.io/projected/ea653065-69b3-4da2-b8d0-9518964204d9-kube-api-access-jww4t\") pod \"network-check-target-qzfhn\" (UID: \"ea653065-69b3-4da2-b8d0-9518964204d9\") " pod="openshift-network-diagnostics/network-check-target-qzfhn" Sep 17 07:20:00.454289 ip-10-0-132-17 kubenswrapper[2561]: E0917 07:20:00.454241 2561 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 17 07:20:00.454289 ip-10-0-132-17 kubenswrapper[2561]: E0917 07:20:00.454281 2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 17 07:20:00.454433 ip-10-0-132-17 kubenswrapper[2561]: E0917 07:20:00.454303 2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 17 07:20:00.454433 ip-10-0-132-17 kubenswrapper[2561]: E0917 07:20:00.454316 2561 projected.go:196] Error preparing data for projected volume kube-api-access-jww4t for pod openshift-network-diagnostics/network-check-target-qzfhn: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 17 07:20:00.454433 ip-10-0-132-17 kubenswrapper[2561]: E0917 07:20:00.454318 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f387de20-2724-46ab-9bca-b4b4a23711cf-original-pull-secret podName:f387de20-2724-46ab-9bca-b4b4a23711cf nodeName:}" failed. No retries permitted until 2026-09-17 07:20:16.454298659 +0000 UTC m=+34.260244917 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/f387de20-2724-46ab-9bca-b4b4a23711cf-original-pull-secret") pod "global-pull-secret-syncer-rs4vc" (UID: "f387de20-2724-46ab-9bca-b4b4a23711cf") : object "kube-system"/"original-pull-secret" not registered Sep 17 07:20:00.454433 ip-10-0-132-17 kubenswrapper[2561]: E0917 07:20:00.454366 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ea653065-69b3-4da2-b8d0-9518964204d9-kube-api-access-jww4t podName:ea653065-69b3-4da2-b8d0-9518964204d9 nodeName:}" failed. No retries permitted until 2026-09-17 07:20:16.45435105 +0000 UTC m=+34.260297306 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-jww4t" (UniqueName: "kubernetes.io/projected/ea653065-69b3-4da2-b8d0-9518964204d9-kube-api-access-jww4t") pod "network-check-target-qzfhn" (UID: "ea653065-69b3-4da2-b8d0-9518964204d9") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 17 07:20:00.683222 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:20:00.683191 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mcwtb" Sep 17 07:20:00.683660 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:20:00.683234 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rs4vc" Sep 17 07:20:00.683660 ip-10-0-132-17 kubenswrapper[2561]: E0917 07:20:00.683313 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mcwtb" podUID="e6c12e07-53e7-4f30-a8bf-c5d1a727d2fb" Sep 17 07:20:00.683660 ip-10-0-132-17 kubenswrapper[2561]: E0917 07:20:00.683458 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rs4vc" podUID="f387de20-2724-46ab-9bca-b4b4a23711cf" Sep 17 07:20:01.679852 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:20:01.679822 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qzfhn" Sep 17 07:20:01.680038 ip-10-0-132-17 kubenswrapper[2561]: E0917 07:20:01.679961 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qzfhn" podUID="ea653065-69b3-4da2-b8d0-9518964204d9" Sep 17 07:20:02.679903 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:20:02.679862 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mcwtb" Sep 17 07:20:02.680339 ip-10-0-132-17 kubenswrapper[2561]: E0917 07:20:02.679991 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mcwtb" podUID="e6c12e07-53e7-4f30-a8bf-c5d1a727d2fb" Sep 17 07:20:02.680339 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:20:02.680142 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rs4vc" Sep 17 07:20:02.680339 ip-10-0-132-17 kubenswrapper[2561]: E0917 07:20:02.680283 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rs4vc" podUID="f387de20-2724-46ab-9bca-b4b4a23711cf" Sep 17 07:20:03.679522 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:20:03.679362 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qzfhn" Sep 17 07:20:03.679671 ip-10-0-132-17 kubenswrapper[2561]: E0917 07:20:03.679630 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qzfhn" podUID="ea653065-69b3-4da2-b8d0-9518964204d9" Sep 17 07:20:03.785606 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:20:03.785584 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-885ch" event={"ID":"dd6eae9b-928b-4509-b4cb-035eb209c15d","Type":"ContainerStarted","Data":"23a63d867e5cee266f61630ad623d7ac2befd46402f06fe3a818a5155c93b1e0"} Sep 17 07:20:03.787070 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:20:03.787048 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-pwnj9" event={"ID":"a4c6eeea-2ae6-4bb2-93ee-1b46b62da363","Type":"ContainerStarted","Data":"fbeac285e6c651562c856b2bf4a7af12bc927e17d7c58ae20913386351cd5de6"} Sep 17 07:20:03.788543 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:20:03.788512 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-9skpb" event={"ID":"96c5b8e5-2fc0-489b-8889-52bf66184838","Type":"ContainerStarted","Data":"e903c6b93eecb9dd7b3a1865a6e99a8854d431476c3ebf154bc263a641a9c3c8"} Sep 17 07:20:03.790862 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:20:03.790847 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2frz9_0b5240b1-13ea-4cee-b7f1-aa241ca58aa4/ovn-acl-logging/0.log" Sep 17 07:20:03.791191 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:20:03.791171 2561 generic.go:356] "Generic (PLEG): container finished" podID="0b5240b1-13ea-4cee-b7f1-aa241ca58aa4" containerID="0aa6b5496576b87465d4a86da4d2992d3ce7db399eefca788201677931a77536" exitCode=1 Sep 17 07:20:03.791263 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:20:03.791237 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-2frz9" event={"ID":"0b5240b1-13ea-4cee-b7f1-aa241ca58aa4","Type":"ContainerStarted","Data":"4533f1ab09c186cd8b7a06ff440cee0582f3b513e7b0ef58f5aaa5a1a095550b"} Sep 17 07:20:03.791323 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:20:03.791293 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-2frz9" event={"ID":"0b5240b1-13ea-4cee-b7f1-aa241ca58aa4","Type":"ContainerStarted","Data":"2ef885b5cb5da480270135ea8683cbac49e8389bf27c5cb8a19993648d1a6163"} Sep 17 07:20:03.791364 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:20:03.791338 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-2frz9" event={"ID":"0b5240b1-13ea-4cee-b7f1-aa241ca58aa4","Type":"ContainerDied","Data":"0aa6b5496576b87465d4a86da4d2992d3ce7db399eefca788201677931a77536"} Sep 17 07:20:03.791404 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:20:03.791369 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-2frz9" event={"ID":"0b5240b1-13ea-4cee-b7f1-aa241ca58aa4","Type":"ContainerStarted","Data":"034fe1f5157e3eaa1cbc033768acd1627ce433de19ebd8bdc8fcdf1737d7b7de"} Sep 17 07:20:03.792723 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:20:03.792701 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-pj8tk" event={"ID":"dfe039e6-328a-476c-805f-7b90b0401bc0","Type":"ContainerStarted","Data":"bd9468e4e5f479a024655876bf053c252651bb6e67e993c59a6a1747bc97c103"} Sep 17 07:20:03.794157 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:20:03.794134 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-77v6s" event={"ID":"4d703673-6fad-4e54-82fd-c935ee6fed42","Type":"ContainerStarted","Data":"04525c39583c178338d9c00754be92bb3cd33c9ad25ed1db44afc986c68888d1"} Sep 17 07:20:03.795633 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:20:03.795612 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-8qgg7" event={"ID":"e154eb37-bb6a-4aca-b364-ab985fa57261","Type":"ContainerStarted","Data":"75abe6328465634591a12da3e991d0bc0c2bfef3154c909e0c557d49cc51a27f"} Sep 17 07:20:03.797114 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:20:03.797094 2561 generic.go:356] "Generic (PLEG): container finished" podID="dc177633-60cf-4933-90f5-26d2619f7c82" containerID="84d40090e971414b1cf841043051ff36b1c45000fd5cc2c40dce75633884a1a6" exitCode=0 Sep 17 07:20:03.797184 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:20:03.797130 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-4hbmd" event={"ID":"dc177633-60cf-4933-90f5-26d2619f7c82","Type":"ContainerDied","Data":"84d40090e971414b1cf841043051ff36b1c45000fd5cc2c40dce75633884a1a6"} Sep 17 07:20:03.803264 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:20:03.803221 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-885ch" podStartSLOduration=2.614103352 podStartE2EDuration="20.80321024s" totalImagesPullingTime="18.189106888s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-17 07:19:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 07:20:03.803142599 +0000 UTC m=+21.609088897" watchObservedRunningTime="2026-09-17 07:20:03.80321024 +0000 UTC m=+21.609156515" Sep 17 07:20:03.817587 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:20:03.817555 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-pwnj9" podStartSLOduration=3.830594342 podStartE2EDuration="21.817544248s" totalImagesPullingTime="17.986949906s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-17 07:19:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 07:20:03.816886073 +0000 UTC m=+21.622832348" watchObservedRunningTime="2026-09-17 07:20:03.817544248 +0000 UTC m=+21.623490523" Sep 17 07:20:03.832144 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:20:03.832111 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-8qgg7" podStartSLOduration=2.623050199 podStartE2EDuration="20.832099919s" totalImagesPullingTime="18.20904972s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-17 07:19:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 07:20:03.831881057 +0000 UTC m=+21.637827345" watchObservedRunningTime="2026-09-17 07:20:03.832099919 +0000 UTC m=+21.638046194" Sep 17 07:20:03.895497 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:20:03.895455 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-9skpb" podStartSLOduration=3.891607838 podStartE2EDuration="21.895442249s" totalImagesPullingTime="18.003834411s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 07:19:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 07:20:03.863012471 +0000 UTC m=+21.668958724" watchObservedRunningTime="2026-09-17 07:20:03.895442249 +0000 UTC m=+21.701388524" Sep 17 07:20:04.680019 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:20:04.679690 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rs4vc" Sep 17 07:20:04.680198 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:20:04.679748 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mcwtb" Sep 17 07:20:04.680198 ip-10-0-132-17 kubenswrapper[2561]: E0917 07:20:04.680066 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rs4vc" podUID="f387de20-2724-46ab-9bca-b4b4a23711cf" Sep 17 07:20:04.680198 ip-10-0-132-17 kubenswrapper[2561]: E0917 07:20:04.680124 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mcwtb" podUID="e6c12e07-53e7-4f30-a8bf-c5d1a727d2fb" Sep 17 07:20:04.800149 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:20:04.800115 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-dp2bc" event={"ID":"d0ad9040-c0ce-453f-813c-809ea9f53c56","Type":"ContainerStarted","Data":"e42a134062b73f9f7997a030d6cf2f35379e7b06a420206bb532be57a87719de"} Sep 17 07:20:04.802763 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:20:04.802742 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2frz9_0b5240b1-13ea-4cee-b7f1-aa241ca58aa4/ovn-acl-logging/0.log" Sep 17 07:20:04.803109 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:20:04.803085 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-2frz9" event={"ID":"0b5240b1-13ea-4cee-b7f1-aa241ca58aa4","Type":"ContainerStarted","Data":"54b7e2751dff7603c047a4e630476fb5ef8b4bab22a018966c6fa4a4206f4f6e"} Sep 17 07:20:04.803205 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:20:04.803158 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-2frz9" event={"ID":"0b5240b1-13ea-4cee-b7f1-aa241ca58aa4","Type":"ContainerStarted","Data":"adbffb78f4cda9cb39dd25c2a65f9738e15e3215e7646f0ca5372ce68a21f711"} Sep 17 07:20:04.834602 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:20:04.834565 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-pj8tk" podStartSLOduration=3.575299114 podStartE2EDuration="21.834548872s" totalImagesPullingTime="18.259249758s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-17 07:19:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 07:20:03.92372033 +0000 UTC m=+21.729666609" watchObservedRunningTime="2026-09-17 07:20:04.834548872 +0000 UTC m=+22.640495147" Sep 17 07:20:04.976971 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:20:04.976924 2561 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Sep 17 07:20:05.680042 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:20:05.680008 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qzfhn" Sep 17 07:20:05.680192 ip-10-0-132-17 kubenswrapper[2561]: E0917 07:20:05.680111 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qzfhn" podUID="ea653065-69b3-4da2-b8d0-9518964204d9" Sep 17 07:20:05.692962 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:20:05.692864 2561 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-09-17T07:20:04.976969485Z","UUID":"eee41440-d8f8-4f37-93ba-ea9eb6159916","Handler":null,"Name":"","Endpoint":""} Sep 17 07:20:05.695104 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:20:05.695080 2561 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Sep 17 07:20:05.695221 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:20:05.695119 2561 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Sep 17 07:20:05.808552 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:20:05.808514 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-77v6s" event={"ID":"4d703673-6fad-4e54-82fd-c935ee6fed42","Type":"ContainerStarted","Data":"0f25e3bd4277d1321265e083e9bf0e2415e704402e8b74b0a55b73c1b3c8a902"} Sep 17 07:20:06.293857 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:20:06.293787 2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-9skpb" Sep 17 07:20:06.294369 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:20:06.294352 2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-9skpb" Sep 17 07:20:06.315485 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:20:06.315444 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-dp2bc" podStartSLOduration=6.302985169 podStartE2EDuration="24.315424518s" totalImagesPullingTime="18.012439349s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-17 07:19:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 07:20:04.835178337 +0000 UTC m=+22.641124635" watchObservedRunningTime="2026-09-17 07:20:06.315424518 +0000 UTC m=+24.121370793" Sep 17 07:20:06.679711 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:20:06.679676 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rs4vc" Sep 17 07:20:06.679711 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:20:06.679709 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mcwtb" Sep 17 07:20:06.679894 ip-10-0-132-17 kubenswrapper[2561]: E0917 07:20:06.679850 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rs4vc" podUID="f387de20-2724-46ab-9bca-b4b4a23711cf" Sep 17 07:20:06.680011 ip-10-0-132-17 kubenswrapper[2561]: E0917 07:20:06.679991 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mcwtb" podUID="e6c12e07-53e7-4f30-a8bf-c5d1a727d2fb" Sep 17 07:20:06.813699 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:20:06.813673 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2frz9_0b5240b1-13ea-4cee-b7f1-aa241ca58aa4/ovn-acl-logging/0.log" Sep 17 07:20:06.814122 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:20:06.814096 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-2frz9" event={"ID":"0b5240b1-13ea-4cee-b7f1-aa241ca58aa4","Type":"ContainerStarted","Data":"68ac4cb0021e43840fec7e346714d3427a7ab02c8a1d67bb96475f0d0fcf4161"} Sep 17 07:20:06.816116 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:20:06.816090 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-77v6s" event={"ID":"4d703673-6fad-4e54-82fd-c935ee6fed42","Type":"ContainerStarted","Data":"6830f586c535637ad6c85fa365217e88258ce002db3d5c9b06d9a4d3a0b7728f"} Sep 17 07:20:06.816369 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:20:06.816348 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-9skpb" Sep 17 07:20:06.816722 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:20:06.816707 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-9skpb" Sep 17 07:20:06.894006 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:20:06.893962 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-77v6s" podStartSLOduration=2.887944788 podStartE2EDuration="23.893950074s" totalImagesPullingTime="21.006005286s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-17 07:19:43 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 07:20:06.857243837 +0000 UTC m=+24.663190113" watchObservedRunningTime="2026-09-17 07:20:06.893950074 +0000 UTC m=+24.699896342" Sep 17 07:20:07.679338 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:20:07.679287 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qzfhn" Sep 17 07:20:07.679516 ip-10-0-132-17 kubenswrapper[2561]: E0917 07:20:07.679447 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qzfhn" podUID="ea653065-69b3-4da2-b8d0-9518964204d9" Sep 17 07:20:08.680161 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:20:08.680122 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rs4vc" Sep 17 07:20:08.680593 ip-10-0-132-17 kubenswrapper[2561]: E0917 07:20:08.680257 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rs4vc" podUID="f387de20-2724-46ab-9bca-b4b4a23711cf" Sep 17 07:20:08.680593 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:20:08.680289 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mcwtb" Sep 17 07:20:08.680593 ip-10-0-132-17 kubenswrapper[2561]: E0917 07:20:08.680362 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mcwtb" podUID="e6c12e07-53e7-4f30-a8bf-c5d1a727d2fb" Sep 17 07:20:09.679885 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:20:09.679850 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qzfhn" Sep 17 07:20:09.680068 ip-10-0-132-17 kubenswrapper[2561]: E0917 07:20:09.679994 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qzfhn" podUID="ea653065-69b3-4da2-b8d0-9518964204d9" Sep 17 07:20:09.828341 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:20:09.828118 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2frz9_0b5240b1-13ea-4cee-b7f1-aa241ca58aa4/ovn-acl-logging/0.log" Sep 17 07:20:09.829098 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:20:09.828736 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-2frz9" event={"ID":"0b5240b1-13ea-4cee-b7f1-aa241ca58aa4","Type":"ContainerStarted","Data":"1a8ed4188cb05d547b93f27c6e200e5b4957ff889263110d6c24dc99a029ef69"} Sep 17 07:20:09.829098 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:20:09.829040 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-2frz9" Sep 17 07:20:09.829287 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:20:09.829121 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-2frz9" Sep 17 07:20:09.829287 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:20:09.829173 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-2frz9" Sep 17 07:20:09.829287 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:20:09.829172 2561 scope.go:117] "RemoveContainer" containerID="0aa6b5496576b87465d4a86da4d2992d3ce7db399eefca788201677931a77536" Sep 17 07:20:09.846282 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:20:09.846262 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-2frz9" Sep 17 07:20:09.849239 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:20:09.849214 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-2frz9" Sep 17 07:20:10.679607 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:20:10.679577 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rs4vc" Sep 17 07:20:10.679767 ip-10-0-132-17 kubenswrapper[2561]: E0917 07:20:10.679691 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rs4vc" podUID="f387de20-2724-46ab-9bca-b4b4a23711cf" Sep 17 07:20:10.679767 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:20:10.679748 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mcwtb" Sep 17 07:20:10.679869 ip-10-0-132-17 kubenswrapper[2561]: E0917 07:20:10.679844 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mcwtb" podUID="e6c12e07-53e7-4f30-a8bf-c5d1a727d2fb" Sep 17 07:20:10.834552 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:20:10.834526 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2frz9_0b5240b1-13ea-4cee-b7f1-aa241ca58aa4/ovn-acl-logging/0.log" Sep 17 07:20:10.835226 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:20:10.834877 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-2frz9" event={"ID":"0b5240b1-13ea-4cee-b7f1-aa241ca58aa4","Type":"ContainerStarted","Data":"739d3dbcb0f896b8365669d7470acbc0b477bc2b1761f6aebf2385db882c2537"} Sep 17 07:20:10.836736 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:20:10.836709 2561 generic.go:356] "Generic (PLEG): container finished" podID="dc177633-60cf-4933-90f5-26d2619f7c82" containerID="704dc031e8dba9455cb32d06e2cd735b09772374d9d939275fc78244bd07b5aa" exitCode=0 Sep 17 07:20:10.836863 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:20:10.836757 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-4hbmd" event={"ID":"dc177633-60cf-4933-90f5-26d2619f7c82","Type":"ContainerDied","Data":"704dc031e8dba9455cb32d06e2cd735b09772374d9d939275fc78244bd07b5aa"} Sep 17 07:20:10.866249 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:20:10.866205 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-2frz9" podStartSLOduration=9.642354813 podStartE2EDuration="27.866192719s" totalImagesPullingTime="18.223837906s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-17 07:19:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 07:20:10.864771551 +0000 UTC m=+28.670717837" watchObservedRunningTime="2026-09-17 07:20:10.866192719 +0000 UTC m=+28.672139023" Sep 17 07:20:11.637082 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:20:11.636271 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-rs4vc"] Sep 17 07:20:11.637082 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:20:11.636622 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rs4vc" Sep 17 07:20:11.637082 ip-10-0-132-17 kubenswrapper[2561]: E0917 07:20:11.636735 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rs4vc" podUID="f387de20-2724-46ab-9bca-b4b4a23711cf" Sep 17 07:20:11.641032 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:20:11.641002 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-qzfhn"] Sep 17 07:20:11.641148 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:20:11.641114 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qzfhn" Sep 17 07:20:11.641230 ip-10-0-132-17 kubenswrapper[2561]: E0917 07:20:11.641210 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qzfhn" podUID="ea653065-69b3-4da2-b8d0-9518964204d9" Sep 17 07:20:11.659801 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:20:11.659771 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-mcwtb"] Sep 17 07:20:11.659921 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:20:11.659858 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mcwtb" Sep 17 07:20:11.659987 ip-10-0-132-17 kubenswrapper[2561]: E0917 07:20:11.659956 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mcwtb" podUID="e6c12e07-53e7-4f30-a8bf-c5d1a727d2fb" Sep 17 07:20:12.843356 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:20:12.843328 2561 generic.go:356] "Generic (PLEG): container finished" podID="dc177633-60cf-4933-90f5-26d2619f7c82" containerID="64557b97c4075c689680376ccf7bb0dae8d179e87b63c8983573d6e780ae3b77" exitCode=0 Sep 17 07:20:12.843785 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:20:12.843375 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-4hbmd" event={"ID":"dc177633-60cf-4933-90f5-26d2619f7c82","Type":"ContainerDied","Data":"64557b97c4075c689680376ccf7bb0dae8d179e87b63c8983573d6e780ae3b77"} Sep 17 07:20:13.679769 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:20:13.679746 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qzfhn" Sep 17 07:20:13.679865 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:20:13.679836 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rs4vc" Sep 17 07:20:13.679865 ip-10-0-132-17 kubenswrapper[2561]: E0917 07:20:13.679847 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qzfhn" podUID="ea653065-69b3-4da2-b8d0-9518964204d9" Sep 17 07:20:13.679865 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:20:13.679863 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mcwtb" Sep 17 07:20:13.679986 ip-10-0-132-17 kubenswrapper[2561]: E0917 07:20:13.679964 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rs4vc" podUID="f387de20-2724-46ab-9bca-b4b4a23711cf" Sep 17 07:20:13.680044 ip-10-0-132-17 kubenswrapper[2561]: E0917 07:20:13.680024 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mcwtb" podUID="e6c12e07-53e7-4f30-a8bf-c5d1a727d2fb" Sep 17 07:20:13.848323 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:20:13.848296 2561 generic.go:356] "Generic (PLEG): container finished" podID="dc177633-60cf-4933-90f5-26d2619f7c82" containerID="cbb5008447d59b312ab6d4c59594b6d295ed96e9873264e3463e23b8e163ae64" exitCode=0 Sep 17 07:20:13.848600 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:20:13.848352 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-4hbmd" event={"ID":"dc177633-60cf-4933-90f5-26d2619f7c82","Type":"ContainerDied","Data":"cbb5008447d59b312ab6d4c59594b6d295ed96e9873264e3463e23b8e163ae64"} Sep 17 07:20:15.679678 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:20:15.679644 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qzfhn" Sep 17 07:20:15.679678 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:20:15.679675 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rs4vc" Sep 17 07:20:15.680299 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:20:15.679645 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mcwtb" Sep 17 07:20:15.680299 ip-10-0-132-17 kubenswrapper[2561]: E0917 07:20:15.679762 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qzfhn" podUID="ea653065-69b3-4da2-b8d0-9518964204d9" Sep 17 07:20:15.680299 ip-10-0-132-17 kubenswrapper[2561]: E0917 07:20:15.679862 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mcwtb" podUID="e6c12e07-53e7-4f30-a8bf-c5d1a727d2fb" Sep 17 07:20:15.680299 ip-10-0-132-17 kubenswrapper[2561]: E0917 07:20:15.679982 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rs4vc" podUID="f387de20-2724-46ab-9bca-b4b4a23711cf" Sep 17 07:20:16.055915 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:20:16.055846 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-17.ec2.internal" event="NodeReady" Sep 17 07:20:16.056072 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:20:16.056001 2561 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Sep 17 07:20:16.134017 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:20:16.133982 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-78f65bbf85-k6js8"] Sep 17 07:20:16.136033 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:20:16.136003 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-78f65bbf85-k6js8" Sep 17 07:20:16.142486 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:20:16.142467 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"work-manager-hub-kubeconfig\"" Sep 17 07:20:16.142588 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:20:16.142533 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\"" Sep 17 07:20:16.142834 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:20:16.142809 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\"" Sep 17 07:20:16.143087 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:20:16.143058 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-5d69dcb864-hck5p"] Sep 17 07:20:16.144253 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:20:16.144228 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\"" Sep 17 07:20:16.144730 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:20:16.144713 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-587566598b-6kkq9"] Sep 17 07:20:16.144847 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:20:16.144832 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5d69dcb864-hck5p" Sep 17 07:20:16.146534 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:20:16.146331 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-587566598b-6kkq9" Sep 17 07:20:16.155132 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:20:16.155111 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-dockercfg-qtpmh\"" Sep 17 07:20:16.158220 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:20:16.158200 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Sep 17 07:20:16.158311 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:20:16.158257 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Sep 17 07:20:16.159160 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:20:16.159137 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Sep 17 07:20:16.159500 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:20:16.159481 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-hub-kubeconfig\"" Sep 17 07:20:16.159794 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:20:16.159775 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-n9snn\"" Sep 17 07:20:16.160201 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:20:16.160183 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-78f65bbf85-k6js8"] Sep 17 07:20:16.169504 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:20:16.169478 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Sep 17 07:20:16.180859 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:20:16.180838 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7978f59f89-vc9f5"] Sep 17 07:20:16.182923 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:20:16.182900 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7978f59f89-vc9f5" Sep 17 07:20:16.188760 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:20:16.188726 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-open-cluster-management.io-proxy-agent-signer-client-cert\"" Sep 17 07:20:16.188760 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:20:16.188752 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-ca\"" Sep 17 07:20:16.188881 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:20:16.188774 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-hub-kubeconfig\"" Sep 17 07:20:16.189060 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:20:16.189043 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-service-proxy-server-certificates\"" Sep 17 07:20:16.198853 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:20:16.198833 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-587566598b-6kkq9"] Sep 17 07:20:16.206015 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:20:16.205970 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-5d69dcb864-hck5p"] Sep 17 07:20:16.215801 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:20:16.215776 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7978f59f89-vc9f5"] Sep 17 07:20:16.231272 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:20:16.231254 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-lbjkz"] Sep 17 07:20:16.233076 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:20:16.233060 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-lbjkz" Sep 17 07:20:16.237783 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:20:16.237760 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Sep 17 07:20:16.237882 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:20:16.237818 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-6h7kw"] Sep 17 07:20:16.239057 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:20:16.239040 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-9p6qq\"" Sep 17 07:20:16.239177 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:20:16.239162 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Sep 17 07:20:16.239615 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:20:16.239596 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-6h7kw" Sep 17 07:20:16.245601 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:20:16.245586 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Sep 17 07:20:16.249817 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:20:16.249675 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Sep 17 07:20:16.250536 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:20:16.250514 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-tth88\"" Sep 17 07:20:16.250844 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:20:16.250827 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Sep 17 07:20:16.251545 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:20:16.251511 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-lbjkz"] Sep 17 07:20:16.270503 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:20:16.270485 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/246f42b6-4802-412b-b611-a0d3d360c537-hub\") pod \"cluster-proxy-proxy-agent-7978f59f89-vc9f5\" (UID: \"246f42b6-4802-412b-b611-a0d3d360c537\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7978f59f89-vc9f5" Sep 17 07:20:16.270596 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:20:16.270514 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/246f42b6-4802-412b-b611-a0d3d360c537-additional-service-ca\") pod \"cluster-proxy-proxy-agent-7978f59f89-vc9f5\" (UID: \"246f42b6-4802-412b-b611-a0d3d360c537\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7978f59f89-vc9f5" Sep 17 07:20:16.270596 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:20:16.270534 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/5d07cc07-43a4-401e-831f-e77bd2d21b82-bound-sa-token\") pod \"image-registry-5d69dcb864-hck5p\" (UID: \"5d07cc07-43a4-401e-831f-e77bd2d21b82\") " pod="openshift-image-registry/image-registry-5d69dcb864-hck5p" Sep 17 07:20:16.270596 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:20:16.270558 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/5d07cc07-43a4-401e-831f-e77bd2d21b82-installation-pull-secrets\") pod \"image-registry-5d69dcb864-hck5p\" (UID: \"5d07cc07-43a4-401e-831f-e77bd2d21b82\") " pod="openshift-image-registry/image-registry-5d69dcb864-hck5p" Sep 17 07:20:16.270596 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:20:16.270580 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/4d02ff8a-5500-45eb-96c8-c9c0129c4c62-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-587566598b-6kkq9\" (UID: \"4d02ff8a-5500-45eb-96c8-c9c0129c4c62\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-587566598b-6kkq9" Sep 17 07:20:16.270763 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:20:16.270635 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/5d07cc07-43a4-401e-831f-e77bd2d21b82-image-registry-private-configuration\") pod \"image-registry-5d69dcb864-hck5p\" (UID: \"5d07cc07-43a4-401e-831f-e77bd2d21b82\") " pod="openshift-image-registry/image-registry-5d69dcb864-hck5p" Sep 17 07:20:16.270763 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:20:16.270667 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xwvmf\" (UniqueName: \"kubernetes.io/projected/5d07cc07-43a4-401e-831f-e77bd2d21b82-kube-api-access-xwvmf\") pod \"image-registry-5d69dcb864-hck5p\" (UID: \"5d07cc07-43a4-401e-831f-e77bd2d21b82\") " pod="openshift-image-registry/image-registry-5d69dcb864-hck5p" Sep 17 07:20:16.270763 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:20:16.270695 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dxshh\" (UniqueName: \"kubernetes.io/projected/246f42b6-4802-412b-b611-a0d3d360c537-kube-api-access-dxshh\") pod \"cluster-proxy-proxy-agent-7978f59f89-vc9f5\" (UID: \"246f42b6-4802-412b-b611-a0d3d360c537\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7978f59f89-vc9f5" Sep 17 07:20:16.270763 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:20:16.270729 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/5d07cc07-43a4-401e-831f-e77bd2d21b82-registry-tls\") pod \"image-registry-5d69dcb864-hck5p\" (UID: \"5d07cc07-43a4-401e-831f-e77bd2d21b82\") " pod="openshift-image-registry/image-registry-5d69dcb864-hck5p" Sep 17 07:20:16.270763 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:20:16.270746 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/246f42b6-4802-412b-b611-a0d3d360c537-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-7978f59f89-vc9f5\" (UID: \"246f42b6-4802-412b-b611-a0d3d360c537\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7978f59f89-vc9f5" Sep 17 07:20:16.270954 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:20:16.270762 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/246f42b6-4802-412b-b611-a0d3d360c537-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-7978f59f89-vc9f5\" (UID: \"246f42b6-4802-412b-b611-a0d3d360c537\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7978f59f89-vc9f5" Sep 17 07:20:16.270954 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:20:16.270817 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/fb4d76d4-1b13-4143-94ef-b7098405fbdd-tmp\") pod \"klusterlet-addon-workmgr-78f65bbf85-k6js8\" (UID: \"fb4d76d4-1b13-4143-94ef-b7098405fbdd\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-78f65bbf85-k6js8" Sep 17 07:20:16.270954 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:20:16.270837 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/5d07cc07-43a4-401e-831f-e77bd2d21b82-registry-certificates\") pod \"image-registry-5d69dcb864-hck5p\" (UID: \"5d07cc07-43a4-401e-831f-e77bd2d21b82\") " pod="openshift-image-registry/image-registry-5d69dcb864-hck5p" Sep 17 07:20:16.270954 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:20:16.270863 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/5d07cc07-43a4-401e-831f-e77bd2d21b82-trusted-ca\") pod \"image-registry-5d69dcb864-hck5p\" (UID: \"5d07cc07-43a4-401e-831f-e77bd2d21b82\") " pod="openshift-image-registry/image-registry-5d69dcb864-hck5p" Sep 17 07:20:16.270954 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:20:16.270890 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c88n4\" (UniqueName: \"kubernetes.io/projected/4d02ff8a-5500-45eb-96c8-c9c0129c4c62-kube-api-access-c88n4\") pod \"managed-serviceaccount-addon-agent-587566598b-6kkq9\" (UID: \"4d02ff8a-5500-45eb-96c8-c9c0129c4c62\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-587566598b-6kkq9" Sep 17 07:20:16.270954 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:20:16.270917 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/fb4d76d4-1b13-4143-94ef-b7098405fbdd-klusterlet-config\") pod \"klusterlet-addon-workmgr-78f65bbf85-k6js8\" (UID: \"fb4d76d4-1b13-4143-94ef-b7098405fbdd\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-78f65bbf85-k6js8" Sep 17 07:20:16.271170 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:20:16.270957 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/5d07cc07-43a4-401e-831f-e77bd2d21b82-ca-trust-extracted\") pod \"image-registry-5d69dcb864-hck5p\" (UID: \"5d07cc07-43a4-401e-831f-e77bd2d21b82\") " pod="openshift-image-registry/image-registry-5d69dcb864-hck5p" Sep 17 07:20:16.271170 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:20:16.270981 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/246f42b6-4802-412b-b611-a0d3d360c537-ca\") pod \"cluster-proxy-proxy-agent-7978f59f89-vc9f5\" (UID: \"246f42b6-4802-412b-b611-a0d3d360c537\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7978f59f89-vc9f5" Sep 17 07:20:16.271170 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:20:16.271027 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5ps9f\" (UniqueName: \"kubernetes.io/projected/fb4d76d4-1b13-4143-94ef-b7098405fbdd-kube-api-access-5ps9f\") pod \"klusterlet-addon-workmgr-78f65bbf85-k6js8\" (UID: \"fb4d76d4-1b13-4143-94ef-b7098405fbdd\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-78f65bbf85-k6js8" Sep 17 07:20:16.277707 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:20:16.277686 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-6h7kw"] Sep 17 07:20:16.332513 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:20:16.332430 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9skpb_96c5b8e5-2fc0-489b-8889-52bf66184838/konnectivity-agent/0.log" limit=1024 Sep 17 07:20:16.371671 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:20:16.371640 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/5d07cc07-43a4-401e-831f-e77bd2d21b82-image-registry-private-configuration\") pod \"image-registry-5d69dcb864-hck5p\" (UID: \"5d07cc07-43a4-401e-831f-e77bd2d21b82\") " pod="openshift-image-registry/image-registry-5d69dcb864-hck5p" Sep 17 07:20:16.371794 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:20:16.371679 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xwvmf\" (UniqueName: \"kubernetes.io/projected/5d07cc07-43a4-401e-831f-e77bd2d21b82-kube-api-access-xwvmf\") pod \"image-registry-5d69dcb864-hck5p\" (UID: \"5d07cc07-43a4-401e-831f-e77bd2d21b82\") " pod="openshift-image-registry/image-registry-5d69dcb864-hck5p" Sep 17 07:20:16.371794 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:20:16.371697 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dxshh\" (UniqueName: \"kubernetes.io/projected/246f42b6-4802-412b-b611-a0d3d360c537-kube-api-access-dxshh\") pod \"cluster-proxy-proxy-agent-7978f59f89-vc9f5\" (UID: \"246f42b6-4802-412b-b611-a0d3d360c537\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7978f59f89-vc9f5" Sep 17 07:20:16.371909 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:20:16.371809 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a8fc4c21-3234-45f2-8210-3065895e0eb6-metrics-tls\") pod \"dns-default-6h7kw\" (UID: \"a8fc4c21-3234-45f2-8210-3065895e0eb6\") " pod="openshift-dns/dns-default-6h7kw" Sep 17 07:20:16.371909 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:20:16.371851 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e6c12e07-53e7-4f30-a8bf-c5d1a727d2fb-metrics-certs\") pod \"network-metrics-daemon-mcwtb\" (UID: \"e6c12e07-53e7-4f30-a8bf-c5d1a727d2fb\") " pod="openshift-multus/network-metrics-daemon-mcwtb" Sep 17 07:20:16.372045 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:20:16.371918 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/a8fc4c21-3234-45f2-8210-3065895e0eb6-config-volume\") pod \"dns-default-6h7kw\" (UID: \"a8fc4c21-3234-45f2-8210-3065895e0eb6\") " pod="openshift-dns/dns-default-6h7kw" Sep 17 07:20:16.372045 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:20:16.372000 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/5d07cc07-43a4-401e-831f-e77bd2d21b82-registry-tls\") pod \"image-registry-5d69dcb864-hck5p\" (UID: \"5d07cc07-43a4-401e-831f-e77bd2d21b82\") " pod="openshift-image-registry/image-registry-5d69dcb864-hck5p" Sep 17 07:20:16.372045 ip-10-0-132-17 kubenswrapper[2561]: E0917 07:20:16.371921 2561 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 17 07:20:16.372045 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:20:16.372027 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tzn42\" (UniqueName: \"kubernetes.io/projected/a8fc4c21-3234-45f2-8210-3065895e0eb6-kube-api-access-tzn42\") pod \"dns-default-6h7kw\" (UID: \"a8fc4c21-3234-45f2-8210-3065895e0eb6\") " pod="openshift-dns/dns-default-6h7kw" Sep 17 07:20:16.372222 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:20:16.372060 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/246f42b6-4802-412b-b611-a0d3d360c537-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-7978f59f89-vc9f5\" (UID: \"246f42b6-4802-412b-b611-a0d3d360c537\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7978f59f89-vc9f5" Sep 17 07:20:16.372222 ip-10-0-132-17 kubenswrapper[2561]: E0917 07:20:16.372079 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e6c12e07-53e7-4f30-a8bf-c5d1a727d2fb-metrics-certs podName:e6c12e07-53e7-4f30-a8bf-c5d1a727d2fb nodeName:}" failed. No retries permitted until 2026-09-17 07:20:48.372065015 +0000 UTC m=+66.178011268 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e6c12e07-53e7-4f30-a8bf-c5d1a727d2fb-metrics-certs") pod "network-metrics-daemon-mcwtb" (UID: "e6c12e07-53e7-4f30-a8bf-c5d1a727d2fb") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 17 07:20:16.372222 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:20:16.372101 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/246f42b6-4802-412b-b611-a0d3d360c537-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-7978f59f89-vc9f5\" (UID: \"246f42b6-4802-412b-b611-a0d3d360c537\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7978f59f89-vc9f5" Sep 17 07:20:16.372222 ip-10-0-132-17 kubenswrapper[2561]: E0917 07:20:16.372105 2561 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Sep 17 07:20:16.372222 ip-10-0-132-17 kubenswrapper[2561]: E0917 07:20:16.372119 2561 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5d69dcb864-hck5p: secret "image-registry-tls" not found Sep 17 07:20:16.372222 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:20:16.372123 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pk5k9\" (UniqueName: \"kubernetes.io/projected/8e4c6dcd-3822-4c52-be03-ada3f5f45c9a-kube-api-access-pk5k9\") pod \"ingress-canary-lbjkz\" (UID: \"8e4c6dcd-3822-4c52-be03-ada3f5f45c9a\") " pod="openshift-ingress-canary/ingress-canary-lbjkz" Sep 17 07:20:16.372222 ip-10-0-132-17 kubenswrapper[2561]: E0917 07:20:16.372167 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5d07cc07-43a4-401e-831f-e77bd2d21b82-registry-tls podName:5d07cc07-43a4-401e-831f-e77bd2d21b82 nodeName:}" failed. No retries permitted until 2026-09-17 07:20:16.872148039 +0000 UTC m=+34.678094300 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/5d07cc07-43a4-401e-831f-e77bd2d21b82-registry-tls") pod "image-registry-5d69dcb864-hck5p" (UID: "5d07cc07-43a4-401e-831f-e77bd2d21b82") : secret "image-registry-tls" not found Sep 17 07:20:16.372539 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:20:16.372222 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/fb4d76d4-1b13-4143-94ef-b7098405fbdd-tmp\") pod \"klusterlet-addon-workmgr-78f65bbf85-k6js8\" (UID: \"fb4d76d4-1b13-4143-94ef-b7098405fbdd\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-78f65bbf85-k6js8" Sep 17 07:20:16.372539 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:20:16.372257 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/5d07cc07-43a4-401e-831f-e77bd2d21b82-registry-certificates\") pod \"image-registry-5d69dcb864-hck5p\" (UID: \"5d07cc07-43a4-401e-831f-e77bd2d21b82\") " pod="openshift-image-registry/image-registry-5d69dcb864-hck5p" Sep 17 07:20:16.372539 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:20:16.372284 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/5d07cc07-43a4-401e-831f-e77bd2d21b82-trusted-ca\") pod \"image-registry-5d69dcb864-hck5p\" (UID: \"5d07cc07-43a4-401e-831f-e77bd2d21b82\") " pod="openshift-image-registry/image-registry-5d69dcb864-hck5p" Sep 17 07:20:16.372539 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:20:16.372308 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c88n4\" (UniqueName: \"kubernetes.io/projected/4d02ff8a-5500-45eb-96c8-c9c0129c4c62-kube-api-access-c88n4\") pod \"managed-serviceaccount-addon-agent-587566598b-6kkq9\" (UID: \"4d02ff8a-5500-45eb-96c8-c9c0129c4c62\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-587566598b-6kkq9" Sep 17 07:20:16.372539 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:20:16.372334 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/fb4d76d4-1b13-4143-94ef-b7098405fbdd-klusterlet-config\") pod \"klusterlet-addon-workmgr-78f65bbf85-k6js8\" (UID: \"fb4d76d4-1b13-4143-94ef-b7098405fbdd\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-78f65bbf85-k6js8" Sep 17 07:20:16.372539 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:20:16.372357 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/5d07cc07-43a4-401e-831f-e77bd2d21b82-ca-trust-extracted\") pod \"image-registry-5d69dcb864-hck5p\" (UID: \"5d07cc07-43a4-401e-831f-e77bd2d21b82\") " pod="openshift-image-registry/image-registry-5d69dcb864-hck5p" Sep 17 07:20:16.372816 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:20:16.372798 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/fb4d76d4-1b13-4143-94ef-b7098405fbdd-tmp\") pod \"klusterlet-addon-workmgr-78f65bbf85-k6js8\" (UID: \"fb4d76d4-1b13-4143-94ef-b7098405fbdd\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-78f65bbf85-k6js8" Sep 17 07:20:16.372866 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:20:16.372844 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/246f42b6-4802-412b-b611-a0d3d360c537-ca\") pod \"cluster-proxy-proxy-agent-7978f59f89-vc9f5\" (UID: \"246f42b6-4802-412b-b611-a0d3d360c537\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7978f59f89-vc9f5" Sep 17 07:20:16.372911 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:20:16.372872 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a8fc4c21-3234-45f2-8210-3065895e0eb6-tmp-dir\") pod \"dns-default-6h7kw\" (UID: \"a8fc4c21-3234-45f2-8210-3065895e0eb6\") " pod="openshift-dns/dns-default-6h7kw" Sep 17 07:20:16.372982 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:20:16.372911 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/8e4c6dcd-3822-4c52-be03-ada3f5f45c9a-cert\") pod \"ingress-canary-lbjkz\" (UID: \"8e4c6dcd-3822-4c52-be03-ada3f5f45c9a\") " pod="openshift-ingress-canary/ingress-canary-lbjkz" Sep 17 07:20:16.372982 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:20:16.372964 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5ps9f\" (UniqueName: \"kubernetes.io/projected/fb4d76d4-1b13-4143-94ef-b7098405fbdd-kube-api-access-5ps9f\") pod \"klusterlet-addon-workmgr-78f65bbf85-k6js8\" (UID: \"fb4d76d4-1b13-4143-94ef-b7098405fbdd\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-78f65bbf85-k6js8" Sep 17 07:20:16.373068 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:20:16.372992 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/246f42b6-4802-412b-b611-a0d3d360c537-hub\") pod \"cluster-proxy-proxy-agent-7978f59f89-vc9f5\" (UID: \"246f42b6-4802-412b-b611-a0d3d360c537\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7978f59f89-vc9f5" Sep 17 07:20:16.373068 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:20:16.373015 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/246f42b6-4802-412b-b611-a0d3d360c537-additional-service-ca\") pod \"cluster-proxy-proxy-agent-7978f59f89-vc9f5\" (UID: \"246f42b6-4802-412b-b611-a0d3d360c537\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7978f59f89-vc9f5" Sep 17 07:20:16.373068 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:20:16.373039 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/5d07cc07-43a4-401e-831f-e77bd2d21b82-bound-sa-token\") pod \"image-registry-5d69dcb864-hck5p\" (UID: \"5d07cc07-43a4-401e-831f-e77bd2d21b82\") " pod="openshift-image-registry/image-registry-5d69dcb864-hck5p" Sep 17 07:20:16.373197 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:20:16.373074 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/5d07cc07-43a4-401e-831f-e77bd2d21b82-installation-pull-secrets\") pod \"image-registry-5d69dcb864-hck5p\" (UID: \"5d07cc07-43a4-401e-831f-e77bd2d21b82\") " pod="openshift-image-registry/image-registry-5d69dcb864-hck5p" Sep 17 07:20:16.373197 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:20:16.373082 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/5d07cc07-43a4-401e-831f-e77bd2d21b82-registry-certificates\") pod \"image-registry-5d69dcb864-hck5p\" (UID: \"5d07cc07-43a4-401e-831f-e77bd2d21b82\") " pod="openshift-image-registry/image-registry-5d69dcb864-hck5p" Sep 17 07:20:16.373197 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:20:16.373097 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/4d02ff8a-5500-45eb-96c8-c9c0129c4c62-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-587566598b-6kkq9\" (UID: \"4d02ff8a-5500-45eb-96c8-c9c0129c4c62\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-587566598b-6kkq9" Sep 17 07:20:16.373335 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:20:16.372844 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/5d07cc07-43a4-401e-831f-e77bd2d21b82-ca-trust-extracted\") pod \"image-registry-5d69dcb864-hck5p\" (UID: \"5d07cc07-43a4-401e-831f-e77bd2d21b82\") " pod="openshift-image-registry/image-registry-5d69dcb864-hck5p" Sep 17 07:20:16.374360 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:20:16.373894 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/246f42b6-4802-412b-b611-a0d3d360c537-additional-service-ca\") pod \"cluster-proxy-proxy-agent-7978f59f89-vc9f5\" (UID: \"246f42b6-4802-412b-b611-a0d3d360c537\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7978f59f89-vc9f5" Sep 17 07:20:16.374570 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:20:16.374420 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/5d07cc07-43a4-401e-831f-e77bd2d21b82-trusted-ca\") pod \"image-registry-5d69dcb864-hck5p\" (UID: \"5d07cc07-43a4-401e-831f-e77bd2d21b82\") " pod="openshift-image-registry/image-registry-5d69dcb864-hck5p" Sep 17 07:20:16.377470 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:20:16.377445 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/5d07cc07-43a4-401e-831f-e77bd2d21b82-image-registry-private-configuration\") pod \"image-registry-5d69dcb864-hck5p\" (UID: \"5d07cc07-43a4-401e-831f-e77bd2d21b82\") " pod="openshift-image-registry/image-registry-5d69dcb864-hck5p" Sep 17 07:20:16.377567 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:20:16.377480 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/fb4d76d4-1b13-4143-94ef-b7098405fbdd-klusterlet-config\") pod \"klusterlet-addon-workmgr-78f65bbf85-k6js8\" (UID: \"fb4d76d4-1b13-4143-94ef-b7098405fbdd\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-78f65bbf85-k6js8" Sep 17 07:20:16.377567 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:20:16.377500 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/4d02ff8a-5500-45eb-96c8-c9c0129c4c62-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-587566598b-6kkq9\" (UID: \"4d02ff8a-5500-45eb-96c8-c9c0129c4c62\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-587566598b-6kkq9" Sep 17 07:20:16.378386 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:20:16.378066 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/246f42b6-4802-412b-b611-a0d3d360c537-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-7978f59f89-vc9f5\" (UID: \"246f42b6-4802-412b-b611-a0d3d360c537\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7978f59f89-vc9f5" Sep 17 07:20:16.378386 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:20:16.378066 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/246f42b6-4802-412b-b611-a0d3d360c537-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-7978f59f89-vc9f5\" (UID: \"246f42b6-4802-412b-b611-a0d3d360c537\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7978f59f89-vc9f5" Sep 17 07:20:16.378386 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:20:16.378131 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/5d07cc07-43a4-401e-831f-e77bd2d21b82-installation-pull-secrets\") pod \"image-registry-5d69dcb864-hck5p\" (UID: \"5d07cc07-43a4-401e-831f-e77bd2d21b82\") " pod="openshift-image-registry/image-registry-5d69dcb864-hck5p" Sep 17 07:20:16.378581 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:20:16.378513 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub\" (UniqueName: \"kubernetes.io/secret/246f42b6-4802-412b-b611-a0d3d360c537-hub\") pod \"cluster-proxy-proxy-agent-7978f59f89-vc9f5\" (UID: \"246f42b6-4802-412b-b611-a0d3d360c537\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7978f59f89-vc9f5" Sep 17 07:20:16.379145 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:20:16.379126 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca\" (UniqueName: \"kubernetes.io/secret/246f42b6-4802-412b-b611-a0d3d360c537-ca\") pod \"cluster-proxy-proxy-agent-7978f59f89-vc9f5\" (UID: \"246f42b6-4802-412b-b611-a0d3d360c537\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7978f59f89-vc9f5" Sep 17 07:20:16.390144 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:20:16.390108 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dxshh\" (UniqueName: \"kubernetes.io/projected/246f42b6-4802-412b-b611-a0d3d360c537-kube-api-access-dxshh\") pod \"cluster-proxy-proxy-agent-7978f59f89-vc9f5\" (UID: \"246f42b6-4802-412b-b611-a0d3d360c537\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7978f59f89-vc9f5" Sep 17 07:20:16.391147 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:20:16.391127 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5ps9f\" (UniqueName: \"kubernetes.io/projected/fb4d76d4-1b13-4143-94ef-b7098405fbdd-kube-api-access-5ps9f\") pod \"klusterlet-addon-workmgr-78f65bbf85-k6js8\" (UID: \"fb4d76d4-1b13-4143-94ef-b7098405fbdd\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-78f65bbf85-k6js8" Sep 17 07:20:16.394115 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:20:16.394094 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-c88n4\" (UniqueName: \"kubernetes.io/projected/4d02ff8a-5500-45eb-96c8-c9c0129c4c62-kube-api-access-c88n4\") pod \"managed-serviceaccount-addon-agent-587566598b-6kkq9\" (UID: \"4d02ff8a-5500-45eb-96c8-c9c0129c4c62\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-587566598b-6kkq9" Sep 17 07:20:16.394193 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:20:16.394177 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xwvmf\" (UniqueName: \"kubernetes.io/projected/5d07cc07-43a4-401e-831f-e77bd2d21b82-kube-api-access-xwvmf\") pod \"image-registry-5d69dcb864-hck5p\" (UID: \"5d07cc07-43a4-401e-831f-e77bd2d21b82\") " pod="openshift-image-registry/image-registry-5d69dcb864-hck5p" Sep 17 07:20:16.396031 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:20:16.396000 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/5d07cc07-43a4-401e-831f-e77bd2d21b82-bound-sa-token\") pod \"image-registry-5d69dcb864-hck5p\" (UID: \"5d07cc07-43a4-401e-831f-e77bd2d21b82\") " pod="openshift-image-registry/image-registry-5d69dcb864-hck5p" Sep 17 07:20:16.447641 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:20:16.447619 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-78f65bbf85-k6js8" Sep 17 07:20:16.475064 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:20:16.474010 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/a8fc4c21-3234-45f2-8210-3065895e0eb6-config-volume\") pod \"dns-default-6h7kw\" (UID: \"a8fc4c21-3234-45f2-8210-3065895e0eb6\") " pod="openshift-dns/dns-default-6h7kw" Sep 17 07:20:16.475064 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:20:16.474079 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tzn42\" (UniqueName: \"kubernetes.io/projected/a8fc4c21-3234-45f2-8210-3065895e0eb6-kube-api-access-tzn42\") pod \"dns-default-6h7kw\" (UID: \"a8fc4c21-3234-45f2-8210-3065895e0eb6\") " pod="openshift-dns/dns-default-6h7kw" Sep 17 07:20:16.475064 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:20:16.474100 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pk5k9\" (UniqueName: \"kubernetes.io/projected/8e4c6dcd-3822-4c52-be03-ada3f5f45c9a-kube-api-access-pk5k9\") pod \"ingress-canary-lbjkz\" (UID: \"8e4c6dcd-3822-4c52-be03-ada3f5f45c9a\") " pod="openshift-ingress-canary/ingress-canary-lbjkz" Sep 17 07:20:16.475064 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:20:16.474161 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a8fc4c21-3234-45f2-8210-3065895e0eb6-tmp-dir\") pod \"dns-default-6h7kw\" (UID: \"a8fc4c21-3234-45f2-8210-3065895e0eb6\") " pod="openshift-dns/dns-default-6h7kw" Sep 17 07:20:16.475064 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:20:16.474182 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f387de20-2724-46ab-9bca-b4b4a23711cf-original-pull-secret\") pod \"global-pull-secret-syncer-rs4vc\" (UID: \"f387de20-2724-46ab-9bca-b4b4a23711cf\") " pod="kube-system/global-pull-secret-syncer-rs4vc" Sep 17 07:20:16.475064 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:20:16.474197 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/8e4c6dcd-3822-4c52-be03-ada3f5f45c9a-cert\") pod \"ingress-canary-lbjkz\" (UID: \"8e4c6dcd-3822-4c52-be03-ada3f5f45c9a\") " pod="openshift-ingress-canary/ingress-canary-lbjkz" Sep 17 07:20:16.475064 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:20:16.474250 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jww4t\" (UniqueName: \"kubernetes.io/projected/ea653065-69b3-4da2-b8d0-9518964204d9-kube-api-access-jww4t\") pod \"network-check-target-qzfhn\" (UID: \"ea653065-69b3-4da2-b8d0-9518964204d9\") " pod="openshift-network-diagnostics/network-check-target-qzfhn" Sep 17 07:20:16.475064 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:20:16.474267 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a8fc4c21-3234-45f2-8210-3065895e0eb6-metrics-tls\") pod \"dns-default-6h7kw\" (UID: \"a8fc4c21-3234-45f2-8210-3065895e0eb6\") " pod="openshift-dns/dns-default-6h7kw" Sep 17 07:20:16.475064 ip-10-0-132-17 kubenswrapper[2561]: E0917 07:20:16.474396 2561 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 17 07:20:16.475064 ip-10-0-132-17 kubenswrapper[2561]: E0917 07:20:16.474487 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a8fc4c21-3234-45f2-8210-3065895e0eb6-metrics-tls podName:a8fc4c21-3234-45f2-8210-3065895e0eb6 nodeName:}" failed. No retries permitted until 2026-09-17 07:20:16.974453721 +0000 UTC m=+34.780399977 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/a8fc4c21-3234-45f2-8210-3065895e0eb6-metrics-tls") pod "dns-default-6h7kw" (UID: "a8fc4c21-3234-45f2-8210-3065895e0eb6") : secret "dns-default-metrics-tls" not found Sep 17 07:20:16.475064 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:20:16.474607 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/a8fc4c21-3234-45f2-8210-3065895e0eb6-config-volume\") pod \"dns-default-6h7kw\" (UID: \"a8fc4c21-3234-45f2-8210-3065895e0eb6\") " pod="openshift-dns/dns-default-6h7kw" Sep 17 07:20:16.475064 ip-10-0-132-17 kubenswrapper[2561]: E0917 07:20:16.474697 2561 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 17 07:20:16.475064 ip-10-0-132-17 kubenswrapper[2561]: E0917 07:20:16.474743 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f387de20-2724-46ab-9bca-b4b4a23711cf-original-pull-secret podName:f387de20-2724-46ab-9bca-b4b4a23711cf nodeName:}" failed. No retries permitted until 2026-09-17 07:20:48.474724733 +0000 UTC m=+66.280670985 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/f387de20-2724-46ab-9bca-b4b4a23711cf-original-pull-secret") pod "global-pull-secret-syncer-rs4vc" (UID: "f387de20-2724-46ab-9bca-b4b4a23711cf") : object "kube-system"/"original-pull-secret" not registered Sep 17 07:20:16.476404 ip-10-0-132-17 kubenswrapper[2561]: E0917 07:20:16.475220 2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 17 07:20:16.476404 ip-10-0-132-17 kubenswrapper[2561]: E0917 07:20:16.475236 2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 17 07:20:16.476404 ip-10-0-132-17 kubenswrapper[2561]: E0917 07:20:16.475247 2561 projected.go:196] Error preparing data for projected volume kube-api-access-jww4t for pod openshift-network-diagnostics/network-check-target-qzfhn: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 17 07:20:16.476404 ip-10-0-132-17 kubenswrapper[2561]: E0917 07:20:16.475285 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ea653065-69b3-4da2-b8d0-9518964204d9-kube-api-access-jww4t podName:ea653065-69b3-4da2-b8d0-9518964204d9 nodeName:}" failed. No retries permitted until 2026-09-17 07:20:48.475274935 +0000 UTC m=+66.281221188 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-jww4t" (UniqueName: "kubernetes.io/projected/ea653065-69b3-4da2-b8d0-9518964204d9-kube-api-access-jww4t") pod "network-check-target-qzfhn" (UID: "ea653065-69b3-4da2-b8d0-9518964204d9") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 17 07:20:16.476404 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:20:16.475456 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a8fc4c21-3234-45f2-8210-3065895e0eb6-tmp-dir\") pod \"dns-default-6h7kw\" (UID: \"a8fc4c21-3234-45f2-8210-3065895e0eb6\") " pod="openshift-dns/dns-default-6h7kw" Sep 17 07:20:16.476404 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:20:16.476126 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9skpb_96c5b8e5-2fc0-489b-8889-52bf66184838/konnectivity-agent/0.log" limit=1024 Sep 17 07:20:16.479198 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:20:16.479021 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-587566598b-6kkq9" Sep 17 07:20:16.479912 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:20:16.479894 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/8e4c6dcd-3822-4c52-be03-ada3f5f45c9a-cert\") pod \"ingress-canary-lbjkz\" (UID: \"8e4c6dcd-3822-4c52-be03-ada3f5f45c9a\") " pod="openshift-ingress-canary/ingress-canary-lbjkz" Sep 17 07:20:16.487516 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:20:16.487498 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pk5k9\" (UniqueName: \"kubernetes.io/projected/8e4c6dcd-3822-4c52-be03-ada3f5f45c9a-kube-api-access-pk5k9\") pod \"ingress-canary-lbjkz\" (UID: \"8e4c6dcd-3822-4c52-be03-ada3f5f45c9a\") " pod="openshift-ingress-canary/ingress-canary-lbjkz" Sep 17 07:20:16.488136 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:20:16.488104 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tzn42\" (UniqueName: \"kubernetes.io/projected/a8fc4c21-3234-45f2-8210-3065895e0eb6-kube-api-access-tzn42\") pod \"dns-default-6h7kw\" (UID: \"a8fc4c21-3234-45f2-8210-3065895e0eb6\") " pod="openshift-dns/dns-default-6h7kw" Sep 17 07:20:16.492152 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:20:16.492128 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7978f59f89-vc9f5" Sep 17 07:20:16.559221 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:20:16.559015 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-lbjkz" Sep 17 07:20:16.741321 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:20:16.741286 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-78f65bbf85-k6js8"] Sep 17 07:20:16.745429 ip-10-0-132-17 kubenswrapper[2561]: W0917 07:20:16.745400 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfb4d76d4_1b13_4143_94ef_b7098405fbdd.slice/crio-5526f09854c9427ee5c14d2848fa15986687711df2b4e3d1c7fad3a79df42f31 WatchSource:0}: Error finding container 5526f09854c9427ee5c14d2848fa15986687711df2b4e3d1c7fad3a79df42f31: Status 404 returned error can't find the container with id 5526f09854c9427ee5c14d2848fa15986687711df2b4e3d1c7fad3a79df42f31 Sep 17 07:20:16.769231 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:20:16.769200 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-587566598b-6kkq9"] Sep 17 07:20:16.772722 ip-10-0-132-17 kubenswrapper[2561]: W0917 07:20:16.772657 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod4d02ff8a_5500_45eb_96c8_c9c0129c4c62.slice/crio-3b2e2495f5e64159c6cf3be9d0eee38a13b84a600fcd2fad98e6db5656e2303c WatchSource:0}: Error finding container 3b2e2495f5e64159c6cf3be9d0eee38a13b84a600fcd2fad98e6db5656e2303c: Status 404 returned error can't find the container with id 3b2e2495f5e64159c6cf3be9d0eee38a13b84a600fcd2fad98e6db5656e2303c Sep 17 07:20:16.797319 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:20:16.797295 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7978f59f89-vc9f5"] Sep 17 07:20:16.800061 ip-10-0-132-17 kubenswrapper[2561]: W0917 07:20:16.800032 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod246f42b6_4802_412b_b611_a0d3d360c537.slice/crio-4d8658668f3680014fcff3b5357cb61c6551453ea646203054e44b1d37c339f5 WatchSource:0}: Error finding container 4d8658668f3680014fcff3b5357cb61c6551453ea646203054e44b1d37c339f5: Status 404 returned error can't find the container with id 4d8658668f3680014fcff3b5357cb61c6551453ea646203054e44b1d37c339f5 Sep 17 07:20:16.851665 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:20:16.851640 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-lbjkz"] Sep 17 07:20:16.854904 ip-10-0-132-17 kubenswrapper[2561]: W0917 07:20:16.854872 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8e4c6dcd_3822_4c52_be03_ada3f5f45c9a.slice/crio-57b727270687fbedb5a2e436bddd2d40b7f8bb62907544888646f067f7a70896 WatchSource:0}: Error finding container 57b727270687fbedb5a2e436bddd2d40b7f8bb62907544888646f067f7a70896: Status 404 returned error can't find the container with id 57b727270687fbedb5a2e436bddd2d40b7f8bb62907544888646f067f7a70896 Sep 17 07:20:16.858134 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:20:16.858106 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7978f59f89-vc9f5" event={"ID":"246f42b6-4802-412b-b611-a0d3d360c537","Type":"ContainerStarted","Data":"4d8658668f3680014fcff3b5357cb61c6551453ea646203054e44b1d37c339f5"} Sep 17 07:20:16.859315 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:20:16.859292 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-587566598b-6kkq9" event={"ID":"4d02ff8a-5500-45eb-96c8-c9c0129c4c62","Type":"ContainerStarted","Data":"3b2e2495f5e64159c6cf3be9d0eee38a13b84a600fcd2fad98e6db5656e2303c"} Sep 17 07:20:16.860511 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:20:16.860483 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-78f65bbf85-k6js8" event={"ID":"fb4d76d4-1b13-4143-94ef-b7098405fbdd","Type":"ContainerStarted","Data":"5526f09854c9427ee5c14d2848fa15986687711df2b4e3d1c7fad3a79df42f31"} Sep 17 07:20:16.878357 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:20:16.878307 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/5d07cc07-43a4-401e-831f-e77bd2d21b82-registry-tls\") pod \"image-registry-5d69dcb864-hck5p\" (UID: \"5d07cc07-43a4-401e-831f-e77bd2d21b82\") " pod="openshift-image-registry/image-registry-5d69dcb864-hck5p" Sep 17 07:20:16.878446 ip-10-0-132-17 kubenswrapper[2561]: E0917 07:20:16.878415 2561 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Sep 17 07:20:16.878446 ip-10-0-132-17 kubenswrapper[2561]: E0917 07:20:16.878427 2561 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5d69dcb864-hck5p: secret "image-registry-tls" not found Sep 17 07:20:16.878521 ip-10-0-132-17 kubenswrapper[2561]: E0917 07:20:16.878481 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5d07cc07-43a4-401e-831f-e77bd2d21b82-registry-tls podName:5d07cc07-43a4-401e-831f-e77bd2d21b82 nodeName:}" failed. No retries permitted until 2026-09-17 07:20:17.878462667 +0000 UTC m=+35.684408945 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/5d07cc07-43a4-401e-831f-e77bd2d21b82-registry-tls") pod "image-registry-5d69dcb864-hck5p" (UID: "5d07cc07-43a4-401e-831f-e77bd2d21b82") : secret "image-registry-tls" not found Sep 17 07:20:16.909111 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:20:16.909079 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9skpb_96c5b8e5-2fc0-489b-8889-52bf66184838/konnectivity-agent/0.log" limit=1024 Sep 17 07:20:16.979143 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:20:16.979101 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a8fc4c21-3234-45f2-8210-3065895e0eb6-metrics-tls\") pod \"dns-default-6h7kw\" (UID: \"a8fc4c21-3234-45f2-8210-3065895e0eb6\") " pod="openshift-dns/dns-default-6h7kw" Sep 17 07:20:16.979301 ip-10-0-132-17 kubenswrapper[2561]: E0917 07:20:16.979239 2561 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 17 07:20:16.979301 ip-10-0-132-17 kubenswrapper[2561]: E0917 07:20:16.979300 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a8fc4c21-3234-45f2-8210-3065895e0eb6-metrics-tls podName:a8fc4c21-3234-45f2-8210-3065895e0eb6 nodeName:}" failed. No retries permitted until 2026-09-17 07:20:17.979282498 +0000 UTC m=+35.785228754 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/a8fc4c21-3234-45f2-8210-3065895e0eb6-metrics-tls") pod "dns-default-6h7kw" (UID: "a8fc4c21-3234-45f2-8210-3065895e0eb6") : secret "dns-default-metrics-tls" not found Sep 17 07:20:17.048706 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:20:17.048661 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9skpb_96c5b8e5-2fc0-489b-8889-52bf66184838/konnectivity-agent/0.log" limit=1024 Sep 17 07:20:17.353279 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:20:17.353189 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9skpb_96c5b8e5-2fc0-489b-8889-52bf66184838/konnectivity-agent/0.log" limit=1024 Sep 17 07:20:17.438747 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:20:17.438711 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9skpb_96c5b8e5-2fc0-489b-8889-52bf66184838/konnectivity-agent/0.log" limit=1024 Sep 17 07:20:17.679609 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:20:17.679579 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rs4vc" Sep 17 07:20:17.679783 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:20:17.679578 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qzfhn" Sep 17 07:20:17.679868 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:20:17.679579 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mcwtb" Sep 17 07:20:17.683347 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:20:17.683325 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Sep 17 07:20:17.683584 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:20:17.683570 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Sep 17 07:20:17.683779 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:20:17.683761 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Sep 17 07:20:17.684087 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:20:17.684068 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Sep 17 07:20:17.684320 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:20:17.684303 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-krbdq\"" Sep 17 07:20:17.684320 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:20:17.684310 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-lkdnc\"" Sep 17 07:20:17.865393 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:20:17.865347 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-lbjkz" event={"ID":"8e4c6dcd-3822-4c52-be03-ada3f5f45c9a","Type":"ContainerStarted","Data":"57b727270687fbedb5a2e436bddd2d40b7f8bb62907544888646f067f7a70896"} Sep 17 07:20:17.888724 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:20:17.888694 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/5d07cc07-43a4-401e-831f-e77bd2d21b82-registry-tls\") pod \"image-registry-5d69dcb864-hck5p\" (UID: \"5d07cc07-43a4-401e-831f-e77bd2d21b82\") " pod="openshift-image-registry/image-registry-5d69dcb864-hck5p" Sep 17 07:20:17.888895 ip-10-0-132-17 kubenswrapper[2561]: E0917 07:20:17.888825 2561 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Sep 17 07:20:17.888895 ip-10-0-132-17 kubenswrapper[2561]: E0917 07:20:17.888845 2561 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5d69dcb864-hck5p: secret "image-registry-tls" not found Sep 17 07:20:17.889035 ip-10-0-132-17 kubenswrapper[2561]: E0917 07:20:17.888910 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5d07cc07-43a4-401e-831f-e77bd2d21b82-registry-tls podName:5d07cc07-43a4-401e-831f-e77bd2d21b82 nodeName:}" failed. No retries permitted until 2026-09-17 07:20:19.888890368 +0000 UTC m=+37.694836641 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/5d07cc07-43a4-401e-831f-e77bd2d21b82-registry-tls") pod "image-registry-5d69dcb864-hck5p" (UID: "5d07cc07-43a4-401e-831f-e77bd2d21b82") : secret "image-registry-tls" not found Sep 17 07:20:17.989533 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:20:17.989454 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a8fc4c21-3234-45f2-8210-3065895e0eb6-metrics-tls\") pod \"dns-default-6h7kw\" (UID: \"a8fc4c21-3234-45f2-8210-3065895e0eb6\") " pod="openshift-dns/dns-default-6h7kw" Sep 17 07:20:17.989702 ip-10-0-132-17 kubenswrapper[2561]: E0917 07:20:17.989624 2561 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 17 07:20:17.989762 ip-10-0-132-17 kubenswrapper[2561]: E0917 07:20:17.989706 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a8fc4c21-3234-45f2-8210-3065895e0eb6-metrics-tls podName:a8fc4c21-3234-45f2-8210-3065895e0eb6 nodeName:}" failed. No retries permitted until 2026-09-17 07:20:19.989687495 +0000 UTC m=+37.795633767 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/a8fc4c21-3234-45f2-8210-3065895e0eb6-metrics-tls") pod "dns-default-6h7kw" (UID: "a8fc4c21-3234-45f2-8210-3065895e0eb6") : secret "dns-default-metrics-tls" not found Sep 17 07:20:19.886664 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:20:19.885593 2561 generic.go:356] "Generic (PLEG): container finished" podID="dc177633-60cf-4933-90f5-26d2619f7c82" containerID="7d54a00da211903617f4e8b12f783796aa3bbf40e4569354c4897e7b54c294fd" exitCode=0 Sep 17 07:20:19.886664 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:20:19.886575 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-4hbmd" event={"ID":"dc177633-60cf-4933-90f5-26d2619f7c82","Type":"ContainerDied","Data":"7d54a00da211903617f4e8b12f783796aa3bbf40e4569354c4897e7b54c294fd"} Sep 17 07:20:19.906031 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:20:19.906004 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/5d07cc07-43a4-401e-831f-e77bd2d21b82-registry-tls\") pod \"image-registry-5d69dcb864-hck5p\" (UID: \"5d07cc07-43a4-401e-831f-e77bd2d21b82\") " pod="openshift-image-registry/image-registry-5d69dcb864-hck5p" Sep 17 07:20:19.906166 ip-10-0-132-17 kubenswrapper[2561]: E0917 07:20:19.906150 2561 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Sep 17 07:20:19.906228 ip-10-0-132-17 kubenswrapper[2561]: E0917 07:20:19.906171 2561 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5d69dcb864-hck5p: secret "image-registry-tls" not found Sep 17 07:20:19.906228 ip-10-0-132-17 kubenswrapper[2561]: E0917 07:20:19.906225 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5d07cc07-43a4-401e-831f-e77bd2d21b82-registry-tls podName:5d07cc07-43a4-401e-831f-e77bd2d21b82 nodeName:}" failed. No retries permitted until 2026-09-17 07:20:23.90620553 +0000 UTC m=+41.712151796 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/5d07cc07-43a4-401e-831f-e77bd2d21b82-registry-tls") pod "image-registry-5d69dcb864-hck5p" (UID: "5d07cc07-43a4-401e-831f-e77bd2d21b82") : secret "image-registry-tls" not found Sep 17 07:20:20.006745 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:20:20.006712 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a8fc4c21-3234-45f2-8210-3065895e0eb6-metrics-tls\") pod \"dns-default-6h7kw\" (UID: \"a8fc4c21-3234-45f2-8210-3065895e0eb6\") " pod="openshift-dns/dns-default-6h7kw" Sep 17 07:20:20.006919 ip-10-0-132-17 kubenswrapper[2561]: E0917 07:20:20.006902 2561 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 17 07:20:20.007049 ip-10-0-132-17 kubenswrapper[2561]: E0917 07:20:20.006997 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a8fc4c21-3234-45f2-8210-3065895e0eb6-metrics-tls podName:a8fc4c21-3234-45f2-8210-3065895e0eb6 nodeName:}" failed. No retries permitted until 2026-09-17 07:20:24.006968792 +0000 UTC m=+41.812915247 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/a8fc4c21-3234-45f2-8210-3065895e0eb6-metrics-tls") pod "dns-default-6h7kw" (UID: "a8fc4c21-3234-45f2-8210-3065895e0eb6") : secret "dns-default-metrics-tls" not found Sep 17 07:20:20.897133 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:20:20.897094 2561 generic.go:356] "Generic (PLEG): container finished" podID="dc177633-60cf-4933-90f5-26d2619f7c82" containerID="947548cf902b2d79a280cc45412302a4fe41babd6b9e178986ae78245c781ff4" exitCode=0 Sep 17 07:20:20.897568 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:20:20.897166 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-4hbmd" event={"ID":"dc177633-60cf-4933-90f5-26d2619f7c82","Type":"ContainerDied","Data":"947548cf902b2d79a280cc45412302a4fe41babd6b9e178986ae78245c781ff4"} Sep 17 07:20:21.233670 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:20:21.233617 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9skpb_96c5b8e5-2fc0-489b-8889-52bf66184838/konnectivity-agent/0.log" limit=1024 Sep 17 07:20:21.300301 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:20:21.300266 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9skpb_96c5b8e5-2fc0-489b-8889-52bf66184838/konnectivity-agent/0.log" limit=1024 Sep 17 07:20:23.943164 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:20:23.943128 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/5d07cc07-43a4-401e-831f-e77bd2d21b82-registry-tls\") pod \"image-registry-5d69dcb864-hck5p\" (UID: \"5d07cc07-43a4-401e-831f-e77bd2d21b82\") " pod="openshift-image-registry/image-registry-5d69dcb864-hck5p" Sep 17 07:20:23.943541 ip-10-0-132-17 kubenswrapper[2561]: E0917 07:20:23.943292 2561 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Sep 17 07:20:23.943541 ip-10-0-132-17 kubenswrapper[2561]: E0917 07:20:23.943310 2561 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5d69dcb864-hck5p: secret "image-registry-tls" not found Sep 17 07:20:23.943541 ip-10-0-132-17 kubenswrapper[2561]: E0917 07:20:23.943374 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5d07cc07-43a4-401e-831f-e77bd2d21b82-registry-tls podName:5d07cc07-43a4-401e-831f-e77bd2d21b82 nodeName:}" failed. No retries permitted until 2026-09-17 07:20:31.943353344 +0000 UTC m=+49.749299620 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/5d07cc07-43a4-401e-831f-e77bd2d21b82-registry-tls") pod "image-registry-5d69dcb864-hck5p" (UID: "5d07cc07-43a4-401e-831f-e77bd2d21b82") : secret "image-registry-tls" not found Sep 17 07:20:24.043857 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:20:24.043816 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a8fc4c21-3234-45f2-8210-3065895e0eb6-metrics-tls\") pod \"dns-default-6h7kw\" (UID: \"a8fc4c21-3234-45f2-8210-3065895e0eb6\") " pod="openshift-dns/dns-default-6h7kw" Sep 17 07:20:24.044054 ip-10-0-132-17 kubenswrapper[2561]: E0917 07:20:24.044010 2561 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 17 07:20:24.044219 ip-10-0-132-17 kubenswrapper[2561]: E0917 07:20:24.044087 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a8fc4c21-3234-45f2-8210-3065895e0eb6-metrics-tls podName:a8fc4c21-3234-45f2-8210-3065895e0eb6 nodeName:}" failed. No retries permitted until 2026-09-17 07:20:32.044070294 +0000 UTC m=+49.850016546 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/a8fc4c21-3234-45f2-8210-3065895e0eb6-metrics-tls") pod "dns-default-6h7kw" (UID: "a8fc4c21-3234-45f2-8210-3065895e0eb6") : secret "dns-default-metrics-tls" not found Sep 17 07:20:27.919300 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:20:27.919260 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-4hbmd" event={"ID":"dc177633-60cf-4933-90f5-26d2619f7c82","Type":"ContainerStarted","Data":"b8fc9891b679a81512932db798c9716562d14e48b4656a9457d03b43e588dd7d"} Sep 17 07:20:27.921423 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:20:27.921395 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7978f59f89-vc9f5" event={"ID":"246f42b6-4802-412b-b611-a0d3d360c537","Type":"ContainerStarted","Data":"5e07c5e187639db5871583f516345d1d7a81a9a4a6a135ab54d4c4b6da02e97c"} Sep 17 07:20:27.921533 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:20:27.921438 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7978f59f89-vc9f5" event={"ID":"246f42b6-4802-412b-b611-a0d3d360c537","Type":"ContainerStarted","Data":"16411617b9fd99e1fa5aab05752bd0641ed218aed452f491fae2e7c9fc6a85c6"} Sep 17 07:20:27.921533 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:20:27.921456 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7978f59f89-vc9f5" event={"ID":"246f42b6-4802-412b-b611-a0d3d360c537","Type":"ContainerStarted","Data":"669cc36287da53c67f318b565541acc7f316adbef94f831e399b3f09cb2a46bc"} Sep 17 07:20:27.922982 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:20:27.922870 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-587566598b-6kkq9" event={"ID":"4d02ff8a-5500-45eb-96c8-c9c0129c4c62","Type":"ContainerStarted","Data":"592ef962952425dd1df0335a93c2cbb62fb855b0faab5baea9ae1d7931179c0f"} Sep 17 07:20:27.924371 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:20:27.924340 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-lbjkz" event={"ID":"8e4c6dcd-3822-4c52-be03-ada3f5f45c9a","Type":"ContainerStarted","Data":"580dc0e2b9d541af3796b9a295fc0996162d267afb8579c8bf4972a7ed442134"} Sep 17 07:20:27.925771 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:20:27.925747 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-78f65bbf85-k6js8" event={"ID":"fb4d76d4-1b13-4143-94ef-b7098405fbdd","Type":"ContainerStarted","Data":"b8d25727304481122e7050714fd56555063fe4a87bd5867786372c29376d5339"} Sep 17 07:20:27.925957 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:20:27.925924 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-78f65bbf85-k6js8" Sep 17 07:20:27.927546 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:20:27.927527 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-78f65bbf85-k6js8" Sep 17 07:20:27.946079 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:20:27.946036 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-4hbmd" podStartSLOduration=14.821453583 podStartE2EDuration="45.946022108s" totalImagesPullingTime="31.124568525s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-17 07:19:42 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 07:20:27.944106248 +0000 UTC m=+45.750052525" watchObservedRunningTime="2026-09-17 07:20:27.946022108 +0000 UTC m=+45.751968383" Sep 17 07:20:27.961543 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:20:27.961478 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-lbjkz" podStartSLOduration=1.800984766 podStartE2EDuration="11.961464057s" totalImagesPullingTime="10.160479291s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 07:20:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 07:20:27.960790057 +0000 UTC m=+45.766736332" watchObservedRunningTime="2026-09-17 07:20:27.961464057 +0000 UTC m=+45.767410369" Sep 17 07:20:27.997577 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:20:27.997533 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-78f65bbf85-k6js8" podStartSLOduration=20.263452779 podStartE2EDuration="30.997517655s" totalImagesPullingTime="10.734064876s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 07:19:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 07:20:27.978290153 +0000 UTC m=+45.784236428" watchObservedRunningTime="2026-09-17 07:20:27.997517655 +0000 UTC m=+45.803463921" Sep 17 07:20:28.032338 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:20:28.032291 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7978f59f89-vc9f5" podStartSLOduration=20.823320234 podStartE2EDuration="31.032274429s" totalImagesPullingTime="10.208954195s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 07:19:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 07:20:28.031975943 +0000 UTC m=+45.837922218" watchObservedRunningTime="2026-09-17 07:20:28.032274429 +0000 UTC m=+45.838220705" Sep 17 07:20:28.032589 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:20:28.032568 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-587566598b-6kkq9" podStartSLOduration=20.796843425 podStartE2EDuration="31.032562129s" totalImagesPullingTime="10.235718704s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 07:19:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 07:20:27.99886743 +0000 UTC m=+45.804813702" watchObservedRunningTime="2026-09-17 07:20:28.032562129 +0000 UTC m=+45.838508444" Sep 17 07:20:28.078631 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:20:28.078600 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9skpb_96c5b8e5-2fc0-489b-8889-52bf66184838/konnectivity-agent/0.log" limit=1024 Sep 17 07:20:28.169997 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:20:28.169899 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9skpb_96c5b8e5-2fc0-489b-8889-52bf66184838/konnectivity-agent/0.log" limit=1024 Sep 17 07:20:28.994355 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:20:28.994321 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9skpb_96c5b8e5-2fc0-489b-8889-52bf66184838/konnectivity-agent/0.log" limit=1024 Sep 17 07:20:29.073637 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:20:29.073605 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9skpb_96c5b8e5-2fc0-489b-8889-52bf66184838/konnectivity-agent/0.log" limit=1024 Sep 17 07:20:31.794574 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:20:31.794532 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9skpb_96c5b8e5-2fc0-489b-8889-52bf66184838/konnectivity-agent/0.log" limit=1024 Sep 17 07:20:31.883344 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:20:31.883311 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9skpb_96c5b8e5-2fc0-489b-8889-52bf66184838/konnectivity-agent/0.log" limit=1024 Sep 17 07:20:31.984129 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:20:31.984092 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9skpb_96c5b8e5-2fc0-489b-8889-52bf66184838/konnectivity-agent/0.log" limit=1024 Sep 17 07:20:32.010697 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:20:32.010662 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/5d07cc07-43a4-401e-831f-e77bd2d21b82-registry-tls\") pod \"image-registry-5d69dcb864-hck5p\" (UID: \"5d07cc07-43a4-401e-831f-e77bd2d21b82\") " pod="openshift-image-registry/image-registry-5d69dcb864-hck5p" Sep 17 07:20:32.010850 ip-10-0-132-17 kubenswrapper[2561]: E0917 07:20:32.010807 2561 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Sep 17 07:20:32.010850 ip-10-0-132-17 kubenswrapper[2561]: E0917 07:20:32.010822 2561 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5d69dcb864-hck5p: secret "image-registry-tls" not found Sep 17 07:20:32.010925 ip-10-0-132-17 kubenswrapper[2561]: E0917 07:20:32.010883 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5d07cc07-43a4-401e-831f-e77bd2d21b82-registry-tls podName:5d07cc07-43a4-401e-831f-e77bd2d21b82 nodeName:}" failed. No retries permitted until 2026-09-17 07:20:48.01086705 +0000 UTC m=+65.816813304 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/5d07cc07-43a4-401e-831f-e77bd2d21b82-registry-tls") pod "image-registry-5d69dcb864-hck5p" (UID: "5d07cc07-43a4-401e-831f-e77bd2d21b82") : secret "image-registry-tls" not found Sep 17 07:20:32.087364 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:20:32.086047 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9skpb_96c5b8e5-2fc0-489b-8889-52bf66184838/konnectivity-agent/0.log" limit=1024 Sep 17 07:20:32.110973 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:20:32.110948 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a8fc4c21-3234-45f2-8210-3065895e0eb6-metrics-tls\") pod \"dns-default-6h7kw\" (UID: \"a8fc4c21-3234-45f2-8210-3065895e0eb6\") " pod="openshift-dns/dns-default-6h7kw" Sep 17 07:20:32.111111 ip-10-0-132-17 kubenswrapper[2561]: E0917 07:20:32.111094 2561 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 17 07:20:32.111160 ip-10-0-132-17 kubenswrapper[2561]: E0917 07:20:32.111151 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a8fc4c21-3234-45f2-8210-3065895e0eb6-metrics-tls podName:a8fc4c21-3234-45f2-8210-3065895e0eb6 nodeName:}" failed. No retries permitted until 2026-09-17 07:20:48.111137379 +0000 UTC m=+65.917083631 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/a8fc4c21-3234-45f2-8210-3065895e0eb6-metrics-tls") pod "dns-default-6h7kw" (UID: "a8fc4c21-3234-45f2-8210-3065895e0eb6") : secret "dns-default-metrics-tls" not found Sep 17 07:20:32.186739 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:20:32.186699 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9skpb_96c5b8e5-2fc0-489b-8889-52bf66184838/konnectivity-agent/0.log" limit=1024 Sep 17 07:20:32.271220 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:20:32.271187 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9skpb_96c5b8e5-2fc0-489b-8889-52bf66184838/konnectivity-agent/0.log" limit=1024 Sep 17 07:20:33.114918 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:20:33.114879 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9skpb_96c5b8e5-2fc0-489b-8889-52bf66184838/konnectivity-agent/0.log" limit=1024 Sep 17 07:20:33.216562 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:20:33.216524 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9skpb_96c5b8e5-2fc0-489b-8889-52bf66184838/konnectivity-agent/0.log" limit=1024 Sep 17 07:20:41.849434 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:20:41.849400 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-2frz9" Sep 17 07:20:42.027131 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:20:42.027092 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9skpb_96c5b8e5-2fc0-489b-8889-52bf66184838/konnectivity-agent/0.log" limit=1024 Sep 17 07:20:42.136712 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:20:42.136678 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9skpb_96c5b8e5-2fc0-489b-8889-52bf66184838/konnectivity-agent/0.log" limit=1024 Sep 17 07:20:48.022483 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:20:48.022444 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/5d07cc07-43a4-401e-831f-e77bd2d21b82-registry-tls\") pod \"image-registry-5d69dcb864-hck5p\" (UID: \"5d07cc07-43a4-401e-831f-e77bd2d21b82\") " pod="openshift-image-registry/image-registry-5d69dcb864-hck5p" Sep 17 07:20:48.022896 ip-10-0-132-17 kubenswrapper[2561]: E0917 07:20:48.022558 2561 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Sep 17 07:20:48.022896 ip-10-0-132-17 kubenswrapper[2561]: E0917 07:20:48.022568 2561 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5d69dcb864-hck5p: secret "image-registry-tls" not found Sep 17 07:20:48.022896 ip-10-0-132-17 kubenswrapper[2561]: E0917 07:20:48.022617 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5d07cc07-43a4-401e-831f-e77bd2d21b82-registry-tls podName:5d07cc07-43a4-401e-831f-e77bd2d21b82 nodeName:}" failed. No retries permitted until 2026-09-17 07:21:20.022602989 +0000 UTC m=+97.828549243 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/5d07cc07-43a4-401e-831f-e77bd2d21b82-registry-tls") pod "image-registry-5d69dcb864-hck5p" (UID: "5d07cc07-43a4-401e-831f-e77bd2d21b82") : secret "image-registry-tls" not found Sep 17 07:20:48.123362 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:20:48.123324 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a8fc4c21-3234-45f2-8210-3065895e0eb6-metrics-tls\") pod \"dns-default-6h7kw\" (UID: \"a8fc4c21-3234-45f2-8210-3065895e0eb6\") " pod="openshift-dns/dns-default-6h7kw" Sep 17 07:20:48.123535 ip-10-0-132-17 kubenswrapper[2561]: E0917 07:20:48.123512 2561 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 17 07:20:48.123621 ip-10-0-132-17 kubenswrapper[2561]: E0917 07:20:48.123609 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a8fc4c21-3234-45f2-8210-3065895e0eb6-metrics-tls podName:a8fc4c21-3234-45f2-8210-3065895e0eb6 nodeName:}" failed. No retries permitted until 2026-09-17 07:21:20.123586414 +0000 UTC m=+97.929532685 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/a8fc4c21-3234-45f2-8210-3065895e0eb6-metrics-tls") pod "dns-default-6h7kw" (UID: "a8fc4c21-3234-45f2-8210-3065895e0eb6") : secret "dns-default-metrics-tls" not found Sep 17 07:20:48.425141 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:20:48.425101 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e6c12e07-53e7-4f30-a8bf-c5d1a727d2fb-metrics-certs\") pod \"network-metrics-daemon-mcwtb\" (UID: \"e6c12e07-53e7-4f30-a8bf-c5d1a727d2fb\") " pod="openshift-multus/network-metrics-daemon-mcwtb" Sep 17 07:20:48.440493 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:20:48.440462 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Sep 17 07:20:48.445501 ip-10-0-132-17 kubenswrapper[2561]: E0917 07:20:48.445483 2561 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Sep 17 07:20:48.445601 ip-10-0-132-17 kubenswrapper[2561]: E0917 07:20:48.445552 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e6c12e07-53e7-4f30-a8bf-c5d1a727d2fb-metrics-certs podName:e6c12e07-53e7-4f30-a8bf-c5d1a727d2fb nodeName:}" failed. No retries permitted until 2026-09-17 07:21:52.44553239 +0000 UTC m=+130.251478647 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e6c12e07-53e7-4f30-a8bf-c5d1a727d2fb-metrics-certs") pod "network-metrics-daemon-mcwtb" (UID: "e6c12e07-53e7-4f30-a8bf-c5d1a727d2fb") : secret "metrics-daemon-secret" not found Sep 17 07:20:48.525610 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:20:48.525575 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jww4t\" (UniqueName: \"kubernetes.io/projected/ea653065-69b3-4da2-b8d0-9518964204d9-kube-api-access-jww4t\") pod \"network-check-target-qzfhn\" (UID: \"ea653065-69b3-4da2-b8d0-9518964204d9\") " pod="openshift-network-diagnostics/network-check-target-qzfhn" Sep 17 07:20:48.525760 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:20:48.525651 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f387de20-2724-46ab-9bca-b4b4a23711cf-original-pull-secret\") pod \"global-pull-secret-syncer-rs4vc\" (UID: \"f387de20-2724-46ab-9bca-b4b4a23711cf\") " pod="kube-system/global-pull-secret-syncer-rs4vc" Sep 17 07:20:48.530016 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:20:48.529996 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Sep 17 07:20:48.530121 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:20:48.530040 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Sep 17 07:20:48.538996 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:20:48.538975 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Sep 17 07:20:48.539383 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:20:48.539364 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f387de20-2724-46ab-9bca-b4b4a23711cf-original-pull-secret\") pod \"global-pull-secret-syncer-rs4vc\" (UID: \"f387de20-2724-46ab-9bca-b4b4a23711cf\") " pod="kube-system/global-pull-secret-syncer-rs4vc" Sep 17 07:20:48.549580 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:20:48.549561 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jww4t\" (UniqueName: \"kubernetes.io/projected/ea653065-69b3-4da2-b8d0-9518964204d9-kube-api-access-jww4t\") pod \"network-check-target-qzfhn\" (UID: \"ea653065-69b3-4da2-b8d0-9518964204d9\") " pod="openshift-network-diagnostics/network-check-target-qzfhn" Sep 17 07:20:48.594702 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:20:48.594681 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rs4vc" Sep 17 07:20:48.606059 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:20:48.606041 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-krbdq\"" Sep 17 07:20:48.613786 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:20:48.613759 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qzfhn" Sep 17 07:20:48.877769 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:20:48.877737 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-rs4vc"] Sep 17 07:20:48.881170 ip-10-0-132-17 kubenswrapper[2561]: W0917 07:20:48.881146 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf387de20_2724_46ab_9bca_b4b4a23711cf.slice/crio-3eb2f0238b549306c5e6fa54c31a660bf342b61b6912fa06710d3cca07296aef WatchSource:0}: Error finding container 3eb2f0238b549306c5e6fa54c31a660bf342b61b6912fa06710d3cca07296aef: Status 404 returned error can't find the container with id 3eb2f0238b549306c5e6fa54c31a660bf342b61b6912fa06710d3cca07296aef Sep 17 07:20:48.898898 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:20:48.898876 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-qzfhn"] Sep 17 07:20:48.904587 ip-10-0-132-17 kubenswrapper[2561]: W0917 07:20:48.904566 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podea653065_69b3_4da2_b8d0_9518964204d9.slice/crio-17678fc58a0563aeabcf5aeadd4860013f675d2eaa6bb3b2dd2bb592e762454e WatchSource:0}: Error finding container 17678fc58a0563aeabcf5aeadd4860013f675d2eaa6bb3b2dd2bb592e762454e: Status 404 returned error can't find the container with id 17678fc58a0563aeabcf5aeadd4860013f675d2eaa6bb3b2dd2bb592e762454e Sep 17 07:20:48.989074 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:20:48.989013 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-rs4vc" event={"ID":"f387de20-2724-46ab-9bca-b4b4a23711cf","Type":"ContainerStarted","Data":"3eb2f0238b549306c5e6fa54c31a660bf342b61b6912fa06710d3cca07296aef"} Sep 17 07:20:48.990161 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:20:48.990133 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-qzfhn" event={"ID":"ea653065-69b3-4da2-b8d0-9518964204d9","Type":"ContainerStarted","Data":"17678fc58a0563aeabcf5aeadd4860013f675d2eaa6bb3b2dd2bb592e762454e"} Sep 17 07:20:52.774225 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:20:52.774190 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9skpb_96c5b8e5-2fc0-489b-8889-52bf66184838/konnectivity-agent/0.log" limit=1024 Sep 17 07:20:52.831749 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:20:52.831709 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9skpb_96c5b8e5-2fc0-489b-8889-52bf66184838/konnectivity-agent/0.log" limit=1024 Sep 17 07:20:52.949374 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:20:52.949331 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9skpb_96c5b8e5-2fc0-489b-8889-52bf66184838/konnectivity-agent/0.log" limit=1024 Sep 17 07:20:53.012606 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:20:53.012567 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9skpb_96c5b8e5-2fc0-489b-8889-52bf66184838/konnectivity-agent/0.log" limit=1024 Sep 17 07:20:53.074432 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:20:53.074339 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9skpb_96c5b8e5-2fc0-489b-8889-52bf66184838/konnectivity-agent/0.log" limit=1024 Sep 17 07:20:55.011880 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:20:55.011844 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-rs4vc" event={"ID":"f387de20-2724-46ab-9bca-b4b4a23711cf","Type":"ContainerStarted","Data":"56e2b2ecededb8d90b9f5a04a9a0e4d5ed7adb69cd29ad40232f85ed3d37351e"} Sep 17 07:20:55.013361 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:20:55.013334 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-qzfhn" event={"ID":"ea653065-69b3-4da2-b8d0-9518964204d9","Type":"ContainerStarted","Data":"65a3ece6429496f2e6800cccdd7946f59cd873350349257fc1def044e688185c"} Sep 17 07:20:55.013467 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:20:55.013450 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-qzfhn" Sep 17 07:20:55.029267 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:20:55.029223 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-rs4vc" podStartSLOduration=66.319550475 podStartE2EDuration="1m12.029210677s" totalImagesPullingTime="5.709660202s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-17 07:19:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 07:20:55.028296114 +0000 UTC m=+72.834242389" watchObservedRunningTime="2026-09-17 07:20:55.029210677 +0000 UTC m=+72.835156952" Sep 17 07:20:55.045743 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:20:55.045699 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-qzfhn" podStartSLOduration=67.350314082 podStartE2EDuration="1m13.045685752s" totalImagesPullingTime="5.69537167s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 07:19:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 07:20:55.044771997 +0000 UTC m=+72.850718273" watchObservedRunningTime="2026-09-17 07:20:55.045685752 +0000 UTC m=+72.851632026" Sep 17 07:20:56.554175 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:20:56.554144 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9skpb_96c5b8e5-2fc0-489b-8889-52bf66184838/konnectivity-agent/0.log" limit=1024 Sep 17 07:20:58.076159 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:20:58.076124 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9skpb_96c5b8e5-2fc0-489b-8889-52bf66184838/konnectivity-agent/0.log" limit=1024 Sep 17 07:21:20.043658 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:21:20.043532 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/5d07cc07-43a4-401e-831f-e77bd2d21b82-registry-tls\") pod \"image-registry-5d69dcb864-hck5p\" (UID: \"5d07cc07-43a4-401e-831f-e77bd2d21b82\") " pod="openshift-image-registry/image-registry-5d69dcb864-hck5p" Sep 17 07:21:20.043658 ip-10-0-132-17 kubenswrapper[2561]: E0917 07:21:20.043654 2561 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Sep 17 07:21:20.043658 ip-10-0-132-17 kubenswrapper[2561]: E0917 07:21:20.043666 2561 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5d69dcb864-hck5p: secret "image-registry-tls" not found Sep 17 07:21:20.044123 ip-10-0-132-17 kubenswrapper[2561]: E0917 07:21:20.043726 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5d07cc07-43a4-401e-831f-e77bd2d21b82-registry-tls podName:5d07cc07-43a4-401e-831f-e77bd2d21b82 nodeName:}" failed. No retries permitted until 2026-09-17 07:22:24.043712266 +0000 UTC m=+161.849658520 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/5d07cc07-43a4-401e-831f-e77bd2d21b82-registry-tls") pod "image-registry-5d69dcb864-hck5p" (UID: "5d07cc07-43a4-401e-831f-e77bd2d21b82") : secret "image-registry-tls" not found Sep 17 07:21:20.144443 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:21:20.144407 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a8fc4c21-3234-45f2-8210-3065895e0eb6-metrics-tls\") pod \"dns-default-6h7kw\" (UID: \"a8fc4c21-3234-45f2-8210-3065895e0eb6\") " pod="openshift-dns/dns-default-6h7kw" Sep 17 07:21:20.144629 ip-10-0-132-17 kubenswrapper[2561]: E0917 07:21:20.144536 2561 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 17 07:21:20.144629 ip-10-0-132-17 kubenswrapper[2561]: E0917 07:21:20.144609 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a8fc4c21-3234-45f2-8210-3065895e0eb6-metrics-tls podName:a8fc4c21-3234-45f2-8210-3065895e0eb6 nodeName:}" failed. No retries permitted until 2026-09-17 07:22:24.144583532 +0000 UTC m=+161.950529798 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/a8fc4c21-3234-45f2-8210-3065895e0eb6-metrics-tls") pod "dns-default-6h7kw" (UID: "a8fc4c21-3234-45f2-8210-3065895e0eb6") : secret "dns-default-metrics-tls" not found Sep 17 07:21:26.018286 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:21:26.018252 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-qzfhn" Sep 17 07:21:41.935514 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:21:41.935479 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9skpb_96c5b8e5-2fc0-489b-8889-52bf66184838/konnectivity-agent/0.log" limit=1024 Sep 17 07:21:42.031317 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:21:42.031281 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9skpb_96c5b8e5-2fc0-489b-8889-52bf66184838/konnectivity-agent/0.log" limit=1024 Sep 17 07:21:43.965810 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:21:43.965771 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9skpb_96c5b8e5-2fc0-489b-8889-52bf66184838/konnectivity-agent/0.log" limit=1024 Sep 17 07:21:44.036300 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:21:44.036266 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9skpb_96c5b8e5-2fc0-489b-8889-52bf66184838/konnectivity-agent/0.log" limit=1024 Sep 17 07:21:45.124250 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:21:45.124216 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-mxdhz"] Sep 17 07:21:45.127334 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:21:45.127311 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-mxdhz" Sep 17 07:21:45.131654 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:21:45.131629 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-ghp9r\"" Sep 17 07:21:45.131764 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:21:45.131705 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Sep 17 07:21:45.131764 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:21:45.131711 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Sep 17 07:21:45.131764 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:21:45.131750 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Sep 17 07:21:45.131965 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:21:45.131742 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Sep 17 07:21:45.139774 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:21:45.139753 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9skpb_96c5b8e5-2fc0-489b-8889-52bf66184838/konnectivity-agent/0.log" limit=1024 Sep 17 07:21:45.146056 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:21:45.146037 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-mxdhz"] Sep 17 07:21:45.210689 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:21:45.210663 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9skpb_96c5b8e5-2fc0-489b-8889-52bf66184838/konnectivity-agent/0.log" limit=1024 Sep 17 07:21:45.220757 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:21:45.220736 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/7470450e-ca42-47f8-bfc4-42e9ce03a88e-crio-socket\") pod \"insights-runtime-extractor-mxdhz\" (UID: \"7470450e-ca42-47f8-bfc4-42e9ce03a88e\") " pod="openshift-insights/insights-runtime-extractor-mxdhz" Sep 17 07:21:45.220831 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:21:45.220782 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wz59l\" (UniqueName: \"kubernetes.io/projected/7470450e-ca42-47f8-bfc4-42e9ce03a88e-kube-api-access-wz59l\") pod \"insights-runtime-extractor-mxdhz\" (UID: \"7470450e-ca42-47f8-bfc4-42e9ce03a88e\") " pod="openshift-insights/insights-runtime-extractor-mxdhz" Sep 17 07:21:45.220831 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:21:45.220802 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/7470450e-ca42-47f8-bfc4-42e9ce03a88e-data-volume\") pod \"insights-runtime-extractor-mxdhz\" (UID: \"7470450e-ca42-47f8-bfc4-42e9ce03a88e\") " pod="openshift-insights/insights-runtime-extractor-mxdhz" Sep 17 07:21:45.220831 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:21:45.220820 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/7470450e-ca42-47f8-bfc4-42e9ce03a88e-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-mxdhz\" (UID: \"7470450e-ca42-47f8-bfc4-42e9ce03a88e\") " pod="openshift-insights/insights-runtime-extractor-mxdhz" Sep 17 07:21:45.220968 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:21:45.220869 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/7470450e-ca42-47f8-bfc4-42e9ce03a88e-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-mxdhz\" (UID: \"7470450e-ca42-47f8-bfc4-42e9ce03a88e\") " pod="openshift-insights/insights-runtime-extractor-mxdhz" Sep 17 07:21:45.321342 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:21:45.321311 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/7470450e-ca42-47f8-bfc4-42e9ce03a88e-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-mxdhz\" (UID: \"7470450e-ca42-47f8-bfc4-42e9ce03a88e\") " pod="openshift-insights/insights-runtime-extractor-mxdhz" Sep 17 07:21:45.321459 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:21:45.321369 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/7470450e-ca42-47f8-bfc4-42e9ce03a88e-crio-socket\") pod \"insights-runtime-extractor-mxdhz\" (UID: \"7470450e-ca42-47f8-bfc4-42e9ce03a88e\") " pod="openshift-insights/insights-runtime-extractor-mxdhz" Sep 17 07:21:45.321459 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:21:45.321432 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/7470450e-ca42-47f8-bfc4-42e9ce03a88e-crio-socket\") pod \"insights-runtime-extractor-mxdhz\" (UID: \"7470450e-ca42-47f8-bfc4-42e9ce03a88e\") " pod="openshift-insights/insights-runtime-extractor-mxdhz" Sep 17 07:21:45.321565 ip-10-0-132-17 kubenswrapper[2561]: E0917 07:21:45.321479 2561 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Sep 17 07:21:45.321565 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:21:45.321509 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wz59l\" (UniqueName: \"kubernetes.io/projected/7470450e-ca42-47f8-bfc4-42e9ce03a88e-kube-api-access-wz59l\") pod \"insights-runtime-extractor-mxdhz\" (UID: \"7470450e-ca42-47f8-bfc4-42e9ce03a88e\") " pod="openshift-insights/insights-runtime-extractor-mxdhz" Sep 17 07:21:45.321565 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:21:45.321537 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/7470450e-ca42-47f8-bfc4-42e9ce03a88e-data-volume\") pod \"insights-runtime-extractor-mxdhz\" (UID: \"7470450e-ca42-47f8-bfc4-42e9ce03a88e\") " pod="openshift-insights/insights-runtime-extractor-mxdhz" Sep 17 07:21:45.321565 ip-10-0-132-17 kubenswrapper[2561]: E0917 07:21:45.321563 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7470450e-ca42-47f8-bfc4-42e9ce03a88e-insights-runtime-extractor-tls podName:7470450e-ca42-47f8-bfc4-42e9ce03a88e nodeName:}" failed. No retries permitted until 2026-09-17 07:21:45.821541074 +0000 UTC m=+123.627487344 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/7470450e-ca42-47f8-bfc4-42e9ce03a88e-insights-runtime-extractor-tls") pod "insights-runtime-extractor-mxdhz" (UID: "7470450e-ca42-47f8-bfc4-42e9ce03a88e") : secret "insights-runtime-extractor-tls" not found Sep 17 07:21:45.321767 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:21:45.321596 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/7470450e-ca42-47f8-bfc4-42e9ce03a88e-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-mxdhz\" (UID: \"7470450e-ca42-47f8-bfc4-42e9ce03a88e\") " pod="openshift-insights/insights-runtime-extractor-mxdhz" Sep 17 07:21:45.321767 ip-10-0-132-17 kubenswrapper[2561]: E0917 07:21:45.321671 2561 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Sep 17 07:21:45.321767 ip-10-0-132-17 kubenswrapper[2561]: E0917 07:21:45.321726 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/7470450e-ca42-47f8-bfc4-42e9ce03a88e-kube-rbac-proxy-cm podName:7470450e-ca42-47f8-bfc4-42e9ce03a88e nodeName:}" failed. No retries permitted until 2026-09-17 07:21:45.821712498 +0000 UTC m=+123.627658755 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/7470450e-ca42-47f8-bfc4-42e9ce03a88e-kube-rbac-proxy-cm") pod "insights-runtime-extractor-mxdhz" (UID: "7470450e-ca42-47f8-bfc4-42e9ce03a88e") : configmap "kube-rbac-proxy" not found Sep 17 07:21:45.321886 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:21:45.321768 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/7470450e-ca42-47f8-bfc4-42e9ce03a88e-data-volume\") pod \"insights-runtime-extractor-mxdhz\" (UID: \"7470450e-ca42-47f8-bfc4-42e9ce03a88e\") " pod="openshift-insights/insights-runtime-extractor-mxdhz" Sep 17 07:21:45.332797 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:21:45.332769 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wz59l\" (UniqueName: \"kubernetes.io/projected/7470450e-ca42-47f8-bfc4-42e9ce03a88e-kube-api-access-wz59l\") pod \"insights-runtime-extractor-mxdhz\" (UID: \"7470450e-ca42-47f8-bfc4-42e9ce03a88e\") " pod="openshift-insights/insights-runtime-extractor-mxdhz" Sep 17 07:21:45.825496 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:21:45.825454 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/7470450e-ca42-47f8-bfc4-42e9ce03a88e-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-mxdhz\" (UID: \"7470450e-ca42-47f8-bfc4-42e9ce03a88e\") " pod="openshift-insights/insights-runtime-extractor-mxdhz" Sep 17 07:21:45.825496 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:21:45.825493 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/7470450e-ca42-47f8-bfc4-42e9ce03a88e-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-mxdhz\" (UID: \"7470450e-ca42-47f8-bfc4-42e9ce03a88e\") " pod="openshift-insights/insights-runtime-extractor-mxdhz" Sep 17 07:21:45.825700 ip-10-0-132-17 kubenswrapper[2561]: E0917 07:21:45.825576 2561 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Sep 17 07:21:45.825700 ip-10-0-132-17 kubenswrapper[2561]: E0917 07:21:45.825588 2561 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Sep 17 07:21:45.825700 ip-10-0-132-17 kubenswrapper[2561]: E0917 07:21:45.825646 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7470450e-ca42-47f8-bfc4-42e9ce03a88e-insights-runtime-extractor-tls podName:7470450e-ca42-47f8-bfc4-42e9ce03a88e nodeName:}" failed. No retries permitted until 2026-09-17 07:21:46.825632673 +0000 UTC m=+124.631578925 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/7470450e-ca42-47f8-bfc4-42e9ce03a88e-insights-runtime-extractor-tls") pod "insights-runtime-extractor-mxdhz" (UID: "7470450e-ca42-47f8-bfc4-42e9ce03a88e") : secret "insights-runtime-extractor-tls" not found Sep 17 07:21:45.825700 ip-10-0-132-17 kubenswrapper[2561]: E0917 07:21:45.825660 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/7470450e-ca42-47f8-bfc4-42e9ce03a88e-kube-rbac-proxy-cm podName:7470450e-ca42-47f8-bfc4-42e9ce03a88e nodeName:}" failed. No retries permitted until 2026-09-17 07:21:46.825652679 +0000 UTC m=+124.631598931 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/7470450e-ca42-47f8-bfc4-42e9ce03a88e-kube-rbac-proxy-cm") pod "insights-runtime-extractor-mxdhz" (UID: "7470450e-ca42-47f8-bfc4-42e9ce03a88e") : configmap "kube-rbac-proxy" not found Sep 17 07:21:46.834964 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:21:46.834900 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/7470450e-ca42-47f8-bfc4-42e9ce03a88e-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-mxdhz\" (UID: \"7470450e-ca42-47f8-bfc4-42e9ce03a88e\") " pod="openshift-insights/insights-runtime-extractor-mxdhz" Sep 17 07:21:46.834964 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:21:46.834955 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/7470450e-ca42-47f8-bfc4-42e9ce03a88e-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-mxdhz\" (UID: \"7470450e-ca42-47f8-bfc4-42e9ce03a88e\") " pod="openshift-insights/insights-runtime-extractor-mxdhz" Sep 17 07:21:46.835450 ip-10-0-132-17 kubenswrapper[2561]: E0917 07:21:46.835034 2561 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Sep 17 07:21:46.835450 ip-10-0-132-17 kubenswrapper[2561]: E0917 07:21:46.835092 2561 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Sep 17 07:21:46.835450 ip-10-0-132-17 kubenswrapper[2561]: E0917 07:21:46.835102 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/7470450e-ca42-47f8-bfc4-42e9ce03a88e-kube-rbac-proxy-cm podName:7470450e-ca42-47f8-bfc4-42e9ce03a88e nodeName:}" failed. No retries permitted until 2026-09-17 07:21:48.835081849 +0000 UTC m=+126.641028103 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/7470450e-ca42-47f8-bfc4-42e9ce03a88e-kube-rbac-proxy-cm") pod "insights-runtime-extractor-mxdhz" (UID: "7470450e-ca42-47f8-bfc4-42e9ce03a88e") : configmap "kube-rbac-proxy" not found Sep 17 07:21:46.835450 ip-10-0-132-17 kubenswrapper[2561]: E0917 07:21:46.835184 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7470450e-ca42-47f8-bfc4-42e9ce03a88e-insights-runtime-extractor-tls podName:7470450e-ca42-47f8-bfc4-42e9ce03a88e nodeName:}" failed. No retries permitted until 2026-09-17 07:21:48.835164186 +0000 UTC m=+126.641110442 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/7470450e-ca42-47f8-bfc4-42e9ce03a88e-insights-runtime-extractor-tls") pod "insights-runtime-extractor-mxdhz" (UID: "7470450e-ca42-47f8-bfc4-42e9ce03a88e") : secret "insights-runtime-extractor-tls" not found Sep 17 07:21:46.851395 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:21:46.851377 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-8qgg7_e154eb37-bb6a-4aca-b364-ab985fa57261/dns-node-resolver/0.log" Sep 17 07:21:48.050209 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:21:48.050184 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-pwnj9_a4c6eeea-2ae6-4bb2-93ee-1b46b62da363/node-ca/0.log" Sep 17 07:21:48.851027 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:21:48.850988 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-lbjkz_8e4c6dcd-3822-4c52-be03-ada3f5f45c9a/serve-healthcheck-canary/0.log" Sep 17 07:21:48.851217 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:21:48.851094 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/7470450e-ca42-47f8-bfc4-42e9ce03a88e-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-mxdhz\" (UID: \"7470450e-ca42-47f8-bfc4-42e9ce03a88e\") " pod="openshift-insights/insights-runtime-extractor-mxdhz" Sep 17 07:21:48.851217 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:21:48.851125 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/7470450e-ca42-47f8-bfc4-42e9ce03a88e-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-mxdhz\" (UID: \"7470450e-ca42-47f8-bfc4-42e9ce03a88e\") " pod="openshift-insights/insights-runtime-extractor-mxdhz" Sep 17 07:21:48.851217 ip-10-0-132-17 kubenswrapper[2561]: E0917 07:21:48.851213 2561 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Sep 17 07:21:48.851331 ip-10-0-132-17 kubenswrapper[2561]: E0917 07:21:48.851220 2561 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Sep 17 07:21:48.851367 ip-10-0-132-17 kubenswrapper[2561]: E0917 07:21:48.851281 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/7470450e-ca42-47f8-bfc4-42e9ce03a88e-kube-rbac-proxy-cm podName:7470450e-ca42-47f8-bfc4-42e9ce03a88e nodeName:}" failed. No retries permitted until 2026-09-17 07:21:52.851262427 +0000 UTC m=+130.657208679 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/7470450e-ca42-47f8-bfc4-42e9ce03a88e-kube-rbac-proxy-cm") pod "insights-runtime-extractor-mxdhz" (UID: "7470450e-ca42-47f8-bfc4-42e9ce03a88e") : configmap "kube-rbac-proxy" not found Sep 17 07:21:48.851414 ip-10-0-132-17 kubenswrapper[2561]: E0917 07:21:48.851375 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7470450e-ca42-47f8-bfc4-42e9ce03a88e-insights-runtime-extractor-tls podName:7470450e-ca42-47f8-bfc4-42e9ce03a88e nodeName:}" failed. No retries permitted until 2026-09-17 07:21:52.851359683 +0000 UTC m=+130.657305936 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/7470450e-ca42-47f8-bfc4-42e9ce03a88e-insights-runtime-extractor-tls") pod "insights-runtime-extractor-mxdhz" (UID: "7470450e-ca42-47f8-bfc4-42e9ce03a88e") : secret "insights-runtime-extractor-tls" not found Sep 17 07:21:50.697279 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:21:50.697230 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9skpb_96c5b8e5-2fc0-489b-8889-52bf66184838/konnectivity-agent/0.log" limit=1024 Sep 17 07:21:50.809208 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:21:50.809158 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9skpb_96c5b8e5-2fc0-489b-8889-52bf66184838/konnectivity-agent/0.log" limit=1024 Sep 17 07:21:50.909880 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:21:50.909854 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9skpb_96c5b8e5-2fc0-489b-8889-52bf66184838/konnectivity-agent/0.log" limit=1024 Sep 17 07:21:52.475529 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:21:52.475483 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e6c12e07-53e7-4f30-a8bf-c5d1a727d2fb-metrics-certs\") pod \"network-metrics-daemon-mcwtb\" (UID: \"e6c12e07-53e7-4f30-a8bf-c5d1a727d2fb\") " pod="openshift-multus/network-metrics-daemon-mcwtb" Sep 17 07:21:52.476042 ip-10-0-132-17 kubenswrapper[2561]: E0917 07:21:52.475659 2561 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Sep 17 07:21:52.476042 ip-10-0-132-17 kubenswrapper[2561]: E0917 07:21:52.475761 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e6c12e07-53e7-4f30-a8bf-c5d1a727d2fb-metrics-certs podName:e6c12e07-53e7-4f30-a8bf-c5d1a727d2fb nodeName:}" failed. No retries permitted until 2026-09-17 07:23:54.475738564 +0000 UTC m=+252.281684835 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e6c12e07-53e7-4f30-a8bf-c5d1a727d2fb-metrics-certs") pod "network-metrics-daemon-mcwtb" (UID: "e6c12e07-53e7-4f30-a8bf-c5d1a727d2fb") : secret "metrics-daemon-secret" not found Sep 17 07:21:52.878136 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:21:52.878096 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/7470450e-ca42-47f8-bfc4-42e9ce03a88e-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-mxdhz\" (UID: \"7470450e-ca42-47f8-bfc4-42e9ce03a88e\") " pod="openshift-insights/insights-runtime-extractor-mxdhz" Sep 17 07:21:52.878136 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:21:52.878143 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/7470450e-ca42-47f8-bfc4-42e9ce03a88e-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-mxdhz\" (UID: \"7470450e-ca42-47f8-bfc4-42e9ce03a88e\") " pod="openshift-insights/insights-runtime-extractor-mxdhz" Sep 17 07:21:52.878359 ip-10-0-132-17 kubenswrapper[2561]: E0917 07:21:52.878213 2561 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Sep 17 07:21:52.878359 ip-10-0-132-17 kubenswrapper[2561]: E0917 07:21:52.878269 2561 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Sep 17 07:21:52.878359 ip-10-0-132-17 kubenswrapper[2561]: E0917 07:21:52.878276 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/7470450e-ca42-47f8-bfc4-42e9ce03a88e-kube-rbac-proxy-cm podName:7470450e-ca42-47f8-bfc4-42e9ce03a88e nodeName:}" failed. No retries permitted until 2026-09-17 07:22:00.87826037 +0000 UTC m=+138.684206623 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/7470450e-ca42-47f8-bfc4-42e9ce03a88e-kube-rbac-proxy-cm") pod "insights-runtime-extractor-mxdhz" (UID: "7470450e-ca42-47f8-bfc4-42e9ce03a88e") : configmap "kube-rbac-proxy" not found Sep 17 07:21:52.878359 ip-10-0-132-17 kubenswrapper[2561]: E0917 07:21:52.878310 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7470450e-ca42-47f8-bfc4-42e9ce03a88e-insights-runtime-extractor-tls podName:7470450e-ca42-47f8-bfc4-42e9ce03a88e nodeName:}" failed. No retries permitted until 2026-09-17 07:22:00.878299388 +0000 UTC m=+138.684245641 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/7470450e-ca42-47f8-bfc4-42e9ce03a88e-insights-runtime-extractor-tls") pod "insights-runtime-extractor-mxdhz" (UID: "7470450e-ca42-47f8-bfc4-42e9ce03a88e") : secret "insights-runtime-extractor-tls" not found Sep 17 07:21:53.207859 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:21:53.207777 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9skpb_96c5b8e5-2fc0-489b-8889-52bf66184838/konnectivity-agent/0.log" limit=1024 Sep 17 07:21:53.291539 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:21:53.291507 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9skpb_96c5b8e5-2fc0-489b-8889-52bf66184838/konnectivity-agent/0.log" limit=1024 Sep 17 07:21:53.721483 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:21:53.721451 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9skpb_96c5b8e5-2fc0-489b-8889-52bf66184838/konnectivity-agent/0.log" limit=1024 Sep 17 07:21:53.791048 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:21:53.791017 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9skpb_96c5b8e5-2fc0-489b-8889-52bf66184838/konnectivity-agent/0.log" limit=1024 Sep 17 07:21:54.149065 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:21:54.149033 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9skpb_96c5b8e5-2fc0-489b-8889-52bf66184838/konnectivity-agent/0.log" limit=1024 Sep 17 07:21:54.207561 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:21:54.207531 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9skpb_96c5b8e5-2fc0-489b-8889-52bf66184838/konnectivity-agent/0.log" limit=1024 Sep 17 07:21:54.421791 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:21:54.421705 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9skpb_96c5b8e5-2fc0-489b-8889-52bf66184838/konnectivity-agent/0.log" limit=1024 Sep 17 07:21:54.520464 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:21:54.520437 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9skpb_96c5b8e5-2fc0-489b-8889-52bf66184838/konnectivity-agent/0.log" limit=1024 Sep 17 07:21:56.057151 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:21:56.057113 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9skpb_96c5b8e5-2fc0-489b-8889-52bf66184838/konnectivity-agent/0.log" limit=1024 Sep 17 07:21:57.037527 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:21:57.037490 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9skpb_96c5b8e5-2fc0-489b-8889-52bf66184838/konnectivity-agent/0.log" limit=1024 Sep 17 07:21:58.396862 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:21:58.396830 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9skpb_96c5b8e5-2fc0-489b-8889-52bf66184838/konnectivity-agent/0.log" limit=1024 Sep 17 07:21:59.014402 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:21:59.014359 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9skpb_96c5b8e5-2fc0-489b-8889-52bf66184838/konnectivity-agent/0.log" limit=1024 Sep 17 07:21:59.106458 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:21:59.106424 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9skpb_96c5b8e5-2fc0-489b-8889-52bf66184838/konnectivity-agent/0.log" limit=1024 Sep 17 07:21:59.886775 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:21:59.886724 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9skpb_96c5b8e5-2fc0-489b-8889-52bf66184838/konnectivity-agent/0.log" limit=1024 Sep 17 07:22:00.217690 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:22:00.217598 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9skpb_96c5b8e5-2fc0-489b-8889-52bf66184838/konnectivity-agent/0.log" limit=1024 Sep 17 07:22:00.460059 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:22:00.460025 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9skpb_96c5b8e5-2fc0-489b-8889-52bf66184838/konnectivity-agent/0.log" limit=1024 Sep 17 07:22:00.611207 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:22:00.611120 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9skpb_96c5b8e5-2fc0-489b-8889-52bf66184838/konnectivity-agent/0.log" limit=1024 Sep 17 07:22:00.836726 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:22:00.836694 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9skpb_96c5b8e5-2fc0-489b-8889-52bf66184838/konnectivity-agent/0.log" limit=1024 Sep 17 07:22:00.944611 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:22:00.944575 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/7470450e-ca42-47f8-bfc4-42e9ce03a88e-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-mxdhz\" (UID: \"7470450e-ca42-47f8-bfc4-42e9ce03a88e\") " pod="openshift-insights/insights-runtime-extractor-mxdhz" Sep 17 07:22:00.945003 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:22:00.944623 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/7470450e-ca42-47f8-bfc4-42e9ce03a88e-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-mxdhz\" (UID: \"7470450e-ca42-47f8-bfc4-42e9ce03a88e\") " pod="openshift-insights/insights-runtime-extractor-mxdhz" Sep 17 07:22:00.945003 ip-10-0-132-17 kubenswrapper[2561]: E0917 07:22:00.944787 2561 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Sep 17 07:22:00.945003 ip-10-0-132-17 kubenswrapper[2561]: E0917 07:22:00.944870 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7470450e-ca42-47f8-bfc4-42e9ce03a88e-insights-runtime-extractor-tls podName:7470450e-ca42-47f8-bfc4-42e9ce03a88e nodeName:}" failed. No retries permitted until 2026-09-17 07:22:16.944848932 +0000 UTC m=+154.750795190 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/7470450e-ca42-47f8-bfc4-42e9ce03a88e-insights-runtime-extractor-tls") pod "insights-runtime-extractor-mxdhz" (UID: "7470450e-ca42-47f8-bfc4-42e9ce03a88e") : secret "insights-runtime-extractor-tls" not found Sep 17 07:22:00.945234 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:22:00.945203 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/7470450e-ca42-47f8-bfc4-42e9ce03a88e-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-mxdhz\" (UID: \"7470450e-ca42-47f8-bfc4-42e9ce03a88e\") " pod="openshift-insights/insights-runtime-extractor-mxdhz" Sep 17 07:22:01.113264 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:22:01.113234 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9skpb_96c5b8e5-2fc0-489b-8889-52bf66184838/konnectivity-agent/0.log" limit=1024 Sep 17 07:22:01.503299 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:22:01.503268 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9skpb_96c5b8e5-2fc0-489b-8889-52bf66184838/konnectivity-agent/0.log" limit=1024 Sep 17 07:22:02.131798 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:22:02.131763 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9skpb_96c5b8e5-2fc0-489b-8889-52bf66184838/konnectivity-agent/0.log" limit=1024 Sep 17 07:22:02.715818 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:22:02.715784 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9skpb_96c5b8e5-2fc0-489b-8889-52bf66184838/konnectivity-agent/0.log" limit=1024 Sep 17 07:22:02.904002 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:22:02.903969 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9skpb_96c5b8e5-2fc0-489b-8889-52bf66184838/konnectivity-agent/0.log" limit=1024 Sep 17 07:22:03.325587 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:22:03.325539 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9skpb_96c5b8e5-2fc0-489b-8889-52bf66184838/konnectivity-agent/0.log" limit=1024 Sep 17 07:22:03.532193 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:22:03.532160 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9skpb_96c5b8e5-2fc0-489b-8889-52bf66184838/konnectivity-agent/0.log" limit=1024 Sep 17 07:22:04.058427 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:22:04.058390 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9skpb_96c5b8e5-2fc0-489b-8889-52bf66184838/konnectivity-agent/0.log" limit=1024 Sep 17 07:22:04.157110 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:22:04.157083 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9skpb_96c5b8e5-2fc0-489b-8889-52bf66184838/konnectivity-agent/0.log" limit=1024 Sep 17 07:22:04.518434 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:22:04.518386 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9skpb_96c5b8e5-2fc0-489b-8889-52bf66184838/konnectivity-agent/0.log" limit=1024 Sep 17 07:22:04.732492 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:22:04.732457 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9skpb_96c5b8e5-2fc0-489b-8889-52bf66184838/konnectivity-agent/0.log" limit=1024 Sep 17 07:22:04.834684 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:22:04.834607 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9skpb_96c5b8e5-2fc0-489b-8889-52bf66184838/konnectivity-agent/0.log" limit=1024 Sep 17 07:22:05.141472 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:22:05.141441 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9skpb_96c5b8e5-2fc0-489b-8889-52bf66184838/konnectivity-agent/0.log" limit=1024 Sep 17 07:22:05.952868 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:22:05.952839 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9skpb_96c5b8e5-2fc0-489b-8889-52bf66184838/konnectivity-agent/0.log" limit=1024 Sep 17 07:22:06.335797 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:22:06.335705 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9skpb_96c5b8e5-2fc0-489b-8889-52bf66184838/konnectivity-agent/0.log" limit=1024 Sep 17 07:22:06.524788 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:22:06.524758 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9skpb_96c5b8e5-2fc0-489b-8889-52bf66184838/konnectivity-agent/0.log" limit=1024 Sep 17 07:22:06.752151 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:22:06.752115 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9skpb_96c5b8e5-2fc0-489b-8889-52bf66184838/konnectivity-agent/0.log" limit=1024 Sep 17 07:22:06.891915 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:22:06.891868 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9skpb_96c5b8e5-2fc0-489b-8889-52bf66184838/konnectivity-agent/0.log" limit=1024 Sep 17 07:22:07.163008 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:22:07.162975 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9skpb_96c5b8e5-2fc0-489b-8889-52bf66184838/konnectivity-agent/0.log" limit=1024 Sep 17 07:22:07.765875 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:22:07.765828 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9skpb_96c5b8e5-2fc0-489b-8889-52bf66184838/konnectivity-agent/0.log" limit=1024 Sep 17 07:22:08.166615 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:22:08.166585 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9skpb_96c5b8e5-2fc0-489b-8889-52bf66184838/konnectivity-agent/0.log" limit=1024 Sep 17 07:22:08.543983 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:22:08.543865 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9skpb_96c5b8e5-2fc0-489b-8889-52bf66184838/konnectivity-agent/0.log" limit=1024 Sep 17 07:22:08.933308 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:22:08.933274 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9skpb_96c5b8e5-2fc0-489b-8889-52bf66184838/konnectivity-agent/0.log" limit=1024 Sep 17 07:22:09.344716 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:22:09.344625 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9skpb_96c5b8e5-2fc0-489b-8889-52bf66184838/konnectivity-agent/0.log" limit=1024 Sep 17 07:22:09.537206 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:22:09.537168 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9skpb_96c5b8e5-2fc0-489b-8889-52bf66184838/konnectivity-agent/0.log" limit=1024 Sep 17 07:22:09.732171 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:22:09.732138 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9skpb_96c5b8e5-2fc0-489b-8889-52bf66184838/konnectivity-agent/0.log" limit=1024 Sep 17 07:22:10.131839 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:22:10.131786 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9skpb_96c5b8e5-2fc0-489b-8889-52bf66184838/konnectivity-agent/0.log" limit=1024 Sep 17 07:22:10.339548 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:22:10.339515 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9skpb_96c5b8e5-2fc0-489b-8889-52bf66184838/konnectivity-agent/0.log" limit=1024 Sep 17 07:22:10.713293 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:22:10.713254 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9skpb_96c5b8e5-2fc0-489b-8889-52bf66184838/konnectivity-agent/0.log" limit=1024 Sep 17 07:22:10.920875 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:22:10.920838 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9skpb_96c5b8e5-2fc0-489b-8889-52bf66184838/konnectivity-agent/0.log" limit=1024 Sep 17 07:22:14.008793 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:22:14.008754 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9skpb_96c5b8e5-2fc0-489b-8889-52bf66184838/konnectivity-agent/0.log" limit=1024 Sep 17 07:22:14.102563 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:22:14.102532 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9skpb_96c5b8e5-2fc0-489b-8889-52bf66184838/konnectivity-agent/0.log" limit=1024 Sep 17 07:22:15.228333 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:22:15.228295 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9skpb_96c5b8e5-2fc0-489b-8889-52bf66184838/konnectivity-agent/0.log" limit=1024 Sep 17 07:22:15.368132 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:22:15.368094 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9skpb_96c5b8e5-2fc0-489b-8889-52bf66184838/konnectivity-agent/0.log" limit=1024 Sep 17 07:22:16.437869 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:22:16.437835 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9skpb_96c5b8e5-2fc0-489b-8889-52bf66184838/konnectivity-agent/0.log" limit=1024 Sep 17 07:22:16.570892 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:22:16.570860 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9skpb_96c5b8e5-2fc0-489b-8889-52bf66184838/konnectivity-agent/0.log" limit=1024 Sep 17 07:22:16.691456 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:22:16.691372 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9skpb_96c5b8e5-2fc0-489b-8889-52bf66184838/konnectivity-agent/0.log" limit=1024 Sep 17 07:22:16.968072 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:22:16.967993 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/7470450e-ca42-47f8-bfc4-42e9ce03a88e-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-mxdhz\" (UID: \"7470450e-ca42-47f8-bfc4-42e9ce03a88e\") " pod="openshift-insights/insights-runtime-extractor-mxdhz" Sep 17 07:22:16.970354 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:22:16.970332 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/7470450e-ca42-47f8-bfc4-42e9ce03a88e-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-mxdhz\" (UID: \"7470450e-ca42-47f8-bfc4-42e9ce03a88e\") " pod="openshift-insights/insights-runtime-extractor-mxdhz" Sep 17 07:22:17.198606 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:22:17.198557 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9skpb_96c5b8e5-2fc0-489b-8889-52bf66184838/konnectivity-agent/0.log" limit=1024 Sep 17 07:22:17.235975 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:22:17.235916 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-mxdhz" Sep 17 07:22:17.548053 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:22:17.547980 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-mxdhz"] Sep 17 07:22:17.551106 ip-10-0-132-17 kubenswrapper[2561]: W0917 07:22:17.551081 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7470450e_ca42_47f8_bfc4_42e9ce03a88e.slice/crio-e1da96f8f3ec70766d510689bbf0abb83c9025345331a7ea5a83fa7448c748a4 WatchSource:0}: Error finding container e1da96f8f3ec70766d510689bbf0abb83c9025345331a7ea5a83fa7448c748a4: Status 404 returned error can't find the container with id e1da96f8f3ec70766d510689bbf0abb83c9025345331a7ea5a83fa7448c748a4 Sep 17 07:22:18.250355 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:22:18.250324 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-mxdhz" event={"ID":"7470450e-ca42-47f8-bfc4-42e9ce03a88e","Type":"ContainerStarted","Data":"1e7d29df0a3d4bd48d9b46e7297d3812b9e5c218ddee16983d6e138ad1fba556"} Sep 17 07:22:18.250513 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:22:18.250386 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-mxdhz" event={"ID":"7470450e-ca42-47f8-bfc4-42e9ce03a88e","Type":"ContainerStarted","Data":"e1da96f8f3ec70766d510689bbf0abb83c9025345331a7ea5a83fa7448c748a4"} Sep 17 07:22:19.156944 ip-10-0-132-17 kubenswrapper[2561]: E0917 07:22:19.156889 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[registry-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-image-registry/image-registry-5d69dcb864-hck5p" podUID="5d07cc07-43a4-401e-831f-e77bd2d21b82" Sep 17 07:22:19.256269 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:22:19.256241 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5d69dcb864-hck5p" Sep 17 07:22:19.256437 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:22:19.256236 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-mxdhz" event={"ID":"7470450e-ca42-47f8-bfc4-42e9ce03a88e","Type":"ContainerStarted","Data":"2993ebd53b3dcc0f124669bae27a35a473a9037d5b4f06b410efdd00a9d21d32"} Sep 17 07:22:19.264669 ip-10-0-132-17 kubenswrapper[2561]: E0917 07:22:19.264637 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-6h7kw" podUID="a8fc4c21-3234-45f2-8210-3065895e0eb6" Sep 17 07:22:19.743612 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:22:19.743576 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9skpb_96c5b8e5-2fc0-489b-8889-52bf66184838/konnectivity-agent/0.log" limit=1024 Sep 17 07:22:19.887010 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:22:19.886968 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9skpb_96c5b8e5-2fc0-489b-8889-52bf66184838/konnectivity-agent/0.log" limit=1024 Sep 17 07:22:20.261475 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:22:20.261444 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-mxdhz" event={"ID":"7470450e-ca42-47f8-bfc4-42e9ce03a88e","Type":"ContainerStarted","Data":"6ed58072b6ccb2d41444af9346fba81112d2df31061b7032506640d1dd4f9733"} Sep 17 07:22:20.261856 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:22:20.261457 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-6h7kw" Sep 17 07:22:20.298306 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:22:20.298277 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9skpb_96c5b8e5-2fc0-489b-8889-52bf66184838/konnectivity-agent/0.log" limit=1024 Sep 17 07:22:20.309434 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:22:20.306401 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-mxdhz" podStartSLOduration=32.81841082 podStartE2EDuration="35.306382768s" totalImagesPullingTime="2.487971948s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-17 07:21:45 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 07:22:20.305388481 +0000 UTC m=+158.111334755" watchObservedRunningTime="2026-09-17 07:22:20.306382768 +0000 UTC m=+158.112329044" Sep 17 07:22:20.707502 ip-10-0-132-17 kubenswrapper[2561]: E0917 07:22:20.707472 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-mcwtb" podUID="e6c12e07-53e7-4f30-a8bf-c5d1a727d2fb" Sep 17 07:22:22.703054 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:22:22.703015 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9skpb_96c5b8e5-2fc0-489b-8889-52bf66184838/konnectivity-agent/0.log" limit=1024 Sep 17 07:22:24.115544 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:22:24.115504 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/5d07cc07-43a4-401e-831f-e77bd2d21b82-registry-tls\") pod \"image-registry-5d69dcb864-hck5p\" (UID: \"5d07cc07-43a4-401e-831f-e77bd2d21b82\") " pod="openshift-image-registry/image-registry-5d69dcb864-hck5p" Sep 17 07:22:24.118176 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:22:24.118150 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/5d07cc07-43a4-401e-831f-e77bd2d21b82-registry-tls\") pod \"image-registry-5d69dcb864-hck5p\" (UID: \"5d07cc07-43a4-401e-831f-e77bd2d21b82\") " pod="openshift-image-registry/image-registry-5d69dcb864-hck5p" Sep 17 07:22:24.215891 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:22:24.215857 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a8fc4c21-3234-45f2-8210-3065895e0eb6-metrics-tls\") pod \"dns-default-6h7kw\" (UID: \"a8fc4c21-3234-45f2-8210-3065895e0eb6\") " pod="openshift-dns/dns-default-6h7kw" Sep 17 07:22:24.218260 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:22:24.218236 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a8fc4c21-3234-45f2-8210-3065895e0eb6-metrics-tls\") pod \"dns-default-6h7kw\" (UID: \"a8fc4c21-3234-45f2-8210-3065895e0eb6\") " pod="openshift-dns/dns-default-6h7kw" Sep 17 07:22:24.360072 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:22:24.360034 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-n9snn\"" Sep 17 07:22:24.368144 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:22:24.368126 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5d69dcb864-hck5p" Sep 17 07:22:24.465492 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:22:24.465451 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-tth88\"" Sep 17 07:22:24.473168 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:22:24.473146 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-6h7kw" Sep 17 07:22:24.647431 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:22:24.647407 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-5d69dcb864-hck5p"] Sep 17 07:22:24.649996 ip-10-0-132-17 kubenswrapper[2561]: W0917 07:22:24.649963 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5d07cc07_43a4_401e_831f_e77bd2d21b82.slice/crio-58e46e0512bd5be6b23d223f80f5a0e9e29ea8c00246974d197f28dec25664e4 WatchSource:0}: Error finding container 58e46e0512bd5be6b23d223f80f5a0e9e29ea8c00246974d197f28dec25664e4: Status 404 returned error can't find the container with id 58e46e0512bd5be6b23d223f80f5a0e9e29ea8c00246974d197f28dec25664e4 Sep 17 07:22:24.742914 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:22:24.742757 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-6h7kw"] Sep 17 07:22:24.745319 ip-10-0-132-17 kubenswrapper[2561]: W0917 07:22:24.745289 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda8fc4c21_3234_45f2_8210_3065895e0eb6.slice/crio-b74e4eb9f35f3d2a2b830d79706d5c5f2350e4149ebb7631f02d4b3959cd975b WatchSource:0}: Error finding container b74e4eb9f35f3d2a2b830d79706d5c5f2350e4149ebb7631f02d4b3959cd975b: Status 404 returned error can't find the container with id b74e4eb9f35f3d2a2b830d79706d5c5f2350e4149ebb7631f02d4b3959cd975b Sep 17 07:22:24.922082 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:22:24.921986 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9skpb_96c5b8e5-2fc0-489b-8889-52bf66184838/konnectivity-agent/0.log" limit=1024 Sep 17 07:22:25.264421 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:22:25.264320 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9skpb_96c5b8e5-2fc0-489b-8889-52bf66184838/konnectivity-agent/0.log" limit=1024 Sep 17 07:22:25.276840 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:22:25.276809 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-6h7kw" event={"ID":"a8fc4c21-3234-45f2-8210-3065895e0eb6","Type":"ContainerStarted","Data":"b74e4eb9f35f3d2a2b830d79706d5c5f2350e4149ebb7631f02d4b3959cd975b"} Sep 17 07:22:25.278232 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:22:25.278211 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5d69dcb864-hck5p" event={"ID":"5d07cc07-43a4-401e-831f-e77bd2d21b82","Type":"ContainerStarted","Data":"1dc50059a52d876213518823be814ceb8792c30e431f814a3fd681cfa290eb20"} Sep 17 07:22:25.278353 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:22:25.278250 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5d69dcb864-hck5p" event={"ID":"5d07cc07-43a4-401e-831f-e77bd2d21b82","Type":"ContainerStarted","Data":"58e46e0512bd5be6b23d223f80f5a0e9e29ea8c00246974d197f28dec25664e4"} Sep 17 07:22:25.278422 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:22:25.278358 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-5d69dcb864-hck5p" Sep 17 07:22:25.331386 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:22:25.331335 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-5d69dcb864-hck5p" podStartSLOduration=162.331319405 podStartE2EDuration="2m42.331319405s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 07:19:43 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 07:22:25.329648975 +0000 UTC m=+163.135595252" watchObservedRunningTime="2026-09-17 07:22:25.331319405 +0000 UTC m=+163.137265679" Sep 17 07:22:25.415048 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:22:25.415016 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-kbcpl"] Sep 17 07:22:25.419863 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:22:25.419840 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-kbcpl" Sep 17 07:22:25.423230 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:22:25.423207 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Sep 17 07:22:25.423548 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:22:25.423533 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-l75mw\"" Sep 17 07:22:25.423737 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:22:25.423723 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Sep 17 07:22:25.424111 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:22:25.424094 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Sep 17 07:22:25.424502 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:22:25.424487 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Sep 17 07:22:25.424820 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:22:25.424806 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Sep 17 07:22:25.424862 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:22:25.424833 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Sep 17 07:22:25.425893 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:22:25.425871 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/bec7cc58-ac7e-4df1-9dea-45690659cdac-node-exporter-wtmp\") pod \"node-exporter-kbcpl\" (UID: \"bec7cc58-ac7e-4df1-9dea-45690659cdac\") " pod="openshift-monitoring/node-exporter-kbcpl" Sep 17 07:22:25.425985 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:22:25.425917 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/bec7cc58-ac7e-4df1-9dea-45690659cdac-metrics-client-ca\") pod \"node-exporter-kbcpl\" (UID: \"bec7cc58-ac7e-4df1-9dea-45690659cdac\") " pod="openshift-monitoring/node-exporter-kbcpl" Sep 17 07:22:25.425985 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:22:25.425964 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/bec7cc58-ac7e-4df1-9dea-45690659cdac-node-exporter-textfile\") pod \"node-exporter-kbcpl\" (UID: \"bec7cc58-ac7e-4df1-9dea-45690659cdac\") " pod="openshift-monitoring/node-exporter-kbcpl" Sep 17 07:22:25.426059 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:22:25.425993 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/bec7cc58-ac7e-4df1-9dea-45690659cdac-sys\") pod \"node-exporter-kbcpl\" (UID: \"bec7cc58-ac7e-4df1-9dea-45690659cdac\") " pod="openshift-monitoring/node-exporter-kbcpl" Sep 17 07:22:25.426059 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:22:25.426019 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/bec7cc58-ac7e-4df1-9dea-45690659cdac-root\") pod \"node-exporter-kbcpl\" (UID: \"bec7cc58-ac7e-4df1-9dea-45690659cdac\") " pod="openshift-monitoring/node-exporter-kbcpl" Sep 17 07:22:25.426123 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:22:25.426065 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/bec7cc58-ac7e-4df1-9dea-45690659cdac-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-kbcpl\" (UID: \"bec7cc58-ac7e-4df1-9dea-45690659cdac\") " pod="openshift-monitoring/node-exporter-kbcpl" Sep 17 07:22:25.426123 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:22:25.426106 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/bec7cc58-ac7e-4df1-9dea-45690659cdac-node-exporter-accelerators-collector-config\") pod \"node-exporter-kbcpl\" (UID: \"bec7cc58-ac7e-4df1-9dea-45690659cdac\") " pod="openshift-monitoring/node-exporter-kbcpl" Sep 17 07:22:25.426182 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:22:25.426137 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cgmlw\" (UniqueName: \"kubernetes.io/projected/bec7cc58-ac7e-4df1-9dea-45690659cdac-kube-api-access-cgmlw\") pod \"node-exporter-kbcpl\" (UID: \"bec7cc58-ac7e-4df1-9dea-45690659cdac\") " pod="openshift-monitoring/node-exporter-kbcpl" Sep 17 07:22:25.426182 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:22:25.426174 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/bec7cc58-ac7e-4df1-9dea-45690659cdac-node-exporter-tls\") pod \"node-exporter-kbcpl\" (UID: \"bec7cc58-ac7e-4df1-9dea-45690659cdac\") " pod="openshift-monitoring/node-exporter-kbcpl" Sep 17 07:22:25.443823 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:22:25.443792 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9skpb_96c5b8e5-2fc0-489b-8889-52bf66184838/konnectivity-agent/0.log" limit=1024 Sep 17 07:22:25.526650 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:22:25.526557 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/bec7cc58-ac7e-4df1-9dea-45690659cdac-metrics-client-ca\") pod \"node-exporter-kbcpl\" (UID: \"bec7cc58-ac7e-4df1-9dea-45690659cdac\") " pod="openshift-monitoring/node-exporter-kbcpl" Sep 17 07:22:25.526650 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:22:25.526595 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/bec7cc58-ac7e-4df1-9dea-45690659cdac-node-exporter-textfile\") pod \"node-exporter-kbcpl\" (UID: \"bec7cc58-ac7e-4df1-9dea-45690659cdac\") " pod="openshift-monitoring/node-exporter-kbcpl" Sep 17 07:22:25.526650 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:22:25.526613 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/bec7cc58-ac7e-4df1-9dea-45690659cdac-sys\") pod \"node-exporter-kbcpl\" (UID: \"bec7cc58-ac7e-4df1-9dea-45690659cdac\") " pod="openshift-monitoring/node-exporter-kbcpl" Sep 17 07:22:25.526650 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:22:25.526630 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/bec7cc58-ac7e-4df1-9dea-45690659cdac-root\") pod \"node-exporter-kbcpl\" (UID: \"bec7cc58-ac7e-4df1-9dea-45690659cdac\") " pod="openshift-monitoring/node-exporter-kbcpl" Sep 17 07:22:25.526992 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:22:25.526684 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/bec7cc58-ac7e-4df1-9dea-45690659cdac-root\") pod \"node-exporter-kbcpl\" (UID: \"bec7cc58-ac7e-4df1-9dea-45690659cdac\") " pod="openshift-monitoring/node-exporter-kbcpl" Sep 17 07:22:25.526992 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:22:25.526712 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/bec7cc58-ac7e-4df1-9dea-45690659cdac-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-kbcpl\" (UID: \"bec7cc58-ac7e-4df1-9dea-45690659cdac\") " pod="openshift-monitoring/node-exporter-kbcpl" Sep 17 07:22:25.526992 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:22:25.526711 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/bec7cc58-ac7e-4df1-9dea-45690659cdac-sys\") pod \"node-exporter-kbcpl\" (UID: \"bec7cc58-ac7e-4df1-9dea-45690659cdac\") " pod="openshift-monitoring/node-exporter-kbcpl" Sep 17 07:22:25.526992 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:22:25.526736 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/bec7cc58-ac7e-4df1-9dea-45690659cdac-node-exporter-accelerators-collector-config\") pod \"node-exporter-kbcpl\" (UID: \"bec7cc58-ac7e-4df1-9dea-45690659cdac\") " pod="openshift-monitoring/node-exporter-kbcpl" Sep 17 07:22:25.526992 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:22:25.526764 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cgmlw\" (UniqueName: \"kubernetes.io/projected/bec7cc58-ac7e-4df1-9dea-45690659cdac-kube-api-access-cgmlw\") pod \"node-exporter-kbcpl\" (UID: \"bec7cc58-ac7e-4df1-9dea-45690659cdac\") " pod="openshift-monitoring/node-exporter-kbcpl" Sep 17 07:22:25.526992 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:22:25.526793 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/bec7cc58-ac7e-4df1-9dea-45690659cdac-node-exporter-tls\") pod \"node-exporter-kbcpl\" (UID: \"bec7cc58-ac7e-4df1-9dea-45690659cdac\") " pod="openshift-monitoring/node-exporter-kbcpl" Sep 17 07:22:25.526992 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:22:25.526818 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/bec7cc58-ac7e-4df1-9dea-45690659cdac-node-exporter-wtmp\") pod \"node-exporter-kbcpl\" (UID: \"bec7cc58-ac7e-4df1-9dea-45690659cdac\") " pod="openshift-monitoring/node-exporter-kbcpl" Sep 17 07:22:25.526992 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:22:25.526989 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/bec7cc58-ac7e-4df1-9dea-45690659cdac-node-exporter-wtmp\") pod \"node-exporter-kbcpl\" (UID: \"bec7cc58-ac7e-4df1-9dea-45690659cdac\") " pod="openshift-monitoring/node-exporter-kbcpl" Sep 17 07:22:25.527288 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:22:25.527034 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/bec7cc58-ac7e-4df1-9dea-45690659cdac-node-exporter-textfile\") pod \"node-exporter-kbcpl\" (UID: \"bec7cc58-ac7e-4df1-9dea-45690659cdac\") " pod="openshift-monitoring/node-exporter-kbcpl" Sep 17 07:22:25.527325 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:22:25.527296 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/bec7cc58-ac7e-4df1-9dea-45690659cdac-metrics-client-ca\") pod \"node-exporter-kbcpl\" (UID: \"bec7cc58-ac7e-4df1-9dea-45690659cdac\") " pod="openshift-monitoring/node-exporter-kbcpl" Sep 17 07:22:25.527356 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:22:25.527329 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/bec7cc58-ac7e-4df1-9dea-45690659cdac-node-exporter-accelerators-collector-config\") pod \"node-exporter-kbcpl\" (UID: \"bec7cc58-ac7e-4df1-9dea-45690659cdac\") " pod="openshift-monitoring/node-exporter-kbcpl" Sep 17 07:22:25.529329 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:22:25.529299 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/bec7cc58-ac7e-4df1-9dea-45690659cdac-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-kbcpl\" (UID: \"bec7cc58-ac7e-4df1-9dea-45690659cdac\") " pod="openshift-monitoring/node-exporter-kbcpl" Sep 17 07:22:25.529432 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:22:25.529412 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/bec7cc58-ac7e-4df1-9dea-45690659cdac-node-exporter-tls\") pod \"node-exporter-kbcpl\" (UID: \"bec7cc58-ac7e-4df1-9dea-45690659cdac\") " pod="openshift-monitoring/node-exporter-kbcpl" Sep 17 07:22:25.566491 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:22:25.566451 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cgmlw\" (UniqueName: \"kubernetes.io/projected/bec7cc58-ac7e-4df1-9dea-45690659cdac-kube-api-access-cgmlw\") pod \"node-exporter-kbcpl\" (UID: \"bec7cc58-ac7e-4df1-9dea-45690659cdac\") " pod="openshift-monitoring/node-exporter-kbcpl" Sep 17 07:22:25.634275 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:22:25.634128 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9skpb_96c5b8e5-2fc0-489b-8889-52bf66184838/konnectivity-agent/0.log" limit=1024 Sep 17 07:22:25.719646 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:22:25.719601 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9skpb_96c5b8e5-2fc0-489b-8889-52bf66184838/konnectivity-agent/0.log" limit=1024 Sep 17 07:22:25.729534 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:22:25.729503 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-kbcpl" Sep 17 07:22:25.741590 ip-10-0-132-17 kubenswrapper[2561]: W0917 07:22:25.741561 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbec7cc58_ac7e_4df1_9dea_45690659cdac.slice/crio-4c0e2802ff315b8345c0e08e07cd89f6fd8963e5714569675a03cad7bdfd0aca WatchSource:0}: Error finding container 4c0e2802ff315b8345c0e08e07cd89f6fd8963e5714569675a03cad7bdfd0aca: Status 404 returned error can't find the container with id 4c0e2802ff315b8345c0e08e07cd89f6fd8963e5714569675a03cad7bdfd0aca Sep 17 07:22:25.917584 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:22:25.917545 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9skpb_96c5b8e5-2fc0-489b-8889-52bf66184838/konnectivity-agent/0.log" limit=1024 Sep 17 07:22:26.284154 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:22:26.284060 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-kbcpl" event={"ID":"bec7cc58-ac7e-4df1-9dea-45690659cdac","Type":"ContainerStarted","Data":"4c0e2802ff315b8345c0e08e07cd89f6fd8963e5714569675a03cad7bdfd0aca"} Sep 17 07:22:26.372401 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:22:26.372360 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9skpb_96c5b8e5-2fc0-489b-8889-52bf66184838/konnectivity-agent/0.log" limit=1024 Sep 17 07:22:26.548476 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:22:26.548372 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9skpb_96c5b8e5-2fc0-489b-8889-52bf66184838/konnectivity-agent/0.log" limit=1024 Sep 17 07:22:26.697726 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:22:26.697693 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9skpb_96c5b8e5-2fc0-489b-8889-52bf66184838/konnectivity-agent/0.log" limit=1024 Sep 17 07:22:27.289259 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:22:27.289196 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-6h7kw" event={"ID":"a8fc4c21-3234-45f2-8210-3065895e0eb6","Type":"ContainerStarted","Data":"4fb90590bc582b33d4b96d467e15d6fd1e633bf9a409bdf80bf2271b88e86906"} Sep 17 07:22:27.290890 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:22:27.290870 2561 generic.go:356] "Generic (PLEG): container finished" podID="bec7cc58-ac7e-4df1-9dea-45690659cdac" containerID="a73917a628956801525fb7e829f935ec6689e4d9db7690c3dac3a59661f4279f" exitCode=0 Sep 17 07:22:27.290991 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:22:27.290961 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-kbcpl" event={"ID":"bec7cc58-ac7e-4df1-9dea-45690659cdac","Type":"ContainerDied","Data":"a73917a628956801525fb7e829f935ec6689e4d9db7690c3dac3a59661f4279f"} Sep 17 07:22:27.292530 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:22:27.292511 2561 generic.go:356] "Generic (PLEG): container finished" podID="4d02ff8a-5500-45eb-96c8-c9c0129c4c62" containerID="592ef962952425dd1df0335a93c2cbb62fb855b0faab5baea9ae1d7931179c0f" exitCode=255 Sep 17 07:22:27.292637 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:22:27.292549 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-587566598b-6kkq9" event={"ID":"4d02ff8a-5500-45eb-96c8-c9c0129c4c62","Type":"ContainerDied","Data":"592ef962952425dd1df0335a93c2cbb62fb855b0faab5baea9ae1d7931179c0f"} Sep 17 07:22:27.292818 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:22:27.292805 2561 scope.go:117] "RemoveContainer" containerID="592ef962952425dd1df0335a93c2cbb62fb855b0faab5baea9ae1d7931179c0f" Sep 17 07:22:27.926749 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:22:27.926650 2561 prober.go:120] "Probe failed" probeType="Readiness" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-78f65bbf85-k6js8" podUID="fb4d76d4-1b13-4143-94ef-b7098405fbdd" containerName="acm-agent" probeResult="failure" output="Get \"http://10.132.0.6:8000/readyz\": dial tcp 10.132.0.6:8000: connect: connection refused" Sep 17 07:22:28.301034 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:22:28.300946 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-587566598b-6kkq9" event={"ID":"4d02ff8a-5500-45eb-96c8-c9c0129c4c62","Type":"ContainerStarted","Data":"3c9d7df95faa6da83bb6b165aa3a92f907fb0ffc5baf0340690003c96cf06d30"} Sep 17 07:22:28.302627 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:22:28.302595 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-6h7kw" event={"ID":"a8fc4c21-3234-45f2-8210-3065895e0eb6","Type":"ContainerStarted","Data":"4c12d41bf09c0ca21bd4458f3a0e540de7b563f4d8a40192b3c354229037adfa"} Sep 17 07:22:28.302770 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:22:28.302677 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-6h7kw" Sep 17 07:22:28.304598 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:22:28.304563 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-kbcpl" event={"ID":"bec7cc58-ac7e-4df1-9dea-45690659cdac","Type":"ContainerStarted","Data":"a6f17498d67fa5f73acf34ea53ce32887614fdbc002fff26017df85c314998b3"} Sep 17 07:22:28.304727 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:22:28.304621 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-kbcpl" event={"ID":"bec7cc58-ac7e-4df1-9dea-45690659cdac","Type":"ContainerStarted","Data":"f3ad269cce3a1c852cd7a499f16fb8d60ff7e4b038cc61d099e93d40e60b42b9"} Sep 17 07:22:28.305836 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:22:28.305817 2561 generic.go:356] "Generic (PLEG): container finished" podID="fb4d76d4-1b13-4143-94ef-b7098405fbdd" containerID="b8d25727304481122e7050714fd56555063fe4a87bd5867786372c29376d5339" exitCode=1 Sep 17 07:22:28.305913 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:22:28.305858 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-78f65bbf85-k6js8" event={"ID":"fb4d76d4-1b13-4143-94ef-b7098405fbdd","Type":"ContainerDied","Data":"b8d25727304481122e7050714fd56555063fe4a87bd5867786372c29376d5339"} Sep 17 07:22:28.306101 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:22:28.306089 2561 scope.go:117] "RemoveContainer" containerID="b8d25727304481122e7050714fd56555063fe4a87bd5867786372c29376d5339" Sep 17 07:22:28.442029 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:22:28.441973 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-6h7kw" podStartSLOduration=130.148775354 podStartE2EDuration="2m12.441954735s" totalImagesPullingTime="2.293179381s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 07:20:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 07:22:28.441564242 +0000 UTC m=+166.247510527" watchObservedRunningTime="2026-09-17 07:22:28.441954735 +0000 UTC m=+166.247901010" Sep 17 07:22:28.557668 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:22:28.557558 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-kbcpl" podStartSLOduration=2.181441019 podStartE2EDuration="3.557538322s" totalImagesPullingTime="1.296032714s" totalInitContainerRuntime="80.064589ms" isStatefulPod=true podCreationTimestamp="2026-09-17 07:22:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 07:22:28.557081668 +0000 UTC m=+166.363027953" watchObservedRunningTime="2026-09-17 07:22:28.557538322 +0000 UTC m=+166.363484597" Sep 17 07:22:28.587890 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:22:28.587853 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9skpb_96c5b8e5-2fc0-489b-8889-52bf66184838/konnectivity-agent/0.log" limit=1024 Sep 17 07:22:28.685176 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:22:28.685152 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9skpb_96c5b8e5-2fc0-489b-8889-52bf66184838/konnectivity-agent/0.log" limit=1024 Sep 17 07:22:28.786284 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:22:28.786260 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9skpb_96c5b8e5-2fc0-489b-8889-52bf66184838/konnectivity-agent/0.log" limit=1024 Sep 17 07:22:28.923981 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:22:28.923952 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9skpb_96c5b8e5-2fc0-489b-8889-52bf66184838/konnectivity-agent/0.log" limit=1024 Sep 17 07:22:29.212744 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:22:29.212663 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9skpb_96c5b8e5-2fc0-489b-8889-52bf66184838/konnectivity-agent/0.log" limit=1024 Sep 17 07:22:29.310672 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:22:29.310639 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-78f65bbf85-k6js8" event={"ID":"fb4d76d4-1b13-4143-94ef-b7098405fbdd","Type":"ContainerStarted","Data":"45b9c3ba3d24e17fa7a08c6a717c99643d1fe76956d867a914a85e51956147e1"} Sep 17 07:22:29.311086 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:22:29.311061 2561 status_manager.go:444] "Container readiness changed for unknown container" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-78f65bbf85-k6js8" containerID="cri-o://b8d25727304481122e7050714fd56555063fe4a87bd5867786372c29376d5339" Sep 17 07:22:29.311159 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:22:29.311097 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-78f65bbf85-k6js8" Sep 17 07:22:29.388883 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:22:29.388861 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9skpb_96c5b8e5-2fc0-489b-8889-52bf66184838/konnectivity-agent/0.log" limit=1024 Sep 17 07:22:29.568335 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:22:29.568271 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9skpb_96c5b8e5-2fc0-489b-8889-52bf66184838/konnectivity-agent/0.log" limit=1024 Sep 17 07:22:29.666232 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:22:29.666202 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9skpb_96c5b8e5-2fc0-489b-8889-52bf66184838/konnectivity-agent/0.log" limit=1024 Sep 17 07:22:29.901865 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:22:29.901832 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9skpb_96c5b8e5-2fc0-489b-8889-52bf66184838/konnectivity-agent/0.log" limit=1024 Sep 17 07:22:30.034573 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:22:30.034535 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9skpb_96c5b8e5-2fc0-489b-8889-52bf66184838/konnectivity-agent/0.log" limit=1024 Sep 17 07:22:30.118695 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:22:30.118660 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9skpb_96c5b8e5-2fc0-489b-8889-52bf66184838/konnectivity-agent/0.log" limit=1024 Sep 17 07:22:30.202205 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:22:30.202117 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9skpb_96c5b8e5-2fc0-489b-8889-52bf66184838/konnectivity-agent/0.log" limit=1024 Sep 17 07:22:30.272071 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:22:30.272037 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9skpb_96c5b8e5-2fc0-489b-8889-52bf66184838/konnectivity-agent/0.log" limit=1024 Sep 17 07:22:30.313622 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:22:30.313599 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-78f65bbf85-k6js8" Sep 17 07:22:30.314194 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:22:30.314178 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-78f65bbf85-k6js8" Sep 17 07:22:30.626506 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:22:30.626461 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9skpb_96c5b8e5-2fc0-489b-8889-52bf66184838/konnectivity-agent/0.log" limit=1024 Sep 17 07:22:30.807468 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:22:30.807438 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9skpb_96c5b8e5-2fc0-489b-8889-52bf66184838/konnectivity-agent/0.log" limit=1024 Sep 17 07:22:31.197430 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:22:31.197395 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9skpb_96c5b8e5-2fc0-489b-8889-52bf66184838/konnectivity-agent/0.log" limit=1024 Sep 17 07:22:31.449465 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:22:31.449380 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9skpb_96c5b8e5-2fc0-489b-8889-52bf66184838/konnectivity-agent/0.log" limit=1024 Sep 17 07:22:31.548206 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:22:31.548171 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9skpb_96c5b8e5-2fc0-489b-8889-52bf66184838/konnectivity-agent/0.log" limit=1024 Sep 17 07:22:31.679835 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:22:31.679815 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mcwtb" Sep 17 07:22:31.923043 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:22:31.923014 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9skpb_96c5b8e5-2fc0-489b-8889-52bf66184838/konnectivity-agent/0.log" limit=1024 Sep 17 07:22:38.313221 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:22:38.313150 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-6h7kw" Sep 17 07:22:43.045050 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:22:43.045017 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9skpb_96c5b8e5-2fc0-489b-8889-52bf66184838/konnectivity-agent/0.log" limit=1024 Sep 17 07:22:43.159479 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:22:43.159451 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9skpb_96c5b8e5-2fc0-489b-8889-52bf66184838/konnectivity-agent/0.log" limit=1024 Sep 17 07:22:44.372102 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:22:44.372062 2561 patch_prober.go:28] interesting pod/image-registry-5d69dcb864-hck5p container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Sep 17 07:22:44.372456 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:22:44.372119 2561 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-5d69dcb864-hck5p" podUID="5d07cc07-43a4-401e-831f-e77bd2d21b82" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Sep 17 07:22:45.223767 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:22:45.223732 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9skpb_96c5b8e5-2fc0-489b-8889-52bf66184838/konnectivity-agent/0.log" limit=1024 Sep 17 07:22:45.311592 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:22:45.311554 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9skpb_96c5b8e5-2fc0-489b-8889-52bf66184838/konnectivity-agent/0.log" limit=1024 Sep 17 07:22:46.289175 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:22:46.289144 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-5d69dcb864-hck5p" Sep 17 07:22:46.438685 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:22:46.438648 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9skpb_96c5b8e5-2fc0-489b-8889-52bf66184838/konnectivity-agent/0.log" limit=1024 Sep 17 07:22:46.539542 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:22:46.539450 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9skpb_96c5b8e5-2fc0-489b-8889-52bf66184838/konnectivity-agent/0.log" limit=1024 Sep 17 07:22:47.544699 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:22:47.544667 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9skpb_96c5b8e5-2fc0-489b-8889-52bf66184838/konnectivity-agent/0.log" limit=1024 Sep 17 07:22:48.025533 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:22:48.025499 2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-5d69dcb864-hck5p"] Sep 17 07:22:48.251948 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:22:48.251899 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9skpb_96c5b8e5-2fc0-489b-8889-52bf66184838/konnectivity-agent/0.log" limit=1024 Sep 17 07:22:48.453909 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:22:48.453868 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9skpb_96c5b8e5-2fc0-489b-8889-52bf66184838/konnectivity-agent/0.log" limit=1024 Sep 17 07:22:48.543451 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:22:48.543413 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9skpb_96c5b8e5-2fc0-489b-8889-52bf66184838/konnectivity-agent/0.log" limit=1024 Sep 17 07:22:51.239291 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:22:51.239252 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9skpb_96c5b8e5-2fc0-489b-8889-52bf66184838/konnectivity-agent/0.log" limit=1024 Sep 17 07:22:51.373383 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:22:51.373345 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9skpb_96c5b8e5-2fc0-489b-8889-52bf66184838/konnectivity-agent/0.log" limit=1024 Sep 17 07:22:51.466907 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:22:51.466869 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9skpb_96c5b8e5-2fc0-489b-8889-52bf66184838/konnectivity-agent/0.log" limit=1024 Sep 17 07:22:56.493580 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:22:56.493544 2561 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7978f59f89-vc9f5" podUID="246f42b6-4802-412b-b611-a0d3d360c537" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500" Sep 17 07:22:58.288802 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:22:58.288763 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9skpb_96c5b8e5-2fc0-489b-8889-52bf66184838/konnectivity-agent/0.log" limit=1024 Sep 17 07:22:59.483283 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:22:59.483245 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9skpb_96c5b8e5-2fc0-489b-8889-52bf66184838/konnectivity-agent/0.log" limit=1024 Sep 17 07:22:59.592360 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:22:59.592321 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9skpb_96c5b8e5-2fc0-489b-8889-52bf66184838/konnectivity-agent/0.log" limit=1024 Sep 17 07:23:06.493486 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:23:06.493446 2561 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7978f59f89-vc9f5" podUID="246f42b6-4802-412b-b611-a0d3d360c537" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500" Sep 17 07:23:07.356753 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:23:07.356713 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9skpb_96c5b8e5-2fc0-489b-8889-52bf66184838/konnectivity-agent/0.log" limit=1024 Sep 17 07:23:07.430376 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:23:07.430338 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9skpb_96c5b8e5-2fc0-489b-8889-52bf66184838/konnectivity-agent/0.log" limit=1024 Sep 17 07:23:08.567913 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:23:08.567875 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9skpb_96c5b8e5-2fc0-489b-8889-52bf66184838/konnectivity-agent/0.log" limit=1024 Sep 17 07:23:08.650644 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:23:08.650610 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9skpb_96c5b8e5-2fc0-489b-8889-52bf66184838/konnectivity-agent/0.log" limit=1024 Sep 17 07:23:13.044110 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:23:13.044063 2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-image-registry/image-registry-5d69dcb864-hck5p" podUID="5d07cc07-43a4-401e-831f-e77bd2d21b82" containerName="registry" containerID="cri-o://1dc50059a52d876213518823be814ceb8792c30e431f814a3fd681cfa290eb20" gracePeriod=30 Sep 17 07:23:13.284996 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:23:13.284971 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5d69dcb864-hck5p" Sep 17 07:23:13.370459 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:23:13.370426 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/5d07cc07-43a4-401e-831f-e77bd2d21b82-trusted-ca\") pod \"5d07cc07-43a4-401e-831f-e77bd2d21b82\" (UID: \"5d07cc07-43a4-401e-831f-e77bd2d21b82\") " Sep 17 07:23:13.370615 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:23:13.370474 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/5d07cc07-43a4-401e-831f-e77bd2d21b82-installation-pull-secrets\") pod \"5d07cc07-43a4-401e-831f-e77bd2d21b82\" (UID: \"5d07cc07-43a4-401e-831f-e77bd2d21b82\") " Sep 17 07:23:13.370615 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:23:13.370500 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/5d07cc07-43a4-401e-831f-e77bd2d21b82-image-registry-private-configuration\") pod \"5d07cc07-43a4-401e-831f-e77bd2d21b82\" (UID: \"5d07cc07-43a4-401e-831f-e77bd2d21b82\") " Sep 17 07:23:13.370711 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:23:13.370620 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/5d07cc07-43a4-401e-831f-e77bd2d21b82-registry-tls\") pod \"5d07cc07-43a4-401e-831f-e77bd2d21b82\" (UID: \"5d07cc07-43a4-401e-831f-e77bd2d21b82\") " Sep 17 07:23:13.370711 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:23:13.370670 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/5d07cc07-43a4-401e-831f-e77bd2d21b82-ca-trust-extracted\") pod \"5d07cc07-43a4-401e-831f-e77bd2d21b82\" (UID: \"5d07cc07-43a4-401e-831f-e77bd2d21b82\") " Sep 17 07:23:13.370793 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:23:13.370714 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/5d07cc07-43a4-401e-831f-e77bd2d21b82-registry-certificates\") pod \"5d07cc07-43a4-401e-831f-e77bd2d21b82\" (UID: \"5d07cc07-43a4-401e-831f-e77bd2d21b82\") " Sep 17 07:23:13.370793 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:23:13.370749 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xwvmf\" (UniqueName: \"kubernetes.io/projected/5d07cc07-43a4-401e-831f-e77bd2d21b82-kube-api-access-xwvmf\") pod \"5d07cc07-43a4-401e-831f-e77bd2d21b82\" (UID: \"5d07cc07-43a4-401e-831f-e77bd2d21b82\") " Sep 17 07:23:13.370793 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:23:13.370782 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/5d07cc07-43a4-401e-831f-e77bd2d21b82-bound-sa-token\") pod \"5d07cc07-43a4-401e-831f-e77bd2d21b82\" (UID: \"5d07cc07-43a4-401e-831f-e77bd2d21b82\") " Sep 17 07:23:13.371098 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:23:13.370889 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5d07cc07-43a4-401e-831f-e77bd2d21b82-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "5d07cc07-43a4-401e-831f-e77bd2d21b82" (UID: "5d07cc07-43a4-401e-831f-e77bd2d21b82"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 17 07:23:13.371272 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:23:13.371207 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5d07cc07-43a4-401e-831f-e77bd2d21b82-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "5d07cc07-43a4-401e-831f-e77bd2d21b82" (UID: "5d07cc07-43a4-401e-831f-e77bd2d21b82"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 17 07:23:13.373301 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:23:13.373251 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5d07cc07-43a4-401e-831f-e77bd2d21b82-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "5d07cc07-43a4-401e-831f-e77bd2d21b82" (UID: "5d07cc07-43a4-401e-831f-e77bd2d21b82"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 17 07:23:13.373384 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:23:13.373324 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5d07cc07-43a4-401e-831f-e77bd2d21b82-kube-api-access-xwvmf" (OuterVolumeSpecName: "kube-api-access-xwvmf") pod "5d07cc07-43a4-401e-831f-e77bd2d21b82" (UID: "5d07cc07-43a4-401e-831f-e77bd2d21b82"). InnerVolumeSpecName "kube-api-access-xwvmf". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 17 07:23:13.373384 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:23:13.373347 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5d07cc07-43a4-401e-831f-e77bd2d21b82-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "5d07cc07-43a4-401e-831f-e77bd2d21b82" (UID: "5d07cc07-43a4-401e-831f-e77bd2d21b82"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 17 07:23:13.373492 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:23:13.373426 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5d07cc07-43a4-401e-831f-e77bd2d21b82-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "5d07cc07-43a4-401e-831f-e77bd2d21b82" (UID: "5d07cc07-43a4-401e-831f-e77bd2d21b82"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 17 07:23:13.373671 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:23:13.373653 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5d07cc07-43a4-401e-831f-e77bd2d21b82-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "5d07cc07-43a4-401e-831f-e77bd2d21b82" (UID: "5d07cc07-43a4-401e-831f-e77bd2d21b82"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 17 07:23:13.379514 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:23:13.379489 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5d07cc07-43a4-401e-831f-e77bd2d21b82-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "5d07cc07-43a4-401e-831f-e77bd2d21b82" (UID: "5d07cc07-43a4-401e-831f-e77bd2d21b82"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 17 07:23:13.453612 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:23:13.453580 2561 generic.go:356] "Generic (PLEG): container finished" podID="5d07cc07-43a4-401e-831f-e77bd2d21b82" containerID="1dc50059a52d876213518823be814ceb8792c30e431f814a3fd681cfa290eb20" exitCode=0 Sep 17 07:23:13.453799 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:23:13.453625 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5d69dcb864-hck5p" event={"ID":"5d07cc07-43a4-401e-831f-e77bd2d21b82","Type":"ContainerDied","Data":"1dc50059a52d876213518823be814ceb8792c30e431f814a3fd681cfa290eb20"} Sep 17 07:23:13.453799 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:23:13.453635 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5d69dcb864-hck5p" Sep 17 07:23:13.453799 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:23:13.453703 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5d69dcb864-hck5p" event={"ID":"5d07cc07-43a4-401e-831f-e77bd2d21b82","Type":"ContainerDied","Data":"58e46e0512bd5be6b23d223f80f5a0e9e29ea8c00246974d197f28dec25664e4"} Sep 17 07:23:13.453799 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:23:13.453731 2561 scope.go:117] "RemoveContainer" containerID="1dc50059a52d876213518823be814ceb8792c30e431f814a3fd681cfa290eb20" Sep 17 07:23:13.462142 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:23:13.462122 2561 scope.go:117] "RemoveContainer" containerID="1dc50059a52d876213518823be814ceb8792c30e431f814a3fd681cfa290eb20" Sep 17 07:23:13.462443 ip-10-0-132-17 kubenswrapper[2561]: E0917 07:23:13.462424 2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1dc50059a52d876213518823be814ceb8792c30e431f814a3fd681cfa290eb20\": container with ID starting with 1dc50059a52d876213518823be814ceb8792c30e431f814a3fd681cfa290eb20 not found: ID does not exist" containerID="1dc50059a52d876213518823be814ceb8792c30e431f814a3fd681cfa290eb20" Sep 17 07:23:13.462493 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:23:13.462452 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1dc50059a52d876213518823be814ceb8792c30e431f814a3fd681cfa290eb20"} err="failed to get container status \"1dc50059a52d876213518823be814ceb8792c30e431f814a3fd681cfa290eb20\": rpc error: code = NotFound desc = could not find container \"1dc50059a52d876213518823be814ceb8792c30e431f814a3fd681cfa290eb20\": container with ID starting with 1dc50059a52d876213518823be814ceb8792c30e431f814a3fd681cfa290eb20 not found: ID does not exist" Sep 17 07:23:13.471807 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:23:13.471786 2561 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/5d07cc07-43a4-401e-831f-e77bd2d21b82-registry-tls\") on node \"ip-10-0-132-17.ec2.internal\" DevicePath \"\"" Sep 17 07:23:13.471807 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:23:13.471807 2561 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/5d07cc07-43a4-401e-831f-e77bd2d21b82-ca-trust-extracted\") on node \"ip-10-0-132-17.ec2.internal\" DevicePath \"\"" Sep 17 07:23:13.471950 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:23:13.471817 2561 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/5d07cc07-43a4-401e-831f-e77bd2d21b82-registry-certificates\") on node \"ip-10-0-132-17.ec2.internal\" DevicePath \"\"" Sep 17 07:23:13.471950 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:23:13.471827 2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xwvmf\" (UniqueName: \"kubernetes.io/projected/5d07cc07-43a4-401e-831f-e77bd2d21b82-kube-api-access-xwvmf\") on node \"ip-10-0-132-17.ec2.internal\" DevicePath \"\"" Sep 17 07:23:13.471950 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:23:13.471836 2561 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/5d07cc07-43a4-401e-831f-e77bd2d21b82-bound-sa-token\") on node \"ip-10-0-132-17.ec2.internal\" DevicePath \"\"" Sep 17 07:23:13.471950 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:23:13.471843 2561 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/5d07cc07-43a4-401e-831f-e77bd2d21b82-trusted-ca\") on node \"ip-10-0-132-17.ec2.internal\" DevicePath \"\"" Sep 17 07:23:13.471950 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:23:13.471851 2561 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/5d07cc07-43a4-401e-831f-e77bd2d21b82-installation-pull-secrets\") on node \"ip-10-0-132-17.ec2.internal\" DevicePath \"\"" Sep 17 07:23:13.471950 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:23:13.471859 2561 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/5d07cc07-43a4-401e-831f-e77bd2d21b82-image-registry-private-configuration\") on node \"ip-10-0-132-17.ec2.internal\" DevicePath \"\"" Sep 17 07:23:13.474669 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:23:13.474646 2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-5d69dcb864-hck5p"] Sep 17 07:23:13.479563 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:23:13.479543 2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-5d69dcb864-hck5p"] Sep 17 07:23:13.984795 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:23:13.984762 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9skpb_96c5b8e5-2fc0-489b-8889-52bf66184838/konnectivity-agent/0.log" limit=1024 Sep 17 07:23:14.085622 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:23:14.085583 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9skpb_96c5b8e5-2fc0-489b-8889-52bf66184838/konnectivity-agent/0.log" limit=1024 Sep 17 07:23:14.684470 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:23:14.684435 2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5d07cc07-43a4-401e-831f-e77bd2d21b82" path="/var/lib/kubelet/pods/5d07cc07-43a4-401e-831f-e77bd2d21b82/volumes" Sep 17 07:23:16.493683 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:23:16.493644 2561 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7978f59f89-vc9f5" podUID="246f42b6-4802-412b-b611-a0d3d360c537" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500" Sep 17 07:23:16.494156 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:23:16.493722 2561 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7978f59f89-vc9f5" Sep 17 07:23:16.494209 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:23:16.494192 2561 kuberuntime_manager.go:1192] "Message for Container of pod" containerName="service-proxy" containerStatusID={"Type":"cri-o","ID":"5e07c5e187639db5871583f516345d1d7a81a9a4a6a135ab54d4c4b6da02e97c"} pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7978f59f89-vc9f5" containerMessage="Container service-proxy failed liveness probe, will be restarted" Sep 17 07:23:16.494245 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:23:16.494230 2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7978f59f89-vc9f5" podUID="246f42b6-4802-412b-b611-a0d3d360c537" containerName="service-proxy" containerID="cri-o://5e07c5e187639db5871583f516345d1d7a81a9a4a6a135ab54d4c4b6da02e97c" gracePeriod=30 Sep 17 07:23:17.470153 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:23:17.470116 2561 generic.go:356] "Generic (PLEG): container finished" podID="246f42b6-4802-412b-b611-a0d3d360c537" containerID="5e07c5e187639db5871583f516345d1d7a81a9a4a6a135ab54d4c4b6da02e97c" exitCode=2 Sep 17 07:23:17.470352 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:23:17.470164 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7978f59f89-vc9f5" event={"ID":"246f42b6-4802-412b-b611-a0d3d360c537","Type":"ContainerDied","Data":"5e07c5e187639db5871583f516345d1d7a81a9a4a6a135ab54d4c4b6da02e97c"} Sep 17 07:23:17.470352 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:23:17.470207 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7978f59f89-vc9f5" event={"ID":"246f42b6-4802-412b-b611-a0d3d360c537","Type":"ContainerStarted","Data":"7eb6010d66be75f458a2580d5c62ccf5fe47e78b774697d7fec64196b01f46a3"} Sep 17 07:23:28.991320 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:23:28.991283 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9skpb_96c5b8e5-2fc0-489b-8889-52bf66184838/konnectivity-agent/0.log" limit=1024 Sep 17 07:23:29.060119 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:23:29.060088 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9skpb_96c5b8e5-2fc0-489b-8889-52bf66184838/konnectivity-agent/0.log" limit=1024 Sep 17 07:23:35.387102 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:23:35.387054 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9skpb_96c5b8e5-2fc0-489b-8889-52bf66184838/konnectivity-agent/0.log" limit=1024 Sep 17 07:23:44.943586 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:23:44.943544 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9skpb_96c5b8e5-2fc0-489b-8889-52bf66184838/konnectivity-agent/0.log" limit=1024 Sep 17 07:23:45.235450 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:23:45.235355 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9skpb_96c5b8e5-2fc0-489b-8889-52bf66184838/konnectivity-agent/0.log" limit=1024 Sep 17 07:23:54.570250 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:23:54.570203 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e6c12e07-53e7-4f30-a8bf-c5d1a727d2fb-metrics-certs\") pod \"network-metrics-daemon-mcwtb\" (UID: \"e6c12e07-53e7-4f30-a8bf-c5d1a727d2fb\") " pod="openshift-multus/network-metrics-daemon-mcwtb" Sep 17 07:23:54.572679 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:23:54.572647 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e6c12e07-53e7-4f30-a8bf-c5d1a727d2fb-metrics-certs\") pod \"network-metrics-daemon-mcwtb\" (UID: \"e6c12e07-53e7-4f30-a8bf-c5d1a727d2fb\") " pod="openshift-multus/network-metrics-daemon-mcwtb" Sep 17 07:23:54.573275 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:23:54.573248 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9skpb_96c5b8e5-2fc0-489b-8889-52bf66184838/konnectivity-agent/0.log" limit=1024 Sep 17 07:23:54.673412 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:23:54.673373 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9skpb_96c5b8e5-2fc0-489b-8889-52bf66184838/konnectivity-agent/0.log" limit=1024 Sep 17 07:23:54.783680 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:23:54.783653 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-lkdnc\"" Sep 17 07:23:54.791140 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:23:54.791120 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mcwtb" Sep 17 07:23:55.061293 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:23:55.061261 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-mcwtb"] Sep 17 07:23:55.064360 ip-10-0-132-17 kubenswrapper[2561]: W0917 07:23:55.064336 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode6c12e07_53e7_4f30_a8bf_c5d1a727d2fb.slice/crio-e650c72d092d0b976223534e1d7832ec3cabd98c119bc583682e8fa47f43d2b1 WatchSource:0}: Error finding container e650c72d092d0b976223534e1d7832ec3cabd98c119bc583682e8fa47f43d2b1: Status 404 returned error can't find the container with id e650c72d092d0b976223534e1d7832ec3cabd98c119bc583682e8fa47f43d2b1 Sep 17 07:23:55.596762 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:23:55.596727 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-mcwtb" event={"ID":"e6c12e07-53e7-4f30-a8bf-c5d1a727d2fb","Type":"ContainerStarted","Data":"e650c72d092d0b976223534e1d7832ec3cabd98c119bc583682e8fa47f43d2b1"} Sep 17 07:23:56.602385 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:23:56.602299 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-mcwtb" event={"ID":"e6c12e07-53e7-4f30-a8bf-c5d1a727d2fb","Type":"ContainerStarted","Data":"1a86173a5eece9cb042b80c0cc10ea930a54846af68282de7d963c9ba560a0c8"} Sep 17 07:23:56.602385 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:23:56.602358 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-mcwtb" event={"ID":"e6c12e07-53e7-4f30-a8bf-c5d1a727d2fb","Type":"ContainerStarted","Data":"cc17b81f61b4bb0a56581eec52e22b20dc577c5cf13a6aa4b570d61ce75f1333"} Sep 17 07:23:56.619248 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:23:56.619197 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-mcwtb" podStartSLOduration=253.351119276 podStartE2EDuration="4m14.619181351s" totalImagesPullingTime="1.268062075s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 07:19:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 07:23:56.618885336 +0000 UTC m=+254.424831612" watchObservedRunningTime="2026-09-17 07:23:56.619181351 +0000 UTC m=+254.425127627" Sep 17 07:23:56.740969 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:23:56.740912 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9skpb_96c5b8e5-2fc0-489b-8889-52bf66184838/konnectivity-agent/0.log" limit=1024 Sep 17 07:23:56.839379 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:23:56.839351 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9skpb_96c5b8e5-2fc0-489b-8889-52bf66184838/konnectivity-agent/0.log" limit=1024 Sep 17 07:24:05.631570 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:24:05.631478 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9skpb_96c5b8e5-2fc0-489b-8889-52bf66184838/konnectivity-agent/0.log" limit=1024 Sep 17 07:24:05.743320 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:24:05.743288 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9skpb_96c5b8e5-2fc0-489b-8889-52bf66184838/konnectivity-agent/0.log" limit=1024 Sep 17 07:24:05.811744 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:24:05.811709 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9skpb_96c5b8e5-2fc0-489b-8889-52bf66184838/konnectivity-agent/0.log" limit=1024 Sep 17 07:24:07.564960 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:24:07.564909 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9skpb_96c5b8e5-2fc0-489b-8889-52bf66184838/konnectivity-agent/0.log" limit=1024 Sep 17 07:24:07.622176 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:24:07.622142 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9skpb_96c5b8e5-2fc0-489b-8889-52bf66184838/konnectivity-agent/0.log" limit=1024 Sep 17 07:24:07.678640 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:24:07.678587 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9skpb_96c5b8e5-2fc0-489b-8889-52bf66184838/konnectivity-agent/0.log" limit=1024 Sep 17 07:24:08.844501 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:24:08.844467 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9skpb_96c5b8e5-2fc0-489b-8889-52bf66184838/konnectivity-agent/0.log" limit=1024 Sep 17 07:24:08.945467 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:24:08.945428 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9skpb_96c5b8e5-2fc0-489b-8889-52bf66184838/konnectivity-agent/0.log" limit=1024 Sep 17 07:24:33.574262 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:24:33.574224 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9skpb_96c5b8e5-2fc0-489b-8889-52bf66184838/konnectivity-agent/0.log" limit=1024 Sep 17 07:24:42.621690 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:24:42.621661 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2frz9_0b5240b1-13ea-4cee-b7f1-aa241ca58aa4/ovn-acl-logging/0.log" Sep 17 07:24:42.628189 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:24:42.628168 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2frz9_0b5240b1-13ea-4cee-b7f1-aa241ca58aa4/ovn-acl-logging/0.log" Sep 17 07:24:42.628724 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:24:42.628704 2561 kubelet.go:1648] "Image garbage collection succeeded" Sep 17 07:24:46.156373 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:24:46.156334 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9skpb_96c5b8e5-2fc0-489b-8889-52bf66184838/konnectivity-agent/0.log" limit=1024 Sep 17 07:24:46.212410 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:24:46.212360 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9skpb_96c5b8e5-2fc0-489b-8889-52bf66184838/konnectivity-agent/0.log" limit=1024 Sep 17 07:25:00.256257 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:25:00.256214 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9skpb_96c5b8e5-2fc0-489b-8889-52bf66184838/konnectivity-agent/0.log" limit=1024 Sep 17 07:25:00.377399 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:25:00.377367 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9skpb_96c5b8e5-2fc0-489b-8889-52bf66184838/konnectivity-agent/0.log" limit=1024 Sep 17 07:25:12.298611 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:25:12.298558 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9skpb_96c5b8e5-2fc0-489b-8889-52bf66184838/konnectivity-agent/0.log" limit=1024 Sep 17 07:25:12.451441 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:25:12.451411 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9skpb_96c5b8e5-2fc0-489b-8889-52bf66184838/konnectivity-agent/0.log" limit=1024 Sep 17 07:25:20.326126 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:25:20.326073 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9skpb_96c5b8e5-2fc0-489b-8889-52bf66184838/konnectivity-agent/0.log" limit=1024 Sep 17 07:25:20.423673 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:25:20.423628 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9skpb_96c5b8e5-2fc0-489b-8889-52bf66184838/konnectivity-agent/0.log" limit=1024 Sep 17 07:25:29.016501 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:25:29.016465 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9skpb_96c5b8e5-2fc0-489b-8889-52bf66184838/konnectivity-agent/0.log" limit=1024 Sep 17 07:25:29.118121 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:25:29.118083 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9skpb_96c5b8e5-2fc0-489b-8889-52bf66184838/konnectivity-agent/0.log" limit=1024 Sep 17 07:25:30.958408 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:25:30.958373 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9skpb_96c5b8e5-2fc0-489b-8889-52bf66184838/konnectivity-agent/0.log" limit=1024 Sep 17 07:25:31.060418 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:25:31.060387 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9skpb_96c5b8e5-2fc0-489b-8889-52bf66184838/konnectivity-agent/0.log" limit=1024 Sep 17 07:25:31.125147 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:25:31.125093 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9skpb_96c5b8e5-2fc0-489b-8889-52bf66184838/konnectivity-agent/0.log" limit=1024 Sep 17 07:25:31.186362 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:25:31.186323 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9skpb_96c5b8e5-2fc0-489b-8889-52bf66184838/konnectivity-agent/0.log" limit=1024 Sep 17 07:27:28.848135 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:27:28.848048 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9skpb_96c5b8e5-2fc0-489b-8889-52bf66184838/konnectivity-agent/0.log" limit=1024 Sep 17 07:27:34.405111 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:27:34.405074 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9skpb_96c5b8e5-2fc0-489b-8889-52bf66184838/konnectivity-agent/0.log" limit=1024 Sep 17 07:27:34.478723 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:27:34.478691 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9skpb_96c5b8e5-2fc0-489b-8889-52bf66184838/konnectivity-agent/0.log" limit=1024 Sep 17 07:27:38.610251 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:27:38.610213 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9skpb_96c5b8e5-2fc0-489b-8889-52bf66184838/konnectivity-agent/0.log" limit=1024 Sep 17 07:27:38.746715 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:27:38.746689 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9skpb_96c5b8e5-2fc0-489b-8889-52bf66184838/konnectivity-agent/0.log" limit=1024 Sep 17 07:27:39.585084 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:27:39.585051 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9skpb_96c5b8e5-2fc0-489b-8889-52bf66184838/konnectivity-agent/0.log" limit=1024 Sep 17 07:27:45.506542 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:27:45.506507 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9skpb_96c5b8e5-2fc0-489b-8889-52bf66184838/konnectivity-agent/0.log" limit=1024 Sep 17 07:27:45.607436 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:27:45.607405 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9skpb_96c5b8e5-2fc0-489b-8889-52bf66184838/konnectivity-agent/0.log" limit=1024 Sep 17 07:27:45.710211 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:27:45.710182 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9skpb_96c5b8e5-2fc0-489b-8889-52bf66184838/konnectivity-agent/0.log" limit=1024 Sep 17 07:28:17.453636 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:28:17.453604 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9skpb_96c5b8e5-2fc0-489b-8889-52bf66184838/konnectivity-agent/0.log" limit=1024 Sep 17 07:28:17.557778 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:28:17.557751 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9skpb_96c5b8e5-2fc0-489b-8889-52bf66184838/konnectivity-agent/0.log" limit=1024 Sep 17 07:28:18.162610 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:28:18.162574 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9skpb_96c5b8e5-2fc0-489b-8889-52bf66184838/konnectivity-agent/0.log" limit=1024 Sep 17 07:28:18.288560 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:28:18.288522 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9skpb_96c5b8e5-2fc0-489b-8889-52bf66184838/konnectivity-agent/0.log" limit=1024 Sep 17 07:28:18.477624 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:28:18.477542 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9skpb_96c5b8e5-2fc0-489b-8889-52bf66184838/konnectivity-agent/0.log" limit=1024 Sep 17 07:28:18.636657 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:28:18.636624 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9skpb_96c5b8e5-2fc0-489b-8889-52bf66184838/konnectivity-agent/0.log" limit=1024 Sep 17 07:28:18.760239 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:28:18.760162 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9skpb_96c5b8e5-2fc0-489b-8889-52bf66184838/konnectivity-agent/0.log" limit=1024 Sep 17 07:28:18.870183 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:28:18.870155 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9skpb_96c5b8e5-2fc0-489b-8889-52bf66184838/konnectivity-agent/0.log" limit=1024 Sep 17 07:29:14.299250 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:29:14.299211 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9skpb_96c5b8e5-2fc0-489b-8889-52bf66184838/konnectivity-agent/0.log" limit=1024 Sep 17 07:29:42.642781 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:29:42.642753 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2frz9_0b5240b1-13ea-4cee-b7f1-aa241ca58aa4/ovn-acl-logging/0.log" Sep 17 07:29:42.651565 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:29:42.651545 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2frz9_0b5240b1-13ea-4cee-b7f1-aa241ca58aa4/ovn-acl-logging/0.log" Sep 17 07:30:16.565612 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:30:16.565489 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9skpb_96c5b8e5-2fc0-489b-8889-52bf66184838/konnectivity-agent/0.log" limit=1024 Sep 17 07:30:16.671373 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:30:16.671343 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9skpb_96c5b8e5-2fc0-489b-8889-52bf66184838/konnectivity-agent/0.log" limit=1024 Sep 17 07:30:16.860406 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:30:16.860303 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9skpb_96c5b8e5-2fc0-489b-8889-52bf66184838/konnectivity-agent/0.log" limit=1024 Sep 17 07:30:16.959939 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:30:16.959910 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9skpb_96c5b8e5-2fc0-489b-8889-52bf66184838/konnectivity-agent/0.log" limit=1024 Sep 17 07:30:17.183644 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:30:17.183613 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9skpb_96c5b8e5-2fc0-489b-8889-52bf66184838/konnectivity-agent/0.log" limit=1024 Sep 17 07:30:17.358197 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:30:17.358165 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9skpb_96c5b8e5-2fc0-489b-8889-52bf66184838/konnectivity-agent/0.log" limit=1024 Sep 17 07:30:17.567126 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:30:17.567043 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9skpb_96c5b8e5-2fc0-489b-8889-52bf66184838/konnectivity-agent/0.log" limit=1024 Sep 17 07:30:17.700587 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:30:17.700559 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9skpb_96c5b8e5-2fc0-489b-8889-52bf66184838/konnectivity-agent/0.log" limit=1024 Sep 17 07:30:27.557106 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:30:27.557068 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9skpb_96c5b8e5-2fc0-489b-8889-52bf66184838/konnectivity-agent/0.log" limit=1024 Sep 17 07:30:39.444189 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:30:39.444153 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9skpb_96c5b8e5-2fc0-489b-8889-52bf66184838/konnectivity-agent/0.log" limit=1024 Sep 17 07:30:46.405267 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:30:46.405233 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9skpb_96c5b8e5-2fc0-489b-8889-52bf66184838/konnectivity-agent/0.log" limit=1024 Sep 17 07:30:57.912114 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:30:57.912083 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9skpb_96c5b8e5-2fc0-489b-8889-52bf66184838/konnectivity-agent/0.log" limit=1024 Sep 17 07:31:41.515948 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:31:41.515839 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9skpb_96c5b8e5-2fc0-489b-8889-52bf66184838/konnectivity-agent/0.log" limit=1024 Sep 17 07:31:41.616785 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:31:41.616750 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9skpb_96c5b8e5-2fc0-489b-8889-52bf66184838/konnectivity-agent/0.log" limit=1024 Sep 17 07:31:41.977694 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:31:41.977666 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9skpb_96c5b8e5-2fc0-489b-8889-52bf66184838/konnectivity-agent/0.log" limit=1024 Sep 17 07:31:42.077333 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:31:42.077285 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9skpb_96c5b8e5-2fc0-489b-8889-52bf66184838/konnectivity-agent/0.log" limit=1024 Sep 17 07:31:42.225449 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:31:42.225417 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9skpb_96c5b8e5-2fc0-489b-8889-52bf66184838/konnectivity-agent/0.log" limit=1024 Sep 17 07:31:42.303578 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:31:42.303487 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9skpb_96c5b8e5-2fc0-489b-8889-52bf66184838/konnectivity-agent/0.log" limit=1024 Sep 17 07:32:25.064772 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:32:25.064736 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9skpb_96c5b8e5-2fc0-489b-8889-52bf66184838/konnectivity-agent/0.log" limit=1024 Sep 17 07:33:26.389646 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:33:26.389534 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9skpb_96c5b8e5-2fc0-489b-8889-52bf66184838/konnectivity-agent/0.log" limit=1024 Sep 17 07:33:28.327579 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:33:28.327545 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9skpb_96c5b8e5-2fc0-489b-8889-52bf66184838/konnectivity-agent/0.log" limit=1024 Sep 17 07:33:31.660520 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:33:31.660480 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9skpb_96c5b8e5-2fc0-489b-8889-52bf66184838/konnectivity-agent/0.log" limit=1024 Sep 17 07:33:57.622584 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:33:57.622548 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9skpb_96c5b8e5-2fc0-489b-8889-52bf66184838/konnectivity-agent/0.log" limit=1024 Sep 17 07:34:09.616249 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:34:09.616162 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9skpb_96c5b8e5-2fc0-489b-8889-52bf66184838/konnectivity-agent/0.log" limit=1024 Sep 17 07:34:09.899574 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:34:09.899478 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9skpb_96c5b8e5-2fc0-489b-8889-52bf66184838/konnectivity-agent/0.log" limit=1024 Sep 17 07:34:10.004265 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:34:10.004234 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9skpb_96c5b8e5-2fc0-489b-8889-52bf66184838/konnectivity-agent/0.log" limit=1024 Sep 17 07:34:20.636490 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:34:20.636446 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9skpb_96c5b8e5-2fc0-489b-8889-52bf66184838/konnectivity-agent/0.log" limit=1024 Sep 17 07:34:20.737167 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:34:20.737132 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9skpb_96c5b8e5-2fc0-489b-8889-52bf66184838/konnectivity-agent/0.log" limit=1024 Sep 17 07:34:20.933461 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:34:20.933379 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9skpb_96c5b8e5-2fc0-489b-8889-52bf66184838/konnectivity-agent/0.log" limit=1024 Sep 17 07:34:21.035727 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:34:21.035697 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9skpb_96c5b8e5-2fc0-489b-8889-52bf66184838/konnectivity-agent/0.log" limit=1024 Sep 17 07:34:21.187313 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:34:21.187229 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9skpb_96c5b8e5-2fc0-489b-8889-52bf66184838/konnectivity-agent/0.log" limit=1024 Sep 17 07:34:42.663576 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:34:42.663494 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2frz9_0b5240b1-13ea-4cee-b7f1-aa241ca58aa4/ovn-acl-logging/0.log" Sep 17 07:34:42.669434 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:34:42.669411 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2frz9_0b5240b1-13ea-4cee-b7f1-aa241ca58aa4/ovn-acl-logging/0.log" Sep 17 07:34:46.210115 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:34:46.210084 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9skpb_96c5b8e5-2fc0-489b-8889-52bf66184838/konnectivity-agent/0.log" limit=1024 Sep 17 07:34:47.754356 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:34:47.754329 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["test-ns-feast/feast-test-apply-ck6bh"] Sep 17 07:34:47.754760 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:34:47.754555 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5d07cc07-43a4-401e-831f-e77bd2d21b82" containerName="registry" Sep 17 07:34:47.754760 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:34:47.754565 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="5d07cc07-43a4-401e-831f-e77bd2d21b82" containerName="registry" Sep 17 07:34:47.754760 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:34:47.754616 2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="5d07cc07-43a4-401e-831f-e77bd2d21b82" containerName="registry" Sep 17 07:34:47.757269 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:34:47.757253 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-test-apply-ck6bh" Sep 17 07:34:47.761727 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:34:47.761705 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast\"/\"kube-root-ca.crt\"" Sep 17 07:34:47.761727 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:34:47.761726 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast\"/\"feast-credit-scoring-intra-comm\"" Sep 17 07:34:47.762899 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:34:47.762871 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast\"/\"openshift-service-ca.crt\"" Sep 17 07:34:47.763020 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:34:47.762909 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-credit-scoring-cronjob-dockercfg-xdr66\"" Sep 17 07:34:47.793048 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:34:47.793026 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/feast-test-apply-ck6bh"] Sep 17 07:34:47.948220 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:34:47.948185 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mhgkt\" (UniqueName: \"kubernetes.io/projected/ecb17596-0247-4093-99f2-277e6615b36b-kube-api-access-mhgkt\") pod \"feast-test-apply-ck6bh\" (UID: \"ecb17596-0247-4093-99f2-277e6615b36b\") " pod="test-ns-feast/feast-test-apply-ck6bh" Sep 17 07:34:48.048638 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:34:48.048577 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mhgkt\" (UniqueName: \"kubernetes.io/projected/ecb17596-0247-4093-99f2-277e6615b36b-kube-api-access-mhgkt\") pod \"feast-test-apply-ck6bh\" (UID: \"ecb17596-0247-4093-99f2-277e6615b36b\") " pod="test-ns-feast/feast-test-apply-ck6bh" Sep 17 07:34:48.063395 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:34:48.063372 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mhgkt\" (UniqueName: \"kubernetes.io/projected/ecb17596-0247-4093-99f2-277e6615b36b-kube-api-access-mhgkt\") pod \"feast-test-apply-ck6bh\" (UID: \"ecb17596-0247-4093-99f2-277e6615b36b\") " pod="test-ns-feast/feast-test-apply-ck6bh" Sep 17 07:34:48.066116 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:34:48.066102 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-test-apply-ck6bh" Sep 17 07:34:48.343260 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:34:48.343186 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/feast-test-apply-ck6bh"] Sep 17 07:34:48.346363 ip-10-0-132-17 kubenswrapper[2561]: W0917 07:34:48.346336 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podecb17596_0247_4093_99f2_277e6615b36b.slice/crio-baf2532c002879dfc161dd9884ca0e0590b6b6b1f4716bafd9861b8629174301 WatchSource:0}: Error finding container baf2532c002879dfc161dd9884ca0e0590b6b6b1f4716bafd9861b8629174301: Status 404 returned error can't find the container with id baf2532c002879dfc161dd9884ca0e0590b6b6b1f4716bafd9861b8629174301 Sep 17 07:34:48.348094 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:34:48.348078 2561 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Sep 17 07:34:48.707129 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:34:48.707093 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-test-apply-ck6bh" event={"ID":"ecb17596-0247-4093-99f2-277e6615b36b","Type":"ContainerStarted","Data":"baf2532c002879dfc161dd9884ca0e0590b6b6b1f4716bafd9861b8629174301"} Sep 17 07:34:53.725561 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:34:53.725524 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-test-apply-ck6bh" event={"ID":"ecb17596-0247-4093-99f2-277e6615b36b","Type":"ContainerStarted","Data":"01a304b231699dfd01b3358bb9320c37ef9318ff90d4cada62d22f1eb3a13200"} Sep 17 07:34:59.746126 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:34:59.746087 2561 generic.go:356] "Generic (PLEG): container finished" podID="ecb17596-0247-4093-99f2-277e6615b36b" containerID="01a304b231699dfd01b3358bb9320c37ef9318ff90d4cada62d22f1eb3a13200" exitCode=0 Sep 17 07:34:59.746483 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:34:59.746133 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-test-apply-ck6bh" event={"ID":"ecb17596-0247-4093-99f2-277e6615b36b","Type":"ContainerDied","Data":"01a304b231699dfd01b3358bb9320c37ef9318ff90d4cada62d22f1eb3a13200"} Sep 17 07:35:00.751559 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:35:00.751525 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-test-apply-ck6bh" event={"ID":"ecb17596-0247-4093-99f2-277e6615b36b","Type":"ContainerStarted","Data":"0290a66457be9ae6cc3a0f4d803d73d8cb5304bf0110c6de878bd0d5810230b8"} Sep 17 07:35:00.797890 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:35:00.797834 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="test-ns-feast/feast-test-apply-ck6bh" podStartSLOduration=2.545520804 podStartE2EDuration="13.797819113s" totalImagesPullingTime="4.843625048s" totalInitContainerRuntime="6.408673261s" isStatefulPod=false podCreationTimestamp="2026-09-17 07:34:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 07:35:00.796942881 +0000 UTC m=+918.602889147" watchObservedRunningTime="2026-09-17 07:35:00.797819113 +0000 UTC m=+918.603765387" Sep 17 07:35:09.781586 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:35:09.781550 2561 generic.go:356] "Generic (PLEG): container finished" podID="ecb17596-0247-4093-99f2-277e6615b36b" containerID="0290a66457be9ae6cc3a0f4d803d73d8cb5304bf0110c6de878bd0d5810230b8" exitCode=0 Sep 17 07:35:09.781586 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:35:09.781597 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-test-apply-ck6bh" event={"ID":"ecb17596-0247-4093-99f2-277e6615b36b","Type":"ContainerDied","Data":"0290a66457be9ae6cc3a0f4d803d73d8cb5304bf0110c6de878bd0d5810230b8"} Sep 17 07:35:10.909661 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:35:10.909637 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-test-apply-ck6bh" Sep 17 07:35:11.005739 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:35:11.005709 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mhgkt\" (UniqueName: \"kubernetes.io/projected/ecb17596-0247-4093-99f2-277e6615b36b-kube-api-access-mhgkt\") pod \"ecb17596-0247-4093-99f2-277e6615b36b\" (UID: \"ecb17596-0247-4093-99f2-277e6615b36b\") " Sep 17 07:35:11.008059 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:35:11.008034 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ecb17596-0247-4093-99f2-277e6615b36b-kube-api-access-mhgkt" (OuterVolumeSpecName: "kube-api-access-mhgkt") pod "ecb17596-0247-4093-99f2-277e6615b36b" (UID: "ecb17596-0247-4093-99f2-277e6615b36b"). InnerVolumeSpecName "kube-api-access-mhgkt". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 17 07:35:11.106357 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:35:11.106273 2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mhgkt\" (UniqueName: \"kubernetes.io/projected/ecb17596-0247-4093-99f2-277e6615b36b-kube-api-access-mhgkt\") on node \"ip-10-0-132-17.ec2.internal\" DevicePath \"\"" Sep 17 07:35:11.789241 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:35:11.789200 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-test-apply-ck6bh" event={"ID":"ecb17596-0247-4093-99f2-277e6615b36b","Type":"ContainerDied","Data":"baf2532c002879dfc161dd9884ca0e0590b6b6b1f4716bafd9861b8629174301"} Sep 17 07:35:11.789420 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:35:11.789252 2561 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="baf2532c002879dfc161dd9884ca0e0590b6b6b1f4716bafd9861b8629174301" Sep 17 07:35:11.789420 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:35:11.789273 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-test-apply-ck6bh" Sep 17 07:35:11.968151 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:35:11.968097 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-feast_feast-test-apply-ck6bh_ecb17596-0247-4093-99f2-277e6615b36b/feast-0/0.log" Sep 17 07:35:11.976839 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:35:11.976817 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-feast_feast-test-apply-ck6bh_ecb17596-0247-4093-99f2-277e6615b36b/feast-1/0.log" Sep 17 07:35:43.941632 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:35:43.941598 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9skpb_96c5b8e5-2fc0-489b-8889-52bf66184838/konnectivity-agent/0.log" limit=1024 Sep 17 07:35:48.934027 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:35:48.933998 2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast/feast-test-apply-ck6bh"] Sep 17 07:35:48.946092 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:35:48.946066 2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["test-ns-feast/feast-test-apply-ck6bh"] Sep 17 07:35:49.063262 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:35:49.063229 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9skpb_96c5b8e5-2fc0-489b-8889-52bf66184838/konnectivity-agent/0.log" limit=1024 Sep 17 07:35:50.684229 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:35:50.684196 2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ecb17596-0247-4093-99f2-277e6615b36b" path="/var/lib/kubelet/pods/ecb17596-0247-4093-99f2-277e6615b36b/volumes" Sep 17 07:36:27.307794 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:36:27.307706 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9skpb_96c5b8e5-2fc0-489b-8889-52bf66184838/konnectivity-agent/0.log" limit=1024 Sep 17 07:36:27.406944 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:36:27.406902 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9skpb_96c5b8e5-2fc0-489b-8889-52bf66184838/konnectivity-agent/0.log" limit=1024 Sep 17 07:36:27.517201 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:36:27.517172 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9skpb_96c5b8e5-2fc0-489b-8889-52bf66184838/konnectivity-agent/0.log" limit=1024 Sep 17 07:36:27.652240 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:36:27.652205 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9skpb_96c5b8e5-2fc0-489b-8889-52bf66184838/konnectivity-agent/0.log" limit=1024 Sep 17 07:36:28.243502 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:36:28.243473 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9skpb_96c5b8e5-2fc0-489b-8889-52bf66184838/konnectivity-agent/0.log" limit=1024 Sep 17 07:37:09.770649 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:37:09.770619 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9skpb_96c5b8e5-2fc0-489b-8889-52bf66184838/konnectivity-agent/0.log" limit=1024 Sep 17 07:37:09.843153 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:37:09.843122 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9skpb_96c5b8e5-2fc0-489b-8889-52bf66184838/konnectivity-agent/0.log" limit=1024 Sep 17 07:38:38.865006 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:38:38.864975 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9skpb_96c5b8e5-2fc0-489b-8889-52bf66184838/konnectivity-agent/0.log" limit=1024 Sep 17 07:38:40.467142 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:38:40.467107 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9skpb_96c5b8e5-2fc0-489b-8889-52bf66184838/konnectivity-agent/0.log" limit=1024 Sep 17 07:38:44.564431 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:38:44.564401 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9skpb_96c5b8e5-2fc0-489b-8889-52bf66184838/konnectivity-agent/0.log" limit=1024 Sep 17 07:38:50.160963 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:38:50.160894 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9skpb_96c5b8e5-2fc0-489b-8889-52bf66184838/konnectivity-agent/0.log" limit=1024 Sep 17 07:38:50.436428 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:38:50.436345 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9skpb_96c5b8e5-2fc0-489b-8889-52bf66184838/konnectivity-agent/0.log" limit=1024 Sep 17 07:38:50.920257 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:38:50.920223 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9skpb_96c5b8e5-2fc0-489b-8889-52bf66184838/konnectivity-agent/0.log" limit=1024 Sep 17 07:39:12.726749 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:39:12.726662 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9skpb_96c5b8e5-2fc0-489b-8889-52bf66184838/konnectivity-agent/0.log" limit=1024 Sep 17 07:39:15.957144 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:39:15.957113 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9skpb_96c5b8e5-2fc0-489b-8889-52bf66184838/konnectivity-agent/0.log" limit=1024 Sep 17 07:39:16.075268 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:39:16.075240 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9skpb_96c5b8e5-2fc0-489b-8889-52bf66184838/konnectivity-agent/0.log" limit=1024 Sep 17 07:39:16.203114 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:39:16.203079 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9skpb_96c5b8e5-2fc0-489b-8889-52bf66184838/konnectivity-agent/0.log" limit=1024 Sep 17 07:39:16.303018 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:39:16.302925 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9skpb_96c5b8e5-2fc0-489b-8889-52bf66184838/konnectivity-agent/0.log" limit=1024 Sep 17 07:39:42.684207 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:39:42.684177 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2frz9_0b5240b1-13ea-4cee-b7f1-aa241ca58aa4/ovn-acl-logging/0.log" Sep 17 07:39:42.689240 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:39:42.689221 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2frz9_0b5240b1-13ea-4cee-b7f1-aa241ca58aa4/ovn-acl-logging/0.log" Sep 17 07:41:01.818014 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:41:01.817957 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9skpb_96c5b8e5-2fc0-489b-8889-52bf66184838/konnectivity-agent/0.log" limit=1024 Sep 17 07:41:03.822800 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:41:03.822734 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9skpb_96c5b8e5-2fc0-489b-8889-52bf66184838/konnectivity-agent/0.log" limit=1024 Sep 17 07:41:05.364306 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:41:05.364268 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9skpb_96c5b8e5-2fc0-489b-8889-52bf66184838/konnectivity-agent/0.log" limit=1024 Sep 17 07:41:05.496110 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:41:05.496076 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9skpb_96c5b8e5-2fc0-489b-8889-52bf66184838/konnectivity-agent/0.log" limit=1024 Sep 17 07:41:06.815339 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:41:06.815307 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9skpb_96c5b8e5-2fc0-489b-8889-52bf66184838/konnectivity-agent/0.log" limit=1024 Sep 17 07:41:09.641656 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:41:09.641629 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9skpb_96c5b8e5-2fc0-489b-8889-52bf66184838/konnectivity-agent/0.log" limit=1024 Sep 17 07:41:09.716407 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:41:09.716377 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9skpb_96c5b8e5-2fc0-489b-8889-52bf66184838/konnectivity-agent/0.log" limit=1024 Sep 17 07:41:15.083561 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:41:15.083521 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9skpb_96c5b8e5-2fc0-489b-8889-52bf66184838/konnectivity-agent/0.log" limit=1024 Sep 17 07:41:15.216466 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:41:15.216414 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9skpb_96c5b8e5-2fc0-489b-8889-52bf66184838/konnectivity-agent/0.log" limit=1024 Sep 17 07:41:15.894943 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:41:15.894899 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9skpb_96c5b8e5-2fc0-489b-8889-52bf66184838/konnectivity-agent/0.log" limit=1024 Sep 17 07:41:15.897673 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:41:15.897652 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["feast-operator-system/feast-operator-controller-manager-689b877b4b-mx2rs"] Sep 17 07:41:15.897869 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:41:15.897858 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ecb17596-0247-4093-99f2-277e6615b36b" containerName="feast-0" Sep 17 07:41:15.897914 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:41:15.897871 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="ecb17596-0247-4093-99f2-277e6615b36b" containerName="feast-0" Sep 17 07:41:15.897914 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:41:15.897884 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ecb17596-0247-4093-99f2-277e6615b36b" containerName="feast-1" Sep 17 07:41:15.897914 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:41:15.897890 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="ecb17596-0247-4093-99f2-277e6615b36b" containerName="feast-1" Sep 17 07:41:15.898020 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:41:15.897944 2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="ecb17596-0247-4093-99f2-277e6615b36b" containerName="feast-1" Sep 17 07:41:15.900456 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:41:15.900438 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="feast-operator-system/feast-operator-controller-manager-689b877b4b-mx2rs" Sep 17 07:41:15.903262 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:41:15.903231 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"feast-operator-system\"/\"kube-root-ca.crt\"" Sep 17 07:41:15.903383 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:41:15.903232 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"feast-operator-system\"/\"openshift-service-ca.crt\"" Sep 17 07:41:15.904300 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:41:15.904282 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"feast-operator-system\"/\"feast-operator-controller-manager-dockercfg-87bph\"" Sep 17 07:41:15.914293 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:41:15.914269 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["feast-operator-system/feast-operator-controller-manager-689b877b4b-mx2rs"] Sep 17 07:41:16.007569 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:41:16.007546 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8pkm7\" (UniqueName: \"kubernetes.io/projected/c0b900e9-1a37-421a-8464-183ad367dc3c-kube-api-access-8pkm7\") pod \"feast-operator-controller-manager-689b877b4b-mx2rs\" (UID: \"c0b900e9-1a37-421a-8464-183ad367dc3c\") " pod="feast-operator-system/feast-operator-controller-manager-689b877b4b-mx2rs" Sep 17 07:41:16.108837 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:41:16.108810 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8pkm7\" (UniqueName: \"kubernetes.io/projected/c0b900e9-1a37-421a-8464-183ad367dc3c-kube-api-access-8pkm7\") pod \"feast-operator-controller-manager-689b877b4b-mx2rs\" (UID: \"c0b900e9-1a37-421a-8464-183ad367dc3c\") " pod="feast-operator-system/feast-operator-controller-manager-689b877b4b-mx2rs" Sep 17 07:41:16.119438 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:41:16.119410 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8pkm7\" (UniqueName: \"kubernetes.io/projected/c0b900e9-1a37-421a-8464-183ad367dc3c-kube-api-access-8pkm7\") pod \"feast-operator-controller-manager-689b877b4b-mx2rs\" (UID: \"c0b900e9-1a37-421a-8464-183ad367dc3c\") " pod="feast-operator-system/feast-operator-controller-manager-689b877b4b-mx2rs" Sep 17 07:41:16.209344 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:41:16.209280 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="feast-operator-system/feast-operator-controller-manager-689b877b4b-mx2rs" Sep 17 07:41:16.479317 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:41:16.479242 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["feast-operator-system/feast-operator-controller-manager-689b877b4b-mx2rs"] Sep 17 07:41:16.486364 ip-10-0-132-17 kubenswrapper[2561]: W0917 07:41:16.486333 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc0b900e9_1a37_421a_8464_183ad367dc3c.slice/crio-f2e798346b89020dee751483a33458a5eed03d04b30effa94ae7569147a6566b WatchSource:0}: Error finding container f2e798346b89020dee751483a33458a5eed03d04b30effa94ae7569147a6566b: Status 404 returned error can't find the container with id f2e798346b89020dee751483a33458a5eed03d04b30effa94ae7569147a6566b Sep 17 07:41:16.488367 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:41:16.488350 2561 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Sep 17 07:41:16.971377 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:41:16.971342 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="feast-operator-system/feast-operator-controller-manager-689b877b4b-mx2rs" event={"ID":"c0b900e9-1a37-421a-8464-183ad367dc3c","Type":"ContainerStarted","Data":"f2e798346b89020dee751483a33458a5eed03d04b30effa94ae7569147a6566b"} Sep 17 07:41:18.979127 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:41:18.979095 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="feast-operator-system/feast-operator-controller-manager-689b877b4b-mx2rs" event={"ID":"c0b900e9-1a37-421a-8464-183ad367dc3c","Type":"ContainerStarted","Data":"f17507cfaf98da27eb1bb94af32f82fc40c086558886c738818be02561a2e172"} Sep 17 07:41:18.979638 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:41:18.979223 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="feast-operator-system/feast-operator-controller-manager-689b877b4b-mx2rs" Sep 17 07:41:29.985556 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:41:29.985524 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="feast-operator-system/feast-operator-controller-manager-689b877b4b-mx2rs" Sep 17 07:41:30.018462 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:41:30.018415 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="feast-operator-system/feast-operator-controller-manager-689b877b4b-mx2rs" podStartSLOduration=13.287303265 podStartE2EDuration="15.018401962s" totalImagesPullingTime="1.731098697s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 07:41:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 07:41:19.011694305 +0000 UTC m=+1296.817640589" watchObservedRunningTime="2026-09-17 07:41:30.018401962 +0000 UTC m=+1307.824348239" Sep 17 07:41:32.189671 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:41:32.189636 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9skpb_96c5b8e5-2fc0-489b-8889-52bf66184838/konnectivity-agent/0.log" limit=1024 Sep 17 07:41:32.373440 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:41:32.373410 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9skpb_96c5b8e5-2fc0-489b-8889-52bf66184838/konnectivity-agent/0.log" limit=1024 Sep 17 07:41:32.819518 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:41:32.819484 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9skpb_96c5b8e5-2fc0-489b-8889-52bf66184838/konnectivity-agent/0.log" limit=1024 Sep 17 07:41:32.920151 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:41:32.920114 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9skpb_96c5b8e5-2fc0-489b-8889-52bf66184838/konnectivity-agent/0.log" limit=1024 Sep 17 07:41:32.981054 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:41:32.981022 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["test-ns-feast/feast-simple-feast-setup-57576b8fcf-b2g6j"] Sep 17 07:41:32.985287 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:41:32.985271 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-b2g6j" Sep 17 07:41:32.988492 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:41:32.988471 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast\"/\"kube-root-ca.crt\"" Sep 17 07:41:32.988614 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:41:32.988600 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-online-tls\"" Sep 17 07:41:32.989025 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:41:32.989008 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-registry-tls\"" Sep 17 07:41:32.989106 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:41:32.989090 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-ui-tls\"" Sep 17 07:41:32.989226 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:41:32.989212 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-offline-tls\"" Sep 17 07:41:32.989309 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:41:32.989268 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-dockercfg-vxt72\"" Sep 17 07:41:32.989558 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:41:32.989544 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast\"/\"openshift-service-ca.crt\"" Sep 17 07:41:33.001385 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:41:33.001362 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-57576b8fcf-b2g6j"] Sep 17 07:41:33.013998 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:41:33.013973 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/4c15e90b-53e0-46d5-8fa2-ea0b4f2a9852-registry-tls\") pod \"feast-simple-feast-setup-57576b8fcf-b2g6j\" (UID: \"4c15e90b-53e0-46d5-8fa2-ea0b4f2a9852\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-b2g6j" Sep 17 07:41:33.013998 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:41:33.013998 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/4c15e90b-53e0-46d5-8fa2-ea0b4f2a9852-offline-tls\") pod \"feast-simple-feast-setup-57576b8fcf-b2g6j\" (UID: \"4c15e90b-53e0-46d5-8fa2-ea0b4f2a9852\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-b2g6j" Sep 17 07:41:33.014144 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:41:33.014018 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/4c15e90b-53e0-46d5-8fa2-ea0b4f2a9852-online-tls\") pod \"feast-simple-feast-setup-57576b8fcf-b2g6j\" (UID: \"4c15e90b-53e0-46d5-8fa2-ea0b4f2a9852\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-b2g6j" Sep 17 07:41:33.014144 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:41:33.014038 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/4c15e90b-53e0-46d5-8fa2-ea0b4f2a9852-feast-data\") pod \"feast-simple-feast-setup-57576b8fcf-b2g6j\" (UID: \"4c15e90b-53e0-46d5-8fa2-ea0b4f2a9852\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-b2g6j" Sep 17 07:41:33.014144 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:41:33.014057 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-btmtc\" (UniqueName: \"kubernetes.io/projected/4c15e90b-53e0-46d5-8fa2-ea0b4f2a9852-kube-api-access-btmtc\") pod \"feast-simple-feast-setup-57576b8fcf-b2g6j\" (UID: \"4c15e90b-53e0-46d5-8fa2-ea0b4f2a9852\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-b2g6j" Sep 17 07:41:33.014144 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:41:33.014133 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/4c15e90b-53e0-46d5-8fa2-ea0b4f2a9852-ui-tls\") pod \"feast-simple-feast-setup-57576b8fcf-b2g6j\" (UID: \"4c15e90b-53e0-46d5-8fa2-ea0b4f2a9852\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-b2g6j" Sep 17 07:41:33.051533 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:41:33.051506 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9skpb_96c5b8e5-2fc0-489b-8889-52bf66184838/konnectivity-agent/0.log" limit=1024 Sep 17 07:41:33.115415 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:41:33.115343 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/4c15e90b-53e0-46d5-8fa2-ea0b4f2a9852-registry-tls\") pod \"feast-simple-feast-setup-57576b8fcf-b2g6j\" (UID: \"4c15e90b-53e0-46d5-8fa2-ea0b4f2a9852\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-b2g6j" Sep 17 07:41:33.115415 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:41:33.115373 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/4c15e90b-53e0-46d5-8fa2-ea0b4f2a9852-offline-tls\") pod \"feast-simple-feast-setup-57576b8fcf-b2g6j\" (UID: \"4c15e90b-53e0-46d5-8fa2-ea0b4f2a9852\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-b2g6j" Sep 17 07:41:33.115415 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:41:33.115393 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/4c15e90b-53e0-46d5-8fa2-ea0b4f2a9852-online-tls\") pod \"feast-simple-feast-setup-57576b8fcf-b2g6j\" (UID: \"4c15e90b-53e0-46d5-8fa2-ea0b4f2a9852\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-b2g6j" Sep 17 07:41:33.115639 ip-10-0-132-17 kubenswrapper[2561]: E0917 07:41:33.115484 2561 secret.go:189] Couldn't get secret test-ns-feast/feast-simple-feast-setup-registry-tls: secret "feast-simple-feast-setup-registry-tls" not found Sep 17 07:41:33.115639 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:41:33.115505 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/4c15e90b-53e0-46d5-8fa2-ea0b4f2a9852-feast-data\") pod \"feast-simple-feast-setup-57576b8fcf-b2g6j\" (UID: \"4c15e90b-53e0-46d5-8fa2-ea0b4f2a9852\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-b2g6j" Sep 17 07:41:33.115639 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:41:33.115535 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-btmtc\" (UniqueName: \"kubernetes.io/projected/4c15e90b-53e0-46d5-8fa2-ea0b4f2a9852-kube-api-access-btmtc\") pod \"feast-simple-feast-setup-57576b8fcf-b2g6j\" (UID: \"4c15e90b-53e0-46d5-8fa2-ea0b4f2a9852\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-b2g6j" Sep 17 07:41:33.115639 ip-10-0-132-17 kubenswrapper[2561]: E0917 07:41:33.115554 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4c15e90b-53e0-46d5-8fa2-ea0b4f2a9852-registry-tls podName:4c15e90b-53e0-46d5-8fa2-ea0b4f2a9852 nodeName:}" failed. No retries permitted until 2026-09-17 07:41:33.615538991 +0000 UTC m=+1311.421485243 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/secret/4c15e90b-53e0-46d5-8fa2-ea0b4f2a9852-registry-tls") pod "feast-simple-feast-setup-57576b8fcf-b2g6j" (UID: "4c15e90b-53e0-46d5-8fa2-ea0b4f2a9852") : secret "feast-simple-feast-setup-registry-tls" not found Sep 17 07:41:33.115639 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:41:33.115605 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/4c15e90b-53e0-46d5-8fa2-ea0b4f2a9852-ui-tls\") pod \"feast-simple-feast-setup-57576b8fcf-b2g6j\" (UID: \"4c15e90b-53e0-46d5-8fa2-ea0b4f2a9852\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-b2g6j" Sep 17 07:41:33.115639 ip-10-0-132-17 kubenswrapper[2561]: E0917 07:41:33.115638 2561 secret.go:189] Couldn't get secret test-ns-feast/feast-simple-feast-setup-online-tls: secret "feast-simple-feast-setup-online-tls" not found Sep 17 07:41:33.115892 ip-10-0-132-17 kubenswrapper[2561]: E0917 07:41:33.115704 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4c15e90b-53e0-46d5-8fa2-ea0b4f2a9852-online-tls podName:4c15e90b-53e0-46d5-8fa2-ea0b4f2a9852 nodeName:}" failed. No retries permitted until 2026-09-17 07:41:33.615686433 +0000 UTC m=+1311.421632703 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "online-tls" (UniqueName: "kubernetes.io/secret/4c15e90b-53e0-46d5-8fa2-ea0b4f2a9852-online-tls") pod "feast-simple-feast-setup-57576b8fcf-b2g6j" (UID: "4c15e90b-53e0-46d5-8fa2-ea0b4f2a9852") : secret "feast-simple-feast-setup-online-tls" not found Sep 17 07:41:33.115956 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:41:33.115904 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/4c15e90b-53e0-46d5-8fa2-ea0b4f2a9852-feast-data\") pod \"feast-simple-feast-setup-57576b8fcf-b2g6j\" (UID: \"4c15e90b-53e0-46d5-8fa2-ea0b4f2a9852\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-b2g6j" Sep 17 07:41:33.117869 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:41:33.117843 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/4c15e90b-53e0-46d5-8fa2-ea0b4f2a9852-offline-tls\") pod \"feast-simple-feast-setup-57576b8fcf-b2g6j\" (UID: \"4c15e90b-53e0-46d5-8fa2-ea0b4f2a9852\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-b2g6j" Sep 17 07:41:33.117977 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:41:33.117876 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/4c15e90b-53e0-46d5-8fa2-ea0b4f2a9852-ui-tls\") pod \"feast-simple-feast-setup-57576b8fcf-b2g6j\" (UID: \"4c15e90b-53e0-46d5-8fa2-ea0b4f2a9852\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-b2g6j" Sep 17 07:41:33.132253 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:41:33.132230 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-btmtc\" (UniqueName: \"kubernetes.io/projected/4c15e90b-53e0-46d5-8fa2-ea0b4f2a9852-kube-api-access-btmtc\") pod \"feast-simple-feast-setup-57576b8fcf-b2g6j\" (UID: \"4c15e90b-53e0-46d5-8fa2-ea0b4f2a9852\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-b2g6j" Sep 17 07:41:33.135305 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:41:33.135284 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9skpb_96c5b8e5-2fc0-489b-8889-52bf66184838/konnectivity-agent/0.log" limit=1024 Sep 17 07:41:33.269376 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:41:33.269341 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9skpb_96c5b8e5-2fc0-489b-8889-52bf66184838/konnectivity-agent/0.log" limit=1024 Sep 17 07:41:33.369125 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:41:33.369095 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9skpb_96c5b8e5-2fc0-489b-8889-52bf66184838/konnectivity-agent/0.log" limit=1024 Sep 17 07:41:33.618534 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:41:33.618504 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/4c15e90b-53e0-46d5-8fa2-ea0b4f2a9852-registry-tls\") pod \"feast-simple-feast-setup-57576b8fcf-b2g6j\" (UID: \"4c15e90b-53e0-46d5-8fa2-ea0b4f2a9852\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-b2g6j" Sep 17 07:41:33.618717 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:41:33.618617 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/4c15e90b-53e0-46d5-8fa2-ea0b4f2a9852-online-tls\") pod \"feast-simple-feast-setup-57576b8fcf-b2g6j\" (UID: \"4c15e90b-53e0-46d5-8fa2-ea0b4f2a9852\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-b2g6j" Sep 17 07:41:33.621283 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:41:33.621211 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/4c15e90b-53e0-46d5-8fa2-ea0b4f2a9852-registry-tls\") pod \"feast-simple-feast-setup-57576b8fcf-b2g6j\" (UID: \"4c15e90b-53e0-46d5-8fa2-ea0b4f2a9852\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-b2g6j" Sep 17 07:41:33.621477 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:41:33.621459 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/4c15e90b-53e0-46d5-8fa2-ea0b4f2a9852-online-tls\") pod \"feast-simple-feast-setup-57576b8fcf-b2g6j\" (UID: \"4c15e90b-53e0-46d5-8fa2-ea0b4f2a9852\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-b2g6j" Sep 17 07:41:33.894060 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:41:33.893980 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-b2g6j" Sep 17 07:41:34.176718 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:41:34.176647 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-57576b8fcf-b2g6j"] Sep 17 07:41:34.179969 ip-10-0-132-17 kubenswrapper[2561]: W0917 07:41:34.179924 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod4c15e90b_53e0_46d5_8fa2_ea0b4f2a9852.slice/crio-e922d4e5e0fbf847520ff95d1f21b6e7ba41c35ca6b34d223c29a500ab63b728 WatchSource:0}: Error finding container e922d4e5e0fbf847520ff95d1f21b6e7ba41c35ca6b34d223c29a500ab63b728: Status 404 returned error can't find the container with id e922d4e5e0fbf847520ff95d1f21b6e7ba41c35ca6b34d223c29a500ab63b728 Sep 17 07:41:35.034868 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:41:35.034830 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-b2g6j" event={"ID":"4c15e90b-53e0-46d5-8fa2-ea0b4f2a9852","Type":"ContainerStarted","Data":"e922d4e5e0fbf847520ff95d1f21b6e7ba41c35ca6b34d223c29a500ab63b728"} Sep 17 07:41:42.728314 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:41:42.728282 2561 scope.go:117] "RemoveContainer" containerID="0290a66457be9ae6cc3a0f4d803d73d8cb5304bf0110c6de878bd0d5810230b8" Sep 17 07:41:44.960252 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:41:44.960218 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9skpb_96c5b8e5-2fc0-489b-8889-52bf66184838/konnectivity-agent/0.log" limit=1024 Sep 17 07:41:45.056756 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:41:45.056726 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9skpb_96c5b8e5-2fc0-489b-8889-52bf66184838/konnectivity-agent/0.log" limit=1024 Sep 17 07:41:45.121491 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:41:45.121458 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9skpb_96c5b8e5-2fc0-489b-8889-52bf66184838/konnectivity-agent/0.log" limit=1024 Sep 17 07:41:47.825762 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:41:47.825502 2561 scope.go:117] "RemoveContainer" containerID="01a304b231699dfd01b3358bb9320c37ef9318ff90d4cada62d22f1eb3a13200" Sep 17 07:41:48.085897 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:41:48.085803 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-b2g6j" event={"ID":"4c15e90b-53e0-46d5-8fa2-ea0b4f2a9852","Type":"ContainerStarted","Data":"234124e8fb66a0414b69e8a75ff17bf3c2c230e1a4df020617b8fa54d3fa966c"} Sep 17 07:41:53.104739 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:41:53.104663 2561 generic.go:356] "Generic (PLEG): container finished" podID="4c15e90b-53e0-46d5-8fa2-ea0b4f2a9852" containerID="234124e8fb66a0414b69e8a75ff17bf3c2c230e1a4df020617b8fa54d3fa966c" exitCode=0 Sep 17 07:41:53.104739 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:41:53.104700 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-b2g6j" event={"ID":"4c15e90b-53e0-46d5-8fa2-ea0b4f2a9852","Type":"ContainerDied","Data":"234124e8fb66a0414b69e8a75ff17bf3c2c230e1a4df020617b8fa54d3fa966c"} Sep 17 07:41:54.110609 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:41:54.110572 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-b2g6j" event={"ID":"4c15e90b-53e0-46d5-8fa2-ea0b4f2a9852","Type":"ContainerStarted","Data":"c5686f66e83f10c8533102a184b506f0cbf5dd0d5b9ba6baa2c520eb91e0e41b"} Sep 17 07:41:59.133269 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:41:59.133235 2561 generic.go:356] "Generic (PLEG): container finished" podID="4c15e90b-53e0-46d5-8fa2-ea0b4f2a9852" containerID="c5686f66e83f10c8533102a184b506f0cbf5dd0d5b9ba6baa2c520eb91e0e41b" exitCode=0 Sep 17 07:41:59.133635 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:41:59.133292 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-b2g6j" event={"ID":"4c15e90b-53e0-46d5-8fa2-ea0b4f2a9852","Type":"ContainerDied","Data":"c5686f66e83f10c8533102a184b506f0cbf5dd0d5b9ba6baa2c520eb91e0e41b"} Sep 17 07:42:00.142683 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:42:00.142644 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-b2g6j" event={"ID":"4c15e90b-53e0-46d5-8fa2-ea0b4f2a9852","Type":"ContainerStarted","Data":"5003c0ad9fe7493069492b7c62f1aaf6cf0750f7e64be6d7897df572e9de3911"} Sep 17 07:42:00.143172 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:42:00.142710 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-b2g6j" event={"ID":"4c15e90b-53e0-46d5-8fa2-ea0b4f2a9852","Type":"ContainerStarted","Data":"91ea951bc49feb23361894bf27d4c5f1fac8dde24c6a3bed6faaef50a1cd66e6"} Sep 17 07:42:00.143172 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:42:00.142733 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-b2g6j" event={"ID":"4c15e90b-53e0-46d5-8fa2-ea0b4f2a9852","Type":"ContainerStarted","Data":"71acbc90b54cf06acb4b1156bc1822b3da3977d3c6bc51bb27f4c12102ba7578"} Sep 17 07:42:00.143172 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:42:00.142753 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-b2g6j" event={"ID":"4c15e90b-53e0-46d5-8fa2-ea0b4f2a9852","Type":"ContainerStarted","Data":"6b3e53030ac5c0ef2399bed8e17dcb9b90465b1fca03b75822356ff60181bf5e"} Sep 17 07:42:00.174608 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:42:00.174545 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-b2g6j" podStartSLOduration=14.450433646 podStartE2EDuration="28.174520593s" totalImagesPullingTime="13.724086947s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 07:41:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 07:42:00.172539388 +0000 UTC m=+1337.978485673" watchObservedRunningTime="2026-09-17 07:42:00.174520593 +0000 UTC m=+1337.980466869" Sep 17 07:42:00.895212 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:42:00.895176 2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-b2g6j" Sep 17 07:42:00.895383 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:42:00.895237 2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-b2g6j" Sep 17 07:42:00.895383 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:42:00.895256 2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-b2g6j" Sep 17 07:42:00.895383 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:42:00.895273 2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-b2g6j" Sep 17 07:42:00.897427 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:42:00.897385 2561 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-b2g6j" podUID="4c15e90b-53e0-46d5-8fa2-ea0b4f2a9852" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.15:8443: connect: connection refused" Sep 17 07:42:00.897427 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:42:00.897407 2561 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-b2g6j" podUID="4c15e90b-53e0-46d5-8fa2-ea0b4f2a9852" containerName="registry" probeResult="failure" output="dial tcp 10.132.0.15:6571: connect: connection refused" Sep 17 07:42:00.897616 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:42:00.897425 2561 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-b2g6j" podUID="4c15e90b-53e0-46d5-8fa2-ea0b4f2a9852" containerName="offline" probeResult="failure" output="dial tcp 10.132.0.15:8816: connect: connection refused" Sep 17 07:42:00.897616 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:42:00.897489 2561 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-b2g6j" podUID="4c15e90b-53e0-46d5-8fa2-ea0b4f2a9852" containerName="online" probeResult="failure" output="Get \"https://10.132.0.15:6567/health\": dial tcp 10.132.0.15:6567: connect: connection refused" Sep 17 07:42:02.176109 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:42:02.176061 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9skpb_96c5b8e5-2fc0-489b-8889-52bf66184838/konnectivity-agent/0.log" limit=1024 Sep 17 07:42:03.895070 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:42:03.894972 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-b2g6j" Sep 17 07:42:03.895647 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:42:03.895617 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-b2g6j" Sep 17 07:42:03.895647 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:42:03.895277 2561 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-b2g6j" podUID="4c15e90b-53e0-46d5-8fa2-ea0b4f2a9852" containerName="online" probeResult="failure" output="Get \"https://10.132.0.15:6567/health\": dial tcp 10.132.0.15:6567: connect: connection refused" Sep 17 07:42:03.895827 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:42:03.895318 2561 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-b2g6j" podUID="4c15e90b-53e0-46d5-8fa2-ea0b4f2a9852" containerName="registry" probeResult="failure" output="dial tcp 10.132.0.15:6571: connect: connection refused" Sep 17 07:42:03.895827 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:42:03.895324 2561 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-b2g6j" podUID="4c15e90b-53e0-46d5-8fa2-ea0b4f2a9852" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.15:8443: connect: connection refused" Sep 17 07:42:03.895827 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:42:03.895654 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-b2g6j" Sep 17 07:42:03.895827 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:42:03.895777 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-b2g6j" Sep 17 07:42:03.895827 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:42:03.895287 2561 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-b2g6j" podUID="4c15e90b-53e0-46d5-8fa2-ea0b4f2a9852" containerName="offline" probeResult="failure" output="dial tcp 10.132.0.15:8816: connect: connection refused" Sep 17 07:42:06.894887 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:42:06.894847 2561 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-b2g6j" podUID="4c15e90b-53e0-46d5-8fa2-ea0b4f2a9852" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.15:8443: connect: connection refused" Sep 17 07:42:06.895367 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:42:06.895230 2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-b2g6j" Sep 17 07:42:06.895513 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:42:06.895498 2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-b2g6j" Sep 17 07:42:06.896269 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:42:06.896248 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-b2g6j" Sep 17 07:42:06.896387 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:42:06.896328 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-b2g6j" Sep 17 07:42:06.900141 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:42:06.900126 2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-b2g6j" Sep 17 07:42:07.181618 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:42:07.181540 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-b2g6j" Sep 17 07:42:09.895180 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:42:09.895125 2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-b2g6j" Sep 17 07:42:10.187698 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:42:10.187619 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-b2g6j" Sep 17 07:42:12.297436 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:42:12.297404 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9skpb_96c5b8e5-2fc0-489b-8889-52bf66184838/konnectivity-agent/0.log" limit=1024 Sep 17 07:42:27.409701 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:42:27.409663 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9skpb_96c5b8e5-2fc0-489b-8889-52bf66184838/konnectivity-agent/0.log" limit=1024 Sep 17 07:42:27.607877 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:42:27.607841 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9skpb_96c5b8e5-2fc0-489b-8889-52bf66184838/konnectivity-agent/0.log" limit=1024 Sep 17 07:43:13.288774 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:43:13.288724 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9skpb_96c5b8e5-2fc0-489b-8889-52bf66184838/konnectivity-agent/0.log" limit=1024 Sep 17 07:43:13.315974 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:43:13.315945 2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-57576b8fcf-b2g6j"] Sep 17 07:43:13.316282 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:43:13.316237 2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-b2g6j" podUID="4c15e90b-53e0-46d5-8fa2-ea0b4f2a9852" containerName="registry" containerID="cri-o://6b3e53030ac5c0ef2399bed8e17dcb9b90465b1fca03b75822356ff60181bf5e" gracePeriod=30 Sep 17 07:43:13.316408 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:43:13.316365 2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-b2g6j" podUID="4c15e90b-53e0-46d5-8fa2-ea0b4f2a9852" containerName="online" containerID="cri-o://71acbc90b54cf06acb4b1156bc1822b3da3977d3c6bc51bb27f4c12102ba7578" gracePeriod=30 Sep 17 07:43:13.316480 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:43:13.316428 2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-b2g6j" podUID="4c15e90b-53e0-46d5-8fa2-ea0b4f2a9852" containerName="ui" containerID="cri-o://5003c0ad9fe7493069492b7c62f1aaf6cf0750f7e64be6d7897df572e9de3911" gracePeriod=30 Sep 17 07:43:13.316480 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:43:13.316347 2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-b2g6j" podUID="4c15e90b-53e0-46d5-8fa2-ea0b4f2a9852" containerName="offline" containerID="cri-o://91ea951bc49feb23361894bf27d4c5f1fac8dde24c6a3bed6faaef50a1cd66e6" gracePeriod=30 Sep 17 07:43:13.401167 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:43:13.401134 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9skpb_96c5b8e5-2fc0-489b-8889-52bf66184838/konnectivity-agent/0.log" limit=1024 Sep 17 07:43:13.585883 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:43:13.585776 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9skpb_96c5b8e5-2fc0-489b-8889-52bf66184838/konnectivity-agent/0.log" limit=1024 Sep 17 07:43:13.687806 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:43:13.687763 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9skpb_96c5b8e5-2fc0-489b-8889-52bf66184838/konnectivity-agent/0.log" limit=1024 Sep 17 07:43:13.721166 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:43:13.721130 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["test-ns-feast/feast-simple-feast-setup-57576b8fcf-gq7wc"] Sep 17 07:43:13.724772 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:43:13.724749 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-gq7wc" Sep 17 07:43:13.727960 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:43:13.727922 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-dockercfg-8tzrd\"" Sep 17 07:43:13.755709 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:43:13.755670 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-57576b8fcf-gq7wc"] Sep 17 07:43:13.757324 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:43:13.757292 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/9f6fb216-73d4-4644-8488-7b97e3935c01-registry-tls\") pod \"feast-simple-feast-setup-57576b8fcf-gq7wc\" (UID: \"9f6fb216-73d4-4644-8488-7b97e3935c01\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-gq7wc" Sep 17 07:43:13.757480 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:43:13.757364 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/9f6fb216-73d4-4644-8488-7b97e3935c01-feast-data\") pod \"feast-simple-feast-setup-57576b8fcf-gq7wc\" (UID: \"9f6fb216-73d4-4644-8488-7b97e3935c01\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-gq7wc" Sep 17 07:43:13.757480 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:43:13.757431 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/9f6fb216-73d4-4644-8488-7b97e3935c01-offline-tls\") pod \"feast-simple-feast-setup-57576b8fcf-gq7wc\" (UID: \"9f6fb216-73d4-4644-8488-7b97e3935c01\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-gq7wc" Sep 17 07:43:13.757604 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:43:13.757510 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/9f6fb216-73d4-4644-8488-7b97e3935c01-ui-tls\") pod \"feast-simple-feast-setup-57576b8fcf-gq7wc\" (UID: \"9f6fb216-73d4-4644-8488-7b97e3935c01\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-gq7wc" Sep 17 07:43:13.757604 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:43:13.757566 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/9f6fb216-73d4-4644-8488-7b97e3935c01-online-tls\") pod \"feast-simple-feast-setup-57576b8fcf-gq7wc\" (UID: \"9f6fb216-73d4-4644-8488-7b97e3935c01\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-gq7wc" Sep 17 07:43:13.757694 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:43:13.757605 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hxjhm\" (UniqueName: \"kubernetes.io/projected/9f6fb216-73d4-4644-8488-7b97e3935c01-kube-api-access-hxjhm\") pod \"feast-simple-feast-setup-57576b8fcf-gq7wc\" (UID: \"9f6fb216-73d4-4644-8488-7b97e3935c01\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-gq7wc" Sep 17 07:43:13.851876 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:43:13.851789 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9skpb_96c5b8e5-2fc0-489b-8889-52bf66184838/konnectivity-agent/0.log" limit=1024 Sep 17 07:43:13.857968 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:43:13.857941 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/9f6fb216-73d4-4644-8488-7b97e3935c01-feast-data\") pod \"feast-simple-feast-setup-57576b8fcf-gq7wc\" (UID: \"9f6fb216-73d4-4644-8488-7b97e3935c01\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-gq7wc" Sep 17 07:43:13.858066 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:43:13.857984 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/9f6fb216-73d4-4644-8488-7b97e3935c01-offline-tls\") pod \"feast-simple-feast-setup-57576b8fcf-gq7wc\" (UID: \"9f6fb216-73d4-4644-8488-7b97e3935c01\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-gq7wc" Sep 17 07:43:13.858066 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:43:13.858019 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/9f6fb216-73d4-4644-8488-7b97e3935c01-ui-tls\") pod \"feast-simple-feast-setup-57576b8fcf-gq7wc\" (UID: \"9f6fb216-73d4-4644-8488-7b97e3935c01\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-gq7wc" Sep 17 07:43:13.858066 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:43:13.858060 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/9f6fb216-73d4-4644-8488-7b97e3935c01-online-tls\") pod \"feast-simple-feast-setup-57576b8fcf-gq7wc\" (UID: \"9f6fb216-73d4-4644-8488-7b97e3935c01\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-gq7wc" Sep 17 07:43:13.858219 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:43:13.858091 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hxjhm\" (UniqueName: \"kubernetes.io/projected/9f6fb216-73d4-4644-8488-7b97e3935c01-kube-api-access-hxjhm\") pod \"feast-simple-feast-setup-57576b8fcf-gq7wc\" (UID: \"9f6fb216-73d4-4644-8488-7b97e3935c01\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-gq7wc" Sep 17 07:43:13.858219 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:43:13.858127 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/9f6fb216-73d4-4644-8488-7b97e3935c01-registry-tls\") pod \"feast-simple-feast-setup-57576b8fcf-gq7wc\" (UID: \"9f6fb216-73d4-4644-8488-7b97e3935c01\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-gq7wc" Sep 17 07:43:13.858219 ip-10-0-132-17 kubenswrapper[2561]: E0917 07:43:13.858158 2561 secret.go:189] Couldn't get secret test-ns-feast/feast-simple-feast-setup-ui-tls: secret "feast-simple-feast-setup-ui-tls" not found Sep 17 07:43:13.858367 ip-10-0-132-17 kubenswrapper[2561]: E0917 07:43:13.858230 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9f6fb216-73d4-4644-8488-7b97e3935c01-ui-tls podName:9f6fb216-73d4-4644-8488-7b97e3935c01 nodeName:}" failed. No retries permitted until 2026-09-17 07:43:14.358208546 +0000 UTC m=+1412.164154818 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "ui-tls" (UniqueName: "kubernetes.io/secret/9f6fb216-73d4-4644-8488-7b97e3935c01-ui-tls") pod "feast-simple-feast-setup-57576b8fcf-gq7wc" (UID: "9f6fb216-73d4-4644-8488-7b97e3935c01") : secret "feast-simple-feast-setup-ui-tls" not found Sep 17 07:43:13.858367 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:43:13.858324 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/9f6fb216-73d4-4644-8488-7b97e3935c01-feast-data\") pod \"feast-simple-feast-setup-57576b8fcf-gq7wc\" (UID: \"9f6fb216-73d4-4644-8488-7b97e3935c01\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-gq7wc" Sep 17 07:43:13.860812 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:43:13.860784 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/9f6fb216-73d4-4644-8488-7b97e3935c01-online-tls\") pod \"feast-simple-feast-setup-57576b8fcf-gq7wc\" (UID: \"9f6fb216-73d4-4644-8488-7b97e3935c01\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-gq7wc" Sep 17 07:43:13.861237 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:43:13.861217 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/9f6fb216-73d4-4644-8488-7b97e3935c01-registry-tls\") pod \"feast-simple-feast-setup-57576b8fcf-gq7wc\" (UID: \"9f6fb216-73d4-4644-8488-7b97e3935c01\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-gq7wc" Sep 17 07:43:13.861284 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:43:13.861220 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/9f6fb216-73d4-4644-8488-7b97e3935c01-offline-tls\") pod \"feast-simple-feast-setup-57576b8fcf-gq7wc\" (UID: \"9f6fb216-73d4-4644-8488-7b97e3935c01\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-gq7wc" Sep 17 07:43:13.875077 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:43:13.875053 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hxjhm\" (UniqueName: \"kubernetes.io/projected/9f6fb216-73d4-4644-8488-7b97e3935c01-kube-api-access-hxjhm\") pod \"feast-simple-feast-setup-57576b8fcf-gq7wc\" (UID: \"9f6fb216-73d4-4644-8488-7b97e3935c01\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-gq7wc" Sep 17 07:43:13.964794 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:43:13.964764 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9skpb_96c5b8e5-2fc0-489b-8889-52bf66184838/konnectivity-agent/0.log" limit=1024 Sep 17 07:43:14.362418 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:43:14.362383 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/9f6fb216-73d4-4644-8488-7b97e3935c01-ui-tls\") pod \"feast-simple-feast-setup-57576b8fcf-gq7wc\" (UID: \"9f6fb216-73d4-4644-8488-7b97e3935c01\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-gq7wc" Sep 17 07:43:14.364869 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:43:14.364848 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/9f6fb216-73d4-4644-8488-7b97e3935c01-ui-tls\") pod \"feast-simple-feast-setup-57576b8fcf-gq7wc\" (UID: \"9f6fb216-73d4-4644-8488-7b97e3935c01\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-gq7wc" Sep 17 07:43:14.407746 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:43:14.407686 2561 generic.go:356] "Generic (PLEG): container finished" podID="4c15e90b-53e0-46d5-8fa2-ea0b4f2a9852" containerID="5003c0ad9fe7493069492b7c62f1aaf6cf0750f7e64be6d7897df572e9de3911" exitCode=0 Sep 17 07:43:14.407746 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:43:14.407705 2561 generic.go:356] "Generic (PLEG): container finished" podID="4c15e90b-53e0-46d5-8fa2-ea0b4f2a9852" containerID="71acbc90b54cf06acb4b1156bc1822b3da3977d3c6bc51bb27f4c12102ba7578" exitCode=0 Sep 17 07:43:14.407746 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:43:14.407743 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-b2g6j" event={"ID":"4c15e90b-53e0-46d5-8fa2-ea0b4f2a9852","Type":"ContainerDied","Data":"5003c0ad9fe7493069492b7c62f1aaf6cf0750f7e64be6d7897df572e9de3911"} Sep 17 07:43:14.407966 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:43:14.407772 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-b2g6j" event={"ID":"4c15e90b-53e0-46d5-8fa2-ea0b4f2a9852","Type":"ContainerDied","Data":"71acbc90b54cf06acb4b1156bc1822b3da3977d3c6bc51bb27f4c12102ba7578"} Sep 17 07:43:14.473257 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:43:14.473231 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9skpb_96c5b8e5-2fc0-489b-8889-52bf66184838/konnectivity-agent/0.log" limit=1024 Sep 17 07:43:14.634580 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:43:14.634552 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-gq7wc" Sep 17 07:43:14.911800 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:43:14.911735 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-57576b8fcf-gq7wc"] Sep 17 07:43:14.913744 ip-10-0-132-17 kubenswrapper[2561]: W0917 07:43:14.913708 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod9f6fb216_73d4_4644_8488_7b97e3935c01.slice/crio-1b1975f57515ec1d23ffbe13df095a24f26d7971626f0c96da90f6a5e9d8622b WatchSource:0}: Error finding container 1b1975f57515ec1d23ffbe13df095a24f26d7971626f0c96da90f6a5e9d8622b: Status 404 returned error can't find the container with id 1b1975f57515ec1d23ffbe13df095a24f26d7971626f0c96da90f6a5e9d8622b Sep 17 07:43:15.412677 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:43:15.412640 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-gq7wc" event={"ID":"9f6fb216-73d4-4644-8488-7b97e3935c01","Type":"ContainerStarted","Data":"b6e2aae751beb1de04d00e403350102ac2ffb47a6c5383acd7a4ae5c77a7bbdd"} Sep 17 07:43:15.413090 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:43:15.412689 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-gq7wc" event={"ID":"9f6fb216-73d4-4644-8488-7b97e3935c01","Type":"ContainerStarted","Data":"1b1975f57515ec1d23ffbe13df095a24f26d7971626f0c96da90f6a5e9d8622b"} Sep 17 07:43:17.179287 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:43:17.179253 2561 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-b2g6j" podUID="4c15e90b-53e0-46d5-8fa2-ea0b4f2a9852" containerName="online" probeResult="failure" output="Get \"https://10.132.0.15:6567/health\": dial tcp 10.132.0.15:6567: connect: connection refused" Sep 17 07:43:18.573350 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:43:18.573317 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9skpb_96c5b8e5-2fc0-489b-8889-52bf66184838/konnectivity-agent/0.log" limit=1024 Sep 17 07:43:20.188108 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:43:20.188070 2561 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-b2g6j" podUID="4c15e90b-53e0-46d5-8fa2-ea0b4f2a9852" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.15:8443: connect: connection refused" Sep 17 07:43:20.434362 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:43:20.434328 2561 generic.go:356] "Generic (PLEG): container finished" podID="9f6fb216-73d4-4644-8488-7b97e3935c01" containerID="b6e2aae751beb1de04d00e403350102ac2ffb47a6c5383acd7a4ae5c77a7bbdd" exitCode=0 Sep 17 07:43:20.434515 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:43:20.434404 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-gq7wc" event={"ID":"9f6fb216-73d4-4644-8488-7b97e3935c01","Type":"ContainerDied","Data":"b6e2aae751beb1de04d00e403350102ac2ffb47a6c5383acd7a4ae5c77a7bbdd"} Sep 17 07:43:21.439275 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:43:21.439237 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-gq7wc" event={"ID":"9f6fb216-73d4-4644-8488-7b97e3935c01","Type":"ContainerStarted","Data":"6904e1606c28a0785b8cebf64b9f9848d475a4c30060b41fe8d1247457616c2b"} Sep 17 07:43:26.458893 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:43:26.458860 2561 generic.go:356] "Generic (PLEG): container finished" podID="9f6fb216-73d4-4644-8488-7b97e3935c01" containerID="6904e1606c28a0785b8cebf64b9f9848d475a4c30060b41fe8d1247457616c2b" exitCode=0 Sep 17 07:43:26.459242 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:43:26.458946 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-gq7wc" event={"ID":"9f6fb216-73d4-4644-8488-7b97e3935c01","Type":"ContainerDied","Data":"6904e1606c28a0785b8cebf64b9f9848d475a4c30060b41fe8d1247457616c2b"} Sep 17 07:43:27.179119 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:43:27.179063 2561 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-b2g6j" podUID="4c15e90b-53e0-46d5-8fa2-ea0b4f2a9852" containerName="online" probeResult="failure" output="Get \"https://10.132.0.15:6567/health\": dial tcp 10.132.0.15:6567: connect: connection refused" Sep 17 07:43:27.468400 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:43:27.468307 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-gq7wc" event={"ID":"9f6fb216-73d4-4644-8488-7b97e3935c01","Type":"ContainerStarted","Data":"ff5d796effe889f3cbcd014690816c4a4026d3b7f43073b7bf5d1954dfa58e6e"} Sep 17 07:43:27.468400 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:43:27.468380 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-gq7wc" event={"ID":"9f6fb216-73d4-4644-8488-7b97e3935c01","Type":"ContainerStarted","Data":"b47dc677b694b9d873a052efd6d5847a97b3e047d6b8c3803e6637b8a4a497e5"} Sep 17 07:43:27.468400 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:43:27.468400 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-gq7wc" event={"ID":"9f6fb216-73d4-4644-8488-7b97e3935c01","Type":"ContainerStarted","Data":"25483171bd721759aa4e41523afcdf85d16e37ff82158ce4e65442044b67e175"} Sep 17 07:43:27.468967 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:43:27.468418 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-gq7wc" event={"ID":"9f6fb216-73d4-4644-8488-7b97e3935c01","Type":"ContainerStarted","Data":"09b8635ece694eb931f329b83411e2d5d6db21d0271ff7aa155ebca5ed02d778"} Sep 17 07:43:27.508952 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:43:27.508849 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-gq7wc" podStartSLOduration=14.508828709 podStartE2EDuration="14.508828709s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 07:43:13 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 07:43:27.508093074 +0000 UTC m=+1425.314039368" watchObservedRunningTime="2026-09-17 07:43:27.508828709 +0000 UTC m=+1425.314774984" Sep 17 07:43:29.635683 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:43:29.635641 2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-gq7wc" Sep 17 07:43:29.636282 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:43:29.636248 2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-gq7wc" Sep 17 07:43:29.636282 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:43:29.636290 2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-gq7wc" Sep 17 07:43:29.636487 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:43:29.636308 2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-gq7wc" Sep 17 07:43:29.637984 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:43:29.637955 2561 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-gq7wc" podUID="9f6fb216-73d4-4644-8488-7b97e3935c01" containerName="registry" probeResult="failure" output="dial tcp 10.132.0.16:6571: connect: connection refused" Sep 17 07:43:29.638196 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:43:29.637985 2561 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-gq7wc" podUID="9f6fb216-73d4-4644-8488-7b97e3935c01" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.16:8443: connect: connection refused" Sep 17 07:43:29.638277 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:43:29.637988 2561 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-gq7wc" podUID="9f6fb216-73d4-4644-8488-7b97e3935c01" containerName="offline" probeResult="failure" output="dial tcp 10.132.0.16:8816: connect: connection refused" Sep 17 07:43:29.638277 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:43:29.638043 2561 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-gq7wc" podUID="9f6fb216-73d4-4644-8488-7b97e3935c01" containerName="online" probeResult="failure" output="Get \"https://10.132.0.16:6567/health\": dial tcp 10.132.0.16:6567: connect: connection refused" Sep 17 07:43:30.187483 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:43:30.187428 2561 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-b2g6j" podUID="4c15e90b-53e0-46d5-8fa2-ea0b4f2a9852" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.15:8443: connect: connection refused" Sep 17 07:43:32.635359 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:43:32.635105 2561 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-gq7wc" podUID="9f6fb216-73d4-4644-8488-7b97e3935c01" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.16:8443: connect: connection refused" Sep 17 07:43:32.635359 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:43:32.635104 2561 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-gq7wc" podUID="9f6fb216-73d4-4644-8488-7b97e3935c01" containerName="offline" probeResult="failure" output="dial tcp 10.132.0.16:8816: connect: connection refused" Sep 17 07:43:32.635359 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:43:32.635114 2561 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-gq7wc" podUID="9f6fb216-73d4-4644-8488-7b97e3935c01" containerName="online" probeResult="failure" output="Get \"https://10.132.0.16:6567/health\": dial tcp 10.132.0.16:6567: connect: connection refused" Sep 17 07:43:32.635359 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:43:32.635294 2561 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-gq7wc" podUID="9f6fb216-73d4-4644-8488-7b97e3935c01" containerName="registry" probeResult="failure" output="dial tcp 10.132.0.16:6571: connect: connection refused" Sep 17 07:43:34.635256 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:43:34.635167 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-gq7wc" Sep 17 07:43:34.635256 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:43:34.635218 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-gq7wc" Sep 17 07:43:34.635256 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:43:34.635256 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-gq7wc" Sep 17 07:43:34.635656 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:43:34.635270 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-gq7wc" Sep 17 07:43:35.636249 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:43:35.636217 2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-gq7wc" Sep 17 07:43:35.636694 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:43:35.636362 2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-gq7wc" Sep 17 07:43:35.636694 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:43:35.636596 2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-gq7wc" Sep 17 07:43:35.637087 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:43:35.637065 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-gq7wc" Sep 17 07:43:35.637216 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:43:35.637133 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-gq7wc" Sep 17 07:43:35.637551 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:43:35.637529 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-gq7wc" Sep 17 07:43:35.641867 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:43:35.641847 2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-gq7wc" Sep 17 07:43:36.513385 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:43:36.513359 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-gq7wc" Sep 17 07:43:37.178301 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:43:37.178270 2561 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-b2g6j" podUID="4c15e90b-53e0-46d5-8fa2-ea0b4f2a9852" containerName="online" probeResult="failure" output="Get \"https://10.132.0.15:6567/health\": dial tcp 10.132.0.15:6567: connect: connection refused" Sep 17 07:43:37.178667 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:43:37.178391 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-b2g6j" Sep 17 07:43:40.187768 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:43:40.187730 2561 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-b2g6j" podUID="4c15e90b-53e0-46d5-8fa2-ea0b4f2a9852" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.15:8443: connect: connection refused" Sep 17 07:43:40.188176 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:43:40.187853 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-b2g6j" Sep 17 07:43:43.538200 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:43:43.538171 2561 generic.go:356] "Generic (PLEG): container finished" podID="4c15e90b-53e0-46d5-8fa2-ea0b4f2a9852" containerID="91ea951bc49feb23361894bf27d4c5f1fac8dde24c6a3bed6faaef50a1cd66e6" exitCode=137 Sep 17 07:43:43.538200 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:43:43.538195 2561 generic.go:356] "Generic (PLEG): container finished" podID="4c15e90b-53e0-46d5-8fa2-ea0b4f2a9852" containerID="6b3e53030ac5c0ef2399bed8e17dcb9b90465b1fca03b75822356ff60181bf5e" exitCode=137 Sep 17 07:43:43.538601 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:43:43.538250 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-b2g6j" event={"ID":"4c15e90b-53e0-46d5-8fa2-ea0b4f2a9852","Type":"ContainerDied","Data":"91ea951bc49feb23361894bf27d4c5f1fac8dde24c6a3bed6faaef50a1cd66e6"} Sep 17 07:43:43.538601 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:43:43.538306 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-b2g6j" event={"ID":"4c15e90b-53e0-46d5-8fa2-ea0b4f2a9852","Type":"ContainerDied","Data":"6b3e53030ac5c0ef2399bed8e17dcb9b90465b1fca03b75822356ff60181bf5e"} Sep 17 07:43:43.964975 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:43:43.964952 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-b2g6j" Sep 17 07:43:44.077647 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:43:44.077617 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/4c15e90b-53e0-46d5-8fa2-ea0b4f2a9852-offline-tls\") pod \"4c15e90b-53e0-46d5-8fa2-ea0b4f2a9852\" (UID: \"4c15e90b-53e0-46d5-8fa2-ea0b4f2a9852\") " Sep 17 07:43:44.077647 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:43:44.077651 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/4c15e90b-53e0-46d5-8fa2-ea0b4f2a9852-feast-data\") pod \"4c15e90b-53e0-46d5-8fa2-ea0b4f2a9852\" (UID: \"4c15e90b-53e0-46d5-8fa2-ea0b4f2a9852\") " Sep 17 07:43:44.077842 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:43:44.077677 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/4c15e90b-53e0-46d5-8fa2-ea0b4f2a9852-ui-tls\") pod \"4c15e90b-53e0-46d5-8fa2-ea0b4f2a9852\" (UID: \"4c15e90b-53e0-46d5-8fa2-ea0b4f2a9852\") " Sep 17 07:43:44.077842 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:43:44.077735 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-btmtc\" (UniqueName: \"kubernetes.io/projected/4c15e90b-53e0-46d5-8fa2-ea0b4f2a9852-kube-api-access-btmtc\") pod \"4c15e90b-53e0-46d5-8fa2-ea0b4f2a9852\" (UID: \"4c15e90b-53e0-46d5-8fa2-ea0b4f2a9852\") " Sep 17 07:43:44.077842 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:43:44.077790 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/4c15e90b-53e0-46d5-8fa2-ea0b4f2a9852-online-tls\") pod \"4c15e90b-53e0-46d5-8fa2-ea0b4f2a9852\" (UID: \"4c15e90b-53e0-46d5-8fa2-ea0b4f2a9852\") " Sep 17 07:43:44.077842 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:43:44.077816 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/4c15e90b-53e0-46d5-8fa2-ea0b4f2a9852-registry-tls\") pod \"4c15e90b-53e0-46d5-8fa2-ea0b4f2a9852\" (UID: \"4c15e90b-53e0-46d5-8fa2-ea0b4f2a9852\") " Sep 17 07:43:44.078285 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:43:44.078253 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4c15e90b-53e0-46d5-8fa2-ea0b4f2a9852-feast-data" (OuterVolumeSpecName: "feast-data") pod "4c15e90b-53e0-46d5-8fa2-ea0b4f2a9852" (UID: "4c15e90b-53e0-46d5-8fa2-ea0b4f2a9852"). InnerVolumeSpecName "feast-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 17 07:43:44.080235 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:43:44.080203 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4c15e90b-53e0-46d5-8fa2-ea0b4f2a9852-kube-api-access-btmtc" (OuterVolumeSpecName: "kube-api-access-btmtc") pod "4c15e90b-53e0-46d5-8fa2-ea0b4f2a9852" (UID: "4c15e90b-53e0-46d5-8fa2-ea0b4f2a9852"). InnerVolumeSpecName "kube-api-access-btmtc". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 17 07:43:44.080235 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:43:44.080218 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4c15e90b-53e0-46d5-8fa2-ea0b4f2a9852-ui-tls" (OuterVolumeSpecName: "ui-tls") pod "4c15e90b-53e0-46d5-8fa2-ea0b4f2a9852" (UID: "4c15e90b-53e0-46d5-8fa2-ea0b4f2a9852"). InnerVolumeSpecName "ui-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 17 07:43:44.080396 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:43:44.080230 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4c15e90b-53e0-46d5-8fa2-ea0b4f2a9852-online-tls" (OuterVolumeSpecName: "online-tls") pod "4c15e90b-53e0-46d5-8fa2-ea0b4f2a9852" (UID: "4c15e90b-53e0-46d5-8fa2-ea0b4f2a9852"). InnerVolumeSpecName "online-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 17 07:43:44.080396 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:43:44.080345 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4c15e90b-53e0-46d5-8fa2-ea0b4f2a9852-offline-tls" (OuterVolumeSpecName: "offline-tls") pod "4c15e90b-53e0-46d5-8fa2-ea0b4f2a9852" (UID: "4c15e90b-53e0-46d5-8fa2-ea0b4f2a9852"). InnerVolumeSpecName "offline-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 17 07:43:44.080500 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:43:44.080410 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4c15e90b-53e0-46d5-8fa2-ea0b4f2a9852-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "4c15e90b-53e0-46d5-8fa2-ea0b4f2a9852" (UID: "4c15e90b-53e0-46d5-8fa2-ea0b4f2a9852"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 17 07:43:44.179083 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:43:44.179056 2561 reconciler_common.go:299] "Volume detached for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/4c15e90b-53e0-46d5-8fa2-ea0b4f2a9852-offline-tls\") on node \"ip-10-0-132-17.ec2.internal\" DevicePath \"\"" Sep 17 07:43:44.179083 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:43:44.179079 2561 reconciler_common.go:299] "Volume detached for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/4c15e90b-53e0-46d5-8fa2-ea0b4f2a9852-feast-data\") on node \"ip-10-0-132-17.ec2.internal\" DevicePath \"\"" Sep 17 07:43:44.179083 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:43:44.179087 2561 reconciler_common.go:299] "Volume detached for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/4c15e90b-53e0-46d5-8fa2-ea0b4f2a9852-ui-tls\") on node \"ip-10-0-132-17.ec2.internal\" DevicePath \"\"" Sep 17 07:43:44.179274 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:43:44.179095 2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-btmtc\" (UniqueName: \"kubernetes.io/projected/4c15e90b-53e0-46d5-8fa2-ea0b4f2a9852-kube-api-access-btmtc\") on node \"ip-10-0-132-17.ec2.internal\" DevicePath \"\"" Sep 17 07:43:44.179274 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:43:44.179103 2561 reconciler_common.go:299] "Volume detached for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/4c15e90b-53e0-46d5-8fa2-ea0b4f2a9852-online-tls\") on node \"ip-10-0-132-17.ec2.internal\" DevicePath \"\"" Sep 17 07:43:44.179274 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:43:44.179111 2561 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/4c15e90b-53e0-46d5-8fa2-ea0b4f2a9852-registry-tls\") on node \"ip-10-0-132-17.ec2.internal\" DevicePath \"\"" Sep 17 07:43:44.544514 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:43:44.544485 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-b2g6j" event={"ID":"4c15e90b-53e0-46d5-8fa2-ea0b4f2a9852","Type":"ContainerDied","Data":"e922d4e5e0fbf847520ff95d1f21b6e7ba41c35ca6b34d223c29a500ab63b728"} Sep 17 07:43:44.544915 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:43:44.544538 2561 scope.go:117] "RemoveContainer" containerID="5003c0ad9fe7493069492b7c62f1aaf6cf0750f7e64be6d7897df572e9de3911" Sep 17 07:43:44.544915 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:43:44.544547 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-b2g6j" Sep 17 07:43:44.553411 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:43:44.553394 2561 scope.go:117] "RemoveContainer" containerID="91ea951bc49feb23361894bf27d4c5f1fac8dde24c6a3bed6faaef50a1cd66e6" Sep 17 07:43:44.560838 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:43:44.560817 2561 scope.go:117] "RemoveContainer" containerID="71acbc90b54cf06acb4b1156bc1822b3da3977d3c6bc51bb27f4c12102ba7578" Sep 17 07:43:44.568088 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:43:44.568073 2561 scope.go:117] "RemoveContainer" containerID="6b3e53030ac5c0ef2399bed8e17dcb9b90465b1fca03b75822356ff60181bf5e" Sep 17 07:43:44.576529 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:43:44.576505 2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-57576b8fcf-b2g6j"] Sep 17 07:43:44.577802 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:43:44.577779 2561 scope.go:117] "RemoveContainer" containerID="c5686f66e83f10c8533102a184b506f0cbf5dd0d5b9ba6baa2c520eb91e0e41b" Sep 17 07:43:44.585043 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:43:44.585020 2561 scope.go:117] "RemoveContainer" containerID="234124e8fb66a0414b69e8a75ff17bf3c2c230e1a4df020617b8fa54d3fa966c" Sep 17 07:43:44.586328 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:43:44.586273 2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-57576b8fcf-b2g6j"] Sep 17 07:43:44.683797 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:43:44.683768 2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4c15e90b-53e0-46d5-8fa2-ea0b4f2a9852" path="/var/lib/kubelet/pods/4c15e90b-53e0-46d5-8fa2-ea0b4f2a9852/volumes" Sep 17 07:44:38.348273 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:44:38.348235 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9skpb_96c5b8e5-2fc0-489b-8889-52bf66184838/konnectivity-agent/0.log" limit=1024 Sep 17 07:44:39.145350 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:44:39.145316 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-hxdpt"] Sep 17 07:44:39.145546 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:44:39.145535 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4c15e90b-53e0-46d5-8fa2-ea0b4f2a9852" containerName="feast-apply" Sep 17 07:44:39.145588 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:44:39.145549 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="4c15e90b-53e0-46d5-8fa2-ea0b4f2a9852" containerName="feast-apply" Sep 17 07:44:39.145588 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:44:39.145556 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4c15e90b-53e0-46d5-8fa2-ea0b4f2a9852" containerName="registry" Sep 17 07:44:39.145588 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:44:39.145562 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="4c15e90b-53e0-46d5-8fa2-ea0b4f2a9852" containerName="registry" Sep 17 07:44:39.145588 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:44:39.145572 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4c15e90b-53e0-46d5-8fa2-ea0b4f2a9852" containerName="feast-init" Sep 17 07:44:39.145588 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:44:39.145577 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="4c15e90b-53e0-46d5-8fa2-ea0b4f2a9852" containerName="feast-init" Sep 17 07:44:39.145588 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:44:39.145582 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4c15e90b-53e0-46d5-8fa2-ea0b4f2a9852" containerName="offline" Sep 17 07:44:39.145588 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:44:39.145587 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="4c15e90b-53e0-46d5-8fa2-ea0b4f2a9852" containerName="offline" Sep 17 07:44:39.145784 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:44:39.145595 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4c15e90b-53e0-46d5-8fa2-ea0b4f2a9852" containerName="online" Sep 17 07:44:39.145784 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:44:39.145600 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="4c15e90b-53e0-46d5-8fa2-ea0b4f2a9852" containerName="online" Sep 17 07:44:39.145784 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:44:39.145607 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4c15e90b-53e0-46d5-8fa2-ea0b4f2a9852" containerName="ui" Sep 17 07:44:39.145784 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:44:39.145611 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="4c15e90b-53e0-46d5-8fa2-ea0b4f2a9852" containerName="ui" Sep 17 07:44:39.145784 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:44:39.145663 2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="4c15e90b-53e0-46d5-8fa2-ea0b4f2a9852" containerName="offline" Sep 17 07:44:39.145784 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:44:39.145670 2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="4c15e90b-53e0-46d5-8fa2-ea0b4f2a9852" containerName="registry" Sep 17 07:44:39.145784 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:44:39.145677 2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="4c15e90b-53e0-46d5-8fa2-ea0b4f2a9852" containerName="online" Sep 17 07:44:39.145784 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:44:39.145682 2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="4c15e90b-53e0-46d5-8fa2-ea0b4f2a9852" containerName="ui" Sep 17 07:44:39.148799 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:44:39.148783 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-hxdpt" Sep 17 07:44:39.159944 ip-10-0-132-17 kubenswrapper[2561]: E0917 07:44:39.159903 2561 reflector.go:205] "Failed to watch" err="failed to list *v1.Secret: secrets \"feast-simple-feast-remote-setup-online-tls\" is forbidden: User \"system:node:ip-10-0-132-17.ec2.internal\" cannot list resource \"secrets\" in API group \"\" in the namespace \"test-ns-remote-registry\": no relationship found between node 'ip-10-0-132-17.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-online-tls\"" type="*v1.Secret" Sep 17 07:44:39.161370 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:44:39.161353 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-client-ca\"" Sep 17 07:44:39.161456 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:44:39.161440 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-remote-registry\"/\"openshift-service-ca.crt\"" Sep 17 07:44:39.161503 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:44:39.161480 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-offline-tls\"" Sep 17 07:44:39.162138 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:44:39.162122 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-ui-tls\"" Sep 17 07:44:39.162235 ip-10-0-132-17 kubenswrapper[2561]: E0917 07:44:39.162208 2561 reflector.go:205] "Failed to watch" err="failed to list *v1.Secret: secrets \"feast-simple-feast-remote-setup-dockercfg-pp2xg\" is forbidden: User \"system:node:ip-10-0-132-17.ec2.internal\" cannot list resource \"secrets\" in API group \"\" in the namespace \"test-ns-remote-registry\": no relationship found between node 'ip-10-0-132-17.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-dockercfg-pp2xg\"" type="*v1.Secret" Sep 17 07:44:39.162788 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:44:39.162774 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-remote-registry\"/\"kube-root-ca.crt\"" Sep 17 07:44:39.184063 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:44:39.184043 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-hxdpt"] Sep 17 07:44:39.242164 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:44:39.242139 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hc6qk\" (UniqueName: \"kubernetes.io/projected/8355e671-642f-43f5-93bb-43a4f4b60b0c-kube-api-access-hc6qk\") pod \"feast-simple-feast-remote-setup-c5d49d8c6-hxdpt\" (UID: \"8355e671-642f-43f5-93bb-43a4f4b60b0c\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-hxdpt" Sep 17 07:44:39.242250 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:44:39.242172 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/8355e671-642f-43f5-93bb-43a4f4b60b0c-ui-tls\") pod \"feast-simple-feast-remote-setup-c5d49d8c6-hxdpt\" (UID: \"8355e671-642f-43f5-93bb-43a4f4b60b0c\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-hxdpt" Sep 17 07:44:39.242250 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:44:39.242188 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/8355e671-642f-43f5-93bb-43a4f4b60b0c-feast-data\") pod \"feast-simple-feast-remote-setup-c5d49d8c6-hxdpt\" (UID: \"8355e671-642f-43f5-93bb-43a4f4b60b0c\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-hxdpt" Sep 17 07:44:39.242316 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:44:39.242250 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/8355e671-642f-43f5-93bb-43a4f4b60b0c-offline-tls\") pod \"feast-simple-feast-remote-setup-c5d49d8c6-hxdpt\" (UID: \"8355e671-642f-43f5-93bb-43a4f4b60b0c\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-hxdpt" Sep 17 07:44:39.242316 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:44:39.242270 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/configmap/8355e671-642f-43f5-93bb-43a4f4b60b0c-registry-tls\") pod \"feast-simple-feast-remote-setup-c5d49d8c6-hxdpt\" (UID: \"8355e671-642f-43f5-93bb-43a4f4b60b0c\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-hxdpt" Sep 17 07:44:39.242316 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:44:39.242284 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/8355e671-642f-43f5-93bb-43a4f4b60b0c-online-tls\") pod \"feast-simple-feast-remote-setup-c5d49d8c6-hxdpt\" (UID: \"8355e671-642f-43f5-93bb-43a4f4b60b0c\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-hxdpt" Sep 17 07:44:39.342653 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:44:39.342616 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/configmap/8355e671-642f-43f5-93bb-43a4f4b60b0c-registry-tls\") pod \"feast-simple-feast-remote-setup-c5d49d8c6-hxdpt\" (UID: \"8355e671-642f-43f5-93bb-43a4f4b60b0c\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-hxdpt" Sep 17 07:44:39.342653 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:44:39.342652 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/8355e671-642f-43f5-93bb-43a4f4b60b0c-online-tls\") pod \"feast-simple-feast-remote-setup-c5d49d8c6-hxdpt\" (UID: \"8355e671-642f-43f5-93bb-43a4f4b60b0c\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-hxdpt" Sep 17 07:44:39.342805 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:44:39.342678 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hc6qk\" (UniqueName: \"kubernetes.io/projected/8355e671-642f-43f5-93bb-43a4f4b60b0c-kube-api-access-hc6qk\") pod \"feast-simple-feast-remote-setup-c5d49d8c6-hxdpt\" (UID: \"8355e671-642f-43f5-93bb-43a4f4b60b0c\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-hxdpt" Sep 17 07:44:39.342844 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:44:39.342802 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/8355e671-642f-43f5-93bb-43a4f4b60b0c-ui-tls\") pod \"feast-simple-feast-remote-setup-c5d49d8c6-hxdpt\" (UID: \"8355e671-642f-43f5-93bb-43a4f4b60b0c\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-hxdpt" Sep 17 07:44:39.342844 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:44:39.342830 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/8355e671-642f-43f5-93bb-43a4f4b60b0c-feast-data\") pod \"feast-simple-feast-remote-setup-c5d49d8c6-hxdpt\" (UID: \"8355e671-642f-43f5-93bb-43a4f4b60b0c\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-hxdpt" Sep 17 07:44:39.342914 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:44:39.342882 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/8355e671-642f-43f5-93bb-43a4f4b60b0c-offline-tls\") pod \"feast-simple-feast-remote-setup-c5d49d8c6-hxdpt\" (UID: \"8355e671-642f-43f5-93bb-43a4f4b60b0c\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-hxdpt" Sep 17 07:44:39.343217 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:44:39.343195 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/8355e671-642f-43f5-93bb-43a4f4b60b0c-feast-data\") pod \"feast-simple-feast-remote-setup-c5d49d8c6-hxdpt\" (UID: \"8355e671-642f-43f5-93bb-43a4f4b60b0c\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-hxdpt" Sep 17 07:44:39.343325 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:44:39.343308 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/configmap/8355e671-642f-43f5-93bb-43a4f4b60b0c-registry-tls\") pod \"feast-simple-feast-remote-setup-c5d49d8c6-hxdpt\" (UID: \"8355e671-642f-43f5-93bb-43a4f4b60b0c\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-hxdpt" Sep 17 07:44:39.345257 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:44:39.345235 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/8355e671-642f-43f5-93bb-43a4f4b60b0c-ui-tls\") pod \"feast-simple-feast-remote-setup-c5d49d8c6-hxdpt\" (UID: \"8355e671-642f-43f5-93bb-43a4f4b60b0c\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-hxdpt" Sep 17 07:44:39.345325 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:44:39.345261 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/8355e671-642f-43f5-93bb-43a4f4b60b0c-offline-tls\") pod \"feast-simple-feast-remote-setup-c5d49d8c6-hxdpt\" (UID: \"8355e671-642f-43f5-93bb-43a4f4b60b0c\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-hxdpt" Sep 17 07:44:39.359998 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:44:39.359971 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hc6qk\" (UniqueName: \"kubernetes.io/projected/8355e671-642f-43f5-93bb-43a4f4b60b0c-kube-api-access-hc6qk\") pod \"feast-simple-feast-remote-setup-c5d49d8c6-hxdpt\" (UID: \"8355e671-642f-43f5-93bb-43a4f4b60b0c\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-hxdpt" Sep 17 07:44:40.174042 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:44:40.174013 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-online-tls\"" Sep 17 07:44:40.185978 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:44:40.185926 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/8355e671-642f-43f5-93bb-43a4f4b60b0c-online-tls\") pod \"feast-simple-feast-remote-setup-c5d49d8c6-hxdpt\" (UID: \"8355e671-642f-43f5-93bb-43a4f4b60b0c\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-hxdpt" Sep 17 07:44:40.188474 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:44:40.188452 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-dockercfg-pp2xg\"" Sep 17 07:44:40.357223 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:44:40.357191 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-hxdpt" Sep 17 07:44:40.655678 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:44:40.655650 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-hxdpt"] Sep 17 07:44:40.658640 ip-10-0-132-17 kubenswrapper[2561]: W0917 07:44:40.658608 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod8355e671_642f_43f5_93bb_43a4f4b60b0c.slice/crio-222b280fa38fa78869cea5d50d92c4e7b1f930f8a90a87f5bd18cf4f2c540790 WatchSource:0}: Error finding container 222b280fa38fa78869cea5d50d92c4e7b1f930f8a90a87f5bd18cf4f2c540790: Status 404 returned error can't find the container with id 222b280fa38fa78869cea5d50d92c4e7b1f930f8a90a87f5bd18cf4f2c540790 Sep 17 07:44:40.732538 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:44:40.732507 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-hxdpt" event={"ID":"8355e671-642f-43f5-93bb-43a4f4b60b0c","Type":"ContainerStarted","Data":"f8db23cfcfd02ee1451cd2ba14a69a446f684b727ec6f91621f6fa7f1eb7ee3c"} Sep 17 07:44:40.732683 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:44:40.732555 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-hxdpt" event={"ID":"8355e671-642f-43f5-93bb-43a4f4b60b0c","Type":"ContainerStarted","Data":"222b280fa38fa78869cea5d50d92c4e7b1f930f8a90a87f5bd18cf4f2c540790"} Sep 17 07:44:42.144132 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:44:42.144097 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9skpb_96c5b8e5-2fc0-489b-8889-52bf66184838/konnectivity-agent/0.log" limit=1024 Sep 17 07:44:42.713232 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:44:42.713194 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2frz9_0b5240b1-13ea-4cee-b7f1-aa241ca58aa4/ovn-acl-logging/0.log" Sep 17 07:44:42.715510 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:44:42.715488 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2frz9_0b5240b1-13ea-4cee-b7f1-aa241ca58aa4/ovn-acl-logging/0.log" Sep 17 07:44:45.750464 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:44:45.750379 2561 generic.go:356] "Generic (PLEG): container finished" podID="8355e671-642f-43f5-93bb-43a4f4b60b0c" containerID="f8db23cfcfd02ee1451cd2ba14a69a446f684b727ec6f91621f6fa7f1eb7ee3c" exitCode=0 Sep 17 07:44:45.750464 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:44:45.750454 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-hxdpt" event={"ID":"8355e671-642f-43f5-93bb-43a4f4b60b0c","Type":"ContainerDied","Data":"f8db23cfcfd02ee1451cd2ba14a69a446f684b727ec6f91621f6fa7f1eb7ee3c"} Sep 17 07:44:46.755766 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:44:46.755735 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-hxdpt" event={"ID":"8355e671-642f-43f5-93bb-43a4f4b60b0c","Type":"ContainerStarted","Data":"16be484dca1a73bb87af559cba366efd4f40c58fc10be8bb4a6a5af1497fa0b3"} Sep 17 07:45:16.863334 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:45:16.863297 2561 generic.go:356] "Generic (PLEG): container finished" podID="8355e671-642f-43f5-93bb-43a4f4b60b0c" containerID="16be484dca1a73bb87af559cba366efd4f40c58fc10be8bb4a6a5af1497fa0b3" exitCode=0 Sep 17 07:45:16.863793 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:45:16.863366 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-hxdpt" event={"ID":"8355e671-642f-43f5-93bb-43a4f4b60b0c","Type":"ContainerDied","Data":"16be484dca1a73bb87af559cba366efd4f40c58fc10be8bb4a6a5af1497fa0b3"} Sep 17 07:45:17.871272 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:45:17.871231 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-hxdpt" event={"ID":"8355e671-642f-43f5-93bb-43a4f4b60b0c","Type":"ContainerStarted","Data":"c66cabac8414e48a89c857c26c5a23b7cfa251954f04ce8ddc786dbb7085b9df"} Sep 17 07:45:17.871646 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:45:17.871295 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-hxdpt" event={"ID":"8355e671-642f-43f5-93bb-43a4f4b60b0c","Type":"ContainerStarted","Data":"ae0649305dfd824df7ba896a543e826fd85c0476813739bd0f21839440109c0c"} Sep 17 07:45:17.871646 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:45:17.871318 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-hxdpt" event={"ID":"8355e671-642f-43f5-93bb-43a4f4b60b0c","Type":"ContainerStarted","Data":"2c87c7072593f87eb3229db45466b1f03599ee213cd7ca7bda3d431a50d10a85"} Sep 17 07:45:19.357746 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:45:19.357708 2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-hxdpt" Sep 17 07:45:19.358301 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:45:19.358270 2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-hxdpt" Sep 17 07:45:19.358301 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:45:19.358302 2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-hxdpt" Sep 17 07:45:19.359519 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:45:19.359491 2561 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-hxdpt" podUID="8355e671-642f-43f5-93bb-43a4f4b60b0c" containerName="offline" probeResult="failure" output="dial tcp 10.132.0.17:8816: connect: connection refused" Sep 17 07:45:19.359630 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:45:19.359519 2561 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-hxdpt" podUID="8355e671-642f-43f5-93bb-43a4f4b60b0c" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.17:8443: connect: connection refused" Sep 17 07:45:19.359630 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:45:19.359563 2561 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-hxdpt" podUID="8355e671-642f-43f5-93bb-43a4f4b60b0c" containerName="online" probeResult="failure" output="Get \"https://10.132.0.17:6567/health\": dial tcp 10.132.0.17:6567: connect: connection refused" Sep 17 07:45:20.357610 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:45:20.357566 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-hxdpt" Sep 17 07:45:20.357786 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:45:20.357629 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-hxdpt" Sep 17 07:45:20.357786 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:45:20.357647 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-hxdpt" Sep 17 07:45:22.358256 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:45:22.358214 2561 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-hxdpt" podUID="8355e671-642f-43f5-93bb-43a4f4b60b0c" containerName="offline" probeResult="failure" output="dial tcp 10.132.0.17:8816: connect: connection refused" Sep 17 07:45:22.358757 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:45:22.358214 2561 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-hxdpt" podUID="8355e671-642f-43f5-93bb-43a4f4b60b0c" containerName="online" probeResult="failure" output="Get \"https://10.132.0.17:6567/health\": dial tcp 10.132.0.17:6567: connect: connection refused" Sep 17 07:45:22.358757 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:45:22.358223 2561 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-hxdpt" podUID="8355e671-642f-43f5-93bb-43a4f4b60b0c" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.17:8443: connect: connection refused" Sep 17 07:45:25.358683 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:45:25.358648 2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-hxdpt" Sep 17 07:45:25.359175 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:45:25.359151 2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-hxdpt" Sep 17 07:45:25.359426 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:45:25.359411 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-hxdpt" Sep 17 07:45:25.388948 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:45:25.388877 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-hxdpt" podStartSLOduration=46.388860905 podStartE2EDuration="46.388860905s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 07:44:39 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 07:45:17.917474368 +0000 UTC m=+1535.723420663" watchObservedRunningTime="2026-09-17 07:45:25.388860905 +0000 UTC m=+1543.194807178" Sep 17 07:45:25.907723 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:45:25.907696 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-hxdpt" Sep 17 07:45:26.358225 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:45:26.358135 2561 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-hxdpt" podUID="8355e671-642f-43f5-93bb-43a4f4b60b0c" containerName="online" probeResult="failure" output="Get \"https://10.132.0.17:6567/health\": context deadline exceeded" Sep 17 07:45:29.285862 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:45:29.285829 2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-hxdpt" Sep 17 07:45:30.291096 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:45:30.291053 2561 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-hxdpt" podUID="8355e671-642f-43f5-93bb-43a4f4b60b0c" containerName="online" probeResult="failure" output="Get \"https://10.132.0.17:6567/health\": net/http: request canceled (Client.Timeout exceeded while awaiting headers)" Sep 17 07:45:40.251477 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:45:40.251445 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-hxdpt" Sep 17 07:46:00.291064 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:46:00.291019 2561 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-hxdpt" podUID="8355e671-642f-43f5-93bb-43a4f4b60b0c" containerName="online" probeResult="failure" output="Get \"https://10.132.0.17:6567/health\": net/http: request canceled (Client.Timeout exceeded while awaiting headers)" Sep 17 07:46:01.363079 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:46:01.363035 2561 prober.go:120] "Probe failed" probeType="Liveness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-hxdpt" podUID="8355e671-642f-43f5-93bb-43a4f4b60b0c" containerName="online" probeResult="failure" output="Get \"https://10.132.0.17:6567/health\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Sep 17 07:46:10.291057 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:46:10.291014 2561 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-hxdpt" podUID="8355e671-642f-43f5-93bb-43a4f4b60b0c" containerName="online" probeResult="failure" output="Get \"https://10.132.0.17:6567/health\": net/http: request canceled (Client.Timeout exceeded while awaiting headers)" Sep 17 07:46:20.291060 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:46:20.291021 2561 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-hxdpt" podUID="8355e671-642f-43f5-93bb-43a4f4b60b0c" containerName="online" probeResult="failure" output="Get \"https://10.132.0.17:6567/health\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Sep 17 07:46:20.291434 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:46:20.291137 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-hxdpt" Sep 17 07:46:21.296097 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:46:21.296049 2561 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-hxdpt" podUID="8355e671-642f-43f5-93bb-43a4f4b60b0c" containerName="online" probeResult="failure" output="Get \"https://10.132.0.17:6567/health\": net/http: request canceled (Client.Timeout exceeded while awaiting headers)" Sep 17 07:46:21.399081 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:46:21.399046 2561 prober.go:120] "Probe failed" probeType="Liveness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-hxdpt" podUID="8355e671-642f-43f5-93bb-43a4f4b60b0c" containerName="online" probeResult="failure" output="Get \"https://10.132.0.17:6567/health\": net/http: request canceled (Client.Timeout exceeded while awaiting headers)" Sep 17 07:46:31.296086 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:46:31.296041 2561 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-hxdpt" podUID="8355e671-642f-43f5-93bb-43a4f4b60b0c" containerName="online" probeResult="failure" output="Get \"https://10.132.0.17:6567/health\": net/http: request canceled (Client.Timeout exceeded while awaiting headers)" Sep 17 07:46:41.296119 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:46:41.296035 2561 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-hxdpt" podUID="8355e671-642f-43f5-93bb-43a4f4b60b0c" containerName="online" probeResult="failure" output="Get \"https://10.132.0.17:6567/health\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Sep 17 07:46:41.358148 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:46:41.358105 2561 prober.go:120] "Probe failed" probeType="Liveness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-hxdpt" podUID="8355e671-642f-43f5-93bb-43a4f4b60b0c" containerName="online" probeResult="failure" output="Get \"https://10.132.0.17:6567/health\": context deadline exceeded" Sep 17 07:46:44.266035 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:46:44.265996 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9skpb_96c5b8e5-2fc0-489b-8889-52bf66184838/konnectivity-agent/0.log" limit=1024 Sep 17 07:46:48.269603 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:46:48.269572 2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-57576b8fcf-gq7wc"] Sep 17 07:46:48.270065 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:46:48.269801 2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-gq7wc" podUID="9f6fb216-73d4-4644-8488-7b97e3935c01" containerName="registry" containerID="cri-o://09b8635ece694eb931f329b83411e2d5d6db21d0271ff7aa155ebca5ed02d778" gracePeriod=30 Sep 17 07:46:48.270065 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:46:48.269864 2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-gq7wc" podUID="9f6fb216-73d4-4644-8488-7b97e3935c01" containerName="offline" containerID="cri-o://b47dc677b694b9d873a052efd6d5847a97b3e047d6b8c3803e6637b8a4a497e5" gracePeriod=30 Sep 17 07:46:48.270065 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:46:48.269876 2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-gq7wc" podUID="9f6fb216-73d4-4644-8488-7b97e3935c01" containerName="ui" containerID="cri-o://ff5d796effe889f3cbcd014690816c4a4026d3b7f43073b7bf5d1954dfa58e6e" gracePeriod=30 Sep 17 07:46:48.270065 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:46:48.269860 2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-gq7wc" podUID="9f6fb216-73d4-4644-8488-7b97e3935c01" containerName="online" containerID="cri-o://25483171bd721759aa4e41523afcdf85d16e37ff82158ce4e65442044b67e175" gracePeriod=30 Sep 17 07:46:48.477976 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:46:48.477926 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9skpb_96c5b8e5-2fc0-489b-8889-52bf66184838/konnectivity-agent/0.log" limit=1024 Sep 17 07:46:49.192496 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:46:49.192462 2561 generic.go:356] "Generic (PLEG): container finished" podID="9f6fb216-73d4-4644-8488-7b97e3935c01" containerID="ff5d796effe889f3cbcd014690816c4a4026d3b7f43073b7bf5d1954dfa58e6e" exitCode=0 Sep 17 07:46:49.192496 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:46:49.192487 2561 generic.go:356] "Generic (PLEG): container finished" podID="9f6fb216-73d4-4644-8488-7b97e3935c01" containerID="25483171bd721759aa4e41523afcdf85d16e37ff82158ce4e65442044b67e175" exitCode=0 Sep 17 07:46:49.192687 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:46:49.192535 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-gq7wc" event={"ID":"9f6fb216-73d4-4644-8488-7b97e3935c01","Type":"ContainerDied","Data":"ff5d796effe889f3cbcd014690816c4a4026d3b7f43073b7bf5d1954dfa58e6e"} Sep 17 07:46:49.192687 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:46:49.192589 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-gq7wc" event={"ID":"9f6fb216-73d4-4644-8488-7b97e3935c01","Type":"ContainerDied","Data":"25483171bd721759aa4e41523afcdf85d16e37ff82158ce4e65442044b67e175"} Sep 17 07:46:51.219030 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:46:51.219003 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-hxdpt" Sep 17 07:46:55.637043 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:46:55.637005 2561 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-gq7wc" podUID="9f6fb216-73d4-4644-8488-7b97e3935c01" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.16:8443: connect: connection refused" Sep 17 07:46:56.511149 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:46:56.511108 2561 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-gq7wc" podUID="9f6fb216-73d4-4644-8488-7b97e3935c01" containerName="online" probeResult="failure" output="Get \"https://10.132.0.16:6567/health\": dial tcp 10.132.0.16:6567: connect: connection refused" Sep 17 07:47:01.297101 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:47:01.297050 2561 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-hxdpt" podUID="8355e671-642f-43f5-93bb-43a4f4b60b0c" containerName="online" probeResult="failure" output="Get \"https://10.132.0.17:6567/health\": net/http: request canceled (Client.Timeout exceeded while awaiting headers)" Sep 17 07:47:01.358239 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:47:01.358196 2561 prober.go:120] "Probe failed" probeType="Liveness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-hxdpt" podUID="8355e671-642f-43f5-93bb-43a4f4b60b0c" containerName="online" probeResult="failure" output="Get \"https://10.132.0.17:6567/health\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)" Sep 17 07:47:05.637157 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:47:05.637097 2561 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-gq7wc" podUID="9f6fb216-73d4-4644-8488-7b97e3935c01" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.16:8443: connect: connection refused" Sep 17 07:47:06.510768 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:47:06.510727 2561 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-gq7wc" podUID="9f6fb216-73d4-4644-8488-7b97e3935c01" containerName="online" probeResult="failure" output="Get \"https://10.132.0.16:6567/health\": dial tcp 10.132.0.16:6567: connect: connection refused" Sep 17 07:47:11.297087 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:47:11.297040 2561 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-hxdpt" podUID="8355e671-642f-43f5-93bb-43a4f4b60b0c" containerName="online" probeResult="failure" output="Get \"https://10.132.0.17:6567/health\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Sep 17 07:47:15.637405 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:47:15.637361 2561 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-gq7wc" podUID="9f6fb216-73d4-4644-8488-7b97e3935c01" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.16:8443: connect: connection refused" Sep 17 07:47:15.637854 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:47:15.637510 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-gq7wc" Sep 17 07:47:16.510942 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:47:16.510891 2561 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-gq7wc" podUID="9f6fb216-73d4-4644-8488-7b97e3935c01" containerName="online" probeResult="failure" output="Get \"https://10.132.0.16:6567/health\": dial tcp 10.132.0.16:6567: connect: connection refused" Sep 17 07:47:16.511137 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:47:16.511063 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-gq7wc" Sep 17 07:47:18.912450 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:47:18.912427 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-gq7wc" Sep 17 07:47:18.997504 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:47:18.997453 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/9f6fb216-73d4-4644-8488-7b97e3935c01-feast-data\") pod \"9f6fb216-73d4-4644-8488-7b97e3935c01\" (UID: \"9f6fb216-73d4-4644-8488-7b97e3935c01\") " Sep 17 07:47:18.997504 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:47:18.997500 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/9f6fb216-73d4-4644-8488-7b97e3935c01-registry-tls\") pod \"9f6fb216-73d4-4644-8488-7b97e3935c01\" (UID: \"9f6fb216-73d4-4644-8488-7b97e3935c01\") " Sep 17 07:47:18.997729 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:47:18.997524 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hxjhm\" (UniqueName: \"kubernetes.io/projected/9f6fb216-73d4-4644-8488-7b97e3935c01-kube-api-access-hxjhm\") pod \"9f6fb216-73d4-4644-8488-7b97e3935c01\" (UID: \"9f6fb216-73d4-4644-8488-7b97e3935c01\") " Sep 17 07:47:18.997729 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:47:18.997543 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/9f6fb216-73d4-4644-8488-7b97e3935c01-offline-tls\") pod \"9f6fb216-73d4-4644-8488-7b97e3935c01\" (UID: \"9f6fb216-73d4-4644-8488-7b97e3935c01\") " Sep 17 07:47:18.997729 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:47:18.997568 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/9f6fb216-73d4-4644-8488-7b97e3935c01-online-tls\") pod \"9f6fb216-73d4-4644-8488-7b97e3935c01\" (UID: \"9f6fb216-73d4-4644-8488-7b97e3935c01\") " Sep 17 07:47:18.997729 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:47:18.997584 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/9f6fb216-73d4-4644-8488-7b97e3935c01-ui-tls\") pod \"9f6fb216-73d4-4644-8488-7b97e3935c01\" (UID: \"9f6fb216-73d4-4644-8488-7b97e3935c01\") " Sep 17 07:47:18.998044 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:47:18.998009 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9f6fb216-73d4-4644-8488-7b97e3935c01-feast-data" (OuterVolumeSpecName: "feast-data") pod "9f6fb216-73d4-4644-8488-7b97e3935c01" (UID: "9f6fb216-73d4-4644-8488-7b97e3935c01"). InnerVolumeSpecName "feast-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 17 07:47:18.999712 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:47:18.999678 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9f6fb216-73d4-4644-8488-7b97e3935c01-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "9f6fb216-73d4-4644-8488-7b97e3935c01" (UID: "9f6fb216-73d4-4644-8488-7b97e3935c01"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 17 07:47:19.000233 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:47:19.000205 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9f6fb216-73d4-4644-8488-7b97e3935c01-ui-tls" (OuterVolumeSpecName: "ui-tls") pod "9f6fb216-73d4-4644-8488-7b97e3935c01" (UID: "9f6fb216-73d4-4644-8488-7b97e3935c01"). InnerVolumeSpecName "ui-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 17 07:47:19.000340 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:47:19.000266 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9f6fb216-73d4-4644-8488-7b97e3935c01-offline-tls" (OuterVolumeSpecName: "offline-tls") pod "9f6fb216-73d4-4644-8488-7b97e3935c01" (UID: "9f6fb216-73d4-4644-8488-7b97e3935c01"). InnerVolumeSpecName "offline-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 17 07:47:19.000340 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:47:19.000308 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9f6fb216-73d4-4644-8488-7b97e3935c01-online-tls" (OuterVolumeSpecName: "online-tls") pod "9f6fb216-73d4-4644-8488-7b97e3935c01" (UID: "9f6fb216-73d4-4644-8488-7b97e3935c01"). InnerVolumeSpecName "online-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 17 07:47:19.000448 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:47:19.000407 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9f6fb216-73d4-4644-8488-7b97e3935c01-kube-api-access-hxjhm" (OuterVolumeSpecName: "kube-api-access-hxjhm") pod "9f6fb216-73d4-4644-8488-7b97e3935c01" (UID: "9f6fb216-73d4-4644-8488-7b97e3935c01"). InnerVolumeSpecName "kube-api-access-hxjhm". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 17 07:47:19.098168 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:47:19.098103 2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hxjhm\" (UniqueName: \"kubernetes.io/projected/9f6fb216-73d4-4644-8488-7b97e3935c01-kube-api-access-hxjhm\") on node \"ip-10-0-132-17.ec2.internal\" DevicePath \"\"" Sep 17 07:47:19.098168 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:47:19.098134 2561 reconciler_common.go:299] "Volume detached for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/9f6fb216-73d4-4644-8488-7b97e3935c01-offline-tls\") on node \"ip-10-0-132-17.ec2.internal\" DevicePath \"\"" Sep 17 07:47:19.098168 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:47:19.098162 2561 reconciler_common.go:299] "Volume detached for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/9f6fb216-73d4-4644-8488-7b97e3935c01-online-tls\") on node \"ip-10-0-132-17.ec2.internal\" DevicePath \"\"" Sep 17 07:47:19.098168 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:47:19.098170 2561 reconciler_common.go:299] "Volume detached for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/9f6fb216-73d4-4644-8488-7b97e3935c01-ui-tls\") on node \"ip-10-0-132-17.ec2.internal\" DevicePath \"\"" Sep 17 07:47:19.098168 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:47:19.098178 2561 reconciler_common.go:299] "Volume detached for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/9f6fb216-73d4-4644-8488-7b97e3935c01-feast-data\") on node \"ip-10-0-132-17.ec2.internal\" DevicePath \"\"" Sep 17 07:47:19.098379 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:47:19.098185 2561 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/9f6fb216-73d4-4644-8488-7b97e3935c01-registry-tls\") on node \"ip-10-0-132-17.ec2.internal\" DevicePath \"\"" Sep 17 07:47:19.298345 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:47:19.298313 2561 generic.go:356] "Generic (PLEG): container finished" podID="9f6fb216-73d4-4644-8488-7b97e3935c01" containerID="b47dc677b694b9d873a052efd6d5847a97b3e047d6b8c3803e6637b8a4a497e5" exitCode=137 Sep 17 07:47:19.298345 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:47:19.298337 2561 generic.go:356] "Generic (PLEG): container finished" podID="9f6fb216-73d4-4644-8488-7b97e3935c01" containerID="09b8635ece694eb931f329b83411e2d5d6db21d0271ff7aa155ebca5ed02d778" exitCode=137 Sep 17 07:47:19.298555 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:47:19.298377 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-gq7wc" event={"ID":"9f6fb216-73d4-4644-8488-7b97e3935c01","Type":"ContainerDied","Data":"b47dc677b694b9d873a052efd6d5847a97b3e047d6b8c3803e6637b8a4a497e5"} Sep 17 07:47:19.298555 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:47:19.298386 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-gq7wc" Sep 17 07:47:19.298555 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:47:19.298409 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-gq7wc" event={"ID":"9f6fb216-73d4-4644-8488-7b97e3935c01","Type":"ContainerDied","Data":"09b8635ece694eb931f329b83411e2d5d6db21d0271ff7aa155ebca5ed02d778"} Sep 17 07:47:19.298555 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:47:19.298421 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-gq7wc" event={"ID":"9f6fb216-73d4-4644-8488-7b97e3935c01","Type":"ContainerDied","Data":"1b1975f57515ec1d23ffbe13df095a24f26d7971626f0c96da90f6a5e9d8622b"} Sep 17 07:47:19.298555 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:47:19.298439 2561 scope.go:117] "RemoveContainer" containerID="ff5d796effe889f3cbcd014690816c4a4026d3b7f43073b7bf5d1954dfa58e6e" Sep 17 07:47:19.306588 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:47:19.306573 2561 scope.go:117] "RemoveContainer" containerID="b47dc677b694b9d873a052efd6d5847a97b3e047d6b8c3803e6637b8a4a497e5" Sep 17 07:47:19.313946 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:47:19.313909 2561 scope.go:117] "RemoveContainer" containerID="25483171bd721759aa4e41523afcdf85d16e37ff82158ce4e65442044b67e175" Sep 17 07:47:19.321879 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:47:19.321859 2561 scope.go:117] "RemoveContainer" containerID="09b8635ece694eb931f329b83411e2d5d6db21d0271ff7aa155ebca5ed02d778" Sep 17 07:47:19.322583 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:47:19.322562 2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-57576b8fcf-gq7wc"] Sep 17 07:47:19.327547 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:47:19.327528 2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-57576b8fcf-gq7wc"] Sep 17 07:47:19.330393 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:47:19.330379 2561 scope.go:117] "RemoveContainer" containerID="6904e1606c28a0785b8cebf64b9f9848d475a4c30060b41fe8d1247457616c2b" Sep 17 07:47:19.336864 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:47:19.336849 2561 scope.go:117] "RemoveContainer" containerID="b6e2aae751beb1de04d00e403350102ac2ffb47a6c5383acd7a4ae5c77a7bbdd" Sep 17 07:47:19.343268 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:47:19.343246 2561 scope.go:117] "RemoveContainer" containerID="ff5d796effe889f3cbcd014690816c4a4026d3b7f43073b7bf5d1954dfa58e6e" Sep 17 07:47:19.343502 ip-10-0-132-17 kubenswrapper[2561]: E0917 07:47:19.343484 2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ff5d796effe889f3cbcd014690816c4a4026d3b7f43073b7bf5d1954dfa58e6e\": container with ID starting with ff5d796effe889f3cbcd014690816c4a4026d3b7f43073b7bf5d1954dfa58e6e not found: ID does not exist" containerID="ff5d796effe889f3cbcd014690816c4a4026d3b7f43073b7bf5d1954dfa58e6e" Sep 17 07:47:19.343556 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:47:19.343510 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ff5d796effe889f3cbcd014690816c4a4026d3b7f43073b7bf5d1954dfa58e6e"} err="failed to get container status \"ff5d796effe889f3cbcd014690816c4a4026d3b7f43073b7bf5d1954dfa58e6e\": rpc error: code = NotFound desc = could not find container \"ff5d796effe889f3cbcd014690816c4a4026d3b7f43073b7bf5d1954dfa58e6e\": container with ID starting with ff5d796effe889f3cbcd014690816c4a4026d3b7f43073b7bf5d1954dfa58e6e not found: ID does not exist" Sep 17 07:47:19.343556 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:47:19.343528 2561 scope.go:117] "RemoveContainer" containerID="b47dc677b694b9d873a052efd6d5847a97b3e047d6b8c3803e6637b8a4a497e5" Sep 17 07:47:19.343769 ip-10-0-132-17 kubenswrapper[2561]: E0917 07:47:19.343752 2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b47dc677b694b9d873a052efd6d5847a97b3e047d6b8c3803e6637b8a4a497e5\": container with ID starting with b47dc677b694b9d873a052efd6d5847a97b3e047d6b8c3803e6637b8a4a497e5 not found: ID does not exist" containerID="b47dc677b694b9d873a052efd6d5847a97b3e047d6b8c3803e6637b8a4a497e5" Sep 17 07:47:19.343830 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:47:19.343777 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b47dc677b694b9d873a052efd6d5847a97b3e047d6b8c3803e6637b8a4a497e5"} err="failed to get container status \"b47dc677b694b9d873a052efd6d5847a97b3e047d6b8c3803e6637b8a4a497e5\": rpc error: code = NotFound desc = could not find container \"b47dc677b694b9d873a052efd6d5847a97b3e047d6b8c3803e6637b8a4a497e5\": container with ID starting with b47dc677b694b9d873a052efd6d5847a97b3e047d6b8c3803e6637b8a4a497e5 not found: ID does not exist" Sep 17 07:47:19.343830 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:47:19.343799 2561 scope.go:117] "RemoveContainer" containerID="25483171bd721759aa4e41523afcdf85d16e37ff82158ce4e65442044b67e175" Sep 17 07:47:19.344109 ip-10-0-132-17 kubenswrapper[2561]: E0917 07:47:19.344094 2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"25483171bd721759aa4e41523afcdf85d16e37ff82158ce4e65442044b67e175\": container with ID starting with 25483171bd721759aa4e41523afcdf85d16e37ff82158ce4e65442044b67e175 not found: ID does not exist" containerID="25483171bd721759aa4e41523afcdf85d16e37ff82158ce4e65442044b67e175" Sep 17 07:47:19.344166 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:47:19.344113 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"25483171bd721759aa4e41523afcdf85d16e37ff82158ce4e65442044b67e175"} err="failed to get container status \"25483171bd721759aa4e41523afcdf85d16e37ff82158ce4e65442044b67e175\": rpc error: code = NotFound desc = could not find container \"25483171bd721759aa4e41523afcdf85d16e37ff82158ce4e65442044b67e175\": container with ID starting with 25483171bd721759aa4e41523afcdf85d16e37ff82158ce4e65442044b67e175 not found: ID does not exist" Sep 17 07:47:19.344166 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:47:19.344126 2561 scope.go:117] "RemoveContainer" containerID="09b8635ece694eb931f329b83411e2d5d6db21d0271ff7aa155ebca5ed02d778" Sep 17 07:47:19.344353 ip-10-0-132-17 kubenswrapper[2561]: E0917 07:47:19.344338 2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"09b8635ece694eb931f329b83411e2d5d6db21d0271ff7aa155ebca5ed02d778\": container with ID starting with 09b8635ece694eb931f329b83411e2d5d6db21d0271ff7aa155ebca5ed02d778 not found: ID does not exist" containerID="09b8635ece694eb931f329b83411e2d5d6db21d0271ff7aa155ebca5ed02d778" Sep 17 07:47:19.344413 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:47:19.344359 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"09b8635ece694eb931f329b83411e2d5d6db21d0271ff7aa155ebca5ed02d778"} err="failed to get container status \"09b8635ece694eb931f329b83411e2d5d6db21d0271ff7aa155ebca5ed02d778\": rpc error: code = NotFound desc = could not find container \"09b8635ece694eb931f329b83411e2d5d6db21d0271ff7aa155ebca5ed02d778\": container with ID starting with 09b8635ece694eb931f329b83411e2d5d6db21d0271ff7aa155ebca5ed02d778 not found: ID does not exist" Sep 17 07:47:19.344413 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:47:19.344378 2561 scope.go:117] "RemoveContainer" containerID="6904e1606c28a0785b8cebf64b9f9848d475a4c30060b41fe8d1247457616c2b" Sep 17 07:47:19.344636 ip-10-0-132-17 kubenswrapper[2561]: E0917 07:47:19.344607 2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6904e1606c28a0785b8cebf64b9f9848d475a4c30060b41fe8d1247457616c2b\": container with ID starting with 6904e1606c28a0785b8cebf64b9f9848d475a4c30060b41fe8d1247457616c2b not found: ID does not exist" containerID="6904e1606c28a0785b8cebf64b9f9848d475a4c30060b41fe8d1247457616c2b" Sep 17 07:47:19.344674 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:47:19.344641 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6904e1606c28a0785b8cebf64b9f9848d475a4c30060b41fe8d1247457616c2b"} err="failed to get container status \"6904e1606c28a0785b8cebf64b9f9848d475a4c30060b41fe8d1247457616c2b\": rpc error: code = NotFound desc = could not find container \"6904e1606c28a0785b8cebf64b9f9848d475a4c30060b41fe8d1247457616c2b\": container with ID starting with 6904e1606c28a0785b8cebf64b9f9848d475a4c30060b41fe8d1247457616c2b not found: ID does not exist" Sep 17 07:47:19.344674 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:47:19.344654 2561 scope.go:117] "RemoveContainer" containerID="b6e2aae751beb1de04d00e403350102ac2ffb47a6c5383acd7a4ae5c77a7bbdd" Sep 17 07:47:19.344864 ip-10-0-132-17 kubenswrapper[2561]: E0917 07:47:19.344851 2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b6e2aae751beb1de04d00e403350102ac2ffb47a6c5383acd7a4ae5c77a7bbdd\": container with ID starting with b6e2aae751beb1de04d00e403350102ac2ffb47a6c5383acd7a4ae5c77a7bbdd not found: ID does not exist" containerID="b6e2aae751beb1de04d00e403350102ac2ffb47a6c5383acd7a4ae5c77a7bbdd" Sep 17 07:47:19.344903 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:47:19.344865 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b6e2aae751beb1de04d00e403350102ac2ffb47a6c5383acd7a4ae5c77a7bbdd"} err="failed to get container status \"b6e2aae751beb1de04d00e403350102ac2ffb47a6c5383acd7a4ae5c77a7bbdd\": rpc error: code = NotFound desc = could not find container \"b6e2aae751beb1de04d00e403350102ac2ffb47a6c5383acd7a4ae5c77a7bbdd\": container with ID starting with b6e2aae751beb1de04d00e403350102ac2ffb47a6c5383acd7a4ae5c77a7bbdd not found: ID does not exist" Sep 17 07:47:19.344903 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:47:19.344875 2561 scope.go:117] "RemoveContainer" containerID="ff5d796effe889f3cbcd014690816c4a4026d3b7f43073b7bf5d1954dfa58e6e" Sep 17 07:47:19.345091 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:47:19.345071 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ff5d796effe889f3cbcd014690816c4a4026d3b7f43073b7bf5d1954dfa58e6e"} err="failed to get container status \"ff5d796effe889f3cbcd014690816c4a4026d3b7f43073b7bf5d1954dfa58e6e\": rpc error: code = NotFound desc = could not find container \"ff5d796effe889f3cbcd014690816c4a4026d3b7f43073b7bf5d1954dfa58e6e\": container with ID starting with ff5d796effe889f3cbcd014690816c4a4026d3b7f43073b7bf5d1954dfa58e6e not found: ID does not exist" Sep 17 07:47:19.345154 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:47:19.345093 2561 scope.go:117] "RemoveContainer" containerID="b47dc677b694b9d873a052efd6d5847a97b3e047d6b8c3803e6637b8a4a497e5" Sep 17 07:47:19.345324 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:47:19.345306 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b47dc677b694b9d873a052efd6d5847a97b3e047d6b8c3803e6637b8a4a497e5"} err="failed to get container status \"b47dc677b694b9d873a052efd6d5847a97b3e047d6b8c3803e6637b8a4a497e5\": rpc error: code = NotFound desc = could not find container \"b47dc677b694b9d873a052efd6d5847a97b3e047d6b8c3803e6637b8a4a497e5\": container with ID starting with b47dc677b694b9d873a052efd6d5847a97b3e047d6b8c3803e6637b8a4a497e5 not found: ID does not exist" Sep 17 07:47:19.345392 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:47:19.345324 2561 scope.go:117] "RemoveContainer" containerID="25483171bd721759aa4e41523afcdf85d16e37ff82158ce4e65442044b67e175" Sep 17 07:47:19.345515 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:47:19.345500 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"25483171bd721759aa4e41523afcdf85d16e37ff82158ce4e65442044b67e175"} err="failed to get container status \"25483171bd721759aa4e41523afcdf85d16e37ff82158ce4e65442044b67e175\": rpc error: code = NotFound desc = could not find container \"25483171bd721759aa4e41523afcdf85d16e37ff82158ce4e65442044b67e175\": container with ID starting with 25483171bd721759aa4e41523afcdf85d16e37ff82158ce4e65442044b67e175 not found: ID does not exist" Sep 17 07:47:19.345556 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:47:19.345515 2561 scope.go:117] "RemoveContainer" containerID="09b8635ece694eb931f329b83411e2d5d6db21d0271ff7aa155ebca5ed02d778" Sep 17 07:47:19.345695 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:47:19.345680 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"09b8635ece694eb931f329b83411e2d5d6db21d0271ff7aa155ebca5ed02d778"} err="failed to get container status \"09b8635ece694eb931f329b83411e2d5d6db21d0271ff7aa155ebca5ed02d778\": rpc error: code = NotFound desc = could not find container \"09b8635ece694eb931f329b83411e2d5d6db21d0271ff7aa155ebca5ed02d778\": container with ID starting with 09b8635ece694eb931f329b83411e2d5d6db21d0271ff7aa155ebca5ed02d778 not found: ID does not exist" Sep 17 07:47:19.345735 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:47:19.345695 2561 scope.go:117] "RemoveContainer" containerID="6904e1606c28a0785b8cebf64b9f9848d475a4c30060b41fe8d1247457616c2b" Sep 17 07:47:19.345881 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:47:19.345862 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6904e1606c28a0785b8cebf64b9f9848d475a4c30060b41fe8d1247457616c2b"} err="failed to get container status \"6904e1606c28a0785b8cebf64b9f9848d475a4c30060b41fe8d1247457616c2b\": rpc error: code = NotFound desc = could not find container \"6904e1606c28a0785b8cebf64b9f9848d475a4c30060b41fe8d1247457616c2b\": container with ID starting with 6904e1606c28a0785b8cebf64b9f9848d475a4c30060b41fe8d1247457616c2b not found: ID does not exist" Sep 17 07:47:19.345924 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:47:19.345881 2561 scope.go:117] "RemoveContainer" containerID="b6e2aae751beb1de04d00e403350102ac2ffb47a6c5383acd7a4ae5c77a7bbdd" Sep 17 07:47:19.346117 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:47:19.346101 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b6e2aae751beb1de04d00e403350102ac2ffb47a6c5383acd7a4ae5c77a7bbdd"} err="failed to get container status \"b6e2aae751beb1de04d00e403350102ac2ffb47a6c5383acd7a4ae5c77a7bbdd\": rpc error: code = NotFound desc = could not find container \"b6e2aae751beb1de04d00e403350102ac2ffb47a6c5383acd7a4ae5c77a7bbdd\": container with ID starting with b6e2aae751beb1de04d00e403350102ac2ffb47a6c5383acd7a4ae5c77a7bbdd not found: ID does not exist" Sep 17 07:47:20.202484 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:47:20.202455 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9skpb_96c5b8e5-2fc0-489b-8889-52bf66184838/konnectivity-agent/0.log" limit=1024 Sep 17 07:47:20.344467 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:47:20.344437 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9skpb_96c5b8e5-2fc0-489b-8889-52bf66184838/konnectivity-agent/0.log" limit=1024 Sep 17 07:47:20.683808 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:47:20.683778 2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9f6fb216-73d4-4644-8488-7b97e3935c01" path="/var/lib/kubelet/pods/9f6fb216-73d4-4644-8488-7b97e3935c01/volumes" Sep 17 07:47:21.296070 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:47:21.296027 2561 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-hxdpt" podUID="8355e671-642f-43f5-93bb-43a4f4b60b0c" containerName="online" probeResult="failure" output="Get \"https://10.132.0.17:6567/health\": net/http: request canceled (Client.Timeout exceeded while awaiting headers)" Sep 17 07:47:21.296543 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:47:21.296141 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-hxdpt" Sep 17 07:47:21.358330 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:47:21.358297 2561 prober.go:120] "Probe failed" probeType="Liveness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-hxdpt" podUID="8355e671-642f-43f5-93bb-43a4f4b60b0c" containerName="online" probeResult="failure" output="Get \"https://10.132.0.17:6567/health\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)" Sep 17 07:47:21.686237 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:47:21.686197 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9skpb_96c5b8e5-2fc0-489b-8889-52bf66184838/konnectivity-agent/0.log" limit=1024 Sep 17 07:47:21.790920 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:47:21.790867 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9skpb_96c5b8e5-2fc0-489b-8889-52bf66184838/konnectivity-agent/0.log" limit=1024 Sep 17 07:47:22.297398 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:47:22.297356 2561 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-hxdpt" podUID="8355e671-642f-43f5-93bb-43a4f4b60b0c" containerName="online" probeResult="failure" output="Get \"https://10.132.0.17:6567/health\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)" Sep 17 07:47:26.763406 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:47:26.763371 2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-hxdpt"] Sep 17 07:47:26.763829 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:47:26.763578 2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-hxdpt" podUID="8355e671-642f-43f5-93bb-43a4f4b60b0c" containerName="online" containerID="cri-o://2c87c7072593f87eb3229db45466b1f03599ee213cd7ca7bda3d431a50d10a85" gracePeriod=30 Sep 17 07:47:26.763829 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:47:26.763645 2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-hxdpt" podUID="8355e671-642f-43f5-93bb-43a4f4b60b0c" containerName="ui" containerID="cri-o://c66cabac8414e48a89c857c26c5a23b7cfa251954f04ce8ddc786dbb7085b9df" gracePeriod=30 Sep 17 07:47:26.763829 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:47:26.763660 2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-hxdpt" podUID="8355e671-642f-43f5-93bb-43a4f4b60b0c" containerName="offline" containerID="cri-o://ae0649305dfd824df7ba896a543e826fd85c0476813739bd0f21839440109c0c" gracePeriod=30 Sep 17 07:47:26.813062 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:47:26.813036 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9skpb_96c5b8e5-2fc0-489b-8889-52bf66184838/konnectivity-agent/0.log" limit=1024 Sep 17 07:47:27.763816 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:47:27.763773 2561 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-hxdpt" podUID="8355e671-642f-43f5-93bb-43a4f4b60b0c" containerName="online" probeResult="failure" output="Get \"https://10.132.0.17:6567/health\": context deadline exceeded" Sep 17 07:47:28.333206 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:47:28.333179 2561 generic.go:356] "Generic (PLEG): container finished" podID="8355e671-642f-43f5-93bb-43a4f4b60b0c" containerID="c66cabac8414e48a89c857c26c5a23b7cfa251954f04ce8ddc786dbb7085b9df" exitCode=0 Sep 17 07:47:28.333360 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:47:28.333228 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-hxdpt" event={"ID":"8355e671-642f-43f5-93bb-43a4f4b60b0c","Type":"ContainerDied","Data":"c66cabac8414e48a89c857c26c5a23b7cfa251954f04ce8ddc786dbb7085b9df"} Sep 17 07:47:35.359548 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:47:35.359501 2561 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-hxdpt" podUID="8355e671-642f-43f5-93bb-43a4f4b60b0c" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.17:8443: connect: connection refused" Sep 17 07:47:37.764699 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:47:37.764641 2561 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-hxdpt" podUID="8355e671-642f-43f5-93bb-43a4f4b60b0c" containerName="online" probeResult="failure" output="Get \"https://10.132.0.17:6567/health\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)" Sep 17 07:47:41.377871 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:47:41.377842 2561 generic.go:356] "Generic (PLEG): container finished" podID="8355e671-642f-43f5-93bb-43a4f4b60b0c" containerID="2c87c7072593f87eb3229db45466b1f03599ee213cd7ca7bda3d431a50d10a85" exitCode=0 Sep 17 07:47:41.378223 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:47:41.377893 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-hxdpt" event={"ID":"8355e671-642f-43f5-93bb-43a4f4b60b0c","Type":"ContainerDied","Data":"2c87c7072593f87eb3229db45466b1f03599ee213cd7ca7bda3d431a50d10a85"} Sep 17 07:47:45.359731 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:47:45.359691 2561 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-hxdpt" podUID="8355e671-642f-43f5-93bb-43a4f4b60b0c" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.17:8443: connect: connection refused" Sep 17 07:47:46.764655 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:47:46.764615 2561 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-hxdpt" podUID="8355e671-642f-43f5-93bb-43a4f4b60b0c" containerName="online" probeResult="failure" output="Get \"https://10.132.0.17:6567/health\": dial tcp 10.132.0.17:6567: connect: connection refused" Sep 17 07:47:55.359512 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:47:55.359471 2561 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-hxdpt" podUID="8355e671-642f-43f5-93bb-43a4f4b60b0c" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.17:8443: connect: connection refused" Sep 17 07:47:55.359887 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:47:55.359584 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-hxdpt" Sep 17 07:47:56.764594 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:47:56.764538 2561 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-hxdpt" podUID="8355e671-642f-43f5-93bb-43a4f4b60b0c" containerName="online" probeResult="failure" output="Get \"https://10.132.0.17:6567/health\": dial tcp 10.132.0.17:6567: connect: connection refused" Sep 17 07:47:57.399396 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:47:57.399370 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-hxdpt" Sep 17 07:47:57.432238 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:47:57.432211 2561 generic.go:356] "Generic (PLEG): container finished" podID="8355e671-642f-43f5-93bb-43a4f4b60b0c" containerID="ae0649305dfd824df7ba896a543e826fd85c0476813739bd0f21839440109c0c" exitCode=137 Sep 17 07:47:57.432370 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:47:57.432259 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-hxdpt" event={"ID":"8355e671-642f-43f5-93bb-43a4f4b60b0c","Type":"ContainerDied","Data":"ae0649305dfd824df7ba896a543e826fd85c0476813739bd0f21839440109c0c"} Sep 17 07:47:57.432370 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:47:57.432274 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-hxdpt" Sep 17 07:47:57.432370 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:47:57.432294 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-hxdpt" event={"ID":"8355e671-642f-43f5-93bb-43a4f4b60b0c","Type":"ContainerDied","Data":"222b280fa38fa78869cea5d50d92c4e7b1f930f8a90a87f5bd18cf4f2c540790"} Sep 17 07:47:57.432370 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:47:57.432313 2561 scope.go:117] "RemoveContainer" containerID="c66cabac8414e48a89c857c26c5a23b7cfa251954f04ce8ddc786dbb7085b9df" Sep 17 07:47:57.440766 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:47:57.440742 2561 scope.go:117] "RemoveContainer" containerID="ae0649305dfd824df7ba896a543e826fd85c0476813739bd0f21839440109c0c" Sep 17 07:47:57.447753 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:47:57.447738 2561 scope.go:117] "RemoveContainer" containerID="2c87c7072593f87eb3229db45466b1f03599ee213cd7ca7bda3d431a50d10a85" Sep 17 07:47:57.454711 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:47:57.454693 2561 scope.go:117] "RemoveContainer" containerID="16be484dca1a73bb87af559cba366efd4f40c58fc10be8bb4a6a5af1497fa0b3" Sep 17 07:47:57.461100 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:47:57.461080 2561 scope.go:117] "RemoveContainer" containerID="f8db23cfcfd02ee1451cd2ba14a69a446f684b727ec6f91621f6fa7f1eb7ee3c" Sep 17 07:47:57.467522 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:47:57.467500 2561 scope.go:117] "RemoveContainer" containerID="c66cabac8414e48a89c857c26c5a23b7cfa251954f04ce8ddc786dbb7085b9df" Sep 17 07:47:57.467791 ip-10-0-132-17 kubenswrapper[2561]: E0917 07:47:57.467775 2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c66cabac8414e48a89c857c26c5a23b7cfa251954f04ce8ddc786dbb7085b9df\": container with ID starting with c66cabac8414e48a89c857c26c5a23b7cfa251954f04ce8ddc786dbb7085b9df not found: ID does not exist" containerID="c66cabac8414e48a89c857c26c5a23b7cfa251954f04ce8ddc786dbb7085b9df" Sep 17 07:47:57.467835 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:47:57.467801 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c66cabac8414e48a89c857c26c5a23b7cfa251954f04ce8ddc786dbb7085b9df"} err="failed to get container status \"c66cabac8414e48a89c857c26c5a23b7cfa251954f04ce8ddc786dbb7085b9df\": rpc error: code = NotFound desc = could not find container \"c66cabac8414e48a89c857c26c5a23b7cfa251954f04ce8ddc786dbb7085b9df\": container with ID starting with c66cabac8414e48a89c857c26c5a23b7cfa251954f04ce8ddc786dbb7085b9df not found: ID does not exist" Sep 17 07:47:57.467835 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:47:57.467819 2561 scope.go:117] "RemoveContainer" containerID="ae0649305dfd824df7ba896a543e826fd85c0476813739bd0f21839440109c0c" Sep 17 07:47:57.468078 ip-10-0-132-17 kubenswrapper[2561]: E0917 07:47:57.468056 2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ae0649305dfd824df7ba896a543e826fd85c0476813739bd0f21839440109c0c\": container with ID starting with ae0649305dfd824df7ba896a543e826fd85c0476813739bd0f21839440109c0c not found: ID does not exist" containerID="ae0649305dfd824df7ba896a543e826fd85c0476813739bd0f21839440109c0c" Sep 17 07:47:57.468135 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:47:57.468086 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ae0649305dfd824df7ba896a543e826fd85c0476813739bd0f21839440109c0c"} err="failed to get container status \"ae0649305dfd824df7ba896a543e826fd85c0476813739bd0f21839440109c0c\": rpc error: code = NotFound desc = could not find container \"ae0649305dfd824df7ba896a543e826fd85c0476813739bd0f21839440109c0c\": container with ID starting with ae0649305dfd824df7ba896a543e826fd85c0476813739bd0f21839440109c0c not found: ID does not exist" Sep 17 07:47:57.468135 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:47:57.468103 2561 scope.go:117] "RemoveContainer" containerID="2c87c7072593f87eb3229db45466b1f03599ee213cd7ca7bda3d431a50d10a85" Sep 17 07:47:57.468362 ip-10-0-132-17 kubenswrapper[2561]: E0917 07:47:57.468347 2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2c87c7072593f87eb3229db45466b1f03599ee213cd7ca7bda3d431a50d10a85\": container with ID starting with 2c87c7072593f87eb3229db45466b1f03599ee213cd7ca7bda3d431a50d10a85 not found: ID does not exist" containerID="2c87c7072593f87eb3229db45466b1f03599ee213cd7ca7bda3d431a50d10a85" Sep 17 07:47:57.468405 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:47:57.468364 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2c87c7072593f87eb3229db45466b1f03599ee213cd7ca7bda3d431a50d10a85"} err="failed to get container status \"2c87c7072593f87eb3229db45466b1f03599ee213cd7ca7bda3d431a50d10a85\": rpc error: code = NotFound desc = could not find container \"2c87c7072593f87eb3229db45466b1f03599ee213cd7ca7bda3d431a50d10a85\": container with ID starting with 2c87c7072593f87eb3229db45466b1f03599ee213cd7ca7bda3d431a50d10a85 not found: ID does not exist" Sep 17 07:47:57.468405 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:47:57.468376 2561 scope.go:117] "RemoveContainer" containerID="16be484dca1a73bb87af559cba366efd4f40c58fc10be8bb4a6a5af1497fa0b3" Sep 17 07:47:57.468597 ip-10-0-132-17 kubenswrapper[2561]: E0917 07:47:57.468580 2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"16be484dca1a73bb87af559cba366efd4f40c58fc10be8bb4a6a5af1497fa0b3\": container with ID starting with 16be484dca1a73bb87af559cba366efd4f40c58fc10be8bb4a6a5af1497fa0b3 not found: ID does not exist" containerID="16be484dca1a73bb87af559cba366efd4f40c58fc10be8bb4a6a5af1497fa0b3" Sep 17 07:47:57.468663 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:47:57.468606 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"16be484dca1a73bb87af559cba366efd4f40c58fc10be8bb4a6a5af1497fa0b3"} err="failed to get container status \"16be484dca1a73bb87af559cba366efd4f40c58fc10be8bb4a6a5af1497fa0b3\": rpc error: code = NotFound desc = could not find container \"16be484dca1a73bb87af559cba366efd4f40c58fc10be8bb4a6a5af1497fa0b3\": container with ID starting with 16be484dca1a73bb87af559cba366efd4f40c58fc10be8bb4a6a5af1497fa0b3 not found: ID does not exist" Sep 17 07:47:57.468663 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:47:57.468629 2561 scope.go:117] "RemoveContainer" containerID="f8db23cfcfd02ee1451cd2ba14a69a446f684b727ec6f91621f6fa7f1eb7ee3c" Sep 17 07:47:57.468860 ip-10-0-132-17 kubenswrapper[2561]: E0917 07:47:57.468842 2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f8db23cfcfd02ee1451cd2ba14a69a446f684b727ec6f91621f6fa7f1eb7ee3c\": container with ID starting with f8db23cfcfd02ee1451cd2ba14a69a446f684b727ec6f91621f6fa7f1eb7ee3c not found: ID does not exist" containerID="f8db23cfcfd02ee1451cd2ba14a69a446f684b727ec6f91621f6fa7f1eb7ee3c" Sep 17 07:47:57.468902 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:47:57.468865 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f8db23cfcfd02ee1451cd2ba14a69a446f684b727ec6f91621f6fa7f1eb7ee3c"} err="failed to get container status \"f8db23cfcfd02ee1451cd2ba14a69a446f684b727ec6f91621f6fa7f1eb7ee3c\": rpc error: code = NotFound desc = could not find container \"f8db23cfcfd02ee1451cd2ba14a69a446f684b727ec6f91621f6fa7f1eb7ee3c\": container with ID starting with f8db23cfcfd02ee1451cd2ba14a69a446f684b727ec6f91621f6fa7f1eb7ee3c not found: ID does not exist" Sep 17 07:47:57.548507 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:47:57.548439 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/configmap/8355e671-642f-43f5-93bb-43a4f4b60b0c-registry-tls\") pod \"8355e671-642f-43f5-93bb-43a4f4b60b0c\" (UID: \"8355e671-642f-43f5-93bb-43a4f4b60b0c\") " Sep 17 07:47:57.548507 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:47:57.548493 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/8355e671-642f-43f5-93bb-43a4f4b60b0c-offline-tls\") pod \"8355e671-642f-43f5-93bb-43a4f4b60b0c\" (UID: \"8355e671-642f-43f5-93bb-43a4f4b60b0c\") " Sep 17 07:47:57.548682 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:47:57.548522 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hc6qk\" (UniqueName: \"kubernetes.io/projected/8355e671-642f-43f5-93bb-43a4f4b60b0c-kube-api-access-hc6qk\") pod \"8355e671-642f-43f5-93bb-43a4f4b60b0c\" (UID: \"8355e671-642f-43f5-93bb-43a4f4b60b0c\") " Sep 17 07:47:57.548682 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:47:57.548548 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/8355e671-642f-43f5-93bb-43a4f4b60b0c-ui-tls\") pod \"8355e671-642f-43f5-93bb-43a4f4b60b0c\" (UID: \"8355e671-642f-43f5-93bb-43a4f4b60b0c\") " Sep 17 07:47:57.548682 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:47:57.548573 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/8355e671-642f-43f5-93bb-43a4f4b60b0c-online-tls\") pod \"8355e671-642f-43f5-93bb-43a4f4b60b0c\" (UID: \"8355e671-642f-43f5-93bb-43a4f4b60b0c\") " Sep 17 07:47:57.548682 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:47:57.548606 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/8355e671-642f-43f5-93bb-43a4f4b60b0c-feast-data\") pod \"8355e671-642f-43f5-93bb-43a4f4b60b0c\" (UID: \"8355e671-642f-43f5-93bb-43a4f4b60b0c\") " Sep 17 07:47:57.548864 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:47:57.548812 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8355e671-642f-43f5-93bb-43a4f4b60b0c-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "8355e671-642f-43f5-93bb-43a4f4b60b0c" (UID: "8355e671-642f-43f5-93bb-43a4f4b60b0c"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 17 07:47:57.549417 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:47:57.549262 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8355e671-642f-43f5-93bb-43a4f4b60b0c-feast-data" (OuterVolumeSpecName: "feast-data") pod "8355e671-642f-43f5-93bb-43a4f4b60b0c" (UID: "8355e671-642f-43f5-93bb-43a4f4b60b0c"). InnerVolumeSpecName "feast-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 17 07:47:57.551003 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:47:57.550976 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8355e671-642f-43f5-93bb-43a4f4b60b0c-offline-tls" (OuterVolumeSpecName: "offline-tls") pod "8355e671-642f-43f5-93bb-43a4f4b60b0c" (UID: "8355e671-642f-43f5-93bb-43a4f4b60b0c"). InnerVolumeSpecName "offline-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 17 07:47:57.551003 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:47:57.550985 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8355e671-642f-43f5-93bb-43a4f4b60b0c-kube-api-access-hc6qk" (OuterVolumeSpecName: "kube-api-access-hc6qk") pod "8355e671-642f-43f5-93bb-43a4f4b60b0c" (UID: "8355e671-642f-43f5-93bb-43a4f4b60b0c"). InnerVolumeSpecName "kube-api-access-hc6qk". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 17 07:47:57.551132 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:47:57.551015 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8355e671-642f-43f5-93bb-43a4f4b60b0c-online-tls" (OuterVolumeSpecName: "online-tls") pod "8355e671-642f-43f5-93bb-43a4f4b60b0c" (UID: "8355e671-642f-43f5-93bb-43a4f4b60b0c"). InnerVolumeSpecName "online-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 17 07:47:57.551132 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:47:57.551032 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8355e671-642f-43f5-93bb-43a4f4b60b0c-ui-tls" (OuterVolumeSpecName: "ui-tls") pod "8355e671-642f-43f5-93bb-43a4f4b60b0c" (UID: "8355e671-642f-43f5-93bb-43a4f4b60b0c"). InnerVolumeSpecName "ui-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 17 07:47:57.649638 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:47:57.649605 2561 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/configmap/8355e671-642f-43f5-93bb-43a4f4b60b0c-registry-tls\") on node \"ip-10-0-132-17.ec2.internal\" DevicePath \"\"" Sep 17 07:47:57.649638 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:47:57.649632 2561 reconciler_common.go:299] "Volume detached for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/8355e671-642f-43f5-93bb-43a4f4b60b0c-offline-tls\") on node \"ip-10-0-132-17.ec2.internal\" DevicePath \"\"" Sep 17 07:47:57.649638 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:47:57.649640 2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hc6qk\" (UniqueName: \"kubernetes.io/projected/8355e671-642f-43f5-93bb-43a4f4b60b0c-kube-api-access-hc6qk\") on node \"ip-10-0-132-17.ec2.internal\" DevicePath \"\"" Sep 17 07:47:57.649858 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:47:57.649651 2561 reconciler_common.go:299] "Volume detached for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/8355e671-642f-43f5-93bb-43a4f4b60b0c-ui-tls\") on node \"ip-10-0-132-17.ec2.internal\" DevicePath \"\"" Sep 17 07:47:57.649858 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:47:57.649680 2561 reconciler_common.go:299] "Volume detached for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/8355e671-642f-43f5-93bb-43a4f4b60b0c-online-tls\") on node \"ip-10-0-132-17.ec2.internal\" DevicePath \"\"" Sep 17 07:47:57.649858 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:47:57.649688 2561 reconciler_common.go:299] "Volume detached for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/8355e671-642f-43f5-93bb-43a4f4b60b0c-feast-data\") on node \"ip-10-0-132-17.ec2.internal\" DevicePath \"\"" Sep 17 07:47:57.754013 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:47:57.753985 2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-hxdpt"] Sep 17 07:47:57.758532 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:47:57.758507 2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-hxdpt"] Sep 17 07:47:58.684141 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:47:58.684103 2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8355e671-642f-43f5-93bb-43a4f4b60b0c" path="/var/lib/kubelet/pods/8355e671-642f-43f5-93bb-43a4f4b60b0c/volumes" Sep 17 07:48:04.008307 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:48:04.008229 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9skpb_96c5b8e5-2fc0-489b-8889-52bf66184838/konnectivity-agent/0.log" limit=1024 Sep 17 07:48:04.099248 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:48:04.099218 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9skpb_96c5b8e5-2fc0-489b-8889-52bf66184838/konnectivity-agent/0.log" limit=1024 Sep 17 07:48:05.046265 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:48:05.046236 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9skpb_96c5b8e5-2fc0-489b-8889-52bf66184838/konnectivity-agent/0.log" limit=1024 Sep 17 07:48:05.130426 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:48:05.130399 2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["feast-operator-system/feast-operator-controller-manager-689b877b4b-mx2rs"] Sep 17 07:48:05.130616 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:48:05.130580 2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="feast-operator-system/feast-operator-controller-manager-689b877b4b-mx2rs" podUID="c0b900e9-1a37-421a-8464-183ad367dc3c" containerName="manager" containerID="cri-o://f17507cfaf98da27eb1bb94af32f82fc40c086558886c738818be02561a2e172" gracePeriod=10 Sep 17 07:48:05.360619 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:48:05.360595 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="feast-operator-system/feast-operator-controller-manager-689b877b4b-mx2rs" Sep 17 07:48:05.461652 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:48:05.461617 2561 generic.go:356] "Generic (PLEG): container finished" podID="c0b900e9-1a37-421a-8464-183ad367dc3c" containerID="f17507cfaf98da27eb1bb94af32f82fc40c086558886c738818be02561a2e172" exitCode=0 Sep 17 07:48:05.461811 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:48:05.461660 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="feast-operator-system/feast-operator-controller-manager-689b877b4b-mx2rs" Sep 17 07:48:05.461811 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:48:05.461695 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="feast-operator-system/feast-operator-controller-manager-689b877b4b-mx2rs" event={"ID":"c0b900e9-1a37-421a-8464-183ad367dc3c","Type":"ContainerDied","Data":"f17507cfaf98da27eb1bb94af32f82fc40c086558886c738818be02561a2e172"} Sep 17 07:48:05.461811 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:48:05.461750 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="feast-operator-system/feast-operator-controller-manager-689b877b4b-mx2rs" event={"ID":"c0b900e9-1a37-421a-8464-183ad367dc3c","Type":"ContainerDied","Data":"f2e798346b89020dee751483a33458a5eed03d04b30effa94ae7569147a6566b"} Sep 17 07:48:05.461811 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:48:05.461772 2561 scope.go:117] "RemoveContainer" containerID="f17507cfaf98da27eb1bb94af32f82fc40c086558886c738818be02561a2e172" Sep 17 07:48:05.469138 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:48:05.469120 2561 scope.go:117] "RemoveContainer" containerID="f17507cfaf98da27eb1bb94af32f82fc40c086558886c738818be02561a2e172" Sep 17 07:48:05.469401 ip-10-0-132-17 kubenswrapper[2561]: E0917 07:48:05.469382 2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f17507cfaf98da27eb1bb94af32f82fc40c086558886c738818be02561a2e172\": container with ID starting with f17507cfaf98da27eb1bb94af32f82fc40c086558886c738818be02561a2e172 not found: ID does not exist" containerID="f17507cfaf98da27eb1bb94af32f82fc40c086558886c738818be02561a2e172" Sep 17 07:48:05.469445 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:48:05.469411 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f17507cfaf98da27eb1bb94af32f82fc40c086558886c738818be02561a2e172"} err="failed to get container status \"f17507cfaf98da27eb1bb94af32f82fc40c086558886c738818be02561a2e172\": rpc error: code = NotFound desc = could not find container \"f17507cfaf98da27eb1bb94af32f82fc40c086558886c738818be02561a2e172\": container with ID starting with f17507cfaf98da27eb1bb94af32f82fc40c086558886c738818be02561a2e172 not found: ID does not exist" Sep 17 07:48:05.504203 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:48:05.504181 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8pkm7\" (UniqueName: \"kubernetes.io/projected/c0b900e9-1a37-421a-8464-183ad367dc3c-kube-api-access-8pkm7\") pod \"c0b900e9-1a37-421a-8464-183ad367dc3c\" (UID: \"c0b900e9-1a37-421a-8464-183ad367dc3c\") " Sep 17 07:48:05.506242 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:48:05.506223 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c0b900e9-1a37-421a-8464-183ad367dc3c-kube-api-access-8pkm7" (OuterVolumeSpecName: "kube-api-access-8pkm7") pod "c0b900e9-1a37-421a-8464-183ad367dc3c" (UID: "c0b900e9-1a37-421a-8464-183ad367dc3c"). InnerVolumeSpecName "kube-api-access-8pkm7". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 17 07:48:05.605386 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:48:05.605314 2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8pkm7\" (UniqueName: \"kubernetes.io/projected/c0b900e9-1a37-421a-8464-183ad367dc3c-kube-api-access-8pkm7\") on node \"ip-10-0-132-17.ec2.internal\" DevicePath \"\"" Sep 17 07:48:05.803920 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:48:05.803891 2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["feast-operator-system/feast-operator-controller-manager-689b877b4b-mx2rs"] Sep 17 07:48:05.808174 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:48:05.808153 2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["feast-operator-system/feast-operator-controller-manager-689b877b4b-mx2rs"] Sep 17 07:48:06.687772 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:48:06.687043 2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c0b900e9-1a37-421a-8464-183ad367dc3c" path="/var/lib/kubelet/pods/c0b900e9-1a37-421a-8464-183ad367dc3c/volumes" Sep 17 07:48:10.433164 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:48:10.433136 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["feast-operator-system/feast-operator-controller-manager-689b877b4b-7pxp7"] Sep 17 07:48:10.433594 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:48:10.433345 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9f6fb216-73d4-4644-8488-7b97e3935c01" containerName="feast-init" Sep 17 07:48:10.433594 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:48:10.433356 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="9f6fb216-73d4-4644-8488-7b97e3935c01" containerName="feast-init" Sep 17 07:48:10.433594 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:48:10.433364 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8355e671-642f-43f5-93bb-43a4f4b60b0c" containerName="feast-apply" Sep 17 07:48:10.433594 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:48:10.433370 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="8355e671-642f-43f5-93bb-43a4f4b60b0c" containerName="feast-apply" Sep 17 07:48:10.433594 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:48:10.433376 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8355e671-642f-43f5-93bb-43a4f4b60b0c" containerName="ui" Sep 17 07:48:10.433594 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:48:10.433382 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="8355e671-642f-43f5-93bb-43a4f4b60b0c" containerName="ui" Sep 17 07:48:10.433594 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:48:10.433390 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9f6fb216-73d4-4644-8488-7b97e3935c01" containerName="feast-apply" Sep 17 07:48:10.433594 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:48:10.433397 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="9f6fb216-73d4-4644-8488-7b97e3935c01" containerName="feast-apply" Sep 17 07:48:10.433594 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:48:10.433406 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8355e671-642f-43f5-93bb-43a4f4b60b0c" containerName="feast-init" Sep 17 07:48:10.433594 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:48:10.433411 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="8355e671-642f-43f5-93bb-43a4f4b60b0c" containerName="feast-init" Sep 17 07:48:10.433594 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:48:10.433417 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8355e671-642f-43f5-93bb-43a4f4b60b0c" containerName="online" Sep 17 07:48:10.433594 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:48:10.433422 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="8355e671-642f-43f5-93bb-43a4f4b60b0c" containerName="online" Sep 17 07:48:10.433594 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:48:10.433431 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9f6fb216-73d4-4644-8488-7b97e3935c01" containerName="online" Sep 17 07:48:10.433594 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:48:10.433436 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="9f6fb216-73d4-4644-8488-7b97e3935c01" containerName="online" Sep 17 07:48:10.433594 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:48:10.433442 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8355e671-642f-43f5-93bb-43a4f4b60b0c" containerName="offline" Sep 17 07:48:10.433594 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:48:10.433446 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="8355e671-642f-43f5-93bb-43a4f4b60b0c" containerName="offline" Sep 17 07:48:10.433594 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:48:10.433453 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9f6fb216-73d4-4644-8488-7b97e3935c01" containerName="ui" Sep 17 07:48:10.433594 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:48:10.433458 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="9f6fb216-73d4-4644-8488-7b97e3935c01" containerName="ui" Sep 17 07:48:10.433594 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:48:10.433463 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9f6fb216-73d4-4644-8488-7b97e3935c01" containerName="registry" Sep 17 07:48:10.433594 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:48:10.433468 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="9f6fb216-73d4-4644-8488-7b97e3935c01" containerName="registry" Sep 17 07:48:10.433594 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:48:10.433473 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c0b900e9-1a37-421a-8464-183ad367dc3c" containerName="manager" Sep 17 07:48:10.433594 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:48:10.433477 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="c0b900e9-1a37-421a-8464-183ad367dc3c" containerName="manager" Sep 17 07:48:10.433594 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:48:10.433483 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9f6fb216-73d4-4644-8488-7b97e3935c01" containerName="offline" Sep 17 07:48:10.433594 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:48:10.433487 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="9f6fb216-73d4-4644-8488-7b97e3935c01" containerName="offline" Sep 17 07:48:10.433594 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:48:10.433522 2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="9f6fb216-73d4-4644-8488-7b97e3935c01" containerName="online" Sep 17 07:48:10.433594 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:48:10.433529 2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="9f6fb216-73d4-4644-8488-7b97e3935c01" containerName="offline" Sep 17 07:48:10.433594 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:48:10.433535 2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="9f6fb216-73d4-4644-8488-7b97e3935c01" containerName="ui" Sep 17 07:48:10.433594 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:48:10.433541 2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="8355e671-642f-43f5-93bb-43a4f4b60b0c" containerName="offline" Sep 17 07:48:10.433594 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:48:10.433547 2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="c0b900e9-1a37-421a-8464-183ad367dc3c" containerName="manager" Sep 17 07:48:10.433594 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:48:10.433552 2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="9f6fb216-73d4-4644-8488-7b97e3935c01" containerName="registry" Sep 17 07:48:10.433594 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:48:10.433557 2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="8355e671-642f-43f5-93bb-43a4f4b60b0c" containerName="ui" Sep 17 07:48:10.433594 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:48:10.433563 2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="8355e671-642f-43f5-93bb-43a4f4b60b0c" containerName="online" Sep 17 07:48:10.437604 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:48:10.437589 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="feast-operator-system/feast-operator-controller-manager-689b877b4b-7pxp7" Sep 17 07:48:10.441972 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:48:10.441950 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"feast-operator-system\"/\"openshift-service-ca.crt\"" Sep 17 07:48:10.442878 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:48:10.442859 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"feast-operator-system\"/\"kube-root-ca.crt\"" Sep 17 07:48:10.452695 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:48:10.452678 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"feast-operator-system\"/\"feast-operator-controller-manager-dockercfg-87bph\"" Sep 17 07:48:10.458083 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:48:10.458063 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["feast-operator-system/feast-operator-controller-manager-689b877b4b-7pxp7"] Sep 17 07:48:10.535455 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:48:10.535426 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jrjf2\" (UniqueName: \"kubernetes.io/projected/848710f9-5c0f-4587-9ebe-bf7e0d4c09fb-kube-api-access-jrjf2\") pod \"feast-operator-controller-manager-689b877b4b-7pxp7\" (UID: \"848710f9-5c0f-4587-9ebe-bf7e0d4c09fb\") " pod="feast-operator-system/feast-operator-controller-manager-689b877b4b-7pxp7" Sep 17 07:48:10.636619 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:48:10.636597 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jrjf2\" (UniqueName: \"kubernetes.io/projected/848710f9-5c0f-4587-9ebe-bf7e0d4c09fb-kube-api-access-jrjf2\") pod \"feast-operator-controller-manager-689b877b4b-7pxp7\" (UID: \"848710f9-5c0f-4587-9ebe-bf7e0d4c09fb\") " pod="feast-operator-system/feast-operator-controller-manager-689b877b4b-7pxp7" Sep 17 07:48:10.646478 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:48:10.646454 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jrjf2\" (UniqueName: \"kubernetes.io/projected/848710f9-5c0f-4587-9ebe-bf7e0d4c09fb-kube-api-access-jrjf2\") pod \"feast-operator-controller-manager-689b877b4b-7pxp7\" (UID: \"848710f9-5c0f-4587-9ebe-bf7e0d4c09fb\") " pod="feast-operator-system/feast-operator-controller-manager-689b877b4b-7pxp7" Sep 17 07:48:10.746563 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:48:10.746494 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="feast-operator-system/feast-operator-controller-manager-689b877b4b-7pxp7" Sep 17 07:48:11.028035 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:48:11.027964 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["feast-operator-system/feast-operator-controller-manager-689b877b4b-7pxp7"] Sep 17 07:48:11.031321 ip-10-0-132-17 kubenswrapper[2561]: W0917 07:48:11.031292 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod848710f9_5c0f_4587_9ebe_bf7e0d4c09fb.slice/crio-3e05871440b1e6ecc71936a7e5bcab5dbd8150f770211655c64f708111e37fe7 WatchSource:0}: Error finding container 3e05871440b1e6ecc71936a7e5bcab5dbd8150f770211655c64f708111e37fe7: Status 404 returned error can't find the container with id 3e05871440b1e6ecc71936a7e5bcab5dbd8150f770211655c64f708111e37fe7 Sep 17 07:48:11.483883 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:48:11.483851 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="feast-operator-system/feast-operator-controller-manager-689b877b4b-7pxp7" event={"ID":"848710f9-5c0f-4587-9ebe-bf7e0d4c09fb","Type":"ContainerStarted","Data":"3ec83d09ad775c3426e0f13162856afa44cd30370e4780276f2706ce0156c50f"} Sep 17 07:48:11.484281 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:48:11.483904 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="feast-operator-system/feast-operator-controller-manager-689b877b4b-7pxp7" event={"ID":"848710f9-5c0f-4587-9ebe-bf7e0d4c09fb","Type":"ContainerStarted","Data":"3e05871440b1e6ecc71936a7e5bcab5dbd8150f770211655c64f708111e37fe7"} Sep 17 07:48:11.484281 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:48:11.483966 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="feast-operator-system/feast-operator-controller-manager-689b877b4b-7pxp7" Sep 17 07:48:22.490236 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:48:22.490207 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="feast-operator-system/feast-operator-controller-manager-689b877b4b-7pxp7" Sep 17 07:48:22.512665 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:48:22.512616 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="feast-operator-system/feast-operator-controller-manager-689b877b4b-7pxp7" podStartSLOduration=12.512601216 podStartE2EDuration="12.512601216s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 07:48:10 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 07:48:11.518063324 +0000 UTC m=+1709.324009596" watchObservedRunningTime="2026-09-17 07:48:22.512601216 +0000 UTC m=+1720.318547490" Sep 17 07:48:26.697716 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:48:26.697682 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9skpb_96c5b8e5-2fc0-489b-8889-52bf66184838/konnectivity-agent/0.log" limit=1024 Sep 17 07:48:26.799878 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:48:26.799850 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9skpb_96c5b8e5-2fc0-489b-8889-52bf66184838/konnectivity-agent/0.log" limit=1024 Sep 17 07:48:29.819702 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:48:29.819664 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9skpb_96c5b8e5-2fc0-489b-8889-52bf66184838/konnectivity-agent/0.log" limit=1024 Sep 17 07:48:29.918657 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:48:29.918623 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9skpb_96c5b8e5-2fc0-489b-8889-52bf66184838/konnectivity-agent/0.log" limit=1024 Sep 17 07:48:29.987649 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:48:29.987618 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["test-ns-feast/feast-simple-feast-setup-57576b8fcf-rxcsb"] Sep 17 07:48:29.990870 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:48:29.990854 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-rxcsb" Sep 17 07:48:29.993374 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:48:29.993356 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-offline-tls\"" Sep 17 07:48:29.993572 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:48:29.993560 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-dockercfg-tmnlt\"" Sep 17 07:48:29.993800 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:48:29.993787 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-registry-tls\"" Sep 17 07:48:29.994584 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:48:29.994567 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-ui-tls\"" Sep 17 07:48:29.994678 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:48:29.994581 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-online-tls\"" Sep 17 07:48:29.994678 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:48:29.994618 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast\"/\"openshift-service-ca.crt\"" Sep 17 07:48:29.994678 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:48:29.994672 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast\"/\"kube-root-ca.crt\"" Sep 17 07:48:30.012340 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:48:30.012316 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-57576b8fcf-rxcsb"] Sep 17 07:48:30.021747 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:48:30.021722 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9skpb_96c5b8e5-2fc0-489b-8889-52bf66184838/konnectivity-agent/0.log" limit=1024 Sep 17 07:48:30.112399 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:48:30.112331 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9skpb_96c5b8e5-2fc0-489b-8889-52bf66184838/konnectivity-agent/0.log" limit=1024 Sep 17 07:48:30.163550 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:48:30.163523 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/3656067a-1681-47ee-a484-c614cca4f45a-online-tls\") pod \"feast-simple-feast-setup-57576b8fcf-rxcsb\" (UID: \"3656067a-1681-47ee-a484-c614cca4f45a\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-rxcsb" Sep 17 07:48:30.163675 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:48:30.163555 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/3656067a-1681-47ee-a484-c614cca4f45a-feast-data\") pod \"feast-simple-feast-setup-57576b8fcf-rxcsb\" (UID: \"3656067a-1681-47ee-a484-c614cca4f45a\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-rxcsb" Sep 17 07:48:30.163675 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:48:30.163575 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/3656067a-1681-47ee-a484-c614cca4f45a-registry-tls\") pod \"feast-simple-feast-setup-57576b8fcf-rxcsb\" (UID: \"3656067a-1681-47ee-a484-c614cca4f45a\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-rxcsb" Sep 17 07:48:30.163675 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:48:30.163590 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/3656067a-1681-47ee-a484-c614cca4f45a-ui-tls\") pod \"feast-simple-feast-setup-57576b8fcf-rxcsb\" (UID: \"3656067a-1681-47ee-a484-c614cca4f45a\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-rxcsb" Sep 17 07:48:30.163675 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:48:30.163665 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rbpps\" (UniqueName: \"kubernetes.io/projected/3656067a-1681-47ee-a484-c614cca4f45a-kube-api-access-rbpps\") pod \"feast-simple-feast-setup-57576b8fcf-rxcsb\" (UID: \"3656067a-1681-47ee-a484-c614cca4f45a\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-rxcsb" Sep 17 07:48:30.163811 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:48:30.163685 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/3656067a-1681-47ee-a484-c614cca4f45a-offline-tls\") pod \"feast-simple-feast-setup-57576b8fcf-rxcsb\" (UID: \"3656067a-1681-47ee-a484-c614cca4f45a\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-rxcsb" Sep 17 07:48:30.253058 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:48:30.253031 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9skpb_96c5b8e5-2fc0-489b-8889-52bf66184838/konnectivity-agent/0.log" limit=1024 Sep 17 07:48:30.264615 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:48:30.264593 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/3656067a-1681-47ee-a484-c614cca4f45a-online-tls\") pod \"feast-simple-feast-setup-57576b8fcf-rxcsb\" (UID: \"3656067a-1681-47ee-a484-c614cca4f45a\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-rxcsb" Sep 17 07:48:30.264677 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:48:30.264622 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/3656067a-1681-47ee-a484-c614cca4f45a-feast-data\") pod \"feast-simple-feast-setup-57576b8fcf-rxcsb\" (UID: \"3656067a-1681-47ee-a484-c614cca4f45a\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-rxcsb" Sep 17 07:48:30.264677 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:48:30.264639 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/3656067a-1681-47ee-a484-c614cca4f45a-registry-tls\") pod \"feast-simple-feast-setup-57576b8fcf-rxcsb\" (UID: \"3656067a-1681-47ee-a484-c614cca4f45a\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-rxcsb" Sep 17 07:48:30.264677 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:48:30.264654 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/3656067a-1681-47ee-a484-c614cca4f45a-ui-tls\") pod \"feast-simple-feast-setup-57576b8fcf-rxcsb\" (UID: \"3656067a-1681-47ee-a484-c614cca4f45a\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-rxcsb" Sep 17 07:48:30.264821 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:48:30.264687 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rbpps\" (UniqueName: \"kubernetes.io/projected/3656067a-1681-47ee-a484-c614cca4f45a-kube-api-access-rbpps\") pod \"feast-simple-feast-setup-57576b8fcf-rxcsb\" (UID: \"3656067a-1681-47ee-a484-c614cca4f45a\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-rxcsb" Sep 17 07:48:30.264821 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:48:30.264706 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/3656067a-1681-47ee-a484-c614cca4f45a-offline-tls\") pod \"feast-simple-feast-setup-57576b8fcf-rxcsb\" (UID: \"3656067a-1681-47ee-a484-c614cca4f45a\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-rxcsb" Sep 17 07:48:30.264821 ip-10-0-132-17 kubenswrapper[2561]: E0917 07:48:30.264790 2561 secret.go:189] Couldn't get secret test-ns-feast/feast-simple-feast-setup-ui-tls: secret "feast-simple-feast-setup-ui-tls" not found Sep 17 07:48:30.264968 ip-10-0-132-17 kubenswrapper[2561]: E0917 07:48:30.264883 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3656067a-1681-47ee-a484-c614cca4f45a-ui-tls podName:3656067a-1681-47ee-a484-c614cca4f45a nodeName:}" failed. No retries permitted until 2026-09-17 07:48:30.764864512 +0000 UTC m=+1728.570810764 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "ui-tls" (UniqueName: "kubernetes.io/secret/3656067a-1681-47ee-a484-c614cca4f45a-ui-tls") pod "feast-simple-feast-setup-57576b8fcf-rxcsb" (UID: "3656067a-1681-47ee-a484-c614cca4f45a") : secret "feast-simple-feast-setup-ui-tls" not found Sep 17 07:48:30.265094 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:48:30.265069 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/3656067a-1681-47ee-a484-c614cca4f45a-feast-data\") pod \"feast-simple-feast-setup-57576b8fcf-rxcsb\" (UID: \"3656067a-1681-47ee-a484-c614cca4f45a\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-rxcsb" Sep 17 07:48:30.267469 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:48:30.267438 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/3656067a-1681-47ee-a484-c614cca4f45a-online-tls\") pod \"feast-simple-feast-setup-57576b8fcf-rxcsb\" (UID: \"3656067a-1681-47ee-a484-c614cca4f45a\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-rxcsb" Sep 17 07:48:30.267565 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:48:30.267444 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/3656067a-1681-47ee-a484-c614cca4f45a-registry-tls\") pod \"feast-simple-feast-setup-57576b8fcf-rxcsb\" (UID: \"3656067a-1681-47ee-a484-c614cca4f45a\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-rxcsb" Sep 17 07:48:30.267622 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:48:30.267583 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/3656067a-1681-47ee-a484-c614cca4f45a-offline-tls\") pod \"feast-simple-feast-setup-57576b8fcf-rxcsb\" (UID: \"3656067a-1681-47ee-a484-c614cca4f45a\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-rxcsb" Sep 17 07:48:30.276918 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:48:30.276891 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rbpps\" (UniqueName: \"kubernetes.io/projected/3656067a-1681-47ee-a484-c614cca4f45a-kube-api-access-rbpps\") pod \"feast-simple-feast-setup-57576b8fcf-rxcsb\" (UID: \"3656067a-1681-47ee-a484-c614cca4f45a\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-rxcsb" Sep 17 07:48:30.767608 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:48:30.767577 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/3656067a-1681-47ee-a484-c614cca4f45a-ui-tls\") pod \"feast-simple-feast-setup-57576b8fcf-rxcsb\" (UID: \"3656067a-1681-47ee-a484-c614cca4f45a\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-rxcsb" Sep 17 07:48:30.767779 ip-10-0-132-17 kubenswrapper[2561]: E0917 07:48:30.767682 2561 secret.go:189] Couldn't get secret test-ns-feast/feast-simple-feast-setup-ui-tls: secret "feast-simple-feast-setup-ui-tls" not found Sep 17 07:48:30.767779 ip-10-0-132-17 kubenswrapper[2561]: E0917 07:48:30.767748 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3656067a-1681-47ee-a484-c614cca4f45a-ui-tls podName:3656067a-1681-47ee-a484-c614cca4f45a nodeName:}" failed. No retries permitted until 2026-09-17 07:48:31.767730722 +0000 UTC m=+1729.573676974 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "ui-tls" (UniqueName: "kubernetes.io/secret/3656067a-1681-47ee-a484-c614cca4f45a-ui-tls") pod "feast-simple-feast-setup-57576b8fcf-rxcsb" (UID: "3656067a-1681-47ee-a484-c614cca4f45a") : secret "feast-simple-feast-setup-ui-tls" not found Sep 17 07:48:31.000627 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:48:31.000600 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9skpb_96c5b8e5-2fc0-489b-8889-52bf66184838/konnectivity-agent/0.log" limit=1024 Sep 17 07:48:31.774211 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:48:31.774168 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/3656067a-1681-47ee-a484-c614cca4f45a-ui-tls\") pod \"feast-simple-feast-setup-57576b8fcf-rxcsb\" (UID: \"3656067a-1681-47ee-a484-c614cca4f45a\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-rxcsb" Sep 17 07:48:31.776644 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:48:31.776626 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/3656067a-1681-47ee-a484-c614cca4f45a-ui-tls\") pod \"feast-simple-feast-setup-57576b8fcf-rxcsb\" (UID: \"3656067a-1681-47ee-a484-c614cca4f45a\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-rxcsb" Sep 17 07:48:31.799705 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:48:31.799673 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-rxcsb" Sep 17 07:48:32.080799 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:48:32.080769 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-57576b8fcf-rxcsb"] Sep 17 07:48:32.081944 ip-10-0-132-17 kubenswrapper[2561]: W0917 07:48:32.081898 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod3656067a_1681_47ee_a484_c614cca4f45a.slice/crio-8edf3679d343df42c96dc0f4bfbc5bdc34f0ce73d7e107b496ceeb146f21347a WatchSource:0}: Error finding container 8edf3679d343df42c96dc0f4bfbc5bdc34f0ce73d7e107b496ceeb146f21347a: Status 404 returned error can't find the container with id 8edf3679d343df42c96dc0f4bfbc5bdc34f0ce73d7e107b496ceeb146f21347a Sep 17 07:48:32.557310 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:48:32.557277 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-rxcsb" event={"ID":"3656067a-1681-47ee-a484-c614cca4f45a","Type":"ContainerStarted","Data":"6cc7f96c48882897f2238e1e8d4ce531effa8e7fc8724d3ce781d7cbebc72836"} Sep 17 07:48:32.557526 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:48:32.557320 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-rxcsb" event={"ID":"3656067a-1681-47ee-a484-c614cca4f45a","Type":"ContainerStarted","Data":"8edf3679d343df42c96dc0f4bfbc5bdc34f0ce73d7e107b496ceeb146f21347a"} Sep 17 07:48:37.576946 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:48:37.576907 2561 generic.go:356] "Generic (PLEG): container finished" podID="3656067a-1681-47ee-a484-c614cca4f45a" containerID="6cc7f96c48882897f2238e1e8d4ce531effa8e7fc8724d3ce781d7cbebc72836" exitCode=0 Sep 17 07:48:37.577319 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:48:37.576957 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-rxcsb" event={"ID":"3656067a-1681-47ee-a484-c614cca4f45a","Type":"ContainerDied","Data":"6cc7f96c48882897f2238e1e8d4ce531effa8e7fc8724d3ce781d7cbebc72836"} Sep 17 07:48:38.582370 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:48:38.582334 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-rxcsb" event={"ID":"3656067a-1681-47ee-a484-c614cca4f45a","Type":"ContainerStarted","Data":"c44bd9622f2dd1dfe3e2e4daee320944f427fbd68e76f57c10b699e665481f9a"} Sep 17 07:48:43.602587 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:48:43.602507 2561 generic.go:356] "Generic (PLEG): container finished" podID="3656067a-1681-47ee-a484-c614cca4f45a" containerID="c44bd9622f2dd1dfe3e2e4daee320944f427fbd68e76f57c10b699e665481f9a" exitCode=0 Sep 17 07:48:43.602983 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:48:43.602582 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-rxcsb" event={"ID":"3656067a-1681-47ee-a484-c614cca4f45a","Type":"ContainerDied","Data":"c44bd9622f2dd1dfe3e2e4daee320944f427fbd68e76f57c10b699e665481f9a"} Sep 17 07:48:44.612152 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:48:44.612114 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-rxcsb" event={"ID":"3656067a-1681-47ee-a484-c614cca4f45a","Type":"ContainerStarted","Data":"8d6aadc6e3fad80714659223b552cb0835c77366522166a5f17e01f333d739dd"} Sep 17 07:48:44.612746 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:48:44.612723 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-rxcsb" event={"ID":"3656067a-1681-47ee-a484-c614cca4f45a","Type":"ContainerStarted","Data":"56017cc56ddfbe86298281e03897276ede7fedfe53417f94e02978161ef17fe7"} Sep 17 07:48:44.612892 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:48:44.612872 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-rxcsb" event={"ID":"3656067a-1681-47ee-a484-c614cca4f45a","Type":"ContainerStarted","Data":"57ed7ec7197f141f9b16f20c06a2ae474006186bb7de333aef41e86f7318ed91"} Sep 17 07:48:44.613047 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:48:44.613029 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-rxcsb" event={"ID":"3656067a-1681-47ee-a484-c614cca4f45a","Type":"ContainerStarted","Data":"cd18653f9f630c300320c0cde4c705bf9ea4282f1c5bd4510445fd9aef82c5d9"} Sep 17 07:48:44.648181 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:48:44.648114 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-rxcsb" podStartSLOduration=15.648092311 podStartE2EDuration="15.648092311s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 07:48:29 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 07:48:44.64775688 +0000 UTC m=+1742.453703154" watchObservedRunningTime="2026-09-17 07:48:44.648092311 +0000 UTC m=+1742.454038586" Sep 17 07:48:46.800797 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:48:46.800766 2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-rxcsb" Sep 17 07:48:46.801389 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:48:46.801370 2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-rxcsb" Sep 17 07:48:46.801538 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:48:46.801512 2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-rxcsb" Sep 17 07:48:46.801538 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:48:46.801540 2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-rxcsb" Sep 17 07:48:46.803005 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:48:46.802974 2561 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-rxcsb" podUID="3656067a-1681-47ee-a484-c614cca4f45a" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.19:8443: connect: connection refused" Sep 17 07:48:46.803209 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:48:46.803000 2561 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-rxcsb" podUID="3656067a-1681-47ee-a484-c614cca4f45a" containerName="registry" probeResult="failure" output="dial tcp 10.132.0.19:6571: connect: connection refused" Sep 17 07:48:46.803282 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:48:46.803039 2561 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-rxcsb" podUID="3656067a-1681-47ee-a484-c614cca4f45a" containerName="offline" probeResult="failure" output="dial tcp 10.132.0.19:8816: connect: connection refused" Sep 17 07:48:46.803282 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:48:46.803034 2561 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-rxcsb" podUID="3656067a-1681-47ee-a484-c614cca4f45a" containerName="online" probeResult="failure" output="Get \"https://10.132.0.19:6567/health\": dial tcp 10.132.0.19:6567: connect: connection refused" Sep 17 07:48:49.800112 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:48:49.800063 2561 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-rxcsb" podUID="3656067a-1681-47ee-a484-c614cca4f45a" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.19:8443: connect: connection refused" Sep 17 07:48:49.800112 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:48:49.800102 2561 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-rxcsb" podUID="3656067a-1681-47ee-a484-c614cca4f45a" containerName="online" probeResult="failure" output="Get \"https://10.132.0.19:6567/health\": dial tcp 10.132.0.19:6567: connect: connection refused" Sep 17 07:48:49.800702 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:48:49.800063 2561 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-rxcsb" podUID="3656067a-1681-47ee-a484-c614cca4f45a" containerName="registry" probeResult="failure" output="dial tcp 10.132.0.19:6571: connect: connection refused" Sep 17 07:48:49.800702 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:48:49.800066 2561 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-rxcsb" podUID="3656067a-1681-47ee-a484-c614cca4f45a" containerName="offline" probeResult="failure" output="dial tcp 10.132.0.19:8816: connect: connection refused" Sep 17 07:48:51.800612 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:48:51.800579 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-rxcsb" Sep 17 07:48:51.801011 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:48:51.800656 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-rxcsb" Sep 17 07:48:51.801011 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:48:51.800692 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-rxcsb" Sep 17 07:48:51.801011 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:48:51.800704 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-rxcsb" Sep 17 07:48:52.801685 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:48:52.801647 2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-rxcsb" Sep 17 07:48:52.802094 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:48:52.801825 2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-rxcsb" Sep 17 07:48:52.802297 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:48:52.802279 2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-rxcsb" Sep 17 07:48:52.806793 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:48:52.806770 2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-rxcsb" Sep 17 07:48:53.650730 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:48:53.650702 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-rxcsb" Sep 17 07:48:53.650910 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:48:53.650797 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-rxcsb" Sep 17 07:48:53.650910 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:48:53.650889 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-rxcsb" Sep 17 07:48:53.653329 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:48:53.653316 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-rxcsb" Sep 17 07:49:42.736311 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:49:42.736284 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2frz9_0b5240b1-13ea-4cee-b7f1-aa241ca58aa4/ovn-acl-logging/0.log" Sep 17 07:49:42.736776 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:49:42.736319 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2frz9_0b5240b1-13ea-4cee-b7f1-aa241ca58aa4/ovn-acl-logging/0.log" Sep 17 07:49:55.636967 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:49:55.636898 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9skpb_96c5b8e5-2fc0-489b-8889-52bf66184838/konnectivity-agent/0.log" limit=1024 Sep 17 07:49:55.654586 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:49:55.654553 2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-57576b8fcf-rxcsb"] Sep 17 07:49:55.654827 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:49:55.654798 2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-rxcsb" podUID="3656067a-1681-47ee-a484-c614cca4f45a" containerName="registry" containerID="cri-o://cd18653f9f630c300320c0cde4c705bf9ea4282f1c5bd4510445fd9aef82c5d9" gracePeriod=30 Sep 17 07:49:55.655114 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:49:55.654847 2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-rxcsb" podUID="3656067a-1681-47ee-a484-c614cca4f45a" containerName="offline" containerID="cri-o://56017cc56ddfbe86298281e03897276ede7fedfe53417f94e02978161ef17fe7" gracePeriod=30 Sep 17 07:49:55.655253 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:49:55.654847 2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-rxcsb" podUID="3656067a-1681-47ee-a484-c614cca4f45a" containerName="online" containerID="cri-o://57ed7ec7197f141f9b16f20c06a2ae474006186bb7de333aef41e86f7318ed91" gracePeriod=30 Sep 17 07:49:55.655327 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:49:55.654955 2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-rxcsb" podUID="3656067a-1681-47ee-a484-c614cca4f45a" containerName="ui" containerID="cri-o://8d6aadc6e3fad80714659223b552cb0835c77366522166a5f17e01f333d739dd" gracePeriod=30 Sep 17 07:49:56.102844 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:49:56.102761 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["test-ns-feast/feast-simple-feast-setup-57576b8fcf-jp468"] Sep 17 07:49:56.106404 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:49:56.106380 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-jp468" Sep 17 07:49:56.109611 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:49:56.109588 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-dockercfg-dmz25\"" Sep 17 07:49:56.126287 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:49:56.126260 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-57576b8fcf-jp468"] Sep 17 07:49:56.263738 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:49:56.263706 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/40b24ea3-aaf9-4f95-84e2-d8668a5fa1d4-online-tls\") pod \"feast-simple-feast-setup-57576b8fcf-jp468\" (UID: \"40b24ea3-aaf9-4f95-84e2-d8668a5fa1d4\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-jp468" Sep 17 07:49:56.263901 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:49:56.263754 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cpt77\" (UniqueName: \"kubernetes.io/projected/40b24ea3-aaf9-4f95-84e2-d8668a5fa1d4-kube-api-access-cpt77\") pod \"feast-simple-feast-setup-57576b8fcf-jp468\" (UID: \"40b24ea3-aaf9-4f95-84e2-d8668a5fa1d4\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-jp468" Sep 17 07:49:56.263901 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:49:56.263780 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/40b24ea3-aaf9-4f95-84e2-d8668a5fa1d4-registry-tls\") pod \"feast-simple-feast-setup-57576b8fcf-jp468\" (UID: \"40b24ea3-aaf9-4f95-84e2-d8668a5fa1d4\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-jp468" Sep 17 07:49:56.263901 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:49:56.263853 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/40b24ea3-aaf9-4f95-84e2-d8668a5fa1d4-offline-tls\") pod \"feast-simple-feast-setup-57576b8fcf-jp468\" (UID: \"40b24ea3-aaf9-4f95-84e2-d8668a5fa1d4\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-jp468" Sep 17 07:49:56.263901 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:49:56.263880 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/40b24ea3-aaf9-4f95-84e2-d8668a5fa1d4-ui-tls\") pod \"feast-simple-feast-setup-57576b8fcf-jp468\" (UID: \"40b24ea3-aaf9-4f95-84e2-d8668a5fa1d4\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-jp468" Sep 17 07:49:56.263901 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:49:56.263900 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/40b24ea3-aaf9-4f95-84e2-d8668a5fa1d4-feast-data\") pod \"feast-simple-feast-setup-57576b8fcf-jp468\" (UID: \"40b24ea3-aaf9-4f95-84e2-d8668a5fa1d4\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-jp468" Sep 17 07:49:56.364765 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:49:56.364685 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/40b24ea3-aaf9-4f95-84e2-d8668a5fa1d4-online-tls\") pod \"feast-simple-feast-setup-57576b8fcf-jp468\" (UID: \"40b24ea3-aaf9-4f95-84e2-d8668a5fa1d4\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-jp468" Sep 17 07:49:56.364765 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:49:56.364735 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cpt77\" (UniqueName: \"kubernetes.io/projected/40b24ea3-aaf9-4f95-84e2-d8668a5fa1d4-kube-api-access-cpt77\") pod \"feast-simple-feast-setup-57576b8fcf-jp468\" (UID: \"40b24ea3-aaf9-4f95-84e2-d8668a5fa1d4\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-jp468" Sep 17 07:49:56.364765 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:49:56.364759 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/40b24ea3-aaf9-4f95-84e2-d8668a5fa1d4-registry-tls\") pod \"feast-simple-feast-setup-57576b8fcf-jp468\" (UID: \"40b24ea3-aaf9-4f95-84e2-d8668a5fa1d4\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-jp468" Sep 17 07:49:56.365069 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:49:56.364791 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/40b24ea3-aaf9-4f95-84e2-d8668a5fa1d4-offline-tls\") pod \"feast-simple-feast-setup-57576b8fcf-jp468\" (UID: \"40b24ea3-aaf9-4f95-84e2-d8668a5fa1d4\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-jp468" Sep 17 07:49:56.365069 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:49:56.364804 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/40b24ea3-aaf9-4f95-84e2-d8668a5fa1d4-ui-tls\") pod \"feast-simple-feast-setup-57576b8fcf-jp468\" (UID: \"40b24ea3-aaf9-4f95-84e2-d8668a5fa1d4\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-jp468" Sep 17 07:49:56.365069 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:49:56.364820 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/40b24ea3-aaf9-4f95-84e2-d8668a5fa1d4-feast-data\") pod \"feast-simple-feast-setup-57576b8fcf-jp468\" (UID: \"40b24ea3-aaf9-4f95-84e2-d8668a5fa1d4\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-jp468" Sep 17 07:49:56.365069 ip-10-0-132-17 kubenswrapper[2561]: E0917 07:49:56.364822 2561 secret.go:189] Couldn't get secret test-ns-feast/feast-simple-feast-setup-online-tls: secret "feast-simple-feast-setup-online-tls" not found Sep 17 07:49:56.365069 ip-10-0-132-17 kubenswrapper[2561]: E0917 07:49:56.364911 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/40b24ea3-aaf9-4f95-84e2-d8668a5fa1d4-online-tls podName:40b24ea3-aaf9-4f95-84e2-d8668a5fa1d4 nodeName:}" failed. No retries permitted until 2026-09-17 07:49:56.86489003 +0000 UTC m=+1814.670836298 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "online-tls" (UniqueName: "kubernetes.io/secret/40b24ea3-aaf9-4f95-84e2-d8668a5fa1d4-online-tls") pod "feast-simple-feast-setup-57576b8fcf-jp468" (UID: "40b24ea3-aaf9-4f95-84e2-d8668a5fa1d4") : secret "feast-simple-feast-setup-online-tls" not found Sep 17 07:49:56.365344 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:49:56.365226 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/40b24ea3-aaf9-4f95-84e2-d8668a5fa1d4-feast-data\") pod \"feast-simple-feast-setup-57576b8fcf-jp468\" (UID: \"40b24ea3-aaf9-4f95-84e2-d8668a5fa1d4\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-jp468" Sep 17 07:49:56.367607 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:49:56.367571 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/40b24ea3-aaf9-4f95-84e2-d8668a5fa1d4-ui-tls\") pod \"feast-simple-feast-setup-57576b8fcf-jp468\" (UID: \"40b24ea3-aaf9-4f95-84e2-d8668a5fa1d4\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-jp468" Sep 17 07:49:56.367607 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:49:56.367591 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/40b24ea3-aaf9-4f95-84e2-d8668a5fa1d4-registry-tls\") pod \"feast-simple-feast-setup-57576b8fcf-jp468\" (UID: \"40b24ea3-aaf9-4f95-84e2-d8668a5fa1d4\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-jp468" Sep 17 07:49:56.367756 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:49:56.367634 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/40b24ea3-aaf9-4f95-84e2-d8668a5fa1d4-offline-tls\") pod \"feast-simple-feast-setup-57576b8fcf-jp468\" (UID: \"40b24ea3-aaf9-4f95-84e2-d8668a5fa1d4\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-jp468" Sep 17 07:49:56.372969 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:49:56.372946 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cpt77\" (UniqueName: \"kubernetes.io/projected/40b24ea3-aaf9-4f95-84e2-d8668a5fa1d4-kube-api-access-cpt77\") pod \"feast-simple-feast-setup-57576b8fcf-jp468\" (UID: \"40b24ea3-aaf9-4f95-84e2-d8668a5fa1d4\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-jp468" Sep 17 07:49:56.869106 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:49:56.869072 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/40b24ea3-aaf9-4f95-84e2-d8668a5fa1d4-online-tls\") pod \"feast-simple-feast-setup-57576b8fcf-jp468\" (UID: \"40b24ea3-aaf9-4f95-84e2-d8668a5fa1d4\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-jp468" Sep 17 07:49:56.877351 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:49:56.877322 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/40b24ea3-aaf9-4f95-84e2-d8668a5fa1d4-online-tls\") pod \"feast-simple-feast-setup-57576b8fcf-jp468\" (UID: \"40b24ea3-aaf9-4f95-84e2-d8668a5fa1d4\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-jp468" Sep 17 07:49:56.880330 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:49:56.880288 2561 generic.go:356] "Generic (PLEG): container finished" podID="3656067a-1681-47ee-a484-c614cca4f45a" containerID="8d6aadc6e3fad80714659223b552cb0835c77366522166a5f17e01f333d739dd" exitCode=0 Sep 17 07:49:56.880330 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:49:56.880319 2561 generic.go:356] "Generic (PLEG): container finished" podID="3656067a-1681-47ee-a484-c614cca4f45a" containerID="57ed7ec7197f141f9b16f20c06a2ae474006186bb7de333aef41e86f7318ed91" exitCode=0 Sep 17 07:49:56.880513 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:49:56.880383 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-rxcsb" event={"ID":"3656067a-1681-47ee-a484-c614cca4f45a","Type":"ContainerDied","Data":"8d6aadc6e3fad80714659223b552cb0835c77366522166a5f17e01f333d739dd"} Sep 17 07:49:56.880513 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:49:56.880422 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-rxcsb" event={"ID":"3656067a-1681-47ee-a484-c614cca4f45a","Type":"ContainerDied","Data":"57ed7ec7197f141f9b16f20c06a2ae474006186bb7de333aef41e86f7318ed91"} Sep 17 07:49:56.880704 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:49:56.880685 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9skpb_96c5b8e5-2fc0-489b-8889-52bf66184838/konnectivity-agent/0.log" limit=1024 Sep 17 07:49:57.016481 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:49:57.016443 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-jp468" Sep 17 07:49:57.323685 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:49:57.323609 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-57576b8fcf-jp468"] Sep 17 07:49:57.326543 ip-10-0-132-17 kubenswrapper[2561]: W0917 07:49:57.326518 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod40b24ea3_aaf9_4f95_84e2_d8668a5fa1d4.slice/crio-e8e6253e8b478f85cec3b9788616d77895fe1c3a70597705532ecdeed4fc6a9e WatchSource:0}: Error finding container e8e6253e8b478f85cec3b9788616d77895fe1c3a70597705532ecdeed4fc6a9e: Status 404 returned error can't find the container with id e8e6253e8b478f85cec3b9788616d77895fe1c3a70597705532ecdeed4fc6a9e Sep 17 07:49:57.885586 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:49:57.885546 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-jp468" event={"ID":"40b24ea3-aaf9-4f95-84e2-d8668a5fa1d4","Type":"ContainerStarted","Data":"c9305ef9c03152123082ca8cb4b62e0c14fc2da6c501828279717d0ab1b29258"} Sep 17 07:49:57.885986 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:49:57.885600 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-jp468" event={"ID":"40b24ea3-aaf9-4f95-84e2-d8668a5fa1d4","Type":"ContainerStarted","Data":"e8e6253e8b478f85cec3b9788616d77895fe1c3a70597705532ecdeed4fc6a9e"} Sep 17 07:50:02.905479 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:50:02.905445 2561 generic.go:356] "Generic (PLEG): container finished" podID="40b24ea3-aaf9-4f95-84e2-d8668a5fa1d4" containerID="c9305ef9c03152123082ca8cb4b62e0c14fc2da6c501828279717d0ab1b29258" exitCode=0 Sep 17 07:50:02.905851 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:50:02.905518 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-jp468" event={"ID":"40b24ea3-aaf9-4f95-84e2-d8668a5fa1d4","Type":"ContainerDied","Data":"c9305ef9c03152123082ca8cb4b62e0c14fc2da6c501828279717d0ab1b29258"} Sep 17 07:50:03.650437 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:50:03.650388 2561 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-rxcsb" podUID="3656067a-1681-47ee-a484-c614cca4f45a" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.19:8443: connect: connection refused" Sep 17 07:50:03.650633 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:50:03.650402 2561 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-rxcsb" podUID="3656067a-1681-47ee-a484-c614cca4f45a" containerName="online" probeResult="failure" output="Get \"https://10.132.0.19:6567/health\": dial tcp 10.132.0.19:6567: connect: connection refused" Sep 17 07:50:03.912216 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:50:03.912130 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-jp468" event={"ID":"40b24ea3-aaf9-4f95-84e2-d8668a5fa1d4","Type":"ContainerStarted","Data":"a44feea6ede305798cc698833e40a7faf437c88c3fbe3746fdaf5ff14e888127"} Sep 17 07:50:08.933202 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:50:08.933168 2561 generic.go:356] "Generic (PLEG): container finished" podID="40b24ea3-aaf9-4f95-84e2-d8668a5fa1d4" containerID="a44feea6ede305798cc698833e40a7faf437c88c3fbe3746fdaf5ff14e888127" exitCode=0 Sep 17 07:50:08.933564 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:50:08.933232 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-jp468" event={"ID":"40b24ea3-aaf9-4f95-84e2-d8668a5fa1d4","Type":"ContainerDied","Data":"a44feea6ede305798cc698833e40a7faf437c88c3fbe3746fdaf5ff14e888127"} Sep 17 07:50:09.950838 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:50:09.950789 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-jp468" event={"ID":"40b24ea3-aaf9-4f95-84e2-d8668a5fa1d4","Type":"ContainerStarted","Data":"3752173392c3b17fed29eed00979a4e90923d551edee8aebd4069b923102d980"} Sep 17 07:50:09.951326 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:50:09.950869 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-jp468" event={"ID":"40b24ea3-aaf9-4f95-84e2-d8668a5fa1d4","Type":"ContainerStarted","Data":"a898e73e6f055e895273f144bc2146d441901372163e06e0b0b98631bbb18446"} Sep 17 07:50:09.951326 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:50:09.950893 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-jp468" event={"ID":"40b24ea3-aaf9-4f95-84e2-d8668a5fa1d4","Type":"ContainerStarted","Data":"1f332347deaeb783a5f63137542f7acc2a91a28fafe09f3ad6d3d4ae6043d9fd"} Sep 17 07:50:09.951326 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:50:09.950919 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-jp468" event={"ID":"40b24ea3-aaf9-4f95-84e2-d8668a5fa1d4","Type":"ContainerStarted","Data":"dddacf700c6344c04ef6a888d1dd26ef9815cd8ea2744863417404ed4ba468ce"} Sep 17 07:50:09.993023 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:50:09.992922 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-jp468" podStartSLOduration=13.992902243 podStartE2EDuration="13.992902243s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 07:49:56 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 07:50:09.987854655 +0000 UTC m=+1827.793800941" watchObservedRunningTime="2026-09-17 07:50:09.992902243 +0000 UTC m=+1827.798848518" Sep 17 07:50:12.017138 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:50:12.017085 2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-jp468" Sep 17 07:50:12.017633 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:50:12.017158 2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-jp468" Sep 17 07:50:12.017633 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:50:12.017329 2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-jp468" Sep 17 07:50:12.017633 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:50:12.017357 2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-jp468" Sep 17 07:50:12.019441 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:50:12.019300 2561 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-jp468" podUID="40b24ea3-aaf9-4f95-84e2-d8668a5fa1d4" containerName="registry" probeResult="failure" output="dial tcp 10.132.0.20:6571: connect: connection refused" Sep 17 07:50:12.019441 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:50:12.019340 2561 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-jp468" podUID="40b24ea3-aaf9-4f95-84e2-d8668a5fa1d4" containerName="online" probeResult="failure" output="Get \"https://10.132.0.20:6567/health\": dial tcp 10.132.0.20:6567: connect: connection refused" Sep 17 07:50:12.019441 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:50:12.019378 2561 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-jp468" podUID="40b24ea3-aaf9-4f95-84e2-d8668a5fa1d4" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.20:8443: connect: connection refused" Sep 17 07:50:12.019441 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:50:12.019338 2561 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-jp468" podUID="40b24ea3-aaf9-4f95-84e2-d8668a5fa1d4" containerName="offline" probeResult="failure" output="dial tcp 10.132.0.20:8816: connect: connection refused" Sep 17 07:50:13.651270 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:50:13.651227 2561 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-rxcsb" podUID="3656067a-1681-47ee-a484-c614cca4f45a" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.19:8443: connect: connection refused" Sep 17 07:50:13.651868 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:50:13.651239 2561 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-rxcsb" podUID="3656067a-1681-47ee-a484-c614cca4f45a" containerName="online" probeResult="failure" output="Get \"https://10.132.0.19:6567/health\": dial tcp 10.132.0.19:6567: connect: connection refused" Sep 17 07:50:15.016818 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:50:15.016773 2561 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-jp468" podUID="40b24ea3-aaf9-4f95-84e2-d8668a5fa1d4" containerName="offline" probeResult="failure" output="dial tcp 10.132.0.20:8816: connect: connection refused" Sep 17 07:50:15.017335 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:50:15.016820 2561 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-jp468" podUID="40b24ea3-aaf9-4f95-84e2-d8668a5fa1d4" containerName="online" probeResult="failure" output="Get \"https://10.132.0.20:6567/health\": dial tcp 10.132.0.20:6567: connect: connection refused" Sep 17 07:50:15.017335 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:50:15.016773 2561 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-jp468" podUID="40b24ea3-aaf9-4f95-84e2-d8668a5fa1d4" containerName="registry" probeResult="failure" output="dial tcp 10.132.0.20:6571: connect: connection refused" Sep 17 07:50:15.017335 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:50:15.017283 2561 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-jp468" podUID="40b24ea3-aaf9-4f95-84e2-d8668a5fa1d4" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.20:8443: connect: connection refused" Sep 17 07:50:17.016641 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:50:17.016599 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-jp468" Sep 17 07:50:17.017066 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:50:17.016690 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-jp468" Sep 17 07:50:17.017066 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:50:17.016736 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-jp468" Sep 17 07:50:17.017066 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:50:17.016758 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-jp468" Sep 17 07:50:18.018037 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:50:18.017888 2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-jp468" Sep 17 07:50:18.018503 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:50:18.018165 2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-jp468" Sep 17 07:50:18.018503 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:50:18.018251 2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-jp468" Sep 17 07:50:18.023432 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:50:18.023406 2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-jp468" Sep 17 07:50:19.000488 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:50:19.000459 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-jp468" Sep 17 07:50:19.000674 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:50:19.000622 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-jp468" Sep 17 07:50:19.000756 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:50:19.000742 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-jp468" Sep 17 07:50:19.003299 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:50:19.003277 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-jp468" Sep 17 07:50:23.650850 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:50:23.650800 2561 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-rxcsb" podUID="3656067a-1681-47ee-a484-c614cca4f45a" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.19:8443: connect: connection refused" Sep 17 07:50:23.651334 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:50:23.650810 2561 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-rxcsb" podUID="3656067a-1681-47ee-a484-c614cca4f45a" containerName="online" probeResult="failure" output="Get \"https://10.132.0.19:6567/health\": dial tcp 10.132.0.19:6567: connect: connection refused" Sep 17 07:50:23.651334 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:50:23.650987 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-rxcsb" Sep 17 07:50:23.651334 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:50:23.651062 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-rxcsb" Sep 17 07:50:26.030090 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:50:26.030014 2561 generic.go:356] "Generic (PLEG): container finished" podID="3656067a-1681-47ee-a484-c614cca4f45a" containerID="56017cc56ddfbe86298281e03897276ede7fedfe53417f94e02978161ef17fe7" exitCode=137 Sep 17 07:50:26.030090 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:50:26.030036 2561 generic.go:356] "Generic (PLEG): container finished" podID="3656067a-1681-47ee-a484-c614cca4f45a" containerID="cd18653f9f630c300320c0cde4c705bf9ea4282f1c5bd4510445fd9aef82c5d9" exitCode=137 Sep 17 07:50:26.030090 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:50:26.030065 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-rxcsb" event={"ID":"3656067a-1681-47ee-a484-c614cca4f45a","Type":"ContainerDied","Data":"56017cc56ddfbe86298281e03897276ede7fedfe53417f94e02978161ef17fe7"} Sep 17 07:50:26.030090 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:50:26.030091 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-rxcsb" event={"ID":"3656067a-1681-47ee-a484-c614cca4f45a","Type":"ContainerDied","Data":"cd18653f9f630c300320c0cde4c705bf9ea4282f1c5bd4510445fd9aef82c5d9"} Sep 17 07:50:26.287222 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:50:26.287174 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-rxcsb" Sep 17 07:50:26.406348 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:50:26.406318 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/3656067a-1681-47ee-a484-c614cca4f45a-feast-data\") pod \"3656067a-1681-47ee-a484-c614cca4f45a\" (UID: \"3656067a-1681-47ee-a484-c614cca4f45a\") " Sep 17 07:50:26.406348 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:50:26.406347 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/3656067a-1681-47ee-a484-c614cca4f45a-ui-tls\") pod \"3656067a-1681-47ee-a484-c614cca4f45a\" (UID: \"3656067a-1681-47ee-a484-c614cca4f45a\") " Sep 17 07:50:26.406547 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:50:26.406380 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/3656067a-1681-47ee-a484-c614cca4f45a-online-tls\") pod \"3656067a-1681-47ee-a484-c614cca4f45a\" (UID: \"3656067a-1681-47ee-a484-c614cca4f45a\") " Sep 17 07:50:26.406547 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:50:26.406410 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/3656067a-1681-47ee-a484-c614cca4f45a-registry-tls\") pod \"3656067a-1681-47ee-a484-c614cca4f45a\" (UID: \"3656067a-1681-47ee-a484-c614cca4f45a\") " Sep 17 07:50:26.406547 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:50:26.406534 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rbpps\" (UniqueName: \"kubernetes.io/projected/3656067a-1681-47ee-a484-c614cca4f45a-kube-api-access-rbpps\") pod \"3656067a-1681-47ee-a484-c614cca4f45a\" (UID: \"3656067a-1681-47ee-a484-c614cca4f45a\") " Sep 17 07:50:26.406699 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:50:26.406569 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/3656067a-1681-47ee-a484-c614cca4f45a-offline-tls\") pod \"3656067a-1681-47ee-a484-c614cca4f45a\" (UID: \"3656067a-1681-47ee-a484-c614cca4f45a\") " Sep 17 07:50:26.406894 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:50:26.406867 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3656067a-1681-47ee-a484-c614cca4f45a-feast-data" (OuterVolumeSpecName: "feast-data") pod "3656067a-1681-47ee-a484-c614cca4f45a" (UID: "3656067a-1681-47ee-a484-c614cca4f45a"). InnerVolumeSpecName "feast-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 17 07:50:26.408782 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:50:26.408742 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3656067a-1681-47ee-a484-c614cca4f45a-offline-tls" (OuterVolumeSpecName: "offline-tls") pod "3656067a-1681-47ee-a484-c614cca4f45a" (UID: "3656067a-1681-47ee-a484-c614cca4f45a"). InnerVolumeSpecName "offline-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 17 07:50:26.408885 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:50:26.408806 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3656067a-1681-47ee-a484-c614cca4f45a-ui-tls" (OuterVolumeSpecName: "ui-tls") pod "3656067a-1681-47ee-a484-c614cca4f45a" (UID: "3656067a-1681-47ee-a484-c614cca4f45a"). InnerVolumeSpecName "ui-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 17 07:50:26.408885 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:50:26.408814 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3656067a-1681-47ee-a484-c614cca4f45a-kube-api-access-rbpps" (OuterVolumeSpecName: "kube-api-access-rbpps") pod "3656067a-1681-47ee-a484-c614cca4f45a" (UID: "3656067a-1681-47ee-a484-c614cca4f45a"). InnerVolumeSpecName "kube-api-access-rbpps". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 17 07:50:26.409019 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:50:26.408998 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3656067a-1681-47ee-a484-c614cca4f45a-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "3656067a-1681-47ee-a484-c614cca4f45a" (UID: "3656067a-1681-47ee-a484-c614cca4f45a"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 17 07:50:26.409073 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:50:26.409014 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3656067a-1681-47ee-a484-c614cca4f45a-online-tls" (OuterVolumeSpecName: "online-tls") pod "3656067a-1681-47ee-a484-c614cca4f45a" (UID: "3656067a-1681-47ee-a484-c614cca4f45a"). InnerVolumeSpecName "online-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 17 07:50:26.507762 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:50:26.507731 2561 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/3656067a-1681-47ee-a484-c614cca4f45a-registry-tls\") on node \"ip-10-0-132-17.ec2.internal\" DevicePath \"\"" Sep 17 07:50:26.507762 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:50:26.507757 2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rbpps\" (UniqueName: \"kubernetes.io/projected/3656067a-1681-47ee-a484-c614cca4f45a-kube-api-access-rbpps\") on node \"ip-10-0-132-17.ec2.internal\" DevicePath \"\"" Sep 17 07:50:26.507762 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:50:26.507769 2561 reconciler_common.go:299] "Volume detached for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/3656067a-1681-47ee-a484-c614cca4f45a-offline-tls\") on node \"ip-10-0-132-17.ec2.internal\" DevicePath \"\"" Sep 17 07:50:26.508005 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:50:26.507781 2561 reconciler_common.go:299] "Volume detached for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/3656067a-1681-47ee-a484-c614cca4f45a-feast-data\") on node \"ip-10-0-132-17.ec2.internal\" DevicePath \"\"" Sep 17 07:50:26.508005 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:50:26.507792 2561 reconciler_common.go:299] "Volume detached for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/3656067a-1681-47ee-a484-c614cca4f45a-ui-tls\") on node \"ip-10-0-132-17.ec2.internal\" DevicePath \"\"" Sep 17 07:50:26.508005 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:50:26.507802 2561 reconciler_common.go:299] "Volume detached for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/3656067a-1681-47ee-a484-c614cca4f45a-online-tls\") on node \"ip-10-0-132-17.ec2.internal\" DevicePath \"\"" Sep 17 07:50:27.036433 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:50:27.036352 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-rxcsb" event={"ID":"3656067a-1681-47ee-a484-c614cca4f45a","Type":"ContainerDied","Data":"8edf3679d343df42c96dc0f4bfbc5bdc34f0ce73d7e107b496ceeb146f21347a"} Sep 17 07:50:27.036433 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:50:27.036380 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-rxcsb" Sep 17 07:50:27.036433 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:50:27.036412 2561 scope.go:117] "RemoveContainer" containerID="8d6aadc6e3fad80714659223b552cb0835c77366522166a5f17e01f333d739dd" Sep 17 07:50:27.044173 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:50:27.044157 2561 scope.go:117] "RemoveContainer" containerID="56017cc56ddfbe86298281e03897276ede7fedfe53417f94e02978161ef17fe7" Sep 17 07:50:27.055039 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:50:27.055014 2561 scope.go:117] "RemoveContainer" containerID="57ed7ec7197f141f9b16f20c06a2ae474006186bb7de333aef41e86f7318ed91" Sep 17 07:50:27.059678 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:50:27.059658 2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-57576b8fcf-rxcsb"] Sep 17 07:50:27.062634 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:50:27.062612 2561 scope.go:117] "RemoveContainer" containerID="cd18653f9f630c300320c0cde4c705bf9ea4282f1c5bd4510445fd9aef82c5d9" Sep 17 07:50:27.066058 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:50:27.066039 2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-57576b8fcf-rxcsb"] Sep 17 07:50:27.069925 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:50:27.069909 2561 scope.go:117] "RemoveContainer" containerID="c44bd9622f2dd1dfe3e2e4daee320944f427fbd68e76f57c10b699e665481f9a" Sep 17 07:50:27.076443 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:50:27.076426 2561 scope.go:117] "RemoveContainer" containerID="6cc7f96c48882897f2238e1e8d4ce531effa8e7fc8724d3ce781d7cbebc72836" Sep 17 07:50:28.684024 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:50:28.683992 2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3656067a-1681-47ee-a484-c614cca4f45a" path="/var/lib/kubelet/pods/3656067a-1681-47ee-a484-c614cca4f45a/volumes" Sep 17 07:51:20.473202 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:51:20.473149 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9skpb_96c5b8e5-2fc0-489b-8889-52bf66184838/konnectivity-agent/0.log" limit=1024 Sep 17 07:51:20.563800 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:51:20.563772 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9skpb_96c5b8e5-2fc0-489b-8889-52bf66184838/konnectivity-agent/0.log" limit=1024 Sep 17 07:51:20.829355 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:51:20.829270 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9skpb_96c5b8e5-2fc0-489b-8889-52bf66184838/konnectivity-agent/0.log" limit=1024 Sep 17 07:51:20.928323 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:51:20.928287 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9skpb_96c5b8e5-2fc0-489b-8889-52bf66184838/konnectivity-agent/0.log" limit=1024 Sep 17 07:51:21.049884 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:51:21.049827 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9skpb_96c5b8e5-2fc0-489b-8889-52bf66184838/konnectivity-agent/0.log" limit=1024 Sep 17 07:51:21.137601 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:51:21.137568 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-crt4n"] Sep 17 07:51:21.137814 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:51:21.137802 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3656067a-1681-47ee-a484-c614cca4f45a" containerName="ui" Sep 17 07:51:21.137857 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:51:21.137815 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="3656067a-1681-47ee-a484-c614cca4f45a" containerName="ui" Sep 17 07:51:21.137857 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:51:21.137824 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3656067a-1681-47ee-a484-c614cca4f45a" containerName="online" Sep 17 07:51:21.137857 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:51:21.137830 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="3656067a-1681-47ee-a484-c614cca4f45a" containerName="online" Sep 17 07:51:21.137857 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:51:21.137836 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3656067a-1681-47ee-a484-c614cca4f45a" containerName="feast-init" Sep 17 07:51:21.137857 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:51:21.137843 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="3656067a-1681-47ee-a484-c614cca4f45a" containerName="feast-init" Sep 17 07:51:21.137857 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:51:21.137852 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3656067a-1681-47ee-a484-c614cca4f45a" containerName="offline" Sep 17 07:51:21.137857 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:51:21.137858 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="3656067a-1681-47ee-a484-c614cca4f45a" containerName="offline" Sep 17 07:51:21.138078 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:51:21.137868 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3656067a-1681-47ee-a484-c614cca4f45a" containerName="feast-apply" Sep 17 07:51:21.138078 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:51:21.137873 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="3656067a-1681-47ee-a484-c614cca4f45a" containerName="feast-apply" Sep 17 07:51:21.138078 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:51:21.137881 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3656067a-1681-47ee-a484-c614cca4f45a" containerName="registry" Sep 17 07:51:21.138078 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:51:21.137885 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="3656067a-1681-47ee-a484-c614cca4f45a" containerName="registry" Sep 17 07:51:21.138078 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:51:21.137925 2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="3656067a-1681-47ee-a484-c614cca4f45a" containerName="online" Sep 17 07:51:21.138078 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:51:21.137949 2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="3656067a-1681-47ee-a484-c614cca4f45a" containerName="ui" Sep 17 07:51:21.138078 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:51:21.137955 2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="3656067a-1681-47ee-a484-c614cca4f45a" containerName="offline" Sep 17 07:51:21.138078 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:51:21.137960 2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="3656067a-1681-47ee-a484-c614cca4f45a" containerName="registry" Sep 17 07:51:21.141059 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:51:21.141037 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-crt4n" Sep 17 07:51:21.154922 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:51:21.154902 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-client-ca\"" Sep 17 07:51:21.155044 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:51:21.154989 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-dockercfg-ksfmn\"" Sep 17 07:51:21.155418 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:51:21.155403 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-offline-tls\"" Sep 17 07:51:21.155510 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:51:21.155437 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-online-tls\"" Sep 17 07:51:21.155963 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:51:21.155921 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-remote-registry\"/\"kube-root-ca.crt\"" Sep 17 07:51:21.156186 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:51:21.156173 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-ui-tls\"" Sep 17 07:51:21.156678 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:51:21.156665 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-remote-registry\"/\"openshift-service-ca.crt\"" Sep 17 07:51:21.168441 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:51:21.168418 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-crt4n"] Sep 17 07:51:21.247441 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:51:21.247415 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9skpb_96c5b8e5-2fc0-489b-8889-52bf66184838/konnectivity-agent/0.log" limit=1024 Sep 17 07:51:21.282512 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:51:21.282487 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/5a13d1c0-68a8-4130-9337-9a16158abe2e-offline-tls\") pod \"feast-simple-feast-remote-setup-c5d49d8c6-crt4n\" (UID: \"5a13d1c0-68a8-4130-9337-9a16158abe2e\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-crt4n" Sep 17 07:51:21.282624 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:51:21.282521 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/5a13d1c0-68a8-4130-9337-9a16158abe2e-feast-data\") pod \"feast-simple-feast-remote-setup-c5d49d8c6-crt4n\" (UID: \"5a13d1c0-68a8-4130-9337-9a16158abe2e\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-crt4n" Sep 17 07:51:21.282624 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:51:21.282560 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-brrrw\" (UniqueName: \"kubernetes.io/projected/5a13d1c0-68a8-4130-9337-9a16158abe2e-kube-api-access-brrrw\") pod \"feast-simple-feast-remote-setup-c5d49d8c6-crt4n\" (UID: \"5a13d1c0-68a8-4130-9337-9a16158abe2e\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-crt4n" Sep 17 07:51:21.282700 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:51:21.282626 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/configmap/5a13d1c0-68a8-4130-9337-9a16158abe2e-registry-tls\") pod \"feast-simple-feast-remote-setup-c5d49d8c6-crt4n\" (UID: \"5a13d1c0-68a8-4130-9337-9a16158abe2e\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-crt4n" Sep 17 07:51:21.282700 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:51:21.282648 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/5a13d1c0-68a8-4130-9337-9a16158abe2e-online-tls\") pod \"feast-simple-feast-remote-setup-c5d49d8c6-crt4n\" (UID: \"5a13d1c0-68a8-4130-9337-9a16158abe2e\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-crt4n" Sep 17 07:51:21.282700 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:51:21.282663 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/5a13d1c0-68a8-4130-9337-9a16158abe2e-ui-tls\") pod \"feast-simple-feast-remote-setup-c5d49d8c6-crt4n\" (UID: \"5a13d1c0-68a8-4130-9337-9a16158abe2e\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-crt4n" Sep 17 07:51:21.383709 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:51:21.383682 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/configmap/5a13d1c0-68a8-4130-9337-9a16158abe2e-registry-tls\") pod \"feast-simple-feast-remote-setup-c5d49d8c6-crt4n\" (UID: \"5a13d1c0-68a8-4130-9337-9a16158abe2e\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-crt4n" Sep 17 07:51:21.383709 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:51:21.383710 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/5a13d1c0-68a8-4130-9337-9a16158abe2e-online-tls\") pod \"feast-simple-feast-remote-setup-c5d49d8c6-crt4n\" (UID: \"5a13d1c0-68a8-4130-9337-9a16158abe2e\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-crt4n" Sep 17 07:51:21.383878 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:51:21.383727 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/5a13d1c0-68a8-4130-9337-9a16158abe2e-ui-tls\") pod \"feast-simple-feast-remote-setup-c5d49d8c6-crt4n\" (UID: \"5a13d1c0-68a8-4130-9337-9a16158abe2e\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-crt4n" Sep 17 07:51:21.383878 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:51:21.383744 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/5a13d1c0-68a8-4130-9337-9a16158abe2e-offline-tls\") pod \"feast-simple-feast-remote-setup-c5d49d8c6-crt4n\" (UID: \"5a13d1c0-68a8-4130-9337-9a16158abe2e\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-crt4n" Sep 17 07:51:21.383878 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:51:21.383777 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/5a13d1c0-68a8-4130-9337-9a16158abe2e-feast-data\") pod \"feast-simple-feast-remote-setup-c5d49d8c6-crt4n\" (UID: \"5a13d1c0-68a8-4130-9337-9a16158abe2e\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-crt4n" Sep 17 07:51:21.383878 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:51:21.383826 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-brrrw\" (UniqueName: \"kubernetes.io/projected/5a13d1c0-68a8-4130-9337-9a16158abe2e-kube-api-access-brrrw\") pod \"feast-simple-feast-remote-setup-c5d49d8c6-crt4n\" (UID: \"5a13d1c0-68a8-4130-9337-9a16158abe2e\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-crt4n" Sep 17 07:51:21.383878 ip-10-0-132-17 kubenswrapper[2561]: E0917 07:51:21.383831 2561 secret.go:189] Couldn't get secret test-ns-remote-registry/feast-simple-feast-remote-setup-ui-tls: secret "feast-simple-feast-remote-setup-ui-tls" not found Sep 17 07:51:21.384151 ip-10-0-132-17 kubenswrapper[2561]: E0917 07:51:21.383904 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5a13d1c0-68a8-4130-9337-9a16158abe2e-ui-tls podName:5a13d1c0-68a8-4130-9337-9a16158abe2e nodeName:}" failed. No retries permitted until 2026-09-17 07:51:21.883884839 +0000 UTC m=+1899.689831091 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "ui-tls" (UniqueName: "kubernetes.io/secret/5a13d1c0-68a8-4130-9337-9a16158abe2e-ui-tls") pod "feast-simple-feast-remote-setup-c5d49d8c6-crt4n" (UID: "5a13d1c0-68a8-4130-9337-9a16158abe2e") : secret "feast-simple-feast-remote-setup-ui-tls" not found Sep 17 07:51:21.384287 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:51:21.384266 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/5a13d1c0-68a8-4130-9337-9a16158abe2e-feast-data\") pod \"feast-simple-feast-remote-setup-c5d49d8c6-crt4n\" (UID: \"5a13d1c0-68a8-4130-9337-9a16158abe2e\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-crt4n" Sep 17 07:51:21.384443 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:51:21.384425 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/configmap/5a13d1c0-68a8-4130-9337-9a16158abe2e-registry-tls\") pod \"feast-simple-feast-remote-setup-c5d49d8c6-crt4n\" (UID: \"5a13d1c0-68a8-4130-9337-9a16158abe2e\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-crt4n" Sep 17 07:51:21.386270 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:51:21.386250 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/5a13d1c0-68a8-4130-9337-9a16158abe2e-online-tls\") pod \"feast-simple-feast-remote-setup-c5d49d8c6-crt4n\" (UID: \"5a13d1c0-68a8-4130-9337-9a16158abe2e\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-crt4n" Sep 17 07:51:21.386360 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:51:21.386291 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/5a13d1c0-68a8-4130-9337-9a16158abe2e-offline-tls\") pod \"feast-simple-feast-remote-setup-c5d49d8c6-crt4n\" (UID: \"5a13d1c0-68a8-4130-9337-9a16158abe2e\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-crt4n" Sep 17 07:51:21.393271 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:51:21.393219 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-brrrw\" (UniqueName: \"kubernetes.io/projected/5a13d1c0-68a8-4130-9337-9a16158abe2e-kube-api-access-brrrw\") pod \"feast-simple-feast-remote-setup-c5d49d8c6-crt4n\" (UID: \"5a13d1c0-68a8-4130-9337-9a16158abe2e\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-crt4n" Sep 17 07:51:21.889088 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:51:21.889058 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/5a13d1c0-68a8-4130-9337-9a16158abe2e-ui-tls\") pod \"feast-simple-feast-remote-setup-c5d49d8c6-crt4n\" (UID: \"5a13d1c0-68a8-4130-9337-9a16158abe2e\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-crt4n" Sep 17 07:51:21.891445 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:51:21.891425 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/5a13d1c0-68a8-4130-9337-9a16158abe2e-ui-tls\") pod \"feast-simple-feast-remote-setup-c5d49d8c6-crt4n\" (UID: \"5a13d1c0-68a8-4130-9337-9a16158abe2e\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-crt4n" Sep 17 07:51:21.918314 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:51:21.918288 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9skpb_96c5b8e5-2fc0-489b-8889-52bf66184838/konnectivity-agent/0.log" limit=1024 Sep 17 07:51:22.049187 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:51:22.049154 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-crt4n" Sep 17 07:51:22.326856 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:51:22.326785 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-crt4n"] Sep 17 07:51:22.329688 ip-10-0-132-17 kubenswrapper[2561]: W0917 07:51:22.329661 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod5a13d1c0_68a8_4130_9337_9a16158abe2e.slice/crio-6ef740379adfca364109fb7ff1646678564e0f65ce05afba359fceb9b09ef32b WatchSource:0}: Error finding container 6ef740379adfca364109fb7ff1646678564e0f65ce05afba359fceb9b09ef32b: Status 404 returned error can't find the container with id 6ef740379adfca364109fb7ff1646678564e0f65ce05afba359fceb9b09ef32b Sep 17 07:51:23.229778 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:51:23.229743 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-crt4n" event={"ID":"5a13d1c0-68a8-4130-9337-9a16158abe2e","Type":"ContainerStarted","Data":"f8b8468c8ee80a3746f6278bdddc7122009136f89392e4c605c2480c105bf513"} Sep 17 07:51:23.230137 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:51:23.229787 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-crt4n" event={"ID":"5a13d1c0-68a8-4130-9337-9a16158abe2e","Type":"ContainerStarted","Data":"6ef740379adfca364109fb7ff1646678564e0f65ce05afba359fceb9b09ef32b"} Sep 17 07:51:27.249555 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:51:27.249518 2561 generic.go:356] "Generic (PLEG): container finished" podID="5a13d1c0-68a8-4130-9337-9a16158abe2e" containerID="f8b8468c8ee80a3746f6278bdddc7122009136f89392e4c605c2480c105bf513" exitCode=0 Sep 17 07:51:27.249915 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:51:27.249591 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-crt4n" event={"ID":"5a13d1c0-68a8-4130-9337-9a16158abe2e","Type":"ContainerDied","Data":"f8b8468c8ee80a3746f6278bdddc7122009136f89392e4c605c2480c105bf513"} Sep 17 07:51:28.255096 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:51:28.255060 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-crt4n" event={"ID":"5a13d1c0-68a8-4130-9337-9a16158abe2e","Type":"ContainerStarted","Data":"2c90eb3c428de109fe46a7695be1bdaf1bf0fafb986816b20a22208b9c58dc64"} Sep 17 07:51:32.260492 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:51:32.260460 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9skpb_96c5b8e5-2fc0-489b-8889-52bf66184838/konnectivity-agent/0.log" limit=1024 Sep 17 07:51:44.543773 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:51:44.543726 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9skpb_96c5b8e5-2fc0-489b-8889-52bf66184838/konnectivity-agent/0.log" limit=1024 Sep 17 07:51:51.339146 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:51:51.339067 2561 generic.go:356] "Generic (PLEG): container finished" podID="5a13d1c0-68a8-4130-9337-9a16158abe2e" containerID="2c90eb3c428de109fe46a7695be1bdaf1bf0fafb986816b20a22208b9c58dc64" exitCode=0 Sep 17 07:51:51.339146 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:51:51.339120 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-crt4n" event={"ID":"5a13d1c0-68a8-4130-9337-9a16158abe2e","Type":"ContainerDied","Data":"2c90eb3c428de109fe46a7695be1bdaf1bf0fafb986816b20a22208b9c58dc64"} Sep 17 07:51:52.346231 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:51:52.346194 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-crt4n" event={"ID":"5a13d1c0-68a8-4130-9337-9a16158abe2e","Type":"ContainerStarted","Data":"a8c5e2df9b82f9bdf9f440f30f54f6c760849bd0488fbfb332c2194285270c26"} Sep 17 07:51:52.346818 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:51:52.346246 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-crt4n" event={"ID":"5a13d1c0-68a8-4130-9337-9a16158abe2e","Type":"ContainerStarted","Data":"394ce22107f20ee010762b3f188c4459ca845b6e7b2b1640e52b3440079ced1b"} Sep 17 07:51:52.346818 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:51:52.346259 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-crt4n" event={"ID":"5a13d1c0-68a8-4130-9337-9a16158abe2e","Type":"ContainerStarted","Data":"30413328797c2e8e05a12d511c51fce5ae00568a48f0ce562049fe657dbc26a3"} Sep 17 07:51:52.373728 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:51:52.373654 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-crt4n" podStartSLOduration=31.373630549 podStartE2EDuration="31.373630549s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 07:51:21 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 07:51:52.371339445 +0000 UTC m=+1930.177285721" watchObservedRunningTime="2026-09-17 07:51:52.373630549 +0000 UTC m=+1930.179576823" Sep 17 07:51:55.050073 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:51:55.050031 2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-crt4n" Sep 17 07:51:55.050565 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:51:55.050257 2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-crt4n" Sep 17 07:51:55.050565 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:51:55.050281 2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-crt4n" Sep 17 07:51:55.052126 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:51:55.052091 2561 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-crt4n" podUID="5a13d1c0-68a8-4130-9337-9a16158abe2e" containerName="online" probeResult="failure" output="Get \"https://10.132.0.21:6567/health\": dial tcp 10.132.0.21:6567: connect: connection refused" Sep 17 07:51:55.052126 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:51:55.052115 2561 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-crt4n" podUID="5a13d1c0-68a8-4130-9337-9a16158abe2e" containerName="offline" probeResult="failure" output="dial tcp 10.132.0.21:8816: connect: connection refused" Sep 17 07:51:55.052304 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:51:55.052096 2561 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-crt4n" podUID="5a13d1c0-68a8-4130-9337-9a16158abe2e" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.21:8443: connect: connection refused" Sep 17 07:51:58.049900 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:51:58.049850 2561 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-crt4n" podUID="5a13d1c0-68a8-4130-9337-9a16158abe2e" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.21:8443: connect: connection refused" Sep 17 07:51:58.049900 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:51:58.049880 2561 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-crt4n" podUID="5a13d1c0-68a8-4130-9337-9a16158abe2e" containerName="online" probeResult="failure" output="Get \"https://10.132.0.21:6567/health\": dial tcp 10.132.0.21:6567: connect: connection refused" Sep 17 07:51:58.050481 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:51:58.049851 2561 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-crt4n" podUID="5a13d1c0-68a8-4130-9337-9a16158abe2e" containerName="offline" probeResult="failure" output="dial tcp 10.132.0.21:8816: connect: connection refused" Sep 17 07:52:01.050212 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:52:01.050178 2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-crt4n" Sep 17 07:52:01.050746 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:52:01.050724 2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-crt4n" Sep 17 07:52:01.050815 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:52:01.050765 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-crt4n" Sep 17 07:52:01.051081 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:52:01.051058 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-crt4n" Sep 17 07:52:01.386352 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:52:01.386323 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-crt4n" Sep 17 07:52:01.386891 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:52:01.386871 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-crt4n" Sep 17 07:52:02.049785 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:52:02.049746 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-crt4n" Sep 17 07:52:02.053068 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:52:02.053037 2561 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-crt4n" podUID="5a13d1c0-68a8-4130-9337-9a16158abe2e" containerName="online" probeResult="failure" output="Get \"https://10.132.0.21:6567/health\": net/http: request canceled (Client.Timeout exceeded while awaiting headers)" Sep 17 07:52:04.843519 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:52:04.843488 2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-crt4n" Sep 17 07:52:05.622237 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:52:05.622205 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-crt4n" Sep 17 07:52:21.677857 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:52:21.677806 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9skpb_96c5b8e5-2fc0-489b-8889-52bf66184838/konnectivity-agent/0.log" limit=1024 Sep 17 07:52:21.983264 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:52:21.983184 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9skpb_96c5b8e5-2fc0-489b-8889-52bf66184838/konnectivity-agent/0.log" limit=1024 Sep 17 07:52:27.881194 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:52:27.881163 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9skpb_96c5b8e5-2fc0-489b-8889-52bf66184838/konnectivity-agent/0.log" limit=1024 Sep 17 07:52:27.952463 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:52:27.952431 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9skpb_96c5b8e5-2fc0-489b-8889-52bf66184838/konnectivity-agent/0.log" limit=1024 Sep 17 07:53:03.054116 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:53:03.054062 2561 prober.go:120] "Probe failed" probeType="Liveness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-crt4n" podUID="5a13d1c0-68a8-4130-9337-9a16158abe2e" containerName="online" probeResult="failure" output="Get \"https://10.132.0.21:6567/health\": net/http: request canceled (Client.Timeout exceeded while awaiting headers)" Sep 17 07:53:07.076070 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:53:07.076032 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9skpb_96c5b8e5-2fc0-489b-8889-52bf66184838/konnectivity-agent/0.log" limit=1024 Sep 17 07:53:07.076564 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:53:07.076232 2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-crt4n"] Sep 17 07:53:07.076633 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:53:07.076551 2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-crt4n" podUID="5a13d1c0-68a8-4130-9337-9a16158abe2e" containerName="online" containerID="cri-o://30413328797c2e8e05a12d511c51fce5ae00568a48f0ce562049fe657dbc26a3" gracePeriod=30 Sep 17 07:53:07.076633 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:53:07.076590 2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-crt4n" podUID="5a13d1c0-68a8-4130-9337-9a16158abe2e" containerName="offline" containerID="cri-o://394ce22107f20ee010762b3f188c4459ca845b6e7b2b1640e52b3440079ced1b" gracePeriod=30 Sep 17 07:53:07.076633 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:53:07.076590 2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-crt4n" podUID="5a13d1c0-68a8-4130-9337-9a16158abe2e" containerName="ui" containerID="cri-o://a8c5e2df9b82f9bdf9f440f30f54f6c760849bd0488fbfb332c2194285270c26" gracePeriod=30 Sep 17 07:53:07.140668 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:53:07.140628 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9skpb_96c5b8e5-2fc0-489b-8889-52bf66184838/konnectivity-agent/0.log" limit=1024 Sep 17 07:53:07.221824 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:53:07.221794 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9skpb_96c5b8e5-2fc0-489b-8889-52bf66184838/konnectivity-agent/0.log" limit=1024 Sep 17 07:53:07.231119 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:53:07.231084 2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-57576b8fcf-jp468"] Sep 17 07:53:07.231362 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:53:07.231315 2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-jp468" podUID="40b24ea3-aaf9-4f95-84e2-d8668a5fa1d4" containerName="registry" containerID="cri-o://dddacf700c6344c04ef6a888d1dd26ef9815cd8ea2744863417404ed4ba468ce" gracePeriod=30 Sep 17 07:53:07.231432 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:53:07.231415 2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-jp468" podUID="40b24ea3-aaf9-4f95-84e2-d8668a5fa1d4" containerName="online" containerID="cri-o://1f332347deaeb783a5f63137542f7acc2a91a28fafe09f3ad6d3d4ae6043d9fd" gracePeriod=30 Sep 17 07:53:07.231487 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:53:07.231420 2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-jp468" podUID="40b24ea3-aaf9-4f95-84e2-d8668a5fa1d4" containerName="ui" containerID="cri-o://3752173392c3b17fed29eed00979a4e90923d551edee8aebd4069b923102d980" gracePeriod=30 Sep 17 07:53:07.231566 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:53:07.231427 2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-jp468" podUID="40b24ea3-aaf9-4f95-84e2-d8668a5fa1d4" containerName="offline" containerID="cri-o://a898e73e6f055e895273f144bc2146d441901372163e06e0b0b98631bbb18446" gracePeriod=30 Sep 17 07:53:07.320503 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:53:07.320461 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9skpb_96c5b8e5-2fc0-489b-8889-52bf66184838/konnectivity-agent/0.log" limit=1024 Sep 17 07:53:07.380553 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:53:07.380528 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9skpb_96c5b8e5-2fc0-489b-8889-52bf66184838/konnectivity-agent/0.log" limit=1024 Sep 17 07:53:08.632707 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:53:08.632670 2561 generic.go:356] "Generic (PLEG): container finished" podID="5a13d1c0-68a8-4130-9337-9a16158abe2e" containerID="a8c5e2df9b82f9bdf9f440f30f54f6c760849bd0488fbfb332c2194285270c26" exitCode=0 Sep 17 07:53:08.632707 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:53:08.632697 2561 generic.go:356] "Generic (PLEG): container finished" podID="5a13d1c0-68a8-4130-9337-9a16158abe2e" containerID="30413328797c2e8e05a12d511c51fce5ae00568a48f0ce562049fe657dbc26a3" exitCode=0 Sep 17 07:53:08.633255 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:53:08.632747 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-crt4n" event={"ID":"5a13d1c0-68a8-4130-9337-9a16158abe2e","Type":"ContainerDied","Data":"a8c5e2df9b82f9bdf9f440f30f54f6c760849bd0488fbfb332c2194285270c26"} Sep 17 07:53:08.633255 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:53:08.632794 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-crt4n" event={"ID":"5a13d1c0-68a8-4130-9337-9a16158abe2e","Type":"ContainerDied","Data":"30413328797c2e8e05a12d511c51fce5ae00568a48f0ce562049fe657dbc26a3"} Sep 17 07:53:08.635656 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:53:08.635635 2561 generic.go:356] "Generic (PLEG): container finished" podID="40b24ea3-aaf9-4f95-84e2-d8668a5fa1d4" containerID="3752173392c3b17fed29eed00979a4e90923d551edee8aebd4069b923102d980" exitCode=0 Sep 17 07:53:08.635656 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:53:08.635652 2561 generic.go:356] "Generic (PLEG): container finished" podID="40b24ea3-aaf9-4f95-84e2-d8668a5fa1d4" containerID="1f332347deaeb783a5f63137542f7acc2a91a28fafe09f3ad6d3d4ae6043d9fd" exitCode=0 Sep 17 07:53:08.635819 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:53:08.635703 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-jp468" event={"ID":"40b24ea3-aaf9-4f95-84e2-d8668a5fa1d4","Type":"ContainerDied","Data":"3752173392c3b17fed29eed00979a4e90923d551edee8aebd4069b923102d980"} Sep 17 07:53:08.635819 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:53:08.635734 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-jp468" event={"ID":"40b24ea3-aaf9-4f95-84e2-d8668a5fa1d4","Type":"ContainerDied","Data":"1f332347deaeb783a5f63137542f7acc2a91a28fafe09f3ad6d3d4ae6043d9fd"} Sep 17 07:53:09.000618 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:53:09.000519 2561 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-jp468" podUID="40b24ea3-aaf9-4f95-84e2-d8668a5fa1d4" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.20:8443: connect: connection refused" Sep 17 07:53:09.000618 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:53:09.000549 2561 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-jp468" podUID="40b24ea3-aaf9-4f95-84e2-d8668a5fa1d4" containerName="online" probeResult="failure" output="Get \"https://10.132.0.20:6567/health\": dial tcp 10.132.0.20:6567: connect: connection refused" Sep 17 07:53:11.386892 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:53:11.386851 2561 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-crt4n" podUID="5a13d1c0-68a8-4130-9337-9a16158abe2e" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.21:8443: connect: connection refused" Sep 17 07:53:12.391364 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:53:12.391332 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9skpb_96c5b8e5-2fc0-489b-8889-52bf66184838/konnectivity-agent/0.log" limit=1024 Sep 17 07:53:14.844427 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:53:14.844386 2561 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-crt4n" podUID="5a13d1c0-68a8-4130-9337-9a16158abe2e" containerName="online" probeResult="failure" output="Get \"https://10.132.0.21:6567/health\": dial tcp 10.132.0.21:6567: connect: connection refused" Sep 17 07:53:19.001095 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:53:19.001034 2561 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-jp468" podUID="40b24ea3-aaf9-4f95-84e2-d8668a5fa1d4" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.20:8443: connect: connection refused" Sep 17 07:53:19.001095 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:53:19.001085 2561 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-jp468" podUID="40b24ea3-aaf9-4f95-84e2-d8668a5fa1d4" containerName="online" probeResult="failure" output="Get \"https://10.132.0.20:6567/health\": dial tcp 10.132.0.20:6567: connect: connection refused" Sep 17 07:53:21.386800 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:53:21.386756 2561 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-crt4n" podUID="5a13d1c0-68a8-4130-9337-9a16158abe2e" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.21:8443: connect: connection refused" Sep 17 07:53:24.844303 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:53:24.844262 2561 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-crt4n" podUID="5a13d1c0-68a8-4130-9337-9a16158abe2e" containerName="online" probeResult="failure" output="Get \"https://10.132.0.21:6567/health\": dial tcp 10.132.0.21:6567: connect: connection refused" Sep 17 07:53:29.001112 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:53:29.001058 2561 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-jp468" podUID="40b24ea3-aaf9-4f95-84e2-d8668a5fa1d4" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.20:8443: connect: connection refused" Sep 17 07:53:29.001610 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:53:29.001145 2561 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-jp468" podUID="40b24ea3-aaf9-4f95-84e2-d8668a5fa1d4" containerName="online" probeResult="failure" output="Get \"https://10.132.0.20:6567/health\": dial tcp 10.132.0.20:6567: connect: connection refused" Sep 17 07:53:29.001610 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:53:29.001241 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-jp468" Sep 17 07:53:29.001610 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:53:29.001307 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-jp468" Sep 17 07:53:31.386635 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:53:31.386592 2561 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-crt4n" podUID="5a13d1c0-68a8-4130-9337-9a16158abe2e" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.21:8443: connect: connection refused" Sep 17 07:53:31.387174 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:53:31.386706 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-crt4n" Sep 17 07:53:34.845028 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:53:34.844979 2561 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-crt4n" podUID="5a13d1c0-68a8-4130-9337-9a16158abe2e" containerName="online" probeResult="failure" output="Get \"https://10.132.0.21:6567/health\": dial tcp 10.132.0.21:6567: connect: connection refused" Sep 17 07:53:34.845537 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:53:34.845092 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-crt4n" Sep 17 07:53:37.720460 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:53:37.720431 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-crt4n" Sep 17 07:53:37.741766 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:53:37.741732 2561 generic.go:356] "Generic (PLEG): container finished" podID="5a13d1c0-68a8-4130-9337-9a16158abe2e" containerID="394ce22107f20ee010762b3f188c4459ca845b6e7b2b1640e52b3440079ced1b" exitCode=137 Sep 17 07:53:37.741926 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:53:37.741793 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-crt4n" Sep 17 07:53:37.741926 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:53:37.741792 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-crt4n" event={"ID":"5a13d1c0-68a8-4130-9337-9a16158abe2e","Type":"ContainerDied","Data":"394ce22107f20ee010762b3f188c4459ca845b6e7b2b1640e52b3440079ced1b"} Sep 17 07:53:37.742058 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:53:37.741961 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-crt4n" event={"ID":"5a13d1c0-68a8-4130-9337-9a16158abe2e","Type":"ContainerDied","Data":"6ef740379adfca364109fb7ff1646678564e0f65ce05afba359fceb9b09ef32b"} Sep 17 07:53:37.742058 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:53:37.741979 2561 scope.go:117] "RemoveContainer" containerID="a8c5e2df9b82f9bdf9f440f30f54f6c760849bd0488fbfb332c2194285270c26" Sep 17 07:53:37.745666 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:53:37.745638 2561 generic.go:356] "Generic (PLEG): container finished" podID="40b24ea3-aaf9-4f95-84e2-d8668a5fa1d4" containerID="a898e73e6f055e895273f144bc2146d441901372163e06e0b0b98631bbb18446" exitCode=137 Sep 17 07:53:37.745666 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:53:37.745665 2561 generic.go:356] "Generic (PLEG): container finished" podID="40b24ea3-aaf9-4f95-84e2-d8668a5fa1d4" containerID="dddacf700c6344c04ef6a888d1dd26ef9815cd8ea2744863417404ed4ba468ce" exitCode=137 Sep 17 07:53:37.745666 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:53:37.745708 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-jp468" event={"ID":"40b24ea3-aaf9-4f95-84e2-d8668a5fa1d4","Type":"ContainerDied","Data":"a898e73e6f055e895273f144bc2146d441901372163e06e0b0b98631bbb18446"} Sep 17 07:53:37.746133 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:53:37.745767 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-jp468" event={"ID":"40b24ea3-aaf9-4f95-84e2-d8668a5fa1d4","Type":"ContainerDied","Data":"dddacf700c6344c04ef6a888d1dd26ef9815cd8ea2744863417404ed4ba468ce"} Sep 17 07:53:37.751644 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:53:37.751623 2561 scope.go:117] "RemoveContainer" containerID="394ce22107f20ee010762b3f188c4459ca845b6e7b2b1640e52b3440079ced1b" Sep 17 07:53:37.761653 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:53:37.761629 2561 scope.go:117] "RemoveContainer" containerID="30413328797c2e8e05a12d511c51fce5ae00568a48f0ce562049fe657dbc26a3" Sep 17 07:53:37.771244 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:53:37.771226 2561 scope.go:117] "RemoveContainer" containerID="2c90eb3c428de109fe46a7695be1bdaf1bf0fafb986816b20a22208b9c58dc64" Sep 17 07:53:37.778807 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:53:37.778786 2561 scope.go:117] "RemoveContainer" containerID="f8b8468c8ee80a3746f6278bdddc7122009136f89392e4c605c2480c105bf513" Sep 17 07:53:37.788779 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:53:37.788759 2561 scope.go:117] "RemoveContainer" containerID="a8c5e2df9b82f9bdf9f440f30f54f6c760849bd0488fbfb332c2194285270c26" Sep 17 07:53:37.789153 ip-10-0-132-17 kubenswrapper[2561]: E0917 07:53:37.789132 2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a8c5e2df9b82f9bdf9f440f30f54f6c760849bd0488fbfb332c2194285270c26\": container with ID starting with a8c5e2df9b82f9bdf9f440f30f54f6c760849bd0488fbfb332c2194285270c26 not found: ID does not exist" containerID="a8c5e2df9b82f9bdf9f440f30f54f6c760849bd0488fbfb332c2194285270c26" Sep 17 07:53:37.789224 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:53:37.789166 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a8c5e2df9b82f9bdf9f440f30f54f6c760849bd0488fbfb332c2194285270c26"} err="failed to get container status \"a8c5e2df9b82f9bdf9f440f30f54f6c760849bd0488fbfb332c2194285270c26\": rpc error: code = NotFound desc = could not find container \"a8c5e2df9b82f9bdf9f440f30f54f6c760849bd0488fbfb332c2194285270c26\": container with ID starting with a8c5e2df9b82f9bdf9f440f30f54f6c760849bd0488fbfb332c2194285270c26 not found: ID does not exist" Sep 17 07:53:37.789224 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:53:37.789186 2561 scope.go:117] "RemoveContainer" containerID="394ce22107f20ee010762b3f188c4459ca845b6e7b2b1640e52b3440079ced1b" Sep 17 07:53:37.789522 ip-10-0-132-17 kubenswrapper[2561]: E0917 07:53:37.789504 2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"394ce22107f20ee010762b3f188c4459ca845b6e7b2b1640e52b3440079ced1b\": container with ID starting with 394ce22107f20ee010762b3f188c4459ca845b6e7b2b1640e52b3440079ced1b not found: ID does not exist" containerID="394ce22107f20ee010762b3f188c4459ca845b6e7b2b1640e52b3440079ced1b" Sep 17 07:53:37.789576 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:53:37.789531 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"394ce22107f20ee010762b3f188c4459ca845b6e7b2b1640e52b3440079ced1b"} err="failed to get container status \"394ce22107f20ee010762b3f188c4459ca845b6e7b2b1640e52b3440079ced1b\": rpc error: code = NotFound desc = could not find container \"394ce22107f20ee010762b3f188c4459ca845b6e7b2b1640e52b3440079ced1b\": container with ID starting with 394ce22107f20ee010762b3f188c4459ca845b6e7b2b1640e52b3440079ced1b not found: ID does not exist" Sep 17 07:53:37.789576 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:53:37.789546 2561 scope.go:117] "RemoveContainer" containerID="30413328797c2e8e05a12d511c51fce5ae00568a48f0ce562049fe657dbc26a3" Sep 17 07:53:37.789803 ip-10-0-132-17 kubenswrapper[2561]: E0917 07:53:37.789786 2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"30413328797c2e8e05a12d511c51fce5ae00568a48f0ce562049fe657dbc26a3\": container with ID starting with 30413328797c2e8e05a12d511c51fce5ae00568a48f0ce562049fe657dbc26a3 not found: ID does not exist" containerID="30413328797c2e8e05a12d511c51fce5ae00568a48f0ce562049fe657dbc26a3" Sep 17 07:53:37.789848 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:53:37.789805 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"30413328797c2e8e05a12d511c51fce5ae00568a48f0ce562049fe657dbc26a3"} err="failed to get container status \"30413328797c2e8e05a12d511c51fce5ae00568a48f0ce562049fe657dbc26a3\": rpc error: code = NotFound desc = could not find container \"30413328797c2e8e05a12d511c51fce5ae00568a48f0ce562049fe657dbc26a3\": container with ID starting with 30413328797c2e8e05a12d511c51fce5ae00568a48f0ce562049fe657dbc26a3 not found: ID does not exist" Sep 17 07:53:37.789848 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:53:37.789823 2561 scope.go:117] "RemoveContainer" containerID="2c90eb3c428de109fe46a7695be1bdaf1bf0fafb986816b20a22208b9c58dc64" Sep 17 07:53:37.790443 ip-10-0-132-17 kubenswrapper[2561]: E0917 07:53:37.790428 2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2c90eb3c428de109fe46a7695be1bdaf1bf0fafb986816b20a22208b9c58dc64\": container with ID starting with 2c90eb3c428de109fe46a7695be1bdaf1bf0fafb986816b20a22208b9c58dc64 not found: ID does not exist" containerID="2c90eb3c428de109fe46a7695be1bdaf1bf0fafb986816b20a22208b9c58dc64" Sep 17 07:53:37.790494 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:53:37.790448 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2c90eb3c428de109fe46a7695be1bdaf1bf0fafb986816b20a22208b9c58dc64"} err="failed to get container status \"2c90eb3c428de109fe46a7695be1bdaf1bf0fafb986816b20a22208b9c58dc64\": rpc error: code = NotFound desc = could not find container \"2c90eb3c428de109fe46a7695be1bdaf1bf0fafb986816b20a22208b9c58dc64\": container with ID starting with 2c90eb3c428de109fe46a7695be1bdaf1bf0fafb986816b20a22208b9c58dc64 not found: ID does not exist" Sep 17 07:53:37.790494 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:53:37.790461 2561 scope.go:117] "RemoveContainer" containerID="f8b8468c8ee80a3746f6278bdddc7122009136f89392e4c605c2480c105bf513" Sep 17 07:53:37.790716 ip-10-0-132-17 kubenswrapper[2561]: E0917 07:53:37.790698 2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f8b8468c8ee80a3746f6278bdddc7122009136f89392e4c605c2480c105bf513\": container with ID starting with f8b8468c8ee80a3746f6278bdddc7122009136f89392e4c605c2480c105bf513 not found: ID does not exist" containerID="f8b8468c8ee80a3746f6278bdddc7122009136f89392e4c605c2480c105bf513" Sep 17 07:53:37.790787 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:53:37.790720 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f8b8468c8ee80a3746f6278bdddc7122009136f89392e4c605c2480c105bf513"} err="failed to get container status \"f8b8468c8ee80a3746f6278bdddc7122009136f89392e4c605c2480c105bf513\": rpc error: code = NotFound desc = could not find container \"f8b8468c8ee80a3746f6278bdddc7122009136f89392e4c605c2480c105bf513\": container with ID starting with f8b8468c8ee80a3746f6278bdddc7122009136f89392e4c605c2480c105bf513 not found: ID does not exist" Sep 17 07:53:37.867538 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:53:37.867505 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/5a13d1c0-68a8-4130-9337-9a16158abe2e-feast-data\") pod \"5a13d1c0-68a8-4130-9337-9a16158abe2e\" (UID: \"5a13d1c0-68a8-4130-9337-9a16158abe2e\") " Sep 17 07:53:37.867707 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:53:37.867558 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/5a13d1c0-68a8-4130-9337-9a16158abe2e-offline-tls\") pod \"5a13d1c0-68a8-4130-9337-9a16158abe2e\" (UID: \"5a13d1c0-68a8-4130-9337-9a16158abe2e\") " Sep 17 07:53:37.867707 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:53:37.867596 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/5a13d1c0-68a8-4130-9337-9a16158abe2e-ui-tls\") pod \"5a13d1c0-68a8-4130-9337-9a16158abe2e\" (UID: \"5a13d1c0-68a8-4130-9337-9a16158abe2e\") " Sep 17 07:53:37.867707 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:53:37.867638 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-brrrw\" (UniqueName: \"kubernetes.io/projected/5a13d1c0-68a8-4130-9337-9a16158abe2e-kube-api-access-brrrw\") pod \"5a13d1c0-68a8-4130-9337-9a16158abe2e\" (UID: \"5a13d1c0-68a8-4130-9337-9a16158abe2e\") " Sep 17 07:53:37.867707 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:53:37.867683 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/5a13d1c0-68a8-4130-9337-9a16158abe2e-online-tls\") pod \"5a13d1c0-68a8-4130-9337-9a16158abe2e\" (UID: \"5a13d1c0-68a8-4130-9337-9a16158abe2e\") " Sep 17 07:53:37.867952 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:53:37.867826 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/configmap/5a13d1c0-68a8-4130-9337-9a16158abe2e-registry-tls\") pod \"5a13d1c0-68a8-4130-9337-9a16158abe2e\" (UID: \"5a13d1c0-68a8-4130-9337-9a16158abe2e\") " Sep 17 07:53:37.868044 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:53:37.868016 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5a13d1c0-68a8-4130-9337-9a16158abe2e-feast-data" (OuterVolumeSpecName: "feast-data") pod "5a13d1c0-68a8-4130-9337-9a16158abe2e" (UID: "5a13d1c0-68a8-4130-9337-9a16158abe2e"). InnerVolumeSpecName "feast-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 17 07:53:37.868323 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:53:37.868245 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5a13d1c0-68a8-4130-9337-9a16158abe2e-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "5a13d1c0-68a8-4130-9337-9a16158abe2e" (UID: "5a13d1c0-68a8-4130-9337-9a16158abe2e"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 17 07:53:37.870181 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:53:37.870154 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5a13d1c0-68a8-4130-9337-9a16158abe2e-kube-api-access-brrrw" (OuterVolumeSpecName: "kube-api-access-brrrw") pod "5a13d1c0-68a8-4130-9337-9a16158abe2e" (UID: "5a13d1c0-68a8-4130-9337-9a16158abe2e"). InnerVolumeSpecName "kube-api-access-brrrw". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 17 07:53:37.870181 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:53:37.870155 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5a13d1c0-68a8-4130-9337-9a16158abe2e-online-tls" (OuterVolumeSpecName: "online-tls") pod "5a13d1c0-68a8-4130-9337-9a16158abe2e" (UID: "5a13d1c0-68a8-4130-9337-9a16158abe2e"). InnerVolumeSpecName "online-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 17 07:53:37.870309 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:53:37.870179 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5a13d1c0-68a8-4130-9337-9a16158abe2e-ui-tls" (OuterVolumeSpecName: "ui-tls") pod "5a13d1c0-68a8-4130-9337-9a16158abe2e" (UID: "5a13d1c0-68a8-4130-9337-9a16158abe2e"). InnerVolumeSpecName "ui-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 17 07:53:37.870309 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:53:37.870192 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5a13d1c0-68a8-4130-9337-9a16158abe2e-offline-tls" (OuterVolumeSpecName: "offline-tls") pod "5a13d1c0-68a8-4130-9337-9a16158abe2e" (UID: "5a13d1c0-68a8-4130-9337-9a16158abe2e"). InnerVolumeSpecName "offline-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 17 07:53:37.881228 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:53:37.881205 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-jp468" Sep 17 07:53:37.968456 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:53:37.968424 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/40b24ea3-aaf9-4f95-84e2-d8668a5fa1d4-offline-tls\") pod \"40b24ea3-aaf9-4f95-84e2-d8668a5fa1d4\" (UID: \"40b24ea3-aaf9-4f95-84e2-d8668a5fa1d4\") " Sep 17 07:53:37.968456 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:53:37.968460 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/40b24ea3-aaf9-4f95-84e2-d8668a5fa1d4-registry-tls\") pod \"40b24ea3-aaf9-4f95-84e2-d8668a5fa1d4\" (UID: \"40b24ea3-aaf9-4f95-84e2-d8668a5fa1d4\") " Sep 17 07:53:37.968706 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:53:37.968493 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cpt77\" (UniqueName: \"kubernetes.io/projected/40b24ea3-aaf9-4f95-84e2-d8668a5fa1d4-kube-api-access-cpt77\") pod \"40b24ea3-aaf9-4f95-84e2-d8668a5fa1d4\" (UID: \"40b24ea3-aaf9-4f95-84e2-d8668a5fa1d4\") " Sep 17 07:53:37.968706 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:53:37.968520 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/40b24ea3-aaf9-4f95-84e2-d8668a5fa1d4-feast-data\") pod \"40b24ea3-aaf9-4f95-84e2-d8668a5fa1d4\" (UID: \"40b24ea3-aaf9-4f95-84e2-d8668a5fa1d4\") " Sep 17 07:53:37.968706 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:53:37.968545 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/40b24ea3-aaf9-4f95-84e2-d8668a5fa1d4-online-tls\") pod \"40b24ea3-aaf9-4f95-84e2-d8668a5fa1d4\" (UID: \"40b24ea3-aaf9-4f95-84e2-d8668a5fa1d4\") " Sep 17 07:53:37.968706 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:53:37.968559 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/40b24ea3-aaf9-4f95-84e2-d8668a5fa1d4-ui-tls\") pod \"40b24ea3-aaf9-4f95-84e2-d8668a5fa1d4\" (UID: \"40b24ea3-aaf9-4f95-84e2-d8668a5fa1d4\") " Sep 17 07:53:37.968924 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:53:37.968710 2561 reconciler_common.go:299] "Volume detached for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/5a13d1c0-68a8-4130-9337-9a16158abe2e-online-tls\") on node \"ip-10-0-132-17.ec2.internal\" DevicePath \"\"" Sep 17 07:53:37.968924 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:53:37.968726 2561 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/configmap/5a13d1c0-68a8-4130-9337-9a16158abe2e-registry-tls\") on node \"ip-10-0-132-17.ec2.internal\" DevicePath \"\"" Sep 17 07:53:37.968924 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:53:37.968739 2561 reconciler_common.go:299] "Volume detached for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/5a13d1c0-68a8-4130-9337-9a16158abe2e-feast-data\") on node \"ip-10-0-132-17.ec2.internal\" DevicePath \"\"" Sep 17 07:53:37.968924 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:53:37.968751 2561 reconciler_common.go:299] "Volume detached for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/5a13d1c0-68a8-4130-9337-9a16158abe2e-offline-tls\") on node \"ip-10-0-132-17.ec2.internal\" DevicePath \"\"" Sep 17 07:53:37.968924 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:53:37.968762 2561 reconciler_common.go:299] "Volume detached for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/5a13d1c0-68a8-4130-9337-9a16158abe2e-ui-tls\") on node \"ip-10-0-132-17.ec2.internal\" DevicePath \"\"" Sep 17 07:53:37.968924 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:53:37.968773 2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-brrrw\" (UniqueName: \"kubernetes.io/projected/5a13d1c0-68a8-4130-9337-9a16158abe2e-kube-api-access-brrrw\") on node \"ip-10-0-132-17.ec2.internal\" DevicePath \"\"" Sep 17 07:53:37.969265 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:53:37.969175 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/40b24ea3-aaf9-4f95-84e2-d8668a5fa1d4-feast-data" (OuterVolumeSpecName: "feast-data") pod "40b24ea3-aaf9-4f95-84e2-d8668a5fa1d4" (UID: "40b24ea3-aaf9-4f95-84e2-d8668a5fa1d4"). InnerVolumeSpecName "feast-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 17 07:53:37.970811 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:53:37.970788 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/40b24ea3-aaf9-4f95-84e2-d8668a5fa1d4-online-tls" (OuterVolumeSpecName: "online-tls") pod "40b24ea3-aaf9-4f95-84e2-d8668a5fa1d4" (UID: "40b24ea3-aaf9-4f95-84e2-d8668a5fa1d4"). InnerVolumeSpecName "online-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 17 07:53:37.971200 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:53:37.971176 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/40b24ea3-aaf9-4f95-84e2-d8668a5fa1d4-kube-api-access-cpt77" (OuterVolumeSpecName: "kube-api-access-cpt77") pod "40b24ea3-aaf9-4f95-84e2-d8668a5fa1d4" (UID: "40b24ea3-aaf9-4f95-84e2-d8668a5fa1d4"). InnerVolumeSpecName "kube-api-access-cpt77". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 17 07:53:37.971200 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:53:37.971178 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/40b24ea3-aaf9-4f95-84e2-d8668a5fa1d4-offline-tls" (OuterVolumeSpecName: "offline-tls") pod "40b24ea3-aaf9-4f95-84e2-d8668a5fa1d4" (UID: "40b24ea3-aaf9-4f95-84e2-d8668a5fa1d4"). InnerVolumeSpecName "offline-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 17 07:53:37.971332 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:53:37.971259 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/40b24ea3-aaf9-4f95-84e2-d8668a5fa1d4-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "40b24ea3-aaf9-4f95-84e2-d8668a5fa1d4" (UID: "40b24ea3-aaf9-4f95-84e2-d8668a5fa1d4"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 17 07:53:37.971332 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:53:37.971295 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/40b24ea3-aaf9-4f95-84e2-d8668a5fa1d4-ui-tls" (OuterVolumeSpecName: "ui-tls") pod "40b24ea3-aaf9-4f95-84e2-d8668a5fa1d4" (UID: "40b24ea3-aaf9-4f95-84e2-d8668a5fa1d4"). InnerVolumeSpecName "ui-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 17 07:53:38.067638 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:53:38.067606 2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-crt4n"] Sep 17 07:53:38.069661 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:53:38.069643 2561 reconciler_common.go:299] "Volume detached for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/40b24ea3-aaf9-4f95-84e2-d8668a5fa1d4-online-tls\") on node \"ip-10-0-132-17.ec2.internal\" DevicePath \"\"" Sep 17 07:53:38.069731 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:53:38.069663 2561 reconciler_common.go:299] "Volume detached for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/40b24ea3-aaf9-4f95-84e2-d8668a5fa1d4-ui-tls\") on node \"ip-10-0-132-17.ec2.internal\" DevicePath \"\"" Sep 17 07:53:38.069731 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:53:38.069672 2561 reconciler_common.go:299] "Volume detached for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/40b24ea3-aaf9-4f95-84e2-d8668a5fa1d4-offline-tls\") on node \"ip-10-0-132-17.ec2.internal\" DevicePath \"\"" Sep 17 07:53:38.069731 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:53:38.069680 2561 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/40b24ea3-aaf9-4f95-84e2-d8668a5fa1d4-registry-tls\") on node \"ip-10-0-132-17.ec2.internal\" DevicePath \"\"" Sep 17 07:53:38.069731 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:53:38.069689 2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cpt77\" (UniqueName: \"kubernetes.io/projected/40b24ea3-aaf9-4f95-84e2-d8668a5fa1d4-kube-api-access-cpt77\") on node \"ip-10-0-132-17.ec2.internal\" DevicePath \"\"" Sep 17 07:53:38.069731 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:53:38.069698 2561 reconciler_common.go:299] "Volume detached for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/40b24ea3-aaf9-4f95-84e2-d8668a5fa1d4-feast-data\") on node \"ip-10-0-132-17.ec2.internal\" DevicePath \"\"" Sep 17 07:53:38.072738 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:53:38.072713 2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-crt4n"] Sep 17 07:53:38.684023 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:53:38.683982 2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5a13d1c0-68a8-4130-9337-9a16158abe2e" path="/var/lib/kubelet/pods/5a13d1c0-68a8-4130-9337-9a16158abe2e/volumes" Sep 17 07:53:38.752430 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:53:38.752400 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-jp468" event={"ID":"40b24ea3-aaf9-4f95-84e2-d8668a5fa1d4","Type":"ContainerDied","Data":"e8e6253e8b478f85cec3b9788616d77895fe1c3a70597705532ecdeed4fc6a9e"} Sep 17 07:53:38.752833 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:53:38.752435 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-jp468" Sep 17 07:53:38.752833 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:53:38.752455 2561 scope.go:117] "RemoveContainer" containerID="3752173392c3b17fed29eed00979a4e90923d551edee8aebd4069b923102d980" Sep 17 07:53:38.760186 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:53:38.760169 2561 scope.go:117] "RemoveContainer" containerID="a898e73e6f055e895273f144bc2146d441901372163e06e0b0b98631bbb18446" Sep 17 07:53:38.768967 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:53:38.768918 2561 scope.go:117] "RemoveContainer" containerID="1f332347deaeb783a5f63137542f7acc2a91a28fafe09f3ad6d3d4ae6043d9fd" Sep 17 07:53:38.776580 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:53:38.776561 2561 scope.go:117] "RemoveContainer" containerID="dddacf700c6344c04ef6a888d1dd26ef9815cd8ea2744863417404ed4ba468ce" Sep 17 07:53:38.783670 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:53:38.783654 2561 scope.go:117] "RemoveContainer" containerID="a44feea6ede305798cc698833e40a7faf437c88c3fbe3746fdaf5ff14e888127" Sep 17 07:53:38.790462 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:53:38.790438 2561 scope.go:117] "RemoveContainer" containerID="c9305ef9c03152123082ca8cb4b62e0c14fc2da6c501828279717d0ab1b29258" Sep 17 07:53:38.801074 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:53:38.801055 2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-57576b8fcf-jp468"] Sep 17 07:53:38.805091 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:53:38.805069 2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-57576b8fcf-jp468"] Sep 17 07:53:40.683519 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:53:40.683486 2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="40b24ea3-aaf9-4f95-84e2-d8668a5fa1d4" path="/var/lib/kubelet/pods/40b24ea3-aaf9-4f95-84e2-d8668a5fa1d4/volumes" Sep 17 07:53:50.546582 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:53:50.546537 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9skpb_96c5b8e5-2fc0-489b-8889-52bf66184838/konnectivity-agent/0.log" limit=1024 Sep 17 07:53:50.686115 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:53:50.686089 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9skpb_96c5b8e5-2fc0-489b-8889-52bf66184838/konnectivity-agent/0.log" limit=1024 Sep 17 07:53:56.345874 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:53:56.345829 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9skpb_96c5b8e5-2fc0-489b-8889-52bf66184838/konnectivity-agent/0.log" limit=1024 Sep 17 07:53:56.600377 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:53:56.600289 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9skpb_96c5b8e5-2fc0-489b-8889-52bf66184838/konnectivity-agent/0.log" limit=1024 Sep 17 07:53:57.011058 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:53:57.011019 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9skpb_96c5b8e5-2fc0-489b-8889-52bf66184838/konnectivity-agent/0.log" limit=1024 Sep 17 07:53:57.185940 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:53:57.185905 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9skpb_96c5b8e5-2fc0-489b-8889-52bf66184838/konnectivity-agent/0.log" limit=1024 Sep 17 07:54:14.722744 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:54:14.722665 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9skpb_96c5b8e5-2fc0-489b-8889-52bf66184838/konnectivity-agent/0.log" limit=1024 Sep 17 07:54:14.846823 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:54:14.846793 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-xsbln/must-gather-bs99v"] Sep 17 07:54:14.847044 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:54:14.847032 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="40b24ea3-aaf9-4f95-84e2-d8668a5fa1d4" containerName="feast-apply" Sep 17 07:54:14.847094 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:54:14.847046 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="40b24ea3-aaf9-4f95-84e2-d8668a5fa1d4" containerName="feast-apply" Sep 17 07:54:14.847094 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:54:14.847056 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="40b24ea3-aaf9-4f95-84e2-d8668a5fa1d4" containerName="online" Sep 17 07:54:14.847094 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:54:14.847061 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="40b24ea3-aaf9-4f95-84e2-d8668a5fa1d4" containerName="online" Sep 17 07:54:14.847094 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:54:14.847070 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5a13d1c0-68a8-4130-9337-9a16158abe2e" containerName="feast-apply" Sep 17 07:54:14.847094 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:54:14.847075 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="5a13d1c0-68a8-4130-9337-9a16158abe2e" containerName="feast-apply" Sep 17 07:54:14.847094 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:54:14.847081 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="40b24ea3-aaf9-4f95-84e2-d8668a5fa1d4" containerName="registry" Sep 17 07:54:14.847094 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:54:14.847085 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="40b24ea3-aaf9-4f95-84e2-d8668a5fa1d4" containerName="registry" Sep 17 07:54:14.847094 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:54:14.847093 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="40b24ea3-aaf9-4f95-84e2-d8668a5fa1d4" containerName="feast-init" Sep 17 07:54:14.847094 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:54:14.847098 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="40b24ea3-aaf9-4f95-84e2-d8668a5fa1d4" containerName="feast-init" Sep 17 07:54:14.847361 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:54:14.847104 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="40b24ea3-aaf9-4f95-84e2-d8668a5fa1d4" containerName="offline" Sep 17 07:54:14.847361 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:54:14.847109 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="40b24ea3-aaf9-4f95-84e2-d8668a5fa1d4" containerName="offline" Sep 17 07:54:14.847361 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:54:14.847115 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5a13d1c0-68a8-4130-9337-9a16158abe2e" containerName="ui" Sep 17 07:54:14.847361 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:54:14.847119 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="5a13d1c0-68a8-4130-9337-9a16158abe2e" containerName="ui" Sep 17 07:54:14.847361 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:54:14.847126 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5a13d1c0-68a8-4130-9337-9a16158abe2e" containerName="online" Sep 17 07:54:14.847361 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:54:14.847130 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="5a13d1c0-68a8-4130-9337-9a16158abe2e" containerName="online" Sep 17 07:54:14.847361 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:54:14.847136 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5a13d1c0-68a8-4130-9337-9a16158abe2e" containerName="offline" Sep 17 07:54:14.847361 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:54:14.847140 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="5a13d1c0-68a8-4130-9337-9a16158abe2e" containerName="offline" Sep 17 07:54:14.847361 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:54:14.847146 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="40b24ea3-aaf9-4f95-84e2-d8668a5fa1d4" containerName="ui" Sep 17 07:54:14.847361 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:54:14.847151 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="40b24ea3-aaf9-4f95-84e2-d8668a5fa1d4" containerName="ui" Sep 17 07:54:14.847361 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:54:14.847157 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5a13d1c0-68a8-4130-9337-9a16158abe2e" containerName="feast-init" Sep 17 07:54:14.847361 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:54:14.847162 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="5a13d1c0-68a8-4130-9337-9a16158abe2e" containerName="feast-init" Sep 17 07:54:14.847361 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:54:14.847201 2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="5a13d1c0-68a8-4130-9337-9a16158abe2e" containerName="online" Sep 17 07:54:14.847361 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:54:14.847208 2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="40b24ea3-aaf9-4f95-84e2-d8668a5fa1d4" containerName="online" Sep 17 07:54:14.847361 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:54:14.847213 2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="5a13d1c0-68a8-4130-9337-9a16158abe2e" containerName="ui" Sep 17 07:54:14.847361 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:54:14.847218 2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="40b24ea3-aaf9-4f95-84e2-d8668a5fa1d4" containerName="offline" Sep 17 07:54:14.847361 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:54:14.847225 2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="40b24ea3-aaf9-4f95-84e2-d8668a5fa1d4" containerName="registry" Sep 17 07:54:14.847361 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:54:14.847231 2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="40b24ea3-aaf9-4f95-84e2-d8668a5fa1d4" containerName="ui" Sep 17 07:54:14.847361 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:54:14.847236 2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="5a13d1c0-68a8-4130-9337-9a16158abe2e" containerName="offline" Sep 17 07:54:14.851395 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:54:14.851377 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-xsbln/must-gather-bs99v" Sep 17 07:54:14.854583 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:54:14.854554 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-xsbln\"/\"openshift-service-ca.crt\"" Sep 17 07:54:14.854701 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:54:14.854652 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-xsbln\"/\"kube-root-ca.crt\"" Sep 17 07:54:14.854915 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:54:14.854899 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-xsbln\"/\"default-dockercfg-fpw4b\"" Sep 17 07:54:14.862066 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:54:14.862045 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-xsbln/must-gather-bs99v"] Sep 17 07:54:14.868261 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:54:14.868235 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9skpb_96c5b8e5-2fc0-489b-8889-52bf66184838/konnectivity-agent/0.log" limit=1024 Sep 17 07:54:14.899828 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:54:14.899808 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bsqd7\" (UniqueName: \"kubernetes.io/projected/fd03cb7f-6843-4eb9-b62b-2ce515a9b1c7-kube-api-access-bsqd7\") pod \"must-gather-bs99v\" (UID: \"fd03cb7f-6843-4eb9-b62b-2ce515a9b1c7\") " pod="openshift-must-gather-xsbln/must-gather-bs99v" Sep 17 07:54:14.899957 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:54:14.899834 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/fd03cb7f-6843-4eb9-b62b-2ce515a9b1c7-must-gather-output\") pod \"must-gather-bs99v\" (UID: \"fd03cb7f-6843-4eb9-b62b-2ce515a9b1c7\") " pod="openshift-must-gather-xsbln/must-gather-bs99v" Sep 17 07:54:14.967762 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:54:14.967737 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9skpb_96c5b8e5-2fc0-489b-8889-52bf66184838/konnectivity-agent/0.log" limit=1024 Sep 17 07:54:15.000482 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:54:15.000419 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bsqd7\" (UniqueName: \"kubernetes.io/projected/fd03cb7f-6843-4eb9-b62b-2ce515a9b1c7-kube-api-access-bsqd7\") pod \"must-gather-bs99v\" (UID: \"fd03cb7f-6843-4eb9-b62b-2ce515a9b1c7\") " pod="openshift-must-gather-xsbln/must-gather-bs99v" Sep 17 07:54:15.000482 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:54:15.000445 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/fd03cb7f-6843-4eb9-b62b-2ce515a9b1c7-must-gather-output\") pod \"must-gather-bs99v\" (UID: \"fd03cb7f-6843-4eb9-b62b-2ce515a9b1c7\") " pod="openshift-must-gather-xsbln/must-gather-bs99v" Sep 17 07:54:15.000705 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:54:15.000690 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/fd03cb7f-6843-4eb9-b62b-2ce515a9b1c7-must-gather-output\") pod \"must-gather-bs99v\" (UID: \"fd03cb7f-6843-4eb9-b62b-2ce515a9b1c7\") " pod="openshift-must-gather-xsbln/must-gather-bs99v" Sep 17 07:54:15.009494 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:54:15.009467 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bsqd7\" (UniqueName: \"kubernetes.io/projected/fd03cb7f-6843-4eb9-b62b-2ce515a9b1c7-kube-api-access-bsqd7\") pod \"must-gather-bs99v\" (UID: \"fd03cb7f-6843-4eb9-b62b-2ce515a9b1c7\") " pod="openshift-must-gather-xsbln/must-gather-bs99v" Sep 17 07:54:15.159761 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:54:15.159738 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-xsbln/must-gather-bs99v" Sep 17 07:54:15.428693 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:54:15.428662 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-xsbln/must-gather-bs99v"] Sep 17 07:54:15.431554 ip-10-0-132-17 kubenswrapper[2561]: W0917 07:54:15.431522 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podfd03cb7f_6843_4eb9_b62b_2ce515a9b1c7.slice/crio-a911bba834755c15e5dec8600c806335850e3c403c4a4382a7abd92182ba1b0a WatchSource:0}: Error finding container a911bba834755c15e5dec8600c806335850e3c403c4a4382a7abd92182ba1b0a: Status 404 returned error can't find the container with id a911bba834755c15e5dec8600c806335850e3c403c4a4382a7abd92182ba1b0a Sep 17 07:54:15.433472 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:54:15.433450 2561 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Sep 17 07:54:15.867637 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:54:15.867606 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-xsbln/must-gather-bs99v" event={"ID":"fd03cb7f-6843-4eb9-b62b-2ce515a9b1c7","Type":"ContainerStarted","Data":"a911bba834755c15e5dec8600c806335850e3c403c4a4382a7abd92182ba1b0a"} Sep 17 07:54:16.874568 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:54:16.874536 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-xsbln/must-gather-bs99v" event={"ID":"fd03cb7f-6843-4eb9-b62b-2ce515a9b1c7","Type":"ContainerStarted","Data":"1655c2d35308aa944d652da47b5467ca5151103e0c900f8373988324330a49e7"} Sep 17 07:54:16.874985 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:54:16.874578 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-xsbln/must-gather-bs99v" event={"ID":"fd03cb7f-6843-4eb9-b62b-2ce515a9b1c7","Type":"ContainerStarted","Data":"cad0c668a9c3755377acd44bf0afb57ff6918501a276f51b6022ef4bdb8f9ad4"} Sep 17 07:54:18.171790 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:54:18.171751 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-rs4vc_f387de20-2724-46ab-9bca-b4b4a23711cf/global-pull-secret-syncer/0.log" Sep 17 07:54:18.243388 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:54:18.243354 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-9skpb_96c5b8e5-2fc0-489b-8889-52bf66184838/konnectivity-agent/0.log" Sep 17 07:54:18.362467 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:54:18.362424 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-132-17.ec2.internal_6cba30f3283a64fbc23b4dd01a869002/haproxy/0.log" Sep 17 07:54:20.900390 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:54:20.900313 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9skpb_96c5b8e5-2fc0-489b-8889-52bf66184838/konnectivity-agent/0.log" limit=1024 Sep 17 07:54:21.116143 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:54:21.116104 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9skpb_96c5b8e5-2fc0-489b-8889-52bf66184838/konnectivity-agent/0.log" limit=1024 Sep 17 07:54:22.791174 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:54:22.791106 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-kbcpl_bec7cc58-ac7e-4df1-9dea-45690659cdac/node-exporter/0.log" Sep 17 07:54:22.828904 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:54:22.828829 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-kbcpl_bec7cc58-ac7e-4df1-9dea-45690659cdac/kube-rbac-proxy/0.log" Sep 17 07:54:22.870112 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:54:22.870000 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-kbcpl_bec7cc58-ac7e-4df1-9dea-45690659cdac/init-textfile/0.log" Sep 17 07:54:24.849335 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:54:24.849263 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-xsbln/must-gather-bs99v" podStartSLOduration=9.928501235 podStartE2EDuration="10.849237764s" totalImagesPullingTime="920.736529ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 07:54:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 07:54:16.892814488 +0000 UTC m=+2074.698760763" watchObservedRunningTime="2026-09-17 07:54:24.849237764 +0000 UTC m=+2082.655184041" Sep 17 07:54:24.850619 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:54:24.850589 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-xsbln/perf-node-gather-daemonset-vjxhg"] Sep 17 07:54:24.855900 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:54:24.855854 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-xsbln/perf-node-gather-daemonset-vjxhg" Sep 17 07:54:24.867758 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:54:24.867730 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-xsbln/perf-node-gather-daemonset-vjxhg"] Sep 17 07:54:24.978997 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:54:24.978961 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/f13098ac-9bbe-4c9d-bdf1-b05c5084de72-podres\") pod \"perf-node-gather-daemonset-vjxhg\" (UID: \"f13098ac-9bbe-4c9d-bdf1-b05c5084de72\") " pod="openshift-must-gather-xsbln/perf-node-gather-daemonset-vjxhg" Sep 17 07:54:24.979171 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:54:24.979018 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f13098ac-9bbe-4c9d-bdf1-b05c5084de72-sys\") pod \"perf-node-gather-daemonset-vjxhg\" (UID: \"f13098ac-9bbe-4c9d-bdf1-b05c5084de72\") " pod="openshift-must-gather-xsbln/perf-node-gather-daemonset-vjxhg" Sep 17 07:54:24.979171 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:54:24.979049 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t9ptc\" (UniqueName: \"kubernetes.io/projected/f13098ac-9bbe-4c9d-bdf1-b05c5084de72-kube-api-access-t9ptc\") pod \"perf-node-gather-daemonset-vjxhg\" (UID: \"f13098ac-9bbe-4c9d-bdf1-b05c5084de72\") " pod="openshift-must-gather-xsbln/perf-node-gather-daemonset-vjxhg" Sep 17 07:54:24.979171 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:54:24.979149 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/f13098ac-9bbe-4c9d-bdf1-b05c5084de72-lib-modules\") pod \"perf-node-gather-daemonset-vjxhg\" (UID: \"f13098ac-9bbe-4c9d-bdf1-b05c5084de72\") " pod="openshift-must-gather-xsbln/perf-node-gather-daemonset-vjxhg" Sep 17 07:54:24.979282 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:54:24.979182 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/f13098ac-9bbe-4c9d-bdf1-b05c5084de72-proc\") pod \"perf-node-gather-daemonset-vjxhg\" (UID: \"f13098ac-9bbe-4c9d-bdf1-b05c5084de72\") " pod="openshift-must-gather-xsbln/perf-node-gather-daemonset-vjxhg" Sep 17 07:54:25.080072 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:54:25.080035 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/f13098ac-9bbe-4c9d-bdf1-b05c5084de72-podres\") pod \"perf-node-gather-daemonset-vjxhg\" (UID: \"f13098ac-9bbe-4c9d-bdf1-b05c5084de72\") " pod="openshift-must-gather-xsbln/perf-node-gather-daemonset-vjxhg" Sep 17 07:54:25.080278 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:54:25.080104 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f13098ac-9bbe-4c9d-bdf1-b05c5084de72-sys\") pod \"perf-node-gather-daemonset-vjxhg\" (UID: \"f13098ac-9bbe-4c9d-bdf1-b05c5084de72\") " pod="openshift-must-gather-xsbln/perf-node-gather-daemonset-vjxhg" Sep 17 07:54:25.080278 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:54:25.080130 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t9ptc\" (UniqueName: \"kubernetes.io/projected/f13098ac-9bbe-4c9d-bdf1-b05c5084de72-kube-api-access-t9ptc\") pod \"perf-node-gather-daemonset-vjxhg\" (UID: \"f13098ac-9bbe-4c9d-bdf1-b05c5084de72\") " pod="openshift-must-gather-xsbln/perf-node-gather-daemonset-vjxhg" Sep 17 07:54:25.080278 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:54:25.080173 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/f13098ac-9bbe-4c9d-bdf1-b05c5084de72-lib-modules\") pod \"perf-node-gather-daemonset-vjxhg\" (UID: \"f13098ac-9bbe-4c9d-bdf1-b05c5084de72\") " pod="openshift-must-gather-xsbln/perf-node-gather-daemonset-vjxhg" Sep 17 07:54:25.080278 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:54:25.080191 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/f13098ac-9bbe-4c9d-bdf1-b05c5084de72-podres\") pod \"perf-node-gather-daemonset-vjxhg\" (UID: \"f13098ac-9bbe-4c9d-bdf1-b05c5084de72\") " pod="openshift-must-gather-xsbln/perf-node-gather-daemonset-vjxhg" Sep 17 07:54:25.080278 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:54:25.080198 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/f13098ac-9bbe-4c9d-bdf1-b05c5084de72-proc\") pod \"perf-node-gather-daemonset-vjxhg\" (UID: \"f13098ac-9bbe-4c9d-bdf1-b05c5084de72\") " pod="openshift-must-gather-xsbln/perf-node-gather-daemonset-vjxhg" Sep 17 07:54:25.080278 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:54:25.080240 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/f13098ac-9bbe-4c9d-bdf1-b05c5084de72-proc\") pod \"perf-node-gather-daemonset-vjxhg\" (UID: \"f13098ac-9bbe-4c9d-bdf1-b05c5084de72\") " pod="openshift-must-gather-xsbln/perf-node-gather-daemonset-vjxhg" Sep 17 07:54:25.080278 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:54:25.080225 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f13098ac-9bbe-4c9d-bdf1-b05c5084de72-sys\") pod \"perf-node-gather-daemonset-vjxhg\" (UID: \"f13098ac-9bbe-4c9d-bdf1-b05c5084de72\") " pod="openshift-must-gather-xsbln/perf-node-gather-daemonset-vjxhg" Sep 17 07:54:25.080668 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:54:25.080333 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/f13098ac-9bbe-4c9d-bdf1-b05c5084de72-lib-modules\") pod \"perf-node-gather-daemonset-vjxhg\" (UID: \"f13098ac-9bbe-4c9d-bdf1-b05c5084de72\") " pod="openshift-must-gather-xsbln/perf-node-gather-daemonset-vjxhg" Sep 17 07:54:25.091502 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:54:25.091460 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-t9ptc\" (UniqueName: \"kubernetes.io/projected/f13098ac-9bbe-4c9d-bdf1-b05c5084de72-kube-api-access-t9ptc\") pod \"perf-node-gather-daemonset-vjxhg\" (UID: \"f13098ac-9bbe-4c9d-bdf1-b05c5084de72\") " pod="openshift-must-gather-xsbln/perf-node-gather-daemonset-vjxhg" Sep 17 07:54:25.171056 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:54:25.171020 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-xsbln/perf-node-gather-daemonset-vjxhg" Sep 17 07:54:25.449150 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:54:25.449057 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-xsbln/perf-node-gather-daemonset-vjxhg"] Sep 17 07:54:25.454007 ip-10-0-132-17 kubenswrapper[2561]: W0917 07:54:25.453974 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podf13098ac_9bbe_4c9d_bdf1_b05c5084de72.slice/crio-907148ace7e4d668fc877a39ba30f696cd19b7bd3cb8b3e4e9b3cd34f509c68f WatchSource:0}: Error finding container 907148ace7e4d668fc877a39ba30f696cd19b7bd3cb8b3e4e9b3cd34f509c68f: Status 404 returned error can't find the container with id 907148ace7e4d668fc877a39ba30f696cd19b7bd3cb8b3e4e9b3cd34f509c68f Sep 17 07:54:25.918183 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:54:25.918143 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-xsbln/perf-node-gather-daemonset-vjxhg" event={"ID":"f13098ac-9bbe-4c9d-bdf1-b05c5084de72","Type":"ContainerStarted","Data":"c293f22355713b024c3df1849c8fff61483934aa6f46625d3d17adbdbbaf20f2"} Sep 17 07:54:25.918600 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:54:25.918312 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-xsbln/perf-node-gather-daemonset-vjxhg" Sep 17 07:54:25.918600 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:54:25.918345 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-xsbln/perf-node-gather-daemonset-vjxhg" event={"ID":"f13098ac-9bbe-4c9d-bdf1-b05c5084de72","Type":"ContainerStarted","Data":"907148ace7e4d668fc877a39ba30f696cd19b7bd3cb8b3e4e9b3cd34f509c68f"} Sep 17 07:54:27.232284 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:54:27.232257 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-6h7kw_a8fc4c21-3234-45f2-8210-3065895e0eb6/dns/0.log" Sep 17 07:54:27.272197 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:54:27.272167 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-6h7kw_a8fc4c21-3234-45f2-8210-3065895e0eb6/kube-rbac-proxy/0.log" Sep 17 07:54:27.524339 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:54:27.524247 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-8qgg7_e154eb37-bb6a-4aca-b364-ab985fa57261/dns-node-resolver/0.log" Sep 17 07:54:28.273402 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:54:28.273357 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-pwnj9_a4c6eeea-2ae6-4bb2-93ee-1b46b62da363/node-ca/0.log" Sep 17 07:54:29.471349 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:54:29.471317 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-lbjkz_8e4c6dcd-3822-4c52-be03-ada3f5f45c9a/serve-healthcheck-canary/0.log" Sep 17 07:54:29.908254 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:54:29.908228 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-mxdhz_7470450e-ca42-47f8-bfc4-42e9ce03a88e/kube-rbac-proxy/0.log" Sep 17 07:54:29.930436 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:54:29.930411 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-mxdhz_7470450e-ca42-47f8-bfc4-42e9ce03a88e/exporter/0.log" Sep 17 07:54:29.955572 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:54:29.955550 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-mxdhz_7470450e-ca42-47f8-bfc4-42e9ce03a88e/extractor/0.log" Sep 17 07:54:31.933000 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:54:31.932966 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-xsbln/perf-node-gather-daemonset-vjxhg" Sep 17 07:54:31.949990 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:54:31.949913 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-xsbln/perf-node-gather-daemonset-vjxhg" podStartSLOduration=7.949898687 podStartE2EDuration="7.949898687s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-17 07:54:24 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 07:54:25.946759926 +0000 UTC m=+2083.752706200" watchObservedRunningTime="2026-09-17 07:54:31.949898687 +0000 UTC m=+2089.755844961" Sep 17 07:54:36.213811 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:54:36.213784 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-4hbmd_dc177633-60cf-4933-90f5-26d2619f7c82/kube-multus-additional-cni-plugins/0.log" Sep 17 07:54:36.237571 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:54:36.237545 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-4hbmd_dc177633-60cf-4933-90f5-26d2619f7c82/egress-router-binary-copy/0.log" Sep 17 07:54:36.263363 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:54:36.263341 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-4hbmd_dc177633-60cf-4933-90f5-26d2619f7c82/cni-plugins/0.log" Sep 17 07:54:36.286087 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:54:36.286061 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-4hbmd_dc177633-60cf-4933-90f5-26d2619f7c82/bond-cni-plugin/0.log" Sep 17 07:54:36.314083 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:54:36.314062 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-4hbmd_dc177633-60cf-4933-90f5-26d2619f7c82/routeoverride-cni/0.log" Sep 17 07:54:36.338740 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:54:36.338718 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-4hbmd_dc177633-60cf-4933-90f5-26d2619f7c82/whereabouts-cni-bincopy/0.log" Sep 17 07:54:36.371333 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:54:36.371317 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-4hbmd_dc177633-60cf-4933-90f5-26d2619f7c82/whereabouts-cni/0.log" Sep 17 07:54:36.573738 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:54:36.573660 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-pj8tk_dfe039e6-328a-476c-805f-7b90b0401bc0/kube-multus/0.log" Sep 17 07:54:36.677350 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:54:36.677324 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-mcwtb_e6c12e07-53e7-4f30-a8bf-c5d1a727d2fb/network-metrics-daemon/0.log" Sep 17 07:54:36.702303 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:54:36.702275 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-mcwtb_e6c12e07-53e7-4f30-a8bf-c5d1a727d2fb/kube-rbac-proxy/0.log" Sep 17 07:54:37.538434 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:54:37.538399 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2frz9_0b5240b1-13ea-4cee-b7f1-aa241ca58aa4/ovn-controller/0.log" Sep 17 07:54:37.591612 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:54:37.591563 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2frz9_0b5240b1-13ea-4cee-b7f1-aa241ca58aa4/ovn-acl-logging/0.log" Sep 17 07:54:37.591804 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:54:37.591686 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2frz9_0b5240b1-13ea-4cee-b7f1-aa241ca58aa4/ovn-acl-logging/1.log" Sep 17 07:54:37.685674 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:54:37.685638 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2frz9_0b5240b1-13ea-4cee-b7f1-aa241ca58aa4/kube-rbac-proxy-node/0.log" Sep 17 07:54:37.734052 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:54:37.734024 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2frz9_0b5240b1-13ea-4cee-b7f1-aa241ca58aa4/kube-rbac-proxy-ovn-metrics/0.log" Sep 17 07:54:37.799949 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:54:37.799867 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2frz9_0b5240b1-13ea-4cee-b7f1-aa241ca58aa4/northd/0.log" Sep 17 07:54:37.827523 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:54:37.827497 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2frz9_0b5240b1-13ea-4cee-b7f1-aa241ca58aa4/nbdb/0.log" Sep 17 07:54:37.852536 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:54:37.852513 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2frz9_0b5240b1-13ea-4cee-b7f1-aa241ca58aa4/sbdb/0.log" Sep 17 07:54:37.902512 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:54:37.902485 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2frz9_0b5240b1-13ea-4cee-b7f1-aa241ca58aa4/ovnkube-controller/0.log" Sep 17 07:54:39.398717 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:54:39.398685 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-diagnostics_network-check-target-qzfhn_ea653065-69b3-4da2-b8d0-9518964204d9/network-check-target-container/0.log" Sep 17 07:54:40.422129 ip-10-0-132-17 kubenswrapper[2561]: I0917 07:54:40.422096 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-operator_iptables-alerter-dp2bc_d0ad9040-c0ce-453f-813c-809ea9f53c56/iptables-alerter/0.log"