Sep 17 07:06:07.540749 ip-10-0-138-13 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory Sep 17 07:06:07.540761 ip-10-0-138-13 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory Sep 17 07:06:07.540769 ip-10-0-138-13 systemd[1]: kubelet.service: Failed with result 'resources'. Sep 17 07:06:07.540962 ip-10-0-138-13 systemd[1]: Failed to start Kubernetes Kubelet. Sep 17 07:06:17.617002 ip-10-0-138-13 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found. Sep 17 07:06:17.617024 ip-10-0-138-13 systemd[1]: kubelet.service: Failed with result 'resources'. -- Boot 30dcfc8896f843b18eaf1008d7b3153e -- Sep 17 07:08:11.050367 ip-10-0-138-13 systemd[1]: Starting Kubernetes Kubelet... Sep 17 07:08:11.401267 ip-10-0-138-13 kubenswrapper[2559]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Sep 17 07:08:11.401267 ip-10-0-138-13 kubenswrapper[2559]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Sep 17 07:08:11.401267 ip-10-0-138-13 kubenswrapper[2559]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Sep 17 07:08:11.401267 ip-10-0-138-13 kubenswrapper[2559]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Sep 17 07:08:11.401267 ip-10-0-138-13 kubenswrapper[2559]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Sep 17 07:08:11.402214 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:11.402129 2559 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Sep 17 07:08:11.407770 ip-10-0-138-13 kubenswrapper[2559]: W0917 07:08:11.407747 2559 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 17 07:08:11.407770 ip-10-0-138-13 kubenswrapper[2559]: W0917 07:08:11.407764 2559 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 17 07:08:11.407770 ip-10-0-138-13 kubenswrapper[2559]: W0917 07:08:11.407768 2559 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 17 07:08:11.407770 ip-10-0-138-13 kubenswrapper[2559]: W0917 07:08:11.407771 2559 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 17 07:08:11.407770 ip-10-0-138-13 kubenswrapper[2559]: W0917 07:08:11.407775 2559 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 17 07:08:11.407770 ip-10-0-138-13 kubenswrapper[2559]: W0917 07:08:11.407779 2559 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 17 07:08:11.407989 ip-10-0-138-13 kubenswrapper[2559]: W0917 07:08:11.407782 2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 17 07:08:11.407989 ip-10-0-138-13 kubenswrapper[2559]: W0917 07:08:11.407785 2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 17 07:08:11.407989 ip-10-0-138-13 kubenswrapper[2559]: W0917 07:08:11.407788 2559 feature_gate.go:328] unrecognized feature gate: Example2 Sep 17 07:08:11.407989 ip-10-0-138-13 kubenswrapper[2559]: W0917 07:08:11.407791 2559 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 17 07:08:11.407989 ip-10-0-138-13 kubenswrapper[2559]: W0917 07:08:11.407794 2559 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 17 07:08:11.407989 ip-10-0-138-13 kubenswrapper[2559]: W0917 07:08:11.407797 2559 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 17 07:08:11.407989 ip-10-0-138-13 kubenswrapper[2559]: W0917 07:08:11.407801 2559 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 17 07:08:11.407989 ip-10-0-138-13 kubenswrapper[2559]: W0917 07:08:11.407806 2559 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 17 07:08:11.407989 ip-10-0-138-13 kubenswrapper[2559]: W0917 07:08:11.407810 2559 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 17 07:08:11.407989 ip-10-0-138-13 kubenswrapper[2559]: W0917 07:08:11.407815 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 17 07:08:11.407989 ip-10-0-138-13 kubenswrapper[2559]: W0917 07:08:11.407820 2559 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 17 07:08:11.407989 ip-10-0-138-13 kubenswrapper[2559]: W0917 07:08:11.407824 2559 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 17 07:08:11.407989 ip-10-0-138-13 kubenswrapper[2559]: W0917 07:08:11.407827 2559 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 17 07:08:11.407989 ip-10-0-138-13 kubenswrapper[2559]: W0917 07:08:11.407830 2559 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 17 07:08:11.407989 ip-10-0-138-13 kubenswrapper[2559]: W0917 07:08:11.407833 2559 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 17 07:08:11.407989 ip-10-0-138-13 kubenswrapper[2559]: W0917 07:08:11.407836 2559 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 17 07:08:11.407989 ip-10-0-138-13 kubenswrapper[2559]: W0917 07:08:11.407838 2559 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 17 07:08:11.407989 ip-10-0-138-13 kubenswrapper[2559]: W0917 07:08:11.407841 2559 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 17 07:08:11.407989 ip-10-0-138-13 kubenswrapper[2559]: W0917 07:08:11.407844 2559 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 17 07:08:11.408457 ip-10-0-138-13 kubenswrapper[2559]: W0917 07:08:11.407846 2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 17 07:08:11.408457 ip-10-0-138-13 kubenswrapper[2559]: W0917 07:08:11.407853 2559 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 17 07:08:11.408457 ip-10-0-138-13 kubenswrapper[2559]: W0917 07:08:11.407857 2559 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 17 07:08:11.408457 ip-10-0-138-13 kubenswrapper[2559]: W0917 07:08:11.407860 2559 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 17 07:08:11.408457 ip-10-0-138-13 kubenswrapper[2559]: W0917 07:08:11.407863 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 17 07:08:11.408457 ip-10-0-138-13 kubenswrapper[2559]: W0917 07:08:11.407866 2559 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 17 07:08:11.408457 ip-10-0-138-13 kubenswrapper[2559]: W0917 07:08:11.407869 2559 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 17 07:08:11.408457 ip-10-0-138-13 kubenswrapper[2559]: W0917 07:08:11.407871 2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 17 07:08:11.408457 ip-10-0-138-13 kubenswrapper[2559]: W0917 07:08:11.407874 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 17 07:08:11.408457 ip-10-0-138-13 kubenswrapper[2559]: W0917 07:08:11.407876 2559 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 17 07:08:11.408457 ip-10-0-138-13 kubenswrapper[2559]: W0917 07:08:11.407879 2559 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 17 07:08:11.408457 ip-10-0-138-13 kubenswrapper[2559]: W0917 07:08:11.407881 2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 17 07:08:11.408457 ip-10-0-138-13 kubenswrapper[2559]: W0917 07:08:11.407884 2559 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 17 07:08:11.408457 ip-10-0-138-13 kubenswrapper[2559]: W0917 07:08:11.407887 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 17 07:08:11.408457 ip-10-0-138-13 kubenswrapper[2559]: W0917 07:08:11.407890 2559 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 17 07:08:11.408457 ip-10-0-138-13 kubenswrapper[2559]: W0917 07:08:11.407892 2559 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 17 07:08:11.408457 ip-10-0-138-13 kubenswrapper[2559]: W0917 07:08:11.407895 2559 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 17 07:08:11.408457 ip-10-0-138-13 kubenswrapper[2559]: W0917 07:08:11.407898 2559 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 17 07:08:11.408457 ip-10-0-138-13 kubenswrapper[2559]: W0917 07:08:11.407900 2559 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 17 07:08:11.408457 ip-10-0-138-13 kubenswrapper[2559]: W0917 07:08:11.407908 2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 17 07:08:11.408940 ip-10-0-138-13 kubenswrapper[2559]: W0917 07:08:11.407910 2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 17 07:08:11.408940 ip-10-0-138-13 kubenswrapper[2559]: W0917 07:08:11.407913 2559 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 17 07:08:11.408940 ip-10-0-138-13 kubenswrapper[2559]: W0917 07:08:11.407916 2559 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 17 07:08:11.408940 ip-10-0-138-13 kubenswrapper[2559]: W0917 07:08:11.407918 2559 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 17 07:08:11.408940 ip-10-0-138-13 kubenswrapper[2559]: W0917 07:08:11.407921 2559 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 17 07:08:11.408940 ip-10-0-138-13 kubenswrapper[2559]: W0917 07:08:11.407924 2559 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 17 07:08:11.408940 ip-10-0-138-13 kubenswrapper[2559]: W0917 07:08:11.407927 2559 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 17 07:08:11.408940 ip-10-0-138-13 kubenswrapper[2559]: W0917 07:08:11.407930 2559 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 17 07:08:11.408940 ip-10-0-138-13 kubenswrapper[2559]: W0917 07:08:11.407932 2559 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 17 07:08:11.408940 ip-10-0-138-13 kubenswrapper[2559]: W0917 07:08:11.407935 2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 17 07:08:11.408940 ip-10-0-138-13 kubenswrapper[2559]: W0917 07:08:11.407938 2559 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 17 07:08:11.408940 ip-10-0-138-13 kubenswrapper[2559]: W0917 07:08:11.407940 2559 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 17 07:08:11.408940 ip-10-0-138-13 kubenswrapper[2559]: W0917 07:08:11.407943 2559 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 17 07:08:11.408940 ip-10-0-138-13 kubenswrapper[2559]: W0917 07:08:11.407945 2559 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 17 07:08:11.408940 ip-10-0-138-13 kubenswrapper[2559]: W0917 07:08:11.407948 2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 17 07:08:11.408940 ip-10-0-138-13 kubenswrapper[2559]: W0917 07:08:11.407950 2559 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 17 07:08:11.408940 ip-10-0-138-13 kubenswrapper[2559]: W0917 07:08:11.407953 2559 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 17 07:08:11.408940 ip-10-0-138-13 kubenswrapper[2559]: W0917 07:08:11.407955 2559 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 17 07:08:11.408940 ip-10-0-138-13 kubenswrapper[2559]: W0917 07:08:11.407958 2559 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 17 07:08:11.408940 ip-10-0-138-13 kubenswrapper[2559]: W0917 07:08:11.407960 2559 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 17 07:08:11.409440 ip-10-0-138-13 kubenswrapper[2559]: W0917 07:08:11.407963 2559 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 17 07:08:11.409440 ip-10-0-138-13 kubenswrapper[2559]: W0917 07:08:11.407965 2559 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 17 07:08:11.409440 ip-10-0-138-13 kubenswrapper[2559]: W0917 07:08:11.407968 2559 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 17 07:08:11.409440 ip-10-0-138-13 kubenswrapper[2559]: W0917 07:08:11.407971 2559 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 17 07:08:11.409440 ip-10-0-138-13 kubenswrapper[2559]: W0917 07:08:11.407973 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 17 07:08:11.409440 ip-10-0-138-13 kubenswrapper[2559]: W0917 07:08:11.407977 2559 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 17 07:08:11.409440 ip-10-0-138-13 kubenswrapper[2559]: W0917 07:08:11.407983 2559 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 17 07:08:11.409440 ip-10-0-138-13 kubenswrapper[2559]: W0917 07:08:11.407986 2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 17 07:08:11.409440 ip-10-0-138-13 kubenswrapper[2559]: W0917 07:08:11.407989 2559 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 17 07:08:11.409440 ip-10-0-138-13 kubenswrapper[2559]: W0917 07:08:11.407991 2559 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 17 07:08:11.409440 ip-10-0-138-13 kubenswrapper[2559]: W0917 07:08:11.407994 2559 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 17 07:08:11.409440 ip-10-0-138-13 kubenswrapper[2559]: W0917 07:08:11.407997 2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 17 07:08:11.409440 ip-10-0-138-13 kubenswrapper[2559]: W0917 07:08:11.408000 2559 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 17 07:08:11.409440 ip-10-0-138-13 kubenswrapper[2559]: W0917 07:08:11.408003 2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 17 07:08:11.409440 ip-10-0-138-13 kubenswrapper[2559]: W0917 07:08:11.408006 2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 17 07:08:11.409440 ip-10-0-138-13 kubenswrapper[2559]: W0917 07:08:11.408008 2559 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 17 07:08:11.409440 ip-10-0-138-13 kubenswrapper[2559]: W0917 07:08:11.408011 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 17 07:08:11.409440 ip-10-0-138-13 kubenswrapper[2559]: W0917 07:08:11.408016 2559 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 17 07:08:11.409440 ip-10-0-138-13 kubenswrapper[2559]: W0917 07:08:11.408021 2559 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 17 07:08:11.410003 ip-10-0-138-13 kubenswrapper[2559]: W0917 07:08:11.408024 2559 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 17 07:08:11.410003 ip-10-0-138-13 kubenswrapper[2559]: W0917 07:08:11.408028 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 17 07:08:11.410003 ip-10-0-138-13 kubenswrapper[2559]: W0917 07:08:11.408031 2559 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 17 07:08:11.410003 ip-10-0-138-13 kubenswrapper[2559]: W0917 07:08:11.408034 2559 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 17 07:08:11.410003 ip-10-0-138-13 kubenswrapper[2559]: W0917 07:08:11.408037 2559 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 17 07:08:11.410003 ip-10-0-138-13 kubenswrapper[2559]: W0917 07:08:11.408040 2559 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 17 07:08:11.410003 ip-10-0-138-13 kubenswrapper[2559]: W0917 07:08:11.408043 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 17 07:08:11.410003 ip-10-0-138-13 kubenswrapper[2559]: W0917 07:08:11.408046 2559 feature_gate.go:328] unrecognized feature gate: Example Sep 17 07:08:11.410003 ip-10-0-138-13 kubenswrapper[2559]: W0917 07:08:11.408048 2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 17 07:08:11.410003 ip-10-0-138-13 kubenswrapper[2559]: W0917 07:08:11.408051 2559 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 17 07:08:11.410003 ip-10-0-138-13 kubenswrapper[2559]: W0917 07:08:11.408054 2559 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 17 07:08:11.410003 ip-10-0-138-13 kubenswrapper[2559]: W0917 07:08:11.408057 2559 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 17 07:08:11.410003 ip-10-0-138-13 kubenswrapper[2559]: W0917 07:08:11.408060 2559 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 17 07:08:11.410003 ip-10-0-138-13 kubenswrapper[2559]: W0917 07:08:11.408062 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 17 07:08:11.410003 ip-10-0-138-13 kubenswrapper[2559]: W0917 07:08:11.408065 2559 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 17 07:08:11.410003 ip-10-0-138-13 kubenswrapper[2559]: W0917 07:08:11.408771 2559 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 17 07:08:11.410003 ip-10-0-138-13 kubenswrapper[2559]: W0917 07:08:11.408777 2559 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 17 07:08:11.410003 ip-10-0-138-13 kubenswrapper[2559]: W0917 07:08:11.408780 2559 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 17 07:08:11.410003 ip-10-0-138-13 kubenswrapper[2559]: W0917 07:08:11.408784 2559 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 17 07:08:11.410510 ip-10-0-138-13 kubenswrapper[2559]: W0917 07:08:11.408788 2559 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 17 07:08:11.410510 ip-10-0-138-13 kubenswrapper[2559]: W0917 07:08:11.408792 2559 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 17 07:08:11.410510 ip-10-0-138-13 kubenswrapper[2559]: W0917 07:08:11.408794 2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 17 07:08:11.410510 ip-10-0-138-13 kubenswrapper[2559]: W0917 07:08:11.408797 2559 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 17 07:08:11.410510 ip-10-0-138-13 kubenswrapper[2559]: W0917 07:08:11.408800 2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 17 07:08:11.410510 ip-10-0-138-13 kubenswrapper[2559]: W0917 07:08:11.408802 2559 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 17 07:08:11.410510 ip-10-0-138-13 kubenswrapper[2559]: W0917 07:08:11.408805 2559 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 17 07:08:11.410510 ip-10-0-138-13 kubenswrapper[2559]: W0917 07:08:11.408808 2559 feature_gate.go:328] unrecognized feature gate: Example Sep 17 07:08:11.410510 ip-10-0-138-13 kubenswrapper[2559]: W0917 07:08:11.408810 2559 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 17 07:08:11.410510 ip-10-0-138-13 kubenswrapper[2559]: W0917 07:08:11.408813 2559 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 17 07:08:11.410510 ip-10-0-138-13 kubenswrapper[2559]: W0917 07:08:11.408816 2559 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 17 07:08:11.410510 ip-10-0-138-13 kubenswrapper[2559]: W0917 07:08:11.408819 2559 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 17 07:08:11.410510 ip-10-0-138-13 kubenswrapper[2559]: W0917 07:08:11.408821 2559 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 17 07:08:11.410510 ip-10-0-138-13 kubenswrapper[2559]: W0917 07:08:11.408825 2559 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 17 07:08:11.410510 ip-10-0-138-13 kubenswrapper[2559]: W0917 07:08:11.408827 2559 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 17 07:08:11.410510 ip-10-0-138-13 kubenswrapper[2559]: W0917 07:08:11.408830 2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 17 07:08:11.410510 ip-10-0-138-13 kubenswrapper[2559]: W0917 07:08:11.408833 2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 17 07:08:11.410510 ip-10-0-138-13 kubenswrapper[2559]: W0917 07:08:11.408835 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 17 07:08:11.410510 ip-10-0-138-13 kubenswrapper[2559]: W0917 07:08:11.408838 2559 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 17 07:08:11.410510 ip-10-0-138-13 kubenswrapper[2559]: W0917 07:08:11.408840 2559 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 17 07:08:11.411012 ip-10-0-138-13 kubenswrapper[2559]: W0917 07:08:11.408843 2559 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 17 07:08:11.411012 ip-10-0-138-13 kubenswrapper[2559]: W0917 07:08:11.408845 2559 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 17 07:08:11.411012 ip-10-0-138-13 kubenswrapper[2559]: W0917 07:08:11.408848 2559 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 17 07:08:11.411012 ip-10-0-138-13 kubenswrapper[2559]: W0917 07:08:11.408851 2559 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 17 07:08:11.411012 ip-10-0-138-13 kubenswrapper[2559]: W0917 07:08:11.408853 2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 17 07:08:11.411012 ip-10-0-138-13 kubenswrapper[2559]: W0917 07:08:11.408856 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 17 07:08:11.411012 ip-10-0-138-13 kubenswrapper[2559]: W0917 07:08:11.408858 2559 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 17 07:08:11.411012 ip-10-0-138-13 kubenswrapper[2559]: W0917 07:08:11.408861 2559 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 17 07:08:11.411012 ip-10-0-138-13 kubenswrapper[2559]: W0917 07:08:11.408863 2559 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 17 07:08:11.411012 ip-10-0-138-13 kubenswrapper[2559]: W0917 07:08:11.408866 2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 17 07:08:11.411012 ip-10-0-138-13 kubenswrapper[2559]: W0917 07:08:11.408868 2559 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 17 07:08:11.411012 ip-10-0-138-13 kubenswrapper[2559]: W0917 07:08:11.408871 2559 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 17 07:08:11.411012 ip-10-0-138-13 kubenswrapper[2559]: W0917 07:08:11.408874 2559 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 17 07:08:11.411012 ip-10-0-138-13 kubenswrapper[2559]: W0917 07:08:11.408877 2559 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 17 07:08:11.411012 ip-10-0-138-13 kubenswrapper[2559]: W0917 07:08:11.408880 2559 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 17 07:08:11.411012 ip-10-0-138-13 kubenswrapper[2559]: W0917 07:08:11.408882 2559 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 17 07:08:11.411012 ip-10-0-138-13 kubenswrapper[2559]: W0917 07:08:11.408885 2559 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 17 07:08:11.411012 ip-10-0-138-13 kubenswrapper[2559]: W0917 07:08:11.408887 2559 feature_gate.go:328] unrecognized feature gate: Example2 Sep 17 07:08:11.411012 ip-10-0-138-13 kubenswrapper[2559]: W0917 07:08:11.408890 2559 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 17 07:08:11.411012 ip-10-0-138-13 kubenswrapper[2559]: W0917 07:08:11.408892 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 17 07:08:11.411529 ip-10-0-138-13 kubenswrapper[2559]: W0917 07:08:11.408895 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 17 07:08:11.411529 ip-10-0-138-13 kubenswrapper[2559]: W0917 07:08:11.408897 2559 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 17 07:08:11.411529 ip-10-0-138-13 kubenswrapper[2559]: W0917 07:08:11.408900 2559 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 17 07:08:11.411529 ip-10-0-138-13 kubenswrapper[2559]: W0917 07:08:11.408902 2559 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 17 07:08:11.411529 ip-10-0-138-13 kubenswrapper[2559]: W0917 07:08:11.408905 2559 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 17 07:08:11.411529 ip-10-0-138-13 kubenswrapper[2559]: W0917 07:08:11.408907 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 17 07:08:11.411529 ip-10-0-138-13 kubenswrapper[2559]: W0917 07:08:11.408910 2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 17 07:08:11.411529 ip-10-0-138-13 kubenswrapper[2559]: W0917 07:08:11.408913 2559 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 17 07:08:11.411529 ip-10-0-138-13 kubenswrapper[2559]: W0917 07:08:11.408915 2559 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 17 07:08:11.411529 ip-10-0-138-13 kubenswrapper[2559]: W0917 07:08:11.408919 2559 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 17 07:08:11.411529 ip-10-0-138-13 kubenswrapper[2559]: W0917 07:08:11.408923 2559 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 17 07:08:11.411529 ip-10-0-138-13 kubenswrapper[2559]: W0917 07:08:11.408925 2559 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 17 07:08:11.411529 ip-10-0-138-13 kubenswrapper[2559]: W0917 07:08:11.408928 2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 17 07:08:11.411529 ip-10-0-138-13 kubenswrapper[2559]: W0917 07:08:11.408931 2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 17 07:08:11.411529 ip-10-0-138-13 kubenswrapper[2559]: W0917 07:08:11.408933 2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 17 07:08:11.411529 ip-10-0-138-13 kubenswrapper[2559]: W0917 07:08:11.408936 2559 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 17 07:08:11.411529 ip-10-0-138-13 kubenswrapper[2559]: W0917 07:08:11.408938 2559 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 17 07:08:11.411529 ip-10-0-138-13 kubenswrapper[2559]: W0917 07:08:11.408941 2559 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 17 07:08:11.411529 ip-10-0-138-13 kubenswrapper[2559]: W0917 07:08:11.408943 2559 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 17 07:08:11.411529 ip-10-0-138-13 kubenswrapper[2559]: W0917 07:08:11.408946 2559 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 17 07:08:11.412037 ip-10-0-138-13 kubenswrapper[2559]: W0917 07:08:11.408949 2559 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 17 07:08:11.412037 ip-10-0-138-13 kubenswrapper[2559]: W0917 07:08:11.408953 2559 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 17 07:08:11.412037 ip-10-0-138-13 kubenswrapper[2559]: W0917 07:08:11.408956 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 17 07:08:11.412037 ip-10-0-138-13 kubenswrapper[2559]: W0917 07:08:11.408960 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 17 07:08:11.412037 ip-10-0-138-13 kubenswrapper[2559]: W0917 07:08:11.408964 2559 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 17 07:08:11.412037 ip-10-0-138-13 kubenswrapper[2559]: W0917 07:08:11.408967 2559 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 17 07:08:11.412037 ip-10-0-138-13 kubenswrapper[2559]: W0917 07:08:11.408970 2559 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 17 07:08:11.412037 ip-10-0-138-13 kubenswrapper[2559]: W0917 07:08:11.408972 2559 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 17 07:08:11.412037 ip-10-0-138-13 kubenswrapper[2559]: W0917 07:08:11.408975 2559 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 17 07:08:11.412037 ip-10-0-138-13 kubenswrapper[2559]: W0917 07:08:11.408978 2559 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 17 07:08:11.412037 ip-10-0-138-13 kubenswrapper[2559]: W0917 07:08:11.408980 2559 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 17 07:08:11.412037 ip-10-0-138-13 kubenswrapper[2559]: W0917 07:08:11.408983 2559 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 17 07:08:11.412037 ip-10-0-138-13 kubenswrapper[2559]: W0917 07:08:11.408986 2559 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 17 07:08:11.412037 ip-10-0-138-13 kubenswrapper[2559]: W0917 07:08:11.408989 2559 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 17 07:08:11.412037 ip-10-0-138-13 kubenswrapper[2559]: W0917 07:08:11.408991 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 17 07:08:11.412037 ip-10-0-138-13 kubenswrapper[2559]: W0917 07:08:11.408993 2559 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 17 07:08:11.412037 ip-10-0-138-13 kubenswrapper[2559]: W0917 07:08:11.408996 2559 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 17 07:08:11.412037 ip-10-0-138-13 kubenswrapper[2559]: W0917 07:08:11.408999 2559 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 17 07:08:11.412037 ip-10-0-138-13 kubenswrapper[2559]: W0917 07:08:11.409001 2559 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 17 07:08:11.412037 ip-10-0-138-13 kubenswrapper[2559]: W0917 07:08:11.409005 2559 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 17 07:08:11.412541 ip-10-0-138-13 kubenswrapper[2559]: W0917 07:08:11.409007 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 17 07:08:11.412541 ip-10-0-138-13 kubenswrapper[2559]: W0917 07:08:11.409010 2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 17 07:08:11.412541 ip-10-0-138-13 kubenswrapper[2559]: W0917 07:08:11.409012 2559 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 17 07:08:11.412541 ip-10-0-138-13 kubenswrapper[2559]: W0917 07:08:11.409015 2559 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 17 07:08:11.412541 ip-10-0-138-13 kubenswrapper[2559]: W0917 07:08:11.409018 2559 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 17 07:08:11.412541 ip-10-0-138-13 kubenswrapper[2559]: W0917 07:08:11.409020 2559 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 17 07:08:11.412541 ip-10-0-138-13 kubenswrapper[2559]: W0917 07:08:11.409022 2559 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 17 07:08:11.412541 ip-10-0-138-13 kubenswrapper[2559]: W0917 07:08:11.409026 2559 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 17 07:08:11.412541 ip-10-0-138-13 kubenswrapper[2559]: W0917 07:08:11.409029 2559 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 17 07:08:11.412541 ip-10-0-138-13 kubenswrapper[2559]: W0917 07:08:11.409033 2559 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 17 07:08:11.412541 ip-10-0-138-13 kubenswrapper[2559]: W0917 07:08:11.409036 2559 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 17 07:08:11.412541 ip-10-0-138-13 kubenswrapper[2559]: W0917 07:08:11.409039 2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 17 07:08:11.412541 ip-10-0-138-13 kubenswrapper[2559]: W0917 07:08:11.409042 2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 17 07:08:11.412541 ip-10-0-138-13 kubenswrapper[2559]: W0917 07:08:11.409044 2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 17 07:08:11.412541 ip-10-0-138-13 kubenswrapper[2559]: W0917 07:08:11.409047 2559 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 17 07:08:11.412541 ip-10-0-138-13 kubenswrapper[2559]: W0917 07:08:11.409447 2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 17 07:08:11.412541 ip-10-0-138-13 kubenswrapper[2559]: W0917 07:08:11.409453 2559 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 17 07:08:11.412541 ip-10-0-138-13 kubenswrapper[2559]: W0917 07:08:11.409457 2559 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 17 07:08:11.412541 ip-10-0-138-13 kubenswrapper[2559]: W0917 07:08:11.409460 2559 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 17 07:08:11.413001 ip-10-0-138-13 kubenswrapper[2559]: W0917 07:08:11.409462 2559 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 17 07:08:11.413001 ip-10-0-138-13 kubenswrapper[2559]: W0917 07:08:11.409465 2559 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 17 07:08:11.413001 ip-10-0-138-13 kubenswrapper[2559]: W0917 07:08:11.409469 2559 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 17 07:08:11.413001 ip-10-0-138-13 kubenswrapper[2559]: W0917 07:08:11.409474 2559 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 17 07:08:11.413001 ip-10-0-138-13 kubenswrapper[2559]: W0917 07:08:11.409478 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 17 07:08:11.413001 ip-10-0-138-13 kubenswrapper[2559]: W0917 07:08:11.409482 2559 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 17 07:08:11.413001 ip-10-0-138-13 kubenswrapper[2559]: W0917 07:08:11.409485 2559 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 17 07:08:11.413001 ip-10-0-138-13 kubenswrapper[2559]: W0917 07:08:11.409488 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 17 07:08:11.413001 ip-10-0-138-13 kubenswrapper[2559]: W0917 07:08:11.409490 2559 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 17 07:08:11.413001 ip-10-0-138-13 kubenswrapper[2559]: W0917 07:08:11.409493 2559 feature_gate.go:328] unrecognized feature gate: Example2 Sep 17 07:08:11.413001 ip-10-0-138-13 kubenswrapper[2559]: W0917 07:08:11.409495 2559 feature_gate.go:328] unrecognized feature gate: Example Sep 17 07:08:11.413001 ip-10-0-138-13 kubenswrapper[2559]: W0917 07:08:11.409498 2559 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 17 07:08:11.413001 ip-10-0-138-13 kubenswrapper[2559]: W0917 07:08:11.409501 2559 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 17 07:08:11.413001 ip-10-0-138-13 kubenswrapper[2559]: W0917 07:08:11.409505 2559 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 17 07:08:11.413001 ip-10-0-138-13 kubenswrapper[2559]: W0917 07:08:11.409507 2559 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 17 07:08:11.413001 ip-10-0-138-13 kubenswrapper[2559]: W0917 07:08:11.409510 2559 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 17 07:08:11.413001 ip-10-0-138-13 kubenswrapper[2559]: W0917 07:08:11.409512 2559 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 17 07:08:11.413001 ip-10-0-138-13 kubenswrapper[2559]: W0917 07:08:11.409515 2559 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 17 07:08:11.413001 ip-10-0-138-13 kubenswrapper[2559]: W0917 07:08:11.409517 2559 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 17 07:08:11.413488 ip-10-0-138-13 kubenswrapper[2559]: W0917 07:08:11.409520 2559 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 17 07:08:11.413488 ip-10-0-138-13 kubenswrapper[2559]: W0917 07:08:11.409523 2559 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 17 07:08:11.413488 ip-10-0-138-13 kubenswrapper[2559]: W0917 07:08:11.409525 2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 17 07:08:11.413488 ip-10-0-138-13 kubenswrapper[2559]: W0917 07:08:11.409528 2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 17 07:08:11.413488 ip-10-0-138-13 kubenswrapper[2559]: W0917 07:08:11.409531 2559 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 17 07:08:11.413488 ip-10-0-138-13 kubenswrapper[2559]: W0917 07:08:11.409533 2559 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 17 07:08:11.413488 ip-10-0-138-13 kubenswrapper[2559]: W0917 07:08:11.409536 2559 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 17 07:08:11.413488 ip-10-0-138-13 kubenswrapper[2559]: W0917 07:08:11.409540 2559 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 17 07:08:11.413488 ip-10-0-138-13 kubenswrapper[2559]: W0917 07:08:11.409543 2559 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 17 07:08:11.413488 ip-10-0-138-13 kubenswrapper[2559]: W0917 07:08:11.409547 2559 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 17 07:08:11.413488 ip-10-0-138-13 kubenswrapper[2559]: W0917 07:08:11.409550 2559 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 17 07:08:11.413488 ip-10-0-138-13 kubenswrapper[2559]: W0917 07:08:11.409553 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 17 07:08:11.413488 ip-10-0-138-13 kubenswrapper[2559]: W0917 07:08:11.409556 2559 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 17 07:08:11.413488 ip-10-0-138-13 kubenswrapper[2559]: W0917 07:08:11.409559 2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 17 07:08:11.413488 ip-10-0-138-13 kubenswrapper[2559]: W0917 07:08:11.409562 2559 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 17 07:08:11.413488 ip-10-0-138-13 kubenswrapper[2559]: W0917 07:08:11.409564 2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 17 07:08:11.413488 ip-10-0-138-13 kubenswrapper[2559]: W0917 07:08:11.409567 2559 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 17 07:08:11.413488 ip-10-0-138-13 kubenswrapper[2559]: W0917 07:08:11.409569 2559 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 17 07:08:11.413488 ip-10-0-138-13 kubenswrapper[2559]: W0917 07:08:11.409572 2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 17 07:08:11.413963 ip-10-0-138-13 kubenswrapper[2559]: W0917 07:08:11.409575 2559 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 17 07:08:11.413963 ip-10-0-138-13 kubenswrapper[2559]: W0917 07:08:11.409578 2559 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 17 07:08:11.413963 ip-10-0-138-13 kubenswrapper[2559]: W0917 07:08:11.409580 2559 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 17 07:08:11.413963 ip-10-0-138-13 kubenswrapper[2559]: W0917 07:08:11.409583 2559 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 17 07:08:11.413963 ip-10-0-138-13 kubenswrapper[2559]: W0917 07:08:11.409585 2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 17 07:08:11.413963 ip-10-0-138-13 kubenswrapper[2559]: W0917 07:08:11.409588 2559 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 17 07:08:11.413963 ip-10-0-138-13 kubenswrapper[2559]: W0917 07:08:11.409591 2559 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 17 07:08:11.413963 ip-10-0-138-13 kubenswrapper[2559]: W0917 07:08:11.409594 2559 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 17 07:08:11.413963 ip-10-0-138-13 kubenswrapper[2559]: W0917 07:08:11.409596 2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 17 07:08:11.413963 ip-10-0-138-13 kubenswrapper[2559]: W0917 07:08:11.409601 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 17 07:08:11.413963 ip-10-0-138-13 kubenswrapper[2559]: W0917 07:08:11.409604 2559 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 17 07:08:11.413963 ip-10-0-138-13 kubenswrapper[2559]: W0917 07:08:11.409606 2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 17 07:08:11.413963 ip-10-0-138-13 kubenswrapper[2559]: W0917 07:08:11.409609 2559 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 17 07:08:11.413963 ip-10-0-138-13 kubenswrapper[2559]: W0917 07:08:11.409612 2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 17 07:08:11.413963 ip-10-0-138-13 kubenswrapper[2559]: W0917 07:08:11.409615 2559 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 17 07:08:11.413963 ip-10-0-138-13 kubenswrapper[2559]: W0917 07:08:11.409617 2559 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 17 07:08:11.413963 ip-10-0-138-13 kubenswrapper[2559]: W0917 07:08:11.409620 2559 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 17 07:08:11.413963 ip-10-0-138-13 kubenswrapper[2559]: W0917 07:08:11.409622 2559 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 17 07:08:11.413963 ip-10-0-138-13 kubenswrapper[2559]: W0917 07:08:11.409625 2559 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 17 07:08:11.414439 ip-10-0-138-13 kubenswrapper[2559]: W0917 07:08:11.409627 2559 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 17 07:08:11.414439 ip-10-0-138-13 kubenswrapper[2559]: W0917 07:08:11.409630 2559 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 17 07:08:11.414439 ip-10-0-138-13 kubenswrapper[2559]: W0917 07:08:11.409633 2559 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 17 07:08:11.414439 ip-10-0-138-13 kubenswrapper[2559]: W0917 07:08:11.409635 2559 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 17 07:08:11.414439 ip-10-0-138-13 kubenswrapper[2559]: W0917 07:08:11.409638 2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 17 07:08:11.414439 ip-10-0-138-13 kubenswrapper[2559]: W0917 07:08:11.409641 2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 17 07:08:11.414439 ip-10-0-138-13 kubenswrapper[2559]: W0917 07:08:11.409644 2559 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 17 07:08:11.414439 ip-10-0-138-13 kubenswrapper[2559]: W0917 07:08:11.409646 2559 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 17 07:08:11.414439 ip-10-0-138-13 kubenswrapper[2559]: W0917 07:08:11.409649 2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 17 07:08:11.414439 ip-10-0-138-13 kubenswrapper[2559]: W0917 07:08:11.409653 2559 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 17 07:08:11.414439 ip-10-0-138-13 kubenswrapper[2559]: W0917 07:08:11.409656 2559 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 17 07:08:11.414439 ip-10-0-138-13 kubenswrapper[2559]: W0917 07:08:11.409658 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 17 07:08:11.414439 ip-10-0-138-13 kubenswrapper[2559]: W0917 07:08:11.409661 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 17 07:08:11.414439 ip-10-0-138-13 kubenswrapper[2559]: W0917 07:08:11.409663 2559 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 17 07:08:11.414439 ip-10-0-138-13 kubenswrapper[2559]: W0917 07:08:11.409666 2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 17 07:08:11.414439 ip-10-0-138-13 kubenswrapper[2559]: W0917 07:08:11.409668 2559 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 17 07:08:11.414439 ip-10-0-138-13 kubenswrapper[2559]: W0917 07:08:11.409671 2559 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 17 07:08:11.414439 ip-10-0-138-13 kubenswrapper[2559]: W0917 07:08:11.409674 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 17 07:08:11.414439 ip-10-0-138-13 kubenswrapper[2559]: W0917 07:08:11.409676 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 17 07:08:11.414439 ip-10-0-138-13 kubenswrapper[2559]: W0917 07:08:11.409679 2559 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 17 07:08:11.414917 ip-10-0-138-13 kubenswrapper[2559]: W0917 07:08:11.409681 2559 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 17 07:08:11.414917 ip-10-0-138-13 kubenswrapper[2559]: W0917 07:08:11.409684 2559 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 17 07:08:11.414917 ip-10-0-138-13 kubenswrapper[2559]: W0917 07:08:11.409689 2559 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 17 07:08:11.414917 ip-10-0-138-13 kubenswrapper[2559]: W0917 07:08:11.409691 2559 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 17 07:08:11.414917 ip-10-0-138-13 kubenswrapper[2559]: W0917 07:08:11.409694 2559 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 17 07:08:11.414917 ip-10-0-138-13 kubenswrapper[2559]: W0917 07:08:11.409696 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 17 07:08:11.414917 ip-10-0-138-13 kubenswrapper[2559]: W0917 07:08:11.409699 2559 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 17 07:08:11.414917 ip-10-0-138-13 kubenswrapper[2559]: W0917 07:08:11.409702 2559 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 17 07:08:11.414917 ip-10-0-138-13 kubenswrapper[2559]: W0917 07:08:11.409704 2559 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 17 07:08:11.414917 ip-10-0-138-13 kubenswrapper[2559]: W0917 07:08:11.409707 2559 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 17 07:08:11.414917 ip-10-0-138-13 kubenswrapper[2559]: W0917 07:08:11.409709 2559 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 17 07:08:11.414917 ip-10-0-138-13 kubenswrapper[2559]: W0917 07:08:11.409712 2559 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 17 07:08:11.414917 ip-10-0-138-13 kubenswrapper[2559]: W0917 07:08:11.409714 2559 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 17 07:08:11.414917 ip-10-0-138-13 kubenswrapper[2559]: W0917 07:08:11.409717 2559 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 17 07:08:11.414917 ip-10-0-138-13 kubenswrapper[2559]: W0917 07:08:11.409720 2559 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 17 07:08:11.414917 ip-10-0-138-13 kubenswrapper[2559]: W0917 07:08:11.409722 2559 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 17 07:08:11.414917 ip-10-0-138-13 kubenswrapper[2559]: W0917 07:08:11.409725 2559 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 17 07:08:11.414917 ip-10-0-138-13 kubenswrapper[2559]: W0917 07:08:11.409728 2559 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 17 07:08:11.414917 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:11.409802 2559 flags.go:64] FLAG: --address="0.0.0.0" Sep 17 07:08:11.414917 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:11.409853 2559 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Sep 17 07:08:11.415448 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:11.409861 2559 flags.go:64] FLAG: --anonymous-auth="true" Sep 17 07:08:11.415448 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:11.409866 2559 flags.go:64] FLAG: --application-metrics-count-limit="100" Sep 17 07:08:11.415448 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:11.409870 2559 flags.go:64] FLAG: --authentication-token-webhook="false" Sep 17 07:08:11.415448 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:11.409873 2559 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Sep 17 07:08:11.415448 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:11.409877 2559 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Sep 17 07:08:11.415448 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:11.409882 2559 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Sep 17 07:08:11.415448 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:11.409885 2559 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Sep 17 07:08:11.415448 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:11.409888 2559 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Sep 17 07:08:11.415448 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:11.409891 2559 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Sep 17 07:08:11.415448 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:11.409894 2559 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Sep 17 07:08:11.415448 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:11.409898 2559 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Sep 17 07:08:11.415448 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:11.409901 2559 flags.go:64] FLAG: --cgroup-root="" Sep 17 07:08:11.415448 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:11.409904 2559 flags.go:64] FLAG: --cgroups-per-qos="true" Sep 17 07:08:11.415448 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:11.409907 2559 flags.go:64] FLAG: --client-ca-file="" Sep 17 07:08:11.415448 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:11.409912 2559 flags.go:64] FLAG: --cloud-provider="external" Sep 17 07:08:11.415448 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:11.409915 2559 flags.go:64] FLAG: --cluster-dns="[]" Sep 17 07:08:11.415448 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:11.409919 2559 flags.go:64] FLAG: --cluster-domain="" Sep 17 07:08:11.415448 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:11.409922 2559 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Sep 17 07:08:11.415448 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:11.409925 2559 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Sep 17 07:08:11.415448 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:11.409928 2559 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Sep 17 07:08:11.415448 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:11.409932 2559 flags.go:64] FLAG: --container-log-max-files="5" Sep 17 07:08:11.415448 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:11.409935 2559 flags.go:64] FLAG: --container-log-max-size="10Mi" Sep 17 07:08:11.415448 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:11.409938 2559 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Sep 17 07:08:11.416046 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:11.409941 2559 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Sep 17 07:08:11.416046 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:11.409945 2559 flags.go:64] FLAG: --containerd-namespace="k8s.io" Sep 17 07:08:11.416046 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:11.409948 2559 flags.go:64] FLAG: --contention-profiling="false" Sep 17 07:08:11.416046 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:11.409951 2559 flags.go:64] FLAG: --cpu-cfs-quota="true" Sep 17 07:08:11.416046 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:11.409954 2559 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Sep 17 07:08:11.416046 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:11.409957 2559 flags.go:64] FLAG: --cpu-manager-policy="none" Sep 17 07:08:11.416046 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:11.409960 2559 flags.go:64] FLAG: --cpu-manager-policy-options="" Sep 17 07:08:11.416046 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:11.409964 2559 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Sep 17 07:08:11.416046 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:11.409967 2559 flags.go:64] FLAG: --enable-controller-attach-detach="true" Sep 17 07:08:11.416046 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:11.409970 2559 flags.go:64] FLAG: --enable-debugging-handlers="true" Sep 17 07:08:11.416046 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:11.409973 2559 flags.go:64] FLAG: --enable-load-reader="false" Sep 17 07:08:11.416046 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:11.409976 2559 flags.go:64] FLAG: --enable-server="true" Sep 17 07:08:11.416046 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:11.409979 2559 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Sep 17 07:08:11.416046 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:11.409984 2559 flags.go:64] FLAG: --event-burst="100" Sep 17 07:08:11.416046 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:11.409987 2559 flags.go:64] FLAG: --event-qps="50" Sep 17 07:08:11.416046 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:11.409990 2559 flags.go:64] FLAG: --event-storage-age-limit="default=0" Sep 17 07:08:11.416046 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:11.409993 2559 flags.go:64] FLAG: --event-storage-event-limit="default=0" Sep 17 07:08:11.416046 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:11.409996 2559 flags.go:64] FLAG: --eviction-hard="" Sep 17 07:08:11.416046 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:11.409999 2559 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Sep 17 07:08:11.416046 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:11.410002 2559 flags.go:64] FLAG: --eviction-minimum-reclaim="" Sep 17 07:08:11.416046 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:11.410006 2559 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Sep 17 07:08:11.416046 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:11.410009 2559 flags.go:64] FLAG: --eviction-soft="" Sep 17 07:08:11.416046 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:11.410012 2559 flags.go:64] FLAG: --eviction-soft-grace-period="" Sep 17 07:08:11.416046 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:11.410016 2559 flags.go:64] FLAG: --exit-on-lock-contention="false" Sep 17 07:08:11.416046 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:11.410020 2559 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Sep 17 07:08:11.416696 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:11.410023 2559 flags.go:64] FLAG: --experimental-mounter-path="" Sep 17 07:08:11.416696 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:11.410026 2559 flags.go:64] FLAG: --fail-cgroupv1="false" Sep 17 07:08:11.416696 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:11.410029 2559 flags.go:64] FLAG: --fail-swap-on="true" Sep 17 07:08:11.416696 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:11.410032 2559 flags.go:64] FLAG: --feature-gates="" Sep 17 07:08:11.416696 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:11.410036 2559 flags.go:64] FLAG: --file-check-frequency="20s" Sep 17 07:08:11.416696 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:11.410039 2559 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Sep 17 07:08:11.416696 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:11.410042 2559 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Sep 17 07:08:11.416696 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:11.410045 2559 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Sep 17 07:08:11.416696 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:11.410048 2559 flags.go:64] FLAG: --healthz-port="10248" Sep 17 07:08:11.416696 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:11.410052 2559 flags.go:64] FLAG: --help="false" Sep 17 07:08:11.416696 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:11.410055 2559 flags.go:64] FLAG: --hostname-override="ip-10-0-138-13.ec2.internal" Sep 17 07:08:11.416696 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:11.410059 2559 flags.go:64] FLAG: --housekeeping-interval="10s" Sep 17 07:08:11.416696 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:11.410062 2559 flags.go:64] FLAG: --http-check-frequency="20s" Sep 17 07:08:11.416696 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:11.410065 2559 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Sep 17 07:08:11.416696 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:11.410069 2559 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Sep 17 07:08:11.416696 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:11.410072 2559 flags.go:64] FLAG: --image-gc-high-threshold="85" Sep 17 07:08:11.416696 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:11.410075 2559 flags.go:64] FLAG: --image-gc-low-threshold="80" Sep 17 07:08:11.416696 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:11.410078 2559 flags.go:64] FLAG: --image-service-endpoint="" Sep 17 07:08:11.416696 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:11.410081 2559 flags.go:64] FLAG: --kernel-memcg-notification="false" Sep 17 07:08:11.416696 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:11.410083 2559 flags.go:64] FLAG: --kube-api-burst="100" Sep 17 07:08:11.416696 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:11.410086 2559 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Sep 17 07:08:11.416696 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:11.410089 2559 flags.go:64] FLAG: --kube-api-qps="50" Sep 17 07:08:11.416696 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:11.410092 2559 flags.go:64] FLAG: --kube-reserved="" Sep 17 07:08:11.416696 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:11.410095 2559 flags.go:64] FLAG: --kube-reserved-cgroup="" Sep 17 07:08:11.417293 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:11.410098 2559 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Sep 17 07:08:11.417293 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:11.410114 2559 flags.go:64] FLAG: --kubelet-cgroups="" Sep 17 07:08:11.417293 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:11.410120 2559 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Sep 17 07:08:11.417293 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:11.410124 2559 flags.go:64] FLAG: --lock-file="" Sep 17 07:08:11.417293 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:11.410127 2559 flags.go:64] FLAG: --log-cadvisor-usage="false" Sep 17 07:08:11.417293 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:11.410130 2559 flags.go:64] FLAG: --log-flush-frequency="5s" Sep 17 07:08:11.417293 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:11.410134 2559 flags.go:64] FLAG: --log-json-info-buffer-size="0" Sep 17 07:08:11.417293 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:11.410139 2559 flags.go:64] FLAG: --log-json-split-stream="false" Sep 17 07:08:11.417293 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:11.410147 2559 flags.go:64] FLAG: --log-text-info-buffer-size="0" Sep 17 07:08:11.417293 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:11.410150 2559 flags.go:64] FLAG: --log-text-split-stream="false" Sep 17 07:08:11.417293 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:11.410153 2559 flags.go:64] FLAG: --logging-format="text" Sep 17 07:08:11.417293 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:11.410156 2559 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Sep 17 07:08:11.417293 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:11.410159 2559 flags.go:64] FLAG: --make-iptables-util-chains="true" Sep 17 07:08:11.417293 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:11.410162 2559 flags.go:64] FLAG: --manifest-url="" Sep 17 07:08:11.417293 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:11.410165 2559 flags.go:64] FLAG: --manifest-url-header="" Sep 17 07:08:11.417293 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:11.410170 2559 flags.go:64] FLAG: --max-housekeeping-interval="15s" Sep 17 07:08:11.417293 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:11.410173 2559 flags.go:64] FLAG: --max-open-files="1000000" Sep 17 07:08:11.417293 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:11.410177 2559 flags.go:64] FLAG: --max-pods="110" Sep 17 07:08:11.417293 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:11.410183 2559 flags.go:64] FLAG: --maximum-dead-containers="-1" Sep 17 07:08:11.417293 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:11.410186 2559 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Sep 17 07:08:11.417293 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:11.410188 2559 flags.go:64] FLAG: --memory-manager-policy="None" Sep 17 07:08:11.417293 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:11.410192 2559 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Sep 17 07:08:11.417293 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:11.410194 2559 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Sep 17 07:08:11.417293 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:11.410197 2559 flags.go:64] FLAG: --node-ip="0.0.0.0" Sep 17 07:08:11.417293 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:11.410200 2559 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Sep 17 07:08:11.417916 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:11.410208 2559 flags.go:64] FLAG: --node-status-max-images="50" Sep 17 07:08:11.417916 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:11.410212 2559 flags.go:64] FLAG: --node-status-update-frequency="10s" Sep 17 07:08:11.417916 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:11.410215 2559 flags.go:64] FLAG: --oom-score-adj="-999" Sep 17 07:08:11.417916 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:11.410217 2559 flags.go:64] FLAG: --pod-cidr="" Sep 17 07:08:11.417916 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:11.410220 2559 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:eee392dbe3ac2ed4a38bca29ae3bd486f5b7780406c62c600154cd1906871b10" Sep 17 07:08:11.417916 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:11.410225 2559 flags.go:64] FLAG: --pod-manifest-path="" Sep 17 07:08:11.417916 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:11.410228 2559 flags.go:64] FLAG: --pod-max-pids="-1" Sep 17 07:08:11.417916 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:11.410231 2559 flags.go:64] FLAG: --pods-per-core="0" Sep 17 07:08:11.417916 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:11.410234 2559 flags.go:64] FLAG: --port="10250" Sep 17 07:08:11.417916 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:11.410237 2559 flags.go:64] FLAG: --protect-kernel-defaults="false" Sep 17 07:08:11.417916 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:11.410240 2559 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0866d3d54af0a3d40" Sep 17 07:08:11.417916 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:11.410243 2559 flags.go:64] FLAG: --qos-reserved="" Sep 17 07:08:11.417916 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:11.410246 2559 flags.go:64] FLAG: --read-only-port="10255" Sep 17 07:08:11.417916 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:11.410249 2559 flags.go:64] FLAG: --register-node="true" Sep 17 07:08:11.417916 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:11.410252 2559 flags.go:64] FLAG: --register-with-taints="" Sep 17 07:08:11.417916 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:11.410263 2559 flags.go:64] FLAG: --registry-burst="10" Sep 17 07:08:11.417916 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:11.410266 2559 flags.go:64] FLAG: --registry-qps="5" Sep 17 07:08:11.417916 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:11.410269 2559 flags.go:64] FLAG: --reserved-cpus="" Sep 17 07:08:11.417916 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:11.410272 2559 flags.go:64] FLAG: --reserved-memory="" Sep 17 07:08:11.417916 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:11.410276 2559 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Sep 17 07:08:11.417916 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:11.410279 2559 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Sep 17 07:08:11.417916 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:11.410282 2559 flags.go:64] FLAG: --rotate-certificates="false" Sep 17 07:08:11.417916 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:11.410284 2559 flags.go:64] FLAG: --rotate-server-certificates="false" Sep 17 07:08:11.417916 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:11.410287 2559 flags.go:64] FLAG: --runonce="false" Sep 17 07:08:11.417916 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:11.410290 2559 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Sep 17 07:08:11.418549 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:11.410294 2559 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Sep 17 07:08:11.418549 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:11.410298 2559 flags.go:64] FLAG: --seccomp-default="false" Sep 17 07:08:11.418549 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:11.410301 2559 flags.go:64] FLAG: --serialize-image-pulls="true" Sep 17 07:08:11.418549 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:11.410304 2559 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Sep 17 07:08:11.418549 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:11.410308 2559 flags.go:64] FLAG: --storage-driver-db="cadvisor" Sep 17 07:08:11.418549 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:11.410311 2559 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Sep 17 07:08:11.418549 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:11.410314 2559 flags.go:64] FLAG: --storage-driver-password="root" Sep 17 07:08:11.418549 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:11.410317 2559 flags.go:64] FLAG: --storage-driver-secure="false" Sep 17 07:08:11.418549 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:11.410320 2559 flags.go:64] FLAG: --storage-driver-table="stats" Sep 17 07:08:11.418549 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:11.410323 2559 flags.go:64] FLAG: --storage-driver-user="root" Sep 17 07:08:11.418549 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:11.410325 2559 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Sep 17 07:08:11.418549 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:11.410329 2559 flags.go:64] FLAG: --sync-frequency="1m0s" Sep 17 07:08:11.418549 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:11.410331 2559 flags.go:64] FLAG: --system-cgroups="" Sep 17 07:08:11.418549 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:11.410334 2559 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Sep 17 07:08:11.418549 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:11.410340 2559 flags.go:64] FLAG: --system-reserved-cgroup="" Sep 17 07:08:11.418549 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:11.410343 2559 flags.go:64] FLAG: --tls-cert-file="" Sep 17 07:08:11.418549 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:11.410346 2559 flags.go:64] FLAG: --tls-cipher-suites="[]" Sep 17 07:08:11.418549 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:11.410351 2559 flags.go:64] FLAG: --tls-min-version="" Sep 17 07:08:11.418549 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:11.410354 2559 flags.go:64] FLAG: --tls-private-key-file="" Sep 17 07:08:11.418549 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:11.410356 2559 flags.go:64] FLAG: --topology-manager-policy="none" Sep 17 07:08:11.418549 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:11.410359 2559 flags.go:64] FLAG: --topology-manager-policy-options="" Sep 17 07:08:11.418549 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:11.410362 2559 flags.go:64] FLAG: --topology-manager-scope="container" Sep 17 07:08:11.418549 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:11.410365 2559 flags.go:64] FLAG: --v="2" Sep 17 07:08:11.418549 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:11.410369 2559 flags.go:64] FLAG: --version="false" Sep 17 07:08:11.418549 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:11.410373 2559 flags.go:64] FLAG: --vmodule="" Sep 17 07:08:11.419273 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:11.410377 2559 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Sep 17 07:08:11.419273 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:11.410380 2559 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Sep 17 07:08:11.419273 ip-10-0-138-13 kubenswrapper[2559]: W0917 07:08:11.410501 2559 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 17 07:08:11.419273 ip-10-0-138-13 kubenswrapper[2559]: W0917 07:08:11.410505 2559 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 17 07:08:11.419273 ip-10-0-138-13 kubenswrapper[2559]: W0917 07:08:11.410508 2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 17 07:08:11.419273 ip-10-0-138-13 kubenswrapper[2559]: W0917 07:08:11.410511 2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 17 07:08:11.419273 ip-10-0-138-13 kubenswrapper[2559]: W0917 07:08:11.410514 2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 17 07:08:11.419273 ip-10-0-138-13 kubenswrapper[2559]: W0917 07:08:11.410519 2559 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 17 07:08:11.419273 ip-10-0-138-13 kubenswrapper[2559]: W0917 07:08:11.410522 2559 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 17 07:08:11.419273 ip-10-0-138-13 kubenswrapper[2559]: W0917 07:08:11.410524 2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 17 07:08:11.419273 ip-10-0-138-13 kubenswrapper[2559]: W0917 07:08:11.410527 2559 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 17 07:08:11.419273 ip-10-0-138-13 kubenswrapper[2559]: W0917 07:08:11.410530 2559 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 17 07:08:11.419273 ip-10-0-138-13 kubenswrapper[2559]: W0917 07:08:11.410532 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 17 07:08:11.419273 ip-10-0-138-13 kubenswrapper[2559]: W0917 07:08:11.410535 2559 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 17 07:08:11.419273 ip-10-0-138-13 kubenswrapper[2559]: W0917 07:08:11.410538 2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 17 07:08:11.419273 ip-10-0-138-13 kubenswrapper[2559]: W0917 07:08:11.410540 2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 17 07:08:11.419273 ip-10-0-138-13 kubenswrapper[2559]: W0917 07:08:11.410543 2559 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 17 07:08:11.419273 ip-10-0-138-13 kubenswrapper[2559]: W0917 07:08:11.410546 2559 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 17 07:08:11.419273 ip-10-0-138-13 kubenswrapper[2559]: W0917 07:08:11.410548 2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 17 07:08:11.419273 ip-10-0-138-13 kubenswrapper[2559]: W0917 07:08:11.410551 2559 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 17 07:08:11.419762 ip-10-0-138-13 kubenswrapper[2559]: W0917 07:08:11.410554 2559 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 17 07:08:11.419762 ip-10-0-138-13 kubenswrapper[2559]: W0917 07:08:11.410556 2559 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 17 07:08:11.419762 ip-10-0-138-13 kubenswrapper[2559]: W0917 07:08:11.410559 2559 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 17 07:08:11.419762 ip-10-0-138-13 kubenswrapper[2559]: W0917 07:08:11.410562 2559 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 17 07:08:11.419762 ip-10-0-138-13 kubenswrapper[2559]: W0917 07:08:11.410564 2559 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 17 07:08:11.419762 ip-10-0-138-13 kubenswrapper[2559]: W0917 07:08:11.410567 2559 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 17 07:08:11.419762 ip-10-0-138-13 kubenswrapper[2559]: W0917 07:08:11.410569 2559 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 17 07:08:11.419762 ip-10-0-138-13 kubenswrapper[2559]: W0917 07:08:11.410572 2559 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 17 07:08:11.419762 ip-10-0-138-13 kubenswrapper[2559]: W0917 07:08:11.410575 2559 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 17 07:08:11.419762 ip-10-0-138-13 kubenswrapper[2559]: W0917 07:08:11.410577 2559 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 17 07:08:11.419762 ip-10-0-138-13 kubenswrapper[2559]: W0917 07:08:11.410580 2559 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 17 07:08:11.419762 ip-10-0-138-13 kubenswrapper[2559]: W0917 07:08:11.410583 2559 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 17 07:08:11.419762 ip-10-0-138-13 kubenswrapper[2559]: W0917 07:08:11.410586 2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 17 07:08:11.419762 ip-10-0-138-13 kubenswrapper[2559]: W0917 07:08:11.410589 2559 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 17 07:08:11.419762 ip-10-0-138-13 kubenswrapper[2559]: W0917 07:08:11.410592 2559 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 17 07:08:11.419762 ip-10-0-138-13 kubenswrapper[2559]: W0917 07:08:11.410594 2559 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 17 07:08:11.419762 ip-10-0-138-13 kubenswrapper[2559]: W0917 07:08:11.410597 2559 feature_gate.go:328] unrecognized feature gate: Example Sep 17 07:08:11.419762 ip-10-0-138-13 kubenswrapper[2559]: W0917 07:08:11.410599 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 17 07:08:11.419762 ip-10-0-138-13 kubenswrapper[2559]: W0917 07:08:11.410602 2559 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 17 07:08:11.419762 ip-10-0-138-13 kubenswrapper[2559]: W0917 07:08:11.410606 2559 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 17 07:08:11.420276 ip-10-0-138-13 kubenswrapper[2559]: W0917 07:08:11.410608 2559 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 17 07:08:11.420276 ip-10-0-138-13 kubenswrapper[2559]: W0917 07:08:11.410611 2559 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 17 07:08:11.420276 ip-10-0-138-13 kubenswrapper[2559]: W0917 07:08:11.410614 2559 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 17 07:08:11.420276 ip-10-0-138-13 kubenswrapper[2559]: W0917 07:08:11.410616 2559 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 17 07:08:11.420276 ip-10-0-138-13 kubenswrapper[2559]: W0917 07:08:11.410619 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 17 07:08:11.420276 ip-10-0-138-13 kubenswrapper[2559]: W0917 07:08:11.410621 2559 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 17 07:08:11.420276 ip-10-0-138-13 kubenswrapper[2559]: W0917 07:08:11.410624 2559 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 17 07:08:11.420276 ip-10-0-138-13 kubenswrapper[2559]: W0917 07:08:11.410626 2559 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 17 07:08:11.420276 ip-10-0-138-13 kubenswrapper[2559]: W0917 07:08:11.410629 2559 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 17 07:08:11.420276 ip-10-0-138-13 kubenswrapper[2559]: W0917 07:08:11.410632 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 17 07:08:11.420276 ip-10-0-138-13 kubenswrapper[2559]: W0917 07:08:11.410635 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 17 07:08:11.420276 ip-10-0-138-13 kubenswrapper[2559]: W0917 07:08:11.410638 2559 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 17 07:08:11.420276 ip-10-0-138-13 kubenswrapper[2559]: W0917 07:08:11.410640 2559 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 17 07:08:11.420276 ip-10-0-138-13 kubenswrapper[2559]: W0917 07:08:11.410643 2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 17 07:08:11.420276 ip-10-0-138-13 kubenswrapper[2559]: W0917 07:08:11.410646 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 17 07:08:11.420276 ip-10-0-138-13 kubenswrapper[2559]: W0917 07:08:11.410648 2559 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 17 07:08:11.420276 ip-10-0-138-13 kubenswrapper[2559]: W0917 07:08:11.410651 2559 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 17 07:08:11.420276 ip-10-0-138-13 kubenswrapper[2559]: W0917 07:08:11.410654 2559 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 17 07:08:11.420276 ip-10-0-138-13 kubenswrapper[2559]: W0917 07:08:11.410656 2559 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 17 07:08:11.420276 ip-10-0-138-13 kubenswrapper[2559]: W0917 07:08:11.410659 2559 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 17 07:08:11.420767 ip-10-0-138-13 kubenswrapper[2559]: W0917 07:08:11.410663 2559 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 17 07:08:11.420767 ip-10-0-138-13 kubenswrapper[2559]: W0917 07:08:11.410667 2559 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 17 07:08:11.420767 ip-10-0-138-13 kubenswrapper[2559]: W0917 07:08:11.410671 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 17 07:08:11.420767 ip-10-0-138-13 kubenswrapper[2559]: W0917 07:08:11.410674 2559 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 17 07:08:11.420767 ip-10-0-138-13 kubenswrapper[2559]: W0917 07:08:11.410677 2559 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 17 07:08:11.420767 ip-10-0-138-13 kubenswrapper[2559]: W0917 07:08:11.410680 2559 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 17 07:08:11.420767 ip-10-0-138-13 kubenswrapper[2559]: W0917 07:08:11.410683 2559 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 17 07:08:11.420767 ip-10-0-138-13 kubenswrapper[2559]: W0917 07:08:11.410687 2559 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 17 07:08:11.420767 ip-10-0-138-13 kubenswrapper[2559]: W0917 07:08:11.410690 2559 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 17 07:08:11.420767 ip-10-0-138-13 kubenswrapper[2559]: W0917 07:08:11.410694 2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 17 07:08:11.420767 ip-10-0-138-13 kubenswrapper[2559]: W0917 07:08:11.410697 2559 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 17 07:08:11.420767 ip-10-0-138-13 kubenswrapper[2559]: W0917 07:08:11.410701 2559 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 17 07:08:11.420767 ip-10-0-138-13 kubenswrapper[2559]: W0917 07:08:11.410704 2559 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 17 07:08:11.420767 ip-10-0-138-13 kubenswrapper[2559]: W0917 07:08:11.410706 2559 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 17 07:08:11.420767 ip-10-0-138-13 kubenswrapper[2559]: W0917 07:08:11.410709 2559 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 17 07:08:11.420767 ip-10-0-138-13 kubenswrapper[2559]: W0917 07:08:11.410712 2559 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 17 07:08:11.420767 ip-10-0-138-13 kubenswrapper[2559]: W0917 07:08:11.410714 2559 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 17 07:08:11.420767 ip-10-0-138-13 kubenswrapper[2559]: W0917 07:08:11.410717 2559 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 17 07:08:11.420767 ip-10-0-138-13 kubenswrapper[2559]: W0917 07:08:11.410720 2559 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 17 07:08:11.421279 ip-10-0-138-13 kubenswrapper[2559]: W0917 07:08:11.410722 2559 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 17 07:08:11.421279 ip-10-0-138-13 kubenswrapper[2559]: W0917 07:08:11.410725 2559 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 17 07:08:11.421279 ip-10-0-138-13 kubenswrapper[2559]: W0917 07:08:11.410728 2559 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 17 07:08:11.421279 ip-10-0-138-13 kubenswrapper[2559]: W0917 07:08:11.410730 2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 17 07:08:11.421279 ip-10-0-138-13 kubenswrapper[2559]: W0917 07:08:11.410733 2559 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 17 07:08:11.421279 ip-10-0-138-13 kubenswrapper[2559]: W0917 07:08:11.410735 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 17 07:08:11.421279 ip-10-0-138-13 kubenswrapper[2559]: W0917 07:08:11.410739 2559 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 17 07:08:11.421279 ip-10-0-138-13 kubenswrapper[2559]: W0917 07:08:11.410743 2559 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 17 07:08:11.421279 ip-10-0-138-13 kubenswrapper[2559]: W0917 07:08:11.410746 2559 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 17 07:08:11.421279 ip-10-0-138-13 kubenswrapper[2559]: W0917 07:08:11.410749 2559 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 17 07:08:11.421279 ip-10-0-138-13 kubenswrapper[2559]: W0917 07:08:11.410752 2559 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 17 07:08:11.421279 ip-10-0-138-13 kubenswrapper[2559]: W0917 07:08:11.410755 2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 17 07:08:11.421279 ip-10-0-138-13 kubenswrapper[2559]: W0917 07:08:11.410758 2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 17 07:08:11.421279 ip-10-0-138-13 kubenswrapper[2559]: W0917 07:08:11.410763 2559 feature_gate.go:328] unrecognized feature gate: Example2 Sep 17 07:08:11.421279 ip-10-0-138-13 kubenswrapper[2559]: W0917 07:08:11.410766 2559 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 17 07:08:11.421279 ip-10-0-138-13 kubenswrapper[2559]: W0917 07:08:11.410769 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 17 07:08:11.421279 ip-10-0-138-13 kubenswrapper[2559]: W0917 07:08:11.410772 2559 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 17 07:08:11.421279 ip-10-0-138-13 kubenswrapper[2559]: W0917 07:08:11.410775 2559 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 17 07:08:11.421279 ip-10-0-138-13 kubenswrapper[2559]: W0917 07:08:11.410778 2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 17 07:08:11.421758 ip-10-0-138-13 kubenswrapper[2559]: W0917 07:08:11.410781 2559 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 17 07:08:11.421758 ip-10-0-138-13 kubenswrapper[2559]: W0917 07:08:11.410784 2559 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 17 07:08:11.421758 ip-10-0-138-13 kubenswrapper[2559]: W0917 07:08:11.410787 2559 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 17 07:08:11.421758 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:11.410792 2559 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Sep 17 07:08:11.421758 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:11.417493 2559 server.go:529] "Kubelet version" kubeletVersion="v1.34.9" Sep 17 07:08:11.421758 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:11.417512 2559 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Sep 17 07:08:11.421758 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:11.418147 2559 watchdog_linux.go:95] "Systemd watchdog is not enabled" Sep 17 07:08:11.421758 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:11.418156 2559 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Sep 17 07:08:11.421758 ip-10-0-138-13 kubenswrapper[2559]: W0917 07:08:11.418226 2559 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 17 07:08:11.421758 ip-10-0-138-13 kubenswrapper[2559]: W0917 07:08:11.418231 2559 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 17 07:08:11.421758 ip-10-0-138-13 kubenswrapper[2559]: W0917 07:08:11.418234 2559 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 17 07:08:11.421758 ip-10-0-138-13 kubenswrapper[2559]: W0917 07:08:11.418237 2559 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 17 07:08:11.421758 ip-10-0-138-13 kubenswrapper[2559]: W0917 07:08:11.418241 2559 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 17 07:08:11.421758 ip-10-0-138-13 kubenswrapper[2559]: W0917 07:08:11.418244 2559 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 17 07:08:11.421758 ip-10-0-138-13 kubenswrapper[2559]: W0917 07:08:11.418248 2559 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 17 07:08:11.422170 ip-10-0-138-13 kubenswrapper[2559]: W0917 07:08:11.418251 2559 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 17 07:08:11.422170 ip-10-0-138-13 kubenswrapper[2559]: W0917 07:08:11.418254 2559 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 17 07:08:11.422170 ip-10-0-138-13 kubenswrapper[2559]: W0917 07:08:11.418257 2559 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 17 07:08:11.422170 ip-10-0-138-13 kubenswrapper[2559]: W0917 07:08:11.418260 2559 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 17 07:08:11.422170 ip-10-0-138-13 kubenswrapper[2559]: W0917 07:08:11.418262 2559 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 17 07:08:11.422170 ip-10-0-138-13 kubenswrapper[2559]: W0917 07:08:11.418265 2559 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 17 07:08:11.422170 ip-10-0-138-13 kubenswrapper[2559]: W0917 07:08:11.418268 2559 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 17 07:08:11.422170 ip-10-0-138-13 kubenswrapper[2559]: W0917 07:08:11.418271 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 17 07:08:11.422170 ip-10-0-138-13 kubenswrapper[2559]: W0917 07:08:11.418273 2559 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 17 07:08:11.422170 ip-10-0-138-13 kubenswrapper[2559]: W0917 07:08:11.418276 2559 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 17 07:08:11.422170 ip-10-0-138-13 kubenswrapper[2559]: W0917 07:08:11.418278 2559 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 17 07:08:11.422170 ip-10-0-138-13 kubenswrapper[2559]: W0917 07:08:11.418281 2559 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 17 07:08:11.422170 ip-10-0-138-13 kubenswrapper[2559]: W0917 07:08:11.418283 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 17 07:08:11.422170 ip-10-0-138-13 kubenswrapper[2559]: W0917 07:08:11.418286 2559 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 17 07:08:11.422170 ip-10-0-138-13 kubenswrapper[2559]: W0917 07:08:11.418289 2559 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 17 07:08:11.422170 ip-10-0-138-13 kubenswrapper[2559]: W0917 07:08:11.418291 2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 17 07:08:11.422170 ip-10-0-138-13 kubenswrapper[2559]: W0917 07:08:11.418294 2559 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 17 07:08:11.422170 ip-10-0-138-13 kubenswrapper[2559]: W0917 07:08:11.418296 2559 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 17 07:08:11.422170 ip-10-0-138-13 kubenswrapper[2559]: W0917 07:08:11.418300 2559 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 17 07:08:11.422170 ip-10-0-138-13 kubenswrapper[2559]: W0917 07:08:11.418304 2559 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 17 07:08:11.422686 ip-10-0-138-13 kubenswrapper[2559]: W0917 07:08:11.418307 2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 17 07:08:11.422686 ip-10-0-138-13 kubenswrapper[2559]: W0917 07:08:11.418310 2559 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 17 07:08:11.422686 ip-10-0-138-13 kubenswrapper[2559]: W0917 07:08:11.418315 2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 17 07:08:11.422686 ip-10-0-138-13 kubenswrapper[2559]: W0917 07:08:11.418318 2559 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 17 07:08:11.422686 ip-10-0-138-13 kubenswrapper[2559]: W0917 07:08:11.418321 2559 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 17 07:08:11.422686 ip-10-0-138-13 kubenswrapper[2559]: W0917 07:08:11.418324 2559 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 17 07:08:11.422686 ip-10-0-138-13 kubenswrapper[2559]: W0917 07:08:11.418327 2559 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 17 07:08:11.422686 ip-10-0-138-13 kubenswrapper[2559]: W0917 07:08:11.418329 2559 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 17 07:08:11.422686 ip-10-0-138-13 kubenswrapper[2559]: W0917 07:08:11.418332 2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 17 07:08:11.422686 ip-10-0-138-13 kubenswrapper[2559]: W0917 07:08:11.418334 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 17 07:08:11.422686 ip-10-0-138-13 kubenswrapper[2559]: W0917 07:08:11.418338 2559 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 17 07:08:11.422686 ip-10-0-138-13 kubenswrapper[2559]: W0917 07:08:11.418342 2559 feature_gate.go:328] unrecognized feature gate: Example Sep 17 07:08:11.422686 ip-10-0-138-13 kubenswrapper[2559]: W0917 07:08:11.418345 2559 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 17 07:08:11.422686 ip-10-0-138-13 kubenswrapper[2559]: W0917 07:08:11.418348 2559 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 17 07:08:11.422686 ip-10-0-138-13 kubenswrapper[2559]: W0917 07:08:11.418350 2559 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 17 07:08:11.422686 ip-10-0-138-13 kubenswrapper[2559]: W0917 07:08:11.418353 2559 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 17 07:08:11.422686 ip-10-0-138-13 kubenswrapper[2559]: W0917 07:08:11.418356 2559 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 17 07:08:11.422686 ip-10-0-138-13 kubenswrapper[2559]: W0917 07:08:11.418358 2559 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 17 07:08:11.422686 ip-10-0-138-13 kubenswrapper[2559]: W0917 07:08:11.418361 2559 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 17 07:08:11.422686 ip-10-0-138-13 kubenswrapper[2559]: W0917 07:08:11.418363 2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 17 07:08:11.423247 ip-10-0-138-13 kubenswrapper[2559]: W0917 07:08:11.418366 2559 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 17 07:08:11.423247 ip-10-0-138-13 kubenswrapper[2559]: W0917 07:08:11.418370 2559 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 17 07:08:11.423247 ip-10-0-138-13 kubenswrapper[2559]: W0917 07:08:11.418373 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 17 07:08:11.423247 ip-10-0-138-13 kubenswrapper[2559]: W0917 07:08:11.418376 2559 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 17 07:08:11.423247 ip-10-0-138-13 kubenswrapper[2559]: W0917 07:08:11.418379 2559 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 17 07:08:11.423247 ip-10-0-138-13 kubenswrapper[2559]: W0917 07:08:11.418382 2559 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 17 07:08:11.423247 ip-10-0-138-13 kubenswrapper[2559]: W0917 07:08:11.418385 2559 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 17 07:08:11.423247 ip-10-0-138-13 kubenswrapper[2559]: W0917 07:08:11.418387 2559 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 17 07:08:11.423247 ip-10-0-138-13 kubenswrapper[2559]: W0917 07:08:11.418391 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 17 07:08:11.423247 ip-10-0-138-13 kubenswrapper[2559]: W0917 07:08:11.418394 2559 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 17 07:08:11.423247 ip-10-0-138-13 kubenswrapper[2559]: W0917 07:08:11.418396 2559 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 17 07:08:11.423247 ip-10-0-138-13 kubenswrapper[2559]: W0917 07:08:11.418399 2559 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 17 07:08:11.423247 ip-10-0-138-13 kubenswrapper[2559]: W0917 07:08:11.418402 2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 17 07:08:11.423247 ip-10-0-138-13 kubenswrapper[2559]: W0917 07:08:11.418405 2559 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 17 07:08:11.423247 ip-10-0-138-13 kubenswrapper[2559]: W0917 07:08:11.418408 2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 17 07:08:11.423247 ip-10-0-138-13 kubenswrapper[2559]: W0917 07:08:11.418411 2559 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 17 07:08:11.423247 ip-10-0-138-13 kubenswrapper[2559]: W0917 07:08:11.418414 2559 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 17 07:08:11.423247 ip-10-0-138-13 kubenswrapper[2559]: W0917 07:08:11.418417 2559 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 17 07:08:11.423247 ip-10-0-138-13 kubenswrapper[2559]: W0917 07:08:11.418419 2559 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 17 07:08:11.423247 ip-10-0-138-13 kubenswrapper[2559]: W0917 07:08:11.418422 2559 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 17 07:08:11.423744 ip-10-0-138-13 kubenswrapper[2559]: W0917 07:08:11.418425 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 17 07:08:11.423744 ip-10-0-138-13 kubenswrapper[2559]: W0917 07:08:11.418427 2559 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 17 07:08:11.423744 ip-10-0-138-13 kubenswrapper[2559]: W0917 07:08:11.418430 2559 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 17 07:08:11.423744 ip-10-0-138-13 kubenswrapper[2559]: W0917 07:08:11.418432 2559 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 17 07:08:11.423744 ip-10-0-138-13 kubenswrapper[2559]: W0917 07:08:11.418435 2559 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 17 07:08:11.423744 ip-10-0-138-13 kubenswrapper[2559]: W0917 07:08:11.418437 2559 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 17 07:08:11.423744 ip-10-0-138-13 kubenswrapper[2559]: W0917 07:08:11.418440 2559 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 17 07:08:11.423744 ip-10-0-138-13 kubenswrapper[2559]: W0917 07:08:11.418443 2559 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 17 07:08:11.423744 ip-10-0-138-13 kubenswrapper[2559]: W0917 07:08:11.418445 2559 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 17 07:08:11.423744 ip-10-0-138-13 kubenswrapper[2559]: W0917 07:08:11.418448 2559 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 17 07:08:11.423744 ip-10-0-138-13 kubenswrapper[2559]: W0917 07:08:11.418450 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 17 07:08:11.423744 ip-10-0-138-13 kubenswrapper[2559]: W0917 07:08:11.418453 2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 17 07:08:11.423744 ip-10-0-138-13 kubenswrapper[2559]: W0917 07:08:11.418456 2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 17 07:08:11.423744 ip-10-0-138-13 kubenswrapper[2559]: W0917 07:08:11.418458 2559 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 17 07:08:11.423744 ip-10-0-138-13 kubenswrapper[2559]: W0917 07:08:11.418461 2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 17 07:08:11.423744 ip-10-0-138-13 kubenswrapper[2559]: W0917 07:08:11.418463 2559 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 17 07:08:11.423744 ip-10-0-138-13 kubenswrapper[2559]: W0917 07:08:11.418466 2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 17 07:08:11.423744 ip-10-0-138-13 kubenswrapper[2559]: W0917 07:08:11.418469 2559 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 17 07:08:11.423744 ip-10-0-138-13 kubenswrapper[2559]: W0917 07:08:11.418472 2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 17 07:08:11.424235 ip-10-0-138-13 kubenswrapper[2559]: W0917 07:08:11.418474 2559 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 17 07:08:11.424235 ip-10-0-138-13 kubenswrapper[2559]: W0917 07:08:11.418477 2559 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 17 07:08:11.424235 ip-10-0-138-13 kubenswrapper[2559]: W0917 07:08:11.418479 2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 17 07:08:11.424235 ip-10-0-138-13 kubenswrapper[2559]: W0917 07:08:11.418482 2559 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 17 07:08:11.424235 ip-10-0-138-13 kubenswrapper[2559]: W0917 07:08:11.418484 2559 feature_gate.go:328] unrecognized feature gate: Example2 Sep 17 07:08:11.424235 ip-10-0-138-13 kubenswrapper[2559]: W0917 07:08:11.418487 2559 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 17 07:08:11.424235 ip-10-0-138-13 kubenswrapper[2559]: W0917 07:08:11.418490 2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 17 07:08:11.424235 ip-10-0-138-13 kubenswrapper[2559]: W0917 07:08:11.418493 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 17 07:08:11.424235 ip-10-0-138-13 kubenswrapper[2559]: W0917 07:08:11.418495 2559 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 17 07:08:11.424235 ip-10-0-138-13 kubenswrapper[2559]: W0917 07:08:11.418499 2559 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 17 07:08:11.424235 ip-10-0-138-13 kubenswrapper[2559]: W0917 07:08:11.418501 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 17 07:08:11.424235 ip-10-0-138-13 kubenswrapper[2559]: W0917 07:08:11.418504 2559 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 17 07:08:11.424235 ip-10-0-138-13 kubenswrapper[2559]: W0917 07:08:11.418506 2559 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 17 07:08:11.424235 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:11.418511 2559 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Sep 17 07:08:11.424235 ip-10-0-138-13 kubenswrapper[2559]: W0917 07:08:11.418620 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 17 07:08:11.424604 ip-10-0-138-13 kubenswrapper[2559]: W0917 07:08:11.418625 2559 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 17 07:08:11.424604 ip-10-0-138-13 kubenswrapper[2559]: W0917 07:08:11.418628 2559 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 17 07:08:11.424604 ip-10-0-138-13 kubenswrapper[2559]: W0917 07:08:11.418631 2559 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 17 07:08:11.424604 ip-10-0-138-13 kubenswrapper[2559]: W0917 07:08:11.418634 2559 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 17 07:08:11.424604 ip-10-0-138-13 kubenswrapper[2559]: W0917 07:08:11.418636 2559 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 17 07:08:11.424604 ip-10-0-138-13 kubenswrapper[2559]: W0917 07:08:11.418639 2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 17 07:08:11.424604 ip-10-0-138-13 kubenswrapper[2559]: W0917 07:08:11.418641 2559 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 17 07:08:11.424604 ip-10-0-138-13 kubenswrapper[2559]: W0917 07:08:11.418644 2559 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 17 07:08:11.424604 ip-10-0-138-13 kubenswrapper[2559]: W0917 07:08:11.418647 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 17 07:08:11.424604 ip-10-0-138-13 kubenswrapper[2559]: W0917 07:08:11.418650 2559 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 17 07:08:11.424604 ip-10-0-138-13 kubenswrapper[2559]: W0917 07:08:11.418652 2559 feature_gate.go:328] unrecognized feature gate: Example Sep 17 07:08:11.424604 ip-10-0-138-13 kubenswrapper[2559]: W0917 07:08:11.418655 2559 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 17 07:08:11.424604 ip-10-0-138-13 kubenswrapper[2559]: W0917 07:08:11.418658 2559 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 17 07:08:11.424604 ip-10-0-138-13 kubenswrapper[2559]: W0917 07:08:11.418660 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 17 07:08:11.424604 ip-10-0-138-13 kubenswrapper[2559]: W0917 07:08:11.418663 2559 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 17 07:08:11.424604 ip-10-0-138-13 kubenswrapper[2559]: W0917 07:08:11.418666 2559 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 17 07:08:11.424604 ip-10-0-138-13 kubenswrapper[2559]: W0917 07:08:11.418668 2559 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 17 07:08:11.424604 ip-10-0-138-13 kubenswrapper[2559]: W0917 07:08:11.418671 2559 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 17 07:08:11.424604 ip-10-0-138-13 kubenswrapper[2559]: W0917 07:08:11.418674 2559 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 17 07:08:11.424604 ip-10-0-138-13 kubenswrapper[2559]: W0917 07:08:11.418676 2559 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 17 07:08:11.425084 ip-10-0-138-13 kubenswrapper[2559]: W0917 07:08:11.418679 2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 17 07:08:11.425084 ip-10-0-138-13 kubenswrapper[2559]: W0917 07:08:11.418681 2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 17 07:08:11.425084 ip-10-0-138-13 kubenswrapper[2559]: W0917 07:08:11.418684 2559 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 17 07:08:11.425084 ip-10-0-138-13 kubenswrapper[2559]: W0917 07:08:11.418687 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 17 07:08:11.425084 ip-10-0-138-13 kubenswrapper[2559]: W0917 07:08:11.418690 2559 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 17 07:08:11.425084 ip-10-0-138-13 kubenswrapper[2559]: W0917 07:08:11.418693 2559 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 17 07:08:11.425084 ip-10-0-138-13 kubenswrapper[2559]: W0917 07:08:11.418695 2559 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 17 07:08:11.425084 ip-10-0-138-13 kubenswrapper[2559]: W0917 07:08:11.418698 2559 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 17 07:08:11.425084 ip-10-0-138-13 kubenswrapper[2559]: W0917 07:08:11.418701 2559 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 17 07:08:11.425084 ip-10-0-138-13 kubenswrapper[2559]: W0917 07:08:11.418703 2559 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 17 07:08:11.425084 ip-10-0-138-13 kubenswrapper[2559]: W0917 07:08:11.418706 2559 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 17 07:08:11.425084 ip-10-0-138-13 kubenswrapper[2559]: W0917 07:08:11.418708 2559 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 17 07:08:11.425084 ip-10-0-138-13 kubenswrapper[2559]: W0917 07:08:11.418711 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 17 07:08:11.425084 ip-10-0-138-13 kubenswrapper[2559]: W0917 07:08:11.418713 2559 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 17 07:08:11.425084 ip-10-0-138-13 kubenswrapper[2559]: W0917 07:08:11.418716 2559 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 17 07:08:11.425084 ip-10-0-138-13 kubenswrapper[2559]: W0917 07:08:11.418719 2559 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 17 07:08:11.425084 ip-10-0-138-13 kubenswrapper[2559]: W0917 07:08:11.418721 2559 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 17 07:08:11.425084 ip-10-0-138-13 kubenswrapper[2559]: W0917 07:08:11.418723 2559 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 17 07:08:11.425084 ip-10-0-138-13 kubenswrapper[2559]: W0917 07:08:11.418726 2559 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 17 07:08:11.425084 ip-10-0-138-13 kubenswrapper[2559]: W0917 07:08:11.418729 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 17 07:08:11.425575 ip-10-0-138-13 kubenswrapper[2559]: W0917 07:08:11.418731 2559 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 17 07:08:11.425575 ip-10-0-138-13 kubenswrapper[2559]: W0917 07:08:11.418734 2559 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 17 07:08:11.425575 ip-10-0-138-13 kubenswrapper[2559]: W0917 07:08:11.418737 2559 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 17 07:08:11.425575 ip-10-0-138-13 kubenswrapper[2559]: W0917 07:08:11.418740 2559 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 17 07:08:11.425575 ip-10-0-138-13 kubenswrapper[2559]: W0917 07:08:11.418743 2559 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 17 07:08:11.425575 ip-10-0-138-13 kubenswrapper[2559]: W0917 07:08:11.418745 2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 17 07:08:11.425575 ip-10-0-138-13 kubenswrapper[2559]: W0917 07:08:11.418748 2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 17 07:08:11.425575 ip-10-0-138-13 kubenswrapper[2559]: W0917 07:08:11.418750 2559 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 17 07:08:11.425575 ip-10-0-138-13 kubenswrapper[2559]: W0917 07:08:11.418753 2559 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 17 07:08:11.425575 ip-10-0-138-13 kubenswrapper[2559]: W0917 07:08:11.418756 2559 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 17 07:08:11.425575 ip-10-0-138-13 kubenswrapper[2559]: W0917 07:08:11.418758 2559 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 17 07:08:11.425575 ip-10-0-138-13 kubenswrapper[2559]: W0917 07:08:11.418762 2559 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 17 07:08:11.425575 ip-10-0-138-13 kubenswrapper[2559]: W0917 07:08:11.418765 2559 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 17 07:08:11.425575 ip-10-0-138-13 kubenswrapper[2559]: W0917 07:08:11.418768 2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 17 07:08:11.425575 ip-10-0-138-13 kubenswrapper[2559]: W0917 07:08:11.418771 2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 17 07:08:11.425575 ip-10-0-138-13 kubenswrapper[2559]: W0917 07:08:11.418774 2559 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 17 07:08:11.425575 ip-10-0-138-13 kubenswrapper[2559]: W0917 07:08:11.418777 2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 17 07:08:11.425575 ip-10-0-138-13 kubenswrapper[2559]: W0917 07:08:11.418780 2559 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 17 07:08:11.426007 ip-10-0-138-13 kubenswrapper[2559]: W0917 07:08:11.418782 2559 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 17 07:08:11.426007 ip-10-0-138-13 kubenswrapper[2559]: W0917 07:08:11.418785 2559 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 17 07:08:11.426007 ip-10-0-138-13 kubenswrapper[2559]: W0917 07:08:11.418788 2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 17 07:08:11.426007 ip-10-0-138-13 kubenswrapper[2559]: W0917 07:08:11.418791 2559 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 17 07:08:11.426007 ip-10-0-138-13 kubenswrapper[2559]: W0917 07:08:11.418793 2559 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 17 07:08:11.426007 ip-10-0-138-13 kubenswrapper[2559]: W0917 07:08:11.418796 2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 17 07:08:11.426007 ip-10-0-138-13 kubenswrapper[2559]: W0917 07:08:11.418798 2559 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 17 07:08:11.426007 ip-10-0-138-13 kubenswrapper[2559]: W0917 07:08:11.418801 2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 17 07:08:11.426007 ip-10-0-138-13 kubenswrapper[2559]: W0917 07:08:11.418803 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 17 07:08:11.426007 ip-10-0-138-13 kubenswrapper[2559]: W0917 07:08:11.418806 2559 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 17 07:08:11.426007 ip-10-0-138-13 kubenswrapper[2559]: W0917 07:08:11.418808 2559 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 17 07:08:11.426007 ip-10-0-138-13 kubenswrapper[2559]: W0917 07:08:11.418812 2559 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 17 07:08:11.426007 ip-10-0-138-13 kubenswrapper[2559]: W0917 07:08:11.418815 2559 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 17 07:08:11.426007 ip-10-0-138-13 kubenswrapper[2559]: W0917 07:08:11.418818 2559 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 17 07:08:11.426007 ip-10-0-138-13 kubenswrapper[2559]: W0917 07:08:11.418821 2559 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 17 07:08:11.426007 ip-10-0-138-13 kubenswrapper[2559]: W0917 07:08:11.418824 2559 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 17 07:08:11.426007 ip-10-0-138-13 kubenswrapper[2559]: W0917 07:08:11.418827 2559 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 17 07:08:11.426007 ip-10-0-138-13 kubenswrapper[2559]: W0917 07:08:11.418829 2559 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 17 07:08:11.426007 ip-10-0-138-13 kubenswrapper[2559]: W0917 07:08:11.418832 2559 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 17 07:08:11.426007 ip-10-0-138-13 kubenswrapper[2559]: W0917 07:08:11.418835 2559 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 17 07:08:11.426508 ip-10-0-138-13 kubenswrapper[2559]: W0917 07:08:11.418837 2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 17 07:08:11.426508 ip-10-0-138-13 kubenswrapper[2559]: W0917 07:08:11.418840 2559 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 17 07:08:11.426508 ip-10-0-138-13 kubenswrapper[2559]: W0917 07:08:11.418842 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 17 07:08:11.426508 ip-10-0-138-13 kubenswrapper[2559]: W0917 07:08:11.418845 2559 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 17 07:08:11.426508 ip-10-0-138-13 kubenswrapper[2559]: W0917 07:08:11.418848 2559 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 17 07:08:11.426508 ip-10-0-138-13 kubenswrapper[2559]: W0917 07:08:11.418850 2559 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 17 07:08:11.426508 ip-10-0-138-13 kubenswrapper[2559]: W0917 07:08:11.418853 2559 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 17 07:08:11.426508 ip-10-0-138-13 kubenswrapper[2559]: W0917 07:08:11.418856 2559 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 17 07:08:11.426508 ip-10-0-138-13 kubenswrapper[2559]: W0917 07:08:11.418858 2559 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 17 07:08:11.426508 ip-10-0-138-13 kubenswrapper[2559]: W0917 07:08:11.418861 2559 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 17 07:08:11.426508 ip-10-0-138-13 kubenswrapper[2559]: W0917 07:08:11.418863 2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 17 07:08:11.426508 ip-10-0-138-13 kubenswrapper[2559]: W0917 07:08:11.418866 2559 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 17 07:08:11.426508 ip-10-0-138-13 kubenswrapper[2559]: W0917 07:08:11.418869 2559 feature_gate.go:328] unrecognized feature gate: Example2 Sep 17 07:08:11.426508 ip-10-0-138-13 kubenswrapper[2559]: W0917 07:08:11.418871 2559 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 17 07:08:11.426508 ip-10-0-138-13 kubenswrapper[2559]: W0917 07:08:11.418874 2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 17 07:08:11.426508 ip-10-0-138-13 kubenswrapper[2559]: W0917 07:08:11.418876 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 17 07:08:11.426508 ip-10-0-138-13 kubenswrapper[2559]: W0917 07:08:11.418879 2559 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 17 07:08:11.426508 ip-10-0-138-13 kubenswrapper[2559]: W0917 07:08:11.418882 2559 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 17 07:08:11.426508 ip-10-0-138-13 kubenswrapper[2559]: W0917 07:08:11.418884 2559 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 17 07:08:11.426508 ip-10-0-138-13 kubenswrapper[2559]: W0917 07:08:11.418887 2559 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 17 07:08:11.426982 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:11.418892 2559 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Sep 17 07:08:11.426982 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:11.418991 2559 server.go:962] "Client rotation is on, will bootstrap in background" Sep 17 07:08:11.426982 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:11.420898 2559 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Sep 17 07:08:11.426982 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:11.421677 2559 server.go:1019] "Starting client certificate rotation" Sep 17 07:08:11.426982 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:11.421782 2559 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Sep 17 07:08:11.426982 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:11.422396 2559 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Sep 17 07:08:11.426982 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:11.423695 2559 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Sep 17 07:08:11.429895 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:11.429871 2559 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Sep 17 07:08:11.439566 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:11.439545 2559 log.go:25] "Validated CRI v1 runtime API" Sep 17 07:08:11.441992 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:11.441977 2559 log.go:25] "Validated CRI v1 image API" Sep 17 07:08:11.443918 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:11.443904 2559 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Sep 17 07:08:11.445830 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:11.445813 2559 fs.go:135] Filesystem UUIDs: map[3a75be2d-2019-4dcc-9ba6-2c918ca22ca4:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2 eba7d996-2538-4075-af4a-2431baf182a8:/dev/nvme0n1p4] Sep 17 07:08:11.445883 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:11.445830 2559 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Sep 17 07:08:11.450444 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:11.450427 2559 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Sep 17 07:08:11.450677 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:11.450576 2559 manager.go:216] Machine: {Timestamp:2026-09-17 07:08:11.449444224 +0000 UTC m=+0.297453844 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3105319 MemoryCapacity:33164476416 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec215af9534e034bac4a48ce2836717f SystemUUID:ec215af9-534e-034b-ac4a-48ce2836717f BootID:30dcfc88-96f8-43b1-8eaf-1008d7b3153e Filesystems:[{Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632898560 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582238208 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582238208 Type:vfs Inodes:4048398 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:ff:f0:80:39:5f Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:ff:f0:80:39:5f Speed:0 Mtu:9001} {Name:ovs-system MacAddress:fe:b6:e3:0d:60:15 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164476416 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Sep 17 07:08:11.450677 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:11.450677 2559 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Sep 17 07:08:11.450798 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:11.450787 2559 manager.go:232] Version: {KernelVersion:5.14.0-570.140.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260908-1 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Sep 17 07:08:11.453247 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:11.453227 2559 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Sep 17 07:08:11.453410 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:11.453250 2559 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-138-13.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Sep 17 07:08:11.453949 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:11.453939 2559 topology_manager.go:138] "Creating topology manager with none policy" Sep 17 07:08:11.453983 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:11.453952 2559 container_manager_linux.go:309] "Creating device plugin manager" Sep 17 07:08:11.453983 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:11.453959 2559 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Sep 17 07:08:11.454466 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:11.454456 2559 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Sep 17 07:08:11.455151 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:11.455141 2559 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Sep 17 07:08:11.458503 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:11.458491 2559 state_mem.go:36] "Initialized new in-memory state store" Sep 17 07:08:11.458618 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:11.458610 2559 server.go:1240] "Using root directory" path="/var/lib/kubelet" Sep 17 07:08:11.458649 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:11.458641 2559 kubelet.go:486] "Attempting to sync node with API server" Sep 17 07:08:11.458679 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:11.458653 2559 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Sep 17 07:08:11.458679 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:11.458667 2559 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Sep 17 07:08:11.458679 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:11.458677 2559 kubelet.go:398] "Adding apiserver pod source" Sep 17 07:08:11.458779 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:11.458686 2559 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Sep 17 07:08:11.459064 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:11.459050 2559 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Sep 17 07:08:11.459181 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:11.459078 2559 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Sep 17 07:08:11.461021 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:11.461007 2559 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.12-5.rhaos4.21.gitd1ec63c.el9" apiVersion="v1" Sep 17 07:08:11.465632 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:11.465607 2559 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Sep 17 07:08:11.465716 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:11.465654 2559 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Sep 17 07:08:11.467732 ip-10-0-138-13 kubenswrapper[2559]: E0917 07:08:11.467710 2559 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-138-13.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Sep 17 07:08:11.467808 ip-10-0-138-13 kubenswrapper[2559]: E0917 07:08:11.467768 2559 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Sep 17 07:08:11.468084 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:11.468069 2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Sep 17 07:08:11.468180 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:11.468088 2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Sep 17 07:08:11.468180 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:11.468094 2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Sep 17 07:08:11.468180 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:11.468100 2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Sep 17 07:08:11.468180 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:11.468122 2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Sep 17 07:08:11.468180 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:11.468128 2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Sep 17 07:08:11.468180 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:11.468141 2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Sep 17 07:08:11.468180 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:11.468146 2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Sep 17 07:08:11.468180 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:11.468153 2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Sep 17 07:08:11.468180 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:11.468159 2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Sep 17 07:08:11.468180 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:11.468175 2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Sep 17 07:08:11.468180 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:11.468181 2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Sep 17 07:08:11.468585 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:11.468204 2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Sep 17 07:08:11.468585 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:11.468210 2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Sep 17 07:08:11.471115 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:11.471081 2559 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-138-13.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Sep 17 07:08:11.471924 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:11.471906 2559 server.go:1268] "Started kubelet" Sep 17 07:08:11.472006 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:11.471924 2559 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Sep 17 07:08:11.472050 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:11.471992 2559 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Sep 17 07:08:11.472098 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:11.472061 2559 server_v1.go:49] "podresources" method="list" useActivePods=true Sep 17 07:08:11.472833 ip-10-0-138-13 systemd[1]: Started Kubernetes Kubelet. Sep 17 07:08:11.473061 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:11.472911 2559 server.go:310] "Adding debug handlers to kubelet server" Sep 17 07:08:11.474403 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:11.474311 2559 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Sep 17 07:08:11.476798 ip-10-0-138-13 kubenswrapper[2559]: E0917 07:08:11.476695 2559 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Sep 17 07:08:11.478679 ip-10-0-138-13 kubenswrapper[2559]: E0917 07:08:11.477824 2559 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-138-13.ec2.internal.18d609feb3f4330a default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-138-13.ec2.internal,UID:ip-10-0-138-13.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-138-13.ec2.internal,},FirstTimestamp:2026-09-17 07:08:11.47181953 +0000 UTC m=+0.319829149,LastTimestamp:2026-09-17 07:08:11.47181953 +0000 UTC m=+0.319829149,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-138-13.ec2.internal,}" Sep 17 07:08:11.479123 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:11.479090 2559 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Sep 17 07:08:11.479456 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:11.479438 2559 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-4l7x5" Sep 17 07:08:11.479579 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:11.479565 2559 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Sep 17 07:08:11.479847 ip-10-0-138-13 kubenswrapper[2559]: E0917 07:08:11.479830 2559 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-13.ec2.internal\" not found" Sep 17 07:08:11.480398 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:11.480279 2559 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Sep 17 07:08:11.480398 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:11.480283 2559 volume_manager.go:311] "The desired_state_of_world populator starts" Sep 17 07:08:11.480398 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:11.480328 2559 volume_manager.go:313] "Starting Kubelet Volume Manager" Sep 17 07:08:11.480562 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:11.480465 2559 factory.go:55] Registering systemd factory Sep 17 07:08:11.480562 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:11.480481 2559 factory.go:223] Registration of the systemd container factory successfully Sep 17 07:08:11.480562 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:11.480495 2559 reconstruct.go:97] "Volume reconstruction finished" Sep 17 07:08:11.480562 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:11.480502 2559 reconciler.go:29] "Reconciler: start to sync state" Sep 17 07:08:11.480981 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:11.480965 2559 factory.go:153] Registering CRI-O factory Sep 17 07:08:11.480981 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:11.480983 2559 factory.go:223] Registration of the crio container factory successfully Sep 17 07:08:11.481116 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:11.481038 2559 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Sep 17 07:08:11.481116 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:11.481056 2559 factory.go:103] Registering Raw factory Sep 17 07:08:11.481116 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:11.481065 2559 manager.go:1196] Started watching for new ooms in manager Sep 17 07:08:11.481512 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:11.481499 2559 manager.go:349] Starting recovery of all containers Sep 17 07:08:11.485709 ip-10-0-138-13 kubenswrapper[2559]: E0917 07:08:11.485681 2559 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Sep 17 07:08:11.485816 ip-10-0-138-13 kubenswrapper[2559]: E0917 07:08:11.485783 2559 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-138-13.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Sep 17 07:08:11.489599 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:11.489577 2559 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-4l7x5" Sep 17 07:08:11.493212 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:11.493192 2559 manager.go:354] Recovery completed Sep 17 07:08:11.495761 ip-10-0-138-13 kubenswrapper[2559]: E0917 07:08:11.495740 2559 watcher.go:152] Failed to watch directory "/sys/fs/cgroup/system.slice/systemd-update-utmp-runlevel.service": inotify_add_watch /sys/fs/cgroup/system.slice/systemd-update-utmp-runlevel.service: no such file or directory Sep 17 07:08:11.499612 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:11.499597 2559 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 17 07:08:11.501463 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:11.501447 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-13.ec2.internal" event="NodeHasSufficientMemory" Sep 17 07:08:11.501521 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:11.501477 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-13.ec2.internal" event="NodeHasNoDiskPressure" Sep 17 07:08:11.501521 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:11.501491 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-13.ec2.internal" event="NodeHasSufficientPID" Sep 17 07:08:11.502099 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:11.502079 2559 cpu_manager.go:222] "Starting CPU manager" policy="none" Sep 17 07:08:11.502099 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:11.502097 2559 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Sep 17 07:08:11.502225 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:11.502086 2559 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 17 07:08:11.502225 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:11.502131 2559 state_mem.go:36] "Initialized new in-memory state store" Sep 17 07:08:11.502809 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:11.502791 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-13.ec2.internal" event="NodeHasSufficientMemory" Sep 17 07:08:11.502892 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:11.502820 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-13.ec2.internal" event="NodeHasNoDiskPressure" Sep 17 07:08:11.502892 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:11.502835 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-13.ec2.internal" event="NodeHasSufficientPID" Sep 17 07:08:11.503454 ip-10-0-138-13 kubenswrapper[2559]: E0917 07:08:11.503388 2559 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-138-13.ec2.internal.18d609feb5b88835 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-138-13.ec2.internal,UID:ip-10-0-138-13.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-138-13.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-138-13.ec2.internal,},FirstTimestamp:2026-09-17 07:08:11.501463605 +0000 UTC m=+0.349473228,LastTimestamp:2026-09-17 07:08:11.501463605 +0000 UTC m=+0.349473228,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-138-13.ec2.internal,}" Sep 17 07:08:11.504143 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:11.504126 2559 policy_none.go:49] "None policy: Start" Sep 17 07:08:11.504217 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:11.504147 2559 memory_manager.go:187] "Starting memorymanager" policy="None" Sep 17 07:08:11.504217 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:11.504160 2559 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Sep 17 07:08:11.506130 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:11.506119 2559 policy_none.go:47] "Start" Sep 17 07:08:11.555817 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:11.555648 2559 manager.go:337] "Starting Device Plugin manager" Sep 17 07:08:11.555951 ip-10-0-138-13 kubenswrapper[2559]: E0917 07:08:11.555857 2559 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Sep 17 07:08:11.555951 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:11.555872 2559 server.go:87] "Starting device plugin registration server" Sep 17 07:08:11.556090 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:11.556078 2559 eviction_manager.go:189] "Eviction manager: starting control loop" Sep 17 07:08:11.556155 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:11.556091 2559 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Sep 17 07:08:11.556228 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:11.556212 2559 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Sep 17 07:08:11.556311 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:11.556300 2559 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Sep 17 07:08:11.556360 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:11.556311 2559 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Sep 17 07:08:11.556922 ip-10-0-138-13 kubenswrapper[2559]: E0917 07:08:11.556901 2559 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Sep 17 07:08:11.557003 ip-10-0-138-13 kubenswrapper[2559]: E0917 07:08:11.556955 2559 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-138-13.ec2.internal\" not found" Sep 17 07:08:11.590958 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:11.590924 2559 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Sep 17 07:08:11.592284 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:11.592267 2559 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Sep 17 07:08:11.592374 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:11.592323 2559 status_manager.go:244] "Starting to sync pod status with apiserver" Sep 17 07:08:11.592374 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:11.592348 2559 kubelet.go:2448] "Starting kubelet main sync loop" Sep 17 07:08:11.592485 ip-10-0-138-13 kubenswrapper[2559]: E0917 07:08:11.592438 2559 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Sep 17 07:08:11.594599 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:11.594582 2559 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Sep 17 07:08:11.656413 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:11.656338 2559 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 17 07:08:11.657279 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:11.657263 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-13.ec2.internal" event="NodeHasSufficientMemory" Sep 17 07:08:11.657373 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:11.657299 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-13.ec2.internal" event="NodeHasNoDiskPressure" Sep 17 07:08:11.657373 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:11.657316 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-13.ec2.internal" event="NodeHasSufficientPID" Sep 17 07:08:11.657373 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:11.657346 2559 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-138-13.ec2.internal" Sep 17 07:08:11.665203 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:11.665180 2559 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-138-13.ec2.internal" Sep 17 07:08:11.665308 ip-10-0-138-13 kubenswrapper[2559]: E0917 07:08:11.665206 2559 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-138-13.ec2.internal\": node \"ip-10-0-138-13.ec2.internal\" not found" Sep 17 07:08:11.678142 ip-10-0-138-13 kubenswrapper[2559]: E0917 07:08:11.678120 2559 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-13.ec2.internal\" not found" Sep 17 07:08:11.693076 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:11.693050 2559 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-13.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-138-13.ec2.internal"] Sep 17 07:08:11.693183 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:11.693141 2559 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 17 07:08:11.693958 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:11.693939 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-13.ec2.internal" event="NodeHasSufficientMemory" Sep 17 07:08:11.694034 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:11.693968 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-13.ec2.internal" event="NodeHasNoDiskPressure" Sep 17 07:08:11.694034 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:11.693977 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-13.ec2.internal" event="NodeHasSufficientPID" Sep 17 07:08:11.696227 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:11.696213 2559 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 17 07:08:11.696368 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:11.696352 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-13.ec2.internal" Sep 17 07:08:11.696420 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:11.696403 2559 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 17 07:08:11.696870 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:11.696852 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-13.ec2.internal" event="NodeHasSufficientMemory" Sep 17 07:08:11.696870 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:11.696862 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-13.ec2.internal" event="NodeHasSufficientMemory" Sep 17 07:08:11.696983 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:11.696882 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-13.ec2.internal" event="NodeHasNoDiskPressure" Sep 17 07:08:11.696983 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:11.696893 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-13.ec2.internal" event="NodeHasSufficientPID" Sep 17 07:08:11.697047 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:11.696883 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-13.ec2.internal" event="NodeHasNoDiskPressure" Sep 17 07:08:11.697047 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:11.697024 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-13.ec2.internal" event="NodeHasSufficientPID" Sep 17 07:08:11.699012 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:11.698999 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-13.ec2.internal" Sep 17 07:08:11.699064 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:11.699023 2559 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 17 07:08:11.699659 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:11.699644 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-13.ec2.internal" event="NodeHasSufficientMemory" Sep 17 07:08:11.699705 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:11.699670 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-13.ec2.internal" event="NodeHasNoDiskPressure" Sep 17 07:08:11.699705 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:11.699679 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-13.ec2.internal" event="NodeHasSufficientPID" Sep 17 07:08:11.712640 ip-10-0-138-13 kubenswrapper[2559]: E0917 07:08:11.712622 2559 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-138-13.ec2.internal\" not found" node="ip-10-0-138-13.ec2.internal" Sep 17 07:08:11.715753 ip-10-0-138-13 kubenswrapper[2559]: E0917 07:08:11.715735 2559 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-138-13.ec2.internal\" not found" node="ip-10-0-138-13.ec2.internal" Sep 17 07:08:11.778308 ip-10-0-138-13 kubenswrapper[2559]: E0917 07:08:11.778287 2559 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-13.ec2.internal\" not found" Sep 17 07:08:11.781590 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:11.781574 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/ec0037d84d1fcffd24b5abcb3709fd6b-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-138-13.ec2.internal\" (UID: \"ec0037d84d1fcffd24b5abcb3709fd6b\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-13.ec2.internal" Sep 17 07:08:11.781660 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:11.781598 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ec0037d84d1fcffd24b5abcb3709fd6b-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-138-13.ec2.internal\" (UID: \"ec0037d84d1fcffd24b5abcb3709fd6b\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-13.ec2.internal" Sep 17 07:08:11.781660 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:11.781621 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/6e31eb7ec87a2342202a2651286e5c55-config\") pod \"kube-apiserver-proxy-ip-10-0-138-13.ec2.internal\" (UID: \"6e31eb7ec87a2342202a2651286e5c55\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-138-13.ec2.internal" Sep 17 07:08:11.879141 ip-10-0-138-13 kubenswrapper[2559]: E0917 07:08:11.879120 2559 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-13.ec2.internal\" not found" Sep 17 07:08:11.882398 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:11.882383 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/ec0037d84d1fcffd24b5abcb3709fd6b-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-138-13.ec2.internal\" (UID: \"ec0037d84d1fcffd24b5abcb3709fd6b\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-13.ec2.internal" Sep 17 07:08:11.882453 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:11.882405 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ec0037d84d1fcffd24b5abcb3709fd6b-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-138-13.ec2.internal\" (UID: \"ec0037d84d1fcffd24b5abcb3709fd6b\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-13.ec2.internal" Sep 17 07:08:11.882453 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:11.882425 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/6e31eb7ec87a2342202a2651286e5c55-config\") pod \"kube-apiserver-proxy-ip-10-0-138-13.ec2.internal\" (UID: \"6e31eb7ec87a2342202a2651286e5c55\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-138-13.ec2.internal" Sep 17 07:08:11.882527 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:11.882453 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/6e31eb7ec87a2342202a2651286e5c55-config\") pod \"kube-apiserver-proxy-ip-10-0-138-13.ec2.internal\" (UID: \"6e31eb7ec87a2342202a2651286e5c55\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-138-13.ec2.internal" Sep 17 07:08:11.882527 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:11.882492 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ec0037d84d1fcffd24b5abcb3709fd6b-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-138-13.ec2.internal\" (UID: \"ec0037d84d1fcffd24b5abcb3709fd6b\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-13.ec2.internal" Sep 17 07:08:11.882527 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:11.882479 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/ec0037d84d1fcffd24b5abcb3709fd6b-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-138-13.ec2.internal\" (UID: \"ec0037d84d1fcffd24b5abcb3709fd6b\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-13.ec2.internal" Sep 17 07:08:11.979911 ip-10-0-138-13 kubenswrapper[2559]: E0917 07:08:11.979840 2559 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-13.ec2.internal\" not found" Sep 17 07:08:12.015269 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:12.015246 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-13.ec2.internal" Sep 17 07:08:12.018350 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:12.018329 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-13.ec2.internal" Sep 17 07:08:12.080897 ip-10-0-138-13 kubenswrapper[2559]: E0917 07:08:12.080856 2559 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-13.ec2.internal\" not found" Sep 17 07:08:12.181298 ip-10-0-138-13 kubenswrapper[2559]: E0917 07:08:12.181272 2559 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-13.ec2.internal\" not found" Sep 17 07:08:13.581613 ip-10-0-138-13 kubenswrapper[2559]: E0917 07:08:13.581576 2559 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-13.ec2.internal\" not found" Sep 17 07:08:13.682122 ip-10-0-138-13 kubenswrapper[2559]: E0917 07:08:13.682084 2559 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-13.ec2.internal\" not found" Sep 17 07:08:13.721391 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:13.721366 2559 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Sep 17 07:08:13.721864 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:13.721499 2559 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Sep 17 07:08:13.782948 ip-10-0-138-13 kubenswrapper[2559]: E0917 07:08:13.782891 2559 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-13.ec2.internal\" not found" Sep 17 07:08:13.794089 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:13.794058 2559 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-09-16 07:03:12 +0000 UTC" deadline="2028-06-30 02:53:39.875032916 +0000 UTC" Sep 17 07:08:13.794089 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:13.794083 2559 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="15643h45m26.080952584s" Sep 17 07:08:13.810309 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:13.810288 2559 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Sep 17 07:08:13.883631 ip-10-0-138-13 kubenswrapper[2559]: E0917 07:08:13.883604 2559 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-13.ec2.internal\" not found" Sep 17 07:08:13.896903 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:13.896884 2559 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Sep 17 07:08:13.980319 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:13.980297 2559 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-13.ec2.internal" Sep 17 07:08:13.980487 ip-10-0-138-13 kubenswrapper[2559]: W0917 07:08:13.980440 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podec0037d84d1fcffd24b5abcb3709fd6b.slice/crio-c6213d43c84b1c36e37b31391a201138360a4d692746b84e12a8a0f654de0f77 WatchSource:0}: Error finding container c6213d43c84b1c36e37b31391a201138360a4d692746b84e12a8a0f654de0f77: Status 404 returned error can't find the container with id c6213d43c84b1c36e37b31391a201138360a4d692746b84e12a8a0f654de0f77 Sep 17 07:08:13.980723 ip-10-0-138-13 kubenswrapper[2559]: W0917 07:08:13.980694 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6e31eb7ec87a2342202a2651286e5c55.slice/crio-ddcf5d7cd4c9e1bc8a25d73de864c7d65a1d7a7a690893c50ee186c89b962379 WatchSource:0}: Error finding container ddcf5d7cd4c9e1bc8a25d73de864c7d65a1d7a7a690893c50ee186c89b962379: Status 404 returned error can't find the container with id ddcf5d7cd4c9e1bc8a25d73de864c7d65a1d7a7a690893c50ee186c89b962379 Sep 17 07:08:13.984740 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:13.984726 2559 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Sep 17 07:08:13.992185 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:13.992165 2559 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Sep 17 07:08:13.993876 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:13.993862 2559 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-13.ec2.internal" Sep 17 07:08:14.000232 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:14.000196 2559 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Sep 17 07:08:14.041406 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:14.041351 2559 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Sep 17 07:08:14.759959 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:14.759928 2559 apiserver.go:52] "Watching apiserver" Sep 17 07:08:14.769182 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:14.769150 2559 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Sep 17 07:08:14.770247 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:14.770210 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/node-ca-5c544","openshift-multus/multus-dksgh","openshift-multus/network-metrics-daemon-25zvh","openshift-network-operator/iptables-alerter-bb7gz","kube-system/global-pull-secret-syncer-btqpf","kube-system/konnectivity-agent-jkzvc","kube-system/kube-apiserver-proxy-ip-10-0-138-13.ec2.internal","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-13.ec2.internal","openshift-multus/multus-additional-cni-plugins-bb7bn","openshift-network-diagnostics/network-check-target-b768z","openshift-ovn-kubernetes/ovnkube-node-b99wz","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tfqjg","openshift-cluster-node-tuning-operator/tuned-nmwwq","openshift-dns/node-resolver-kf4sp"] Sep 17 07:08:14.772854 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:14.772832 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-jkzvc" Sep 17 07:08:14.774918 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:14.774896 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-nmwwq" Sep 17 07:08:14.777899 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:14.777250 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-pz7rf\"" Sep 17 07:08:14.777899 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:14.777304 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Sep 17 07:08:14.777899 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:14.777441 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-28jkm\"" Sep 17 07:08:14.777899 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:14.777492 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-bb7gz" Sep 17 07:08:14.777899 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:14.777516 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Sep 17 07:08:14.777899 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:14.777713 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Sep 17 07:08:14.778316 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:14.777940 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Sep 17 07:08:14.779890 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:14.779871 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Sep 17 07:08:14.780230 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:14.780215 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Sep 17 07:08:14.780435 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:14.780421 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Sep 17 07:08:14.780612 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:14.780598 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-btqpf" Sep 17 07:08:14.780715 ip-10-0-138-13 kubenswrapper[2559]: E0917 07:08:14.780661 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-btqpf" podUID="ac82b91d-660c-4aeb-8538-2dd48f75e691" Sep 17 07:08:14.780878 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:14.780861 2559 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Sep 17 07:08:14.781098 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:14.781079 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-c4r2m\"" Sep 17 07:08:14.782017 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:14.781997 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-25zvh" Sep 17 07:08:14.782108 ip-10-0-138-13 kubenswrapper[2559]: E0917 07:08:14.782065 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-25zvh" podUID="cb76f3bc-38be-404f-b207-231482554bfe" Sep 17 07:08:14.784396 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:14.784367 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-5c544" Sep 17 07:08:14.786757 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:14.786737 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-bb7bn" Sep 17 07:08:14.786839 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:14.786776 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-5mnnn\"" Sep 17 07:08:14.787013 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:14.786998 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Sep 17 07:08:14.787313 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:14.787298 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Sep 17 07:08:14.787385 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:14.787354 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Sep 17 07:08:14.788932 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:14.788904 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-b768z" Sep 17 07:08:14.788932 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:14.788925 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Sep 17 07:08:14.789099 ip-10-0-138-13 kubenswrapper[2559]: E0917 07:08:14.789004 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-b768z" podUID="4a9846c2-c1e2-4063-a31f-91190fa6c7a9" Sep 17 07:08:14.789099 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:14.789064 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Sep 17 07:08:14.789405 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:14.789385 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-kgxzz\"" Sep 17 07:08:14.789505 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:14.789385 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Sep 17 07:08:14.789505 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:14.789389 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Sep 17 07:08:14.789659 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:14.789641 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Sep 17 07:08:14.790575 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:14.790556 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/82e83454-bcdc-464a-848b-730186df6a59-etc-tuned\") pod \"tuned-nmwwq\" (UID: \"82e83454-bcdc-464a-848b-730186df6a59\") " pod="openshift-cluster-node-tuning-operator/tuned-nmwwq" Sep 17 07:08:14.790668 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:14.790588 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/82e83454-bcdc-464a-848b-730186df6a59-tmp\") pod \"tuned-nmwwq\" (UID: \"82e83454-bcdc-464a-848b-730186df6a59\") " pod="openshift-cluster-node-tuning-operator/tuned-nmwwq" Sep 17 07:08:14.790668 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:14.790613 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/ac82b91d-660c-4aeb-8538-2dd48f75e691-kubelet-config\") pod \"global-pull-secret-syncer-btqpf\" (UID: \"ac82b91d-660c-4aeb-8538-2dd48f75e691\") " pod="kube-system/global-pull-secret-syncer-btqpf" Sep 17 07:08:14.790668 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:14.790636 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/82e83454-bcdc-464a-848b-730186df6a59-var-lib-kubelet\") pod \"tuned-nmwwq\" (UID: \"82e83454-bcdc-464a-848b-730186df6a59\") " pod="openshift-cluster-node-tuning-operator/tuned-nmwwq" Sep 17 07:08:14.790668 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:14.790658 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bgd2f\" (UniqueName: \"kubernetes.io/projected/82e83454-bcdc-464a-848b-730186df6a59-kube-api-access-bgd2f\") pod \"tuned-nmwwq\" (UID: \"82e83454-bcdc-464a-848b-730186df6a59\") " pod="openshift-cluster-node-tuning-operator/tuned-nmwwq" Sep 17 07:08:14.790869 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:14.790682 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/6299ddb0-0911-4f6c-baa4-7c4559bade5f-iptables-alerter-script\") pod \"iptables-alerter-bb7gz\" (UID: \"6299ddb0-0911-4f6c-baa4-7c4559bade5f\") " pod="openshift-network-operator/iptables-alerter-bb7gz" Sep 17 07:08:14.790869 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:14.790707 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ndzcc\" (UniqueName: \"kubernetes.io/projected/6299ddb0-0911-4f6c-baa4-7c4559bade5f-kube-api-access-ndzcc\") pod \"iptables-alerter-bb7gz\" (UID: \"6299ddb0-0911-4f6c-baa4-7c4559bade5f\") " pod="openshift-network-operator/iptables-alerter-bb7gz" Sep 17 07:08:14.790869 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:14.790731 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tksjr\" (UniqueName: \"kubernetes.io/projected/cb76f3bc-38be-404f-b207-231482554bfe-kube-api-access-tksjr\") pod \"network-metrics-daemon-25zvh\" (UID: \"cb76f3bc-38be-404f-b207-231482554bfe\") " pod="openshift-multus/network-metrics-daemon-25zvh" Sep 17 07:08:14.790869 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:14.790754 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/82e83454-bcdc-464a-848b-730186df6a59-etc-sysctl-d\") pod \"tuned-nmwwq\" (UID: \"82e83454-bcdc-464a-848b-730186df6a59\") " pod="openshift-cluster-node-tuning-operator/tuned-nmwwq" Sep 17 07:08:14.790869 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:14.790775 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/82e83454-bcdc-464a-848b-730186df6a59-etc-sysctl-conf\") pod \"tuned-nmwwq\" (UID: \"82e83454-bcdc-464a-848b-730186df6a59\") " pod="openshift-cluster-node-tuning-operator/tuned-nmwwq" Sep 17 07:08:14.790869 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:14.790798 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/82e83454-bcdc-464a-848b-730186df6a59-etc-systemd\") pod \"tuned-nmwwq\" (UID: \"82e83454-bcdc-464a-848b-730186df6a59\") " pod="openshift-cluster-node-tuning-operator/tuned-nmwwq" Sep 17 07:08:14.790869 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:14.790819 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/82e83454-bcdc-464a-848b-730186df6a59-run\") pod \"tuned-nmwwq\" (UID: \"82e83454-bcdc-464a-848b-730186df6a59\") " pod="openshift-cluster-node-tuning-operator/tuned-nmwwq" Sep 17 07:08:14.790869 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:14.790842 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/82e83454-bcdc-464a-848b-730186df6a59-sys\") pod \"tuned-nmwwq\" (UID: \"82e83454-bcdc-464a-848b-730186df6a59\") " pod="openshift-cluster-node-tuning-operator/tuned-nmwwq" Sep 17 07:08:14.791243 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:14.790875 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/6299ddb0-0911-4f6c-baa4-7c4559bade5f-host-slash\") pod \"iptables-alerter-bb7gz\" (UID: \"6299ddb0-0911-4f6c-baa4-7c4559bade5f\") " pod="openshift-network-operator/iptables-alerter-bb7gz" Sep 17 07:08:14.791243 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:14.790897 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/ac82b91d-660c-4aeb-8538-2dd48f75e691-dbus\") pod \"global-pull-secret-syncer-btqpf\" (UID: \"ac82b91d-660c-4aeb-8538-2dd48f75e691\") " pod="kube-system/global-pull-secret-syncer-btqpf" Sep 17 07:08:14.791243 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:14.790919 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cb76f3bc-38be-404f-b207-231482554bfe-metrics-certs\") pod \"network-metrics-daemon-25zvh\" (UID: \"cb76f3bc-38be-404f-b207-231482554bfe\") " pod="openshift-multus/network-metrics-daemon-25zvh" Sep 17 07:08:14.791243 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:14.790952 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/37a6b6ba-2423-42bf-ba8a-072efd4cb13a-konnectivity-ca\") pod \"konnectivity-agent-jkzvc\" (UID: \"37a6b6ba-2423-42bf-ba8a-072efd4cb13a\") " pod="kube-system/konnectivity-agent-jkzvc" Sep 17 07:08:14.791243 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:14.790999 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/82e83454-bcdc-464a-848b-730186df6a59-etc-sysconfig\") pod \"tuned-nmwwq\" (UID: \"82e83454-bcdc-464a-848b-730186df6a59\") " pod="openshift-cluster-node-tuning-operator/tuned-nmwwq" Sep 17 07:08:14.791243 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:14.791022 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/82e83454-bcdc-464a-848b-730186df6a59-lib-modules\") pod \"tuned-nmwwq\" (UID: \"82e83454-bcdc-464a-848b-730186df6a59\") " pod="openshift-cluster-node-tuning-operator/tuned-nmwwq" Sep 17 07:08:14.791243 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:14.791043 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/82e83454-bcdc-464a-848b-730186df6a59-host\") pod \"tuned-nmwwq\" (UID: \"82e83454-bcdc-464a-848b-730186df6a59\") " pod="openshift-cluster-node-tuning-operator/tuned-nmwwq" Sep 17 07:08:14.791243 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:14.791069 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ac82b91d-660c-4aeb-8538-2dd48f75e691-original-pull-secret\") pod \"global-pull-secret-syncer-btqpf\" (UID: \"ac82b91d-660c-4aeb-8538-2dd48f75e691\") " pod="kube-system/global-pull-secret-syncer-btqpf" Sep 17 07:08:14.791243 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:14.791091 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/37a6b6ba-2423-42bf-ba8a-072efd4cb13a-agent-certs\") pod \"konnectivity-agent-jkzvc\" (UID: \"37a6b6ba-2423-42bf-ba8a-072efd4cb13a\") " pod="kube-system/konnectivity-agent-jkzvc" Sep 17 07:08:14.791243 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:14.791112 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/82e83454-bcdc-464a-848b-730186df6a59-etc-modprobe-d\") pod \"tuned-nmwwq\" (UID: \"82e83454-bcdc-464a-848b-730186df6a59\") " pod="openshift-cluster-node-tuning-operator/tuned-nmwwq" Sep 17 07:08:14.791243 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:14.791135 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/82e83454-bcdc-464a-848b-730186df6a59-etc-kubernetes\") pod \"tuned-nmwwq\" (UID: \"82e83454-bcdc-464a-848b-730186df6a59\") " pod="openshift-cluster-node-tuning-operator/tuned-nmwwq" Sep 17 07:08:14.791995 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:14.791958 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-b99wz" Sep 17 07:08:14.794103 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:14.794084 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Sep 17 07:08:14.794894 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:14.794596 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Sep 17 07:08:14.794894 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:14.794642 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Sep 17 07:08:14.794894 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:14.794857 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tfqjg" Sep 17 07:08:14.795724 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:14.795702 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Sep 17 07:08:14.795899 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:14.795882 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Sep 17 07:08:14.796143 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:14.796123 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Sep 17 07:08:14.796346 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:14.796327 2559 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Sep 17 07:08:14.797250 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:14.797231 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-x82mg\"" Sep 17 07:08:14.797486 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:14.797465 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Sep 17 07:08:14.797709 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:14.797692 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Sep 17 07:08:14.798028 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:14.798007 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Sep 17 07:08:14.798569 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:14.798543 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-dksgh" Sep 17 07:08:14.800179 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:14.800153 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-4gzfq\"" Sep 17 07:08:14.800660 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:14.800638 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-kf4sp" Sep 17 07:08:14.802511 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:14.802488 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-qzn49\"" Sep 17 07:08:14.802671 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:14.802651 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Sep 17 07:08:14.802906 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:14.802890 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Sep 17 07:08:14.803207 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:14.803188 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-7zx9n\"" Sep 17 07:08:14.803292 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:14.803261 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Sep 17 07:08:14.817663 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:14.817641 2559 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-gdx56" Sep 17 07:08:14.825580 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:14.825562 2559 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-gdx56" Sep 17 07:08:14.882009 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:14.881983 2559 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Sep 17 07:08:14.892309 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:14.892284 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/82e83454-bcdc-464a-848b-730186df6a59-var-lib-kubelet\") pod \"tuned-nmwwq\" (UID: \"82e83454-bcdc-464a-848b-730186df6a59\") " pod="openshift-cluster-node-tuning-operator/tuned-nmwwq" Sep 17 07:08:14.892437 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:14.892318 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/248ebec7-b104-47b9-9187-04bb22c1101a-host\") pod \"node-ca-5c544\" (UID: \"248ebec7-b104-47b9-9187-04bb22c1101a\") " pod="openshift-image-registry/node-ca-5c544" Sep 17 07:08:14.892437 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:14.892342 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/5ae9fb13-f8a8-4999-9023-cebdf2a7bd97-log-socket\") pod \"ovnkube-node-b99wz\" (UID: \"5ae9fb13-f8a8-4999-9023-cebdf2a7bd97\") " pod="openshift-ovn-kubernetes/ovnkube-node-b99wz" Sep 17 07:08:14.892437 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:14.892399 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5ae9fb13-f8a8-4999-9023-cebdf2a7bd97-host-run-ovn-kubernetes\") pod \"ovnkube-node-b99wz\" (UID: \"5ae9fb13-f8a8-4999-9023-cebdf2a7bd97\") " pod="openshift-ovn-kubernetes/ovnkube-node-b99wz" Sep 17 07:08:14.892437 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:14.892427 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/82e83454-bcdc-464a-848b-730186df6a59-var-lib-kubelet\") pod \"tuned-nmwwq\" (UID: \"82e83454-bcdc-464a-848b-730186df6a59\") " pod="openshift-cluster-node-tuning-operator/tuned-nmwwq" Sep 17 07:08:14.892580 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:14.892476 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gp9bs\" (UniqueName: \"kubernetes.io/projected/5ae9fb13-f8a8-4999-9023-cebdf2a7bd97-kube-api-access-gp9bs\") pod \"ovnkube-node-b99wz\" (UID: \"5ae9fb13-f8a8-4999-9023-cebdf2a7bd97\") " pod="openshift-ovn-kubernetes/ovnkube-node-b99wz" Sep 17 07:08:14.892580 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:14.892503 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/bef4b614-ed84-4224-8091-e7d1cd9b0165-device-dir\") pod \"aws-ebs-csi-driver-node-tfqjg\" (UID: \"bef4b614-ed84-4224-8091-e7d1cd9b0165\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tfqjg" Sep 17 07:08:14.892580 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:14.892543 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/983514df-8e0a-4e43-b269-52be4de79e7d-cni-binary-copy\") pod \"multus-dksgh\" (UID: \"983514df-8e0a-4e43-b269-52be4de79e7d\") " pod="openshift-multus/multus-dksgh" Sep 17 07:08:14.892580 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:14.892570 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/983514df-8e0a-4e43-b269-52be4de79e7d-multus-socket-dir-parent\") pod \"multus-dksgh\" (UID: \"983514df-8e0a-4e43-b269-52be4de79e7d\") " pod="openshift-multus/multus-dksgh" Sep 17 07:08:14.892806 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:14.892606 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tksjr\" (UniqueName: \"kubernetes.io/projected/cb76f3bc-38be-404f-b207-231482554bfe-kube-api-access-tksjr\") pod \"network-metrics-daemon-25zvh\" (UID: \"cb76f3bc-38be-404f-b207-231482554bfe\") " pod="openshift-multus/network-metrics-daemon-25zvh" Sep 17 07:08:14.892806 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:14.892636 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/82e83454-bcdc-464a-848b-730186df6a59-run\") pod \"tuned-nmwwq\" (UID: \"82e83454-bcdc-464a-848b-730186df6a59\") " pod="openshift-cluster-node-tuning-operator/tuned-nmwwq" Sep 17 07:08:14.892806 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:14.892661 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/983514df-8e0a-4e43-b269-52be4de79e7d-cnibin\") pod \"multus-dksgh\" (UID: \"983514df-8e0a-4e43-b269-52be4de79e7d\") " pod="openshift-multus/multus-dksgh" Sep 17 07:08:14.892806 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:14.892685 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/983514df-8e0a-4e43-b269-52be4de79e7d-host-run-k8s-cni-cncf-io\") pod \"multus-dksgh\" (UID: \"983514df-8e0a-4e43-b269-52be4de79e7d\") " pod="openshift-multus/multus-dksgh" Sep 17 07:08:14.892806 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:14.892720 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/82e83454-bcdc-464a-848b-730186df6a59-run\") pod \"tuned-nmwwq\" (UID: \"82e83454-bcdc-464a-848b-730186df6a59\") " pod="openshift-cluster-node-tuning-operator/tuned-nmwwq" Sep 17 07:08:14.892806 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:14.892743 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/983514df-8e0a-4e43-b269-52be4de79e7d-host-var-lib-cni-multus\") pod \"multus-dksgh\" (UID: \"983514df-8e0a-4e43-b269-52be4de79e7d\") " pod="openshift-multus/multus-dksgh" Sep 17 07:08:14.892806 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:14.892778 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/983514df-8e0a-4e43-b269-52be4de79e7d-hostroot\") pod \"multus-dksgh\" (UID: \"983514df-8e0a-4e43-b269-52be4de79e7d\") " pod="openshift-multus/multus-dksgh" Sep 17 07:08:14.893097 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:14.892872 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/983514df-8e0a-4e43-b269-52be4de79e7d-host-run-multus-certs\") pod \"multus-dksgh\" (UID: \"983514df-8e0a-4e43-b269-52be4de79e7d\") " pod="openshift-multus/multus-dksgh" Sep 17 07:08:14.893097 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:14.892910 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d2dww\" (UniqueName: \"kubernetes.io/projected/983514df-8e0a-4e43-b269-52be4de79e7d-kube-api-access-d2dww\") pod \"multus-dksgh\" (UID: \"983514df-8e0a-4e43-b269-52be4de79e7d\") " pod="openshift-multus/multus-dksgh" Sep 17 07:08:14.893097 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:14.892937 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/6299ddb0-0911-4f6c-baa4-7c4559bade5f-host-slash\") pod \"iptables-alerter-bb7gz\" (UID: \"6299ddb0-0911-4f6c-baa4-7c4559bade5f\") " pod="openshift-network-operator/iptables-alerter-bb7gz" Sep 17 07:08:14.893097 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:14.892990 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/ac82b91d-660c-4aeb-8538-2dd48f75e691-dbus\") pod \"global-pull-secret-syncer-btqpf\" (UID: \"ac82b91d-660c-4aeb-8538-2dd48f75e691\") " pod="kube-system/global-pull-secret-syncer-btqpf" Sep 17 07:08:14.893097 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:14.893036 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/6299ddb0-0911-4f6c-baa4-7c4559bade5f-host-slash\") pod \"iptables-alerter-bb7gz\" (UID: \"6299ddb0-0911-4f6c-baa4-7c4559bade5f\") " pod="openshift-network-operator/iptables-alerter-bb7gz" Sep 17 07:08:14.893097 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:14.893059 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/ac82b91d-660c-4aeb-8538-2dd48f75e691-dbus\") pod \"global-pull-secret-syncer-btqpf\" (UID: \"ac82b91d-660c-4aeb-8538-2dd48f75e691\") " pod="kube-system/global-pull-secret-syncer-btqpf" Sep 17 07:08:14.893097 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:14.893084 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-29zv7\" (UniqueName: \"kubernetes.io/projected/afdc4eea-caa0-4af7-a1cf-6e0ecb42fd53-kube-api-access-29zv7\") pod \"multus-additional-cni-plugins-bb7bn\" (UID: \"afdc4eea-caa0-4af7-a1cf-6e0ecb42fd53\") " pod="openshift-multus/multus-additional-cni-plugins-bb7bn" Sep 17 07:08:14.893396 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:14.893105 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/5ae9fb13-f8a8-4999-9023-cebdf2a7bd97-ovnkube-script-lib\") pod \"ovnkube-node-b99wz\" (UID: \"5ae9fb13-f8a8-4999-9023-cebdf2a7bd97\") " pod="openshift-ovn-kubernetes/ovnkube-node-b99wz" Sep 17 07:08:14.893396 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:14.893129 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/bef4b614-ed84-4224-8091-e7d1cd9b0165-kubelet-dir\") pod \"aws-ebs-csi-driver-node-tfqjg\" (UID: \"bef4b614-ed84-4224-8091-e7d1cd9b0165\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tfqjg" Sep 17 07:08:14.893396 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:14.893154 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t7c8v\" (UniqueName: \"kubernetes.io/projected/a731e2cb-6abe-4f3a-81ca-d8742a141c4e-kube-api-access-t7c8v\") pod \"node-resolver-kf4sp\" (UID: \"a731e2cb-6abe-4f3a-81ca-d8742a141c4e\") " pod="openshift-dns/node-resolver-kf4sp" Sep 17 07:08:14.893396 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:14.893177 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/5ae9fb13-f8a8-4999-9023-cebdf2a7bd97-host-kubelet\") pod \"ovnkube-node-b99wz\" (UID: \"5ae9fb13-f8a8-4999-9023-cebdf2a7bd97\") " pod="openshift-ovn-kubernetes/ovnkube-node-b99wz" Sep 17 07:08:14.893396 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:14.893200 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/983514df-8e0a-4e43-b269-52be4de79e7d-host-var-lib-cni-bin\") pod \"multus-dksgh\" (UID: \"983514df-8e0a-4e43-b269-52be4de79e7d\") " pod="openshift-multus/multus-dksgh" Sep 17 07:08:14.893396 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:14.893222 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a731e2cb-6abe-4f3a-81ca-d8742a141c4e-tmp-dir\") pod \"node-resolver-kf4sp\" (UID: \"a731e2cb-6abe-4f3a-81ca-d8742a141c4e\") " pod="openshift-dns/node-resolver-kf4sp" Sep 17 07:08:14.893396 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:14.893250 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/ac82b91d-660c-4aeb-8538-2dd48f75e691-kubelet-config\") pod \"global-pull-secret-syncer-btqpf\" (UID: \"ac82b91d-660c-4aeb-8538-2dd48f75e691\") " pod="kube-system/global-pull-secret-syncer-btqpf" Sep 17 07:08:14.893396 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:14.893273 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/5ae9fb13-f8a8-4999-9023-cebdf2a7bd97-host-cni-bin\") pod \"ovnkube-node-b99wz\" (UID: \"5ae9fb13-f8a8-4999-9023-cebdf2a7bd97\") " pod="openshift-ovn-kubernetes/ovnkube-node-b99wz" Sep 17 07:08:14.893396 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:14.893302 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/bef4b614-ed84-4224-8091-e7d1cd9b0165-etc-selinux\") pod \"aws-ebs-csi-driver-node-tfqjg\" (UID: \"bef4b614-ed84-4224-8091-e7d1cd9b0165\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tfqjg" Sep 17 07:08:14.893396 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:14.893337 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/983514df-8e0a-4e43-b269-52be4de79e7d-system-cni-dir\") pod \"multus-dksgh\" (UID: \"983514df-8e0a-4e43-b269-52be4de79e7d\") " pod="openshift-multus/multus-dksgh" Sep 17 07:08:14.893396 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:14.893360 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/5ae9fb13-f8a8-4999-9023-cebdf2a7bd97-env-overrides\") pod \"ovnkube-node-b99wz\" (UID: \"5ae9fb13-f8a8-4999-9023-cebdf2a7bd97\") " pod="openshift-ovn-kubernetes/ovnkube-node-b99wz" Sep 17 07:08:14.893396 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:14.893358 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/ac82b91d-660c-4aeb-8538-2dd48f75e691-kubelet-config\") pod \"global-pull-secret-syncer-btqpf\" (UID: \"ac82b91d-660c-4aeb-8538-2dd48f75e691\") " pod="kube-system/global-pull-secret-syncer-btqpf" Sep 17 07:08:14.893396 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:14.893384 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ndzcc\" (UniqueName: \"kubernetes.io/projected/6299ddb0-0911-4f6c-baa4-7c4559bade5f-kube-api-access-ndzcc\") pod \"iptables-alerter-bb7gz\" (UID: \"6299ddb0-0911-4f6c-baa4-7c4559bade5f\") " pod="openshift-network-operator/iptables-alerter-bb7gz" Sep 17 07:08:14.894066 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:14.893408 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jm9nx\" (UniqueName: \"kubernetes.io/projected/4a9846c2-c1e2-4063-a31f-91190fa6c7a9-kube-api-access-jm9nx\") pod \"network-check-target-b768z\" (UID: \"4a9846c2-c1e2-4063-a31f-91190fa6c7a9\") " pod="openshift-network-diagnostics/network-check-target-b768z" Sep 17 07:08:14.894066 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:14.893435 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/afdc4eea-caa0-4af7-a1cf-6e0ecb42fd53-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-bb7bn\" (UID: \"afdc4eea-caa0-4af7-a1cf-6e0ecb42fd53\") " pod="openshift-multus/multus-additional-cni-plugins-bb7bn" Sep 17 07:08:14.894066 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:14.893460 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/5ae9fb13-f8a8-4999-9023-cebdf2a7bd97-ovn-node-metrics-cert\") pod \"ovnkube-node-b99wz\" (UID: \"5ae9fb13-f8a8-4999-9023-cebdf2a7bd97\") " pod="openshift-ovn-kubernetes/ovnkube-node-b99wz" Sep 17 07:08:14.894066 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:14.893484 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bgd2f\" (UniqueName: \"kubernetes.io/projected/82e83454-bcdc-464a-848b-730186df6a59-kube-api-access-bgd2f\") pod \"tuned-nmwwq\" (UID: \"82e83454-bcdc-464a-848b-730186df6a59\") " pod="openshift-cluster-node-tuning-operator/tuned-nmwwq" Sep 17 07:08:14.894066 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:14.893509 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/37a6b6ba-2423-42bf-ba8a-072efd4cb13a-konnectivity-ca\") pod \"konnectivity-agent-jkzvc\" (UID: \"37a6b6ba-2423-42bf-ba8a-072efd4cb13a\") " pod="kube-system/konnectivity-agent-jkzvc" Sep 17 07:08:14.894066 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:14.893533 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/afdc4eea-caa0-4af7-a1cf-6e0ecb42fd53-system-cni-dir\") pod \"multus-additional-cni-plugins-bb7bn\" (UID: \"afdc4eea-caa0-4af7-a1cf-6e0ecb42fd53\") " pod="openshift-multus/multus-additional-cni-plugins-bb7bn" Sep 17 07:08:14.894066 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:14.893549 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/afdc4eea-caa0-4af7-a1cf-6e0ecb42fd53-cnibin\") pod \"multus-additional-cni-plugins-bb7bn\" (UID: \"afdc4eea-caa0-4af7-a1cf-6e0ecb42fd53\") " pod="openshift-multus/multus-additional-cni-plugins-bb7bn" Sep 17 07:08:14.894066 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:14.893566 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/bef4b614-ed84-4224-8091-e7d1cd9b0165-socket-dir\") pod \"aws-ebs-csi-driver-node-tfqjg\" (UID: \"bef4b614-ed84-4224-8091-e7d1cd9b0165\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tfqjg" Sep 17 07:08:14.894066 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:14.893617 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/983514df-8e0a-4e43-b269-52be4de79e7d-host-run-netns\") pod \"multus-dksgh\" (UID: \"983514df-8e0a-4e43-b269-52be4de79e7d\") " pod="openshift-multus/multus-dksgh" Sep 17 07:08:14.894066 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:14.893694 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ac82b91d-660c-4aeb-8538-2dd48f75e691-original-pull-secret\") pod \"global-pull-secret-syncer-btqpf\" (UID: \"ac82b91d-660c-4aeb-8538-2dd48f75e691\") " pod="kube-system/global-pull-secret-syncer-btqpf" Sep 17 07:08:14.894066 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:14.893723 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/82e83454-bcdc-464a-848b-730186df6a59-etc-kubernetes\") pod \"tuned-nmwwq\" (UID: \"82e83454-bcdc-464a-848b-730186df6a59\") " pod="openshift-cluster-node-tuning-operator/tuned-nmwwq" Sep 17 07:08:14.894066 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:14.893758 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5ae9fb13-f8a8-4999-9023-cebdf2a7bd97-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-b99wz\" (UID: \"5ae9fb13-f8a8-4999-9023-cebdf2a7bd97\") " pod="openshift-ovn-kubernetes/ovnkube-node-b99wz" Sep 17 07:08:14.894066 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:14.893783 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p25s8\" (UniqueName: \"kubernetes.io/projected/bef4b614-ed84-4224-8091-e7d1cd9b0165-kube-api-access-p25s8\") pod \"aws-ebs-csi-driver-node-tfqjg\" (UID: \"bef4b614-ed84-4224-8091-e7d1cd9b0165\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tfqjg" Sep 17 07:08:14.894066 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:14.893806 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/248ebec7-b104-47b9-9187-04bb22c1101a-serviceca\") pod \"node-ca-5c544\" (UID: \"248ebec7-b104-47b9-9187-04bb22c1101a\") " pod="openshift-image-registry/node-ca-5c544" Sep 17 07:08:14.894066 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:14.893828 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/983514df-8e0a-4e43-b269-52be4de79e7d-multus-daemon-config\") pod \"multus-dksgh\" (UID: \"983514df-8e0a-4e43-b269-52be4de79e7d\") " pod="openshift-multus/multus-dksgh" Sep 17 07:08:14.894066 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:14.893856 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/983514df-8e0a-4e43-b269-52be4de79e7d-etc-kubernetes\") pod \"multus-dksgh\" (UID: \"983514df-8e0a-4e43-b269-52be4de79e7d\") " pod="openshift-multus/multus-dksgh" Sep 17 07:08:14.894874 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:14.893874 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/a731e2cb-6abe-4f3a-81ca-d8742a141c4e-hosts-file\") pod \"node-resolver-kf4sp\" (UID: \"a731e2cb-6abe-4f3a-81ca-d8742a141c4e\") " pod="openshift-dns/node-resolver-kf4sp" Sep 17 07:08:14.894874 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:14.893911 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/82e83454-bcdc-464a-848b-730186df6a59-etc-sysctl-conf\") pod \"tuned-nmwwq\" (UID: \"82e83454-bcdc-464a-848b-730186df6a59\") " pod="openshift-cluster-node-tuning-operator/tuned-nmwwq" Sep 17 07:08:14.894874 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:14.893932 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/5ae9fb13-f8a8-4999-9023-cebdf2a7bd97-ovnkube-config\") pod \"ovnkube-node-b99wz\" (UID: \"5ae9fb13-f8a8-4999-9023-cebdf2a7bd97\") " pod="openshift-ovn-kubernetes/ovnkube-node-b99wz" Sep 17 07:08:14.894874 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:14.893946 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/bef4b614-ed84-4224-8091-e7d1cd9b0165-sys-fs\") pod \"aws-ebs-csi-driver-node-tfqjg\" (UID: \"bef4b614-ed84-4224-8091-e7d1cd9b0165\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tfqjg" Sep 17 07:08:14.894874 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:14.893962 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/82e83454-bcdc-464a-848b-730186df6a59-etc-sysconfig\") pod \"tuned-nmwwq\" (UID: \"82e83454-bcdc-464a-848b-730186df6a59\") " pod="openshift-cluster-node-tuning-operator/tuned-nmwwq" Sep 17 07:08:14.894874 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:14.893994 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/82e83454-bcdc-464a-848b-730186df6a59-host\") pod \"tuned-nmwwq\" (UID: \"82e83454-bcdc-464a-848b-730186df6a59\") " pod="openshift-cluster-node-tuning-operator/tuned-nmwwq" Sep 17 07:08:14.894874 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:14.894048 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/5ae9fb13-f8a8-4999-9023-cebdf2a7bd97-systemd-units\") pod \"ovnkube-node-b99wz\" (UID: \"5ae9fb13-f8a8-4999-9023-cebdf2a7bd97\") " pod="openshift-ovn-kubernetes/ovnkube-node-b99wz" Sep 17 07:08:14.894874 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:14.894069 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/5ae9fb13-f8a8-4999-9023-cebdf2a7bd97-host-slash\") pod \"ovnkube-node-b99wz\" (UID: \"5ae9fb13-f8a8-4999-9023-cebdf2a7bd97\") " pod="openshift-ovn-kubernetes/ovnkube-node-b99wz" Sep 17 07:08:14.894874 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:14.894087 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/5ae9fb13-f8a8-4999-9023-cebdf2a7bd97-var-lib-openvswitch\") pod \"ovnkube-node-b99wz\" (UID: \"5ae9fb13-f8a8-4999-9023-cebdf2a7bd97\") " pod="openshift-ovn-kubernetes/ovnkube-node-b99wz" Sep 17 07:08:14.894874 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:14.894100 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/5ae9fb13-f8a8-4999-9023-cebdf2a7bd97-run-ovn\") pod \"ovnkube-node-b99wz\" (UID: \"5ae9fb13-f8a8-4999-9023-cebdf2a7bd97\") " pod="openshift-ovn-kubernetes/ovnkube-node-b99wz" Sep 17 07:08:14.894874 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:14.894118 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/82e83454-bcdc-464a-848b-730186df6a59-etc-modprobe-d\") pod \"tuned-nmwwq\" (UID: \"82e83454-bcdc-464a-848b-730186df6a59\") " pod="openshift-cluster-node-tuning-operator/tuned-nmwwq" Sep 17 07:08:14.894874 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:14.894127 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/37a6b6ba-2423-42bf-ba8a-072efd4cb13a-konnectivity-ca\") pod \"konnectivity-agent-jkzvc\" (UID: \"37a6b6ba-2423-42bf-ba8a-072efd4cb13a\") " pod="kube-system/konnectivity-agent-jkzvc" Sep 17 07:08:14.894874 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:14.894132 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/5ae9fb13-f8a8-4999-9023-cebdf2a7bd97-host-run-netns\") pod \"ovnkube-node-b99wz\" (UID: \"5ae9fb13-f8a8-4999-9023-cebdf2a7bd97\") " pod="openshift-ovn-kubernetes/ovnkube-node-b99wz" Sep 17 07:08:14.894874 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:14.894166 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/82e83454-bcdc-464a-848b-730186df6a59-host\") pod \"tuned-nmwwq\" (UID: \"82e83454-bcdc-464a-848b-730186df6a59\") " pod="openshift-cluster-node-tuning-operator/tuned-nmwwq" Sep 17 07:08:14.894874 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:14.894192 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/bef4b614-ed84-4224-8091-e7d1cd9b0165-registration-dir\") pod \"aws-ebs-csi-driver-node-tfqjg\" (UID: \"bef4b614-ed84-4224-8091-e7d1cd9b0165\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tfqjg" Sep 17 07:08:14.894874 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:14.894220 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/983514df-8e0a-4e43-b269-52be4de79e7d-multus-conf-dir\") pod \"multus-dksgh\" (UID: \"983514df-8e0a-4e43-b269-52be4de79e7d\") " pod="openshift-multus/multus-dksgh" Sep 17 07:08:14.894874 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:14.894233 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/82e83454-bcdc-464a-848b-730186df6a59-etc-kubernetes\") pod \"tuned-nmwwq\" (UID: \"82e83454-bcdc-464a-848b-730186df6a59\") " pod="openshift-cluster-node-tuning-operator/tuned-nmwwq" Sep 17 07:08:14.895637 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:14.894246 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/afdc4eea-caa0-4af7-a1cf-6e0ecb42fd53-tuning-conf-dir\") pod \"multus-additional-cni-plugins-bb7bn\" (UID: \"afdc4eea-caa0-4af7-a1cf-6e0ecb42fd53\") " pod="openshift-multus/multus-additional-cni-plugins-bb7bn" Sep 17 07:08:14.895637 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:14.894271 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/5ae9fb13-f8a8-4999-9023-cebdf2a7bd97-run-systemd\") pod \"ovnkube-node-b99wz\" (UID: \"5ae9fb13-f8a8-4999-9023-cebdf2a7bd97\") " pod="openshift-ovn-kubernetes/ovnkube-node-b99wz" Sep 17 07:08:14.895637 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:14.894295 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/5ae9fb13-f8a8-4999-9023-cebdf2a7bd97-node-log\") pod \"ovnkube-node-b99wz\" (UID: \"5ae9fb13-f8a8-4999-9023-cebdf2a7bd97\") " pod="openshift-ovn-kubernetes/ovnkube-node-b99wz" Sep 17 07:08:14.895637 ip-10-0-138-13 kubenswrapper[2559]: E0917 07:08:14.894301 2559 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 17 07:08:14.895637 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:14.894330 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/6299ddb0-0911-4f6c-baa4-7c4559bade5f-iptables-alerter-script\") pod \"iptables-alerter-bb7gz\" (UID: \"6299ddb0-0911-4f6c-baa4-7c4559bade5f\") " pod="openshift-network-operator/iptables-alerter-bb7gz" Sep 17 07:08:14.895637 ip-10-0-138-13 kubenswrapper[2559]: E0917 07:08:14.894365 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ac82b91d-660c-4aeb-8538-2dd48f75e691-original-pull-secret podName:ac82b91d-660c-4aeb-8538-2dd48f75e691 nodeName:}" failed. No retries permitted until 2026-09-17 07:08:15.394335763 +0000 UTC m=+2.942482466 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/ac82b91d-660c-4aeb-8538-2dd48f75e691-original-pull-secret") pod "global-pull-secret-syncer-btqpf" (UID: "ac82b91d-660c-4aeb-8538-2dd48f75e691") : object "kube-system"/"original-pull-secret" not registered Sep 17 07:08:14.895637 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:14.894383 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/82e83454-bcdc-464a-848b-730186df6a59-etc-sysctl-d\") pod \"tuned-nmwwq\" (UID: \"82e83454-bcdc-464a-848b-730186df6a59\") " pod="openshift-cluster-node-tuning-operator/tuned-nmwwq" Sep 17 07:08:14.895637 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:14.894399 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/82e83454-bcdc-464a-848b-730186df6a59-etc-systemd\") pod \"tuned-nmwwq\" (UID: \"82e83454-bcdc-464a-848b-730186df6a59\") " pod="openshift-cluster-node-tuning-operator/tuned-nmwwq" Sep 17 07:08:14.895637 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:14.894417 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/82e83454-bcdc-464a-848b-730186df6a59-sys\") pod \"tuned-nmwwq\" (UID: \"82e83454-bcdc-464a-848b-730186df6a59\") " pod="openshift-cluster-node-tuning-operator/tuned-nmwwq" Sep 17 07:08:14.895637 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:14.894609 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/82e83454-bcdc-464a-848b-730186df6a59-lib-modules\") pod \"tuned-nmwwq\" (UID: \"82e83454-bcdc-464a-848b-730186df6a59\") " pod="openshift-cluster-node-tuning-operator/tuned-nmwwq" Sep 17 07:08:14.895637 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:14.894624 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/82e83454-bcdc-464a-848b-730186df6a59-etc-systemd\") pod \"tuned-nmwwq\" (UID: \"82e83454-bcdc-464a-848b-730186df6a59\") " pod="openshift-cluster-node-tuning-operator/tuned-nmwwq" Sep 17 07:08:14.895637 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:14.894635 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/82e83454-bcdc-464a-848b-730186df6a59-sys\") pod \"tuned-nmwwq\" (UID: \"82e83454-bcdc-464a-848b-730186df6a59\") " pod="openshift-cluster-node-tuning-operator/tuned-nmwwq" Sep 17 07:08:14.895637 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:14.894647 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/afdc4eea-caa0-4af7-a1cf-6e0ecb42fd53-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-bb7bn\" (UID: \"afdc4eea-caa0-4af7-a1cf-6e0ecb42fd53\") " pod="openshift-multus/multus-additional-cni-plugins-bb7bn" Sep 17 07:08:14.895637 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:14.894678 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/82e83454-bcdc-464a-848b-730186df6a59-etc-sysconfig\") pod \"tuned-nmwwq\" (UID: \"82e83454-bcdc-464a-848b-730186df6a59\") " pod="openshift-cluster-node-tuning-operator/tuned-nmwwq" Sep 17 07:08:14.895637 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:14.894678 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/5ae9fb13-f8a8-4999-9023-cebdf2a7bd97-etc-openvswitch\") pod \"ovnkube-node-b99wz\" (UID: \"5ae9fb13-f8a8-4999-9023-cebdf2a7bd97\") " pod="openshift-ovn-kubernetes/ovnkube-node-b99wz" Sep 17 07:08:14.895637 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:14.894709 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/82e83454-bcdc-464a-848b-730186df6a59-etc-tuned\") pod \"tuned-nmwwq\" (UID: \"82e83454-bcdc-464a-848b-730186df6a59\") " pod="openshift-cluster-node-tuning-operator/tuned-nmwwq" Sep 17 07:08:14.895637 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:14.894732 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cb76f3bc-38be-404f-b207-231482554bfe-metrics-certs\") pod \"network-metrics-daemon-25zvh\" (UID: \"cb76f3bc-38be-404f-b207-231482554bfe\") " pod="openshift-multus/network-metrics-daemon-25zvh" Sep 17 07:08:14.896446 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:14.894754 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/82e83454-bcdc-464a-848b-730186df6a59-etc-sysctl-conf\") pod \"tuned-nmwwq\" (UID: \"82e83454-bcdc-464a-848b-730186df6a59\") " pod="openshift-cluster-node-tuning-operator/tuned-nmwwq" Sep 17 07:08:14.896446 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:14.894778 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/82e83454-bcdc-464a-848b-730186df6a59-etc-modprobe-d\") pod \"tuned-nmwwq\" (UID: \"82e83454-bcdc-464a-848b-730186df6a59\") " pod="openshift-cluster-node-tuning-operator/tuned-nmwwq" Sep 17 07:08:14.896446 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:14.894788 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7wpnj\" (UniqueName: \"kubernetes.io/projected/248ebec7-b104-47b9-9187-04bb22c1101a-kube-api-access-7wpnj\") pod \"node-ca-5c544\" (UID: \"248ebec7-b104-47b9-9187-04bb22c1101a\") " pod="openshift-image-registry/node-ca-5c544" Sep 17 07:08:14.896446 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:14.894817 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/6299ddb0-0911-4f6c-baa4-7c4559bade5f-iptables-alerter-script\") pod \"iptables-alerter-bb7gz\" (UID: \"6299ddb0-0911-4f6c-baa4-7c4559bade5f\") " pod="openshift-network-operator/iptables-alerter-bb7gz" Sep 17 07:08:14.896446 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:14.894823 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/afdc4eea-caa0-4af7-a1cf-6e0ecb42fd53-cni-binary-copy\") pod \"multus-additional-cni-plugins-bb7bn\" (UID: \"afdc4eea-caa0-4af7-a1cf-6e0ecb42fd53\") " pod="openshift-multus/multus-additional-cni-plugins-bb7bn" Sep 17 07:08:14.896446 ip-10-0-138-13 kubenswrapper[2559]: E0917 07:08:14.894848 2559 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 17 07:08:14.896446 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:14.894849 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/82e83454-bcdc-464a-848b-730186df6a59-etc-sysctl-d\") pod \"tuned-nmwwq\" (UID: \"82e83454-bcdc-464a-848b-730186df6a59\") " pod="openshift-cluster-node-tuning-operator/tuned-nmwwq" Sep 17 07:08:14.896446 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:14.894873 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/983514df-8e0a-4e43-b269-52be4de79e7d-multus-cni-dir\") pod \"multus-dksgh\" (UID: \"983514df-8e0a-4e43-b269-52be4de79e7d\") " pod="openshift-multus/multus-dksgh" Sep 17 07:08:14.896446 ip-10-0-138-13 kubenswrapper[2559]: E0917 07:08:14.894903 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cb76f3bc-38be-404f-b207-231482554bfe-metrics-certs podName:cb76f3bc-38be-404f-b207-231482554bfe nodeName:}" failed. No retries permitted until 2026-09-17 07:08:15.394889505 +0000 UTC m=+2.943036214 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/cb76f3bc-38be-404f-b207-231482554bfe-metrics-certs") pod "network-metrics-daemon-25zvh" (UID: "cb76f3bc-38be-404f-b207-231482554bfe") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 17 07:08:14.896446 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:14.894936 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/983514df-8e0a-4e43-b269-52be4de79e7d-host-var-lib-kubelet\") pod \"multus-dksgh\" (UID: \"983514df-8e0a-4e43-b269-52be4de79e7d\") " pod="openshift-multus/multus-dksgh" Sep 17 07:08:14.896446 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:14.894928 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/82e83454-bcdc-464a-848b-730186df6a59-lib-modules\") pod \"tuned-nmwwq\" (UID: \"82e83454-bcdc-464a-848b-730186df6a59\") " pod="openshift-cluster-node-tuning-operator/tuned-nmwwq" Sep 17 07:08:14.896446 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:14.894986 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/37a6b6ba-2423-42bf-ba8a-072efd4cb13a-agent-certs\") pod \"konnectivity-agent-jkzvc\" (UID: \"37a6b6ba-2423-42bf-ba8a-072efd4cb13a\") " pod="kube-system/konnectivity-agent-jkzvc" Sep 17 07:08:14.896446 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:14.895019 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/82e83454-bcdc-464a-848b-730186df6a59-tmp\") pod \"tuned-nmwwq\" (UID: \"82e83454-bcdc-464a-848b-730186df6a59\") " pod="openshift-cluster-node-tuning-operator/tuned-nmwwq" Sep 17 07:08:14.896446 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:14.895060 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/5ae9fb13-f8a8-4999-9023-cebdf2a7bd97-run-openvswitch\") pod \"ovnkube-node-b99wz\" (UID: \"5ae9fb13-f8a8-4999-9023-cebdf2a7bd97\") " pod="openshift-ovn-kubernetes/ovnkube-node-b99wz" Sep 17 07:08:14.896446 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:14.895122 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/5ae9fb13-f8a8-4999-9023-cebdf2a7bd97-host-cni-netd\") pod \"ovnkube-node-b99wz\" (UID: \"5ae9fb13-f8a8-4999-9023-cebdf2a7bd97\") " pod="openshift-ovn-kubernetes/ovnkube-node-b99wz" Sep 17 07:08:14.896446 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:14.895217 2559 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Sep 17 07:08:14.897780 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:14.897737 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-13.ec2.internal" event={"ID":"6e31eb7ec87a2342202a2651286e5c55","Type":"ContainerStarted","Data":"ddcf5d7cd4c9e1bc8a25d73de864c7d65a1d7a7a690893c50ee186c89b962379"} Sep 17 07:08:14.898995 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:14.898958 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/82e83454-bcdc-464a-848b-730186df6a59-tmp\") pod \"tuned-nmwwq\" (UID: \"82e83454-bcdc-464a-848b-730186df6a59\") " pod="openshift-cluster-node-tuning-operator/tuned-nmwwq" Sep 17 07:08:14.899095 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:14.899034 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/82e83454-bcdc-464a-848b-730186df6a59-etc-tuned\") pod \"tuned-nmwwq\" (UID: \"82e83454-bcdc-464a-848b-730186df6a59\") " pod="openshift-cluster-node-tuning-operator/tuned-nmwwq" Sep 17 07:08:14.899376 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:14.899357 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/37a6b6ba-2423-42bf-ba8a-072efd4cb13a-agent-certs\") pod \"konnectivity-agent-jkzvc\" (UID: \"37a6b6ba-2423-42bf-ba8a-072efd4cb13a\") " pod="kube-system/konnectivity-agent-jkzvc" Sep 17 07:08:14.899847 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:14.899813 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-13.ec2.internal" event={"ID":"ec0037d84d1fcffd24b5abcb3709fd6b","Type":"ContainerStarted","Data":"c6213d43c84b1c36e37b31391a201138360a4d692746b84e12a8a0f654de0f77"} Sep 17 07:08:14.904306 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:14.904272 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ndzcc\" (UniqueName: \"kubernetes.io/projected/6299ddb0-0911-4f6c-baa4-7c4559bade5f-kube-api-access-ndzcc\") pod \"iptables-alerter-bb7gz\" (UID: \"6299ddb0-0911-4f6c-baa4-7c4559bade5f\") " pod="openshift-network-operator/iptables-alerter-bb7gz" Sep 17 07:08:14.905394 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:14.905363 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bgd2f\" (UniqueName: \"kubernetes.io/projected/82e83454-bcdc-464a-848b-730186df6a59-kube-api-access-bgd2f\") pod \"tuned-nmwwq\" (UID: \"82e83454-bcdc-464a-848b-730186df6a59\") " pod="openshift-cluster-node-tuning-operator/tuned-nmwwq" Sep 17 07:08:14.906230 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:14.906193 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tksjr\" (UniqueName: \"kubernetes.io/projected/cb76f3bc-38be-404f-b207-231482554bfe-kube-api-access-tksjr\") pod \"network-metrics-daemon-25zvh\" (UID: \"cb76f3bc-38be-404f-b207-231482554bfe\") " pod="openshift-multus/network-metrics-daemon-25zvh" Sep 17 07:08:14.996374 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:14.996342 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/5ae9fb13-f8a8-4999-9023-cebdf2a7bd97-node-log\") pod \"ovnkube-node-b99wz\" (UID: \"5ae9fb13-f8a8-4999-9023-cebdf2a7bd97\") " pod="openshift-ovn-kubernetes/ovnkube-node-b99wz" Sep 17 07:08:14.996543 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:14.996380 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/afdc4eea-caa0-4af7-a1cf-6e0ecb42fd53-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-bb7bn\" (UID: \"afdc4eea-caa0-4af7-a1cf-6e0ecb42fd53\") " pod="openshift-multus/multus-additional-cni-plugins-bb7bn" Sep 17 07:08:14.996543 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:14.996442 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/5ae9fb13-f8a8-4999-9023-cebdf2a7bd97-node-log\") pod \"ovnkube-node-b99wz\" (UID: \"5ae9fb13-f8a8-4999-9023-cebdf2a7bd97\") " pod="openshift-ovn-kubernetes/ovnkube-node-b99wz" Sep 17 07:08:14.996543 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:14.996491 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/5ae9fb13-f8a8-4999-9023-cebdf2a7bd97-etc-openvswitch\") pod \"ovnkube-node-b99wz\" (UID: \"5ae9fb13-f8a8-4999-9023-cebdf2a7bd97\") " pod="openshift-ovn-kubernetes/ovnkube-node-b99wz" Sep 17 07:08:14.996543 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:14.996534 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7wpnj\" (UniqueName: \"kubernetes.io/projected/248ebec7-b104-47b9-9187-04bb22c1101a-kube-api-access-7wpnj\") pod \"node-ca-5c544\" (UID: \"248ebec7-b104-47b9-9187-04bb22c1101a\") " pod="openshift-image-registry/node-ca-5c544" Sep 17 07:08:14.996751 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:14.996557 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/afdc4eea-caa0-4af7-a1cf-6e0ecb42fd53-cni-binary-copy\") pod \"multus-additional-cni-plugins-bb7bn\" (UID: \"afdc4eea-caa0-4af7-a1cf-6e0ecb42fd53\") " pod="openshift-multus/multus-additional-cni-plugins-bb7bn" Sep 17 07:08:14.996751 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:14.996580 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/983514df-8e0a-4e43-b269-52be4de79e7d-multus-cni-dir\") pod \"multus-dksgh\" (UID: \"983514df-8e0a-4e43-b269-52be4de79e7d\") " pod="openshift-multus/multus-dksgh" Sep 17 07:08:14.996751 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:14.996605 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/983514df-8e0a-4e43-b269-52be4de79e7d-host-var-lib-kubelet\") pod \"multus-dksgh\" (UID: \"983514df-8e0a-4e43-b269-52be4de79e7d\") " pod="openshift-multus/multus-dksgh" Sep 17 07:08:14.996751 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:14.996667 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/5ae9fb13-f8a8-4999-9023-cebdf2a7bd97-etc-openvswitch\") pod \"ovnkube-node-b99wz\" (UID: \"5ae9fb13-f8a8-4999-9023-cebdf2a7bd97\") " pod="openshift-ovn-kubernetes/ovnkube-node-b99wz" Sep 17 07:08:14.996751 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:14.996695 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/983514df-8e0a-4e43-b269-52be4de79e7d-multus-cni-dir\") pod \"multus-dksgh\" (UID: \"983514df-8e0a-4e43-b269-52be4de79e7d\") " pod="openshift-multus/multus-dksgh" Sep 17 07:08:14.996751 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:14.996718 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/5ae9fb13-f8a8-4999-9023-cebdf2a7bd97-run-openvswitch\") pod \"ovnkube-node-b99wz\" (UID: \"5ae9fb13-f8a8-4999-9023-cebdf2a7bd97\") " pod="openshift-ovn-kubernetes/ovnkube-node-b99wz" Sep 17 07:08:14.996751 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:14.996737 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/983514df-8e0a-4e43-b269-52be4de79e7d-host-var-lib-kubelet\") pod \"multus-dksgh\" (UID: \"983514df-8e0a-4e43-b269-52be4de79e7d\") " pod="openshift-multus/multus-dksgh" Sep 17 07:08:14.996751 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:14.996748 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/5ae9fb13-f8a8-4999-9023-cebdf2a7bd97-host-cni-netd\") pod \"ovnkube-node-b99wz\" (UID: \"5ae9fb13-f8a8-4999-9023-cebdf2a7bd97\") " pod="openshift-ovn-kubernetes/ovnkube-node-b99wz" Sep 17 07:08:14.997175 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:14.996773 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/5ae9fb13-f8a8-4999-9023-cebdf2a7bd97-run-openvswitch\") pod \"ovnkube-node-b99wz\" (UID: \"5ae9fb13-f8a8-4999-9023-cebdf2a7bd97\") " pod="openshift-ovn-kubernetes/ovnkube-node-b99wz" Sep 17 07:08:14.997175 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:14.996776 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/248ebec7-b104-47b9-9187-04bb22c1101a-host\") pod \"node-ca-5c544\" (UID: \"248ebec7-b104-47b9-9187-04bb22c1101a\") " pod="openshift-image-registry/node-ca-5c544" Sep 17 07:08:14.997175 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:14.996801 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/5ae9fb13-f8a8-4999-9023-cebdf2a7bd97-log-socket\") pod \"ovnkube-node-b99wz\" (UID: \"5ae9fb13-f8a8-4999-9023-cebdf2a7bd97\") " pod="openshift-ovn-kubernetes/ovnkube-node-b99wz" Sep 17 07:08:14.997175 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:14.996817 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5ae9fb13-f8a8-4999-9023-cebdf2a7bd97-host-run-ovn-kubernetes\") pod \"ovnkube-node-b99wz\" (UID: \"5ae9fb13-f8a8-4999-9023-cebdf2a7bd97\") " pod="openshift-ovn-kubernetes/ovnkube-node-b99wz" Sep 17 07:08:14.997175 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:14.996818 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/5ae9fb13-f8a8-4999-9023-cebdf2a7bd97-host-cni-netd\") pod \"ovnkube-node-b99wz\" (UID: \"5ae9fb13-f8a8-4999-9023-cebdf2a7bd97\") " pod="openshift-ovn-kubernetes/ovnkube-node-b99wz" Sep 17 07:08:14.997175 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:14.996834 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gp9bs\" (UniqueName: \"kubernetes.io/projected/5ae9fb13-f8a8-4999-9023-cebdf2a7bd97-kube-api-access-gp9bs\") pod \"ovnkube-node-b99wz\" (UID: \"5ae9fb13-f8a8-4999-9023-cebdf2a7bd97\") " pod="openshift-ovn-kubernetes/ovnkube-node-b99wz" Sep 17 07:08:14.997175 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:14.996850 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/bef4b614-ed84-4224-8091-e7d1cd9b0165-device-dir\") pod \"aws-ebs-csi-driver-node-tfqjg\" (UID: \"bef4b614-ed84-4224-8091-e7d1cd9b0165\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tfqjg" Sep 17 07:08:14.997175 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:14.996865 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/983514df-8e0a-4e43-b269-52be4de79e7d-cni-binary-copy\") pod \"multus-dksgh\" (UID: \"983514df-8e0a-4e43-b269-52be4de79e7d\") " pod="openshift-multus/multus-dksgh" Sep 17 07:08:14.997175 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:14.996876 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/5ae9fb13-f8a8-4999-9023-cebdf2a7bd97-log-socket\") pod \"ovnkube-node-b99wz\" (UID: \"5ae9fb13-f8a8-4999-9023-cebdf2a7bd97\") " pod="openshift-ovn-kubernetes/ovnkube-node-b99wz" Sep 17 07:08:14.997175 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:14.996891 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5ae9fb13-f8a8-4999-9023-cebdf2a7bd97-host-run-ovn-kubernetes\") pod \"ovnkube-node-b99wz\" (UID: \"5ae9fb13-f8a8-4999-9023-cebdf2a7bd97\") " pod="openshift-ovn-kubernetes/ovnkube-node-b99wz" Sep 17 07:08:14.997175 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:14.996890 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/248ebec7-b104-47b9-9187-04bb22c1101a-host\") pod \"node-ca-5c544\" (UID: \"248ebec7-b104-47b9-9187-04bb22c1101a\") " pod="openshift-image-registry/node-ca-5c544" Sep 17 07:08:14.997175 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:14.996930 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/983514df-8e0a-4e43-b269-52be4de79e7d-multus-socket-dir-parent\") pod \"multus-dksgh\" (UID: \"983514df-8e0a-4e43-b269-52be4de79e7d\") " pod="openshift-multus/multus-dksgh" Sep 17 07:08:14.997175 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:14.996880 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/983514df-8e0a-4e43-b269-52be4de79e7d-multus-socket-dir-parent\") pod \"multus-dksgh\" (UID: \"983514df-8e0a-4e43-b269-52be4de79e7d\") " pod="openshift-multus/multus-dksgh" Sep 17 07:08:14.997175 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:14.996944 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/afdc4eea-caa0-4af7-a1cf-6e0ecb42fd53-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-bb7bn\" (UID: \"afdc4eea-caa0-4af7-a1cf-6e0ecb42fd53\") " pod="openshift-multus/multus-additional-cni-plugins-bb7bn" Sep 17 07:08:14.997175 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:14.996946 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/bef4b614-ed84-4224-8091-e7d1cd9b0165-device-dir\") pod \"aws-ebs-csi-driver-node-tfqjg\" (UID: \"bef4b614-ed84-4224-8091-e7d1cd9b0165\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tfqjg" Sep 17 07:08:14.997175 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:14.996993 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/983514df-8e0a-4e43-b269-52be4de79e7d-cnibin\") pod \"multus-dksgh\" (UID: \"983514df-8e0a-4e43-b269-52be4de79e7d\") " pod="openshift-multus/multus-dksgh" Sep 17 07:08:14.997175 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:14.997029 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/983514df-8e0a-4e43-b269-52be4de79e7d-host-run-k8s-cni-cncf-io\") pod \"multus-dksgh\" (UID: \"983514df-8e0a-4e43-b269-52be4de79e7d\") " pod="openshift-multus/multus-dksgh" Sep 17 07:08:14.997175 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:14.997035 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/983514df-8e0a-4e43-b269-52be4de79e7d-cnibin\") pod \"multus-dksgh\" (UID: \"983514df-8e0a-4e43-b269-52be4de79e7d\") " pod="openshift-multus/multus-dksgh" Sep 17 07:08:14.998031 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:14.997054 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/983514df-8e0a-4e43-b269-52be4de79e7d-host-var-lib-cni-multus\") pod \"multus-dksgh\" (UID: \"983514df-8e0a-4e43-b269-52be4de79e7d\") " pod="openshift-multus/multus-dksgh" Sep 17 07:08:14.998031 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:14.997070 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/983514df-8e0a-4e43-b269-52be4de79e7d-host-run-k8s-cni-cncf-io\") pod \"multus-dksgh\" (UID: \"983514df-8e0a-4e43-b269-52be4de79e7d\") " pod="openshift-multus/multus-dksgh" Sep 17 07:08:14.998031 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:14.997080 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/983514df-8e0a-4e43-b269-52be4de79e7d-hostroot\") pod \"multus-dksgh\" (UID: \"983514df-8e0a-4e43-b269-52be4de79e7d\") " pod="openshift-multus/multus-dksgh" Sep 17 07:08:14.998031 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:14.997117 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/983514df-8e0a-4e43-b269-52be4de79e7d-host-run-multus-certs\") pod \"multus-dksgh\" (UID: \"983514df-8e0a-4e43-b269-52be4de79e7d\") " pod="openshift-multus/multus-dksgh" Sep 17 07:08:14.998031 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:14.997131 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/afdc4eea-caa0-4af7-a1cf-6e0ecb42fd53-cni-binary-copy\") pod \"multus-additional-cni-plugins-bb7bn\" (UID: \"afdc4eea-caa0-4af7-a1cf-6e0ecb42fd53\") " pod="openshift-multus/multus-additional-cni-plugins-bb7bn" Sep 17 07:08:14.998031 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:14.997142 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/983514df-8e0a-4e43-b269-52be4de79e7d-hostroot\") pod \"multus-dksgh\" (UID: \"983514df-8e0a-4e43-b269-52be4de79e7d\") " pod="openshift-multus/multus-dksgh" Sep 17 07:08:14.998031 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:14.997144 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d2dww\" (UniqueName: \"kubernetes.io/projected/983514df-8e0a-4e43-b269-52be4de79e7d-kube-api-access-d2dww\") pod \"multus-dksgh\" (UID: \"983514df-8e0a-4e43-b269-52be4de79e7d\") " pod="openshift-multus/multus-dksgh" Sep 17 07:08:14.998031 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:14.997182 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-29zv7\" (UniqueName: \"kubernetes.io/projected/afdc4eea-caa0-4af7-a1cf-6e0ecb42fd53-kube-api-access-29zv7\") pod \"multus-additional-cni-plugins-bb7bn\" (UID: \"afdc4eea-caa0-4af7-a1cf-6e0ecb42fd53\") " pod="openshift-multus/multus-additional-cni-plugins-bb7bn" Sep 17 07:08:14.998031 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:14.997175 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/983514df-8e0a-4e43-b269-52be4de79e7d-host-run-multus-certs\") pod \"multus-dksgh\" (UID: \"983514df-8e0a-4e43-b269-52be4de79e7d\") " pod="openshift-multus/multus-dksgh" Sep 17 07:08:14.998031 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:14.997210 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/5ae9fb13-f8a8-4999-9023-cebdf2a7bd97-ovnkube-script-lib\") pod \"ovnkube-node-b99wz\" (UID: \"5ae9fb13-f8a8-4999-9023-cebdf2a7bd97\") " pod="openshift-ovn-kubernetes/ovnkube-node-b99wz" Sep 17 07:08:14.998031 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:14.997239 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/983514df-8e0a-4e43-b269-52be4de79e7d-host-var-lib-cni-multus\") pod \"multus-dksgh\" (UID: \"983514df-8e0a-4e43-b269-52be4de79e7d\") " pod="openshift-multus/multus-dksgh" Sep 17 07:08:14.998031 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:14.997241 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/bef4b614-ed84-4224-8091-e7d1cd9b0165-kubelet-dir\") pod \"aws-ebs-csi-driver-node-tfqjg\" (UID: \"bef4b614-ed84-4224-8091-e7d1cd9b0165\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tfqjg" Sep 17 07:08:14.998031 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:14.997306 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/bef4b614-ed84-4224-8091-e7d1cd9b0165-kubelet-dir\") pod \"aws-ebs-csi-driver-node-tfqjg\" (UID: \"bef4b614-ed84-4224-8091-e7d1cd9b0165\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tfqjg" Sep 17 07:08:14.998031 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:14.997387 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t7c8v\" (UniqueName: \"kubernetes.io/projected/a731e2cb-6abe-4f3a-81ca-d8742a141c4e-kube-api-access-t7c8v\") pod \"node-resolver-kf4sp\" (UID: \"a731e2cb-6abe-4f3a-81ca-d8742a141c4e\") " pod="openshift-dns/node-resolver-kf4sp" Sep 17 07:08:14.998031 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:14.997419 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/5ae9fb13-f8a8-4999-9023-cebdf2a7bd97-host-kubelet\") pod \"ovnkube-node-b99wz\" (UID: \"5ae9fb13-f8a8-4999-9023-cebdf2a7bd97\") " pod="openshift-ovn-kubernetes/ovnkube-node-b99wz" Sep 17 07:08:14.998031 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:14.997447 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/983514df-8e0a-4e43-b269-52be4de79e7d-host-var-lib-cni-bin\") pod \"multus-dksgh\" (UID: \"983514df-8e0a-4e43-b269-52be4de79e7d\") " pod="openshift-multus/multus-dksgh" Sep 17 07:08:14.998031 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:14.997495 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/983514df-8e0a-4e43-b269-52be4de79e7d-host-var-lib-cni-bin\") pod \"multus-dksgh\" (UID: \"983514df-8e0a-4e43-b269-52be4de79e7d\") " pod="openshift-multus/multus-dksgh" Sep 17 07:08:14.998843 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:14.997498 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/5ae9fb13-f8a8-4999-9023-cebdf2a7bd97-host-kubelet\") pod \"ovnkube-node-b99wz\" (UID: \"5ae9fb13-f8a8-4999-9023-cebdf2a7bd97\") " pod="openshift-ovn-kubernetes/ovnkube-node-b99wz" Sep 17 07:08:14.998843 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:14.997524 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/983514df-8e0a-4e43-b269-52be4de79e7d-cni-binary-copy\") pod \"multus-dksgh\" (UID: \"983514df-8e0a-4e43-b269-52be4de79e7d\") " pod="openshift-multus/multus-dksgh" Sep 17 07:08:14.998843 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:14.997551 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a731e2cb-6abe-4f3a-81ca-d8742a141c4e-tmp-dir\") pod \"node-resolver-kf4sp\" (UID: \"a731e2cb-6abe-4f3a-81ca-d8742a141c4e\") " pod="openshift-dns/node-resolver-kf4sp" Sep 17 07:08:14.998843 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:14.997587 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/5ae9fb13-f8a8-4999-9023-cebdf2a7bd97-host-cni-bin\") pod \"ovnkube-node-b99wz\" (UID: \"5ae9fb13-f8a8-4999-9023-cebdf2a7bd97\") " pod="openshift-ovn-kubernetes/ovnkube-node-b99wz" Sep 17 07:08:14.998843 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:14.997610 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/bef4b614-ed84-4224-8091-e7d1cd9b0165-etc-selinux\") pod \"aws-ebs-csi-driver-node-tfqjg\" (UID: \"bef4b614-ed84-4224-8091-e7d1cd9b0165\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tfqjg" Sep 17 07:08:14.998843 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:14.997655 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/5ae9fb13-f8a8-4999-9023-cebdf2a7bd97-host-cni-bin\") pod \"ovnkube-node-b99wz\" (UID: \"5ae9fb13-f8a8-4999-9023-cebdf2a7bd97\") " pod="openshift-ovn-kubernetes/ovnkube-node-b99wz" Sep 17 07:08:14.998843 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:14.997667 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/bef4b614-ed84-4224-8091-e7d1cd9b0165-etc-selinux\") pod \"aws-ebs-csi-driver-node-tfqjg\" (UID: \"bef4b614-ed84-4224-8091-e7d1cd9b0165\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tfqjg" Sep 17 07:08:14.998843 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:14.997687 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/983514df-8e0a-4e43-b269-52be4de79e7d-system-cni-dir\") pod \"multus-dksgh\" (UID: \"983514df-8e0a-4e43-b269-52be4de79e7d\") " pod="openshift-multus/multus-dksgh" Sep 17 07:08:14.998843 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:14.997713 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/5ae9fb13-f8a8-4999-9023-cebdf2a7bd97-env-overrides\") pod \"ovnkube-node-b99wz\" (UID: \"5ae9fb13-f8a8-4999-9023-cebdf2a7bd97\") " pod="openshift-ovn-kubernetes/ovnkube-node-b99wz" Sep 17 07:08:14.998843 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:14.997739 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jm9nx\" (UniqueName: \"kubernetes.io/projected/4a9846c2-c1e2-4063-a31f-91190fa6c7a9-kube-api-access-jm9nx\") pod \"network-check-target-b768z\" (UID: \"4a9846c2-c1e2-4063-a31f-91190fa6c7a9\") " pod="openshift-network-diagnostics/network-check-target-b768z" Sep 17 07:08:14.998843 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:14.997767 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/afdc4eea-caa0-4af7-a1cf-6e0ecb42fd53-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-bb7bn\" (UID: \"afdc4eea-caa0-4af7-a1cf-6e0ecb42fd53\") " pod="openshift-multus/multus-additional-cni-plugins-bb7bn" Sep 17 07:08:14.998843 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:14.997793 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/5ae9fb13-f8a8-4999-9023-cebdf2a7bd97-ovn-node-metrics-cert\") pod \"ovnkube-node-b99wz\" (UID: \"5ae9fb13-f8a8-4999-9023-cebdf2a7bd97\") " pod="openshift-ovn-kubernetes/ovnkube-node-b99wz" Sep 17 07:08:14.998843 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:14.997794 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/983514df-8e0a-4e43-b269-52be4de79e7d-system-cni-dir\") pod \"multus-dksgh\" (UID: \"983514df-8e0a-4e43-b269-52be4de79e7d\") " pod="openshift-multus/multus-dksgh" Sep 17 07:08:14.998843 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:14.997830 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a731e2cb-6abe-4f3a-81ca-d8742a141c4e-tmp-dir\") pod \"node-resolver-kf4sp\" (UID: \"a731e2cb-6abe-4f3a-81ca-d8742a141c4e\") " pod="openshift-dns/node-resolver-kf4sp" Sep 17 07:08:14.998843 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:14.997834 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/afdc4eea-caa0-4af7-a1cf-6e0ecb42fd53-system-cni-dir\") pod \"multus-additional-cni-plugins-bb7bn\" (UID: \"afdc4eea-caa0-4af7-a1cf-6e0ecb42fd53\") " pod="openshift-multus/multus-additional-cni-plugins-bb7bn" Sep 17 07:08:14.998843 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:14.997866 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/afdc4eea-caa0-4af7-a1cf-6e0ecb42fd53-system-cni-dir\") pod \"multus-additional-cni-plugins-bb7bn\" (UID: \"afdc4eea-caa0-4af7-a1cf-6e0ecb42fd53\") " pod="openshift-multus/multus-additional-cni-plugins-bb7bn" Sep 17 07:08:14.998843 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:14.997880 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/5ae9fb13-f8a8-4999-9023-cebdf2a7bd97-ovnkube-script-lib\") pod \"ovnkube-node-b99wz\" (UID: \"5ae9fb13-f8a8-4999-9023-cebdf2a7bd97\") " pod="openshift-ovn-kubernetes/ovnkube-node-b99wz" Sep 17 07:08:14.999652 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:14.997882 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/afdc4eea-caa0-4af7-a1cf-6e0ecb42fd53-cnibin\") pod \"multus-additional-cni-plugins-bb7bn\" (UID: \"afdc4eea-caa0-4af7-a1cf-6e0ecb42fd53\") " pod="openshift-multus/multus-additional-cni-plugins-bb7bn" Sep 17 07:08:14.999652 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:14.997934 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/bef4b614-ed84-4224-8091-e7d1cd9b0165-socket-dir\") pod \"aws-ebs-csi-driver-node-tfqjg\" (UID: \"bef4b614-ed84-4224-8091-e7d1cd9b0165\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tfqjg" Sep 17 07:08:14.999652 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:14.997946 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/afdc4eea-caa0-4af7-a1cf-6e0ecb42fd53-cnibin\") pod \"multus-additional-cni-plugins-bb7bn\" (UID: \"afdc4eea-caa0-4af7-a1cf-6e0ecb42fd53\") " pod="openshift-multus/multus-additional-cni-plugins-bb7bn" Sep 17 07:08:14.999652 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:14.997959 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/983514df-8e0a-4e43-b269-52be4de79e7d-host-run-netns\") pod \"multus-dksgh\" (UID: \"983514df-8e0a-4e43-b269-52be4de79e7d\") " pod="openshift-multus/multus-dksgh" Sep 17 07:08:14.999652 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:14.998010 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/983514df-8e0a-4e43-b269-52be4de79e7d-host-run-netns\") pod \"multus-dksgh\" (UID: \"983514df-8e0a-4e43-b269-52be4de79e7d\") " pod="openshift-multus/multus-dksgh" Sep 17 07:08:14.999652 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:14.998017 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5ae9fb13-f8a8-4999-9023-cebdf2a7bd97-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-b99wz\" (UID: \"5ae9fb13-f8a8-4999-9023-cebdf2a7bd97\") " pod="openshift-ovn-kubernetes/ovnkube-node-b99wz" Sep 17 07:08:14.999652 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:14.998044 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p25s8\" (UniqueName: \"kubernetes.io/projected/bef4b614-ed84-4224-8091-e7d1cd9b0165-kube-api-access-p25s8\") pod \"aws-ebs-csi-driver-node-tfqjg\" (UID: \"bef4b614-ed84-4224-8091-e7d1cd9b0165\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tfqjg" Sep 17 07:08:14.999652 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:14.998050 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5ae9fb13-f8a8-4999-9023-cebdf2a7bd97-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-b99wz\" (UID: \"5ae9fb13-f8a8-4999-9023-cebdf2a7bd97\") " pod="openshift-ovn-kubernetes/ovnkube-node-b99wz" Sep 17 07:08:14.999652 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:14.998067 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/248ebec7-b104-47b9-9187-04bb22c1101a-serviceca\") pod \"node-ca-5c544\" (UID: \"248ebec7-b104-47b9-9187-04bb22c1101a\") " pod="openshift-image-registry/node-ca-5c544" Sep 17 07:08:14.999652 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:14.998082 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/bef4b614-ed84-4224-8091-e7d1cd9b0165-socket-dir\") pod \"aws-ebs-csi-driver-node-tfqjg\" (UID: \"bef4b614-ed84-4224-8091-e7d1cd9b0165\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tfqjg" Sep 17 07:08:14.999652 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:14.998108 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/5ae9fb13-f8a8-4999-9023-cebdf2a7bd97-env-overrides\") pod \"ovnkube-node-b99wz\" (UID: \"5ae9fb13-f8a8-4999-9023-cebdf2a7bd97\") " pod="openshift-ovn-kubernetes/ovnkube-node-b99wz" Sep 17 07:08:14.999652 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:14.998129 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/983514df-8e0a-4e43-b269-52be4de79e7d-multus-daemon-config\") pod \"multus-dksgh\" (UID: \"983514df-8e0a-4e43-b269-52be4de79e7d\") " pod="openshift-multus/multus-dksgh" Sep 17 07:08:14.999652 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:14.998165 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/983514df-8e0a-4e43-b269-52be4de79e7d-etc-kubernetes\") pod \"multus-dksgh\" (UID: \"983514df-8e0a-4e43-b269-52be4de79e7d\") " pod="openshift-multus/multus-dksgh" Sep 17 07:08:14.999652 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:14.998212 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/983514df-8e0a-4e43-b269-52be4de79e7d-etc-kubernetes\") pod \"multus-dksgh\" (UID: \"983514df-8e0a-4e43-b269-52be4de79e7d\") " pod="openshift-multus/multus-dksgh" Sep 17 07:08:14.999652 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:14.998241 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/a731e2cb-6abe-4f3a-81ca-d8742a141c4e-hosts-file\") pod \"node-resolver-kf4sp\" (UID: \"a731e2cb-6abe-4f3a-81ca-d8742a141c4e\") " pod="openshift-dns/node-resolver-kf4sp" Sep 17 07:08:14.999652 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:14.998267 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/5ae9fb13-f8a8-4999-9023-cebdf2a7bd97-ovnkube-config\") pod \"ovnkube-node-b99wz\" (UID: \"5ae9fb13-f8a8-4999-9023-cebdf2a7bd97\") " pod="openshift-ovn-kubernetes/ovnkube-node-b99wz" Sep 17 07:08:14.999652 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:14.998291 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/bef4b614-ed84-4224-8091-e7d1cd9b0165-sys-fs\") pod \"aws-ebs-csi-driver-node-tfqjg\" (UID: \"bef4b614-ed84-4224-8091-e7d1cd9b0165\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tfqjg" Sep 17 07:08:15.000419 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:14.998304 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/afdc4eea-caa0-4af7-a1cf-6e0ecb42fd53-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-bb7bn\" (UID: \"afdc4eea-caa0-4af7-a1cf-6e0ecb42fd53\") " pod="openshift-multus/multus-additional-cni-plugins-bb7bn" Sep 17 07:08:15.000419 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:14.998318 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/5ae9fb13-f8a8-4999-9023-cebdf2a7bd97-systemd-units\") pod \"ovnkube-node-b99wz\" (UID: \"5ae9fb13-f8a8-4999-9023-cebdf2a7bd97\") " pod="openshift-ovn-kubernetes/ovnkube-node-b99wz" Sep 17 07:08:15.000419 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:14.998333 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/a731e2cb-6abe-4f3a-81ca-d8742a141c4e-hosts-file\") pod \"node-resolver-kf4sp\" (UID: \"a731e2cb-6abe-4f3a-81ca-d8742a141c4e\") " pod="openshift-dns/node-resolver-kf4sp" Sep 17 07:08:15.000419 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:14.998373 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/bef4b614-ed84-4224-8091-e7d1cd9b0165-sys-fs\") pod \"aws-ebs-csi-driver-node-tfqjg\" (UID: \"bef4b614-ed84-4224-8091-e7d1cd9b0165\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tfqjg" Sep 17 07:08:15.000419 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:14.998388 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/5ae9fb13-f8a8-4999-9023-cebdf2a7bd97-systemd-units\") pod \"ovnkube-node-b99wz\" (UID: \"5ae9fb13-f8a8-4999-9023-cebdf2a7bd97\") " pod="openshift-ovn-kubernetes/ovnkube-node-b99wz" Sep 17 07:08:15.000419 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:14.998421 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/5ae9fb13-f8a8-4999-9023-cebdf2a7bd97-host-slash\") pod \"ovnkube-node-b99wz\" (UID: \"5ae9fb13-f8a8-4999-9023-cebdf2a7bd97\") " pod="openshift-ovn-kubernetes/ovnkube-node-b99wz" Sep 17 07:08:15.000419 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:14.998446 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/5ae9fb13-f8a8-4999-9023-cebdf2a7bd97-var-lib-openvswitch\") pod \"ovnkube-node-b99wz\" (UID: \"5ae9fb13-f8a8-4999-9023-cebdf2a7bd97\") " pod="openshift-ovn-kubernetes/ovnkube-node-b99wz" Sep 17 07:08:15.000419 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:14.998469 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/5ae9fb13-f8a8-4999-9023-cebdf2a7bd97-run-ovn\") pod \"ovnkube-node-b99wz\" (UID: \"5ae9fb13-f8a8-4999-9023-cebdf2a7bd97\") " pod="openshift-ovn-kubernetes/ovnkube-node-b99wz" Sep 17 07:08:15.000419 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:14.998473 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/5ae9fb13-f8a8-4999-9023-cebdf2a7bd97-host-slash\") pod \"ovnkube-node-b99wz\" (UID: \"5ae9fb13-f8a8-4999-9023-cebdf2a7bd97\") " pod="openshift-ovn-kubernetes/ovnkube-node-b99wz" Sep 17 07:08:15.000419 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:14.998519 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/5ae9fb13-f8a8-4999-9023-cebdf2a7bd97-var-lib-openvswitch\") pod \"ovnkube-node-b99wz\" (UID: \"5ae9fb13-f8a8-4999-9023-cebdf2a7bd97\") " pod="openshift-ovn-kubernetes/ovnkube-node-b99wz" Sep 17 07:08:15.000419 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:14.998508 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/5ae9fb13-f8a8-4999-9023-cebdf2a7bd97-host-run-netns\") pod \"ovnkube-node-b99wz\" (UID: \"5ae9fb13-f8a8-4999-9023-cebdf2a7bd97\") " pod="openshift-ovn-kubernetes/ovnkube-node-b99wz" Sep 17 07:08:15.000419 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:14.998540 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/248ebec7-b104-47b9-9187-04bb22c1101a-serviceca\") pod \"node-ca-5c544\" (UID: \"248ebec7-b104-47b9-9187-04bb22c1101a\") " pod="openshift-image-registry/node-ca-5c544" Sep 17 07:08:15.000419 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:14.998556 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/bef4b614-ed84-4224-8091-e7d1cd9b0165-registration-dir\") pod \"aws-ebs-csi-driver-node-tfqjg\" (UID: \"bef4b614-ed84-4224-8091-e7d1cd9b0165\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tfqjg" Sep 17 07:08:15.000419 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:14.998574 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/5ae9fb13-f8a8-4999-9023-cebdf2a7bd97-run-ovn\") pod \"ovnkube-node-b99wz\" (UID: \"5ae9fb13-f8a8-4999-9023-cebdf2a7bd97\") " pod="openshift-ovn-kubernetes/ovnkube-node-b99wz" Sep 17 07:08:15.000419 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:14.998585 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/983514df-8e0a-4e43-b269-52be4de79e7d-multus-conf-dir\") pod \"multus-dksgh\" (UID: \"983514df-8e0a-4e43-b269-52be4de79e7d\") " pod="openshift-multus/multus-dksgh" Sep 17 07:08:15.000419 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:14.998595 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/5ae9fb13-f8a8-4999-9023-cebdf2a7bd97-host-run-netns\") pod \"ovnkube-node-b99wz\" (UID: \"5ae9fb13-f8a8-4999-9023-cebdf2a7bd97\") " pod="openshift-ovn-kubernetes/ovnkube-node-b99wz" Sep 17 07:08:15.000419 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:14.998629 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/983514df-8e0a-4e43-b269-52be4de79e7d-multus-daemon-config\") pod \"multus-dksgh\" (UID: \"983514df-8e0a-4e43-b269-52be4de79e7d\") " pod="openshift-multus/multus-dksgh" Sep 17 07:08:15.001084 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:14.998634 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/afdc4eea-caa0-4af7-a1cf-6e0ecb42fd53-tuning-conf-dir\") pod \"multus-additional-cni-plugins-bb7bn\" (UID: \"afdc4eea-caa0-4af7-a1cf-6e0ecb42fd53\") " pod="openshift-multus/multus-additional-cni-plugins-bb7bn" Sep 17 07:08:15.001084 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:14.998629 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/bef4b614-ed84-4224-8091-e7d1cd9b0165-registration-dir\") pod \"aws-ebs-csi-driver-node-tfqjg\" (UID: \"bef4b614-ed84-4224-8091-e7d1cd9b0165\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tfqjg" Sep 17 07:08:15.001084 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:14.998660 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/5ae9fb13-f8a8-4999-9023-cebdf2a7bd97-run-systemd\") pod \"ovnkube-node-b99wz\" (UID: \"5ae9fb13-f8a8-4999-9023-cebdf2a7bd97\") " pod="openshift-ovn-kubernetes/ovnkube-node-b99wz" Sep 17 07:08:15.001084 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:14.998672 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/983514df-8e0a-4e43-b269-52be4de79e7d-multus-conf-dir\") pod \"multus-dksgh\" (UID: \"983514df-8e0a-4e43-b269-52be4de79e7d\") " pod="openshift-multus/multus-dksgh" Sep 17 07:08:15.001084 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:14.998721 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/5ae9fb13-f8a8-4999-9023-cebdf2a7bd97-run-systemd\") pod \"ovnkube-node-b99wz\" (UID: \"5ae9fb13-f8a8-4999-9023-cebdf2a7bd97\") " pod="openshift-ovn-kubernetes/ovnkube-node-b99wz" Sep 17 07:08:15.001084 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:14.998767 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/5ae9fb13-f8a8-4999-9023-cebdf2a7bd97-ovnkube-config\") pod \"ovnkube-node-b99wz\" (UID: \"5ae9fb13-f8a8-4999-9023-cebdf2a7bd97\") " pod="openshift-ovn-kubernetes/ovnkube-node-b99wz" Sep 17 07:08:15.001084 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:14.998790 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/afdc4eea-caa0-4af7-a1cf-6e0ecb42fd53-tuning-conf-dir\") pod \"multus-additional-cni-plugins-bb7bn\" (UID: \"afdc4eea-caa0-4af7-a1cf-6e0ecb42fd53\") " pod="openshift-multus/multus-additional-cni-plugins-bb7bn" Sep 17 07:08:15.001084 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:15.000522 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/5ae9fb13-f8a8-4999-9023-cebdf2a7bd97-ovn-node-metrics-cert\") pod \"ovnkube-node-b99wz\" (UID: \"5ae9fb13-f8a8-4999-9023-cebdf2a7bd97\") " pod="openshift-ovn-kubernetes/ovnkube-node-b99wz" Sep 17 07:08:15.006709 ip-10-0-138-13 kubenswrapper[2559]: E0917 07:08:15.006684 2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 17 07:08:15.006826 ip-10-0-138-13 kubenswrapper[2559]: E0917 07:08:15.006712 2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 17 07:08:15.006826 ip-10-0-138-13 kubenswrapper[2559]: E0917 07:08:15.006725 2559 projected.go:196] Error preparing data for projected volume kube-api-access-jm9nx for pod openshift-network-diagnostics/network-check-target-b768z: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 17 07:08:15.006826 ip-10-0-138-13 kubenswrapper[2559]: E0917 07:08:15.006786 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4a9846c2-c1e2-4063-a31f-91190fa6c7a9-kube-api-access-jm9nx podName:4a9846c2-c1e2-4063-a31f-91190fa6c7a9 nodeName:}" failed. No retries permitted until 2026-09-17 07:08:15.506765563 +0000 UTC m=+3.054912279 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-jm9nx" (UniqueName: "kubernetes.io/projected/4a9846c2-c1e2-4063-a31f-91190fa6c7a9-kube-api-access-jm9nx") pod "network-check-target-b768z" (UID: "4a9846c2-c1e2-4063-a31f-91190fa6c7a9") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 17 07:08:15.009084 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:15.009057 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-p25s8\" (UniqueName: \"kubernetes.io/projected/bef4b614-ed84-4224-8091-e7d1cd9b0165-kube-api-access-p25s8\") pod \"aws-ebs-csi-driver-node-tfqjg\" (UID: \"bef4b614-ed84-4224-8091-e7d1cd9b0165\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tfqjg" Sep 17 07:08:15.010163 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:15.010114 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-t7c8v\" (UniqueName: \"kubernetes.io/projected/a731e2cb-6abe-4f3a-81ca-d8742a141c4e-kube-api-access-t7c8v\") pod \"node-resolver-kf4sp\" (UID: \"a731e2cb-6abe-4f3a-81ca-d8742a141c4e\") " pod="openshift-dns/node-resolver-kf4sp" Sep 17 07:08:15.010163 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:15.010132 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7wpnj\" (UniqueName: \"kubernetes.io/projected/248ebec7-b104-47b9-9187-04bb22c1101a-kube-api-access-7wpnj\") pod \"node-ca-5c544\" (UID: \"248ebec7-b104-47b9-9187-04bb22c1101a\") " pod="openshift-image-registry/node-ca-5c544" Sep 17 07:08:15.010313 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:15.010210 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gp9bs\" (UniqueName: \"kubernetes.io/projected/5ae9fb13-f8a8-4999-9023-cebdf2a7bd97-kube-api-access-gp9bs\") pod \"ovnkube-node-b99wz\" (UID: \"5ae9fb13-f8a8-4999-9023-cebdf2a7bd97\") " pod="openshift-ovn-kubernetes/ovnkube-node-b99wz" Sep 17 07:08:15.010573 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:15.010551 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-29zv7\" (UniqueName: \"kubernetes.io/projected/afdc4eea-caa0-4af7-a1cf-6e0ecb42fd53-kube-api-access-29zv7\") pod \"multus-additional-cni-plugins-bb7bn\" (UID: \"afdc4eea-caa0-4af7-a1cf-6e0ecb42fd53\") " pod="openshift-multus/multus-additional-cni-plugins-bb7bn" Sep 17 07:08:15.010651 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:15.010616 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-d2dww\" (UniqueName: \"kubernetes.io/projected/983514df-8e0a-4e43-b269-52be4de79e7d-kube-api-access-d2dww\") pod \"multus-dksgh\" (UID: \"983514df-8e0a-4e43-b269-52be4de79e7d\") " pod="openshift-multus/multus-dksgh" Sep 17 07:08:15.087031 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:15.086999 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-jkzvc" Sep 17 07:08:15.095447 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:15.095426 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-nmwwq" Sep 17 07:08:15.106376 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:15.106345 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-bb7gz" Sep 17 07:08:15.112497 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:15.112479 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-5c544" Sep 17 07:08:15.119016 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:15.118994 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-bb7bn" Sep 17 07:08:15.127717 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:15.127697 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-b99wz" Sep 17 07:08:15.135342 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:15.135325 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tfqjg" Sep 17 07:08:15.142836 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:15.142816 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-dksgh" Sep 17 07:08:15.148267 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:15.148250 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-kf4sp" Sep 17 07:08:15.275345 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:15.275269 2559 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Sep 17 07:08:15.401920 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:15.401887 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ac82b91d-660c-4aeb-8538-2dd48f75e691-original-pull-secret\") pod \"global-pull-secret-syncer-btqpf\" (UID: \"ac82b91d-660c-4aeb-8538-2dd48f75e691\") " pod="kube-system/global-pull-secret-syncer-btqpf" Sep 17 07:08:15.402078 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:15.401940 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cb76f3bc-38be-404f-b207-231482554bfe-metrics-certs\") pod \"network-metrics-daemon-25zvh\" (UID: \"cb76f3bc-38be-404f-b207-231482554bfe\") " pod="openshift-multus/network-metrics-daemon-25zvh" Sep 17 07:08:15.402078 ip-10-0-138-13 kubenswrapper[2559]: E0917 07:08:15.402061 2559 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 17 07:08:15.402145 ip-10-0-138-13 kubenswrapper[2559]: E0917 07:08:15.402098 2559 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 17 07:08:15.402145 ip-10-0-138-13 kubenswrapper[2559]: E0917 07:08:15.402118 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ac82b91d-660c-4aeb-8538-2dd48f75e691-original-pull-secret podName:ac82b91d-660c-4aeb-8538-2dd48f75e691 nodeName:}" failed. No retries permitted until 2026-09-17 07:08:16.402103919 +0000 UTC m=+3.950250619 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/ac82b91d-660c-4aeb-8538-2dd48f75e691-original-pull-secret") pod "global-pull-secret-syncer-btqpf" (UID: "ac82b91d-660c-4aeb-8538-2dd48f75e691") : object "kube-system"/"original-pull-secret" not registered Sep 17 07:08:15.402230 ip-10-0-138-13 kubenswrapper[2559]: E0917 07:08:15.402147 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cb76f3bc-38be-404f-b207-231482554bfe-metrics-certs podName:cb76f3bc-38be-404f-b207-231482554bfe nodeName:}" failed. No retries permitted until 2026-09-17 07:08:16.402135138 +0000 UTC m=+3.950281844 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/cb76f3bc-38be-404f-b207-231482554bfe-metrics-certs") pod "network-metrics-daemon-25zvh" (UID: "cb76f3bc-38be-404f-b207-231482554bfe") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 17 07:08:15.603321 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:15.603230 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jm9nx\" (UniqueName: \"kubernetes.io/projected/4a9846c2-c1e2-4063-a31f-91190fa6c7a9-kube-api-access-jm9nx\") pod \"network-check-target-b768z\" (UID: \"4a9846c2-c1e2-4063-a31f-91190fa6c7a9\") " pod="openshift-network-diagnostics/network-check-target-b768z" Sep 17 07:08:15.603491 ip-10-0-138-13 kubenswrapper[2559]: E0917 07:08:15.603405 2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 17 07:08:15.603491 ip-10-0-138-13 kubenswrapper[2559]: E0917 07:08:15.603434 2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 17 07:08:15.603491 ip-10-0-138-13 kubenswrapper[2559]: E0917 07:08:15.603445 2559 projected.go:196] Error preparing data for projected volume kube-api-access-jm9nx for pod openshift-network-diagnostics/network-check-target-b768z: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 17 07:08:15.603655 ip-10-0-138-13 kubenswrapper[2559]: E0917 07:08:15.603494 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4a9846c2-c1e2-4063-a31f-91190fa6c7a9-kube-api-access-jm9nx podName:4a9846c2-c1e2-4063-a31f-91190fa6c7a9 nodeName:}" failed. No retries permitted until 2026-09-17 07:08:16.603481813 +0000 UTC m=+4.151628501 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-jm9nx" (UniqueName: "kubernetes.io/projected/4a9846c2-c1e2-4063-a31f-91190fa6c7a9-kube-api-access-jm9nx") pod "network-check-target-b768z" (UID: "4a9846c2-c1e2-4063-a31f-91190fa6c7a9") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 17 07:08:15.829566 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:15.829535 2559 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-16 07:03:14 +0000 UTC" deadline="2028-04-06 02:42:02.348002132 +0000 UTC" Sep 17 07:08:15.829566 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:15.829562 2559 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13603h33m46.518443721s" Sep 17 07:08:15.874255 ip-10-0-138-13 kubenswrapper[2559]: W0917 07:08:15.874225 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod82e83454_bcdc_464a_848b_730186df6a59.slice/crio-adcbc2d81a20824983e0b9b0b707d4dc1e34f7057e00b4cf0d06cb369c4312e0 WatchSource:0}: Error finding container adcbc2d81a20824983e0b9b0b707d4dc1e34f7057e00b4cf0d06cb369c4312e0: Status 404 returned error can't find the container with id adcbc2d81a20824983e0b9b0b707d4dc1e34f7057e00b4cf0d06cb369c4312e0 Sep 17 07:08:15.875200 ip-10-0-138-13 kubenswrapper[2559]: W0917 07:08:15.875176 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5ae9fb13_f8a8_4999_9023_cebdf2a7bd97.slice/crio-2734bc3c87f7c0a5060bfeaf6f495eb3f09fccac974196ad1eb08376c4b78a2c WatchSource:0}: Error finding container 2734bc3c87f7c0a5060bfeaf6f495eb3f09fccac974196ad1eb08376c4b78a2c: Status 404 returned error can't find the container with id 2734bc3c87f7c0a5060bfeaf6f495eb3f09fccac974196ad1eb08376c4b78a2c Sep 17 07:08:15.875900 ip-10-0-138-13 kubenswrapper[2559]: W0917 07:08:15.875761 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod983514df_8e0a_4e43_b269_52be4de79e7d.slice/crio-e1963f3e66c10eb201b1f105e522d031a7297f9e42c7950b822f413b8c149902 WatchSource:0}: Error finding container e1963f3e66c10eb201b1f105e522d031a7297f9e42c7950b822f413b8c149902: Status 404 returned error can't find the container with id e1963f3e66c10eb201b1f105e522d031a7297f9e42c7950b822f413b8c149902 Sep 17 07:08:15.877269 ip-10-0-138-13 kubenswrapper[2559]: W0917 07:08:15.877092 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbef4b614_ed84_4224_8091_e7d1cd9b0165.slice/crio-174d886b5ae3a5eca935e50a0fa1ddbd6300e8cc55dd3c278ef00d433191de1c WatchSource:0}: Error finding container 174d886b5ae3a5eca935e50a0fa1ddbd6300e8cc55dd3c278ef00d433191de1c: Status 404 returned error can't find the container with id 174d886b5ae3a5eca935e50a0fa1ddbd6300e8cc55dd3c278ef00d433191de1c Sep 17 07:08:15.880234 ip-10-0-138-13 kubenswrapper[2559]: W0917 07:08:15.880213 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda731e2cb_6abe_4f3a_81ca_d8742a141c4e.slice/crio-b79f9c1255fe1b7187ebade5e926e2920890dd9a0700a15b2860d47936f9feef WatchSource:0}: Error finding container b79f9c1255fe1b7187ebade5e926e2920890dd9a0700a15b2860d47936f9feef: Status 404 returned error can't find the container with id b79f9c1255fe1b7187ebade5e926e2920890dd9a0700a15b2860d47936f9feef Sep 17 07:08:15.881039 ip-10-0-138-13 kubenswrapper[2559]: W0917 07:08:15.881019 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6299ddb0_0911_4f6c_baa4_7c4559bade5f.slice/crio-4e21a008c9ed0b37021def8ee32f77add45c254c3a7ceedb401afdf2177241da WatchSource:0}: Error finding container 4e21a008c9ed0b37021def8ee32f77add45c254c3a7ceedb401afdf2177241da: Status 404 returned error can't find the container with id 4e21a008c9ed0b37021def8ee32f77add45c254c3a7ceedb401afdf2177241da Sep 17 07:08:15.882530 ip-10-0-138-13 kubenswrapper[2559]: W0917 07:08:15.882468 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod248ebec7_b104_47b9_9187_04bb22c1101a.slice/crio-1c921d1d0bcdf1b621e56b4dab01c98cfb0854df257c69377efc206a380cff4c WatchSource:0}: Error finding container 1c921d1d0bcdf1b621e56b4dab01c98cfb0854df257c69377efc206a380cff4c: Status 404 returned error can't find the container with id 1c921d1d0bcdf1b621e56b4dab01c98cfb0854df257c69377efc206a380cff4c Sep 17 07:08:15.883744 ip-10-0-138-13 kubenswrapper[2559]: W0917 07:08:15.883045 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podafdc4eea_caa0_4af7_a1cf_6e0ecb42fd53.slice/crio-2a7a71773db2a7d227f06e81f9d33b008290f3c56b6455d8e2c9eacb551172b7 WatchSource:0}: Error finding container 2a7a71773db2a7d227f06e81f9d33b008290f3c56b6455d8e2c9eacb551172b7: Status 404 returned error can't find the container with id 2a7a71773db2a7d227f06e81f9d33b008290f3c56b6455d8e2c9eacb551172b7 Sep 17 07:08:15.902914 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:15.902887 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-jkzvc" event={"ID":"37a6b6ba-2423-42bf-ba8a-072efd4cb13a","Type":"ContainerStarted","Data":"731726221bf8cfb376a7b3eadcae61194d8114ed3fd9d520ad33b2883b2fde8a"} Sep 17 07:08:15.904230 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:15.904208 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-5c544" event={"ID":"248ebec7-b104-47b9-9187-04bb22c1101a","Type":"ContainerStarted","Data":"1c921d1d0bcdf1b621e56b4dab01c98cfb0854df257c69377efc206a380cff4c"} Sep 17 07:08:15.905695 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:15.905669 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-bb7gz" event={"ID":"6299ddb0-0911-4f6c-baa4-7c4559bade5f","Type":"ContainerStarted","Data":"4e21a008c9ed0b37021def8ee32f77add45c254c3a7ceedb401afdf2177241da"} Sep 17 07:08:15.907559 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:15.907530 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tfqjg" event={"ID":"bef4b614-ed84-4224-8091-e7d1cd9b0165","Type":"ContainerStarted","Data":"174d886b5ae3a5eca935e50a0fa1ddbd6300e8cc55dd3c278ef00d433191de1c"} Sep 17 07:08:15.911984 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:15.911948 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-dksgh" event={"ID":"983514df-8e0a-4e43-b269-52be4de79e7d","Type":"ContainerStarted","Data":"e1963f3e66c10eb201b1f105e522d031a7297f9e42c7950b822f413b8c149902"} Sep 17 07:08:15.915323 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:15.915260 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-b99wz" event={"ID":"5ae9fb13-f8a8-4999-9023-cebdf2a7bd97","Type":"ContainerStarted","Data":"2734bc3c87f7c0a5060bfeaf6f495eb3f09fccac974196ad1eb08376c4b78a2c"} Sep 17 07:08:15.917575 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:15.917528 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-nmwwq" event={"ID":"82e83454-bcdc-464a-848b-730186df6a59","Type":"ContainerStarted","Data":"adcbc2d81a20824983e0b9b0b707d4dc1e34f7057e00b4cf0d06cb369c4312e0"} Sep 17 07:08:15.918932 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:15.918907 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-bb7bn" event={"ID":"afdc4eea-caa0-4af7-a1cf-6e0ecb42fd53","Type":"ContainerStarted","Data":"2a7a71773db2a7d227f06e81f9d33b008290f3c56b6455d8e2c9eacb551172b7"} Sep 17 07:08:15.920957 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:15.920930 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-kf4sp" event={"ID":"a731e2cb-6abe-4f3a-81ca-d8742a141c4e","Type":"ContainerStarted","Data":"b79f9c1255fe1b7187ebade5e926e2920890dd9a0700a15b2860d47936f9feef"} Sep 17 07:08:16.409088 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:16.408694 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cb76f3bc-38be-404f-b207-231482554bfe-metrics-certs\") pod \"network-metrics-daemon-25zvh\" (UID: \"cb76f3bc-38be-404f-b207-231482554bfe\") " pod="openshift-multus/network-metrics-daemon-25zvh" Sep 17 07:08:16.409088 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:16.408783 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ac82b91d-660c-4aeb-8538-2dd48f75e691-original-pull-secret\") pod \"global-pull-secret-syncer-btqpf\" (UID: \"ac82b91d-660c-4aeb-8538-2dd48f75e691\") " pod="kube-system/global-pull-secret-syncer-btqpf" Sep 17 07:08:16.409088 ip-10-0-138-13 kubenswrapper[2559]: E0917 07:08:16.408894 2559 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 17 07:08:16.409088 ip-10-0-138-13 kubenswrapper[2559]: E0917 07:08:16.408956 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ac82b91d-660c-4aeb-8538-2dd48f75e691-original-pull-secret podName:ac82b91d-660c-4aeb-8538-2dd48f75e691 nodeName:}" failed. No retries permitted until 2026-09-17 07:08:18.408938753 +0000 UTC m=+5.957085460 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/ac82b91d-660c-4aeb-8538-2dd48f75e691-original-pull-secret") pod "global-pull-secret-syncer-btqpf" (UID: "ac82b91d-660c-4aeb-8538-2dd48f75e691") : object "kube-system"/"original-pull-secret" not registered Sep 17 07:08:16.409394 ip-10-0-138-13 kubenswrapper[2559]: E0917 07:08:16.408894 2559 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 17 07:08:16.409394 ip-10-0-138-13 kubenswrapper[2559]: E0917 07:08:16.409352 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cb76f3bc-38be-404f-b207-231482554bfe-metrics-certs podName:cb76f3bc-38be-404f-b207-231482554bfe nodeName:}" failed. No retries permitted until 2026-09-17 07:08:18.409333904 +0000 UTC m=+5.957480608 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/cb76f3bc-38be-404f-b207-231482554bfe-metrics-certs") pod "network-metrics-daemon-25zvh" (UID: "cb76f3bc-38be-404f-b207-231482554bfe") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 17 07:08:16.611199 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:16.611116 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jm9nx\" (UniqueName: \"kubernetes.io/projected/4a9846c2-c1e2-4063-a31f-91190fa6c7a9-kube-api-access-jm9nx\") pod \"network-check-target-b768z\" (UID: \"4a9846c2-c1e2-4063-a31f-91190fa6c7a9\") " pod="openshift-network-diagnostics/network-check-target-b768z" Sep 17 07:08:16.611387 ip-10-0-138-13 kubenswrapper[2559]: E0917 07:08:16.611284 2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 17 07:08:16.611387 ip-10-0-138-13 kubenswrapper[2559]: E0917 07:08:16.611309 2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 17 07:08:16.611387 ip-10-0-138-13 kubenswrapper[2559]: E0917 07:08:16.611322 2559 projected.go:196] Error preparing data for projected volume kube-api-access-jm9nx for pod openshift-network-diagnostics/network-check-target-b768z: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 17 07:08:16.611387 ip-10-0-138-13 kubenswrapper[2559]: E0917 07:08:16.611379 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4a9846c2-c1e2-4063-a31f-91190fa6c7a9-kube-api-access-jm9nx podName:4a9846c2-c1e2-4063-a31f-91190fa6c7a9 nodeName:}" failed. No retries permitted until 2026-09-17 07:08:18.611363195 +0000 UTC m=+6.159509896 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-jm9nx" (UniqueName: "kubernetes.io/projected/4a9846c2-c1e2-4063-a31f-91190fa6c7a9-kube-api-access-jm9nx") pod "network-check-target-b768z" (UID: "4a9846c2-c1e2-4063-a31f-91190fa6c7a9") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 17 07:08:16.830661 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:16.830547 2559 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-16 07:03:14 +0000 UTC" deadline="2028-03-10 16:02:58.448547274 +0000 UTC" Sep 17 07:08:16.830661 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:16.830611 2559 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12968h54m41.61793988s" Sep 17 07:08:16.895179 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:16.895148 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-25zvh" Sep 17 07:08:16.895340 ip-10-0-138-13 kubenswrapper[2559]: E0917 07:08:16.895291 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-25zvh" podUID="cb76f3bc-38be-404f-b207-231482554bfe" Sep 17 07:08:16.895741 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:16.895720 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-btqpf" Sep 17 07:08:16.895836 ip-10-0-138-13 kubenswrapper[2559]: E0917 07:08:16.895817 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-btqpf" podUID="ac82b91d-660c-4aeb-8538-2dd48f75e691" Sep 17 07:08:16.895915 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:16.895886 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-b768z" Sep 17 07:08:16.895986 ip-10-0-138-13 kubenswrapper[2559]: E0917 07:08:16.895960 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-b768z" podUID="4a9846c2-c1e2-4063-a31f-91190fa6c7a9" Sep 17 07:08:16.933996 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:16.933598 2559 generic.go:356] "Generic (PLEG): container finished" podID="ec0037d84d1fcffd24b5abcb3709fd6b" containerID="e8c321fa8c3e66ed0fbda828a4fac56bcd680391db7b51a9ed3b0816711cfdea" exitCode=0 Sep 17 07:08:16.933996 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:16.933691 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-13.ec2.internal" event={"ID":"ec0037d84d1fcffd24b5abcb3709fd6b","Type":"ContainerDied","Data":"e8c321fa8c3e66ed0fbda828a4fac56bcd680391db7b51a9ed3b0816711cfdea"} Sep 17 07:08:16.943351 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:16.942885 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-13.ec2.internal" event={"ID":"6e31eb7ec87a2342202a2651286e5c55","Type":"ContainerStarted","Data":"34717591a311f23e64f4dc1eb3eab62a31e1f44f175458e6c61dbed6c0c0313e"} Sep 17 07:08:17.986948 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:17.986562 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-13.ec2.internal" event={"ID":"ec0037d84d1fcffd24b5abcb3709fd6b","Type":"ContainerStarted","Data":"f01be73544a00984126eab0e176d37f275c06dfb52a2d1af619927f12508eed1"} Sep 17 07:08:18.007312 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:18.006172 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-13.ec2.internal" podStartSLOduration=5.006149888 podStartE2EDuration="5.006149888s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-17 07:08:13 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 07:08:18.006115151 +0000 UTC m=+5.554261861" watchObservedRunningTime="2026-09-17 07:08:18.006149888 +0000 UTC m=+5.554296599" Sep 17 07:08:18.007312 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:18.007180 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-13.ec2.internal" podStartSLOduration=5.007168499 podStartE2EDuration="5.007168499s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-17 07:08:13 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 07:08:16.973594788 +0000 UTC m=+4.521741498" watchObservedRunningTime="2026-09-17 07:08:18.007168499 +0000 UTC m=+5.555315209" Sep 17 07:08:18.427747 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:18.427711 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cb76f3bc-38be-404f-b207-231482554bfe-metrics-certs\") pod \"network-metrics-daemon-25zvh\" (UID: \"cb76f3bc-38be-404f-b207-231482554bfe\") " pod="openshift-multus/network-metrics-daemon-25zvh" Sep 17 07:08:18.427945 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:18.427798 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ac82b91d-660c-4aeb-8538-2dd48f75e691-original-pull-secret\") pod \"global-pull-secret-syncer-btqpf\" (UID: \"ac82b91d-660c-4aeb-8538-2dd48f75e691\") " pod="kube-system/global-pull-secret-syncer-btqpf" Sep 17 07:08:18.427945 ip-10-0-138-13 kubenswrapper[2559]: E0917 07:08:18.427888 2559 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 17 07:08:18.428069 ip-10-0-138-13 kubenswrapper[2559]: E0917 07:08:18.427959 2559 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 17 07:08:18.428069 ip-10-0-138-13 kubenswrapper[2559]: E0917 07:08:18.427988 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cb76f3bc-38be-404f-b207-231482554bfe-metrics-certs podName:cb76f3bc-38be-404f-b207-231482554bfe nodeName:}" failed. No retries permitted until 2026-09-17 07:08:22.427953069 +0000 UTC m=+9.976099775 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/cb76f3bc-38be-404f-b207-231482554bfe-metrics-certs") pod "network-metrics-daemon-25zvh" (UID: "cb76f3bc-38be-404f-b207-231482554bfe") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 17 07:08:18.428069 ip-10-0-138-13 kubenswrapper[2559]: E0917 07:08:18.428030 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ac82b91d-660c-4aeb-8538-2dd48f75e691-original-pull-secret podName:ac82b91d-660c-4aeb-8538-2dd48f75e691 nodeName:}" failed. No retries permitted until 2026-09-17 07:08:22.428014208 +0000 UTC m=+9.976160915 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/ac82b91d-660c-4aeb-8538-2dd48f75e691-original-pull-secret") pod "global-pull-secret-syncer-btqpf" (UID: "ac82b91d-660c-4aeb-8538-2dd48f75e691") : object "kube-system"/"original-pull-secret" not registered Sep 17 07:08:18.630605 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:18.629866 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jm9nx\" (UniqueName: \"kubernetes.io/projected/4a9846c2-c1e2-4063-a31f-91190fa6c7a9-kube-api-access-jm9nx\") pod \"network-check-target-b768z\" (UID: \"4a9846c2-c1e2-4063-a31f-91190fa6c7a9\") " pod="openshift-network-diagnostics/network-check-target-b768z" Sep 17 07:08:18.630605 ip-10-0-138-13 kubenswrapper[2559]: E0917 07:08:18.630113 2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 17 07:08:18.630605 ip-10-0-138-13 kubenswrapper[2559]: E0917 07:08:18.630134 2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 17 07:08:18.630605 ip-10-0-138-13 kubenswrapper[2559]: E0917 07:08:18.630146 2559 projected.go:196] Error preparing data for projected volume kube-api-access-jm9nx for pod openshift-network-diagnostics/network-check-target-b768z: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 17 07:08:18.630605 ip-10-0-138-13 kubenswrapper[2559]: E0917 07:08:18.630213 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4a9846c2-c1e2-4063-a31f-91190fa6c7a9-kube-api-access-jm9nx podName:4a9846c2-c1e2-4063-a31f-91190fa6c7a9 nodeName:}" failed. No retries permitted until 2026-09-17 07:08:22.63018565 +0000 UTC m=+10.178332355 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-jm9nx" (UniqueName: "kubernetes.io/projected/4a9846c2-c1e2-4063-a31f-91190fa6c7a9-kube-api-access-jm9nx") pod "network-check-target-b768z" (UID: "4a9846c2-c1e2-4063-a31f-91190fa6c7a9") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 17 07:08:18.894200 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:18.894126 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-b768z" Sep 17 07:08:18.894358 ip-10-0-138-13 kubenswrapper[2559]: E0917 07:08:18.894256 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-b768z" podUID="4a9846c2-c1e2-4063-a31f-91190fa6c7a9" Sep 17 07:08:18.894712 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:18.894631 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-25zvh" Sep 17 07:08:18.894811 ip-10-0-138-13 kubenswrapper[2559]: E0917 07:08:18.894745 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-25zvh" podUID="cb76f3bc-38be-404f-b207-231482554bfe" Sep 17 07:08:18.895026 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:18.894959 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-btqpf" Sep 17 07:08:18.895162 ip-10-0-138-13 kubenswrapper[2559]: E0917 07:08:18.895085 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-btqpf" podUID="ac82b91d-660c-4aeb-8538-2dd48f75e691" Sep 17 07:08:20.892655 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:20.892625 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-b768z" Sep 17 07:08:20.893092 ip-10-0-138-13 kubenswrapper[2559]: E0917 07:08:20.892730 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-b768z" podUID="4a9846c2-c1e2-4063-a31f-91190fa6c7a9" Sep 17 07:08:20.893092 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:20.893069 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-25zvh" Sep 17 07:08:20.893202 ip-10-0-138-13 kubenswrapper[2559]: E0917 07:08:20.893141 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-25zvh" podUID="cb76f3bc-38be-404f-b207-231482554bfe" Sep 17 07:08:20.893315 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:20.893295 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-btqpf" Sep 17 07:08:20.893401 ip-10-0-138-13 kubenswrapper[2559]: E0917 07:08:20.893384 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-btqpf" podUID="ac82b91d-660c-4aeb-8538-2dd48f75e691" Sep 17 07:08:22.463281 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:22.463246 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ac82b91d-660c-4aeb-8538-2dd48f75e691-original-pull-secret\") pod \"global-pull-secret-syncer-btqpf\" (UID: \"ac82b91d-660c-4aeb-8538-2dd48f75e691\") " pod="kube-system/global-pull-secret-syncer-btqpf" Sep 17 07:08:22.463823 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:22.463312 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cb76f3bc-38be-404f-b207-231482554bfe-metrics-certs\") pod \"network-metrics-daemon-25zvh\" (UID: \"cb76f3bc-38be-404f-b207-231482554bfe\") " pod="openshift-multus/network-metrics-daemon-25zvh" Sep 17 07:08:22.463823 ip-10-0-138-13 kubenswrapper[2559]: E0917 07:08:22.463418 2559 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 17 07:08:22.463823 ip-10-0-138-13 kubenswrapper[2559]: E0917 07:08:22.463422 2559 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 17 07:08:22.463823 ip-10-0-138-13 kubenswrapper[2559]: E0917 07:08:22.463497 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ac82b91d-660c-4aeb-8538-2dd48f75e691-original-pull-secret podName:ac82b91d-660c-4aeb-8538-2dd48f75e691 nodeName:}" failed. No retries permitted until 2026-09-17 07:08:30.463476553 +0000 UTC m=+18.011623259 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/ac82b91d-660c-4aeb-8538-2dd48f75e691-original-pull-secret") pod "global-pull-secret-syncer-btqpf" (UID: "ac82b91d-660c-4aeb-8538-2dd48f75e691") : object "kube-system"/"original-pull-secret" not registered Sep 17 07:08:22.463823 ip-10-0-138-13 kubenswrapper[2559]: E0917 07:08:22.463569 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cb76f3bc-38be-404f-b207-231482554bfe-metrics-certs podName:cb76f3bc-38be-404f-b207-231482554bfe nodeName:}" failed. No retries permitted until 2026-09-17 07:08:30.463551667 +0000 UTC m=+18.011698356 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/cb76f3bc-38be-404f-b207-231482554bfe-metrics-certs") pod "network-metrics-daemon-25zvh" (UID: "cb76f3bc-38be-404f-b207-231482554bfe") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 17 07:08:22.664652 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:22.664617 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jm9nx\" (UniqueName: \"kubernetes.io/projected/4a9846c2-c1e2-4063-a31f-91190fa6c7a9-kube-api-access-jm9nx\") pod \"network-check-target-b768z\" (UID: \"4a9846c2-c1e2-4063-a31f-91190fa6c7a9\") " pod="openshift-network-diagnostics/network-check-target-b768z" Sep 17 07:08:22.664817 ip-10-0-138-13 kubenswrapper[2559]: E0917 07:08:22.664795 2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 17 07:08:22.664890 ip-10-0-138-13 kubenswrapper[2559]: E0917 07:08:22.664819 2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 17 07:08:22.664890 ip-10-0-138-13 kubenswrapper[2559]: E0917 07:08:22.664833 2559 projected.go:196] Error preparing data for projected volume kube-api-access-jm9nx for pod openshift-network-diagnostics/network-check-target-b768z: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 17 07:08:22.665006 ip-10-0-138-13 kubenswrapper[2559]: E0917 07:08:22.664894 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4a9846c2-c1e2-4063-a31f-91190fa6c7a9-kube-api-access-jm9nx podName:4a9846c2-c1e2-4063-a31f-91190fa6c7a9 nodeName:}" failed. No retries permitted until 2026-09-17 07:08:30.664873349 +0000 UTC m=+18.213020056 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-jm9nx" (UniqueName: "kubernetes.io/projected/4a9846c2-c1e2-4063-a31f-91190fa6c7a9-kube-api-access-jm9nx") pod "network-check-target-b768z" (UID: "4a9846c2-c1e2-4063-a31f-91190fa6c7a9") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 17 07:08:22.894349 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:22.893752 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-25zvh" Sep 17 07:08:22.894349 ip-10-0-138-13 kubenswrapper[2559]: E0917 07:08:22.893880 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-25zvh" podUID="cb76f3bc-38be-404f-b207-231482554bfe" Sep 17 07:08:22.894349 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:22.893917 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-btqpf" Sep 17 07:08:22.894349 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:22.893919 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-b768z" Sep 17 07:08:22.894349 ip-10-0-138-13 kubenswrapper[2559]: E0917 07:08:22.894037 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-btqpf" podUID="ac82b91d-660c-4aeb-8538-2dd48f75e691" Sep 17 07:08:22.894349 ip-10-0-138-13 kubenswrapper[2559]: E0917 07:08:22.894082 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-b768z" podUID="4a9846c2-c1e2-4063-a31f-91190fa6c7a9" Sep 17 07:08:24.893435 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:24.893395 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-25zvh" Sep 17 07:08:24.893898 ip-10-0-138-13 kubenswrapper[2559]: E0917 07:08:24.893548 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-25zvh" podUID="cb76f3bc-38be-404f-b207-231482554bfe" Sep 17 07:08:24.893898 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:24.893695 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-btqpf" Sep 17 07:08:24.893898 ip-10-0-138-13 kubenswrapper[2559]: E0917 07:08:24.893795 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-btqpf" podUID="ac82b91d-660c-4aeb-8538-2dd48f75e691" Sep 17 07:08:24.893898 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:24.893872 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-b768z" Sep 17 07:08:24.894130 ip-10-0-138-13 kubenswrapper[2559]: E0917 07:08:24.894000 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-b768z" podUID="4a9846c2-c1e2-4063-a31f-91190fa6c7a9" Sep 17 07:08:26.892728 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:26.892695 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-btqpf" Sep 17 07:08:26.893196 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:26.892695 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-b768z" Sep 17 07:08:26.893196 ip-10-0-138-13 kubenswrapper[2559]: E0917 07:08:26.892829 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-btqpf" podUID="ac82b91d-660c-4aeb-8538-2dd48f75e691" Sep 17 07:08:26.893196 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:26.892713 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-25zvh" Sep 17 07:08:26.893196 ip-10-0-138-13 kubenswrapper[2559]: E0917 07:08:26.892864 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-b768z" podUID="4a9846c2-c1e2-4063-a31f-91190fa6c7a9" Sep 17 07:08:26.893196 ip-10-0-138-13 kubenswrapper[2559]: E0917 07:08:26.892981 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-25zvh" podUID="cb76f3bc-38be-404f-b207-231482554bfe" Sep 17 07:08:28.893195 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:28.893168 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-btqpf" Sep 17 07:08:28.893195 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:28.893189 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-25zvh" Sep 17 07:08:28.893708 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:28.893174 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-b768z" Sep 17 07:08:28.893708 ip-10-0-138-13 kubenswrapper[2559]: E0917 07:08:28.893294 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-btqpf" podUID="ac82b91d-660c-4aeb-8538-2dd48f75e691" Sep 17 07:08:28.893708 ip-10-0-138-13 kubenswrapper[2559]: E0917 07:08:28.893383 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-25zvh" podUID="cb76f3bc-38be-404f-b207-231482554bfe" Sep 17 07:08:28.893708 ip-10-0-138-13 kubenswrapper[2559]: E0917 07:08:28.893461 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-b768z" podUID="4a9846c2-c1e2-4063-a31f-91190fa6c7a9" Sep 17 07:08:30.520024 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:30.519993 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cb76f3bc-38be-404f-b207-231482554bfe-metrics-certs\") pod \"network-metrics-daemon-25zvh\" (UID: \"cb76f3bc-38be-404f-b207-231482554bfe\") " pod="openshift-multus/network-metrics-daemon-25zvh" Sep 17 07:08:30.520517 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:30.520060 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ac82b91d-660c-4aeb-8538-2dd48f75e691-original-pull-secret\") pod \"global-pull-secret-syncer-btqpf\" (UID: \"ac82b91d-660c-4aeb-8538-2dd48f75e691\") " pod="kube-system/global-pull-secret-syncer-btqpf" Sep 17 07:08:30.520517 ip-10-0-138-13 kubenswrapper[2559]: E0917 07:08:30.520144 2559 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 17 07:08:30.520517 ip-10-0-138-13 kubenswrapper[2559]: E0917 07:08:30.520204 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ac82b91d-660c-4aeb-8538-2dd48f75e691-original-pull-secret podName:ac82b91d-660c-4aeb-8538-2dd48f75e691 nodeName:}" failed. No retries permitted until 2026-09-17 07:08:46.520189763 +0000 UTC m=+34.068336467 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/ac82b91d-660c-4aeb-8538-2dd48f75e691-original-pull-secret") pod "global-pull-secret-syncer-btqpf" (UID: "ac82b91d-660c-4aeb-8538-2dd48f75e691") : object "kube-system"/"original-pull-secret" not registered Sep 17 07:08:30.520517 ip-10-0-138-13 kubenswrapper[2559]: E0917 07:08:30.520142 2559 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 17 07:08:30.520517 ip-10-0-138-13 kubenswrapper[2559]: E0917 07:08:30.520314 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cb76f3bc-38be-404f-b207-231482554bfe-metrics-certs podName:cb76f3bc-38be-404f-b207-231482554bfe nodeName:}" failed. No retries permitted until 2026-09-17 07:08:46.520290671 +0000 UTC m=+34.068437375 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/cb76f3bc-38be-404f-b207-231482554bfe-metrics-certs") pod "network-metrics-daemon-25zvh" (UID: "cb76f3bc-38be-404f-b207-231482554bfe") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 17 07:08:30.722125 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:30.722093 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jm9nx\" (UniqueName: \"kubernetes.io/projected/4a9846c2-c1e2-4063-a31f-91190fa6c7a9-kube-api-access-jm9nx\") pod \"network-check-target-b768z\" (UID: \"4a9846c2-c1e2-4063-a31f-91190fa6c7a9\") " pod="openshift-network-diagnostics/network-check-target-b768z" Sep 17 07:08:30.722287 ip-10-0-138-13 kubenswrapper[2559]: E0917 07:08:30.722246 2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 17 07:08:30.722287 ip-10-0-138-13 kubenswrapper[2559]: E0917 07:08:30.722264 2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 17 07:08:30.722287 ip-10-0-138-13 kubenswrapper[2559]: E0917 07:08:30.722275 2559 projected.go:196] Error preparing data for projected volume kube-api-access-jm9nx for pod openshift-network-diagnostics/network-check-target-b768z: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 17 07:08:30.722428 ip-10-0-138-13 kubenswrapper[2559]: E0917 07:08:30.722335 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4a9846c2-c1e2-4063-a31f-91190fa6c7a9-kube-api-access-jm9nx podName:4a9846c2-c1e2-4063-a31f-91190fa6c7a9 nodeName:}" failed. No retries permitted until 2026-09-17 07:08:46.722315673 +0000 UTC m=+34.270462380 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-jm9nx" (UniqueName: "kubernetes.io/projected/4a9846c2-c1e2-4063-a31f-91190fa6c7a9-kube-api-access-jm9nx") pod "network-check-target-b768z" (UID: "4a9846c2-c1e2-4063-a31f-91190fa6c7a9") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 17 07:08:30.893511 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:30.893430 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-b768z" Sep 17 07:08:30.893671 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:30.893430 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-btqpf" Sep 17 07:08:30.893671 ip-10-0-138-13 kubenswrapper[2559]: E0917 07:08:30.893562 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-b768z" podUID="4a9846c2-c1e2-4063-a31f-91190fa6c7a9" Sep 17 07:08:30.893671 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:30.893441 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-25zvh" Sep 17 07:08:30.893671 ip-10-0-138-13 kubenswrapper[2559]: E0917 07:08:30.893648 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-btqpf" podUID="ac82b91d-660c-4aeb-8538-2dd48f75e691" Sep 17 07:08:30.893862 ip-10-0-138-13 kubenswrapper[2559]: E0917 07:08:30.893762 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-25zvh" podUID="cb76f3bc-38be-404f-b207-231482554bfe" Sep 17 07:08:32.893456 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:32.893414 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-btqpf" Sep 17 07:08:32.893943 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:32.893503 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-b768z" Sep 17 07:08:32.893943 ip-10-0-138-13 kubenswrapper[2559]: E0917 07:08:32.893527 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-btqpf" podUID="ac82b91d-660c-4aeb-8538-2dd48f75e691" Sep 17 07:08:32.893943 ip-10-0-138-13 kubenswrapper[2559]: E0917 07:08:32.893606 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-b768z" podUID="4a9846c2-c1e2-4063-a31f-91190fa6c7a9" Sep 17 07:08:32.893943 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:32.893621 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-25zvh" Sep 17 07:08:32.893943 ip-10-0-138-13 kubenswrapper[2559]: E0917 07:08:32.893706 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-25zvh" podUID="cb76f3bc-38be-404f-b207-231482554bfe" Sep 17 07:08:34.022505 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:34.022176 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-5c544" event={"ID":"248ebec7-b104-47b9-9187-04bb22c1101a","Type":"ContainerStarted","Data":"28a3d2b6253afcbcbc57bc6819887b0e411df67d4b89e4d22aba927957be35b6"} Sep 17 07:08:34.023611 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:34.023587 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tfqjg" event={"ID":"bef4b614-ed84-4224-8091-e7d1cd9b0165","Type":"ContainerStarted","Data":"b708c0e8308f082a72e2290f0742873c0620669bdee0b0b7aa69550a617449d7"} Sep 17 07:08:34.025388 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:34.025369 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-b99wz_5ae9fb13-f8a8-4999-9023-cebdf2a7bd97/ovn-acl-logging/0.log" Sep 17 07:08:34.025713 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:34.025689 2559 generic.go:356] "Generic (PLEG): container finished" podID="5ae9fb13-f8a8-4999-9023-cebdf2a7bd97" containerID="5543118af079ffe9ab1eb5536967f4006a2318df888c1f0991867b03471f74e4" exitCode=1 Sep 17 07:08:34.025775 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:34.025758 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-b99wz" event={"ID":"5ae9fb13-f8a8-4999-9023-cebdf2a7bd97","Type":"ContainerStarted","Data":"1d4ed2956e764357e3bf15bd988f0c78bb45815c2cb1220cf47295b9de33296d"} Sep 17 07:08:34.025847 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:34.025832 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-b99wz" event={"ID":"5ae9fb13-f8a8-4999-9023-cebdf2a7bd97","Type":"ContainerDied","Data":"5543118af079ffe9ab1eb5536967f4006a2318df888c1f0991867b03471f74e4"} Sep 17 07:08:34.025895 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:34.025887 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-b99wz" event={"ID":"5ae9fb13-f8a8-4999-9023-cebdf2a7bd97","Type":"ContainerStarted","Data":"4dc71a6b8573f16e5470682e5682ac0ce740619c2b7c59776c0bc7ee4abbfa66"} Sep 17 07:08:34.027326 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:34.027300 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-nmwwq" event={"ID":"82e83454-bcdc-464a-848b-730186df6a59","Type":"ContainerStarted","Data":"3a59ab8453ca9adbdcb4a4a2d20bfd29aee4465b7342abecc6a96aca89b4a90e"} Sep 17 07:08:34.029158 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:34.029135 2559 generic.go:356] "Generic (PLEG): container finished" podID="afdc4eea-caa0-4af7-a1cf-6e0ecb42fd53" containerID="13a3691fab7fecf7a60c9ef04296f2b8a6ca1767f47535384c336a17fddbf45a" exitCode=0 Sep 17 07:08:34.029264 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:34.029218 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-bb7bn" event={"ID":"afdc4eea-caa0-4af7-a1cf-6e0ecb42fd53","Type":"ContainerDied","Data":"13a3691fab7fecf7a60c9ef04296f2b8a6ca1767f47535384c336a17fddbf45a"} Sep 17 07:08:34.031057 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:34.030990 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-kf4sp" event={"ID":"a731e2cb-6abe-4f3a-81ca-d8742a141c4e","Type":"ContainerStarted","Data":"cad7f69944a06b126abbccd239c5f1c2689688a84b781a676ea794e60b409071"} Sep 17 07:08:34.032648 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:34.032626 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-jkzvc" event={"ID":"37a6b6ba-2423-42bf-ba8a-072efd4cb13a","Type":"ContainerStarted","Data":"aefc72e73479e16d868d26612b2c4ba812c7395de5664c99b3ed8768f2d10f43"} Sep 17 07:08:34.043184 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:34.043132 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-5c544" podStartSLOduration=3.564388943 podStartE2EDuration="21.043114319s" totalImagesPullingTime="17.478725376s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-17 07:08:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 07:08:34.042671042 +0000 UTC m=+21.590817751" watchObservedRunningTime="2026-09-17 07:08:34.043114319 +0000 UTC m=+21.591261028" Sep 17 07:08:34.068326 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:34.068275 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-jkzvc" podStartSLOduration=8.628550502 podStartE2EDuration="22.068251031s" totalImagesPullingTime="13.439700529s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 07:08:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 07:08:34.067786626 +0000 UTC m=+21.615933335" watchObservedRunningTime="2026-09-17 07:08:34.068251031 +0000 UTC m=+21.616397741" Sep 17 07:08:34.123375 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:34.123325 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-nmwwq" podStartSLOduration=4.633398343 podStartE2EDuration="22.123309055s" totalImagesPullingTime="17.489910712s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-17 07:08:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 07:08:34.122999039 +0000 UTC m=+21.671145742" watchObservedRunningTime="2026-09-17 07:08:34.123309055 +0000 UTC m=+21.671455764" Sep 17 07:08:34.785150 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:34.785126 2559 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Sep 17 07:08:34.868296 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:34.868121 2559 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-09-17T07:08:34.785145462Z","UUID":"ac758c72-c18f-4e92-b697-5e1a59a6fa79","Handler":null,"Name":"","Endpoint":""} Sep 17 07:08:34.869605 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:34.869584 2559 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Sep 17 07:08:34.869734 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:34.869614 2559 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Sep 17 07:08:34.893418 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:34.893378 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-btqpf" Sep 17 07:08:34.893617 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:34.893378 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-25zvh" Sep 17 07:08:34.893617 ip-10-0-138-13 kubenswrapper[2559]: E0917 07:08:34.893489 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-btqpf" podUID="ac82b91d-660c-4aeb-8538-2dd48f75e691" Sep 17 07:08:34.893617 ip-10-0-138-13 kubenswrapper[2559]: E0917 07:08:34.893595 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-25zvh" podUID="cb76f3bc-38be-404f-b207-231482554bfe" Sep 17 07:08:34.893617 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:34.893378 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-b768z" Sep 17 07:08:34.893849 ip-10-0-138-13 kubenswrapper[2559]: E0917 07:08:34.893674 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-b768z" podUID="4a9846c2-c1e2-4063-a31f-91190fa6c7a9" Sep 17 07:08:35.036348 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:35.036310 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-bb7gz" event={"ID":"6299ddb0-0911-4f6c-baa4-7c4559bade5f","Type":"ContainerStarted","Data":"aeb8a9f713695a5f68c5c022f085adecf51237f90635c4cc61e390353bfc6446"} Sep 17 07:08:35.038227 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:35.038201 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tfqjg" event={"ID":"bef4b614-ed84-4224-8091-e7d1cd9b0165","Type":"ContainerStarted","Data":"f03ce649162f18ea6bc71c3e59b689ebbcd07d98f731210f34b6a5cf53ed9914"} Sep 17 07:08:35.039751 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:35.039720 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-dksgh" event={"ID":"983514df-8e0a-4e43-b269-52be4de79e7d","Type":"ContainerStarted","Data":"d59b4fea74be80b50523216c1de394bf1bcb418b968cdfcc344e53f137a0f600"} Sep 17 07:08:35.042608 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:35.042567 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-b99wz_5ae9fb13-f8a8-4999-9023-cebdf2a7bd97/ovn-acl-logging/0.log" Sep 17 07:08:35.043081 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:35.043048 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-b99wz" event={"ID":"5ae9fb13-f8a8-4999-9023-cebdf2a7bd97","Type":"ContainerStarted","Data":"b9efb7c6e7f1334d7afcb49d19e28b276519a64bfbf557212bb66fe765148b06"} Sep 17 07:08:35.043197 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:35.043138 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-b99wz" event={"ID":"5ae9fb13-f8a8-4999-9023-cebdf2a7bd97","Type":"ContainerStarted","Data":"a50babc7ebb3473d698fac01948c4329425b79fa6e6412c489ec6ab42f5b9891"} Sep 17 07:08:35.043197 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:35.043195 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-b99wz" event={"ID":"5ae9fb13-f8a8-4999-9023-cebdf2a7bd97","Type":"ContainerStarted","Data":"35f42ce5283cda97b51711831f881e08a3978bc8c1f1ffbb0e011c265eed9817"} Sep 17 07:08:35.055035 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:35.054963 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-bb7gz" podStartSLOduration=4.574660364 podStartE2EDuration="22.054947113s" totalImagesPullingTime="17.480286749s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-17 07:08:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 07:08:35.054707041 +0000 UTC m=+22.602853752" watchObservedRunningTime="2026-09-17 07:08:35.054947113 +0000 UTC m=+22.603093822" Sep 17 07:08:35.055628 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:35.055593 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-kf4sp" podStartSLOduration=4.589255638 podStartE2EDuration="22.055580724s" totalImagesPullingTime="17.466325086s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-17 07:08:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 07:08:34.141524964 +0000 UTC m=+21.689671673" watchObservedRunningTime="2026-09-17 07:08:35.055580724 +0000 UTC m=+22.603727475" Sep 17 07:08:35.076650 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:35.076586 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-dksgh" podStartSLOduration=3.93781311 podStartE2EDuration="22.076568569s" totalImagesPullingTime="18.138755459s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-17 07:08:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 07:08:35.07639111 +0000 UTC m=+22.624537820" watchObservedRunningTime="2026-09-17 07:08:35.076568569 +0000 UTC m=+22.624715279" Sep 17 07:08:35.420563 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:35.420462 2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-jkzvc" Sep 17 07:08:35.421138 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:35.421109 2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-jkzvc" Sep 17 07:08:36.893385 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:36.893110 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-b768z" Sep 17 07:08:36.893993 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:36.893109 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-25zvh" Sep 17 07:08:36.893993 ip-10-0-138-13 kubenswrapper[2559]: E0917 07:08:36.893490 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-b768z" podUID="4a9846c2-c1e2-4063-a31f-91190fa6c7a9" Sep 17 07:08:36.893993 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:36.893150 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-btqpf" Sep 17 07:08:36.893993 ip-10-0-138-13 kubenswrapper[2559]: E0917 07:08:36.893577 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-25zvh" podUID="cb76f3bc-38be-404f-b207-231482554bfe" Sep 17 07:08:36.893993 ip-10-0-138-13 kubenswrapper[2559]: E0917 07:08:36.893631 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-btqpf" podUID="ac82b91d-660c-4aeb-8538-2dd48f75e691" Sep 17 07:08:37.050744 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:37.050717 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-b99wz_5ae9fb13-f8a8-4999-9023-cebdf2a7bd97/ovn-acl-logging/0.log" Sep 17 07:08:37.051208 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:37.051172 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-b99wz" event={"ID":"5ae9fb13-f8a8-4999-9023-cebdf2a7bd97","Type":"ContainerStarted","Data":"c3ad4275599dcb9b2ee0e0902b6330300c08a98b8c8abd2e2f3511128b883101"} Sep 17 07:08:37.053247 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:37.053223 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tfqjg" event={"ID":"bef4b614-ed84-4224-8091-e7d1cd9b0165","Type":"ContainerStarted","Data":"3f9c81e4517627edaf27bd0079b582338283784b412c8ff718bc12e16119c8b6"} Sep 17 07:08:37.053386 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:37.053285 2559 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Sep 17 07:08:37.088703 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:37.088650 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tfqjg" podStartSLOduration=3.939085033 podStartE2EDuration="24.088632822s" totalImagesPullingTime="20.149547789s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-17 07:08:13 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 07:08:37.088605891 +0000 UTC m=+24.636752599" watchObservedRunningTime="2026-09-17 07:08:37.088632822 +0000 UTC m=+24.636779509" Sep 17 07:08:38.893342 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:38.893309 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-b768z" Sep 17 07:08:38.893781 ip-10-0-138-13 kubenswrapper[2559]: E0917 07:08:38.893422 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-b768z" podUID="4a9846c2-c1e2-4063-a31f-91190fa6c7a9" Sep 17 07:08:38.893781 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:38.893445 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-25zvh" Sep 17 07:08:38.893781 ip-10-0-138-13 kubenswrapper[2559]: E0917 07:08:38.893534 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-25zvh" podUID="cb76f3bc-38be-404f-b207-231482554bfe" Sep 17 07:08:38.893781 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:38.893576 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-btqpf" Sep 17 07:08:38.893781 ip-10-0-138-13 kubenswrapper[2559]: E0917 07:08:38.893639 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-btqpf" podUID="ac82b91d-660c-4aeb-8538-2dd48f75e691" Sep 17 07:08:39.191668 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:39.191641 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-jkzvc" Sep 17 07:08:39.191841 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:39.191829 2559 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Sep 17 07:08:39.192310 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:39.192274 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-jkzvc" Sep 17 07:08:40.064291 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:40.064137 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-b99wz_5ae9fb13-f8a8-4999-9023-cebdf2a7bd97/ovn-acl-logging/0.log" Sep 17 07:08:40.064739 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:40.064595 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-b99wz" event={"ID":"5ae9fb13-f8a8-4999-9023-cebdf2a7bd97","Type":"ContainerStarted","Data":"96facb3bce50f55ea56b950d5852f5b8258967e28843c64fae17e5bf547c68dc"} Sep 17 07:08:40.064923 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:40.064890 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-b99wz" Sep 17 07:08:40.065045 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:40.064961 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-b99wz" Sep 17 07:08:40.065107 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:40.065089 2559 scope.go:117] "RemoveContainer" containerID="5543118af079ffe9ab1eb5536967f4006a2318df888c1f0991867b03471f74e4" Sep 17 07:08:40.066608 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:40.066583 2559 generic.go:356] "Generic (PLEG): container finished" podID="afdc4eea-caa0-4af7-a1cf-6e0ecb42fd53" containerID="3c5482008fa6903f6c2ecf16dc4e68cac9cb24344c020b82194ce636f2961536" exitCode=0 Sep 17 07:08:40.066705 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:40.066668 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-bb7bn" event={"ID":"afdc4eea-caa0-4af7-a1cf-6e0ecb42fd53","Type":"ContainerDied","Data":"3c5482008fa6903f6c2ecf16dc4e68cac9cb24344c020b82194ce636f2961536"} Sep 17 07:08:40.081898 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:40.081879 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-b99wz" Sep 17 07:08:40.893479 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:40.893449 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-btqpf" Sep 17 07:08:40.893710 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:40.893449 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-25zvh" Sep 17 07:08:40.893710 ip-10-0-138-13 kubenswrapper[2559]: E0917 07:08:40.893574 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-btqpf" podUID="ac82b91d-660c-4aeb-8538-2dd48f75e691" Sep 17 07:08:40.893710 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:40.893595 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-b768z" Sep 17 07:08:40.893908 ip-10-0-138-13 kubenswrapper[2559]: E0917 07:08:40.893711 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-25zvh" podUID="cb76f3bc-38be-404f-b207-231482554bfe" Sep 17 07:08:40.893908 ip-10-0-138-13 kubenswrapper[2559]: E0917 07:08:40.893797 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-b768z" podUID="4a9846c2-c1e2-4063-a31f-91190fa6c7a9" Sep 17 07:08:41.074819 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:41.074789 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-b99wz_5ae9fb13-f8a8-4999-9023-cebdf2a7bd97/ovn-acl-logging/0.log" Sep 17 07:08:41.075522 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:41.075240 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-b99wz" event={"ID":"5ae9fb13-f8a8-4999-9023-cebdf2a7bd97","Type":"ContainerStarted","Data":"5b3cafe4f2a0ff870f8516262997311e4a73cf519481e4644fa3651ce8f88d50"} Sep 17 07:08:41.075522 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:41.075503 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-b99wz" Sep 17 07:08:41.092409 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:41.092384 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-b99wz" Sep 17 07:08:41.132795 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:41.132748 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-b99wz" podStartSLOduration=10.608230643 podStartE2EDuration="28.132732494s" totalImagesPullingTime="17.524501851s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-17 07:08:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 07:08:41.131415891 +0000 UTC m=+28.679562600" watchObservedRunningTime="2026-09-17 07:08:41.132732494 +0000 UTC m=+28.680879203" Sep 17 07:08:41.618148 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:41.617899 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-btqpf"] Sep 17 07:08:41.618270 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:41.618188 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-btqpf" Sep 17 07:08:41.618304 ip-10-0-138-13 kubenswrapper[2559]: E0917 07:08:41.618274 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-btqpf" podUID="ac82b91d-660c-4aeb-8538-2dd48f75e691" Sep 17 07:08:41.628461 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:41.628370 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-b768z"] Sep 17 07:08:41.628597 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:41.628485 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-b768z" Sep 17 07:08:41.628597 ip-10-0-138-13 kubenswrapper[2559]: E0917 07:08:41.628560 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-b768z" podUID="4a9846c2-c1e2-4063-a31f-91190fa6c7a9" Sep 17 07:08:41.632889 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:41.632864 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-25zvh"] Sep 17 07:08:41.632997 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:41.632983 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-25zvh" Sep 17 07:08:41.633079 ip-10-0-138-13 kubenswrapper[2559]: E0917 07:08:41.633063 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-25zvh" podUID="cb76f3bc-38be-404f-b207-231482554bfe" Sep 17 07:08:42.079402 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:42.079371 2559 generic.go:356] "Generic (PLEG): container finished" podID="afdc4eea-caa0-4af7-a1cf-6e0ecb42fd53" containerID="8f740b57404f186d521b75603766c7c2bd6f02012a9b218d81c1f7dda7775d33" exitCode=0 Sep 17 07:08:42.079846 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:42.079460 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-bb7bn" event={"ID":"afdc4eea-caa0-4af7-a1cf-6e0ecb42fd53","Type":"ContainerDied","Data":"8f740b57404f186d521b75603766c7c2bd6f02012a9b218d81c1f7dda7775d33"} Sep 17 07:08:42.893161 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:42.893129 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-25zvh" Sep 17 07:08:42.893325 ip-10-0-138-13 kubenswrapper[2559]: E0917 07:08:42.893216 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-25zvh" podUID="cb76f3bc-38be-404f-b207-231482554bfe" Sep 17 07:08:42.893325 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:42.893270 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-btqpf" Sep 17 07:08:42.893434 ip-10-0-138-13 kubenswrapper[2559]: E0917 07:08:42.893364 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-btqpf" podUID="ac82b91d-660c-4aeb-8538-2dd48f75e691" Sep 17 07:08:43.084746 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:43.084715 2559 generic.go:356] "Generic (PLEG): container finished" podID="afdc4eea-caa0-4af7-a1cf-6e0ecb42fd53" containerID="e824f87b24cd608b1207e31e1511222c2417399679895100ba000d48b128f355" exitCode=0 Sep 17 07:08:43.085120 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:43.084791 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-bb7bn" event={"ID":"afdc4eea-caa0-4af7-a1cf-6e0ecb42fd53","Type":"ContainerDied","Data":"e824f87b24cd608b1207e31e1511222c2417399679895100ba000d48b128f355"} Sep 17 07:08:43.892400 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:43.892374 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-b768z" Sep 17 07:08:43.892587 ip-10-0-138-13 kubenswrapper[2559]: E0917 07:08:43.892464 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-b768z" podUID="4a9846c2-c1e2-4063-a31f-91190fa6c7a9" Sep 17 07:08:44.893447 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:44.893371 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-25zvh" Sep 17 07:08:44.893788 ip-10-0-138-13 kubenswrapper[2559]: E0917 07:08:44.893481 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-25zvh" podUID="cb76f3bc-38be-404f-b207-231482554bfe" Sep 17 07:08:44.893788 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:44.893531 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-btqpf" Sep 17 07:08:44.893788 ip-10-0-138-13 kubenswrapper[2559]: E0917 07:08:44.893615 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-btqpf" podUID="ac82b91d-660c-4aeb-8538-2dd48f75e691" Sep 17 07:08:45.892927 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:45.892891 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-b768z" Sep 17 07:08:45.893127 ip-10-0-138-13 kubenswrapper[2559]: E0917 07:08:45.893033 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-b768z" podUID="4a9846c2-c1e2-4063-a31f-91190fa6c7a9" Sep 17 07:08:46.536456 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:46.536417 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cb76f3bc-38be-404f-b207-231482554bfe-metrics-certs\") pod \"network-metrics-daemon-25zvh\" (UID: \"cb76f3bc-38be-404f-b207-231482554bfe\") " pod="openshift-multus/network-metrics-daemon-25zvh" Sep 17 07:08:46.536912 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:46.536525 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ac82b91d-660c-4aeb-8538-2dd48f75e691-original-pull-secret\") pod \"global-pull-secret-syncer-btqpf\" (UID: \"ac82b91d-660c-4aeb-8538-2dd48f75e691\") " pod="kube-system/global-pull-secret-syncer-btqpf" Sep 17 07:08:46.536912 ip-10-0-138-13 kubenswrapper[2559]: E0917 07:08:46.536588 2559 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 17 07:08:46.536912 ip-10-0-138-13 kubenswrapper[2559]: E0917 07:08:46.536639 2559 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 17 07:08:46.536912 ip-10-0-138-13 kubenswrapper[2559]: E0917 07:08:46.536668 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cb76f3bc-38be-404f-b207-231482554bfe-metrics-certs podName:cb76f3bc-38be-404f-b207-231482554bfe nodeName:}" failed. No retries permitted until 2026-09-17 07:09:18.536645443 +0000 UTC m=+66.084792144 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/cb76f3bc-38be-404f-b207-231482554bfe-metrics-certs") pod "network-metrics-daemon-25zvh" (UID: "cb76f3bc-38be-404f-b207-231482554bfe") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 17 07:08:46.536912 ip-10-0-138-13 kubenswrapper[2559]: E0917 07:08:46.536691 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ac82b91d-660c-4aeb-8538-2dd48f75e691-original-pull-secret podName:ac82b91d-660c-4aeb-8538-2dd48f75e691 nodeName:}" failed. No retries permitted until 2026-09-17 07:09:18.53668126 +0000 UTC m=+66.084827953 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/ac82b91d-660c-4aeb-8538-2dd48f75e691-original-pull-secret") pod "global-pull-secret-syncer-btqpf" (UID: "ac82b91d-660c-4aeb-8538-2dd48f75e691") : object "kube-system"/"original-pull-secret" not registered Sep 17 07:08:46.691776 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:46.691699 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-13.ec2.internal" event="NodeReady" Sep 17 07:08:46.691944 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:46.691858 2559 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Sep 17 07:08:46.738033 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:46.738003 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jm9nx\" (UniqueName: \"kubernetes.io/projected/4a9846c2-c1e2-4063-a31f-91190fa6c7a9-kube-api-access-jm9nx\") pod \"network-check-target-b768z\" (UID: \"4a9846c2-c1e2-4063-a31f-91190fa6c7a9\") " pod="openshift-network-diagnostics/network-check-target-b768z" Sep 17 07:08:46.738208 ip-10-0-138-13 kubenswrapper[2559]: E0917 07:08:46.738171 2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 17 07:08:46.738208 ip-10-0-138-13 kubenswrapper[2559]: E0917 07:08:46.738188 2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 17 07:08:46.738208 ip-10-0-138-13 kubenswrapper[2559]: E0917 07:08:46.738198 2559 projected.go:196] Error preparing data for projected volume kube-api-access-jm9nx for pod openshift-network-diagnostics/network-check-target-b768z: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 17 07:08:46.738373 ip-10-0-138-13 kubenswrapper[2559]: E0917 07:08:46.738251 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4a9846c2-c1e2-4063-a31f-91190fa6c7a9-kube-api-access-jm9nx podName:4a9846c2-c1e2-4063-a31f-91190fa6c7a9 nodeName:}" failed. No retries permitted until 2026-09-17 07:09:18.738233526 +0000 UTC m=+66.286380215 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-jm9nx" (UniqueName: "kubernetes.io/projected/4a9846c2-c1e2-4063-a31f-91190fa6c7a9-kube-api-access-jm9nx") pod "network-check-target-b768z" (UID: "4a9846c2-c1e2-4063-a31f-91190fa6c7a9") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 17 07:08:46.812862 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:46.812832 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-8zt9c"] Sep 17 07:08:46.848571 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:46.848540 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-v82wm"] Sep 17 07:08:46.848745 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:46.848648 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-8zt9c" Sep 17 07:08:46.858146 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:46.858121 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-wq5pm\"" Sep 17 07:08:46.858272 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:46.858158 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Sep 17 07:08:46.858335 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:46.858278 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Sep 17 07:08:46.862678 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:46.862653 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-v82wm"] Sep 17 07:08:46.862678 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:46.862671 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-v82wm" Sep 17 07:08:46.862874 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:46.862715 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-8zt9c"] Sep 17 07:08:46.868139 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:46.867896 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Sep 17 07:08:46.868139 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:46.867928 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Sep 17 07:08:46.868139 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:46.867928 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-qh9gr\"" Sep 17 07:08:46.868369 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:46.868306 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Sep 17 07:08:46.893360 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:46.893321 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-25zvh" Sep 17 07:08:46.893486 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:46.893329 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-btqpf" Sep 17 07:08:46.896004 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:46.895984 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Sep 17 07:08:46.896153 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:46.895990 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-g2nsv\"" Sep 17 07:08:46.896254 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:46.896222 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Sep 17 07:08:46.939107 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:46.939079 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l8fgx\" (UniqueName: \"kubernetes.io/projected/2204950c-6aee-4c24-9abf-58c5fcc5bafd-kube-api-access-l8fgx\") pod \"dns-default-8zt9c\" (UID: \"2204950c-6aee-4c24-9abf-58c5fcc5bafd\") " pod="openshift-dns/dns-default-8zt9c" Sep 17 07:08:46.939227 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:46.939140 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c0d04997-4e22-48b8-b36c-e98153ddcd60-cert\") pod \"ingress-canary-v82wm\" (UID: \"c0d04997-4e22-48b8-b36c-e98153ddcd60\") " pod="openshift-ingress-canary/ingress-canary-v82wm" Sep 17 07:08:46.939227 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:46.939165 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/2204950c-6aee-4c24-9abf-58c5fcc5bafd-config-volume\") pod \"dns-default-8zt9c\" (UID: \"2204950c-6aee-4c24-9abf-58c5fcc5bafd\") " pod="openshift-dns/dns-default-8zt9c" Sep 17 07:08:46.939227 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:46.939189 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4gbt8\" (UniqueName: \"kubernetes.io/projected/c0d04997-4e22-48b8-b36c-e98153ddcd60-kube-api-access-4gbt8\") pod \"ingress-canary-v82wm\" (UID: \"c0d04997-4e22-48b8-b36c-e98153ddcd60\") " pod="openshift-ingress-canary/ingress-canary-v82wm" Sep 17 07:08:46.939227 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:46.939217 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/2204950c-6aee-4c24-9abf-58c5fcc5bafd-metrics-tls\") pod \"dns-default-8zt9c\" (UID: \"2204950c-6aee-4c24-9abf-58c5fcc5bafd\") " pod="openshift-dns/dns-default-8zt9c" Sep 17 07:08:46.939436 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:46.939265 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2204950c-6aee-4c24-9abf-58c5fcc5bafd-tmp-dir\") pod \"dns-default-8zt9c\" (UID: \"2204950c-6aee-4c24-9abf-58c5fcc5bafd\") " pod="openshift-dns/dns-default-8zt9c" Sep 17 07:08:47.039978 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:47.039941 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2204950c-6aee-4c24-9abf-58c5fcc5bafd-tmp-dir\") pod \"dns-default-8zt9c\" (UID: \"2204950c-6aee-4c24-9abf-58c5fcc5bafd\") " pod="openshift-dns/dns-default-8zt9c" Sep 17 07:08:47.040134 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:47.040024 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l8fgx\" (UniqueName: \"kubernetes.io/projected/2204950c-6aee-4c24-9abf-58c5fcc5bafd-kube-api-access-l8fgx\") pod \"dns-default-8zt9c\" (UID: \"2204950c-6aee-4c24-9abf-58c5fcc5bafd\") " pod="openshift-dns/dns-default-8zt9c" Sep 17 07:08:47.040134 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:47.040086 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c0d04997-4e22-48b8-b36c-e98153ddcd60-cert\") pod \"ingress-canary-v82wm\" (UID: \"c0d04997-4e22-48b8-b36c-e98153ddcd60\") " pod="openshift-ingress-canary/ingress-canary-v82wm" Sep 17 07:08:47.040134 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:47.040116 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/2204950c-6aee-4c24-9abf-58c5fcc5bafd-config-volume\") pod \"dns-default-8zt9c\" (UID: \"2204950c-6aee-4c24-9abf-58c5fcc5bafd\") " pod="openshift-dns/dns-default-8zt9c" Sep 17 07:08:47.040291 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:47.040142 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4gbt8\" (UniqueName: \"kubernetes.io/projected/c0d04997-4e22-48b8-b36c-e98153ddcd60-kube-api-access-4gbt8\") pod \"ingress-canary-v82wm\" (UID: \"c0d04997-4e22-48b8-b36c-e98153ddcd60\") " pod="openshift-ingress-canary/ingress-canary-v82wm" Sep 17 07:08:47.040291 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:47.040185 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/2204950c-6aee-4c24-9abf-58c5fcc5bafd-metrics-tls\") pod \"dns-default-8zt9c\" (UID: \"2204950c-6aee-4c24-9abf-58c5fcc5bafd\") " pod="openshift-dns/dns-default-8zt9c" Sep 17 07:08:47.040291 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:47.040266 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2204950c-6aee-4c24-9abf-58c5fcc5bafd-tmp-dir\") pod \"dns-default-8zt9c\" (UID: \"2204950c-6aee-4c24-9abf-58c5fcc5bafd\") " pod="openshift-dns/dns-default-8zt9c" Sep 17 07:08:47.040291 ip-10-0-138-13 kubenswrapper[2559]: E0917 07:08:47.040289 2559 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 17 07:08:47.040487 ip-10-0-138-13 kubenswrapper[2559]: E0917 07:08:47.040347 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2204950c-6aee-4c24-9abf-58c5fcc5bafd-metrics-tls podName:2204950c-6aee-4c24-9abf-58c5fcc5bafd nodeName:}" failed. No retries permitted until 2026-09-17 07:08:47.540326617 +0000 UTC m=+35.088473318 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/2204950c-6aee-4c24-9abf-58c5fcc5bafd-metrics-tls") pod "dns-default-8zt9c" (UID: "2204950c-6aee-4c24-9abf-58c5fcc5bafd") : secret "dns-default-metrics-tls" not found Sep 17 07:08:47.040736 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:47.040715 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/2204950c-6aee-4c24-9abf-58c5fcc5bafd-config-volume\") pod \"dns-default-8zt9c\" (UID: \"2204950c-6aee-4c24-9abf-58c5fcc5bafd\") " pod="openshift-dns/dns-default-8zt9c" Sep 17 07:08:47.044571 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:47.044548 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c0d04997-4e22-48b8-b36c-e98153ddcd60-cert\") pod \"ingress-canary-v82wm\" (UID: \"c0d04997-4e22-48b8-b36c-e98153ddcd60\") " pod="openshift-ingress-canary/ingress-canary-v82wm" Sep 17 07:08:47.058360 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:47.058332 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4gbt8\" (UniqueName: \"kubernetes.io/projected/c0d04997-4e22-48b8-b36c-e98153ddcd60-kube-api-access-4gbt8\") pod \"ingress-canary-v82wm\" (UID: \"c0d04997-4e22-48b8-b36c-e98153ddcd60\") " pod="openshift-ingress-canary/ingress-canary-v82wm" Sep 17 07:08:47.058960 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:47.058937 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-l8fgx\" (UniqueName: \"kubernetes.io/projected/2204950c-6aee-4c24-9abf-58c5fcc5bafd-kube-api-access-l8fgx\") pod \"dns-default-8zt9c\" (UID: \"2204950c-6aee-4c24-9abf-58c5fcc5bafd\") " pod="openshift-dns/dns-default-8zt9c" Sep 17 07:08:47.173101 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:47.173067 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-v82wm" Sep 17 07:08:47.543357 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:47.543153 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/2204950c-6aee-4c24-9abf-58c5fcc5bafd-metrics-tls\") pod \"dns-default-8zt9c\" (UID: \"2204950c-6aee-4c24-9abf-58c5fcc5bafd\") " pod="openshift-dns/dns-default-8zt9c" Sep 17 07:08:47.543782 ip-10-0-138-13 kubenswrapper[2559]: E0917 07:08:47.543310 2559 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 17 07:08:47.543782 ip-10-0-138-13 kubenswrapper[2559]: E0917 07:08:47.543485 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2204950c-6aee-4c24-9abf-58c5fcc5bafd-metrics-tls podName:2204950c-6aee-4c24-9abf-58c5fcc5bafd nodeName:}" failed. No retries permitted until 2026-09-17 07:08:48.543465678 +0000 UTC m=+36.091612369 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/2204950c-6aee-4c24-9abf-58c5fcc5bafd-metrics-tls") pod "dns-default-8zt9c" (UID: "2204950c-6aee-4c24-9abf-58c5fcc5bafd") : secret "dns-default-metrics-tls" not found Sep 17 07:08:47.892861 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:47.892799 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-b768z" Sep 17 07:08:47.895536 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:47.895515 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-2f8p7\"" Sep 17 07:08:47.895679 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:47.895658 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Sep 17 07:08:47.896330 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:47.896311 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Sep 17 07:08:48.240575 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:48.240494 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-v82wm"] Sep 17 07:08:48.244441 ip-10-0-138-13 kubenswrapper[2559]: W0917 07:08:48.244414 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc0d04997_4e22_48b8_b36c_e98153ddcd60.slice/crio-5e567b434c8437f03cead970023ebe86b7dc4df759572ab380b5dcaa1c370479 WatchSource:0}: Error finding container 5e567b434c8437f03cead970023ebe86b7dc4df759572ab380b5dcaa1c370479: Status 404 returned error can't find the container with id 5e567b434c8437f03cead970023ebe86b7dc4df759572ab380b5dcaa1c370479 Sep 17 07:08:48.548545 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:48.548516 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/2204950c-6aee-4c24-9abf-58c5fcc5bafd-metrics-tls\") pod \"dns-default-8zt9c\" (UID: \"2204950c-6aee-4c24-9abf-58c5fcc5bafd\") " pod="openshift-dns/dns-default-8zt9c" Sep 17 07:08:48.549100 ip-10-0-138-13 kubenswrapper[2559]: E0917 07:08:48.548660 2559 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 17 07:08:48.549100 ip-10-0-138-13 kubenswrapper[2559]: E0917 07:08:48.548723 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2204950c-6aee-4c24-9abf-58c5fcc5bafd-metrics-tls podName:2204950c-6aee-4c24-9abf-58c5fcc5bafd nodeName:}" failed. No retries permitted until 2026-09-17 07:08:50.548707507 +0000 UTC m=+38.096854212 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/2204950c-6aee-4c24-9abf-58c5fcc5bafd-metrics-tls") pod "dns-default-8zt9c" (UID: "2204950c-6aee-4c24-9abf-58c5fcc5bafd") : secret "dns-default-metrics-tls" not found Sep 17 07:08:49.104389 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:49.104357 2559 generic.go:356] "Generic (PLEG): container finished" podID="afdc4eea-caa0-4af7-a1cf-6e0ecb42fd53" containerID="0bc1c6f1160c5bd8457d89d0a8e7bda5a5926a596c2dca06202aeaac0dab9914" exitCode=0 Sep 17 07:08:49.104566 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:49.104438 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-bb7bn" event={"ID":"afdc4eea-caa0-4af7-a1cf-6e0ecb42fd53","Type":"ContainerDied","Data":"0bc1c6f1160c5bd8457d89d0a8e7bda5a5926a596c2dca06202aeaac0dab9914"} Sep 17 07:08:49.105662 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:49.105638 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-v82wm" event={"ID":"c0d04997-4e22-48b8-b36c-e98153ddcd60","Type":"ContainerStarted","Data":"5e567b434c8437f03cead970023ebe86b7dc4df759572ab380b5dcaa1c370479"} Sep 17 07:08:50.111024 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:50.110994 2559 generic.go:356] "Generic (PLEG): container finished" podID="afdc4eea-caa0-4af7-a1cf-6e0ecb42fd53" containerID="b33c82fb061bbeae90416fba5b2676b8bf116adbf6f1b26da71a121f968f7923" exitCode=0 Sep 17 07:08:50.111439 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:50.111036 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-bb7bn" event={"ID":"afdc4eea-caa0-4af7-a1cf-6e0ecb42fd53","Type":"ContainerDied","Data":"b33c82fb061bbeae90416fba5b2676b8bf116adbf6f1b26da71a121f968f7923"} Sep 17 07:08:50.563165 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:50.563132 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/2204950c-6aee-4c24-9abf-58c5fcc5bafd-metrics-tls\") pod \"dns-default-8zt9c\" (UID: \"2204950c-6aee-4c24-9abf-58c5fcc5bafd\") " pod="openshift-dns/dns-default-8zt9c" Sep 17 07:08:50.563325 ip-10-0-138-13 kubenswrapper[2559]: E0917 07:08:50.563268 2559 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 17 07:08:50.563371 ip-10-0-138-13 kubenswrapper[2559]: E0917 07:08:50.563329 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2204950c-6aee-4c24-9abf-58c5fcc5bafd-metrics-tls podName:2204950c-6aee-4c24-9abf-58c5fcc5bafd nodeName:}" failed. No retries permitted until 2026-09-17 07:08:54.56331227 +0000 UTC m=+42.111458968 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/2204950c-6aee-4c24-9abf-58c5fcc5bafd-metrics-tls") pod "dns-default-8zt9c" (UID: "2204950c-6aee-4c24-9abf-58c5fcc5bafd") : secret "dns-default-metrics-tls" not found Sep 17 07:08:51.117027 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:51.116994 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-bb7bn" event={"ID":"afdc4eea-caa0-4af7-a1cf-6e0ecb42fd53","Type":"ContainerStarted","Data":"715874fbfbe69d0919cf74346bda7d15bd51f303b47f251ce3674b5be83566ff"} Sep 17 07:08:51.148397 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:51.148351 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-bb7bn" podStartSLOduration=8.366438739 podStartE2EDuration="38.148335086s" totalImagesPullingTime="29.781896347s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-17 07:08:13 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 07:08:51.147226466 +0000 UTC m=+38.695373175" watchObservedRunningTime="2026-09-17 07:08:51.148335086 +0000 UTC m=+38.696481819" Sep 17 07:08:52.120553 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:52.120508 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-v82wm" event={"ID":"c0d04997-4e22-48b8-b36c-e98153ddcd60","Type":"ContainerStarted","Data":"454613e6f25b1d8e51b9952384b5ade508c0ff3e2f37cb3320495694c492cc2b"} Sep 17 07:08:52.143954 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:52.143899 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-v82wm" podStartSLOduration=2.887510568 podStartE2EDuration="6.14388382s" totalImagesPullingTime="3.256373252s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 07:08:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 07:08:52.142411577 +0000 UTC m=+39.690558286" watchObservedRunningTime="2026-09-17 07:08:52.14388382 +0000 UTC m=+39.692030580" Sep 17 07:08:54.591398 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:08:54.591359 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/2204950c-6aee-4c24-9abf-58c5fcc5bafd-metrics-tls\") pod \"dns-default-8zt9c\" (UID: \"2204950c-6aee-4c24-9abf-58c5fcc5bafd\") " pod="openshift-dns/dns-default-8zt9c" Sep 17 07:08:54.591768 ip-10-0-138-13 kubenswrapper[2559]: E0917 07:08:54.591483 2559 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 17 07:08:54.591768 ip-10-0-138-13 kubenswrapper[2559]: E0917 07:08:54.591536 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2204950c-6aee-4c24-9abf-58c5fcc5bafd-metrics-tls podName:2204950c-6aee-4c24-9abf-58c5fcc5bafd nodeName:}" failed. No retries permitted until 2026-09-17 07:09:02.591522736 +0000 UTC m=+50.139669437 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/2204950c-6aee-4c24-9abf-58c5fcc5bafd-metrics-tls") pod "dns-default-8zt9c" (UID: "2204950c-6aee-4c24-9abf-58c5fcc5bafd") : secret "dns-default-metrics-tls" not found Sep 17 07:09:02.643887 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:09:02.643847 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/2204950c-6aee-4c24-9abf-58c5fcc5bafd-metrics-tls\") pod \"dns-default-8zt9c\" (UID: \"2204950c-6aee-4c24-9abf-58c5fcc5bafd\") " pod="openshift-dns/dns-default-8zt9c" Sep 17 07:09:02.644354 ip-10-0-138-13 kubenswrapper[2559]: E0917 07:09:02.644031 2559 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 17 07:09:02.644354 ip-10-0-138-13 kubenswrapper[2559]: E0917 07:09:02.644094 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2204950c-6aee-4c24-9abf-58c5fcc5bafd-metrics-tls podName:2204950c-6aee-4c24-9abf-58c5fcc5bafd nodeName:}" failed. No retries permitted until 2026-09-17 07:09:18.64407906 +0000 UTC m=+66.192225748 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/2204950c-6aee-4c24-9abf-58c5fcc5bafd-metrics-tls") pod "dns-default-8zt9c" (UID: "2204950c-6aee-4c24-9abf-58c5fcc5bafd") : secret "dns-default-metrics-tls" not found Sep 17 07:09:05.207593 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:09:05.207559 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-6cd954b897-24z67"] Sep 17 07:09:05.209039 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:09:05.209023 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-6f9c47f54-2kl8l"] Sep 17 07:09:05.209153 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:09:05.209136 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-24z67" Sep 17 07:09:05.210461 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:09:05.210437 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-6f9c47f54-2kl8l" Sep 17 07:09:05.211638 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:09:05.211614 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\"" Sep 17 07:09:05.211893 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:09:05.211879 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Sep 17 07:09:05.213109 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:09:05.213086 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-t5nm2\"" Sep 17 07:09:05.213211 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:09:05.213129 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\"" Sep 17 07:09:05.213211 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:09:05.213149 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\"" Sep 17 07:09:05.213211 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:09:05.213164 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-cjd87\"" Sep 17 07:09:05.213211 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:09:05.213172 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Sep 17 07:09:05.213394 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:09:05.213129 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Sep 17 07:09:05.213394 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:09:05.213228 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\"" Sep 17 07:09:05.213885 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:09:05.213871 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\"" Sep 17 07:09:05.213955 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:09:05.213879 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\"" Sep 17 07:09:05.213955 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:09:05.213883 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Sep 17 07:09:05.223039 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:09:05.223022 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-6cd954b897-24z67"] Sep 17 07:09:05.223706 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:09:05.223686 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-6f9c47f54-2kl8l"] Sep 17 07:09:05.310294 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:09:05.310251 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-86695b7cc7-mpn5m"] Sep 17 07:09:05.312252 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:09:05.312234 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-v6zwt"] Sep 17 07:09:05.312362 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:09:05.312345 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-86695b7cc7-mpn5m" Sep 17 07:09:05.313737 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:09:05.313719 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-v6zwt" Sep 17 07:09:05.322278 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:09:05.322261 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-hm4vg\"" Sep 17 07:09:05.322774 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:09:05.322756 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\"" Sep 17 07:09:05.322894 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:09:05.322848 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\"" Sep 17 07:09:05.322894 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:09:05.322859 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-tckcj\"" Sep 17 07:09:05.322894 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:09:05.322889 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\"" Sep 17 07:09:05.323135 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:09:05.322986 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\"" Sep 17 07:09:05.323389 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:09:05.323375 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\"" Sep 17 07:09:05.334024 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:09:05.333998 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-v6zwt"] Sep 17 07:09:05.335326 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:09:05.335306 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-86695b7cc7-mpn5m"] Sep 17 07:09:05.364222 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:09:05.364196 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/73223634-3371-4e5a-a594-e79584605e80-stats-auth\") pod \"router-default-6f9c47f54-2kl8l\" (UID: \"73223634-3371-4e5a-a594-e79584605e80\") " pod="openshift-ingress/router-default-6f9c47f54-2kl8l" Sep 17 07:09:05.364222 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:09:05.364221 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/73223634-3371-4e5a-a594-e79584605e80-metrics-certs\") pod \"router-default-6f9c47f54-2kl8l\" (UID: \"73223634-3371-4e5a-a594-e79584605e80\") " pod="openshift-ingress/router-default-6f9c47f54-2kl8l" Sep 17 07:09:05.364372 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:09:05.364244 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/73223634-3371-4e5a-a594-e79584605e80-service-ca-bundle\") pod \"router-default-6f9c47f54-2kl8l\" (UID: \"73223634-3371-4e5a-a594-e79584605e80\") " pod="openshift-ingress/router-default-6f9c47f54-2kl8l" Sep 17 07:09:05.364372 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:09:05.364262 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ktgrw\" (UniqueName: \"kubernetes.io/projected/fa45a0ac-8d9b-4458-b6c0-ae63e5aff0ab-kube-api-access-ktgrw\") pod \"cluster-monitoring-operator-6cd954b897-24z67\" (UID: \"fa45a0ac-8d9b-4458-b6c0-ae63e5aff0ab\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-24z67" Sep 17 07:09:05.364372 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:09:05.364280 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/73223634-3371-4e5a-a594-e79584605e80-default-certificate\") pod \"router-default-6f9c47f54-2kl8l\" (UID: \"73223634-3371-4e5a-a594-e79584605e80\") " pod="openshift-ingress/router-default-6f9c47f54-2kl8l" Sep 17 07:09:05.364372 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:09:05.364308 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/fa45a0ac-8d9b-4458-b6c0-ae63e5aff0ab-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cd954b897-24z67\" (UID: \"fa45a0ac-8d9b-4458-b6c0-ae63e5aff0ab\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-24z67" Sep 17 07:09:05.364495 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:09:05.364392 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4299t\" (UniqueName: \"kubernetes.io/projected/73223634-3371-4e5a-a594-e79584605e80-kube-api-access-4299t\") pod \"router-default-6f9c47f54-2kl8l\" (UID: \"73223634-3371-4e5a-a594-e79584605e80\") " pod="openshift-ingress/router-default-6f9c47f54-2kl8l" Sep 17 07:09:05.364495 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:09:05.364411 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/fa45a0ac-8d9b-4458-b6c0-ae63e5aff0ab-telemetry-config\") pod \"cluster-monitoring-operator-6cd954b897-24z67\" (UID: \"fa45a0ac-8d9b-4458-b6c0-ae63e5aff0ab\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-24z67" Sep 17 07:09:05.410521 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:09:05.410495 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-5844b856db-tvlrq"] Sep 17 07:09:05.413489 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:09:05.413462 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-5844b856db-tvlrq" Sep 17 07:09:05.417757 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:09:05.417739 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\"" Sep 17 07:09:05.418662 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:09:05.418642 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Sep 17 07:09:05.418747 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:09:05.418646 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\"" Sep 17 07:09:05.419550 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:09:05.419383 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Sep 17 07:09:05.420268 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:09:05.420252 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-p84fc\"" Sep 17 07:09:05.424352 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:09:05.424335 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\"" Sep 17 07:09:05.431827 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:09:05.431804 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-5844b856db-tvlrq"] Sep 17 07:09:05.465498 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:09:05.465444 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4299t\" (UniqueName: \"kubernetes.io/projected/73223634-3371-4e5a-a594-e79584605e80-kube-api-access-4299t\") pod \"router-default-6f9c47f54-2kl8l\" (UID: \"73223634-3371-4e5a-a594-e79584605e80\") " pod="openshift-ingress/router-default-6f9c47f54-2kl8l" Sep 17 07:09:05.465498 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:09:05.465469 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/fa45a0ac-8d9b-4458-b6c0-ae63e5aff0ab-telemetry-config\") pod \"cluster-monitoring-operator-6cd954b897-24z67\" (UID: \"fa45a0ac-8d9b-4458-b6c0-ae63e5aff0ab\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-24z67" Sep 17 07:09:05.465498 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:09:05.465490 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/5a8b414a-bbfc-4557-8da2-cf9b40f9a6c1-samples-operator-tls\") pod \"cluster-samples-operator-86499c89c4-v6zwt\" (UID: \"5a8b414a-bbfc-4557-8da2-cf9b40f9a6c1\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-v6zwt" Sep 17 07:09:05.465693 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:09:05.465533 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/73223634-3371-4e5a-a594-e79584605e80-stats-auth\") pod \"router-default-6f9c47f54-2kl8l\" (UID: \"73223634-3371-4e5a-a594-e79584605e80\") " pod="openshift-ingress/router-default-6f9c47f54-2kl8l" Sep 17 07:09:05.465693 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:09:05.465548 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/73223634-3371-4e5a-a594-e79584605e80-metrics-certs\") pod \"router-default-6f9c47f54-2kl8l\" (UID: \"73223634-3371-4e5a-a594-e79584605e80\") " pod="openshift-ingress/router-default-6f9c47f54-2kl8l" Sep 17 07:09:05.465693 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:09:05.465601 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/73223634-3371-4e5a-a594-e79584605e80-service-ca-bundle\") pod \"router-default-6f9c47f54-2kl8l\" (UID: \"73223634-3371-4e5a-a594-e79584605e80\") " pod="openshift-ingress/router-default-6f9c47f54-2kl8l" Sep 17 07:09:05.465693 ip-10-0-138-13 kubenswrapper[2559]: E0917 07:09:05.465618 2559 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Sep 17 07:09:05.465693 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:09:05.465640 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ktgrw\" (UniqueName: \"kubernetes.io/projected/fa45a0ac-8d9b-4458-b6c0-ae63e5aff0ab-kube-api-access-ktgrw\") pod \"cluster-monitoring-operator-6cd954b897-24z67\" (UID: \"fa45a0ac-8d9b-4458-b6c0-ae63e5aff0ab\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-24z67" Sep 17 07:09:05.465693 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:09:05.465671 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/73223634-3371-4e5a-a594-e79584605e80-default-certificate\") pod \"router-default-6f9c47f54-2kl8l\" (UID: \"73223634-3371-4e5a-a594-e79584605e80\") " pod="openshift-ingress/router-default-6f9c47f54-2kl8l" Sep 17 07:09:05.465693 ip-10-0-138-13 kubenswrapper[2559]: E0917 07:09:05.465688 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/73223634-3371-4e5a-a594-e79584605e80-metrics-certs podName:73223634-3371-4e5a-a594-e79584605e80 nodeName:}" failed. No retries permitted until 2026-09-17 07:09:05.965667836 +0000 UTC m=+53.513814536 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/73223634-3371-4e5a-a594-e79584605e80-metrics-certs") pod "router-default-6f9c47f54-2kl8l" (UID: "73223634-3371-4e5a-a594-e79584605e80") : secret "router-metrics-certs-default" not found Sep 17 07:09:05.466034 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:09:05.465772 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/fa45a0ac-8d9b-4458-b6c0-ae63e5aff0ab-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cd954b897-24z67\" (UID: \"fa45a0ac-8d9b-4458-b6c0-ae63e5aff0ab\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-24z67" Sep 17 07:09:05.466034 ip-10-0-138-13 kubenswrapper[2559]: E0917 07:09:05.465789 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/73223634-3371-4e5a-a594-e79584605e80-service-ca-bundle podName:73223634-3371-4e5a-a594-e79584605e80 nodeName:}" failed. No retries permitted until 2026-09-17 07:09:05.965769254 +0000 UTC m=+53.513915963 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/73223634-3371-4e5a-a594-e79584605e80-service-ca-bundle") pod "router-default-6f9c47f54-2kl8l" (UID: "73223634-3371-4e5a-a594-e79584605e80") : configmap references non-existent config key: service-ca.crt Sep 17 07:09:05.466034 ip-10-0-138-13 kubenswrapper[2559]: E0917 07:09:05.465835 2559 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Sep 17 07:09:05.466034 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:09:05.465855 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n2b98\" (UniqueName: \"kubernetes.io/projected/39418702-f038-4ba4-b9be-d4132800b75c-kube-api-access-n2b98\") pod \"volume-data-source-validator-86695b7cc7-mpn5m\" (UID: \"39418702-f038-4ba4-b9be-d4132800b75c\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-86695b7cc7-mpn5m" Sep 17 07:09:05.466034 ip-10-0-138-13 kubenswrapper[2559]: E0917 07:09:05.465886 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fa45a0ac-8d9b-4458-b6c0-ae63e5aff0ab-cluster-monitoring-operator-tls podName:fa45a0ac-8d9b-4458-b6c0-ae63e5aff0ab nodeName:}" failed. No retries permitted until 2026-09-17 07:09:05.9658716 +0000 UTC m=+53.514018288 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/fa45a0ac-8d9b-4458-b6c0-ae63e5aff0ab-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6cd954b897-24z67" (UID: "fa45a0ac-8d9b-4458-b6c0-ae63e5aff0ab") : secret "cluster-monitoring-operator-tls" not found Sep 17 07:09:05.466034 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:09:05.465942 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-944xn\" (UniqueName: \"kubernetes.io/projected/5a8b414a-bbfc-4557-8da2-cf9b40f9a6c1-kube-api-access-944xn\") pod \"cluster-samples-operator-86499c89c4-v6zwt\" (UID: \"5a8b414a-bbfc-4557-8da2-cf9b40f9a6c1\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-v6zwt" Sep 17 07:09:05.466287 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:09:05.466227 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/fa45a0ac-8d9b-4458-b6c0-ae63e5aff0ab-telemetry-config\") pod \"cluster-monitoring-operator-6cd954b897-24z67\" (UID: \"fa45a0ac-8d9b-4458-b6c0-ae63e5aff0ab\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-24z67" Sep 17 07:09:05.469206 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:09:05.469186 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/73223634-3371-4e5a-a594-e79584605e80-default-certificate\") pod \"router-default-6f9c47f54-2kl8l\" (UID: \"73223634-3371-4e5a-a594-e79584605e80\") " pod="openshift-ingress/router-default-6f9c47f54-2kl8l" Sep 17 07:09:05.469289 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:09:05.469225 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/73223634-3371-4e5a-a594-e79584605e80-stats-auth\") pod \"router-default-6f9c47f54-2kl8l\" (UID: \"73223634-3371-4e5a-a594-e79584605e80\") " pod="openshift-ingress/router-default-6f9c47f54-2kl8l" Sep 17 07:09:05.477526 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:09:05.477495 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4299t\" (UniqueName: \"kubernetes.io/projected/73223634-3371-4e5a-a594-e79584605e80-kube-api-access-4299t\") pod \"router-default-6f9c47f54-2kl8l\" (UID: \"73223634-3371-4e5a-a594-e79584605e80\") " pod="openshift-ingress/router-default-6f9c47f54-2kl8l" Sep 17 07:09:05.477604 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:09:05.477563 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ktgrw\" (UniqueName: \"kubernetes.io/projected/fa45a0ac-8d9b-4458-b6c0-ae63e5aff0ab-kube-api-access-ktgrw\") pod \"cluster-monitoring-operator-6cd954b897-24z67\" (UID: \"fa45a0ac-8d9b-4458-b6c0-ae63e5aff0ab\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-24z67" Sep 17 07:09:05.567141 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:09:05.567114 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/cd659f26-f444-43c8-bc39-fbd8f61b84b0-serving-cert\") pod \"insights-operator-5844b856db-tvlrq\" (UID: \"cd659f26-f444-43c8-bc39-fbd8f61b84b0\") " pod="openshift-insights/insights-operator-5844b856db-tvlrq" Sep 17 07:09:05.567296 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:09:05.567184 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/cd659f26-f444-43c8-bc39-fbd8f61b84b0-snapshots\") pod \"insights-operator-5844b856db-tvlrq\" (UID: \"cd659f26-f444-43c8-bc39-fbd8f61b84b0\") " pod="openshift-insights/insights-operator-5844b856db-tvlrq" Sep 17 07:09:05.567296 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:09:05.567213 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n2b98\" (UniqueName: \"kubernetes.io/projected/39418702-f038-4ba4-b9be-d4132800b75c-kube-api-access-n2b98\") pod \"volume-data-source-validator-86695b7cc7-mpn5m\" (UID: \"39418702-f038-4ba4-b9be-d4132800b75c\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-86695b7cc7-mpn5m" Sep 17 07:09:05.567296 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:09:05.567258 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-944xn\" (UniqueName: \"kubernetes.io/projected/5a8b414a-bbfc-4557-8da2-cf9b40f9a6c1-kube-api-access-944xn\") pod \"cluster-samples-operator-86499c89c4-v6zwt\" (UID: \"5a8b414a-bbfc-4557-8da2-cf9b40f9a6c1\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-v6zwt" Sep 17 07:09:05.567296 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:09:05.567283 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/cd659f26-f444-43c8-bc39-fbd8f61b84b0-tmp\") pod \"insights-operator-5844b856db-tvlrq\" (UID: \"cd659f26-f444-43c8-bc39-fbd8f61b84b0\") " pod="openshift-insights/insights-operator-5844b856db-tvlrq" Sep 17 07:09:05.567472 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:09:05.567313 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/5a8b414a-bbfc-4557-8da2-cf9b40f9a6c1-samples-operator-tls\") pod \"cluster-samples-operator-86499c89c4-v6zwt\" (UID: \"5a8b414a-bbfc-4557-8da2-cf9b40f9a6c1\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-v6zwt" Sep 17 07:09:05.567472 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:09:05.567340 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cd659f26-f444-43c8-bc39-fbd8f61b84b0-trusted-ca-bundle\") pod \"insights-operator-5844b856db-tvlrq\" (UID: \"cd659f26-f444-43c8-bc39-fbd8f61b84b0\") " pod="openshift-insights/insights-operator-5844b856db-tvlrq" Sep 17 07:09:05.567472 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:09:05.567418 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cd659f26-f444-43c8-bc39-fbd8f61b84b0-service-ca-bundle\") pod \"insights-operator-5844b856db-tvlrq\" (UID: \"cd659f26-f444-43c8-bc39-fbd8f61b84b0\") " pod="openshift-insights/insights-operator-5844b856db-tvlrq" Sep 17 07:09:05.567472 ip-10-0-138-13 kubenswrapper[2559]: E0917 07:09:05.567442 2559 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Sep 17 07:09:05.567472 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:09:05.567450 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5ldgs\" (UniqueName: \"kubernetes.io/projected/cd659f26-f444-43c8-bc39-fbd8f61b84b0-kube-api-access-5ldgs\") pod \"insights-operator-5844b856db-tvlrq\" (UID: \"cd659f26-f444-43c8-bc39-fbd8f61b84b0\") " pod="openshift-insights/insights-operator-5844b856db-tvlrq" Sep 17 07:09:05.567710 ip-10-0-138-13 kubenswrapper[2559]: E0917 07:09:05.567494 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5a8b414a-bbfc-4557-8da2-cf9b40f9a6c1-samples-operator-tls podName:5a8b414a-bbfc-4557-8da2-cf9b40f9a6c1 nodeName:}" failed. No retries permitted until 2026-09-17 07:09:06.06748133 +0000 UTC m=+53.615628018 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/5a8b414a-bbfc-4557-8da2-cf9b40f9a6c1-samples-operator-tls") pod "cluster-samples-operator-86499c89c4-v6zwt" (UID: "5a8b414a-bbfc-4557-8da2-cf9b40f9a6c1") : secret "samples-operator-tls" not found Sep 17 07:09:05.577114 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:09:05.577090 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-944xn\" (UniqueName: \"kubernetes.io/projected/5a8b414a-bbfc-4557-8da2-cf9b40f9a6c1-kube-api-access-944xn\") pod \"cluster-samples-operator-86499c89c4-v6zwt\" (UID: \"5a8b414a-bbfc-4557-8da2-cf9b40f9a6c1\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-v6zwt" Sep 17 07:09:05.587866 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:09:05.587845 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-n2b98\" (UniqueName: \"kubernetes.io/projected/39418702-f038-4ba4-b9be-d4132800b75c-kube-api-access-n2b98\") pod \"volume-data-source-validator-86695b7cc7-mpn5m\" (UID: \"39418702-f038-4ba4-b9be-d4132800b75c\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-86695b7cc7-mpn5m" Sep 17 07:09:05.621860 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:09:05.621838 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-86695b7cc7-mpn5m" Sep 17 07:09:05.669250 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:09:05.668336 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/cd659f26-f444-43c8-bc39-fbd8f61b84b0-tmp\") pod \"insights-operator-5844b856db-tvlrq\" (UID: \"cd659f26-f444-43c8-bc39-fbd8f61b84b0\") " pod="openshift-insights/insights-operator-5844b856db-tvlrq" Sep 17 07:09:05.669250 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:09:05.668426 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cd659f26-f444-43c8-bc39-fbd8f61b84b0-trusted-ca-bundle\") pod \"insights-operator-5844b856db-tvlrq\" (UID: \"cd659f26-f444-43c8-bc39-fbd8f61b84b0\") " pod="openshift-insights/insights-operator-5844b856db-tvlrq" Sep 17 07:09:05.669250 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:09:05.668476 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cd659f26-f444-43c8-bc39-fbd8f61b84b0-service-ca-bundle\") pod \"insights-operator-5844b856db-tvlrq\" (UID: \"cd659f26-f444-43c8-bc39-fbd8f61b84b0\") " pod="openshift-insights/insights-operator-5844b856db-tvlrq" Sep 17 07:09:05.669250 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:09:05.668501 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5ldgs\" (UniqueName: \"kubernetes.io/projected/cd659f26-f444-43c8-bc39-fbd8f61b84b0-kube-api-access-5ldgs\") pod \"insights-operator-5844b856db-tvlrq\" (UID: \"cd659f26-f444-43c8-bc39-fbd8f61b84b0\") " pod="openshift-insights/insights-operator-5844b856db-tvlrq" Sep 17 07:09:05.669250 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:09:05.668590 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/cd659f26-f444-43c8-bc39-fbd8f61b84b0-serving-cert\") pod \"insights-operator-5844b856db-tvlrq\" (UID: \"cd659f26-f444-43c8-bc39-fbd8f61b84b0\") " pod="openshift-insights/insights-operator-5844b856db-tvlrq" Sep 17 07:09:05.669250 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:09:05.668650 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/cd659f26-f444-43c8-bc39-fbd8f61b84b0-snapshots\") pod \"insights-operator-5844b856db-tvlrq\" (UID: \"cd659f26-f444-43c8-bc39-fbd8f61b84b0\") " pod="openshift-insights/insights-operator-5844b856db-tvlrq" Sep 17 07:09:05.669250 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:09:05.668732 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/cd659f26-f444-43c8-bc39-fbd8f61b84b0-tmp\") pod \"insights-operator-5844b856db-tvlrq\" (UID: \"cd659f26-f444-43c8-bc39-fbd8f61b84b0\") " pod="openshift-insights/insights-operator-5844b856db-tvlrq" Sep 17 07:09:05.669250 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:09:05.669170 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/cd659f26-f444-43c8-bc39-fbd8f61b84b0-snapshots\") pod \"insights-operator-5844b856db-tvlrq\" (UID: \"cd659f26-f444-43c8-bc39-fbd8f61b84b0\") " pod="openshift-insights/insights-operator-5844b856db-tvlrq" Sep 17 07:09:05.669706 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:09:05.669337 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cd659f26-f444-43c8-bc39-fbd8f61b84b0-trusted-ca-bundle\") pod \"insights-operator-5844b856db-tvlrq\" (UID: \"cd659f26-f444-43c8-bc39-fbd8f61b84b0\") " pod="openshift-insights/insights-operator-5844b856db-tvlrq" Sep 17 07:09:05.670242 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:09:05.670219 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cd659f26-f444-43c8-bc39-fbd8f61b84b0-service-ca-bundle\") pod \"insights-operator-5844b856db-tvlrq\" (UID: \"cd659f26-f444-43c8-bc39-fbd8f61b84b0\") " pod="openshift-insights/insights-operator-5844b856db-tvlrq" Sep 17 07:09:05.671772 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:09:05.671750 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/cd659f26-f444-43c8-bc39-fbd8f61b84b0-serving-cert\") pod \"insights-operator-5844b856db-tvlrq\" (UID: \"cd659f26-f444-43c8-bc39-fbd8f61b84b0\") " pod="openshift-insights/insights-operator-5844b856db-tvlrq" Sep 17 07:09:05.678814 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:09:05.678791 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5ldgs\" (UniqueName: \"kubernetes.io/projected/cd659f26-f444-43c8-bc39-fbd8f61b84b0-kube-api-access-5ldgs\") pod \"insights-operator-5844b856db-tvlrq\" (UID: \"cd659f26-f444-43c8-bc39-fbd8f61b84b0\") " pod="openshift-insights/insights-operator-5844b856db-tvlrq" Sep 17 07:09:05.722493 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:09:05.722434 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-5844b856db-tvlrq" Sep 17 07:09:05.897486 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:09:05.897449 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-86695b7cc7-mpn5m"] Sep 17 07:09:05.900190 ip-10-0-138-13 kubenswrapper[2559]: W0917 07:09:05.900167 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod39418702_f038_4ba4_b9be_d4132800b75c.slice/crio-db14ee36af2f8ac4605a9a8576d7cfd3e7219d295c5252fbadf44cabe0963aa0 WatchSource:0}: Error finding container db14ee36af2f8ac4605a9a8576d7cfd3e7219d295c5252fbadf44cabe0963aa0: Status 404 returned error can't find the container with id db14ee36af2f8ac4605a9a8576d7cfd3e7219d295c5252fbadf44cabe0963aa0 Sep 17 07:09:05.970300 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:09:05.970273 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/73223634-3371-4e5a-a594-e79584605e80-metrics-certs\") pod \"router-default-6f9c47f54-2kl8l\" (UID: \"73223634-3371-4e5a-a594-e79584605e80\") " pod="openshift-ingress/router-default-6f9c47f54-2kl8l" Sep 17 07:09:05.970449 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:09:05.970324 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/73223634-3371-4e5a-a594-e79584605e80-service-ca-bundle\") pod \"router-default-6f9c47f54-2kl8l\" (UID: \"73223634-3371-4e5a-a594-e79584605e80\") " pod="openshift-ingress/router-default-6f9c47f54-2kl8l" Sep 17 07:09:05.970449 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:09:05.970369 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/fa45a0ac-8d9b-4458-b6c0-ae63e5aff0ab-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cd954b897-24z67\" (UID: \"fa45a0ac-8d9b-4458-b6c0-ae63e5aff0ab\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-24z67" Sep 17 07:09:05.970449 ip-10-0-138-13 kubenswrapper[2559]: E0917 07:09:05.970426 2559 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Sep 17 07:09:05.970602 ip-10-0-138-13 kubenswrapper[2559]: E0917 07:09:05.970431 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/73223634-3371-4e5a-a594-e79584605e80-service-ca-bundle podName:73223634-3371-4e5a-a594-e79584605e80 nodeName:}" failed. No retries permitted until 2026-09-17 07:09:06.970414687 +0000 UTC m=+54.518561375 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/73223634-3371-4e5a-a594-e79584605e80-service-ca-bundle") pod "router-default-6f9c47f54-2kl8l" (UID: "73223634-3371-4e5a-a594-e79584605e80") : configmap references non-existent config key: service-ca.crt Sep 17 07:09:05.970602 ip-10-0-138-13 kubenswrapper[2559]: E0917 07:09:05.970481 2559 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Sep 17 07:09:05.970602 ip-10-0-138-13 kubenswrapper[2559]: E0917 07:09:05.970500 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/73223634-3371-4e5a-a594-e79584605e80-metrics-certs podName:73223634-3371-4e5a-a594-e79584605e80 nodeName:}" failed. No retries permitted until 2026-09-17 07:09:06.970483237 +0000 UTC m=+54.518629925 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/73223634-3371-4e5a-a594-e79584605e80-metrics-certs") pod "router-default-6f9c47f54-2kl8l" (UID: "73223634-3371-4e5a-a594-e79584605e80") : secret "router-metrics-certs-default" not found Sep 17 07:09:05.970602 ip-10-0-138-13 kubenswrapper[2559]: E0917 07:09:05.970529 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fa45a0ac-8d9b-4458-b6c0-ae63e5aff0ab-cluster-monitoring-operator-tls podName:fa45a0ac-8d9b-4458-b6c0-ae63e5aff0ab nodeName:}" failed. No retries permitted until 2026-09-17 07:09:06.970513807 +0000 UTC m=+54.518660521 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/fa45a0ac-8d9b-4458-b6c0-ae63e5aff0ab-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6cd954b897-24z67" (UID: "fa45a0ac-8d9b-4458-b6c0-ae63e5aff0ab") : secret "cluster-monitoring-operator-tls" not found Sep 17 07:09:05.995319 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:09:05.995261 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-5844b856db-tvlrq"] Sep 17 07:09:05.998648 ip-10-0-138-13 kubenswrapper[2559]: W0917 07:09:05.998627 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcd659f26_f444_43c8_bc39_fbd8f61b84b0.slice/crio-8562d71a84397a00f4b583068e73a780062f3610715212be8d75e1d2b67e1623 WatchSource:0}: Error finding container 8562d71a84397a00f4b583068e73a780062f3610715212be8d75e1d2b67e1623: Status 404 returned error can't find the container with id 8562d71a84397a00f4b583068e73a780062f3610715212be8d75e1d2b67e1623 Sep 17 07:09:06.071235 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:09:06.071208 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/5a8b414a-bbfc-4557-8da2-cf9b40f9a6c1-samples-operator-tls\") pod \"cluster-samples-operator-86499c89c4-v6zwt\" (UID: \"5a8b414a-bbfc-4557-8da2-cf9b40f9a6c1\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-v6zwt" Sep 17 07:09:06.071392 ip-10-0-138-13 kubenswrapper[2559]: E0917 07:09:06.071373 2559 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Sep 17 07:09:06.071460 ip-10-0-138-13 kubenswrapper[2559]: E0917 07:09:06.071443 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5a8b414a-bbfc-4557-8da2-cf9b40f9a6c1-samples-operator-tls podName:5a8b414a-bbfc-4557-8da2-cf9b40f9a6c1 nodeName:}" failed. No retries permitted until 2026-09-17 07:09:07.071423659 +0000 UTC m=+54.619570364 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/5a8b414a-bbfc-4557-8da2-cf9b40f9a6c1-samples-operator-tls") pod "cluster-samples-operator-86499c89c4-v6zwt" (UID: "5a8b414a-bbfc-4557-8da2-cf9b40f9a6c1") : secret "samples-operator-tls" not found Sep 17 07:09:06.156430 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:09:06.156401 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5844b856db-tvlrq" event={"ID":"cd659f26-f444-43c8-bc39-fbd8f61b84b0","Type":"ContainerStarted","Data":"8562d71a84397a00f4b583068e73a780062f3610715212be8d75e1d2b67e1623"} Sep 17 07:09:06.157529 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:09:06.157509 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-86695b7cc7-mpn5m" event={"ID":"39418702-f038-4ba4-b9be-d4132800b75c","Type":"ContainerStarted","Data":"db14ee36af2f8ac4605a9a8576d7cfd3e7219d295c5252fbadf44cabe0963aa0"} Sep 17 07:09:06.979962 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:09:06.979936 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/73223634-3371-4e5a-a594-e79584605e80-service-ca-bundle\") pod \"router-default-6f9c47f54-2kl8l\" (UID: \"73223634-3371-4e5a-a594-e79584605e80\") " pod="openshift-ingress/router-default-6f9c47f54-2kl8l" Sep 17 07:09:06.980322 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:09:06.979997 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/fa45a0ac-8d9b-4458-b6c0-ae63e5aff0ab-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cd954b897-24z67\" (UID: \"fa45a0ac-8d9b-4458-b6c0-ae63e5aff0ab\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-24z67" Sep 17 07:09:06.980322 ip-10-0-138-13 kubenswrapper[2559]: E0917 07:09:06.980090 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/73223634-3371-4e5a-a594-e79584605e80-service-ca-bundle podName:73223634-3371-4e5a-a594-e79584605e80 nodeName:}" failed. No retries permitted until 2026-09-17 07:09:08.980069731 +0000 UTC m=+56.528216439 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/73223634-3371-4e5a-a594-e79584605e80-service-ca-bundle") pod "router-default-6f9c47f54-2kl8l" (UID: "73223634-3371-4e5a-a594-e79584605e80") : configmap references non-existent config key: service-ca.crt Sep 17 07:09:06.980322 ip-10-0-138-13 kubenswrapper[2559]: E0917 07:09:06.980151 2559 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Sep 17 07:09:06.980322 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:09:06.980180 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/73223634-3371-4e5a-a594-e79584605e80-metrics-certs\") pod \"router-default-6f9c47f54-2kl8l\" (UID: \"73223634-3371-4e5a-a594-e79584605e80\") " pod="openshift-ingress/router-default-6f9c47f54-2kl8l" Sep 17 07:09:06.980322 ip-10-0-138-13 kubenswrapper[2559]: E0917 07:09:06.980197 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fa45a0ac-8d9b-4458-b6c0-ae63e5aff0ab-cluster-monitoring-operator-tls podName:fa45a0ac-8d9b-4458-b6c0-ae63e5aff0ab nodeName:}" failed. No retries permitted until 2026-09-17 07:09:08.980182233 +0000 UTC m=+56.528328922 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/fa45a0ac-8d9b-4458-b6c0-ae63e5aff0ab-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6cd954b897-24z67" (UID: "fa45a0ac-8d9b-4458-b6c0-ae63e5aff0ab") : secret "cluster-monitoring-operator-tls" not found Sep 17 07:09:06.980322 ip-10-0-138-13 kubenswrapper[2559]: E0917 07:09:06.980239 2559 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Sep 17 07:09:06.980322 ip-10-0-138-13 kubenswrapper[2559]: E0917 07:09:06.980270 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/73223634-3371-4e5a-a594-e79584605e80-metrics-certs podName:73223634-3371-4e5a-a594-e79584605e80 nodeName:}" failed. No retries permitted until 2026-09-17 07:09:08.980261871 +0000 UTC m=+56.528408583 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/73223634-3371-4e5a-a594-e79584605e80-metrics-certs") pod "router-default-6f9c47f54-2kl8l" (UID: "73223634-3371-4e5a-a594-e79584605e80") : secret "router-metrics-certs-default" not found Sep 17 07:09:07.081236 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:09:07.081200 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/5a8b414a-bbfc-4557-8da2-cf9b40f9a6c1-samples-operator-tls\") pod \"cluster-samples-operator-86499c89c4-v6zwt\" (UID: \"5a8b414a-bbfc-4557-8da2-cf9b40f9a6c1\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-v6zwt" Sep 17 07:09:07.081413 ip-10-0-138-13 kubenswrapper[2559]: E0917 07:09:07.081353 2559 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Sep 17 07:09:07.081470 ip-10-0-138-13 kubenswrapper[2559]: E0917 07:09:07.081431 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5a8b414a-bbfc-4557-8da2-cf9b40f9a6c1-samples-operator-tls podName:5a8b414a-bbfc-4557-8da2-cf9b40f9a6c1 nodeName:}" failed. No retries permitted until 2026-09-17 07:09:09.081415627 +0000 UTC m=+56.629562315 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/5a8b414a-bbfc-4557-8da2-cf9b40f9a6c1-samples-operator-tls") pod "cluster-samples-operator-86499c89c4-v6zwt" (UID: "5a8b414a-bbfc-4557-8da2-cf9b40f9a6c1") : secret "samples-operator-tls" not found Sep 17 07:09:07.161339 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:09:07.161305 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-86695b7cc7-mpn5m" event={"ID":"39418702-f038-4ba4-b9be-d4132800b75c","Type":"ContainerStarted","Data":"e0f2c601aba2604d377e0bf563752d7ad12054a83c23be33f8b925a659f592c2"} Sep 17 07:09:08.997814 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:09:08.997778 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/73223634-3371-4e5a-a594-e79584605e80-metrics-certs\") pod \"router-default-6f9c47f54-2kl8l\" (UID: \"73223634-3371-4e5a-a594-e79584605e80\") " pod="openshift-ingress/router-default-6f9c47f54-2kl8l" Sep 17 07:09:08.997814 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:09:08.997822 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/73223634-3371-4e5a-a594-e79584605e80-service-ca-bundle\") pod \"router-default-6f9c47f54-2kl8l\" (UID: \"73223634-3371-4e5a-a594-e79584605e80\") " pod="openshift-ingress/router-default-6f9c47f54-2kl8l" Sep 17 07:09:08.998344 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:09:08.997852 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/fa45a0ac-8d9b-4458-b6c0-ae63e5aff0ab-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cd954b897-24z67\" (UID: \"fa45a0ac-8d9b-4458-b6c0-ae63e5aff0ab\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-24z67" Sep 17 07:09:08.998344 ip-10-0-138-13 kubenswrapper[2559]: E0917 07:09:08.998017 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/73223634-3371-4e5a-a594-e79584605e80-service-ca-bundle podName:73223634-3371-4e5a-a594-e79584605e80 nodeName:}" failed. No retries permitted until 2026-09-17 07:09:12.997993088 +0000 UTC m=+60.546139794 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/73223634-3371-4e5a-a594-e79584605e80-service-ca-bundle") pod "router-default-6f9c47f54-2kl8l" (UID: "73223634-3371-4e5a-a594-e79584605e80") : configmap references non-existent config key: service-ca.crt Sep 17 07:09:08.998344 ip-10-0-138-13 kubenswrapper[2559]: E0917 07:09:08.998252 2559 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Sep 17 07:09:08.998344 ip-10-0-138-13 kubenswrapper[2559]: E0917 07:09:08.998299 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/73223634-3371-4e5a-a594-e79584605e80-metrics-certs podName:73223634-3371-4e5a-a594-e79584605e80 nodeName:}" failed. No retries permitted until 2026-09-17 07:09:12.998284691 +0000 UTC m=+60.546431379 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/73223634-3371-4e5a-a594-e79584605e80-metrics-certs") pod "router-default-6f9c47f54-2kl8l" (UID: "73223634-3371-4e5a-a594-e79584605e80") : secret "router-metrics-certs-default" not found Sep 17 07:09:08.998552 ip-10-0-138-13 kubenswrapper[2559]: E0917 07:09:08.998532 2559 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Sep 17 07:09:08.998603 ip-10-0-138-13 kubenswrapper[2559]: E0917 07:09:08.998591 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fa45a0ac-8d9b-4458-b6c0-ae63e5aff0ab-cluster-monitoring-operator-tls podName:fa45a0ac-8d9b-4458-b6c0-ae63e5aff0ab nodeName:}" failed. No retries permitted until 2026-09-17 07:09:12.998578518 +0000 UTC m=+60.546725221 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/fa45a0ac-8d9b-4458-b6c0-ae63e5aff0ab-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6cd954b897-24z67" (UID: "fa45a0ac-8d9b-4458-b6c0-ae63e5aff0ab") : secret "cluster-monitoring-operator-tls" not found Sep 17 07:09:09.098600 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:09:09.098569 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/5a8b414a-bbfc-4557-8da2-cf9b40f9a6c1-samples-operator-tls\") pod \"cluster-samples-operator-86499c89c4-v6zwt\" (UID: \"5a8b414a-bbfc-4557-8da2-cf9b40f9a6c1\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-v6zwt" Sep 17 07:09:09.098738 ip-10-0-138-13 kubenswrapper[2559]: E0917 07:09:09.098706 2559 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Sep 17 07:09:09.098779 ip-10-0-138-13 kubenswrapper[2559]: E0917 07:09:09.098761 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5a8b414a-bbfc-4557-8da2-cf9b40f9a6c1-samples-operator-tls podName:5a8b414a-bbfc-4557-8da2-cf9b40f9a6c1 nodeName:}" failed. No retries permitted until 2026-09-17 07:09:13.098746071 +0000 UTC m=+60.646892769 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/5a8b414a-bbfc-4557-8da2-cf9b40f9a6c1-samples-operator-tls") pod "cluster-samples-operator-86499c89c4-v6zwt" (UID: "5a8b414a-bbfc-4557-8da2-cf9b40f9a6c1") : secret "samples-operator-tls" not found Sep 17 07:09:09.168231 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:09:09.168202 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5844b856db-tvlrq" event={"ID":"cd659f26-f444-43c8-bc39-fbd8f61b84b0","Type":"ContainerStarted","Data":"22f4a2069deeab9291340ecfbbff127508a3a9570b7dab381aa197056180d093"} Sep 17 07:09:09.220145 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:09:09.220104 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-86695b7cc7-mpn5m" podStartSLOduration=3.203795514 podStartE2EDuration="4.220091599s" totalImagesPullingTime="1.016296085s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 07:09:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 07:09:07.207265869 +0000 UTC m=+54.755412578" watchObservedRunningTime="2026-09-17 07:09:09.220091599 +0000 UTC m=+56.768238307" Sep 17 07:09:09.220272 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:09:09.220172 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-operator-5844b856db-tvlrq" podStartSLOduration=1.949921449 podStartE2EDuration="4.220166798s" totalImagesPullingTime="2.270245349s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 07:09:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 07:09:09.219933011 +0000 UTC m=+56.768079720" watchObservedRunningTime="2026-09-17 07:09:09.220166798 +0000 UTC m=+56.768313507" Sep 17 07:09:09.769239 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:09:09.769202 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-47gnn"] Sep 17 07:09:09.774292 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:09:09.774270 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-47gnn" Sep 17 07:09:09.786909 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:09:09.786888 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Sep 17 07:09:09.794088 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:09:09.794067 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Sep 17 07:09:09.801959 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:09:09.801943 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-hbl8z\"" Sep 17 07:09:09.810735 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:09:09.810711 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-47gnn"] Sep 17 07:09:09.905607 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:09:09.905585 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/1a90ce9b-0a4a-4e14-9f90-a27c4f39b958-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-47gnn\" (UID: \"1a90ce9b-0a4a-4e14-9f90-a27c4f39b958\") " pod="openshift-insights/insights-runtime-extractor-47gnn" Sep 17 07:09:09.905720 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:09:09.905635 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/1a90ce9b-0a4a-4e14-9f90-a27c4f39b958-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-47gnn\" (UID: \"1a90ce9b-0a4a-4e14-9f90-a27c4f39b958\") " pod="openshift-insights/insights-runtime-extractor-47gnn" Sep 17 07:09:09.905720 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:09:09.905690 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/1a90ce9b-0a4a-4e14-9f90-a27c4f39b958-data-volume\") pod \"insights-runtime-extractor-47gnn\" (UID: \"1a90ce9b-0a4a-4e14-9f90-a27c4f39b958\") " pod="openshift-insights/insights-runtime-extractor-47gnn" Sep 17 07:09:09.905784 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:09:09.905736 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/1a90ce9b-0a4a-4e14-9f90-a27c4f39b958-crio-socket\") pod \"insights-runtime-extractor-47gnn\" (UID: \"1a90ce9b-0a4a-4e14-9f90-a27c4f39b958\") " pod="openshift-insights/insights-runtime-extractor-47gnn" Sep 17 07:09:09.905784 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:09:09.905769 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gwxbp\" (UniqueName: \"kubernetes.io/projected/1a90ce9b-0a4a-4e14-9f90-a27c4f39b958-kube-api-access-gwxbp\") pod \"insights-runtime-extractor-47gnn\" (UID: \"1a90ce9b-0a4a-4e14-9f90-a27c4f39b958\") " pod="openshift-insights/insights-runtime-extractor-47gnn" Sep 17 07:09:10.007020 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:09:10.006990 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/1a90ce9b-0a4a-4e14-9f90-a27c4f39b958-crio-socket\") pod \"insights-runtime-extractor-47gnn\" (UID: \"1a90ce9b-0a4a-4e14-9f90-a27c4f39b958\") " pod="openshift-insights/insights-runtime-extractor-47gnn" Sep 17 07:09:10.007469 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:09:10.007034 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gwxbp\" (UniqueName: \"kubernetes.io/projected/1a90ce9b-0a4a-4e14-9f90-a27c4f39b958-kube-api-access-gwxbp\") pod \"insights-runtime-extractor-47gnn\" (UID: \"1a90ce9b-0a4a-4e14-9f90-a27c4f39b958\") " pod="openshift-insights/insights-runtime-extractor-47gnn" Sep 17 07:09:10.007469 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:09:10.007118 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/1a90ce9b-0a4a-4e14-9f90-a27c4f39b958-crio-socket\") pod \"insights-runtime-extractor-47gnn\" (UID: \"1a90ce9b-0a4a-4e14-9f90-a27c4f39b958\") " pod="openshift-insights/insights-runtime-extractor-47gnn" Sep 17 07:09:10.007469 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:09:10.007202 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/1a90ce9b-0a4a-4e14-9f90-a27c4f39b958-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-47gnn\" (UID: \"1a90ce9b-0a4a-4e14-9f90-a27c4f39b958\") " pod="openshift-insights/insights-runtime-extractor-47gnn" Sep 17 07:09:10.007469 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:09:10.007271 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/1a90ce9b-0a4a-4e14-9f90-a27c4f39b958-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-47gnn\" (UID: \"1a90ce9b-0a4a-4e14-9f90-a27c4f39b958\") " pod="openshift-insights/insights-runtime-extractor-47gnn" Sep 17 07:09:10.007469 ip-10-0-138-13 kubenswrapper[2559]: E0917 07:09:10.007301 2559 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Sep 17 07:09:10.007469 ip-10-0-138-13 kubenswrapper[2559]: E0917 07:09:10.007349 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/1a90ce9b-0a4a-4e14-9f90-a27c4f39b958-kube-rbac-proxy-cm podName:1a90ce9b-0a4a-4e14-9f90-a27c4f39b958 nodeName:}" failed. No retries permitted until 2026-09-17 07:09:10.507334036 +0000 UTC m=+58.055480723 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/1a90ce9b-0a4a-4e14-9f90-a27c4f39b958-kube-rbac-proxy-cm") pod "insights-runtime-extractor-47gnn" (UID: "1a90ce9b-0a4a-4e14-9f90-a27c4f39b958") : configmap "kube-rbac-proxy" not found Sep 17 07:09:10.007469 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:09:10.007365 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/1a90ce9b-0a4a-4e14-9f90-a27c4f39b958-data-volume\") pod \"insights-runtime-extractor-47gnn\" (UID: \"1a90ce9b-0a4a-4e14-9f90-a27c4f39b958\") " pod="openshift-insights/insights-runtime-extractor-47gnn" Sep 17 07:09:10.007469 ip-10-0-138-13 kubenswrapper[2559]: E0917 07:09:10.007395 2559 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Sep 17 07:09:10.007469 ip-10-0-138-13 kubenswrapper[2559]: E0917 07:09:10.007451 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1a90ce9b-0a4a-4e14-9f90-a27c4f39b958-insights-runtime-extractor-tls podName:1a90ce9b-0a4a-4e14-9f90-a27c4f39b958 nodeName:}" failed. No retries permitted until 2026-09-17 07:09:10.507439256 +0000 UTC m=+58.055585948 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/1a90ce9b-0a4a-4e14-9f90-a27c4f39b958-insights-runtime-extractor-tls") pod "insights-runtime-extractor-47gnn" (UID: "1a90ce9b-0a4a-4e14-9f90-a27c4f39b958") : secret "insights-runtime-extractor-tls" not found Sep 17 07:09:10.007741 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:09:10.007646 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/1a90ce9b-0a4a-4e14-9f90-a27c4f39b958-data-volume\") pod \"insights-runtime-extractor-47gnn\" (UID: \"1a90ce9b-0a4a-4e14-9f90-a27c4f39b958\") " pod="openshift-insights/insights-runtime-extractor-47gnn" Sep 17 07:09:10.052478 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:09:10.052419 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gwxbp\" (UniqueName: \"kubernetes.io/projected/1a90ce9b-0a4a-4e14-9f90-a27c4f39b958-kube-api-access-gwxbp\") pod \"insights-runtime-extractor-47gnn\" (UID: \"1a90ce9b-0a4a-4e14-9f90-a27c4f39b958\") " pod="openshift-insights/insights-runtime-extractor-47gnn" Sep 17 07:09:10.511838 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:09:10.511812 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/1a90ce9b-0a4a-4e14-9f90-a27c4f39b958-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-47gnn\" (UID: \"1a90ce9b-0a4a-4e14-9f90-a27c4f39b958\") " pod="openshift-insights/insights-runtime-extractor-47gnn" Sep 17 07:09:10.512005 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:09:10.511956 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/1a90ce9b-0a4a-4e14-9f90-a27c4f39b958-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-47gnn\" (UID: \"1a90ce9b-0a4a-4e14-9f90-a27c4f39b958\") " pod="openshift-insights/insights-runtime-extractor-47gnn" Sep 17 07:09:10.512005 ip-10-0-138-13 kubenswrapper[2559]: E0917 07:09:10.511989 2559 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Sep 17 07:09:10.512083 ip-10-0-138-13 kubenswrapper[2559]: E0917 07:09:10.512055 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1a90ce9b-0a4a-4e14-9f90-a27c4f39b958-insights-runtime-extractor-tls podName:1a90ce9b-0a4a-4e14-9f90-a27c4f39b958 nodeName:}" failed. No retries permitted until 2026-09-17 07:09:11.512041516 +0000 UTC m=+59.060188216 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/1a90ce9b-0a4a-4e14-9f90-a27c4f39b958-insights-runtime-extractor-tls") pod "insights-runtime-extractor-47gnn" (UID: "1a90ce9b-0a4a-4e14-9f90-a27c4f39b958") : secret "insights-runtime-extractor-tls" not found Sep 17 07:09:10.512083 ip-10-0-138-13 kubenswrapper[2559]: E0917 07:09:10.512068 2559 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Sep 17 07:09:10.512156 ip-10-0-138-13 kubenswrapper[2559]: E0917 07:09:10.512120 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/1a90ce9b-0a4a-4e14-9f90-a27c4f39b958-kube-rbac-proxy-cm podName:1a90ce9b-0a4a-4e14-9f90-a27c4f39b958 nodeName:}" failed. No retries permitted until 2026-09-17 07:09:11.512108098 +0000 UTC m=+59.060254802 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/1a90ce9b-0a4a-4e14-9f90-a27c4f39b958-kube-rbac-proxy-cm") pod "insights-runtime-extractor-47gnn" (UID: "1a90ce9b-0a4a-4e14-9f90-a27c4f39b958") : configmap "kube-rbac-proxy" not found Sep 17 07:09:11.520043 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:09:11.520009 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/1a90ce9b-0a4a-4e14-9f90-a27c4f39b958-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-47gnn\" (UID: \"1a90ce9b-0a4a-4e14-9f90-a27c4f39b958\") " pod="openshift-insights/insights-runtime-extractor-47gnn" Sep 17 07:09:11.520414 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:09:11.520162 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/1a90ce9b-0a4a-4e14-9f90-a27c4f39b958-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-47gnn\" (UID: \"1a90ce9b-0a4a-4e14-9f90-a27c4f39b958\") " pod="openshift-insights/insights-runtime-extractor-47gnn" Sep 17 07:09:11.520414 ip-10-0-138-13 kubenswrapper[2559]: E0917 07:09:11.520170 2559 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Sep 17 07:09:11.520414 ip-10-0-138-13 kubenswrapper[2559]: E0917 07:09:11.520237 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1a90ce9b-0a4a-4e14-9f90-a27c4f39b958-insights-runtime-extractor-tls podName:1a90ce9b-0a4a-4e14-9f90-a27c4f39b958 nodeName:}" failed. No retries permitted until 2026-09-17 07:09:13.520218693 +0000 UTC m=+61.068365402 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/1a90ce9b-0a4a-4e14-9f90-a27c4f39b958-insights-runtime-extractor-tls") pod "insights-runtime-extractor-47gnn" (UID: "1a90ce9b-0a4a-4e14-9f90-a27c4f39b958") : secret "insights-runtime-extractor-tls" not found Sep 17 07:09:11.520414 ip-10-0-138-13 kubenswrapper[2559]: E0917 07:09:11.520241 2559 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Sep 17 07:09:11.520414 ip-10-0-138-13 kubenswrapper[2559]: E0917 07:09:11.520277 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/1a90ce9b-0a4a-4e14-9f90-a27c4f39b958-kube-rbac-proxy-cm podName:1a90ce9b-0a4a-4e14-9f90-a27c4f39b958 nodeName:}" failed. No retries permitted until 2026-09-17 07:09:13.520267137 +0000 UTC m=+61.068413837 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/1a90ce9b-0a4a-4e14-9f90-a27c4f39b958-kube-rbac-proxy-cm") pod "insights-runtime-extractor-47gnn" (UID: "1a90ce9b-0a4a-4e14-9f90-a27c4f39b958") : configmap "kube-rbac-proxy" not found Sep 17 07:09:11.602268 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:09:11.602238 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-kf4sp_a731e2cb-6abe-4f3a-81ca-d8742a141c4e/dns-node-resolver/0.log" Sep 17 07:09:12.403448 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:09:12.403423 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-5c544_248ebec7-b104-47b9-9187-04bb22c1101a/node-ca/0.log" Sep 17 07:09:13.030290 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:09:13.030265 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/73223634-3371-4e5a-a594-e79584605e80-metrics-certs\") pod \"router-default-6f9c47f54-2kl8l\" (UID: \"73223634-3371-4e5a-a594-e79584605e80\") " pod="openshift-ingress/router-default-6f9c47f54-2kl8l" Sep 17 07:09:13.030706 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:09:13.030300 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/73223634-3371-4e5a-a594-e79584605e80-service-ca-bundle\") pod \"router-default-6f9c47f54-2kl8l\" (UID: \"73223634-3371-4e5a-a594-e79584605e80\") " pod="openshift-ingress/router-default-6f9c47f54-2kl8l" Sep 17 07:09:13.030706 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:09:13.030320 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/fa45a0ac-8d9b-4458-b6c0-ae63e5aff0ab-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cd954b897-24z67\" (UID: \"fa45a0ac-8d9b-4458-b6c0-ae63e5aff0ab\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-24z67" Sep 17 07:09:13.030706 ip-10-0-138-13 kubenswrapper[2559]: E0917 07:09:13.030391 2559 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Sep 17 07:09:13.030706 ip-10-0-138-13 kubenswrapper[2559]: E0917 07:09:13.030394 2559 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Sep 17 07:09:13.030706 ip-10-0-138-13 kubenswrapper[2559]: E0917 07:09:13.030431 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fa45a0ac-8d9b-4458-b6c0-ae63e5aff0ab-cluster-monitoring-operator-tls podName:fa45a0ac-8d9b-4458-b6c0-ae63e5aff0ab nodeName:}" failed. No retries permitted until 2026-09-17 07:09:21.030419659 +0000 UTC m=+68.578566346 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/fa45a0ac-8d9b-4458-b6c0-ae63e5aff0ab-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6cd954b897-24z67" (UID: "fa45a0ac-8d9b-4458-b6c0-ae63e5aff0ab") : secret "cluster-monitoring-operator-tls" not found Sep 17 07:09:13.030706 ip-10-0-138-13 kubenswrapper[2559]: E0917 07:09:13.030443 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/73223634-3371-4e5a-a594-e79584605e80-service-ca-bundle podName:73223634-3371-4e5a-a594-e79584605e80 nodeName:}" failed. No retries permitted until 2026-09-17 07:09:21.030436882 +0000 UTC m=+68.578583569 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/73223634-3371-4e5a-a594-e79584605e80-service-ca-bundle") pod "router-default-6f9c47f54-2kl8l" (UID: "73223634-3371-4e5a-a594-e79584605e80") : configmap references non-existent config key: service-ca.crt Sep 17 07:09:13.030706 ip-10-0-138-13 kubenswrapper[2559]: E0917 07:09:13.030453 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/73223634-3371-4e5a-a594-e79584605e80-metrics-certs podName:73223634-3371-4e5a-a594-e79584605e80 nodeName:}" failed. No retries permitted until 2026-09-17 07:09:21.030447256 +0000 UTC m=+68.578593942 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/73223634-3371-4e5a-a594-e79584605e80-metrics-certs") pod "router-default-6f9c47f54-2kl8l" (UID: "73223634-3371-4e5a-a594-e79584605e80") : secret "router-metrics-certs-default" not found Sep 17 07:09:13.095038 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:09:13.095019 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-b99wz" Sep 17 07:09:13.131657 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:09:13.131635 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/5a8b414a-bbfc-4557-8da2-cf9b40f9a6c1-samples-operator-tls\") pod \"cluster-samples-operator-86499c89c4-v6zwt\" (UID: \"5a8b414a-bbfc-4557-8da2-cf9b40f9a6c1\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-v6zwt" Sep 17 07:09:13.131771 ip-10-0-138-13 kubenswrapper[2559]: E0917 07:09:13.131755 2559 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Sep 17 07:09:13.131812 ip-10-0-138-13 kubenswrapper[2559]: E0917 07:09:13.131804 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5a8b414a-bbfc-4557-8da2-cf9b40f9a6c1-samples-operator-tls podName:5a8b414a-bbfc-4557-8da2-cf9b40f9a6c1 nodeName:}" failed. No retries permitted until 2026-09-17 07:09:21.131791743 +0000 UTC m=+68.679938449 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/5a8b414a-bbfc-4557-8da2-cf9b40f9a6c1-samples-operator-tls") pod "cluster-samples-operator-86499c89c4-v6zwt" (UID: "5a8b414a-bbfc-4557-8da2-cf9b40f9a6c1") : secret "samples-operator-tls" not found Sep 17 07:09:13.533518 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:09:13.533487 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/1a90ce9b-0a4a-4e14-9f90-a27c4f39b958-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-47gnn\" (UID: \"1a90ce9b-0a4a-4e14-9f90-a27c4f39b958\") " pod="openshift-insights/insights-runtime-extractor-47gnn" Sep 17 07:09:13.533676 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:09:13.533533 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/1a90ce9b-0a4a-4e14-9f90-a27c4f39b958-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-47gnn\" (UID: \"1a90ce9b-0a4a-4e14-9f90-a27c4f39b958\") " pod="openshift-insights/insights-runtime-extractor-47gnn" Sep 17 07:09:13.533676 ip-10-0-138-13 kubenswrapper[2559]: E0917 07:09:13.533599 2559 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Sep 17 07:09:13.533676 ip-10-0-138-13 kubenswrapper[2559]: E0917 07:09:13.533636 2559 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Sep 17 07:09:13.533676 ip-10-0-138-13 kubenswrapper[2559]: E0917 07:09:13.533665 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/1a90ce9b-0a4a-4e14-9f90-a27c4f39b958-kube-rbac-proxy-cm podName:1a90ce9b-0a4a-4e14-9f90-a27c4f39b958 nodeName:}" failed. No retries permitted until 2026-09-17 07:09:17.533645338 +0000 UTC m=+65.081792042 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/1a90ce9b-0a4a-4e14-9f90-a27c4f39b958-kube-rbac-proxy-cm") pod "insights-runtime-extractor-47gnn" (UID: "1a90ce9b-0a4a-4e14-9f90-a27c4f39b958") : configmap "kube-rbac-proxy" not found Sep 17 07:09:13.533813 ip-10-0-138-13 kubenswrapper[2559]: E0917 07:09:13.533684 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1a90ce9b-0a4a-4e14-9f90-a27c4f39b958-insights-runtime-extractor-tls podName:1a90ce9b-0a4a-4e14-9f90-a27c4f39b958 nodeName:}" failed. No retries permitted until 2026-09-17 07:09:17.53367165 +0000 UTC m=+65.081818354 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/1a90ce9b-0a4a-4e14-9f90-a27c4f39b958-insights-runtime-extractor-tls") pod "insights-runtime-extractor-47gnn" (UID: "1a90ce9b-0a4a-4e14-9f90-a27c4f39b958") : secret "insights-runtime-extractor-tls" not found Sep 17 07:09:13.606490 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:09:13.606455 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-v82wm_c0d04997-4e22-48b8-b36c-e98153ddcd60/serve-healthcheck-canary/0.log" Sep 17 07:09:17.561791 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:09:17.561755 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/1a90ce9b-0a4a-4e14-9f90-a27c4f39b958-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-47gnn\" (UID: \"1a90ce9b-0a4a-4e14-9f90-a27c4f39b958\") " pod="openshift-insights/insights-runtime-extractor-47gnn" Sep 17 07:09:17.562250 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:09:17.561801 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/1a90ce9b-0a4a-4e14-9f90-a27c4f39b958-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-47gnn\" (UID: \"1a90ce9b-0a4a-4e14-9f90-a27c4f39b958\") " pod="openshift-insights/insights-runtime-extractor-47gnn" Sep 17 07:09:17.562250 ip-10-0-138-13 kubenswrapper[2559]: E0917 07:09:17.561874 2559 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Sep 17 07:09:17.562250 ip-10-0-138-13 kubenswrapper[2559]: E0917 07:09:17.561943 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/1a90ce9b-0a4a-4e14-9f90-a27c4f39b958-kube-rbac-proxy-cm podName:1a90ce9b-0a4a-4e14-9f90-a27c4f39b958 nodeName:}" failed. No retries permitted until 2026-09-17 07:09:25.561927725 +0000 UTC m=+73.110074444 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/1a90ce9b-0a4a-4e14-9f90-a27c4f39b958-kube-rbac-proxy-cm") pod "insights-runtime-extractor-47gnn" (UID: "1a90ce9b-0a4a-4e14-9f90-a27c4f39b958") : configmap "kube-rbac-proxy" not found Sep 17 07:09:17.562250 ip-10-0-138-13 kubenswrapper[2559]: E0917 07:09:17.561995 2559 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Sep 17 07:09:17.562250 ip-10-0-138-13 kubenswrapper[2559]: E0917 07:09:17.562066 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1a90ce9b-0a4a-4e14-9f90-a27c4f39b958-insights-runtime-extractor-tls podName:1a90ce9b-0a4a-4e14-9f90-a27c4f39b958 nodeName:}" failed. No retries permitted until 2026-09-17 07:09:25.562051949 +0000 UTC m=+73.110198636 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/1a90ce9b-0a4a-4e14-9f90-a27c4f39b958-insights-runtime-extractor-tls") pod "insights-runtime-extractor-47gnn" (UID: "1a90ce9b-0a4a-4e14-9f90-a27c4f39b958") : secret "insights-runtime-extractor-tls" not found Sep 17 07:09:18.569026 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:09:18.568984 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ac82b91d-660c-4aeb-8538-2dd48f75e691-original-pull-secret\") pod \"global-pull-secret-syncer-btqpf\" (UID: \"ac82b91d-660c-4aeb-8538-2dd48f75e691\") " pod="kube-system/global-pull-secret-syncer-btqpf" Sep 17 07:09:18.569417 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:09:18.569070 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cb76f3bc-38be-404f-b207-231482554bfe-metrics-certs\") pod \"network-metrics-daemon-25zvh\" (UID: \"cb76f3bc-38be-404f-b207-231482554bfe\") " pod="openshift-multus/network-metrics-daemon-25zvh" Sep 17 07:09:18.572568 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:09:18.572544 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Sep 17 07:09:18.572678 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:09:18.572616 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Sep 17 07:09:18.579476 ip-10-0-138-13 kubenswrapper[2559]: E0917 07:09:18.579451 2559 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Sep 17 07:09:18.579556 ip-10-0-138-13 kubenswrapper[2559]: E0917 07:09:18.579512 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cb76f3bc-38be-404f-b207-231482554bfe-metrics-certs podName:cb76f3bc-38be-404f-b207-231482554bfe nodeName:}" failed. No retries permitted until 2026-09-17 07:10:22.579496871 +0000 UTC m=+130.127643571 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/cb76f3bc-38be-404f-b207-231482554bfe-metrics-certs") pod "network-metrics-daemon-25zvh" (UID: "cb76f3bc-38be-404f-b207-231482554bfe") : secret "metrics-daemon-secret" not found Sep 17 07:09:18.581719 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:09:18.581698 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ac82b91d-660c-4aeb-8538-2dd48f75e691-original-pull-secret\") pod \"global-pull-secret-syncer-btqpf\" (UID: \"ac82b91d-660c-4aeb-8538-2dd48f75e691\") " pod="kube-system/global-pull-secret-syncer-btqpf" Sep 17 07:09:18.670324 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:09:18.670300 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/2204950c-6aee-4c24-9abf-58c5fcc5bafd-metrics-tls\") pod \"dns-default-8zt9c\" (UID: \"2204950c-6aee-4c24-9abf-58c5fcc5bafd\") " pod="openshift-dns/dns-default-8zt9c" Sep 17 07:09:18.670436 ip-10-0-138-13 kubenswrapper[2559]: E0917 07:09:18.670419 2559 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 17 07:09:18.670480 ip-10-0-138-13 kubenswrapper[2559]: E0917 07:09:18.670469 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2204950c-6aee-4c24-9abf-58c5fcc5bafd-metrics-tls podName:2204950c-6aee-4c24-9abf-58c5fcc5bafd nodeName:}" failed. No retries permitted until 2026-09-17 07:09:50.670457133 +0000 UTC m=+98.218603848 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/2204950c-6aee-4c24-9abf-58c5fcc5bafd-metrics-tls") pod "dns-default-8zt9c" (UID: "2204950c-6aee-4c24-9abf-58c5fcc5bafd") : secret "dns-default-metrics-tls" not found Sep 17 07:09:18.710778 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:09:18.710749 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-btqpf" Sep 17 07:09:18.771056 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:09:18.771004 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jm9nx\" (UniqueName: \"kubernetes.io/projected/4a9846c2-c1e2-4063-a31f-91190fa6c7a9-kube-api-access-jm9nx\") pod \"network-check-target-b768z\" (UID: \"4a9846c2-c1e2-4063-a31f-91190fa6c7a9\") " pod="openshift-network-diagnostics/network-check-target-b768z" Sep 17 07:09:18.775178 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:09:18.775137 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Sep 17 07:09:18.786076 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:09:18.786050 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Sep 17 07:09:18.795256 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:09:18.795235 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jm9nx\" (UniqueName: \"kubernetes.io/projected/4a9846c2-c1e2-4063-a31f-91190fa6c7a9-kube-api-access-jm9nx\") pod \"network-check-target-b768z\" (UID: \"4a9846c2-c1e2-4063-a31f-91190fa6c7a9\") " pod="openshift-network-diagnostics/network-check-target-b768z" Sep 17 07:09:18.809115 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:09:18.809094 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-2f8p7\"" Sep 17 07:09:18.812219 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:09:18.812205 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-b768z" Sep 17 07:09:19.018335 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:09:19.018306 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-btqpf"] Sep 17 07:09:19.021073 ip-10-0-138-13 kubenswrapper[2559]: W0917 07:09:19.021050 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podac82b91d_660c_4aeb_8538_2dd48f75e691.slice/crio-6b855030dec80f9ee7aa1df7ef015f4abe3e6051ab3089c13f4b1b09c814cc1c WatchSource:0}: Error finding container 6b855030dec80f9ee7aa1df7ef015f4abe3e6051ab3089c13f4b1b09c814cc1c: Status 404 returned error can't find the container with id 6b855030dec80f9ee7aa1df7ef015f4abe3e6051ab3089c13f4b1b09c814cc1c Sep 17 07:09:19.107747 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:09:19.107697 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-b768z"] Sep 17 07:09:19.110121 ip-10-0-138-13 kubenswrapper[2559]: W0917 07:09:19.110102 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4a9846c2_c1e2_4063_a31f_91190fa6c7a9.slice/crio-04457b19d30f3dde8c914266cdc7f56b770e363d7974191e8d51145be8858778 WatchSource:0}: Error finding container 04457b19d30f3dde8c914266cdc7f56b770e363d7974191e8d51145be8858778: Status 404 returned error can't find the container with id 04457b19d30f3dde8c914266cdc7f56b770e363d7974191e8d51145be8858778 Sep 17 07:09:19.192645 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:09:19.192616 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-b768z" event={"ID":"4a9846c2-c1e2-4063-a31f-91190fa6c7a9","Type":"ContainerStarted","Data":"04457b19d30f3dde8c914266cdc7f56b770e363d7974191e8d51145be8858778"} Sep 17 07:09:19.193779 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:09:19.193757 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-btqpf" event={"ID":"ac82b91d-660c-4aeb-8538-2dd48f75e691","Type":"ContainerStarted","Data":"6b855030dec80f9ee7aa1df7ef015f4abe3e6051ab3089c13f4b1b09c814cc1c"} Sep 17 07:09:21.088915 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:09:21.088866 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/73223634-3371-4e5a-a594-e79584605e80-metrics-certs\") pod \"router-default-6f9c47f54-2kl8l\" (UID: \"73223634-3371-4e5a-a594-e79584605e80\") " pod="openshift-ingress/router-default-6f9c47f54-2kl8l" Sep 17 07:09:21.089352 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:09:21.088924 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/73223634-3371-4e5a-a594-e79584605e80-service-ca-bundle\") pod \"router-default-6f9c47f54-2kl8l\" (UID: \"73223634-3371-4e5a-a594-e79584605e80\") " pod="openshift-ingress/router-default-6f9c47f54-2kl8l" Sep 17 07:09:21.089352 ip-10-0-138-13 kubenswrapper[2559]: E0917 07:09:21.089084 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/73223634-3371-4e5a-a594-e79584605e80-service-ca-bundle podName:73223634-3371-4e5a-a594-e79584605e80 nodeName:}" failed. No retries permitted until 2026-09-17 07:09:37.089063839 +0000 UTC m=+84.637210543 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/73223634-3371-4e5a-a594-e79584605e80-service-ca-bundle") pod "router-default-6f9c47f54-2kl8l" (UID: "73223634-3371-4e5a-a594-e79584605e80") : configmap references non-existent config key: service-ca.crt Sep 17 07:09:21.089497 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:09:21.089464 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/fa45a0ac-8d9b-4458-b6c0-ae63e5aff0ab-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cd954b897-24z67\" (UID: \"fa45a0ac-8d9b-4458-b6c0-ae63e5aff0ab\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-24z67" Sep 17 07:09:21.089625 ip-10-0-138-13 kubenswrapper[2559]: E0917 07:09:21.089603 2559 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Sep 17 07:09:21.089717 ip-10-0-138-13 kubenswrapper[2559]: E0917 07:09:21.089667 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fa45a0ac-8d9b-4458-b6c0-ae63e5aff0ab-cluster-monitoring-operator-tls podName:fa45a0ac-8d9b-4458-b6c0-ae63e5aff0ab nodeName:}" failed. No retries permitted until 2026-09-17 07:09:37.08965208 +0000 UTC m=+84.637798781 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/fa45a0ac-8d9b-4458-b6c0-ae63e5aff0ab-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6cd954b897-24z67" (UID: "fa45a0ac-8d9b-4458-b6c0-ae63e5aff0ab") : secret "cluster-monitoring-operator-tls" not found Sep 17 07:09:21.091815 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:09:21.091787 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/73223634-3371-4e5a-a594-e79584605e80-metrics-certs\") pod \"router-default-6f9c47f54-2kl8l\" (UID: \"73223634-3371-4e5a-a594-e79584605e80\") " pod="openshift-ingress/router-default-6f9c47f54-2kl8l" Sep 17 07:09:21.190062 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:09:21.190027 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/5a8b414a-bbfc-4557-8da2-cf9b40f9a6c1-samples-operator-tls\") pod \"cluster-samples-operator-86499c89c4-v6zwt\" (UID: \"5a8b414a-bbfc-4557-8da2-cf9b40f9a6c1\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-v6zwt" Sep 17 07:09:21.192727 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:09:21.192704 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/5a8b414a-bbfc-4557-8da2-cf9b40f9a6c1-samples-operator-tls\") pod \"cluster-samples-operator-86499c89c4-v6zwt\" (UID: \"5a8b414a-bbfc-4557-8da2-cf9b40f9a6c1\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-v6zwt" Sep 17 07:09:21.234226 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:09:21.234192 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-tckcj\"" Sep 17 07:09:21.236834 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:09:21.236805 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-v6zwt" Sep 17 07:09:22.428340 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:09:22.428217 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-v6zwt"] Sep 17 07:09:23.208561 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:09:23.208522 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-b768z" event={"ID":"4a9846c2-c1e2-4063-a31f-91190fa6c7a9","Type":"ContainerStarted","Data":"23ddec591a40e5e9f7f3fb5cac3d2b9c4177f1a9ade25111802f9b7d3fbbf7e6"} Sep 17 07:09:23.208732 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:09:23.208716 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-b768z" Sep 17 07:09:23.230396 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:09:23.230340 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-b768z" podStartSLOduration=67.170526119 podStartE2EDuration="1m10.230322575s" totalImagesPullingTime="3.059796456s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 07:08:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 07:09:23.228958869 +0000 UTC m=+70.777105578" watchObservedRunningTime="2026-09-17 07:09:23.230322575 +0000 UTC m=+70.778469285" Sep 17 07:09:24.215705 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:09:24.215659 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-btqpf" event={"ID":"ac82b91d-660c-4aeb-8538-2dd48f75e691","Type":"ContainerStarted","Data":"55c0304af97ebaef21409a846ce161d1f9fd47f02219d4f3be11cc1898a59391"} Sep 17 07:09:24.216827 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:09:24.216799 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-v6zwt" event={"ID":"5a8b414a-bbfc-4557-8da2-cf9b40f9a6c1","Type":"ContainerStarted","Data":"e0b57e7dd6d010a27e4a0a8fcac436be1b40bd8d189d49afdfb594db94e4da58"} Sep 17 07:09:24.242848 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:09:24.242808 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-btqpf" podStartSLOduration=66.574409385 podStartE2EDuration="1m11.242795368s" totalImagesPullingTime="4.668385983s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-17 07:08:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 07:09:24.242002034 +0000 UTC m=+71.790148741" watchObservedRunningTime="2026-09-17 07:09:24.242795368 +0000 UTC m=+71.790942068" Sep 17 07:09:25.627126 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:09:25.627093 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/1a90ce9b-0a4a-4e14-9f90-a27c4f39b958-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-47gnn\" (UID: \"1a90ce9b-0a4a-4e14-9f90-a27c4f39b958\") " pod="openshift-insights/insights-runtime-extractor-47gnn" Sep 17 07:09:25.627468 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:09:25.627137 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/1a90ce9b-0a4a-4e14-9f90-a27c4f39b958-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-47gnn\" (UID: \"1a90ce9b-0a4a-4e14-9f90-a27c4f39b958\") " pod="openshift-insights/insights-runtime-extractor-47gnn" Sep 17 07:09:25.627468 ip-10-0-138-13 kubenswrapper[2559]: E0917 07:09:25.627229 2559 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Sep 17 07:09:25.627468 ip-10-0-138-13 kubenswrapper[2559]: E0917 07:09:25.627279 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1a90ce9b-0a4a-4e14-9f90-a27c4f39b958-insights-runtime-extractor-tls podName:1a90ce9b-0a4a-4e14-9f90-a27c4f39b958 nodeName:}" failed. No retries permitted until 2026-09-17 07:09:41.627267052 +0000 UTC m=+89.175413739 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/1a90ce9b-0a4a-4e14-9f90-a27c4f39b958-insights-runtime-extractor-tls") pod "insights-runtime-extractor-47gnn" (UID: "1a90ce9b-0a4a-4e14-9f90-a27c4f39b958") : secret "insights-runtime-extractor-tls" not found Sep 17 07:09:25.627592 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:09:25.627572 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/1a90ce9b-0a4a-4e14-9f90-a27c4f39b958-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-47gnn\" (UID: \"1a90ce9b-0a4a-4e14-9f90-a27c4f39b958\") " pod="openshift-insights/insights-runtime-extractor-47gnn" Sep 17 07:09:26.224871 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:09:26.224834 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-v6zwt" event={"ID":"5a8b414a-bbfc-4557-8da2-cf9b40f9a6c1","Type":"ContainerStarted","Data":"eea0bf6e8b99ff7dbfed0904ecf9276e6d6b4c559323b12b79bc60a966c2c42a"} Sep 17 07:09:26.225056 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:09:26.224890 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-v6zwt" event={"ID":"5a8b414a-bbfc-4557-8da2-cf9b40f9a6c1","Type":"ContainerStarted","Data":"fd9f7df051dd7f47bedf064c6509a94759e0d38a09760f5f25e088590eceac19"} Sep 17 07:09:26.250852 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:09:26.250808 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-v6zwt" podStartSLOduration=19.534849356 podStartE2EDuration="21.250793384s" totalImagesPullingTime="1.715944028s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 07:09:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 07:09:26.250382936 +0000 UTC m=+73.798529646" watchObservedRunningTime="2026-09-17 07:09:26.250793384 +0000 UTC m=+73.798940092" Sep 17 07:09:37.108697 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:09:37.108576 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/73223634-3371-4e5a-a594-e79584605e80-service-ca-bundle\") pod \"router-default-6f9c47f54-2kl8l\" (UID: \"73223634-3371-4e5a-a594-e79584605e80\") " pod="openshift-ingress/router-default-6f9c47f54-2kl8l" Sep 17 07:09:37.108697 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:09:37.108622 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/fa45a0ac-8d9b-4458-b6c0-ae63e5aff0ab-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cd954b897-24z67\" (UID: \"fa45a0ac-8d9b-4458-b6c0-ae63e5aff0ab\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-24z67" Sep 17 07:09:37.109305 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:09:37.109285 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/73223634-3371-4e5a-a594-e79584605e80-service-ca-bundle\") pod \"router-default-6f9c47f54-2kl8l\" (UID: \"73223634-3371-4e5a-a594-e79584605e80\") " pod="openshift-ingress/router-default-6f9c47f54-2kl8l" Sep 17 07:09:37.110881 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:09:37.110857 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/fa45a0ac-8d9b-4458-b6c0-ae63e5aff0ab-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cd954b897-24z67\" (UID: \"fa45a0ac-8d9b-4458-b6c0-ae63e5aff0ab\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-24z67" Sep 17 07:09:37.320753 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:09:37.320727 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-t5nm2\"" Sep 17 07:09:37.326111 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:09:37.326091 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-cjd87\"" Sep 17 07:09:37.328942 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:09:37.328930 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-24z67" Sep 17 07:09:37.334497 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:09:37.334480 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-6f9c47f54-2kl8l" Sep 17 07:09:37.616886 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:09:37.616851 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-6cd954b897-24z67"] Sep 17 07:09:37.618103 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:09:37.618081 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-6f9c47f54-2kl8l"] Sep 17 07:09:37.620113 ip-10-0-138-13 kubenswrapper[2559]: W0917 07:09:37.620089 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod73223634_3371_4e5a_a594_e79584605e80.slice/crio-ecd83c37652d3ca8d3cee1064d1c5ccec27b5fc4ae9e4195caad63eacf09e402 WatchSource:0}: Error finding container ecd83c37652d3ca8d3cee1064d1c5ccec27b5fc4ae9e4195caad63eacf09e402: Status 404 returned error can't find the container with id ecd83c37652d3ca8d3cee1064d1c5ccec27b5fc4ae9e4195caad63eacf09e402 Sep 17 07:09:37.620774 ip-10-0-138-13 kubenswrapper[2559]: W0917 07:09:37.620749 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfa45a0ac_8d9b_4458_b6c0_ae63e5aff0ab.slice/crio-505af3562f38558c6e4e55748043fa66fe9f83d36a8c4d1b0f3a37df2c26ac99 WatchSource:0}: Error finding container 505af3562f38558c6e4e55748043fa66fe9f83d36a8c4d1b0f3a37df2c26ac99: Status 404 returned error can't find the container with id 505af3562f38558c6e4e55748043fa66fe9f83d36a8c4d1b0f3a37df2c26ac99 Sep 17 07:09:38.261608 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:09:38.261573 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-6f9c47f54-2kl8l" event={"ID":"73223634-3371-4e5a-a594-e79584605e80","Type":"ContainerStarted","Data":"aa6266e3d8abd510477ebdce0bca6e23a5e23c2274ed91eff7f29285e050409a"} Sep 17 07:09:38.262068 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:09:38.261628 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-6f9c47f54-2kl8l" event={"ID":"73223634-3371-4e5a-a594-e79584605e80","Type":"ContainerStarted","Data":"ecd83c37652d3ca8d3cee1064d1c5ccec27b5fc4ae9e4195caad63eacf09e402"} Sep 17 07:09:38.262640 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:09:38.262619 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-24z67" event={"ID":"fa45a0ac-8d9b-4458-b6c0-ae63e5aff0ab","Type":"ContainerStarted","Data":"505af3562f38558c6e4e55748043fa66fe9f83d36a8c4d1b0f3a37df2c26ac99"} Sep 17 07:09:38.335663 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:09:38.335635 2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-6f9c47f54-2kl8l" Sep 17 07:09:38.338017 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:09:38.337994 2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-6f9c47f54-2kl8l" Sep 17 07:09:38.364844 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:09:38.364801 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/router-default-6f9c47f54-2kl8l" podStartSLOduration=33.364788234 podStartE2EDuration="33.364788234s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 07:09:05 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 07:09:38.282788129 +0000 UTC m=+85.830934838" watchObservedRunningTime="2026-09-17 07:09:38.364788234 +0000 UTC m=+85.912934942" Sep 17 07:09:38.878339 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:09:38.878301 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-5dcbc7df6b-86ngp"] Sep 17 07:09:38.880718 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:09:38.880697 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-86ngp" Sep 17 07:09:38.884147 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:09:38.884122 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\"" Sep 17 07:09:38.884261 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:09:38.884124 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\"" Sep 17 07:09:38.884261 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:09:38.884167 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-5xp9f\"" Sep 17 07:09:38.898894 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:09:38.898870 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-5dcbc7df6b-86ngp"] Sep 17 07:09:38.924086 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:09:38.924056 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/30a5321e-8a62-4229-8b8c-bf3dfa518557-nginx-conf\") pod \"networking-console-plugin-5dcbc7df6b-86ngp\" (UID: \"30a5321e-8a62-4229-8b8c-bf3dfa518557\") " pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-86ngp" Sep 17 07:09:38.924209 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:09:38.924130 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/30a5321e-8a62-4229-8b8c-bf3dfa518557-networking-console-plugin-cert\") pod \"networking-console-plugin-5dcbc7df6b-86ngp\" (UID: \"30a5321e-8a62-4229-8b8c-bf3dfa518557\") " pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-86ngp" Sep 17 07:09:39.013601 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:09:39.013571 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-6574ff4d64-zc265"] Sep 17 07:09:39.015330 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:09:39.015313 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6574ff4d64-zc265" Sep 17 07:09:39.025396 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:09:39.025376 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/30a5321e-8a62-4229-8b8c-bf3dfa518557-nginx-conf\") pod \"networking-console-plugin-5dcbc7df6b-86ngp\" (UID: \"30a5321e-8a62-4229-8b8c-bf3dfa518557\") " pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-86ngp" Sep 17 07:09:39.025491 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:09:39.025428 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/30a5321e-8a62-4229-8b8c-bf3dfa518557-networking-console-plugin-cert\") pod \"networking-console-plugin-5dcbc7df6b-86ngp\" (UID: \"30a5321e-8a62-4229-8b8c-bf3dfa518557\") " pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-86ngp" Sep 17 07:09:39.025919 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:09:39.025896 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/30a5321e-8a62-4229-8b8c-bf3dfa518557-nginx-conf\") pod \"networking-console-plugin-5dcbc7df6b-86ngp\" (UID: \"30a5321e-8a62-4229-8b8c-bf3dfa518557\") " pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-86ngp" Sep 17 07:09:39.027128 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:09:39.027112 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\"" Sep 17 07:09:39.027521 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:09:39.027503 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\"" Sep 17 07:09:39.027661 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:09:39.027643 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/30a5321e-8a62-4229-8b8c-bf3dfa518557-networking-console-plugin-cert\") pod \"networking-console-plugin-5dcbc7df6b-86ngp\" (UID: \"30a5321e-8a62-4229-8b8c-bf3dfa518557\") " pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-86ngp" Sep 17 07:09:39.027962 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:09:39.027948 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"work-manager-hub-kubeconfig\"" Sep 17 07:09:39.029325 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:09:39.029301 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\"" Sep 17 07:09:39.125774 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:09:39.125739 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cnlz8\" (UniqueName: \"kubernetes.io/projected/0def2d1a-ccf1-4fc9-ba82-597441649f50-kube-api-access-cnlz8\") pod \"klusterlet-addon-workmgr-6574ff4d64-zc265\" (UID: \"0def2d1a-ccf1-4fc9-ba82-597441649f50\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6574ff4d64-zc265" Sep 17 07:09:39.125937 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:09:39.125842 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/0def2d1a-ccf1-4fc9-ba82-597441649f50-klusterlet-config\") pod \"klusterlet-addon-workmgr-6574ff4d64-zc265\" (UID: \"0def2d1a-ccf1-4fc9-ba82-597441649f50\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6574ff4d64-zc265" Sep 17 07:09:39.125937 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:09:39.125872 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0def2d1a-ccf1-4fc9-ba82-597441649f50-tmp\") pod \"klusterlet-addon-workmgr-6574ff4d64-zc265\" (UID: \"0def2d1a-ccf1-4fc9-ba82-597441649f50\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6574ff4d64-zc265" Sep 17 07:09:39.126956 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:09:39.126934 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-f476b5c9b-7khtp"] Sep 17 07:09:39.129347 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:09:39.129286 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-f476b5c9b-7khtp" Sep 17 07:09:39.133081 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:09:39.132926 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Sep 17 07:09:39.136701 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:09:39.136146 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-rps6t\"" Sep 17 07:09:39.136908 ip-10-0-138-13 kubenswrapper[2559]: E0917 07:09:39.136864 2559 reflector.go:205] "Failed to watch" err="failed to list *v1.Secret: secrets \"image-registry-tls\" is forbidden: User \"system:node:ip-10-0-138-13.ec2.internal\" cannot list resource \"secrets\" in API group \"\" in the namespace \"openshift-image-registry\": no relationship found between node 'ip-10-0-138-13.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" type="*v1.Secret" Sep 17 07:09:39.137270 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:09:39.137089 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Sep 17 07:09:39.137543 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:09:39.137523 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-6574ff4d64-zc265"] Sep 17 07:09:39.148388 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:09:39.148367 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Sep 17 07:09:39.168121 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:09:39.168089 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-f476b5c9b-7khtp"] Sep 17 07:09:39.191259 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:09:39.191237 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-86ngp" Sep 17 07:09:39.227164 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:09:39.227124 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cnlz8\" (UniqueName: \"kubernetes.io/projected/0def2d1a-ccf1-4fc9-ba82-597441649f50-kube-api-access-cnlz8\") pod \"klusterlet-addon-workmgr-6574ff4d64-zc265\" (UID: \"0def2d1a-ccf1-4fc9-ba82-597441649f50\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6574ff4d64-zc265" Sep 17 07:09:39.227313 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:09:39.227206 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/f6ea68a3-2405-419e-8435-f1f1fdb7f4a0-installation-pull-secrets\") pod \"image-registry-f476b5c9b-7khtp\" (UID: \"f6ea68a3-2405-419e-8435-f1f1fdb7f4a0\") " pod="openshift-image-registry/image-registry-f476b5c9b-7khtp" Sep 17 07:09:39.227313 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:09:39.227230 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/f6ea68a3-2405-419e-8435-f1f1fdb7f4a0-registry-certificates\") pod \"image-registry-f476b5c9b-7khtp\" (UID: \"f6ea68a3-2405-419e-8435-f1f1fdb7f4a0\") " pod="openshift-image-registry/image-registry-f476b5c9b-7khtp" Sep 17 07:09:39.227313 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:09:39.227259 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/f6ea68a3-2405-419e-8435-f1f1fdb7f4a0-ca-trust-extracted\") pod \"image-registry-f476b5c9b-7khtp\" (UID: \"f6ea68a3-2405-419e-8435-f1f1fdb7f4a0\") " pod="openshift-image-registry/image-registry-f476b5c9b-7khtp" Sep 17 07:09:39.227313 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:09:39.227283 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/f6ea68a3-2405-419e-8435-f1f1fdb7f4a0-image-registry-private-configuration\") pod \"image-registry-f476b5c9b-7khtp\" (UID: \"f6ea68a3-2405-419e-8435-f1f1fdb7f4a0\") " pod="openshift-image-registry/image-registry-f476b5c9b-7khtp" Sep 17 07:09:39.227313 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:09:39.227306 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/f6ea68a3-2405-419e-8435-f1f1fdb7f4a0-trusted-ca\") pod \"image-registry-f476b5c9b-7khtp\" (UID: \"f6ea68a3-2405-419e-8435-f1f1fdb7f4a0\") " pod="openshift-image-registry/image-registry-f476b5c9b-7khtp" Sep 17 07:09:39.227575 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:09:39.227354 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/0def2d1a-ccf1-4fc9-ba82-597441649f50-klusterlet-config\") pod \"klusterlet-addon-workmgr-6574ff4d64-zc265\" (UID: \"0def2d1a-ccf1-4fc9-ba82-597441649f50\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6574ff4d64-zc265" Sep 17 07:09:39.227575 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:09:39.227370 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/f6ea68a3-2405-419e-8435-f1f1fdb7f4a0-registry-tls\") pod \"image-registry-f476b5c9b-7khtp\" (UID: \"f6ea68a3-2405-419e-8435-f1f1fdb7f4a0\") " pod="openshift-image-registry/image-registry-f476b5c9b-7khtp" Sep 17 07:09:39.227575 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:09:39.227384 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8bqsf\" (UniqueName: \"kubernetes.io/projected/f6ea68a3-2405-419e-8435-f1f1fdb7f4a0-kube-api-access-8bqsf\") pod \"image-registry-f476b5c9b-7khtp\" (UID: \"f6ea68a3-2405-419e-8435-f1f1fdb7f4a0\") " pod="openshift-image-registry/image-registry-f476b5c9b-7khtp" Sep 17 07:09:39.227575 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:09:39.227402 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0def2d1a-ccf1-4fc9-ba82-597441649f50-tmp\") pod \"klusterlet-addon-workmgr-6574ff4d64-zc265\" (UID: \"0def2d1a-ccf1-4fc9-ba82-597441649f50\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6574ff4d64-zc265" Sep 17 07:09:39.227575 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:09:39.227425 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/f6ea68a3-2405-419e-8435-f1f1fdb7f4a0-bound-sa-token\") pod \"image-registry-f476b5c9b-7khtp\" (UID: \"f6ea68a3-2405-419e-8435-f1f1fdb7f4a0\") " pod="openshift-image-registry/image-registry-f476b5c9b-7khtp" Sep 17 07:09:39.227829 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:09:39.227754 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0def2d1a-ccf1-4fc9-ba82-597441649f50-tmp\") pod \"klusterlet-addon-workmgr-6574ff4d64-zc265\" (UID: \"0def2d1a-ccf1-4fc9-ba82-597441649f50\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6574ff4d64-zc265" Sep 17 07:09:39.230591 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:09:39.230545 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/0def2d1a-ccf1-4fc9-ba82-597441649f50-klusterlet-config\") pod \"klusterlet-addon-workmgr-6574ff4d64-zc265\" (UID: \"0def2d1a-ccf1-4fc9-ba82-597441649f50\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6574ff4d64-zc265" Sep 17 07:09:39.242148 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:09:39.241913 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cnlz8\" (UniqueName: \"kubernetes.io/projected/0def2d1a-ccf1-4fc9-ba82-597441649f50-kube-api-access-cnlz8\") pod \"klusterlet-addon-workmgr-6574ff4d64-zc265\" (UID: \"0def2d1a-ccf1-4fc9-ba82-597441649f50\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6574ff4d64-zc265" Sep 17 07:09:39.266839 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:09:39.266811 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-6f9c47f54-2kl8l" Sep 17 07:09:39.268881 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:09:39.268633 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-6f9c47f54-2kl8l" Sep 17 07:09:39.323625 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:09:39.323597 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6574ff4d64-zc265" Sep 17 07:09:39.328405 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:09:39.328382 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/f6ea68a3-2405-419e-8435-f1f1fdb7f4a0-trusted-ca\") pod \"image-registry-f476b5c9b-7khtp\" (UID: \"f6ea68a3-2405-419e-8435-f1f1fdb7f4a0\") " pod="openshift-image-registry/image-registry-f476b5c9b-7khtp" Sep 17 07:09:39.328511 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:09:39.328444 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/f6ea68a3-2405-419e-8435-f1f1fdb7f4a0-registry-tls\") pod \"image-registry-f476b5c9b-7khtp\" (UID: \"f6ea68a3-2405-419e-8435-f1f1fdb7f4a0\") " pod="openshift-image-registry/image-registry-f476b5c9b-7khtp" Sep 17 07:09:39.328511 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:09:39.328469 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8bqsf\" (UniqueName: \"kubernetes.io/projected/f6ea68a3-2405-419e-8435-f1f1fdb7f4a0-kube-api-access-8bqsf\") pod \"image-registry-f476b5c9b-7khtp\" (UID: \"f6ea68a3-2405-419e-8435-f1f1fdb7f4a0\") " pod="openshift-image-registry/image-registry-f476b5c9b-7khtp" Sep 17 07:09:39.328511 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:09:39.328505 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/f6ea68a3-2405-419e-8435-f1f1fdb7f4a0-bound-sa-token\") pod \"image-registry-f476b5c9b-7khtp\" (UID: \"f6ea68a3-2405-419e-8435-f1f1fdb7f4a0\") " pod="openshift-image-registry/image-registry-f476b5c9b-7khtp" Sep 17 07:09:39.328683 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:09:39.328636 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/f6ea68a3-2405-419e-8435-f1f1fdb7f4a0-installation-pull-secrets\") pod \"image-registry-f476b5c9b-7khtp\" (UID: \"f6ea68a3-2405-419e-8435-f1f1fdb7f4a0\") " pod="openshift-image-registry/image-registry-f476b5c9b-7khtp" Sep 17 07:09:39.328683 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:09:39.328667 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/f6ea68a3-2405-419e-8435-f1f1fdb7f4a0-registry-certificates\") pod \"image-registry-f476b5c9b-7khtp\" (UID: \"f6ea68a3-2405-419e-8435-f1f1fdb7f4a0\") " pod="openshift-image-registry/image-registry-f476b5c9b-7khtp" Sep 17 07:09:39.328784 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:09:39.328712 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/f6ea68a3-2405-419e-8435-f1f1fdb7f4a0-ca-trust-extracted\") pod \"image-registry-f476b5c9b-7khtp\" (UID: \"f6ea68a3-2405-419e-8435-f1f1fdb7f4a0\") " pod="openshift-image-registry/image-registry-f476b5c9b-7khtp" Sep 17 07:09:39.328784 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:09:39.328759 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/f6ea68a3-2405-419e-8435-f1f1fdb7f4a0-image-registry-private-configuration\") pod \"image-registry-f476b5c9b-7khtp\" (UID: \"f6ea68a3-2405-419e-8435-f1f1fdb7f4a0\") " pod="openshift-image-registry/image-registry-f476b5c9b-7khtp" Sep 17 07:09:39.329675 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:09:39.329296 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/f6ea68a3-2405-419e-8435-f1f1fdb7f4a0-trusted-ca\") pod \"image-registry-f476b5c9b-7khtp\" (UID: \"f6ea68a3-2405-419e-8435-f1f1fdb7f4a0\") " pod="openshift-image-registry/image-registry-f476b5c9b-7khtp" Sep 17 07:09:39.329675 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:09:39.329635 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/f6ea68a3-2405-419e-8435-f1f1fdb7f4a0-ca-trust-extracted\") pod \"image-registry-f476b5c9b-7khtp\" (UID: \"f6ea68a3-2405-419e-8435-f1f1fdb7f4a0\") " pod="openshift-image-registry/image-registry-f476b5c9b-7khtp" Sep 17 07:09:39.329934 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:09:39.329912 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/f6ea68a3-2405-419e-8435-f1f1fdb7f4a0-registry-certificates\") pod \"image-registry-f476b5c9b-7khtp\" (UID: \"f6ea68a3-2405-419e-8435-f1f1fdb7f4a0\") " pod="openshift-image-registry/image-registry-f476b5c9b-7khtp" Sep 17 07:09:39.331483 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:09:39.331464 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/f6ea68a3-2405-419e-8435-f1f1fdb7f4a0-image-registry-private-configuration\") pod \"image-registry-f476b5c9b-7khtp\" (UID: \"f6ea68a3-2405-419e-8435-f1f1fdb7f4a0\") " pod="openshift-image-registry/image-registry-f476b5c9b-7khtp" Sep 17 07:09:39.332009 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:09:39.331987 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/f6ea68a3-2405-419e-8435-f1f1fdb7f4a0-installation-pull-secrets\") pod \"image-registry-f476b5c9b-7khtp\" (UID: \"f6ea68a3-2405-419e-8435-f1f1fdb7f4a0\") " pod="openshift-image-registry/image-registry-f476b5c9b-7khtp" Sep 17 07:09:39.339361 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:09:39.339342 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8bqsf\" (UniqueName: \"kubernetes.io/projected/f6ea68a3-2405-419e-8435-f1f1fdb7f4a0-kube-api-access-8bqsf\") pod \"image-registry-f476b5c9b-7khtp\" (UID: \"f6ea68a3-2405-419e-8435-f1f1fdb7f4a0\") " pod="openshift-image-registry/image-registry-f476b5c9b-7khtp" Sep 17 07:09:39.345352 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:09:39.345330 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/f6ea68a3-2405-419e-8435-f1f1fdb7f4a0-bound-sa-token\") pod \"image-registry-f476b5c9b-7khtp\" (UID: \"f6ea68a3-2405-419e-8435-f1f1fdb7f4a0\") " pod="openshift-image-registry/image-registry-f476b5c9b-7khtp" Sep 17 07:09:39.476800 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:09:39.476770 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-5dcbc7df6b-86ngp"] Sep 17 07:09:39.625450 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:09:39.625416 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-6574ff4d64-zc265"] Sep 17 07:09:39.855434 ip-10-0-138-13 kubenswrapper[2559]: W0917 07:09:39.855399 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod30a5321e_8a62_4229_8b8c_bf3dfa518557.slice/crio-b350bd86726ddc38172817045b287d497e8fd181266d3c92d2055a15178f4e94 WatchSource:0}: Error finding container b350bd86726ddc38172817045b287d497e8fd181266d3c92d2055a15178f4e94: Status 404 returned error can't find the container with id b350bd86726ddc38172817045b287d497e8fd181266d3c92d2055a15178f4e94 Sep 17 07:09:39.855991 ip-10-0-138-13 kubenswrapper[2559]: W0917 07:09:39.855953 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0def2d1a_ccf1_4fc9_ba82_597441649f50.slice/crio-9619bd1cf2767fa5f902b758951e314137e151e8dad37d5d55081f11e03ca3ef WatchSource:0}: Error finding container 9619bd1cf2767fa5f902b758951e314137e151e8dad37d5d55081f11e03ca3ef: Status 404 returned error can't find the container with id 9619bd1cf2767fa5f902b758951e314137e151e8dad37d5d55081f11e03ca3ef Sep 17 07:09:40.196668 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:09:40.196594 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Sep 17 07:09:40.201011 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:09:40.200949 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/f6ea68a3-2405-419e-8435-f1f1fdb7f4a0-registry-tls\") pod \"image-registry-f476b5c9b-7khtp\" (UID: \"f6ea68a3-2405-419e-8435-f1f1fdb7f4a0\") " pod="openshift-image-registry/image-registry-f476b5c9b-7khtp" Sep 17 07:09:40.274813 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:09:40.274777 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-24z67" event={"ID":"fa45a0ac-8d9b-4458-b6c0-ae63e5aff0ab","Type":"ContainerStarted","Data":"3bbbfece5041bca72ed5108d877ba8717c42fd60be9c78d1d43acab383e5a1b6"} Sep 17 07:09:40.276020 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:09:40.275995 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-86ngp" event={"ID":"30a5321e-8a62-4229-8b8c-bf3dfa518557","Type":"ContainerStarted","Data":"b350bd86726ddc38172817045b287d497e8fd181266d3c92d2055a15178f4e94"} Sep 17 07:09:40.277072 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:09:40.277041 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6574ff4d64-zc265" event={"ID":"0def2d1a-ccf1-4fc9-ba82-597441649f50","Type":"ContainerStarted","Data":"9619bd1cf2767fa5f902b758951e314137e151e8dad37d5d55081f11e03ca3ef"} Sep 17 07:09:40.309434 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:09:40.309388 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-24z67" podStartSLOduration=33.050241776 podStartE2EDuration="35.309372348s" totalImagesPullingTime="2.259130572s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 07:09:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 07:09:40.308545809 +0000 UTC m=+87.856692517" watchObservedRunningTime="2026-09-17 07:09:40.309372348 +0000 UTC m=+87.857519057" Sep 17 07:09:40.341054 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:09:40.341034 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-f476b5c9b-7khtp" Sep 17 07:09:40.629831 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:09:40.629475 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-f476b5c9b-7khtp"] Sep 17 07:09:40.631389 ip-10-0-138-13 kubenswrapper[2559]: W0917 07:09:40.631341 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf6ea68a3_2405_419e_8435_f1f1fdb7f4a0.slice/crio-cd582a92721a46565d7519affd5a930d97822bb36d9f6c4c42f0f43a67f0d990 WatchSource:0}: Error finding container cd582a92721a46565d7519affd5a930d97822bb36d9f6c4c42f0f43a67f0d990: Status 404 returned error can't find the container with id cd582a92721a46565d7519affd5a930d97822bb36d9f6c4c42f0f43a67f0d990 Sep 17 07:09:41.287303 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:09:41.286801 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-f476b5c9b-7khtp" event={"ID":"f6ea68a3-2405-419e-8435-f1f1fdb7f4a0","Type":"ContainerStarted","Data":"c62ae0babd742b5623ebf0cb8ec448c7205541e983092ba237ba96cb4bd05684"} Sep 17 07:09:41.287303 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:09:41.286852 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-f476b5c9b-7khtp" event={"ID":"f6ea68a3-2405-419e-8435-f1f1fdb7f4a0","Type":"ContainerStarted","Data":"cd582a92721a46565d7519affd5a930d97822bb36d9f6c4c42f0f43a67f0d990"} Sep 17 07:09:41.287303 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:09:41.287158 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-f476b5c9b-7khtp" Sep 17 07:09:41.307901 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:09:41.307849 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-f476b5c9b-7khtp" podStartSLOduration=2.307827922 podStartE2EDuration="2.307827922s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 07:09:39 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 07:09:41.305810641 +0000 UTC m=+88.853957353" watchObservedRunningTime="2026-09-17 07:09:41.307827922 +0000 UTC m=+88.855974633" Sep 17 07:09:41.652279 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:09:41.652234 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/1a90ce9b-0a4a-4e14-9f90-a27c4f39b958-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-47gnn\" (UID: \"1a90ce9b-0a4a-4e14-9f90-a27c4f39b958\") " pod="openshift-insights/insights-runtime-extractor-47gnn" Sep 17 07:09:41.655056 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:09:41.655027 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/1a90ce9b-0a4a-4e14-9f90-a27c4f39b958-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-47gnn\" (UID: \"1a90ce9b-0a4a-4e14-9f90-a27c4f39b958\") " pod="openshift-insights/insights-runtime-extractor-47gnn" Sep 17 07:09:41.885456 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:09:41.885416 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-hbl8z\"" Sep 17 07:09:41.893330 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:09:41.893294 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-47gnn" Sep 17 07:09:42.291166 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:09:42.291119 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-86ngp" event={"ID":"30a5321e-8a62-4229-8b8c-bf3dfa518557","Type":"ContainerStarted","Data":"d0ba5cd74e8c982bf119c0ee49e479abe9f6fac75ccaa87e40d10c942d1f0feb"} Sep 17 07:09:42.307305 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:09:42.307255 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-86ngp" podStartSLOduration=2.961334454 podStartE2EDuration="4.307239774s" totalImagesPullingTime="1.34590532s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 07:09:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 07:09:42.306938715 +0000 UTC m=+89.855085427" watchObservedRunningTime="2026-09-17 07:09:42.307239774 +0000 UTC m=+89.855386480" Sep 17 07:09:42.395573 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:09:42.395452 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-47gnn"] Sep 17 07:09:43.492132 ip-10-0-138-13 kubenswrapper[2559]: W0917 07:09:43.492084 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1a90ce9b_0a4a_4e14_9f90_a27c4f39b958.slice/crio-94621c888a1ee00358885b8f1cb6eab1704fbe08e7c2bf93d5512662fea59a03 WatchSource:0}: Error finding container 94621c888a1ee00358885b8f1cb6eab1704fbe08e7c2bf93d5512662fea59a03: Status 404 returned error can't find the container with id 94621c888a1ee00358885b8f1cb6eab1704fbe08e7c2bf93d5512662fea59a03 Sep 17 07:09:44.299367 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:09:44.299339 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6574ff4d64-zc265" event={"ID":"0def2d1a-ccf1-4fc9-ba82-597441649f50","Type":"ContainerStarted","Data":"0966148918fcc13a134a92aa1d0b28e7350e8912919b205ebf7fa74aaf6156ad"} Sep 17 07:09:44.299533 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:09:44.299510 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6574ff4d64-zc265" Sep 17 07:09:44.301014 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:09:44.300989 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-47gnn" event={"ID":"1a90ce9b-0a4a-4e14-9f90-a27c4f39b958","Type":"ContainerStarted","Data":"262baa6c8ebd246617d4f70732f9d95deaf8003f5159691c654b42b09ec25e03"} Sep 17 07:09:44.301106 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:09:44.301037 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-47gnn" event={"ID":"1a90ce9b-0a4a-4e14-9f90-a27c4f39b958","Type":"ContainerStarted","Data":"94621c888a1ee00358885b8f1cb6eab1704fbe08e7c2bf93d5512662fea59a03"} Sep 17 07:09:44.301433 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:09:44.301415 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6574ff4d64-zc265" Sep 17 07:09:44.317290 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:09:44.317251 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6574ff4d64-zc265" podStartSLOduration=2.607996462 podStartE2EDuration="6.317235485s" totalImagesPullingTime="3.709239023s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 07:09:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 07:09:44.316436105 +0000 UTC m=+91.864582816" watchObservedRunningTime="2026-09-17 07:09:44.317235485 +0000 UTC m=+91.865382193" Sep 17 07:09:45.308258 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:09:45.308218 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-47gnn" event={"ID":"1a90ce9b-0a4a-4e14-9f90-a27c4f39b958","Type":"ContainerStarted","Data":"75766378c197916ce4e6144596f3d45d12133a3b24af2672ca28482e75141125"} Sep 17 07:09:46.315316 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:09:46.315270 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-47gnn" event={"ID":"1a90ce9b-0a4a-4e14-9f90-a27c4f39b958","Type":"ContainerStarted","Data":"2c030341162e3bcd2a8663fb17b72ec136c623f5c9222b60e0d99a88bcbbe02f"} Sep 17 07:09:46.335872 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:09:46.335827 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-47gnn" podStartSLOduration=35.230713453 podStartE2EDuration="37.33580981s" totalImagesPullingTime="2.105096357s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-17 07:09:09 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 07:09:46.335362992 +0000 UTC m=+93.883509700" watchObservedRunningTime="2026-09-17 07:09:46.33580981 +0000 UTC m=+93.883956540" Sep 17 07:09:50.724321 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:09:50.724289 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/2204950c-6aee-4c24-9abf-58c5fcc5bafd-metrics-tls\") pod \"dns-default-8zt9c\" (UID: \"2204950c-6aee-4c24-9abf-58c5fcc5bafd\") " pod="openshift-dns/dns-default-8zt9c" Sep 17 07:09:50.726768 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:09:50.726736 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/2204950c-6aee-4c24-9abf-58c5fcc5bafd-metrics-tls\") pod \"dns-default-8zt9c\" (UID: \"2204950c-6aee-4c24-9abf-58c5fcc5bafd\") " pod="openshift-dns/dns-default-8zt9c" Sep 17 07:09:50.762172 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:09:50.762143 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-wq5pm\"" Sep 17 07:09:50.770200 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:09:50.770176 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-8zt9c" Sep 17 07:09:51.027090 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:09:51.027062 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-67dcf8c979-khvdn"] Sep 17 07:09:51.031297 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:09:51.031279 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-khvdn" Sep 17 07:09:51.038329 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:09:51.038308 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\"" Sep 17 07:09:51.039340 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:09:51.039325 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Sep 17 07:09:51.039413 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:09:51.039344 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\"" Sep 17 07:09:51.039413 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:09:51.039400 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-csxzg\"" Sep 17 07:09:51.058450 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:09:51.058426 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-w55j5"] Sep 17 07:09:51.061411 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:09:51.061395 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-w55j5" Sep 17 07:09:51.063940 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:09:51.063923 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Sep 17 07:09:51.064099 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:09:51.064074 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Sep 17 07:09:51.064208 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:09:51.064179 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-795dp\"" Sep 17 07:09:51.064268 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:09:51.064252 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Sep 17 07:09:51.071026 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:09:51.071007 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-67dcf8c979-khvdn"] Sep 17 07:09:51.072001 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:09:51.071980 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-8zt9c"] Sep 17 07:09:51.073702 ip-10-0-138-13 kubenswrapper[2559]: W0917 07:09:51.073672 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2204950c_6aee_4c24_9abf_58c5fcc5bafd.slice/crio-0d3d8666a3d802b88a5e02eaf71ec8cbe8d2960270b8eca716b96f92914d05e4 WatchSource:0}: Error finding container 0d3d8666a3d802b88a5e02eaf71ec8cbe8d2960270b8eca716b96f92914d05e4: Status 404 returned error can't find the container with id 0d3d8666a3d802b88a5e02eaf71ec8cbe8d2960270b8eca716b96f92914d05e4 Sep 17 07:09:51.127855 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:09:51.127830 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/98e5d160-0b87-4ad9-ab09-23d64a419f9a-openshift-state-metrics-tls\") pod \"openshift-state-metrics-67dcf8c979-khvdn\" (UID: \"98e5d160-0b87-4ad9-ab09-23d64a419f9a\") " pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-khvdn" Sep 17 07:09:51.128006 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:09:51.127861 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/98e5d160-0b87-4ad9-ab09-23d64a419f9a-metrics-client-ca\") pod \"openshift-state-metrics-67dcf8c979-khvdn\" (UID: \"98e5d160-0b87-4ad9-ab09-23d64a419f9a\") " pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-khvdn" Sep 17 07:09:51.128006 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:09:51.127881 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/40bdd2f2-69d1-46dd-9ec2-3c57fb98b874-node-exporter-accelerators-collector-config\") pod \"node-exporter-w55j5\" (UID: \"40bdd2f2-69d1-46dd-9ec2-3c57fb98b874\") " pod="openshift-monitoring/node-exporter-w55j5" Sep 17 07:09:51.128006 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:09:51.127931 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/40bdd2f2-69d1-46dd-9ec2-3c57fb98b874-node-exporter-textfile\") pod \"node-exporter-w55j5\" (UID: \"40bdd2f2-69d1-46dd-9ec2-3c57fb98b874\") " pod="openshift-monitoring/node-exporter-w55j5" Sep 17 07:09:51.128006 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:09:51.127960 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/40bdd2f2-69d1-46dd-9ec2-3c57fb98b874-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-w55j5\" (UID: \"40bdd2f2-69d1-46dd-9ec2-3c57fb98b874\") " pod="openshift-monitoring/node-exporter-w55j5" Sep 17 07:09:51.128165 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:09:51.128007 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/40bdd2f2-69d1-46dd-9ec2-3c57fb98b874-root\") pod \"node-exporter-w55j5\" (UID: \"40bdd2f2-69d1-46dd-9ec2-3c57fb98b874\") " pod="openshift-monitoring/node-exporter-w55j5" Sep 17 07:09:51.128165 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:09:51.128040 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/40bdd2f2-69d1-46dd-9ec2-3c57fb98b874-sys\") pod \"node-exporter-w55j5\" (UID: \"40bdd2f2-69d1-46dd-9ec2-3c57fb98b874\") " pod="openshift-monitoring/node-exporter-w55j5" Sep 17 07:09:51.128165 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:09:51.128073 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/40bdd2f2-69d1-46dd-9ec2-3c57fb98b874-metrics-client-ca\") pod \"node-exporter-w55j5\" (UID: \"40bdd2f2-69d1-46dd-9ec2-3c57fb98b874\") " pod="openshift-monitoring/node-exporter-w55j5" Sep 17 07:09:51.128165 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:09:51.128115 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/40bdd2f2-69d1-46dd-9ec2-3c57fb98b874-node-exporter-wtmp\") pod \"node-exporter-w55j5\" (UID: \"40bdd2f2-69d1-46dd-9ec2-3c57fb98b874\") " pod="openshift-monitoring/node-exporter-w55j5" Sep 17 07:09:51.128165 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:09:51.128156 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/98e5d160-0b87-4ad9-ab09-23d64a419f9a-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-67dcf8c979-khvdn\" (UID: \"98e5d160-0b87-4ad9-ab09-23d64a419f9a\") " pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-khvdn" Sep 17 07:09:51.128345 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:09:51.128188 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pslnm\" (UniqueName: \"kubernetes.io/projected/40bdd2f2-69d1-46dd-9ec2-3c57fb98b874-kube-api-access-pslnm\") pod \"node-exporter-w55j5\" (UID: \"40bdd2f2-69d1-46dd-9ec2-3c57fb98b874\") " pod="openshift-monitoring/node-exporter-w55j5" Sep 17 07:09:51.128345 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:09:51.128208 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/40bdd2f2-69d1-46dd-9ec2-3c57fb98b874-node-exporter-tls\") pod \"node-exporter-w55j5\" (UID: \"40bdd2f2-69d1-46dd-9ec2-3c57fb98b874\") " pod="openshift-monitoring/node-exporter-w55j5" Sep 17 07:09:51.128345 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:09:51.128236 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vjtl6\" (UniqueName: \"kubernetes.io/projected/98e5d160-0b87-4ad9-ab09-23d64a419f9a-kube-api-access-vjtl6\") pod \"openshift-state-metrics-67dcf8c979-khvdn\" (UID: \"98e5d160-0b87-4ad9-ab09-23d64a419f9a\") " pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-khvdn" Sep 17 07:09:51.229200 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:09:51.229173 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/40bdd2f2-69d1-46dd-9ec2-3c57fb98b874-node-exporter-textfile\") pod \"node-exporter-w55j5\" (UID: \"40bdd2f2-69d1-46dd-9ec2-3c57fb98b874\") " pod="openshift-monitoring/node-exporter-w55j5" Sep 17 07:09:51.229200 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:09:51.229203 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/40bdd2f2-69d1-46dd-9ec2-3c57fb98b874-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-w55j5\" (UID: \"40bdd2f2-69d1-46dd-9ec2-3c57fb98b874\") " pod="openshift-monitoring/node-exporter-w55j5" Sep 17 07:09:51.229349 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:09:51.229222 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/40bdd2f2-69d1-46dd-9ec2-3c57fb98b874-root\") pod \"node-exporter-w55j5\" (UID: \"40bdd2f2-69d1-46dd-9ec2-3c57fb98b874\") " pod="openshift-monitoring/node-exporter-w55j5" Sep 17 07:09:51.229349 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:09:51.229268 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/40bdd2f2-69d1-46dd-9ec2-3c57fb98b874-root\") pod \"node-exporter-w55j5\" (UID: \"40bdd2f2-69d1-46dd-9ec2-3c57fb98b874\") " pod="openshift-monitoring/node-exporter-w55j5" Sep 17 07:09:51.229349 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:09:51.229315 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/40bdd2f2-69d1-46dd-9ec2-3c57fb98b874-sys\") pod \"node-exporter-w55j5\" (UID: \"40bdd2f2-69d1-46dd-9ec2-3c57fb98b874\") " pod="openshift-monitoring/node-exporter-w55j5" Sep 17 07:09:51.229477 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:09:51.229354 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/40bdd2f2-69d1-46dd-9ec2-3c57fb98b874-metrics-client-ca\") pod \"node-exporter-w55j5\" (UID: \"40bdd2f2-69d1-46dd-9ec2-3c57fb98b874\") " pod="openshift-monitoring/node-exporter-w55j5" Sep 17 07:09:51.229477 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:09:51.229383 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/40bdd2f2-69d1-46dd-9ec2-3c57fb98b874-sys\") pod \"node-exporter-w55j5\" (UID: \"40bdd2f2-69d1-46dd-9ec2-3c57fb98b874\") " pod="openshift-monitoring/node-exporter-w55j5" Sep 17 07:09:51.229477 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:09:51.229404 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/40bdd2f2-69d1-46dd-9ec2-3c57fb98b874-node-exporter-wtmp\") pod \"node-exporter-w55j5\" (UID: \"40bdd2f2-69d1-46dd-9ec2-3c57fb98b874\") " pod="openshift-monitoring/node-exporter-w55j5" Sep 17 07:09:51.229477 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:09:51.229443 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/98e5d160-0b87-4ad9-ab09-23d64a419f9a-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-67dcf8c979-khvdn\" (UID: \"98e5d160-0b87-4ad9-ab09-23d64a419f9a\") " pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-khvdn" Sep 17 07:09:51.229635 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:09:51.229477 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pslnm\" (UniqueName: \"kubernetes.io/projected/40bdd2f2-69d1-46dd-9ec2-3c57fb98b874-kube-api-access-pslnm\") pod \"node-exporter-w55j5\" (UID: \"40bdd2f2-69d1-46dd-9ec2-3c57fb98b874\") " pod="openshift-monitoring/node-exporter-w55j5" Sep 17 07:09:51.229635 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:09:51.229503 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/40bdd2f2-69d1-46dd-9ec2-3c57fb98b874-node-exporter-tls\") pod \"node-exporter-w55j5\" (UID: \"40bdd2f2-69d1-46dd-9ec2-3c57fb98b874\") " pod="openshift-monitoring/node-exporter-w55j5" Sep 17 07:09:51.229635 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:09:51.229512 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/40bdd2f2-69d1-46dd-9ec2-3c57fb98b874-node-exporter-textfile\") pod \"node-exporter-w55j5\" (UID: \"40bdd2f2-69d1-46dd-9ec2-3c57fb98b874\") " pod="openshift-monitoring/node-exporter-w55j5" Sep 17 07:09:51.229635 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:09:51.229535 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vjtl6\" (UniqueName: \"kubernetes.io/projected/98e5d160-0b87-4ad9-ab09-23d64a419f9a-kube-api-access-vjtl6\") pod \"openshift-state-metrics-67dcf8c979-khvdn\" (UID: \"98e5d160-0b87-4ad9-ab09-23d64a419f9a\") " pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-khvdn" Sep 17 07:09:51.229635 ip-10-0-138-13 kubenswrapper[2559]: E0917 07:09:51.229603 2559 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found Sep 17 07:09:51.229866 ip-10-0-138-13 kubenswrapper[2559]: E0917 07:09:51.229664 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/40bdd2f2-69d1-46dd-9ec2-3c57fb98b874-node-exporter-tls podName:40bdd2f2-69d1-46dd-9ec2-3c57fb98b874 nodeName:}" failed. No retries permitted until 2026-09-17 07:09:51.729641148 +0000 UTC m=+99.277787856 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/40bdd2f2-69d1-46dd-9ec2-3c57fb98b874-node-exporter-tls") pod "node-exporter-w55j5" (UID: "40bdd2f2-69d1-46dd-9ec2-3c57fb98b874") : secret "node-exporter-tls" not found Sep 17 07:09:51.229866 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:09:51.229708 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/98e5d160-0b87-4ad9-ab09-23d64a419f9a-openshift-state-metrics-tls\") pod \"openshift-state-metrics-67dcf8c979-khvdn\" (UID: \"98e5d160-0b87-4ad9-ab09-23d64a419f9a\") " pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-khvdn" Sep 17 07:09:51.229866 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:09:51.229709 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/40bdd2f2-69d1-46dd-9ec2-3c57fb98b874-node-exporter-wtmp\") pod \"node-exporter-w55j5\" (UID: \"40bdd2f2-69d1-46dd-9ec2-3c57fb98b874\") " pod="openshift-monitoring/node-exporter-w55j5" Sep 17 07:09:51.229866 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:09:51.229749 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/98e5d160-0b87-4ad9-ab09-23d64a419f9a-metrics-client-ca\") pod \"openshift-state-metrics-67dcf8c979-khvdn\" (UID: \"98e5d160-0b87-4ad9-ab09-23d64a419f9a\") " pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-khvdn" Sep 17 07:09:51.229866 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:09:51.229774 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/40bdd2f2-69d1-46dd-9ec2-3c57fb98b874-node-exporter-accelerators-collector-config\") pod \"node-exporter-w55j5\" (UID: \"40bdd2f2-69d1-46dd-9ec2-3c57fb98b874\") " pod="openshift-monitoring/node-exporter-w55j5" Sep 17 07:09:51.230342 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:09:51.230319 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/40bdd2f2-69d1-46dd-9ec2-3c57fb98b874-metrics-client-ca\") pod \"node-exporter-w55j5\" (UID: \"40bdd2f2-69d1-46dd-9ec2-3c57fb98b874\") " pod="openshift-monitoring/node-exporter-w55j5" Sep 17 07:09:51.230431 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:09:51.230319 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/40bdd2f2-69d1-46dd-9ec2-3c57fb98b874-node-exporter-accelerators-collector-config\") pod \"node-exporter-w55j5\" (UID: \"40bdd2f2-69d1-46dd-9ec2-3c57fb98b874\") " pod="openshift-monitoring/node-exporter-w55j5" Sep 17 07:09:51.230501 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:09:51.230480 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/98e5d160-0b87-4ad9-ab09-23d64a419f9a-metrics-client-ca\") pod \"openshift-state-metrics-67dcf8c979-khvdn\" (UID: \"98e5d160-0b87-4ad9-ab09-23d64a419f9a\") " pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-khvdn" Sep 17 07:09:51.231580 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:09:51.231558 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/40bdd2f2-69d1-46dd-9ec2-3c57fb98b874-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-w55j5\" (UID: \"40bdd2f2-69d1-46dd-9ec2-3c57fb98b874\") " pod="openshift-monitoring/node-exporter-w55j5" Sep 17 07:09:51.232237 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:09:51.232213 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/98e5d160-0b87-4ad9-ab09-23d64a419f9a-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-67dcf8c979-khvdn\" (UID: \"98e5d160-0b87-4ad9-ab09-23d64a419f9a\") " pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-khvdn" Sep 17 07:09:51.232332 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:09:51.232244 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/98e5d160-0b87-4ad9-ab09-23d64a419f9a-openshift-state-metrics-tls\") pod \"openshift-state-metrics-67dcf8c979-khvdn\" (UID: \"98e5d160-0b87-4ad9-ab09-23d64a419f9a\") " pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-khvdn" Sep 17 07:09:51.237261 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:09:51.237238 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pslnm\" (UniqueName: \"kubernetes.io/projected/40bdd2f2-69d1-46dd-9ec2-3c57fb98b874-kube-api-access-pslnm\") pod \"node-exporter-w55j5\" (UID: \"40bdd2f2-69d1-46dd-9ec2-3c57fb98b874\") " pod="openshift-monitoring/node-exporter-w55j5" Sep 17 07:09:51.240240 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:09:51.240219 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vjtl6\" (UniqueName: \"kubernetes.io/projected/98e5d160-0b87-4ad9-ab09-23d64a419f9a-kube-api-access-vjtl6\") pod \"openshift-state-metrics-67dcf8c979-khvdn\" (UID: \"98e5d160-0b87-4ad9-ab09-23d64a419f9a\") " pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-khvdn" Sep 17 07:09:51.332040 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:09:51.331955 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-8zt9c" event={"ID":"2204950c-6aee-4c24-9abf-58c5fcc5bafd","Type":"ContainerStarted","Data":"0d3d8666a3d802b88a5e02eaf71ec8cbe8d2960270b8eca716b96f92914d05e4"} Sep 17 07:09:51.340271 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:09:51.340250 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-khvdn" Sep 17 07:09:51.615850 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:09:51.615758 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-67dcf8c979-khvdn"] Sep 17 07:09:51.618944 ip-10-0-138-13 kubenswrapper[2559]: W0917 07:09:51.618911 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod98e5d160_0b87_4ad9_ab09_23d64a419f9a.slice/crio-91ec0e745ec7678a398f52b39416790a8a6cccaecefb8d8ea9874f223c9ef37b WatchSource:0}: Error finding container 91ec0e745ec7678a398f52b39416790a8a6cccaecefb8d8ea9874f223c9ef37b: Status 404 returned error can't find the container with id 91ec0e745ec7678a398f52b39416790a8a6cccaecefb8d8ea9874f223c9ef37b Sep 17 07:09:51.733311 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:09:51.733137 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/40bdd2f2-69d1-46dd-9ec2-3c57fb98b874-node-exporter-tls\") pod \"node-exporter-w55j5\" (UID: \"40bdd2f2-69d1-46dd-9ec2-3c57fb98b874\") " pod="openshift-monitoring/node-exporter-w55j5" Sep 17 07:09:51.736047 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:09:51.736022 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/40bdd2f2-69d1-46dd-9ec2-3c57fb98b874-node-exporter-tls\") pod \"node-exporter-w55j5\" (UID: \"40bdd2f2-69d1-46dd-9ec2-3c57fb98b874\") " pod="openshift-monitoring/node-exporter-w55j5" Sep 17 07:09:51.969426 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:09:51.969351 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-w55j5" Sep 17 07:09:51.980586 ip-10-0-138-13 kubenswrapper[2559]: W0917 07:09:51.980559 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod40bdd2f2_69d1_46dd_9ec2_3c57fb98b874.slice/crio-4d02d8c95e75f873d99816360b17b13de3055e1f27ced4b9ff36df92c6cffe69 WatchSource:0}: Error finding container 4d02d8c95e75f873d99816360b17b13de3055e1f27ced4b9ff36df92c6cffe69: Status 404 returned error can't find the container with id 4d02d8c95e75f873d99816360b17b13de3055e1f27ced4b9ff36df92c6cffe69 Sep 17 07:09:52.075304 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:09:52.075272 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Sep 17 07:09:52.079933 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:09:52.079911 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Sep 17 07:09:52.082380 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:09:52.082353 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Sep 17 07:09:52.083018 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:09:52.082996 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Sep 17 07:09:52.083828 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:09:52.083449 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Sep 17 07:09:52.083828 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:09:52.083451 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Sep 17 07:09:52.083828 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:09:52.083535 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Sep 17 07:09:52.083828 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:09:52.083602 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Sep 17 07:09:52.083828 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:09:52.083695 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Sep 17 07:09:52.083828 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:09:52.083739 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Sep 17 07:09:52.083828 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:09:52.083805 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-wqtcq\"" Sep 17 07:09:52.084225 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:09:52.084041 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Sep 17 07:09:52.103293 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:09:52.103272 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Sep 17 07:09:52.237238 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:09:52.237133 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/cc61e935-78e3-401a-8504-6ca431e50840-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"cc61e935-78e3-401a-8504-6ca431e50840\") " pod="openshift-monitoring/alertmanager-main-0" Sep 17 07:09:52.237238 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:09:52.237172 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q6nw2\" (UniqueName: \"kubernetes.io/projected/cc61e935-78e3-401a-8504-6ca431e50840-kube-api-access-q6nw2\") pod \"alertmanager-main-0\" (UID: \"cc61e935-78e3-401a-8504-6ca431e50840\") " pod="openshift-monitoring/alertmanager-main-0" Sep 17 07:09:52.237742 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:09:52.237240 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/cc61e935-78e3-401a-8504-6ca431e50840-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"cc61e935-78e3-401a-8504-6ca431e50840\") " pod="openshift-monitoring/alertmanager-main-0" Sep 17 07:09:52.237742 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:09:52.237292 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/cc61e935-78e3-401a-8504-6ca431e50840-config-volume\") pod \"alertmanager-main-0\" (UID: \"cc61e935-78e3-401a-8504-6ca431e50840\") " pod="openshift-monitoring/alertmanager-main-0" Sep 17 07:09:52.237742 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:09:52.237325 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/cc61e935-78e3-401a-8504-6ca431e50840-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"cc61e935-78e3-401a-8504-6ca431e50840\") " pod="openshift-monitoring/alertmanager-main-0" Sep 17 07:09:52.237742 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:09:52.237388 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/cc61e935-78e3-401a-8504-6ca431e50840-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"cc61e935-78e3-401a-8504-6ca431e50840\") " pod="openshift-monitoring/alertmanager-main-0" Sep 17 07:09:52.237742 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:09:52.237431 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/cc61e935-78e3-401a-8504-6ca431e50840-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"cc61e935-78e3-401a-8504-6ca431e50840\") " pod="openshift-monitoring/alertmanager-main-0" Sep 17 07:09:52.237742 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:09:52.237484 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/cc61e935-78e3-401a-8504-6ca431e50840-config-out\") pod \"alertmanager-main-0\" (UID: \"cc61e935-78e3-401a-8504-6ca431e50840\") " pod="openshift-monitoring/alertmanager-main-0" Sep 17 07:09:52.237742 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:09:52.237536 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/cc61e935-78e3-401a-8504-6ca431e50840-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"cc61e935-78e3-401a-8504-6ca431e50840\") " pod="openshift-monitoring/alertmanager-main-0" Sep 17 07:09:52.237742 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:09:52.237576 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cc61e935-78e3-401a-8504-6ca431e50840-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"cc61e935-78e3-401a-8504-6ca431e50840\") " pod="openshift-monitoring/alertmanager-main-0" Sep 17 07:09:52.237742 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:09:52.237666 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/cc61e935-78e3-401a-8504-6ca431e50840-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"cc61e935-78e3-401a-8504-6ca431e50840\") " pod="openshift-monitoring/alertmanager-main-0" Sep 17 07:09:52.237742 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:09:52.237695 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/cc61e935-78e3-401a-8504-6ca431e50840-tls-assets\") pod \"alertmanager-main-0\" (UID: \"cc61e935-78e3-401a-8504-6ca431e50840\") " pod="openshift-monitoring/alertmanager-main-0" Sep 17 07:09:52.237742 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:09:52.237718 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/cc61e935-78e3-401a-8504-6ca431e50840-web-config\") pod \"alertmanager-main-0\" (UID: \"cc61e935-78e3-401a-8504-6ca431e50840\") " pod="openshift-monitoring/alertmanager-main-0" Sep 17 07:09:52.338150 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:09:52.338100 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q6nw2\" (UniqueName: \"kubernetes.io/projected/cc61e935-78e3-401a-8504-6ca431e50840-kube-api-access-q6nw2\") pod \"alertmanager-main-0\" (UID: \"cc61e935-78e3-401a-8504-6ca431e50840\") " pod="openshift-monitoring/alertmanager-main-0" Sep 17 07:09:52.338323 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:09:52.338162 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/cc61e935-78e3-401a-8504-6ca431e50840-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"cc61e935-78e3-401a-8504-6ca431e50840\") " pod="openshift-monitoring/alertmanager-main-0" Sep 17 07:09:52.338323 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:09:52.338208 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/cc61e935-78e3-401a-8504-6ca431e50840-config-volume\") pod \"alertmanager-main-0\" (UID: \"cc61e935-78e3-401a-8504-6ca431e50840\") " pod="openshift-monitoring/alertmanager-main-0" Sep 17 07:09:52.338323 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:09:52.338233 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/cc61e935-78e3-401a-8504-6ca431e50840-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"cc61e935-78e3-401a-8504-6ca431e50840\") " pod="openshift-monitoring/alertmanager-main-0" Sep 17 07:09:52.338323 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:09:52.338267 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/cc61e935-78e3-401a-8504-6ca431e50840-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"cc61e935-78e3-401a-8504-6ca431e50840\") " pod="openshift-monitoring/alertmanager-main-0" Sep 17 07:09:52.338323 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:09:52.338300 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/cc61e935-78e3-401a-8504-6ca431e50840-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"cc61e935-78e3-401a-8504-6ca431e50840\") " pod="openshift-monitoring/alertmanager-main-0" Sep 17 07:09:52.338599 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:09:52.338355 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/cc61e935-78e3-401a-8504-6ca431e50840-config-out\") pod \"alertmanager-main-0\" (UID: \"cc61e935-78e3-401a-8504-6ca431e50840\") " pod="openshift-monitoring/alertmanager-main-0" Sep 17 07:09:52.338599 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:09:52.338377 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/cc61e935-78e3-401a-8504-6ca431e50840-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"cc61e935-78e3-401a-8504-6ca431e50840\") " pod="openshift-monitoring/alertmanager-main-0" Sep 17 07:09:52.338599 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:09:52.338399 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cc61e935-78e3-401a-8504-6ca431e50840-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"cc61e935-78e3-401a-8504-6ca431e50840\") " pod="openshift-monitoring/alertmanager-main-0" Sep 17 07:09:52.338599 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:09:52.338453 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/cc61e935-78e3-401a-8504-6ca431e50840-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"cc61e935-78e3-401a-8504-6ca431e50840\") " pod="openshift-monitoring/alertmanager-main-0" Sep 17 07:09:52.338599 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:09:52.338479 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/cc61e935-78e3-401a-8504-6ca431e50840-tls-assets\") pod \"alertmanager-main-0\" (UID: \"cc61e935-78e3-401a-8504-6ca431e50840\") " pod="openshift-monitoring/alertmanager-main-0" Sep 17 07:09:52.338599 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:09:52.338502 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/cc61e935-78e3-401a-8504-6ca431e50840-web-config\") pod \"alertmanager-main-0\" (UID: \"cc61e935-78e3-401a-8504-6ca431e50840\") " pod="openshift-monitoring/alertmanager-main-0" Sep 17 07:09:52.338599 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:09:52.338546 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/cc61e935-78e3-401a-8504-6ca431e50840-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"cc61e935-78e3-401a-8504-6ca431e50840\") " pod="openshift-monitoring/alertmanager-main-0" Sep 17 07:09:52.339496 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:09:52.338204 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-w55j5" event={"ID":"40bdd2f2-69d1-46dd-9ec2-3c57fb98b874","Type":"ContainerStarted","Data":"4d02d8c95e75f873d99816360b17b13de3055e1f27ced4b9ff36df92c6cffe69"} Sep 17 07:09:52.339820 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:09:52.339791 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/cc61e935-78e3-401a-8504-6ca431e50840-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"cc61e935-78e3-401a-8504-6ca431e50840\") " pod="openshift-monitoring/alertmanager-main-0" Sep 17 07:09:52.341611 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:09:52.340801 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cc61e935-78e3-401a-8504-6ca431e50840-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"cc61e935-78e3-401a-8504-6ca431e50840\") " pod="openshift-monitoring/alertmanager-main-0" Sep 17 07:09:52.341611 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:09:52.341068 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/cc61e935-78e3-401a-8504-6ca431e50840-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"cc61e935-78e3-401a-8504-6ca431e50840\") " pod="openshift-monitoring/alertmanager-main-0" Sep 17 07:09:52.342400 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:09:52.342380 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/cc61e935-78e3-401a-8504-6ca431e50840-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"cc61e935-78e3-401a-8504-6ca431e50840\") " pod="openshift-monitoring/alertmanager-main-0" Sep 17 07:09:52.343111 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:09:52.343081 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-khvdn" event={"ID":"98e5d160-0b87-4ad9-ab09-23d64a419f9a","Type":"ContainerStarted","Data":"d15d1ecc27a7ccc279dec7f350ccb754eb2cc45f3177624b49ba91c80b41bcfc"} Sep 17 07:09:52.343194 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:09:52.343146 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-khvdn" event={"ID":"98e5d160-0b87-4ad9-ab09-23d64a419f9a","Type":"ContainerStarted","Data":"740a9e583361cb35c3bd0131780c57578a8f27e6558cca9ea1fb84665a1c446f"} Sep 17 07:09:52.343194 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:09:52.343151 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/cc61e935-78e3-401a-8504-6ca431e50840-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"cc61e935-78e3-401a-8504-6ca431e50840\") " pod="openshift-monitoring/alertmanager-main-0" Sep 17 07:09:52.343194 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:09:52.343177 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-khvdn" event={"ID":"98e5d160-0b87-4ad9-ab09-23d64a419f9a","Type":"ContainerStarted","Data":"91ec0e745ec7678a398f52b39416790a8a6cccaecefb8d8ea9874f223c9ef37b"} Sep 17 07:09:52.343194 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:09:52.343186 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/cc61e935-78e3-401a-8504-6ca431e50840-config-out\") pod \"alertmanager-main-0\" (UID: \"cc61e935-78e3-401a-8504-6ca431e50840\") " pod="openshift-monitoring/alertmanager-main-0" Sep 17 07:09:52.343425 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:09:52.343403 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/cc61e935-78e3-401a-8504-6ca431e50840-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"cc61e935-78e3-401a-8504-6ca431e50840\") " pod="openshift-monitoring/alertmanager-main-0" Sep 17 07:09:52.344117 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:09:52.344094 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/cc61e935-78e3-401a-8504-6ca431e50840-tls-assets\") pod \"alertmanager-main-0\" (UID: \"cc61e935-78e3-401a-8504-6ca431e50840\") " pod="openshift-monitoring/alertmanager-main-0" Sep 17 07:09:52.344801 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:09:52.344750 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/cc61e935-78e3-401a-8504-6ca431e50840-config-volume\") pod \"alertmanager-main-0\" (UID: \"cc61e935-78e3-401a-8504-6ca431e50840\") " pod="openshift-monitoring/alertmanager-main-0" Sep 17 07:09:52.345127 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:09:52.345070 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/cc61e935-78e3-401a-8504-6ca431e50840-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"cc61e935-78e3-401a-8504-6ca431e50840\") " pod="openshift-monitoring/alertmanager-main-0" Sep 17 07:09:52.345127 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:09:52.345070 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/cc61e935-78e3-401a-8504-6ca431e50840-web-config\") pod \"alertmanager-main-0\" (UID: \"cc61e935-78e3-401a-8504-6ca431e50840\") " pod="openshift-monitoring/alertmanager-main-0" Sep 17 07:09:52.345469 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:09:52.345450 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/cc61e935-78e3-401a-8504-6ca431e50840-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"cc61e935-78e3-401a-8504-6ca431e50840\") " pod="openshift-monitoring/alertmanager-main-0" Sep 17 07:09:52.348576 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:09:52.348557 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-q6nw2\" (UniqueName: \"kubernetes.io/projected/cc61e935-78e3-401a-8504-6ca431e50840-kube-api-access-q6nw2\") pod \"alertmanager-main-0\" (UID: \"cc61e935-78e3-401a-8504-6ca431e50840\") " pod="openshift-monitoring/alertmanager-main-0" Sep 17 07:09:52.392575 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:09:52.392546 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Sep 17 07:09:53.349895 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:09:53.349809 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-khvdn" event={"ID":"98e5d160-0b87-4ad9-ab09-23d64a419f9a","Type":"ContainerStarted","Data":"4bc0bf695d714af6b1e21e0e81f9fba6c38bc8f4f0e48485307be366b7fa197e"} Sep 17 07:09:53.352715 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:09:53.352687 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-8zt9c" event={"ID":"2204950c-6aee-4c24-9abf-58c5fcc5bafd","Type":"ContainerStarted","Data":"77d6e1c2f1ed6a09cd2980c13e393f07031f9de5f248927d55db13987701b26f"} Sep 17 07:09:53.352820 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:09:53.352742 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-8zt9c" event={"ID":"2204950c-6aee-4c24-9abf-58c5fcc5bafd","Type":"ContainerStarted","Data":"fdc33a32227e773e4b6400ec37a4794cd432414bb5b6cb58947c11cc3e654009"} Sep 17 07:09:53.352820 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:09:53.352796 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-8zt9c" Sep 17 07:09:53.372650 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:09:53.372627 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Sep 17 07:09:53.380484 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:09:53.380445 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-khvdn" podStartSLOduration=1.119342098 podStartE2EDuration="2.380426657s" totalImagesPullingTime="1.261084559s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 07:09:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 07:09:53.379836704 +0000 UTC m=+100.927983414" watchObservedRunningTime="2026-09-17 07:09:53.380426657 +0000 UTC m=+100.928573368" Sep 17 07:09:53.406476 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:09:53.406421 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-8zt9c" podStartSLOduration=65.437541551 podStartE2EDuration="1m7.406405843s" totalImagesPullingTime="1.968864292s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 07:08:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 07:09:53.404511238 +0000 UTC m=+100.952657970" watchObservedRunningTime="2026-09-17 07:09:53.406405843 +0000 UTC m=+100.954552551" Sep 17 07:09:53.584522 ip-10-0-138-13 kubenswrapper[2559]: W0917 07:09:53.584492 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcc61e935_78e3_401a_8504_6ca431e50840.slice/crio-ca54f21d8e0db92ceb0f8fc17d47855533f000ae24c876637089f73f6601c247 WatchSource:0}: Error finding container ca54f21d8e0db92ceb0f8fc17d47855533f000ae24c876637089f73f6601c247: Status 404 returned error can't find the container with id ca54f21d8e0db92ceb0f8fc17d47855533f000ae24c876637089f73f6601c247 Sep 17 07:09:54.122751 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:09:54.122717 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-6fd79699b8-9pm6z"] Sep 17 07:09:54.126633 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:09:54.126613 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-6fd79699b8-9pm6z" Sep 17 07:09:54.129667 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:09:54.129642 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\"" Sep 17 07:09:54.129800 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:09:54.129785 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\"" Sep 17 07:09:54.129913 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:09:54.129896 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\"" Sep 17 07:09:54.130478 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:09:54.130463 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-42d2kmdegbci5\"" Sep 17 07:09:54.130627 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:09:54.130605 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\"" Sep 17 07:09:54.130720 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:09:54.130702 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-4ptn5\"" Sep 17 07:09:54.136905 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:09:54.136888 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\"" Sep 17 07:09:54.198139 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:09:54.198114 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-6fd79699b8-9pm6z"] Sep 17 07:09:54.219523 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:09:54.219502 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-b768z" Sep 17 07:09:54.252678 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:09:54.252648 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/f6186428-be06-481b-a94c-090002b4dd47-secret-thanos-querier-tls\") pod \"thanos-querier-6fd79699b8-9pm6z\" (UID: \"f6186428-be06-481b-a94c-090002b4dd47\") " pod="openshift-monitoring/thanos-querier-6fd79699b8-9pm6z" Sep 17 07:09:54.252789 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:09:54.252702 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/f6186428-be06-481b-a94c-090002b4dd47-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-6fd79699b8-9pm6z\" (UID: \"f6186428-be06-481b-a94c-090002b4dd47\") " pod="openshift-monitoring/thanos-querier-6fd79699b8-9pm6z" Sep 17 07:09:54.252789 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:09:54.252730 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/f6186428-be06-481b-a94c-090002b4dd47-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-6fd79699b8-9pm6z\" (UID: \"f6186428-be06-481b-a94c-090002b4dd47\") " pod="openshift-monitoring/thanos-querier-6fd79699b8-9pm6z" Sep 17 07:09:54.252892 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:09:54.252814 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/f6186428-be06-481b-a94c-090002b4dd47-secret-grpc-tls\") pod \"thanos-querier-6fd79699b8-9pm6z\" (UID: \"f6186428-be06-481b-a94c-090002b4dd47\") " pod="openshift-monitoring/thanos-querier-6fd79699b8-9pm6z" Sep 17 07:09:54.252892 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:09:54.252874 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/f6186428-be06-481b-a94c-090002b4dd47-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-6fd79699b8-9pm6z\" (UID: \"f6186428-be06-481b-a94c-090002b4dd47\") " pod="openshift-monitoring/thanos-querier-6fd79699b8-9pm6z" Sep 17 07:09:54.253038 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:09:54.252903 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/f6186428-be06-481b-a94c-090002b4dd47-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-6fd79699b8-9pm6z\" (UID: \"f6186428-be06-481b-a94c-090002b4dd47\") " pod="openshift-monitoring/thanos-querier-6fd79699b8-9pm6z" Sep 17 07:09:54.253038 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:09:54.252930 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4xtcx\" (UniqueName: \"kubernetes.io/projected/f6186428-be06-481b-a94c-090002b4dd47-kube-api-access-4xtcx\") pod \"thanos-querier-6fd79699b8-9pm6z\" (UID: \"f6186428-be06-481b-a94c-090002b4dd47\") " pod="openshift-monitoring/thanos-querier-6fd79699b8-9pm6z" Sep 17 07:09:54.253038 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:09:54.252958 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f6186428-be06-481b-a94c-090002b4dd47-metrics-client-ca\") pod \"thanos-querier-6fd79699b8-9pm6z\" (UID: \"f6186428-be06-481b-a94c-090002b4dd47\") " pod="openshift-monitoring/thanos-querier-6fd79699b8-9pm6z" Sep 17 07:09:54.354157 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:09:54.354121 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/f6186428-be06-481b-a94c-090002b4dd47-secret-grpc-tls\") pod \"thanos-querier-6fd79699b8-9pm6z\" (UID: \"f6186428-be06-481b-a94c-090002b4dd47\") " pod="openshift-monitoring/thanos-querier-6fd79699b8-9pm6z" Sep 17 07:09:54.354598 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:09:54.354173 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/f6186428-be06-481b-a94c-090002b4dd47-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-6fd79699b8-9pm6z\" (UID: \"f6186428-be06-481b-a94c-090002b4dd47\") " pod="openshift-monitoring/thanos-querier-6fd79699b8-9pm6z" Sep 17 07:09:54.354598 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:09:54.354334 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/f6186428-be06-481b-a94c-090002b4dd47-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-6fd79699b8-9pm6z\" (UID: \"f6186428-be06-481b-a94c-090002b4dd47\") " pod="openshift-monitoring/thanos-querier-6fd79699b8-9pm6z" Sep 17 07:09:54.354598 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:09:54.354370 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4xtcx\" (UniqueName: \"kubernetes.io/projected/f6186428-be06-481b-a94c-090002b4dd47-kube-api-access-4xtcx\") pod \"thanos-querier-6fd79699b8-9pm6z\" (UID: \"f6186428-be06-481b-a94c-090002b4dd47\") " pod="openshift-monitoring/thanos-querier-6fd79699b8-9pm6z" Sep 17 07:09:54.354598 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:09:54.354517 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f6186428-be06-481b-a94c-090002b4dd47-metrics-client-ca\") pod \"thanos-querier-6fd79699b8-9pm6z\" (UID: \"f6186428-be06-481b-a94c-090002b4dd47\") " pod="openshift-monitoring/thanos-querier-6fd79699b8-9pm6z" Sep 17 07:09:54.354598 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:09:54.354571 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/f6186428-be06-481b-a94c-090002b4dd47-secret-thanos-querier-tls\") pod \"thanos-querier-6fd79699b8-9pm6z\" (UID: \"f6186428-be06-481b-a94c-090002b4dd47\") " pod="openshift-monitoring/thanos-querier-6fd79699b8-9pm6z" Sep 17 07:09:54.354837 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:09:54.354659 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/f6186428-be06-481b-a94c-090002b4dd47-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-6fd79699b8-9pm6z\" (UID: \"f6186428-be06-481b-a94c-090002b4dd47\") " pod="openshift-monitoring/thanos-querier-6fd79699b8-9pm6z" Sep 17 07:09:54.354837 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:09:54.354691 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/f6186428-be06-481b-a94c-090002b4dd47-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-6fd79699b8-9pm6z\" (UID: \"f6186428-be06-481b-a94c-090002b4dd47\") " pod="openshift-monitoring/thanos-querier-6fd79699b8-9pm6z" Sep 17 07:09:54.355613 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:09:54.355296 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f6186428-be06-481b-a94c-090002b4dd47-metrics-client-ca\") pod \"thanos-querier-6fd79699b8-9pm6z\" (UID: \"f6186428-be06-481b-a94c-090002b4dd47\") " pod="openshift-monitoring/thanos-querier-6fd79699b8-9pm6z" Sep 17 07:09:54.357192 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:09:54.357161 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/f6186428-be06-481b-a94c-090002b4dd47-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-6fd79699b8-9pm6z\" (UID: \"f6186428-be06-481b-a94c-090002b4dd47\") " pod="openshift-monitoring/thanos-querier-6fd79699b8-9pm6z" Sep 17 07:09:54.358116 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:09:54.358050 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/f6186428-be06-481b-a94c-090002b4dd47-secret-thanos-querier-tls\") pod \"thanos-querier-6fd79699b8-9pm6z\" (UID: \"f6186428-be06-481b-a94c-090002b4dd47\") " pod="openshift-monitoring/thanos-querier-6fd79699b8-9pm6z" Sep 17 07:09:54.358116 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:09:54.358072 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/f6186428-be06-481b-a94c-090002b4dd47-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-6fd79699b8-9pm6z\" (UID: \"f6186428-be06-481b-a94c-090002b4dd47\") " pod="openshift-monitoring/thanos-querier-6fd79699b8-9pm6z" Sep 17 07:09:54.363131 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:09:54.358271 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/f6186428-be06-481b-a94c-090002b4dd47-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-6fd79699b8-9pm6z\" (UID: \"f6186428-be06-481b-a94c-090002b4dd47\") " pod="openshift-monitoring/thanos-querier-6fd79699b8-9pm6z" Sep 17 07:09:54.363131 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:09:54.358634 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/f6186428-be06-481b-a94c-090002b4dd47-secret-grpc-tls\") pod \"thanos-querier-6fd79699b8-9pm6z\" (UID: \"f6186428-be06-481b-a94c-090002b4dd47\") " pod="openshift-monitoring/thanos-querier-6fd79699b8-9pm6z" Sep 17 07:09:54.363131 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:09:54.358945 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/f6186428-be06-481b-a94c-090002b4dd47-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-6fd79699b8-9pm6z\" (UID: \"f6186428-be06-481b-a94c-090002b4dd47\") " pod="openshift-monitoring/thanos-querier-6fd79699b8-9pm6z" Sep 17 07:09:54.364294 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:09:54.364253 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"cc61e935-78e3-401a-8504-6ca431e50840","Type":"ContainerStarted","Data":"ca54f21d8e0db92ceb0f8fc17d47855533f000ae24c876637089f73f6601c247"} Sep 17 07:09:54.364963 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:09:54.364938 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4xtcx\" (UniqueName: \"kubernetes.io/projected/f6186428-be06-481b-a94c-090002b4dd47-kube-api-access-4xtcx\") pod \"thanos-querier-6fd79699b8-9pm6z\" (UID: \"f6186428-be06-481b-a94c-090002b4dd47\") " pod="openshift-monitoring/thanos-querier-6fd79699b8-9pm6z" Sep 17 07:09:54.366189 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:09:54.366169 2559 generic.go:356] "Generic (PLEG): container finished" podID="40bdd2f2-69d1-46dd-9ec2-3c57fb98b874" containerID="33ba933d893861a45f2f2d4e61eb85a979496c6b0bd9e65676ba24055f45ae66" exitCode=0 Sep 17 07:09:54.366275 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:09:54.366252 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-w55j5" event={"ID":"40bdd2f2-69d1-46dd-9ec2-3c57fb98b874","Type":"ContainerDied","Data":"33ba933d893861a45f2f2d4e61eb85a979496c6b0bd9e65676ba24055f45ae66"} Sep 17 07:09:54.435487 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:09:54.435460 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-6fd79699b8-9pm6z" Sep 17 07:09:54.790801 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:09:54.790770 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-6fd79699b8-9pm6z"] Sep 17 07:09:54.903098 ip-10-0-138-13 kubenswrapper[2559]: W0917 07:09:54.903070 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf6186428_be06_481b_a94c_090002b4dd47.slice/crio-bb111608aeae43dbb3b2ff20a1eca7f95c855d4b2fc1e7ab8e5163bf25ddaf0f WatchSource:0}: Error finding container bb111608aeae43dbb3b2ff20a1eca7f95c855d4b2fc1e7ab8e5163bf25ddaf0f: Status 404 returned error can't find the container with id bb111608aeae43dbb3b2ff20a1eca7f95c855d4b2fc1e7ab8e5163bf25ddaf0f Sep 17 07:09:55.371843 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:09:55.371811 2559 generic.go:356] "Generic (PLEG): container finished" podID="cc61e935-78e3-401a-8504-6ca431e50840" containerID="ae2e52edc3a2af88a3296b9d68f75cdafaa1dabfad19f7d6ebef67fd0913f516" exitCode=0 Sep 17 07:09:55.372291 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:09:55.371882 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"cc61e935-78e3-401a-8504-6ca431e50840","Type":"ContainerDied","Data":"ae2e52edc3a2af88a3296b9d68f75cdafaa1dabfad19f7d6ebef67fd0913f516"} Sep 17 07:09:55.373227 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:09:55.373192 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6fd79699b8-9pm6z" event={"ID":"f6186428-be06-481b-a94c-090002b4dd47","Type":"ContainerStarted","Data":"bb111608aeae43dbb3b2ff20a1eca7f95c855d4b2fc1e7ab8e5163bf25ddaf0f"} Sep 17 07:09:55.375592 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:09:55.375564 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-w55j5" event={"ID":"40bdd2f2-69d1-46dd-9ec2-3c57fb98b874","Type":"ContainerStarted","Data":"34a0b9507a3bc1753c0a21fcc0c41702b276998e2642252394ab3b35d65c3d11"} Sep 17 07:09:55.375664 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:09:55.375612 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-w55j5" event={"ID":"40bdd2f2-69d1-46dd-9ec2-3c57fb98b874","Type":"ContainerStarted","Data":"27c0d821d5b923e78e4f2df036d33cb84169a737fe6d3ae9d15160a1d961bc15"} Sep 17 07:09:55.425957 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:09:55.425928 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-8db5f8b5c-xt759"] Sep 17 07:09:55.429132 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:09:55.429110 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-8db5f8b5c-xt759" Sep 17 07:09:55.440932 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:09:55.440914 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\"" Sep 17 07:09:55.441182 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:09:55.441166 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\"" Sep 17 07:09:55.441326 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:09:55.441304 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Sep 17 07:09:55.441511 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:09:55.441461 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-bmp55pu564d4c\"" Sep 17 07:09:55.441511 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:09:55.441505 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\"" Sep 17 07:09:55.441644 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:09:55.441544 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-dxbpm\"" Sep 17 07:09:55.452479 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:09:55.452452 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-8db5f8b5c-xt759"] Sep 17 07:09:55.454230 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:09:55.454181 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-w55j5" podStartSLOduration=2.733328182 podStartE2EDuration="4.45416286s" totalImagesPullingTime="1.660558697s" totalInitContainerRuntime="60.275981ms" isStatefulPod=true podCreationTimestamp="2026-09-17 07:09:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 07:09:55.45364655 +0000 UTC m=+103.001793267" watchObservedRunningTime="2026-09-17 07:09:55.45416286 +0000 UTC m=+103.002309570" Sep 17 07:09:55.566844 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:09:55.566816 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/d700e0c0-22c1-484b-81ff-d75bd670e3e2-secret-metrics-server-client-certs\") pod \"metrics-server-8db5f8b5c-xt759\" (UID: \"d700e0c0-22c1-484b-81ff-d75bd670e3e2\") " pod="openshift-monitoring/metrics-server-8db5f8b5c-xt759" Sep 17 07:09:55.567032 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:09:55.566876 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/d700e0c0-22c1-484b-81ff-d75bd670e3e2-audit-log\") pod \"metrics-server-8db5f8b5c-xt759\" (UID: \"d700e0c0-22c1-484b-81ff-d75bd670e3e2\") " pod="openshift-monitoring/metrics-server-8db5f8b5c-xt759" Sep 17 07:09:55.567032 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:09:55.566925 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6krds\" (UniqueName: \"kubernetes.io/projected/d700e0c0-22c1-484b-81ff-d75bd670e3e2-kube-api-access-6krds\") pod \"metrics-server-8db5f8b5c-xt759\" (UID: \"d700e0c0-22c1-484b-81ff-d75bd670e3e2\") " pod="openshift-monitoring/metrics-server-8db5f8b5c-xt759" Sep 17 07:09:55.567032 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:09:55.566950 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/d700e0c0-22c1-484b-81ff-d75bd670e3e2-client-ca-bundle\") pod \"metrics-server-8db5f8b5c-xt759\" (UID: \"d700e0c0-22c1-484b-81ff-d75bd670e3e2\") " pod="openshift-monitoring/metrics-server-8db5f8b5c-xt759" Sep 17 07:09:55.567214 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:09:55.567049 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/d700e0c0-22c1-484b-81ff-d75bd670e3e2-metrics-server-audit-profiles\") pod \"metrics-server-8db5f8b5c-xt759\" (UID: \"d700e0c0-22c1-484b-81ff-d75bd670e3e2\") " pod="openshift-monitoring/metrics-server-8db5f8b5c-xt759" Sep 17 07:09:55.567214 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:09:55.567070 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/d700e0c0-22c1-484b-81ff-d75bd670e3e2-secret-metrics-server-tls\") pod \"metrics-server-8db5f8b5c-xt759\" (UID: \"d700e0c0-22c1-484b-81ff-d75bd670e3e2\") " pod="openshift-monitoring/metrics-server-8db5f8b5c-xt759" Sep 17 07:09:55.567214 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:09:55.567123 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d700e0c0-22c1-484b-81ff-d75bd670e3e2-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-8db5f8b5c-xt759\" (UID: \"d700e0c0-22c1-484b-81ff-d75bd670e3e2\") " pod="openshift-monitoring/metrics-server-8db5f8b5c-xt759" Sep 17 07:09:55.668205 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:09:55.668123 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/d700e0c0-22c1-484b-81ff-d75bd670e3e2-audit-log\") pod \"metrics-server-8db5f8b5c-xt759\" (UID: \"d700e0c0-22c1-484b-81ff-d75bd670e3e2\") " pod="openshift-monitoring/metrics-server-8db5f8b5c-xt759" Sep 17 07:09:55.668205 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:09:55.668166 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6krds\" (UniqueName: \"kubernetes.io/projected/d700e0c0-22c1-484b-81ff-d75bd670e3e2-kube-api-access-6krds\") pod \"metrics-server-8db5f8b5c-xt759\" (UID: \"d700e0c0-22c1-484b-81ff-d75bd670e3e2\") " pod="openshift-monitoring/metrics-server-8db5f8b5c-xt759" Sep 17 07:09:55.668205 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:09:55.668188 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/d700e0c0-22c1-484b-81ff-d75bd670e3e2-client-ca-bundle\") pod \"metrics-server-8db5f8b5c-xt759\" (UID: \"d700e0c0-22c1-484b-81ff-d75bd670e3e2\") " pod="openshift-monitoring/metrics-server-8db5f8b5c-xt759" Sep 17 07:09:55.668462 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:09:55.668263 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/d700e0c0-22c1-484b-81ff-d75bd670e3e2-metrics-server-audit-profiles\") pod \"metrics-server-8db5f8b5c-xt759\" (UID: \"d700e0c0-22c1-484b-81ff-d75bd670e3e2\") " pod="openshift-monitoring/metrics-server-8db5f8b5c-xt759" Sep 17 07:09:55.668462 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:09:55.668289 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/d700e0c0-22c1-484b-81ff-d75bd670e3e2-secret-metrics-server-tls\") pod \"metrics-server-8db5f8b5c-xt759\" (UID: \"d700e0c0-22c1-484b-81ff-d75bd670e3e2\") " pod="openshift-monitoring/metrics-server-8db5f8b5c-xt759" Sep 17 07:09:55.668462 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:09:55.668313 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d700e0c0-22c1-484b-81ff-d75bd670e3e2-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-8db5f8b5c-xt759\" (UID: \"d700e0c0-22c1-484b-81ff-d75bd670e3e2\") " pod="openshift-monitoring/metrics-server-8db5f8b5c-xt759" Sep 17 07:09:55.668462 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:09:55.668363 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/d700e0c0-22c1-484b-81ff-d75bd670e3e2-secret-metrics-server-client-certs\") pod \"metrics-server-8db5f8b5c-xt759\" (UID: \"d700e0c0-22c1-484b-81ff-d75bd670e3e2\") " pod="openshift-monitoring/metrics-server-8db5f8b5c-xt759" Sep 17 07:09:55.669007 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:09:55.668668 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/d700e0c0-22c1-484b-81ff-d75bd670e3e2-audit-log\") pod \"metrics-server-8db5f8b5c-xt759\" (UID: \"d700e0c0-22c1-484b-81ff-d75bd670e3e2\") " pod="openshift-monitoring/metrics-server-8db5f8b5c-xt759" Sep 17 07:09:55.669376 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:09:55.669324 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d700e0c0-22c1-484b-81ff-d75bd670e3e2-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-8db5f8b5c-xt759\" (UID: \"d700e0c0-22c1-484b-81ff-d75bd670e3e2\") " pod="openshift-monitoring/metrics-server-8db5f8b5c-xt759" Sep 17 07:09:55.669494 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:09:55.669388 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/d700e0c0-22c1-484b-81ff-d75bd670e3e2-metrics-server-audit-profiles\") pod \"metrics-server-8db5f8b5c-xt759\" (UID: \"d700e0c0-22c1-484b-81ff-d75bd670e3e2\") " pod="openshift-monitoring/metrics-server-8db5f8b5c-xt759" Sep 17 07:09:55.671314 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:09:55.671290 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/d700e0c0-22c1-484b-81ff-d75bd670e3e2-secret-metrics-server-client-certs\") pod \"metrics-server-8db5f8b5c-xt759\" (UID: \"d700e0c0-22c1-484b-81ff-d75bd670e3e2\") " pod="openshift-monitoring/metrics-server-8db5f8b5c-xt759" Sep 17 07:09:55.671453 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:09:55.671433 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/d700e0c0-22c1-484b-81ff-d75bd670e3e2-secret-metrics-server-tls\") pod \"metrics-server-8db5f8b5c-xt759\" (UID: \"d700e0c0-22c1-484b-81ff-d75bd670e3e2\") " pod="openshift-monitoring/metrics-server-8db5f8b5c-xt759" Sep 17 07:09:55.671526 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:09:55.671493 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/d700e0c0-22c1-484b-81ff-d75bd670e3e2-client-ca-bundle\") pod \"metrics-server-8db5f8b5c-xt759\" (UID: \"d700e0c0-22c1-484b-81ff-d75bd670e3e2\") " pod="openshift-monitoring/metrics-server-8db5f8b5c-xt759" Sep 17 07:09:55.679638 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:09:55.679618 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6krds\" (UniqueName: \"kubernetes.io/projected/d700e0c0-22c1-484b-81ff-d75bd670e3e2-kube-api-access-6krds\") pod \"metrics-server-8db5f8b5c-xt759\" (UID: \"d700e0c0-22c1-484b-81ff-d75bd670e3e2\") " pod="openshift-monitoring/metrics-server-8db5f8b5c-xt759" Sep 17 07:09:55.738287 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:09:55.738260 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-5d85778b9d-tj6dc"] Sep 17 07:09:55.739422 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:09:55.739399 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-8db5f8b5c-xt759" Sep 17 07:09:55.743933 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:09:55.743915 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-5d85778b9d-tj6dc" Sep 17 07:09:55.746547 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:09:55.746524 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\"" Sep 17 07:09:55.747284 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:09:55.747263 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-cczsv\"" Sep 17 07:09:55.767890 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:09:55.767802 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-5d85778b9d-tj6dc"] Sep 17 07:09:55.871155 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:09:55.871122 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/208b9bb7-106e-4807-a3fb-80925f62e39a-monitoring-plugin-cert\") pod \"monitoring-plugin-5d85778b9d-tj6dc\" (UID: \"208b9bb7-106e-4807-a3fb-80925f62e39a\") " pod="openshift-monitoring/monitoring-plugin-5d85778b9d-tj6dc" Sep 17 07:09:55.871293 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:09:55.871227 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x7h6c\" (UniqueName: \"kubernetes.io/projected/208b9bb7-106e-4807-a3fb-80925f62e39a-kube-api-access-x7h6c\") pod \"monitoring-plugin-5d85778b9d-tj6dc\" (UID: \"208b9bb7-106e-4807-a3fb-80925f62e39a\") " pod="openshift-monitoring/monitoring-plugin-5d85778b9d-tj6dc" Sep 17 07:09:55.972328 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:09:55.972250 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x7h6c\" (UniqueName: \"kubernetes.io/projected/208b9bb7-106e-4807-a3fb-80925f62e39a-kube-api-access-x7h6c\") pod \"monitoring-plugin-5d85778b9d-tj6dc\" (UID: \"208b9bb7-106e-4807-a3fb-80925f62e39a\") " pod="openshift-monitoring/monitoring-plugin-5d85778b9d-tj6dc" Sep 17 07:09:55.972480 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:09:55.972372 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/208b9bb7-106e-4807-a3fb-80925f62e39a-monitoring-plugin-cert\") pod \"monitoring-plugin-5d85778b9d-tj6dc\" (UID: \"208b9bb7-106e-4807-a3fb-80925f62e39a\") " pod="openshift-monitoring/monitoring-plugin-5d85778b9d-tj6dc" Sep 17 07:09:55.975225 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:09:55.975203 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/208b9bb7-106e-4807-a3fb-80925f62e39a-monitoring-plugin-cert\") pod \"monitoring-plugin-5d85778b9d-tj6dc\" (UID: \"208b9bb7-106e-4807-a3fb-80925f62e39a\") " pod="openshift-monitoring/monitoring-plugin-5d85778b9d-tj6dc" Sep 17 07:09:55.982097 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:09:55.982065 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-x7h6c\" (UniqueName: \"kubernetes.io/projected/208b9bb7-106e-4807-a3fb-80925f62e39a-kube-api-access-x7h6c\") pod \"monitoring-plugin-5d85778b9d-tj6dc\" (UID: \"208b9bb7-106e-4807-a3fb-80925f62e39a\") " pod="openshift-monitoring/monitoring-plugin-5d85778b9d-tj6dc" Sep 17 07:09:56.025839 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:09:56.025809 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-8db5f8b5c-xt759"] Sep 17 07:09:56.029676 ip-10-0-138-13 kubenswrapper[2559]: W0917 07:09:56.029651 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd700e0c0_22c1_484b_81ff_d75bd670e3e2.slice/crio-7bfa119d8c3db0533758035a8411f38494a5f725cb3a6533c646259775fa9be3 WatchSource:0}: Error finding container 7bfa119d8c3db0533758035a8411f38494a5f725cb3a6533c646259775fa9be3: Status 404 returned error can't find the container with id 7bfa119d8c3db0533758035a8411f38494a5f725cb3a6533c646259775fa9be3 Sep 17 07:09:56.071139 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:09:56.071112 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-5d85778b9d-tj6dc" Sep 17 07:09:56.352047 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:09:56.352022 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-5d85778b9d-tj6dc"] Sep 17 07:09:56.384016 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:09:56.383761 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-8db5f8b5c-xt759" event={"ID":"d700e0c0-22c1-484b-81ff-d75bd670e3e2","Type":"ContainerStarted","Data":"7bfa119d8c3db0533758035a8411f38494a5f725cb3a6533c646259775fa9be3"} Sep 17 07:09:56.760459 ip-10-0-138-13 kubenswrapper[2559]: W0917 07:09:56.760425 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod208b9bb7_106e_4807_a3fb_80925f62e39a.slice/crio-834ccb39241dfbef0b8520af03e0715a23cfc10eb4dba3c11c8a5efbdd184a68 WatchSource:0}: Error finding container 834ccb39241dfbef0b8520af03e0715a23cfc10eb4dba3c11c8a5efbdd184a68: Status 404 returned error can't find the container with id 834ccb39241dfbef0b8520af03e0715a23cfc10eb4dba3c11c8a5efbdd184a68 Sep 17 07:09:57.387551 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:09:57.387511 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-5d85778b9d-tj6dc" event={"ID":"208b9bb7-106e-4807-a3fb-80925f62e39a","Type":"ContainerStarted","Data":"834ccb39241dfbef0b8520af03e0715a23cfc10eb4dba3c11c8a5efbdd184a68"} Sep 17 07:09:58.394130 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:09:58.394092 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6fd79699b8-9pm6z" event={"ID":"f6186428-be06-481b-a94c-090002b4dd47","Type":"ContainerStarted","Data":"a1537d3fc2f1d8920d682eef0c4f840ce4f29da0c8521b0748eed4ece0300a37"} Sep 17 07:09:58.394564 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:09:58.394160 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6fd79699b8-9pm6z" event={"ID":"f6186428-be06-481b-a94c-090002b4dd47","Type":"ContainerStarted","Data":"bab31ea320c64cf30d9b79e1efb75ae41f8dac2be289dbd24ec46b262cdb8551"} Sep 17 07:09:58.394564 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:09:58.394187 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6fd79699b8-9pm6z" event={"ID":"f6186428-be06-481b-a94c-090002b4dd47","Type":"ContainerStarted","Data":"5f65cb6a89466e06c87cc8119ecdaa30ffc49fe29848f3dc919a643e0c1476c1"} Sep 17 07:09:58.396725 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:09:58.396702 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"cc61e935-78e3-401a-8504-6ca431e50840","Type":"ContainerStarted","Data":"7fa04235c29615d51ea96d81c481c6137129407ec6f7f6a9345b99f7f2827d26"} Sep 17 07:09:58.396818 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:09:58.396757 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"cc61e935-78e3-401a-8504-6ca431e50840","Type":"ContainerStarted","Data":"ebc8f2b381a1cad1ff907c028f8ec04bbcd860e7e308dc277f5587c53215bd45"} Sep 17 07:09:58.396818 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:09:58.396782 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"cc61e935-78e3-401a-8504-6ca431e50840","Type":"ContainerStarted","Data":"f74f412d1d2e9847e5af48c5a1f2d7fbd55c386c1087e6668ac708e8168e31d8"} Sep 17 07:09:58.396818 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:09:58.396807 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"cc61e935-78e3-401a-8504-6ca431e50840","Type":"ContainerStarted","Data":"be082bbfd151e4ee433e09a53a2c4fb9c40f29efd140a4c5e6dc06f164664508"} Sep 17 07:10:00.346459 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:10:00.346429 2559 patch_prober.go:28] interesting pod/image-registry-f476b5c9b-7khtp container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Sep 17 07:10:00.346838 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:10:00.346485 2559 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-f476b5c9b-7khtp" podUID="f6ea68a3-2405-419e-8435-f1f1fdb7f4a0" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Sep 17 07:10:00.418319 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:10:00.418289 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"cc61e935-78e3-401a-8504-6ca431e50840","Type":"ContainerStarted","Data":"cc02539d449a03441c083854f8f51bdb480498d821d73c842a3a57f662f40005"} Sep 17 07:10:00.418439 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:10:00.418389 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"cc61e935-78e3-401a-8504-6ca431e50840","Type":"ContainerStarted","Data":"524ce8e06b60ccecac23f55966f5e842f5604a2233cab6188d05d5439b0ed2b4"} Sep 17 07:10:00.419835 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:10:00.419813 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-8db5f8b5c-xt759" event={"ID":"d700e0c0-22c1-484b-81ff-d75bd670e3e2","Type":"ContainerStarted","Data":"d9ac8655dbc54bc5cb0948c0220c78a3ed7d8e36fd5aab0fb9a5003a46f1026b"} Sep 17 07:10:00.421519 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:10:00.421487 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-5d85778b9d-tj6dc" event={"ID":"208b9bb7-106e-4807-a3fb-80925f62e39a","Type":"ContainerStarted","Data":"3c72c6aba9707d49d3c1892636db4ebd6065690b6bbdfbd731791a8642da9d5b"} Sep 17 07:10:00.421654 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:10:00.421638 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-5d85778b9d-tj6dc" Sep 17 07:10:00.424697 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:10:00.424677 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6fd79699b8-9pm6z" event={"ID":"f6186428-be06-481b-a94c-090002b4dd47","Type":"ContainerStarted","Data":"1b86b3828befbac6aca2d8b9a58aa41a630705c1707406b29bd6f23ab7a722f5"} Sep 17 07:10:00.424779 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:10:00.424723 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6fd79699b8-9pm6z" event={"ID":"f6186428-be06-481b-a94c-090002b4dd47","Type":"ContainerStarted","Data":"db08243e5c67b6adf49b3d67537f9860911de6fdaccf56abd66f6895be88563b"} Sep 17 07:10:00.424779 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:10:00.424749 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6fd79699b8-9pm6z" event={"ID":"f6186428-be06-481b-a94c-090002b4dd47","Type":"ContainerStarted","Data":"172eb76deacb48409b9e7f3a24b9a3c0f429df5990bf68541004b6ea08b3eac8"} Sep 17 07:10:00.424883 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:10:00.424833 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-6fd79699b8-9pm6z" Sep 17 07:10:00.426677 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:10:00.426654 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-5d85778b9d-tj6dc" Sep 17 07:10:00.453688 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:10:00.453640 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=4.189608504 podStartE2EDuration="8.453623377s" totalImagesPullingTime="4.248452609s" totalInitContainerRuntime="15.562264ms" isStatefulPod=false podCreationTimestamp="2026-09-17 07:09:52 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 07:10:00.451508254 +0000 UTC m=+107.999654976" watchObservedRunningTime="2026-09-17 07:10:00.453623377 +0000 UTC m=+108.001770087" Sep 17 07:10:00.479115 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:10:00.479063 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-6fd79699b8-9pm6z" podStartSLOduration=1.8416578019999998 podStartE2EDuration="6.479043137s" totalImagesPullingTime="4.637385335s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 07:09:54 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 07:10:00.477463632 +0000 UTC m=+108.025610341" watchObservedRunningTime="2026-09-17 07:10:00.479043137 +0000 UTC m=+108.027189847" Sep 17 07:10:00.499290 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:10:00.499243 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-8db5f8b5c-xt759" podStartSLOduration=2.008522227 podStartE2EDuration="5.499228767s" totalImagesPullingTime="3.49070654s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 07:09:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 07:10:00.498639571 +0000 UTC m=+108.046786291" watchObservedRunningTime="2026-09-17 07:10:00.499228767 +0000 UTC m=+108.047375475" Sep 17 07:10:00.520362 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:10:00.520315 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-5d85778b9d-tj6dc" podStartSLOduration=2.761144061 podStartE2EDuration="5.520297865s" totalImagesPullingTime="2.759153804s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 07:09:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 07:10:00.520101356 +0000 UTC m=+108.068248065" watchObservedRunningTime="2026-09-17 07:10:00.520297865 +0000 UTC m=+108.068444575" Sep 17 07:10:03.299214 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:10:03.299186 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-f476b5c9b-7khtp" Sep 17 07:10:03.368726 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:10:03.368694 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-8zt9c" Sep 17 07:10:06.434876 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:10:06.434849 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-6fd79699b8-9pm6z" Sep 17 07:10:15.739980 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:10:15.739946 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-8db5f8b5c-xt759" Sep 17 07:10:15.740421 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:10:15.740024 2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-8db5f8b5c-xt759" Sep 17 07:10:22.600286 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:10:22.600246 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cb76f3bc-38be-404f-b207-231482554bfe-metrics-certs\") pod \"network-metrics-daemon-25zvh\" (UID: \"cb76f3bc-38be-404f-b207-231482554bfe\") " pod="openshift-multus/network-metrics-daemon-25zvh" Sep 17 07:10:22.602480 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:10:22.602460 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cb76f3bc-38be-404f-b207-231482554bfe-metrics-certs\") pod \"network-metrics-daemon-25zvh\" (UID: \"cb76f3bc-38be-404f-b207-231482554bfe\") " pod="openshift-multus/network-metrics-daemon-25zvh" Sep 17 07:10:22.607576 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:10:22.607559 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-g2nsv\"" Sep 17 07:10:22.614886 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:10:22.614867 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-25zvh" Sep 17 07:10:22.910294 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:10:22.910187 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-25zvh"] Sep 17 07:10:22.912869 ip-10-0-138-13 kubenswrapper[2559]: W0917 07:10:22.912846 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcb76f3bc_38be_404f_b207_231482554bfe.slice/crio-d35ce8c5e8e670dd8f5751c583a2f217be1c2c0e2e3f20d2a303d2f94bc9c4c0 WatchSource:0}: Error finding container d35ce8c5e8e670dd8f5751c583a2f217be1c2c0e2e3f20d2a303d2f94bc9c4c0: Status 404 returned error can't find the container with id d35ce8c5e8e670dd8f5751c583a2f217be1c2c0e2e3f20d2a303d2f94bc9c4c0 Sep 17 07:10:23.513362 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:10:23.513322 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-25zvh" event={"ID":"cb76f3bc-38be-404f-b207-231482554bfe","Type":"ContainerStarted","Data":"d35ce8c5e8e670dd8f5751c583a2f217be1c2c0e2e3f20d2a303d2f94bc9c4c0"} Sep 17 07:10:24.519188 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:10:24.519153 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-25zvh" event={"ID":"cb76f3bc-38be-404f-b207-231482554bfe","Type":"ContainerStarted","Data":"1a50abe9728b2c73afa63ea660a296a322077ad3680e502a68d1987870cdfe9f"} Sep 17 07:10:24.519615 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:10:24.519211 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-25zvh" event={"ID":"cb76f3bc-38be-404f-b207-231482554bfe","Type":"ContainerStarted","Data":"adf8421ec1de15003d3891b6faae62b180fdcf977f30ffd30371d7c50108bde3"} Sep 17 07:10:24.562263 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:10:24.562211 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-25zvh" podStartSLOduration=130.553162415 podStartE2EDuration="2m11.562196457s" totalImagesPullingTime="1.009034042s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 07:08:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 07:10:24.561462216 +0000 UTC m=+132.109608924" watchObservedRunningTime="2026-09-17 07:10:24.562196457 +0000 UTC m=+132.110343193" Sep 17 07:10:35.745778 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:10:35.745750 2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-8db5f8b5c-xt759" Sep 17 07:10:35.749480 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:10:35.749461 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-8db5f8b5c-xt759" Sep 17 07:10:43.595877 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:10:43.595849 2559 generic.go:356] "Generic (PLEG): container finished" podID="cd659f26-f444-43c8-bc39-fbd8f61b84b0" containerID="22f4a2069deeab9291340ecfbbff127508a3a9570b7dab381aa197056180d093" exitCode=0 Sep 17 07:10:43.596211 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:10:43.595928 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5844b856db-tvlrq" event={"ID":"cd659f26-f444-43c8-bc39-fbd8f61b84b0","Type":"ContainerDied","Data":"22f4a2069deeab9291340ecfbbff127508a3a9570b7dab381aa197056180d093"} Sep 17 07:10:43.596281 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:10:43.596268 2559 scope.go:117] "RemoveContainer" containerID="22f4a2069deeab9291340ecfbbff127508a3a9570b7dab381aa197056180d093" Sep 17 07:10:44.601517 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:10:44.601481 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5844b856db-tvlrq" event={"ID":"cd659f26-f444-43c8-bc39-fbd8f61b84b0","Type":"ContainerStarted","Data":"247b36a028e79773a35c652e53f9e4634531d75ee44bde9ddcf56130177ea1a3"} Sep 17 07:11:11.391134 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:11:11.391049 2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Sep 17 07:11:11.391607 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:11:11.391337 2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="cc61e935-78e3-401a-8504-6ca431e50840" containerName="alertmanager" containerID="cri-o://be082bbfd151e4ee433e09a53a2c4fb9c40f29efd140a4c5e6dc06f164664508" gracePeriod=120 Sep 17 07:11:11.391607 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:11:11.391425 2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="cc61e935-78e3-401a-8504-6ca431e50840" containerName="kube-rbac-proxy-metric" containerID="cri-o://524ce8e06b60ccecac23f55966f5e842f5604a2233cab6188d05d5439b0ed2b4" gracePeriod=120 Sep 17 07:11:11.391607 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:11:11.391482 2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="cc61e935-78e3-401a-8504-6ca431e50840" containerName="config-reloader" containerID="cri-o://f74f412d1d2e9847e5af48c5a1f2d7fbd55c386c1087e6668ac708e8168e31d8" gracePeriod=120 Sep 17 07:11:11.391607 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:11:11.391438 2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="cc61e935-78e3-401a-8504-6ca431e50840" containerName="kube-rbac-proxy-web" containerID="cri-o://ebc8f2b381a1cad1ff907c028f8ec04bbcd860e7e308dc277f5587c53215bd45" gracePeriod=120 Sep 17 07:11:11.391607 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:11:11.391482 2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="cc61e935-78e3-401a-8504-6ca431e50840" containerName="prom-label-proxy" containerID="cri-o://cc02539d449a03441c083854f8f51bdb480498d821d73c842a3a57f662f40005" gracePeriod=120 Sep 17 07:11:11.391607 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:11:11.391498 2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="cc61e935-78e3-401a-8504-6ca431e50840" containerName="kube-rbac-proxy" containerID="cri-o://7fa04235c29615d51ea96d81c481c6137129407ec6f7f6a9345b99f7f2827d26" gracePeriod=120 Sep 17 07:11:11.718730 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:11:11.718649 2559 generic.go:356] "Generic (PLEG): container finished" podID="cc61e935-78e3-401a-8504-6ca431e50840" containerID="cc02539d449a03441c083854f8f51bdb480498d821d73c842a3a57f662f40005" exitCode=0 Sep 17 07:11:11.718730 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:11:11.718674 2559 generic.go:356] "Generic (PLEG): container finished" podID="cc61e935-78e3-401a-8504-6ca431e50840" containerID="7fa04235c29615d51ea96d81c481c6137129407ec6f7f6a9345b99f7f2827d26" exitCode=0 Sep 17 07:11:11.718730 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:11:11.718681 2559 generic.go:356] "Generic (PLEG): container finished" podID="cc61e935-78e3-401a-8504-6ca431e50840" containerID="f74f412d1d2e9847e5af48c5a1f2d7fbd55c386c1087e6668ac708e8168e31d8" exitCode=0 Sep 17 07:11:11.718730 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:11:11.718687 2559 generic.go:356] "Generic (PLEG): container finished" podID="cc61e935-78e3-401a-8504-6ca431e50840" containerID="be082bbfd151e4ee433e09a53a2c4fb9c40f29efd140a4c5e6dc06f164664508" exitCode=0 Sep 17 07:11:11.718730 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:11:11.718708 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"cc61e935-78e3-401a-8504-6ca431e50840","Type":"ContainerDied","Data":"cc02539d449a03441c083854f8f51bdb480498d821d73c842a3a57f662f40005"} Sep 17 07:11:11.719028 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:11:11.718775 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"cc61e935-78e3-401a-8504-6ca431e50840","Type":"ContainerDied","Data":"7fa04235c29615d51ea96d81c481c6137129407ec6f7f6a9345b99f7f2827d26"} Sep 17 07:11:11.719028 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:11:11.718801 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"cc61e935-78e3-401a-8504-6ca431e50840","Type":"ContainerDied","Data":"f74f412d1d2e9847e5af48c5a1f2d7fbd55c386c1087e6668ac708e8168e31d8"} Sep 17 07:11:11.719028 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:11:11.718825 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"cc61e935-78e3-401a-8504-6ca431e50840","Type":"ContainerDied","Data":"be082bbfd151e4ee433e09a53a2c4fb9c40f29efd140a4c5e6dc06f164664508"} Sep 17 07:11:12.639110 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:11:12.639087 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Sep 17 07:11:12.708360 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:11:12.708333 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/cc61e935-78e3-401a-8504-6ca431e50840-config-volume\") pod \"cc61e935-78e3-401a-8504-6ca431e50840\" (UID: \"cc61e935-78e3-401a-8504-6ca431e50840\") " Sep 17 07:11:12.708523 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:11:12.708366 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cc61e935-78e3-401a-8504-6ca431e50840-alertmanager-trusted-ca-bundle\") pod \"cc61e935-78e3-401a-8504-6ca431e50840\" (UID: \"cc61e935-78e3-401a-8504-6ca431e50840\") " Sep 17 07:11:12.708523 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:11:12.708395 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/cc61e935-78e3-401a-8504-6ca431e50840-tls-assets\") pod \"cc61e935-78e3-401a-8504-6ca431e50840\" (UID: \"cc61e935-78e3-401a-8504-6ca431e50840\") " Sep 17 07:11:12.708638 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:11:12.708518 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-q6nw2\" (UniqueName: \"kubernetes.io/projected/cc61e935-78e3-401a-8504-6ca431e50840-kube-api-access-q6nw2\") pod \"cc61e935-78e3-401a-8504-6ca431e50840\" (UID: \"cc61e935-78e3-401a-8504-6ca431e50840\") " Sep 17 07:11:12.708638 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:11:12.708606 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/cc61e935-78e3-401a-8504-6ca431e50840-secret-alertmanager-kube-rbac-proxy-metric\") pod \"cc61e935-78e3-401a-8504-6ca431e50840\" (UID: \"cc61e935-78e3-401a-8504-6ca431e50840\") " Sep 17 07:11:12.708745 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:11:12.708637 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/cc61e935-78e3-401a-8504-6ca431e50840-alertmanager-main-db\") pod \"cc61e935-78e3-401a-8504-6ca431e50840\" (UID: \"cc61e935-78e3-401a-8504-6ca431e50840\") " Sep 17 07:11:12.708745 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:11:12.708670 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/cc61e935-78e3-401a-8504-6ca431e50840-secret-alertmanager-kube-rbac-proxy\") pod \"cc61e935-78e3-401a-8504-6ca431e50840\" (UID: \"cc61e935-78e3-401a-8504-6ca431e50840\") " Sep 17 07:11:12.708745 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:11:12.708706 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/cc61e935-78e3-401a-8504-6ca431e50840-secret-alertmanager-main-tls\") pod \"cc61e935-78e3-401a-8504-6ca431e50840\" (UID: \"cc61e935-78e3-401a-8504-6ca431e50840\") " Sep 17 07:11:12.708890 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:11:12.708762 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/cc61e935-78e3-401a-8504-6ca431e50840-web-config\") pod \"cc61e935-78e3-401a-8504-6ca431e50840\" (UID: \"cc61e935-78e3-401a-8504-6ca431e50840\") " Sep 17 07:11:12.708890 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:11:12.708778 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cc61e935-78e3-401a-8504-6ca431e50840-alertmanager-trusted-ca-bundle" (OuterVolumeSpecName: "alertmanager-trusted-ca-bundle") pod "cc61e935-78e3-401a-8504-6ca431e50840" (UID: "cc61e935-78e3-401a-8504-6ca431e50840"). InnerVolumeSpecName "alertmanager-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 17 07:11:12.708890 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:11:12.708795 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/cc61e935-78e3-401a-8504-6ca431e50840-metrics-client-ca\") pod \"cc61e935-78e3-401a-8504-6ca431e50840\" (UID: \"cc61e935-78e3-401a-8504-6ca431e50840\") " Sep 17 07:11:12.708890 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:11:12.708836 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/cc61e935-78e3-401a-8504-6ca431e50840-config-out\") pod \"cc61e935-78e3-401a-8504-6ca431e50840\" (UID: \"cc61e935-78e3-401a-8504-6ca431e50840\") " Sep 17 07:11:12.708890 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:11:12.708867 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/cc61e935-78e3-401a-8504-6ca431e50840-secret-alertmanager-kube-rbac-proxy-web\") pod \"cc61e935-78e3-401a-8504-6ca431e50840\" (UID: \"cc61e935-78e3-401a-8504-6ca431e50840\") " Sep 17 07:11:12.709139 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:11:12.708899 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/cc61e935-78e3-401a-8504-6ca431e50840-cluster-tls-config\") pod \"cc61e935-78e3-401a-8504-6ca431e50840\" (UID: \"cc61e935-78e3-401a-8504-6ca431e50840\") " Sep 17 07:11:12.709201 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:11:12.709176 2559 reconciler_common.go:299] "Volume detached for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cc61e935-78e3-401a-8504-6ca431e50840-alertmanager-trusted-ca-bundle\") on node \"ip-10-0-138-13.ec2.internal\" DevicePath \"\"" Sep 17 07:11:12.709380 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:11:12.709350 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cc61e935-78e3-401a-8504-6ca431e50840-alertmanager-main-db" (OuterVolumeSpecName: "alertmanager-main-db") pod "cc61e935-78e3-401a-8504-6ca431e50840" (UID: "cc61e935-78e3-401a-8504-6ca431e50840"). InnerVolumeSpecName "alertmanager-main-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 17 07:11:12.709473 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:11:12.709453 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cc61e935-78e3-401a-8504-6ca431e50840-metrics-client-ca" (OuterVolumeSpecName: "metrics-client-ca") pod "cc61e935-78e3-401a-8504-6ca431e50840" (UID: "cc61e935-78e3-401a-8504-6ca431e50840"). InnerVolumeSpecName "metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 17 07:11:12.711323 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:11:12.711250 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cc61e935-78e3-401a-8504-6ca431e50840-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "cc61e935-78e3-401a-8504-6ca431e50840" (UID: "cc61e935-78e3-401a-8504-6ca431e50840"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 17 07:11:12.711902 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:11:12.711872 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cc61e935-78e3-401a-8504-6ca431e50840-secret-alertmanager-kube-rbac-proxy-metric" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-metric") pod "cc61e935-78e3-401a-8504-6ca431e50840" (UID: "cc61e935-78e3-401a-8504-6ca431e50840"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-metric". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 17 07:11:12.712284 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:11:12.712246 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cc61e935-78e3-401a-8504-6ca431e50840-config-volume" (OuterVolumeSpecName: "config-volume") pod "cc61e935-78e3-401a-8504-6ca431e50840" (UID: "cc61e935-78e3-401a-8504-6ca431e50840"). InnerVolumeSpecName "config-volume". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 17 07:11:12.712938 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:11:12.712910 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cc61e935-78e3-401a-8504-6ca431e50840-kube-api-access-q6nw2" (OuterVolumeSpecName: "kube-api-access-q6nw2") pod "cc61e935-78e3-401a-8504-6ca431e50840" (UID: "cc61e935-78e3-401a-8504-6ca431e50840"). InnerVolumeSpecName "kube-api-access-q6nw2". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 17 07:11:12.713065 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:11:12.713006 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cc61e935-78e3-401a-8504-6ca431e50840-secret-alertmanager-main-tls" (OuterVolumeSpecName: "secret-alertmanager-main-tls") pod "cc61e935-78e3-401a-8504-6ca431e50840" (UID: "cc61e935-78e3-401a-8504-6ca431e50840"). InnerVolumeSpecName "secret-alertmanager-main-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 17 07:11:12.713130 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:11:12.713089 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cc61e935-78e3-401a-8504-6ca431e50840-secret-alertmanager-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-web") pod "cc61e935-78e3-401a-8504-6ca431e50840" (UID: "cc61e935-78e3-401a-8504-6ca431e50840"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 17 07:11:12.713290 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:11:12.713258 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cc61e935-78e3-401a-8504-6ca431e50840-secret-alertmanager-kube-rbac-proxy" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy") pod "cc61e935-78e3-401a-8504-6ca431e50840" (UID: "cc61e935-78e3-401a-8504-6ca431e50840"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 17 07:11:12.713480 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:11:12.713455 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cc61e935-78e3-401a-8504-6ca431e50840-config-out" (OuterVolumeSpecName: "config-out") pod "cc61e935-78e3-401a-8504-6ca431e50840" (UID: "cc61e935-78e3-401a-8504-6ca431e50840"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 17 07:11:12.717112 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:11:12.717083 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cc61e935-78e3-401a-8504-6ca431e50840-cluster-tls-config" (OuterVolumeSpecName: "cluster-tls-config") pod "cc61e935-78e3-401a-8504-6ca431e50840" (UID: "cc61e935-78e3-401a-8504-6ca431e50840"). InnerVolumeSpecName "cluster-tls-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 17 07:11:12.723527 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:11:12.723499 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cc61e935-78e3-401a-8504-6ca431e50840-web-config" (OuterVolumeSpecName: "web-config") pod "cc61e935-78e3-401a-8504-6ca431e50840" (UID: "cc61e935-78e3-401a-8504-6ca431e50840"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 17 07:11:12.730018 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:11:12.729993 2559 generic.go:356] "Generic (PLEG): container finished" podID="cc61e935-78e3-401a-8504-6ca431e50840" containerID="524ce8e06b60ccecac23f55966f5e842f5604a2233cab6188d05d5439b0ed2b4" exitCode=0 Sep 17 07:11:12.730018 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:11:12.730018 2559 generic.go:356] "Generic (PLEG): container finished" podID="cc61e935-78e3-401a-8504-6ca431e50840" containerID="ebc8f2b381a1cad1ff907c028f8ec04bbcd860e7e308dc277f5587c53215bd45" exitCode=0 Sep 17 07:11:12.730164 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:11:12.730068 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"cc61e935-78e3-401a-8504-6ca431e50840","Type":"ContainerDied","Data":"524ce8e06b60ccecac23f55966f5e842f5604a2233cab6188d05d5439b0ed2b4"} Sep 17 07:11:12.730164 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:11:12.730142 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"cc61e935-78e3-401a-8504-6ca431e50840","Type":"ContainerDied","Data":"ebc8f2b381a1cad1ff907c028f8ec04bbcd860e7e308dc277f5587c53215bd45"} Sep 17 07:11:12.730164 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:11:12.730082 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Sep 17 07:11:12.730258 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:11:12.730176 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"cc61e935-78e3-401a-8504-6ca431e50840","Type":"ContainerDied","Data":"ca54f21d8e0db92ceb0f8fc17d47855533f000ae24c876637089f73f6601c247"} Sep 17 07:11:12.730258 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:11:12.730207 2559 scope.go:117] "RemoveContainer" containerID="cc02539d449a03441c083854f8f51bdb480498d821d73c842a3a57f662f40005" Sep 17 07:11:12.738017 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:11:12.737998 2559 scope.go:117] "RemoveContainer" containerID="524ce8e06b60ccecac23f55966f5e842f5604a2233cab6188d05d5439b0ed2b4" Sep 17 07:11:12.744952 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:11:12.744937 2559 scope.go:117] "RemoveContainer" containerID="7fa04235c29615d51ea96d81c481c6137129407ec6f7f6a9345b99f7f2827d26" Sep 17 07:11:12.751470 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:11:12.751456 2559 scope.go:117] "RemoveContainer" containerID="ebc8f2b381a1cad1ff907c028f8ec04bbcd860e7e308dc277f5587c53215bd45" Sep 17 07:11:12.755168 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:11:12.755149 2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Sep 17 07:11:12.758424 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:11:12.758400 2559 scope.go:117] "RemoveContainer" containerID="f74f412d1d2e9847e5af48c5a1f2d7fbd55c386c1087e6668ac708e8168e31d8" Sep 17 07:11:12.760758 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:11:12.760741 2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Sep 17 07:11:12.765844 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:11:12.765827 2559 scope.go:117] "RemoveContainer" containerID="be082bbfd151e4ee433e09a53a2c4fb9c40f29efd140a4c5e6dc06f164664508" Sep 17 07:11:12.772550 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:11:12.772533 2559 scope.go:117] "RemoveContainer" containerID="ae2e52edc3a2af88a3296b9d68f75cdafaa1dabfad19f7d6ebef67fd0913f516" Sep 17 07:11:12.779254 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:11:12.779238 2559 scope.go:117] "RemoveContainer" containerID="cc02539d449a03441c083854f8f51bdb480498d821d73c842a3a57f662f40005" Sep 17 07:11:12.779504 ip-10-0-138-13 kubenswrapper[2559]: E0917 07:11:12.779485 2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cc02539d449a03441c083854f8f51bdb480498d821d73c842a3a57f662f40005\": container with ID starting with cc02539d449a03441c083854f8f51bdb480498d821d73c842a3a57f662f40005 not found: ID does not exist" containerID="cc02539d449a03441c083854f8f51bdb480498d821d73c842a3a57f662f40005" Sep 17 07:11:12.779560 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:11:12.779513 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cc02539d449a03441c083854f8f51bdb480498d821d73c842a3a57f662f40005"} err="failed to get container status \"cc02539d449a03441c083854f8f51bdb480498d821d73c842a3a57f662f40005\": rpc error: code = NotFound desc = could not find container \"cc02539d449a03441c083854f8f51bdb480498d821d73c842a3a57f662f40005\": container with ID starting with cc02539d449a03441c083854f8f51bdb480498d821d73c842a3a57f662f40005 not found: ID does not exist" Sep 17 07:11:12.779560 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:11:12.779541 2559 scope.go:117] "RemoveContainer" containerID="524ce8e06b60ccecac23f55966f5e842f5604a2233cab6188d05d5439b0ed2b4" Sep 17 07:11:12.779770 ip-10-0-138-13 kubenswrapper[2559]: E0917 07:11:12.779754 2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"524ce8e06b60ccecac23f55966f5e842f5604a2233cab6188d05d5439b0ed2b4\": container with ID starting with 524ce8e06b60ccecac23f55966f5e842f5604a2233cab6188d05d5439b0ed2b4 not found: ID does not exist" containerID="524ce8e06b60ccecac23f55966f5e842f5604a2233cab6188d05d5439b0ed2b4" Sep 17 07:11:12.779807 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:11:12.779774 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"524ce8e06b60ccecac23f55966f5e842f5604a2233cab6188d05d5439b0ed2b4"} err="failed to get container status \"524ce8e06b60ccecac23f55966f5e842f5604a2233cab6188d05d5439b0ed2b4\": rpc error: code = NotFound desc = could not find container \"524ce8e06b60ccecac23f55966f5e842f5604a2233cab6188d05d5439b0ed2b4\": container with ID starting with 524ce8e06b60ccecac23f55966f5e842f5604a2233cab6188d05d5439b0ed2b4 not found: ID does not exist" Sep 17 07:11:12.779807 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:11:12.779786 2559 scope.go:117] "RemoveContainer" containerID="7fa04235c29615d51ea96d81c481c6137129407ec6f7f6a9345b99f7f2827d26" Sep 17 07:11:12.780040 ip-10-0-138-13 kubenswrapper[2559]: E0917 07:11:12.780021 2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7fa04235c29615d51ea96d81c481c6137129407ec6f7f6a9345b99f7f2827d26\": container with ID starting with 7fa04235c29615d51ea96d81c481c6137129407ec6f7f6a9345b99f7f2827d26 not found: ID does not exist" containerID="7fa04235c29615d51ea96d81c481c6137129407ec6f7f6a9345b99f7f2827d26" Sep 17 07:11:12.780098 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:11:12.780045 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7fa04235c29615d51ea96d81c481c6137129407ec6f7f6a9345b99f7f2827d26"} err="failed to get container status \"7fa04235c29615d51ea96d81c481c6137129407ec6f7f6a9345b99f7f2827d26\": rpc error: code = NotFound desc = could not find container \"7fa04235c29615d51ea96d81c481c6137129407ec6f7f6a9345b99f7f2827d26\": container with ID starting with 7fa04235c29615d51ea96d81c481c6137129407ec6f7f6a9345b99f7f2827d26 not found: ID does not exist" Sep 17 07:11:12.780098 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:11:12.780058 2559 scope.go:117] "RemoveContainer" containerID="ebc8f2b381a1cad1ff907c028f8ec04bbcd860e7e308dc277f5587c53215bd45" Sep 17 07:11:12.780284 ip-10-0-138-13 kubenswrapper[2559]: E0917 07:11:12.780270 2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ebc8f2b381a1cad1ff907c028f8ec04bbcd860e7e308dc277f5587c53215bd45\": container with ID starting with ebc8f2b381a1cad1ff907c028f8ec04bbcd860e7e308dc277f5587c53215bd45 not found: ID does not exist" containerID="ebc8f2b381a1cad1ff907c028f8ec04bbcd860e7e308dc277f5587c53215bd45" Sep 17 07:11:12.780322 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:11:12.780285 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ebc8f2b381a1cad1ff907c028f8ec04bbcd860e7e308dc277f5587c53215bd45"} err="failed to get container status \"ebc8f2b381a1cad1ff907c028f8ec04bbcd860e7e308dc277f5587c53215bd45\": rpc error: code = NotFound desc = could not find container \"ebc8f2b381a1cad1ff907c028f8ec04bbcd860e7e308dc277f5587c53215bd45\": container with ID starting with ebc8f2b381a1cad1ff907c028f8ec04bbcd860e7e308dc277f5587c53215bd45 not found: ID does not exist" Sep 17 07:11:12.780322 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:11:12.780297 2559 scope.go:117] "RemoveContainer" containerID="f74f412d1d2e9847e5af48c5a1f2d7fbd55c386c1087e6668ac708e8168e31d8" Sep 17 07:11:12.780638 ip-10-0-138-13 kubenswrapper[2559]: E0917 07:11:12.780529 2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f74f412d1d2e9847e5af48c5a1f2d7fbd55c386c1087e6668ac708e8168e31d8\": container with ID starting with f74f412d1d2e9847e5af48c5a1f2d7fbd55c386c1087e6668ac708e8168e31d8 not found: ID does not exist" containerID="f74f412d1d2e9847e5af48c5a1f2d7fbd55c386c1087e6668ac708e8168e31d8" Sep 17 07:11:12.780638 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:11:12.780555 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f74f412d1d2e9847e5af48c5a1f2d7fbd55c386c1087e6668ac708e8168e31d8"} err="failed to get container status \"f74f412d1d2e9847e5af48c5a1f2d7fbd55c386c1087e6668ac708e8168e31d8\": rpc error: code = NotFound desc = could not find container \"f74f412d1d2e9847e5af48c5a1f2d7fbd55c386c1087e6668ac708e8168e31d8\": container with ID starting with f74f412d1d2e9847e5af48c5a1f2d7fbd55c386c1087e6668ac708e8168e31d8 not found: ID does not exist" Sep 17 07:11:12.780638 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:11:12.780575 2559 scope.go:117] "RemoveContainer" containerID="be082bbfd151e4ee433e09a53a2c4fb9c40f29efd140a4c5e6dc06f164664508" Sep 17 07:11:12.780872 ip-10-0-138-13 kubenswrapper[2559]: E0917 07:11:12.780852 2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"be082bbfd151e4ee433e09a53a2c4fb9c40f29efd140a4c5e6dc06f164664508\": container with ID starting with be082bbfd151e4ee433e09a53a2c4fb9c40f29efd140a4c5e6dc06f164664508 not found: ID does not exist" containerID="be082bbfd151e4ee433e09a53a2c4fb9c40f29efd140a4c5e6dc06f164664508" Sep 17 07:11:12.780936 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:11:12.780878 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"be082bbfd151e4ee433e09a53a2c4fb9c40f29efd140a4c5e6dc06f164664508"} err="failed to get container status \"be082bbfd151e4ee433e09a53a2c4fb9c40f29efd140a4c5e6dc06f164664508\": rpc error: code = NotFound desc = could not find container \"be082bbfd151e4ee433e09a53a2c4fb9c40f29efd140a4c5e6dc06f164664508\": container with ID starting with be082bbfd151e4ee433e09a53a2c4fb9c40f29efd140a4c5e6dc06f164664508 not found: ID does not exist" Sep 17 07:11:12.780936 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:11:12.780898 2559 scope.go:117] "RemoveContainer" containerID="ae2e52edc3a2af88a3296b9d68f75cdafaa1dabfad19f7d6ebef67fd0913f516" Sep 17 07:11:12.781208 ip-10-0-138-13 kubenswrapper[2559]: E0917 07:11:12.781183 2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ae2e52edc3a2af88a3296b9d68f75cdafaa1dabfad19f7d6ebef67fd0913f516\": container with ID starting with ae2e52edc3a2af88a3296b9d68f75cdafaa1dabfad19f7d6ebef67fd0913f516 not found: ID does not exist" containerID="ae2e52edc3a2af88a3296b9d68f75cdafaa1dabfad19f7d6ebef67fd0913f516" Sep 17 07:11:12.781276 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:11:12.781212 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ae2e52edc3a2af88a3296b9d68f75cdafaa1dabfad19f7d6ebef67fd0913f516"} err="failed to get container status \"ae2e52edc3a2af88a3296b9d68f75cdafaa1dabfad19f7d6ebef67fd0913f516\": rpc error: code = NotFound desc = could not find container \"ae2e52edc3a2af88a3296b9d68f75cdafaa1dabfad19f7d6ebef67fd0913f516\": container with ID starting with ae2e52edc3a2af88a3296b9d68f75cdafaa1dabfad19f7d6ebef67fd0913f516 not found: ID does not exist" Sep 17 07:11:12.781276 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:11:12.781227 2559 scope.go:117] "RemoveContainer" containerID="cc02539d449a03441c083854f8f51bdb480498d821d73c842a3a57f662f40005" Sep 17 07:11:12.781443 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:11:12.781426 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cc02539d449a03441c083854f8f51bdb480498d821d73c842a3a57f662f40005"} err="failed to get container status \"cc02539d449a03441c083854f8f51bdb480498d821d73c842a3a57f662f40005\": rpc error: code = NotFound desc = could not find container \"cc02539d449a03441c083854f8f51bdb480498d821d73c842a3a57f662f40005\": container with ID starting with cc02539d449a03441c083854f8f51bdb480498d821d73c842a3a57f662f40005 not found: ID does not exist" Sep 17 07:11:12.781485 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:11:12.781442 2559 scope.go:117] "RemoveContainer" containerID="524ce8e06b60ccecac23f55966f5e842f5604a2233cab6188d05d5439b0ed2b4" Sep 17 07:11:12.781672 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:11:12.781652 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"524ce8e06b60ccecac23f55966f5e842f5604a2233cab6188d05d5439b0ed2b4"} err="failed to get container status \"524ce8e06b60ccecac23f55966f5e842f5604a2233cab6188d05d5439b0ed2b4\": rpc error: code = NotFound desc = could not find container \"524ce8e06b60ccecac23f55966f5e842f5604a2233cab6188d05d5439b0ed2b4\": container with ID starting with 524ce8e06b60ccecac23f55966f5e842f5604a2233cab6188d05d5439b0ed2b4 not found: ID does not exist" Sep 17 07:11:12.781711 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:11:12.781673 2559 scope.go:117] "RemoveContainer" containerID="7fa04235c29615d51ea96d81c481c6137129407ec6f7f6a9345b99f7f2827d26" Sep 17 07:11:12.781902 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:11:12.781882 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7fa04235c29615d51ea96d81c481c6137129407ec6f7f6a9345b99f7f2827d26"} err="failed to get container status \"7fa04235c29615d51ea96d81c481c6137129407ec6f7f6a9345b99f7f2827d26\": rpc error: code = NotFound desc = could not find container \"7fa04235c29615d51ea96d81c481c6137129407ec6f7f6a9345b99f7f2827d26\": container with ID starting with 7fa04235c29615d51ea96d81c481c6137129407ec6f7f6a9345b99f7f2827d26 not found: ID does not exist" Sep 17 07:11:12.781943 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:11:12.781902 2559 scope.go:117] "RemoveContainer" containerID="ebc8f2b381a1cad1ff907c028f8ec04bbcd860e7e308dc277f5587c53215bd45" Sep 17 07:11:12.782140 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:11:12.782119 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ebc8f2b381a1cad1ff907c028f8ec04bbcd860e7e308dc277f5587c53215bd45"} err="failed to get container status \"ebc8f2b381a1cad1ff907c028f8ec04bbcd860e7e308dc277f5587c53215bd45\": rpc error: code = NotFound desc = could not find container \"ebc8f2b381a1cad1ff907c028f8ec04bbcd860e7e308dc277f5587c53215bd45\": container with ID starting with ebc8f2b381a1cad1ff907c028f8ec04bbcd860e7e308dc277f5587c53215bd45 not found: ID does not exist" Sep 17 07:11:12.782193 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:11:12.782141 2559 scope.go:117] "RemoveContainer" containerID="f74f412d1d2e9847e5af48c5a1f2d7fbd55c386c1087e6668ac708e8168e31d8" Sep 17 07:11:12.782371 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:11:12.782354 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f74f412d1d2e9847e5af48c5a1f2d7fbd55c386c1087e6668ac708e8168e31d8"} err="failed to get container status \"f74f412d1d2e9847e5af48c5a1f2d7fbd55c386c1087e6668ac708e8168e31d8\": rpc error: code = NotFound desc = could not find container \"f74f412d1d2e9847e5af48c5a1f2d7fbd55c386c1087e6668ac708e8168e31d8\": container with ID starting with f74f412d1d2e9847e5af48c5a1f2d7fbd55c386c1087e6668ac708e8168e31d8 not found: ID does not exist" Sep 17 07:11:12.782413 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:11:12.782372 2559 scope.go:117] "RemoveContainer" containerID="be082bbfd151e4ee433e09a53a2c4fb9c40f29efd140a4c5e6dc06f164664508" Sep 17 07:11:12.782582 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:11:12.782564 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"be082bbfd151e4ee433e09a53a2c4fb9c40f29efd140a4c5e6dc06f164664508"} err="failed to get container status \"be082bbfd151e4ee433e09a53a2c4fb9c40f29efd140a4c5e6dc06f164664508\": rpc error: code = NotFound desc = could not find container \"be082bbfd151e4ee433e09a53a2c4fb9c40f29efd140a4c5e6dc06f164664508\": container with ID starting with be082bbfd151e4ee433e09a53a2c4fb9c40f29efd140a4c5e6dc06f164664508 not found: ID does not exist" Sep 17 07:11:12.782623 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:11:12.782583 2559 scope.go:117] "RemoveContainer" containerID="ae2e52edc3a2af88a3296b9d68f75cdafaa1dabfad19f7d6ebef67fd0913f516" Sep 17 07:11:12.782794 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:11:12.782778 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ae2e52edc3a2af88a3296b9d68f75cdafaa1dabfad19f7d6ebef67fd0913f516"} err="failed to get container status \"ae2e52edc3a2af88a3296b9d68f75cdafaa1dabfad19f7d6ebef67fd0913f516\": rpc error: code = NotFound desc = could not find container \"ae2e52edc3a2af88a3296b9d68f75cdafaa1dabfad19f7d6ebef67fd0913f516\": container with ID starting with ae2e52edc3a2af88a3296b9d68f75cdafaa1dabfad19f7d6ebef67fd0913f516 not found: ID does not exist" Sep 17 07:11:12.792208 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:11:12.792184 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Sep 17 07:11:12.792511 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:11:12.792496 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cc61e935-78e3-401a-8504-6ca431e50840" containerName="alertmanager" Sep 17 07:11:12.792582 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:11:12.792514 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="cc61e935-78e3-401a-8504-6ca431e50840" containerName="alertmanager" Sep 17 07:11:12.792582 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:11:12.792537 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cc61e935-78e3-401a-8504-6ca431e50840" containerName="kube-rbac-proxy-web" Sep 17 07:11:12.792582 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:11:12.792546 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="cc61e935-78e3-401a-8504-6ca431e50840" containerName="kube-rbac-proxy-web" Sep 17 07:11:12.792582 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:11:12.792566 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cc61e935-78e3-401a-8504-6ca431e50840" containerName="config-reloader" Sep 17 07:11:12.792582 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:11:12.792575 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="cc61e935-78e3-401a-8504-6ca431e50840" containerName="config-reloader" Sep 17 07:11:12.792817 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:11:12.792586 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cc61e935-78e3-401a-8504-6ca431e50840" containerName="prom-label-proxy" Sep 17 07:11:12.792817 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:11:12.792594 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="cc61e935-78e3-401a-8504-6ca431e50840" containerName="prom-label-proxy" Sep 17 07:11:12.792817 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:11:12.792611 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cc61e935-78e3-401a-8504-6ca431e50840" containerName="kube-rbac-proxy-metric" Sep 17 07:11:12.792817 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:11:12.792619 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="cc61e935-78e3-401a-8504-6ca431e50840" containerName="kube-rbac-proxy-metric" Sep 17 07:11:12.792817 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:11:12.792630 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cc61e935-78e3-401a-8504-6ca431e50840" containerName="init-config-reloader" Sep 17 07:11:12.792817 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:11:12.792638 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="cc61e935-78e3-401a-8504-6ca431e50840" containerName="init-config-reloader" Sep 17 07:11:12.792817 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:11:12.792651 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cc61e935-78e3-401a-8504-6ca431e50840" containerName="kube-rbac-proxy" Sep 17 07:11:12.792817 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:11:12.792660 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="cc61e935-78e3-401a-8504-6ca431e50840" containerName="kube-rbac-proxy" Sep 17 07:11:12.792817 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:11:12.792766 2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="cc61e935-78e3-401a-8504-6ca431e50840" containerName="config-reloader" Sep 17 07:11:12.792817 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:11:12.792776 2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="cc61e935-78e3-401a-8504-6ca431e50840" containerName="kube-rbac-proxy-web" Sep 17 07:11:12.792817 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:11:12.792787 2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="cc61e935-78e3-401a-8504-6ca431e50840" containerName="kube-rbac-proxy" Sep 17 07:11:12.792817 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:11:12.792796 2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="cc61e935-78e3-401a-8504-6ca431e50840" containerName="kube-rbac-proxy-metric" Sep 17 07:11:12.792817 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:11:12.792807 2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="cc61e935-78e3-401a-8504-6ca431e50840" containerName="prom-label-proxy" Sep 17 07:11:12.792817 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:11:12.792816 2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="cc61e935-78e3-401a-8504-6ca431e50840" containerName="alertmanager" Sep 17 07:11:12.796483 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:11:12.796465 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Sep 17 07:11:12.798947 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:11:12.798930 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-wqtcq\"" Sep 17 07:11:12.800147 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:11:12.800130 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Sep 17 07:11:12.800407 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:11:12.800381 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Sep 17 07:11:12.800407 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:11:12.800395 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Sep 17 07:11:12.800580 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:11:12.800428 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Sep 17 07:11:12.800580 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:11:12.800479 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Sep 17 07:11:12.800580 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:11:12.800433 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Sep 17 07:11:12.800580 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:11:12.800534 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Sep 17 07:11:12.800778 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:11:12.800673 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Sep 17 07:11:12.810118 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:11:12.810096 2559 reconciler_common.go:299] "Volume detached for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/cc61e935-78e3-401a-8504-6ca431e50840-config-volume\") on node \"ip-10-0-138-13.ec2.internal\" DevicePath \"\"" Sep 17 07:11:12.810199 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:11:12.810123 2559 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/cc61e935-78e3-401a-8504-6ca431e50840-tls-assets\") on node \"ip-10-0-138-13.ec2.internal\" DevicePath \"\"" Sep 17 07:11:12.810199 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:11:12.810139 2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-q6nw2\" (UniqueName: \"kubernetes.io/projected/cc61e935-78e3-401a-8504-6ca431e50840-kube-api-access-q6nw2\") on node \"ip-10-0-138-13.ec2.internal\" DevicePath \"\"" Sep 17 07:11:12.810199 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:11:12.810156 2559 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/cc61e935-78e3-401a-8504-6ca431e50840-secret-alertmanager-kube-rbac-proxy-metric\") on node \"ip-10-0-138-13.ec2.internal\" DevicePath \"\"" Sep 17 07:11:12.810199 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:11:12.810173 2559 reconciler_common.go:299] "Volume detached for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/cc61e935-78e3-401a-8504-6ca431e50840-alertmanager-main-db\") on node \"ip-10-0-138-13.ec2.internal\" DevicePath \"\"" Sep 17 07:11:12.810199 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:11:12.810188 2559 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/cc61e935-78e3-401a-8504-6ca431e50840-secret-alertmanager-kube-rbac-proxy\") on node \"ip-10-0-138-13.ec2.internal\" DevicePath \"\"" Sep 17 07:11:12.810382 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:11:12.810202 2559 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/cc61e935-78e3-401a-8504-6ca431e50840-secret-alertmanager-main-tls\") on node \"ip-10-0-138-13.ec2.internal\" DevicePath \"\"" Sep 17 07:11:12.810382 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:11:12.810217 2559 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/cc61e935-78e3-401a-8504-6ca431e50840-web-config\") on node \"ip-10-0-138-13.ec2.internal\" DevicePath \"\"" Sep 17 07:11:12.810382 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:11:12.810230 2559 reconciler_common.go:299] "Volume detached for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/cc61e935-78e3-401a-8504-6ca431e50840-metrics-client-ca\") on node \"ip-10-0-138-13.ec2.internal\" DevicePath \"\"" Sep 17 07:11:12.810382 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:11:12.810244 2559 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/cc61e935-78e3-401a-8504-6ca431e50840-config-out\") on node \"ip-10-0-138-13.ec2.internal\" DevicePath \"\"" Sep 17 07:11:12.810382 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:11:12.810257 2559 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/cc61e935-78e3-401a-8504-6ca431e50840-secret-alertmanager-kube-rbac-proxy-web\") on node \"ip-10-0-138-13.ec2.internal\" DevicePath \"\"" Sep 17 07:11:12.810382 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:11:12.810271 2559 reconciler_common.go:299] "Volume detached for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/cc61e935-78e3-401a-8504-6ca431e50840-cluster-tls-config\") on node \"ip-10-0-138-13.ec2.internal\" DevicePath \"\"" Sep 17 07:11:12.810960 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:11:12.810941 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Sep 17 07:11:12.817715 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:11:12.817695 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Sep 17 07:11:12.897354 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:11:12.897327 2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cc61e935-78e3-401a-8504-6ca431e50840" path="/var/lib/kubelet/pods/cc61e935-78e3-401a-8504-6ca431e50840/volumes" Sep 17 07:11:12.910588 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:11:12.910563 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q7mpq\" (UniqueName: \"kubernetes.io/projected/48bde459-06ea-46d4-867a-f367e2a9067e-kube-api-access-q7mpq\") pod \"alertmanager-main-0\" (UID: \"48bde459-06ea-46d4-867a-f367e2a9067e\") " pod="openshift-monitoring/alertmanager-main-0" Sep 17 07:11:12.910718 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:11:12.910616 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/48bde459-06ea-46d4-867a-f367e2a9067e-config-out\") pod \"alertmanager-main-0\" (UID: \"48bde459-06ea-46d4-867a-f367e2a9067e\") " pod="openshift-monitoring/alertmanager-main-0" Sep 17 07:11:12.910718 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:11:12.910642 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/48bde459-06ea-46d4-867a-f367e2a9067e-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"48bde459-06ea-46d4-867a-f367e2a9067e\") " pod="openshift-monitoring/alertmanager-main-0" Sep 17 07:11:12.910718 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:11:12.910701 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/48bde459-06ea-46d4-867a-f367e2a9067e-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"48bde459-06ea-46d4-867a-f367e2a9067e\") " pod="openshift-monitoring/alertmanager-main-0" Sep 17 07:11:12.910846 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:11:12.910738 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/48bde459-06ea-46d4-867a-f367e2a9067e-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"48bde459-06ea-46d4-867a-f367e2a9067e\") " pod="openshift-monitoring/alertmanager-main-0" Sep 17 07:11:12.910846 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:11:12.910780 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/48bde459-06ea-46d4-867a-f367e2a9067e-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"48bde459-06ea-46d4-867a-f367e2a9067e\") " pod="openshift-monitoring/alertmanager-main-0" Sep 17 07:11:12.910846 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:11:12.910800 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/48bde459-06ea-46d4-867a-f367e2a9067e-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"48bde459-06ea-46d4-867a-f367e2a9067e\") " pod="openshift-monitoring/alertmanager-main-0" Sep 17 07:11:12.910846 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:11:12.910822 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/48bde459-06ea-46d4-867a-f367e2a9067e-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"48bde459-06ea-46d4-867a-f367e2a9067e\") " pod="openshift-monitoring/alertmanager-main-0" Sep 17 07:11:12.910846 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:11:12.910842 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/48bde459-06ea-46d4-867a-f367e2a9067e-config-volume\") pod \"alertmanager-main-0\" (UID: \"48bde459-06ea-46d4-867a-f367e2a9067e\") " pod="openshift-monitoring/alertmanager-main-0" Sep 17 07:11:12.911086 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:11:12.910863 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/48bde459-06ea-46d4-867a-f367e2a9067e-tls-assets\") pod \"alertmanager-main-0\" (UID: \"48bde459-06ea-46d4-867a-f367e2a9067e\") " pod="openshift-monitoring/alertmanager-main-0" Sep 17 07:11:12.911086 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:11:12.910889 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/48bde459-06ea-46d4-867a-f367e2a9067e-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"48bde459-06ea-46d4-867a-f367e2a9067e\") " pod="openshift-monitoring/alertmanager-main-0" Sep 17 07:11:12.911086 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:11:12.910904 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/48bde459-06ea-46d4-867a-f367e2a9067e-web-config\") pod \"alertmanager-main-0\" (UID: \"48bde459-06ea-46d4-867a-f367e2a9067e\") " pod="openshift-monitoring/alertmanager-main-0" Sep 17 07:11:12.911086 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:11:12.910927 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/48bde459-06ea-46d4-867a-f367e2a9067e-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"48bde459-06ea-46d4-867a-f367e2a9067e\") " pod="openshift-monitoring/alertmanager-main-0" Sep 17 07:11:13.011818 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:11:13.011795 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/48bde459-06ea-46d4-867a-f367e2a9067e-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"48bde459-06ea-46d4-867a-f367e2a9067e\") " pod="openshift-monitoring/alertmanager-main-0" Sep 17 07:11:13.011930 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:11:13.011844 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q7mpq\" (UniqueName: \"kubernetes.io/projected/48bde459-06ea-46d4-867a-f367e2a9067e-kube-api-access-q7mpq\") pod \"alertmanager-main-0\" (UID: \"48bde459-06ea-46d4-867a-f367e2a9067e\") " pod="openshift-monitoring/alertmanager-main-0" Sep 17 07:11:13.011930 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:11:13.011873 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/48bde459-06ea-46d4-867a-f367e2a9067e-config-out\") pod \"alertmanager-main-0\" (UID: \"48bde459-06ea-46d4-867a-f367e2a9067e\") " pod="openshift-monitoring/alertmanager-main-0" Sep 17 07:11:13.011930 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:11:13.011890 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/48bde459-06ea-46d4-867a-f367e2a9067e-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"48bde459-06ea-46d4-867a-f367e2a9067e\") " pod="openshift-monitoring/alertmanager-main-0" Sep 17 07:11:13.012088 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:11:13.012007 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/48bde459-06ea-46d4-867a-f367e2a9067e-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"48bde459-06ea-46d4-867a-f367e2a9067e\") " pod="openshift-monitoring/alertmanager-main-0" Sep 17 07:11:13.012088 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:11:13.012069 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/48bde459-06ea-46d4-867a-f367e2a9067e-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"48bde459-06ea-46d4-867a-f367e2a9067e\") " pod="openshift-monitoring/alertmanager-main-0" Sep 17 07:11:13.012190 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:11:13.012108 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/48bde459-06ea-46d4-867a-f367e2a9067e-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"48bde459-06ea-46d4-867a-f367e2a9067e\") " pod="openshift-monitoring/alertmanager-main-0" Sep 17 07:11:13.012190 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:11:13.012131 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/48bde459-06ea-46d4-867a-f367e2a9067e-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"48bde459-06ea-46d4-867a-f367e2a9067e\") " pod="openshift-monitoring/alertmanager-main-0" Sep 17 07:11:13.012190 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:11:13.012163 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/48bde459-06ea-46d4-867a-f367e2a9067e-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"48bde459-06ea-46d4-867a-f367e2a9067e\") " pod="openshift-monitoring/alertmanager-main-0" Sep 17 07:11:13.012486 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:11:13.012447 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/48bde459-06ea-46d4-867a-f367e2a9067e-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"48bde459-06ea-46d4-867a-f367e2a9067e\") " pod="openshift-monitoring/alertmanager-main-0" Sep 17 07:11:13.012668 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:11:13.012647 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/48bde459-06ea-46d4-867a-f367e2a9067e-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"48bde459-06ea-46d4-867a-f367e2a9067e\") " pod="openshift-monitoring/alertmanager-main-0" Sep 17 07:11:13.012746 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:11:13.012705 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/48bde459-06ea-46d4-867a-f367e2a9067e-config-volume\") pod \"alertmanager-main-0\" (UID: \"48bde459-06ea-46d4-867a-f367e2a9067e\") " pod="openshift-monitoring/alertmanager-main-0" Sep 17 07:11:13.012746 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:11:13.012735 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/48bde459-06ea-46d4-867a-f367e2a9067e-tls-assets\") pod \"alertmanager-main-0\" (UID: \"48bde459-06ea-46d4-867a-f367e2a9067e\") " pod="openshift-monitoring/alertmanager-main-0" Sep 17 07:11:13.012861 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:11:13.012790 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/48bde459-06ea-46d4-867a-f367e2a9067e-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"48bde459-06ea-46d4-867a-f367e2a9067e\") " pod="openshift-monitoring/alertmanager-main-0" Sep 17 07:11:13.012861 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:11:13.012813 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/48bde459-06ea-46d4-867a-f367e2a9067e-web-config\") pod \"alertmanager-main-0\" (UID: \"48bde459-06ea-46d4-867a-f367e2a9067e\") " pod="openshift-monitoring/alertmanager-main-0" Sep 17 07:11:13.012985 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:11:13.012948 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/48bde459-06ea-46d4-867a-f367e2a9067e-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"48bde459-06ea-46d4-867a-f367e2a9067e\") " pod="openshift-monitoring/alertmanager-main-0" Sep 17 07:11:13.014913 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:11:13.014777 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/48bde459-06ea-46d4-867a-f367e2a9067e-config-out\") pod \"alertmanager-main-0\" (UID: \"48bde459-06ea-46d4-867a-f367e2a9067e\") " pod="openshift-monitoring/alertmanager-main-0" Sep 17 07:11:13.015239 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:11:13.015109 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/48bde459-06ea-46d4-867a-f367e2a9067e-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"48bde459-06ea-46d4-867a-f367e2a9067e\") " pod="openshift-monitoring/alertmanager-main-0" Sep 17 07:11:13.015239 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:11:13.015179 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/48bde459-06ea-46d4-867a-f367e2a9067e-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"48bde459-06ea-46d4-867a-f367e2a9067e\") " pod="openshift-monitoring/alertmanager-main-0" Sep 17 07:11:13.015239 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:11:13.015218 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/48bde459-06ea-46d4-867a-f367e2a9067e-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"48bde459-06ea-46d4-867a-f367e2a9067e\") " pod="openshift-monitoring/alertmanager-main-0" Sep 17 07:11:13.015388 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:11:13.015243 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/48bde459-06ea-46d4-867a-f367e2a9067e-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"48bde459-06ea-46d4-867a-f367e2a9067e\") " pod="openshift-monitoring/alertmanager-main-0" Sep 17 07:11:13.015446 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:11:13.015429 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/48bde459-06ea-46d4-867a-f367e2a9067e-tls-assets\") pod \"alertmanager-main-0\" (UID: \"48bde459-06ea-46d4-867a-f367e2a9067e\") " pod="openshift-monitoring/alertmanager-main-0" Sep 17 07:11:13.015643 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:11:13.015622 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/48bde459-06ea-46d4-867a-f367e2a9067e-web-config\") pod \"alertmanager-main-0\" (UID: \"48bde459-06ea-46d4-867a-f367e2a9067e\") " pod="openshift-monitoring/alertmanager-main-0" Sep 17 07:11:13.015851 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:11:13.015831 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/48bde459-06ea-46d4-867a-f367e2a9067e-config-volume\") pod \"alertmanager-main-0\" (UID: \"48bde459-06ea-46d4-867a-f367e2a9067e\") " pod="openshift-monitoring/alertmanager-main-0" Sep 17 07:11:13.016906 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:11:13.016885 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/48bde459-06ea-46d4-867a-f367e2a9067e-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"48bde459-06ea-46d4-867a-f367e2a9067e\") " pod="openshift-monitoring/alertmanager-main-0" Sep 17 07:11:13.021566 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:11:13.021540 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-q7mpq\" (UniqueName: \"kubernetes.io/projected/48bde459-06ea-46d4-867a-f367e2a9067e-kube-api-access-q7mpq\") pod \"alertmanager-main-0\" (UID: \"48bde459-06ea-46d4-867a-f367e2a9067e\") " pod="openshift-monitoring/alertmanager-main-0" Sep 17 07:11:13.111633 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:11:13.111603 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Sep 17 07:11:13.395108 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:11:13.395079 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Sep 17 07:11:13.396187 ip-10-0-138-13 kubenswrapper[2559]: W0917 07:11:13.396157 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod48bde459_06ea_46d4_867a_f367e2a9067e.slice/crio-8bf373d1fe89af8b26428d80abf2ff5681ad7783a6e6171c5be2ae927d80951f WatchSource:0}: Error finding container 8bf373d1fe89af8b26428d80abf2ff5681ad7783a6e6171c5be2ae927d80951f: Status 404 returned error can't find the container with id 8bf373d1fe89af8b26428d80abf2ff5681ad7783a6e6171c5be2ae927d80951f Sep 17 07:11:13.735195 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:11:13.735108 2559 generic.go:356] "Generic (PLEG): container finished" podID="48bde459-06ea-46d4-867a-f367e2a9067e" containerID="b4a04a3d038943b61a732cc156b935b041a52d81479478c3c7e819bd247a85cd" exitCode=0 Sep 17 07:11:13.735540 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:11:13.735199 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"48bde459-06ea-46d4-867a-f367e2a9067e","Type":"ContainerDied","Data":"b4a04a3d038943b61a732cc156b935b041a52d81479478c3c7e819bd247a85cd"} Sep 17 07:11:13.735540 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:11:13.735284 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"48bde459-06ea-46d4-867a-f367e2a9067e","Type":"ContainerStarted","Data":"8bf373d1fe89af8b26428d80abf2ff5681ad7783a6e6171c5be2ae927d80951f"} Sep 17 07:11:14.743262 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:11:14.743216 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"48bde459-06ea-46d4-867a-f367e2a9067e","Type":"ContainerStarted","Data":"be9c8fb70a4b156b5f4ae764a5ea4cf6bf0240322776d40d46b612d8fe600d5b"} Sep 17 07:11:14.743628 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:11:14.743320 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"48bde459-06ea-46d4-867a-f367e2a9067e","Type":"ContainerStarted","Data":"f5a11e8e47396071fd575fca43d9679df671a134b3246ce00bd85d35f36076df"} Sep 17 07:11:14.743628 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:11:14.743348 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"48bde459-06ea-46d4-867a-f367e2a9067e","Type":"ContainerStarted","Data":"20dcbc5fb920f70861d109874f2652f431edc3bbe986e6194697b41a85237287"} Sep 17 07:11:14.743628 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:11:14.743373 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"48bde459-06ea-46d4-867a-f367e2a9067e","Type":"ContainerStarted","Data":"1e87cc01a0b2e11d9996578660a7165847750833c825e1625ba952dbfdf4f225"} Sep 17 07:11:14.743628 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:11:14.743398 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"48bde459-06ea-46d4-867a-f367e2a9067e","Type":"ContainerStarted","Data":"f4370ccc10e71bf794e56c7c4f27ed72e10aefac17685bba92e29d55f71c8785"} Sep 17 07:11:14.743628 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:11:14.743421 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"48bde459-06ea-46d4-867a-f367e2a9067e","Type":"ContainerStarted","Data":"4b1c2973ecb0e2f0c46df677ca5beba0058c75a875d1454e3b677276d484edba"} Sep 17 07:11:14.775368 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:11:14.775304 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.7596671219999998 podStartE2EDuration="2.775283599s" totalImagesPullingTime="0s" totalInitContainerRuntime="15.616477ms" isStatefulPod=false podCreationTimestamp="2026-09-17 07:11:12 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 07:11:14.773025184 +0000 UTC m=+182.321171895" watchObservedRunningTime="2026-09-17 07:11:14.775283599 +0000 UTC m=+182.323430368" Sep 17 07:11:15.813123 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:11:15.813081 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-6b74b75746-hvr5n"] Sep 17 07:11:15.815794 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:11:15.815771 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-6b74b75746-hvr5n" Sep 17 07:11:15.820295 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:11:15.820256 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\"" Sep 17 07:11:15.820474 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:11:15.820256 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\"" Sep 17 07:11:15.820474 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:11:15.820333 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\"" Sep 17 07:11:15.820591 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:11:15.820478 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\"" Sep 17 07:11:15.820651 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:11:15.820611 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-f7md5\"" Sep 17 07:11:15.820710 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:11:15.820645 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\"" Sep 17 07:11:15.831616 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:11:15.831581 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-6b74b75746-hvr5n"] Sep 17 07:11:15.831810 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:11:15.831666 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\"" Sep 17 07:11:15.944854 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:11:15.944805 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/9c6ee632-6804-4582-8a0b-0ad112f66408-telemeter-client-tls\") pod \"telemeter-client-6b74b75746-hvr5n\" (UID: \"9c6ee632-6804-4582-8a0b-0ad112f66408\") " pod="openshift-monitoring/telemeter-client-6b74b75746-hvr5n" Sep 17 07:11:15.945106 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:11:15.944888 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/9c6ee632-6804-4582-8a0b-0ad112f66408-federate-client-tls\") pod \"telemeter-client-6b74b75746-hvr5n\" (UID: \"9c6ee632-6804-4582-8a0b-0ad112f66408\") " pod="openshift-monitoring/telemeter-client-6b74b75746-hvr5n" Sep 17 07:11:15.945106 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:11:15.944912 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9c6ee632-6804-4582-8a0b-0ad112f66408-serving-certs-ca-bundle\") pod \"telemeter-client-6b74b75746-hvr5n\" (UID: \"9c6ee632-6804-4582-8a0b-0ad112f66408\") " pod="openshift-monitoring/telemeter-client-6b74b75746-hvr5n" Sep 17 07:11:15.945106 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:11:15.944956 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2f5jm\" (UniqueName: \"kubernetes.io/projected/9c6ee632-6804-4582-8a0b-0ad112f66408-kube-api-access-2f5jm\") pod \"telemeter-client-6b74b75746-hvr5n\" (UID: \"9c6ee632-6804-4582-8a0b-0ad112f66408\") " pod="openshift-monitoring/telemeter-client-6b74b75746-hvr5n" Sep 17 07:11:15.945106 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:11:15.945008 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9c6ee632-6804-4582-8a0b-0ad112f66408-telemeter-trusted-ca-bundle\") pod \"telemeter-client-6b74b75746-hvr5n\" (UID: \"9c6ee632-6804-4582-8a0b-0ad112f66408\") " pod="openshift-monitoring/telemeter-client-6b74b75746-hvr5n" Sep 17 07:11:15.945106 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:11:15.945067 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/9c6ee632-6804-4582-8a0b-0ad112f66408-secret-telemeter-client\") pod \"telemeter-client-6b74b75746-hvr5n\" (UID: \"9c6ee632-6804-4582-8a0b-0ad112f66408\") " pod="openshift-monitoring/telemeter-client-6b74b75746-hvr5n" Sep 17 07:11:15.945383 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:11:15.945135 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/9c6ee632-6804-4582-8a0b-0ad112f66408-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-6b74b75746-hvr5n\" (UID: \"9c6ee632-6804-4582-8a0b-0ad112f66408\") " pod="openshift-monitoring/telemeter-client-6b74b75746-hvr5n" Sep 17 07:11:15.945383 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:11:15.945214 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9c6ee632-6804-4582-8a0b-0ad112f66408-metrics-client-ca\") pod \"telemeter-client-6b74b75746-hvr5n\" (UID: \"9c6ee632-6804-4582-8a0b-0ad112f66408\") " pod="openshift-monitoring/telemeter-client-6b74b75746-hvr5n" Sep 17 07:11:16.046267 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:11:16.046225 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/9c6ee632-6804-4582-8a0b-0ad112f66408-secret-telemeter-client\") pod \"telemeter-client-6b74b75746-hvr5n\" (UID: \"9c6ee632-6804-4582-8a0b-0ad112f66408\") " pod="openshift-monitoring/telemeter-client-6b74b75746-hvr5n" Sep 17 07:11:16.046267 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:11:16.046275 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/9c6ee632-6804-4582-8a0b-0ad112f66408-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-6b74b75746-hvr5n\" (UID: \"9c6ee632-6804-4582-8a0b-0ad112f66408\") " pod="openshift-monitoring/telemeter-client-6b74b75746-hvr5n" Sep 17 07:11:16.046581 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:11:16.046310 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9c6ee632-6804-4582-8a0b-0ad112f66408-metrics-client-ca\") pod \"telemeter-client-6b74b75746-hvr5n\" (UID: \"9c6ee632-6804-4582-8a0b-0ad112f66408\") " pod="openshift-monitoring/telemeter-client-6b74b75746-hvr5n" Sep 17 07:11:16.046581 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:11:16.046332 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/9c6ee632-6804-4582-8a0b-0ad112f66408-telemeter-client-tls\") pod \"telemeter-client-6b74b75746-hvr5n\" (UID: \"9c6ee632-6804-4582-8a0b-0ad112f66408\") " pod="openshift-monitoring/telemeter-client-6b74b75746-hvr5n" Sep 17 07:11:16.046581 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:11:16.046363 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/9c6ee632-6804-4582-8a0b-0ad112f66408-federate-client-tls\") pod \"telemeter-client-6b74b75746-hvr5n\" (UID: \"9c6ee632-6804-4582-8a0b-0ad112f66408\") " pod="openshift-monitoring/telemeter-client-6b74b75746-hvr5n" Sep 17 07:11:16.046581 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:11:16.046380 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9c6ee632-6804-4582-8a0b-0ad112f66408-serving-certs-ca-bundle\") pod \"telemeter-client-6b74b75746-hvr5n\" (UID: \"9c6ee632-6804-4582-8a0b-0ad112f66408\") " pod="openshift-monitoring/telemeter-client-6b74b75746-hvr5n" Sep 17 07:11:16.046581 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:11:16.046401 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2f5jm\" (UniqueName: \"kubernetes.io/projected/9c6ee632-6804-4582-8a0b-0ad112f66408-kube-api-access-2f5jm\") pod \"telemeter-client-6b74b75746-hvr5n\" (UID: \"9c6ee632-6804-4582-8a0b-0ad112f66408\") " pod="openshift-monitoring/telemeter-client-6b74b75746-hvr5n" Sep 17 07:11:16.046581 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:11:16.046419 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9c6ee632-6804-4582-8a0b-0ad112f66408-telemeter-trusted-ca-bundle\") pod \"telemeter-client-6b74b75746-hvr5n\" (UID: \"9c6ee632-6804-4582-8a0b-0ad112f66408\") " pod="openshift-monitoring/telemeter-client-6b74b75746-hvr5n" Sep 17 07:11:16.047353 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:11:16.047314 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9c6ee632-6804-4582-8a0b-0ad112f66408-metrics-client-ca\") pod \"telemeter-client-6b74b75746-hvr5n\" (UID: \"9c6ee632-6804-4582-8a0b-0ad112f66408\") " pod="openshift-monitoring/telemeter-client-6b74b75746-hvr5n" Sep 17 07:11:16.047501 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:11:16.047316 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9c6ee632-6804-4582-8a0b-0ad112f66408-serving-certs-ca-bundle\") pod \"telemeter-client-6b74b75746-hvr5n\" (UID: \"9c6ee632-6804-4582-8a0b-0ad112f66408\") " pod="openshift-monitoring/telemeter-client-6b74b75746-hvr5n" Sep 17 07:11:16.047501 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:11:16.047383 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9c6ee632-6804-4582-8a0b-0ad112f66408-telemeter-trusted-ca-bundle\") pod \"telemeter-client-6b74b75746-hvr5n\" (UID: \"9c6ee632-6804-4582-8a0b-0ad112f66408\") " pod="openshift-monitoring/telemeter-client-6b74b75746-hvr5n" Sep 17 07:11:16.049143 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:11:16.049115 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/9c6ee632-6804-4582-8a0b-0ad112f66408-federate-client-tls\") pod \"telemeter-client-6b74b75746-hvr5n\" (UID: \"9c6ee632-6804-4582-8a0b-0ad112f66408\") " pod="openshift-monitoring/telemeter-client-6b74b75746-hvr5n" Sep 17 07:11:16.049308 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:11:16.049157 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/9c6ee632-6804-4582-8a0b-0ad112f66408-telemeter-client-tls\") pod \"telemeter-client-6b74b75746-hvr5n\" (UID: \"9c6ee632-6804-4582-8a0b-0ad112f66408\") " pod="openshift-monitoring/telemeter-client-6b74b75746-hvr5n" Sep 17 07:11:16.049380 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:11:16.049356 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/9c6ee632-6804-4582-8a0b-0ad112f66408-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-6b74b75746-hvr5n\" (UID: \"9c6ee632-6804-4582-8a0b-0ad112f66408\") " pod="openshift-monitoring/telemeter-client-6b74b75746-hvr5n" Sep 17 07:11:16.049453 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:11:16.049431 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/9c6ee632-6804-4582-8a0b-0ad112f66408-secret-telemeter-client\") pod \"telemeter-client-6b74b75746-hvr5n\" (UID: \"9c6ee632-6804-4582-8a0b-0ad112f66408\") " pod="openshift-monitoring/telemeter-client-6b74b75746-hvr5n" Sep 17 07:11:16.066902 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:11:16.066816 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2f5jm\" (UniqueName: \"kubernetes.io/projected/9c6ee632-6804-4582-8a0b-0ad112f66408-kube-api-access-2f5jm\") pod \"telemeter-client-6b74b75746-hvr5n\" (UID: \"9c6ee632-6804-4582-8a0b-0ad112f66408\") " pod="openshift-monitoring/telemeter-client-6b74b75746-hvr5n" Sep 17 07:11:16.127245 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:11:16.127201 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-6b74b75746-hvr5n" Sep 17 07:11:16.414559 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:11:16.414467 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-6b74b75746-hvr5n"] Sep 17 07:11:16.417895 ip-10-0-138-13 kubenswrapper[2559]: W0917 07:11:16.417867 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9c6ee632_6804_4582_8a0b_0ad112f66408.slice/crio-697934ac012d0afe0ced60381ab314432c1d3a8a27ed65878a2edc5d7cf4432f WatchSource:0}: Error finding container 697934ac012d0afe0ced60381ab314432c1d3a8a27ed65878a2edc5d7cf4432f: Status 404 returned error can't find the container with id 697934ac012d0afe0ced60381ab314432c1d3a8a27ed65878a2edc5d7cf4432f Sep 17 07:11:16.753153 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:11:16.753109 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-6b74b75746-hvr5n" event={"ID":"9c6ee632-6804-4582-8a0b-0ad112f66408","Type":"ContainerStarted","Data":"697934ac012d0afe0ced60381ab314432c1d3a8a27ed65878a2edc5d7cf4432f"} Sep 17 07:11:18.764581 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:11:18.764535 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-6b74b75746-hvr5n" event={"ID":"9c6ee632-6804-4582-8a0b-0ad112f66408","Type":"ContainerStarted","Data":"0d0de50132cebff67c5ef421ab667a99202c6624c1f58fdd57d4e6ff346218bf"} Sep 17 07:11:18.765104 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:11:18.764636 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-6b74b75746-hvr5n" event={"ID":"9c6ee632-6804-4582-8a0b-0ad112f66408","Type":"ContainerStarted","Data":"3f7d74880396b339dcb9113ba2e50f3f88a45e1f10d30fdd3fb0968cf3e67f5e"} Sep 17 07:11:18.765104 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:11:18.764661 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-6b74b75746-hvr5n" event={"ID":"9c6ee632-6804-4582-8a0b-0ad112f66408","Type":"ContainerStarted","Data":"20cea5711a3aa41a422327695cc2a210551ea4f053be4d002c391aa73bebd049"} Sep 17 07:11:18.793298 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:11:18.793234 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-6b74b75746-hvr5n" podStartSLOduration=1.879049062 podStartE2EDuration="3.793213924s" totalImagesPullingTime="1.914164862s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 07:11:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 07:11:18.79181935 +0000 UTC m=+186.339966084" watchObservedRunningTime="2026-09-17 07:11:18.793213924 +0000 UTC m=+186.341360633" Sep 17 07:13:12.809539 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:13:12.809508 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-b99wz_5ae9fb13-f8a8-4999-9023-cebdf2a7bd97/ovn-acl-logging/0.log" Sep 17 07:13:12.812239 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:13:12.812219 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-b99wz_5ae9fb13-f8a8-4999-9023-cebdf2a7bd97/ovn-acl-logging/0.log" Sep 17 07:13:12.813149 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:13:12.813123 2559 kubelet.go:1648] "Image garbage collection succeeded" Sep 17 07:15:24.365669 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:15:24.365631 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["test-ns-feast/feast-simple-feast-setup-b9485f697-h9x9b"] Sep 17 07:15:24.369598 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:15:24.369580 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-b9485f697-h9x9b" Sep 17 07:15:24.372155 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:15:24.372131 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-intra-comm\"" Sep 17 07:15:24.372155 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:15:24.372147 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-offline-tls\"" Sep 17 07:15:24.372829 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:15:24.372811 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-online-tls\"" Sep 17 07:15:24.372907 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:15:24.372877 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-registry-tls\"" Sep 17 07:15:24.372907 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:15:24.372890 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast\"/\"kube-root-ca.crt\"" Sep 17 07:15:24.373050 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:15:24.372963 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-ui-tls\"" Sep 17 07:15:24.373050 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:15:24.372959 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-dockercfg-cv8sj\"" Sep 17 07:15:24.373265 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:15:24.373244 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast\"/\"openshift-service-ca.crt\"" Sep 17 07:15:24.382278 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:15:24.382255 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-b9485f697-h9x9b"] Sep 17 07:15:24.468680 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:15:24.468649 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/e1039f4e-f954-4afd-9036-e99dd41e6367-offline-tls\") pod \"feast-simple-feast-setup-b9485f697-h9x9b\" (UID: \"e1039f4e-f954-4afd-9036-e99dd41e6367\") " pod="test-ns-feast/feast-simple-feast-setup-b9485f697-h9x9b" Sep 17 07:15:24.468829 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:15:24.468691 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/e1039f4e-f954-4afd-9036-e99dd41e6367-online-tls\") pod \"feast-simple-feast-setup-b9485f697-h9x9b\" (UID: \"e1039f4e-f954-4afd-9036-e99dd41e6367\") " pod="test-ns-feast/feast-simple-feast-setup-b9485f697-h9x9b" Sep 17 07:15:24.468829 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:15:24.468715 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/e1039f4e-f954-4afd-9036-e99dd41e6367-ui-tls\") pod \"feast-simple-feast-setup-b9485f697-h9x9b\" (UID: \"e1039f4e-f954-4afd-9036-e99dd41e6367\") " pod="test-ns-feast/feast-simple-feast-setup-b9485f697-h9x9b" Sep 17 07:15:24.468829 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:15:24.468770 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/e1039f4e-f954-4afd-9036-e99dd41e6367-feast-data\") pod \"feast-simple-feast-setup-b9485f697-h9x9b\" (UID: \"e1039f4e-f954-4afd-9036-e99dd41e6367\") " pod="test-ns-feast/feast-simple-feast-setup-b9485f697-h9x9b" Sep 17 07:15:24.468829 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:15:24.468806 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bncpr\" (UniqueName: \"kubernetes.io/projected/e1039f4e-f954-4afd-9036-e99dd41e6367-kube-api-access-bncpr\") pod \"feast-simple-feast-setup-b9485f697-h9x9b\" (UID: \"e1039f4e-f954-4afd-9036-e99dd41e6367\") " pod="test-ns-feast/feast-simple-feast-setup-b9485f697-h9x9b" Sep 17 07:15:24.468992 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:15:24.468848 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/e1039f4e-f954-4afd-9036-e99dd41e6367-registry-tls\") pod \"feast-simple-feast-setup-b9485f697-h9x9b\" (UID: \"e1039f4e-f954-4afd-9036-e99dd41e6367\") " pod="test-ns-feast/feast-simple-feast-setup-b9485f697-h9x9b" Sep 17 07:15:24.569816 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:15:24.569780 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/e1039f4e-f954-4afd-9036-e99dd41e6367-online-tls\") pod \"feast-simple-feast-setup-b9485f697-h9x9b\" (UID: \"e1039f4e-f954-4afd-9036-e99dd41e6367\") " pod="test-ns-feast/feast-simple-feast-setup-b9485f697-h9x9b" Sep 17 07:15:24.569816 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:15:24.569822 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/e1039f4e-f954-4afd-9036-e99dd41e6367-ui-tls\") pod \"feast-simple-feast-setup-b9485f697-h9x9b\" (UID: \"e1039f4e-f954-4afd-9036-e99dd41e6367\") " pod="test-ns-feast/feast-simple-feast-setup-b9485f697-h9x9b" Sep 17 07:15:24.570052 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:15:24.569845 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/e1039f4e-f954-4afd-9036-e99dd41e6367-feast-data\") pod \"feast-simple-feast-setup-b9485f697-h9x9b\" (UID: \"e1039f4e-f954-4afd-9036-e99dd41e6367\") " pod="test-ns-feast/feast-simple-feast-setup-b9485f697-h9x9b" Sep 17 07:15:24.570052 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:15:24.569869 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bncpr\" (UniqueName: \"kubernetes.io/projected/e1039f4e-f954-4afd-9036-e99dd41e6367-kube-api-access-bncpr\") pod \"feast-simple-feast-setup-b9485f697-h9x9b\" (UID: \"e1039f4e-f954-4afd-9036-e99dd41e6367\") " pod="test-ns-feast/feast-simple-feast-setup-b9485f697-h9x9b" Sep 17 07:15:24.570052 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:15:24.569909 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/e1039f4e-f954-4afd-9036-e99dd41e6367-registry-tls\") pod \"feast-simple-feast-setup-b9485f697-h9x9b\" (UID: \"e1039f4e-f954-4afd-9036-e99dd41e6367\") " pod="test-ns-feast/feast-simple-feast-setup-b9485f697-h9x9b" Sep 17 07:15:24.570052 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:15:24.570011 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/e1039f4e-f954-4afd-9036-e99dd41e6367-offline-tls\") pod \"feast-simple-feast-setup-b9485f697-h9x9b\" (UID: \"e1039f4e-f954-4afd-9036-e99dd41e6367\") " pod="test-ns-feast/feast-simple-feast-setup-b9485f697-h9x9b" Sep 17 07:15:24.570291 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:15:24.570270 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/e1039f4e-f954-4afd-9036-e99dd41e6367-feast-data\") pod \"feast-simple-feast-setup-b9485f697-h9x9b\" (UID: \"e1039f4e-f954-4afd-9036-e99dd41e6367\") " pod="test-ns-feast/feast-simple-feast-setup-b9485f697-h9x9b" Sep 17 07:15:24.572455 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:15:24.572433 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/e1039f4e-f954-4afd-9036-e99dd41e6367-offline-tls\") pod \"feast-simple-feast-setup-b9485f697-h9x9b\" (UID: \"e1039f4e-f954-4afd-9036-e99dd41e6367\") " pod="test-ns-feast/feast-simple-feast-setup-b9485f697-h9x9b" Sep 17 07:15:24.572568 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:15:24.572478 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/e1039f4e-f954-4afd-9036-e99dd41e6367-ui-tls\") pod \"feast-simple-feast-setup-b9485f697-h9x9b\" (UID: \"e1039f4e-f954-4afd-9036-e99dd41e6367\") " pod="test-ns-feast/feast-simple-feast-setup-b9485f697-h9x9b" Sep 17 07:15:24.572652 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:15:24.572633 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/e1039f4e-f954-4afd-9036-e99dd41e6367-registry-tls\") pod \"feast-simple-feast-setup-b9485f697-h9x9b\" (UID: \"e1039f4e-f954-4afd-9036-e99dd41e6367\") " pod="test-ns-feast/feast-simple-feast-setup-b9485f697-h9x9b" Sep 17 07:15:24.572689 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:15:24.572641 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/e1039f4e-f954-4afd-9036-e99dd41e6367-online-tls\") pod \"feast-simple-feast-setup-b9485f697-h9x9b\" (UID: \"e1039f4e-f954-4afd-9036-e99dd41e6367\") " pod="test-ns-feast/feast-simple-feast-setup-b9485f697-h9x9b" Sep 17 07:15:24.579042 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:15:24.578943 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bncpr\" (UniqueName: \"kubernetes.io/projected/e1039f4e-f954-4afd-9036-e99dd41e6367-kube-api-access-bncpr\") pod \"feast-simple-feast-setup-b9485f697-h9x9b\" (UID: \"e1039f4e-f954-4afd-9036-e99dd41e6367\") " pod="test-ns-feast/feast-simple-feast-setup-b9485f697-h9x9b" Sep 17 07:15:24.684267 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:15:24.684181 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-b9485f697-h9x9b" Sep 17 07:15:24.963987 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:15:24.963947 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-b9485f697-h9x9b"] Sep 17 07:15:24.965698 ip-10-0-138-13 kubenswrapper[2559]: W0917 07:15:24.965667 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pode1039f4e_f954_4afd_9036_e99dd41e6367.slice/crio-a61ef8a07ad33126f882cf441fd580ba23257a898eb4147b1dc1a0dbdac5bf69 WatchSource:0}: Error finding container a61ef8a07ad33126f882cf441fd580ba23257a898eb4147b1dc1a0dbdac5bf69: Status 404 returned error can't find the container with id a61ef8a07ad33126f882cf441fd580ba23257a898eb4147b1dc1a0dbdac5bf69 Sep 17 07:15:24.967749 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:15:24.967731 2559 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Sep 17 07:15:25.760236 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:15:25.760197 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-b9485f697-h9x9b" event={"ID":"e1039f4e-f954-4afd-9036-e99dd41e6367","Type":"ContainerStarted","Data":"a61ef8a07ad33126f882cf441fd580ba23257a898eb4147b1dc1a0dbdac5bf69"} Sep 17 07:15:51.882076 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:15:51.882039 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-b9485f697-h9x9b" event={"ID":"e1039f4e-f954-4afd-9036-e99dd41e6367","Type":"ContainerStarted","Data":"8b1b5094a344a770c62adbf05bbeb360d666def88ad5dcb62f2a16585664e5f8"} Sep 17 07:15:56.903880 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:15:56.903838 2559 generic.go:356] "Generic (PLEG): container finished" podID="e1039f4e-f954-4afd-9036-e99dd41e6367" containerID="8b1b5094a344a770c62adbf05bbeb360d666def88ad5dcb62f2a16585664e5f8" exitCode=0 Sep 17 07:15:56.904327 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:15:56.903908 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-b9485f697-h9x9b" event={"ID":"e1039f4e-f954-4afd-9036-e99dd41e6367","Type":"ContainerDied","Data":"8b1b5094a344a770c62adbf05bbeb360d666def88ad5dcb62f2a16585664e5f8"} Sep 17 07:15:57.910761 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:15:57.910720 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-b9485f697-h9x9b" event={"ID":"e1039f4e-f954-4afd-9036-e99dd41e6367","Type":"ContainerStarted","Data":"0ff00d2e7a73356c8e0c99e87d0439144a19f4f071fe6ea9689db32b445d9b2f"} Sep 17 07:16:03.939819 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:16:03.939753 2559 generic.go:356] "Generic (PLEG): container finished" podID="e1039f4e-f954-4afd-9036-e99dd41e6367" containerID="0ff00d2e7a73356c8e0c99e87d0439144a19f4f071fe6ea9689db32b445d9b2f" exitCode=0 Sep 17 07:16:03.940404 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:16:03.939824 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-b9485f697-h9x9b" event={"ID":"e1039f4e-f954-4afd-9036-e99dd41e6367","Type":"ContainerDied","Data":"0ff00d2e7a73356c8e0c99e87d0439144a19f4f071fe6ea9689db32b445d9b2f"} Sep 17 07:16:04.950879 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:16:04.950827 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-b9485f697-h9x9b" event={"ID":"e1039f4e-f954-4afd-9036-e99dd41e6367","Type":"ContainerStarted","Data":"6f9d528371c5562baaf21b1418f56f5817a13f0d628fa3344155f8cf732034df"} Sep 17 07:16:04.951411 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:16:04.950910 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-b9485f697-h9x9b" event={"ID":"e1039f4e-f954-4afd-9036-e99dd41e6367","Type":"ContainerStarted","Data":"415464861c5e2d5a9e73d84d99d0553f93d1517dd97f90a050434b0ce3875039"} Sep 17 07:16:04.951411 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:16:04.950933 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-b9485f697-h9x9b" event={"ID":"e1039f4e-f954-4afd-9036-e99dd41e6367","Type":"ContainerStarted","Data":"3ee69a30fe036788ae30580b7bf0fd16427aa2523fc2865105f00a9e05ce4b48"} Sep 17 07:16:04.951411 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:16:04.950987 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-b9485f697-h9x9b" event={"ID":"e1039f4e-f954-4afd-9036-e99dd41e6367","Type":"ContainerStarted","Data":"4bac1fdd29d76cc690fa025885418553e0fd829f9036759b8a5990c4e86843aa"} Sep 17 07:16:04.982187 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:16:04.982119 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="test-ns-feast/feast-simple-feast-setup-b9485f697-h9x9b" podStartSLOduration=14.224215427 podStartE2EDuration="40.982092224s" totalImagesPullingTime="26.757876797s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 07:15:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 07:16:04.980124669 +0000 UTC m=+472.528271390" watchObservedRunningTime="2026-09-17 07:16:04.982092224 +0000 UTC m=+472.530238934" Sep 17 07:16:06.684776 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:16:06.684726 2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-b9485f697-h9x9b" Sep 17 07:16:06.685418 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:16:06.685383 2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-b9485f697-h9x9b" Sep 17 07:16:06.685418 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:16:06.685419 2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-b9485f697-h9x9b" Sep 17 07:16:06.685616 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:16:06.685441 2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-b9485f697-h9x9b" Sep 17 07:16:06.687343 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:16:06.687307 2559 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-b9485f697-h9x9b" podUID="e1039f4e-f954-4afd-9036-e99dd41e6367" containerName="ui" probeResult="failure" output="dial tcp 10.134.0.24:8443: connect: connection refused" Sep 17 07:16:06.687549 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:16:06.687303 2559 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-b9485f697-h9x9b" podUID="e1039f4e-f954-4afd-9036-e99dd41e6367" containerName="online" probeResult="failure" output="Get \"https://10.134.0.24:6567/health\": dial tcp 10.134.0.24:6567: connect: connection refused" Sep 17 07:16:06.687672 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:16:06.687313 2559 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-b9485f697-h9x9b" podUID="e1039f4e-f954-4afd-9036-e99dd41e6367" containerName="registry" probeResult="failure" output="dial tcp 10.134.0.24:6571: connect: connection refused" Sep 17 07:16:06.687672 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:16:06.687344 2559 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-b9485f697-h9x9b" podUID="e1039f4e-f954-4afd-9036-e99dd41e6367" containerName="offline" probeResult="failure" output="dial tcp 10.134.0.24:8816: connect: connection refused" Sep 17 07:16:09.685502 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:16:09.685447 2559 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-b9485f697-h9x9b" podUID="e1039f4e-f954-4afd-9036-e99dd41e6367" containerName="offline" probeResult="failure" output="dial tcp 10.134.0.24:8816: connect: connection refused" Sep 17 07:16:09.685502 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:16:09.685476 2559 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-b9485f697-h9x9b" podUID="e1039f4e-f954-4afd-9036-e99dd41e6367" containerName="registry" probeResult="failure" output="dial tcp 10.134.0.24:6571: connect: connection refused" Sep 17 07:16:09.686073 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:16:09.685516 2559 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-b9485f697-h9x9b" podUID="e1039f4e-f954-4afd-9036-e99dd41e6367" containerName="online" probeResult="failure" output="Get \"https://10.134.0.24:6567/health\": dial tcp 10.134.0.24:6567: connect: connection refused" Sep 17 07:16:09.686073 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:16:09.685923 2559 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-b9485f697-h9x9b" podUID="e1039f4e-f954-4afd-9036-e99dd41e6367" containerName="ui" probeResult="failure" output="dial tcp 10.134.0.24:8443: connect: connection refused" Sep 17 07:16:12.685669 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:16:12.685637 2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-b9485f697-h9x9b" Sep 17 07:16:12.686046 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:16:12.685799 2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-b9485f697-h9x9b" Sep 17 07:16:12.686123 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:16:12.686103 2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-b9485f697-h9x9b" Sep 17 07:16:12.686226 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:16:12.686199 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-b9485f697-h9x9b" Sep 17 07:16:12.686492 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:16:12.686474 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-b9485f697-h9x9b" Sep 17 07:16:12.686633 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:16:12.686615 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-b9485f697-h9x9b" Sep 17 07:16:12.686722 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:16:12.686702 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-b9485f697-h9x9b" Sep 17 07:16:12.686772 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:16:12.686755 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-b9485f697-h9x9b" Sep 17 07:16:12.686836 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:16:12.686799 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-b9485f697-h9x9b" Sep 17 07:16:12.691007 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:16:12.690986 2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-b9485f697-h9x9b" Sep 17 07:16:12.998754 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:16:12.998723 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-b9485f697-h9x9b" Sep 17 07:16:13.003452 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:16:13.003423 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-b9485f697-h9x9b" Sep 17 07:17:15.044699 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:17:15.044624 2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-b9485f697-h9x9b"] Sep 17 07:17:15.045174 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:17:15.044857 2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-b9485f697-h9x9b" podUID="e1039f4e-f954-4afd-9036-e99dd41e6367" containerName="registry" containerID="cri-o://4bac1fdd29d76cc690fa025885418553e0fd829f9036759b8a5990c4e86843aa" gracePeriod=30 Sep 17 07:17:15.045174 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:17:15.044894 2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-b9485f697-h9x9b" podUID="e1039f4e-f954-4afd-9036-e99dd41e6367" containerName="offline" containerID="cri-o://415464861c5e2d5a9e73d84d99d0553f93d1517dd97f90a050434b0ce3875039" gracePeriod=30 Sep 17 07:17:15.045174 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:17:15.044903 2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-b9485f697-h9x9b" podUID="e1039f4e-f954-4afd-9036-e99dd41e6367" containerName="ui" containerID="cri-o://6f9d528371c5562baaf21b1418f56f5817a13f0d628fa3344155f8cf732034df" gracePeriod=30 Sep 17 07:17:15.045174 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:17:15.044903 2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-b9485f697-h9x9b" podUID="e1039f4e-f954-4afd-9036-e99dd41e6367" containerName="online" containerID="cri-o://3ee69a30fe036788ae30580b7bf0fd16427aa2523fc2865105f00a9e05ce4b48" gracePeriod=30 Sep 17 07:17:15.742039 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:17:15.741996 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["test-ns-feast/feast-simple-feast-setup-b9485f697-sx2pm"] Sep 17 07:17:15.744930 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:17:15.744899 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-b9485f697-sx2pm" Sep 17 07:17:15.750181 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:17:15.750144 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-dockercfg-74cgn\"" Sep 17 07:17:15.782753 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:17:15.782719 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-b9485f697-sx2pm"] Sep 17 07:17:15.865061 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:17:15.865013 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/508bc053-6063-4200-be89-8f4d497b84c3-registry-tls\") pod \"feast-simple-feast-setup-b9485f697-sx2pm\" (UID: \"508bc053-6063-4200-be89-8f4d497b84c3\") " pod="test-ns-feast/feast-simple-feast-setup-b9485f697-sx2pm" Sep 17 07:17:15.865061 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:17:15.865053 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/508bc053-6063-4200-be89-8f4d497b84c3-ui-tls\") pod \"feast-simple-feast-setup-b9485f697-sx2pm\" (UID: \"508bc053-6063-4200-be89-8f4d497b84c3\") " pod="test-ns-feast/feast-simple-feast-setup-b9485f697-sx2pm" Sep 17 07:17:15.865061 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:17:15.865070 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/508bc053-6063-4200-be89-8f4d497b84c3-feast-data\") pod \"feast-simple-feast-setup-b9485f697-sx2pm\" (UID: \"508bc053-6063-4200-be89-8f4d497b84c3\") " pod="test-ns-feast/feast-simple-feast-setup-b9485f697-sx2pm" Sep 17 07:17:15.865337 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:17:15.865090 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qsjk8\" (UniqueName: \"kubernetes.io/projected/508bc053-6063-4200-be89-8f4d497b84c3-kube-api-access-qsjk8\") pod \"feast-simple-feast-setup-b9485f697-sx2pm\" (UID: \"508bc053-6063-4200-be89-8f4d497b84c3\") " pod="test-ns-feast/feast-simple-feast-setup-b9485f697-sx2pm" Sep 17 07:17:15.865337 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:17:15.865258 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/508bc053-6063-4200-be89-8f4d497b84c3-online-tls\") pod \"feast-simple-feast-setup-b9485f697-sx2pm\" (UID: \"508bc053-6063-4200-be89-8f4d497b84c3\") " pod="test-ns-feast/feast-simple-feast-setup-b9485f697-sx2pm" Sep 17 07:17:15.865337 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:17:15.865330 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/508bc053-6063-4200-be89-8f4d497b84c3-offline-tls\") pod \"feast-simple-feast-setup-b9485f697-sx2pm\" (UID: \"508bc053-6063-4200-be89-8f4d497b84c3\") " pod="test-ns-feast/feast-simple-feast-setup-b9485f697-sx2pm" Sep 17 07:17:15.965939 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:17:15.965904 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/508bc053-6063-4200-be89-8f4d497b84c3-online-tls\") pod \"feast-simple-feast-setup-b9485f697-sx2pm\" (UID: \"508bc053-6063-4200-be89-8f4d497b84c3\") " pod="test-ns-feast/feast-simple-feast-setup-b9485f697-sx2pm" Sep 17 07:17:15.966078 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:17:15.965954 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/508bc053-6063-4200-be89-8f4d497b84c3-offline-tls\") pod \"feast-simple-feast-setup-b9485f697-sx2pm\" (UID: \"508bc053-6063-4200-be89-8f4d497b84c3\") " pod="test-ns-feast/feast-simple-feast-setup-b9485f697-sx2pm" Sep 17 07:17:15.966078 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:17:15.966017 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/508bc053-6063-4200-be89-8f4d497b84c3-registry-tls\") pod \"feast-simple-feast-setup-b9485f697-sx2pm\" (UID: \"508bc053-6063-4200-be89-8f4d497b84c3\") " pod="test-ns-feast/feast-simple-feast-setup-b9485f697-sx2pm" Sep 17 07:17:15.966078 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:17:15.966035 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/508bc053-6063-4200-be89-8f4d497b84c3-ui-tls\") pod \"feast-simple-feast-setup-b9485f697-sx2pm\" (UID: \"508bc053-6063-4200-be89-8f4d497b84c3\") " pod="test-ns-feast/feast-simple-feast-setup-b9485f697-sx2pm" Sep 17 07:17:15.966078 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:17:15.966049 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/508bc053-6063-4200-be89-8f4d497b84c3-feast-data\") pod \"feast-simple-feast-setup-b9485f697-sx2pm\" (UID: \"508bc053-6063-4200-be89-8f4d497b84c3\") " pod="test-ns-feast/feast-simple-feast-setup-b9485f697-sx2pm" Sep 17 07:17:15.966078 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:17:15.966068 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qsjk8\" (UniqueName: \"kubernetes.io/projected/508bc053-6063-4200-be89-8f4d497b84c3-kube-api-access-qsjk8\") pod \"feast-simple-feast-setup-b9485f697-sx2pm\" (UID: \"508bc053-6063-4200-be89-8f4d497b84c3\") " pod="test-ns-feast/feast-simple-feast-setup-b9485f697-sx2pm" Sep 17 07:17:15.966553 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:17:15.966516 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/508bc053-6063-4200-be89-8f4d497b84c3-feast-data\") pod \"feast-simple-feast-setup-b9485f697-sx2pm\" (UID: \"508bc053-6063-4200-be89-8f4d497b84c3\") " pod="test-ns-feast/feast-simple-feast-setup-b9485f697-sx2pm" Sep 17 07:17:15.968698 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:17:15.968665 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/508bc053-6063-4200-be89-8f4d497b84c3-registry-tls\") pod \"feast-simple-feast-setup-b9485f697-sx2pm\" (UID: \"508bc053-6063-4200-be89-8f4d497b84c3\") " pod="test-ns-feast/feast-simple-feast-setup-b9485f697-sx2pm" Sep 17 07:17:15.968819 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:17:15.968664 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/508bc053-6063-4200-be89-8f4d497b84c3-offline-tls\") pod \"feast-simple-feast-setup-b9485f697-sx2pm\" (UID: \"508bc053-6063-4200-be89-8f4d497b84c3\") " pod="test-ns-feast/feast-simple-feast-setup-b9485f697-sx2pm" Sep 17 07:17:15.968868 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:17:15.968850 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/508bc053-6063-4200-be89-8f4d497b84c3-online-tls\") pod \"feast-simple-feast-setup-b9485f697-sx2pm\" (UID: \"508bc053-6063-4200-be89-8f4d497b84c3\") " pod="test-ns-feast/feast-simple-feast-setup-b9485f697-sx2pm" Sep 17 07:17:15.968905 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:17:15.968895 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/508bc053-6063-4200-be89-8f4d497b84c3-ui-tls\") pod \"feast-simple-feast-setup-b9485f697-sx2pm\" (UID: \"508bc053-6063-4200-be89-8f4d497b84c3\") " pod="test-ns-feast/feast-simple-feast-setup-b9485f697-sx2pm" Sep 17 07:17:15.977880 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:17:15.977852 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qsjk8\" (UniqueName: \"kubernetes.io/projected/508bc053-6063-4200-be89-8f4d497b84c3-kube-api-access-qsjk8\") pod \"feast-simple-feast-setup-b9485f697-sx2pm\" (UID: \"508bc053-6063-4200-be89-8f4d497b84c3\") " pod="test-ns-feast/feast-simple-feast-setup-b9485f697-sx2pm" Sep 17 07:17:16.056865 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:17:16.056815 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-b9485f697-sx2pm" Sep 17 07:17:16.262602 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:17:16.262564 2559 generic.go:356] "Generic (PLEG): container finished" podID="e1039f4e-f954-4afd-9036-e99dd41e6367" containerID="6f9d528371c5562baaf21b1418f56f5817a13f0d628fa3344155f8cf732034df" exitCode=0 Sep 17 07:17:16.262602 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:17:16.262592 2559 generic.go:356] "Generic (PLEG): container finished" podID="e1039f4e-f954-4afd-9036-e99dd41e6367" containerID="3ee69a30fe036788ae30580b7bf0fd16427aa2523fc2865105f00a9e05ce4b48" exitCode=0 Sep 17 07:17:16.262811 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:17:16.262636 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-b9485f697-h9x9b" event={"ID":"e1039f4e-f954-4afd-9036-e99dd41e6367","Type":"ContainerDied","Data":"6f9d528371c5562baaf21b1418f56f5817a13f0d628fa3344155f8cf732034df"} Sep 17 07:17:16.262811 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:17:16.262685 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-b9485f697-h9x9b" event={"ID":"e1039f4e-f954-4afd-9036-e99dd41e6367","Type":"ContainerDied","Data":"3ee69a30fe036788ae30580b7bf0fd16427aa2523fc2865105f00a9e05ce4b48"} Sep 17 07:17:16.347838 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:17:16.347804 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-b9485f697-sx2pm"] Sep 17 07:17:16.349287 ip-10-0-138-13 kubenswrapper[2559]: W0917 07:17:16.349262 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod508bc053_6063_4200_be89_8f4d497b84c3.slice/crio-2e891c26f1407e6c2230763227d29e4257adc62e967a68d04dd58961b9d5b9af WatchSource:0}: Error finding container 2e891c26f1407e6c2230763227d29e4257adc62e967a68d04dd58961b9d5b9af: Status 404 returned error can't find the container with id 2e891c26f1407e6c2230763227d29e4257adc62e967a68d04dd58961b9d5b9af Sep 17 07:17:17.269225 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:17:17.269182 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-b9485f697-sx2pm" event={"ID":"508bc053-6063-4200-be89-8f4d497b84c3","Type":"ContainerStarted","Data":"8626f3b33f5538a9712b872a5fb03551e0cccecee56f86b3abd18a4003969162"} Sep 17 07:17:17.269751 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:17:17.269239 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-b9485f697-sx2pm" event={"ID":"508bc053-6063-4200-be89-8f4d497b84c3","Type":"ContainerStarted","Data":"2e891c26f1407e6c2230763227d29e4257adc62e967a68d04dd58961b9d5b9af"} Sep 17 07:17:21.289774 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:17:21.289741 2559 generic.go:356] "Generic (PLEG): container finished" podID="508bc053-6063-4200-be89-8f4d497b84c3" containerID="8626f3b33f5538a9712b872a5fb03551e0cccecee56f86b3abd18a4003969162" exitCode=0 Sep 17 07:17:21.290139 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:17:21.289822 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-b9485f697-sx2pm" event={"ID":"508bc053-6063-4200-be89-8f4d497b84c3","Type":"ContainerDied","Data":"8626f3b33f5538a9712b872a5fb03551e0cccecee56f86b3abd18a4003969162"} Sep 17 07:17:22.295955 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:17:22.295924 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-b9485f697-sx2pm" event={"ID":"508bc053-6063-4200-be89-8f4d497b84c3","Type":"ContainerStarted","Data":"4a6d1a7f256c38cd941132f6d7dcada914c10b2ec2917efc92e2397543fdccf4"} Sep 17 07:17:22.687278 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:17:22.687175 2559 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-b9485f697-h9x9b" podUID="e1039f4e-f954-4afd-9036-e99dd41e6367" containerName="ui" probeResult="failure" output="dial tcp 10.134.0.24:8443: connect: connection refused" Sep 17 07:17:22.999827 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:17:22.999782 2559 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-b9485f697-h9x9b" podUID="e1039f4e-f954-4afd-9036-e99dd41e6367" containerName="online" probeResult="failure" output="Get \"https://10.134.0.24:6567/health\": dial tcp 10.134.0.24:6567: connect: connection refused" Sep 17 07:17:27.317741 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:17:27.317661 2559 generic.go:356] "Generic (PLEG): container finished" podID="508bc053-6063-4200-be89-8f4d497b84c3" containerID="4a6d1a7f256c38cd941132f6d7dcada914c10b2ec2917efc92e2397543fdccf4" exitCode=0 Sep 17 07:17:27.317741 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:17:27.317717 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-b9485f697-sx2pm" event={"ID":"508bc053-6063-4200-be89-8f4d497b84c3","Type":"ContainerDied","Data":"4a6d1a7f256c38cd941132f6d7dcada914c10b2ec2917efc92e2397543fdccf4"} Sep 17 07:17:28.328915 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:17:28.328874 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-b9485f697-sx2pm" event={"ID":"508bc053-6063-4200-be89-8f4d497b84c3","Type":"ContainerStarted","Data":"dac51a1fe93e3db6446fbf074c79fb65b32f992112175a6c318f7b9be57e7227"} Sep 17 07:17:28.329410 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:17:28.328941 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-b9485f697-sx2pm" event={"ID":"508bc053-6063-4200-be89-8f4d497b84c3","Type":"ContainerStarted","Data":"766aa70477b311c6f4a9e13d5f17d1aee37f73d34b4c49db31d30cc790f5759e"} Sep 17 07:17:28.329410 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:17:28.328985 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-b9485f697-sx2pm" event={"ID":"508bc053-6063-4200-be89-8f4d497b84c3","Type":"ContainerStarted","Data":"6d46ae4db2805dd427a729880194bf2272c3410b3cf3f80c0705091918bcdeb6"} Sep 17 07:17:28.329410 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:17:28.329004 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-b9485f697-sx2pm" event={"ID":"508bc053-6063-4200-be89-8f4d497b84c3","Type":"ContainerStarted","Data":"93a12f29569cc26ae2756e92c3c905423859d98df2e74f2cb630bef10df7b3fc"} Sep 17 07:17:31.057298 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:17:31.057171 2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-b9485f697-sx2pm" Sep 17 07:17:31.057298 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:17:31.057248 2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-b9485f697-sx2pm" Sep 17 07:17:31.057298 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:17:31.057268 2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-b9485f697-sx2pm" Sep 17 07:17:31.057298 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:17:31.057286 2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-b9485f697-sx2pm" Sep 17 07:17:31.059422 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:17:31.059386 2559 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-b9485f697-sx2pm" podUID="508bc053-6063-4200-be89-8f4d497b84c3" containerName="registry" probeResult="failure" output="dial tcp 10.134.0.25:6571: connect: connection refused" Sep 17 07:17:31.059647 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:17:31.059385 2559 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-b9485f697-sx2pm" podUID="508bc053-6063-4200-be89-8f4d497b84c3" containerName="online" probeResult="failure" output="Get \"https://10.134.0.25:6567/health\": dial tcp 10.134.0.25:6567: connect: connection refused" Sep 17 07:17:31.059765 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:17:31.059436 2559 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-b9485f697-sx2pm" podUID="508bc053-6063-4200-be89-8f4d497b84c3" containerName="ui" probeResult="failure" output="dial tcp 10.134.0.25:8443: connect: connection refused" Sep 17 07:17:31.059765 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:17:31.059467 2559 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-b9485f697-sx2pm" podUID="508bc053-6063-4200-be89-8f4d497b84c3" containerName="offline" probeResult="failure" output="dial tcp 10.134.0.25:8816: connect: connection refused" Sep 17 07:17:32.686802 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:17:32.686753 2559 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-b9485f697-h9x9b" podUID="e1039f4e-f954-4afd-9036-e99dd41e6367" containerName="ui" probeResult="failure" output="dial tcp 10.134.0.24:8443: connect: connection refused" Sep 17 07:17:32.999530 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:17:32.999478 2559 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-b9485f697-h9x9b" podUID="e1039f4e-f954-4afd-9036-e99dd41e6367" containerName="online" probeResult="failure" output="Get \"https://10.134.0.24:6567/health\": dial tcp 10.134.0.24:6567: connect: connection refused" Sep 17 07:17:34.057227 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:17:34.057171 2559 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-b9485f697-sx2pm" podUID="508bc053-6063-4200-be89-8f4d497b84c3" containerName="offline" probeResult="failure" output="dial tcp 10.134.0.25:8816: connect: connection refused" Sep 17 07:17:34.057821 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:17:34.057227 2559 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-b9485f697-sx2pm" podUID="508bc053-6063-4200-be89-8f4d497b84c3" containerName="registry" probeResult="failure" output="dial tcp 10.134.0.25:6571: connect: connection refused" Sep 17 07:17:34.057939 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:17:34.057228 2559 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-b9485f697-sx2pm" podUID="508bc053-6063-4200-be89-8f4d497b84c3" containerName="online" probeResult="failure" output="Get \"https://10.134.0.25:6567/health\": dial tcp 10.134.0.25:6567: connect: connection refused" Sep 17 07:17:34.057939 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:17:34.057281 2559 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-b9485f697-sx2pm" podUID="508bc053-6063-4200-be89-8f4d497b84c3" containerName="ui" probeResult="failure" output="dial tcp 10.134.0.25:8443: connect: connection refused" Sep 17 07:17:36.057855 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:17:36.057815 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-b9485f697-sx2pm" Sep 17 07:17:36.058365 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:17:36.057877 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-b9485f697-sx2pm" Sep 17 07:17:36.058365 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:17:36.057897 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-b9485f697-sx2pm" Sep 17 07:17:36.058365 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:17:36.057914 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-b9485f697-sx2pm" Sep 17 07:17:37.057741 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:17:37.057708 2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-b9485f697-sx2pm" Sep 17 07:17:37.058130 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:17:37.058107 2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-b9485f697-sx2pm" Sep 17 07:17:37.058437 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:17:37.058224 2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-b9485f697-sx2pm" Sep 17 07:17:37.058792 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:17:37.058768 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-b9485f697-sx2pm" Sep 17 07:17:37.058890 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:17:37.058837 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-b9485f697-sx2pm" Sep 17 07:17:37.059032 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:17:37.059018 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-b9485f697-sx2pm" Sep 17 07:17:37.063121 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:17:37.063107 2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-b9485f697-sx2pm" Sep 17 07:17:37.098131 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:17:37.098079 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="test-ns-feast/feast-simple-feast-setup-b9485f697-sx2pm" podStartSLOduration=22.098062167 podStartE2EDuration="22.098062167s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 07:17:15 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 07:17:28.393051218 +0000 UTC m=+555.941197934" watchObservedRunningTime="2026-09-17 07:17:37.098062167 +0000 UTC m=+564.646208894" Sep 17 07:17:37.385331 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:17:37.385248 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-b9485f697-sx2pm" Sep 17 07:17:42.686513 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:17:42.686462 2559 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-b9485f697-h9x9b" podUID="e1039f4e-f954-4afd-9036-e99dd41e6367" containerName="ui" probeResult="failure" output="dial tcp 10.134.0.24:8443: connect: connection refused" Sep 17 07:17:42.687005 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:17:42.686659 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-b9485f697-h9x9b" Sep 17 07:17:42.998839 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:17:42.998802 2559 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-b9485f697-h9x9b" podUID="e1039f4e-f954-4afd-9036-e99dd41e6367" containerName="online" probeResult="failure" output="Get \"https://10.134.0.24:6567/health\": dial tcp 10.134.0.24:6567: connect: connection refused" Sep 17 07:17:42.999046 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:17:42.998926 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-b9485f697-h9x9b" Sep 17 07:17:45.418295 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:17:45.418217 2559 generic.go:356] "Generic (PLEG): container finished" podID="e1039f4e-f954-4afd-9036-e99dd41e6367" containerID="415464861c5e2d5a9e73d84d99d0553f93d1517dd97f90a050434b0ce3875039" exitCode=137 Sep 17 07:17:45.418295 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:17:45.418242 2559 generic.go:356] "Generic (PLEG): container finished" podID="e1039f4e-f954-4afd-9036-e99dd41e6367" containerID="4bac1fdd29d76cc690fa025885418553e0fd829f9036759b8a5990c4e86843aa" exitCode=137 Sep 17 07:17:45.418650 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:17:45.418289 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-b9485f697-h9x9b" event={"ID":"e1039f4e-f954-4afd-9036-e99dd41e6367","Type":"ContainerDied","Data":"415464861c5e2d5a9e73d84d99d0553f93d1517dd97f90a050434b0ce3875039"} Sep 17 07:17:45.418650 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:17:45.418333 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-b9485f697-h9x9b" event={"ID":"e1039f4e-f954-4afd-9036-e99dd41e6367","Type":"ContainerDied","Data":"4bac1fdd29d76cc690fa025885418553e0fd829f9036759b8a5990c4e86843aa"} Sep 17 07:17:45.686452 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:17:45.686430 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-b9485f697-h9x9b" Sep 17 07:17:45.739343 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:17:45.739313 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/e1039f4e-f954-4afd-9036-e99dd41e6367-registry-tls\") pod \"e1039f4e-f954-4afd-9036-e99dd41e6367\" (UID: \"e1039f4e-f954-4afd-9036-e99dd41e6367\") " Sep 17 07:17:45.739501 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:17:45.739350 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/e1039f4e-f954-4afd-9036-e99dd41e6367-online-tls\") pod \"e1039f4e-f954-4afd-9036-e99dd41e6367\" (UID: \"e1039f4e-f954-4afd-9036-e99dd41e6367\") " Sep 17 07:17:45.739501 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:17:45.739472 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/e1039f4e-f954-4afd-9036-e99dd41e6367-offline-tls\") pod \"e1039f4e-f954-4afd-9036-e99dd41e6367\" (UID: \"e1039f4e-f954-4afd-9036-e99dd41e6367\") " Sep 17 07:17:45.739624 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:17:45.739527 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bncpr\" (UniqueName: \"kubernetes.io/projected/e1039f4e-f954-4afd-9036-e99dd41e6367-kube-api-access-bncpr\") pod \"e1039f4e-f954-4afd-9036-e99dd41e6367\" (UID: \"e1039f4e-f954-4afd-9036-e99dd41e6367\") " Sep 17 07:17:45.739624 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:17:45.739565 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/e1039f4e-f954-4afd-9036-e99dd41e6367-ui-tls\") pod \"e1039f4e-f954-4afd-9036-e99dd41e6367\" (UID: \"e1039f4e-f954-4afd-9036-e99dd41e6367\") " Sep 17 07:17:45.739737 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:17:45.739629 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/e1039f4e-f954-4afd-9036-e99dd41e6367-feast-data\") pod \"e1039f4e-f954-4afd-9036-e99dd41e6367\" (UID: \"e1039f4e-f954-4afd-9036-e99dd41e6367\") " Sep 17 07:17:45.740458 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:17:45.740416 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e1039f4e-f954-4afd-9036-e99dd41e6367-feast-data" (OuterVolumeSpecName: "feast-data") pod "e1039f4e-f954-4afd-9036-e99dd41e6367" (UID: "e1039f4e-f954-4afd-9036-e99dd41e6367"). InnerVolumeSpecName "feast-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 17 07:17:45.742017 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:17:45.741940 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e1039f4e-f954-4afd-9036-e99dd41e6367-ui-tls" (OuterVolumeSpecName: "ui-tls") pod "e1039f4e-f954-4afd-9036-e99dd41e6367" (UID: "e1039f4e-f954-4afd-9036-e99dd41e6367"). InnerVolumeSpecName "ui-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 17 07:17:45.742196 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:17:45.742161 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e1039f4e-f954-4afd-9036-e99dd41e6367-kube-api-access-bncpr" (OuterVolumeSpecName: "kube-api-access-bncpr") pod "e1039f4e-f954-4afd-9036-e99dd41e6367" (UID: "e1039f4e-f954-4afd-9036-e99dd41e6367"). InnerVolumeSpecName "kube-api-access-bncpr". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 17 07:17:45.742196 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:17:45.742166 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e1039f4e-f954-4afd-9036-e99dd41e6367-online-tls" (OuterVolumeSpecName: "online-tls") pod "e1039f4e-f954-4afd-9036-e99dd41e6367" (UID: "e1039f4e-f954-4afd-9036-e99dd41e6367"). InnerVolumeSpecName "online-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 17 07:17:45.742346 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:17:45.742241 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e1039f4e-f954-4afd-9036-e99dd41e6367-offline-tls" (OuterVolumeSpecName: "offline-tls") pod "e1039f4e-f954-4afd-9036-e99dd41e6367" (UID: "e1039f4e-f954-4afd-9036-e99dd41e6367"). InnerVolumeSpecName "offline-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 17 07:17:45.742387 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:17:45.742346 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e1039f4e-f954-4afd-9036-e99dd41e6367-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "e1039f4e-f954-4afd-9036-e99dd41e6367" (UID: "e1039f4e-f954-4afd-9036-e99dd41e6367"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 17 07:17:45.840719 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:17:45.840695 2559 reconciler_common.go:299] "Volume detached for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/e1039f4e-f954-4afd-9036-e99dd41e6367-feast-data\") on node \"ip-10-0-138-13.ec2.internal\" DevicePath \"\"" Sep 17 07:17:45.840719 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:17:45.840716 2559 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/e1039f4e-f954-4afd-9036-e99dd41e6367-registry-tls\") on node \"ip-10-0-138-13.ec2.internal\" DevicePath \"\"" Sep 17 07:17:45.840719 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:17:45.840724 2559 reconciler_common.go:299] "Volume detached for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/e1039f4e-f954-4afd-9036-e99dd41e6367-online-tls\") on node \"ip-10-0-138-13.ec2.internal\" DevicePath \"\"" Sep 17 07:17:45.840887 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:17:45.840732 2559 reconciler_common.go:299] "Volume detached for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/e1039f4e-f954-4afd-9036-e99dd41e6367-offline-tls\") on node \"ip-10-0-138-13.ec2.internal\" DevicePath \"\"" Sep 17 07:17:45.840887 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:17:45.840742 2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bncpr\" (UniqueName: \"kubernetes.io/projected/e1039f4e-f954-4afd-9036-e99dd41e6367-kube-api-access-bncpr\") on node \"ip-10-0-138-13.ec2.internal\" DevicePath \"\"" Sep 17 07:17:45.840887 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:17:45.840751 2559 reconciler_common.go:299] "Volume detached for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/e1039f4e-f954-4afd-9036-e99dd41e6367-ui-tls\") on node \"ip-10-0-138-13.ec2.internal\" DevicePath \"\"" Sep 17 07:17:46.431287 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:17:46.431241 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-b9485f697-h9x9b" event={"ID":"e1039f4e-f954-4afd-9036-e99dd41e6367","Type":"ContainerDied","Data":"a61ef8a07ad33126f882cf441fd580ba23257a898eb4147b1dc1a0dbdac5bf69"} Sep 17 07:17:46.431287 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:17:46.431278 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-b9485f697-h9x9b" Sep 17 07:17:46.431857 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:17:46.431310 2559 scope.go:117] "RemoveContainer" containerID="6f9d528371c5562baaf21b1418f56f5817a13f0d628fa3344155f8cf732034df" Sep 17 07:17:46.440285 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:17:46.440265 2559 scope.go:117] "RemoveContainer" containerID="415464861c5e2d5a9e73d84d99d0553f93d1517dd97f90a050434b0ce3875039" Sep 17 07:17:46.447672 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:17:46.447654 2559 scope.go:117] "RemoveContainer" containerID="3ee69a30fe036788ae30580b7bf0fd16427aa2523fc2865105f00a9e05ce4b48" Sep 17 07:17:46.458347 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:17:46.458321 2559 scope.go:117] "RemoveContainer" containerID="4bac1fdd29d76cc690fa025885418553e0fd829f9036759b8a5990c4e86843aa" Sep 17 07:17:46.459316 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:17:46.459297 2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-b9485f697-h9x9b"] Sep 17 07:17:46.465334 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:17:46.465313 2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-b9485f697-h9x9b"] Sep 17 07:17:46.466223 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:17:46.466205 2559 scope.go:117] "RemoveContainer" containerID="0ff00d2e7a73356c8e0c99e87d0439144a19f4f071fe6ea9689db32b445d9b2f" Sep 17 07:17:46.473227 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:17:46.473208 2559 scope.go:117] "RemoveContainer" containerID="8b1b5094a344a770c62adbf05bbeb360d666def88ad5dcb62f2a16585664e5f8" Sep 17 07:17:46.899086 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:17:46.899049 2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e1039f4e-f954-4afd-9036-e99dd41e6367" path="/var/lib/kubelet/pods/e1039f4e-f954-4afd-9036-e99dd41e6367/volumes" Sep 17 07:18:12.839330 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:18:12.839300 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-b99wz_5ae9fb13-f8a8-4999-9023-cebdf2a7bd97/ovn-acl-logging/0.log" Sep 17 07:18:12.839809 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:18:12.839486 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-b99wz_5ae9fb13-f8a8-4999-9023-cebdf2a7bd97/ovn-acl-logging/0.log" Sep 17 07:18:40.522921 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:18:40.522843 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-b5ff4bdbb-knkhh"] Sep 17 07:18:40.523365 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:18:40.523211 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e1039f4e-f954-4afd-9036-e99dd41e6367" containerName="ui" Sep 17 07:18:40.523365 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:18:40.523223 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="e1039f4e-f954-4afd-9036-e99dd41e6367" containerName="ui" Sep 17 07:18:40.523365 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:18:40.523235 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e1039f4e-f954-4afd-9036-e99dd41e6367" containerName="online" Sep 17 07:18:40.523365 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:18:40.523241 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="e1039f4e-f954-4afd-9036-e99dd41e6367" containerName="online" Sep 17 07:18:40.523365 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:18:40.523248 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e1039f4e-f954-4afd-9036-e99dd41e6367" containerName="offline" Sep 17 07:18:40.523365 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:18:40.523253 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="e1039f4e-f954-4afd-9036-e99dd41e6367" containerName="offline" Sep 17 07:18:40.523365 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:18:40.523265 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e1039f4e-f954-4afd-9036-e99dd41e6367" containerName="feast-init" Sep 17 07:18:40.523365 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:18:40.523271 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="e1039f4e-f954-4afd-9036-e99dd41e6367" containerName="feast-init" Sep 17 07:18:40.523365 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:18:40.523276 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e1039f4e-f954-4afd-9036-e99dd41e6367" containerName="registry" Sep 17 07:18:40.523365 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:18:40.523281 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="e1039f4e-f954-4afd-9036-e99dd41e6367" containerName="registry" Sep 17 07:18:40.523365 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:18:40.523288 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e1039f4e-f954-4afd-9036-e99dd41e6367" containerName="feast-apply" Sep 17 07:18:40.523365 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:18:40.523293 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="e1039f4e-f954-4afd-9036-e99dd41e6367" containerName="feast-apply" Sep 17 07:18:40.523365 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:18:40.523345 2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="e1039f4e-f954-4afd-9036-e99dd41e6367" containerName="offline" Sep 17 07:18:40.523365 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:18:40.523353 2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="e1039f4e-f954-4afd-9036-e99dd41e6367" containerName="online" Sep 17 07:18:40.523365 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:18:40.523359 2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="e1039f4e-f954-4afd-9036-e99dd41e6367" containerName="ui" Sep 17 07:18:40.523365 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:18:40.523366 2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="e1039f4e-f954-4afd-9036-e99dd41e6367" containerName="registry" Sep 17 07:18:40.525796 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:18:40.525778 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-b5ff4bdbb-knkhh" Sep 17 07:18:40.528185 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:18:40.528162 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-offline-tls\"" Sep 17 07:18:40.528295 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:18:40.528202 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-client-ca\"" Sep 17 07:18:40.528295 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:18:40.528268 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-intra-comm\"" Sep 17 07:18:40.528468 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:18:40.528319 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-remote-registry\"/\"openshift-service-ca.crt\"" Sep 17 07:18:40.528468 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:18:40.528319 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-dockercfg-78qgg\"" Sep 17 07:18:40.528468 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:18:40.528396 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-online-tls\"" Sep 17 07:18:40.528686 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:18:40.528669 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-ui-tls\"" Sep 17 07:18:40.528818 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:18:40.528801 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-remote-registry\"/\"kube-root-ca.crt\"" Sep 17 07:18:40.540705 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:18:40.540682 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-b5ff4bdbb-knkhh"] Sep 17 07:18:40.598882 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:18:40.598855 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/519dfa2c-f934-42d7-a2db-3ec1d12b4f3e-online-tls\") pod \"feast-simple-feast-remote-setup-b5ff4bdbb-knkhh\" (UID: \"519dfa2c-f934-42d7-a2db-3ec1d12b4f3e\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-b5ff4bdbb-knkhh" Sep 17 07:18:40.598882 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:18:40.598883 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tp7n5\" (UniqueName: \"kubernetes.io/projected/519dfa2c-f934-42d7-a2db-3ec1d12b4f3e-kube-api-access-tp7n5\") pod \"feast-simple-feast-remote-setup-b5ff4bdbb-knkhh\" (UID: \"519dfa2c-f934-42d7-a2db-3ec1d12b4f3e\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-b5ff4bdbb-knkhh" Sep 17 07:18:40.599074 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:18:40.598907 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/519dfa2c-f934-42d7-a2db-3ec1d12b4f3e-feast-data\") pod \"feast-simple-feast-remote-setup-b5ff4bdbb-knkhh\" (UID: \"519dfa2c-f934-42d7-a2db-3ec1d12b4f3e\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-b5ff4bdbb-knkhh" Sep 17 07:18:40.599074 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:18:40.599003 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/configmap/519dfa2c-f934-42d7-a2db-3ec1d12b4f3e-registry-tls\") pod \"feast-simple-feast-remote-setup-b5ff4bdbb-knkhh\" (UID: \"519dfa2c-f934-42d7-a2db-3ec1d12b4f3e\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-b5ff4bdbb-knkhh" Sep 17 07:18:40.599074 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:18:40.599038 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/519dfa2c-f934-42d7-a2db-3ec1d12b4f3e-offline-tls\") pod \"feast-simple-feast-remote-setup-b5ff4bdbb-knkhh\" (UID: \"519dfa2c-f934-42d7-a2db-3ec1d12b4f3e\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-b5ff4bdbb-knkhh" Sep 17 07:18:40.599074 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:18:40.599058 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/519dfa2c-f934-42d7-a2db-3ec1d12b4f3e-ui-tls\") pod \"feast-simple-feast-remote-setup-b5ff4bdbb-knkhh\" (UID: \"519dfa2c-f934-42d7-a2db-3ec1d12b4f3e\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-b5ff4bdbb-knkhh" Sep 17 07:18:40.700044 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:18:40.700019 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/519dfa2c-f934-42d7-a2db-3ec1d12b4f3e-online-tls\") pod \"feast-simple-feast-remote-setup-b5ff4bdbb-knkhh\" (UID: \"519dfa2c-f934-42d7-a2db-3ec1d12b4f3e\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-b5ff4bdbb-knkhh" Sep 17 07:18:40.700044 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:18:40.700046 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tp7n5\" (UniqueName: \"kubernetes.io/projected/519dfa2c-f934-42d7-a2db-3ec1d12b4f3e-kube-api-access-tp7n5\") pod \"feast-simple-feast-remote-setup-b5ff4bdbb-knkhh\" (UID: \"519dfa2c-f934-42d7-a2db-3ec1d12b4f3e\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-b5ff4bdbb-knkhh" Sep 17 07:18:40.700257 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:18:40.700069 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/519dfa2c-f934-42d7-a2db-3ec1d12b4f3e-feast-data\") pod \"feast-simple-feast-remote-setup-b5ff4bdbb-knkhh\" (UID: \"519dfa2c-f934-42d7-a2db-3ec1d12b4f3e\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-b5ff4bdbb-knkhh" Sep 17 07:18:40.700257 ip-10-0-138-13 kubenswrapper[2559]: E0917 07:18:40.700173 2559 secret.go:189] Couldn't get secret test-ns-remote-registry/feast-simple-feast-remote-setup-online-tls: secret "feast-simple-feast-remote-setup-online-tls" not found Sep 17 07:18:40.700257 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:18:40.700183 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/configmap/519dfa2c-f934-42d7-a2db-3ec1d12b4f3e-registry-tls\") pod \"feast-simple-feast-remote-setup-b5ff4bdbb-knkhh\" (UID: \"519dfa2c-f934-42d7-a2db-3ec1d12b4f3e\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-b5ff4bdbb-knkhh" Sep 17 07:18:40.700257 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:18:40.700230 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/519dfa2c-f934-42d7-a2db-3ec1d12b4f3e-offline-tls\") pod \"feast-simple-feast-remote-setup-b5ff4bdbb-knkhh\" (UID: \"519dfa2c-f934-42d7-a2db-3ec1d12b4f3e\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-b5ff4bdbb-knkhh" Sep 17 07:18:40.700257 ip-10-0-138-13 kubenswrapper[2559]: E0917 07:18:40.700253 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/519dfa2c-f934-42d7-a2db-3ec1d12b4f3e-online-tls podName:519dfa2c-f934-42d7-a2db-3ec1d12b4f3e nodeName:}" failed. No retries permitted until 2026-09-17 07:18:41.20023239 +0000 UTC m=+628.748379091 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "online-tls" (UniqueName: "kubernetes.io/secret/519dfa2c-f934-42d7-a2db-3ec1d12b4f3e-online-tls") pod "feast-simple-feast-remote-setup-b5ff4bdbb-knkhh" (UID: "519dfa2c-f934-42d7-a2db-3ec1d12b4f3e") : secret "feast-simple-feast-remote-setup-online-tls" not found Sep 17 07:18:40.700494 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:18:40.700293 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/519dfa2c-f934-42d7-a2db-3ec1d12b4f3e-ui-tls\") pod \"feast-simple-feast-remote-setup-b5ff4bdbb-knkhh\" (UID: \"519dfa2c-f934-42d7-a2db-3ec1d12b4f3e\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-b5ff4bdbb-knkhh" Sep 17 07:18:40.700494 ip-10-0-138-13 kubenswrapper[2559]: E0917 07:18:40.700428 2559 secret.go:189] Couldn't get secret test-ns-remote-registry/feast-simple-feast-remote-setup-ui-tls: secret "feast-simple-feast-remote-setup-ui-tls" not found Sep 17 07:18:40.700571 ip-10-0-138-13 kubenswrapper[2559]: E0917 07:18:40.700506 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/519dfa2c-f934-42d7-a2db-3ec1d12b4f3e-ui-tls podName:519dfa2c-f934-42d7-a2db-3ec1d12b4f3e nodeName:}" failed. No retries permitted until 2026-09-17 07:18:41.200485759 +0000 UTC m=+628.748632449 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "ui-tls" (UniqueName: "kubernetes.io/secret/519dfa2c-f934-42d7-a2db-3ec1d12b4f3e-ui-tls") pod "feast-simple-feast-remote-setup-b5ff4bdbb-knkhh" (UID: "519dfa2c-f934-42d7-a2db-3ec1d12b4f3e") : secret "feast-simple-feast-remote-setup-ui-tls" not found Sep 17 07:18:40.700614 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:18:40.700603 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/519dfa2c-f934-42d7-a2db-3ec1d12b4f3e-feast-data\") pod \"feast-simple-feast-remote-setup-b5ff4bdbb-knkhh\" (UID: \"519dfa2c-f934-42d7-a2db-3ec1d12b4f3e\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-b5ff4bdbb-knkhh" Sep 17 07:18:40.700883 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:18:40.700865 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/configmap/519dfa2c-f934-42d7-a2db-3ec1d12b4f3e-registry-tls\") pod \"feast-simple-feast-remote-setup-b5ff4bdbb-knkhh\" (UID: \"519dfa2c-f934-42d7-a2db-3ec1d12b4f3e\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-b5ff4bdbb-knkhh" Sep 17 07:18:40.702715 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:18:40.702695 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/519dfa2c-f934-42d7-a2db-3ec1d12b4f3e-offline-tls\") pod \"feast-simple-feast-remote-setup-b5ff4bdbb-knkhh\" (UID: \"519dfa2c-f934-42d7-a2db-3ec1d12b4f3e\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-b5ff4bdbb-knkhh" Sep 17 07:18:40.709320 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:18:40.709303 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tp7n5\" (UniqueName: \"kubernetes.io/projected/519dfa2c-f934-42d7-a2db-3ec1d12b4f3e-kube-api-access-tp7n5\") pod \"feast-simple-feast-remote-setup-b5ff4bdbb-knkhh\" (UID: \"519dfa2c-f934-42d7-a2db-3ec1d12b4f3e\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-b5ff4bdbb-knkhh" Sep 17 07:18:41.204938 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:18:41.204904 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/519dfa2c-f934-42d7-a2db-3ec1d12b4f3e-ui-tls\") pod \"feast-simple-feast-remote-setup-b5ff4bdbb-knkhh\" (UID: \"519dfa2c-f934-42d7-a2db-3ec1d12b4f3e\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-b5ff4bdbb-knkhh" Sep 17 07:18:41.205128 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:18:41.204987 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/519dfa2c-f934-42d7-a2db-3ec1d12b4f3e-online-tls\") pod \"feast-simple-feast-remote-setup-b5ff4bdbb-knkhh\" (UID: \"519dfa2c-f934-42d7-a2db-3ec1d12b4f3e\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-b5ff4bdbb-knkhh" Sep 17 07:18:41.207244 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:18:41.207218 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/519dfa2c-f934-42d7-a2db-3ec1d12b4f3e-online-tls\") pod \"feast-simple-feast-remote-setup-b5ff4bdbb-knkhh\" (UID: \"519dfa2c-f934-42d7-a2db-3ec1d12b4f3e\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-b5ff4bdbb-knkhh" Sep 17 07:18:41.207347 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:18:41.207286 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/519dfa2c-f934-42d7-a2db-3ec1d12b4f3e-ui-tls\") pod \"feast-simple-feast-remote-setup-b5ff4bdbb-knkhh\" (UID: \"519dfa2c-f934-42d7-a2db-3ec1d12b4f3e\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-b5ff4bdbb-knkhh" Sep 17 07:18:41.435007 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:18:41.434948 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-b5ff4bdbb-knkhh" Sep 17 07:18:41.713195 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:18:41.713018 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-b5ff4bdbb-knkhh"] Sep 17 07:18:41.715324 ip-10-0-138-13 kubenswrapper[2559]: W0917 07:18:41.715287 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod519dfa2c_f934_42d7_a2db_3ec1d12b4f3e.slice/crio-88e886ff5b2f8db00b93f8294299b219a8757b0837ed6b98004b464920923368 WatchSource:0}: Error finding container 88e886ff5b2f8db00b93f8294299b219a8757b0837ed6b98004b464920923368: Status 404 returned error can't find the container with id 88e886ff5b2f8db00b93f8294299b219a8757b0837ed6b98004b464920923368 Sep 17 07:18:42.662684 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:18:42.662648 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-b5ff4bdbb-knkhh" event={"ID":"519dfa2c-f934-42d7-a2db-3ec1d12b4f3e","Type":"ContainerStarted","Data":"0cea47f33b5640bd77e854f4eb8572b6248b5b6cda13d4f0c763cfc819c94ea5"} Sep 17 07:18:42.662886 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:18:42.662697 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-b5ff4bdbb-knkhh" event={"ID":"519dfa2c-f934-42d7-a2db-3ec1d12b4f3e","Type":"ContainerStarted","Data":"88e886ff5b2f8db00b93f8294299b219a8757b0837ed6b98004b464920923368"} Sep 17 07:18:46.679438 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:18:46.679405 2559 generic.go:356] "Generic (PLEG): container finished" podID="519dfa2c-f934-42d7-a2db-3ec1d12b4f3e" containerID="0cea47f33b5640bd77e854f4eb8572b6248b5b6cda13d4f0c763cfc819c94ea5" exitCode=0 Sep 17 07:18:46.679804 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:18:46.679466 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-b5ff4bdbb-knkhh" event={"ID":"519dfa2c-f934-42d7-a2db-3ec1d12b4f3e","Type":"ContainerDied","Data":"0cea47f33b5640bd77e854f4eb8572b6248b5b6cda13d4f0c763cfc819c94ea5"} Sep 17 07:18:47.685592 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:18:47.685559 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-b5ff4bdbb-knkhh" event={"ID":"519dfa2c-f934-42d7-a2db-3ec1d12b4f3e","Type":"ContainerStarted","Data":"215490091bfe7b0992448c905d1328e8c8cfcaeccbfaca781324dee68962292b"} Sep 17 07:19:14.803616 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:19:14.803578 2559 generic.go:356] "Generic (PLEG): container finished" podID="519dfa2c-f934-42d7-a2db-3ec1d12b4f3e" containerID="215490091bfe7b0992448c905d1328e8c8cfcaeccbfaca781324dee68962292b" exitCode=0 Sep 17 07:19:14.804032 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:19:14.803646 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-b5ff4bdbb-knkhh" event={"ID":"519dfa2c-f934-42d7-a2db-3ec1d12b4f3e","Type":"ContainerDied","Data":"215490091bfe7b0992448c905d1328e8c8cfcaeccbfaca781324dee68962292b"} Sep 17 07:19:14.808705 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:19:14.808689 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-intra-comm\"" Sep 17 07:19:15.813035 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:19:15.812996 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-b5ff4bdbb-knkhh" event={"ID":"519dfa2c-f934-42d7-a2db-3ec1d12b4f3e","Type":"ContainerStarted","Data":"804e5d7eb4f569071a96052e7623880efc5b6f9fccd34aa4674691b922d98f11"} Sep 17 07:19:15.813508 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:19:15.813047 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-b5ff4bdbb-knkhh" event={"ID":"519dfa2c-f934-42d7-a2db-3ec1d12b4f3e","Type":"ContainerStarted","Data":"f4cc1a76188169a67603b23e21aeafb3b4ccbb516084302213703b96381dffe6"} Sep 17 07:19:15.813508 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:19:15.813062 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-b5ff4bdbb-knkhh" event={"ID":"519dfa2c-f934-42d7-a2db-3ec1d12b4f3e","Type":"ContainerStarted","Data":"d3f84c013becdc05b6795c6903bfd73e3716247010dbd5ddae0e938bc5b1ef3b"} Sep 17 07:19:15.848040 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:19:15.847962 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-b5ff4bdbb-knkhh" podStartSLOduration=35.847939746 podStartE2EDuration="35.847939746s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 07:18:40 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 07:19:15.8444681 +0000 UTC m=+663.392614809" watchObservedRunningTime="2026-09-17 07:19:15.847939746 +0000 UTC m=+663.396086456" Sep 17 07:19:17.435922 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:19:17.435878 2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-b5ff4bdbb-knkhh" Sep 17 07:19:17.436651 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:19:17.436613 2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-b5ff4bdbb-knkhh" Sep 17 07:19:17.436651 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:19:17.436648 2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-b5ff4bdbb-knkhh" Sep 17 07:19:17.437783 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:19:17.437741 2559 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-b5ff4bdbb-knkhh" podUID="519dfa2c-f934-42d7-a2db-3ec1d12b4f3e" containerName="ui" probeResult="failure" output="dial tcp 10.134.0.26:8443: connect: connection refused" Sep 17 07:19:17.437907 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:19:17.437786 2559 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-b5ff4bdbb-knkhh" podUID="519dfa2c-f934-42d7-a2db-3ec1d12b4f3e" containerName="online" probeResult="failure" output="Get \"https://10.134.0.26:6567/health\": dial tcp 10.134.0.26:6567: connect: connection refused" Sep 17 07:19:17.437907 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:19:17.437787 2559 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-b5ff4bdbb-knkhh" podUID="519dfa2c-f934-42d7-a2db-3ec1d12b4f3e" containerName="offline" probeResult="failure" output="dial tcp 10.134.0.26:8816: connect: connection refused" Sep 17 07:19:20.435592 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:19:20.435550 2559 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-b5ff4bdbb-knkhh" podUID="519dfa2c-f934-42d7-a2db-3ec1d12b4f3e" containerName="offline" probeResult="failure" output="dial tcp 10.134.0.26:8816: connect: connection refused" Sep 17 07:19:20.435592 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:19:20.435569 2559 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-b5ff4bdbb-knkhh" podUID="519dfa2c-f934-42d7-a2db-3ec1d12b4f3e" containerName="ui" probeResult="failure" output="dial tcp 10.134.0.26:8443: connect: connection refused" Sep 17 07:19:20.436158 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:19:20.435646 2559 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-b5ff4bdbb-knkhh" podUID="519dfa2c-f934-42d7-a2db-3ec1d12b4f3e" containerName="online" probeResult="failure" output="Get \"https://10.134.0.26:6567/health\": dial tcp 10.134.0.26:6567: connect: connection refused" Sep 17 07:19:21.435540 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:19:21.435503 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-b5ff4bdbb-knkhh" Sep 17 07:19:21.435744 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:19:21.435559 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-b5ff4bdbb-knkhh" Sep 17 07:19:21.435744 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:19:21.435574 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-b5ff4bdbb-knkhh" Sep 17 07:19:23.437139 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:19:23.437107 2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-b5ff4bdbb-knkhh" Sep 17 07:19:23.437547 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:19:23.437239 2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-b5ff4bdbb-knkhh" Sep 17 07:19:23.438048 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:19:23.438024 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-b5ff4bdbb-knkhh" Sep 17 07:19:23.438270 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:19:23.438250 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-b5ff4bdbb-knkhh" Sep 17 07:19:23.458740 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:19:23.458717 2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-b5ff4bdbb-knkhh" Sep 17 07:19:23.878074 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:19:23.878045 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-b5ff4bdbb-knkhh" Sep 17 07:20:26.875715 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:20:26.875633 2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-b5ff4bdbb-knkhh"] Sep 17 07:20:26.876244 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:20:26.875909 2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-b5ff4bdbb-knkhh" podUID="519dfa2c-f934-42d7-a2db-3ec1d12b4f3e" containerName="online" containerID="cri-o://d3f84c013becdc05b6795c6903bfd73e3716247010dbd5ddae0e938bc5b1ef3b" gracePeriod=30 Sep 17 07:20:26.876244 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:20:26.875996 2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-b5ff4bdbb-knkhh" podUID="519dfa2c-f934-42d7-a2db-3ec1d12b4f3e" containerName="ui" containerID="cri-o://804e5d7eb4f569071a96052e7623880efc5b6f9fccd34aa4674691b922d98f11" gracePeriod=30 Sep 17 07:20:26.876762 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:20:26.876019 2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-b5ff4bdbb-knkhh" podUID="519dfa2c-f934-42d7-a2db-3ec1d12b4f3e" containerName="offline" containerID="cri-o://f4cc1a76188169a67603b23e21aeafb3b4ccbb516084302213703b96381dffe6" gracePeriod=30 Sep 17 07:20:26.998507 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:20:26.998474 2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-b9485f697-sx2pm"] Sep 17 07:20:26.998755 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:20:26.998709 2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-b9485f697-sx2pm" podUID="508bc053-6063-4200-be89-8f4d497b84c3" containerName="registry" containerID="cri-o://93a12f29569cc26ae2756e92c3c905423859d98df2e74f2cb630bef10df7b3fc" gracePeriod=30 Sep 17 07:20:26.998884 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:20:26.998828 2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-b9485f697-sx2pm" podUID="508bc053-6063-4200-be89-8f4d497b84c3" containerName="ui" containerID="cri-o://dac51a1fe93e3db6446fbf074c79fb65b32f992112175a6c318f7b9be57e7227" gracePeriod=30 Sep 17 07:20:26.998884 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:20:26.998839 2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-b9485f697-sx2pm" podUID="508bc053-6063-4200-be89-8f4d497b84c3" containerName="offline" containerID="cri-o://766aa70477b311c6f4a9e13d5f17d1aee37f73d34b4c49db31d30cc790f5759e" gracePeriod=30 Sep 17 07:20:26.999035 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:20:26.998883 2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-b9485f697-sx2pm" podUID="508bc053-6063-4200-be89-8f4d497b84c3" containerName="online" containerID="cri-o://6d46ae4db2805dd427a729880194bf2272c3410b3cf3f80c0705091918bcdeb6" gracePeriod=30 Sep 17 07:20:27.383254 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:20:27.383208 2559 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-b9485f697-sx2pm" podUID="508bc053-6063-4200-be89-8f4d497b84c3" containerName="online" probeResult="failure" output="Get \"https://10.134.0.25:6567/health\": dial tcp 10.134.0.25:6567: connect: connection refused" Sep 17 07:20:28.133624 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:20:28.133591 2559 generic.go:356] "Generic (PLEG): container finished" podID="508bc053-6063-4200-be89-8f4d497b84c3" containerID="dac51a1fe93e3db6446fbf074c79fb65b32f992112175a6c318f7b9be57e7227" exitCode=0 Sep 17 07:20:28.133624 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:20:28.133617 2559 generic.go:356] "Generic (PLEG): container finished" podID="508bc053-6063-4200-be89-8f4d497b84c3" containerID="6d46ae4db2805dd427a729880194bf2272c3410b3cf3f80c0705091918bcdeb6" exitCode=0 Sep 17 07:20:28.134085 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:20:28.133670 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-b9485f697-sx2pm" event={"ID":"508bc053-6063-4200-be89-8f4d497b84c3","Type":"ContainerDied","Data":"dac51a1fe93e3db6446fbf074c79fb65b32f992112175a6c318f7b9be57e7227"} Sep 17 07:20:28.134085 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:20:28.133724 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-b9485f697-sx2pm" event={"ID":"508bc053-6063-4200-be89-8f4d497b84c3","Type":"ContainerDied","Data":"6d46ae4db2805dd427a729880194bf2272c3410b3cf3f80c0705091918bcdeb6"} Sep 17 07:20:28.136592 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:20:28.136569 2559 generic.go:356] "Generic (PLEG): container finished" podID="519dfa2c-f934-42d7-a2db-3ec1d12b4f3e" containerID="804e5d7eb4f569071a96052e7623880efc5b6f9fccd34aa4674691b922d98f11" exitCode=0 Sep 17 07:20:28.136592 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:20:28.136589 2559 generic.go:356] "Generic (PLEG): container finished" podID="519dfa2c-f934-42d7-a2db-3ec1d12b4f3e" containerID="d3f84c013becdc05b6795c6903bfd73e3716247010dbd5ddae0e938bc5b1ef3b" exitCode=0 Sep 17 07:20:28.136740 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:20:28.136639 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-b5ff4bdbb-knkhh" event={"ID":"519dfa2c-f934-42d7-a2db-3ec1d12b4f3e","Type":"ContainerDied","Data":"804e5d7eb4f569071a96052e7623880efc5b6f9fccd34aa4674691b922d98f11"} Sep 17 07:20:28.136740 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:20:28.136668 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-b5ff4bdbb-knkhh" event={"ID":"519dfa2c-f934-42d7-a2db-3ec1d12b4f3e","Type":"ContainerDied","Data":"d3f84c013becdc05b6795c6903bfd73e3716247010dbd5ddae0e938bc5b1ef3b"} Sep 17 07:20:33.438078 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:20:33.438030 2559 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-b5ff4bdbb-knkhh" podUID="519dfa2c-f934-42d7-a2db-3ec1d12b4f3e" containerName="ui" probeResult="failure" output="dial tcp 10.134.0.26:8443: connect: connection refused" Sep 17 07:20:33.859159 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:20:33.859116 2559 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-b5ff4bdbb-knkhh" podUID="519dfa2c-f934-42d7-a2db-3ec1d12b4f3e" containerName="online" probeResult="failure" output="Get \"https://10.134.0.26:6567/health\": dial tcp 10.134.0.26:6567: connect: connection refused" Sep 17 07:20:37.058853 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:20:37.058805 2559 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-b9485f697-sx2pm" podUID="508bc053-6063-4200-be89-8f4d497b84c3" containerName="ui" probeResult="failure" output="dial tcp 10.134.0.25:8443: connect: connection refused" Sep 17 07:20:37.382607 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:20:37.382518 2559 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-b9485f697-sx2pm" podUID="508bc053-6063-4200-be89-8f4d497b84c3" containerName="online" probeResult="failure" output="Get \"https://10.134.0.25:6567/health\": dial tcp 10.134.0.25:6567: connect: connection refused" Sep 17 07:20:43.438088 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:20:43.438040 2559 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-b5ff4bdbb-knkhh" podUID="519dfa2c-f934-42d7-a2db-3ec1d12b4f3e" containerName="ui" probeResult="failure" output="dial tcp 10.134.0.26:8443: connect: connection refused" Sep 17 07:20:43.859409 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:20:43.859367 2559 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-b5ff4bdbb-knkhh" podUID="519dfa2c-f934-42d7-a2db-3ec1d12b4f3e" containerName="online" probeResult="failure" output="Get \"https://10.134.0.26:6567/health\": dial tcp 10.134.0.26:6567: connect: connection refused" Sep 17 07:20:47.059157 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:20:47.059103 2559 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-b9485f697-sx2pm" podUID="508bc053-6063-4200-be89-8f4d497b84c3" containerName="ui" probeResult="failure" output="dial tcp 10.134.0.25:8443: connect: connection refused" Sep 17 07:20:47.382688 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:20:47.382596 2559 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-b9485f697-sx2pm" podUID="508bc053-6063-4200-be89-8f4d497b84c3" containerName="online" probeResult="failure" output="Get \"https://10.134.0.25:6567/health\": dial tcp 10.134.0.25:6567: connect: connection refused" Sep 17 07:20:47.382823 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:20:47.382717 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-b9485f697-sx2pm" Sep 17 07:20:53.437947 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:20:53.437898 2559 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-b5ff4bdbb-knkhh" podUID="519dfa2c-f934-42d7-a2db-3ec1d12b4f3e" containerName="ui" probeResult="failure" output="dial tcp 10.134.0.26:8443: connect: connection refused" Sep 17 07:20:53.438411 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:20:53.438050 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-b5ff4bdbb-knkhh" Sep 17 07:20:53.858827 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:20:53.858789 2559 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-b5ff4bdbb-knkhh" podUID="519dfa2c-f934-42d7-a2db-3ec1d12b4f3e" containerName="online" probeResult="failure" output="Get \"https://10.134.0.26:6567/health\": dial tcp 10.134.0.26:6567: connect: connection refused" Sep 17 07:20:53.858985 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:20:53.858900 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-b5ff4bdbb-knkhh" Sep 17 07:20:57.058875 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:20:57.058839 2559 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-b9485f697-sx2pm" podUID="508bc053-6063-4200-be89-8f4d497b84c3" containerName="offline" probeResult="failure" output="dial tcp 10.134.0.25:8816: connect: connection refused" Sep 17 07:20:57.059291 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:20:57.058832 2559 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-b9485f697-sx2pm" podUID="508bc053-6063-4200-be89-8f4d497b84c3" containerName="registry" probeResult="failure" output="dial tcp 10.134.0.25:6571: connect: connection refused" Sep 17 07:20:57.059291 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:20:57.058840 2559 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-b9485f697-sx2pm" podUID="508bc053-6063-4200-be89-8f4d497b84c3" containerName="ui" probeResult="failure" output="dial tcp 10.134.0.25:8443: connect: connection refused" Sep 17 07:20:57.059291 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:20:57.059095 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-b9485f697-sx2pm" Sep 17 07:20:57.259429 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:20:57.259394 2559 generic.go:356] "Generic (PLEG): container finished" podID="508bc053-6063-4200-be89-8f4d497b84c3" containerID="766aa70477b311c6f4a9e13d5f17d1aee37f73d34b4c49db31d30cc790f5759e" exitCode=137 Sep 17 07:20:57.259429 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:20:57.259420 2559 generic.go:356] "Generic (PLEG): container finished" podID="508bc053-6063-4200-be89-8f4d497b84c3" containerID="93a12f29569cc26ae2756e92c3c905423859d98df2e74f2cb630bef10df7b3fc" exitCode=137 Sep 17 07:20:57.259649 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:20:57.259462 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-b9485f697-sx2pm" event={"ID":"508bc053-6063-4200-be89-8f4d497b84c3","Type":"ContainerDied","Data":"766aa70477b311c6f4a9e13d5f17d1aee37f73d34b4c49db31d30cc790f5759e"} Sep 17 07:20:57.259649 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:20:57.259506 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-b9485f697-sx2pm" event={"ID":"508bc053-6063-4200-be89-8f4d497b84c3","Type":"ContainerDied","Data":"93a12f29569cc26ae2756e92c3c905423859d98df2e74f2cb630bef10df7b3fc"} Sep 17 07:20:57.262342 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:20:57.262315 2559 generic.go:356] "Generic (PLEG): container finished" podID="519dfa2c-f934-42d7-a2db-3ec1d12b4f3e" containerID="f4cc1a76188169a67603b23e21aeafb3b4ccbb516084302213703b96381dffe6" exitCode=137 Sep 17 07:20:57.262474 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:20:57.262379 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-b5ff4bdbb-knkhh" event={"ID":"519dfa2c-f934-42d7-a2db-3ec1d12b4f3e","Type":"ContainerDied","Data":"f4cc1a76188169a67603b23e21aeafb3b4ccbb516084302213703b96381dffe6"} Sep 17 07:20:57.382217 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:20:57.382170 2559 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-b9485f697-sx2pm" podUID="508bc053-6063-4200-be89-8f4d497b84c3" containerName="online" probeResult="failure" output="Get \"https://10.134.0.25:6567/health\": dial tcp 10.134.0.25:6567: connect: connection refused" Sep 17 07:20:57.537676 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:20:57.537644 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-b5ff4bdbb-knkhh" Sep 17 07:20:57.658221 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:20:57.658188 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-b9485f697-sx2pm" Sep 17 07:20:57.670563 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:20:57.670527 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/configmap/519dfa2c-f934-42d7-a2db-3ec1d12b4f3e-registry-tls\") pod \"519dfa2c-f934-42d7-a2db-3ec1d12b4f3e\" (UID: \"519dfa2c-f934-42d7-a2db-3ec1d12b4f3e\") " Sep 17 07:20:57.670563 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:20:57.670566 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/519dfa2c-f934-42d7-a2db-3ec1d12b4f3e-offline-tls\") pod \"519dfa2c-f934-42d7-a2db-3ec1d12b4f3e\" (UID: \"519dfa2c-f934-42d7-a2db-3ec1d12b4f3e\") " Sep 17 07:20:57.670837 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:20:57.670613 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/519dfa2c-f934-42d7-a2db-3ec1d12b4f3e-online-tls\") pod \"519dfa2c-f934-42d7-a2db-3ec1d12b4f3e\" (UID: \"519dfa2c-f934-42d7-a2db-3ec1d12b4f3e\") " Sep 17 07:20:57.670837 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:20:57.670651 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tp7n5\" (UniqueName: \"kubernetes.io/projected/519dfa2c-f934-42d7-a2db-3ec1d12b4f3e-kube-api-access-tp7n5\") pod \"519dfa2c-f934-42d7-a2db-3ec1d12b4f3e\" (UID: \"519dfa2c-f934-42d7-a2db-3ec1d12b4f3e\") " Sep 17 07:20:57.670837 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:20:57.670695 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/519dfa2c-f934-42d7-a2db-3ec1d12b4f3e-feast-data\") pod \"519dfa2c-f934-42d7-a2db-3ec1d12b4f3e\" (UID: \"519dfa2c-f934-42d7-a2db-3ec1d12b4f3e\") " Sep 17 07:20:57.671032 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:20:57.670851 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/519dfa2c-f934-42d7-a2db-3ec1d12b4f3e-ui-tls\") pod \"519dfa2c-f934-42d7-a2db-3ec1d12b4f3e\" (UID: \"519dfa2c-f934-42d7-a2db-3ec1d12b4f3e\") " Sep 17 07:20:57.671095 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:20:57.671019 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/519dfa2c-f934-42d7-a2db-3ec1d12b4f3e-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "519dfa2c-f934-42d7-a2db-3ec1d12b4f3e" (UID: "519dfa2c-f934-42d7-a2db-3ec1d12b4f3e"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 17 07:20:57.671248 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:20:57.671225 2559 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/configmap/519dfa2c-f934-42d7-a2db-3ec1d12b4f3e-registry-tls\") on node \"ip-10-0-138-13.ec2.internal\" DevicePath \"\"" Sep 17 07:20:57.671326 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:20:57.671251 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/519dfa2c-f934-42d7-a2db-3ec1d12b4f3e-feast-data" (OuterVolumeSpecName: "feast-data") pod "519dfa2c-f934-42d7-a2db-3ec1d12b4f3e" (UID: "519dfa2c-f934-42d7-a2db-3ec1d12b4f3e"). InnerVolumeSpecName "feast-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 17 07:20:57.673070 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:20:57.673037 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/519dfa2c-f934-42d7-a2db-3ec1d12b4f3e-online-tls" (OuterVolumeSpecName: "online-tls") pod "519dfa2c-f934-42d7-a2db-3ec1d12b4f3e" (UID: "519dfa2c-f934-42d7-a2db-3ec1d12b4f3e"). InnerVolumeSpecName "online-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 17 07:20:57.673206 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:20:57.673049 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/519dfa2c-f934-42d7-a2db-3ec1d12b4f3e-offline-tls" (OuterVolumeSpecName: "offline-tls") pod "519dfa2c-f934-42d7-a2db-3ec1d12b4f3e" (UID: "519dfa2c-f934-42d7-a2db-3ec1d12b4f3e"). InnerVolumeSpecName "offline-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 17 07:20:57.673248 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:20:57.673213 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/519dfa2c-f934-42d7-a2db-3ec1d12b4f3e-kube-api-access-tp7n5" (OuterVolumeSpecName: "kube-api-access-tp7n5") pod "519dfa2c-f934-42d7-a2db-3ec1d12b4f3e" (UID: "519dfa2c-f934-42d7-a2db-3ec1d12b4f3e"). InnerVolumeSpecName "kube-api-access-tp7n5". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 17 07:20:57.675058 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:20:57.673456 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/519dfa2c-f934-42d7-a2db-3ec1d12b4f3e-ui-tls" (OuterVolumeSpecName: "ui-tls") pod "519dfa2c-f934-42d7-a2db-3ec1d12b4f3e" (UID: "519dfa2c-f934-42d7-a2db-3ec1d12b4f3e"). InnerVolumeSpecName "ui-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 17 07:20:57.772250 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:20:57.772060 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/508bc053-6063-4200-be89-8f4d497b84c3-online-tls\") pod \"508bc053-6063-4200-be89-8f4d497b84c3\" (UID: \"508bc053-6063-4200-be89-8f4d497b84c3\") " Sep 17 07:20:57.772250 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:20:57.772133 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/508bc053-6063-4200-be89-8f4d497b84c3-offline-tls\") pod \"508bc053-6063-4200-be89-8f4d497b84c3\" (UID: \"508bc053-6063-4200-be89-8f4d497b84c3\") " Sep 17 07:20:57.772250 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:20:57.772176 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/508bc053-6063-4200-be89-8f4d497b84c3-registry-tls\") pod \"508bc053-6063-4200-be89-8f4d497b84c3\" (UID: \"508bc053-6063-4200-be89-8f4d497b84c3\") " Sep 17 07:20:57.772654 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:20:57.772278 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qsjk8\" (UniqueName: \"kubernetes.io/projected/508bc053-6063-4200-be89-8f4d497b84c3-kube-api-access-qsjk8\") pod \"508bc053-6063-4200-be89-8f4d497b84c3\" (UID: \"508bc053-6063-4200-be89-8f4d497b84c3\") " Sep 17 07:20:57.772654 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:20:57.772344 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/508bc053-6063-4200-be89-8f4d497b84c3-feast-data\") pod \"508bc053-6063-4200-be89-8f4d497b84c3\" (UID: \"508bc053-6063-4200-be89-8f4d497b84c3\") " Sep 17 07:20:57.772654 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:20:57.772405 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/508bc053-6063-4200-be89-8f4d497b84c3-ui-tls\") pod \"508bc053-6063-4200-be89-8f4d497b84c3\" (UID: \"508bc053-6063-4200-be89-8f4d497b84c3\") " Sep 17 07:20:57.772811 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:20:57.772772 2559 reconciler_common.go:299] "Volume detached for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/519dfa2c-f934-42d7-a2db-3ec1d12b4f3e-ui-tls\") on node \"ip-10-0-138-13.ec2.internal\" DevicePath \"\"" Sep 17 07:20:57.772811 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:20:57.772792 2559 reconciler_common.go:299] "Volume detached for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/519dfa2c-f934-42d7-a2db-3ec1d12b4f3e-offline-tls\") on node \"ip-10-0-138-13.ec2.internal\" DevicePath \"\"" Sep 17 07:20:57.772904 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:20:57.772811 2559 reconciler_common.go:299] "Volume detached for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/519dfa2c-f934-42d7-a2db-3ec1d12b4f3e-online-tls\") on node \"ip-10-0-138-13.ec2.internal\" DevicePath \"\"" Sep 17 07:20:57.772904 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:20:57.772829 2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tp7n5\" (UniqueName: \"kubernetes.io/projected/519dfa2c-f934-42d7-a2db-3ec1d12b4f3e-kube-api-access-tp7n5\") on node \"ip-10-0-138-13.ec2.internal\" DevicePath \"\"" Sep 17 07:20:57.772904 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:20:57.772844 2559 reconciler_common.go:299] "Volume detached for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/519dfa2c-f934-42d7-a2db-3ec1d12b4f3e-feast-data\") on node \"ip-10-0-138-13.ec2.internal\" DevicePath \"\"" Sep 17 07:20:57.773261 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:20:57.773213 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/508bc053-6063-4200-be89-8f4d497b84c3-feast-data" (OuterVolumeSpecName: "feast-data") pod "508bc053-6063-4200-be89-8f4d497b84c3" (UID: "508bc053-6063-4200-be89-8f4d497b84c3"). InnerVolumeSpecName "feast-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 17 07:20:57.774997 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:20:57.774943 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/508bc053-6063-4200-be89-8f4d497b84c3-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "508bc053-6063-4200-be89-8f4d497b84c3" (UID: "508bc053-6063-4200-be89-8f4d497b84c3"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 17 07:20:57.775341 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:20:57.775315 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/508bc053-6063-4200-be89-8f4d497b84c3-online-tls" (OuterVolumeSpecName: "online-tls") pod "508bc053-6063-4200-be89-8f4d497b84c3" (UID: "508bc053-6063-4200-be89-8f4d497b84c3"). InnerVolumeSpecName "online-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 17 07:20:57.775422 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:20:57.775371 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/508bc053-6063-4200-be89-8f4d497b84c3-ui-tls" (OuterVolumeSpecName: "ui-tls") pod "508bc053-6063-4200-be89-8f4d497b84c3" (UID: "508bc053-6063-4200-be89-8f4d497b84c3"). InnerVolumeSpecName "ui-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 17 07:20:57.775480 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:20:57.775429 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/508bc053-6063-4200-be89-8f4d497b84c3-offline-tls" (OuterVolumeSpecName: "offline-tls") pod "508bc053-6063-4200-be89-8f4d497b84c3" (UID: "508bc053-6063-4200-be89-8f4d497b84c3"). InnerVolumeSpecName "offline-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 17 07:20:57.775480 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:20:57.775449 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/508bc053-6063-4200-be89-8f4d497b84c3-kube-api-access-qsjk8" (OuterVolumeSpecName: "kube-api-access-qsjk8") pod "508bc053-6063-4200-be89-8f4d497b84c3" (UID: "508bc053-6063-4200-be89-8f4d497b84c3"). InnerVolumeSpecName "kube-api-access-qsjk8". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 17 07:20:57.874098 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:20:57.874057 2559 reconciler_common.go:299] "Volume detached for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/508bc053-6063-4200-be89-8f4d497b84c3-online-tls\") on node \"ip-10-0-138-13.ec2.internal\" DevicePath \"\"" Sep 17 07:20:57.874098 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:20:57.874087 2559 reconciler_common.go:299] "Volume detached for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/508bc053-6063-4200-be89-8f4d497b84c3-offline-tls\") on node \"ip-10-0-138-13.ec2.internal\" DevicePath \"\"" Sep 17 07:20:57.874098 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:20:57.874097 2559 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/508bc053-6063-4200-be89-8f4d497b84c3-registry-tls\") on node \"ip-10-0-138-13.ec2.internal\" DevicePath \"\"" Sep 17 07:20:57.874098 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:20:57.874106 2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qsjk8\" (UniqueName: \"kubernetes.io/projected/508bc053-6063-4200-be89-8f4d497b84c3-kube-api-access-qsjk8\") on node \"ip-10-0-138-13.ec2.internal\" DevicePath \"\"" Sep 17 07:20:57.874363 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:20:57.874117 2559 reconciler_common.go:299] "Volume detached for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/508bc053-6063-4200-be89-8f4d497b84c3-feast-data\") on node \"ip-10-0-138-13.ec2.internal\" DevicePath \"\"" Sep 17 07:20:57.874363 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:20:57.874125 2559 reconciler_common.go:299] "Volume detached for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/508bc053-6063-4200-be89-8f4d497b84c3-ui-tls\") on node \"ip-10-0-138-13.ec2.internal\" DevicePath \"\"" Sep 17 07:20:58.269084 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:20:58.269050 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-b9485f697-sx2pm" event={"ID":"508bc053-6063-4200-be89-8f4d497b84c3","Type":"ContainerDied","Data":"2e891c26f1407e6c2230763227d29e4257adc62e967a68d04dd58961b9d5b9af"} Sep 17 07:20:58.269084 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:20:58.269078 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-b9485f697-sx2pm" Sep 17 07:20:58.269596 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:20:58.269113 2559 scope.go:117] "RemoveContainer" containerID="dac51a1fe93e3db6446fbf074c79fb65b32f992112175a6c318f7b9be57e7227" Sep 17 07:20:58.271963 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:20:58.271935 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-b5ff4bdbb-knkhh" event={"ID":"519dfa2c-f934-42d7-a2db-3ec1d12b4f3e","Type":"ContainerDied","Data":"88e886ff5b2f8db00b93f8294299b219a8757b0837ed6b98004b464920923368"} Sep 17 07:20:58.272099 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:20:58.272036 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-b5ff4bdbb-knkhh" Sep 17 07:20:58.278354 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:20:58.278334 2559 scope.go:117] "RemoveContainer" containerID="766aa70477b311c6f4a9e13d5f17d1aee37f73d34b4c49db31d30cc790f5759e" Sep 17 07:20:58.286665 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:20:58.286647 2559 scope.go:117] "RemoveContainer" containerID="6d46ae4db2805dd427a729880194bf2272c3410b3cf3f80c0705091918bcdeb6" Sep 17 07:20:58.294035 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:20:58.294017 2559 scope.go:117] "RemoveContainer" containerID="93a12f29569cc26ae2756e92c3c905423859d98df2e74f2cb630bef10df7b3fc" Sep 17 07:20:58.298341 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:20:58.298319 2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-b9485f697-sx2pm"] Sep 17 07:20:58.302183 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:20:58.302145 2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-b9485f697-sx2pm"] Sep 17 07:20:58.302254 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:20:58.302199 2559 scope.go:117] "RemoveContainer" containerID="4a6d1a7f256c38cd941132f6d7dcada914c10b2ec2917efc92e2397543fdccf4" Sep 17 07:20:58.309237 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:20:58.309224 2559 scope.go:117] "RemoveContainer" containerID="8626f3b33f5538a9712b872a5fb03551e0cccecee56f86b3abd18a4003969162" Sep 17 07:20:58.316183 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:20:58.316169 2559 scope.go:117] "RemoveContainer" containerID="804e5d7eb4f569071a96052e7623880efc5b6f9fccd34aa4674691b922d98f11" Sep 17 07:20:58.321228 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:20:58.321209 2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-b5ff4bdbb-knkhh"] Sep 17 07:20:58.323277 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:20:58.323261 2559 scope.go:117] "RemoveContainer" containerID="f4cc1a76188169a67603b23e21aeafb3b4ccbb516084302213703b96381dffe6" Sep 17 07:20:58.330535 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:20:58.330517 2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-b5ff4bdbb-knkhh"] Sep 17 07:20:58.330761 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:20:58.330747 2559 scope.go:117] "RemoveContainer" containerID="d3f84c013becdc05b6795c6903bfd73e3716247010dbd5ddae0e938bc5b1ef3b" Sep 17 07:20:58.337777 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:20:58.337760 2559 scope.go:117] "RemoveContainer" containerID="215490091bfe7b0992448c905d1328e8c8cfcaeccbfaca781324dee68962292b" Sep 17 07:20:58.344543 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:20:58.344524 2559 scope.go:117] "RemoveContainer" containerID="0cea47f33b5640bd77e854f4eb8572b6248b5b6cda13d4f0c763cfc819c94ea5" Sep 17 07:20:58.898398 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:20:58.898369 2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="508bc053-6063-4200-be89-8f4d497b84c3" path="/var/lib/kubelet/pods/508bc053-6063-4200-be89-8f4d497b84c3/volumes" Sep 17 07:20:58.899036 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:20:58.899019 2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="519dfa2c-f934-42d7-a2db-3ec1d12b4f3e" path="/var/lib/kubelet/pods/519dfa2c-f934-42d7-a2db-3ec1d12b4f3e/volumes" Sep 17 07:21:10.174029 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:21:10.173997 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["test-ns-feast/redis-69bbd798b6-w2mvj"] Sep 17 07:21:10.174497 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:21:10.174340 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="508bc053-6063-4200-be89-8f4d497b84c3" containerName="online" Sep 17 07:21:10.174497 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:21:10.174352 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="508bc053-6063-4200-be89-8f4d497b84c3" containerName="online" Sep 17 07:21:10.174497 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:21:10.174364 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="508bc053-6063-4200-be89-8f4d497b84c3" containerName="registry" Sep 17 07:21:10.174497 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:21:10.174371 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="508bc053-6063-4200-be89-8f4d497b84c3" containerName="registry" Sep 17 07:21:10.174497 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:21:10.174378 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="519dfa2c-f934-42d7-a2db-3ec1d12b4f3e" containerName="online" Sep 17 07:21:10.174497 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:21:10.174383 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="519dfa2c-f934-42d7-a2db-3ec1d12b4f3e" containerName="online" Sep 17 07:21:10.174497 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:21:10.174396 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="508bc053-6063-4200-be89-8f4d497b84c3" containerName="feast-apply" Sep 17 07:21:10.174497 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:21:10.174405 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="508bc053-6063-4200-be89-8f4d497b84c3" containerName="feast-apply" Sep 17 07:21:10.174497 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:21:10.174414 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="519dfa2c-f934-42d7-a2db-3ec1d12b4f3e" containerName="offline" Sep 17 07:21:10.174497 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:21:10.174420 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="519dfa2c-f934-42d7-a2db-3ec1d12b4f3e" containerName="offline" Sep 17 07:21:10.174497 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:21:10.174428 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="519dfa2c-f934-42d7-a2db-3ec1d12b4f3e" containerName="feast-init" Sep 17 07:21:10.174497 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:21:10.174433 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="519dfa2c-f934-42d7-a2db-3ec1d12b4f3e" containerName="feast-init" Sep 17 07:21:10.174497 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:21:10.174440 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="519dfa2c-f934-42d7-a2db-3ec1d12b4f3e" containerName="feast-apply" Sep 17 07:21:10.174497 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:21:10.174445 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="519dfa2c-f934-42d7-a2db-3ec1d12b4f3e" containerName="feast-apply" Sep 17 07:21:10.174497 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:21:10.174452 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="508bc053-6063-4200-be89-8f4d497b84c3" containerName="offline" Sep 17 07:21:10.174497 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:21:10.174457 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="508bc053-6063-4200-be89-8f4d497b84c3" containerName="offline" Sep 17 07:21:10.174497 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:21:10.174463 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="519dfa2c-f934-42d7-a2db-3ec1d12b4f3e" containerName="ui" Sep 17 07:21:10.174497 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:21:10.174469 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="519dfa2c-f934-42d7-a2db-3ec1d12b4f3e" containerName="ui" Sep 17 07:21:10.174497 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:21:10.174485 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="508bc053-6063-4200-be89-8f4d497b84c3" containerName="ui" Sep 17 07:21:10.174497 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:21:10.174491 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="508bc053-6063-4200-be89-8f4d497b84c3" containerName="ui" Sep 17 07:21:10.174497 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:21:10.174498 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="508bc053-6063-4200-be89-8f4d497b84c3" containerName="feast-init" Sep 17 07:21:10.174497 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:21:10.174503 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="508bc053-6063-4200-be89-8f4d497b84c3" containerName="feast-init" Sep 17 07:21:10.175692 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:21:10.174550 2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="508bc053-6063-4200-be89-8f4d497b84c3" containerName="registry" Sep 17 07:21:10.175692 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:21:10.174565 2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="519dfa2c-f934-42d7-a2db-3ec1d12b4f3e" containerName="online" Sep 17 07:21:10.175692 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:21:10.174572 2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="508bc053-6063-4200-be89-8f4d497b84c3" containerName="online" Sep 17 07:21:10.175692 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:21:10.174578 2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="508bc053-6063-4200-be89-8f4d497b84c3" containerName="ui" Sep 17 07:21:10.175692 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:21:10.174583 2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="519dfa2c-f934-42d7-a2db-3ec1d12b4f3e" containerName="offline" Sep 17 07:21:10.175692 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:21:10.174590 2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="508bc053-6063-4200-be89-8f4d497b84c3" containerName="offline" Sep 17 07:21:10.175692 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:21:10.174595 2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="519dfa2c-f934-42d7-a2db-3ec1d12b4f3e" containerName="ui" Sep 17 07:21:10.177096 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:21:10.177073 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/redis-69bbd798b6-w2mvj" Sep 17 07:21:10.180070 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:21:10.180050 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"default-dockercfg-qcmsg\"" Sep 17 07:21:10.180181 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:21:10.180081 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast\"/\"openshift-service-ca.crt\"" Sep 17 07:21:10.180750 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:21:10.180731 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast\"/\"kube-root-ca.crt\"" Sep 17 07:21:10.181010 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:21:10.180990 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zdzqm\" (UniqueName: \"kubernetes.io/projected/34735e40-9e8e-4912-8fad-188871430ea0-kube-api-access-zdzqm\") pod \"redis-69bbd798b6-w2mvj\" (UID: \"34735e40-9e8e-4912-8fad-188871430ea0\") " pod="test-ns-feast/redis-69bbd798b6-w2mvj" Sep 17 07:21:10.188271 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:21:10.188252 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/redis-69bbd798b6-w2mvj"] Sep 17 07:21:10.282372 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:21:10.282337 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zdzqm\" (UniqueName: \"kubernetes.io/projected/34735e40-9e8e-4912-8fad-188871430ea0-kube-api-access-zdzqm\") pod \"redis-69bbd798b6-w2mvj\" (UID: \"34735e40-9e8e-4912-8fad-188871430ea0\") " pod="test-ns-feast/redis-69bbd798b6-w2mvj" Sep 17 07:21:10.291384 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:21:10.291354 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zdzqm\" (UniqueName: \"kubernetes.io/projected/34735e40-9e8e-4912-8fad-188871430ea0-kube-api-access-zdzqm\") pod \"redis-69bbd798b6-w2mvj\" (UID: \"34735e40-9e8e-4912-8fad-188871430ea0\") " pod="test-ns-feast/redis-69bbd798b6-w2mvj" Sep 17 07:21:10.500122 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:21:10.500097 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/redis-69bbd798b6-w2mvj" Sep 17 07:21:10.768556 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:21:10.768534 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/redis-69bbd798b6-w2mvj"] Sep 17 07:21:10.770778 ip-10-0-138-13 kubenswrapper[2559]: W0917 07:21:10.770750 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod34735e40_9e8e_4912_8fad_188871430ea0.slice/crio-efb8719594120db2ad9abd56032724c60234989120f9d0b6442c1bd8c7f4d21b WatchSource:0}: Error finding container efb8719594120db2ad9abd56032724c60234989120f9d0b6442c1bd8c7f4d21b: Status 404 returned error can't find the container with id efb8719594120db2ad9abd56032724c60234989120f9d0b6442c1bd8c7f4d21b Sep 17 07:21:10.772578 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:21:10.772560 2559 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Sep 17 07:21:11.331548 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:21:11.331508 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/redis-69bbd798b6-w2mvj" event={"ID":"34735e40-9e8e-4912-8fad-188871430ea0","Type":"ContainerStarted","Data":"efb8719594120db2ad9abd56032724c60234989120f9d0b6442c1bd8c7f4d21b"} Sep 17 07:21:12.336708 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:21:12.336630 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/redis-69bbd798b6-w2mvj" event={"ID":"34735e40-9e8e-4912-8fad-188871430ea0","Type":"ContainerStarted","Data":"c2893eb0e105e666f8036a2dd611262f4ee8e748cc79c327a6f13f0a65795a52"} Sep 17 07:21:12.353551 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:21:12.353500 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="test-ns-feast/redis-69bbd798b6-w2mvj" podStartSLOduration=1.098433101 podStartE2EDuration="2.353483475s" totalImagesPullingTime="1.255050374s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 07:21:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 07:21:12.353382767 +0000 UTC m=+779.901529480" watchObservedRunningTime="2026-09-17 07:21:12.353483475 +0000 UTC m=+779.901630185" Sep 17 07:21:23.331046 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:21:23.331010 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["test-ns-feast/feast-credit-scoring-7df46bdb47-8vt5r"] Sep 17 07:21:23.336046 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:21:23.336029 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-credit-scoring-7df46bdb47-8vt5r" Sep 17 07:21:23.339899 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:21:23.339854 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-credit-scoring-online-tls\"" Sep 17 07:21:23.340185 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:21:23.340085 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-credit-scoring-registry-tls\"" Sep 17 07:21:23.340992 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:21:23.340954 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"postgres-secret\"" Sep 17 07:21:23.341074 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:21:23.341055 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast\"/\"feast-credit-scoring-intra-comm\"" Sep 17 07:21:23.341207 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:21:23.341190 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-credit-scoring-dockercfg-fg4dp\"" Sep 17 07:21:23.341415 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:21:23.341401 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-credit-scoring-offline-tls\"" Sep 17 07:21:23.360586 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:21:23.360548 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/feast-credit-scoring-7df46bdb47-8vt5r"] Sep 17 07:21:23.403853 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:21:23.403821 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/5ba2d920-50db-4402-b57a-9720acaf7535-online-tls\") pod \"feast-credit-scoring-7df46bdb47-8vt5r\" (UID: \"5ba2d920-50db-4402-b57a-9720acaf7535\") " pod="test-ns-feast/feast-credit-scoring-7df46bdb47-8vt5r" Sep 17 07:21:23.404032 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:21:23.403860 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/5ba2d920-50db-4402-b57a-9720acaf7535-feast-data\") pod \"feast-credit-scoring-7df46bdb47-8vt5r\" (UID: \"5ba2d920-50db-4402-b57a-9720acaf7535\") " pod="test-ns-feast/feast-credit-scoring-7df46bdb47-8vt5r" Sep 17 07:21:23.404032 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:21:23.403934 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5mgxn\" (UniqueName: \"kubernetes.io/projected/5ba2d920-50db-4402-b57a-9720acaf7535-kube-api-access-5mgxn\") pod \"feast-credit-scoring-7df46bdb47-8vt5r\" (UID: \"5ba2d920-50db-4402-b57a-9720acaf7535\") " pod="test-ns-feast/feast-credit-scoring-7df46bdb47-8vt5r" Sep 17 07:21:23.404032 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:21:23.403960 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/5ba2d920-50db-4402-b57a-9720acaf7535-offline-tls\") pod \"feast-credit-scoring-7df46bdb47-8vt5r\" (UID: \"5ba2d920-50db-4402-b57a-9720acaf7535\") " pod="test-ns-feast/feast-credit-scoring-7df46bdb47-8vt5r" Sep 17 07:21:23.404032 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:21:23.404028 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/5ba2d920-50db-4402-b57a-9720acaf7535-registry-tls\") pod \"feast-credit-scoring-7df46bdb47-8vt5r\" (UID: \"5ba2d920-50db-4402-b57a-9720acaf7535\") " pod="test-ns-feast/feast-credit-scoring-7df46bdb47-8vt5r" Sep 17 07:21:23.504615 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:21:23.504575 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5mgxn\" (UniqueName: \"kubernetes.io/projected/5ba2d920-50db-4402-b57a-9720acaf7535-kube-api-access-5mgxn\") pod \"feast-credit-scoring-7df46bdb47-8vt5r\" (UID: \"5ba2d920-50db-4402-b57a-9720acaf7535\") " pod="test-ns-feast/feast-credit-scoring-7df46bdb47-8vt5r" Sep 17 07:21:23.504615 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:21:23.504622 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/5ba2d920-50db-4402-b57a-9720acaf7535-offline-tls\") pod \"feast-credit-scoring-7df46bdb47-8vt5r\" (UID: \"5ba2d920-50db-4402-b57a-9720acaf7535\") " pod="test-ns-feast/feast-credit-scoring-7df46bdb47-8vt5r" Sep 17 07:21:23.504833 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:21:23.504669 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/5ba2d920-50db-4402-b57a-9720acaf7535-registry-tls\") pod \"feast-credit-scoring-7df46bdb47-8vt5r\" (UID: \"5ba2d920-50db-4402-b57a-9720acaf7535\") " pod="test-ns-feast/feast-credit-scoring-7df46bdb47-8vt5r" Sep 17 07:21:23.504833 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:21:23.504697 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/5ba2d920-50db-4402-b57a-9720acaf7535-online-tls\") pod \"feast-credit-scoring-7df46bdb47-8vt5r\" (UID: \"5ba2d920-50db-4402-b57a-9720acaf7535\") " pod="test-ns-feast/feast-credit-scoring-7df46bdb47-8vt5r" Sep 17 07:21:23.504833 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:21:23.504724 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/5ba2d920-50db-4402-b57a-9720acaf7535-feast-data\") pod \"feast-credit-scoring-7df46bdb47-8vt5r\" (UID: \"5ba2d920-50db-4402-b57a-9720acaf7535\") " pod="test-ns-feast/feast-credit-scoring-7df46bdb47-8vt5r" Sep 17 07:21:23.505231 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:21:23.505203 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/5ba2d920-50db-4402-b57a-9720acaf7535-feast-data\") pod \"feast-credit-scoring-7df46bdb47-8vt5r\" (UID: \"5ba2d920-50db-4402-b57a-9720acaf7535\") " pod="test-ns-feast/feast-credit-scoring-7df46bdb47-8vt5r" Sep 17 07:21:23.507224 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:21:23.507200 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/5ba2d920-50db-4402-b57a-9720acaf7535-offline-tls\") pod \"feast-credit-scoring-7df46bdb47-8vt5r\" (UID: \"5ba2d920-50db-4402-b57a-9720acaf7535\") " pod="test-ns-feast/feast-credit-scoring-7df46bdb47-8vt5r" Sep 17 07:21:23.507363 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:21:23.507342 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/5ba2d920-50db-4402-b57a-9720acaf7535-registry-tls\") pod \"feast-credit-scoring-7df46bdb47-8vt5r\" (UID: \"5ba2d920-50db-4402-b57a-9720acaf7535\") " pod="test-ns-feast/feast-credit-scoring-7df46bdb47-8vt5r" Sep 17 07:21:23.507424 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:21:23.507352 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/5ba2d920-50db-4402-b57a-9720acaf7535-online-tls\") pod \"feast-credit-scoring-7df46bdb47-8vt5r\" (UID: \"5ba2d920-50db-4402-b57a-9720acaf7535\") " pod="test-ns-feast/feast-credit-scoring-7df46bdb47-8vt5r" Sep 17 07:21:23.515487 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:21:23.515467 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5mgxn\" (UniqueName: \"kubernetes.io/projected/5ba2d920-50db-4402-b57a-9720acaf7535-kube-api-access-5mgxn\") pod \"feast-credit-scoring-7df46bdb47-8vt5r\" (UID: \"5ba2d920-50db-4402-b57a-9720acaf7535\") " pod="test-ns-feast/feast-credit-scoring-7df46bdb47-8vt5r" Sep 17 07:21:23.645788 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:21:23.645696 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-credit-scoring-7df46bdb47-8vt5r" Sep 17 07:21:23.935895 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:21:23.935864 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/feast-credit-scoring-7df46bdb47-8vt5r"] Sep 17 07:21:23.936110 ip-10-0-138-13 kubenswrapper[2559]: W0917 07:21:23.936090 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5ba2d920_50db_4402_b57a_9720acaf7535.slice/crio-89d550b1b2b4b8f04d36eb91438587e820efdeeb7b3b7fea6bbba76f908435e0 WatchSource:0}: Error finding container 89d550b1b2b4b8f04d36eb91438587e820efdeeb7b3b7fea6bbba76f908435e0: Status 404 returned error can't find the container with id 89d550b1b2b4b8f04d36eb91438587e820efdeeb7b3b7fea6bbba76f908435e0 Sep 17 07:21:24.388082 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:21:24.388046 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-credit-scoring-7df46bdb47-8vt5r" event={"ID":"5ba2d920-50db-4402-b57a-9720acaf7535","Type":"ContainerStarted","Data":"da37851bbd7a1cf53f35f77acc3050a30b36267678d090ebb45d3fa2aa9d6935"} Sep 17 07:21:24.388539 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:21:24.388102 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-credit-scoring-7df46bdb47-8vt5r" event={"ID":"5ba2d920-50db-4402-b57a-9720acaf7535","Type":"ContainerStarted","Data":"89d550b1b2b4b8f04d36eb91438587e820efdeeb7b3b7fea6bbba76f908435e0"} Sep 17 07:21:25.393540 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:21:25.393446 2559 generic.go:356] "Generic (PLEG): container finished" podID="5ba2d920-50db-4402-b57a-9720acaf7535" containerID="da37851bbd7a1cf53f35f77acc3050a30b36267678d090ebb45d3fa2aa9d6935" exitCode=0 Sep 17 07:21:25.393540 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:21:25.393500 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-credit-scoring-7df46bdb47-8vt5r" event={"ID":"5ba2d920-50db-4402-b57a-9720acaf7535","Type":"ContainerDied","Data":"da37851bbd7a1cf53f35f77acc3050a30b36267678d090ebb45d3fa2aa9d6935"} Sep 17 07:21:26.400512 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:21:26.400476 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-credit-scoring-7df46bdb47-8vt5r" event={"ID":"5ba2d920-50db-4402-b57a-9720acaf7535","Type":"ContainerStarted","Data":"882909adb7d399a2c02eaf5ad51cffddbb84e23ebce76abf06d727e9696698da"} Sep 17 07:21:32.429565 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:21:32.429528 2559 generic.go:356] "Generic (PLEG): container finished" podID="5ba2d920-50db-4402-b57a-9720acaf7535" containerID="882909adb7d399a2c02eaf5ad51cffddbb84e23ebce76abf06d727e9696698da" exitCode=0 Sep 17 07:21:32.430035 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:21:32.429601 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-credit-scoring-7df46bdb47-8vt5r" event={"ID":"5ba2d920-50db-4402-b57a-9720acaf7535","Type":"ContainerDied","Data":"882909adb7d399a2c02eaf5ad51cffddbb84e23ebce76abf06d727e9696698da"} Sep 17 07:21:33.439056 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:21:33.439013 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-credit-scoring-7df46bdb47-8vt5r" event={"ID":"5ba2d920-50db-4402-b57a-9720acaf7535","Type":"ContainerStarted","Data":"188c87a5b4e9e2edf6aa5ab35a70a963bad6689831a53e0df1d1a9cded552437"} Sep 17 07:21:33.439518 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:21:33.439099 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-credit-scoring-7df46bdb47-8vt5r" event={"ID":"5ba2d920-50db-4402-b57a-9720acaf7535","Type":"ContainerStarted","Data":"a79a1ddb65605b4cbd676bed8667095370ed38c767fccd00fe4df03086bd72fe"} Sep 17 07:21:33.439518 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:21:33.439131 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-credit-scoring-7df46bdb47-8vt5r" event={"ID":"5ba2d920-50db-4402-b57a-9720acaf7535","Type":"ContainerStarted","Data":"0dee303700304eca155ef577696fa95017b7fffb4d85540a30ba9344f167399e"} Sep 17 07:21:33.481252 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:21:33.481184 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="test-ns-feast/feast-credit-scoring-7df46bdb47-8vt5r" podStartSLOduration=10.481160619 podStartE2EDuration="10.481160619s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 07:21:23 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 07:21:33.477945684 +0000 UTC m=+801.026092429" watchObservedRunningTime="2026-09-17 07:21:33.481160619 +0000 UTC m=+801.029307329" Sep 17 07:21:33.646720 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:21:33.646683 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-credit-scoring-7df46bdb47-8vt5r" Sep 17 07:21:33.646908 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:21:33.646758 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-credit-scoring-7df46bdb47-8vt5r" Sep 17 07:21:33.646908 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:21:33.646786 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-credit-scoring-7df46bdb47-8vt5r" Sep 17 07:21:35.646334 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:21:35.646236 2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-credit-scoring-7df46bdb47-8vt5r" Sep 17 07:21:35.646334 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:21:35.646321 2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-credit-scoring-7df46bdb47-8vt5r" Sep 17 07:21:35.646860 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:21:35.646346 2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-credit-scoring-7df46bdb47-8vt5r" Sep 17 07:21:35.648718 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:21:35.648673 2559 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-credit-scoring-7df46bdb47-8vt5r" podUID="5ba2d920-50db-4402-b57a-9720acaf7535" containerName="offline" probeResult="failure" output="dial tcp 10.134.0.28:8816: connect: connection refused" Sep 17 07:21:35.648718 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:21:35.648696 2559 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-credit-scoring-7df46bdb47-8vt5r" podUID="5ba2d920-50db-4402-b57a-9720acaf7535" containerName="registry" probeResult="failure" output="dial tcp 10.134.0.28:6571: connect: connection refused" Sep 17 07:21:35.648947 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:21:35.648722 2559 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-credit-scoring-7df46bdb47-8vt5r" podUID="5ba2d920-50db-4402-b57a-9720acaf7535" containerName="online" probeResult="failure" output="Get \"https://10.134.0.28:6567/health\": dial tcp 10.134.0.28:6567: connect: connection refused" Sep 17 07:21:38.646468 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:21:38.646413 2559 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-credit-scoring-7df46bdb47-8vt5r" podUID="5ba2d920-50db-4402-b57a-9720acaf7535" containerName="registry" probeResult="failure" output="dial tcp 10.134.0.28:6571: connect: connection refused" Sep 17 07:21:38.646958 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:21:38.646438 2559 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-credit-scoring-7df46bdb47-8vt5r" podUID="5ba2d920-50db-4402-b57a-9720acaf7535" containerName="offline" probeResult="failure" output="dial tcp 10.134.0.28:8816: connect: connection refused" Sep 17 07:21:38.647061 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:21:38.647007 2559 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-credit-scoring-7df46bdb47-8vt5r" podUID="5ba2d920-50db-4402-b57a-9720acaf7535" containerName="online" probeResult="failure" output="Get \"https://10.134.0.28:6567/health\": dial tcp 10.134.0.28:6567: connect: connection refused" Sep 17 07:21:41.647106 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:21:41.647027 2559 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-credit-scoring-7df46bdb47-8vt5r" podUID="5ba2d920-50db-4402-b57a-9720acaf7535" containerName="registry" probeResult="failure" output="dial tcp 10.134.0.28:6571: connect: connection refused" Sep 17 07:21:41.648145 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:21:41.648115 2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-credit-scoring-7df46bdb47-8vt5r" Sep 17 07:21:41.649144 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:21:41.649123 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-credit-scoring-7df46bdb47-8vt5r" Sep 17 07:21:41.654073 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:21:41.654033 2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-credit-scoring-7df46bdb47-8vt5r" Sep 17 07:21:42.492310 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:21:42.492272 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-credit-scoring-7df46bdb47-8vt5r" Sep 17 07:21:44.646514 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:21:44.646455 2559 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-credit-scoring-7df46bdb47-8vt5r" podUID="5ba2d920-50db-4402-b57a-9720acaf7535" containerName="registry" probeResult="failure" output="dial tcp 10.134.0.28:6571: connect: connection refused" Sep 17 07:21:47.646591 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:21:47.646553 2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-credit-scoring-7df46bdb47-8vt5r" Sep 17 07:21:47.647436 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:21:47.647413 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-credit-scoring-7df46bdb47-8vt5r" Sep 17 07:22:53.812483 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:22:53.812449 2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast/feast-credit-scoring-7df46bdb47-8vt5r"] Sep 17 07:22:53.813047 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:22:53.812708 2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/feast-credit-scoring-7df46bdb47-8vt5r" podUID="5ba2d920-50db-4402-b57a-9720acaf7535" containerName="registry" containerID="cri-o://0dee303700304eca155ef577696fa95017b7fffb4d85540a30ba9344f167399e" gracePeriod=30 Sep 17 07:22:53.813047 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:22:53.812768 2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/feast-credit-scoring-7df46bdb47-8vt5r" podUID="5ba2d920-50db-4402-b57a-9720acaf7535" containerName="offline" containerID="cri-o://188c87a5b4e9e2edf6aa5ab35a70a963bad6689831a53e0df1d1a9cded552437" gracePeriod=30 Sep 17 07:22:53.813047 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:22:53.812769 2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/feast-credit-scoring-7df46bdb47-8vt5r" podUID="5ba2d920-50db-4402-b57a-9720acaf7535" containerName="online" containerID="cri-o://a79a1ddb65605b4cbd676bed8667095370ed38c767fccd00fe4df03086bd72fe" gracePeriod=30 Sep 17 07:22:53.842247 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:22:53.842223 2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast/redis-69bbd798b6-w2mvj"] Sep 17 07:22:53.842379 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:22:53.842362 2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/redis-69bbd798b6-w2mvj" podUID="34735e40-9e8e-4912-8fad-188871430ea0" containerName="redis" containerID="cri-o://c2893eb0e105e666f8036a2dd611262f4ee8e748cc79c327a6f13f0a65795a52" gracePeriod=30 Sep 17 07:22:54.076565 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:22:54.076507 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/redis-69bbd798b6-w2mvj" Sep 17 07:22:54.123250 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:22:54.123218 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zdzqm\" (UniqueName: \"kubernetes.io/projected/34735e40-9e8e-4912-8fad-188871430ea0-kube-api-access-zdzqm\") pod \"34735e40-9e8e-4912-8fad-188871430ea0\" (UID: \"34735e40-9e8e-4912-8fad-188871430ea0\") " Sep 17 07:22:54.125690 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:22:54.125657 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/34735e40-9e8e-4912-8fad-188871430ea0-kube-api-access-zdzqm" (OuterVolumeSpecName: "kube-api-access-zdzqm") pod "34735e40-9e8e-4912-8fad-188871430ea0" (UID: "34735e40-9e8e-4912-8fad-188871430ea0"). InnerVolumeSpecName "kube-api-access-zdzqm". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 17 07:22:54.224485 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:22:54.224454 2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zdzqm\" (UniqueName: \"kubernetes.io/projected/34735e40-9e8e-4912-8fad-188871430ea0-kube-api-access-zdzqm\") on node \"ip-10-0-138-13.ec2.internal\" DevicePath \"\"" Sep 17 07:22:54.812626 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:22:54.812594 2559 generic.go:356] "Generic (PLEG): container finished" podID="5ba2d920-50db-4402-b57a-9720acaf7535" containerID="a79a1ddb65605b4cbd676bed8667095370ed38c767fccd00fe4df03086bd72fe" exitCode=0 Sep 17 07:22:54.813029 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:22:54.812662 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-credit-scoring-7df46bdb47-8vt5r" event={"ID":"5ba2d920-50db-4402-b57a-9720acaf7535","Type":"ContainerDied","Data":"a79a1ddb65605b4cbd676bed8667095370ed38c767fccd00fe4df03086bd72fe"} Sep 17 07:22:54.813870 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:22:54.813849 2559 generic.go:356] "Generic (PLEG): container finished" podID="34735e40-9e8e-4912-8fad-188871430ea0" containerID="c2893eb0e105e666f8036a2dd611262f4ee8e748cc79c327a6f13f0a65795a52" exitCode=0 Sep 17 07:22:54.813992 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:22:54.813887 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/redis-69bbd798b6-w2mvj" Sep 17 07:22:54.813992 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:22:54.813907 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/redis-69bbd798b6-w2mvj" event={"ID":"34735e40-9e8e-4912-8fad-188871430ea0","Type":"ContainerDied","Data":"c2893eb0e105e666f8036a2dd611262f4ee8e748cc79c327a6f13f0a65795a52"} Sep 17 07:22:54.813992 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:22:54.813941 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/redis-69bbd798b6-w2mvj" event={"ID":"34735e40-9e8e-4912-8fad-188871430ea0","Type":"ContainerDied","Data":"efb8719594120db2ad9abd56032724c60234989120f9d0b6442c1bd8c7f4d21b"} Sep 17 07:22:54.813992 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:22:54.813962 2559 scope.go:117] "RemoveContainer" containerID="c2893eb0e105e666f8036a2dd611262f4ee8e748cc79c327a6f13f0a65795a52" Sep 17 07:22:54.821938 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:22:54.821922 2559 scope.go:117] "RemoveContainer" containerID="c2893eb0e105e666f8036a2dd611262f4ee8e748cc79c327a6f13f0a65795a52" Sep 17 07:22:54.822212 ip-10-0-138-13 kubenswrapper[2559]: E0917 07:22:54.822195 2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c2893eb0e105e666f8036a2dd611262f4ee8e748cc79c327a6f13f0a65795a52\": container with ID starting with c2893eb0e105e666f8036a2dd611262f4ee8e748cc79c327a6f13f0a65795a52 not found: ID does not exist" containerID="c2893eb0e105e666f8036a2dd611262f4ee8e748cc79c327a6f13f0a65795a52" Sep 17 07:22:54.822261 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:22:54.822220 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c2893eb0e105e666f8036a2dd611262f4ee8e748cc79c327a6f13f0a65795a52"} err="failed to get container status \"c2893eb0e105e666f8036a2dd611262f4ee8e748cc79c327a6f13f0a65795a52\": rpc error: code = NotFound desc = could not find container \"c2893eb0e105e666f8036a2dd611262f4ee8e748cc79c327a6f13f0a65795a52\": container with ID starting with c2893eb0e105e666f8036a2dd611262f4ee8e748cc79c327a6f13f0a65795a52 not found: ID does not exist" Sep 17 07:22:54.835308 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:22:54.835284 2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast/redis-69bbd798b6-w2mvj"] Sep 17 07:22:54.842599 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:22:54.842580 2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["test-ns-feast/redis-69bbd798b6-w2mvj"] Sep 17 07:22:54.899039 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:22:54.898961 2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="34735e40-9e8e-4912-8fad-188871430ea0" path="/var/lib/kubelet/pods/34735e40-9e8e-4912-8fad-188871430ea0/volumes" Sep 17 07:23:02.489373 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:23:02.489331 2559 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-credit-scoring-7df46bdb47-8vt5r" podUID="5ba2d920-50db-4402-b57a-9720acaf7535" containerName="online" probeResult="failure" output="Get \"https://10.134.0.28:6567/health\": dial tcp 10.134.0.28:6567: connect: connection refused" Sep 17 07:23:12.489373 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:23:12.489283 2559 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-credit-scoring-7df46bdb47-8vt5r" podUID="5ba2d920-50db-4402-b57a-9720acaf7535" containerName="online" probeResult="failure" output="Get \"https://10.134.0.28:6567/health\": dial tcp 10.134.0.28:6567: connect: connection refused" Sep 17 07:23:12.868809 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:23:12.868782 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-b99wz_5ae9fb13-f8a8-4999-9023-cebdf2a7bd97/ovn-acl-logging/0.log" Sep 17 07:23:12.871278 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:23:12.871256 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-b99wz_5ae9fb13-f8a8-4999-9023-cebdf2a7bd97/ovn-acl-logging/0.log" Sep 17 07:23:22.488798 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:23:22.488753 2559 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-credit-scoring-7df46bdb47-8vt5r" podUID="5ba2d920-50db-4402-b57a-9720acaf7535" containerName="online" probeResult="failure" output="Get \"https://10.134.0.28:6567/health\": dial tcp 10.134.0.28:6567: connect: connection refused" Sep 17 07:23:22.489215 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:23:22.488875 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-credit-scoring-7df46bdb47-8vt5r" Sep 17 07:23:23.933530 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:23:23.933503 2559 generic.go:356] "Generic (PLEG): container finished" podID="5ba2d920-50db-4402-b57a-9720acaf7535" containerID="188c87a5b4e9e2edf6aa5ab35a70a963bad6689831a53e0df1d1a9cded552437" exitCode=137 Sep 17 07:23:23.933530 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:23:23.933525 2559 generic.go:356] "Generic (PLEG): container finished" podID="5ba2d920-50db-4402-b57a-9720acaf7535" containerID="0dee303700304eca155ef577696fa95017b7fffb4d85540a30ba9344f167399e" exitCode=137 Sep 17 07:23:23.933854 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:23:23.933545 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-credit-scoring-7df46bdb47-8vt5r" event={"ID":"5ba2d920-50db-4402-b57a-9720acaf7535","Type":"ContainerDied","Data":"188c87a5b4e9e2edf6aa5ab35a70a963bad6689831a53e0df1d1a9cded552437"} Sep 17 07:23:23.933854 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:23:23.933584 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-credit-scoring-7df46bdb47-8vt5r" event={"ID":"5ba2d920-50db-4402-b57a-9720acaf7535","Type":"ContainerDied","Data":"0dee303700304eca155ef577696fa95017b7fffb4d85540a30ba9344f167399e"} Sep 17 07:23:24.456848 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:23:24.456824 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-credit-scoring-7df46bdb47-8vt5r" Sep 17 07:23:24.478398 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:23:24.478376 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/5ba2d920-50db-4402-b57a-9720acaf7535-offline-tls\") pod \"5ba2d920-50db-4402-b57a-9720acaf7535\" (UID: \"5ba2d920-50db-4402-b57a-9720acaf7535\") " Sep 17 07:23:24.478531 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:23:24.478406 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/5ba2d920-50db-4402-b57a-9720acaf7535-online-tls\") pod \"5ba2d920-50db-4402-b57a-9720acaf7535\" (UID: \"5ba2d920-50db-4402-b57a-9720acaf7535\") " Sep 17 07:23:24.478531 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:23:24.478465 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/5ba2d920-50db-4402-b57a-9720acaf7535-feast-data\") pod \"5ba2d920-50db-4402-b57a-9720acaf7535\" (UID: \"5ba2d920-50db-4402-b57a-9720acaf7535\") " Sep 17 07:23:24.478607 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:23:24.478537 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5mgxn\" (UniqueName: \"kubernetes.io/projected/5ba2d920-50db-4402-b57a-9720acaf7535-kube-api-access-5mgxn\") pod \"5ba2d920-50db-4402-b57a-9720acaf7535\" (UID: \"5ba2d920-50db-4402-b57a-9720acaf7535\") " Sep 17 07:23:24.478607 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:23:24.478594 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/5ba2d920-50db-4402-b57a-9720acaf7535-registry-tls\") pod \"5ba2d920-50db-4402-b57a-9720acaf7535\" (UID: \"5ba2d920-50db-4402-b57a-9720acaf7535\") " Sep 17 07:23:24.480552 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:23:24.480523 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5ba2d920-50db-4402-b57a-9720acaf7535-offline-tls" (OuterVolumeSpecName: "offline-tls") pod "5ba2d920-50db-4402-b57a-9720acaf7535" (UID: "5ba2d920-50db-4402-b57a-9720acaf7535"). InnerVolumeSpecName "offline-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 17 07:23:24.480797 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:23:24.480772 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5ba2d920-50db-4402-b57a-9720acaf7535-online-tls" (OuterVolumeSpecName: "online-tls") pod "5ba2d920-50db-4402-b57a-9720acaf7535" (UID: "5ba2d920-50db-4402-b57a-9720acaf7535"). InnerVolumeSpecName "online-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 17 07:23:24.481025 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:23:24.481002 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5ba2d920-50db-4402-b57a-9720acaf7535-kube-api-access-5mgxn" (OuterVolumeSpecName: "kube-api-access-5mgxn") pod "5ba2d920-50db-4402-b57a-9720acaf7535" (UID: "5ba2d920-50db-4402-b57a-9720acaf7535"). InnerVolumeSpecName "kube-api-access-5mgxn". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 17 07:23:24.481114 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:23:24.481078 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5ba2d920-50db-4402-b57a-9720acaf7535-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "5ba2d920-50db-4402-b57a-9720acaf7535" (UID: "5ba2d920-50db-4402-b57a-9720acaf7535"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 17 07:23:24.487795 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:23:24.487771 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5ba2d920-50db-4402-b57a-9720acaf7535-feast-data" (OuterVolumeSpecName: "feast-data") pod "5ba2d920-50db-4402-b57a-9720acaf7535" (UID: "5ba2d920-50db-4402-b57a-9720acaf7535"). InnerVolumeSpecName "feast-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 17 07:23:24.579716 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:23:24.579644 2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5mgxn\" (UniqueName: \"kubernetes.io/projected/5ba2d920-50db-4402-b57a-9720acaf7535-kube-api-access-5mgxn\") on node \"ip-10-0-138-13.ec2.internal\" DevicePath \"\"" Sep 17 07:23:24.579716 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:23:24.579673 2559 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/5ba2d920-50db-4402-b57a-9720acaf7535-registry-tls\") on node \"ip-10-0-138-13.ec2.internal\" DevicePath \"\"" Sep 17 07:23:24.579716 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:23:24.579685 2559 reconciler_common.go:299] "Volume detached for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/5ba2d920-50db-4402-b57a-9720acaf7535-offline-tls\") on node \"ip-10-0-138-13.ec2.internal\" DevicePath \"\"" Sep 17 07:23:24.579716 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:23:24.579696 2559 reconciler_common.go:299] "Volume detached for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/5ba2d920-50db-4402-b57a-9720acaf7535-online-tls\") on node \"ip-10-0-138-13.ec2.internal\" DevicePath \"\"" Sep 17 07:23:24.579716 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:23:24.579707 2559 reconciler_common.go:299] "Volume detached for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/5ba2d920-50db-4402-b57a-9720acaf7535-feast-data\") on node \"ip-10-0-138-13.ec2.internal\" DevicePath \"\"" Sep 17 07:23:24.940729 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:23:24.940697 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-credit-scoring-7df46bdb47-8vt5r" event={"ID":"5ba2d920-50db-4402-b57a-9720acaf7535","Type":"ContainerDied","Data":"89d550b1b2b4b8f04d36eb91438587e820efdeeb7b3b7fea6bbba76f908435e0"} Sep 17 07:23:24.941091 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:23:24.940735 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-credit-scoring-7df46bdb47-8vt5r" Sep 17 07:23:24.941091 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:23:24.940773 2559 scope.go:117] "RemoveContainer" containerID="188c87a5b4e9e2edf6aa5ab35a70a963bad6689831a53e0df1d1a9cded552437" Sep 17 07:23:24.949720 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:23:24.949702 2559 scope.go:117] "RemoveContainer" containerID="a79a1ddb65605b4cbd676bed8667095370ed38c767fccd00fe4df03086bd72fe" Sep 17 07:23:24.959149 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:23:24.959126 2559 scope.go:117] "RemoveContainer" containerID="0dee303700304eca155ef577696fa95017b7fffb4d85540a30ba9344f167399e" Sep 17 07:23:24.964024 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:23:24.964004 2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast/feast-credit-scoring-7df46bdb47-8vt5r"] Sep 17 07:23:24.967311 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:23:24.967293 2559 scope.go:117] "RemoveContainer" containerID="882909adb7d399a2c02eaf5ad51cffddbb84e23ebce76abf06d727e9696698da" Sep 17 07:23:24.971680 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:23:24.971661 2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["test-ns-feast/feast-credit-scoring-7df46bdb47-8vt5r"] Sep 17 07:23:24.974574 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:23:24.974551 2559 scope.go:117] "RemoveContainer" containerID="da37851bbd7a1cf53f35f77acc3050a30b36267678d090ebb45d3fa2aa9d6935" Sep 17 07:23:26.897914 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:23:26.897876 2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5ba2d920-50db-4402-b57a-9720acaf7535" path="/var/lib/kubelet/pods/5ba2d920-50db-4402-b57a-9720acaf7535/volumes" Sep 17 07:25:54.310653 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:25:54.310615 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["test-ns-feast-rest/feast-credit-scoring-dbd676869-z7hhv"] Sep 17 07:25:54.311063 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:25:54.310952 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5ba2d920-50db-4402-b57a-9720acaf7535" containerName="feast-apply" Sep 17 07:25:54.311063 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:25:54.310962 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="5ba2d920-50db-4402-b57a-9720acaf7535" containerName="feast-apply" Sep 17 07:25:54.311063 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:25:54.310989 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="34735e40-9e8e-4912-8fad-188871430ea0" containerName="redis" Sep 17 07:25:54.311063 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:25:54.310996 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="34735e40-9e8e-4912-8fad-188871430ea0" containerName="redis" Sep 17 07:25:54.311063 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:25:54.311007 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5ba2d920-50db-4402-b57a-9720acaf7535" containerName="feast-init" Sep 17 07:25:54.311063 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:25:54.311014 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="5ba2d920-50db-4402-b57a-9720acaf7535" containerName="feast-init" Sep 17 07:25:54.311063 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:25:54.311019 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5ba2d920-50db-4402-b57a-9720acaf7535" containerName="online" Sep 17 07:25:54.311063 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:25:54.311025 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="5ba2d920-50db-4402-b57a-9720acaf7535" containerName="online" Sep 17 07:25:54.311063 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:25:54.311035 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5ba2d920-50db-4402-b57a-9720acaf7535" containerName="registry" Sep 17 07:25:54.311063 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:25:54.311040 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="5ba2d920-50db-4402-b57a-9720acaf7535" containerName="registry" Sep 17 07:25:54.311063 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:25:54.311045 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5ba2d920-50db-4402-b57a-9720acaf7535" containerName="offline" Sep 17 07:25:54.311063 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:25:54.311050 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="5ba2d920-50db-4402-b57a-9720acaf7535" containerName="offline" Sep 17 07:25:54.311430 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:25:54.311102 2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="5ba2d920-50db-4402-b57a-9720acaf7535" containerName="offline" Sep 17 07:25:54.311430 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:25:54.311111 2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="34735e40-9e8e-4912-8fad-188871430ea0" containerName="redis" Sep 17 07:25:54.311430 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:25:54.311117 2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="5ba2d920-50db-4402-b57a-9720acaf7535" containerName="online" Sep 17 07:25:54.311430 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:25:54.311123 2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="5ba2d920-50db-4402-b57a-9720acaf7535" containerName="registry" Sep 17 07:25:54.314129 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:25:54.314114 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast-rest/feast-credit-scoring-dbd676869-z7hhv" Sep 17 07:25:54.316879 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:25:54.316848 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast-rest\"/\"feast-credit-scoring-intra-comm\"" Sep 17 07:25:54.317031 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:25:54.316904 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast-rest\"/\"feast-credit-scoring-registry-tls\"" Sep 17 07:25:54.317335 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:25:54.317320 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast-rest\"/\"postgres-secret\"" Sep 17 07:25:54.317505 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:25:54.317489 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast-rest\"/\"feast-credit-scoring-online-tls\"" Sep 17 07:25:54.317565 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:25:54.317518 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast-rest\"/\"kube-root-ca.crt\"" Sep 17 07:25:54.317565 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:25:54.317546 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast-rest\"/\"openshift-service-ca.crt\"" Sep 17 07:25:54.317650 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:25:54.317613 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast-rest\"/\"feast-credit-scoring-dockercfg-bnnt4\"" Sep 17 07:25:54.330440 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:25:54.330417 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast-rest/feast-credit-scoring-dbd676869-z7hhv"] Sep 17 07:25:54.354398 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:25:54.354368 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/a3006af8-996e-4ac0-8e6b-ca089cc5cd65-registry-tls\") pod \"feast-credit-scoring-dbd676869-z7hhv\" (UID: \"a3006af8-996e-4ac0-8e6b-ca089cc5cd65\") " pod="test-ns-feast-rest/feast-credit-scoring-dbd676869-z7hhv" Sep 17 07:25:54.354515 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:25:54.354402 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/a3006af8-996e-4ac0-8e6b-ca089cc5cd65-feast-data\") pod \"feast-credit-scoring-dbd676869-z7hhv\" (UID: \"a3006af8-996e-4ac0-8e6b-ca089cc5cd65\") " pod="test-ns-feast-rest/feast-credit-scoring-dbd676869-z7hhv" Sep 17 07:25:54.354515 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:25:54.354468 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pbkcx\" (UniqueName: \"kubernetes.io/projected/a3006af8-996e-4ac0-8e6b-ca089cc5cd65-kube-api-access-pbkcx\") pod \"feast-credit-scoring-dbd676869-z7hhv\" (UID: \"a3006af8-996e-4ac0-8e6b-ca089cc5cd65\") " pod="test-ns-feast-rest/feast-credit-scoring-dbd676869-z7hhv" Sep 17 07:25:54.354607 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:25:54.354555 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/a3006af8-996e-4ac0-8e6b-ca089cc5cd65-online-tls\") pod \"feast-credit-scoring-dbd676869-z7hhv\" (UID: \"a3006af8-996e-4ac0-8e6b-ca089cc5cd65\") " pod="test-ns-feast-rest/feast-credit-scoring-dbd676869-z7hhv" Sep 17 07:25:54.455101 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:25:54.455067 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/a3006af8-996e-4ac0-8e6b-ca089cc5cd65-registry-tls\") pod \"feast-credit-scoring-dbd676869-z7hhv\" (UID: \"a3006af8-996e-4ac0-8e6b-ca089cc5cd65\") " pod="test-ns-feast-rest/feast-credit-scoring-dbd676869-z7hhv" Sep 17 07:25:54.455101 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:25:54.455103 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/a3006af8-996e-4ac0-8e6b-ca089cc5cd65-feast-data\") pod \"feast-credit-scoring-dbd676869-z7hhv\" (UID: \"a3006af8-996e-4ac0-8e6b-ca089cc5cd65\") " pod="test-ns-feast-rest/feast-credit-scoring-dbd676869-z7hhv" Sep 17 07:25:54.455295 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:25:54.455139 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pbkcx\" (UniqueName: \"kubernetes.io/projected/a3006af8-996e-4ac0-8e6b-ca089cc5cd65-kube-api-access-pbkcx\") pod \"feast-credit-scoring-dbd676869-z7hhv\" (UID: \"a3006af8-996e-4ac0-8e6b-ca089cc5cd65\") " pod="test-ns-feast-rest/feast-credit-scoring-dbd676869-z7hhv" Sep 17 07:25:54.455295 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:25:54.455203 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/a3006af8-996e-4ac0-8e6b-ca089cc5cd65-online-tls\") pod \"feast-credit-scoring-dbd676869-z7hhv\" (UID: \"a3006af8-996e-4ac0-8e6b-ca089cc5cd65\") " pod="test-ns-feast-rest/feast-credit-scoring-dbd676869-z7hhv" Sep 17 07:25:54.455531 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:25:54.455510 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/a3006af8-996e-4ac0-8e6b-ca089cc5cd65-feast-data\") pod \"feast-credit-scoring-dbd676869-z7hhv\" (UID: \"a3006af8-996e-4ac0-8e6b-ca089cc5cd65\") " pod="test-ns-feast-rest/feast-credit-scoring-dbd676869-z7hhv" Sep 17 07:25:54.457686 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:25:54.457657 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/a3006af8-996e-4ac0-8e6b-ca089cc5cd65-online-tls\") pod \"feast-credit-scoring-dbd676869-z7hhv\" (UID: \"a3006af8-996e-4ac0-8e6b-ca089cc5cd65\") " pod="test-ns-feast-rest/feast-credit-scoring-dbd676869-z7hhv" Sep 17 07:25:54.457788 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:25:54.457657 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/a3006af8-996e-4ac0-8e6b-ca089cc5cd65-registry-tls\") pod \"feast-credit-scoring-dbd676869-z7hhv\" (UID: \"a3006af8-996e-4ac0-8e6b-ca089cc5cd65\") " pod="test-ns-feast-rest/feast-credit-scoring-dbd676869-z7hhv" Sep 17 07:25:54.463570 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:25:54.463550 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pbkcx\" (UniqueName: \"kubernetes.io/projected/a3006af8-996e-4ac0-8e6b-ca089cc5cd65-kube-api-access-pbkcx\") pod \"feast-credit-scoring-dbd676869-z7hhv\" (UID: \"a3006af8-996e-4ac0-8e6b-ca089cc5cd65\") " pod="test-ns-feast-rest/feast-credit-scoring-dbd676869-z7hhv" Sep 17 07:25:54.623722 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:25:54.623613 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast-rest/feast-credit-scoring-dbd676869-z7hhv" Sep 17 07:25:54.898551 ip-10-0-138-13 kubenswrapper[2559]: W0917 07:25:54.898518 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda3006af8_996e_4ac0_8e6b_ca089cc5cd65.slice/crio-16c09c39e2fd7938ecfdedc8f8204556e81ab9ea60259eaf7fd00564dcf0b90d WatchSource:0}: Error finding container 16c09c39e2fd7938ecfdedc8f8204556e81ab9ea60259eaf7fd00564dcf0b90d: Status 404 returned error can't find the container with id 16c09c39e2fd7938ecfdedc8f8204556e81ab9ea60259eaf7fd00564dcf0b90d Sep 17 07:25:54.899246 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:25:54.899221 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast-rest/feast-credit-scoring-dbd676869-z7hhv"] Sep 17 07:25:55.536640 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:25:55.536603 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-credit-scoring-dbd676869-z7hhv" event={"ID":"a3006af8-996e-4ac0-8e6b-ca089cc5cd65","Type":"ContainerStarted","Data":"b2c510104c51fb1eeb20e8b8b4552f5b2c9b3b1f85ba92dd25960389de5867fe"} Sep 17 07:25:55.537083 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:25:55.536655 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-credit-scoring-dbd676869-z7hhv" event={"ID":"a3006af8-996e-4ac0-8e6b-ca089cc5cd65","Type":"ContainerStarted","Data":"16c09c39e2fd7938ecfdedc8f8204556e81ab9ea60259eaf7fd00564dcf0b90d"} Sep 17 07:25:56.543875 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:25:56.543802 2559 generic.go:356] "Generic (PLEG): container finished" podID="a3006af8-996e-4ac0-8e6b-ca089cc5cd65" containerID="b2c510104c51fb1eeb20e8b8b4552f5b2c9b3b1f85ba92dd25960389de5867fe" exitCode=0 Sep 17 07:25:56.544421 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:25:56.543897 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-credit-scoring-dbd676869-z7hhv" event={"ID":"a3006af8-996e-4ac0-8e6b-ca089cc5cd65","Type":"ContainerDied","Data":"b2c510104c51fb1eeb20e8b8b4552f5b2c9b3b1f85ba92dd25960389de5867fe"} Sep 17 07:25:57.550358 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:25:57.550321 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-credit-scoring-dbd676869-z7hhv" event={"ID":"a3006af8-996e-4ac0-8e6b-ca089cc5cd65","Type":"ContainerStarted","Data":"52548ef17693a6bcf38a6029b2bca235167ac2040e34fad157c22eb1bd5f4cf6"} Sep 17 07:26:04.584679 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:26:04.584584 2559 generic.go:356] "Generic (PLEG): container finished" podID="a3006af8-996e-4ac0-8e6b-ca089cc5cd65" containerID="52548ef17693a6bcf38a6029b2bca235167ac2040e34fad157c22eb1bd5f4cf6" exitCode=0 Sep 17 07:26:04.584679 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:26:04.584655 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-credit-scoring-dbd676869-z7hhv" event={"ID":"a3006af8-996e-4ac0-8e6b-ca089cc5cd65","Type":"ContainerDied","Data":"52548ef17693a6bcf38a6029b2bca235167ac2040e34fad157c22eb1bd5f4cf6"} Sep 17 07:26:05.592645 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:26:05.592565 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-credit-scoring-dbd676869-z7hhv" event={"ID":"a3006af8-996e-4ac0-8e6b-ca089cc5cd65","Type":"ContainerStarted","Data":"4acea8c239f48607d6a50e17ab4d9d89dd0fb0d0a7ecca94a924dbffeab6ad49"} Sep 17 07:26:05.592645 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:26:05.592626 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-credit-scoring-dbd676869-z7hhv" event={"ID":"a3006af8-996e-4ac0-8e6b-ca089cc5cd65","Type":"ContainerStarted","Data":"76c5b7ad894ca8b1cf84ecfa18d581da0ad614f35ff773751dd77ade62bdc8b2"} Sep 17 07:26:05.618637 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:26:05.618581 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="test-ns-feast-rest/feast-credit-scoring-dbd676869-z7hhv" podStartSLOduration=11.618564615 podStartE2EDuration="11.618564615s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 07:25:54 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 07:26:05.618484467 +0000 UTC m=+1073.166631176" watchObservedRunningTime="2026-09-17 07:26:05.618564615 +0000 UTC m=+1073.166711324" Sep 17 07:26:06.624876 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:26:06.624833 2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast-rest/feast-credit-scoring-dbd676869-z7hhv" Sep 17 07:26:06.625275 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:26:06.624907 2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast-rest/feast-credit-scoring-dbd676869-z7hhv" Sep 17 07:26:06.626819 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:26:06.626771 2559 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast-rest/feast-credit-scoring-dbd676869-z7hhv" podUID="a3006af8-996e-4ac0-8e6b-ca089cc5cd65" containerName="registry" probeResult="failure" output="dial tcp 10.134.0.29:6571: connect: connection refused" Sep 17 07:26:06.626819 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:26:06.626801 2559 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast-rest/feast-credit-scoring-dbd676869-z7hhv" podUID="a3006af8-996e-4ac0-8e6b-ca089cc5cd65" containerName="online" probeResult="failure" output="Get \"https://10.134.0.29:6567/health\": dial tcp 10.134.0.29:6567: connect: connection refused" Sep 17 07:26:09.624394 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:26:09.624335 2559 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast-rest/feast-credit-scoring-dbd676869-z7hhv" podUID="a3006af8-996e-4ac0-8e6b-ca089cc5cd65" containerName="registry" probeResult="failure" output="dial tcp 10.134.0.29:6571: connect: connection refused" Sep 17 07:26:09.624394 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:26:09.624382 2559 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast-rest/feast-credit-scoring-dbd676869-z7hhv" podUID="a3006af8-996e-4ac0-8e6b-ca089cc5cd65" containerName="online" probeResult="failure" output="Get \"https://10.134.0.29:6567/health\": dial tcp 10.134.0.29:6567: connect: connection refused" Sep 17 07:26:12.624127 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:26:12.624084 2559 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast-rest/feast-credit-scoring-dbd676869-z7hhv" podUID="a3006af8-996e-4ac0-8e6b-ca089cc5cd65" containerName="registry" probeResult="failure" output="dial tcp 10.134.0.29:6571: connect: connection refused" Sep 17 07:26:12.629853 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:26:12.629824 2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast-rest/feast-credit-scoring-dbd676869-z7hhv" Sep 17 07:26:12.630235 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:26:12.630210 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast-rest/feast-credit-scoring-dbd676869-z7hhv" Sep 17 07:26:12.633237 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:26:12.633216 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast-rest/feast-credit-scoring-dbd676869-z7hhv" Sep 17 07:26:14.624280 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:26:14.624241 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast-rest/feast-credit-scoring-dbd676869-z7hhv" Sep 17 07:26:15.624956 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:26:15.624895 2559 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast-rest/feast-credit-scoring-dbd676869-z7hhv" podUID="a3006af8-996e-4ac0-8e6b-ca089cc5cd65" containerName="registry" probeResult="failure" output="dial tcp 10.134.0.29:6571: connect: connection refused" Sep 17 07:26:18.624713 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:26:18.624684 2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast-rest/feast-credit-scoring-dbd676869-z7hhv" Sep 17 07:26:18.625445 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:26:18.625426 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast-rest/feast-credit-scoring-dbd676869-z7hhv" Sep 17 07:26:20.198777 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:26:20.198747 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["test-ns-feast-rest/feast-driver-ranking-586d6cc54b-2q5cp"] Sep 17 07:26:20.202340 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:26:20.202322 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast-rest/feast-driver-ranking-586d6cc54b-2q5cp" Sep 17 07:26:20.204738 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:26:20.204713 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast-rest\"/\"feast-driver-ranking-intra-comm\"" Sep 17 07:26:20.204738 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:26:20.204727 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast-rest\"/\"feast-driver-ranking-dockercfg-r958v\"" Sep 17 07:26:20.204895 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:26:20.204714 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast-rest\"/\"feast-driver-ranking-online-tls\"" Sep 17 07:26:20.204895 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:26:20.204714 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast-rest\"/\"feast-driver-ranking-registry-tls\"" Sep 17 07:26:20.216844 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:26:20.216821 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast-rest/feast-driver-ranking-586d6cc54b-2q5cp"] Sep 17 07:26:20.291663 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:26:20.291634 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/1db23607-4f78-4235-94ad-111f8d362cd0-registry-tls\") pod \"feast-driver-ranking-586d6cc54b-2q5cp\" (UID: \"1db23607-4f78-4235-94ad-111f8d362cd0\") " pod="test-ns-feast-rest/feast-driver-ranking-586d6cc54b-2q5cp" Sep 17 07:26:20.291805 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:26:20.291685 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8cf4k\" (UniqueName: \"kubernetes.io/projected/1db23607-4f78-4235-94ad-111f8d362cd0-kube-api-access-8cf4k\") pod \"feast-driver-ranking-586d6cc54b-2q5cp\" (UID: \"1db23607-4f78-4235-94ad-111f8d362cd0\") " pod="test-ns-feast-rest/feast-driver-ranking-586d6cc54b-2q5cp" Sep 17 07:26:20.291805 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:26:20.291706 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/1db23607-4f78-4235-94ad-111f8d362cd0-online-tls\") pod \"feast-driver-ranking-586d6cc54b-2q5cp\" (UID: \"1db23607-4f78-4235-94ad-111f8d362cd0\") " pod="test-ns-feast-rest/feast-driver-ranking-586d6cc54b-2q5cp" Sep 17 07:26:20.291805 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:26:20.291778 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/1db23607-4f78-4235-94ad-111f8d362cd0-feast-data\") pod \"feast-driver-ranking-586d6cc54b-2q5cp\" (UID: \"1db23607-4f78-4235-94ad-111f8d362cd0\") " pod="test-ns-feast-rest/feast-driver-ranking-586d6cc54b-2q5cp" Sep 17 07:26:20.392595 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:26:20.392565 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8cf4k\" (UniqueName: \"kubernetes.io/projected/1db23607-4f78-4235-94ad-111f8d362cd0-kube-api-access-8cf4k\") pod \"feast-driver-ranking-586d6cc54b-2q5cp\" (UID: \"1db23607-4f78-4235-94ad-111f8d362cd0\") " pod="test-ns-feast-rest/feast-driver-ranking-586d6cc54b-2q5cp" Sep 17 07:26:20.392595 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:26:20.392598 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/1db23607-4f78-4235-94ad-111f8d362cd0-online-tls\") pod \"feast-driver-ranking-586d6cc54b-2q5cp\" (UID: \"1db23607-4f78-4235-94ad-111f8d362cd0\") " pod="test-ns-feast-rest/feast-driver-ranking-586d6cc54b-2q5cp" Sep 17 07:26:20.392759 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:26:20.392629 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/1db23607-4f78-4235-94ad-111f8d362cd0-feast-data\") pod \"feast-driver-ranking-586d6cc54b-2q5cp\" (UID: \"1db23607-4f78-4235-94ad-111f8d362cd0\") " pod="test-ns-feast-rest/feast-driver-ranking-586d6cc54b-2q5cp" Sep 17 07:26:20.392759 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:26:20.392691 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/1db23607-4f78-4235-94ad-111f8d362cd0-registry-tls\") pod \"feast-driver-ranking-586d6cc54b-2q5cp\" (UID: \"1db23607-4f78-4235-94ad-111f8d362cd0\") " pod="test-ns-feast-rest/feast-driver-ranking-586d6cc54b-2q5cp" Sep 17 07:26:20.392871 ip-10-0-138-13 kubenswrapper[2559]: E0917 07:26:20.392796 2559 secret.go:189] Couldn't get secret test-ns-feast-rest/feast-driver-ranking-registry-tls: secret "feast-driver-ranking-registry-tls" not found Sep 17 07:26:20.392871 ip-10-0-138-13 kubenswrapper[2559]: E0917 07:26:20.392856 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1db23607-4f78-4235-94ad-111f8d362cd0-registry-tls podName:1db23607-4f78-4235-94ad-111f8d362cd0 nodeName:}" failed. No retries permitted until 2026-09-17 07:26:20.892836952 +0000 UTC m=+1088.440983651 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/secret/1db23607-4f78-4235-94ad-111f8d362cd0-registry-tls") pod "feast-driver-ranking-586d6cc54b-2q5cp" (UID: "1db23607-4f78-4235-94ad-111f8d362cd0") : secret "feast-driver-ranking-registry-tls" not found Sep 17 07:26:20.393078 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:26:20.393060 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/1db23607-4f78-4235-94ad-111f8d362cd0-feast-data\") pod \"feast-driver-ranking-586d6cc54b-2q5cp\" (UID: \"1db23607-4f78-4235-94ad-111f8d362cd0\") " pod="test-ns-feast-rest/feast-driver-ranking-586d6cc54b-2q5cp" Sep 17 07:26:20.394829 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:26:20.394813 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/1db23607-4f78-4235-94ad-111f8d362cd0-online-tls\") pod \"feast-driver-ranking-586d6cc54b-2q5cp\" (UID: \"1db23607-4f78-4235-94ad-111f8d362cd0\") " pod="test-ns-feast-rest/feast-driver-ranking-586d6cc54b-2q5cp" Sep 17 07:26:20.412156 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:26:20.412130 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8cf4k\" (UniqueName: \"kubernetes.io/projected/1db23607-4f78-4235-94ad-111f8d362cd0-kube-api-access-8cf4k\") pod \"feast-driver-ranking-586d6cc54b-2q5cp\" (UID: \"1db23607-4f78-4235-94ad-111f8d362cd0\") " pod="test-ns-feast-rest/feast-driver-ranking-586d6cc54b-2q5cp" Sep 17 07:26:20.895622 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:26:20.895589 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/1db23607-4f78-4235-94ad-111f8d362cd0-registry-tls\") pod \"feast-driver-ranking-586d6cc54b-2q5cp\" (UID: \"1db23607-4f78-4235-94ad-111f8d362cd0\") " pod="test-ns-feast-rest/feast-driver-ranking-586d6cc54b-2q5cp" Sep 17 07:26:20.897768 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:26:20.897751 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/1db23607-4f78-4235-94ad-111f8d362cd0-registry-tls\") pod \"feast-driver-ranking-586d6cc54b-2q5cp\" (UID: \"1db23607-4f78-4235-94ad-111f8d362cd0\") " pod="test-ns-feast-rest/feast-driver-ranking-586d6cc54b-2q5cp" Sep 17 07:26:21.111217 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:26:21.111192 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast-rest/feast-driver-ranking-586d6cc54b-2q5cp" Sep 17 07:26:21.383110 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:26:21.383088 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast-rest/feast-driver-ranking-586d6cc54b-2q5cp"] Sep 17 07:26:21.383727 ip-10-0-138-13 kubenswrapper[2559]: W0917 07:26:21.383704 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1db23607_4f78_4235_94ad_111f8d362cd0.slice/crio-acf1881abf0ff4e01cc2126478ba31c1f2d5a202020b2b330299e35780f69f39 WatchSource:0}: Error finding container acf1881abf0ff4e01cc2126478ba31c1f2d5a202020b2b330299e35780f69f39: Status 404 returned error can't find the container with id acf1881abf0ff4e01cc2126478ba31c1f2d5a202020b2b330299e35780f69f39 Sep 17 07:26:21.677167 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:26:21.677072 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-driver-ranking-586d6cc54b-2q5cp" event={"ID":"1db23607-4f78-4235-94ad-111f8d362cd0","Type":"ContainerStarted","Data":"1cb21f1e2868ef8df01330cb687c24f6fe7fee9774a55768a0182165f2a65592"} Sep 17 07:26:21.677340 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:26:21.677182 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-driver-ranking-586d6cc54b-2q5cp" event={"ID":"1db23607-4f78-4235-94ad-111f8d362cd0","Type":"ContainerStarted","Data":"acf1881abf0ff4e01cc2126478ba31c1f2d5a202020b2b330299e35780f69f39"} Sep 17 07:26:26.702022 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:26:26.701988 2559 generic.go:356] "Generic (PLEG): container finished" podID="1db23607-4f78-4235-94ad-111f8d362cd0" containerID="1cb21f1e2868ef8df01330cb687c24f6fe7fee9774a55768a0182165f2a65592" exitCode=0 Sep 17 07:26:26.702367 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:26:26.702043 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-driver-ranking-586d6cc54b-2q5cp" event={"ID":"1db23607-4f78-4235-94ad-111f8d362cd0","Type":"ContainerDied","Data":"1cb21f1e2868ef8df01330cb687c24f6fe7fee9774a55768a0182165f2a65592"} Sep 17 07:26:27.707424 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:26:27.707388 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-driver-ranking-586d6cc54b-2q5cp" event={"ID":"1db23607-4f78-4235-94ad-111f8d362cd0","Type":"ContainerStarted","Data":"eb1e02ebd91b6fde07efd7a03e609e970936500b09db83ee7cc88098f99939b7"} Sep 17 07:26:34.738607 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:26:34.738572 2559 generic.go:356] "Generic (PLEG): container finished" podID="1db23607-4f78-4235-94ad-111f8d362cd0" containerID="eb1e02ebd91b6fde07efd7a03e609e970936500b09db83ee7cc88098f99939b7" exitCode=0 Sep 17 07:26:34.738993 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:26:34.738627 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-driver-ranking-586d6cc54b-2q5cp" event={"ID":"1db23607-4f78-4235-94ad-111f8d362cd0","Type":"ContainerDied","Data":"eb1e02ebd91b6fde07efd7a03e609e970936500b09db83ee7cc88098f99939b7"} Sep 17 07:26:35.751671 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:26:35.751637 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-driver-ranking-586d6cc54b-2q5cp" event={"ID":"1db23607-4f78-4235-94ad-111f8d362cd0","Type":"ContainerStarted","Data":"d0ec0dfda58d14f18f77d532cfbd23a3960698e35140c86eaa1693efe8421604"} Sep 17 07:26:35.752255 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:26:35.751704 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-driver-ranking-586d6cc54b-2q5cp" event={"ID":"1db23607-4f78-4235-94ad-111f8d362cd0","Type":"ContainerStarted","Data":"38856c7eb4f024287ed6c6b5407026162f653ae3da73623173e233e5a0f7b0e4"} Sep 17 07:26:36.111989 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:26:36.111860 2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast-rest/feast-driver-ranking-586d6cc54b-2q5cp" Sep 17 07:26:36.111989 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:26:36.111942 2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast-rest/feast-driver-ranking-586d6cc54b-2q5cp" Sep 17 07:26:36.113556 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:26:36.113520 2559 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast-rest/feast-driver-ranking-586d6cc54b-2q5cp" podUID="1db23607-4f78-4235-94ad-111f8d362cd0" containerName="registry" probeResult="failure" output="dial tcp 10.134.0.30:6571: connect: connection refused" Sep 17 07:26:36.113688 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:26:36.113582 2559 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast-rest/feast-driver-ranking-586d6cc54b-2q5cp" podUID="1db23607-4f78-4235-94ad-111f8d362cd0" containerName="online" probeResult="failure" output="Get \"https://10.134.0.30:6567/health\": dial tcp 10.134.0.30:6567: connect: connection refused" Sep 17 07:26:39.112492 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:26:39.112448 2559 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast-rest/feast-driver-ranking-586d6cc54b-2q5cp" podUID="1db23607-4f78-4235-94ad-111f8d362cd0" containerName="registry" probeResult="failure" output="dial tcp 10.134.0.30:6571: connect: connection refused" Sep 17 07:26:39.112947 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:26:39.112454 2559 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast-rest/feast-driver-ranking-586d6cc54b-2q5cp" podUID="1db23607-4f78-4235-94ad-111f8d362cd0" containerName="online" probeResult="failure" output="Get \"https://10.134.0.30:6567/health\": dial tcp 10.134.0.30:6567: connect: connection refused" Sep 17 07:26:41.112338 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:26:41.112292 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast-rest/feast-driver-ranking-586d6cc54b-2q5cp" Sep 17 07:26:41.112723 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:26:41.112380 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast-rest/feast-driver-ranking-586d6cc54b-2q5cp" Sep 17 07:26:42.112413 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:26:42.112369 2559 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast-rest/feast-driver-ranking-586d6cc54b-2q5cp" podUID="1db23607-4f78-4235-94ad-111f8d362cd0" containerName="registry" probeResult="failure" output="dial tcp 10.134.0.30:6571: connect: connection refused" Sep 17 07:26:42.118832 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:26:42.118798 2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast-rest/feast-driver-ranking-586d6cc54b-2q5cp" Sep 17 07:26:42.152391 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:26:42.152322 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="test-ns-feast-rest/feast-driver-ranking-586d6cc54b-2q5cp" podStartSLOduration=22.152298778 podStartE2EDuration="22.152298778s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 07:26:20 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 07:26:35.798553341 +0000 UTC m=+1103.346700051" watchObservedRunningTime="2026-09-17 07:26:42.152298778 +0000 UTC m=+1109.700445487" Sep 17 07:26:42.792142 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:26:42.792108 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast-rest/feast-driver-ranking-586d6cc54b-2q5cp" Sep 17 07:26:45.112650 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:26:45.112597 2559 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast-rest/feast-driver-ranking-586d6cc54b-2q5cp" podUID="1db23607-4f78-4235-94ad-111f8d362cd0" containerName="registry" probeResult="failure" output="dial tcp 10.134.0.30:6571: connect: connection refused" Sep 17 07:26:48.112613 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:26:48.112578 2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast-rest/feast-driver-ranking-586d6cc54b-2q5cp" Sep 17 07:26:48.113350 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:26:48.113328 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast-rest/feast-driver-ranking-586d6cc54b-2q5cp" Sep 17 07:28:10.381086 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:28:10.381012 2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast-rest/feast-credit-scoring-dbd676869-z7hhv"] Sep 17 07:28:10.381555 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:28:10.381254 2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast-rest/feast-credit-scoring-dbd676869-z7hhv" podUID="a3006af8-996e-4ac0-8e6b-ca089cc5cd65" containerName="registry" containerID="cri-o://76c5b7ad894ca8b1cf84ecfa18d581da0ad614f35ff773751dd77ade62bdc8b2" gracePeriod=30 Sep 17 07:28:10.381555 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:28:10.381333 2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast-rest/feast-credit-scoring-dbd676869-z7hhv" podUID="a3006af8-996e-4ac0-8e6b-ca089cc5cd65" containerName="online" containerID="cri-o://4acea8c239f48607d6a50e17ab4d9d89dd0fb0d0a7ecca94a924dbffeab6ad49" gracePeriod=30 Sep 17 07:28:10.388506 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:28:10.388481 2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast-rest/feast-driver-ranking-586d6cc54b-2q5cp"] Sep 17 07:28:10.388697 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:28:10.388672 2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast-rest/feast-driver-ranking-586d6cc54b-2q5cp" podUID="1db23607-4f78-4235-94ad-111f8d362cd0" containerName="registry" containerID="cri-o://38856c7eb4f024287ed6c6b5407026162f653ae3da73623173e233e5a0f7b0e4" gracePeriod=30 Sep 17 07:28:10.388805 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:28:10.388711 2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast-rest/feast-driver-ranking-586d6cc54b-2q5cp" podUID="1db23607-4f78-4235-94ad-111f8d362cd0" containerName="online" containerID="cri-o://d0ec0dfda58d14f18f77d532cfbd23a3960698e35140c86eaa1693efe8421604" gracePeriod=30 Sep 17 07:28:12.172704 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:28:12.172673 2559 generic.go:356] "Generic (PLEG): container finished" podID="a3006af8-996e-4ac0-8e6b-ca089cc5cd65" containerID="4acea8c239f48607d6a50e17ab4d9d89dd0fb0d0a7ecca94a924dbffeab6ad49" exitCode=0 Sep 17 07:28:12.173149 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:28:12.172747 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-credit-scoring-dbd676869-z7hhv" event={"ID":"a3006af8-996e-4ac0-8e6b-ca089cc5cd65","Type":"ContainerDied","Data":"4acea8c239f48607d6a50e17ab4d9d89dd0fb0d0a7ecca94a924dbffeab6ad49"} Sep 17 07:28:12.175136 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:28:12.175116 2559 generic.go:356] "Generic (PLEG): container finished" podID="1db23607-4f78-4235-94ad-111f8d362cd0" containerID="d0ec0dfda58d14f18f77d532cfbd23a3960698e35140c86eaa1693efe8421604" exitCode=0 Sep 17 07:28:12.175249 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:28:12.175160 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-driver-ranking-586d6cc54b-2q5cp" event={"ID":"1db23607-4f78-4235-94ad-111f8d362cd0","Type":"ContainerDied","Data":"d0ec0dfda58d14f18f77d532cfbd23a3960698e35140c86eaa1693efe8421604"} Sep 17 07:28:12.630556 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:28:12.630521 2559 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast-rest/feast-credit-scoring-dbd676869-z7hhv" podUID="a3006af8-996e-4ac0-8e6b-ca089cc5cd65" containerName="online" probeResult="failure" output="Get \"https://10.134.0.29:6567/health\": dial tcp 10.134.0.29:6567: connect: connection refused" Sep 17 07:28:12.789434 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:28:12.789401 2559 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast-rest/feast-driver-ranking-586d6cc54b-2q5cp" podUID="1db23607-4f78-4235-94ad-111f8d362cd0" containerName="online" probeResult="failure" output="Get \"https://10.134.0.30:6567/health\": dial tcp 10.134.0.30:6567: connect: connection refused" Sep 17 07:28:12.907590 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:28:12.907524 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-b99wz_5ae9fb13-f8a8-4999-9023-cebdf2a7bd97/ovn-acl-logging/0.log" Sep 17 07:28:12.909094 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:28:12.909076 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-b99wz_5ae9fb13-f8a8-4999-9023-cebdf2a7bd97/ovn-acl-logging/0.log" Sep 17 07:28:22.631335 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:28:22.631282 2559 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast-rest/feast-credit-scoring-dbd676869-z7hhv" podUID="a3006af8-996e-4ac0-8e6b-ca089cc5cd65" containerName="online" probeResult="failure" output="Get \"https://10.134.0.29:6567/health\": dial tcp 10.134.0.29:6567: connect: connection refused" Sep 17 07:28:22.789539 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:28:22.789496 2559 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast-rest/feast-driver-ranking-586d6cc54b-2q5cp" podUID="1db23607-4f78-4235-94ad-111f8d362cd0" containerName="online" probeResult="failure" output="Get \"https://10.134.0.30:6567/health\": dial tcp 10.134.0.30:6567: connect: connection refused" Sep 17 07:28:32.631067 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:28:32.631024 2559 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast-rest/feast-credit-scoring-dbd676869-z7hhv" podUID="a3006af8-996e-4ac0-8e6b-ca089cc5cd65" containerName="online" probeResult="failure" output="Get \"https://10.134.0.29:6567/health\": dial tcp 10.134.0.29:6567: connect: connection refused" Sep 17 07:28:32.631443 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:28:32.631174 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast-rest/feast-credit-scoring-dbd676869-z7hhv" Sep 17 07:28:32.789238 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:28:32.789206 2559 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast-rest/feast-driver-ranking-586d6cc54b-2q5cp" podUID="1db23607-4f78-4235-94ad-111f8d362cd0" containerName="online" probeResult="failure" output="Get \"https://10.134.0.30:6567/health\": dial tcp 10.134.0.30:6567: connect: connection refused" Sep 17 07:28:32.789391 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:28:32.789302 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast-rest/feast-driver-ranking-586d6cc54b-2q5cp" Sep 17 07:28:41.046348 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:28:41.046322 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast-rest/feast-credit-scoring-dbd676869-z7hhv" Sep 17 07:28:41.048865 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:28:41.048849 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast-rest/feast-driver-ranking-586d6cc54b-2q5cp" Sep 17 07:28:41.110359 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:28:41.110336 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/a3006af8-996e-4ac0-8e6b-ca089cc5cd65-feast-data\") pod \"a3006af8-996e-4ac0-8e6b-ca089cc5cd65\" (UID: \"a3006af8-996e-4ac0-8e6b-ca089cc5cd65\") " Sep 17 07:28:41.110471 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:28:41.110369 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8cf4k\" (UniqueName: \"kubernetes.io/projected/1db23607-4f78-4235-94ad-111f8d362cd0-kube-api-access-8cf4k\") pod \"1db23607-4f78-4235-94ad-111f8d362cd0\" (UID: \"1db23607-4f78-4235-94ad-111f8d362cd0\") " Sep 17 07:28:41.110471 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:28:41.110445 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/1db23607-4f78-4235-94ad-111f8d362cd0-online-tls\") pod \"1db23607-4f78-4235-94ad-111f8d362cd0\" (UID: \"1db23607-4f78-4235-94ad-111f8d362cd0\") " Sep 17 07:28:41.110594 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:28:41.110470 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/1db23607-4f78-4235-94ad-111f8d362cd0-feast-data\") pod \"1db23607-4f78-4235-94ad-111f8d362cd0\" (UID: \"1db23607-4f78-4235-94ad-111f8d362cd0\") " Sep 17 07:28:41.110594 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:28:41.110548 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/a3006af8-996e-4ac0-8e6b-ca089cc5cd65-online-tls\") pod \"a3006af8-996e-4ac0-8e6b-ca089cc5cd65\" (UID: \"a3006af8-996e-4ac0-8e6b-ca089cc5cd65\") " Sep 17 07:28:41.110691 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:28:41.110620 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/a3006af8-996e-4ac0-8e6b-ca089cc5cd65-registry-tls\") pod \"a3006af8-996e-4ac0-8e6b-ca089cc5cd65\" (UID: \"a3006af8-996e-4ac0-8e6b-ca089cc5cd65\") " Sep 17 07:28:41.110691 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:28:41.110644 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/1db23607-4f78-4235-94ad-111f8d362cd0-registry-tls\") pod \"1db23607-4f78-4235-94ad-111f8d362cd0\" (UID: \"1db23607-4f78-4235-94ad-111f8d362cd0\") " Sep 17 07:28:41.110691 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:28:41.110675 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pbkcx\" (UniqueName: \"kubernetes.io/projected/a3006af8-996e-4ac0-8e6b-ca089cc5cd65-kube-api-access-pbkcx\") pod \"a3006af8-996e-4ac0-8e6b-ca089cc5cd65\" (UID: \"a3006af8-996e-4ac0-8e6b-ca089cc5cd65\") " Sep 17 07:28:41.110925 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:28:41.110900 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1db23607-4f78-4235-94ad-111f8d362cd0-feast-data" (OuterVolumeSpecName: "feast-data") pod "1db23607-4f78-4235-94ad-111f8d362cd0" (UID: "1db23607-4f78-4235-94ad-111f8d362cd0"). InnerVolumeSpecName "feast-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 17 07:28:41.113293 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:28:41.113098 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1db23607-4f78-4235-94ad-111f8d362cd0-online-tls" (OuterVolumeSpecName: "online-tls") pod "1db23607-4f78-4235-94ad-111f8d362cd0" (UID: "1db23607-4f78-4235-94ad-111f8d362cd0"). InnerVolumeSpecName "online-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 17 07:28:41.113433 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:28:41.113410 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a3006af8-996e-4ac0-8e6b-ca089cc5cd65-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "a3006af8-996e-4ac0-8e6b-ca089cc5cd65" (UID: "a3006af8-996e-4ac0-8e6b-ca089cc5cd65"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 17 07:28:41.114127 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:28:41.114055 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1db23607-4f78-4235-94ad-111f8d362cd0-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "1db23607-4f78-4235-94ad-111f8d362cd0" (UID: "1db23607-4f78-4235-94ad-111f8d362cd0"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 17 07:28:41.114127 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:28:41.114097 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a3006af8-996e-4ac0-8e6b-ca089cc5cd65-kube-api-access-pbkcx" (OuterVolumeSpecName: "kube-api-access-pbkcx") pod "a3006af8-996e-4ac0-8e6b-ca089cc5cd65" (UID: "a3006af8-996e-4ac0-8e6b-ca089cc5cd65"). InnerVolumeSpecName "kube-api-access-pbkcx". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 17 07:28:41.114277 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:28:41.114139 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1db23607-4f78-4235-94ad-111f8d362cd0-kube-api-access-8cf4k" (OuterVolumeSpecName: "kube-api-access-8cf4k") pod "1db23607-4f78-4235-94ad-111f8d362cd0" (UID: "1db23607-4f78-4235-94ad-111f8d362cd0"). InnerVolumeSpecName "kube-api-access-8cf4k". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 17 07:28:41.114277 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:28:41.114213 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a3006af8-996e-4ac0-8e6b-ca089cc5cd65-online-tls" (OuterVolumeSpecName: "online-tls") pod "a3006af8-996e-4ac0-8e6b-ca089cc5cd65" (UID: "a3006af8-996e-4ac0-8e6b-ca089cc5cd65"). InnerVolumeSpecName "online-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 17 07:28:41.121518 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:28:41.121496 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a3006af8-996e-4ac0-8e6b-ca089cc5cd65-feast-data" (OuterVolumeSpecName: "feast-data") pod "a3006af8-996e-4ac0-8e6b-ca089cc5cd65" (UID: "a3006af8-996e-4ac0-8e6b-ca089cc5cd65"). InnerVolumeSpecName "feast-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 17 07:28:41.211238 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:28:41.211192 2559 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/a3006af8-996e-4ac0-8e6b-ca089cc5cd65-registry-tls\") on node \"ip-10-0-138-13.ec2.internal\" DevicePath \"\"" Sep 17 07:28:41.211238 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:28:41.211213 2559 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/1db23607-4f78-4235-94ad-111f8d362cd0-registry-tls\") on node \"ip-10-0-138-13.ec2.internal\" DevicePath \"\"" Sep 17 07:28:41.211238 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:28:41.211221 2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pbkcx\" (UniqueName: \"kubernetes.io/projected/a3006af8-996e-4ac0-8e6b-ca089cc5cd65-kube-api-access-pbkcx\") on node \"ip-10-0-138-13.ec2.internal\" DevicePath \"\"" Sep 17 07:28:41.211238 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:28:41.211229 2559 reconciler_common.go:299] "Volume detached for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/a3006af8-996e-4ac0-8e6b-ca089cc5cd65-feast-data\") on node \"ip-10-0-138-13.ec2.internal\" DevicePath \"\"" Sep 17 07:28:41.211238 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:28:41.211238 2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8cf4k\" (UniqueName: \"kubernetes.io/projected/1db23607-4f78-4235-94ad-111f8d362cd0-kube-api-access-8cf4k\") on node \"ip-10-0-138-13.ec2.internal\" DevicePath \"\"" Sep 17 07:28:41.211432 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:28:41.211246 2559 reconciler_common.go:299] "Volume detached for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/1db23607-4f78-4235-94ad-111f8d362cd0-online-tls\") on node \"ip-10-0-138-13.ec2.internal\" DevicePath \"\"" Sep 17 07:28:41.211432 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:28:41.211254 2559 reconciler_common.go:299] "Volume detached for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/1db23607-4f78-4235-94ad-111f8d362cd0-feast-data\") on node \"ip-10-0-138-13.ec2.internal\" DevicePath \"\"" Sep 17 07:28:41.211432 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:28:41.211261 2559 reconciler_common.go:299] "Volume detached for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/a3006af8-996e-4ac0-8e6b-ca089cc5cd65-online-tls\") on node \"ip-10-0-138-13.ec2.internal\" DevicePath \"\"" Sep 17 07:28:41.306569 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:28:41.306545 2559 generic.go:356] "Generic (PLEG): container finished" podID="a3006af8-996e-4ac0-8e6b-ca089cc5cd65" containerID="76c5b7ad894ca8b1cf84ecfa18d581da0ad614f35ff773751dd77ade62bdc8b2" exitCode=137 Sep 17 07:28:41.306650 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:28:41.306600 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast-rest/feast-credit-scoring-dbd676869-z7hhv" Sep 17 07:28:41.306650 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:28:41.306623 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-credit-scoring-dbd676869-z7hhv" event={"ID":"a3006af8-996e-4ac0-8e6b-ca089cc5cd65","Type":"ContainerDied","Data":"76c5b7ad894ca8b1cf84ecfa18d581da0ad614f35ff773751dd77ade62bdc8b2"} Sep 17 07:28:41.306725 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:28:41.306670 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-credit-scoring-dbd676869-z7hhv" event={"ID":"a3006af8-996e-4ac0-8e6b-ca089cc5cd65","Type":"ContainerDied","Data":"16c09c39e2fd7938ecfdedc8f8204556e81ab9ea60259eaf7fd00564dcf0b90d"} Sep 17 07:28:41.306725 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:28:41.306695 2559 scope.go:117] "RemoveContainer" containerID="4acea8c239f48607d6a50e17ab4d9d89dd0fb0d0a7ecca94a924dbffeab6ad49" Sep 17 07:28:41.309097 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:28:41.309073 2559 generic.go:356] "Generic (PLEG): container finished" podID="1db23607-4f78-4235-94ad-111f8d362cd0" containerID="38856c7eb4f024287ed6c6b5407026162f653ae3da73623173e233e5a0f7b0e4" exitCode=137 Sep 17 07:28:41.309197 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:28:41.309109 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-driver-ranking-586d6cc54b-2q5cp" event={"ID":"1db23607-4f78-4235-94ad-111f8d362cd0","Type":"ContainerDied","Data":"38856c7eb4f024287ed6c6b5407026162f653ae3da73623173e233e5a0f7b0e4"} Sep 17 07:28:41.309197 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:28:41.309136 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast-rest/feast-driver-ranking-586d6cc54b-2q5cp" Sep 17 07:28:41.309197 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:28:41.309147 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-driver-ranking-586d6cc54b-2q5cp" event={"ID":"1db23607-4f78-4235-94ad-111f8d362cd0","Type":"ContainerDied","Data":"acf1881abf0ff4e01cc2126478ba31c1f2d5a202020b2b330299e35780f69f39"} Sep 17 07:28:41.315930 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:28:41.315833 2559 scope.go:117] "RemoveContainer" containerID="76c5b7ad894ca8b1cf84ecfa18d581da0ad614f35ff773751dd77ade62bdc8b2" Sep 17 07:28:41.324055 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:28:41.324039 2559 scope.go:117] "RemoveContainer" containerID="52548ef17693a6bcf38a6029b2bca235167ac2040e34fad157c22eb1bd5f4cf6" Sep 17 07:28:41.330964 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:28:41.330949 2559 scope.go:117] "RemoveContainer" containerID="b2c510104c51fb1eeb20e8b8b4552f5b2c9b3b1f85ba92dd25960389de5867fe" Sep 17 07:28:41.336753 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:28:41.336734 2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast-rest/feast-driver-ranking-586d6cc54b-2q5cp"] Sep 17 07:28:41.338181 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:28:41.338167 2559 scope.go:117] "RemoveContainer" containerID="4acea8c239f48607d6a50e17ab4d9d89dd0fb0d0a7ecca94a924dbffeab6ad49" Sep 17 07:28:41.338431 ip-10-0-138-13 kubenswrapper[2559]: E0917 07:28:41.338412 2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4acea8c239f48607d6a50e17ab4d9d89dd0fb0d0a7ecca94a924dbffeab6ad49\": container with ID starting with 4acea8c239f48607d6a50e17ab4d9d89dd0fb0d0a7ecca94a924dbffeab6ad49 not found: ID does not exist" containerID="4acea8c239f48607d6a50e17ab4d9d89dd0fb0d0a7ecca94a924dbffeab6ad49" Sep 17 07:28:41.338526 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:28:41.338440 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4acea8c239f48607d6a50e17ab4d9d89dd0fb0d0a7ecca94a924dbffeab6ad49"} err="failed to get container status \"4acea8c239f48607d6a50e17ab4d9d89dd0fb0d0a7ecca94a924dbffeab6ad49\": rpc error: code = NotFound desc = could not find container \"4acea8c239f48607d6a50e17ab4d9d89dd0fb0d0a7ecca94a924dbffeab6ad49\": container with ID starting with 4acea8c239f48607d6a50e17ab4d9d89dd0fb0d0a7ecca94a924dbffeab6ad49 not found: ID does not exist" Sep 17 07:28:41.338526 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:28:41.338463 2559 scope.go:117] "RemoveContainer" containerID="76c5b7ad894ca8b1cf84ecfa18d581da0ad614f35ff773751dd77ade62bdc8b2" Sep 17 07:28:41.338706 ip-10-0-138-13 kubenswrapper[2559]: E0917 07:28:41.338688 2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"76c5b7ad894ca8b1cf84ecfa18d581da0ad614f35ff773751dd77ade62bdc8b2\": container with ID starting with 76c5b7ad894ca8b1cf84ecfa18d581da0ad614f35ff773751dd77ade62bdc8b2 not found: ID does not exist" containerID="76c5b7ad894ca8b1cf84ecfa18d581da0ad614f35ff773751dd77ade62bdc8b2" Sep 17 07:28:41.338744 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:28:41.338712 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"76c5b7ad894ca8b1cf84ecfa18d581da0ad614f35ff773751dd77ade62bdc8b2"} err="failed to get container status \"76c5b7ad894ca8b1cf84ecfa18d581da0ad614f35ff773751dd77ade62bdc8b2\": rpc error: code = NotFound desc = could not find container \"76c5b7ad894ca8b1cf84ecfa18d581da0ad614f35ff773751dd77ade62bdc8b2\": container with ID starting with 76c5b7ad894ca8b1cf84ecfa18d581da0ad614f35ff773751dd77ade62bdc8b2 not found: ID does not exist" Sep 17 07:28:41.338744 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:28:41.338726 2559 scope.go:117] "RemoveContainer" containerID="52548ef17693a6bcf38a6029b2bca235167ac2040e34fad157c22eb1bd5f4cf6" Sep 17 07:28:41.339058 ip-10-0-138-13 kubenswrapper[2559]: E0917 07:28:41.339036 2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"52548ef17693a6bcf38a6029b2bca235167ac2040e34fad157c22eb1bd5f4cf6\": container with ID starting with 52548ef17693a6bcf38a6029b2bca235167ac2040e34fad157c22eb1bd5f4cf6 not found: ID does not exist" containerID="52548ef17693a6bcf38a6029b2bca235167ac2040e34fad157c22eb1bd5f4cf6" Sep 17 07:28:41.339137 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:28:41.339066 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"52548ef17693a6bcf38a6029b2bca235167ac2040e34fad157c22eb1bd5f4cf6"} err="failed to get container status \"52548ef17693a6bcf38a6029b2bca235167ac2040e34fad157c22eb1bd5f4cf6\": rpc error: code = NotFound desc = could not find container \"52548ef17693a6bcf38a6029b2bca235167ac2040e34fad157c22eb1bd5f4cf6\": container with ID starting with 52548ef17693a6bcf38a6029b2bca235167ac2040e34fad157c22eb1bd5f4cf6 not found: ID does not exist" Sep 17 07:28:41.339137 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:28:41.339088 2559 scope.go:117] "RemoveContainer" containerID="b2c510104c51fb1eeb20e8b8b4552f5b2c9b3b1f85ba92dd25960389de5867fe" Sep 17 07:28:41.339371 ip-10-0-138-13 kubenswrapper[2559]: E0917 07:28:41.339349 2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b2c510104c51fb1eeb20e8b8b4552f5b2c9b3b1f85ba92dd25960389de5867fe\": container with ID starting with b2c510104c51fb1eeb20e8b8b4552f5b2c9b3b1f85ba92dd25960389de5867fe not found: ID does not exist" containerID="b2c510104c51fb1eeb20e8b8b4552f5b2c9b3b1f85ba92dd25960389de5867fe" Sep 17 07:28:41.339519 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:28:41.339380 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b2c510104c51fb1eeb20e8b8b4552f5b2c9b3b1f85ba92dd25960389de5867fe"} err="failed to get container status \"b2c510104c51fb1eeb20e8b8b4552f5b2c9b3b1f85ba92dd25960389de5867fe\": rpc error: code = NotFound desc = could not find container \"b2c510104c51fb1eeb20e8b8b4552f5b2c9b3b1f85ba92dd25960389de5867fe\": container with ID starting with b2c510104c51fb1eeb20e8b8b4552f5b2c9b3b1f85ba92dd25960389de5867fe not found: ID does not exist" Sep 17 07:28:41.339519 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:28:41.339400 2559 scope.go:117] "RemoveContainer" containerID="d0ec0dfda58d14f18f77d532cfbd23a3960698e35140c86eaa1693efe8421604" Sep 17 07:28:41.341671 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:28:41.341652 2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["test-ns-feast-rest/feast-driver-ranking-586d6cc54b-2q5cp"] Sep 17 07:28:41.346696 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:28:41.346681 2559 scope.go:117] "RemoveContainer" containerID="38856c7eb4f024287ed6c6b5407026162f653ae3da73623173e233e5a0f7b0e4" Sep 17 07:28:41.354873 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:28:41.354842 2559 scope.go:117] "RemoveContainer" containerID="eb1e02ebd91b6fde07efd7a03e609e970936500b09db83ee7cc88098f99939b7" Sep 17 07:28:41.361893 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:28:41.361875 2559 scope.go:117] "RemoveContainer" containerID="1cb21f1e2868ef8df01330cb687c24f6fe7fee9774a55768a0182165f2a65592" Sep 17 07:28:41.368736 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:28:41.368719 2559 scope.go:117] "RemoveContainer" containerID="d0ec0dfda58d14f18f77d532cfbd23a3960698e35140c86eaa1693efe8421604" Sep 17 07:28:41.369020 ip-10-0-138-13 kubenswrapper[2559]: E0917 07:28:41.368998 2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d0ec0dfda58d14f18f77d532cfbd23a3960698e35140c86eaa1693efe8421604\": container with ID starting with d0ec0dfda58d14f18f77d532cfbd23a3960698e35140c86eaa1693efe8421604 not found: ID does not exist" containerID="d0ec0dfda58d14f18f77d532cfbd23a3960698e35140c86eaa1693efe8421604" Sep 17 07:28:41.369089 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:28:41.369031 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d0ec0dfda58d14f18f77d532cfbd23a3960698e35140c86eaa1693efe8421604"} err="failed to get container status \"d0ec0dfda58d14f18f77d532cfbd23a3960698e35140c86eaa1693efe8421604\": rpc error: code = NotFound desc = could not find container \"d0ec0dfda58d14f18f77d532cfbd23a3960698e35140c86eaa1693efe8421604\": container with ID starting with d0ec0dfda58d14f18f77d532cfbd23a3960698e35140c86eaa1693efe8421604 not found: ID does not exist" Sep 17 07:28:41.369089 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:28:41.369057 2559 scope.go:117] "RemoveContainer" containerID="38856c7eb4f024287ed6c6b5407026162f653ae3da73623173e233e5a0f7b0e4" Sep 17 07:28:41.369369 ip-10-0-138-13 kubenswrapper[2559]: E0917 07:28:41.369351 2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"38856c7eb4f024287ed6c6b5407026162f653ae3da73623173e233e5a0f7b0e4\": container with ID starting with 38856c7eb4f024287ed6c6b5407026162f653ae3da73623173e233e5a0f7b0e4 not found: ID does not exist" containerID="38856c7eb4f024287ed6c6b5407026162f653ae3da73623173e233e5a0f7b0e4" Sep 17 07:28:41.369461 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:28:41.369377 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"38856c7eb4f024287ed6c6b5407026162f653ae3da73623173e233e5a0f7b0e4"} err="failed to get container status \"38856c7eb4f024287ed6c6b5407026162f653ae3da73623173e233e5a0f7b0e4\": rpc error: code = NotFound desc = could not find container \"38856c7eb4f024287ed6c6b5407026162f653ae3da73623173e233e5a0f7b0e4\": container with ID starting with 38856c7eb4f024287ed6c6b5407026162f653ae3da73623173e233e5a0f7b0e4 not found: ID does not exist" Sep 17 07:28:41.369461 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:28:41.369398 2559 scope.go:117] "RemoveContainer" containerID="eb1e02ebd91b6fde07efd7a03e609e970936500b09db83ee7cc88098f99939b7" Sep 17 07:28:41.369849 ip-10-0-138-13 kubenswrapper[2559]: E0917 07:28:41.369829 2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"eb1e02ebd91b6fde07efd7a03e609e970936500b09db83ee7cc88098f99939b7\": container with ID starting with eb1e02ebd91b6fde07efd7a03e609e970936500b09db83ee7cc88098f99939b7 not found: ID does not exist" containerID="eb1e02ebd91b6fde07efd7a03e609e970936500b09db83ee7cc88098f99939b7" Sep 17 07:28:41.369948 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:28:41.369856 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"eb1e02ebd91b6fde07efd7a03e609e970936500b09db83ee7cc88098f99939b7"} err="failed to get container status \"eb1e02ebd91b6fde07efd7a03e609e970936500b09db83ee7cc88098f99939b7\": rpc error: code = NotFound desc = could not find container \"eb1e02ebd91b6fde07efd7a03e609e970936500b09db83ee7cc88098f99939b7\": container with ID starting with eb1e02ebd91b6fde07efd7a03e609e970936500b09db83ee7cc88098f99939b7 not found: ID does not exist" Sep 17 07:28:41.369948 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:28:41.369877 2559 scope.go:117] "RemoveContainer" containerID="1cb21f1e2868ef8df01330cb687c24f6fe7fee9774a55768a0182165f2a65592" Sep 17 07:28:41.370172 ip-10-0-138-13 kubenswrapper[2559]: E0917 07:28:41.370156 2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1cb21f1e2868ef8df01330cb687c24f6fe7fee9774a55768a0182165f2a65592\": container with ID starting with 1cb21f1e2868ef8df01330cb687c24f6fe7fee9774a55768a0182165f2a65592 not found: ID does not exist" containerID="1cb21f1e2868ef8df01330cb687c24f6fe7fee9774a55768a0182165f2a65592" Sep 17 07:28:41.370225 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:28:41.370180 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1cb21f1e2868ef8df01330cb687c24f6fe7fee9774a55768a0182165f2a65592"} err="failed to get container status \"1cb21f1e2868ef8df01330cb687c24f6fe7fee9774a55768a0182165f2a65592\": rpc error: code = NotFound desc = could not find container \"1cb21f1e2868ef8df01330cb687c24f6fe7fee9774a55768a0182165f2a65592\": container with ID starting with 1cb21f1e2868ef8df01330cb687c24f6fe7fee9774a55768a0182165f2a65592 not found: ID does not exist" Sep 17 07:28:41.371114 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:28:41.371098 2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast-rest/feast-credit-scoring-dbd676869-z7hhv"] Sep 17 07:28:41.378876 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:28:41.378857 2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["test-ns-feast-rest/feast-credit-scoring-dbd676869-z7hhv"] Sep 17 07:28:42.898220 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:28:42.898187 2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1db23607-4f78-4235-94ad-111f8d362cd0" path="/var/lib/kubelet/pods/1db23607-4f78-4235-94ad-111f8d362cd0/volumes" Sep 17 07:28:42.898684 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:28:42.898669 2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a3006af8-996e-4ac0-8e6b-ca089cc5cd65" path="/var/lib/kubelet/pods/a3006af8-996e-4ac0-8e6b-ca089cc5cd65/volumes" Sep 17 07:33:12.932806 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:33:12.932779 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-b99wz_5ae9fb13-f8a8-4999-9023-cebdf2a7bd97/ovn-acl-logging/0.log" Sep 17 07:33:12.935312 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:33:12.935293 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-b99wz_5ae9fb13-f8a8-4999-9023-cebdf2a7bd97/ovn-acl-logging/0.log" Sep 17 07:38:12.960191 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:38:12.960161 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-b99wz_5ae9fb13-f8a8-4999-9023-cebdf2a7bd97/ovn-acl-logging/0.log" Sep 17 07:38:12.965686 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:38:12.965668 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-b99wz_5ae9fb13-f8a8-4999-9023-cebdf2a7bd97/ovn-acl-logging/0.log" Sep 17 07:40:28.277761 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:40:28.277731 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-btqpf_ac82b91d-660c-4aeb-8538-2dd48f75e691/global-pull-secret-syncer/0.log" Sep 17 07:40:28.448202 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:40:28.448175 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-jkzvc_37a6b6ba-2423-42bf-ba8a-072efd4cb13a/konnectivity-agent/0.log" Sep 17 07:40:28.493385 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:40:28.493362 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-138-13.ec2.internal_6e31eb7ec87a2342202a2651286e5c55/haproxy/0.log" Sep 17 07:40:32.018757 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:40:32.018680 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_48bde459-06ea-46d4-867a-f367e2a9067e/alertmanager/0.log" Sep 17 07:40:32.046547 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:40:32.046513 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_48bde459-06ea-46d4-867a-f367e2a9067e/config-reloader/0.log" Sep 17 07:40:32.075616 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:40:32.075588 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_48bde459-06ea-46d4-867a-f367e2a9067e/kube-rbac-proxy-web/0.log" Sep 17 07:40:32.103437 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:40:32.103414 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_48bde459-06ea-46d4-867a-f367e2a9067e/kube-rbac-proxy/0.log" Sep 17 07:40:32.128771 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:40:32.128750 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_48bde459-06ea-46d4-867a-f367e2a9067e/kube-rbac-proxy-metric/0.log" Sep 17 07:40:32.150682 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:40:32.150661 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_48bde459-06ea-46d4-867a-f367e2a9067e/prom-label-proxy/0.log" Sep 17 07:40:32.175916 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:40:32.175900 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_48bde459-06ea-46d4-867a-f367e2a9067e/init-config-reloader/0.log" Sep 17 07:40:32.213697 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:40:32.213676 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-6cd954b897-24z67_fa45a0ac-8d9b-4458-b6c0-ae63e5aff0ab/cluster-monitoring-operator/0.log" Sep 17 07:40:32.316272 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:40:32.316213 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-8db5f8b5c-xt759_d700e0c0-22c1-484b-81ff-d75bd670e3e2/metrics-server/0.log" Sep 17 07:40:32.348502 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:40:32.348475 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-5d85778b9d-tj6dc_208b9bb7-106e-4807-a3fb-80925f62e39a/monitoring-plugin/0.log" Sep 17 07:40:32.587607 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:40:32.587556 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-w55j5_40bdd2f2-69d1-46dd-9ec2-3c57fb98b874/node-exporter/0.log" Sep 17 07:40:32.608501 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:40:32.608478 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-w55j5_40bdd2f2-69d1-46dd-9ec2-3c57fb98b874/kube-rbac-proxy/0.log" Sep 17 07:40:32.633786 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:40:32.633763 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-w55j5_40bdd2f2-69d1-46dd-9ec2-3c57fb98b874/init-textfile/0.log" Sep 17 07:40:32.668517 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:40:32.668495 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-67dcf8c979-khvdn_98e5d160-0b87-4ad9-ab09-23d64a419f9a/kube-rbac-proxy-main/0.log" Sep 17 07:40:32.688567 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:40:32.688546 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-67dcf8c979-khvdn_98e5d160-0b87-4ad9-ab09-23d64a419f9a/kube-rbac-proxy-self/0.log" Sep 17 07:40:32.709268 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:40:32.709245 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-67dcf8c979-khvdn_98e5d160-0b87-4ad9-ab09-23d64a419f9a/openshift-state-metrics/0.log" Sep 17 07:40:32.989899 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:40:32.989839 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-6b74b75746-hvr5n_9c6ee632-6804-4582-8a0b-0ad112f66408/telemeter-client/0.log" Sep 17 07:40:33.012162 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:40:33.012130 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-6b74b75746-hvr5n_9c6ee632-6804-4582-8a0b-0ad112f66408/reload/0.log" Sep 17 07:40:33.035010 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:40:33.034989 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-6b74b75746-hvr5n_9c6ee632-6804-4582-8a0b-0ad112f66408/kube-rbac-proxy/0.log" Sep 17 07:40:33.068894 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:40:33.068877 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-6fd79699b8-9pm6z_f6186428-be06-481b-a94c-090002b4dd47/thanos-query/0.log" Sep 17 07:40:33.094044 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:40:33.094026 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-6fd79699b8-9pm6z_f6186428-be06-481b-a94c-090002b4dd47/kube-rbac-proxy-web/0.log" Sep 17 07:40:33.114731 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:40:33.114712 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-6fd79699b8-9pm6z_f6186428-be06-481b-a94c-090002b4dd47/kube-rbac-proxy/0.log" Sep 17 07:40:33.140549 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:40:33.140525 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-6fd79699b8-9pm6z_f6186428-be06-481b-a94c-090002b4dd47/prom-label-proxy/0.log" Sep 17 07:40:33.163656 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:40:33.163635 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-6fd79699b8-9pm6z_f6186428-be06-481b-a94c-090002b4dd47/kube-rbac-proxy-rules/0.log" Sep 17 07:40:33.200164 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:40:33.200141 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-6fd79699b8-9pm6z_f6186428-be06-481b-a94c-090002b4dd47/kube-rbac-proxy-metrics/0.log" Sep 17 07:40:34.478393 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:40:34.478364 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-5dcbc7df6b-86ngp_30a5321e-8a62-4229-8b8c-bf3dfa518557/networking-console-plugin/0.log" Sep 17 07:40:35.580958 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:40:35.580926 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-vh9zj/perf-node-gather-daemonset-qw5nd"] Sep 17 07:40:35.581330 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:40:35.581257 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1db23607-4f78-4235-94ad-111f8d362cd0" containerName="online" Sep 17 07:40:35.581330 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:40:35.581268 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="1db23607-4f78-4235-94ad-111f8d362cd0" containerName="online" Sep 17 07:40:35.581330 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:40:35.581282 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a3006af8-996e-4ac0-8e6b-ca089cc5cd65" containerName="online" Sep 17 07:40:35.581330 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:40:35.581288 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="a3006af8-996e-4ac0-8e6b-ca089cc5cd65" containerName="online" Sep 17 07:40:35.581330 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:40:35.581296 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a3006af8-996e-4ac0-8e6b-ca089cc5cd65" containerName="feast-init" Sep 17 07:40:35.581330 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:40:35.581302 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="a3006af8-996e-4ac0-8e6b-ca089cc5cd65" containerName="feast-init" Sep 17 07:40:35.581330 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:40:35.581316 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a3006af8-996e-4ac0-8e6b-ca089cc5cd65" containerName="feast-apply" Sep 17 07:40:35.581330 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:40:35.581322 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="a3006af8-996e-4ac0-8e6b-ca089cc5cd65" containerName="feast-apply" Sep 17 07:40:35.581330 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:40:35.581329 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1db23607-4f78-4235-94ad-111f8d362cd0" containerName="feast-init" Sep 17 07:40:35.581330 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:40:35.581334 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="1db23607-4f78-4235-94ad-111f8d362cd0" containerName="feast-init" Sep 17 07:40:35.581680 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:40:35.581344 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a3006af8-996e-4ac0-8e6b-ca089cc5cd65" containerName="registry" Sep 17 07:40:35.581680 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:40:35.581350 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="a3006af8-996e-4ac0-8e6b-ca089cc5cd65" containerName="registry" Sep 17 07:40:35.581680 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:40:35.581355 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1db23607-4f78-4235-94ad-111f8d362cd0" containerName="feast-apply" Sep 17 07:40:35.581680 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:40:35.581360 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="1db23607-4f78-4235-94ad-111f8d362cd0" containerName="feast-apply" Sep 17 07:40:35.581680 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:40:35.581365 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1db23607-4f78-4235-94ad-111f8d362cd0" containerName="registry" Sep 17 07:40:35.581680 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:40:35.581370 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="1db23607-4f78-4235-94ad-111f8d362cd0" containerName="registry" Sep 17 07:40:35.581680 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:40:35.581416 2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="1db23607-4f78-4235-94ad-111f8d362cd0" containerName="online" Sep 17 07:40:35.581680 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:40:35.581424 2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="a3006af8-996e-4ac0-8e6b-ca089cc5cd65" containerName="online" Sep 17 07:40:35.581680 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:40:35.581430 2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="1db23607-4f78-4235-94ad-111f8d362cd0" containerName="registry" Sep 17 07:40:35.581680 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:40:35.581437 2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="a3006af8-996e-4ac0-8e6b-ca089cc5cd65" containerName="registry" Sep 17 07:40:35.584469 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:40:35.584448 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-vh9zj/perf-node-gather-daemonset-qw5nd" Sep 17 07:40:35.587028 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:40:35.587008 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-vh9zj\"/\"kube-root-ca.crt\"" Sep 17 07:40:35.587131 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:40:35.587010 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-vh9zj\"/\"default-dockercfg-79wf9\"" Sep 17 07:40:35.587684 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:40:35.587670 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-vh9zj\"/\"openshift-service-ca.crt\"" Sep 17 07:40:35.594573 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:40:35.594553 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-vh9zj/perf-node-gather-daemonset-qw5nd"] Sep 17 07:40:35.653397 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:40:35.653374 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/cbc9b3de-ab4b-4e0f-be2d-25a8a8c97c58-podres\") pod \"perf-node-gather-daemonset-qw5nd\" (UID: \"cbc9b3de-ab4b-4e0f-be2d-25a8a8c97c58\") " pod="openshift-must-gather-vh9zj/perf-node-gather-daemonset-qw5nd" Sep 17 07:40:35.653517 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:40:35.653422 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/cbc9b3de-ab4b-4e0f-be2d-25a8a8c97c58-lib-modules\") pod \"perf-node-gather-daemonset-qw5nd\" (UID: \"cbc9b3de-ab4b-4e0f-be2d-25a8a8c97c58\") " pod="openshift-must-gather-vh9zj/perf-node-gather-daemonset-qw5nd" Sep 17 07:40:35.653517 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:40:35.653452 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/cbc9b3de-ab4b-4e0f-be2d-25a8a8c97c58-sys\") pod \"perf-node-gather-daemonset-qw5nd\" (UID: \"cbc9b3de-ab4b-4e0f-be2d-25a8a8c97c58\") " pod="openshift-must-gather-vh9zj/perf-node-gather-daemonset-qw5nd" Sep 17 07:40:35.653517 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:40:35.653499 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hsg76\" (UniqueName: \"kubernetes.io/projected/cbc9b3de-ab4b-4e0f-be2d-25a8a8c97c58-kube-api-access-hsg76\") pod \"perf-node-gather-daemonset-qw5nd\" (UID: \"cbc9b3de-ab4b-4e0f-be2d-25a8a8c97c58\") " pod="openshift-must-gather-vh9zj/perf-node-gather-daemonset-qw5nd" Sep 17 07:40:35.653627 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:40:35.653524 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/cbc9b3de-ab4b-4e0f-be2d-25a8a8c97c58-proc\") pod \"perf-node-gather-daemonset-qw5nd\" (UID: \"cbc9b3de-ab4b-4e0f-be2d-25a8a8c97c58\") " pod="openshift-must-gather-vh9zj/perf-node-gather-daemonset-qw5nd" Sep 17 07:40:35.753985 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:40:35.753942 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hsg76\" (UniqueName: \"kubernetes.io/projected/cbc9b3de-ab4b-4e0f-be2d-25a8a8c97c58-kube-api-access-hsg76\") pod \"perf-node-gather-daemonset-qw5nd\" (UID: \"cbc9b3de-ab4b-4e0f-be2d-25a8a8c97c58\") " pod="openshift-must-gather-vh9zj/perf-node-gather-daemonset-qw5nd" Sep 17 07:40:35.754079 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:40:35.754003 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/cbc9b3de-ab4b-4e0f-be2d-25a8a8c97c58-proc\") pod \"perf-node-gather-daemonset-qw5nd\" (UID: \"cbc9b3de-ab4b-4e0f-be2d-25a8a8c97c58\") " pod="openshift-must-gather-vh9zj/perf-node-gather-daemonset-qw5nd" Sep 17 07:40:35.754079 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:40:35.754038 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/cbc9b3de-ab4b-4e0f-be2d-25a8a8c97c58-podres\") pod \"perf-node-gather-daemonset-qw5nd\" (UID: \"cbc9b3de-ab4b-4e0f-be2d-25a8a8c97c58\") " pod="openshift-must-gather-vh9zj/perf-node-gather-daemonset-qw5nd" Sep 17 07:40:35.754079 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:40:35.754078 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/cbc9b3de-ab4b-4e0f-be2d-25a8a8c97c58-lib-modules\") pod \"perf-node-gather-daemonset-qw5nd\" (UID: \"cbc9b3de-ab4b-4e0f-be2d-25a8a8c97c58\") " pod="openshift-must-gather-vh9zj/perf-node-gather-daemonset-qw5nd" Sep 17 07:40:35.754227 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:40:35.754096 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/cbc9b3de-ab4b-4e0f-be2d-25a8a8c97c58-sys\") pod \"perf-node-gather-daemonset-qw5nd\" (UID: \"cbc9b3de-ab4b-4e0f-be2d-25a8a8c97c58\") " pod="openshift-must-gather-vh9zj/perf-node-gather-daemonset-qw5nd" Sep 17 07:40:35.754227 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:40:35.754125 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/cbc9b3de-ab4b-4e0f-be2d-25a8a8c97c58-proc\") pod \"perf-node-gather-daemonset-qw5nd\" (UID: \"cbc9b3de-ab4b-4e0f-be2d-25a8a8c97c58\") " pod="openshift-must-gather-vh9zj/perf-node-gather-daemonset-qw5nd" Sep 17 07:40:35.754227 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:40:35.754167 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/cbc9b3de-ab4b-4e0f-be2d-25a8a8c97c58-sys\") pod \"perf-node-gather-daemonset-qw5nd\" (UID: \"cbc9b3de-ab4b-4e0f-be2d-25a8a8c97c58\") " pod="openshift-must-gather-vh9zj/perf-node-gather-daemonset-qw5nd" Sep 17 07:40:35.754227 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:40:35.754187 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/cbc9b3de-ab4b-4e0f-be2d-25a8a8c97c58-lib-modules\") pod \"perf-node-gather-daemonset-qw5nd\" (UID: \"cbc9b3de-ab4b-4e0f-be2d-25a8a8c97c58\") " pod="openshift-must-gather-vh9zj/perf-node-gather-daemonset-qw5nd" Sep 17 07:40:35.754227 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:40:35.754195 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/cbc9b3de-ab4b-4e0f-be2d-25a8a8c97c58-podres\") pod \"perf-node-gather-daemonset-qw5nd\" (UID: \"cbc9b3de-ab4b-4e0f-be2d-25a8a8c97c58\") " pod="openshift-must-gather-vh9zj/perf-node-gather-daemonset-qw5nd" Sep 17 07:40:35.764627 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:40:35.764603 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hsg76\" (UniqueName: \"kubernetes.io/projected/cbc9b3de-ab4b-4e0f-be2d-25a8a8c97c58-kube-api-access-hsg76\") pod \"perf-node-gather-daemonset-qw5nd\" (UID: \"cbc9b3de-ab4b-4e0f-be2d-25a8a8c97c58\") " pod="openshift-must-gather-vh9zj/perf-node-gather-daemonset-qw5nd" Sep 17 07:40:35.894156 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:40:35.894090 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-vh9zj/perf-node-gather-daemonset-qw5nd" Sep 17 07:40:35.989265 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:40:35.989238 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-86695b7cc7-mpn5m_39418702-f038-4ba4-b9be-d4132800b75c/volume-data-source-validator/0.log" Sep 17 07:40:36.165102 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:40:36.165080 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-vh9zj/perf-node-gather-daemonset-qw5nd"] Sep 17 07:40:36.167187 ip-10-0-138-13 kubenswrapper[2559]: W0917 07:40:36.167162 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podcbc9b3de_ab4b_4e0f_be2d_25a8a8c97c58.slice/crio-aa9cac5eee48d972aba87e38f41ac19a2959ea3c24fb981eb596c5a1904c7ad1 WatchSource:0}: Error finding container aa9cac5eee48d972aba87e38f41ac19a2959ea3c24fb981eb596c5a1904c7ad1: Status 404 returned error can't find the container with id aa9cac5eee48d972aba87e38f41ac19a2959ea3c24fb981eb596c5a1904c7ad1 Sep 17 07:40:36.251802 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:40:36.251778 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-vh9zj/perf-node-gather-daemonset-qw5nd" event={"ID":"cbc9b3de-ab4b-4e0f-be2d-25a8a8c97c58","Type":"ContainerStarted","Data":"aa9cac5eee48d972aba87e38f41ac19a2959ea3c24fb981eb596c5a1904c7ad1"} Sep 17 07:40:36.863378 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:40:36.863350 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-8zt9c_2204950c-6aee-4c24-9abf-58c5fcc5bafd/dns/0.log" Sep 17 07:40:36.883901 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:40:36.883880 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-8zt9c_2204950c-6aee-4c24-9abf-58c5fcc5bafd/kube-rbac-proxy/0.log" Sep 17 07:40:36.973740 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:40:36.973716 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-kf4sp_a731e2cb-6abe-4f3a-81ca-d8742a141c4e/dns-node-resolver/0.log" Sep 17 07:40:37.256806 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:40:37.256775 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-vh9zj/perf-node-gather-daemonset-qw5nd" event={"ID":"cbc9b3de-ab4b-4e0f-be2d-25a8a8c97c58","Type":"ContainerStarted","Data":"8374f58d59b295b6898247e0d4c20172ed44610aa7247880bde711e7e4518ca3"} Sep 17 07:40:37.256908 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:40:37.256861 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-vh9zj/perf-node-gather-daemonset-qw5nd" Sep 17 07:40:37.273579 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:40:37.273539 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-vh9zj/perf-node-gather-daemonset-qw5nd" podStartSLOduration=2.273525615 podStartE2EDuration="2.273525615s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-17 07:40:35 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 07:40:37.271735572 +0000 UTC m=+1944.819882281" watchObservedRunningTime="2026-09-17 07:40:37.273525615 +0000 UTC m=+1944.821672350" Sep 17 07:40:37.379089 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:40:37.379070 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-f476b5c9b-7khtp_f6ea68a3-2405-419e-8435-f1f1fdb7f4a0/registry/0.log" Sep 17 07:40:37.397130 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:40:37.397107 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-5c544_248ebec7-b104-47b9-9187-04bb22c1101a/node-ca/0.log" Sep 17 07:40:38.306122 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:40:38.306099 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-6f9c47f54-2kl8l_73223634-3371-4e5a-a594-e79584605e80/router/0.log" Sep 17 07:40:38.685370 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:40:38.685278 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-v82wm_c0d04997-4e22-48b8-b36c-e98153ddcd60/serve-healthcheck-canary/0.log" Sep 17 07:40:39.073070 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:40:39.073029 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-5844b856db-tvlrq_cd659f26-f444-43c8-bc39-fbd8f61b84b0/insights-operator/1.log" Sep 17 07:40:39.073268 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:40:39.073113 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-5844b856db-tvlrq_cd659f26-f444-43c8-bc39-fbd8f61b84b0/insights-operator/0.log" Sep 17 07:40:39.165836 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:40:39.165801 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-47gnn_1a90ce9b-0a4a-4e14-9f90-a27c4f39b958/kube-rbac-proxy/0.log" Sep 17 07:40:39.186189 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:40:39.186167 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-47gnn_1a90ce9b-0a4a-4e14-9f90-a27c4f39b958/exporter/0.log" Sep 17 07:40:39.218070 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:40:39.218052 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-47gnn_1a90ce9b-0a4a-4e14-9f90-a27c4f39b958/extractor/0.log" Sep 17 07:40:43.270002 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:40:43.269955 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-vh9zj/perf-node-gather-daemonset-qw5nd" Sep 17 07:40:44.906159 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:40:44.906130 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-bb7bn_afdc4eea-caa0-4af7-a1cf-6e0ecb42fd53/kube-multus-additional-cni-plugins/0.log" Sep 17 07:40:44.928277 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:40:44.928204 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-bb7bn_afdc4eea-caa0-4af7-a1cf-6e0ecb42fd53/egress-router-binary-copy/0.log" Sep 17 07:40:44.950771 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:40:44.950750 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-bb7bn_afdc4eea-caa0-4af7-a1cf-6e0ecb42fd53/cni-plugins/0.log" Sep 17 07:40:44.974721 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:40:44.974700 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-bb7bn_afdc4eea-caa0-4af7-a1cf-6e0ecb42fd53/bond-cni-plugin/0.log" Sep 17 07:40:44.999272 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:40:44.999255 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-bb7bn_afdc4eea-caa0-4af7-a1cf-6e0ecb42fd53/routeoverride-cni/0.log" Sep 17 07:40:45.024024 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:40:45.024007 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-bb7bn_afdc4eea-caa0-4af7-a1cf-6e0ecb42fd53/whereabouts-cni-bincopy/0.log" Sep 17 07:40:45.048785 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:40:45.048764 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-bb7bn_afdc4eea-caa0-4af7-a1cf-6e0ecb42fd53/whereabouts-cni/0.log" Sep 17 07:40:45.427024 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:40:45.426991 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-dksgh_983514df-8e0a-4e43-b269-52be4de79e7d/kube-multus/0.log" Sep 17 07:40:45.510511 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:40:45.510479 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-25zvh_cb76f3bc-38be-404f-b207-231482554bfe/network-metrics-daemon/0.log" Sep 17 07:40:45.530959 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:40:45.530907 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-25zvh_cb76f3bc-38be-404f-b207-231482554bfe/kube-rbac-proxy/0.log" Sep 17 07:40:46.894186 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:40:46.894105 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-b99wz_5ae9fb13-f8a8-4999-9023-cebdf2a7bd97/ovn-controller/0.log" Sep 17 07:40:46.912636 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:40:46.912616 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-b99wz_5ae9fb13-f8a8-4999-9023-cebdf2a7bd97/ovn-acl-logging/1.log" Sep 17 07:40:46.912636 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:40:46.912636 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-b99wz_5ae9fb13-f8a8-4999-9023-cebdf2a7bd97/ovn-acl-logging/0.log" Sep 17 07:40:46.930585 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:40:46.930562 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-b99wz_5ae9fb13-f8a8-4999-9023-cebdf2a7bd97/kube-rbac-proxy-node/0.log" Sep 17 07:40:46.952626 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:40:46.952603 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-b99wz_5ae9fb13-f8a8-4999-9023-cebdf2a7bd97/kube-rbac-proxy-ovn-metrics/0.log" Sep 17 07:40:46.970847 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:40:46.970828 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-b99wz_5ae9fb13-f8a8-4999-9023-cebdf2a7bd97/northd/0.log" Sep 17 07:40:46.993709 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:40:46.993693 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-b99wz_5ae9fb13-f8a8-4999-9023-cebdf2a7bd97/nbdb/0.log" Sep 17 07:40:47.016657 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:40:47.016641 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-b99wz_5ae9fb13-f8a8-4999-9023-cebdf2a7bd97/sbdb/0.log" Sep 17 07:40:47.062753 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:40:47.062736 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-b99wz_5ae9fb13-f8a8-4999-9023-cebdf2a7bd97/ovnkube-controller/0.log" Sep 17 07:40:48.068860 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:40:48.068825 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-diagnostics_network-check-target-b768z_4a9846c2-c1e2-4063-a31f-91190fa6c7a9/network-check-target-container/0.log" Sep 17 07:40:49.030168 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:40:49.030140 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-operator_iptables-alerter-bb7gz_6299ddb0-0911-4f6c-baa4-7c4559bade5f/iptables-alerter/0.log" Sep 17 07:40:49.678871 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:40:49.678842 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-node-tuning-operator_tuned-nmwwq_82e83454-bcdc-464a-848b-730186df6a59/tuned/0.log" Sep 17 07:40:51.476119 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:40:51.476065 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-samples-operator_cluster-samples-operator-86499c89c4-v6zwt_5a8b414a-bbfc-4557-8da2-cf9b40f9a6c1/cluster-samples-operator/0.log" Sep 17 07:40:51.493243 ip-10-0-138-13 kubenswrapper[2559]: I0917 07:40:51.493220 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-samples-operator_cluster-samples-operator-86499c89c4-v6zwt_5a8b414a-bbfc-4557-8da2-cf9b40f9a6c1/cluster-samples-operator-watch/0.log"