Sep 09 08:37:10.652872 ip-10-0-137-144 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory Sep 09 08:37:10.652886 ip-10-0-137-144 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory Sep 09 08:37:10.652896 ip-10-0-137-144 systemd[1]: kubelet.service: Failed with result 'resources'. Sep 09 08:37:10.653094 ip-10-0-137-144 systemd[1]: Failed to start Kubernetes Kubelet. Sep 09 08:37:20.773766 ip-10-0-137-144 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found. Sep 09 08:37:20.773786 ip-10-0-137-144 systemd[1]: kubelet.service: Failed with result 'resources'. -- Boot 7b2440a1c43d4ee793942ae68e805fc9 -- Sep 09 08:38:57.465108 ip-10-0-137-144 systemd[1]: Starting Kubernetes Kubelet... Sep 09 08:38:57.872409 ip-10-0-137-144 kubenswrapper[2564]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Sep 09 08:38:57.872409 ip-10-0-137-144 kubenswrapper[2564]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Sep 09 08:38:57.872409 ip-10-0-137-144 kubenswrapper[2564]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Sep 09 08:38:57.872409 ip-10-0-137-144 kubenswrapper[2564]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Sep 09 08:38:57.873013 ip-10-0-137-144 kubenswrapper[2564]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Sep 09 08:38:57.873350 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:38:57.873269 2564 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Sep 09 08:38:57.876860 ip-10-0-137-144 kubenswrapper[2564]: W0909 08:38:57.876845 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 09 08:38:57.876860 ip-10-0-137-144 kubenswrapper[2564]: W0909 08:38:57.876860 2564 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 09 08:38:57.876921 ip-10-0-137-144 kubenswrapper[2564]: W0909 08:38:57.876864 2564 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 09 08:38:57.876921 ip-10-0-137-144 kubenswrapper[2564]: W0909 08:38:57.876867 2564 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 09 08:38:57.876921 ip-10-0-137-144 kubenswrapper[2564]: W0909 08:38:57.876870 2564 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 09 08:38:57.876921 ip-10-0-137-144 kubenswrapper[2564]: W0909 08:38:57.876879 2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 09 08:38:57.876921 ip-10-0-137-144 kubenswrapper[2564]: W0909 08:38:57.876882 2564 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 09 08:38:57.876921 ip-10-0-137-144 kubenswrapper[2564]: W0909 08:38:57.876885 2564 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 09 08:38:57.876921 ip-10-0-137-144 kubenswrapper[2564]: W0909 08:38:57.876888 2564 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 09 08:38:57.876921 ip-10-0-137-144 kubenswrapper[2564]: W0909 08:38:57.876890 2564 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 09 08:38:57.876921 ip-10-0-137-144 kubenswrapper[2564]: W0909 08:38:57.876894 2564 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 09 08:38:57.876921 ip-10-0-137-144 kubenswrapper[2564]: W0909 08:38:57.876898 2564 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 09 08:38:57.876921 ip-10-0-137-144 kubenswrapper[2564]: W0909 08:38:57.876903 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 09 08:38:57.876921 ip-10-0-137-144 kubenswrapper[2564]: W0909 08:38:57.876906 2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 09 08:38:57.876921 ip-10-0-137-144 kubenswrapper[2564]: W0909 08:38:57.876909 2564 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 09 08:38:57.876921 ip-10-0-137-144 kubenswrapper[2564]: W0909 08:38:57.876912 2564 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 09 08:38:57.876921 ip-10-0-137-144 kubenswrapper[2564]: W0909 08:38:57.876915 2564 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 09 08:38:57.876921 ip-10-0-137-144 kubenswrapper[2564]: W0909 08:38:57.876918 2564 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 09 08:38:57.876921 ip-10-0-137-144 kubenswrapper[2564]: W0909 08:38:57.876920 2564 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 09 08:38:57.876921 ip-10-0-137-144 kubenswrapper[2564]: W0909 08:38:57.876923 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 09 08:38:57.876921 ip-10-0-137-144 kubenswrapper[2564]: W0909 08:38:57.876926 2564 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 09 08:38:57.876921 ip-10-0-137-144 kubenswrapper[2564]: W0909 08:38:57.876929 2564 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 09 08:38:57.877390 ip-10-0-137-144 kubenswrapper[2564]: W0909 08:38:57.876932 2564 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 09 08:38:57.877390 ip-10-0-137-144 kubenswrapper[2564]: W0909 08:38:57.876935 2564 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 09 08:38:57.877390 ip-10-0-137-144 kubenswrapper[2564]: W0909 08:38:57.876938 2564 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 09 08:38:57.877390 ip-10-0-137-144 kubenswrapper[2564]: W0909 08:38:57.876940 2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 09 08:38:57.877390 ip-10-0-137-144 kubenswrapper[2564]: W0909 08:38:57.876943 2564 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 09 08:38:57.877390 ip-10-0-137-144 kubenswrapper[2564]: W0909 08:38:57.876945 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 09 08:38:57.877390 ip-10-0-137-144 kubenswrapper[2564]: W0909 08:38:57.876948 2564 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 09 08:38:57.877390 ip-10-0-137-144 kubenswrapper[2564]: W0909 08:38:57.876951 2564 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 09 08:38:57.877390 ip-10-0-137-144 kubenswrapper[2564]: W0909 08:38:57.876953 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 09 08:38:57.877390 ip-10-0-137-144 kubenswrapper[2564]: W0909 08:38:57.876956 2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 09 08:38:57.877390 ip-10-0-137-144 kubenswrapper[2564]: W0909 08:38:57.876958 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 09 08:38:57.877390 ip-10-0-137-144 kubenswrapper[2564]: W0909 08:38:57.876961 2564 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 09 08:38:57.877390 ip-10-0-137-144 kubenswrapper[2564]: W0909 08:38:57.876963 2564 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 09 08:38:57.877390 ip-10-0-137-144 kubenswrapper[2564]: W0909 08:38:57.876966 2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 09 08:38:57.877390 ip-10-0-137-144 kubenswrapper[2564]: W0909 08:38:57.876968 2564 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 09 08:38:57.877390 ip-10-0-137-144 kubenswrapper[2564]: W0909 08:38:57.876971 2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 09 08:38:57.877390 ip-10-0-137-144 kubenswrapper[2564]: W0909 08:38:57.876974 2564 feature_gate.go:328] unrecognized feature gate: Example2 Sep 09 08:38:57.877390 ip-10-0-137-144 kubenswrapper[2564]: W0909 08:38:57.876976 2564 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 09 08:38:57.877390 ip-10-0-137-144 kubenswrapper[2564]: W0909 08:38:57.876979 2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 09 08:38:57.877874 ip-10-0-137-144 kubenswrapper[2564]: W0909 08:38:57.876983 2564 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 09 08:38:57.877874 ip-10-0-137-144 kubenswrapper[2564]: W0909 08:38:57.876987 2564 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 09 08:38:57.877874 ip-10-0-137-144 kubenswrapper[2564]: W0909 08:38:57.876989 2564 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 09 08:38:57.877874 ip-10-0-137-144 kubenswrapper[2564]: W0909 08:38:57.876992 2564 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 09 08:38:57.877874 ip-10-0-137-144 kubenswrapper[2564]: W0909 08:38:57.876995 2564 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 09 08:38:57.877874 ip-10-0-137-144 kubenswrapper[2564]: W0909 08:38:57.876999 2564 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 09 08:38:57.877874 ip-10-0-137-144 kubenswrapper[2564]: W0909 08:38:57.877002 2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 09 08:38:57.877874 ip-10-0-137-144 kubenswrapper[2564]: W0909 08:38:57.877005 2564 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 09 08:38:57.877874 ip-10-0-137-144 kubenswrapper[2564]: W0909 08:38:57.877008 2564 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 09 08:38:57.877874 ip-10-0-137-144 kubenswrapper[2564]: W0909 08:38:57.877011 2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 09 08:38:57.877874 ip-10-0-137-144 kubenswrapper[2564]: W0909 08:38:57.877014 2564 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 09 08:38:57.877874 ip-10-0-137-144 kubenswrapper[2564]: W0909 08:38:57.877018 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 09 08:38:57.877874 ip-10-0-137-144 kubenswrapper[2564]: W0909 08:38:57.877021 2564 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 09 08:38:57.877874 ip-10-0-137-144 kubenswrapper[2564]: W0909 08:38:57.877024 2564 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 09 08:38:57.877874 ip-10-0-137-144 kubenswrapper[2564]: W0909 08:38:57.877027 2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 09 08:38:57.877874 ip-10-0-137-144 kubenswrapper[2564]: W0909 08:38:57.877030 2564 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 09 08:38:57.877874 ip-10-0-137-144 kubenswrapper[2564]: W0909 08:38:57.877033 2564 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 09 08:38:57.877874 ip-10-0-137-144 kubenswrapper[2564]: W0909 08:38:57.877036 2564 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 09 08:38:57.877874 ip-10-0-137-144 kubenswrapper[2564]: W0909 08:38:57.877038 2564 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 09 08:38:57.878343 ip-10-0-137-144 kubenswrapper[2564]: W0909 08:38:57.877041 2564 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 09 08:38:57.878343 ip-10-0-137-144 kubenswrapper[2564]: W0909 08:38:57.877044 2564 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 09 08:38:57.878343 ip-10-0-137-144 kubenswrapper[2564]: W0909 08:38:57.877047 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 09 08:38:57.878343 ip-10-0-137-144 kubenswrapper[2564]: W0909 08:38:57.877049 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 09 08:38:57.878343 ip-10-0-137-144 kubenswrapper[2564]: W0909 08:38:57.877052 2564 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 09 08:38:57.878343 ip-10-0-137-144 kubenswrapper[2564]: W0909 08:38:57.877054 2564 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 09 08:38:57.878343 ip-10-0-137-144 kubenswrapper[2564]: W0909 08:38:57.877057 2564 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 09 08:38:57.878343 ip-10-0-137-144 kubenswrapper[2564]: W0909 08:38:57.877060 2564 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 09 08:38:57.878343 ip-10-0-137-144 kubenswrapper[2564]: W0909 08:38:57.877062 2564 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 09 08:38:57.878343 ip-10-0-137-144 kubenswrapper[2564]: W0909 08:38:57.877065 2564 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 09 08:38:57.878343 ip-10-0-137-144 kubenswrapper[2564]: W0909 08:38:57.877067 2564 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 09 08:38:57.878343 ip-10-0-137-144 kubenswrapper[2564]: W0909 08:38:57.877071 2564 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 09 08:38:57.878343 ip-10-0-137-144 kubenswrapper[2564]: W0909 08:38:57.877073 2564 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 09 08:38:57.878343 ip-10-0-137-144 kubenswrapper[2564]: W0909 08:38:57.877077 2564 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 09 08:38:57.878343 ip-10-0-137-144 kubenswrapper[2564]: W0909 08:38:57.877080 2564 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 09 08:38:57.878343 ip-10-0-137-144 kubenswrapper[2564]: W0909 08:38:57.877082 2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 09 08:38:57.878343 ip-10-0-137-144 kubenswrapper[2564]: W0909 08:38:57.877085 2564 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 09 08:38:57.878343 ip-10-0-137-144 kubenswrapper[2564]: W0909 08:38:57.877088 2564 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 09 08:38:57.878343 ip-10-0-137-144 kubenswrapper[2564]: W0909 08:38:57.877090 2564 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 09 08:38:57.878343 ip-10-0-137-144 kubenswrapper[2564]: W0909 08:38:57.877093 2564 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 09 08:38:57.878834 ip-10-0-137-144 kubenswrapper[2564]: W0909 08:38:57.877096 2564 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 09 08:38:57.878834 ip-10-0-137-144 kubenswrapper[2564]: W0909 08:38:57.877098 2564 feature_gate.go:328] unrecognized feature gate: Example Sep 09 08:38:57.878834 ip-10-0-137-144 kubenswrapper[2564]: W0909 08:38:57.877101 2564 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 09 08:38:57.878834 ip-10-0-137-144 kubenswrapper[2564]: W0909 08:38:57.877104 2564 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 09 08:38:57.878834 ip-10-0-137-144 kubenswrapper[2564]: W0909 08:38:57.877106 2564 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 09 08:38:57.878834 ip-10-0-137-144 kubenswrapper[2564]: W0909 08:38:57.877109 2564 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 09 08:38:57.878834 ip-10-0-137-144 kubenswrapper[2564]: W0909 08:38:57.877113 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 09 08:38:57.878834 ip-10-0-137-144 kubenswrapper[2564]: W0909 08:38:57.877116 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 09 08:38:57.878834 ip-10-0-137-144 kubenswrapper[2564]: W0909 08:38:57.877118 2564 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 09 08:38:57.878834 ip-10-0-137-144 kubenswrapper[2564]: W0909 08:38:57.877121 2564 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 09 08:38:57.878834 ip-10-0-137-144 kubenswrapper[2564]: W0909 08:38:57.877123 2564 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 09 08:38:57.878834 ip-10-0-137-144 kubenswrapper[2564]: W0909 08:38:57.877126 2564 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 09 08:38:57.878834 ip-10-0-137-144 kubenswrapper[2564]: W0909 08:38:57.877129 2564 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 09 08:38:57.878834 ip-10-0-137-144 kubenswrapper[2564]: W0909 08:38:57.877132 2564 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 09 08:38:57.878834 ip-10-0-137-144 kubenswrapper[2564]: W0909 08:38:57.877134 2564 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 09 08:38:57.878834 ip-10-0-137-144 kubenswrapper[2564]: W0909 08:38:57.877137 2564 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 09 08:38:57.878834 ip-10-0-137-144 kubenswrapper[2564]: W0909 08:38:57.877140 2564 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 09 08:38:57.878834 ip-10-0-137-144 kubenswrapper[2564]: W0909 08:38:57.877142 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 09 08:38:57.878834 ip-10-0-137-144 kubenswrapper[2564]: W0909 08:38:57.877145 2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 09 08:38:57.878834 ip-10-0-137-144 kubenswrapper[2564]: W0909 08:38:57.877895 2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 09 08:38:57.879327 ip-10-0-137-144 kubenswrapper[2564]: W0909 08:38:57.877908 2564 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 09 08:38:57.879327 ip-10-0-137-144 kubenswrapper[2564]: W0909 08:38:57.877911 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 09 08:38:57.879327 ip-10-0-137-144 kubenswrapper[2564]: W0909 08:38:57.877914 2564 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 09 08:38:57.879327 ip-10-0-137-144 kubenswrapper[2564]: W0909 08:38:57.877917 2564 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 09 08:38:57.879327 ip-10-0-137-144 kubenswrapper[2564]: W0909 08:38:57.877926 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 09 08:38:57.879327 ip-10-0-137-144 kubenswrapper[2564]: W0909 08:38:57.877929 2564 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 09 08:38:57.879327 ip-10-0-137-144 kubenswrapper[2564]: W0909 08:38:57.877931 2564 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 09 08:38:57.879327 ip-10-0-137-144 kubenswrapper[2564]: W0909 08:38:57.877936 2564 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 09 08:38:57.879327 ip-10-0-137-144 kubenswrapper[2564]: W0909 08:38:57.877940 2564 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 09 08:38:57.879327 ip-10-0-137-144 kubenswrapper[2564]: W0909 08:38:57.877943 2564 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 09 08:38:57.879327 ip-10-0-137-144 kubenswrapper[2564]: W0909 08:38:57.877946 2564 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 09 08:38:57.879327 ip-10-0-137-144 kubenswrapper[2564]: W0909 08:38:57.877949 2564 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 09 08:38:57.879327 ip-10-0-137-144 kubenswrapper[2564]: W0909 08:38:57.877952 2564 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 09 08:38:57.879327 ip-10-0-137-144 kubenswrapper[2564]: W0909 08:38:57.877955 2564 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 09 08:38:57.879327 ip-10-0-137-144 kubenswrapper[2564]: W0909 08:38:57.877958 2564 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 09 08:38:57.879327 ip-10-0-137-144 kubenswrapper[2564]: W0909 08:38:57.877960 2564 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 09 08:38:57.879327 ip-10-0-137-144 kubenswrapper[2564]: W0909 08:38:57.877963 2564 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 09 08:38:57.879327 ip-10-0-137-144 kubenswrapper[2564]: W0909 08:38:57.877968 2564 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 09 08:38:57.879327 ip-10-0-137-144 kubenswrapper[2564]: W0909 08:38:57.877972 2564 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 09 08:38:57.879810 ip-10-0-137-144 kubenswrapper[2564]: W0909 08:38:57.877976 2564 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 09 08:38:57.879810 ip-10-0-137-144 kubenswrapper[2564]: W0909 08:38:57.877979 2564 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 09 08:38:57.879810 ip-10-0-137-144 kubenswrapper[2564]: W0909 08:38:57.877982 2564 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 09 08:38:57.879810 ip-10-0-137-144 kubenswrapper[2564]: W0909 08:38:57.877984 2564 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 09 08:38:57.879810 ip-10-0-137-144 kubenswrapper[2564]: W0909 08:38:57.877987 2564 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 09 08:38:57.879810 ip-10-0-137-144 kubenswrapper[2564]: W0909 08:38:57.877990 2564 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 09 08:38:57.879810 ip-10-0-137-144 kubenswrapper[2564]: W0909 08:38:57.877993 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 09 08:38:57.879810 ip-10-0-137-144 kubenswrapper[2564]: W0909 08:38:57.877995 2564 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 09 08:38:57.879810 ip-10-0-137-144 kubenswrapper[2564]: W0909 08:38:57.877998 2564 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 09 08:38:57.879810 ip-10-0-137-144 kubenswrapper[2564]: W0909 08:38:57.878000 2564 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 09 08:38:57.879810 ip-10-0-137-144 kubenswrapper[2564]: W0909 08:38:57.878003 2564 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 09 08:38:57.879810 ip-10-0-137-144 kubenswrapper[2564]: W0909 08:38:57.878005 2564 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 09 08:38:57.879810 ip-10-0-137-144 kubenswrapper[2564]: W0909 08:38:57.878008 2564 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 09 08:38:57.879810 ip-10-0-137-144 kubenswrapper[2564]: W0909 08:38:57.878011 2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 09 08:38:57.879810 ip-10-0-137-144 kubenswrapper[2564]: W0909 08:38:57.878013 2564 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 09 08:38:57.879810 ip-10-0-137-144 kubenswrapper[2564]: W0909 08:38:57.878016 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 09 08:38:57.879810 ip-10-0-137-144 kubenswrapper[2564]: W0909 08:38:57.878019 2564 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 09 08:38:57.879810 ip-10-0-137-144 kubenswrapper[2564]: W0909 08:38:57.878021 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 09 08:38:57.879810 ip-10-0-137-144 kubenswrapper[2564]: W0909 08:38:57.878029 2564 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 09 08:38:57.880286 ip-10-0-137-144 kubenswrapper[2564]: W0909 08:38:57.878031 2564 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 09 08:38:57.880286 ip-10-0-137-144 kubenswrapper[2564]: W0909 08:38:57.878034 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 09 08:38:57.880286 ip-10-0-137-144 kubenswrapper[2564]: W0909 08:38:57.878037 2564 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 09 08:38:57.880286 ip-10-0-137-144 kubenswrapper[2564]: W0909 08:38:57.878040 2564 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 09 08:38:57.880286 ip-10-0-137-144 kubenswrapper[2564]: W0909 08:38:57.878042 2564 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 09 08:38:57.880286 ip-10-0-137-144 kubenswrapper[2564]: W0909 08:38:57.878046 2564 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 09 08:38:57.880286 ip-10-0-137-144 kubenswrapper[2564]: W0909 08:38:57.878048 2564 feature_gate.go:328] unrecognized feature gate: Example Sep 09 08:38:57.880286 ip-10-0-137-144 kubenswrapper[2564]: W0909 08:38:57.878051 2564 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 09 08:38:57.880286 ip-10-0-137-144 kubenswrapper[2564]: W0909 08:38:57.878053 2564 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 09 08:38:57.880286 ip-10-0-137-144 kubenswrapper[2564]: W0909 08:38:57.878056 2564 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 09 08:38:57.880286 ip-10-0-137-144 kubenswrapper[2564]: W0909 08:38:57.878058 2564 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 09 08:38:57.880286 ip-10-0-137-144 kubenswrapper[2564]: W0909 08:38:57.878061 2564 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 09 08:38:57.880286 ip-10-0-137-144 kubenswrapper[2564]: W0909 08:38:57.878065 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 09 08:38:57.880286 ip-10-0-137-144 kubenswrapper[2564]: W0909 08:38:57.878067 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 09 08:38:57.880286 ip-10-0-137-144 kubenswrapper[2564]: W0909 08:38:57.878070 2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 09 08:38:57.880286 ip-10-0-137-144 kubenswrapper[2564]: W0909 08:38:57.878073 2564 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 09 08:38:57.880286 ip-10-0-137-144 kubenswrapper[2564]: W0909 08:38:57.878075 2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 09 08:38:57.880286 ip-10-0-137-144 kubenswrapper[2564]: W0909 08:38:57.878078 2564 feature_gate.go:328] unrecognized feature gate: Example2 Sep 09 08:38:57.880286 ip-10-0-137-144 kubenswrapper[2564]: W0909 08:38:57.878080 2564 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 09 08:38:57.880286 ip-10-0-137-144 kubenswrapper[2564]: W0909 08:38:57.878083 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 09 08:38:57.880772 ip-10-0-137-144 kubenswrapper[2564]: W0909 08:38:57.878086 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 09 08:38:57.880772 ip-10-0-137-144 kubenswrapper[2564]: W0909 08:38:57.878088 2564 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 09 08:38:57.880772 ip-10-0-137-144 kubenswrapper[2564]: W0909 08:38:57.878091 2564 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 09 08:38:57.880772 ip-10-0-137-144 kubenswrapper[2564]: W0909 08:38:57.878093 2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 09 08:38:57.880772 ip-10-0-137-144 kubenswrapper[2564]: W0909 08:38:57.878096 2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 09 08:38:57.880772 ip-10-0-137-144 kubenswrapper[2564]: W0909 08:38:57.878098 2564 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 09 08:38:57.880772 ip-10-0-137-144 kubenswrapper[2564]: W0909 08:38:57.878100 2564 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 09 08:38:57.880772 ip-10-0-137-144 kubenswrapper[2564]: W0909 08:38:57.878103 2564 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 09 08:38:57.880772 ip-10-0-137-144 kubenswrapper[2564]: W0909 08:38:57.878106 2564 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 09 08:38:57.880772 ip-10-0-137-144 kubenswrapper[2564]: W0909 08:38:57.878109 2564 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 09 08:38:57.880772 ip-10-0-137-144 kubenswrapper[2564]: W0909 08:38:57.878111 2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 09 08:38:57.880772 ip-10-0-137-144 kubenswrapper[2564]: W0909 08:38:57.878114 2564 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 09 08:38:57.880772 ip-10-0-137-144 kubenswrapper[2564]: W0909 08:38:57.878122 2564 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 09 08:38:57.880772 ip-10-0-137-144 kubenswrapper[2564]: W0909 08:38:57.878125 2564 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 09 08:38:57.880772 ip-10-0-137-144 kubenswrapper[2564]: W0909 08:38:57.878127 2564 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 09 08:38:57.880772 ip-10-0-137-144 kubenswrapper[2564]: W0909 08:38:57.878130 2564 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 09 08:38:57.880772 ip-10-0-137-144 kubenswrapper[2564]: W0909 08:38:57.878133 2564 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 09 08:38:57.880772 ip-10-0-137-144 kubenswrapper[2564]: W0909 08:38:57.878136 2564 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 09 08:38:57.880772 ip-10-0-137-144 kubenswrapper[2564]: W0909 08:38:57.878138 2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 09 08:38:57.880772 ip-10-0-137-144 kubenswrapper[2564]: W0909 08:38:57.878141 2564 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 09 08:38:57.881288 ip-10-0-137-144 kubenswrapper[2564]: W0909 08:38:57.878143 2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 09 08:38:57.881288 ip-10-0-137-144 kubenswrapper[2564]: W0909 08:38:57.878145 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 09 08:38:57.881288 ip-10-0-137-144 kubenswrapper[2564]: W0909 08:38:57.878148 2564 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 09 08:38:57.881288 ip-10-0-137-144 kubenswrapper[2564]: W0909 08:38:57.878151 2564 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 09 08:38:57.881288 ip-10-0-137-144 kubenswrapper[2564]: W0909 08:38:57.878154 2564 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 09 08:38:57.881288 ip-10-0-137-144 kubenswrapper[2564]: W0909 08:38:57.878156 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 09 08:38:57.881288 ip-10-0-137-144 kubenswrapper[2564]: W0909 08:38:57.878159 2564 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 09 08:38:57.881288 ip-10-0-137-144 kubenswrapper[2564]: W0909 08:38:57.878162 2564 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 09 08:38:57.881288 ip-10-0-137-144 kubenswrapper[2564]: W0909 08:38:57.878165 2564 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 09 08:38:57.881288 ip-10-0-137-144 kubenswrapper[2564]: W0909 08:38:57.878169 2564 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 09 08:38:57.881288 ip-10-0-137-144 kubenswrapper[2564]: W0909 08:38:57.878172 2564 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 09 08:38:57.881288 ip-10-0-137-144 kubenswrapper[2564]: W0909 08:38:57.878175 2564 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 09 08:38:57.881288 ip-10-0-137-144 kubenswrapper[2564]: W0909 08:38:57.878178 2564 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 09 08:38:57.881288 ip-10-0-137-144 kubenswrapper[2564]: W0909 08:38:57.878180 2564 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 09 08:38:57.881288 ip-10-0-137-144 kubenswrapper[2564]: W0909 08:38:57.878183 2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 09 08:38:57.881288 ip-10-0-137-144 kubenswrapper[2564]: W0909 08:38:57.878186 2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 09 08:38:57.881288 ip-10-0-137-144 kubenswrapper[2564]: W0909 08:38:57.878189 2564 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 09 08:38:57.881288 ip-10-0-137-144 kubenswrapper[2564]: W0909 08:38:57.878191 2564 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 09 08:38:57.881288 ip-10-0-137-144 kubenswrapper[2564]: W0909 08:38:57.878194 2564 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 09 08:38:57.881288 ip-10-0-137-144 kubenswrapper[2564]: W0909 08:38:57.878197 2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 09 08:38:57.881788 ip-10-0-137-144 kubenswrapper[2564]: W0909 08:38:57.878656 2564 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 09 08:38:57.881788 ip-10-0-137-144 kubenswrapper[2564]: W0909 08:38:57.878661 2564 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 09 08:38:57.881788 ip-10-0-137-144 kubenswrapper[2564]: W0909 08:38:57.878664 2564 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 09 08:38:57.881788 ip-10-0-137-144 kubenswrapper[2564]: W0909 08:38:57.878667 2564 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 09 08:38:57.881788 ip-10-0-137-144 kubenswrapper[2564]: W0909 08:38:57.878675 2564 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 09 08:38:57.881788 ip-10-0-137-144 kubenswrapper[2564]: W0909 08:38:57.878678 2564 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 09 08:38:57.881788 ip-10-0-137-144 kubenswrapper[2564]: W0909 08:38:57.878681 2564 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 09 08:38:57.881788 ip-10-0-137-144 kubenswrapper[2564]: W0909 08:38:57.878683 2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 09 08:38:57.881788 ip-10-0-137-144 kubenswrapper[2564]: W0909 08:38:57.878686 2564 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 09 08:38:57.881788 ip-10-0-137-144 kubenswrapper[2564]: W0909 08:38:57.878689 2564 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 09 08:38:57.881788 ip-10-0-137-144 kubenswrapper[2564]: W0909 08:38:57.878691 2564 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 09 08:38:57.881788 ip-10-0-137-144 kubenswrapper[2564]: W0909 08:38:57.878694 2564 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 09 08:38:57.881788 ip-10-0-137-144 kubenswrapper[2564]: W0909 08:38:57.878696 2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 09 08:38:57.881788 ip-10-0-137-144 kubenswrapper[2564]: W0909 08:38:57.878699 2564 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 09 08:38:57.881788 ip-10-0-137-144 kubenswrapper[2564]: W0909 08:38:57.878702 2564 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 09 08:38:57.881788 ip-10-0-137-144 kubenswrapper[2564]: W0909 08:38:57.878705 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 09 08:38:57.881788 ip-10-0-137-144 kubenswrapper[2564]: W0909 08:38:57.878708 2564 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 09 08:38:57.881788 ip-10-0-137-144 kubenswrapper[2564]: W0909 08:38:57.878710 2564 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 09 08:38:57.881788 ip-10-0-137-144 kubenswrapper[2564]: W0909 08:38:57.878713 2564 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 09 08:38:57.881788 ip-10-0-137-144 kubenswrapper[2564]: W0909 08:38:57.878716 2564 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 09 08:38:57.882324 ip-10-0-137-144 kubenswrapper[2564]: W0909 08:38:57.878718 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 09 08:38:57.882324 ip-10-0-137-144 kubenswrapper[2564]: W0909 08:38:57.878721 2564 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 09 08:38:57.882324 ip-10-0-137-144 kubenswrapper[2564]: W0909 08:38:57.878724 2564 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 09 08:38:57.882324 ip-10-0-137-144 kubenswrapper[2564]: W0909 08:38:57.878726 2564 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 09 08:38:57.882324 ip-10-0-137-144 kubenswrapper[2564]: W0909 08:38:57.878729 2564 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 09 08:38:57.882324 ip-10-0-137-144 kubenswrapper[2564]: W0909 08:38:57.878731 2564 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 09 08:38:57.882324 ip-10-0-137-144 kubenswrapper[2564]: W0909 08:38:57.878734 2564 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 09 08:38:57.882324 ip-10-0-137-144 kubenswrapper[2564]: W0909 08:38:57.878737 2564 feature_gate.go:328] unrecognized feature gate: Example2 Sep 09 08:38:57.882324 ip-10-0-137-144 kubenswrapper[2564]: W0909 08:38:57.878739 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 09 08:38:57.882324 ip-10-0-137-144 kubenswrapper[2564]: W0909 08:38:57.878742 2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 09 08:38:57.882324 ip-10-0-137-144 kubenswrapper[2564]: W0909 08:38:57.878744 2564 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 09 08:38:57.882324 ip-10-0-137-144 kubenswrapper[2564]: W0909 08:38:57.878747 2564 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 09 08:38:57.882324 ip-10-0-137-144 kubenswrapper[2564]: W0909 08:38:57.878749 2564 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 09 08:38:57.882324 ip-10-0-137-144 kubenswrapper[2564]: W0909 08:38:57.878752 2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 09 08:38:57.882324 ip-10-0-137-144 kubenswrapper[2564]: W0909 08:38:57.878755 2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 09 08:38:57.882324 ip-10-0-137-144 kubenswrapper[2564]: W0909 08:38:57.878757 2564 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 09 08:38:57.882324 ip-10-0-137-144 kubenswrapper[2564]: W0909 08:38:57.878760 2564 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 09 08:38:57.882324 ip-10-0-137-144 kubenswrapper[2564]: W0909 08:38:57.878773 2564 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 09 08:38:57.882324 ip-10-0-137-144 kubenswrapper[2564]: W0909 08:38:57.878789 2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 09 08:38:57.882775 ip-10-0-137-144 kubenswrapper[2564]: W0909 08:38:57.878792 2564 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 09 08:38:57.882775 ip-10-0-137-144 kubenswrapper[2564]: W0909 08:38:57.878794 2564 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 09 08:38:57.882775 ip-10-0-137-144 kubenswrapper[2564]: W0909 08:38:57.878797 2564 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 09 08:38:57.882775 ip-10-0-137-144 kubenswrapper[2564]: W0909 08:38:57.878800 2564 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 09 08:38:57.882775 ip-10-0-137-144 kubenswrapper[2564]: W0909 08:38:57.878802 2564 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 09 08:38:57.882775 ip-10-0-137-144 kubenswrapper[2564]: W0909 08:38:57.878805 2564 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 09 08:38:57.882775 ip-10-0-137-144 kubenswrapper[2564]: W0909 08:38:57.878807 2564 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 09 08:38:57.882775 ip-10-0-137-144 kubenswrapper[2564]: W0909 08:38:57.878810 2564 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 09 08:38:57.882775 ip-10-0-137-144 kubenswrapper[2564]: W0909 08:38:57.878815 2564 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 09 08:38:57.882775 ip-10-0-137-144 kubenswrapper[2564]: W0909 08:38:57.878818 2564 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 09 08:38:57.882775 ip-10-0-137-144 kubenswrapper[2564]: W0909 08:38:57.878821 2564 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 09 08:38:57.882775 ip-10-0-137-144 kubenswrapper[2564]: W0909 08:38:57.878824 2564 feature_gate.go:328] unrecognized feature gate: Example Sep 09 08:38:57.882775 ip-10-0-137-144 kubenswrapper[2564]: W0909 08:38:57.878826 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 09 08:38:57.882775 ip-10-0-137-144 kubenswrapper[2564]: W0909 08:38:57.878829 2564 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 09 08:38:57.882775 ip-10-0-137-144 kubenswrapper[2564]: W0909 08:38:57.878832 2564 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 09 08:38:57.882775 ip-10-0-137-144 kubenswrapper[2564]: W0909 08:38:57.878836 2564 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 09 08:38:57.882775 ip-10-0-137-144 kubenswrapper[2564]: W0909 08:38:57.878840 2564 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 09 08:38:57.882775 ip-10-0-137-144 kubenswrapper[2564]: W0909 08:38:57.878843 2564 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 09 08:38:57.882775 ip-10-0-137-144 kubenswrapper[2564]: W0909 08:38:57.878846 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 09 08:38:57.882775 ip-10-0-137-144 kubenswrapper[2564]: W0909 08:38:57.878849 2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 09 08:38:57.883277 ip-10-0-137-144 kubenswrapper[2564]: W0909 08:38:57.878851 2564 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 09 08:38:57.883277 ip-10-0-137-144 kubenswrapper[2564]: W0909 08:38:57.878854 2564 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 09 08:38:57.883277 ip-10-0-137-144 kubenswrapper[2564]: W0909 08:38:57.878857 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 09 08:38:57.883277 ip-10-0-137-144 kubenswrapper[2564]: W0909 08:38:57.878860 2564 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 09 08:38:57.883277 ip-10-0-137-144 kubenswrapper[2564]: W0909 08:38:57.878863 2564 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 09 08:38:57.883277 ip-10-0-137-144 kubenswrapper[2564]: W0909 08:38:57.878865 2564 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 09 08:38:57.883277 ip-10-0-137-144 kubenswrapper[2564]: W0909 08:38:57.878868 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 09 08:38:57.883277 ip-10-0-137-144 kubenswrapper[2564]: W0909 08:38:57.878870 2564 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 09 08:38:57.883277 ip-10-0-137-144 kubenswrapper[2564]: W0909 08:38:57.878873 2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 09 08:38:57.883277 ip-10-0-137-144 kubenswrapper[2564]: W0909 08:38:57.878877 2564 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 09 08:38:57.883277 ip-10-0-137-144 kubenswrapper[2564]: W0909 08:38:57.878879 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 09 08:38:57.883277 ip-10-0-137-144 kubenswrapper[2564]: W0909 08:38:57.878889 2564 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 09 08:38:57.883277 ip-10-0-137-144 kubenswrapper[2564]: W0909 08:38:57.878892 2564 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 09 08:38:57.883277 ip-10-0-137-144 kubenswrapper[2564]: W0909 08:38:57.878896 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 09 08:38:57.883277 ip-10-0-137-144 kubenswrapper[2564]: W0909 08:38:57.878899 2564 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 09 08:38:57.883277 ip-10-0-137-144 kubenswrapper[2564]: W0909 08:38:57.878901 2564 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 09 08:38:57.883277 ip-10-0-137-144 kubenswrapper[2564]: W0909 08:38:57.878904 2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 09 08:38:57.883277 ip-10-0-137-144 kubenswrapper[2564]: W0909 08:38:57.878906 2564 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 09 08:38:57.883277 ip-10-0-137-144 kubenswrapper[2564]: W0909 08:38:57.878909 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 09 08:38:57.883277 ip-10-0-137-144 kubenswrapper[2564]: W0909 08:38:57.878911 2564 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 09 08:38:57.883794 ip-10-0-137-144 kubenswrapper[2564]: W0909 08:38:57.878915 2564 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 09 08:38:57.883794 ip-10-0-137-144 kubenswrapper[2564]: W0909 08:38:57.878918 2564 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 09 08:38:57.883794 ip-10-0-137-144 kubenswrapper[2564]: W0909 08:38:57.878920 2564 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 09 08:38:57.883794 ip-10-0-137-144 kubenswrapper[2564]: W0909 08:38:57.878923 2564 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 09 08:38:57.883794 ip-10-0-137-144 kubenswrapper[2564]: W0909 08:38:57.878925 2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 09 08:38:57.883794 ip-10-0-137-144 kubenswrapper[2564]: W0909 08:38:57.878928 2564 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 09 08:38:57.883794 ip-10-0-137-144 kubenswrapper[2564]: W0909 08:38:57.878931 2564 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 09 08:38:57.883794 ip-10-0-137-144 kubenswrapper[2564]: W0909 08:38:57.878934 2564 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 09 08:38:57.883794 ip-10-0-137-144 kubenswrapper[2564]: W0909 08:38:57.878938 2564 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 09 08:38:57.883794 ip-10-0-137-144 kubenswrapper[2564]: W0909 08:38:57.878940 2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 09 08:38:57.883794 ip-10-0-137-144 kubenswrapper[2564]: W0909 08:38:57.878943 2564 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 09 08:38:57.883794 ip-10-0-137-144 kubenswrapper[2564]: W0909 08:38:57.878946 2564 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 09 08:38:57.883794 ip-10-0-137-144 kubenswrapper[2564]: W0909 08:38:57.878949 2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 09 08:38:57.883794 ip-10-0-137-144 kubenswrapper[2564]: W0909 08:38:57.878951 2564 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 09 08:38:57.883794 ip-10-0-137-144 kubenswrapper[2564]: W0909 08:38:57.878954 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 09 08:38:57.883794 ip-10-0-137-144 kubenswrapper[2564]: W0909 08:38:57.878956 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 09 08:38:57.883794 ip-10-0-137-144 kubenswrapper[2564]: W0909 08:38:57.878959 2564 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 09 08:38:57.883794 ip-10-0-137-144 kubenswrapper[2564]: W0909 08:38:57.878961 2564 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 09 08:38:57.883794 ip-10-0-137-144 kubenswrapper[2564]: W0909 08:38:57.878970 2564 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 09 08:38:57.884252 ip-10-0-137-144 kubenswrapper[2564]: W0909 08:38:57.878974 2564 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 09 08:38:57.884252 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:38:57.879049 2564 flags.go:64] FLAG: --address="0.0.0.0" Sep 09 08:38:57.884252 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:38:57.879090 2564 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Sep 09 08:38:57.884252 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:38:57.879101 2564 flags.go:64] FLAG: --anonymous-auth="true" Sep 09 08:38:57.884252 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:38:57.879105 2564 flags.go:64] FLAG: --application-metrics-count-limit="100" Sep 09 08:38:57.884252 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:38:57.879110 2564 flags.go:64] FLAG: --authentication-token-webhook="false" Sep 09 08:38:57.884252 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:38:57.879116 2564 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Sep 09 08:38:57.884252 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:38:57.879120 2564 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Sep 09 08:38:57.884252 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:38:57.879125 2564 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Sep 09 08:38:57.884252 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:38:57.879128 2564 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Sep 09 08:38:57.884252 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:38:57.879139 2564 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Sep 09 08:38:57.884252 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:38:57.879143 2564 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Sep 09 08:38:57.884252 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:38:57.879147 2564 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Sep 09 08:38:57.884252 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:38:57.879151 2564 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Sep 09 08:38:57.884252 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:38:57.879154 2564 flags.go:64] FLAG: --cgroup-root="" Sep 09 08:38:57.884252 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:38:57.879157 2564 flags.go:64] FLAG: --cgroups-per-qos="true" Sep 09 08:38:57.884252 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:38:57.879160 2564 flags.go:64] FLAG: --client-ca-file="" Sep 09 08:38:57.884252 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:38:57.879163 2564 flags.go:64] FLAG: --cloud-provider="external" Sep 09 08:38:57.884252 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:38:57.879166 2564 flags.go:64] FLAG: --cluster-dns="[]" Sep 09 08:38:57.884252 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:38:57.879174 2564 flags.go:64] FLAG: --cluster-domain="" Sep 09 08:38:57.884252 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:38:57.879177 2564 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Sep 09 08:38:57.884252 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:38:57.879180 2564 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Sep 09 08:38:57.884252 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:38:57.879183 2564 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Sep 09 08:38:57.884252 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:38:57.879186 2564 flags.go:64] FLAG: --container-log-max-files="5" Sep 09 08:38:57.884844 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:38:57.879190 2564 flags.go:64] FLAG: --container-log-max-size="10Mi" Sep 09 08:38:57.884844 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:38:57.879193 2564 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Sep 09 08:38:57.884844 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:38:57.879196 2564 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Sep 09 08:38:57.884844 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:38:57.879200 2564 flags.go:64] FLAG: --containerd-namespace="k8s.io" Sep 09 08:38:57.884844 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:38:57.879203 2564 flags.go:64] FLAG: --contention-profiling="false" Sep 09 08:38:57.884844 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:38:57.879206 2564 flags.go:64] FLAG: --cpu-cfs-quota="true" Sep 09 08:38:57.884844 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:38:57.879209 2564 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Sep 09 08:38:57.884844 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:38:57.879212 2564 flags.go:64] FLAG: --cpu-manager-policy="none" Sep 09 08:38:57.884844 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:38:57.879215 2564 flags.go:64] FLAG: --cpu-manager-policy-options="" Sep 09 08:38:57.884844 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:38:57.879220 2564 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Sep 09 08:38:57.884844 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:38:57.879223 2564 flags.go:64] FLAG: --enable-controller-attach-detach="true" Sep 09 08:38:57.884844 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:38:57.879226 2564 flags.go:64] FLAG: --enable-debugging-handlers="true" Sep 09 08:38:57.884844 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:38:57.879229 2564 flags.go:64] FLAG: --enable-load-reader="false" Sep 09 08:38:57.884844 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:38:57.879232 2564 flags.go:64] FLAG: --enable-server="true" Sep 09 08:38:57.884844 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:38:57.879238 2564 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Sep 09 08:38:57.884844 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:38:57.879245 2564 flags.go:64] FLAG: --event-burst="100" Sep 09 08:38:57.884844 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:38:57.879248 2564 flags.go:64] FLAG: --event-qps="50" Sep 09 08:38:57.884844 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:38:57.879251 2564 flags.go:64] FLAG: --event-storage-age-limit="default=0" Sep 09 08:38:57.884844 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:38:57.879254 2564 flags.go:64] FLAG: --event-storage-event-limit="default=0" Sep 09 08:38:57.884844 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:38:57.879257 2564 flags.go:64] FLAG: --eviction-hard="" Sep 09 08:38:57.884844 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:38:57.879260 2564 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Sep 09 08:38:57.884844 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:38:57.879264 2564 flags.go:64] FLAG: --eviction-minimum-reclaim="" Sep 09 08:38:57.884844 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:38:57.879267 2564 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Sep 09 08:38:57.884844 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:38:57.879271 2564 flags.go:64] FLAG: --eviction-soft="" Sep 09 08:38:57.884844 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:38:57.879273 2564 flags.go:64] FLAG: --eviction-soft-grace-period="" Sep 09 08:38:57.885447 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:38:57.879276 2564 flags.go:64] FLAG: --exit-on-lock-contention="false" Sep 09 08:38:57.885447 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:38:57.879279 2564 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Sep 09 08:38:57.885447 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:38:57.879282 2564 flags.go:64] FLAG: --experimental-mounter-path="" Sep 09 08:38:57.885447 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:38:57.879285 2564 flags.go:64] FLAG: --fail-cgroupv1="false" Sep 09 08:38:57.885447 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:38:57.879288 2564 flags.go:64] FLAG: --fail-swap-on="true" Sep 09 08:38:57.885447 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:38:57.879291 2564 flags.go:64] FLAG: --feature-gates="" Sep 09 08:38:57.885447 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:38:57.879295 2564 flags.go:64] FLAG: --file-check-frequency="20s" Sep 09 08:38:57.885447 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:38:57.879298 2564 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Sep 09 08:38:57.885447 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:38:57.879301 2564 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Sep 09 08:38:57.885447 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:38:57.879304 2564 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Sep 09 08:38:57.885447 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:38:57.879307 2564 flags.go:64] FLAG: --healthz-port="10248" Sep 09 08:38:57.885447 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:38:57.879310 2564 flags.go:64] FLAG: --help="false" Sep 09 08:38:57.885447 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:38:57.879313 2564 flags.go:64] FLAG: --hostname-override="ip-10-0-137-144.ec2.internal" Sep 09 08:38:57.885447 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:38:57.879316 2564 flags.go:64] FLAG: --housekeeping-interval="10s" Sep 09 08:38:57.885447 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:38:57.879319 2564 flags.go:64] FLAG: --http-check-frequency="20s" Sep 09 08:38:57.885447 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:38:57.879322 2564 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Sep 09 08:38:57.885447 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:38:57.879325 2564 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Sep 09 08:38:57.885447 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:38:57.879328 2564 flags.go:64] FLAG: --image-gc-high-threshold="85" Sep 09 08:38:57.885447 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:38:57.879332 2564 flags.go:64] FLAG: --image-gc-low-threshold="80" Sep 09 08:38:57.885447 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:38:57.879334 2564 flags.go:64] FLAG: --image-service-endpoint="" Sep 09 08:38:57.885447 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:38:57.879338 2564 flags.go:64] FLAG: --kernel-memcg-notification="false" Sep 09 08:38:57.885447 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:38:57.879342 2564 flags.go:64] FLAG: --kube-api-burst="100" Sep 09 08:38:57.885447 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:38:57.879350 2564 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Sep 09 08:38:57.886054 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:38:57.879354 2564 flags.go:64] FLAG: --kube-api-qps="50" Sep 09 08:38:57.886054 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:38:57.879356 2564 flags.go:64] FLAG: --kube-reserved="" Sep 09 08:38:57.886054 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:38:57.879360 2564 flags.go:64] FLAG: --kube-reserved-cgroup="" Sep 09 08:38:57.886054 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:38:57.879363 2564 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Sep 09 08:38:57.886054 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:38:57.879366 2564 flags.go:64] FLAG: --kubelet-cgroups="" Sep 09 08:38:57.886054 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:38:57.879369 2564 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Sep 09 08:38:57.886054 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:38:57.879372 2564 flags.go:64] FLAG: --lock-file="" Sep 09 08:38:57.886054 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:38:57.879375 2564 flags.go:64] FLAG: --log-cadvisor-usage="false" Sep 09 08:38:57.886054 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:38:57.879378 2564 flags.go:64] FLAG: --log-flush-frequency="5s" Sep 09 08:38:57.886054 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:38:57.879381 2564 flags.go:64] FLAG: --log-json-info-buffer-size="0" Sep 09 08:38:57.886054 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:38:57.879386 2564 flags.go:64] FLAG: --log-json-split-stream="false" Sep 09 08:38:57.886054 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:38:57.879389 2564 flags.go:64] FLAG: --log-text-info-buffer-size="0" Sep 09 08:38:57.886054 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:38:57.879392 2564 flags.go:64] FLAG: --log-text-split-stream="false" Sep 09 08:38:57.886054 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:38:57.879394 2564 flags.go:64] FLAG: --logging-format="text" Sep 09 08:38:57.886054 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:38:57.879397 2564 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Sep 09 08:38:57.886054 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:38:57.879401 2564 flags.go:64] FLAG: --make-iptables-util-chains="true" Sep 09 08:38:57.886054 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:38:57.879403 2564 flags.go:64] FLAG: --manifest-url="" Sep 09 08:38:57.886054 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:38:57.879406 2564 flags.go:64] FLAG: --manifest-url-header="" Sep 09 08:38:57.886054 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:38:57.879410 2564 flags.go:64] FLAG: --max-housekeeping-interval="15s" Sep 09 08:38:57.886054 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:38:57.879413 2564 flags.go:64] FLAG: --max-open-files="1000000" Sep 09 08:38:57.886054 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:38:57.879417 2564 flags.go:64] FLAG: --max-pods="110" Sep 09 08:38:57.886054 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:38:57.879420 2564 flags.go:64] FLAG: --maximum-dead-containers="-1" Sep 09 08:38:57.886054 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:38:57.879423 2564 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Sep 09 08:38:57.886054 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:38:57.879426 2564 flags.go:64] FLAG: --memory-manager-policy="None" Sep 09 08:38:57.886054 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:38:57.879429 2564 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Sep 09 08:38:57.886663 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:38:57.879432 2564 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Sep 09 08:38:57.886663 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:38:57.879435 2564 flags.go:64] FLAG: --node-ip="0.0.0.0" Sep 09 08:38:57.886663 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:38:57.879437 2564 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Sep 09 08:38:57.886663 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:38:57.879445 2564 flags.go:64] FLAG: --node-status-max-images="50" Sep 09 08:38:57.886663 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:38:57.879448 2564 flags.go:64] FLAG: --node-status-update-frequency="10s" Sep 09 08:38:57.886663 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:38:57.879451 2564 flags.go:64] FLAG: --oom-score-adj="-999" Sep 09 08:38:57.886663 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:38:57.879454 2564 flags.go:64] FLAG: --pod-cidr="" Sep 09 08:38:57.886663 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:38:57.879462 2564 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8ccbacc999dbf9abad8f4009240188312b683f36ced4763eed166c1500c164b1" Sep 09 08:38:57.886663 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:38:57.879468 2564 flags.go:64] FLAG: --pod-manifest-path="" Sep 09 08:38:57.886663 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:38:57.879471 2564 flags.go:64] FLAG: --pod-max-pids="-1" Sep 09 08:38:57.886663 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:38:57.879474 2564 flags.go:64] FLAG: --pods-per-core="0" Sep 09 08:38:57.886663 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:38:57.879476 2564 flags.go:64] FLAG: --port="10250" Sep 09 08:38:57.886663 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:38:57.879479 2564 flags.go:64] FLAG: --protect-kernel-defaults="false" Sep 09 08:38:57.886663 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:38:57.879482 2564 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-060b06e3500f48a79" Sep 09 08:38:57.886663 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:38:57.879486 2564 flags.go:64] FLAG: --qos-reserved="" Sep 09 08:38:57.886663 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:38:57.879489 2564 flags.go:64] FLAG: --read-only-port="10255" Sep 09 08:38:57.886663 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:38:57.879492 2564 flags.go:64] FLAG: --register-node="true" Sep 09 08:38:57.886663 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:38:57.879495 2564 flags.go:64] FLAG: --register-with-taints="" Sep 09 08:38:57.886663 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:38:57.879498 2564 flags.go:64] FLAG: --registry-burst="10" Sep 09 08:38:57.886663 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:38:57.879501 2564 flags.go:64] FLAG: --registry-qps="5" Sep 09 08:38:57.886663 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:38:57.879504 2564 flags.go:64] FLAG: --reserved-cpus="" Sep 09 08:38:57.886663 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:38:57.879507 2564 flags.go:64] FLAG: --reserved-memory="" Sep 09 08:38:57.886663 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:38:57.879510 2564 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Sep 09 08:38:57.886663 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:38:57.879513 2564 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Sep 09 08:38:57.886663 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:38:57.879516 2564 flags.go:64] FLAG: --rotate-certificates="false" Sep 09 08:38:57.887419 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:38:57.879519 2564 flags.go:64] FLAG: --rotate-server-certificates="false" Sep 09 08:38:57.887419 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:38:57.879522 2564 flags.go:64] FLAG: --runonce="false" Sep 09 08:38:57.887419 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:38:57.879525 2564 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Sep 09 08:38:57.887419 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:38:57.879528 2564 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Sep 09 08:38:57.887419 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:38:57.879531 2564 flags.go:64] FLAG: --seccomp-default="false" Sep 09 08:38:57.887419 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:38:57.879534 2564 flags.go:64] FLAG: --serialize-image-pulls="true" Sep 09 08:38:57.887419 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:38:57.879537 2564 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Sep 09 08:38:57.887419 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:38:57.879540 2564 flags.go:64] FLAG: --storage-driver-db="cadvisor" Sep 09 08:38:57.887419 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:38:57.879543 2564 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Sep 09 08:38:57.887419 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:38:57.879546 2564 flags.go:64] FLAG: --storage-driver-password="root" Sep 09 08:38:57.887419 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:38:57.879549 2564 flags.go:64] FLAG: --storage-driver-secure="false" Sep 09 08:38:57.887419 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:38:57.879552 2564 flags.go:64] FLAG: --storage-driver-table="stats" Sep 09 08:38:57.887419 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:38:57.879555 2564 flags.go:64] FLAG: --storage-driver-user="root" Sep 09 08:38:57.887419 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:38:57.879558 2564 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Sep 09 08:38:57.887419 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:38:57.879562 2564 flags.go:64] FLAG: --sync-frequency="1m0s" Sep 09 08:38:57.887419 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:38:57.879570 2564 flags.go:64] FLAG: --system-cgroups="" Sep 09 08:38:57.887419 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:38:57.879573 2564 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Sep 09 08:38:57.887419 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:38:57.879578 2564 flags.go:64] FLAG: --system-reserved-cgroup="" Sep 09 08:38:57.887419 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:38:57.879581 2564 flags.go:64] FLAG: --tls-cert-file="" Sep 09 08:38:57.887419 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:38:57.879583 2564 flags.go:64] FLAG: --tls-cipher-suites="[]" Sep 09 08:38:57.887419 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:38:57.879590 2564 flags.go:64] FLAG: --tls-min-version="" Sep 09 08:38:57.887419 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:38:57.879593 2564 flags.go:64] FLAG: --tls-private-key-file="" Sep 09 08:38:57.887419 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:38:57.879596 2564 flags.go:64] FLAG: --topology-manager-policy="none" Sep 09 08:38:57.887419 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:38:57.879598 2564 flags.go:64] FLAG: --topology-manager-policy-options="" Sep 09 08:38:57.887419 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:38:57.879601 2564 flags.go:64] FLAG: --topology-manager-scope="container" Sep 09 08:38:57.888074 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:38:57.879604 2564 flags.go:64] FLAG: --v="2" Sep 09 08:38:57.888074 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:38:57.879608 2564 flags.go:64] FLAG: --version="false" Sep 09 08:38:57.888074 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:38:57.879612 2564 flags.go:64] FLAG: --vmodule="" Sep 09 08:38:57.888074 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:38:57.879615 2564 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Sep 09 08:38:57.888074 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:38:57.879618 2564 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Sep 09 08:38:57.888074 ip-10-0-137-144 kubenswrapper[2564]: W0909 08:38:57.879762 2564 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 09 08:38:57.888074 ip-10-0-137-144 kubenswrapper[2564]: W0909 08:38:57.879766 2564 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 09 08:38:57.888074 ip-10-0-137-144 kubenswrapper[2564]: W0909 08:38:57.879769 2564 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 09 08:38:57.888074 ip-10-0-137-144 kubenswrapper[2564]: W0909 08:38:57.879772 2564 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 09 08:38:57.888074 ip-10-0-137-144 kubenswrapper[2564]: W0909 08:38:57.879774 2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 09 08:38:57.888074 ip-10-0-137-144 kubenswrapper[2564]: W0909 08:38:57.879789 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 09 08:38:57.888074 ip-10-0-137-144 kubenswrapper[2564]: W0909 08:38:57.879792 2564 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 09 08:38:57.888074 ip-10-0-137-144 kubenswrapper[2564]: W0909 08:38:57.879795 2564 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 09 08:38:57.888074 ip-10-0-137-144 kubenswrapper[2564]: W0909 08:38:57.879798 2564 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 09 08:38:57.888074 ip-10-0-137-144 kubenswrapper[2564]: W0909 08:38:57.879800 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 09 08:38:57.888074 ip-10-0-137-144 kubenswrapper[2564]: W0909 08:38:57.879803 2564 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 09 08:38:57.888074 ip-10-0-137-144 kubenswrapper[2564]: W0909 08:38:57.879806 2564 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 09 08:38:57.888074 ip-10-0-137-144 kubenswrapper[2564]: W0909 08:38:57.879808 2564 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 09 08:38:57.888074 ip-10-0-137-144 kubenswrapper[2564]: W0909 08:38:57.879811 2564 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 09 08:38:57.888074 ip-10-0-137-144 kubenswrapper[2564]: W0909 08:38:57.879814 2564 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 09 08:38:57.888074 ip-10-0-137-144 kubenswrapper[2564]: W0909 08:38:57.879819 2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 09 08:38:57.888074 ip-10-0-137-144 kubenswrapper[2564]: W0909 08:38:57.879822 2564 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 09 08:38:57.889017 ip-10-0-137-144 kubenswrapper[2564]: W0909 08:38:57.879824 2564 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 09 08:38:57.889017 ip-10-0-137-144 kubenswrapper[2564]: W0909 08:38:57.879828 2564 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 09 08:38:57.889017 ip-10-0-137-144 kubenswrapper[2564]: W0909 08:38:57.879831 2564 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 09 08:38:57.889017 ip-10-0-137-144 kubenswrapper[2564]: W0909 08:38:57.879833 2564 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 09 08:38:57.889017 ip-10-0-137-144 kubenswrapper[2564]: W0909 08:38:57.879836 2564 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 09 08:38:57.889017 ip-10-0-137-144 kubenswrapper[2564]: W0909 08:38:57.879839 2564 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 09 08:38:57.889017 ip-10-0-137-144 kubenswrapper[2564]: W0909 08:38:57.879841 2564 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 09 08:38:57.889017 ip-10-0-137-144 kubenswrapper[2564]: W0909 08:38:57.879844 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 09 08:38:57.889017 ip-10-0-137-144 kubenswrapper[2564]: W0909 08:38:57.879846 2564 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 09 08:38:57.889017 ip-10-0-137-144 kubenswrapper[2564]: W0909 08:38:57.879849 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 09 08:38:57.889017 ip-10-0-137-144 kubenswrapper[2564]: W0909 08:38:57.879852 2564 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 09 08:38:57.889017 ip-10-0-137-144 kubenswrapper[2564]: W0909 08:38:57.879855 2564 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 09 08:38:57.889017 ip-10-0-137-144 kubenswrapper[2564]: W0909 08:38:57.879857 2564 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 09 08:38:57.889017 ip-10-0-137-144 kubenswrapper[2564]: W0909 08:38:57.879860 2564 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 09 08:38:57.889017 ip-10-0-137-144 kubenswrapper[2564]: W0909 08:38:57.879864 2564 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 09 08:38:57.889017 ip-10-0-137-144 kubenswrapper[2564]: W0909 08:38:57.879867 2564 feature_gate.go:328] unrecognized feature gate: Example2 Sep 09 08:38:57.889017 ip-10-0-137-144 kubenswrapper[2564]: W0909 08:38:57.879871 2564 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 09 08:38:57.889017 ip-10-0-137-144 kubenswrapper[2564]: W0909 08:38:57.879874 2564 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 09 08:38:57.889017 ip-10-0-137-144 kubenswrapper[2564]: W0909 08:38:57.879877 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 09 08:38:57.889017 ip-10-0-137-144 kubenswrapper[2564]: W0909 08:38:57.879879 2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 09 08:38:57.889811 ip-10-0-137-144 kubenswrapper[2564]: W0909 08:38:57.879882 2564 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 09 08:38:57.889811 ip-10-0-137-144 kubenswrapper[2564]: W0909 08:38:57.879885 2564 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 09 08:38:57.889811 ip-10-0-137-144 kubenswrapper[2564]: W0909 08:38:57.879887 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 09 08:38:57.889811 ip-10-0-137-144 kubenswrapper[2564]: W0909 08:38:57.879890 2564 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 09 08:38:57.889811 ip-10-0-137-144 kubenswrapper[2564]: W0909 08:38:57.879893 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 09 08:38:57.889811 ip-10-0-137-144 kubenswrapper[2564]: W0909 08:38:57.879896 2564 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 09 08:38:57.889811 ip-10-0-137-144 kubenswrapper[2564]: W0909 08:38:57.879898 2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 09 08:38:57.889811 ip-10-0-137-144 kubenswrapper[2564]: W0909 08:38:57.879901 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 09 08:38:57.889811 ip-10-0-137-144 kubenswrapper[2564]: W0909 08:38:57.879904 2564 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 09 08:38:57.889811 ip-10-0-137-144 kubenswrapper[2564]: W0909 08:38:57.879906 2564 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 09 08:38:57.889811 ip-10-0-137-144 kubenswrapper[2564]: W0909 08:38:57.879909 2564 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 09 08:38:57.889811 ip-10-0-137-144 kubenswrapper[2564]: W0909 08:38:57.879912 2564 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 09 08:38:57.889811 ip-10-0-137-144 kubenswrapper[2564]: W0909 08:38:57.879914 2564 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 09 08:38:57.889811 ip-10-0-137-144 kubenswrapper[2564]: W0909 08:38:57.879917 2564 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 09 08:38:57.889811 ip-10-0-137-144 kubenswrapper[2564]: W0909 08:38:57.879920 2564 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 09 08:38:57.889811 ip-10-0-137-144 kubenswrapper[2564]: W0909 08:38:57.879924 2564 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 09 08:38:57.889811 ip-10-0-137-144 kubenswrapper[2564]: W0909 08:38:57.879927 2564 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 09 08:38:57.889811 ip-10-0-137-144 kubenswrapper[2564]: W0909 08:38:57.879929 2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 09 08:38:57.889811 ip-10-0-137-144 kubenswrapper[2564]: W0909 08:38:57.879932 2564 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 09 08:38:57.889811 ip-10-0-137-144 kubenswrapper[2564]: W0909 08:38:57.879935 2564 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 09 08:38:57.890327 ip-10-0-137-144 kubenswrapper[2564]: W0909 08:38:57.879937 2564 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 09 08:38:57.890327 ip-10-0-137-144 kubenswrapper[2564]: W0909 08:38:57.879940 2564 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 09 08:38:57.890327 ip-10-0-137-144 kubenswrapper[2564]: W0909 08:38:57.879943 2564 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 09 08:38:57.890327 ip-10-0-137-144 kubenswrapper[2564]: W0909 08:38:57.879946 2564 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 09 08:38:57.890327 ip-10-0-137-144 kubenswrapper[2564]: W0909 08:38:57.879948 2564 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 09 08:38:57.890327 ip-10-0-137-144 kubenswrapper[2564]: W0909 08:38:57.879951 2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 09 08:38:57.890327 ip-10-0-137-144 kubenswrapper[2564]: W0909 08:38:57.879953 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 09 08:38:57.890327 ip-10-0-137-144 kubenswrapper[2564]: W0909 08:38:57.879956 2564 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 09 08:38:57.890327 ip-10-0-137-144 kubenswrapper[2564]: W0909 08:38:57.879959 2564 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 09 08:38:57.890327 ip-10-0-137-144 kubenswrapper[2564]: W0909 08:38:57.879961 2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 09 08:38:57.890327 ip-10-0-137-144 kubenswrapper[2564]: W0909 08:38:57.879964 2564 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 09 08:38:57.890327 ip-10-0-137-144 kubenswrapper[2564]: W0909 08:38:57.879967 2564 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 09 08:38:57.890327 ip-10-0-137-144 kubenswrapper[2564]: W0909 08:38:57.879969 2564 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 09 08:38:57.890327 ip-10-0-137-144 kubenswrapper[2564]: W0909 08:38:57.879972 2564 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 09 08:38:57.890327 ip-10-0-137-144 kubenswrapper[2564]: W0909 08:38:57.879975 2564 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 09 08:38:57.890327 ip-10-0-137-144 kubenswrapper[2564]: W0909 08:38:57.879977 2564 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 09 08:38:57.890327 ip-10-0-137-144 kubenswrapper[2564]: W0909 08:38:57.879980 2564 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 09 08:38:57.890327 ip-10-0-137-144 kubenswrapper[2564]: W0909 08:38:57.879983 2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 09 08:38:57.890327 ip-10-0-137-144 kubenswrapper[2564]: W0909 08:38:57.879985 2564 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 09 08:38:57.890813 ip-10-0-137-144 kubenswrapper[2564]: W0909 08:38:57.879988 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 09 08:38:57.890813 ip-10-0-137-144 kubenswrapper[2564]: W0909 08:38:57.879991 2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 09 08:38:57.890813 ip-10-0-137-144 kubenswrapper[2564]: W0909 08:38:57.879994 2564 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 09 08:38:57.890813 ip-10-0-137-144 kubenswrapper[2564]: W0909 08:38:57.879997 2564 feature_gate.go:328] unrecognized feature gate: Example Sep 09 08:38:57.890813 ip-10-0-137-144 kubenswrapper[2564]: W0909 08:38:57.879999 2564 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 09 08:38:57.890813 ip-10-0-137-144 kubenswrapper[2564]: W0909 08:38:57.880002 2564 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 09 08:38:57.890813 ip-10-0-137-144 kubenswrapper[2564]: W0909 08:38:57.880005 2564 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 09 08:38:57.890813 ip-10-0-137-144 kubenswrapper[2564]: W0909 08:38:57.880007 2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 09 08:38:57.890813 ip-10-0-137-144 kubenswrapper[2564]: W0909 08:38:57.880011 2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 09 08:38:57.890813 ip-10-0-137-144 kubenswrapper[2564]: W0909 08:38:57.880014 2564 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 09 08:38:57.890813 ip-10-0-137-144 kubenswrapper[2564]: W0909 08:38:57.880017 2564 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 09 08:38:57.890813 ip-10-0-137-144 kubenswrapper[2564]: W0909 08:38:57.880019 2564 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 09 08:38:57.890813 ip-10-0-137-144 kubenswrapper[2564]: W0909 08:38:57.880022 2564 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 09 08:38:57.890813 ip-10-0-137-144 kubenswrapper[2564]: W0909 08:38:57.880025 2564 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 09 08:38:57.890813 ip-10-0-137-144 kubenswrapper[2564]: W0909 08:38:57.880027 2564 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 09 08:38:57.890813 ip-10-0-137-144 kubenswrapper[2564]: W0909 08:38:57.880030 2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 09 08:38:57.890813 ip-10-0-137-144 kubenswrapper[2564]: W0909 08:38:57.880034 2564 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 09 08:38:57.890813 ip-10-0-137-144 kubenswrapper[2564]: W0909 08:38:57.880037 2564 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 09 08:38:57.890813 ip-10-0-137-144 kubenswrapper[2564]: W0909 08:38:57.880040 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 09 08:38:57.891274 ip-10-0-137-144 kubenswrapper[2564]: W0909 08:38:57.880043 2564 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 09 08:38:57.891274 ip-10-0-137-144 kubenswrapper[2564]: W0909 08:38:57.880046 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 09 08:38:57.891274 ip-10-0-137-144 kubenswrapper[2564]: W0909 08:38:57.880049 2564 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 09 08:38:57.891274 ip-10-0-137-144 kubenswrapper[2564]: W0909 08:38:57.880053 2564 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 09 08:38:57.891274 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:38:57.880614 2564 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Sep 09 08:38:57.891274 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:38:57.890167 2564 server.go:529] "Kubelet version" kubeletVersion="v1.34.9" Sep 09 08:38:57.891274 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:38:57.890182 2564 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Sep 09 08:38:57.891274 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:38:57.890849 2564 watchdog_linux.go:95] "Systemd watchdog is not enabled" Sep 09 08:38:57.891274 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:38:57.890857 2564 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Sep 09 08:38:57.891274 ip-10-0-137-144 kubenswrapper[2564]: W0909 08:38:57.890917 2564 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 09 08:38:57.891274 ip-10-0-137-144 kubenswrapper[2564]: W0909 08:38:57.890922 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 09 08:38:57.891274 ip-10-0-137-144 kubenswrapper[2564]: W0909 08:38:57.890926 2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 09 08:38:57.891274 ip-10-0-137-144 kubenswrapper[2564]: W0909 08:38:57.890929 2564 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 09 08:38:57.891274 ip-10-0-137-144 kubenswrapper[2564]: W0909 08:38:57.890932 2564 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 09 08:38:57.891629 ip-10-0-137-144 kubenswrapper[2564]: W0909 08:38:57.890935 2564 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 09 08:38:57.891629 ip-10-0-137-144 kubenswrapper[2564]: W0909 08:38:57.890938 2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 09 08:38:57.891629 ip-10-0-137-144 kubenswrapper[2564]: W0909 08:38:57.890941 2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 09 08:38:57.891629 ip-10-0-137-144 kubenswrapper[2564]: W0909 08:38:57.890943 2564 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 09 08:38:57.891629 ip-10-0-137-144 kubenswrapper[2564]: W0909 08:38:57.890946 2564 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 09 08:38:57.891629 ip-10-0-137-144 kubenswrapper[2564]: W0909 08:38:57.890949 2564 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 09 08:38:57.891629 ip-10-0-137-144 kubenswrapper[2564]: W0909 08:38:57.890952 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 09 08:38:57.891629 ip-10-0-137-144 kubenswrapper[2564]: W0909 08:38:57.890954 2564 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 09 08:38:57.891629 ip-10-0-137-144 kubenswrapper[2564]: W0909 08:38:57.890957 2564 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 09 08:38:57.891629 ip-10-0-137-144 kubenswrapper[2564]: W0909 08:38:57.890960 2564 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 09 08:38:57.891629 ip-10-0-137-144 kubenswrapper[2564]: W0909 08:38:57.890963 2564 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 09 08:38:57.891629 ip-10-0-137-144 kubenswrapper[2564]: W0909 08:38:57.890966 2564 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 09 08:38:57.891629 ip-10-0-137-144 kubenswrapper[2564]: W0909 08:38:57.890969 2564 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 09 08:38:57.891629 ip-10-0-137-144 kubenswrapper[2564]: W0909 08:38:57.890972 2564 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 09 08:38:57.891629 ip-10-0-137-144 kubenswrapper[2564]: W0909 08:38:57.890974 2564 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 09 08:38:57.891629 ip-10-0-137-144 kubenswrapper[2564]: W0909 08:38:57.890977 2564 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 09 08:38:57.891629 ip-10-0-137-144 kubenswrapper[2564]: W0909 08:38:57.890980 2564 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 09 08:38:57.891629 ip-10-0-137-144 kubenswrapper[2564]: W0909 08:38:57.890983 2564 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 09 08:38:57.891629 ip-10-0-137-144 kubenswrapper[2564]: W0909 08:38:57.890986 2564 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 09 08:38:57.891629 ip-10-0-137-144 kubenswrapper[2564]: W0909 08:38:57.890989 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 09 08:38:57.892230 ip-10-0-137-144 kubenswrapper[2564]: W0909 08:38:57.890991 2564 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 09 08:38:57.892230 ip-10-0-137-144 kubenswrapper[2564]: W0909 08:38:57.890994 2564 feature_gate.go:328] unrecognized feature gate: Example Sep 09 08:38:57.892230 ip-10-0-137-144 kubenswrapper[2564]: W0909 08:38:57.890997 2564 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 09 08:38:57.892230 ip-10-0-137-144 kubenswrapper[2564]: W0909 08:38:57.891001 2564 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 09 08:38:57.892230 ip-10-0-137-144 kubenswrapper[2564]: W0909 08:38:57.891006 2564 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 09 08:38:57.892230 ip-10-0-137-144 kubenswrapper[2564]: W0909 08:38:57.891009 2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 09 08:38:57.892230 ip-10-0-137-144 kubenswrapper[2564]: W0909 08:38:57.891012 2564 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 09 08:38:57.892230 ip-10-0-137-144 kubenswrapper[2564]: W0909 08:38:57.891015 2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 09 08:38:57.892230 ip-10-0-137-144 kubenswrapper[2564]: W0909 08:38:57.891018 2564 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 09 08:38:57.892230 ip-10-0-137-144 kubenswrapper[2564]: W0909 08:38:57.891021 2564 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 09 08:38:57.892230 ip-10-0-137-144 kubenswrapper[2564]: W0909 08:38:57.891024 2564 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 09 08:38:57.892230 ip-10-0-137-144 kubenswrapper[2564]: W0909 08:38:57.891027 2564 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 09 08:38:57.892230 ip-10-0-137-144 kubenswrapper[2564]: W0909 08:38:57.891029 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 09 08:38:57.892230 ip-10-0-137-144 kubenswrapper[2564]: W0909 08:38:57.891032 2564 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 09 08:38:57.892230 ip-10-0-137-144 kubenswrapper[2564]: W0909 08:38:57.891035 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 09 08:38:57.892230 ip-10-0-137-144 kubenswrapper[2564]: W0909 08:38:57.891037 2564 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 09 08:38:57.892230 ip-10-0-137-144 kubenswrapper[2564]: W0909 08:38:57.891040 2564 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 09 08:38:57.892230 ip-10-0-137-144 kubenswrapper[2564]: W0909 08:38:57.891042 2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 09 08:38:57.892230 ip-10-0-137-144 kubenswrapper[2564]: W0909 08:38:57.891045 2564 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 09 08:38:57.892230 ip-10-0-137-144 kubenswrapper[2564]: W0909 08:38:57.891048 2564 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 09 08:38:57.892704 ip-10-0-137-144 kubenswrapper[2564]: W0909 08:38:57.891050 2564 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 09 08:38:57.892704 ip-10-0-137-144 kubenswrapper[2564]: W0909 08:38:57.891054 2564 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 09 08:38:57.892704 ip-10-0-137-144 kubenswrapper[2564]: W0909 08:38:57.891057 2564 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 09 08:38:57.892704 ip-10-0-137-144 kubenswrapper[2564]: W0909 08:38:57.891060 2564 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 09 08:38:57.892704 ip-10-0-137-144 kubenswrapper[2564]: W0909 08:38:57.891062 2564 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 09 08:38:57.892704 ip-10-0-137-144 kubenswrapper[2564]: W0909 08:38:57.891065 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 09 08:38:57.892704 ip-10-0-137-144 kubenswrapper[2564]: W0909 08:38:57.891068 2564 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 09 08:38:57.892704 ip-10-0-137-144 kubenswrapper[2564]: W0909 08:38:57.891070 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 09 08:38:57.892704 ip-10-0-137-144 kubenswrapper[2564]: W0909 08:38:57.891073 2564 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 09 08:38:57.892704 ip-10-0-137-144 kubenswrapper[2564]: W0909 08:38:57.891076 2564 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 09 08:38:57.892704 ip-10-0-137-144 kubenswrapper[2564]: W0909 08:38:57.891079 2564 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 09 08:38:57.892704 ip-10-0-137-144 kubenswrapper[2564]: W0909 08:38:57.891081 2564 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 09 08:38:57.892704 ip-10-0-137-144 kubenswrapper[2564]: W0909 08:38:57.891084 2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 09 08:38:57.892704 ip-10-0-137-144 kubenswrapper[2564]: W0909 08:38:57.891087 2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 09 08:38:57.892704 ip-10-0-137-144 kubenswrapper[2564]: W0909 08:38:57.891089 2564 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 09 08:38:57.892704 ip-10-0-137-144 kubenswrapper[2564]: W0909 08:38:57.891093 2564 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 09 08:38:57.892704 ip-10-0-137-144 kubenswrapper[2564]: W0909 08:38:57.891095 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 09 08:38:57.892704 ip-10-0-137-144 kubenswrapper[2564]: W0909 08:38:57.891098 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 09 08:38:57.892704 ip-10-0-137-144 kubenswrapper[2564]: W0909 08:38:57.891101 2564 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 09 08:38:57.892704 ip-10-0-137-144 kubenswrapper[2564]: W0909 08:38:57.891104 2564 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 09 08:38:57.893191 ip-10-0-137-144 kubenswrapper[2564]: W0909 08:38:57.891107 2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 09 08:38:57.893191 ip-10-0-137-144 kubenswrapper[2564]: W0909 08:38:57.891109 2564 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 09 08:38:57.893191 ip-10-0-137-144 kubenswrapper[2564]: W0909 08:38:57.891112 2564 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 09 08:38:57.893191 ip-10-0-137-144 kubenswrapper[2564]: W0909 08:38:57.891114 2564 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 09 08:38:57.893191 ip-10-0-137-144 kubenswrapper[2564]: W0909 08:38:57.891118 2564 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 09 08:38:57.893191 ip-10-0-137-144 kubenswrapper[2564]: W0909 08:38:57.891122 2564 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 09 08:38:57.893191 ip-10-0-137-144 kubenswrapper[2564]: W0909 08:38:57.891124 2564 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 09 08:38:57.893191 ip-10-0-137-144 kubenswrapper[2564]: W0909 08:38:57.891127 2564 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 09 08:38:57.893191 ip-10-0-137-144 kubenswrapper[2564]: W0909 08:38:57.891137 2564 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 09 08:38:57.893191 ip-10-0-137-144 kubenswrapper[2564]: W0909 08:38:57.891141 2564 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 09 08:38:57.893191 ip-10-0-137-144 kubenswrapper[2564]: W0909 08:38:57.891144 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 09 08:38:57.893191 ip-10-0-137-144 kubenswrapper[2564]: W0909 08:38:57.891147 2564 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 09 08:38:57.893191 ip-10-0-137-144 kubenswrapper[2564]: W0909 08:38:57.891149 2564 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 09 08:38:57.893191 ip-10-0-137-144 kubenswrapper[2564]: W0909 08:38:57.891153 2564 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 09 08:38:57.893191 ip-10-0-137-144 kubenswrapper[2564]: W0909 08:38:57.891158 2564 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 09 08:38:57.893191 ip-10-0-137-144 kubenswrapper[2564]: W0909 08:38:57.891161 2564 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 09 08:38:57.893191 ip-10-0-137-144 kubenswrapper[2564]: W0909 08:38:57.891164 2564 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 09 08:38:57.893191 ip-10-0-137-144 kubenswrapper[2564]: W0909 08:38:57.891167 2564 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 09 08:38:57.893191 ip-10-0-137-144 kubenswrapper[2564]: W0909 08:38:57.891170 2564 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 09 08:38:57.893637 ip-10-0-137-144 kubenswrapper[2564]: W0909 08:38:57.891173 2564 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 09 08:38:57.893637 ip-10-0-137-144 kubenswrapper[2564]: W0909 08:38:57.891175 2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 09 08:38:57.893637 ip-10-0-137-144 kubenswrapper[2564]: W0909 08:38:57.891177 2564 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 09 08:38:57.893637 ip-10-0-137-144 kubenswrapper[2564]: W0909 08:38:57.891180 2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 09 08:38:57.893637 ip-10-0-137-144 kubenswrapper[2564]: W0909 08:38:57.891183 2564 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 09 08:38:57.893637 ip-10-0-137-144 kubenswrapper[2564]: W0909 08:38:57.891185 2564 feature_gate.go:328] unrecognized feature gate: Example2 Sep 09 08:38:57.893637 ip-10-0-137-144 kubenswrapper[2564]: W0909 08:38:57.891188 2564 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 09 08:38:57.893637 ip-10-0-137-144 kubenswrapper[2564]: W0909 08:38:57.891191 2564 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 09 08:38:57.893637 ip-10-0-137-144 kubenswrapper[2564]: W0909 08:38:57.891194 2564 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 09 08:38:57.893637 ip-10-0-137-144 kubenswrapper[2564]: W0909 08:38:57.891196 2564 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 09 08:38:57.893637 ip-10-0-137-144 kubenswrapper[2564]: W0909 08:38:57.891199 2564 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 09 08:38:57.893637 ip-10-0-137-144 kubenswrapper[2564]: W0909 08:38:57.891202 2564 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 09 08:38:57.893637 ip-10-0-137-144 kubenswrapper[2564]: W0909 08:38:57.891204 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 09 08:38:57.893637 ip-10-0-137-144 kubenswrapper[2564]: W0909 08:38:57.891207 2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 09 08:38:57.893637 ip-10-0-137-144 kubenswrapper[2564]: W0909 08:38:57.891210 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 09 08:38:57.894017 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:38:57.891215 2564 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Sep 09 08:38:57.894017 ip-10-0-137-144 kubenswrapper[2564]: W0909 08:38:57.891331 2564 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 09 08:38:57.894017 ip-10-0-137-144 kubenswrapper[2564]: W0909 08:38:57.891336 2564 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 09 08:38:57.894017 ip-10-0-137-144 kubenswrapper[2564]: W0909 08:38:57.891339 2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 09 08:38:57.894017 ip-10-0-137-144 kubenswrapper[2564]: W0909 08:38:57.891343 2564 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 09 08:38:57.894017 ip-10-0-137-144 kubenswrapper[2564]: W0909 08:38:57.891346 2564 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 09 08:38:57.894017 ip-10-0-137-144 kubenswrapper[2564]: W0909 08:38:57.891349 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 09 08:38:57.894017 ip-10-0-137-144 kubenswrapper[2564]: W0909 08:38:57.891352 2564 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 09 08:38:57.894017 ip-10-0-137-144 kubenswrapper[2564]: W0909 08:38:57.891354 2564 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 09 08:38:57.894017 ip-10-0-137-144 kubenswrapper[2564]: W0909 08:38:57.891357 2564 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 09 08:38:57.894017 ip-10-0-137-144 kubenswrapper[2564]: W0909 08:38:57.891360 2564 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 09 08:38:57.894017 ip-10-0-137-144 kubenswrapper[2564]: W0909 08:38:57.891362 2564 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 09 08:38:57.894017 ip-10-0-137-144 kubenswrapper[2564]: W0909 08:38:57.891365 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 09 08:38:57.894017 ip-10-0-137-144 kubenswrapper[2564]: W0909 08:38:57.891368 2564 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 09 08:38:57.894017 ip-10-0-137-144 kubenswrapper[2564]: W0909 08:38:57.891371 2564 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 09 08:38:57.894418 ip-10-0-137-144 kubenswrapper[2564]: W0909 08:38:57.891374 2564 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 09 08:38:57.894418 ip-10-0-137-144 kubenswrapper[2564]: W0909 08:38:57.891376 2564 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 09 08:38:57.894418 ip-10-0-137-144 kubenswrapper[2564]: W0909 08:38:57.891379 2564 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 09 08:38:57.894418 ip-10-0-137-144 kubenswrapper[2564]: W0909 08:38:57.891381 2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 09 08:38:57.894418 ip-10-0-137-144 kubenswrapper[2564]: W0909 08:38:57.891384 2564 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 09 08:38:57.894418 ip-10-0-137-144 kubenswrapper[2564]: W0909 08:38:57.891387 2564 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 09 08:38:57.894418 ip-10-0-137-144 kubenswrapper[2564]: W0909 08:38:57.891389 2564 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 09 08:38:57.894418 ip-10-0-137-144 kubenswrapper[2564]: W0909 08:38:57.891392 2564 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 09 08:38:57.894418 ip-10-0-137-144 kubenswrapper[2564]: W0909 08:38:57.891394 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 09 08:38:57.894418 ip-10-0-137-144 kubenswrapper[2564]: W0909 08:38:57.891397 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 09 08:38:57.894418 ip-10-0-137-144 kubenswrapper[2564]: W0909 08:38:57.891400 2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 09 08:38:57.894418 ip-10-0-137-144 kubenswrapper[2564]: W0909 08:38:57.891402 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 09 08:38:57.894418 ip-10-0-137-144 kubenswrapper[2564]: W0909 08:38:57.891405 2564 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 09 08:38:57.894418 ip-10-0-137-144 kubenswrapper[2564]: W0909 08:38:57.891408 2564 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 09 08:38:57.894418 ip-10-0-137-144 kubenswrapper[2564]: W0909 08:38:57.891410 2564 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 09 08:38:57.894418 ip-10-0-137-144 kubenswrapper[2564]: W0909 08:38:57.891413 2564 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 09 08:38:57.894418 ip-10-0-137-144 kubenswrapper[2564]: W0909 08:38:57.891415 2564 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 09 08:38:57.894418 ip-10-0-137-144 kubenswrapper[2564]: W0909 08:38:57.891418 2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 09 08:38:57.894418 ip-10-0-137-144 kubenswrapper[2564]: W0909 08:38:57.891421 2564 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 09 08:38:57.894418 ip-10-0-137-144 kubenswrapper[2564]: W0909 08:38:57.891423 2564 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 09 08:38:57.894950 ip-10-0-137-144 kubenswrapper[2564]: W0909 08:38:57.891426 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 09 08:38:57.894950 ip-10-0-137-144 kubenswrapper[2564]: W0909 08:38:57.891429 2564 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 09 08:38:57.894950 ip-10-0-137-144 kubenswrapper[2564]: W0909 08:38:57.891431 2564 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 09 08:38:57.894950 ip-10-0-137-144 kubenswrapper[2564]: W0909 08:38:57.891434 2564 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 09 08:38:57.894950 ip-10-0-137-144 kubenswrapper[2564]: W0909 08:38:57.891436 2564 feature_gate.go:328] unrecognized feature gate: Example2 Sep 09 08:38:57.894950 ip-10-0-137-144 kubenswrapper[2564]: W0909 08:38:57.891439 2564 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 09 08:38:57.894950 ip-10-0-137-144 kubenswrapper[2564]: W0909 08:38:57.891442 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 09 08:38:57.894950 ip-10-0-137-144 kubenswrapper[2564]: W0909 08:38:57.891444 2564 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 09 08:38:57.894950 ip-10-0-137-144 kubenswrapper[2564]: W0909 08:38:57.891447 2564 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 09 08:38:57.894950 ip-10-0-137-144 kubenswrapper[2564]: W0909 08:38:57.891449 2564 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 09 08:38:57.894950 ip-10-0-137-144 kubenswrapper[2564]: W0909 08:38:57.891452 2564 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 09 08:38:57.894950 ip-10-0-137-144 kubenswrapper[2564]: W0909 08:38:57.891455 2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 09 08:38:57.894950 ip-10-0-137-144 kubenswrapper[2564]: W0909 08:38:57.891457 2564 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 09 08:38:57.894950 ip-10-0-137-144 kubenswrapper[2564]: W0909 08:38:57.891460 2564 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 09 08:38:57.894950 ip-10-0-137-144 kubenswrapper[2564]: W0909 08:38:57.891462 2564 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 09 08:38:57.894950 ip-10-0-137-144 kubenswrapper[2564]: W0909 08:38:57.891465 2564 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 09 08:38:57.894950 ip-10-0-137-144 kubenswrapper[2564]: W0909 08:38:57.891469 2564 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 09 08:38:57.894950 ip-10-0-137-144 kubenswrapper[2564]: W0909 08:38:57.891473 2564 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 09 08:38:57.894950 ip-10-0-137-144 kubenswrapper[2564]: W0909 08:38:57.891476 2564 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 09 08:38:57.894950 ip-10-0-137-144 kubenswrapper[2564]: W0909 08:38:57.891479 2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 09 08:38:57.895450 ip-10-0-137-144 kubenswrapper[2564]: W0909 08:38:57.891481 2564 feature_gate.go:328] unrecognized feature gate: Example Sep 09 08:38:57.895450 ip-10-0-137-144 kubenswrapper[2564]: W0909 08:38:57.891484 2564 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 09 08:38:57.895450 ip-10-0-137-144 kubenswrapper[2564]: W0909 08:38:57.891486 2564 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 09 08:38:57.895450 ip-10-0-137-144 kubenswrapper[2564]: W0909 08:38:57.891489 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 09 08:38:57.895450 ip-10-0-137-144 kubenswrapper[2564]: W0909 08:38:57.891492 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 09 08:38:57.895450 ip-10-0-137-144 kubenswrapper[2564]: W0909 08:38:57.891495 2564 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 09 08:38:57.895450 ip-10-0-137-144 kubenswrapper[2564]: W0909 08:38:57.891497 2564 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 09 08:38:57.895450 ip-10-0-137-144 kubenswrapper[2564]: W0909 08:38:57.891500 2564 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 09 08:38:57.895450 ip-10-0-137-144 kubenswrapper[2564]: W0909 08:38:57.891503 2564 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 09 08:38:57.895450 ip-10-0-137-144 kubenswrapper[2564]: W0909 08:38:57.891506 2564 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 09 08:38:57.895450 ip-10-0-137-144 kubenswrapper[2564]: W0909 08:38:57.891510 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 09 08:38:57.895450 ip-10-0-137-144 kubenswrapper[2564]: W0909 08:38:57.891513 2564 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 09 08:38:57.895450 ip-10-0-137-144 kubenswrapper[2564]: W0909 08:38:57.891517 2564 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 09 08:38:57.895450 ip-10-0-137-144 kubenswrapper[2564]: W0909 08:38:57.891519 2564 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 09 08:38:57.895450 ip-10-0-137-144 kubenswrapper[2564]: W0909 08:38:57.891522 2564 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 09 08:38:57.895450 ip-10-0-137-144 kubenswrapper[2564]: W0909 08:38:57.891525 2564 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 09 08:38:57.895450 ip-10-0-137-144 kubenswrapper[2564]: W0909 08:38:57.891528 2564 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 09 08:38:57.895450 ip-10-0-137-144 kubenswrapper[2564]: W0909 08:38:57.891531 2564 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 09 08:38:57.895450 ip-10-0-137-144 kubenswrapper[2564]: W0909 08:38:57.891534 2564 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 09 08:38:57.895935 ip-10-0-137-144 kubenswrapper[2564]: W0909 08:38:57.891536 2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 09 08:38:57.895935 ip-10-0-137-144 kubenswrapper[2564]: W0909 08:38:57.891539 2564 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 09 08:38:57.895935 ip-10-0-137-144 kubenswrapper[2564]: W0909 08:38:57.891542 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 09 08:38:57.895935 ip-10-0-137-144 kubenswrapper[2564]: W0909 08:38:57.891544 2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 09 08:38:57.895935 ip-10-0-137-144 kubenswrapper[2564]: W0909 08:38:57.891547 2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 09 08:38:57.895935 ip-10-0-137-144 kubenswrapper[2564]: W0909 08:38:57.891550 2564 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 09 08:38:57.895935 ip-10-0-137-144 kubenswrapper[2564]: W0909 08:38:57.891553 2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 09 08:38:57.895935 ip-10-0-137-144 kubenswrapper[2564]: W0909 08:38:57.891555 2564 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 09 08:38:57.895935 ip-10-0-137-144 kubenswrapper[2564]: W0909 08:38:57.891558 2564 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 09 08:38:57.895935 ip-10-0-137-144 kubenswrapper[2564]: W0909 08:38:57.891561 2564 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 09 08:38:57.895935 ip-10-0-137-144 kubenswrapper[2564]: W0909 08:38:57.891563 2564 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 09 08:38:57.895935 ip-10-0-137-144 kubenswrapper[2564]: W0909 08:38:57.891566 2564 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 09 08:38:57.895935 ip-10-0-137-144 kubenswrapper[2564]: W0909 08:38:57.891568 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 09 08:38:57.895935 ip-10-0-137-144 kubenswrapper[2564]: W0909 08:38:57.891571 2564 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 09 08:38:57.895935 ip-10-0-137-144 kubenswrapper[2564]: W0909 08:38:57.891574 2564 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 09 08:38:57.895935 ip-10-0-137-144 kubenswrapper[2564]: W0909 08:38:57.891576 2564 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 09 08:38:57.895935 ip-10-0-137-144 kubenswrapper[2564]: W0909 08:38:57.891579 2564 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 09 08:38:57.895935 ip-10-0-137-144 kubenswrapper[2564]: W0909 08:38:57.891582 2564 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 09 08:38:57.895935 ip-10-0-137-144 kubenswrapper[2564]: W0909 08:38:57.891584 2564 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 09 08:38:57.896398 ip-10-0-137-144 kubenswrapper[2564]: W0909 08:38:57.891587 2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 09 08:38:57.896398 ip-10-0-137-144 kubenswrapper[2564]: W0909 08:38:57.891589 2564 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 09 08:38:57.896398 ip-10-0-137-144 kubenswrapper[2564]: W0909 08:38:57.891592 2564 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 09 08:38:57.896398 ip-10-0-137-144 kubenswrapper[2564]: W0909 08:38:57.891595 2564 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 09 08:38:57.896398 ip-10-0-137-144 kubenswrapper[2564]: W0909 08:38:57.891597 2564 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 09 08:38:57.896398 ip-10-0-137-144 kubenswrapper[2564]: W0909 08:38:57.891600 2564 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 09 08:38:57.896398 ip-10-0-137-144 kubenswrapper[2564]: W0909 08:38:57.891602 2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 09 08:38:57.896398 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:38:57.891607 2564 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Sep 09 08:38:57.896398 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:38:57.891710 2564 server.go:962] "Client rotation is on, will bootstrap in background" Sep 09 08:38:57.896398 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:38:57.894033 2564 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Sep 09 08:38:57.896398 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:38:57.894934 2564 server.go:1019] "Starting client certificate rotation" Sep 09 08:38:57.896398 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:38:57.895027 2564 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Sep 09 08:38:57.896398 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:38:57.895804 2564 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Sep 09 08:38:57.897211 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:38:57.897197 2564 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Sep 09 08:38:57.898352 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:38:57.898335 2564 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Sep 09 08:38:57.909230 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:38:57.909216 2564 log.go:25] "Validated CRI v1 runtime API" Sep 09 08:38:57.914007 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:38:57.913991 2564 log.go:25] "Validated CRI v1 image API" Sep 09 08:38:57.914798 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:38:57.914771 2564 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Sep 09 08:38:57.918758 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:38:57.918740 2564 fs.go:135] Filesystem UUIDs: map[1d55804d-ad74-4727-9872-8efd266f6144:/dev/nvme0n1p3 58fa4539-15bc-4ccd-bdb5-05f4699f56c4:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2] Sep 09 08:38:57.918830 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:38:57.918757 2564 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Sep 09 08:38:57.924943 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:38:57.924835 2564 manager.go:216] Machine: {Timestamp:2026-09-09 08:38:57.922291739 +0000 UTC m=+0.337732487 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3091689 MemoryCapacity:33164484608 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec22f8e172e180011c2df8a1ed145e32 SystemUUID:ec22f8e1-72e1-8001-1c2d-f8a1ed145e32 BootID:7b2440a1-c43d-4ee7-9394-2ae68e805fc9 Filesystems:[{Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582242304 Type:vfs Inodes:4048399 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632898560 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582242304 Type:vfs Inodes:1048576 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:71:b6:ba:82:95 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:71:b6:ba:82:95 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:8e:1b:8f:72:40:cc Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164484608 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Sep 09 08:38:57.924943 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:38:57.924942 2564 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Sep 09 08:38:57.925076 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:38:57.925023 2564 manager.go:232] Version: {KernelVersion:5.14.0-570.138.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260901-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Sep 09 08:38:57.927605 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:38:57.927584 2564 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Sep 09 08:38:57.927729 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:38:57.927608 2564 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-137-144.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Sep 09 08:38:57.928300 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:38:57.928285 2564 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Sep 09 08:38:57.928729 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:38:57.928718 2564 topology_manager.go:138] "Creating topology manager with none policy" Sep 09 08:38:57.928762 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:38:57.928733 2564 container_manager_linux.go:309] "Creating device plugin manager" Sep 09 08:38:57.928762 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:38:57.928741 2564 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Sep 09 08:38:57.929518 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:38:57.929507 2564 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Sep 09 08:38:57.930650 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:38:57.930640 2564 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Sep 09 08:38:57.933303 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:38:57.933292 2564 state_mem.go:36] "Initialized new in-memory state store" Sep 09 08:38:57.933425 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:38:57.933416 2564 server.go:1240] "Using root directory" path="/var/lib/kubelet" Sep 09 08:38:57.934054 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:38:57.934043 2564 kubelet.go:486] "Attempting to sync node with API server" Sep 09 08:38:57.934090 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:38:57.934061 2564 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Sep 09 08:38:57.934090 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:38:57.934076 2564 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Sep 09 08:38:57.934090 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:38:57.934084 2564 kubelet.go:398] "Adding apiserver pod source" Sep 09 08:38:57.934205 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:38:57.934093 2564 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Sep 09 08:38:57.934412 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:38:57.934397 2564 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Sep 09 08:38:57.934463 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:38:57.934425 2564 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Sep 09 08:38:57.938147 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:38:57.938126 2564 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.12-5.rhaos4.21.gitd1ec63c.el9" apiVersion="v1" Sep 09 08:38:57.940101 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:38:57.940087 2564 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Sep 09 08:38:57.940156 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:38:57.940117 2564 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Sep 09 08:38:57.940841 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:38:57.940829 2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Sep 09 08:38:57.940909 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:38:57.940846 2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Sep 09 08:38:57.940909 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:38:57.940852 2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Sep 09 08:38:57.940909 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:38:57.940857 2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Sep 09 08:38:57.940909 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:38:57.940865 2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Sep 09 08:38:57.940909 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:38:57.940870 2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Sep 09 08:38:57.941873 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:38:57.941865 2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Sep 09 08:38:57.941873 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:38:57.941873 2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Sep 09 08:38:57.941941 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:38:57.941880 2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Sep 09 08:38:57.941941 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:38:57.941885 2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Sep 09 08:38:57.941941 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:38:57.941894 2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Sep 09 08:38:57.941941 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:38:57.941901 2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Sep 09 08:38:57.942767 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:38:57.942758 2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Sep 09 08:38:57.942767 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:38:57.942766 2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Sep 09 08:38:57.944796 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:38:57.944752 2564 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-137-144.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Sep 09 08:38:57.945023 ip-10-0-137-144 kubenswrapper[2564]: E0909 08:38:57.945001 2564 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Sep 09 08:38:57.945163 ip-10-0-137-144 kubenswrapper[2564]: E0909 08:38:57.945136 2564 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-137-144.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Sep 09 08:38:57.946524 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:38:57.946512 2564 server.go:1268] "Started kubelet" Sep 09 08:38:57.946623 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:38:57.946575 2564 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Sep 09 08:38:57.946689 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:38:57.946648 2564 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Sep 09 08:38:57.946729 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:38:57.946706 2564 server_v1.go:49] "podresources" method="list" useActivePods=true Sep 09 08:38:57.947800 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:38:57.947752 2564 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Sep 09 08:38:57.948116 ip-10-0-137-144 systemd[1]: Started Kubernetes Kubelet. Sep 09 08:38:57.949131 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:38:57.948481 2564 server.go:310] "Adding debug handlers to kubelet server" Sep 09 08:38:57.950132 ip-10-0-137-144 kubenswrapper[2564]: E0909 08:38:57.950115 2564 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Sep 09 08:38:57.952224 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:38:57.952206 2564 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Sep 09 08:38:57.952571 ip-10-0-137-144 kubenswrapper[2564]: E0909 08:38:57.951668 2564 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-137-144.ec2.internal.18d39a4e44ac4935 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-137-144.ec2.internal,UID:ip-10-0-137-144.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-137-144.ec2.internal,},FirstTimestamp:2026-09-09 08:38:57.946487093 +0000 UTC m=+0.361927843,LastTimestamp:2026-09-09 08:38:57.946487093 +0000 UTC m=+0.361927843,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-137-144.ec2.internal,}" Sep 09 08:38:57.952818 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:38:57.952800 2564 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Sep 09 08:38:57.952907 ip-10-0-137-144 kubenswrapper[2564]: E0909 08:38:57.952895 2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-144.ec2.internal\" not found" Sep 09 08:38:57.953473 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:38:57.953433 2564 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Sep 09 08:38:57.953473 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:38:57.953435 2564 volume_manager.go:311] "The desired_state_of_world populator starts" Sep 09 08:38:57.953614 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:38:57.953500 2564 volume_manager.go:313] "Starting Kubelet Volume Manager" Sep 09 08:38:57.953614 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:38:57.953559 2564 reconstruct.go:97] "Volume reconstruction finished" Sep 09 08:38:57.953614 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:38:57.953568 2564 reconciler.go:29] "Reconciler: start to sync state" Sep 09 08:38:57.953746 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:38:57.953628 2564 factory.go:55] Registering systemd factory Sep 09 08:38:57.953746 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:38:57.953642 2564 factory.go:223] Registration of the systemd container factory successfully Sep 09 08:38:57.953936 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:38:57.953920 2564 factory.go:153] Registering CRI-O factory Sep 09 08:38:57.953936 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:38:57.953934 2564 factory.go:223] Registration of the crio container factory successfully Sep 09 08:38:57.954080 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:38:57.953974 2564 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Sep 09 08:38:57.954080 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:38:57.953989 2564 factory.go:103] Registering Raw factory Sep 09 08:38:57.954080 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:38:57.953999 2564 manager.go:1196] Started watching for new ooms in manager Sep 09 08:38:57.954306 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:38:57.954296 2564 manager.go:349] Starting recovery of all containers Sep 09 08:38:57.962447 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:38:57.962414 2564 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Sep 09 08:38:57.964060 ip-10-0-137-144 kubenswrapper[2564]: E0909 08:38:57.964035 2564 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Sep 09 08:38:57.964159 ip-10-0-137-144 kubenswrapper[2564]: E0909 08:38:57.964085 2564 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-137-144.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Sep 09 08:38:57.964615 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:38:57.964598 2564 manager.go:354] Recovery completed Sep 09 08:38:57.970080 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:38:57.970066 2564 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 09 08:38:57.971846 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:38:57.971826 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-144.ec2.internal" event="NodeHasSufficientMemory" Sep 09 08:38:57.971912 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:38:57.971858 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-144.ec2.internal" event="NodeHasNoDiskPressure" Sep 09 08:38:57.971912 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:38:57.971871 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-144.ec2.internal" event="NodeHasSufficientPID" Sep 09 08:38:57.972347 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:38:57.972331 2564 cpu_manager.go:222] "Starting CPU manager" policy="none" Sep 09 08:38:57.972347 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:38:57.972345 2564 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Sep 09 08:38:57.972471 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:38:57.972362 2564 state_mem.go:36] "Initialized new in-memory state store" Sep 09 08:38:57.972471 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:38:57.972345 2564 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 09 08:38:57.973109 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:38:57.973094 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-144.ec2.internal" event="NodeHasSufficientMemory" Sep 09 08:38:57.973162 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:38:57.973121 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-144.ec2.internal" event="NodeHasNoDiskPressure" Sep 09 08:38:57.973162 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:38:57.973134 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-144.ec2.internal" event="NodeHasSufficientPID" Sep 09 08:38:57.973632 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:38:57.973532 2564 policy_none.go:49] "None policy: Start" Sep 09 08:38:57.973677 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:38:57.973636 2564 memory_manager.go:187] "Starting memorymanager" policy="None" Sep 09 08:38:57.973677 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:38:57.973648 2564 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Sep 09 08:38:57.974070 ip-10-0-137-144 kubenswrapper[2564]: E0909 08:38:57.973999 2564 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-137-144.ec2.internal.18d39a4e462f3a58 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-137-144.ec2.internal,UID:ip-10-0-137-144.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-137-144.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-137-144.ec2.internal,},FirstTimestamp:2026-09-09 08:38:57.97184572 +0000 UTC m=+0.387286476,LastTimestamp:2026-09-09 08:38:57.97184572 +0000 UTC m=+0.387286476,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-137-144.ec2.internal,}" Sep 09 08:38:57.974630 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:38:57.974617 2564 policy_none.go:47] "Start" Sep 09 08:38:57.980178 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:38:57.980161 2564 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-7zrmx" Sep 09 08:38:57.981332 ip-10-0-137-144 kubenswrapper[2564]: E0909 08:38:57.981250 2564 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-137-144.ec2.internal.18d39a4e462f87a2 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-137-144.ec2.internal,UID:ip-10-0-137-144.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-137-144.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-137-144.ec2.internal,},FirstTimestamp:2026-09-09 08:38:57.971865506 +0000 UTC m=+0.387306254,LastTimestamp:2026-09-09 08:38:57.971865506 +0000 UTC m=+0.387306254,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-137-144.ec2.internal,}" Sep 09 08:38:57.983774 ip-10-0-137-144 kubenswrapper[2564]: E0909 08:38:57.983717 2564 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-137-144.ec2.internal.18d39a4e462fad12 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-137-144.ec2.internal,UID:ip-10-0-137-144.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientPID,Message:Node ip-10-0-137-144.ec2.internal status is now: NodeHasSufficientPID,Source:EventSource{Component:kubelet,Host:ip-10-0-137-144.ec2.internal,},FirstTimestamp:2026-09-09 08:38:57.97187509 +0000 UTC m=+0.387315839,LastTimestamp:2026-09-09 08:38:57.97187509 +0000 UTC m=+0.387315839,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-137-144.ec2.internal,}" Sep 09 08:38:57.988482 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:38:57.988460 2564 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-7zrmx" Sep 09 08:38:58.005344 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:38:58.005330 2564 manager.go:337] "Starting Device Plugin manager" Sep 09 08:38:58.024486 ip-10-0-137-144 kubenswrapper[2564]: E0909 08:38:58.005371 2564 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Sep 09 08:38:58.024486 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:38:58.005381 2564 server.go:87] "Starting device plugin registration server" Sep 09 08:38:58.024486 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:38:58.005661 2564 eviction_manager.go:189] "Eviction manager: starting control loop" Sep 09 08:38:58.024486 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:38:58.005673 2564 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Sep 09 08:38:58.024486 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:38:58.005796 2564 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Sep 09 08:38:58.024486 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:38:58.005870 2564 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Sep 09 08:38:58.024486 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:38:58.005878 2564 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Sep 09 08:38:58.024486 ip-10-0-137-144 kubenswrapper[2564]: E0909 08:38:58.006344 2564 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Sep 09 08:38:58.024486 ip-10-0-137-144 kubenswrapper[2564]: E0909 08:38:58.006401 2564 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-137-144.ec2.internal\" not found" Sep 09 08:38:58.083270 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:38:58.083238 2564 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Sep 09 08:38:58.083413 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:38:58.083299 2564 status_manager.go:244] "Starting to sync pod status with apiserver" Sep 09 08:38:58.083413 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:38:58.083324 2564 kubelet.go:2448] "Starting kubelet main sync loop" Sep 09 08:38:58.083496 ip-10-0-137-144 kubenswrapper[2564]: E0909 08:38:58.083426 2564 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Sep 09 08:38:58.086344 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:38:58.086324 2564 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Sep 09 08:38:58.106165 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:38:58.106149 2564 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 09 08:38:58.107038 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:38:58.107021 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-144.ec2.internal" event="NodeHasSufficientMemory" Sep 09 08:38:58.107140 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:38:58.107051 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-144.ec2.internal" event="NodeHasNoDiskPressure" Sep 09 08:38:58.107140 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:38:58.107065 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-144.ec2.internal" event="NodeHasSufficientPID" Sep 09 08:38:58.107140 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:38:58.107089 2564 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-137-144.ec2.internal" Sep 09 08:38:58.115314 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:38:58.115294 2564 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-137-144.ec2.internal" Sep 09 08:38:58.115371 ip-10-0-137-144 kubenswrapper[2564]: E0909 08:38:58.115315 2564 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-137-144.ec2.internal\": node \"ip-10-0-137-144.ec2.internal\" not found" Sep 09 08:38:58.143413 ip-10-0-137-144 kubenswrapper[2564]: E0909 08:38:58.143336 2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-144.ec2.internal\" not found" Sep 09 08:38:58.183760 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:38:58.183739 2564 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-144.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-137-144.ec2.internal"] Sep 09 08:38:58.183855 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:38:58.183813 2564 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 09 08:38:58.185694 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:38:58.185665 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-144.ec2.internal" event="NodeHasSufficientMemory" Sep 09 08:38:58.185763 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:38:58.185703 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-144.ec2.internal" event="NodeHasNoDiskPressure" Sep 09 08:38:58.185763 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:38:58.185715 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-144.ec2.internal" event="NodeHasSufficientPID" Sep 09 08:38:58.188032 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:38:58.188020 2564 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 09 08:38:58.188161 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:38:58.188148 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-144.ec2.internal" Sep 09 08:38:58.188196 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:38:58.188179 2564 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 09 08:38:58.188733 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:38:58.188721 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-144.ec2.internal" event="NodeHasSufficientMemory" Sep 09 08:38:58.188793 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:38:58.188725 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-144.ec2.internal" event="NodeHasSufficientMemory" Sep 09 08:38:58.188793 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:38:58.188751 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-144.ec2.internal" event="NodeHasNoDiskPressure" Sep 09 08:38:58.188793 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:38:58.188765 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-144.ec2.internal" event="NodeHasSufficientPID" Sep 09 08:38:58.188793 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:38:58.188766 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-144.ec2.internal" event="NodeHasNoDiskPressure" Sep 09 08:38:58.188927 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:38:58.188799 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-144.ec2.internal" event="NodeHasSufficientPID" Sep 09 08:38:58.191612 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:38:58.191596 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-144.ec2.internal" Sep 09 08:38:58.191677 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:38:58.191638 2564 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 09 08:38:58.192284 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:38:58.192269 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-144.ec2.internal" event="NodeHasSufficientMemory" Sep 09 08:38:58.192357 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:38:58.192296 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-144.ec2.internal" event="NodeHasNoDiskPressure" Sep 09 08:38:58.192357 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:38:58.192306 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-144.ec2.internal" event="NodeHasSufficientPID" Sep 09 08:38:58.217345 ip-10-0-137-144 kubenswrapper[2564]: E0909 08:38:58.217326 2564 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-137-144.ec2.internal\" not found" node="ip-10-0-137-144.ec2.internal" Sep 09 08:38:58.221511 ip-10-0-137-144 kubenswrapper[2564]: E0909 08:38:58.221497 2564 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-137-144.ec2.internal\" not found" node="ip-10-0-137-144.ec2.internal" Sep 09 08:38:58.244260 ip-10-0-137-144 kubenswrapper[2564]: E0909 08:38:58.244241 2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-144.ec2.internal\" not found" Sep 09 08:38:58.254934 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:38:58.254917 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/e62b73efee802c3e810d30a3512fea6c-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-137-144.ec2.internal\" (UID: \"e62b73efee802c3e810d30a3512fea6c\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-144.ec2.internal" Sep 09 08:38:58.254984 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:38:58.254939 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e62b73efee802c3e810d30a3512fea6c-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-137-144.ec2.internal\" (UID: \"e62b73efee802c3e810d30a3512fea6c\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-144.ec2.internal" Sep 09 08:38:58.254984 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:38:58.254956 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/efe7ba22b7eb392835b6437abb5fbd2b-config\") pod \"kube-apiserver-proxy-ip-10-0-137-144.ec2.internal\" (UID: \"efe7ba22b7eb392835b6437abb5fbd2b\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-137-144.ec2.internal" Sep 09 08:38:58.344685 ip-10-0-137-144 kubenswrapper[2564]: E0909 08:38:58.344654 2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-144.ec2.internal\" not found" Sep 09 08:38:58.356015 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:38:58.355992 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/efe7ba22b7eb392835b6437abb5fbd2b-config\") pod \"kube-apiserver-proxy-ip-10-0-137-144.ec2.internal\" (UID: \"efe7ba22b7eb392835b6437abb5fbd2b\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-137-144.ec2.internal" Sep 09 08:38:58.356084 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:38:58.356020 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/e62b73efee802c3e810d30a3512fea6c-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-137-144.ec2.internal\" (UID: \"e62b73efee802c3e810d30a3512fea6c\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-144.ec2.internal" Sep 09 08:38:58.356084 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:38:58.356042 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e62b73efee802c3e810d30a3512fea6c-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-137-144.ec2.internal\" (UID: \"e62b73efee802c3e810d30a3512fea6c\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-144.ec2.internal" Sep 09 08:38:58.356157 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:38:58.356080 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/e62b73efee802c3e810d30a3512fea6c-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-137-144.ec2.internal\" (UID: \"e62b73efee802c3e810d30a3512fea6c\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-144.ec2.internal" Sep 09 08:38:58.356157 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:38:58.356081 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/efe7ba22b7eb392835b6437abb5fbd2b-config\") pod \"kube-apiserver-proxy-ip-10-0-137-144.ec2.internal\" (UID: \"efe7ba22b7eb392835b6437abb5fbd2b\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-137-144.ec2.internal" Sep 09 08:38:58.356157 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:38:58.356102 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e62b73efee802c3e810d30a3512fea6c-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-137-144.ec2.internal\" (UID: \"e62b73efee802c3e810d30a3512fea6c\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-144.ec2.internal" Sep 09 08:38:58.445457 ip-10-0-137-144 kubenswrapper[2564]: E0909 08:38:58.445382 2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-144.ec2.internal\" not found" Sep 09 08:38:58.520883 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:38:58.520846 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-144.ec2.internal" Sep 09 08:38:58.524209 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:38:58.524190 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-144.ec2.internal" Sep 09 08:39:00.263448 ip-10-0-137-144 kubenswrapper[2564]: E0909 08:39:00.263423 2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-144.ec2.internal\" not found" Sep 09 08:39:00.363912 ip-10-0-137-144 kubenswrapper[2564]: E0909 08:39:00.363878 2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-144.ec2.internal\" not found" Sep 09 08:39:00.464471 ip-10-0-137-144 kubenswrapper[2564]: E0909 08:39:00.464408 2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-144.ec2.internal\" not found" Sep 09 08:39:00.564903 ip-10-0-137-144 kubenswrapper[2564]: E0909 08:39:00.564874 2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-144.ec2.internal\" not found" Sep 09 08:39:00.613399 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:39:00.613377 2564 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Sep 09 08:39:00.613867 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:39:00.613496 2564 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Sep 09 08:39:00.665464 ip-10-0-137-144 kubenswrapper[2564]: E0909 08:39:00.665439 2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-144.ec2.internal\" not found" Sep 09 08:39:00.708108 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:39:00.708071 2564 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-09-08 08:33:59 +0000 UTC" deadline="2028-04-01 04:20:05.761758375 +0000 UTC" Sep 09 08:39:00.708108 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:39:00.708098 2564 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="13675h41m5.053663714s" Sep 09 08:39:00.766404 ip-10-0-137-144 kubenswrapper[2564]: E0909 08:39:00.766386 2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-144.ec2.internal\" not found" Sep 09 08:39:00.815174 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:39:00.814552 2564 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Sep 09 08:39:00.829669 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:39:00.829644 2564 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 09 08:39:00.830668 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:39:00.830649 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-144.ec2.internal" event="NodeHasSufficientMemory" Sep 09 08:39:00.830748 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:39:00.830680 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-144.ec2.internal" event="NodeHasNoDiskPressure" Sep 09 08:39:00.830748 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:39:00.830691 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-144.ec2.internal" event="NodeHasSufficientPID" Sep 09 08:39:00.866936 ip-10-0-137-144 kubenswrapper[2564]: E0909 08:39:00.866917 2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-144.ec2.internal\" not found" Sep 09 08:39:00.916517 ip-10-0-137-144 kubenswrapper[2564]: W0909 08:39:00.916474 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode62b73efee802c3e810d30a3512fea6c.slice/crio-9630559d64e625d8f559c36039b96a461a89e5298798c8909b2f3ee4f3530136 WatchSource:0}: Error finding container 9630559d64e625d8f559c36039b96a461a89e5298798c8909b2f3ee4f3530136: Status 404 returned error can't find the container with id 9630559d64e625d8f559c36039b96a461a89e5298798c8909b2f3ee4f3530136 Sep 09 08:39:00.916764 ip-10-0-137-144 kubenswrapper[2564]: W0909 08:39:00.916733 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podefe7ba22b7eb392835b6437abb5fbd2b.slice/crio-f1ab57165be19b0a13320f1dfcadae19ff21de603a84dd773cd828477057c1a8 WatchSource:0}: Error finding container f1ab57165be19b0a13320f1dfcadae19ff21de603a84dd773cd828477057c1a8: Status 404 returned error can't find the container with id f1ab57165be19b0a13320f1dfcadae19ff21de603a84dd773cd828477057c1a8 Sep 09 08:39:00.922324 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:39:00.922309 2564 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Sep 09 08:39:00.967429 ip-10-0-137-144 kubenswrapper[2564]: E0909 08:39:00.967402 2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-144.ec2.internal\" not found" Sep 09 08:39:01.031467 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:39:01.031412 2564 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Sep 09 08:39:01.068011 ip-10-0-137-144 kubenswrapper[2564]: E0909 08:39:01.067992 2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-144.ec2.internal\" not found" Sep 09 08:39:01.168741 ip-10-0-137-144 kubenswrapper[2564]: E0909 08:39:01.168720 2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-144.ec2.internal\" not found" Sep 09 08:39:01.175096 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:39:01.175079 2564 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Sep 09 08:39:01.271006 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:39:01.270985 2564 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-144.ec2.internal" Sep 09 08:39:01.283083 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:39:01.283032 2564 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Sep 09 08:39:01.283898 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:39:01.283886 2564 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-144.ec2.internal" Sep 09 08:39:01.292622 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:39:01.292607 2564 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Sep 09 08:39:01.652921 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:39:01.652887 2564 apiserver.go:52] "Watching apiserver" Sep 09 08:39:01.660707 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:39:01.660675 2564 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Sep 09 08:39:01.661149 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:39:01.661128 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dh9g8","openshift-image-registry/node-ca-pdgxz","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-144.ec2.internal","openshift-multus/multus-additional-cni-plugins-tszfd","openshift-ovn-kubernetes/ovnkube-node-4h8qf","kube-system/global-pull-secret-syncer-dvhwl","kube-system/kube-apiserver-proxy-ip-10-0-137-144.ec2.internal","openshift-cluster-node-tuning-operator/tuned-wdpws","openshift-dns/node-resolver-b6v64","openshift-multus/multus-tm68w","openshift-multus/network-metrics-daemon-b2965","openshift-network-diagnostics/network-check-target-2zg7w","openshift-network-operator/iptables-alerter-kq8xr","kube-system/konnectivity-agent-p7hs5"] Sep 09 08:39:01.663675 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:39:01.663652 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-tm68w" Sep 09 08:39:01.665948 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:39:01.665916 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dh9g8" Sep 09 08:39:01.666656 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:39:01.666437 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Sep 09 08:39:01.666656 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:39:01.666439 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Sep 09 08:39:01.666656 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:39:01.666469 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Sep 09 08:39:01.666656 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:39:01.666511 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Sep 09 08:39:01.666867 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:39:01.666694 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-dhz45\"" Sep 09 08:39:01.668101 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:39:01.668082 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-wdpws" Sep 09 08:39:01.668780 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:39:01.668590 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Sep 09 08:39:01.668780 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:39:01.668642 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Sep 09 08:39:01.668780 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:39:01.668599 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-5z6lq\"" Sep 09 08:39:01.668780 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:39:01.668776 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Sep 09 08:39:01.670422 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:39:01.670230 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Sep 09 08:39:01.670422 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:39:01.670316 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-tszfd" Sep 09 08:39:01.670592 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:39:01.670455 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Sep 09 08:39:01.670592 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:39:01.670506 2564 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Sep 09 08:39:01.670689 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:39:01.670591 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-6zl56\"" Sep 09 08:39:01.672250 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:39:01.672199 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-zwhl4\"" Sep 09 08:39:01.672464 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:39:01.672433 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Sep 09 08:39:01.672655 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:39:01.672636 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Sep 09 08:39:01.673885 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:39:01.673861 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-4h8qf" Sep 09 08:39:01.676238 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:39:01.676213 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-zpj5v\"" Sep 09 08:39:01.677537 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:39:01.676794 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Sep 09 08:39:01.677537 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:39:01.676833 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Sep 09 08:39:01.677537 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:39:01.676957 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-kq8xr" Sep 09 08:39:01.677722 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:39:01.677577 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Sep 09 08:39:01.677722 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:39:01.677647 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Sep 09 08:39:01.679169 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:39:01.677845 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Sep 09 08:39:01.679169 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:39:01.678857 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Sep 09 08:39:01.679946 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:39:01.679654 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-b6v64" Sep 09 08:39:01.680515 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:39:01.680478 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-mc2wv\"" Sep 09 08:39:01.680620 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:39:01.680525 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Sep 09 08:39:01.680620 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:39:01.680613 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Sep 09 08:39:01.680749 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:39:01.680730 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Sep 09 08:39:01.680862 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:39:01.680844 2564 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Sep 09 08:39:01.681751 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:39:01.681724 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-slb2t\"" Sep 09 08:39:01.681751 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:39:01.681740 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/3526e800-9ea7-4be9-8320-dc4e8f536116-run\") pod \"tuned-wdpws\" (UID: \"3526e800-9ea7-4be9-8320-dc4e8f536116\") " pod="openshift-cluster-node-tuning-operator/tuned-wdpws" Sep 09 08:39:01.681889 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:39:01.681767 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/3526e800-9ea7-4be9-8320-dc4e8f536116-lib-modules\") pod \"tuned-wdpws\" (UID: \"3526e800-9ea7-4be9-8320-dc4e8f536116\") " pod="openshift-cluster-node-tuning-operator/tuned-wdpws" Sep 09 08:39:01.681889 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:39:01.681790 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q22zj\" (UniqueName: \"kubernetes.io/projected/3526e800-9ea7-4be9-8320-dc4e8f536116-kube-api-access-q22zj\") pod \"tuned-wdpws\" (UID: \"3526e800-9ea7-4be9-8320-dc4e8f536116\") " pod="openshift-cluster-node-tuning-operator/tuned-wdpws" Sep 09 08:39:01.681889 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:39:01.681812 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/17eb483a-cd23-4d7e-b8fe-ad1b77d1537a-host-cni-netd\") pod \"ovnkube-node-4h8qf\" (UID: \"17eb483a-cd23-4d7e-b8fe-ad1b77d1537a\") " pod="openshift-ovn-kubernetes/ovnkube-node-4h8qf" Sep 09 08:39:01.681889 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:39:01.681835 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/6c33c8b3-58fb-4539-92c2-da514e6d52ef-tuning-conf-dir\") pod \"multus-additional-cni-plugins-tszfd\" (UID: \"6c33c8b3-58fb-4539-92c2-da514e6d52ef\") " pod="openshift-multus/multus-additional-cni-plugins-tszfd" Sep 09 08:39:01.681889 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:39:01.681857 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/6c33c8b3-58fb-4539-92c2-da514e6d52ef-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-tszfd\" (UID: \"6c33c8b3-58fb-4539-92c2-da514e6d52ef\") " pod="openshift-multus/multus-additional-cni-plugins-tszfd" Sep 09 08:39:01.682125 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:39:01.681877 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/17eb483a-cd23-4d7e-b8fe-ad1b77d1537a-etc-openvswitch\") pod \"ovnkube-node-4h8qf\" (UID: \"17eb483a-cd23-4d7e-b8fe-ad1b77d1537a\") " pod="openshift-ovn-kubernetes/ovnkube-node-4h8qf" Sep 09 08:39:01.682125 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:39:01.681940 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/247ba8ee-92a3-4333-b1e1-e98c71402928-cni-binary-copy\") pod \"multus-tm68w\" (UID: \"247ba8ee-92a3-4333-b1e1-e98c71402928\") " pod="openshift-multus/multus-tm68w" Sep 09 08:39:01.682125 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:39:01.681959 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/3526e800-9ea7-4be9-8320-dc4e8f536116-sys\") pod \"tuned-wdpws\" (UID: \"3526e800-9ea7-4be9-8320-dc4e8f536116\") " pod="openshift-cluster-node-tuning-operator/tuned-wdpws" Sep 09 08:39:01.682125 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:39:01.681968 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Sep 09 08:39:01.682125 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:39:01.681975 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Sep 09 08:39:01.682125 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:39:01.681980 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/3526e800-9ea7-4be9-8320-dc4e8f536116-etc-tuned\") pod \"tuned-wdpws\" (UID: \"3526e800-9ea7-4be9-8320-dc4e8f536116\") " pod="openshift-cluster-node-tuning-operator/tuned-wdpws" Sep 09 08:39:01.682125 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:39:01.682032 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pf7k4\" (UniqueName: \"kubernetes.io/projected/17eb483a-cd23-4d7e-b8fe-ad1b77d1537a-kube-api-access-pf7k4\") pod \"ovnkube-node-4h8qf\" (UID: \"17eb483a-cd23-4d7e-b8fe-ad1b77d1537a\") " pod="openshift-ovn-kubernetes/ovnkube-node-4h8qf" Sep 09 08:39:01.682125 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:39:01.682064 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/247ba8ee-92a3-4333-b1e1-e98c71402928-host-var-lib-kubelet\") pod \"multus-tm68w\" (UID: \"247ba8ee-92a3-4333-b1e1-e98c71402928\") " pod="openshift-multus/multus-tm68w" Sep 09 08:39:01.682125 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:39:01.682091 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/17eb483a-cd23-4d7e-b8fe-ad1b77d1537a-log-socket\") pod \"ovnkube-node-4h8qf\" (UID: \"17eb483a-cd23-4d7e-b8fe-ad1b77d1537a\") " pod="openshift-ovn-kubernetes/ovnkube-node-4h8qf" Sep 09 08:39:01.682125 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:39:01.682120 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/247ba8ee-92a3-4333-b1e1-e98c71402928-host-run-k8s-cni-cncf-io\") pod \"multus-tm68w\" (UID: \"247ba8ee-92a3-4333-b1e1-e98c71402928\") " pod="openshift-multus/multus-tm68w" Sep 09 08:39:01.682562 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:39:01.682143 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/247ba8ee-92a3-4333-b1e1-e98c71402928-host-run-multus-certs\") pod \"multus-tm68w\" (UID: \"247ba8ee-92a3-4333-b1e1-e98c71402928\") " pod="openshift-multus/multus-tm68w" Sep 09 08:39:01.682562 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:39:01.682166 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/857d0c30-88d7-429b-8487-bca1106267e2-registration-dir\") pod \"aws-ebs-csi-driver-node-dh9g8\" (UID: \"857d0c30-88d7-429b-8487-bca1106267e2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dh9g8" Sep 09 08:39:01.682562 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:39:01.682189 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/3526e800-9ea7-4be9-8320-dc4e8f536116-etc-sysctl-conf\") pod \"tuned-wdpws\" (UID: \"3526e800-9ea7-4be9-8320-dc4e8f536116\") " pod="openshift-cluster-node-tuning-operator/tuned-wdpws" Sep 09 08:39:01.682562 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:39:01.682211 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/3526e800-9ea7-4be9-8320-dc4e8f536116-var-lib-kubelet\") pod \"tuned-wdpws\" (UID: \"3526e800-9ea7-4be9-8320-dc4e8f536116\") " pod="openshift-cluster-node-tuning-operator/tuned-wdpws" Sep 09 08:39:01.682562 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:39:01.682233 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/17eb483a-cd23-4d7e-b8fe-ad1b77d1537a-host-cni-bin\") pod \"ovnkube-node-4h8qf\" (UID: \"17eb483a-cd23-4d7e-b8fe-ad1b77d1537a\") " pod="openshift-ovn-kubernetes/ovnkube-node-4h8qf" Sep 09 08:39:01.682562 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:39:01.682259 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/6c33c8b3-58fb-4539-92c2-da514e6d52ef-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-tszfd\" (UID: \"6c33c8b3-58fb-4539-92c2-da514e6d52ef\") " pod="openshift-multus/multus-additional-cni-plugins-tszfd" Sep 09 08:39:01.682562 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:39:01.682282 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tpfww\" (UniqueName: \"kubernetes.io/projected/6c33c8b3-58fb-4539-92c2-da514e6d52ef-kube-api-access-tpfww\") pod \"multus-additional-cni-plugins-tszfd\" (UID: \"6c33c8b3-58fb-4539-92c2-da514e6d52ef\") " pod="openshift-multus/multus-additional-cni-plugins-tszfd" Sep 09 08:39:01.682562 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:39:01.682306 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/17eb483a-cd23-4d7e-b8fe-ad1b77d1537a-host-kubelet\") pod \"ovnkube-node-4h8qf\" (UID: \"17eb483a-cd23-4d7e-b8fe-ad1b77d1537a\") " pod="openshift-ovn-kubernetes/ovnkube-node-4h8qf" Sep 09 08:39:01.682562 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:39:01.682357 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/17eb483a-cd23-4d7e-b8fe-ad1b77d1537a-run-openvswitch\") pod \"ovnkube-node-4h8qf\" (UID: \"17eb483a-cd23-4d7e-b8fe-ad1b77d1537a\") " pod="openshift-ovn-kubernetes/ovnkube-node-4h8qf" Sep 09 08:39:01.682562 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:39:01.682381 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/247ba8ee-92a3-4333-b1e1-e98c71402928-system-cni-dir\") pod \"multus-tm68w\" (UID: \"247ba8ee-92a3-4333-b1e1-e98c71402928\") " pod="openshift-multus/multus-tm68w" Sep 09 08:39:01.682562 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:39:01.682420 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/857d0c30-88d7-429b-8487-bca1106267e2-device-dir\") pod \"aws-ebs-csi-driver-node-dh9g8\" (UID: \"857d0c30-88d7-429b-8487-bca1106267e2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dh9g8" Sep 09 08:39:01.682562 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:39:01.682444 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/17eb483a-cd23-4d7e-b8fe-ad1b77d1537a-ovn-node-metrics-cert\") pod \"ovnkube-node-4h8qf\" (UID: \"17eb483a-cd23-4d7e-b8fe-ad1b77d1537a\") " pod="openshift-ovn-kubernetes/ovnkube-node-4h8qf" Sep 09 08:39:01.682562 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:39:01.682466 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/17eb483a-cd23-4d7e-b8fe-ad1b77d1537a-systemd-units\") pod \"ovnkube-node-4h8qf\" (UID: \"17eb483a-cd23-4d7e-b8fe-ad1b77d1537a\") " pod="openshift-ovn-kubernetes/ovnkube-node-4h8qf" Sep 09 08:39:01.682562 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:39:01.682489 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/247ba8ee-92a3-4333-b1e1-e98c71402928-multus-conf-dir\") pod \"multus-tm68w\" (UID: \"247ba8ee-92a3-4333-b1e1-e98c71402928\") " pod="openshift-multus/multus-tm68w" Sep 09 08:39:01.682562 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:39:01.682513 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/6c33c8b3-58fb-4539-92c2-da514e6d52ef-cni-binary-copy\") pod \"multus-additional-cni-plugins-tszfd\" (UID: \"6c33c8b3-58fb-4539-92c2-da514e6d52ef\") " pod="openshift-multus/multus-additional-cni-plugins-tszfd" Sep 09 08:39:01.682562 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:39:01.682539 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/17eb483a-cd23-4d7e-b8fe-ad1b77d1537a-ovnkube-script-lib\") pod \"ovnkube-node-4h8qf\" (UID: \"17eb483a-cd23-4d7e-b8fe-ad1b77d1537a\") " pod="openshift-ovn-kubernetes/ovnkube-node-4h8qf" Sep 09 08:39:01.683206 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:39:01.682562 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/247ba8ee-92a3-4333-b1e1-e98c71402928-multus-cni-dir\") pod \"multus-tm68w\" (UID: \"247ba8ee-92a3-4333-b1e1-e98c71402928\") " pod="openshift-multus/multus-tm68w" Sep 09 08:39:01.683206 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:39:01.682603 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/857d0c30-88d7-429b-8487-bca1106267e2-socket-dir\") pod \"aws-ebs-csi-driver-node-dh9g8\" (UID: \"857d0c30-88d7-429b-8487-bca1106267e2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dh9g8" Sep 09 08:39:01.683206 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:39:01.682614 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-pdgxz" Sep 09 08:39:01.683206 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:39:01.682624 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3526e800-9ea7-4be9-8320-dc4e8f536116-etc-kubernetes\") pod \"tuned-wdpws\" (UID: \"3526e800-9ea7-4be9-8320-dc4e8f536116\") " pod="openshift-cluster-node-tuning-operator/tuned-wdpws" Sep 09 08:39:01.683206 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:39:01.682648 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/3526e800-9ea7-4be9-8320-dc4e8f536116-etc-modprobe-d\") pod \"tuned-wdpws\" (UID: \"3526e800-9ea7-4be9-8320-dc4e8f536116\") " pod="openshift-cluster-node-tuning-operator/tuned-wdpws" Sep 09 08:39:01.683206 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:39:01.682675 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/6c33c8b3-58fb-4539-92c2-da514e6d52ef-system-cni-dir\") pod \"multus-additional-cni-plugins-tszfd\" (UID: \"6c33c8b3-58fb-4539-92c2-da514e6d52ef\") " pod="openshift-multus/multus-additional-cni-plugins-tszfd" Sep 09 08:39:01.683206 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:39:01.682699 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/6c33c8b3-58fb-4539-92c2-da514e6d52ef-cnibin\") pod \"multus-additional-cni-plugins-tszfd\" (UID: \"6c33c8b3-58fb-4539-92c2-da514e6d52ef\") " pod="openshift-multus/multus-additional-cni-plugins-tszfd" Sep 09 08:39:01.683206 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:39:01.682721 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/247ba8ee-92a3-4333-b1e1-e98c71402928-hostroot\") pod \"multus-tm68w\" (UID: \"247ba8ee-92a3-4333-b1e1-e98c71402928\") " pod="openshift-multus/multus-tm68w" Sep 09 08:39:01.683206 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:39:01.682742 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/3526e800-9ea7-4be9-8320-dc4e8f536116-etc-sysctl-d\") pod \"tuned-wdpws\" (UID: \"3526e800-9ea7-4be9-8320-dc4e8f536116\") " pod="openshift-cluster-node-tuning-operator/tuned-wdpws" Sep 09 08:39:01.683206 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:39:01.682765 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/3526e800-9ea7-4be9-8320-dc4e8f536116-etc-sysconfig\") pod \"tuned-wdpws\" (UID: \"3526e800-9ea7-4be9-8320-dc4e8f536116\") " pod="openshift-cluster-node-tuning-operator/tuned-wdpws" Sep 09 08:39:01.683206 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:39:01.682787 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/17eb483a-cd23-4d7e-b8fe-ad1b77d1537a-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-4h8qf\" (UID: \"17eb483a-cd23-4d7e-b8fe-ad1b77d1537a\") " pod="openshift-ovn-kubernetes/ovnkube-node-4h8qf" Sep 09 08:39:01.683206 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:39:01.682814 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/17eb483a-cd23-4d7e-b8fe-ad1b77d1537a-run-systemd\") pod \"ovnkube-node-4h8qf\" (UID: \"17eb483a-cd23-4d7e-b8fe-ad1b77d1537a\") " pod="openshift-ovn-kubernetes/ovnkube-node-4h8qf" Sep 09 08:39:01.683206 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:39:01.682837 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/247ba8ee-92a3-4333-b1e1-e98c71402928-etc-kubernetes\") pod \"multus-tm68w\" (UID: \"247ba8ee-92a3-4333-b1e1-e98c71402928\") " pod="openshift-multus/multus-tm68w" Sep 09 08:39:01.683206 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:39:01.682858 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/857d0c30-88d7-429b-8487-bca1106267e2-sys-fs\") pod \"aws-ebs-csi-driver-node-dh9g8\" (UID: \"857d0c30-88d7-429b-8487-bca1106267e2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dh9g8" Sep 09 08:39:01.683206 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:39:01.682878 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7dcpk\" (UniqueName: \"kubernetes.io/projected/857d0c30-88d7-429b-8487-bca1106267e2-kube-api-access-7dcpk\") pod \"aws-ebs-csi-driver-node-dh9g8\" (UID: \"857d0c30-88d7-429b-8487-bca1106267e2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dh9g8" Sep 09 08:39:01.683206 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:39:01.682891 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/17eb483a-cd23-4d7e-b8fe-ad1b77d1537a-host-slash\") pod \"ovnkube-node-4h8qf\" (UID: \"17eb483a-cd23-4d7e-b8fe-ad1b77d1537a\") " pod="openshift-ovn-kubernetes/ovnkube-node-4h8qf" Sep 09 08:39:01.683206 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:39:01.682904 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/17eb483a-cd23-4d7e-b8fe-ad1b77d1537a-run-ovn\") pod \"ovnkube-node-4h8qf\" (UID: \"17eb483a-cd23-4d7e-b8fe-ad1b77d1537a\") " pod="openshift-ovn-kubernetes/ovnkube-node-4h8qf" Sep 09 08:39:01.683857 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:39:01.682925 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/17eb483a-cd23-4d7e-b8fe-ad1b77d1537a-env-overrides\") pod \"ovnkube-node-4h8qf\" (UID: \"17eb483a-cd23-4d7e-b8fe-ad1b77d1537a\") " pod="openshift-ovn-kubernetes/ovnkube-node-4h8qf" Sep 09 08:39:01.683857 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:39:01.682941 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/247ba8ee-92a3-4333-b1e1-e98c71402928-host-run-netns\") pod \"multus-tm68w\" (UID: \"247ba8ee-92a3-4333-b1e1-e98c71402928\") " pod="openshift-multus/multus-tm68w" Sep 09 08:39:01.683857 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:39:01.682956 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/247ba8ee-92a3-4333-b1e1-e98c71402928-host-var-lib-cni-bin\") pod \"multus-tm68w\" (UID: \"247ba8ee-92a3-4333-b1e1-e98c71402928\") " pod="openshift-multus/multus-tm68w" Sep 09 08:39:01.683857 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:39:01.682973 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/17eb483a-cd23-4d7e-b8fe-ad1b77d1537a-host-run-ovn-kubernetes\") pod \"ovnkube-node-4h8qf\" (UID: \"17eb483a-cd23-4d7e-b8fe-ad1b77d1537a\") " pod="openshift-ovn-kubernetes/ovnkube-node-4h8qf" Sep 09 08:39:01.683857 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:39:01.683016 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/857d0c30-88d7-429b-8487-bca1106267e2-kubelet-dir\") pod \"aws-ebs-csi-driver-node-dh9g8\" (UID: \"857d0c30-88d7-429b-8487-bca1106267e2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dh9g8" Sep 09 08:39:01.683857 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:39:01.683036 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3526e800-9ea7-4be9-8320-dc4e8f536116-tmp\") pod \"tuned-wdpws\" (UID: \"3526e800-9ea7-4be9-8320-dc4e8f536116\") " pod="openshift-cluster-node-tuning-operator/tuned-wdpws" Sep 09 08:39:01.683857 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:39:01.683059 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/17eb483a-cd23-4d7e-b8fe-ad1b77d1537a-ovnkube-config\") pod \"ovnkube-node-4h8qf\" (UID: \"17eb483a-cd23-4d7e-b8fe-ad1b77d1537a\") " pod="openshift-ovn-kubernetes/ovnkube-node-4h8qf" Sep 09 08:39:01.683857 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:39:01.683084 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/17eb483a-cd23-4d7e-b8fe-ad1b77d1537a-host-run-netns\") pod \"ovnkube-node-4h8qf\" (UID: \"17eb483a-cd23-4d7e-b8fe-ad1b77d1537a\") " pod="openshift-ovn-kubernetes/ovnkube-node-4h8qf" Sep 09 08:39:01.683857 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:39:01.683107 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/247ba8ee-92a3-4333-b1e1-e98c71402928-cnibin\") pod \"multus-tm68w\" (UID: \"247ba8ee-92a3-4333-b1e1-e98c71402928\") " pod="openshift-multus/multus-tm68w" Sep 09 08:39:01.683857 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:39:01.683125 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/247ba8ee-92a3-4333-b1e1-e98c71402928-host-var-lib-cni-multus\") pod \"multus-tm68w\" (UID: \"247ba8ee-92a3-4333-b1e1-e98c71402928\") " pod="openshift-multus/multus-tm68w" Sep 09 08:39:01.683857 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:39:01.683148 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/17eb483a-cd23-4d7e-b8fe-ad1b77d1537a-var-lib-openvswitch\") pod \"ovnkube-node-4h8qf\" (UID: \"17eb483a-cd23-4d7e-b8fe-ad1b77d1537a\") " pod="openshift-ovn-kubernetes/ovnkube-node-4h8qf" Sep 09 08:39:01.683857 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:39:01.683184 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/247ba8ee-92a3-4333-b1e1-e98c71402928-multus-socket-dir-parent\") pod \"multus-tm68w\" (UID: \"247ba8ee-92a3-4333-b1e1-e98c71402928\") " pod="openshift-multus/multus-tm68w" Sep 09 08:39:01.683857 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:39:01.683213 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/17eb483a-cd23-4d7e-b8fe-ad1b77d1537a-node-log\") pod \"ovnkube-node-4h8qf\" (UID: \"17eb483a-cd23-4d7e-b8fe-ad1b77d1537a\") " pod="openshift-ovn-kubernetes/ovnkube-node-4h8qf" Sep 09 08:39:01.683857 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:39:01.683237 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-86lbv\" (UniqueName: \"kubernetes.io/projected/247ba8ee-92a3-4333-b1e1-e98c71402928-kube-api-access-86lbv\") pod \"multus-tm68w\" (UID: \"247ba8ee-92a3-4333-b1e1-e98c71402928\") " pod="openshift-multus/multus-tm68w" Sep 09 08:39:01.683857 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:39:01.683258 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/3526e800-9ea7-4be9-8320-dc4e8f536116-host\") pod \"tuned-wdpws\" (UID: \"3526e800-9ea7-4be9-8320-dc4e8f536116\") " pod="openshift-cluster-node-tuning-operator/tuned-wdpws" Sep 09 08:39:01.683857 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:39:01.683329 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/247ba8ee-92a3-4333-b1e1-e98c71402928-multus-daemon-config\") pod \"multus-tm68w\" (UID: \"247ba8ee-92a3-4333-b1e1-e98c71402928\") " pod="openshift-multus/multus-tm68w" Sep 09 08:39:01.683857 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:39:01.683384 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/857d0c30-88d7-429b-8487-bca1106267e2-etc-selinux\") pod \"aws-ebs-csi-driver-node-dh9g8\" (UID: \"857d0c30-88d7-429b-8487-bca1106267e2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dh9g8" Sep 09 08:39:01.684656 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:39:01.683409 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/3526e800-9ea7-4be9-8320-dc4e8f536116-etc-systemd\") pod \"tuned-wdpws\" (UID: \"3526e800-9ea7-4be9-8320-dc4e8f536116\") " pod="openshift-cluster-node-tuning-operator/tuned-wdpws" Sep 09 08:39:01.684894 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:39:01.684879 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dvhwl" Sep 09 08:39:01.684962 ip-10-0-137-144 kubenswrapper[2564]: E0909 08:39:01.684940 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dvhwl" podUID="950a27f9-3274-48f2-a23e-21f86398eb00" Sep 09 08:39:01.685538 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:39:01.685518 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Sep 09 08:39:01.685640 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:39:01.685553 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Sep 09 08:39:01.685640 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:39:01.685574 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Sep 09 08:39:01.685640 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:39:01.685580 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-nkllp\"" Sep 09 08:39:01.687143 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:39:01.687125 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-b2965" Sep 09 08:39:01.687239 ip-10-0-137-144 kubenswrapper[2564]: E0909 08:39:01.687210 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-b2965" podUID="50f8cfa3-6f41-47be-899d-cf16c3251f84" Sep 09 08:39:01.689643 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:39:01.689616 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2zg7w" Sep 09 08:39:01.689725 ip-10-0-137-144 kubenswrapper[2564]: E0909 08:39:01.689707 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2zg7w" podUID="96601efb-dd16-407b-9899-22f67a88b7f0" Sep 09 08:39:01.691913 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:39:01.691896 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-p7hs5" Sep 09 08:39:01.694473 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:39:01.694108 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Sep 09 08:39:01.694473 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:39:01.694136 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Sep 09 08:39:01.694473 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:39:01.694286 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-9mcg9\"" Sep 09 08:39:01.704377 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:39:01.704356 2564 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-gh9p6" Sep 09 08:39:01.713898 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:39:01.713879 2564 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-gh9p6" Sep 09 08:39:01.771910 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:39:01.771881 2564 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Sep 09 08:39:01.783684 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:39:01.783659 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/806a2d46-69ad-493c-a1cc-5796636d6a06-serviceca\") pod \"node-ca-pdgxz\" (UID: \"806a2d46-69ad-493c-a1cc-5796636d6a06\") " pod="openshift-image-registry/node-ca-pdgxz" Sep 09 08:39:01.783852 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:39:01.783702 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/950a27f9-3274-48f2-a23e-21f86398eb00-dbus\") pod \"global-pull-secret-syncer-dvhwl\" (UID: \"950a27f9-3274-48f2-a23e-21f86398eb00\") " pod="kube-system/global-pull-secret-syncer-dvhwl" Sep 09 08:39:01.783852 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:39:01.783727 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/5cfc7f17-0984-4eb8-bf5f-a4c593b2d411-hosts-file\") pod \"node-resolver-b6v64\" (UID: \"5cfc7f17-0984-4eb8-bf5f-a4c593b2d411\") " pod="openshift-dns/node-resolver-b6v64" Sep 09 08:39:01.783852 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:39:01.783769 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/3526e800-9ea7-4be9-8320-dc4e8f536116-etc-modprobe-d\") pod \"tuned-wdpws\" (UID: \"3526e800-9ea7-4be9-8320-dc4e8f536116\") " pod="openshift-cluster-node-tuning-operator/tuned-wdpws" Sep 09 08:39:01.783852 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:39:01.783831 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/6c33c8b3-58fb-4539-92c2-da514e6d52ef-system-cni-dir\") pod \"multus-additional-cni-plugins-tszfd\" (UID: \"6c33c8b3-58fb-4539-92c2-da514e6d52ef\") " pod="openshift-multus/multus-additional-cni-plugins-tszfd" Sep 09 08:39:01.784036 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:39:01.783864 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/6c33c8b3-58fb-4539-92c2-da514e6d52ef-cnibin\") pod \"multus-additional-cni-plugins-tszfd\" (UID: \"6c33c8b3-58fb-4539-92c2-da514e6d52ef\") " pod="openshift-multus/multus-additional-cni-plugins-tszfd" Sep 09 08:39:01.784036 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:39:01.783909 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/6c33c8b3-58fb-4539-92c2-da514e6d52ef-system-cni-dir\") pod \"multus-additional-cni-plugins-tszfd\" (UID: \"6c33c8b3-58fb-4539-92c2-da514e6d52ef\") " pod="openshift-multus/multus-additional-cni-plugins-tszfd" Sep 09 08:39:01.784036 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:39:01.783917 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/247ba8ee-92a3-4333-b1e1-e98c71402928-hostroot\") pod \"multus-tm68w\" (UID: \"247ba8ee-92a3-4333-b1e1-e98c71402928\") " pod="openshift-multus/multus-tm68w" Sep 09 08:39:01.784036 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:39:01.783925 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/6c33c8b3-58fb-4539-92c2-da514e6d52ef-cnibin\") pod \"multus-additional-cni-plugins-tszfd\" (UID: \"6c33c8b3-58fb-4539-92c2-da514e6d52ef\") " pod="openshift-multus/multus-additional-cni-plugins-tszfd" Sep 09 08:39:01.784036 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:39:01.783890 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/3526e800-9ea7-4be9-8320-dc4e8f536116-etc-modprobe-d\") pod \"tuned-wdpws\" (UID: \"3526e800-9ea7-4be9-8320-dc4e8f536116\") " pod="openshift-cluster-node-tuning-operator/tuned-wdpws" Sep 09 08:39:01.784036 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:39:01.783941 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/3526e800-9ea7-4be9-8320-dc4e8f536116-etc-sysctl-d\") pod \"tuned-wdpws\" (UID: \"3526e800-9ea7-4be9-8320-dc4e8f536116\") " pod="openshift-cluster-node-tuning-operator/tuned-wdpws" Sep 09 08:39:01.784036 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:39:01.783975 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/247ba8ee-92a3-4333-b1e1-e98c71402928-hostroot\") pod \"multus-tm68w\" (UID: \"247ba8ee-92a3-4333-b1e1-e98c71402928\") " pod="openshift-multus/multus-tm68w" Sep 09 08:39:01.784036 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:39:01.783993 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5b6cf\" (UniqueName: \"kubernetes.io/projected/0bdb3c4d-ae9d-4a19-b79f-da2080ee1cf5-kube-api-access-5b6cf\") pod \"iptables-alerter-kq8xr\" (UID: \"0bdb3c4d-ae9d-4a19-b79f-da2080ee1cf5\") " pod="openshift-network-operator/iptables-alerter-kq8xr" Sep 09 08:39:01.784036 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:39:01.784024 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/3526e800-9ea7-4be9-8320-dc4e8f536116-etc-sysctl-d\") pod \"tuned-wdpws\" (UID: \"3526e800-9ea7-4be9-8320-dc4e8f536116\") " pod="openshift-cluster-node-tuning-operator/tuned-wdpws" Sep 09 08:39:01.784459 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:39:01.784042 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/3526e800-9ea7-4be9-8320-dc4e8f536116-etc-sysconfig\") pod \"tuned-wdpws\" (UID: \"3526e800-9ea7-4be9-8320-dc4e8f536116\") " pod="openshift-cluster-node-tuning-operator/tuned-wdpws" Sep 09 08:39:01.784459 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:39:01.784067 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/17eb483a-cd23-4d7e-b8fe-ad1b77d1537a-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-4h8qf\" (UID: \"17eb483a-cd23-4d7e-b8fe-ad1b77d1537a\") " pod="openshift-ovn-kubernetes/ovnkube-node-4h8qf" Sep 09 08:39:01.784459 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:39:01.784188 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/3526e800-9ea7-4be9-8320-dc4e8f536116-etc-sysconfig\") pod \"tuned-wdpws\" (UID: \"3526e800-9ea7-4be9-8320-dc4e8f536116\") " pod="openshift-cluster-node-tuning-operator/tuned-wdpws" Sep 09 08:39:01.784459 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:39:01.784222 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/17eb483a-cd23-4d7e-b8fe-ad1b77d1537a-run-systemd\") pod \"ovnkube-node-4h8qf\" (UID: \"17eb483a-cd23-4d7e-b8fe-ad1b77d1537a\") " pod="openshift-ovn-kubernetes/ovnkube-node-4h8qf" Sep 09 08:39:01.784459 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:39:01.784256 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/247ba8ee-92a3-4333-b1e1-e98c71402928-etc-kubernetes\") pod \"multus-tm68w\" (UID: \"247ba8ee-92a3-4333-b1e1-e98c71402928\") " pod="openshift-multus/multus-tm68w" Sep 09 08:39:01.784459 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:39:01.784275 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/17eb483a-cd23-4d7e-b8fe-ad1b77d1537a-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-4h8qf\" (UID: \"17eb483a-cd23-4d7e-b8fe-ad1b77d1537a\") " pod="openshift-ovn-kubernetes/ovnkube-node-4h8qf" Sep 09 08:39:01.784459 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:39:01.784281 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/857d0c30-88d7-429b-8487-bca1106267e2-sys-fs\") pod \"aws-ebs-csi-driver-node-dh9g8\" (UID: \"857d0c30-88d7-429b-8487-bca1106267e2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dh9g8" Sep 09 08:39:01.784459 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:39:01.784320 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7dcpk\" (UniqueName: \"kubernetes.io/projected/857d0c30-88d7-429b-8487-bca1106267e2-kube-api-access-7dcpk\") pod \"aws-ebs-csi-driver-node-dh9g8\" (UID: \"857d0c30-88d7-429b-8487-bca1106267e2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dh9g8" Sep 09 08:39:01.784459 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:39:01.784325 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/857d0c30-88d7-429b-8487-bca1106267e2-sys-fs\") pod \"aws-ebs-csi-driver-node-dh9g8\" (UID: \"857d0c30-88d7-429b-8487-bca1106267e2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dh9g8" Sep 09 08:39:01.784459 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:39:01.784382 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/17eb483a-cd23-4d7e-b8fe-ad1b77d1537a-run-systemd\") pod \"ovnkube-node-4h8qf\" (UID: \"17eb483a-cd23-4d7e-b8fe-ad1b77d1537a\") " pod="openshift-ovn-kubernetes/ovnkube-node-4h8qf" Sep 09 08:39:01.784459 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:39:01.784393 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/247ba8ee-92a3-4333-b1e1-e98c71402928-etc-kubernetes\") pod \"multus-tm68w\" (UID: \"247ba8ee-92a3-4333-b1e1-e98c71402928\") " pod="openshift-multus/multus-tm68w" Sep 09 08:39:01.784459 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:39:01.784396 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/17eb483a-cd23-4d7e-b8fe-ad1b77d1537a-host-slash\") pod \"ovnkube-node-4h8qf\" (UID: \"17eb483a-cd23-4d7e-b8fe-ad1b77d1537a\") " pod="openshift-ovn-kubernetes/ovnkube-node-4h8qf" Sep 09 08:39:01.784459 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:39:01.784431 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/17eb483a-cd23-4d7e-b8fe-ad1b77d1537a-run-ovn\") pod \"ovnkube-node-4h8qf\" (UID: \"17eb483a-cd23-4d7e-b8fe-ad1b77d1537a\") " pod="openshift-ovn-kubernetes/ovnkube-node-4h8qf" Sep 09 08:39:01.784459 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:39:01.784443 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/17eb483a-cd23-4d7e-b8fe-ad1b77d1537a-host-slash\") pod \"ovnkube-node-4h8qf\" (UID: \"17eb483a-cd23-4d7e-b8fe-ad1b77d1537a\") " pod="openshift-ovn-kubernetes/ovnkube-node-4h8qf" Sep 09 08:39:01.784459 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:39:01.784453 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/17eb483a-cd23-4d7e-b8fe-ad1b77d1537a-env-overrides\") pod \"ovnkube-node-4h8qf\" (UID: \"17eb483a-cd23-4d7e-b8fe-ad1b77d1537a\") " pod="openshift-ovn-kubernetes/ovnkube-node-4h8qf" Sep 09 08:39:01.785143 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:39:01.784483 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/247ba8ee-92a3-4333-b1e1-e98c71402928-host-run-netns\") pod \"multus-tm68w\" (UID: \"247ba8ee-92a3-4333-b1e1-e98c71402928\") " pod="openshift-multus/multus-tm68w" Sep 09 08:39:01.785143 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:39:01.784507 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/247ba8ee-92a3-4333-b1e1-e98c71402928-host-var-lib-cni-bin\") pod \"multus-tm68w\" (UID: \"247ba8ee-92a3-4333-b1e1-e98c71402928\") " pod="openshift-multus/multus-tm68w" Sep 09 08:39:01.785143 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:39:01.784520 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/17eb483a-cd23-4d7e-b8fe-ad1b77d1537a-run-ovn\") pod \"ovnkube-node-4h8qf\" (UID: \"17eb483a-cd23-4d7e-b8fe-ad1b77d1537a\") " pod="openshift-ovn-kubernetes/ovnkube-node-4h8qf" Sep 09 08:39:01.785143 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:39:01.784530 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-59rv8\" (UniqueName: \"kubernetes.io/projected/806a2d46-69ad-493c-a1cc-5796636d6a06-kube-api-access-59rv8\") pod \"node-ca-pdgxz\" (UID: \"806a2d46-69ad-493c-a1cc-5796636d6a06\") " pod="openshift-image-registry/node-ca-pdgxz" Sep 09 08:39:01.785143 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:39:01.784533 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/247ba8ee-92a3-4333-b1e1-e98c71402928-host-run-netns\") pod \"multus-tm68w\" (UID: \"247ba8ee-92a3-4333-b1e1-e98c71402928\") " pod="openshift-multus/multus-tm68w" Sep 09 08:39:01.785143 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:39:01.784555 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/17eb483a-cd23-4d7e-b8fe-ad1b77d1537a-host-run-ovn-kubernetes\") pod \"ovnkube-node-4h8qf\" (UID: \"17eb483a-cd23-4d7e-b8fe-ad1b77d1537a\") " pod="openshift-ovn-kubernetes/ovnkube-node-4h8qf" Sep 09 08:39:01.785143 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:39:01.784588 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/247ba8ee-92a3-4333-b1e1-e98c71402928-host-var-lib-cni-bin\") pod \"multus-tm68w\" (UID: \"247ba8ee-92a3-4333-b1e1-e98c71402928\") " pod="openshift-multus/multus-tm68w" Sep 09 08:39:01.785143 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:39:01.784630 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/857d0c30-88d7-429b-8487-bca1106267e2-kubelet-dir\") pod \"aws-ebs-csi-driver-node-dh9g8\" (UID: \"857d0c30-88d7-429b-8487-bca1106267e2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dh9g8" Sep 09 08:39:01.785143 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:39:01.784660 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/17eb483a-cd23-4d7e-b8fe-ad1b77d1537a-host-run-ovn-kubernetes\") pod \"ovnkube-node-4h8qf\" (UID: \"17eb483a-cd23-4d7e-b8fe-ad1b77d1537a\") " pod="openshift-ovn-kubernetes/ovnkube-node-4h8qf" Sep 09 08:39:01.785143 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:39:01.784708 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3526e800-9ea7-4be9-8320-dc4e8f536116-tmp\") pod \"tuned-wdpws\" (UID: \"3526e800-9ea7-4be9-8320-dc4e8f536116\") " pod="openshift-cluster-node-tuning-operator/tuned-wdpws" Sep 09 08:39:01.785143 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:39:01.784740 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/806a2d46-69ad-493c-a1cc-5796636d6a06-host\") pod \"node-ca-pdgxz\" (UID: \"806a2d46-69ad-493c-a1cc-5796636d6a06\") " pod="openshift-image-registry/node-ca-pdgxz" Sep 09 08:39:01.785143 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:39:01.784749 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/857d0c30-88d7-429b-8487-bca1106267e2-kubelet-dir\") pod \"aws-ebs-csi-driver-node-dh9g8\" (UID: \"857d0c30-88d7-429b-8487-bca1106267e2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dh9g8" Sep 09 08:39:01.785143 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:39:01.784798 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/950a27f9-3274-48f2-a23e-21f86398eb00-original-pull-secret\") pod \"global-pull-secret-syncer-dvhwl\" (UID: \"950a27f9-3274-48f2-a23e-21f86398eb00\") " pod="kube-system/global-pull-secret-syncer-dvhwl" Sep 09 08:39:01.785143 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:39:01.784849 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/17eb483a-cd23-4d7e-b8fe-ad1b77d1537a-ovnkube-config\") pod \"ovnkube-node-4h8qf\" (UID: \"17eb483a-cd23-4d7e-b8fe-ad1b77d1537a\") " pod="openshift-ovn-kubernetes/ovnkube-node-4h8qf" Sep 09 08:39:01.785143 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:39:01.784878 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/17eb483a-cd23-4d7e-b8fe-ad1b77d1537a-host-run-netns\") pod \"ovnkube-node-4h8qf\" (UID: \"17eb483a-cd23-4d7e-b8fe-ad1b77d1537a\") " pod="openshift-ovn-kubernetes/ovnkube-node-4h8qf" Sep 09 08:39:01.785143 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:39:01.784925 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/247ba8ee-92a3-4333-b1e1-e98c71402928-cnibin\") pod \"multus-tm68w\" (UID: \"247ba8ee-92a3-4333-b1e1-e98c71402928\") " pod="openshift-multus/multus-tm68w" Sep 09 08:39:01.785143 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:39:01.784951 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/17eb483a-cd23-4d7e-b8fe-ad1b77d1537a-host-run-netns\") pod \"ovnkube-node-4h8qf\" (UID: \"17eb483a-cd23-4d7e-b8fe-ad1b77d1537a\") " pod="openshift-ovn-kubernetes/ovnkube-node-4h8qf" Sep 09 08:39:01.785821 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:39:01.784950 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/247ba8ee-92a3-4333-b1e1-e98c71402928-host-var-lib-cni-multus\") pod \"multus-tm68w\" (UID: \"247ba8ee-92a3-4333-b1e1-e98c71402928\") " pod="openshift-multus/multus-tm68w" Sep 09 08:39:01.785821 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:39:01.784985 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/17eb483a-cd23-4d7e-b8fe-ad1b77d1537a-var-lib-openvswitch\") pod \"ovnkube-node-4h8qf\" (UID: \"17eb483a-cd23-4d7e-b8fe-ad1b77d1537a\") " pod="openshift-ovn-kubernetes/ovnkube-node-4h8qf" Sep 09 08:39:01.785821 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:39:01.784998 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/247ba8ee-92a3-4333-b1e1-e98c71402928-cnibin\") pod \"multus-tm68w\" (UID: \"247ba8ee-92a3-4333-b1e1-e98c71402928\") " pod="openshift-multus/multus-tm68w" Sep 09 08:39:01.785821 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:39:01.785011 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/247ba8ee-92a3-4333-b1e1-e98c71402928-multus-socket-dir-parent\") pod \"multus-tm68w\" (UID: \"247ba8ee-92a3-4333-b1e1-e98c71402928\") " pod="openshift-multus/multus-tm68w" Sep 09 08:39:01.785821 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:39:01.785025 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/247ba8ee-92a3-4333-b1e1-e98c71402928-host-var-lib-cni-multus\") pod \"multus-tm68w\" (UID: \"247ba8ee-92a3-4333-b1e1-e98c71402928\") " pod="openshift-multus/multus-tm68w" Sep 09 08:39:01.785821 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:39:01.785052 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4jbtg\" (UniqueName: \"kubernetes.io/projected/5cfc7f17-0984-4eb8-bf5f-a4c593b2d411-kube-api-access-4jbtg\") pod \"node-resolver-b6v64\" (UID: \"5cfc7f17-0984-4eb8-bf5f-a4c593b2d411\") " pod="openshift-dns/node-resolver-b6v64" Sep 09 08:39:01.785821 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:39:01.785080 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/17eb483a-cd23-4d7e-b8fe-ad1b77d1537a-var-lib-openvswitch\") pod \"ovnkube-node-4h8qf\" (UID: \"17eb483a-cd23-4d7e-b8fe-ad1b77d1537a\") " pod="openshift-ovn-kubernetes/ovnkube-node-4h8qf" Sep 09 08:39:01.785821 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:39:01.785090 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/17eb483a-cd23-4d7e-b8fe-ad1b77d1537a-node-log\") pod \"ovnkube-node-4h8qf\" (UID: \"17eb483a-cd23-4d7e-b8fe-ad1b77d1537a\") " pod="openshift-ovn-kubernetes/ovnkube-node-4h8qf" Sep 09 08:39:01.785821 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:39:01.785104 2564 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Sep 09 08:39:01.785821 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:39:01.785791 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/247ba8ee-92a3-4333-b1e1-e98c71402928-multus-socket-dir-parent\") pod \"multus-tm68w\" (UID: \"247ba8ee-92a3-4333-b1e1-e98c71402928\") " pod="openshift-multus/multus-tm68w" Sep 09 08:39:01.785821 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:39:01.785822 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/17eb483a-cd23-4d7e-b8fe-ad1b77d1537a-node-log\") pod \"ovnkube-node-4h8qf\" (UID: \"17eb483a-cd23-4d7e-b8fe-ad1b77d1537a\") " pod="openshift-ovn-kubernetes/ovnkube-node-4h8qf" Sep 09 08:39:01.786326 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:39:01.785871 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-86lbv\" (UniqueName: \"kubernetes.io/projected/247ba8ee-92a3-4333-b1e1-e98c71402928-kube-api-access-86lbv\") pod \"multus-tm68w\" (UID: \"247ba8ee-92a3-4333-b1e1-e98c71402928\") " pod="openshift-multus/multus-tm68w" Sep 09 08:39:01.786326 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:39:01.785904 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/3526e800-9ea7-4be9-8320-dc4e8f536116-host\") pod \"tuned-wdpws\" (UID: \"3526e800-9ea7-4be9-8320-dc4e8f536116\") " pod="openshift-cluster-node-tuning-operator/tuned-wdpws" Sep 09 08:39:01.786326 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:39:01.785939 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5cfc7f17-0984-4eb8-bf5f-a4c593b2d411-tmp-dir\") pod \"node-resolver-b6v64\" (UID: \"5cfc7f17-0984-4eb8-bf5f-a4c593b2d411\") " pod="openshift-dns/node-resolver-b6v64" Sep 09 08:39:01.786326 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:39:01.785964 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/247ba8ee-92a3-4333-b1e1-e98c71402928-multus-daemon-config\") pod \"multus-tm68w\" (UID: \"247ba8ee-92a3-4333-b1e1-e98c71402928\") " pod="openshift-multus/multus-tm68w" Sep 09 08:39:01.786326 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:39:01.786001 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/857d0c30-88d7-429b-8487-bca1106267e2-etc-selinux\") pod \"aws-ebs-csi-driver-node-dh9g8\" (UID: \"857d0c30-88d7-429b-8487-bca1106267e2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dh9g8" Sep 09 08:39:01.786326 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:39:01.786032 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/3526e800-9ea7-4be9-8320-dc4e8f536116-etc-systemd\") pod \"tuned-wdpws\" (UID: \"3526e800-9ea7-4be9-8320-dc4e8f536116\") " pod="openshift-cluster-node-tuning-operator/tuned-wdpws" Sep 09 08:39:01.786326 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:39:01.786060 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/3526e800-9ea7-4be9-8320-dc4e8f536116-run\") pod \"tuned-wdpws\" (UID: \"3526e800-9ea7-4be9-8320-dc4e8f536116\") " pod="openshift-cluster-node-tuning-operator/tuned-wdpws" Sep 09 08:39:01.786326 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:39:01.786122 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/3526e800-9ea7-4be9-8320-dc4e8f536116-lib-modules\") pod \"tuned-wdpws\" (UID: \"3526e800-9ea7-4be9-8320-dc4e8f536116\") " pod="openshift-cluster-node-tuning-operator/tuned-wdpws" Sep 09 08:39:01.786326 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:39:01.786146 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q22zj\" (UniqueName: \"kubernetes.io/projected/3526e800-9ea7-4be9-8320-dc4e8f536116-kube-api-access-q22zj\") pod \"tuned-wdpws\" (UID: \"3526e800-9ea7-4be9-8320-dc4e8f536116\") " pod="openshift-cluster-node-tuning-operator/tuned-wdpws" Sep 09 08:39:01.786326 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:39:01.786199 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/17eb483a-cd23-4d7e-b8fe-ad1b77d1537a-host-cni-netd\") pod \"ovnkube-node-4h8qf\" (UID: \"17eb483a-cd23-4d7e-b8fe-ad1b77d1537a\") " pod="openshift-ovn-kubernetes/ovnkube-node-4h8qf" Sep 09 08:39:01.786326 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:39:01.786250 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/17eb483a-cd23-4d7e-b8fe-ad1b77d1537a-env-overrides\") pod \"ovnkube-node-4h8qf\" (UID: \"17eb483a-cd23-4d7e-b8fe-ad1b77d1537a\") " pod="openshift-ovn-kubernetes/ovnkube-node-4h8qf" Sep 09 08:39:01.786847 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:39:01.786376 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/3526e800-9ea7-4be9-8320-dc4e8f536116-host\") pod \"tuned-wdpws\" (UID: \"3526e800-9ea7-4be9-8320-dc4e8f536116\") " pod="openshift-cluster-node-tuning-operator/tuned-wdpws" Sep 09 08:39:01.786847 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:39:01.786408 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/6c33c8b3-58fb-4539-92c2-da514e6d52ef-tuning-conf-dir\") pod \"multus-additional-cni-plugins-tszfd\" (UID: \"6c33c8b3-58fb-4539-92c2-da514e6d52ef\") " pod="openshift-multus/multus-additional-cni-plugins-tszfd" Sep 09 08:39:01.786847 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:39:01.786461 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/3526e800-9ea7-4be9-8320-dc4e8f536116-run\") pod \"tuned-wdpws\" (UID: \"3526e800-9ea7-4be9-8320-dc4e8f536116\") " pod="openshift-cluster-node-tuning-operator/tuned-wdpws" Sep 09 08:39:01.786847 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:39:01.786479 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/17eb483a-cd23-4d7e-b8fe-ad1b77d1537a-ovnkube-config\") pod \"ovnkube-node-4h8qf\" (UID: \"17eb483a-cd23-4d7e-b8fe-ad1b77d1537a\") " pod="openshift-ovn-kubernetes/ovnkube-node-4h8qf" Sep 09 08:39:01.786847 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:39:01.786590 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/17eb483a-cd23-4d7e-b8fe-ad1b77d1537a-host-cni-netd\") pod \"ovnkube-node-4h8qf\" (UID: \"17eb483a-cd23-4d7e-b8fe-ad1b77d1537a\") " pod="openshift-ovn-kubernetes/ovnkube-node-4h8qf" Sep 09 08:39:01.786847 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:39:01.786623 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/3526e800-9ea7-4be9-8320-dc4e8f536116-lib-modules\") pod \"tuned-wdpws\" (UID: \"3526e800-9ea7-4be9-8320-dc4e8f536116\") " pod="openshift-cluster-node-tuning-operator/tuned-wdpws" Sep 09 08:39:01.786847 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:39:01.786672 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/3526e800-9ea7-4be9-8320-dc4e8f536116-etc-systemd\") pod \"tuned-wdpws\" (UID: \"3526e800-9ea7-4be9-8320-dc4e8f536116\") " pod="openshift-cluster-node-tuning-operator/tuned-wdpws" Sep 09 08:39:01.786847 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:39:01.786757 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/857d0c30-88d7-429b-8487-bca1106267e2-etc-selinux\") pod \"aws-ebs-csi-driver-node-dh9g8\" (UID: \"857d0c30-88d7-429b-8487-bca1106267e2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dh9g8" Sep 09 08:39:01.786847 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:39:01.786768 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/6c33c8b3-58fb-4539-92c2-da514e6d52ef-tuning-conf-dir\") pod \"multus-additional-cni-plugins-tszfd\" (UID: \"6c33c8b3-58fb-4539-92c2-da514e6d52ef\") " pod="openshift-multus/multus-additional-cni-plugins-tszfd" Sep 09 08:39:01.786847 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:39:01.786837 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/6c33c8b3-58fb-4539-92c2-da514e6d52ef-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-tszfd\" (UID: \"6c33c8b3-58fb-4539-92c2-da514e6d52ef\") " pod="openshift-multus/multus-additional-cni-plugins-tszfd" Sep 09 08:39:01.787289 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:39:01.786870 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/17eb483a-cd23-4d7e-b8fe-ad1b77d1537a-etc-openvswitch\") pod \"ovnkube-node-4h8qf\" (UID: \"17eb483a-cd23-4d7e-b8fe-ad1b77d1537a\") " pod="openshift-ovn-kubernetes/ovnkube-node-4h8qf" Sep 09 08:39:01.787289 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:39:01.786906 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/247ba8ee-92a3-4333-b1e1-e98c71402928-cni-binary-copy\") pod \"multus-tm68w\" (UID: \"247ba8ee-92a3-4333-b1e1-e98c71402928\") " pod="openshift-multus/multus-tm68w" Sep 09 08:39:01.787289 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:39:01.786936 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/3526e800-9ea7-4be9-8320-dc4e8f536116-sys\") pod \"tuned-wdpws\" (UID: \"3526e800-9ea7-4be9-8320-dc4e8f536116\") " pod="openshift-cluster-node-tuning-operator/tuned-wdpws" Sep 09 08:39:01.787289 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:39:01.786966 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/3526e800-9ea7-4be9-8320-dc4e8f536116-etc-tuned\") pod \"tuned-wdpws\" (UID: \"3526e800-9ea7-4be9-8320-dc4e8f536116\") " pod="openshift-cluster-node-tuning-operator/tuned-wdpws" Sep 09 08:39:01.787289 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:39:01.787002 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/950a27f9-3274-48f2-a23e-21f86398eb00-kubelet-config\") pod \"global-pull-secret-syncer-dvhwl\" (UID: \"950a27f9-3274-48f2-a23e-21f86398eb00\") " pod="kube-system/global-pull-secret-syncer-dvhwl" Sep 09 08:39:01.787289 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:39:01.787031 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/0bdb3c4d-ae9d-4a19-b79f-da2080ee1cf5-iptables-alerter-script\") pod \"iptables-alerter-kq8xr\" (UID: \"0bdb3c4d-ae9d-4a19-b79f-da2080ee1cf5\") " pod="openshift-network-operator/iptables-alerter-kq8xr" Sep 09 08:39:01.787289 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:39:01.787070 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/0bdb3c4d-ae9d-4a19-b79f-da2080ee1cf5-host-slash\") pod \"iptables-alerter-kq8xr\" (UID: \"0bdb3c4d-ae9d-4a19-b79f-da2080ee1cf5\") " pod="openshift-network-operator/iptables-alerter-kq8xr" Sep 09 08:39:01.787289 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:39:01.787109 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/50f8cfa3-6f41-47be-899d-cf16c3251f84-metrics-certs\") pod \"network-metrics-daemon-b2965\" (UID: \"50f8cfa3-6f41-47be-899d-cf16c3251f84\") " pod="openshift-multus/network-metrics-daemon-b2965" Sep 09 08:39:01.787289 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:39:01.787145 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-26l5q\" (UniqueName: \"kubernetes.io/projected/50f8cfa3-6f41-47be-899d-cf16c3251f84-kube-api-access-26l5q\") pod \"network-metrics-daemon-b2965\" (UID: \"50f8cfa3-6f41-47be-899d-cf16c3251f84\") " pod="openshift-multus/network-metrics-daemon-b2965" Sep 09 08:39:01.787289 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:39:01.787179 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pf7k4\" (UniqueName: \"kubernetes.io/projected/17eb483a-cd23-4d7e-b8fe-ad1b77d1537a-kube-api-access-pf7k4\") pod \"ovnkube-node-4h8qf\" (UID: \"17eb483a-cd23-4d7e-b8fe-ad1b77d1537a\") " pod="openshift-ovn-kubernetes/ovnkube-node-4h8qf" Sep 09 08:39:01.787289 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:39:01.787207 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/247ba8ee-92a3-4333-b1e1-e98c71402928-host-var-lib-kubelet\") pod \"multus-tm68w\" (UID: \"247ba8ee-92a3-4333-b1e1-e98c71402928\") " pod="openshift-multus/multus-tm68w" Sep 09 08:39:01.787289 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:39:01.787242 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/17eb483a-cd23-4d7e-b8fe-ad1b77d1537a-log-socket\") pod \"ovnkube-node-4h8qf\" (UID: \"17eb483a-cd23-4d7e-b8fe-ad1b77d1537a\") " pod="openshift-ovn-kubernetes/ovnkube-node-4h8qf" Sep 09 08:39:01.787289 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:39:01.787272 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/247ba8ee-92a3-4333-b1e1-e98c71402928-host-run-k8s-cni-cncf-io\") pod \"multus-tm68w\" (UID: \"247ba8ee-92a3-4333-b1e1-e98c71402928\") " pod="openshift-multus/multus-tm68w" Sep 09 08:39:01.787909 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:39:01.787302 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/247ba8ee-92a3-4333-b1e1-e98c71402928-host-run-multus-certs\") pod \"multus-tm68w\" (UID: \"247ba8ee-92a3-4333-b1e1-e98c71402928\") " pod="openshift-multus/multus-tm68w" Sep 09 08:39:01.787909 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:39:01.787320 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/247ba8ee-92a3-4333-b1e1-e98c71402928-multus-daemon-config\") pod \"multus-tm68w\" (UID: \"247ba8ee-92a3-4333-b1e1-e98c71402928\") " pod="openshift-multus/multus-tm68w" Sep 09 08:39:01.787909 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:39:01.787354 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/857d0c30-88d7-429b-8487-bca1106267e2-registration-dir\") pod \"aws-ebs-csi-driver-node-dh9g8\" (UID: \"857d0c30-88d7-429b-8487-bca1106267e2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dh9g8" Sep 09 08:39:01.787909 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:39:01.787383 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/3526e800-9ea7-4be9-8320-dc4e8f536116-etc-sysctl-conf\") pod \"tuned-wdpws\" (UID: \"3526e800-9ea7-4be9-8320-dc4e8f536116\") " pod="openshift-cluster-node-tuning-operator/tuned-wdpws" Sep 09 08:39:01.787909 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:39:01.787414 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/3526e800-9ea7-4be9-8320-dc4e8f536116-var-lib-kubelet\") pod \"tuned-wdpws\" (UID: \"3526e800-9ea7-4be9-8320-dc4e8f536116\") " pod="openshift-cluster-node-tuning-operator/tuned-wdpws" Sep 09 08:39:01.787909 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:39:01.787433 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/3526e800-9ea7-4be9-8320-dc4e8f536116-sys\") pod \"tuned-wdpws\" (UID: \"3526e800-9ea7-4be9-8320-dc4e8f536116\") " pod="openshift-cluster-node-tuning-operator/tuned-wdpws" Sep 09 08:39:01.787909 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:39:01.787447 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/c50a1df3-102a-4460-b42a-0be6714665ea-agent-certs\") pod \"konnectivity-agent-p7hs5\" (UID: \"c50a1df3-102a-4460-b42a-0be6714665ea\") " pod="kube-system/konnectivity-agent-p7hs5" Sep 09 08:39:01.787909 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:39:01.787482 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/c50a1df3-102a-4460-b42a-0be6714665ea-konnectivity-ca\") pod \"konnectivity-agent-p7hs5\" (UID: \"c50a1df3-102a-4460-b42a-0be6714665ea\") " pod="kube-system/konnectivity-agent-p7hs5" Sep 09 08:39:01.787909 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:39:01.787502 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/247ba8ee-92a3-4333-b1e1-e98c71402928-cni-binary-copy\") pod \"multus-tm68w\" (UID: \"247ba8ee-92a3-4333-b1e1-e98c71402928\") " pod="openshift-multus/multus-tm68w" Sep 09 08:39:01.787909 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:39:01.787527 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/17eb483a-cd23-4d7e-b8fe-ad1b77d1537a-host-cni-bin\") pod \"ovnkube-node-4h8qf\" (UID: \"17eb483a-cd23-4d7e-b8fe-ad1b77d1537a\") " pod="openshift-ovn-kubernetes/ovnkube-node-4h8qf" Sep 09 08:39:01.787909 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:39:01.787581 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/17eb483a-cd23-4d7e-b8fe-ad1b77d1537a-etc-openvswitch\") pod \"ovnkube-node-4h8qf\" (UID: \"17eb483a-cd23-4d7e-b8fe-ad1b77d1537a\") " pod="openshift-ovn-kubernetes/ovnkube-node-4h8qf" Sep 09 08:39:01.787909 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:39:01.787586 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/17eb483a-cd23-4d7e-b8fe-ad1b77d1537a-host-cni-bin\") pod \"ovnkube-node-4h8qf\" (UID: \"17eb483a-cd23-4d7e-b8fe-ad1b77d1537a\") " pod="openshift-ovn-kubernetes/ovnkube-node-4h8qf" Sep 09 08:39:01.787909 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:39:01.787673 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/17eb483a-cd23-4d7e-b8fe-ad1b77d1537a-log-socket\") pod \"ovnkube-node-4h8qf\" (UID: \"17eb483a-cd23-4d7e-b8fe-ad1b77d1537a\") " pod="openshift-ovn-kubernetes/ovnkube-node-4h8qf" Sep 09 08:39:01.787909 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:39:01.787717 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/6c33c8b3-58fb-4539-92c2-da514e6d52ef-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-tszfd\" (UID: \"6c33c8b3-58fb-4539-92c2-da514e6d52ef\") " pod="openshift-multus/multus-additional-cni-plugins-tszfd" Sep 09 08:39:01.787909 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:39:01.787734 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/3526e800-9ea7-4be9-8320-dc4e8f536116-etc-sysctl-conf\") pod \"tuned-wdpws\" (UID: \"3526e800-9ea7-4be9-8320-dc4e8f536116\") " pod="openshift-cluster-node-tuning-operator/tuned-wdpws" Sep 09 08:39:01.787909 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:39:01.787734 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/857d0c30-88d7-429b-8487-bca1106267e2-registration-dir\") pod \"aws-ebs-csi-driver-node-dh9g8\" (UID: \"857d0c30-88d7-429b-8487-bca1106267e2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dh9g8" Sep 09 08:39:01.787909 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:39:01.787784 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/247ba8ee-92a3-4333-b1e1-e98c71402928-host-run-multus-certs\") pod \"multus-tm68w\" (UID: \"247ba8ee-92a3-4333-b1e1-e98c71402928\") " pod="openshift-multus/multus-tm68w" Sep 09 08:39:01.788709 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:39:01.787811 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/6c33c8b3-58fb-4539-92c2-da514e6d52ef-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-tszfd\" (UID: \"6c33c8b3-58fb-4539-92c2-da514e6d52ef\") " pod="openshift-multus/multus-additional-cni-plugins-tszfd" Sep 09 08:39:01.788709 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:39:01.787850 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tpfww\" (UniqueName: \"kubernetes.io/projected/6c33c8b3-58fb-4539-92c2-da514e6d52ef-kube-api-access-tpfww\") pod \"multus-additional-cni-plugins-tszfd\" (UID: \"6c33c8b3-58fb-4539-92c2-da514e6d52ef\") " pod="openshift-multus/multus-additional-cni-plugins-tszfd" Sep 09 08:39:01.788709 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:39:01.787870 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/247ba8ee-92a3-4333-b1e1-e98c71402928-host-var-lib-kubelet\") pod \"multus-tm68w\" (UID: \"247ba8ee-92a3-4333-b1e1-e98c71402928\") " pod="openshift-multus/multus-tm68w" Sep 09 08:39:01.788709 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:39:01.787916 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/247ba8ee-92a3-4333-b1e1-e98c71402928-host-run-k8s-cni-cncf-io\") pod \"multus-tm68w\" (UID: \"247ba8ee-92a3-4333-b1e1-e98c71402928\") " pod="openshift-multus/multus-tm68w" Sep 09 08:39:01.788709 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:39:01.787958 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/17eb483a-cd23-4d7e-b8fe-ad1b77d1537a-host-kubelet\") pod \"ovnkube-node-4h8qf\" (UID: \"17eb483a-cd23-4d7e-b8fe-ad1b77d1537a\") " pod="openshift-ovn-kubernetes/ovnkube-node-4h8qf" Sep 09 08:39:01.788709 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:39:01.787993 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/17eb483a-cd23-4d7e-b8fe-ad1b77d1537a-run-openvswitch\") pod \"ovnkube-node-4h8qf\" (UID: \"17eb483a-cd23-4d7e-b8fe-ad1b77d1537a\") " pod="openshift-ovn-kubernetes/ovnkube-node-4h8qf" Sep 09 08:39:01.788709 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:39:01.788028 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/247ba8ee-92a3-4333-b1e1-e98c71402928-system-cni-dir\") pod \"multus-tm68w\" (UID: \"247ba8ee-92a3-4333-b1e1-e98c71402928\") " pod="openshift-multus/multus-tm68w" Sep 09 08:39:01.788709 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:39:01.788041 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/3526e800-9ea7-4be9-8320-dc4e8f536116-var-lib-kubelet\") pod \"tuned-wdpws\" (UID: \"3526e800-9ea7-4be9-8320-dc4e8f536116\") " pod="openshift-cluster-node-tuning-operator/tuned-wdpws" Sep 09 08:39:01.788709 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:39:01.788117 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/857d0c30-88d7-429b-8487-bca1106267e2-device-dir\") pod \"aws-ebs-csi-driver-node-dh9g8\" (UID: \"857d0c30-88d7-429b-8487-bca1106267e2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dh9g8" Sep 09 08:39:01.788709 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:39:01.788155 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qvmn4\" (UniqueName: \"kubernetes.io/projected/96601efb-dd16-407b-9899-22f67a88b7f0-kube-api-access-qvmn4\") pod \"network-check-target-2zg7w\" (UID: \"96601efb-dd16-407b-9899-22f67a88b7f0\") " pod="openshift-network-diagnostics/network-check-target-2zg7w" Sep 09 08:39:01.788709 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:39:01.788205 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/17eb483a-cd23-4d7e-b8fe-ad1b77d1537a-run-openvswitch\") pod \"ovnkube-node-4h8qf\" (UID: \"17eb483a-cd23-4d7e-b8fe-ad1b77d1537a\") " pod="openshift-ovn-kubernetes/ovnkube-node-4h8qf" Sep 09 08:39:01.788709 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:39:01.788214 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/17eb483a-cd23-4d7e-b8fe-ad1b77d1537a-host-kubelet\") pod \"ovnkube-node-4h8qf\" (UID: \"17eb483a-cd23-4d7e-b8fe-ad1b77d1537a\") " pod="openshift-ovn-kubernetes/ovnkube-node-4h8qf" Sep 09 08:39:01.788709 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:39:01.788240 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/17eb483a-cd23-4d7e-b8fe-ad1b77d1537a-ovn-node-metrics-cert\") pod \"ovnkube-node-4h8qf\" (UID: \"17eb483a-cd23-4d7e-b8fe-ad1b77d1537a\") " pod="openshift-ovn-kubernetes/ovnkube-node-4h8qf" Sep 09 08:39:01.788709 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:39:01.788359 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/247ba8ee-92a3-4333-b1e1-e98c71402928-system-cni-dir\") pod \"multus-tm68w\" (UID: \"247ba8ee-92a3-4333-b1e1-e98c71402928\") " pod="openshift-multus/multus-tm68w" Sep 09 08:39:01.788709 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:39:01.788448 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/17eb483a-cd23-4d7e-b8fe-ad1b77d1537a-systemd-units\") pod \"ovnkube-node-4h8qf\" (UID: \"17eb483a-cd23-4d7e-b8fe-ad1b77d1537a\") " pod="openshift-ovn-kubernetes/ovnkube-node-4h8qf" Sep 09 08:39:01.788709 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:39:01.788482 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/247ba8ee-92a3-4333-b1e1-e98c71402928-multus-conf-dir\") pod \"multus-tm68w\" (UID: \"247ba8ee-92a3-4333-b1e1-e98c71402928\") " pod="openshift-multus/multus-tm68w" Sep 09 08:39:01.788709 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:39:01.788536 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/857d0c30-88d7-429b-8487-bca1106267e2-device-dir\") pod \"aws-ebs-csi-driver-node-dh9g8\" (UID: \"857d0c30-88d7-429b-8487-bca1106267e2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dh9g8" Sep 09 08:39:01.789534 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:39:01.788633 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/17eb483a-cd23-4d7e-b8fe-ad1b77d1537a-systemd-units\") pod \"ovnkube-node-4h8qf\" (UID: \"17eb483a-cd23-4d7e-b8fe-ad1b77d1537a\") " pod="openshift-ovn-kubernetes/ovnkube-node-4h8qf" Sep 09 08:39:01.789534 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:39:01.788700 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/6c33c8b3-58fb-4539-92c2-da514e6d52ef-cni-binary-copy\") pod \"multus-additional-cni-plugins-tszfd\" (UID: \"6c33c8b3-58fb-4539-92c2-da514e6d52ef\") " pod="openshift-multus/multus-additional-cni-plugins-tszfd" Sep 09 08:39:01.789534 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:39:01.788776 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/6c33c8b3-58fb-4539-92c2-da514e6d52ef-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-tszfd\" (UID: \"6c33c8b3-58fb-4539-92c2-da514e6d52ef\") " pod="openshift-multus/multus-additional-cni-plugins-tszfd" Sep 09 08:39:01.789534 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:39:01.788783 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/17eb483a-cd23-4d7e-b8fe-ad1b77d1537a-ovnkube-script-lib\") pod \"ovnkube-node-4h8qf\" (UID: \"17eb483a-cd23-4d7e-b8fe-ad1b77d1537a\") " pod="openshift-ovn-kubernetes/ovnkube-node-4h8qf" Sep 09 08:39:01.789534 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:39:01.788818 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/247ba8ee-92a3-4333-b1e1-e98c71402928-multus-cni-dir\") pod \"multus-tm68w\" (UID: \"247ba8ee-92a3-4333-b1e1-e98c71402928\") " pod="openshift-multus/multus-tm68w" Sep 09 08:39:01.789534 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:39:01.788867 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/247ba8ee-92a3-4333-b1e1-e98c71402928-multus-conf-dir\") pod \"multus-tm68w\" (UID: \"247ba8ee-92a3-4333-b1e1-e98c71402928\") " pod="openshift-multus/multus-tm68w" Sep 09 08:39:01.789534 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:39:01.789265 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/6c33c8b3-58fb-4539-92c2-da514e6d52ef-cni-binary-copy\") pod \"multus-additional-cni-plugins-tszfd\" (UID: \"6c33c8b3-58fb-4539-92c2-da514e6d52ef\") " pod="openshift-multus/multus-additional-cni-plugins-tszfd" Sep 09 08:39:01.789534 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:39:01.789300 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/17eb483a-cd23-4d7e-b8fe-ad1b77d1537a-ovnkube-script-lib\") pod \"ovnkube-node-4h8qf\" (UID: \"17eb483a-cd23-4d7e-b8fe-ad1b77d1537a\") " pod="openshift-ovn-kubernetes/ovnkube-node-4h8qf" Sep 09 08:39:01.789534 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:39:01.789318 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/857d0c30-88d7-429b-8487-bca1106267e2-socket-dir\") pod \"aws-ebs-csi-driver-node-dh9g8\" (UID: \"857d0c30-88d7-429b-8487-bca1106267e2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dh9g8" Sep 09 08:39:01.789534 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:39:01.789397 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/247ba8ee-92a3-4333-b1e1-e98c71402928-multus-cni-dir\") pod \"multus-tm68w\" (UID: \"247ba8ee-92a3-4333-b1e1-e98c71402928\") " pod="openshift-multus/multus-tm68w" Sep 09 08:39:01.789534 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:39:01.789408 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3526e800-9ea7-4be9-8320-dc4e8f536116-etc-kubernetes\") pod \"tuned-wdpws\" (UID: \"3526e800-9ea7-4be9-8320-dc4e8f536116\") " pod="openshift-cluster-node-tuning-operator/tuned-wdpws" Sep 09 08:39:01.789534 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:39:01.789528 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3526e800-9ea7-4be9-8320-dc4e8f536116-etc-kubernetes\") pod \"tuned-wdpws\" (UID: \"3526e800-9ea7-4be9-8320-dc4e8f536116\") " pod="openshift-cluster-node-tuning-operator/tuned-wdpws" Sep 09 08:39:01.790102 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:39:01.789569 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/857d0c30-88d7-429b-8487-bca1106267e2-socket-dir\") pod \"aws-ebs-csi-driver-node-dh9g8\" (UID: \"857d0c30-88d7-429b-8487-bca1106267e2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dh9g8" Sep 09 08:39:01.790102 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:39:01.789733 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/3526e800-9ea7-4be9-8320-dc4e8f536116-etc-tuned\") pod \"tuned-wdpws\" (UID: \"3526e800-9ea7-4be9-8320-dc4e8f536116\") " pod="openshift-cluster-node-tuning-operator/tuned-wdpws" Sep 09 08:39:01.791146 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:39:01.791116 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/17eb483a-cd23-4d7e-b8fe-ad1b77d1537a-ovn-node-metrics-cert\") pod \"ovnkube-node-4h8qf\" (UID: \"17eb483a-cd23-4d7e-b8fe-ad1b77d1537a\") " pod="openshift-ovn-kubernetes/ovnkube-node-4h8qf" Sep 09 08:39:01.792517 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:39:01.792474 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3526e800-9ea7-4be9-8320-dc4e8f536116-tmp\") pod \"tuned-wdpws\" (UID: \"3526e800-9ea7-4be9-8320-dc4e8f536116\") " pod="openshift-cluster-node-tuning-operator/tuned-wdpws" Sep 09 08:39:01.793155 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:39:01.793099 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7dcpk\" (UniqueName: \"kubernetes.io/projected/857d0c30-88d7-429b-8487-bca1106267e2-kube-api-access-7dcpk\") pod \"aws-ebs-csi-driver-node-dh9g8\" (UID: \"857d0c30-88d7-429b-8487-bca1106267e2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dh9g8" Sep 09 08:39:01.794033 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:39:01.793990 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-q22zj\" (UniqueName: \"kubernetes.io/projected/3526e800-9ea7-4be9-8320-dc4e8f536116-kube-api-access-q22zj\") pod \"tuned-wdpws\" (UID: \"3526e800-9ea7-4be9-8320-dc4e8f536116\") " pod="openshift-cluster-node-tuning-operator/tuned-wdpws" Sep 09 08:39:01.795584 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:39:01.795551 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-86lbv\" (UniqueName: \"kubernetes.io/projected/247ba8ee-92a3-4333-b1e1-e98c71402928-kube-api-access-86lbv\") pod \"multus-tm68w\" (UID: \"247ba8ee-92a3-4333-b1e1-e98c71402928\") " pod="openshift-multus/multus-tm68w" Sep 09 08:39:01.795584 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:39:01.795576 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pf7k4\" (UniqueName: \"kubernetes.io/projected/17eb483a-cd23-4d7e-b8fe-ad1b77d1537a-kube-api-access-pf7k4\") pod \"ovnkube-node-4h8qf\" (UID: \"17eb483a-cd23-4d7e-b8fe-ad1b77d1537a\") " pod="openshift-ovn-kubernetes/ovnkube-node-4h8qf" Sep 09 08:39:01.796125 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:39:01.796091 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tpfww\" (UniqueName: \"kubernetes.io/projected/6c33c8b3-58fb-4539-92c2-da514e6d52ef-kube-api-access-tpfww\") pod \"multus-additional-cni-plugins-tszfd\" (UID: \"6c33c8b3-58fb-4539-92c2-da514e6d52ef\") " pod="openshift-multus/multus-additional-cni-plugins-tszfd" Sep 09 08:39:01.805632 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:39:01.805582 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-144.ec2.internal" event={"ID":"e62b73efee802c3e810d30a3512fea6c","Type":"ContainerStarted","Data":"9630559d64e625d8f559c36039b96a461a89e5298798c8909b2f3ee4f3530136"} Sep 09 08:39:01.806694 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:39:01.806671 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-144.ec2.internal" event={"ID":"efe7ba22b7eb392835b6437abb5fbd2b","Type":"ContainerStarted","Data":"f1ab57165be19b0a13320f1dfcadae19ff21de603a84dd773cd828477057c1a8"} Sep 09 08:39:01.889937 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:39:01.889906 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/806a2d46-69ad-493c-a1cc-5796636d6a06-host\") pod \"node-ca-pdgxz\" (UID: \"806a2d46-69ad-493c-a1cc-5796636d6a06\") " pod="openshift-image-registry/node-ca-pdgxz" Sep 09 08:39:01.889937 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:39:01.889939 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/950a27f9-3274-48f2-a23e-21f86398eb00-original-pull-secret\") pod \"global-pull-secret-syncer-dvhwl\" (UID: \"950a27f9-3274-48f2-a23e-21f86398eb00\") " pod="kube-system/global-pull-secret-syncer-dvhwl" Sep 09 08:39:01.890161 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:39:01.889959 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4jbtg\" (UniqueName: \"kubernetes.io/projected/5cfc7f17-0984-4eb8-bf5f-a4c593b2d411-kube-api-access-4jbtg\") pod \"node-resolver-b6v64\" (UID: \"5cfc7f17-0984-4eb8-bf5f-a4c593b2d411\") " pod="openshift-dns/node-resolver-b6v64" Sep 09 08:39:01.890161 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:39:01.889975 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5cfc7f17-0984-4eb8-bf5f-a4c593b2d411-tmp-dir\") pod \"node-resolver-b6v64\" (UID: \"5cfc7f17-0984-4eb8-bf5f-a4c593b2d411\") " pod="openshift-dns/node-resolver-b6v64" Sep 09 08:39:01.890161 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:39:01.890026 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/806a2d46-69ad-493c-a1cc-5796636d6a06-host\") pod \"node-ca-pdgxz\" (UID: \"806a2d46-69ad-493c-a1cc-5796636d6a06\") " pod="openshift-image-registry/node-ca-pdgxz" Sep 09 08:39:01.890161 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:39:01.890019 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/950a27f9-3274-48f2-a23e-21f86398eb00-kubelet-config\") pod \"global-pull-secret-syncer-dvhwl\" (UID: \"950a27f9-3274-48f2-a23e-21f86398eb00\") " pod="kube-system/global-pull-secret-syncer-dvhwl" Sep 09 08:39:01.890161 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:39:01.890080 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/0bdb3c4d-ae9d-4a19-b79f-da2080ee1cf5-iptables-alerter-script\") pod \"iptables-alerter-kq8xr\" (UID: \"0bdb3c4d-ae9d-4a19-b79f-da2080ee1cf5\") " pod="openshift-network-operator/iptables-alerter-kq8xr" Sep 09 08:39:01.890161 ip-10-0-137-144 kubenswrapper[2564]: E0909 08:39:01.890088 2564 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 09 08:39:01.890161 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:39:01.890105 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/0bdb3c4d-ae9d-4a19-b79f-da2080ee1cf5-host-slash\") pod \"iptables-alerter-kq8xr\" (UID: \"0bdb3c4d-ae9d-4a19-b79f-da2080ee1cf5\") " pod="openshift-network-operator/iptables-alerter-kq8xr" Sep 09 08:39:01.890161 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:39:01.890131 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/50f8cfa3-6f41-47be-899d-cf16c3251f84-metrics-certs\") pod \"network-metrics-daemon-b2965\" (UID: \"50f8cfa3-6f41-47be-899d-cf16c3251f84\") " pod="openshift-multus/network-metrics-daemon-b2965" Sep 09 08:39:01.890563 ip-10-0-137-144 kubenswrapper[2564]: E0909 08:39:01.890176 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/950a27f9-3274-48f2-a23e-21f86398eb00-original-pull-secret podName:950a27f9-3274-48f2-a23e-21f86398eb00 nodeName:}" failed. No retries permitted until 2026-09-09 08:39:02.390139165 +0000 UTC m=+3.088023061 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/950a27f9-3274-48f2-a23e-21f86398eb00-original-pull-secret") pod "global-pull-secret-syncer-dvhwl" (UID: "950a27f9-3274-48f2-a23e-21f86398eb00") : object "kube-system"/"original-pull-secret" not registered Sep 09 08:39:01.890563 ip-10-0-137-144 kubenswrapper[2564]: E0909 08:39:01.890202 2564 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 09 08:39:01.890563 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:39:01.890207 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-26l5q\" (UniqueName: \"kubernetes.io/projected/50f8cfa3-6f41-47be-899d-cf16c3251f84-kube-api-access-26l5q\") pod \"network-metrics-daemon-b2965\" (UID: \"50f8cfa3-6f41-47be-899d-cf16c3251f84\") " pod="openshift-multus/network-metrics-daemon-b2965" Sep 09 08:39:01.890563 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:39:01.890207 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/0bdb3c4d-ae9d-4a19-b79f-da2080ee1cf5-host-slash\") pod \"iptables-alerter-kq8xr\" (UID: \"0bdb3c4d-ae9d-4a19-b79f-da2080ee1cf5\") " pod="openshift-network-operator/iptables-alerter-kq8xr" Sep 09 08:39:01.890563 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:39:01.890092 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/950a27f9-3274-48f2-a23e-21f86398eb00-kubelet-config\") pod \"global-pull-secret-syncer-dvhwl\" (UID: \"950a27f9-3274-48f2-a23e-21f86398eb00\") " pod="kube-system/global-pull-secret-syncer-dvhwl" Sep 09 08:39:01.890563 ip-10-0-137-144 kubenswrapper[2564]: E0909 08:39:01.890248 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/50f8cfa3-6f41-47be-899d-cf16c3251f84-metrics-certs podName:50f8cfa3-6f41-47be-899d-cf16c3251f84 nodeName:}" failed. No retries permitted until 2026-09-09 08:39:02.390231815 +0000 UTC m=+3.088115711 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/50f8cfa3-6f41-47be-899d-cf16c3251f84-metrics-certs") pod "network-metrics-daemon-b2965" (UID: "50f8cfa3-6f41-47be-899d-cf16c3251f84") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 09 08:39:01.890563 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:39:01.890270 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/c50a1df3-102a-4460-b42a-0be6714665ea-agent-certs\") pod \"konnectivity-agent-p7hs5\" (UID: \"c50a1df3-102a-4460-b42a-0be6714665ea\") " pod="kube-system/konnectivity-agent-p7hs5" Sep 09 08:39:01.890563 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:39:01.890295 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/c50a1df3-102a-4460-b42a-0be6714665ea-konnectivity-ca\") pod \"konnectivity-agent-p7hs5\" (UID: \"c50a1df3-102a-4460-b42a-0be6714665ea\") " pod="kube-system/konnectivity-agent-p7hs5" Sep 09 08:39:01.890563 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:39:01.890319 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5cfc7f17-0984-4eb8-bf5f-a4c593b2d411-tmp-dir\") pod \"node-resolver-b6v64\" (UID: \"5cfc7f17-0984-4eb8-bf5f-a4c593b2d411\") " pod="openshift-dns/node-resolver-b6v64" Sep 09 08:39:01.890563 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:39:01.890325 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qvmn4\" (UniqueName: \"kubernetes.io/projected/96601efb-dd16-407b-9899-22f67a88b7f0-kube-api-access-qvmn4\") pod \"network-check-target-2zg7w\" (UID: \"96601efb-dd16-407b-9899-22f67a88b7f0\") " pod="openshift-network-diagnostics/network-check-target-2zg7w" Sep 09 08:39:01.890563 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:39:01.890397 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/806a2d46-69ad-493c-a1cc-5796636d6a06-serviceca\") pod \"node-ca-pdgxz\" (UID: \"806a2d46-69ad-493c-a1cc-5796636d6a06\") " pod="openshift-image-registry/node-ca-pdgxz" Sep 09 08:39:01.890563 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:39:01.890424 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/950a27f9-3274-48f2-a23e-21f86398eb00-dbus\") pod \"global-pull-secret-syncer-dvhwl\" (UID: \"950a27f9-3274-48f2-a23e-21f86398eb00\") " pod="kube-system/global-pull-secret-syncer-dvhwl" Sep 09 08:39:01.890563 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:39:01.890486 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/950a27f9-3274-48f2-a23e-21f86398eb00-dbus\") pod \"global-pull-secret-syncer-dvhwl\" (UID: \"950a27f9-3274-48f2-a23e-21f86398eb00\") " pod="kube-system/global-pull-secret-syncer-dvhwl" Sep 09 08:39:01.891150 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:39:01.890621 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/5cfc7f17-0984-4eb8-bf5f-a4c593b2d411-hosts-file\") pod \"node-resolver-b6v64\" (UID: \"5cfc7f17-0984-4eb8-bf5f-a4c593b2d411\") " pod="openshift-dns/node-resolver-b6v64" Sep 09 08:39:01.891150 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:39:01.890633 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/0bdb3c4d-ae9d-4a19-b79f-da2080ee1cf5-iptables-alerter-script\") pod \"iptables-alerter-kq8xr\" (UID: \"0bdb3c4d-ae9d-4a19-b79f-da2080ee1cf5\") " pod="openshift-network-operator/iptables-alerter-kq8xr" Sep 09 08:39:01.891150 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:39:01.890663 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5b6cf\" (UniqueName: \"kubernetes.io/projected/0bdb3c4d-ae9d-4a19-b79f-da2080ee1cf5-kube-api-access-5b6cf\") pod \"iptables-alerter-kq8xr\" (UID: \"0bdb3c4d-ae9d-4a19-b79f-da2080ee1cf5\") " pod="openshift-network-operator/iptables-alerter-kq8xr" Sep 09 08:39:01.891150 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:39:01.890703 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-59rv8\" (UniqueName: \"kubernetes.io/projected/806a2d46-69ad-493c-a1cc-5796636d6a06-kube-api-access-59rv8\") pod \"node-ca-pdgxz\" (UID: \"806a2d46-69ad-493c-a1cc-5796636d6a06\") " pod="openshift-image-registry/node-ca-pdgxz" Sep 09 08:39:01.891150 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:39:01.890712 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/5cfc7f17-0984-4eb8-bf5f-a4c593b2d411-hosts-file\") pod \"node-resolver-b6v64\" (UID: \"5cfc7f17-0984-4eb8-bf5f-a4c593b2d411\") " pod="openshift-dns/node-resolver-b6v64" Sep 09 08:39:01.891150 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:39:01.891036 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/c50a1df3-102a-4460-b42a-0be6714665ea-konnectivity-ca\") pod \"konnectivity-agent-p7hs5\" (UID: \"c50a1df3-102a-4460-b42a-0be6714665ea\") " pod="kube-system/konnectivity-agent-p7hs5" Sep 09 08:39:01.891150 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:39:01.891058 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/806a2d46-69ad-493c-a1cc-5796636d6a06-serviceca\") pod \"node-ca-pdgxz\" (UID: \"806a2d46-69ad-493c-a1cc-5796636d6a06\") " pod="openshift-image-registry/node-ca-pdgxz" Sep 09 08:39:01.893208 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:39:01.893186 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/c50a1df3-102a-4460-b42a-0be6714665ea-agent-certs\") pod \"konnectivity-agent-p7hs5\" (UID: \"c50a1df3-102a-4460-b42a-0be6714665ea\") " pod="kube-system/konnectivity-agent-p7hs5" Sep 09 08:39:01.897405 ip-10-0-137-144 kubenswrapper[2564]: E0909 08:39:01.897384 2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 09 08:39:01.897486 ip-10-0-137-144 kubenswrapper[2564]: E0909 08:39:01.897413 2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 09 08:39:01.897486 ip-10-0-137-144 kubenswrapper[2564]: E0909 08:39:01.897428 2564 projected.go:196] Error preparing data for projected volume kube-api-access-qvmn4 for pod openshift-network-diagnostics/network-check-target-2zg7w: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 09 08:39:01.897577 ip-10-0-137-144 kubenswrapper[2564]: E0909 08:39:01.897497 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/96601efb-dd16-407b-9899-22f67a88b7f0-kube-api-access-qvmn4 podName:96601efb-dd16-407b-9899-22f67a88b7f0 nodeName:}" failed. No retries permitted until 2026-09-09 08:39:02.397469879 +0000 UTC m=+3.095353764 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-qvmn4" (UniqueName: "kubernetes.io/projected/96601efb-dd16-407b-9899-22f67a88b7f0-kube-api-access-qvmn4") pod "network-check-target-2zg7w" (UID: "96601efb-dd16-407b-9899-22f67a88b7f0") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 09 08:39:01.900223 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:39:01.900195 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-26l5q\" (UniqueName: \"kubernetes.io/projected/50f8cfa3-6f41-47be-899d-cf16c3251f84-kube-api-access-26l5q\") pod \"network-metrics-daemon-b2965\" (UID: \"50f8cfa3-6f41-47be-899d-cf16c3251f84\") " pod="openshift-multus/network-metrics-daemon-b2965" Sep 09 08:39:01.900223 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:39:01.900222 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5b6cf\" (UniqueName: \"kubernetes.io/projected/0bdb3c4d-ae9d-4a19-b79f-da2080ee1cf5-kube-api-access-5b6cf\") pod \"iptables-alerter-kq8xr\" (UID: \"0bdb3c4d-ae9d-4a19-b79f-da2080ee1cf5\") " pod="openshift-network-operator/iptables-alerter-kq8xr" Sep 09 08:39:01.900552 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:39:01.900524 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4jbtg\" (UniqueName: \"kubernetes.io/projected/5cfc7f17-0984-4eb8-bf5f-a4c593b2d411-kube-api-access-4jbtg\") pod \"node-resolver-b6v64\" (UID: \"5cfc7f17-0984-4eb8-bf5f-a4c593b2d411\") " pod="openshift-dns/node-resolver-b6v64" Sep 09 08:39:01.900618 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:39:01.900570 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-59rv8\" (UniqueName: \"kubernetes.io/projected/806a2d46-69ad-493c-a1cc-5796636d6a06-kube-api-access-59rv8\") pod \"node-ca-pdgxz\" (UID: \"806a2d46-69ad-493c-a1cc-5796636d6a06\") " pod="openshift-image-registry/node-ca-pdgxz" Sep 09 08:39:01.975794 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:39:01.975714 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-tm68w" Sep 09 08:39:01.985606 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:39:01.985439 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dh9g8" Sep 09 08:39:01.993368 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:39:01.993346 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-wdpws" Sep 09 08:39:01.998114 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:39:01.998093 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-tszfd" Sep 09 08:39:02.004931 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:39:02.004902 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-4h8qf" Sep 09 08:39:02.012725 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:39:02.012565 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-kq8xr" Sep 09 08:39:02.020375 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:39:02.020348 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-b6v64" Sep 09 08:39:02.026396 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:39:02.026375 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-pdgxz" Sep 09 08:39:02.033007 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:39:02.032986 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-p7hs5" Sep 09 08:39:02.071284 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:39:02.071254 2564 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Sep 09 08:39:02.221329 ip-10-0-137-144 kubenswrapper[2564]: W0909 08:39:02.221304 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod806a2d46_69ad_493c_a1cc_5796636d6a06.slice/crio-d3fd9adfcdb6a3c8d24a57e69e1628baf52135f87b08b67d2fef97d520452201 WatchSource:0}: Error finding container d3fd9adfcdb6a3c8d24a57e69e1628baf52135f87b08b67d2fef97d520452201: Status 404 returned error can't find the container with id d3fd9adfcdb6a3c8d24a57e69e1628baf52135f87b08b67d2fef97d520452201 Sep 09 08:39:02.222442 ip-10-0-137-144 kubenswrapper[2564]: W0909 08:39:02.222409 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod247ba8ee_92a3_4333_b1e1_e98c71402928.slice/crio-d1d6ff47dc35d12a14a31547a178aeebcc08143aeb4ea6875a0696ba37625ec2 WatchSource:0}: Error finding container d1d6ff47dc35d12a14a31547a178aeebcc08143aeb4ea6875a0696ba37625ec2: Status 404 returned error can't find the container with id d1d6ff47dc35d12a14a31547a178aeebcc08143aeb4ea6875a0696ba37625ec2 Sep 09 08:39:02.224698 ip-10-0-137-144 kubenswrapper[2564]: W0909 08:39:02.224499 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3526e800_9ea7_4be9_8320_dc4e8f536116.slice/crio-c73e34ec788228014b90d7b4320f445d5c977801ef2135c2b975eb1e1d2185c6 WatchSource:0}: Error finding container c73e34ec788228014b90d7b4320f445d5c977801ef2135c2b975eb1e1d2185c6: Status 404 returned error can't find the container with id c73e34ec788228014b90d7b4320f445d5c977801ef2135c2b975eb1e1d2185c6 Sep 09 08:39:02.227020 ip-10-0-137-144 kubenswrapper[2564]: W0909 08:39:02.226966 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod857d0c30_88d7_429b_8487_bca1106267e2.slice/crio-6b24eb221b8baa19579ea6eb904593d71e97c61f97c57195adb86efab4cfb4b6 WatchSource:0}: Error finding container 6b24eb221b8baa19579ea6eb904593d71e97c61f97c57195adb86efab4cfb4b6: Status 404 returned error can't find the container with id 6b24eb221b8baa19579ea6eb904593d71e97c61f97c57195adb86efab4cfb4b6 Sep 09 08:39:02.232835 ip-10-0-137-144 kubenswrapper[2564]: W0909 08:39:02.232812 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0bdb3c4d_ae9d_4a19_b79f_da2080ee1cf5.slice/crio-336a5386a2bff28fe45dbad7fe85d3fc3cca966dc07c4816d465116cf6cb9075 WatchSource:0}: Error finding container 336a5386a2bff28fe45dbad7fe85d3fc3cca966dc07c4816d465116cf6cb9075: Status 404 returned error can't find the container with id 336a5386a2bff28fe45dbad7fe85d3fc3cca966dc07c4816d465116cf6cb9075 Sep 09 08:39:02.233570 ip-10-0-137-144 kubenswrapper[2564]: W0909 08:39:02.233544 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6c33c8b3_58fb_4539_92c2_da514e6d52ef.slice/crio-57e13b9da4cf21ba820ee5111535f0973f321d1cf139bcd589a6d6cd7c9ac7ef WatchSource:0}: Error finding container 57e13b9da4cf21ba820ee5111535f0973f321d1cf139bcd589a6d6cd7c9ac7ef: Status 404 returned error can't find the container with id 57e13b9da4cf21ba820ee5111535f0973f321d1cf139bcd589a6d6cd7c9ac7ef Sep 09 08:39:02.393915 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:39:02.393888 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/950a27f9-3274-48f2-a23e-21f86398eb00-original-pull-secret\") pod \"global-pull-secret-syncer-dvhwl\" (UID: \"950a27f9-3274-48f2-a23e-21f86398eb00\") " pod="kube-system/global-pull-secret-syncer-dvhwl" Sep 09 08:39:02.394074 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:39:02.393927 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/50f8cfa3-6f41-47be-899d-cf16c3251f84-metrics-certs\") pod \"network-metrics-daemon-b2965\" (UID: \"50f8cfa3-6f41-47be-899d-cf16c3251f84\") " pod="openshift-multus/network-metrics-daemon-b2965" Sep 09 08:39:02.394074 ip-10-0-137-144 kubenswrapper[2564]: E0909 08:39:02.394014 2564 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 09 08:39:02.394074 ip-10-0-137-144 kubenswrapper[2564]: E0909 08:39:02.394066 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/50f8cfa3-6f41-47be-899d-cf16c3251f84-metrics-certs podName:50f8cfa3-6f41-47be-899d-cf16c3251f84 nodeName:}" failed. No retries permitted until 2026-09-09 08:39:03.394050617 +0000 UTC m=+4.091934498 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/50f8cfa3-6f41-47be-899d-cf16c3251f84-metrics-certs") pod "network-metrics-daemon-b2965" (UID: "50f8cfa3-6f41-47be-899d-cf16c3251f84") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 09 08:39:02.394185 ip-10-0-137-144 kubenswrapper[2564]: E0909 08:39:02.394015 2564 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 09 08:39:02.394185 ip-10-0-137-144 kubenswrapper[2564]: E0909 08:39:02.394133 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/950a27f9-3274-48f2-a23e-21f86398eb00-original-pull-secret podName:950a27f9-3274-48f2-a23e-21f86398eb00 nodeName:}" failed. No retries permitted until 2026-09-09 08:39:03.394120564 +0000 UTC m=+4.092004443 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/950a27f9-3274-48f2-a23e-21f86398eb00-original-pull-secret") pod "global-pull-secret-syncer-dvhwl" (UID: "950a27f9-3274-48f2-a23e-21f86398eb00") : object "kube-system"/"original-pull-secret" not registered Sep 09 08:39:02.494801 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:39:02.494741 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qvmn4\" (UniqueName: \"kubernetes.io/projected/96601efb-dd16-407b-9899-22f67a88b7f0-kube-api-access-qvmn4\") pod \"network-check-target-2zg7w\" (UID: \"96601efb-dd16-407b-9899-22f67a88b7f0\") " pod="openshift-network-diagnostics/network-check-target-2zg7w" Sep 09 08:39:02.494919 ip-10-0-137-144 kubenswrapper[2564]: E0909 08:39:02.494884 2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 09 08:39:02.494919 ip-10-0-137-144 kubenswrapper[2564]: E0909 08:39:02.494908 2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 09 08:39:02.495013 ip-10-0-137-144 kubenswrapper[2564]: E0909 08:39:02.494921 2564 projected.go:196] Error preparing data for projected volume kube-api-access-qvmn4 for pod openshift-network-diagnostics/network-check-target-2zg7w: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 09 08:39:02.495013 ip-10-0-137-144 kubenswrapper[2564]: E0909 08:39:02.494984 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/96601efb-dd16-407b-9899-22f67a88b7f0-kube-api-access-qvmn4 podName:96601efb-dd16-407b-9899-22f67a88b7f0 nodeName:}" failed. No retries permitted until 2026-09-09 08:39:03.494964239 +0000 UTC m=+4.192848135 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-qvmn4" (UniqueName: "kubernetes.io/projected/96601efb-dd16-407b-9899-22f67a88b7f0-kube-api-access-qvmn4") pod "network-check-target-2zg7w" (UID: "96601efb-dd16-407b-9899-22f67a88b7f0") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 09 08:39:02.716805 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:39:02.716739 2564 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-08 08:34:01 +0000 UTC" deadline="2028-04-18 18:20:18.916809169 +0000 UTC" Sep 09 08:39:02.716805 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:39:02.716798 2564 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14097h41m16.200013496s" Sep 09 08:39:02.811358 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:39:02.811273 2564 generic.go:356] "Generic (PLEG): container finished" podID="e62b73efee802c3e810d30a3512fea6c" containerID="c10fe9fccd38d50c29c535e7a92616925708ba6610e3f8f782091e899e4e494f" exitCode=0 Sep 09 08:39:02.811490 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:39:02.811366 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-144.ec2.internal" event={"ID":"e62b73efee802c3e810d30a3512fea6c","Type":"ContainerDied","Data":"c10fe9fccd38d50c29c535e7a92616925708ba6610e3f8f782091e899e4e494f"} Sep 09 08:39:02.812849 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:39:02.812826 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-kq8xr" event={"ID":"0bdb3c4d-ae9d-4a19-b79f-da2080ee1cf5","Type":"ContainerStarted","Data":"336a5386a2bff28fe45dbad7fe85d3fc3cca966dc07c4816d465116cf6cb9075"} Sep 09 08:39:02.813974 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:39:02.813950 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-4h8qf" event={"ID":"17eb483a-cd23-4d7e-b8fe-ad1b77d1537a","Type":"ContainerStarted","Data":"cb41be5a69abc82c6b566c2dac92420555dd51013b9f239c9130af27dd435d03"} Sep 09 08:39:02.815229 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:39:02.815194 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-p7hs5" event={"ID":"c50a1df3-102a-4460-b42a-0be6714665ea","Type":"ContainerStarted","Data":"55a97163e9f91d1677c55283863e70e011659c1108614f37c6586005d2a0f763"} Sep 09 08:39:02.816382 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:39:02.816362 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dh9g8" event={"ID":"857d0c30-88d7-429b-8487-bca1106267e2","Type":"ContainerStarted","Data":"6b24eb221b8baa19579ea6eb904593d71e97c61f97c57195adb86efab4cfb4b6"} Sep 09 08:39:02.817466 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:39:02.817443 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-wdpws" event={"ID":"3526e800-9ea7-4be9-8320-dc4e8f536116","Type":"ContainerStarted","Data":"c73e34ec788228014b90d7b4320f445d5c977801ef2135c2b975eb1e1d2185c6"} Sep 09 08:39:02.818536 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:39:02.818516 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-pdgxz" event={"ID":"806a2d46-69ad-493c-a1cc-5796636d6a06","Type":"ContainerStarted","Data":"d3fd9adfcdb6a3c8d24a57e69e1628baf52135f87b08b67d2fef97d520452201"} Sep 09 08:39:02.819752 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:39:02.819728 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-tszfd" event={"ID":"6c33c8b3-58fb-4539-92c2-da514e6d52ef","Type":"ContainerStarted","Data":"57e13b9da4cf21ba820ee5111535f0973f321d1cf139bcd589a6d6cd7c9ac7ef"} Sep 09 08:39:02.820863 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:39:02.820845 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-b6v64" event={"ID":"5cfc7f17-0984-4eb8-bf5f-a4c593b2d411","Type":"ContainerStarted","Data":"0a625d008e64916ef46e3401bfb63527314458a9bd3e66e1445a5b88d88390da"} Sep 09 08:39:02.821964 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:39:02.821946 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-tm68w" event={"ID":"247ba8ee-92a3-4333-b1e1-e98c71402928","Type":"ContainerStarted","Data":"d1d6ff47dc35d12a14a31547a178aeebcc08143aeb4ea6875a0696ba37625ec2"} Sep 09 08:39:03.402298 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:39:03.402255 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/950a27f9-3274-48f2-a23e-21f86398eb00-original-pull-secret\") pod \"global-pull-secret-syncer-dvhwl\" (UID: \"950a27f9-3274-48f2-a23e-21f86398eb00\") " pod="kube-system/global-pull-secret-syncer-dvhwl" Sep 09 08:39:03.402500 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:39:03.402326 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/50f8cfa3-6f41-47be-899d-cf16c3251f84-metrics-certs\") pod \"network-metrics-daemon-b2965\" (UID: \"50f8cfa3-6f41-47be-899d-cf16c3251f84\") " pod="openshift-multus/network-metrics-daemon-b2965" Sep 09 08:39:03.402570 ip-10-0-137-144 kubenswrapper[2564]: E0909 08:39:03.402503 2564 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 09 08:39:03.402570 ip-10-0-137-144 kubenswrapper[2564]: E0909 08:39:03.402568 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/50f8cfa3-6f41-47be-899d-cf16c3251f84-metrics-certs podName:50f8cfa3-6f41-47be-899d-cf16c3251f84 nodeName:}" failed. No retries permitted until 2026-09-09 08:39:05.402548522 +0000 UTC m=+6.100432406 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/50f8cfa3-6f41-47be-899d-cf16c3251f84-metrics-certs") pod "network-metrics-daemon-b2965" (UID: "50f8cfa3-6f41-47be-899d-cf16c3251f84") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 09 08:39:03.402978 ip-10-0-137-144 kubenswrapper[2564]: E0909 08:39:03.402957 2564 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 09 08:39:03.403069 ip-10-0-137-144 kubenswrapper[2564]: E0909 08:39:03.403012 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/950a27f9-3274-48f2-a23e-21f86398eb00-original-pull-secret podName:950a27f9-3274-48f2-a23e-21f86398eb00 nodeName:}" failed. No retries permitted until 2026-09-09 08:39:05.402997397 +0000 UTC m=+6.100881281 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/950a27f9-3274-48f2-a23e-21f86398eb00-original-pull-secret") pod "global-pull-secret-syncer-dvhwl" (UID: "950a27f9-3274-48f2-a23e-21f86398eb00") : object "kube-system"/"original-pull-secret" not registered Sep 09 08:39:03.504227 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:39:03.504187 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qvmn4\" (UniqueName: \"kubernetes.io/projected/96601efb-dd16-407b-9899-22f67a88b7f0-kube-api-access-qvmn4\") pod \"network-check-target-2zg7w\" (UID: \"96601efb-dd16-407b-9899-22f67a88b7f0\") " pod="openshift-network-diagnostics/network-check-target-2zg7w" Sep 09 08:39:03.504427 ip-10-0-137-144 kubenswrapper[2564]: E0909 08:39:03.504378 2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 09 08:39:03.504427 ip-10-0-137-144 kubenswrapper[2564]: E0909 08:39:03.504403 2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 09 08:39:03.504427 ip-10-0-137-144 kubenswrapper[2564]: E0909 08:39:03.504417 2564 projected.go:196] Error preparing data for projected volume kube-api-access-qvmn4 for pod openshift-network-diagnostics/network-check-target-2zg7w: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 09 08:39:03.504585 ip-10-0-137-144 kubenswrapper[2564]: E0909 08:39:03.504476 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/96601efb-dd16-407b-9899-22f67a88b7f0-kube-api-access-qvmn4 podName:96601efb-dd16-407b-9899-22f67a88b7f0 nodeName:}" failed. No retries permitted until 2026-09-09 08:39:05.50445682 +0000 UTC m=+6.202340698 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-qvmn4" (UniqueName: "kubernetes.io/projected/96601efb-dd16-407b-9899-22f67a88b7f0-kube-api-access-qvmn4") pod "network-check-target-2zg7w" (UID: "96601efb-dd16-407b-9899-22f67a88b7f0") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 09 08:39:03.717195 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:39:03.717143 2564 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-08 08:34:01 +0000 UTC" deadline="2028-03-23 20:19:53.093248307 +0000 UTC" Sep 09 08:39:03.717195 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:39:03.717175 2564 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13475h40m49.376078206s" Sep 09 08:39:03.804577 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:39:03.801442 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2zg7w" Sep 09 08:39:03.804577 ip-10-0-137-144 kubenswrapper[2564]: E0909 08:39:03.801607 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2zg7w" podUID="96601efb-dd16-407b-9899-22f67a88b7f0" Sep 09 08:39:03.804577 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:39:03.801971 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dvhwl" Sep 09 08:39:03.804577 ip-10-0-137-144 kubenswrapper[2564]: E0909 08:39:03.802060 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dvhwl" podUID="950a27f9-3274-48f2-a23e-21f86398eb00" Sep 09 08:39:03.804577 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:39:03.802125 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-b2965" Sep 09 08:39:03.804577 ip-10-0-137-144 kubenswrapper[2564]: E0909 08:39:03.802204 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-b2965" podUID="50f8cfa3-6f41-47be-899d-cf16c3251f84" Sep 09 08:39:03.846585 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:39:03.845615 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-144.ec2.internal" event={"ID":"efe7ba22b7eb392835b6437abb5fbd2b","Type":"ContainerStarted","Data":"82c286889d473521be5f67c473d9607572a950feb8e450f68ad9463937a39c7b"} Sep 09 08:39:03.863261 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:39:03.862063 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-144.ec2.internal" podStartSLOduration=2.862042091 podStartE2EDuration="2.862042091s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-09 08:39:01 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 08:39:03.861885134 +0000 UTC m=+4.559769038" watchObservedRunningTime="2026-09-09 08:39:03.862042091 +0000 UTC m=+4.559925993" Sep 09 08:39:04.865284 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:39:04.865191 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-144.ec2.internal" event={"ID":"e62b73efee802c3e810d30a3512fea6c","Type":"ContainerStarted","Data":"caa71d6a69c2a926c026a105665449b27af49ac8a6bdd94f71c594e3b5959ab3"} Sep 09 08:39:04.881796 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:39:04.881711 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-144.ec2.internal" podStartSLOduration=3.881690601 podStartE2EDuration="3.881690601s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-09 08:39:01 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 08:39:04.881285959 +0000 UTC m=+5.579169861" watchObservedRunningTime="2026-09-09 08:39:04.881690601 +0000 UTC m=+5.579574504" Sep 09 08:39:05.420954 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:39:05.420917 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/950a27f9-3274-48f2-a23e-21f86398eb00-original-pull-secret\") pod \"global-pull-secret-syncer-dvhwl\" (UID: \"950a27f9-3274-48f2-a23e-21f86398eb00\") " pod="kube-system/global-pull-secret-syncer-dvhwl" Sep 09 08:39:05.421124 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:39:05.420985 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/50f8cfa3-6f41-47be-899d-cf16c3251f84-metrics-certs\") pod \"network-metrics-daemon-b2965\" (UID: \"50f8cfa3-6f41-47be-899d-cf16c3251f84\") " pod="openshift-multus/network-metrics-daemon-b2965" Sep 09 08:39:05.421196 ip-10-0-137-144 kubenswrapper[2564]: E0909 08:39:05.421144 2564 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 09 08:39:05.421264 ip-10-0-137-144 kubenswrapper[2564]: E0909 08:39:05.421205 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/50f8cfa3-6f41-47be-899d-cf16c3251f84-metrics-certs podName:50f8cfa3-6f41-47be-899d-cf16c3251f84 nodeName:}" failed. No retries permitted until 2026-09-09 08:39:09.421186718 +0000 UTC m=+10.119070602 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/50f8cfa3-6f41-47be-899d-cf16c3251f84-metrics-certs") pod "network-metrics-daemon-b2965" (UID: "50f8cfa3-6f41-47be-899d-cf16c3251f84") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 09 08:39:05.421324 ip-10-0-137-144 kubenswrapper[2564]: E0909 08:39:05.421266 2564 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 09 08:39:05.421324 ip-10-0-137-144 kubenswrapper[2564]: E0909 08:39:05.421300 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/950a27f9-3274-48f2-a23e-21f86398eb00-original-pull-secret podName:950a27f9-3274-48f2-a23e-21f86398eb00 nodeName:}" failed. No retries permitted until 2026-09-09 08:39:09.421290042 +0000 UTC m=+10.119173926 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/950a27f9-3274-48f2-a23e-21f86398eb00-original-pull-secret") pod "global-pull-secret-syncer-dvhwl" (UID: "950a27f9-3274-48f2-a23e-21f86398eb00") : object "kube-system"/"original-pull-secret" not registered Sep 09 08:39:05.521570 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:39:05.521535 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qvmn4\" (UniqueName: \"kubernetes.io/projected/96601efb-dd16-407b-9899-22f67a88b7f0-kube-api-access-qvmn4\") pod \"network-check-target-2zg7w\" (UID: \"96601efb-dd16-407b-9899-22f67a88b7f0\") " pod="openshift-network-diagnostics/network-check-target-2zg7w" Sep 09 08:39:05.521740 ip-10-0-137-144 kubenswrapper[2564]: E0909 08:39:05.521725 2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 09 08:39:05.521800 ip-10-0-137-144 kubenswrapper[2564]: E0909 08:39:05.521746 2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 09 08:39:05.521800 ip-10-0-137-144 kubenswrapper[2564]: E0909 08:39:05.521760 2564 projected.go:196] Error preparing data for projected volume kube-api-access-qvmn4 for pod openshift-network-diagnostics/network-check-target-2zg7w: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 09 08:39:05.521963 ip-10-0-137-144 kubenswrapper[2564]: E0909 08:39:05.521815 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/96601efb-dd16-407b-9899-22f67a88b7f0-kube-api-access-qvmn4 podName:96601efb-dd16-407b-9899-22f67a88b7f0 nodeName:}" failed. No retries permitted until 2026-09-09 08:39:09.521798739 +0000 UTC m=+10.219682624 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-qvmn4" (UniqueName: "kubernetes.io/projected/96601efb-dd16-407b-9899-22f67a88b7f0-kube-api-access-qvmn4") pod "network-check-target-2zg7w" (UID: "96601efb-dd16-407b-9899-22f67a88b7f0") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 09 08:39:05.803152 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:39:05.802427 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dvhwl" Sep 09 08:39:05.803152 ip-10-0-137-144 kubenswrapper[2564]: E0909 08:39:05.802564 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dvhwl" podUID="950a27f9-3274-48f2-a23e-21f86398eb00" Sep 09 08:39:05.803152 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:39:05.802969 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-b2965" Sep 09 08:39:05.803152 ip-10-0-137-144 kubenswrapper[2564]: E0909 08:39:05.803059 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-b2965" podUID="50f8cfa3-6f41-47be-899d-cf16c3251f84" Sep 09 08:39:05.803656 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:39:05.803523 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2zg7w" Sep 09 08:39:05.803656 ip-10-0-137-144 kubenswrapper[2564]: E0909 08:39:05.803621 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2zg7w" podUID="96601efb-dd16-407b-9899-22f67a88b7f0" Sep 09 08:39:07.802449 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:39:07.802417 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dvhwl" Sep 09 08:39:07.802875 ip-10-0-137-144 kubenswrapper[2564]: E0909 08:39:07.802547 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dvhwl" podUID="950a27f9-3274-48f2-a23e-21f86398eb00" Sep 09 08:39:07.802875 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:39:07.802576 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-b2965" Sep 09 08:39:07.802875 ip-10-0-137-144 kubenswrapper[2564]: E0909 08:39:07.802674 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-b2965" podUID="50f8cfa3-6f41-47be-899d-cf16c3251f84" Sep 09 08:39:07.802875 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:39:07.802747 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2zg7w" Sep 09 08:39:07.802875 ip-10-0-137-144 kubenswrapper[2564]: E0909 08:39:07.802831 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2zg7w" podUID="96601efb-dd16-407b-9899-22f67a88b7f0" Sep 09 08:39:09.457463 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:39:09.456678 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/50f8cfa3-6f41-47be-899d-cf16c3251f84-metrics-certs\") pod \"network-metrics-daemon-b2965\" (UID: \"50f8cfa3-6f41-47be-899d-cf16c3251f84\") " pod="openshift-multus/network-metrics-daemon-b2965" Sep 09 08:39:09.457463 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:39:09.456790 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/950a27f9-3274-48f2-a23e-21f86398eb00-original-pull-secret\") pod \"global-pull-secret-syncer-dvhwl\" (UID: \"950a27f9-3274-48f2-a23e-21f86398eb00\") " pod="kube-system/global-pull-secret-syncer-dvhwl" Sep 09 08:39:09.457463 ip-10-0-137-144 kubenswrapper[2564]: E0909 08:39:09.456929 2564 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 09 08:39:09.457463 ip-10-0-137-144 kubenswrapper[2564]: E0909 08:39:09.456994 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/950a27f9-3274-48f2-a23e-21f86398eb00-original-pull-secret podName:950a27f9-3274-48f2-a23e-21f86398eb00 nodeName:}" failed. No retries permitted until 2026-09-09 08:39:17.456975222 +0000 UTC m=+18.154859121 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/950a27f9-3274-48f2-a23e-21f86398eb00-original-pull-secret") pod "global-pull-secret-syncer-dvhwl" (UID: "950a27f9-3274-48f2-a23e-21f86398eb00") : object "kube-system"/"original-pull-secret" not registered Sep 09 08:39:09.457463 ip-10-0-137-144 kubenswrapper[2564]: E0909 08:39:09.457377 2564 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 09 08:39:09.457463 ip-10-0-137-144 kubenswrapper[2564]: E0909 08:39:09.457430 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/50f8cfa3-6f41-47be-899d-cf16c3251f84-metrics-certs podName:50f8cfa3-6f41-47be-899d-cf16c3251f84 nodeName:}" failed. No retries permitted until 2026-09-09 08:39:17.457414221 +0000 UTC m=+18.155298131 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/50f8cfa3-6f41-47be-899d-cf16c3251f84-metrics-certs") pod "network-metrics-daemon-b2965" (UID: "50f8cfa3-6f41-47be-899d-cf16c3251f84") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 09 08:39:09.557406 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:39:09.557363 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qvmn4\" (UniqueName: \"kubernetes.io/projected/96601efb-dd16-407b-9899-22f67a88b7f0-kube-api-access-qvmn4\") pod \"network-check-target-2zg7w\" (UID: \"96601efb-dd16-407b-9899-22f67a88b7f0\") " pod="openshift-network-diagnostics/network-check-target-2zg7w" Sep 09 08:39:09.557621 ip-10-0-137-144 kubenswrapper[2564]: E0909 08:39:09.557550 2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 09 08:39:09.557621 ip-10-0-137-144 kubenswrapper[2564]: E0909 08:39:09.557582 2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 09 08:39:09.557621 ip-10-0-137-144 kubenswrapper[2564]: E0909 08:39:09.557603 2564 projected.go:196] Error preparing data for projected volume kube-api-access-qvmn4 for pod openshift-network-diagnostics/network-check-target-2zg7w: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 09 08:39:09.557800 ip-10-0-137-144 kubenswrapper[2564]: E0909 08:39:09.557664 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/96601efb-dd16-407b-9899-22f67a88b7f0-kube-api-access-qvmn4 podName:96601efb-dd16-407b-9899-22f67a88b7f0 nodeName:}" failed. No retries permitted until 2026-09-09 08:39:17.557645339 +0000 UTC m=+18.255529221 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-qvmn4" (UniqueName: "kubernetes.io/projected/96601efb-dd16-407b-9899-22f67a88b7f0-kube-api-access-qvmn4") pod "network-check-target-2zg7w" (UID: "96601efb-dd16-407b-9899-22f67a88b7f0") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 09 08:39:09.802391 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:39:09.802300 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-b2965" Sep 09 08:39:09.802581 ip-10-0-137-144 kubenswrapper[2564]: E0909 08:39:09.802450 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-b2965" podUID="50f8cfa3-6f41-47be-899d-cf16c3251f84" Sep 09 08:39:09.802642 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:39:09.802593 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2zg7w" Sep 09 08:39:09.802724 ip-10-0-137-144 kubenswrapper[2564]: E0909 08:39:09.802700 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2zg7w" podUID="96601efb-dd16-407b-9899-22f67a88b7f0" Sep 09 08:39:09.802796 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:39:09.802746 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dvhwl" Sep 09 08:39:09.802847 ip-10-0-137-144 kubenswrapper[2564]: E0909 08:39:09.802818 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dvhwl" podUID="950a27f9-3274-48f2-a23e-21f86398eb00" Sep 09 08:39:11.801506 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:39:11.801447 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-b2965" Sep 09 08:39:11.801938 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:39:11.801457 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dvhwl" Sep 09 08:39:11.801938 ip-10-0-137-144 kubenswrapper[2564]: E0909 08:39:11.801596 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-b2965" podUID="50f8cfa3-6f41-47be-899d-cf16c3251f84" Sep 09 08:39:11.801938 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:39:11.801457 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2zg7w" Sep 09 08:39:11.801938 ip-10-0-137-144 kubenswrapper[2564]: E0909 08:39:11.801678 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dvhwl" podUID="950a27f9-3274-48f2-a23e-21f86398eb00" Sep 09 08:39:11.801938 ip-10-0-137-144 kubenswrapper[2564]: E0909 08:39:11.801746 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2zg7w" podUID="96601efb-dd16-407b-9899-22f67a88b7f0" Sep 09 08:39:13.801543 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:39:13.801505 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-b2965" Sep 09 08:39:13.801543 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:39:13.801528 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2zg7w" Sep 09 08:39:13.802094 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:39:13.801505 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dvhwl" Sep 09 08:39:13.802094 ip-10-0-137-144 kubenswrapper[2564]: E0909 08:39:13.801646 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-b2965" podUID="50f8cfa3-6f41-47be-899d-cf16c3251f84" Sep 09 08:39:13.802094 ip-10-0-137-144 kubenswrapper[2564]: E0909 08:39:13.801727 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dvhwl" podUID="950a27f9-3274-48f2-a23e-21f86398eb00" Sep 09 08:39:13.802094 ip-10-0-137-144 kubenswrapper[2564]: E0909 08:39:13.801901 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2zg7w" podUID="96601efb-dd16-407b-9899-22f67a88b7f0" Sep 09 08:39:15.804306 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:39:15.804136 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2zg7w" Sep 09 08:39:15.805071 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:39:15.804186 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dvhwl" Sep 09 08:39:15.805071 ip-10-0-137-144 kubenswrapper[2564]: E0909 08:39:15.804415 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2zg7w" podUID="96601efb-dd16-407b-9899-22f67a88b7f0" Sep 09 08:39:15.805071 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:39:15.804207 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-b2965" Sep 09 08:39:15.805071 ip-10-0-137-144 kubenswrapper[2564]: E0909 08:39:15.804490 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dvhwl" podUID="950a27f9-3274-48f2-a23e-21f86398eb00" Sep 09 08:39:15.805071 ip-10-0-137-144 kubenswrapper[2564]: E0909 08:39:15.804578 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-b2965" podUID="50f8cfa3-6f41-47be-899d-cf16c3251f84" Sep 09 08:39:17.515750 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:39:17.515713 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/950a27f9-3274-48f2-a23e-21f86398eb00-original-pull-secret\") pod \"global-pull-secret-syncer-dvhwl\" (UID: \"950a27f9-3274-48f2-a23e-21f86398eb00\") " pod="kube-system/global-pull-secret-syncer-dvhwl" Sep 09 08:39:17.516211 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:39:17.515765 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/50f8cfa3-6f41-47be-899d-cf16c3251f84-metrics-certs\") pod \"network-metrics-daemon-b2965\" (UID: \"50f8cfa3-6f41-47be-899d-cf16c3251f84\") " pod="openshift-multus/network-metrics-daemon-b2965" Sep 09 08:39:17.516211 ip-10-0-137-144 kubenswrapper[2564]: E0909 08:39:17.515881 2564 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 09 08:39:17.516211 ip-10-0-137-144 kubenswrapper[2564]: E0909 08:39:17.515948 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/950a27f9-3274-48f2-a23e-21f86398eb00-original-pull-secret podName:950a27f9-3274-48f2-a23e-21f86398eb00 nodeName:}" failed. No retries permitted until 2026-09-09 08:39:33.515932032 +0000 UTC m=+34.213815910 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/950a27f9-3274-48f2-a23e-21f86398eb00-original-pull-secret") pod "global-pull-secret-syncer-dvhwl" (UID: "950a27f9-3274-48f2-a23e-21f86398eb00") : object "kube-system"/"original-pull-secret" not registered Sep 09 08:39:17.516211 ip-10-0-137-144 kubenswrapper[2564]: E0909 08:39:17.515885 2564 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 09 08:39:17.516211 ip-10-0-137-144 kubenswrapper[2564]: E0909 08:39:17.516045 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/50f8cfa3-6f41-47be-899d-cf16c3251f84-metrics-certs podName:50f8cfa3-6f41-47be-899d-cf16c3251f84 nodeName:}" failed. No retries permitted until 2026-09-09 08:39:33.516025832 +0000 UTC m=+34.213909729 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/50f8cfa3-6f41-47be-899d-cf16c3251f84-metrics-certs") pod "network-metrics-daemon-b2965" (UID: "50f8cfa3-6f41-47be-899d-cf16c3251f84") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 09 08:39:17.616213 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:39:17.616180 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qvmn4\" (UniqueName: \"kubernetes.io/projected/96601efb-dd16-407b-9899-22f67a88b7f0-kube-api-access-qvmn4\") pod \"network-check-target-2zg7w\" (UID: \"96601efb-dd16-407b-9899-22f67a88b7f0\") " pod="openshift-network-diagnostics/network-check-target-2zg7w" Sep 09 08:39:17.616383 ip-10-0-137-144 kubenswrapper[2564]: E0909 08:39:17.616319 2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 09 08:39:17.616383 ip-10-0-137-144 kubenswrapper[2564]: E0909 08:39:17.616356 2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 09 08:39:17.616383 ip-10-0-137-144 kubenswrapper[2564]: E0909 08:39:17.616367 2564 projected.go:196] Error preparing data for projected volume kube-api-access-qvmn4 for pod openshift-network-diagnostics/network-check-target-2zg7w: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 09 08:39:17.616547 ip-10-0-137-144 kubenswrapper[2564]: E0909 08:39:17.616435 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/96601efb-dd16-407b-9899-22f67a88b7f0-kube-api-access-qvmn4 podName:96601efb-dd16-407b-9899-22f67a88b7f0 nodeName:}" failed. No retries permitted until 2026-09-09 08:39:33.616403869 +0000 UTC m=+34.314287749 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-qvmn4" (UniqueName: "kubernetes.io/projected/96601efb-dd16-407b-9899-22f67a88b7f0-kube-api-access-qvmn4") pod "network-check-target-2zg7w" (UID: "96601efb-dd16-407b-9899-22f67a88b7f0") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 09 08:39:17.801980 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:39:17.801870 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2zg7w" Sep 09 08:39:17.801980 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:39:17.801870 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dvhwl" Sep 09 08:39:17.802165 ip-10-0-137-144 kubenswrapper[2564]: E0909 08:39:17.801994 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2zg7w" podUID="96601efb-dd16-407b-9899-22f67a88b7f0" Sep 09 08:39:17.802165 ip-10-0-137-144 kubenswrapper[2564]: E0909 08:39:17.802094 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dvhwl" podUID="950a27f9-3274-48f2-a23e-21f86398eb00" Sep 09 08:39:17.802165 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:39:17.801870 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-b2965" Sep 09 08:39:17.802295 ip-10-0-137-144 kubenswrapper[2564]: E0909 08:39:17.802200 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-b2965" podUID="50f8cfa3-6f41-47be-899d-cf16c3251f84" Sep 09 08:39:19.801906 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:39:19.801874 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dvhwl" Sep 09 08:39:19.802366 ip-10-0-137-144 kubenswrapper[2564]: E0909 08:39:19.801963 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dvhwl" podUID="950a27f9-3274-48f2-a23e-21f86398eb00" Sep 09 08:39:19.802366 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:39:19.801990 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-b2965" Sep 09 08:39:19.802366 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:39:19.802020 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2zg7w" Sep 09 08:39:19.802366 ip-10-0-137-144 kubenswrapper[2564]: E0909 08:39:19.802097 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-b2965" podUID="50f8cfa3-6f41-47be-899d-cf16c3251f84" Sep 09 08:39:19.802366 ip-10-0-137-144 kubenswrapper[2564]: E0909 08:39:19.802170 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2zg7w" podUID="96601efb-dd16-407b-9899-22f67a88b7f0" Sep 09 08:39:20.899582 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:39:20.899370 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-4h8qf" event={"ID":"17eb483a-cd23-4d7e-b8fe-ad1b77d1537a","Type":"ContainerStarted","Data":"2cba12a9c75964c56fbf8df38419c6d59f5187e4e5ca5ffc5d5c4e0c777f00f4"} Sep 09 08:39:20.900276 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:39:20.899680 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-4h8qf" event={"ID":"17eb483a-cd23-4d7e-b8fe-ad1b77d1537a","Type":"ContainerStarted","Data":"34c5006236fbe7e2318074bcfe551be95fff83fd480fc670a22e90d00c6f92ae"} Sep 09 08:39:20.900276 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:39:20.899728 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-4h8qf" event={"ID":"17eb483a-cd23-4d7e-b8fe-ad1b77d1537a","Type":"ContainerStarted","Data":"70dd069eb9e6d6703654e9a3524a84760f7f5064b2129bd43d649e404e87268b"} Sep 09 08:39:20.900276 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:39:20.899776 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-4h8qf" event={"ID":"17eb483a-cd23-4d7e-b8fe-ad1b77d1537a","Type":"ContainerStarted","Data":"c2afff841caa572ecb0bb3f0af5d9356c5ef8801929bc8bb5b496cc469d943f5"} Sep 09 08:39:20.900276 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:39:20.899822 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-4h8qf" event={"ID":"17eb483a-cd23-4d7e-b8fe-ad1b77d1537a","Type":"ContainerStarted","Data":"0831a788dc2f1747f2241b0c5029574ebc686bf2dac90096de4d0238e9b3a1f4"} Sep 09 08:39:20.900276 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:39:20.899869 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-4h8qf" event={"ID":"17eb483a-cd23-4d7e-b8fe-ad1b77d1537a","Type":"ContainerStarted","Data":"739ba498826930e9dff0bd2e9958c5289ec7689c55467d4bd1bb3d5366a1fe6b"} Sep 09 08:39:20.901069 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:39:20.901036 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-p7hs5" event={"ID":"c50a1df3-102a-4460-b42a-0be6714665ea","Type":"ContainerStarted","Data":"d19ffa87bda8cc9e36ea07fa0b551c447f0e84963b582484ee0dc2fc669346a7"} Sep 09 08:39:20.902720 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:39:20.902700 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dh9g8" event={"ID":"857d0c30-88d7-429b-8487-bca1106267e2","Type":"ContainerStarted","Data":"3ab79659550ae7f4cc2a07cbbe3d883af4989007d668493e423da755c70ac55e"} Sep 09 08:39:20.904364 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:39:20.904327 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-wdpws" event={"ID":"3526e800-9ea7-4be9-8320-dc4e8f536116","Type":"ContainerStarted","Data":"5265e57d8a644028473e3d215589226bf4a4e74983691822db679e7f43846392"} Sep 09 08:39:20.906165 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:39:20.906120 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-pdgxz" event={"ID":"806a2d46-69ad-493c-a1cc-5796636d6a06","Type":"ContainerStarted","Data":"66d040e710a5132f08dad86eb5ad2ccc2ebb30a6be9ae67ecf046aea123e2c0a"} Sep 09 08:39:20.908079 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:39:20.908059 2564 generic.go:356] "Generic (PLEG): container finished" podID="6c33c8b3-58fb-4539-92c2-da514e6d52ef" containerID="6c7d366174d1c5d72dcd35b775bc001f30e2a2a829a43893a6e5187d31e23d76" exitCode=0 Sep 09 08:39:20.908173 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:39:20.908134 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-tszfd" event={"ID":"6c33c8b3-58fb-4539-92c2-da514e6d52ef","Type":"ContainerDied","Data":"6c7d366174d1c5d72dcd35b775bc001f30e2a2a829a43893a6e5187d31e23d76"} Sep 09 08:39:20.910784 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:39:20.910762 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-b6v64" event={"ID":"5cfc7f17-0984-4eb8-bf5f-a4c593b2d411","Type":"ContainerStarted","Data":"58e219d7fdaaa52f337e06f8d3b501e83e120dd466d4502a91cafd3c074db3e3"} Sep 09 08:39:20.912688 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:39:20.912653 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-tm68w" event={"ID":"247ba8ee-92a3-4333-b1e1-e98c71402928","Type":"ContainerStarted","Data":"b8f0383812c1645ce830ce150eb23d4cc0266dc0d719639ec3e400bb7471fdfb"} Sep 09 08:39:20.914152 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:39:20.914113 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-p7hs5" podStartSLOduration=10.485581715 podStartE2EDuration="20.914100842s" totalImagesPullingTime="10.428519127s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 08:39:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 08:39:20.913874902 +0000 UTC m=+21.611758803" watchObservedRunningTime="2026-09-09 08:39:20.914100842 +0000 UTC m=+21.611984742" Sep 09 08:39:20.928604 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:39:20.928559 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-tm68w" podStartSLOduration=3.88485011 podStartE2EDuration="21.92854123s" totalImagesPullingTime="18.04369112s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-09 08:38:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 08:39:20.928379266 +0000 UTC m=+21.626263167" watchObservedRunningTime="2026-09-09 08:39:20.92854123 +0000 UTC m=+21.626425132" Sep 09 08:39:20.943059 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:39:20.943012 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-wdpws" podStartSLOduration=4.004530142 podStartE2EDuration="21.942992997s" totalImagesPullingTime="17.938462855s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-09 08:38:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 08:39:20.942467347 +0000 UTC m=+21.640351249" watchObservedRunningTime="2026-09-09 08:39:20.942992997 +0000 UTC m=+21.640876900" Sep 09 08:39:20.955564 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:39:20.955516 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-b6v64" podStartSLOduration=3.044823375 podStartE2EDuration="20.95550309s" totalImagesPullingTime="17.910679715s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-09 08:39:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 08:39:20.955262965 +0000 UTC m=+21.653146867" watchObservedRunningTime="2026-09-09 08:39:20.95550309 +0000 UTC m=+21.653386993" Sep 09 08:39:21.002884 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:39:21.002835 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-pdgxz" podStartSLOduration=3.077847116 podStartE2EDuration="21.002816264s" totalImagesPullingTime="17.924969148s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-09 08:39:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 08:39:21.002627701 +0000 UTC m=+21.700511601" watchObservedRunningTime="2026-09-09 08:39:21.002816264 +0000 UTC m=+21.700700166" Sep 09 08:39:21.359831 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:39:21.359809 2564 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Sep 09 08:39:21.734762 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:39:21.734477 2564 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-09-09T08:39:21.359827703Z","UUID":"7062475a-4434-4b2d-b5a3-300286f688f6","Handler":null,"Name":"","Endpoint":""} Sep 09 08:39:21.736018 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:39:21.735991 2564 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Sep 09 08:39:21.736139 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:39:21.736027 2564 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Sep 09 08:39:21.801977 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:39:21.801945 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-b2965" Sep 09 08:39:21.802146 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:39:21.801945 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dvhwl" Sep 09 08:39:21.802146 ip-10-0-137-144 kubenswrapper[2564]: E0909 08:39:21.802092 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-b2965" podUID="50f8cfa3-6f41-47be-899d-cf16c3251f84" Sep 09 08:39:21.802259 ip-10-0-137-144 kubenswrapper[2564]: E0909 08:39:21.802202 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dvhwl" podUID="950a27f9-3274-48f2-a23e-21f86398eb00" Sep 09 08:39:21.802259 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:39:21.801947 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2zg7w" Sep 09 08:39:21.802359 ip-10-0-137-144 kubenswrapper[2564]: E0909 08:39:21.802298 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2zg7w" podUID="96601efb-dd16-407b-9899-22f67a88b7f0" Sep 09 08:39:21.918182 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:39:21.918140 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dh9g8" event={"ID":"857d0c30-88d7-429b-8487-bca1106267e2","Type":"ContainerStarted","Data":"83e4fe5d513e9bae0a4b7319ab99472e635bb28bd5bd03f3b4dc6db2cfd6106f"} Sep 09 08:39:21.920006 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:39:21.919935 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-kq8xr" event={"ID":"0bdb3c4d-ae9d-4a19-b79f-da2080ee1cf5","Type":"ContainerStarted","Data":"7feed82af472b66f8545a0bbbfd3661254de83b4036503dcc53887c8331881fb"} Sep 09 08:39:21.933861 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:39:21.933813 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-kq8xr" podStartSLOduration=4.023651306 podStartE2EDuration="21.933796067s" totalImagesPullingTime="17.910144761s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-09 08:39:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 08:39:21.933613529 +0000 UTC m=+22.631497431" watchObservedRunningTime="2026-09-09 08:39:21.933796067 +0000 UTC m=+22.631679969" Sep 09 08:39:22.923724 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:39:22.923698 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dh9g8" event={"ID":"857d0c30-88d7-429b-8487-bca1106267e2","Type":"ContainerStarted","Data":"b28aec189180e2232298f8d34de8b38235778ada086c555502a0cbe845ae62f8"} Sep 09 08:39:22.939497 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:39:22.939441 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dh9g8" podStartSLOduration=4.257338054 podStartE2EDuration="23.939418934s" totalImagesPullingTime="19.68208088s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-09 08:38:59 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 08:39:22.938614497 +0000 UTC m=+23.636498399" watchObservedRunningTime="2026-09-09 08:39:22.939418934 +0000 UTC m=+23.637302855" Sep 09 08:39:23.801350 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:39:23.801307 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-b2965" Sep 09 08:39:23.801623 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:39:23.801367 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2zg7w" Sep 09 08:39:23.801623 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:39:23.801307 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dvhwl" Sep 09 08:39:23.801623 ip-10-0-137-144 kubenswrapper[2564]: E0909 08:39:23.801465 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-b2965" podUID="50f8cfa3-6f41-47be-899d-cf16c3251f84" Sep 09 08:39:23.801623 ip-10-0-137-144 kubenswrapper[2564]: E0909 08:39:23.801528 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2zg7w" podUID="96601efb-dd16-407b-9899-22f67a88b7f0" Sep 09 08:39:23.801623 ip-10-0-137-144 kubenswrapper[2564]: E0909 08:39:23.801595 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dvhwl" podUID="950a27f9-3274-48f2-a23e-21f86398eb00" Sep 09 08:39:23.930608 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:39:23.930574 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-4h8qf" event={"ID":"17eb483a-cd23-4d7e-b8fe-ad1b77d1537a","Type":"ContainerStarted","Data":"c5e722a41c52174bc16a70c7a8f3870f3d6a1285cf12c5359adbf3d2a126cbf5"} Sep 09 08:39:24.121542 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:39:24.121499 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-p7hs5" Sep 09 08:39:24.122082 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:39:24.122053 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-p7hs5" Sep 09 08:39:24.933542 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:39:24.933514 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-p7hs5" Sep 09 08:39:24.934151 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:39:24.934131 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-p7hs5" Sep 09 08:39:25.801108 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:39:25.801086 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2zg7w" Sep 09 08:39:25.801274 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:39:25.801086 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-b2965" Sep 09 08:39:25.801274 ip-10-0-137-144 kubenswrapper[2564]: E0909 08:39:25.801183 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2zg7w" podUID="96601efb-dd16-407b-9899-22f67a88b7f0" Sep 09 08:39:25.801274 ip-10-0-137-144 kubenswrapper[2564]: E0909 08:39:25.801241 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-b2965" podUID="50f8cfa3-6f41-47be-899d-cf16c3251f84" Sep 09 08:39:25.801398 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:39:25.801278 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dvhwl" Sep 09 08:39:25.801398 ip-10-0-137-144 kubenswrapper[2564]: E0909 08:39:25.801326 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dvhwl" podUID="950a27f9-3274-48f2-a23e-21f86398eb00" Sep 09 08:39:26.938558 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:39:26.938312 2564 generic.go:356] "Generic (PLEG): container finished" podID="6c33c8b3-58fb-4539-92c2-da514e6d52ef" containerID="da12168dc8de470cdf282d406ac06fa01b42390c7a0517047ca2a589262932b0" exitCode=0 Sep 09 08:39:26.939005 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:39:26.938367 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-tszfd" event={"ID":"6c33c8b3-58fb-4539-92c2-da514e6d52ef","Type":"ContainerDied","Data":"da12168dc8de470cdf282d406ac06fa01b42390c7a0517047ca2a589262932b0"} Sep 09 08:39:26.944844 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:39:26.944814 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-4h8qf" event={"ID":"17eb483a-cd23-4d7e-b8fe-ad1b77d1537a","Type":"ContainerStarted","Data":"27078403b08de97c8e9b6adc305e03171ed4dce45b9d0a5613f09f7aae00b5d9"} Sep 09 08:39:26.945160 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:39:26.945143 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-4h8qf" Sep 09 08:39:26.945242 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:39:26.945203 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-4h8qf" Sep 09 08:39:26.959606 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:39:26.959576 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-4h8qf" Sep 09 08:39:26.979871 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:39:26.979830 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-4h8qf" podStartSLOduration=10.052112273 podStartE2EDuration="27.979816566s" totalImagesPullingTime="17.927704293s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-09 08:38:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 08:39:26.97889581 +0000 UTC m=+27.676779710" watchObservedRunningTime="2026-09-09 08:39:26.979816566 +0000 UTC m=+27.677700472" Sep 09 08:39:27.805385 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:39:27.805356 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2zg7w" Sep 09 08:39:27.805527 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:39:27.805426 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-b2965" Sep 09 08:39:27.805527 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:39:27.805439 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dvhwl" Sep 09 08:39:27.805617 ip-10-0-137-144 kubenswrapper[2564]: E0909 08:39:27.805525 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2zg7w" podUID="96601efb-dd16-407b-9899-22f67a88b7f0" Sep 09 08:39:27.805617 ip-10-0-137-144 kubenswrapper[2564]: E0909 08:39:27.805604 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-b2965" podUID="50f8cfa3-6f41-47be-899d-cf16c3251f84" Sep 09 08:39:27.805685 ip-10-0-137-144 kubenswrapper[2564]: E0909 08:39:27.805649 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dvhwl" podUID="950a27f9-3274-48f2-a23e-21f86398eb00" Sep 09 08:39:27.843251 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:39:27.843222 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-dvhwl"] Sep 09 08:39:27.849445 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:39:27.849400 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-2zg7w"] Sep 09 08:39:27.850104 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:39:27.850080 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-b2965"] Sep 09 08:39:27.947240 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:39:27.947214 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2zg7w" Sep 09 08:39:27.947879 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:39:27.947214 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-b2965" Sep 09 08:39:27.947879 ip-10-0-137-144 kubenswrapper[2564]: E0909 08:39:27.947316 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2zg7w" podUID="96601efb-dd16-407b-9899-22f67a88b7f0" Sep 09 08:39:27.947879 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:39:27.947214 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dvhwl" Sep 09 08:39:27.947879 ip-10-0-137-144 kubenswrapper[2564]: E0909 08:39:27.947411 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-b2965" podUID="50f8cfa3-6f41-47be-899d-cf16c3251f84" Sep 09 08:39:27.947879 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:39:27.947748 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-4h8qf" Sep 09 08:39:27.947879 ip-10-0-137-144 kubenswrapper[2564]: E0909 08:39:27.947753 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dvhwl" podUID="950a27f9-3274-48f2-a23e-21f86398eb00" Sep 09 08:39:27.961904 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:39:27.961882 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-4h8qf" Sep 09 08:39:28.951381 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:39:28.951333 2564 generic.go:356] "Generic (PLEG): container finished" podID="6c33c8b3-58fb-4539-92c2-da514e6d52ef" containerID="e3bf04d323ecde0e701e6792e833cf8e288ced1e94b364234357c013c17d3187" exitCode=0 Sep 09 08:39:28.951899 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:39:28.951435 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-tszfd" event={"ID":"6c33c8b3-58fb-4539-92c2-da514e6d52ef","Type":"ContainerDied","Data":"e3bf04d323ecde0e701e6792e833cf8e288ced1e94b364234357c013c17d3187"} Sep 09 08:39:29.802172 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:39:29.801992 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dvhwl" Sep 09 08:39:29.802348 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:39:29.802078 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-b2965" Sep 09 08:39:29.802348 ip-10-0-137-144 kubenswrapper[2564]: E0909 08:39:29.802234 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dvhwl" podUID="950a27f9-3274-48f2-a23e-21f86398eb00" Sep 09 08:39:29.802348 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:39:29.802121 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2zg7w" Sep 09 08:39:29.802348 ip-10-0-137-144 kubenswrapper[2564]: E0909 08:39:29.802320 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-b2965" podUID="50f8cfa3-6f41-47be-899d-cf16c3251f84" Sep 09 08:39:29.802620 ip-10-0-137-144 kubenswrapper[2564]: E0909 08:39:29.802427 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2zg7w" podUID="96601efb-dd16-407b-9899-22f67a88b7f0" Sep 09 08:39:30.959126 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:39:30.958909 2564 generic.go:356] "Generic (PLEG): container finished" podID="6c33c8b3-58fb-4539-92c2-da514e6d52ef" containerID="4c7fba9886aae57fa5fc08d3eef9bff60d9dd8323d145b05fb39496a7de3f89d" exitCode=0 Sep 09 08:39:30.959126 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:39:30.958974 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-tszfd" event={"ID":"6c33c8b3-58fb-4539-92c2-da514e6d52ef","Type":"ContainerDied","Data":"4c7fba9886aae57fa5fc08d3eef9bff60d9dd8323d145b05fb39496a7de3f89d"} Sep 09 08:39:31.801991 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:39:31.801958 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-b2965" Sep 09 08:39:31.802176 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:39:31.801958 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dvhwl" Sep 09 08:39:31.802176 ip-10-0-137-144 kubenswrapper[2564]: E0909 08:39:31.802089 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-b2965" podUID="50f8cfa3-6f41-47be-899d-cf16c3251f84" Sep 09 08:39:31.802176 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:39:31.802103 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2zg7w" Sep 09 08:39:31.802365 ip-10-0-137-144 kubenswrapper[2564]: E0909 08:39:31.802200 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dvhwl" podUID="950a27f9-3274-48f2-a23e-21f86398eb00" Sep 09 08:39:31.802365 ip-10-0-137-144 kubenswrapper[2564]: E0909 08:39:31.802293 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2zg7w" podUID="96601efb-dd16-407b-9899-22f67a88b7f0" Sep 09 08:39:33.008218 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:39:33.008144 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-144.ec2.internal" event="NodeReady" Sep 09 08:39:33.008661 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:39:33.008285 2564 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Sep 09 08:39:33.040855 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:39:33.040822 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-85b454874b-tdfqx"] Sep 09 08:39:33.042982 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:39:33.042958 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-85b454874b-tdfqx" Sep 09 08:39:33.043886 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:39:33.043848 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-5d984d89dd-r8hr5"] Sep 09 08:39:33.045306 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:39:33.045119 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\"" Sep 09 08:39:33.045306 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:39:33.045250 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-dbxg5\"" Sep 09 08:39:33.045699 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:39:33.045680 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5d984d89dd-r8hr5" Sep 09 08:39:33.046111 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:39:33.046094 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\"" Sep 09 08:39:33.047130 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:39:33.047114 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\"" Sep 09 08:39:33.047763 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:39:33.047746 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\"" Sep 09 08:39:33.053057 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:39:33.053037 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Sep 09 08:39:33.053306 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:39:33.053271 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-722gc\"" Sep 09 08:39:33.055945 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:39:33.055923 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Sep 09 08:39:33.058684 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:39:33.058661 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Sep 09 08:39:33.062045 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:39:33.061784 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-85b454874b-tdfqx"] Sep 09 08:39:33.067281 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:39:33.067261 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\"" Sep 09 08:39:33.070454 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:39:33.070436 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Sep 09 08:39:33.085367 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:39:33.085329 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-v2cwj"] Sep 09 08:39:33.087580 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:39:33.087535 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-685456655f-p45dk"] Sep 09 08:39:33.088373 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:39:33.087875 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-v2cwj" Sep 09 08:39:33.089715 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:39:33.089694 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-859f94c4b-njzs5"] Sep 09 08:39:33.089811 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:39:33.089775 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-685456655f-p45dk" Sep 09 08:39:33.090432 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:39:33.090406 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Sep 09 08:39:33.090523 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:39:33.090459 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-zfltp\"" Sep 09 08:39:33.091122 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:39:33.091104 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Sep 09 08:39:33.092125 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:39:33.092103 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-6blnq"] Sep 09 08:39:33.092284 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:39:33.092266 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-njzs5" Sep 09 08:39:33.092499 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:39:33.092416 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Sep 09 08:39:33.093935 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:39:33.093917 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-5d984d89dd-r8hr5"] Sep 09 08:39:33.094028 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:39:33.093946 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-79977f9844-9nmsv"] Sep 09 08:39:33.094091 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:39:33.094031 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-6blnq" Sep 09 08:39:33.094148 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:39:33.094119 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Sep 09 08:39:33.095983 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:39:33.095906 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-w944n"] Sep 09 08:39:33.096051 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:39:33.096033 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-79977f9844-9nmsv" Sep 09 08:39:33.097780 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:39:33.097764 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-w944n" Sep 09 08:39:33.103845 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:39:33.103769 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\"" Sep 09 08:39:33.104226 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:39:33.104155 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-fb7vh\"" Sep 09 08:39:33.104226 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:39:33.104185 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Sep 09 08:39:33.104226 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:39:33.104205 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\"" Sep 09 08:39:33.104594 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:39:33.104250 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\"" Sep 09 08:39:33.104594 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:39:33.104587 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\"" Sep 09 08:39:33.104714 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:39:33.104592 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\"" Sep 09 08:39:33.104714 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:39:33.104607 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-fv8rb\"" Sep 09 08:39:33.104811 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:39:33.104722 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-j8mw2\"" Sep 09 08:39:33.104811 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:39:33.104760 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\"" Sep 09 08:39:33.104913 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:39:33.104847 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\"" Sep 09 08:39:33.105496 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:39:33.104978 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Sep 09 08:39:33.105496 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:39:33.105066 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\"" Sep 09 08:39:33.105496 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:39:33.105068 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-nqwrh\"" Sep 09 08:39:33.105496 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:39:33.105199 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\"" Sep 09 08:39:33.105496 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:39:33.105296 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-5k2vx\"" Sep 09 08:39:33.105496 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:39:33.105316 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\"" Sep 09 08:39:33.105908 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:39:33.105888 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-685456655f-p45dk"] Sep 09 08:39:33.108258 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:39:33.108228 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Sep 09 08:39:33.122452 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:39:33.122326 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-w944n"] Sep 09 08:39:33.123283 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:39:33.123252 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-v2cwj"] Sep 09 08:39:33.123763 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:39:33.123746 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-79977f9844-9nmsv"] Sep 09 08:39:33.124556 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:39:33.124537 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-859f94c4b-njzs5"] Sep 09 08:39:33.128689 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:39:33.128658 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/fbc63112-9a58-49c8-b9e2-830f9e027723-registry-certificates\") pod \"image-registry-5d984d89dd-r8hr5\" (UID: \"fbc63112-9a58-49c8-b9e2-830f9e027723\") " pod="openshift-image-registry/image-registry-5d984d89dd-r8hr5" Sep 09 08:39:33.128771 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:39:33.128702 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/fbc63112-9a58-49c8-b9e2-830f9e027723-bound-sa-token\") pod \"image-registry-5d984d89dd-r8hr5\" (UID: \"fbc63112-9a58-49c8-b9e2-830f9e027723\") " pod="openshift-image-registry/image-registry-5d984d89dd-r8hr5" Sep 09 08:39:33.128850 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:39:33.128827 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/fbc63112-9a58-49c8-b9e2-830f9e027723-installation-pull-secrets\") pod \"image-registry-5d984d89dd-r8hr5\" (UID: \"fbc63112-9a58-49c8-b9e2-830f9e027723\") " pod="openshift-image-registry/image-registry-5d984d89dd-r8hr5" Sep 09 08:39:33.128911 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:39:33.128896 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/f81169f8-3c85-4cd7-8b59-684973ff46f7-serving-cert\") pod \"console-operator-85b454874b-tdfqx\" (UID: \"f81169f8-3c85-4cd7-8b59-684973ff46f7\") " pod="openshift-console-operator/console-operator-85b454874b-tdfqx" Sep 09 08:39:33.128985 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:39:33.128969 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/f81169f8-3c85-4cd7-8b59-684973ff46f7-config\") pod \"console-operator-85b454874b-tdfqx\" (UID: \"f81169f8-3c85-4cd7-8b59-684973ff46f7\") " pod="openshift-console-operator/console-operator-85b454874b-tdfqx" Sep 09 08:39:33.129043 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:39:33.129021 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/fbc63112-9a58-49c8-b9e2-830f9e027723-registry-tls\") pod \"image-registry-5d984d89dd-r8hr5\" (UID: \"fbc63112-9a58-49c8-b9e2-830f9e027723\") " pod="openshift-image-registry/image-registry-5d984d89dd-r8hr5" Sep 09 08:39:33.129094 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:39:33.129054 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/fbc63112-9a58-49c8-b9e2-830f9e027723-ca-trust-extracted\") pod \"image-registry-5d984d89dd-r8hr5\" (UID: \"fbc63112-9a58-49c8-b9e2-830f9e027723\") " pod="openshift-image-registry/image-registry-5d984d89dd-r8hr5" Sep 09 08:39:33.129124 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:39:33.129087 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/fbc63112-9a58-49c8-b9e2-830f9e027723-image-registry-private-configuration\") pod \"image-registry-5d984d89dd-r8hr5\" (UID: \"fbc63112-9a58-49c8-b9e2-830f9e027723\") " pod="openshift-image-registry/image-registry-5d984d89dd-r8hr5" Sep 09 08:39:33.129156 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:39:33.129121 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/f81169f8-3c85-4cd7-8b59-684973ff46f7-trusted-ca\") pod \"console-operator-85b454874b-tdfqx\" (UID: \"f81169f8-3c85-4cd7-8b59-684973ff46f7\") " pod="openshift-console-operator/console-operator-85b454874b-tdfqx" Sep 09 08:39:33.129188 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:39:33.129151 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/fbc63112-9a58-49c8-b9e2-830f9e027723-trusted-ca\") pod \"image-registry-5d984d89dd-r8hr5\" (UID: \"fbc63112-9a58-49c8-b9e2-830f9e027723\") " pod="openshift-image-registry/image-registry-5d984d89dd-r8hr5" Sep 09 08:39:33.129227 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:39:33.129191 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9khqh\" (UniqueName: \"kubernetes.io/projected/fbc63112-9a58-49c8-b9e2-830f9e027723-kube-api-access-9khqh\") pod \"image-registry-5d984d89dd-r8hr5\" (UID: \"fbc63112-9a58-49c8-b9e2-830f9e027723\") " pod="openshift-image-registry/image-registry-5d984d89dd-r8hr5" Sep 09 08:39:33.129227 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:39:33.129219 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7hqhm\" (UniqueName: \"kubernetes.io/projected/f81169f8-3c85-4cd7-8b59-684973ff46f7-kube-api-access-7hqhm\") pod \"console-operator-85b454874b-tdfqx\" (UID: \"f81169f8-3c85-4cd7-8b59-684973ff46f7\") " pod="openshift-console-operator/console-operator-85b454874b-tdfqx" Sep 09 08:39:33.136377 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:39:33.136357 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-6blnq"] Sep 09 08:39:33.230247 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:39:33.230216 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/fbc63112-9a58-49c8-b9e2-830f9e027723-bound-sa-token\") pod \"image-registry-5d984d89dd-r8hr5\" (UID: \"fbc63112-9a58-49c8-b9e2-830f9e027723\") " pod="openshift-image-registry/image-registry-5d984d89dd-r8hr5" Sep 09 08:39:33.230450 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:39:33.230256 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7qgzl\" (UniqueName: \"kubernetes.io/projected/aaa6f86d-29c1-45fb-bec3-3bf3bfb3d0bc-kube-api-access-7qgzl\") pod \"service-ca-operator-859f94c4b-njzs5\" (UID: \"aaa6f86d-29c1-45fb-bec3-3bf3bfb3d0bc\") " pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-njzs5" Sep 09 08:39:33.230450 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:39:33.230284 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/adccc815-e6f4-4a83-a484-53522f06da20-serving-cert\") pod \"kube-storage-version-migrator-operator-8d7dd4675-6blnq\" (UID: \"adccc815-e6f4-4a83-a484-53522f06da20\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-6blnq" Sep 09 08:39:33.230450 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:39:33.230315 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/7b2288b4-72fd-45bc-a286-f1ff2580d3cc-networking-console-plugin-cert\") pod \"networking-console-plugin-79977f9844-9nmsv\" (UID: \"7b2288b4-72fd-45bc-a286-f1ff2580d3cc\") " pod="openshift-network-console/networking-console-plugin-79977f9844-9nmsv" Sep 09 08:39:33.230450 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:39:33.230352 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-42kx5\" (UniqueName: \"kubernetes.io/projected/77658115-dcd3-45b6-905e-2cfc02b948ed-kube-api-access-42kx5\") pod \"ingress-canary-w944n\" (UID: \"77658115-dcd3-45b6-905e-2cfc02b948ed\") " pod="openshift-ingress-canary/ingress-canary-w944n" Sep 09 08:39:33.230450 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:39:33.230412 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/fbc63112-9a58-49c8-b9e2-830f9e027723-installation-pull-secrets\") pod \"image-registry-5d984d89dd-r8hr5\" (UID: \"fbc63112-9a58-49c8-b9e2-830f9e027723\") " pod="openshift-image-registry/image-registry-5d984d89dd-r8hr5" Sep 09 08:39:33.230713 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:39:33.230493 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/aaa6f86d-29c1-45fb-bec3-3bf3bfb3d0bc-config\") pod \"service-ca-operator-859f94c4b-njzs5\" (UID: \"aaa6f86d-29c1-45fb-bec3-3bf3bfb3d0bc\") " pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-njzs5" Sep 09 08:39:33.230713 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:39:33.230535 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/f81169f8-3c85-4cd7-8b59-684973ff46f7-serving-cert\") pod \"console-operator-85b454874b-tdfqx\" (UID: \"f81169f8-3c85-4cd7-8b59-684973ff46f7\") " pod="openshift-console-operator/console-operator-85b454874b-tdfqx" Sep 09 08:39:33.230713 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:39:33.230571 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rqlq4\" (UniqueName: \"kubernetes.io/projected/2c0efc1d-4b09-4830-ab44-3a8e07964f13-kube-api-access-rqlq4\") pod \"network-check-source-685456655f-p45dk\" (UID: \"2c0efc1d-4b09-4830-ab44-3a8e07964f13\") " pod="openshift-network-diagnostics/network-check-source-685456655f-p45dk" Sep 09 08:39:33.230713 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:39:33.230630 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/f81169f8-3c85-4cd7-8b59-684973ff46f7-config\") pod \"console-operator-85b454874b-tdfqx\" (UID: \"f81169f8-3c85-4cd7-8b59-684973ff46f7\") " pod="openshift-console-operator/console-operator-85b454874b-tdfqx" Sep 09 08:39:33.230713 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:39:33.230653 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/025bcb2f-08a5-4ea4-98f9-8ca84afd9b33-config-volume\") pod \"dns-default-v2cwj\" (UID: \"025bcb2f-08a5-4ea4-98f9-8ca84afd9b33\") " pod="openshift-dns/dns-default-v2cwj" Sep 09 08:39:33.230713 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:39:33.230679 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/adccc815-e6f4-4a83-a484-53522f06da20-config\") pod \"kube-storage-version-migrator-operator-8d7dd4675-6blnq\" (UID: \"adccc815-e6f4-4a83-a484-53522f06da20\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-6blnq" Sep 09 08:39:33.230713 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:39:33.230707 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hhjzc\" (UniqueName: \"kubernetes.io/projected/adccc815-e6f4-4a83-a484-53522f06da20-kube-api-access-hhjzc\") pod \"kube-storage-version-migrator-operator-8d7dd4675-6blnq\" (UID: \"adccc815-e6f4-4a83-a484-53522f06da20\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-6blnq" Sep 09 08:39:33.231041 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:39:33.230739 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/fbc63112-9a58-49c8-b9e2-830f9e027723-registry-tls\") pod \"image-registry-5d984d89dd-r8hr5\" (UID: \"fbc63112-9a58-49c8-b9e2-830f9e027723\") " pod="openshift-image-registry/image-registry-5d984d89dd-r8hr5" Sep 09 08:39:33.231041 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:39:33.230765 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/fbc63112-9a58-49c8-b9e2-830f9e027723-ca-trust-extracted\") pod \"image-registry-5d984d89dd-r8hr5\" (UID: \"fbc63112-9a58-49c8-b9e2-830f9e027723\") " pod="openshift-image-registry/image-registry-5d984d89dd-r8hr5" Sep 09 08:39:33.231041 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:39:33.230789 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n9s97\" (UniqueName: \"kubernetes.io/projected/025bcb2f-08a5-4ea4-98f9-8ca84afd9b33-kube-api-access-n9s97\") pod \"dns-default-v2cwj\" (UID: \"025bcb2f-08a5-4ea4-98f9-8ca84afd9b33\") " pod="openshift-dns/dns-default-v2cwj" Sep 09 08:39:33.231041 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:39:33.230821 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/fbc63112-9a58-49c8-b9e2-830f9e027723-image-registry-private-configuration\") pod \"image-registry-5d984d89dd-r8hr5\" (UID: \"fbc63112-9a58-49c8-b9e2-830f9e027723\") " pod="openshift-image-registry/image-registry-5d984d89dd-r8hr5" Sep 09 08:39:33.231041 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:39:33.230844 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/aaa6f86d-29c1-45fb-bec3-3bf3bfb3d0bc-serving-cert\") pod \"service-ca-operator-859f94c4b-njzs5\" (UID: \"aaa6f86d-29c1-45fb-bec3-3bf3bfb3d0bc\") " pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-njzs5" Sep 09 08:39:33.231041 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:39:33.230874 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/f81169f8-3c85-4cd7-8b59-684973ff46f7-trusted-ca\") pod \"console-operator-85b454874b-tdfqx\" (UID: \"f81169f8-3c85-4cd7-8b59-684973ff46f7\") " pod="openshift-console-operator/console-operator-85b454874b-tdfqx" Sep 09 08:39:33.231041 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:39:33.230904 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/fbc63112-9a58-49c8-b9e2-830f9e027723-trusted-ca\") pod \"image-registry-5d984d89dd-r8hr5\" (UID: \"fbc63112-9a58-49c8-b9e2-830f9e027723\") " pod="openshift-image-registry/image-registry-5d984d89dd-r8hr5" Sep 09 08:39:33.231041 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:39:33.230930 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/77658115-dcd3-45b6-905e-2cfc02b948ed-cert\") pod \"ingress-canary-w944n\" (UID: \"77658115-dcd3-45b6-905e-2cfc02b948ed\") " pod="openshift-ingress-canary/ingress-canary-w944n" Sep 09 08:39:33.231840 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:39:33.231706 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/f81169f8-3c85-4cd7-8b59-684973ff46f7-config\") pod \"console-operator-85b454874b-tdfqx\" (UID: \"f81169f8-3c85-4cd7-8b59-684973ff46f7\") " pod="openshift-console-operator/console-operator-85b454874b-tdfqx" Sep 09 08:39:33.231840 ip-10-0-137-144 kubenswrapper[2564]: E0909 08:39:33.231808 2564 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Sep 09 08:39:33.231840 ip-10-0-137-144 kubenswrapper[2564]: E0909 08:39:33.231824 2564 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5d984d89dd-r8hr5: secret "image-registry-tls" not found Sep 09 08:39:33.232014 ip-10-0-137-144 kubenswrapper[2564]: E0909 08:39:33.231891 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/fbc63112-9a58-49c8-b9e2-830f9e027723-registry-tls podName:fbc63112-9a58-49c8-b9e2-830f9e027723 nodeName:}" failed. No retries permitted until 2026-09-09 08:39:33.731871875 +0000 UTC m=+34.429755772 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/fbc63112-9a58-49c8-b9e2-830f9e027723-registry-tls") pod "image-registry-5d984d89dd-r8hr5" (UID: "fbc63112-9a58-49c8-b9e2-830f9e027723") : secret "image-registry-tls" not found Sep 09 08:39:33.232084 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:39:33.232030 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/f81169f8-3c85-4cd7-8b59-684973ff46f7-trusted-ca\") pod \"console-operator-85b454874b-tdfqx\" (UID: \"f81169f8-3c85-4cd7-8b59-684973ff46f7\") " pod="openshift-console-operator/console-operator-85b454874b-tdfqx" Sep 09 08:39:33.232084 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:39:33.232071 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/fbc63112-9a58-49c8-b9e2-830f9e027723-trusted-ca\") pod \"image-registry-5d984d89dd-r8hr5\" (UID: \"fbc63112-9a58-49c8-b9e2-830f9e027723\") " pod="openshift-image-registry/image-registry-5d984d89dd-r8hr5" Sep 09 08:39:33.232176 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:39:33.232088 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9khqh\" (UniqueName: \"kubernetes.io/projected/fbc63112-9a58-49c8-b9e2-830f9e027723-kube-api-access-9khqh\") pod \"image-registry-5d984d89dd-r8hr5\" (UID: \"fbc63112-9a58-49c8-b9e2-830f9e027723\") " pod="openshift-image-registry/image-registry-5d984d89dd-r8hr5" Sep 09 08:39:33.232176 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:39:33.232157 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/025bcb2f-08a5-4ea4-98f9-8ca84afd9b33-metrics-tls\") pod \"dns-default-v2cwj\" (UID: \"025bcb2f-08a5-4ea4-98f9-8ca84afd9b33\") " pod="openshift-dns/dns-default-v2cwj" Sep 09 08:39:33.232368 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:39:33.232326 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/fbc63112-9a58-49c8-b9e2-830f9e027723-ca-trust-extracted\") pod \"image-registry-5d984d89dd-r8hr5\" (UID: \"fbc63112-9a58-49c8-b9e2-830f9e027723\") " pod="openshift-image-registry/image-registry-5d984d89dd-r8hr5" Sep 09 08:39:33.232446 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:39:33.232327 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7hqhm\" (UniqueName: \"kubernetes.io/projected/f81169f8-3c85-4cd7-8b59-684973ff46f7-kube-api-access-7hqhm\") pod \"console-operator-85b454874b-tdfqx\" (UID: \"f81169f8-3c85-4cd7-8b59-684973ff46f7\") " pod="openshift-console-operator/console-operator-85b454874b-tdfqx" Sep 09 08:39:33.232446 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:39:33.232396 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/7b2288b4-72fd-45bc-a286-f1ff2580d3cc-nginx-conf\") pod \"networking-console-plugin-79977f9844-9nmsv\" (UID: \"7b2288b4-72fd-45bc-a286-f1ff2580d3cc\") " pod="openshift-network-console/networking-console-plugin-79977f9844-9nmsv" Sep 09 08:39:33.232446 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:39:33.232419 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/025bcb2f-08a5-4ea4-98f9-8ca84afd9b33-tmp-dir\") pod \"dns-default-v2cwj\" (UID: \"025bcb2f-08a5-4ea4-98f9-8ca84afd9b33\") " pod="openshift-dns/dns-default-v2cwj" Sep 09 08:39:33.232602 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:39:33.232458 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/fbc63112-9a58-49c8-b9e2-830f9e027723-registry-certificates\") pod \"image-registry-5d984d89dd-r8hr5\" (UID: \"fbc63112-9a58-49c8-b9e2-830f9e027723\") " pod="openshift-image-registry/image-registry-5d984d89dd-r8hr5" Sep 09 08:39:33.232957 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:39:33.232931 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/fbc63112-9a58-49c8-b9e2-830f9e027723-registry-certificates\") pod \"image-registry-5d984d89dd-r8hr5\" (UID: \"fbc63112-9a58-49c8-b9e2-830f9e027723\") " pod="openshift-image-registry/image-registry-5d984d89dd-r8hr5" Sep 09 08:39:33.234864 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:39:33.234841 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/f81169f8-3c85-4cd7-8b59-684973ff46f7-serving-cert\") pod \"console-operator-85b454874b-tdfqx\" (UID: \"f81169f8-3c85-4cd7-8b59-684973ff46f7\") " pod="openshift-console-operator/console-operator-85b454874b-tdfqx" Sep 09 08:39:33.234956 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:39:33.234889 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/fbc63112-9a58-49c8-b9e2-830f9e027723-image-registry-private-configuration\") pod \"image-registry-5d984d89dd-r8hr5\" (UID: \"fbc63112-9a58-49c8-b9e2-830f9e027723\") " pod="openshift-image-registry/image-registry-5d984d89dd-r8hr5" Sep 09 08:39:33.235020 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:39:33.234988 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/fbc63112-9a58-49c8-b9e2-830f9e027723-installation-pull-secrets\") pod \"image-registry-5d984d89dd-r8hr5\" (UID: \"fbc63112-9a58-49c8-b9e2-830f9e027723\") " pod="openshift-image-registry/image-registry-5d984d89dd-r8hr5" Sep 09 08:39:33.239083 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:39:33.239055 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/fbc63112-9a58-49c8-b9e2-830f9e027723-bound-sa-token\") pod \"image-registry-5d984d89dd-r8hr5\" (UID: \"fbc63112-9a58-49c8-b9e2-830f9e027723\") " pod="openshift-image-registry/image-registry-5d984d89dd-r8hr5" Sep 09 08:39:33.240991 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:39:33.240970 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9khqh\" (UniqueName: \"kubernetes.io/projected/fbc63112-9a58-49c8-b9e2-830f9e027723-kube-api-access-9khqh\") pod \"image-registry-5d984d89dd-r8hr5\" (UID: \"fbc63112-9a58-49c8-b9e2-830f9e027723\") " pod="openshift-image-registry/image-registry-5d984d89dd-r8hr5" Sep 09 08:39:33.241634 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:39:33.241595 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7hqhm\" (UniqueName: \"kubernetes.io/projected/f81169f8-3c85-4cd7-8b59-684973ff46f7-kube-api-access-7hqhm\") pod \"console-operator-85b454874b-tdfqx\" (UID: \"f81169f8-3c85-4cd7-8b59-684973ff46f7\") " pod="openshift-console-operator/console-operator-85b454874b-tdfqx" Sep 09 08:39:33.333556 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:39:33.333522 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/aaa6f86d-29c1-45fb-bec3-3bf3bfb3d0bc-serving-cert\") pod \"service-ca-operator-859f94c4b-njzs5\" (UID: \"aaa6f86d-29c1-45fb-bec3-3bf3bfb3d0bc\") " pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-njzs5" Sep 09 08:39:33.333720 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:39:33.333575 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/77658115-dcd3-45b6-905e-2cfc02b948ed-cert\") pod \"ingress-canary-w944n\" (UID: \"77658115-dcd3-45b6-905e-2cfc02b948ed\") " pod="openshift-ingress-canary/ingress-canary-w944n" Sep 09 08:39:33.333720 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:39:33.333620 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/025bcb2f-08a5-4ea4-98f9-8ca84afd9b33-metrics-tls\") pod \"dns-default-v2cwj\" (UID: \"025bcb2f-08a5-4ea4-98f9-8ca84afd9b33\") " pod="openshift-dns/dns-default-v2cwj" Sep 09 08:39:33.333720 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:39:33.333648 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/7b2288b4-72fd-45bc-a286-f1ff2580d3cc-nginx-conf\") pod \"networking-console-plugin-79977f9844-9nmsv\" (UID: \"7b2288b4-72fd-45bc-a286-f1ff2580d3cc\") " pod="openshift-network-console/networking-console-plugin-79977f9844-9nmsv" Sep 09 08:39:33.333873 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:39:33.333798 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/025bcb2f-08a5-4ea4-98f9-8ca84afd9b33-tmp-dir\") pod \"dns-default-v2cwj\" (UID: \"025bcb2f-08a5-4ea4-98f9-8ca84afd9b33\") " pod="openshift-dns/dns-default-v2cwj" Sep 09 08:39:33.333873 ip-10-0-137-144 kubenswrapper[2564]: E0909 08:39:33.333813 2564 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 09 08:39:33.333873 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:39:33.333847 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7qgzl\" (UniqueName: \"kubernetes.io/projected/aaa6f86d-29c1-45fb-bec3-3bf3bfb3d0bc-kube-api-access-7qgzl\") pod \"service-ca-operator-859f94c4b-njzs5\" (UID: \"aaa6f86d-29c1-45fb-bec3-3bf3bfb3d0bc\") " pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-njzs5" Sep 09 08:39:33.334014 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:39:33.333877 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/adccc815-e6f4-4a83-a484-53522f06da20-serving-cert\") pod \"kube-storage-version-migrator-operator-8d7dd4675-6blnq\" (UID: \"adccc815-e6f4-4a83-a484-53522f06da20\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-6blnq" Sep 09 08:39:33.334014 ip-10-0-137-144 kubenswrapper[2564]: E0909 08:39:33.333905 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/025bcb2f-08a5-4ea4-98f9-8ca84afd9b33-metrics-tls podName:025bcb2f-08a5-4ea4-98f9-8ca84afd9b33 nodeName:}" failed. No retries permitted until 2026-09-09 08:39:33.833883032 +0000 UTC m=+34.531766912 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/025bcb2f-08a5-4ea4-98f9-8ca84afd9b33-metrics-tls") pod "dns-default-v2cwj" (UID: "025bcb2f-08a5-4ea4-98f9-8ca84afd9b33") : secret "dns-default-metrics-tls" not found Sep 09 08:39:33.334014 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:39:33.333948 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/7b2288b4-72fd-45bc-a286-f1ff2580d3cc-networking-console-plugin-cert\") pod \"networking-console-plugin-79977f9844-9nmsv\" (UID: \"7b2288b4-72fd-45bc-a286-f1ff2580d3cc\") " pod="openshift-network-console/networking-console-plugin-79977f9844-9nmsv" Sep 09 08:39:33.334014 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:39:33.333978 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-42kx5\" (UniqueName: \"kubernetes.io/projected/77658115-dcd3-45b6-905e-2cfc02b948ed-kube-api-access-42kx5\") pod \"ingress-canary-w944n\" (UID: \"77658115-dcd3-45b6-905e-2cfc02b948ed\") " pod="openshift-ingress-canary/ingress-canary-w944n" Sep 09 08:39:33.334233 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:39:33.334030 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/aaa6f86d-29c1-45fb-bec3-3bf3bfb3d0bc-config\") pod \"service-ca-operator-859f94c4b-njzs5\" (UID: \"aaa6f86d-29c1-45fb-bec3-3bf3bfb3d0bc\") " pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-njzs5" Sep 09 08:39:33.334233 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:39:33.334061 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rqlq4\" (UniqueName: \"kubernetes.io/projected/2c0efc1d-4b09-4830-ab44-3a8e07964f13-kube-api-access-rqlq4\") pod \"network-check-source-685456655f-p45dk\" (UID: \"2c0efc1d-4b09-4830-ab44-3a8e07964f13\") " pod="openshift-network-diagnostics/network-check-source-685456655f-p45dk" Sep 09 08:39:33.334233 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:39:33.334114 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/025bcb2f-08a5-4ea4-98f9-8ca84afd9b33-config-volume\") pod \"dns-default-v2cwj\" (UID: \"025bcb2f-08a5-4ea4-98f9-8ca84afd9b33\") " pod="openshift-dns/dns-default-v2cwj" Sep 09 08:39:33.334233 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:39:33.334122 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/025bcb2f-08a5-4ea4-98f9-8ca84afd9b33-tmp-dir\") pod \"dns-default-v2cwj\" (UID: \"025bcb2f-08a5-4ea4-98f9-8ca84afd9b33\") " pod="openshift-dns/dns-default-v2cwj" Sep 09 08:39:33.334233 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:39:33.334141 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/adccc815-e6f4-4a83-a484-53522f06da20-config\") pod \"kube-storage-version-migrator-operator-8d7dd4675-6blnq\" (UID: \"adccc815-e6f4-4a83-a484-53522f06da20\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-6blnq" Sep 09 08:39:33.334233 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:39:33.334176 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hhjzc\" (UniqueName: \"kubernetes.io/projected/adccc815-e6f4-4a83-a484-53522f06da20-kube-api-access-hhjzc\") pod \"kube-storage-version-migrator-operator-8d7dd4675-6blnq\" (UID: \"adccc815-e6f4-4a83-a484-53522f06da20\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-6blnq" Sep 09 08:39:33.334233 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:39:33.334220 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n9s97\" (UniqueName: \"kubernetes.io/projected/025bcb2f-08a5-4ea4-98f9-8ca84afd9b33-kube-api-access-n9s97\") pod \"dns-default-v2cwj\" (UID: \"025bcb2f-08a5-4ea4-98f9-8ca84afd9b33\") " pod="openshift-dns/dns-default-v2cwj" Sep 09 08:39:33.334594 ip-10-0-137-144 kubenswrapper[2564]: E0909 08:39:33.334240 2564 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Sep 09 08:39:33.334594 ip-10-0-137-144 kubenswrapper[2564]: E0909 08:39:33.334299 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7b2288b4-72fd-45bc-a286-f1ff2580d3cc-networking-console-plugin-cert podName:7b2288b4-72fd-45bc-a286-f1ff2580d3cc nodeName:}" failed. No retries permitted until 2026-09-09 08:39:33.83428142 +0000 UTC m=+34.532165303 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/7b2288b4-72fd-45bc-a286-f1ff2580d3cc-networking-console-plugin-cert") pod "networking-console-plugin-79977f9844-9nmsv" (UID: "7b2288b4-72fd-45bc-a286-f1ff2580d3cc") : secret "networking-console-plugin-cert" not found Sep 09 08:39:33.334594 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:39:33.334522 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/7b2288b4-72fd-45bc-a286-f1ff2580d3cc-nginx-conf\") pod \"networking-console-plugin-79977f9844-9nmsv\" (UID: \"7b2288b4-72fd-45bc-a286-f1ff2580d3cc\") " pod="openshift-network-console/networking-console-plugin-79977f9844-9nmsv" Sep 09 08:39:33.334759 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:39:33.334658 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/aaa6f86d-29c1-45fb-bec3-3bf3bfb3d0bc-config\") pod \"service-ca-operator-859f94c4b-njzs5\" (UID: \"aaa6f86d-29c1-45fb-bec3-3bf3bfb3d0bc\") " pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-njzs5" Sep 09 08:39:33.334815 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:39:33.334792 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/025bcb2f-08a5-4ea4-98f9-8ca84afd9b33-config-volume\") pod \"dns-default-v2cwj\" (UID: \"025bcb2f-08a5-4ea4-98f9-8ca84afd9b33\") " pod="openshift-dns/dns-default-v2cwj" Sep 09 08:39:33.335073 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:39:33.335048 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/adccc815-e6f4-4a83-a484-53522f06da20-config\") pod \"kube-storage-version-migrator-operator-8d7dd4675-6blnq\" (UID: \"adccc815-e6f4-4a83-a484-53522f06da20\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-6blnq" Sep 09 08:39:33.336435 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:39:33.336412 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/aaa6f86d-29c1-45fb-bec3-3bf3bfb3d0bc-serving-cert\") pod \"service-ca-operator-859f94c4b-njzs5\" (UID: \"aaa6f86d-29c1-45fb-bec3-3bf3bfb3d0bc\") " pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-njzs5" Sep 09 08:39:33.336435 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:39:33.336429 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/adccc815-e6f4-4a83-a484-53522f06da20-serving-cert\") pod \"kube-storage-version-migrator-operator-8d7dd4675-6blnq\" (UID: \"adccc815-e6f4-4a83-a484-53522f06da20\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-6blnq" Sep 09 08:39:33.336593 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:39:33.336459 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/77658115-dcd3-45b6-905e-2cfc02b948ed-cert\") pod \"ingress-canary-w944n\" (UID: \"77658115-dcd3-45b6-905e-2cfc02b948ed\") " pod="openshift-ingress-canary/ingress-canary-w944n" Sep 09 08:39:33.344112 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:39:33.344088 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hhjzc\" (UniqueName: \"kubernetes.io/projected/adccc815-e6f4-4a83-a484-53522f06da20-kube-api-access-hhjzc\") pod \"kube-storage-version-migrator-operator-8d7dd4675-6blnq\" (UID: \"adccc815-e6f4-4a83-a484-53522f06da20\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-6blnq" Sep 09 08:39:33.344260 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:39:33.344238 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rqlq4\" (UniqueName: \"kubernetes.io/projected/2c0efc1d-4b09-4830-ab44-3a8e07964f13-kube-api-access-rqlq4\") pod \"network-check-source-685456655f-p45dk\" (UID: \"2c0efc1d-4b09-4830-ab44-3a8e07964f13\") " pod="openshift-network-diagnostics/network-check-source-685456655f-p45dk" Sep 09 08:39:33.344360 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:39:33.344324 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-n9s97\" (UniqueName: \"kubernetes.io/projected/025bcb2f-08a5-4ea4-98f9-8ca84afd9b33-kube-api-access-n9s97\") pod \"dns-default-v2cwj\" (UID: \"025bcb2f-08a5-4ea4-98f9-8ca84afd9b33\") " pod="openshift-dns/dns-default-v2cwj" Sep 09 08:39:33.344360 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:39:33.344329 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7qgzl\" (UniqueName: \"kubernetes.io/projected/aaa6f86d-29c1-45fb-bec3-3bf3bfb3d0bc-kube-api-access-7qgzl\") pod \"service-ca-operator-859f94c4b-njzs5\" (UID: \"aaa6f86d-29c1-45fb-bec3-3bf3bfb3d0bc\") " pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-njzs5" Sep 09 08:39:33.345381 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:39:33.345360 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-42kx5\" (UniqueName: \"kubernetes.io/projected/77658115-dcd3-45b6-905e-2cfc02b948ed-kube-api-access-42kx5\") pod \"ingress-canary-w944n\" (UID: \"77658115-dcd3-45b6-905e-2cfc02b948ed\") " pod="openshift-ingress-canary/ingress-canary-w944n" Sep 09 08:39:33.356226 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:39:33.356179 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-85b454874b-tdfqx" Sep 09 08:39:33.407872 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:39:33.407833 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-685456655f-p45dk" Sep 09 08:39:33.415620 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:39:33.415600 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-njzs5" Sep 09 08:39:33.424894 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:39:33.424712 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-6blnq" Sep 09 08:39:33.439517 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:39:33.439489 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-w944n" Sep 09 08:39:33.536839 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:39:33.536800 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/50f8cfa3-6f41-47be-899d-cf16c3251f84-metrics-certs\") pod \"network-metrics-daemon-b2965\" (UID: \"50f8cfa3-6f41-47be-899d-cf16c3251f84\") " pod="openshift-multus/network-metrics-daemon-b2965" Sep 09 08:39:33.536943 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:39:33.536881 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/950a27f9-3274-48f2-a23e-21f86398eb00-original-pull-secret\") pod \"global-pull-secret-syncer-dvhwl\" (UID: \"950a27f9-3274-48f2-a23e-21f86398eb00\") " pod="kube-system/global-pull-secret-syncer-dvhwl" Sep 09 08:39:33.537017 ip-10-0-137-144 kubenswrapper[2564]: E0909 08:39:33.536952 2564 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 09 08:39:33.537017 ip-10-0-137-144 kubenswrapper[2564]: E0909 08:39:33.537008 2564 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 09 08:39:33.537120 ip-10-0-137-144 kubenswrapper[2564]: E0909 08:39:33.537012 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/50f8cfa3-6f41-47be-899d-cf16c3251f84-metrics-certs podName:50f8cfa3-6f41-47be-899d-cf16c3251f84 nodeName:}" failed. No retries permitted until 2026-09-09 08:40:05.536997584 +0000 UTC m=+66.234881463 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/50f8cfa3-6f41-47be-899d-cf16c3251f84-metrics-certs") pod "network-metrics-daemon-b2965" (UID: "50f8cfa3-6f41-47be-899d-cf16c3251f84") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 09 08:39:33.537120 ip-10-0-137-144 kubenswrapper[2564]: E0909 08:39:33.537073 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/950a27f9-3274-48f2-a23e-21f86398eb00-original-pull-secret podName:950a27f9-3274-48f2-a23e-21f86398eb00 nodeName:}" failed. No retries permitted until 2026-09-09 08:40:05.537055808 +0000 UTC m=+66.234939692 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/950a27f9-3274-48f2-a23e-21f86398eb00-original-pull-secret") pod "global-pull-secret-syncer-dvhwl" (UID: "950a27f9-3274-48f2-a23e-21f86398eb00") : object "kube-system"/"original-pull-secret" not registered Sep 09 08:39:33.637585 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:39:33.637513 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qvmn4\" (UniqueName: \"kubernetes.io/projected/96601efb-dd16-407b-9899-22f67a88b7f0-kube-api-access-qvmn4\") pod \"network-check-target-2zg7w\" (UID: \"96601efb-dd16-407b-9899-22f67a88b7f0\") " pod="openshift-network-diagnostics/network-check-target-2zg7w" Sep 09 08:39:33.641276 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:39:33.641244 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qvmn4\" (UniqueName: \"kubernetes.io/projected/96601efb-dd16-407b-9899-22f67a88b7f0-kube-api-access-qvmn4\") pod \"network-check-target-2zg7w\" (UID: \"96601efb-dd16-407b-9899-22f67a88b7f0\") " pod="openshift-network-diagnostics/network-check-target-2zg7w" Sep 09 08:39:33.642307 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:39:33.642286 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-85b454874b-tdfqx"] Sep 09 08:39:33.645915 ip-10-0-137-144 kubenswrapper[2564]: W0909 08:39:33.645893 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf81169f8_3c85_4cd7_8b59_684973ff46f7.slice/crio-0153e4e577e7809c28616d549bbdf2b0964931a1eb4698c68908efb71311f68a WatchSource:0}: Error finding container 0153e4e577e7809c28616d549bbdf2b0964931a1eb4698c68908efb71311f68a: Status 404 returned error can't find the container with id 0153e4e577e7809c28616d549bbdf2b0964931a1eb4698c68908efb71311f68a Sep 09 08:39:33.701660 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:39:33.701586 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-685456655f-p45dk"] Sep 09 08:39:33.702868 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:39:33.702812 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-859f94c4b-njzs5"] Sep 09 08:39:33.705588 ip-10-0-137-144 kubenswrapper[2564]: W0909 08:39:33.705559 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2c0efc1d_4b09_4830_ab44_3a8e07964f13.slice/crio-902535fa364a88396d3a597b53a679d9793496745d172bcc2a11f7214b4aca83 WatchSource:0}: Error finding container 902535fa364a88396d3a597b53a679d9793496745d172bcc2a11f7214b4aca83: Status 404 returned error can't find the container with id 902535fa364a88396d3a597b53a679d9793496745d172bcc2a11f7214b4aca83 Sep 09 08:39:33.706037 ip-10-0-137-144 kubenswrapper[2564]: W0909 08:39:33.706011 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaaa6f86d_29c1_45fb_bec3_3bf3bfb3d0bc.slice/crio-c17cba715c274b799e4d7e340cf715f686dbf9b6649d5c7909733b7ce6cc611d WatchSource:0}: Error finding container c17cba715c274b799e4d7e340cf715f686dbf9b6649d5c7909733b7ce6cc611d: Status 404 returned error can't find the container with id c17cba715c274b799e4d7e340cf715f686dbf9b6649d5c7909733b7ce6cc611d Sep 09 08:39:33.718160 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:39:33.718141 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-6blnq"] Sep 09 08:39:33.722894 ip-10-0-137-144 kubenswrapper[2564]: W0909 08:39:33.722868 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podadccc815_e6f4_4a83_a484_53522f06da20.slice/crio-af587539e896364b10f562df7541b43c7b3227b3d0ae926d748505f34f3194f0 WatchSource:0}: Error finding container af587539e896364b10f562df7541b43c7b3227b3d0ae926d748505f34f3194f0: Status 404 returned error can't find the container with id af587539e896364b10f562df7541b43c7b3227b3d0ae926d748505f34f3194f0 Sep 09 08:39:33.733899 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:39:33.733878 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-w944n"] Sep 09 08:39:33.736533 ip-10-0-137-144 kubenswrapper[2564]: W0909 08:39:33.736513 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod77658115_dcd3_45b6_905e_2cfc02b948ed.slice/crio-414ea45104f11b17c5899a13215496239821250ca270959ba62d15d6bfa4f69e WatchSource:0}: Error finding container 414ea45104f11b17c5899a13215496239821250ca270959ba62d15d6bfa4f69e: Status 404 returned error can't find the container with id 414ea45104f11b17c5899a13215496239821250ca270959ba62d15d6bfa4f69e Sep 09 08:39:33.737964 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:39:33.737946 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/fbc63112-9a58-49c8-b9e2-830f9e027723-registry-tls\") pod \"image-registry-5d984d89dd-r8hr5\" (UID: \"fbc63112-9a58-49c8-b9e2-830f9e027723\") " pod="openshift-image-registry/image-registry-5d984d89dd-r8hr5" Sep 09 08:39:33.738064 ip-10-0-137-144 kubenswrapper[2564]: E0909 08:39:33.738052 2564 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Sep 09 08:39:33.738064 ip-10-0-137-144 kubenswrapper[2564]: E0909 08:39:33.738063 2564 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5d984d89dd-r8hr5: secret "image-registry-tls" not found Sep 09 08:39:33.738179 ip-10-0-137-144 kubenswrapper[2564]: E0909 08:39:33.738107 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/fbc63112-9a58-49c8-b9e2-830f9e027723-registry-tls podName:fbc63112-9a58-49c8-b9e2-830f9e027723 nodeName:}" failed. No retries permitted until 2026-09-09 08:39:34.738094733 +0000 UTC m=+35.435978613 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/fbc63112-9a58-49c8-b9e2-830f9e027723-registry-tls") pod "image-registry-5d984d89dd-r8hr5" (UID: "fbc63112-9a58-49c8-b9e2-830f9e027723") : secret "image-registry-tls" not found Sep 09 08:39:33.801949 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:39:33.801919 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dvhwl" Sep 09 08:39:33.802135 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:39:33.802049 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-b2965" Sep 09 08:39:33.802135 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:39:33.802089 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2zg7w" Sep 09 08:39:33.806755 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:39:33.805315 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-dtwcb\"" Sep 09 08:39:33.806755 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:39:33.805643 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Sep 09 08:39:33.806755 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:39:33.805719 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Sep 09 08:39:33.806755 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:39:33.805890 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-4bf2n\"" Sep 09 08:39:33.828381 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:39:33.828364 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2zg7w" Sep 09 08:39:33.838409 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:39:33.838389 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/025bcb2f-08a5-4ea4-98f9-8ca84afd9b33-metrics-tls\") pod \"dns-default-v2cwj\" (UID: \"025bcb2f-08a5-4ea4-98f9-8ca84afd9b33\") " pod="openshift-dns/dns-default-v2cwj" Sep 09 08:39:33.838506 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:39:33.838429 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/7b2288b4-72fd-45bc-a286-f1ff2580d3cc-networking-console-plugin-cert\") pod \"networking-console-plugin-79977f9844-9nmsv\" (UID: \"7b2288b4-72fd-45bc-a286-f1ff2580d3cc\") " pod="openshift-network-console/networking-console-plugin-79977f9844-9nmsv" Sep 09 08:39:33.838557 ip-10-0-137-144 kubenswrapper[2564]: E0909 08:39:33.838535 2564 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 09 08:39:33.838600 ip-10-0-137-144 kubenswrapper[2564]: E0909 08:39:33.838556 2564 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Sep 09 08:39:33.838600 ip-10-0-137-144 kubenswrapper[2564]: E0909 08:39:33.838586 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/025bcb2f-08a5-4ea4-98f9-8ca84afd9b33-metrics-tls podName:025bcb2f-08a5-4ea4-98f9-8ca84afd9b33 nodeName:}" failed. No retries permitted until 2026-09-09 08:39:34.838571916 +0000 UTC m=+35.536455796 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/025bcb2f-08a5-4ea4-98f9-8ca84afd9b33-metrics-tls") pod "dns-default-v2cwj" (UID: "025bcb2f-08a5-4ea4-98f9-8ca84afd9b33") : secret "dns-default-metrics-tls" not found Sep 09 08:39:33.838600 ip-10-0-137-144 kubenswrapper[2564]: E0909 08:39:33.838599 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7b2288b4-72fd-45bc-a286-f1ff2580d3cc-networking-console-plugin-cert podName:7b2288b4-72fd-45bc-a286-f1ff2580d3cc nodeName:}" failed. No retries permitted until 2026-09-09 08:39:34.838593117 +0000 UTC m=+35.536476996 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/7b2288b4-72fd-45bc-a286-f1ff2580d3cc-networking-console-plugin-cert") pod "networking-console-plugin-79977f9844-9nmsv" (UID: "7b2288b4-72fd-45bc-a286-f1ff2580d3cc") : secret "networking-console-plugin-cert" not found Sep 09 08:39:33.968512 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:39:33.968427 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-njzs5" event={"ID":"aaa6f86d-29c1-45fb-bec3-3bf3bfb3d0bc","Type":"ContainerStarted","Data":"c17cba715c274b799e4d7e340cf715f686dbf9b6649d5c7909733b7ce6cc611d"} Sep 09 08:39:33.969824 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:39:33.969803 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-w944n" event={"ID":"77658115-dcd3-45b6-905e-2cfc02b948ed","Type":"ContainerStarted","Data":"414ea45104f11b17c5899a13215496239821250ca270959ba62d15d6bfa4f69e"} Sep 09 08:39:33.971203 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:39:33.971153 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-685456655f-p45dk" event={"ID":"2c0efc1d-4b09-4830-ab44-3a8e07964f13","Type":"ContainerStarted","Data":"902535fa364a88396d3a597b53a679d9793496745d172bcc2a11f7214b4aca83"} Sep 09 08:39:33.972496 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:39:33.972471 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-85b454874b-tdfqx" event={"ID":"f81169f8-3c85-4cd7-8b59-684973ff46f7","Type":"ContainerStarted","Data":"0153e4e577e7809c28616d549bbdf2b0964931a1eb4698c68908efb71311f68a"} Sep 09 08:39:33.973756 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:39:33.973734 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-6blnq" event={"ID":"adccc815-e6f4-4a83-a484-53522f06da20","Type":"ContainerStarted","Data":"af587539e896364b10f562df7541b43c7b3227b3d0ae926d748505f34f3194f0"} Sep 09 08:39:34.745098 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:39:34.745069 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/fbc63112-9a58-49c8-b9e2-830f9e027723-registry-tls\") pod \"image-registry-5d984d89dd-r8hr5\" (UID: \"fbc63112-9a58-49c8-b9e2-830f9e027723\") " pod="openshift-image-registry/image-registry-5d984d89dd-r8hr5" Sep 09 08:39:34.745655 ip-10-0-137-144 kubenswrapper[2564]: E0909 08:39:34.745245 2564 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Sep 09 08:39:34.745655 ip-10-0-137-144 kubenswrapper[2564]: E0909 08:39:34.745265 2564 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5d984d89dd-r8hr5: secret "image-registry-tls" not found Sep 09 08:39:34.745655 ip-10-0-137-144 kubenswrapper[2564]: E0909 08:39:34.745327 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/fbc63112-9a58-49c8-b9e2-830f9e027723-registry-tls podName:fbc63112-9a58-49c8-b9e2-830f9e027723 nodeName:}" failed. No retries permitted until 2026-09-09 08:39:36.74530529 +0000 UTC m=+37.443189183 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/fbc63112-9a58-49c8-b9e2-830f9e027723-registry-tls") pod "image-registry-5d984d89dd-r8hr5" (UID: "fbc63112-9a58-49c8-b9e2-830f9e027723") : secret "image-registry-tls" not found Sep 09 08:39:34.846353 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:39:34.846308 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/025bcb2f-08a5-4ea4-98f9-8ca84afd9b33-metrics-tls\") pod \"dns-default-v2cwj\" (UID: \"025bcb2f-08a5-4ea4-98f9-8ca84afd9b33\") " pod="openshift-dns/dns-default-v2cwj" Sep 09 08:39:34.846536 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:39:34.846377 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/7b2288b4-72fd-45bc-a286-f1ff2580d3cc-networking-console-plugin-cert\") pod \"networking-console-plugin-79977f9844-9nmsv\" (UID: \"7b2288b4-72fd-45bc-a286-f1ff2580d3cc\") " pod="openshift-network-console/networking-console-plugin-79977f9844-9nmsv" Sep 09 08:39:34.846536 ip-10-0-137-144 kubenswrapper[2564]: E0909 08:39:34.846491 2564 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 09 08:39:34.846536 ip-10-0-137-144 kubenswrapper[2564]: E0909 08:39:34.846531 2564 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Sep 09 08:39:34.846652 ip-10-0-137-144 kubenswrapper[2564]: E0909 08:39:34.846576 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/025bcb2f-08a5-4ea4-98f9-8ca84afd9b33-metrics-tls podName:025bcb2f-08a5-4ea4-98f9-8ca84afd9b33 nodeName:}" failed. No retries permitted until 2026-09-09 08:39:36.84655393 +0000 UTC m=+37.544437833 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/025bcb2f-08a5-4ea4-98f9-8ca84afd9b33-metrics-tls") pod "dns-default-v2cwj" (UID: "025bcb2f-08a5-4ea4-98f9-8ca84afd9b33") : secret "dns-default-metrics-tls" not found Sep 09 08:39:34.846652 ip-10-0-137-144 kubenswrapper[2564]: E0909 08:39:34.846595 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7b2288b4-72fd-45bc-a286-f1ff2580d3cc-networking-console-plugin-cert podName:7b2288b4-72fd-45bc-a286-f1ff2580d3cc nodeName:}" failed. No retries permitted until 2026-09-09 08:39:36.846586953 +0000 UTC m=+37.544470835 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/7b2288b4-72fd-45bc-a286-f1ff2580d3cc-networking-console-plugin-cert") pod "networking-console-plugin-79977f9844-9nmsv" (UID: "7b2288b4-72fd-45bc-a286-f1ff2580d3cc") : secret "networking-console-plugin-cert" not found Sep 09 08:39:35.486007 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:39:35.483330 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-2zg7w"] Sep 09 08:39:35.538914 ip-10-0-137-144 kubenswrapper[2564]: W0909 08:39:35.538876 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod96601efb_dd16_407b_9899_22f67a88b7f0.slice/crio-90b6b57ca9e06405b2f9e8f552770b94dcf55244633ad09476f8a14f4a80841e WatchSource:0}: Error finding container 90b6b57ca9e06405b2f9e8f552770b94dcf55244633ad09476f8a14f4a80841e: Status 404 returned error can't find the container with id 90b6b57ca9e06405b2f9e8f552770b94dcf55244633ad09476f8a14f4a80841e Sep 09 08:39:35.987681 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:39:35.987438 2564 generic.go:356] "Generic (PLEG): container finished" podID="6c33c8b3-58fb-4539-92c2-da514e6d52ef" containerID="dcba81ed11ba3cb23a54dbc9221870c376f0d76b7b41d35b43052b7711373b7a" exitCode=0 Sep 09 08:39:35.988324 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:39:35.987744 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-tszfd" event={"ID":"6c33c8b3-58fb-4539-92c2-da514e6d52ef","Type":"ContainerDied","Data":"dcba81ed11ba3cb23a54dbc9221870c376f0d76b7b41d35b43052b7711373b7a"} Sep 09 08:39:35.996730 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:39:35.996690 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-2zg7w" event={"ID":"96601efb-dd16-407b-9899-22f67a88b7f0","Type":"ContainerStarted","Data":"90b6b57ca9e06405b2f9e8f552770b94dcf55244633ad09476f8a14f4a80841e"} Sep 09 08:39:36.763753 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:39:36.763697 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/fbc63112-9a58-49c8-b9e2-830f9e027723-registry-tls\") pod \"image-registry-5d984d89dd-r8hr5\" (UID: \"fbc63112-9a58-49c8-b9e2-830f9e027723\") " pod="openshift-image-registry/image-registry-5d984d89dd-r8hr5" Sep 09 08:39:36.763981 ip-10-0-137-144 kubenswrapper[2564]: E0909 08:39:36.763962 2564 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Sep 09 08:39:36.763981 ip-10-0-137-144 kubenswrapper[2564]: E0909 08:39:36.763981 2564 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5d984d89dd-r8hr5: secret "image-registry-tls" not found Sep 09 08:39:36.764105 ip-10-0-137-144 kubenswrapper[2564]: E0909 08:39:36.764042 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/fbc63112-9a58-49c8-b9e2-830f9e027723-registry-tls podName:fbc63112-9a58-49c8-b9e2-830f9e027723 nodeName:}" failed. No retries permitted until 2026-09-09 08:39:40.764023294 +0000 UTC m=+41.461907187 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/fbc63112-9a58-49c8-b9e2-830f9e027723-registry-tls") pod "image-registry-5d984d89dd-r8hr5" (UID: "fbc63112-9a58-49c8-b9e2-830f9e027723") : secret "image-registry-tls" not found Sep 09 08:39:36.865180 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:39:36.865137 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/7b2288b4-72fd-45bc-a286-f1ff2580d3cc-networking-console-plugin-cert\") pod \"networking-console-plugin-79977f9844-9nmsv\" (UID: \"7b2288b4-72fd-45bc-a286-f1ff2580d3cc\") " pod="openshift-network-console/networking-console-plugin-79977f9844-9nmsv" Sep 09 08:39:36.865353 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:39:36.865289 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/025bcb2f-08a5-4ea4-98f9-8ca84afd9b33-metrics-tls\") pod \"dns-default-v2cwj\" (UID: \"025bcb2f-08a5-4ea4-98f9-8ca84afd9b33\") " pod="openshift-dns/dns-default-v2cwj" Sep 09 08:39:36.865496 ip-10-0-137-144 kubenswrapper[2564]: E0909 08:39:36.865440 2564 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 09 08:39:36.865586 ip-10-0-137-144 kubenswrapper[2564]: E0909 08:39:36.865509 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/025bcb2f-08a5-4ea4-98f9-8ca84afd9b33-metrics-tls podName:025bcb2f-08a5-4ea4-98f9-8ca84afd9b33 nodeName:}" failed. No retries permitted until 2026-09-09 08:39:40.865489658 +0000 UTC m=+41.563373542 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/025bcb2f-08a5-4ea4-98f9-8ca84afd9b33-metrics-tls") pod "dns-default-v2cwj" (UID: "025bcb2f-08a5-4ea4-98f9-8ca84afd9b33") : secret "dns-default-metrics-tls" not found Sep 09 08:39:36.866125 ip-10-0-137-144 kubenswrapper[2564]: E0909 08:39:36.865903 2564 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Sep 09 08:39:36.866125 ip-10-0-137-144 kubenswrapper[2564]: E0909 08:39:36.865984 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7b2288b4-72fd-45bc-a286-f1ff2580d3cc-networking-console-plugin-cert podName:7b2288b4-72fd-45bc-a286-f1ff2580d3cc nodeName:}" failed. No retries permitted until 2026-09-09 08:39:40.8659451 +0000 UTC m=+41.563828983 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/7b2288b4-72fd-45bc-a286-f1ff2580d3cc-networking-console-plugin-cert") pod "networking-console-plugin-79977f9844-9nmsv" (UID: "7b2288b4-72fd-45bc-a286-f1ff2580d3cc") : secret "networking-console-plugin-cert" not found Sep 09 08:39:37.015067 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:39:37.014975 2564 generic.go:356] "Generic (PLEG): container finished" podID="6c33c8b3-58fb-4539-92c2-da514e6d52ef" containerID="09dc9f5056a77082afea15f088dd24cda3f0032b4c9f05cf60ed15c4d825feb0" exitCode=0 Sep 09 08:39:37.015067 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:39:37.015048 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-tszfd" event={"ID":"6c33c8b3-58fb-4539-92c2-da514e6d52ef","Type":"ContainerDied","Data":"09dc9f5056a77082afea15f088dd24cda3f0032b4c9f05cf60ed15c4d825feb0"} Sep 09 08:39:40.800028 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:39:40.799986 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/fbc63112-9a58-49c8-b9e2-830f9e027723-registry-tls\") pod \"image-registry-5d984d89dd-r8hr5\" (UID: \"fbc63112-9a58-49c8-b9e2-830f9e027723\") " pod="openshift-image-registry/image-registry-5d984d89dd-r8hr5" Sep 09 08:39:40.800491 ip-10-0-137-144 kubenswrapper[2564]: E0909 08:39:40.800163 2564 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Sep 09 08:39:40.800491 ip-10-0-137-144 kubenswrapper[2564]: E0909 08:39:40.800189 2564 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5d984d89dd-r8hr5: secret "image-registry-tls" not found Sep 09 08:39:40.800491 ip-10-0-137-144 kubenswrapper[2564]: E0909 08:39:40.800260 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/fbc63112-9a58-49c8-b9e2-830f9e027723-registry-tls podName:fbc63112-9a58-49c8-b9e2-830f9e027723 nodeName:}" failed. No retries permitted until 2026-09-09 08:39:48.800239367 +0000 UTC m=+49.498123249 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/fbc63112-9a58-49c8-b9e2-830f9e027723-registry-tls") pod "image-registry-5d984d89dd-r8hr5" (UID: "fbc63112-9a58-49c8-b9e2-830f9e027723") : secret "image-registry-tls" not found Sep 09 08:39:40.901270 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:39:40.901237 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/025bcb2f-08a5-4ea4-98f9-8ca84afd9b33-metrics-tls\") pod \"dns-default-v2cwj\" (UID: \"025bcb2f-08a5-4ea4-98f9-8ca84afd9b33\") " pod="openshift-dns/dns-default-v2cwj" Sep 09 08:39:40.901457 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:39:40.901281 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/7b2288b4-72fd-45bc-a286-f1ff2580d3cc-networking-console-plugin-cert\") pod \"networking-console-plugin-79977f9844-9nmsv\" (UID: \"7b2288b4-72fd-45bc-a286-f1ff2580d3cc\") " pod="openshift-network-console/networking-console-plugin-79977f9844-9nmsv" Sep 09 08:39:40.901457 ip-10-0-137-144 kubenswrapper[2564]: E0909 08:39:40.901408 2564 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Sep 09 08:39:40.901577 ip-10-0-137-144 kubenswrapper[2564]: E0909 08:39:40.901468 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7b2288b4-72fd-45bc-a286-f1ff2580d3cc-networking-console-plugin-cert podName:7b2288b4-72fd-45bc-a286-f1ff2580d3cc nodeName:}" failed. No retries permitted until 2026-09-09 08:39:48.901453858 +0000 UTC m=+49.599337737 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/7b2288b4-72fd-45bc-a286-f1ff2580d3cc-networking-console-plugin-cert") pod "networking-console-plugin-79977f9844-9nmsv" (UID: "7b2288b4-72fd-45bc-a286-f1ff2580d3cc") : secret "networking-console-plugin-cert" not found Sep 09 08:39:40.901577 ip-10-0-137-144 kubenswrapper[2564]: E0909 08:39:40.901408 2564 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 09 08:39:40.901577 ip-10-0-137-144 kubenswrapper[2564]: E0909 08:39:40.901550 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/025bcb2f-08a5-4ea4-98f9-8ca84afd9b33-metrics-tls podName:025bcb2f-08a5-4ea4-98f9-8ca84afd9b33 nodeName:}" failed. No retries permitted until 2026-09-09 08:39:48.901536414 +0000 UTC m=+49.599420300 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/025bcb2f-08a5-4ea4-98f9-8ca84afd9b33-metrics-tls") pod "dns-default-v2cwj" (UID: "025bcb2f-08a5-4ea4-98f9-8ca84afd9b33") : secret "dns-default-metrics-tls" not found Sep 09 08:39:42.029284 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:39:42.029261 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-tszfd" event={"ID":"6c33c8b3-58fb-4539-92c2-da514e6d52ef","Type":"ContainerStarted","Data":"72be4cb0616eef9827010116a604b6b99f21a2b966813436147ffcad842e4539"} Sep 09 08:39:42.065348 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:39:42.065284 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-tszfd" podStartSLOduration=13.186301629 podStartE2EDuration="43.065264328s" totalImagesPullingTime="29.878962699s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-09 08:38:59 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 08:39:42.063704893 +0000 UTC m=+42.761588794" watchObservedRunningTime="2026-09-09 08:39:42.065264328 +0000 UTC m=+42.763148230" Sep 09 08:39:43.035111 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:39:43.035083 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-tdfqx_f81169f8-3c85-4cd7-8b59-684973ff46f7/console-operator/0.log" Sep 09 08:39:43.035560 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:39:43.035121 2564 generic.go:356] "Generic (PLEG): container finished" podID="f81169f8-3c85-4cd7-8b59-684973ff46f7" containerID="13a06900abea6b4987faec6bf112bbce388617d8a8c345e44e8482e3b27c9d8f" exitCode=255 Sep 09 08:39:43.035560 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:39:43.035186 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-85b454874b-tdfqx" event={"ID":"f81169f8-3c85-4cd7-8b59-684973ff46f7","Type":"ContainerDied","Data":"13a06900abea6b4987faec6bf112bbce388617d8a8c345e44e8482e3b27c9d8f"} Sep 09 08:39:43.035560 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:39:43.035497 2564 scope.go:117] "RemoveContainer" containerID="13a06900abea6b4987faec6bf112bbce388617d8a8c345e44e8482e3b27c9d8f" Sep 09 08:39:43.037002 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:39:43.036977 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-2zg7w" event={"ID":"96601efb-dd16-407b-9899-22f67a88b7f0","Type":"ContainerStarted","Data":"5de0c10b6ab617661e9654a36500bad12bb1247413b0046f4af4c554288142ae"} Sep 09 08:39:43.037116 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:39:43.037055 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-2zg7w" Sep 09 08:39:43.038779 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:39:43.038738 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-6blnq" event={"ID":"adccc815-e6f4-4a83-a484-53522f06da20","Type":"ContainerStarted","Data":"b20b9cb8c29bc435318646c68d0197969f254a25b93e9a17cdd49a27a01e7dd4"} Sep 09 08:39:43.040382 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:39:43.040347 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-njzs5" event={"ID":"aaa6f86d-29c1-45fb-bec3-3bf3bfb3d0bc","Type":"ContainerStarted","Data":"705086a699387f9e519a7f6c8d14d6ffc617586c8b9a123630f22fc167fbd226"} Sep 09 08:39:43.041942 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:39:43.041913 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-w944n" event={"ID":"77658115-dcd3-45b6-905e-2cfc02b948ed","Type":"ContainerStarted","Data":"66f899882e3aced7e63756e1bdbbfbde11ce00ddf6ccc54851ad32b63576cfe1"} Sep 09 08:39:43.043510 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:39:43.043486 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-685456655f-p45dk" event={"ID":"2c0efc1d-4b09-4830-ab44-3a8e07964f13","Type":"ContainerStarted","Data":"2248b4843e4a15e77c0cd4d62503a4aee248fe778a127b94efb825546aa6500c"} Sep 09 08:39:43.067225 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:39:43.067171 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-njzs5" podStartSLOduration=31.806470159 podStartE2EDuration="40.067151651s" totalImagesPullingTime="8.260681492s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 08:39:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 08:39:43.066027079 +0000 UTC m=+43.763910981" watchObservedRunningTime="2026-09-09 08:39:43.067151651 +0000 UTC m=+43.765035554" Sep 09 08:39:43.080101 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:39:43.080045 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-6blnq" podStartSLOduration=30.836586147 podStartE2EDuration="39.080027806s" totalImagesPullingTime="8.243441659s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 08:39:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 08:39:43.079582295 +0000 UTC m=+43.777466189" watchObservedRunningTime="2026-09-09 08:39:43.080027806 +0000 UTC m=+43.777911708" Sep 09 08:39:43.094713 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:39:43.094662 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-685456655f-p45dk" podStartSLOduration=29.833108423 podStartE2EDuration="38.094642684s" totalImagesPullingTime="8.261534261s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 08:39:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 08:39:43.094482198 +0000 UTC m=+43.792366101" watchObservedRunningTime="2026-09-09 08:39:43.094642684 +0000 UTC m=+43.792526588" Sep 09 08:39:43.113090 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:39:43.113041 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-w944n" podStartSLOduration=1.882448326 podStartE2EDuration="10.113024558s" totalImagesPullingTime="8.230576232s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 08:39:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 08:39:43.111870323 +0000 UTC m=+43.809754224" watchObservedRunningTime="2026-09-09 08:39:43.113024558 +0000 UTC m=+43.810908461" Sep 09 08:39:43.129428 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:39:43.129388 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-2zg7w" podStartSLOduration=36.69159013 podStartE2EDuration="43.129374448s" totalImagesPullingTime="6.437784318s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 08:39:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 08:39:43.128770509 +0000 UTC m=+43.826654413" watchObservedRunningTime="2026-09-09 08:39:43.129374448 +0000 UTC m=+43.827258349" Sep 09 08:39:43.356822 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:39:43.356784 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-85b454874b-tdfqx" Sep 09 08:39:43.356960 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:39:43.356847 2564 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-85b454874b-tdfqx" Sep 09 08:39:44.053521 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:39:44.053493 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-tdfqx_f81169f8-3c85-4cd7-8b59-684973ff46f7/console-operator/1.log" Sep 09 08:39:44.053925 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:39:44.053914 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-tdfqx_f81169f8-3c85-4cd7-8b59-684973ff46f7/console-operator/0.log" Sep 09 08:39:44.053972 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:39:44.053944 2564 generic.go:356] "Generic (PLEG): container finished" podID="f81169f8-3c85-4cd7-8b59-684973ff46f7" containerID="01daed94e9eb6ab9f92915f162f61d8126b22800b02f0ca1b79fa667080fd550" exitCode=255 Sep 09 08:39:44.054002 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:39:44.053976 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-85b454874b-tdfqx" event={"ID":"f81169f8-3c85-4cd7-8b59-684973ff46f7","Type":"ContainerDied","Data":"01daed94e9eb6ab9f92915f162f61d8126b22800b02f0ca1b79fa667080fd550"} Sep 09 08:39:44.054069 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:39:44.054055 2564 scope.go:117] "RemoveContainer" containerID="13a06900abea6b4987faec6bf112bbce388617d8a8c345e44e8482e3b27c9d8f" Sep 09 08:39:44.054302 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:39:44.054282 2564 scope.go:117] "RemoveContainer" containerID="01daed94e9eb6ab9f92915f162f61d8126b22800b02f0ca1b79fa667080fd550" Sep 09 08:39:44.054501 ip-10-0-137-144 kubenswrapper[2564]: E0909 08:39:44.054480 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-85b454874b-tdfqx_openshift-console-operator(f81169f8-3c85-4cd7-8b59-684973ff46f7)\"" pod="openshift-console-operator/console-operator-85b454874b-tdfqx" podUID="f81169f8-3c85-4cd7-8b59-684973ff46f7" Sep 09 08:39:44.356001 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:39:44.355961 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-fdbb8fdff-cdz72"] Sep 09 08:39:44.393772 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:39:44.393740 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-fdbb8fdff-cdz72"] Sep 09 08:39:44.393909 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:39:44.393839 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-fdbb8fdff-cdz72" Sep 09 08:39:44.395961 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:39:44.395931 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\"" Sep 09 08:39:44.396092 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:39:44.396076 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-6gtn5\"" Sep 09 08:39:44.396153 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:39:44.396070 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\"" Sep 09 08:39:44.529016 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:39:44.528985 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6vfhg\" (UniqueName: \"kubernetes.io/projected/2fb3fbb8-ab1e-41bd-bee8-f5fbf7872e2d-kube-api-access-6vfhg\") pod \"migrator-fdbb8fdff-cdz72\" (UID: \"2fb3fbb8-ab1e-41bd-bee8-f5fbf7872e2d\") " pod="openshift-kube-storage-version-migrator/migrator-fdbb8fdff-cdz72" Sep 09 08:39:44.629961 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:39:44.629892 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6vfhg\" (UniqueName: \"kubernetes.io/projected/2fb3fbb8-ab1e-41bd-bee8-f5fbf7872e2d-kube-api-access-6vfhg\") pod \"migrator-fdbb8fdff-cdz72\" (UID: \"2fb3fbb8-ab1e-41bd-bee8-f5fbf7872e2d\") " pod="openshift-kube-storage-version-migrator/migrator-fdbb8fdff-cdz72" Sep 09 08:39:44.638238 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:39:44.638207 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6vfhg\" (UniqueName: \"kubernetes.io/projected/2fb3fbb8-ab1e-41bd-bee8-f5fbf7872e2d-kube-api-access-6vfhg\") pod \"migrator-fdbb8fdff-cdz72\" (UID: \"2fb3fbb8-ab1e-41bd-bee8-f5fbf7872e2d\") " pod="openshift-kube-storage-version-migrator/migrator-fdbb8fdff-cdz72" Sep 09 08:39:44.702900 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:39:44.702868 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-fdbb8fdff-cdz72" Sep 09 08:39:44.993776 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:39:44.993698 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-fdbb8fdff-cdz72"] Sep 09 08:39:44.996644 ip-10-0-137-144 kubenswrapper[2564]: W0909 08:39:44.996615 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2fb3fbb8_ab1e_41bd_bee8_f5fbf7872e2d.slice/crio-04ddaa83f0b3e25f236ad9f325a8ab6f52d8fa5421ef44094e9d63edf3ecfb7d WatchSource:0}: Error finding container 04ddaa83f0b3e25f236ad9f325a8ab6f52d8fa5421ef44094e9d63edf3ecfb7d: Status 404 returned error can't find the container with id 04ddaa83f0b3e25f236ad9f325a8ab6f52d8fa5421ef44094e9d63edf3ecfb7d Sep 09 08:39:45.059167 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:39:45.059149 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-tdfqx_f81169f8-3c85-4cd7-8b59-684973ff46f7/console-operator/1.log" Sep 09 08:39:45.059571 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:39:45.059553 2564 scope.go:117] "RemoveContainer" containerID="01daed94e9eb6ab9f92915f162f61d8126b22800b02f0ca1b79fa667080fd550" Sep 09 08:39:45.059753 ip-10-0-137-144 kubenswrapper[2564]: E0909 08:39:45.059728 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-85b454874b-tdfqx_openshift-console-operator(f81169f8-3c85-4cd7-8b59-684973ff46f7)\"" pod="openshift-console-operator/console-operator-85b454874b-tdfqx" podUID="f81169f8-3c85-4cd7-8b59-684973ff46f7" Sep 09 08:39:45.060507 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:39:45.060484 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-fdbb8fdff-cdz72" event={"ID":"2fb3fbb8-ab1e-41bd-bee8-f5fbf7872e2d","Type":"ContainerStarted","Data":"04ddaa83f0b3e25f236ad9f325a8ab6f52d8fa5421ef44094e9d63edf3ecfb7d"} Sep 09 08:39:47.068825 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:39:47.068783 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-fdbb8fdff-cdz72" event={"ID":"2fb3fbb8-ab1e-41bd-bee8-f5fbf7872e2d","Type":"ContainerStarted","Data":"05828d76dba8534800c62f5c7f8e3d48a347cbe1c7e705db210a5f61775aee05"} Sep 09 08:39:47.069213 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:39:47.068850 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-fdbb8fdff-cdz72" event={"ID":"2fb3fbb8-ab1e-41bd-bee8-f5fbf7872e2d","Type":"ContainerStarted","Data":"0a0522a4848d56f934550dfd3f1e92a7d837d1af5e843b25f8fe896663ca0d54"} Sep 09 08:39:47.087723 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:39:47.084925 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-fdbb8fdff-cdz72" podStartSLOduration=1.5597438559999999 podStartE2EDuration="3.084906368s" totalImagesPullingTime="1.525162512s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 08:39:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 08:39:47.084517708 +0000 UTC m=+47.782401613" watchObservedRunningTime="2026-09-09 08:39:47.084906368 +0000 UTC m=+47.782790271" Sep 09 08:39:48.863586 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:39:48.863545 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/fbc63112-9a58-49c8-b9e2-830f9e027723-registry-tls\") pod \"image-registry-5d984d89dd-r8hr5\" (UID: \"fbc63112-9a58-49c8-b9e2-830f9e027723\") " pod="openshift-image-registry/image-registry-5d984d89dd-r8hr5" Sep 09 08:39:48.864050 ip-10-0-137-144 kubenswrapper[2564]: E0909 08:39:48.863696 2564 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Sep 09 08:39:48.864050 ip-10-0-137-144 kubenswrapper[2564]: E0909 08:39:48.863714 2564 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5d984d89dd-r8hr5: secret "image-registry-tls" not found Sep 09 08:39:48.864050 ip-10-0-137-144 kubenswrapper[2564]: E0909 08:39:48.863783 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/fbc63112-9a58-49c8-b9e2-830f9e027723-registry-tls podName:fbc63112-9a58-49c8-b9e2-830f9e027723 nodeName:}" failed. No retries permitted until 2026-09-09 08:40:04.863763576 +0000 UTC m=+65.561647466 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/fbc63112-9a58-49c8-b9e2-830f9e027723-registry-tls") pod "image-registry-5d984d89dd-r8hr5" (UID: "fbc63112-9a58-49c8-b9e2-830f9e027723") : secret "image-registry-tls" not found Sep 09 08:39:48.964633 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:39:48.964587 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/025bcb2f-08a5-4ea4-98f9-8ca84afd9b33-metrics-tls\") pod \"dns-default-v2cwj\" (UID: \"025bcb2f-08a5-4ea4-98f9-8ca84afd9b33\") " pod="openshift-dns/dns-default-v2cwj" Sep 09 08:39:48.964819 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:39:48.964644 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/7b2288b4-72fd-45bc-a286-f1ff2580d3cc-networking-console-plugin-cert\") pod \"networking-console-plugin-79977f9844-9nmsv\" (UID: \"7b2288b4-72fd-45bc-a286-f1ff2580d3cc\") " pod="openshift-network-console/networking-console-plugin-79977f9844-9nmsv" Sep 09 08:39:48.964819 ip-10-0-137-144 kubenswrapper[2564]: E0909 08:39:48.964747 2564 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 09 08:39:48.964819 ip-10-0-137-144 kubenswrapper[2564]: E0909 08:39:48.964799 2564 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Sep 09 08:39:48.964925 ip-10-0-137-144 kubenswrapper[2564]: E0909 08:39:48.964823 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/025bcb2f-08a5-4ea4-98f9-8ca84afd9b33-metrics-tls podName:025bcb2f-08a5-4ea4-98f9-8ca84afd9b33 nodeName:}" failed. No retries permitted until 2026-09-09 08:40:04.964807846 +0000 UTC m=+65.662691725 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/025bcb2f-08a5-4ea4-98f9-8ca84afd9b33-metrics-tls") pod "dns-default-v2cwj" (UID: "025bcb2f-08a5-4ea4-98f9-8ca84afd9b33") : secret "dns-default-metrics-tls" not found Sep 09 08:39:48.964925 ip-10-0-137-144 kubenswrapper[2564]: E0909 08:39:48.964850 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7b2288b4-72fd-45bc-a286-f1ff2580d3cc-networking-console-plugin-cert podName:7b2288b4-72fd-45bc-a286-f1ff2580d3cc nodeName:}" failed. No retries permitted until 2026-09-09 08:40:04.96483697 +0000 UTC m=+65.662720891 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/7b2288b4-72fd-45bc-a286-f1ff2580d3cc-networking-console-plugin-cert") pod "networking-console-plugin-79977f9844-9nmsv" (UID: "7b2288b4-72fd-45bc-a286-f1ff2580d3cc") : secret "networking-console-plugin-cert" not found Sep 09 08:39:53.356518 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:39:53.356481 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-85b454874b-tdfqx" Sep 09 08:39:53.356901 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:39:53.356541 2564 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-85b454874b-tdfqx" Sep 09 08:39:53.356901 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:39:53.356856 2564 scope.go:117] "RemoveContainer" containerID="01daed94e9eb6ab9f92915f162f61d8126b22800b02f0ca1b79fa667080fd550" Sep 09 08:39:54.092221 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:39:54.092194 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-tdfqx_f81169f8-3c85-4cd7-8b59-684973ff46f7/console-operator/2.log" Sep 09 08:39:54.092622 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:39:54.092608 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-tdfqx_f81169f8-3c85-4cd7-8b59-684973ff46f7/console-operator/1.log" Sep 09 08:39:54.092667 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:39:54.092638 2564 generic.go:356] "Generic (PLEG): container finished" podID="f81169f8-3c85-4cd7-8b59-684973ff46f7" containerID="2c4f9a120ef7c95b800c69d644e211fc6c0d796fa8971677bd99dddce92e836c" exitCode=255 Sep 09 08:39:54.092709 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:39:54.092676 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-85b454874b-tdfqx" event={"ID":"f81169f8-3c85-4cd7-8b59-684973ff46f7","Type":"ContainerDied","Data":"2c4f9a120ef7c95b800c69d644e211fc6c0d796fa8971677bd99dddce92e836c"} Sep 09 08:39:54.092744 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:39:54.092725 2564 scope.go:117] "RemoveContainer" containerID="01daed94e9eb6ab9f92915f162f61d8126b22800b02f0ca1b79fa667080fd550" Sep 09 08:39:54.093038 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:39:54.093016 2564 scope.go:117] "RemoveContainer" containerID="2c4f9a120ef7c95b800c69d644e211fc6c0d796fa8971677bd99dddce92e836c" Sep 09 08:39:54.093222 ip-10-0-137-144 kubenswrapper[2564]: E0909 08:39:54.093200 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 20s restarting failed container=console-operator pod=console-operator-85b454874b-tdfqx_openshift-console-operator(f81169f8-3c85-4cd7-8b59-684973ff46f7)\"" pod="openshift-console-operator/console-operator-85b454874b-tdfqx" podUID="f81169f8-3c85-4cd7-8b59-684973ff46f7" Sep 09 08:39:55.097274 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:39:55.097246 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-tdfqx_f81169f8-3c85-4cd7-8b59-684973ff46f7/console-operator/2.log" Sep 09 08:39:59.964616 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:39:59.964588 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-4h8qf" Sep 09 08:40:03.357153 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:40:03.357106 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-85b454874b-tdfqx" Sep 09 08:40:03.357153 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:40:03.357169 2564 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-85b454874b-tdfqx" Sep 09 08:40:03.357605 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:40:03.357491 2564 scope.go:117] "RemoveContainer" containerID="2c4f9a120ef7c95b800c69d644e211fc6c0d796fa8971677bd99dddce92e836c" Sep 09 08:40:03.357660 ip-10-0-137-144 kubenswrapper[2564]: E0909 08:40:03.357639 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 20s restarting failed container=console-operator pod=console-operator-85b454874b-tdfqx_openshift-console-operator(f81169f8-3c85-4cd7-8b59-684973ff46f7)\"" pod="openshift-console-operator/console-operator-85b454874b-tdfqx" podUID="f81169f8-3c85-4cd7-8b59-684973ff46f7" Sep 09 08:40:04.879721 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:40:04.879672 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/fbc63112-9a58-49c8-b9e2-830f9e027723-registry-tls\") pod \"image-registry-5d984d89dd-r8hr5\" (UID: \"fbc63112-9a58-49c8-b9e2-830f9e027723\") " pod="openshift-image-registry/image-registry-5d984d89dd-r8hr5" Sep 09 08:40:04.882021 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:40:04.881999 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/fbc63112-9a58-49c8-b9e2-830f9e027723-registry-tls\") pod \"image-registry-5d984d89dd-r8hr5\" (UID: \"fbc63112-9a58-49c8-b9e2-830f9e027723\") " pod="openshift-image-registry/image-registry-5d984d89dd-r8hr5" Sep 09 08:40:04.980439 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:40:04.980393 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/7b2288b4-72fd-45bc-a286-f1ff2580d3cc-networking-console-plugin-cert\") pod \"networking-console-plugin-79977f9844-9nmsv\" (UID: \"7b2288b4-72fd-45bc-a286-f1ff2580d3cc\") " pod="openshift-network-console/networking-console-plugin-79977f9844-9nmsv" Sep 09 08:40:04.980610 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:40:04.980489 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/025bcb2f-08a5-4ea4-98f9-8ca84afd9b33-metrics-tls\") pod \"dns-default-v2cwj\" (UID: \"025bcb2f-08a5-4ea4-98f9-8ca84afd9b33\") " pod="openshift-dns/dns-default-v2cwj" Sep 09 08:40:04.982751 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:40:04.982720 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/025bcb2f-08a5-4ea4-98f9-8ca84afd9b33-metrics-tls\") pod \"dns-default-v2cwj\" (UID: \"025bcb2f-08a5-4ea4-98f9-8ca84afd9b33\") " pod="openshift-dns/dns-default-v2cwj" Sep 09 08:40:04.982751 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:40:04.982735 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/7b2288b4-72fd-45bc-a286-f1ff2580d3cc-networking-console-plugin-cert\") pod \"networking-console-plugin-79977f9844-9nmsv\" (UID: \"7b2288b4-72fd-45bc-a286-f1ff2580d3cc\") " pod="openshift-network-console/networking-console-plugin-79977f9844-9nmsv" Sep 09 08:40:05.166151 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:40:05.166070 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-722gc\"" Sep 09 08:40:05.173892 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:40:05.173868 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5d984d89dd-r8hr5" Sep 09 08:40:05.201388 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:40:05.201366 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-zfltp\"" Sep 09 08:40:05.210158 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:40:05.210127 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-v2cwj" Sep 09 08:40:05.233733 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:40:05.233704 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-5k2vx\"" Sep 09 08:40:05.241763 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:40:05.241740 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-79977f9844-9nmsv" Sep 09 08:40:05.443529 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:40:05.443456 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-5d984d89dd-r8hr5"] Sep 09 08:40:05.446687 ip-10-0-137-144 kubenswrapper[2564]: W0909 08:40:05.446661 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfbc63112_9a58_49c8_b9e2_830f9e027723.slice/crio-3c3742d68c94ccf2643345bd83d4b9eaaef14977329cf59d82f31196bfef839d WatchSource:0}: Error finding container 3c3742d68c94ccf2643345bd83d4b9eaaef14977329cf59d82f31196bfef839d: Status 404 returned error can't find the container with id 3c3742d68c94ccf2643345bd83d4b9eaaef14977329cf59d82f31196bfef839d Sep 09 08:40:05.495354 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:40:05.495309 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-v2cwj"] Sep 09 08:40:05.498985 ip-10-0-137-144 kubenswrapper[2564]: W0909 08:40:05.498963 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod025bcb2f_08a5_4ea4_98f9_8ca84afd9b33.slice/crio-960de33297dced24271bbb3c95ddfa3b917f2a892a8fe495ec6a2656798c8162 WatchSource:0}: Error finding container 960de33297dced24271bbb3c95ddfa3b917f2a892a8fe495ec6a2656798c8162: Status 404 returned error can't find the container with id 960de33297dced24271bbb3c95ddfa3b917f2a892a8fe495ec6a2656798c8162 Sep 09 08:40:05.517504 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:40:05.517480 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-79977f9844-9nmsv"] Sep 09 08:40:05.520134 ip-10-0-137-144 kubenswrapper[2564]: W0909 08:40:05.520105 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7b2288b4_72fd_45bc_a286_f1ff2580d3cc.slice/crio-821c437ab772f6e2e3a456a8cb4dec7c286119c26c99246fc09431621ac154a1 WatchSource:0}: Error finding container 821c437ab772f6e2e3a456a8cb4dec7c286119c26c99246fc09431621ac154a1: Status 404 returned error can't find the container with id 821c437ab772f6e2e3a456a8cb4dec7c286119c26c99246fc09431621ac154a1 Sep 09 08:40:05.585245 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:40:05.585217 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/950a27f9-3274-48f2-a23e-21f86398eb00-original-pull-secret\") pod \"global-pull-secret-syncer-dvhwl\" (UID: \"950a27f9-3274-48f2-a23e-21f86398eb00\") " pod="kube-system/global-pull-secret-syncer-dvhwl" Sep 09 08:40:05.585421 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:40:05.585268 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/50f8cfa3-6f41-47be-899d-cf16c3251f84-metrics-certs\") pod \"network-metrics-daemon-b2965\" (UID: \"50f8cfa3-6f41-47be-899d-cf16c3251f84\") " pod="openshift-multus/network-metrics-daemon-b2965" Sep 09 08:40:05.587646 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:40:05.587628 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Sep 09 08:40:05.587704 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:40:05.587630 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Sep 09 08:40:05.598682 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:40:05.598652 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/50f8cfa3-6f41-47be-899d-cf16c3251f84-metrics-certs\") pod \"network-metrics-daemon-b2965\" (UID: \"50f8cfa3-6f41-47be-899d-cf16c3251f84\") " pod="openshift-multus/network-metrics-daemon-b2965" Sep 09 08:40:05.598813 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:40:05.598791 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/950a27f9-3274-48f2-a23e-21f86398eb00-original-pull-secret\") pod \"global-pull-secret-syncer-dvhwl\" (UID: \"950a27f9-3274-48f2-a23e-21f86398eb00\") " pod="kube-system/global-pull-secret-syncer-dvhwl" Sep 09 08:40:05.616864 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:40:05.616849 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dvhwl" Sep 09 08:40:05.625465 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:40:05.625444 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-4bf2n\"" Sep 09 08:40:05.634271 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:40:05.634238 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-b2965" Sep 09 08:40:05.895681 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:40:05.895650 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-dvhwl"] Sep 09 08:40:05.898606 ip-10-0-137-144 kubenswrapper[2564]: W0909 08:40:05.898580 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod950a27f9_3274_48f2_a23e_21f86398eb00.slice/crio-182abb816168253289e401004d65c150cb3c793cddeb25861abb0796c166294c WatchSource:0}: Error finding container 182abb816168253289e401004d65c150cb3c793cddeb25861abb0796c166294c: Status 404 returned error can't find the container with id 182abb816168253289e401004d65c150cb3c793cddeb25861abb0796c166294c Sep 09 08:40:05.927096 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:40:05.927073 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-b2965"] Sep 09 08:40:05.929692 ip-10-0-137-144 kubenswrapper[2564]: W0909 08:40:05.929670 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod50f8cfa3_6f41_47be_899d_cf16c3251f84.slice/crio-6ebb45e04ad1f7387bae6c4f00863b5e511ea95ee32cf481f4d3a0b2294c8d1b WatchSource:0}: Error finding container 6ebb45e04ad1f7387bae6c4f00863b5e511ea95ee32cf481f4d3a0b2294c8d1b: Status 404 returned error can't find the container with id 6ebb45e04ad1f7387bae6c4f00863b5e511ea95ee32cf481f4d3a0b2294c8d1b Sep 09 08:40:06.131325 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:40:06.131286 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-b2965" event={"ID":"50f8cfa3-6f41-47be-899d-cf16c3251f84","Type":"ContainerStarted","Data":"6ebb45e04ad1f7387bae6c4f00863b5e511ea95ee32cf481f4d3a0b2294c8d1b"} Sep 09 08:40:06.133144 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:40:06.133071 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-v2cwj" event={"ID":"025bcb2f-08a5-4ea4-98f9-8ca84afd9b33","Type":"ContainerStarted","Data":"960de33297dced24271bbb3c95ddfa3b917f2a892a8fe495ec6a2656798c8162"} Sep 09 08:40:06.134575 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:40:06.134549 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-79977f9844-9nmsv" event={"ID":"7b2288b4-72fd-45bc-a286-f1ff2580d3cc","Type":"ContainerStarted","Data":"821c437ab772f6e2e3a456a8cb4dec7c286119c26c99246fc09431621ac154a1"} Sep 09 08:40:06.135845 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:40:06.135814 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-dvhwl" event={"ID":"950a27f9-3274-48f2-a23e-21f86398eb00","Type":"ContainerStarted","Data":"182abb816168253289e401004d65c150cb3c793cddeb25861abb0796c166294c"} Sep 09 08:40:06.137504 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:40:06.137471 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5d984d89dd-r8hr5" event={"ID":"fbc63112-9a58-49c8-b9e2-830f9e027723","Type":"ContainerStarted","Data":"e7f70e888910bfb8163d6d0007aae8701850a570e3520620f9aa2b9159063276"} Sep 09 08:40:06.137595 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:40:06.137515 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5d984d89dd-r8hr5" event={"ID":"fbc63112-9a58-49c8-b9e2-830f9e027723","Type":"ContainerStarted","Data":"3c3742d68c94ccf2643345bd83d4b9eaaef14977329cf59d82f31196bfef839d"} Sep 09 08:40:06.137654 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:40:06.137616 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-5d984d89dd-r8hr5" Sep 09 08:40:06.195058 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:40:06.195010 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-5d984d89dd-r8hr5" podStartSLOduration=66.194993723 podStartE2EDuration="1m6.194993723s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 08:39:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 08:40:06.192428165 +0000 UTC m=+66.890312069" watchObservedRunningTime="2026-09-09 08:40:06.194993723 +0000 UTC m=+66.892877624" Sep 09 08:40:06.203843 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:40:06.203587 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-6cdcc96965-q4nst"] Sep 09 08:40:06.209547 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:40:06.209151 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-57d46cff9d-b89s4"] Sep 09 08:40:06.210085 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:40:06.210064 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-q4nst" Sep 09 08:40:06.211482 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:40:06.211460 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-57d46cff9d-b89s4" Sep 09 08:40:06.216411 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:40:06.216374 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Sep 09 08:40:06.216547 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:40:06.216530 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\"" Sep 09 08:40:06.217066 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:40:06.216412 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\"" Sep 09 08:40:06.217066 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:40:06.216464 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-2xdn7\"" Sep 09 08:40:06.217066 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:40:06.216753 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-hub-kubeconfig\"" Sep 09 08:40:06.217066 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:40:06.216443 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Sep 09 08:40:06.217066 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:40:06.216893 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-ca\"" Sep 09 08:40:06.217066 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:40:06.216906 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\"" Sep 09 08:40:06.217066 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:40:06.216958 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-open-cluster-management.io-proxy-agent-signer-client-cert\"" Sep 09 08:40:06.217066 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:40:06.216966 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\"" Sep 09 08:40:06.217066 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:40:06.216992 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-service-proxy-server-certificates\"" Sep 09 08:40:06.217599 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:40:06.217082 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\"" Sep 09 08:40:06.225443 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:40:06.225316 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-6cdcc96965-q4nst"] Sep 09 08:40:06.226550 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:40:06.226515 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-57d46cff9d-b89s4"] Sep 09 08:40:06.291627 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:40:06.291593 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/6cc349f7-f7df-4e63-86e7-e99c32f6ebaa-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-57d46cff9d-b89s4\" (UID: \"6cc349f7-f7df-4e63-86e7-e99c32f6ebaa\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-57d46cff9d-b89s4" Sep 09 08:40:06.291627 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:40:06.291628 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/15de325d-9020-4dc9-8666-b1b02a3b2e2e-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cdcc96965-q4nst\" (UID: \"15de325d-9020-4dc9-8666-b1b02a3b2e2e\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-q4nst" Sep 09 08:40:06.291861 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:40:06.291694 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/6cc349f7-f7df-4e63-86e7-e99c32f6ebaa-hub\") pod \"cluster-proxy-proxy-agent-57d46cff9d-b89s4\" (UID: \"6cc349f7-f7df-4e63-86e7-e99c32f6ebaa\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-57d46cff9d-b89s4" Sep 09 08:40:06.291861 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:40:06.291740 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wrzzr\" (UniqueName: \"kubernetes.io/projected/15de325d-9020-4dc9-8666-b1b02a3b2e2e-kube-api-access-wrzzr\") pod \"cluster-monitoring-operator-6cdcc96965-q4nst\" (UID: \"15de325d-9020-4dc9-8666-b1b02a3b2e2e\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-q4nst" Sep 09 08:40:06.291861 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:40:06.291771 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/6cc349f7-f7df-4e63-86e7-e99c32f6ebaa-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-57d46cff9d-b89s4\" (UID: \"6cc349f7-f7df-4e63-86e7-e99c32f6ebaa\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-57d46cff9d-b89s4" Sep 09 08:40:06.291861 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:40:06.291810 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/6cc349f7-f7df-4e63-86e7-e99c32f6ebaa-additional-service-ca\") pod \"cluster-proxy-proxy-agent-57d46cff9d-b89s4\" (UID: \"6cc349f7-f7df-4e63-86e7-e99c32f6ebaa\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-57d46cff9d-b89s4" Sep 09 08:40:06.292067 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:40:06.291863 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/6cc349f7-f7df-4e63-86e7-e99c32f6ebaa-ca\") pod \"cluster-proxy-proxy-agent-57d46cff9d-b89s4\" (UID: \"6cc349f7-f7df-4e63-86e7-e99c32f6ebaa\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-57d46cff9d-b89s4" Sep 09 08:40:06.292067 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:40:06.291888 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j9kvw\" (UniqueName: \"kubernetes.io/projected/6cc349f7-f7df-4e63-86e7-e99c32f6ebaa-kube-api-access-j9kvw\") pod \"cluster-proxy-proxy-agent-57d46cff9d-b89s4\" (UID: \"6cc349f7-f7df-4e63-86e7-e99c32f6ebaa\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-57d46cff9d-b89s4" Sep 09 08:40:06.292067 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:40:06.291918 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/15de325d-9020-4dc9-8666-b1b02a3b2e2e-telemetry-config\") pod \"cluster-monitoring-operator-6cdcc96965-q4nst\" (UID: \"15de325d-9020-4dc9-8666-b1b02a3b2e2e\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-q4nst" Sep 09 08:40:06.393122 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:40:06.393042 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/6cc349f7-f7df-4e63-86e7-e99c32f6ebaa-ca\") pod \"cluster-proxy-proxy-agent-57d46cff9d-b89s4\" (UID: \"6cc349f7-f7df-4e63-86e7-e99c32f6ebaa\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-57d46cff9d-b89s4" Sep 09 08:40:06.393122 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:40:06.393090 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j9kvw\" (UniqueName: \"kubernetes.io/projected/6cc349f7-f7df-4e63-86e7-e99c32f6ebaa-kube-api-access-j9kvw\") pod \"cluster-proxy-proxy-agent-57d46cff9d-b89s4\" (UID: \"6cc349f7-f7df-4e63-86e7-e99c32f6ebaa\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-57d46cff9d-b89s4" Sep 09 08:40:06.393358 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:40:06.393124 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/15de325d-9020-4dc9-8666-b1b02a3b2e2e-telemetry-config\") pod \"cluster-monitoring-operator-6cdcc96965-q4nst\" (UID: \"15de325d-9020-4dc9-8666-b1b02a3b2e2e\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-q4nst" Sep 09 08:40:06.393358 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:40:06.393155 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/6cc349f7-f7df-4e63-86e7-e99c32f6ebaa-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-57d46cff9d-b89s4\" (UID: \"6cc349f7-f7df-4e63-86e7-e99c32f6ebaa\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-57d46cff9d-b89s4" Sep 09 08:40:06.393358 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:40:06.393188 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/15de325d-9020-4dc9-8666-b1b02a3b2e2e-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cdcc96965-q4nst\" (UID: \"15de325d-9020-4dc9-8666-b1b02a3b2e2e\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-q4nst" Sep 09 08:40:06.393358 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:40:06.393231 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/6cc349f7-f7df-4e63-86e7-e99c32f6ebaa-hub\") pod \"cluster-proxy-proxy-agent-57d46cff9d-b89s4\" (UID: \"6cc349f7-f7df-4e63-86e7-e99c32f6ebaa\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-57d46cff9d-b89s4" Sep 09 08:40:06.393358 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:40:06.393257 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wrzzr\" (UniqueName: \"kubernetes.io/projected/15de325d-9020-4dc9-8666-b1b02a3b2e2e-kube-api-access-wrzzr\") pod \"cluster-monitoring-operator-6cdcc96965-q4nst\" (UID: \"15de325d-9020-4dc9-8666-b1b02a3b2e2e\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-q4nst" Sep 09 08:40:06.393358 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:40:06.393288 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/6cc349f7-f7df-4e63-86e7-e99c32f6ebaa-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-57d46cff9d-b89s4\" (UID: \"6cc349f7-f7df-4e63-86e7-e99c32f6ebaa\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-57d46cff9d-b89s4" Sep 09 08:40:06.393358 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:40:06.393330 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/6cc349f7-f7df-4e63-86e7-e99c32f6ebaa-additional-service-ca\") pod \"cluster-proxy-proxy-agent-57d46cff9d-b89s4\" (UID: \"6cc349f7-f7df-4e63-86e7-e99c32f6ebaa\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-57d46cff9d-b89s4" Sep 09 08:40:06.394549 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:40:06.394231 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/15de325d-9020-4dc9-8666-b1b02a3b2e2e-telemetry-config\") pod \"cluster-monitoring-operator-6cdcc96965-q4nst\" (UID: \"15de325d-9020-4dc9-8666-b1b02a3b2e2e\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-q4nst" Sep 09 08:40:06.394667 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:40:06.394568 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/6cc349f7-f7df-4e63-86e7-e99c32f6ebaa-additional-service-ca\") pod \"cluster-proxy-proxy-agent-57d46cff9d-b89s4\" (UID: \"6cc349f7-f7df-4e63-86e7-e99c32f6ebaa\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-57d46cff9d-b89s4" Sep 09 08:40:06.397191 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:40:06.396722 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca\" (UniqueName: \"kubernetes.io/secret/6cc349f7-f7df-4e63-86e7-e99c32f6ebaa-ca\") pod \"cluster-proxy-proxy-agent-57d46cff9d-b89s4\" (UID: \"6cc349f7-f7df-4e63-86e7-e99c32f6ebaa\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-57d46cff9d-b89s4" Sep 09 08:40:06.397191 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:40:06.396825 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub\" (UniqueName: \"kubernetes.io/secret/6cc349f7-f7df-4e63-86e7-e99c32f6ebaa-hub\") pod \"cluster-proxy-proxy-agent-57d46cff9d-b89s4\" (UID: \"6cc349f7-f7df-4e63-86e7-e99c32f6ebaa\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-57d46cff9d-b89s4" Sep 09 08:40:06.397191 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:40:06.397149 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/6cc349f7-f7df-4e63-86e7-e99c32f6ebaa-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-57d46cff9d-b89s4\" (UID: \"6cc349f7-f7df-4e63-86e7-e99c32f6ebaa\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-57d46cff9d-b89s4" Sep 09 08:40:06.398146 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:40:06.398116 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/15de325d-9020-4dc9-8666-b1b02a3b2e2e-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cdcc96965-q4nst\" (UID: \"15de325d-9020-4dc9-8666-b1b02a3b2e2e\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-q4nst" Sep 09 08:40:06.398545 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:40:06.398504 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/6cc349f7-f7df-4e63-86e7-e99c32f6ebaa-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-57d46cff9d-b89s4\" (UID: \"6cc349f7-f7df-4e63-86e7-e99c32f6ebaa\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-57d46cff9d-b89s4" Sep 09 08:40:06.405828 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:40:06.405801 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-j9kvw\" (UniqueName: \"kubernetes.io/projected/6cc349f7-f7df-4e63-86e7-e99c32f6ebaa-kube-api-access-j9kvw\") pod \"cluster-proxy-proxy-agent-57d46cff9d-b89s4\" (UID: \"6cc349f7-f7df-4e63-86e7-e99c32f6ebaa\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-57d46cff9d-b89s4" Sep 09 08:40:06.409782 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:40:06.409759 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wrzzr\" (UniqueName: \"kubernetes.io/projected/15de325d-9020-4dc9-8666-b1b02a3b2e2e-kube-api-access-wrzzr\") pod \"cluster-monitoring-operator-6cdcc96965-q4nst\" (UID: \"15de325d-9020-4dc9-8666-b1b02a3b2e2e\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-q4nst" Sep 09 08:40:06.526854 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:40:06.526820 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-q4nst" Sep 09 08:40:06.539660 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:40:06.539637 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-57d46cff9d-b89s4" Sep 09 08:40:06.811479 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:40:06.811408 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-6cdcc96965-q4nst"] Sep 09 08:40:06.817804 ip-10-0-137-144 kubenswrapper[2564]: W0909 08:40:06.817768 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod15de325d_9020_4dc9_8666_b1b02a3b2e2e.slice/crio-7aaa9dafb747ebe4f8d8fa10a81a500535a59775c59fb74cc91c462f3e767d0e WatchSource:0}: Error finding container 7aaa9dafb747ebe4f8d8fa10a81a500535a59775c59fb74cc91c462f3e767d0e: Status 404 returned error can't find the container with id 7aaa9dafb747ebe4f8d8fa10a81a500535a59775c59fb74cc91c462f3e767d0e Sep 09 08:40:06.830418 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:40:06.830383 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-57d46cff9d-b89s4"] Sep 09 08:40:06.835667 ip-10-0-137-144 kubenswrapper[2564]: W0909 08:40:06.835631 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod6cc349f7_f7df_4e63_86e7_e99c32f6ebaa.slice/crio-ea7a16e6936209f12b16535af3b391c84ddc65e57bc0d2c8b26aa6d48c92c540 WatchSource:0}: Error finding container ea7a16e6936209f12b16535af3b391c84ddc65e57bc0d2c8b26aa6d48c92c540: Status 404 returned error can't find the container with id ea7a16e6936209f12b16535af3b391c84ddc65e57bc0d2c8b26aa6d48c92c540 Sep 09 08:40:07.144549 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:40:07.144469 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-q4nst" event={"ID":"15de325d-9020-4dc9-8666-b1b02a3b2e2e","Type":"ContainerStarted","Data":"7aaa9dafb747ebe4f8d8fa10a81a500535a59775c59fb74cc91c462f3e767d0e"} Sep 09 08:40:07.146883 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:40:07.146848 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-79977f9844-9nmsv" event={"ID":"7b2288b4-72fd-45bc-a286-f1ff2580d3cc","Type":"ContainerStarted","Data":"255e86d5164bd0f2a040d2ea3ebdfa62541f9359cfb8449b23eff4d5b0b82dee"} Sep 09 08:40:07.148992 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:40:07.148940 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-57d46cff9d-b89s4" event={"ID":"6cc349f7-f7df-4e63-86e7-e99c32f6ebaa","Type":"ContainerStarted","Data":"ea7a16e6936209f12b16535af3b391c84ddc65e57bc0d2c8b26aa6d48c92c540"} Sep 09 08:40:07.161082 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:40:07.161016 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-console/networking-console-plugin-79977f9844-9nmsv" podStartSLOduration=34.109290757 podStartE2EDuration="35.160995423s" totalImagesPullingTime="1.051704666s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 08:39:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 08:40:07.160116449 +0000 UTC m=+67.858000351" watchObservedRunningTime="2026-09-09 08:40:07.160995423 +0000 UTC m=+67.858879327" Sep 09 08:40:08.157916 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:40:08.157801 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-b2965" event={"ID":"50f8cfa3-6f41-47be-899d-cf16c3251f84","Type":"ContainerStarted","Data":"e5a3f647f882727790caa46fa99cc1ff893f5d74d5aced02a0f5894b6e7aa273"} Sep 09 08:40:08.157916 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:40:08.157873 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-b2965" event={"ID":"50f8cfa3-6f41-47be-899d-cf16c3251f84","Type":"ContainerStarted","Data":"96cda238ab202d3f221e2c5346e9a42429fb1671ccf230b9ea6aaf453bf57e0b"} Sep 09 08:40:08.160986 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:40:08.160839 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-v2cwj" event={"ID":"025bcb2f-08a5-4ea4-98f9-8ca84afd9b33","Type":"ContainerStarted","Data":"3aa541d408ea9f6acc351050243841a508bcc3954bc5966fa019ebcbb8cd62d1"} Sep 09 08:40:08.160986 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:40:08.160890 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-v2cwj" event={"ID":"025bcb2f-08a5-4ea4-98f9-8ca84afd9b33","Type":"ContainerStarted","Data":"76a26fa38fc8889a3ca95bb987004ef97c80d9a57772f106eee3483762d00a8a"} Sep 09 08:40:08.161171 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:40:08.160995 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-v2cwj" Sep 09 08:40:08.173754 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:40:08.173684 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-b2965" podStartSLOduration=66.370372088 podStartE2EDuration="1m8.17366534s" totalImagesPullingTime="1.803293252s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 08:39:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 08:40:08.173251694 +0000 UTC m=+68.871135596" watchObservedRunningTime="2026-09-09 08:40:08.17366534 +0000 UTC m=+68.871549243" Sep 09 08:40:08.188801 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:40:08.187783 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-v2cwj" podStartSLOduration=32.951373763 podStartE2EDuration="35.18776442s" totalImagesPullingTime="2.236390657s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 08:39:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 08:40:08.187178471 +0000 UTC m=+68.885062376" watchObservedRunningTime="2026-09-09 08:40:08.18776442 +0000 UTC m=+68.885648324" Sep 09 08:40:12.682803 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:40:12.682768 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-mk45q"] Sep 09 08:40:12.706378 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:40:12.706346 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-mk45q"] Sep 09 08:40:12.706563 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:40:12.706445 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-mk45q" Sep 09 08:40:12.708703 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:40:12.708645 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Sep 09 08:40:12.708703 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:40:12.708659 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-9cg75\"" Sep 09 08:40:12.708703 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:40:12.708669 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Sep 09 08:40:12.709040 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:40:12.708643 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Sep 09 08:40:12.709265 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:40:12.709245 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Sep 09 08:40:12.743159 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:40:12.743134 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/48111af4-bcee-4838-9408-fafc202c8f7b-data-volume\") pod \"insights-runtime-extractor-mk45q\" (UID: \"48111af4-bcee-4838-9408-fafc202c8f7b\") " pod="openshift-insights/insights-runtime-extractor-mk45q" Sep 09 08:40:12.743297 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:40:12.743172 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/48111af4-bcee-4838-9408-fafc202c8f7b-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-mk45q\" (UID: \"48111af4-bcee-4838-9408-fafc202c8f7b\") " pod="openshift-insights/insights-runtime-extractor-mk45q" Sep 09 08:40:12.743297 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:40:12.743192 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/48111af4-bcee-4838-9408-fafc202c8f7b-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-mk45q\" (UID: \"48111af4-bcee-4838-9408-fafc202c8f7b\") " pod="openshift-insights/insights-runtime-extractor-mk45q" Sep 09 08:40:12.743297 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:40:12.743237 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/48111af4-bcee-4838-9408-fafc202c8f7b-crio-socket\") pod \"insights-runtime-extractor-mk45q\" (UID: \"48111af4-bcee-4838-9408-fafc202c8f7b\") " pod="openshift-insights/insights-runtime-extractor-mk45q" Sep 09 08:40:12.743297 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:40:12.743258 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6vrtq\" (UniqueName: \"kubernetes.io/projected/48111af4-bcee-4838-9408-fafc202c8f7b-kube-api-access-6vrtq\") pod \"insights-runtime-extractor-mk45q\" (UID: \"48111af4-bcee-4838-9408-fafc202c8f7b\") " pod="openshift-insights/insights-runtime-extractor-mk45q" Sep 09 08:40:12.844498 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:40:12.844464 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/48111af4-bcee-4838-9408-fafc202c8f7b-data-volume\") pod \"insights-runtime-extractor-mk45q\" (UID: \"48111af4-bcee-4838-9408-fafc202c8f7b\") " pod="openshift-insights/insights-runtime-extractor-mk45q" Sep 09 08:40:12.844498 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:40:12.844502 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/48111af4-bcee-4838-9408-fafc202c8f7b-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-mk45q\" (UID: \"48111af4-bcee-4838-9408-fafc202c8f7b\") " pod="openshift-insights/insights-runtime-extractor-mk45q" Sep 09 08:40:12.844696 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:40:12.844531 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/48111af4-bcee-4838-9408-fafc202c8f7b-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-mk45q\" (UID: \"48111af4-bcee-4838-9408-fafc202c8f7b\") " pod="openshift-insights/insights-runtime-extractor-mk45q" Sep 09 08:40:12.844696 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:40:12.844556 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/48111af4-bcee-4838-9408-fafc202c8f7b-crio-socket\") pod \"insights-runtime-extractor-mk45q\" (UID: \"48111af4-bcee-4838-9408-fafc202c8f7b\") " pod="openshift-insights/insights-runtime-extractor-mk45q" Sep 09 08:40:12.844696 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:40:12.844587 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6vrtq\" (UniqueName: \"kubernetes.io/projected/48111af4-bcee-4838-9408-fafc202c8f7b-kube-api-access-6vrtq\") pod \"insights-runtime-extractor-mk45q\" (UID: \"48111af4-bcee-4838-9408-fafc202c8f7b\") " pod="openshift-insights/insights-runtime-extractor-mk45q" Sep 09 08:40:12.844696 ip-10-0-137-144 kubenswrapper[2564]: E0909 08:40:12.844604 2564 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Sep 09 08:40:12.844696 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:40:12.844683 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/48111af4-bcee-4838-9408-fafc202c8f7b-crio-socket\") pod \"insights-runtime-extractor-mk45q\" (UID: \"48111af4-bcee-4838-9408-fafc202c8f7b\") " pod="openshift-insights/insights-runtime-extractor-mk45q" Sep 09 08:40:12.844891 ip-10-0-137-144 kubenswrapper[2564]: E0909 08:40:12.844701 2564 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Sep 09 08:40:12.844891 ip-10-0-137-144 kubenswrapper[2564]: E0909 08:40:12.844753 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/48111af4-bcee-4838-9408-fafc202c8f7b-kube-rbac-proxy-cm podName:48111af4-bcee-4838-9408-fafc202c8f7b nodeName:}" failed. No retries permitted until 2026-09-09 08:40:13.344724647 +0000 UTC m=+74.042608543 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/48111af4-bcee-4838-9408-fafc202c8f7b-kube-rbac-proxy-cm") pod "insights-runtime-extractor-mk45q" (UID: "48111af4-bcee-4838-9408-fafc202c8f7b") : configmap "kube-rbac-proxy" not found Sep 09 08:40:12.844891 ip-10-0-137-144 kubenswrapper[2564]: E0909 08:40:12.844771 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/48111af4-bcee-4838-9408-fafc202c8f7b-insights-runtime-extractor-tls podName:48111af4-bcee-4838-9408-fafc202c8f7b nodeName:}" failed. No retries permitted until 2026-09-09 08:40:13.344763263 +0000 UTC m=+74.042647142 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/48111af4-bcee-4838-9408-fafc202c8f7b-insights-runtime-extractor-tls") pod "insights-runtime-extractor-mk45q" (UID: "48111af4-bcee-4838-9408-fafc202c8f7b") : secret "insights-runtime-extractor-tls" not found Sep 09 08:40:12.844891 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:40:12.844845 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/48111af4-bcee-4838-9408-fafc202c8f7b-data-volume\") pod \"insights-runtime-extractor-mk45q\" (UID: \"48111af4-bcee-4838-9408-fafc202c8f7b\") " pod="openshift-insights/insights-runtime-extractor-mk45q" Sep 09 08:40:12.855694 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:40:12.855671 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6vrtq\" (UniqueName: \"kubernetes.io/projected/48111af4-bcee-4838-9408-fafc202c8f7b-kube-api-access-6vrtq\") pod \"insights-runtime-extractor-mk45q\" (UID: \"48111af4-bcee-4838-9408-fafc202c8f7b\") " pod="openshift-insights/insights-runtime-extractor-mk45q" Sep 09 08:40:13.347615 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:40:13.347578 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/48111af4-bcee-4838-9408-fafc202c8f7b-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-mk45q\" (UID: \"48111af4-bcee-4838-9408-fafc202c8f7b\") " pod="openshift-insights/insights-runtime-extractor-mk45q" Sep 09 08:40:13.347615 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:40:13.347615 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/48111af4-bcee-4838-9408-fafc202c8f7b-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-mk45q\" (UID: \"48111af4-bcee-4838-9408-fafc202c8f7b\") " pod="openshift-insights/insights-runtime-extractor-mk45q" Sep 09 08:40:13.347795 ip-10-0-137-144 kubenswrapper[2564]: E0909 08:40:13.347706 2564 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Sep 09 08:40:13.347830 ip-10-0-137-144 kubenswrapper[2564]: E0909 08:40:13.347797 2564 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Sep 09 08:40:13.347830 ip-10-0-137-144 kubenswrapper[2564]: E0909 08:40:13.347821 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/48111af4-bcee-4838-9408-fafc202c8f7b-kube-rbac-proxy-cm podName:48111af4-bcee-4838-9408-fafc202c8f7b nodeName:}" failed. No retries permitted until 2026-09-09 08:40:14.347800004 +0000 UTC m=+75.045683907 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/48111af4-bcee-4838-9408-fafc202c8f7b-kube-rbac-proxy-cm") pod "insights-runtime-extractor-mk45q" (UID: "48111af4-bcee-4838-9408-fafc202c8f7b") : configmap "kube-rbac-proxy" not found Sep 09 08:40:13.347895 ip-10-0-137-144 kubenswrapper[2564]: E0909 08:40:13.347849 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/48111af4-bcee-4838-9408-fafc202c8f7b-insights-runtime-extractor-tls podName:48111af4-bcee-4838-9408-fafc202c8f7b nodeName:}" failed. No retries permitted until 2026-09-09 08:40:14.347837486 +0000 UTC m=+75.045721381 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/48111af4-bcee-4838-9408-fafc202c8f7b-insights-runtime-extractor-tls") pod "insights-runtime-extractor-mk45q" (UID: "48111af4-bcee-4838-9408-fafc202c8f7b") : secret "insights-runtime-extractor-tls" not found Sep 09 08:40:14.056878 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:40:14.056795 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-2zg7w" Sep 09 08:40:14.084542 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:40:14.084505 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-v2cwj_025bcb2f-08a5-4ea4-98f9-8ca84afd9b33/dns/0.log" Sep 09 08:40:14.186448 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:40:14.186403 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-q4nst" event={"ID":"15de325d-9020-4dc9-8666-b1b02a3b2e2e","Type":"ContainerStarted","Data":"71d2a0ccd6c9a886109e34abf9688920845520e69e16f2f6b9a683d7cbdbc56a"} Sep 09 08:40:14.188414 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:40:14.188389 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-57d46cff9d-b89s4" event={"ID":"6cc349f7-f7df-4e63-86e7-e99c32f6ebaa","Type":"ContainerStarted","Data":"999016e60bddb52a0c9ea8324914d1bbe43a72cd4c9c3976c27b7a38c812c45f"} Sep 09 08:40:14.188520 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:40:14.188425 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-57d46cff9d-b89s4" event={"ID":"6cc349f7-f7df-4e63-86e7-e99c32f6ebaa","Type":"ContainerStarted","Data":"396f6db5e820f7b4f4a25514fa8d2ed0a1418746ec7bdd76f80eea4edbabfc45"} Sep 09 08:40:14.188520 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:40:14.188438 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-57d46cff9d-b89s4" event={"ID":"6cc349f7-f7df-4e63-86e7-e99c32f6ebaa","Type":"ContainerStarted","Data":"4962861ed738ae4dbd669e6b803efddd105e3a02d1bff7884cfb27251aa7f2c0"} Sep 09 08:40:14.189870 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:40:14.189842 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-dvhwl" event={"ID":"950a27f9-3274-48f2-a23e-21f86398eb00","Type":"ContainerStarted","Data":"8fa76fc93090f35aabde8e2246b15f1b106f3230f4237bd646955395a2816a21"} Sep 09 08:40:14.202389 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:40:14.202326 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-q4nst" podStartSLOduration=1.6063008779999999 podStartE2EDuration="8.202313076s" totalImagesPullingTime="6.596012198s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 08:40:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 08:40:14.201204334 +0000 UTC m=+74.899088250" watchObservedRunningTime="2026-09-09 08:40:14.202313076 +0000 UTC m=+74.900196977" Sep 09 08:40:14.214556 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:40:14.214515 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-dvhwl" podStartSLOduration=66.697841788 podStartE2EDuration="1m14.214502789s" totalImagesPullingTime="7.516661001s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-09 08:39:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 08:40:14.213703599 +0000 UTC m=+74.911587501" watchObservedRunningTime="2026-09-09 08:40:14.214502789 +0000 UTC m=+74.912386681" Sep 09 08:40:14.231681 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:40:14.231638 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-57d46cff9d-b89s4" podStartSLOduration=1.639246789 podStartE2EDuration="8.231621262s" totalImagesPullingTime="6.592374473s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 08:40:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 08:40:14.231504344 +0000 UTC m=+74.929388246" watchObservedRunningTime="2026-09-09 08:40:14.231621262 +0000 UTC m=+74.929505162" Sep 09 08:40:14.254869 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:40:14.254848 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-v2cwj_025bcb2f-08a5-4ea4-98f9-8ca84afd9b33/kube-rbac-proxy/0.log" Sep 09 08:40:14.355198 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:40:14.355173 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/48111af4-bcee-4838-9408-fafc202c8f7b-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-mk45q\" (UID: \"48111af4-bcee-4838-9408-fafc202c8f7b\") " pod="openshift-insights/insights-runtime-extractor-mk45q" Sep 09 08:40:14.355310 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:40:14.355205 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/48111af4-bcee-4838-9408-fafc202c8f7b-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-mk45q\" (UID: \"48111af4-bcee-4838-9408-fafc202c8f7b\") " pod="openshift-insights/insights-runtime-extractor-mk45q" Sep 09 08:40:14.355310 ip-10-0-137-144 kubenswrapper[2564]: E0909 08:40:14.355291 2564 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Sep 09 08:40:14.355412 ip-10-0-137-144 kubenswrapper[2564]: E0909 08:40:14.355318 2564 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Sep 09 08:40:14.355412 ip-10-0-137-144 kubenswrapper[2564]: E0909 08:40:14.355379 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/48111af4-bcee-4838-9408-fafc202c8f7b-kube-rbac-proxy-cm podName:48111af4-bcee-4838-9408-fafc202c8f7b nodeName:}" failed. No retries permitted until 2026-09-09 08:40:16.35536104 +0000 UTC m=+77.053244938 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/48111af4-bcee-4838-9408-fafc202c8f7b-kube-rbac-proxy-cm") pod "insights-runtime-extractor-mk45q" (UID: "48111af4-bcee-4838-9408-fafc202c8f7b") : configmap "kube-rbac-proxy" not found Sep 09 08:40:14.355412 ip-10-0-137-144 kubenswrapper[2564]: E0909 08:40:14.355394 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/48111af4-bcee-4838-9408-fafc202c8f7b-insights-runtime-extractor-tls podName:48111af4-bcee-4838-9408-fafc202c8f7b nodeName:}" failed. No retries permitted until 2026-09-09 08:40:16.355387765 +0000 UTC m=+77.053271647 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/48111af4-bcee-4838-9408-fafc202c8f7b-insights-runtime-extractor-tls") pod "insights-runtime-extractor-mk45q" (UID: "48111af4-bcee-4838-9408-fafc202c8f7b") : secret "insights-runtime-extractor-tls" not found Sep 09 08:40:14.454297 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:40:14.454274 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-b6v64_5cfc7f17-0984-4eb8-bf5f-a4c593b2d411/dns-node-resolver/0.log" Sep 09 08:40:15.254100 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:40:15.254070 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-5d984d89dd-r8hr5_fbc63112-9a58-49c8-b9e2-830f9e027723/registry/0.log" Sep 09 08:40:15.805389 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:40:15.801990 2564 scope.go:117] "RemoveContainer" containerID="2c4f9a120ef7c95b800c69d644e211fc6c0d796fa8971677bd99dddce92e836c" Sep 09 08:40:15.853616 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:40:15.853590 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-pdgxz_806a2d46-69ad-493c-a1cc-5796636d6a06/node-ca/0.log" Sep 09 08:40:16.199402 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:40:16.199372 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-tdfqx_f81169f8-3c85-4cd7-8b59-684973ff46f7/console-operator/2.log" Sep 09 08:40:16.199578 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:40:16.199467 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-85b454874b-tdfqx" event={"ID":"f81169f8-3c85-4cd7-8b59-684973ff46f7","Type":"ContainerStarted","Data":"88e929e57c0adf907c53284f75760ff198f2ba4e626dda2eb0ac69438c1bc997"} Sep 09 08:40:16.199775 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:40:16.199744 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-85b454874b-tdfqx" Sep 09 08:40:16.215457 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:40:16.215409 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console-operator/console-operator-85b454874b-tdfqx" podStartSLOduration=67.894497895 podStartE2EDuration="1m16.215392578s" totalImagesPullingTime="8.320894683s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 08:39:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 08:40:16.215017891 +0000 UTC m=+76.912901791" watchObservedRunningTime="2026-09-09 08:40:16.215392578 +0000 UTC m=+76.913276480" Sep 09 08:40:16.371020 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:40:16.370987 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/48111af4-bcee-4838-9408-fafc202c8f7b-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-mk45q\" (UID: \"48111af4-bcee-4838-9408-fafc202c8f7b\") " pod="openshift-insights/insights-runtime-extractor-mk45q" Sep 09 08:40:16.371433 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:40:16.371031 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/48111af4-bcee-4838-9408-fafc202c8f7b-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-mk45q\" (UID: \"48111af4-bcee-4838-9408-fafc202c8f7b\") " pod="openshift-insights/insights-runtime-extractor-mk45q" Sep 09 08:40:16.371433 ip-10-0-137-144 kubenswrapper[2564]: E0909 08:40:16.371098 2564 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Sep 09 08:40:16.371433 ip-10-0-137-144 kubenswrapper[2564]: E0909 08:40:16.371157 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/48111af4-bcee-4838-9408-fafc202c8f7b-kube-rbac-proxy-cm podName:48111af4-bcee-4838-9408-fafc202c8f7b nodeName:}" failed. No retries permitted until 2026-09-09 08:40:20.371143377 +0000 UTC m=+81.069027256 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/48111af4-bcee-4838-9408-fafc202c8f7b-kube-rbac-proxy-cm") pod "insights-runtime-extractor-mk45q" (UID: "48111af4-bcee-4838-9408-fafc202c8f7b") : configmap "kube-rbac-proxy" not found Sep 09 08:40:16.371433 ip-10-0-137-144 kubenswrapper[2564]: E0909 08:40:16.371174 2564 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Sep 09 08:40:16.371433 ip-10-0-137-144 kubenswrapper[2564]: E0909 08:40:16.371221 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/48111af4-bcee-4838-9408-fafc202c8f7b-insights-runtime-extractor-tls podName:48111af4-bcee-4838-9408-fafc202c8f7b nodeName:}" failed. No retries permitted until 2026-09-09 08:40:20.371205978 +0000 UTC m=+81.069089878 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/48111af4-bcee-4838-9408-fafc202c8f7b-insights-runtime-extractor-tls") pod "insights-runtime-extractor-mk45q" (UID: "48111af4-bcee-4838-9408-fafc202c8f7b") : secret "insights-runtime-extractor-tls" not found Sep 09 08:40:16.395977 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:40:16.395948 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-85b454874b-tdfqx" Sep 09 08:40:16.854914 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:40:16.854868 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-w944n_77658115-dcd3-45b6-905e-2cfc02b948ed/serve-healthcheck-canary/0.log" Sep 09 08:40:18.167520 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:40:18.167487 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-v2cwj" Sep 09 08:40:20.406445 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:40:20.406411 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/48111af4-bcee-4838-9408-fafc202c8f7b-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-mk45q\" (UID: \"48111af4-bcee-4838-9408-fafc202c8f7b\") " pod="openshift-insights/insights-runtime-extractor-mk45q" Sep 09 08:40:20.406445 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:40:20.406449 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/48111af4-bcee-4838-9408-fafc202c8f7b-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-mk45q\" (UID: \"48111af4-bcee-4838-9408-fafc202c8f7b\") " pod="openshift-insights/insights-runtime-extractor-mk45q" Sep 09 08:40:20.406967 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:40:20.406935 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/48111af4-bcee-4838-9408-fafc202c8f7b-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-mk45q\" (UID: \"48111af4-bcee-4838-9408-fafc202c8f7b\") " pod="openshift-insights/insights-runtime-extractor-mk45q" Sep 09 08:40:20.408659 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:40:20.408639 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/48111af4-bcee-4838-9408-fafc202c8f7b-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-mk45q\" (UID: \"48111af4-bcee-4838-9408-fafc202c8f7b\") " pod="openshift-insights/insights-runtime-extractor-mk45q" Sep 09 08:40:20.516693 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:40:20.516659 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-mk45q" Sep 09 08:40:20.785941 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:40:20.785881 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-mk45q"] Sep 09 08:40:20.788454 ip-10-0-137-144 kubenswrapper[2564]: W0909 08:40:20.788428 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod48111af4_bcee_4838_9408_fafc202c8f7b.slice/crio-20337fc8c44f2ed905596f1bcace139374579920611297f03f04889ef72041c8 WatchSource:0}: Error finding container 20337fc8c44f2ed905596f1bcace139374579920611297f03f04889ef72041c8: Status 404 returned error can't find the container with id 20337fc8c44f2ed905596f1bcace139374579920611297f03f04889ef72041c8 Sep 09 08:40:21.223189 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:40:21.223157 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-mk45q" event={"ID":"48111af4-bcee-4838-9408-fafc202c8f7b","Type":"ContainerStarted","Data":"78189ae8bc95dc93a6a1bcacadbaf7437ee97a38914e8aba9f540a5a2eb0e52e"} Sep 09 08:40:21.223381 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:40:21.223221 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-mk45q" event={"ID":"48111af4-bcee-4838-9408-fafc202c8f7b","Type":"ContainerStarted","Data":"20337fc8c44f2ed905596f1bcace139374579920611297f03f04889ef72041c8"} Sep 09 08:40:22.233795 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:40:22.233758 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-mk45q" event={"ID":"48111af4-bcee-4838-9408-fafc202c8f7b","Type":"ContainerStarted","Data":"a0855490a988605ad039e7ab198e4dd272325b76eca7c257b7d96aa66e5d0346"} Sep 09 08:40:22.472184 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:40:22.472143 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-l925d"] Sep 09 08:40:22.474740 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:40:22.474718 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-l925d" Sep 09 08:40:22.476806 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:40:22.476784 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Sep 09 08:40:22.477147 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:40:22.477124 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Sep 09 08:40:22.477317 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:40:22.477296 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Sep 09 08:40:22.477646 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:40:22.477625 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-nngdh\"" Sep 09 08:40:22.477904 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:40:22.477885 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Sep 09 08:40:22.526117 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:40:22.525883 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/e97ee2b5-650a-40ad-8d02-927b4086df5d-root\") pod \"node-exporter-l925d\" (UID: \"e97ee2b5-650a-40ad-8d02-927b4086df5d\") " pod="openshift-monitoring/node-exporter-l925d" Sep 09 08:40:22.526117 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:40:22.525938 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/e97ee2b5-650a-40ad-8d02-927b4086df5d-node-exporter-wtmp\") pod \"node-exporter-l925d\" (UID: \"e97ee2b5-650a-40ad-8d02-927b4086df5d\") " pod="openshift-monitoring/node-exporter-l925d" Sep 09 08:40:22.526117 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:40:22.525969 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mphc9\" (UniqueName: \"kubernetes.io/projected/e97ee2b5-650a-40ad-8d02-927b4086df5d-kube-api-access-mphc9\") pod \"node-exporter-l925d\" (UID: \"e97ee2b5-650a-40ad-8d02-927b4086df5d\") " pod="openshift-monitoring/node-exporter-l925d" Sep 09 08:40:22.526117 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:40:22.526000 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e97ee2b5-650a-40ad-8d02-927b4086df5d-metrics-client-ca\") pod \"node-exporter-l925d\" (UID: \"e97ee2b5-650a-40ad-8d02-927b4086df5d\") " pod="openshift-monitoring/node-exporter-l925d" Sep 09 08:40:22.526117 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:40:22.526082 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e97ee2b5-650a-40ad-8d02-927b4086df5d-sys\") pod \"node-exporter-l925d\" (UID: \"e97ee2b5-650a-40ad-8d02-927b4086df5d\") " pod="openshift-monitoring/node-exporter-l925d" Sep 09 08:40:22.526518 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:40:22.526205 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/e97ee2b5-650a-40ad-8d02-927b4086df5d-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-l925d\" (UID: \"e97ee2b5-650a-40ad-8d02-927b4086df5d\") " pod="openshift-monitoring/node-exporter-l925d" Sep 09 08:40:22.526518 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:40:22.526277 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/e97ee2b5-650a-40ad-8d02-927b4086df5d-node-exporter-accelerators-collector-config\") pod \"node-exporter-l925d\" (UID: \"e97ee2b5-650a-40ad-8d02-927b4086df5d\") " pod="openshift-monitoring/node-exporter-l925d" Sep 09 08:40:22.526518 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:40:22.526325 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/e97ee2b5-650a-40ad-8d02-927b4086df5d-node-exporter-tls\") pod \"node-exporter-l925d\" (UID: \"e97ee2b5-650a-40ad-8d02-927b4086df5d\") " pod="openshift-monitoring/node-exporter-l925d" Sep 09 08:40:22.526518 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:40:22.526376 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/e97ee2b5-650a-40ad-8d02-927b4086df5d-node-exporter-textfile\") pod \"node-exporter-l925d\" (UID: \"e97ee2b5-650a-40ad-8d02-927b4086df5d\") " pod="openshift-monitoring/node-exporter-l925d" Sep 09 08:40:22.627396 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:40:22.627361 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/e97ee2b5-650a-40ad-8d02-927b4086df5d-node-exporter-tls\") pod \"node-exporter-l925d\" (UID: \"e97ee2b5-650a-40ad-8d02-927b4086df5d\") " pod="openshift-monitoring/node-exporter-l925d" Sep 09 08:40:22.627588 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:40:22.627404 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/e97ee2b5-650a-40ad-8d02-927b4086df5d-node-exporter-textfile\") pod \"node-exporter-l925d\" (UID: \"e97ee2b5-650a-40ad-8d02-927b4086df5d\") " pod="openshift-monitoring/node-exporter-l925d" Sep 09 08:40:22.627588 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:40:22.627429 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/e97ee2b5-650a-40ad-8d02-927b4086df5d-root\") pod \"node-exporter-l925d\" (UID: \"e97ee2b5-650a-40ad-8d02-927b4086df5d\") " pod="openshift-monitoring/node-exporter-l925d" Sep 09 08:40:22.627588 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:40:22.627455 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/e97ee2b5-650a-40ad-8d02-927b4086df5d-node-exporter-wtmp\") pod \"node-exporter-l925d\" (UID: \"e97ee2b5-650a-40ad-8d02-927b4086df5d\") " pod="openshift-monitoring/node-exporter-l925d" Sep 09 08:40:22.627588 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:40:22.627483 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mphc9\" (UniqueName: \"kubernetes.io/projected/e97ee2b5-650a-40ad-8d02-927b4086df5d-kube-api-access-mphc9\") pod \"node-exporter-l925d\" (UID: \"e97ee2b5-650a-40ad-8d02-927b4086df5d\") " pod="openshift-monitoring/node-exporter-l925d" Sep 09 08:40:22.627588 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:40:22.627539 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/e97ee2b5-650a-40ad-8d02-927b4086df5d-root\") pod \"node-exporter-l925d\" (UID: \"e97ee2b5-650a-40ad-8d02-927b4086df5d\") " pod="openshift-monitoring/node-exporter-l925d" Sep 09 08:40:22.627588 ip-10-0-137-144 kubenswrapper[2564]: E0909 08:40:22.627564 2564 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found Sep 09 08:40:22.627902 ip-10-0-137-144 kubenswrapper[2564]: E0909 08:40:22.627645 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e97ee2b5-650a-40ad-8d02-927b4086df5d-node-exporter-tls podName:e97ee2b5-650a-40ad-8d02-927b4086df5d nodeName:}" failed. No retries permitted until 2026-09-09 08:40:23.127621401 +0000 UTC m=+83.825505301 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/e97ee2b5-650a-40ad-8d02-927b4086df5d-node-exporter-tls") pod "node-exporter-l925d" (UID: "e97ee2b5-650a-40ad-8d02-927b4086df5d") : secret "node-exporter-tls" not found Sep 09 08:40:22.627902 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:40:22.627669 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e97ee2b5-650a-40ad-8d02-927b4086df5d-metrics-client-ca\") pod \"node-exporter-l925d\" (UID: \"e97ee2b5-650a-40ad-8d02-927b4086df5d\") " pod="openshift-monitoring/node-exporter-l925d" Sep 09 08:40:22.627902 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:40:22.627677 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/e97ee2b5-650a-40ad-8d02-927b4086df5d-node-exporter-wtmp\") pod \"node-exporter-l925d\" (UID: \"e97ee2b5-650a-40ad-8d02-927b4086df5d\") " pod="openshift-monitoring/node-exporter-l925d" Sep 09 08:40:22.627902 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:40:22.627706 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e97ee2b5-650a-40ad-8d02-927b4086df5d-sys\") pod \"node-exporter-l925d\" (UID: \"e97ee2b5-650a-40ad-8d02-927b4086df5d\") " pod="openshift-monitoring/node-exporter-l925d" Sep 09 08:40:22.627902 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:40:22.627767 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/e97ee2b5-650a-40ad-8d02-927b4086df5d-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-l925d\" (UID: \"e97ee2b5-650a-40ad-8d02-927b4086df5d\") " pod="openshift-monitoring/node-exporter-l925d" Sep 09 08:40:22.627902 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:40:22.627782 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/e97ee2b5-650a-40ad-8d02-927b4086df5d-node-exporter-textfile\") pod \"node-exporter-l925d\" (UID: \"e97ee2b5-650a-40ad-8d02-927b4086df5d\") " pod="openshift-monitoring/node-exporter-l925d" Sep 09 08:40:22.627902 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:40:22.627815 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/e97ee2b5-650a-40ad-8d02-927b4086df5d-node-exporter-accelerators-collector-config\") pod \"node-exporter-l925d\" (UID: \"e97ee2b5-650a-40ad-8d02-927b4086df5d\") " pod="openshift-monitoring/node-exporter-l925d" Sep 09 08:40:22.627902 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:40:22.627826 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e97ee2b5-650a-40ad-8d02-927b4086df5d-sys\") pod \"node-exporter-l925d\" (UID: \"e97ee2b5-650a-40ad-8d02-927b4086df5d\") " pod="openshift-monitoring/node-exporter-l925d" Sep 09 08:40:22.628431 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:40:22.628366 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/e97ee2b5-650a-40ad-8d02-927b4086df5d-node-exporter-accelerators-collector-config\") pod \"node-exporter-l925d\" (UID: \"e97ee2b5-650a-40ad-8d02-927b4086df5d\") " pod="openshift-monitoring/node-exporter-l925d" Sep 09 08:40:22.628431 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:40:22.628387 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e97ee2b5-650a-40ad-8d02-927b4086df5d-metrics-client-ca\") pod \"node-exporter-l925d\" (UID: \"e97ee2b5-650a-40ad-8d02-927b4086df5d\") " pod="openshift-monitoring/node-exporter-l925d" Sep 09 08:40:22.629970 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:40:22.629950 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/e97ee2b5-650a-40ad-8d02-927b4086df5d-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-l925d\" (UID: \"e97ee2b5-650a-40ad-8d02-927b4086df5d\") " pod="openshift-monitoring/node-exporter-l925d" Sep 09 08:40:22.635140 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:40:22.635121 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mphc9\" (UniqueName: \"kubernetes.io/projected/e97ee2b5-650a-40ad-8d02-927b4086df5d-kube-api-access-mphc9\") pod \"node-exporter-l925d\" (UID: \"e97ee2b5-650a-40ad-8d02-927b4086df5d\") " pod="openshift-monitoring/node-exporter-l925d" Sep 09 08:40:23.132305 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:40:23.132274 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/e97ee2b5-650a-40ad-8d02-927b4086df5d-node-exporter-tls\") pod \"node-exporter-l925d\" (UID: \"e97ee2b5-650a-40ad-8d02-927b4086df5d\") " pod="openshift-monitoring/node-exporter-l925d" Sep 09 08:40:23.134578 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:40:23.134547 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/e97ee2b5-650a-40ad-8d02-927b4086df5d-node-exporter-tls\") pod \"node-exporter-l925d\" (UID: \"e97ee2b5-650a-40ad-8d02-927b4086df5d\") " pod="openshift-monitoring/node-exporter-l925d" Sep 09 08:40:23.239998 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:40:23.239963 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-mk45q" event={"ID":"48111af4-bcee-4838-9408-fafc202c8f7b","Type":"ContainerStarted","Data":"e7b28ff4c4b821c7648abaf9a6befd84521a8a1d399771736f85a0e00628f389"} Sep 09 08:40:23.268474 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:40:23.268362 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-mk45q" podStartSLOduration=9.163604134 podStartE2EDuration="11.268323423s" totalImagesPullingTime="2.104719289s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-09 08:40:12 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 08:40:23.267441414 +0000 UTC m=+83.965325343" watchObservedRunningTime="2026-09-09 08:40:23.268323423 +0000 UTC m=+83.966207322" Sep 09 08:40:23.386240 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:40:23.386209 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-l925d" Sep 09 08:40:23.395885 ip-10-0-137-144 kubenswrapper[2564]: W0909 08:40:23.395858 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode97ee2b5_650a_40ad_8d02_927b4086df5d.slice/crio-6c2cb7464a441b8f5f8edd86475bdbc749b401e6dacfa972e4780246a68e7a6b WatchSource:0}: Error finding container 6c2cb7464a441b8f5f8edd86475bdbc749b401e6dacfa972e4780246a68e7a6b: Status 404 returned error can't find the container with id 6c2cb7464a441b8f5f8edd86475bdbc749b401e6dacfa972e4780246a68e7a6b Sep 09 08:40:24.246271 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:40:24.246237 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-l925d" event={"ID":"e97ee2b5-650a-40ad-8d02-927b4086df5d","Type":"ContainerStarted","Data":"6c2cb7464a441b8f5f8edd86475bdbc749b401e6dacfa972e4780246a68e7a6b"} Sep 09 08:40:25.251304 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:40:25.251267 2564 generic.go:356] "Generic (PLEG): container finished" podID="e97ee2b5-650a-40ad-8d02-927b4086df5d" containerID="555da67fd4b36bf6e7d1c5213a3b3b73fb65432d2e5afffd50e613983159ee54" exitCode=0 Sep 09 08:40:25.251673 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:40:25.251360 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-l925d" event={"ID":"e97ee2b5-650a-40ad-8d02-927b4086df5d","Type":"ContainerDied","Data":"555da67fd4b36bf6e7d1c5213a3b3b73fb65432d2e5afffd50e613983159ee54"} Sep 09 08:40:26.256642 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:40:26.256603 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-l925d" event={"ID":"e97ee2b5-650a-40ad-8d02-927b4086df5d","Type":"ContainerStarted","Data":"c20f310678c24a1f2e48401d6b33506b15578261d941b3d9f0714bc2f877a11a"} Sep 09 08:40:26.257011 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:40:26.256669 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-l925d" event={"ID":"e97ee2b5-650a-40ad-8d02-927b4086df5d","Type":"ContainerStarted","Data":"1faebc4d1d2a44f060cb324a81accc24adbe94fb29ff6a9b340a2e713325162f"} Sep 09 08:40:26.276381 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:40:26.276318 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-l925d" podStartSLOduration=3.330148637 podStartE2EDuration="4.276290438s" totalImagesPullingTime="881.973174ms" totalInitContainerRuntime="64.168627ms" isStatefulPod=true podCreationTimestamp="2026-09-09 08:40:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 08:40:26.274713683 +0000 UTC m=+86.972597585" watchObservedRunningTime="2026-09-09 08:40:26.276290438 +0000 UTC m=+86.974174339" Sep 09 08:40:27.154016 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:40:27.153984 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-5d984d89dd-r8hr5" Sep 09 08:40:28.883419 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:40:28.883388 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-5d984d89dd-r8hr5"] Sep 09 08:40:53.902879 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:40:53.902831 2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-image-registry/image-registry-5d984d89dd-r8hr5" podUID="fbc63112-9a58-49c8-b9e2-830f9e027723" containerName="registry" containerID="cri-o://e7f70e888910bfb8163d6d0007aae8701850a570e3520620f9aa2b9159063276" gracePeriod=30 Sep 09 08:40:54.143436 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:40:54.143411 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5d984d89dd-r8hr5" Sep 09 08:40:54.271775 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:40:54.271685 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9khqh\" (UniqueName: \"kubernetes.io/projected/fbc63112-9a58-49c8-b9e2-830f9e027723-kube-api-access-9khqh\") pod \"fbc63112-9a58-49c8-b9e2-830f9e027723\" (UID: \"fbc63112-9a58-49c8-b9e2-830f9e027723\") " Sep 09 08:40:54.271775 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:40:54.271733 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/fbc63112-9a58-49c8-b9e2-830f9e027723-trusted-ca\") pod \"fbc63112-9a58-49c8-b9e2-830f9e027723\" (UID: \"fbc63112-9a58-49c8-b9e2-830f9e027723\") " Sep 09 08:40:54.272032 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:40:54.271780 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/fbc63112-9a58-49c8-b9e2-830f9e027723-ca-trust-extracted\") pod \"fbc63112-9a58-49c8-b9e2-830f9e027723\" (UID: \"fbc63112-9a58-49c8-b9e2-830f9e027723\") " Sep 09 08:40:54.272032 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:40:54.271898 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/fbc63112-9a58-49c8-b9e2-830f9e027723-image-registry-private-configuration\") pod \"fbc63112-9a58-49c8-b9e2-830f9e027723\" (UID: \"fbc63112-9a58-49c8-b9e2-830f9e027723\") " Sep 09 08:40:54.272032 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:40:54.271942 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/fbc63112-9a58-49c8-b9e2-830f9e027723-registry-tls\") pod \"fbc63112-9a58-49c8-b9e2-830f9e027723\" (UID: \"fbc63112-9a58-49c8-b9e2-830f9e027723\") " Sep 09 08:40:54.272032 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:40:54.272017 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/fbc63112-9a58-49c8-b9e2-830f9e027723-registry-certificates\") pod \"fbc63112-9a58-49c8-b9e2-830f9e027723\" (UID: \"fbc63112-9a58-49c8-b9e2-830f9e027723\") " Sep 09 08:40:54.272241 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:40:54.272048 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/fbc63112-9a58-49c8-b9e2-830f9e027723-bound-sa-token\") pod \"fbc63112-9a58-49c8-b9e2-830f9e027723\" (UID: \"fbc63112-9a58-49c8-b9e2-830f9e027723\") " Sep 09 08:40:54.272241 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:40:54.272081 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/fbc63112-9a58-49c8-b9e2-830f9e027723-installation-pull-secrets\") pod \"fbc63112-9a58-49c8-b9e2-830f9e027723\" (UID: \"fbc63112-9a58-49c8-b9e2-830f9e027723\") " Sep 09 08:40:54.272241 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:40:54.272183 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fbc63112-9a58-49c8-b9e2-830f9e027723-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "fbc63112-9a58-49c8-b9e2-830f9e027723" (UID: "fbc63112-9a58-49c8-b9e2-830f9e027723"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 09 08:40:54.272538 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:40:54.272456 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fbc63112-9a58-49c8-b9e2-830f9e027723-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "fbc63112-9a58-49c8-b9e2-830f9e027723" (UID: "fbc63112-9a58-49c8-b9e2-830f9e027723"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 09 08:40:54.272538 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:40:54.272476 2564 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/fbc63112-9a58-49c8-b9e2-830f9e027723-trusted-ca\") on node \"ip-10-0-137-144.ec2.internal\" DevicePath \"\"" Sep 09 08:40:54.274845 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:40:54.274799 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fbc63112-9a58-49c8-b9e2-830f9e027723-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "fbc63112-9a58-49c8-b9e2-830f9e027723" (UID: "fbc63112-9a58-49c8-b9e2-830f9e027723"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 09 08:40:54.274958 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:40:54.274870 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fbc63112-9a58-49c8-b9e2-830f9e027723-kube-api-access-9khqh" (OuterVolumeSpecName: "kube-api-access-9khqh") pod "fbc63112-9a58-49c8-b9e2-830f9e027723" (UID: "fbc63112-9a58-49c8-b9e2-830f9e027723"). InnerVolumeSpecName "kube-api-access-9khqh". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 09 08:40:54.274958 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:40:54.274916 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fbc63112-9a58-49c8-b9e2-830f9e027723-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "fbc63112-9a58-49c8-b9e2-830f9e027723" (UID: "fbc63112-9a58-49c8-b9e2-830f9e027723"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 09 08:40:54.275065 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:40:54.274955 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fbc63112-9a58-49c8-b9e2-830f9e027723-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "fbc63112-9a58-49c8-b9e2-830f9e027723" (UID: "fbc63112-9a58-49c8-b9e2-830f9e027723"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 09 08:40:54.275065 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:40:54.275014 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fbc63112-9a58-49c8-b9e2-830f9e027723-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "fbc63112-9a58-49c8-b9e2-830f9e027723" (UID: "fbc63112-9a58-49c8-b9e2-830f9e027723"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 09 08:40:54.280585 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:40:54.280562 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fbc63112-9a58-49c8-b9e2-830f9e027723-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "fbc63112-9a58-49c8-b9e2-830f9e027723" (UID: "fbc63112-9a58-49c8-b9e2-830f9e027723"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 09 08:40:54.356851 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:40:54.356819 2564 generic.go:356] "Generic (PLEG): container finished" podID="fbc63112-9a58-49c8-b9e2-830f9e027723" containerID="e7f70e888910bfb8163d6d0007aae8701850a570e3520620f9aa2b9159063276" exitCode=0 Sep 09 08:40:54.356990 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:40:54.356867 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5d984d89dd-r8hr5" Sep 09 08:40:54.356990 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:40:54.356912 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5d984d89dd-r8hr5" event={"ID":"fbc63112-9a58-49c8-b9e2-830f9e027723","Type":"ContainerDied","Data":"e7f70e888910bfb8163d6d0007aae8701850a570e3520620f9aa2b9159063276"} Sep 09 08:40:54.356990 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:40:54.356966 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5d984d89dd-r8hr5" event={"ID":"fbc63112-9a58-49c8-b9e2-830f9e027723","Type":"ContainerDied","Data":"3c3742d68c94ccf2643345bd83d4b9eaaef14977329cf59d82f31196bfef839d"} Sep 09 08:40:54.356990 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:40:54.356987 2564 scope.go:117] "RemoveContainer" containerID="e7f70e888910bfb8163d6d0007aae8701850a570e3520620f9aa2b9159063276" Sep 09 08:40:54.365108 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:40:54.365089 2564 scope.go:117] "RemoveContainer" containerID="e7f70e888910bfb8163d6d0007aae8701850a570e3520620f9aa2b9159063276" Sep 09 08:40:54.365393 ip-10-0-137-144 kubenswrapper[2564]: E0909 08:40:54.365373 2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e7f70e888910bfb8163d6d0007aae8701850a570e3520620f9aa2b9159063276\": container with ID starting with e7f70e888910bfb8163d6d0007aae8701850a570e3520620f9aa2b9159063276 not found: ID does not exist" containerID="e7f70e888910bfb8163d6d0007aae8701850a570e3520620f9aa2b9159063276" Sep 09 08:40:54.365470 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:40:54.365401 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e7f70e888910bfb8163d6d0007aae8701850a570e3520620f9aa2b9159063276"} err="failed to get container status \"e7f70e888910bfb8163d6d0007aae8701850a570e3520620f9aa2b9159063276\": rpc error: code = NotFound desc = could not find container \"e7f70e888910bfb8163d6d0007aae8701850a570e3520620f9aa2b9159063276\": container with ID starting with e7f70e888910bfb8163d6d0007aae8701850a570e3520620f9aa2b9159063276 not found: ID does not exist" Sep 09 08:40:54.373483 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:40:54.373468 2564 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/fbc63112-9a58-49c8-b9e2-830f9e027723-registry-certificates\") on node \"ip-10-0-137-144.ec2.internal\" DevicePath \"\"" Sep 09 08:40:54.373532 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:40:54.373486 2564 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/fbc63112-9a58-49c8-b9e2-830f9e027723-bound-sa-token\") on node \"ip-10-0-137-144.ec2.internal\" DevicePath \"\"" Sep 09 08:40:54.373532 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:40:54.373495 2564 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/fbc63112-9a58-49c8-b9e2-830f9e027723-installation-pull-secrets\") on node \"ip-10-0-137-144.ec2.internal\" DevicePath \"\"" Sep 09 08:40:54.373532 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:40:54.373504 2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9khqh\" (UniqueName: \"kubernetes.io/projected/fbc63112-9a58-49c8-b9e2-830f9e027723-kube-api-access-9khqh\") on node \"ip-10-0-137-144.ec2.internal\" DevicePath \"\"" Sep 09 08:40:54.373532 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:40:54.373512 2564 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/fbc63112-9a58-49c8-b9e2-830f9e027723-ca-trust-extracted\") on node \"ip-10-0-137-144.ec2.internal\" DevicePath \"\"" Sep 09 08:40:54.373532 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:40:54.373521 2564 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/fbc63112-9a58-49c8-b9e2-830f9e027723-image-registry-private-configuration\") on node \"ip-10-0-137-144.ec2.internal\" DevicePath \"\"" Sep 09 08:40:54.373532 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:40:54.373529 2564 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/fbc63112-9a58-49c8-b9e2-830f9e027723-registry-tls\") on node \"ip-10-0-137-144.ec2.internal\" DevicePath \"\"" Sep 09 08:40:54.380023 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:40:54.380003 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-5d984d89dd-r8hr5"] Sep 09 08:40:54.383732 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:40:54.383711 2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-5d984d89dd-r8hr5"] Sep 09 08:40:55.806110 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:40:55.806074 2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fbc63112-9a58-49c8-b9e2-830f9e027723" path="/var/lib/kubelet/pods/fbc63112-9a58-49c8-b9e2-830f9e027723/volumes" Sep 09 08:40:58.372483 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:40:58.372447 2564 generic.go:356] "Generic (PLEG): container finished" podID="adccc815-e6f4-4a83-a484-53522f06da20" containerID="b20b9cb8c29bc435318646c68d0197969f254a25b93e9a17cdd49a27a01e7dd4" exitCode=0 Sep 09 08:40:58.372946 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:40:58.372518 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-6blnq" event={"ID":"adccc815-e6f4-4a83-a484-53522f06da20","Type":"ContainerDied","Data":"b20b9cb8c29bc435318646c68d0197969f254a25b93e9a17cdd49a27a01e7dd4"} Sep 09 08:40:58.372946 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:40:58.372865 2564 scope.go:117] "RemoveContainer" containerID="b20b9cb8c29bc435318646c68d0197969f254a25b93e9a17cdd49a27a01e7dd4" Sep 09 08:40:58.374193 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:40:58.374173 2564 generic.go:356] "Generic (PLEG): container finished" podID="aaa6f86d-29c1-45fb-bec3-3bf3bfb3d0bc" containerID="705086a699387f9e519a7f6c8d14d6ffc617586c8b9a123630f22fc167fbd226" exitCode=0 Sep 09 08:40:58.374269 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:40:58.374210 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-njzs5" event={"ID":"aaa6f86d-29c1-45fb-bec3-3bf3bfb3d0bc","Type":"ContainerDied","Data":"705086a699387f9e519a7f6c8d14d6ffc617586c8b9a123630f22fc167fbd226"} Sep 09 08:40:58.374506 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:40:58.374490 2564 scope.go:117] "RemoveContainer" containerID="705086a699387f9e519a7f6c8d14d6ffc617586c8b9a123630f22fc167fbd226" Sep 09 08:40:59.379693 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:40:59.379654 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-6blnq" event={"ID":"adccc815-e6f4-4a83-a484-53522f06da20","Type":"ContainerStarted","Data":"1afaec39d96a762c7f67da38fad7c3366659debeb2bcd1e6f58b0301218762c9"} Sep 09 08:40:59.381472 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:40:59.381450 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-njzs5" event={"ID":"aaa6f86d-29c1-45fb-bec3-3bf3bfb3d0bc","Type":"ContainerStarted","Data":"184fe9d823350bb81fc9bda9c8a52d2ec0276f2f6de1a423ff9aee9aa710e7d0"} Sep 09 08:43:59.680759 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:43:59.680723 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-tdfqx_f81169f8-3c85-4cd7-8b59-684973ff46f7/console-operator/2.log" Sep 09 08:43:59.683510 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:43:59.683486 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-tdfqx_f81169f8-3c85-4cd7-8b59-684973ff46f7/console-operator/2.log" Sep 09 08:43:59.690322 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:43:59.690299 2564 kubelet.go:1648] "Image garbage collection succeeded" Sep 09 08:48:59.703197 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:48:59.703169 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-tdfqx_f81169f8-3c85-4cd7-8b59-684973ff46f7/console-operator/2.log" Sep 09 08:48:59.703630 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:48:59.703562 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-tdfqx_f81169f8-3c85-4cd7-8b59-684973ff46f7/console-operator/2.log" Sep 09 08:50:07.062002 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:50:07.061964 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["test-ns-feast/redis-69bbd798b6-qtg5j"] Sep 09 08:50:07.064273 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:50:07.062219 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fbc63112-9a58-49c8-b9e2-830f9e027723" containerName="registry" Sep 09 08:50:07.064273 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:50:07.062231 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="fbc63112-9a58-49c8-b9e2-830f9e027723" containerName="registry" Sep 09 08:50:07.064273 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:50:07.062278 2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="fbc63112-9a58-49c8-b9e2-830f9e027723" containerName="registry" Sep 09 08:50:07.065126 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:50:07.065105 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/redis-69bbd798b6-qtg5j" Sep 09 08:50:07.067271 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:50:07.067244 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast\"/\"kube-root-ca.crt\"" Sep 09 08:50:07.067901 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:50:07.067879 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"default-dockercfg-s7nlj\"" Sep 09 08:50:07.068002 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:50:07.067906 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast\"/\"openshift-service-ca.crt\"" Sep 09 08:50:07.070884 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:50:07.070860 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/redis-69bbd798b6-qtg5j"] Sep 09 08:50:07.113398 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:50:07.113372 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gg2lw\" (UniqueName: \"kubernetes.io/projected/ff512c89-875c-4bcd-9124-74dae44d3fe7-kube-api-access-gg2lw\") pod \"redis-69bbd798b6-qtg5j\" (UID: \"ff512c89-875c-4bcd-9124-74dae44d3fe7\") " pod="test-ns-feast/redis-69bbd798b6-qtg5j" Sep 09 08:50:07.214026 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:50:07.213987 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gg2lw\" (UniqueName: \"kubernetes.io/projected/ff512c89-875c-4bcd-9124-74dae44d3fe7-kube-api-access-gg2lw\") pod \"redis-69bbd798b6-qtg5j\" (UID: \"ff512c89-875c-4bcd-9124-74dae44d3fe7\") " pod="test-ns-feast/redis-69bbd798b6-qtg5j" Sep 09 08:50:07.220969 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:50:07.220940 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gg2lw\" (UniqueName: \"kubernetes.io/projected/ff512c89-875c-4bcd-9124-74dae44d3fe7-kube-api-access-gg2lw\") pod \"redis-69bbd798b6-qtg5j\" (UID: \"ff512c89-875c-4bcd-9124-74dae44d3fe7\") " pod="test-ns-feast/redis-69bbd798b6-qtg5j" Sep 09 08:50:07.374823 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:50:07.374776 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/redis-69bbd798b6-qtg5j" Sep 09 08:50:07.639615 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:50:07.639539 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/redis-69bbd798b6-qtg5j"] Sep 09 08:50:07.642890 ip-10-0-137-144 kubenswrapper[2564]: W0909 08:50:07.642866 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podff512c89_875c_4bcd_9124_74dae44d3fe7.slice/crio-ffb9096f717a01281e2dc309e8ffa0ff176c2793e69c338c8bfa7a96612a9343 WatchSource:0}: Error finding container ffb9096f717a01281e2dc309e8ffa0ff176c2793e69c338c8bfa7a96612a9343: Status 404 returned error can't find the container with id ffb9096f717a01281e2dc309e8ffa0ff176c2793e69c338c8bfa7a96612a9343 Sep 09 08:50:07.645163 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:50:07.645146 2564 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Sep 09 08:50:08.271775 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:50:08.271730 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/redis-69bbd798b6-qtg5j" event={"ID":"ff512c89-875c-4bcd-9124-74dae44d3fe7","Type":"ContainerStarted","Data":"ffb9096f717a01281e2dc309e8ffa0ff176c2793e69c338c8bfa7a96612a9343"} Sep 09 08:50:09.276633 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:50:09.276549 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/redis-69bbd798b6-qtg5j" event={"ID":"ff512c89-875c-4bcd-9124-74dae44d3fe7","Type":"ContainerStarted","Data":"51e88f714082d1f5a30292151a4877bb417fb0493d488215e47bfc2051bc3172"} Sep 09 08:50:09.289753 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:50:09.289705 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="test-ns-feast/redis-69bbd798b6-qtg5j" podStartSLOduration=1.000441987 podStartE2EDuration="2.289689452s" totalImagesPullingTime="1.289247465s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 08:50:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 08:50:09.288955834 +0000 UTC m=+669.986839736" watchObservedRunningTime="2026-09-09 08:50:09.289689452 +0000 UTC m=+669.987573355" Sep 09 08:50:44.452930 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:50:44.452897 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["test-ns-feast/feast-test-apply-28dmq"] Sep 09 08:50:44.458197 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:50:44.458179 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-test-apply-28dmq" Sep 09 08:50:44.460250 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:50:44.460223 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast\"/\"feast-credit-scoring-intra-comm\"" Sep 09 08:50:44.460250 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:50:44.460223 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-credit-scoring-cronjob-dockercfg-sfgqx\"" Sep 09 08:50:44.462857 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:50:44.462836 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/feast-test-apply-28dmq"] Sep 09 08:50:44.582873 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:50:44.582841 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v4r4s\" (UniqueName: \"kubernetes.io/projected/9d88dfdf-afbc-4d29-b01a-5089ecef5fcb-kube-api-access-v4r4s\") pod \"feast-test-apply-28dmq\" (UID: \"9d88dfdf-afbc-4d29-b01a-5089ecef5fcb\") " pod="test-ns-feast/feast-test-apply-28dmq" Sep 09 08:50:44.683582 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:50:44.683550 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v4r4s\" (UniqueName: \"kubernetes.io/projected/9d88dfdf-afbc-4d29-b01a-5089ecef5fcb-kube-api-access-v4r4s\") pod \"feast-test-apply-28dmq\" (UID: \"9d88dfdf-afbc-4d29-b01a-5089ecef5fcb\") " pod="test-ns-feast/feast-test-apply-28dmq" Sep 09 08:50:44.693923 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:50:44.693894 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-v4r4s\" (UniqueName: \"kubernetes.io/projected/9d88dfdf-afbc-4d29-b01a-5089ecef5fcb-kube-api-access-v4r4s\") pod \"feast-test-apply-28dmq\" (UID: \"9d88dfdf-afbc-4d29-b01a-5089ecef5fcb\") " pod="test-ns-feast/feast-test-apply-28dmq" Sep 09 08:50:44.768309 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:50:44.768227 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-test-apply-28dmq" Sep 09 08:50:45.033098 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:50:45.033019 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/feast-test-apply-28dmq"] Sep 09 08:50:45.035983 ip-10-0-137-144 kubenswrapper[2564]: W0909 08:50:45.035955 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod9d88dfdf_afbc_4d29_b01a_5089ecef5fcb.slice/crio-95eeb9d2287554223cb9ac35de59d3fdac4ad7bdf8f6c7ecdeb750e2fe000821 WatchSource:0}: Error finding container 95eeb9d2287554223cb9ac35de59d3fdac4ad7bdf8f6c7ecdeb750e2fe000821: Status 404 returned error can't find the container with id 95eeb9d2287554223cb9ac35de59d3fdac4ad7bdf8f6c7ecdeb750e2fe000821 Sep 09 08:50:45.399487 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:50:45.399448 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-test-apply-28dmq" event={"ID":"9d88dfdf-afbc-4d29-b01a-5089ecef5fcb","Type":"ContainerStarted","Data":"95eeb9d2287554223cb9ac35de59d3fdac4ad7bdf8f6c7ecdeb750e2fe000821"} Sep 09 08:50:51.424206 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:50:51.424169 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-test-apply-28dmq" event={"ID":"9d88dfdf-afbc-4d29-b01a-5089ecef5fcb","Type":"ContainerStarted","Data":"bf7e3f87a79283d03313e69c0ae67995d9e2e147145095d7581e07de7660c8ad"} Sep 09 08:50:58.451714 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:50:58.451678 2564 generic.go:356] "Generic (PLEG): container finished" podID="9d88dfdf-afbc-4d29-b01a-5089ecef5fcb" containerID="bf7e3f87a79283d03313e69c0ae67995d9e2e147145095d7581e07de7660c8ad" exitCode=0 Sep 09 08:50:58.452065 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:50:58.451722 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-test-apply-28dmq" event={"ID":"9d88dfdf-afbc-4d29-b01a-5089ecef5fcb","Type":"ContainerDied","Data":"bf7e3f87a79283d03313e69c0ae67995d9e2e147145095d7581e07de7660c8ad"} Sep 09 08:50:59.457226 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:50:59.457189 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-test-apply-28dmq" event={"ID":"9d88dfdf-afbc-4d29-b01a-5089ecef5fcb","Type":"ContainerStarted","Data":"542245cdbf89d08d475049960b85f6f014d208db98b745f581acce2339dc3741"} Sep 09 08:50:59.473145 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:50:59.473092 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="test-ns-feast/feast-test-apply-28dmq" podStartSLOduration=2.876590637 podStartE2EDuration="15.47307745s" totalImagesPullingTime="6.168391941s" totalInitContainerRuntime="6.428094872s" isStatefulPod=false podCreationTimestamp="2026-09-09 08:50:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 08:50:59.471361584 +0000 UTC m=+720.169245482" watchObservedRunningTime="2026-09-09 08:50:59.47307745 +0000 UTC m=+720.170961350" Sep 09 08:51:08.490393 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:51:08.490330 2564 generic.go:356] "Generic (PLEG): container finished" podID="9d88dfdf-afbc-4d29-b01a-5089ecef5fcb" containerID="542245cdbf89d08d475049960b85f6f014d208db98b745f581acce2339dc3741" exitCode=0 Sep 09 08:51:08.490756 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:51:08.490409 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-test-apply-28dmq" event={"ID":"9d88dfdf-afbc-4d29-b01a-5089ecef5fcb","Type":"ContainerDied","Data":"542245cdbf89d08d475049960b85f6f014d208db98b745f581acce2339dc3741"} Sep 09 08:51:09.619728 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:51:09.619703 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-test-apply-28dmq" Sep 09 08:51:09.673752 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:51:09.673723 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-v4r4s\" (UniqueName: \"kubernetes.io/projected/9d88dfdf-afbc-4d29-b01a-5089ecef5fcb-kube-api-access-v4r4s\") pod \"9d88dfdf-afbc-4d29-b01a-5089ecef5fcb\" (UID: \"9d88dfdf-afbc-4d29-b01a-5089ecef5fcb\") " Sep 09 08:51:09.675787 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:51:09.675760 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9d88dfdf-afbc-4d29-b01a-5089ecef5fcb-kube-api-access-v4r4s" (OuterVolumeSpecName: "kube-api-access-v4r4s") pod "9d88dfdf-afbc-4d29-b01a-5089ecef5fcb" (UID: "9d88dfdf-afbc-4d29-b01a-5089ecef5fcb"). InnerVolumeSpecName "kube-api-access-v4r4s". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 09 08:51:09.774315 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:51:09.774227 2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-v4r4s\" (UniqueName: \"kubernetes.io/projected/9d88dfdf-afbc-4d29-b01a-5089ecef5fcb-kube-api-access-v4r4s\") on node \"ip-10-0-137-144.ec2.internal\" DevicePath \"\"" Sep 09 08:51:10.499101 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:51:10.499072 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-test-apply-28dmq" Sep 09 08:51:10.499101 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:51:10.499095 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-test-apply-28dmq" event={"ID":"9d88dfdf-afbc-4d29-b01a-5089ecef5fcb","Type":"ContainerDied","Data":"95eeb9d2287554223cb9ac35de59d3fdac4ad7bdf8f6c7ecdeb750e2fe000821"} Sep 09 08:51:10.499294 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:51:10.499128 2564 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="95eeb9d2287554223cb9ac35de59d3fdac4ad7bdf8f6c7ecdeb750e2fe000821" Sep 09 08:51:10.672061 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:51:10.672034 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-feast_feast-test-apply-28dmq_9d88dfdf-afbc-4d29-b01a-5089ecef5fcb/feast-0/0.log" Sep 09 08:51:10.677174 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:51:10.677150 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-feast_feast-test-apply-28dmq_9d88dfdf-afbc-4d29-b01a-5089ecef5fcb/feast-1/0.log" Sep 09 08:51:47.647315 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:51:47.647279 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast/feast-test-apply-28dmq"] Sep 09 08:51:47.654816 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:51:47.654788 2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["test-ns-feast/feast-test-apply-28dmq"] Sep 09 08:51:47.666634 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:51:47.666605 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast/redis-69bbd798b6-qtg5j"] Sep 09 08:51:47.666802 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:51:47.666780 2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/redis-69bbd798b6-qtg5j" podUID="ff512c89-875c-4bcd-9124-74dae44d3fe7" containerName="redis" containerID="cri-o://51e88f714082d1f5a30292151a4877bb417fb0493d488215e47bfc2051bc3172" gracePeriod=30 Sep 09 08:51:47.806181 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:51:47.806145 2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9d88dfdf-afbc-4d29-b01a-5089ecef5fcb" path="/var/lib/kubelet/pods/9d88dfdf-afbc-4d29-b01a-5089ecef5fcb/volumes" Sep 09 08:51:47.906566 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:51:47.906506 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/redis-69bbd798b6-qtg5j" Sep 09 08:51:48.049512 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:51:48.049469 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gg2lw\" (UniqueName: \"kubernetes.io/projected/ff512c89-875c-4bcd-9124-74dae44d3fe7-kube-api-access-gg2lw\") pod \"ff512c89-875c-4bcd-9124-74dae44d3fe7\" (UID: \"ff512c89-875c-4bcd-9124-74dae44d3fe7\") " Sep 09 08:51:48.051518 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:51:48.051490 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ff512c89-875c-4bcd-9124-74dae44d3fe7-kube-api-access-gg2lw" (OuterVolumeSpecName: "kube-api-access-gg2lw") pod "ff512c89-875c-4bcd-9124-74dae44d3fe7" (UID: "ff512c89-875c-4bcd-9124-74dae44d3fe7"). InnerVolumeSpecName "kube-api-access-gg2lw". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 09 08:51:48.150158 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:51:48.150105 2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gg2lw\" (UniqueName: \"kubernetes.io/projected/ff512c89-875c-4bcd-9124-74dae44d3fe7-kube-api-access-gg2lw\") on node \"ip-10-0-137-144.ec2.internal\" DevicePath \"\"" Sep 09 08:51:48.636035 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:51:48.635996 2564 generic.go:356] "Generic (PLEG): container finished" podID="ff512c89-875c-4bcd-9124-74dae44d3fe7" containerID="51e88f714082d1f5a30292151a4877bb417fb0493d488215e47bfc2051bc3172" exitCode=0 Sep 09 08:51:48.636222 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:51:48.636047 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/redis-69bbd798b6-qtg5j" Sep 09 08:51:48.636222 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:51:48.636050 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/redis-69bbd798b6-qtg5j" event={"ID":"ff512c89-875c-4bcd-9124-74dae44d3fe7","Type":"ContainerDied","Data":"51e88f714082d1f5a30292151a4877bb417fb0493d488215e47bfc2051bc3172"} Sep 09 08:51:48.636222 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:51:48.636171 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/redis-69bbd798b6-qtg5j" event={"ID":"ff512c89-875c-4bcd-9124-74dae44d3fe7","Type":"ContainerDied","Data":"ffb9096f717a01281e2dc309e8ffa0ff176c2793e69c338c8bfa7a96612a9343"} Sep 09 08:51:48.636222 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:51:48.636199 2564 scope.go:117] "RemoveContainer" containerID="51e88f714082d1f5a30292151a4877bb417fb0493d488215e47bfc2051bc3172" Sep 09 08:51:48.644768 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:51:48.644740 2564 scope.go:117] "RemoveContainer" containerID="51e88f714082d1f5a30292151a4877bb417fb0493d488215e47bfc2051bc3172" Sep 09 08:51:48.645013 ip-10-0-137-144 kubenswrapper[2564]: E0909 08:51:48.644988 2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"51e88f714082d1f5a30292151a4877bb417fb0493d488215e47bfc2051bc3172\": container with ID starting with 51e88f714082d1f5a30292151a4877bb417fb0493d488215e47bfc2051bc3172 not found: ID does not exist" containerID="51e88f714082d1f5a30292151a4877bb417fb0493d488215e47bfc2051bc3172" Sep 09 08:51:48.645055 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:51:48.645019 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"51e88f714082d1f5a30292151a4877bb417fb0493d488215e47bfc2051bc3172"} err="failed to get container status \"51e88f714082d1f5a30292151a4877bb417fb0493d488215e47bfc2051bc3172\": rpc error: code = NotFound desc = could not find container \"51e88f714082d1f5a30292151a4877bb417fb0493d488215e47bfc2051bc3172\": container with ID starting with 51e88f714082d1f5a30292151a4877bb417fb0493d488215e47bfc2051bc3172 not found: ID does not exist" Sep 09 08:51:48.655601 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:51:48.655578 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast/redis-69bbd798b6-qtg5j"] Sep 09 08:51:48.659522 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:51:48.659501 2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["test-ns-feast/redis-69bbd798b6-qtg5j"] Sep 09 08:51:49.806011 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:51:49.805976 2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ff512c89-875c-4bcd-9124-74dae44d3fe7" path="/var/lib/kubelet/pods/ff512c89-875c-4bcd-9124-74dae44d3fe7/volumes" Sep 09 08:53:59.724098 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:53:59.724067 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-tdfqx_f81169f8-3c85-4cd7-8b59-684973ff46f7/console-operator/2.log" Sep 09 08:53:59.725150 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:53:59.725125 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-tdfqx_f81169f8-3c85-4cd7-8b59-684973ff46f7/console-operator/2.log" Sep 09 08:56:59.762652 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:56:59.762619 2564 scope.go:117] "RemoveContainer" containerID="542245cdbf89d08d475049960b85f6f014d208db98b745f581acce2339dc3741" Sep 09 08:56:59.770214 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:56:59.770193 2564 scope.go:117] "RemoveContainer" containerID="bf7e3f87a79283d03313e69c0ae67995d9e2e147145095d7581e07de7660c8ad" Sep 09 08:57:05.889447 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:57:05.889413 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["test-ns-feast/feast-simple-feast-setup-57576b8fcf-c5zcq"] Sep 09 08:57:05.889796 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:57:05.889670 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9d88dfdf-afbc-4d29-b01a-5089ecef5fcb" containerName="feast-1" Sep 09 08:57:05.889796 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:57:05.889681 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="9d88dfdf-afbc-4d29-b01a-5089ecef5fcb" containerName="feast-1" Sep 09 08:57:05.889796 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:57:05.889700 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ff512c89-875c-4bcd-9124-74dae44d3fe7" containerName="redis" Sep 09 08:57:05.889796 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:57:05.889706 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="ff512c89-875c-4bcd-9124-74dae44d3fe7" containerName="redis" Sep 09 08:57:05.889796 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:57:05.889720 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9d88dfdf-afbc-4d29-b01a-5089ecef5fcb" containerName="feast-0" Sep 09 08:57:05.889796 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:57:05.889726 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="9d88dfdf-afbc-4d29-b01a-5089ecef5fcb" containerName="feast-0" Sep 09 08:57:05.889796 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:57:05.889769 2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="ff512c89-875c-4bcd-9124-74dae44d3fe7" containerName="redis" Sep 09 08:57:05.889796 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:57:05.889775 2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="9d88dfdf-afbc-4d29-b01a-5089ecef5fcb" containerName="feast-1" Sep 09 08:57:05.892643 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:57:05.892625 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-c5zcq" Sep 09 08:57:05.895051 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:57:05.895029 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-registry-tls\"" Sep 09 08:57:05.895176 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:57:05.895037 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast\"/\"openshift-service-ca.crt\"" Sep 09 08:57:05.895394 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:57:05.895372 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-offline-tls\"" Sep 09 08:57:05.895475 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:57:05.895380 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-online-tls\"" Sep 09 08:57:05.895475 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:57:05.895416 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast\"/\"kube-root-ca.crt\"" Sep 09 08:57:05.895475 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:57:05.895399 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-ui-tls\"" Sep 09 08:57:05.895622 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:57:05.895487 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-dockercfg-jpkfd\"" Sep 09 08:57:05.904508 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:57:05.904490 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-57576b8fcf-c5zcq"] Sep 09 08:57:05.949043 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:57:05.949018 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8gc5g\" (UniqueName: \"kubernetes.io/projected/a13283a7-8ed3-4875-8ce1-1782fa555f33-kube-api-access-8gc5g\") pod \"feast-simple-feast-setup-57576b8fcf-c5zcq\" (UID: \"a13283a7-8ed3-4875-8ce1-1782fa555f33\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-c5zcq" Sep 09 08:57:05.949161 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:57:05.949057 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/a13283a7-8ed3-4875-8ce1-1782fa555f33-ui-tls\") pod \"feast-simple-feast-setup-57576b8fcf-c5zcq\" (UID: \"a13283a7-8ed3-4875-8ce1-1782fa555f33\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-c5zcq" Sep 09 08:57:05.949161 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:57:05.949085 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/a13283a7-8ed3-4875-8ce1-1782fa555f33-offline-tls\") pod \"feast-simple-feast-setup-57576b8fcf-c5zcq\" (UID: \"a13283a7-8ed3-4875-8ce1-1782fa555f33\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-c5zcq" Sep 09 08:57:05.949161 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:57:05.949143 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/a13283a7-8ed3-4875-8ce1-1782fa555f33-online-tls\") pod \"feast-simple-feast-setup-57576b8fcf-c5zcq\" (UID: \"a13283a7-8ed3-4875-8ce1-1782fa555f33\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-c5zcq" Sep 09 08:57:05.949270 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:57:05.949179 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/a13283a7-8ed3-4875-8ce1-1782fa555f33-registry-tls\") pod \"feast-simple-feast-setup-57576b8fcf-c5zcq\" (UID: \"a13283a7-8ed3-4875-8ce1-1782fa555f33\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-c5zcq" Sep 09 08:57:05.949270 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:57:05.949206 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/a13283a7-8ed3-4875-8ce1-1782fa555f33-feast-data\") pod \"feast-simple-feast-setup-57576b8fcf-c5zcq\" (UID: \"a13283a7-8ed3-4875-8ce1-1782fa555f33\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-c5zcq" Sep 09 08:57:06.049909 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:57:06.049877 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/a13283a7-8ed3-4875-8ce1-1782fa555f33-ui-tls\") pod \"feast-simple-feast-setup-57576b8fcf-c5zcq\" (UID: \"a13283a7-8ed3-4875-8ce1-1782fa555f33\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-c5zcq" Sep 09 08:57:06.050086 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:57:06.049921 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/a13283a7-8ed3-4875-8ce1-1782fa555f33-offline-tls\") pod \"feast-simple-feast-setup-57576b8fcf-c5zcq\" (UID: \"a13283a7-8ed3-4875-8ce1-1782fa555f33\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-c5zcq" Sep 09 08:57:06.050086 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:57:06.049943 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/a13283a7-8ed3-4875-8ce1-1782fa555f33-online-tls\") pod \"feast-simple-feast-setup-57576b8fcf-c5zcq\" (UID: \"a13283a7-8ed3-4875-8ce1-1782fa555f33\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-c5zcq" Sep 09 08:57:06.050086 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:57:06.049962 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/a13283a7-8ed3-4875-8ce1-1782fa555f33-registry-tls\") pod \"feast-simple-feast-setup-57576b8fcf-c5zcq\" (UID: \"a13283a7-8ed3-4875-8ce1-1782fa555f33\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-c5zcq" Sep 09 08:57:06.050086 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:57:06.049990 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/a13283a7-8ed3-4875-8ce1-1782fa555f33-feast-data\") pod \"feast-simple-feast-setup-57576b8fcf-c5zcq\" (UID: \"a13283a7-8ed3-4875-8ce1-1782fa555f33\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-c5zcq" Sep 09 08:57:06.050086 ip-10-0-137-144 kubenswrapper[2564]: E0909 08:57:06.050036 2564 secret.go:189] Couldn't get secret test-ns-feast/feast-simple-feast-setup-ui-tls: secret "feast-simple-feast-setup-ui-tls" not found Sep 09 08:57:06.050329 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:57:06.050089 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8gc5g\" (UniqueName: \"kubernetes.io/projected/a13283a7-8ed3-4875-8ce1-1782fa555f33-kube-api-access-8gc5g\") pod \"feast-simple-feast-setup-57576b8fcf-c5zcq\" (UID: \"a13283a7-8ed3-4875-8ce1-1782fa555f33\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-c5zcq" Sep 09 08:57:06.050329 ip-10-0-137-144 kubenswrapper[2564]: E0909 08:57:06.050118 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a13283a7-8ed3-4875-8ce1-1782fa555f33-ui-tls podName:a13283a7-8ed3-4875-8ce1-1782fa555f33 nodeName:}" failed. No retries permitted until 2026-09-09 08:57:06.550096695 +0000 UTC m=+1087.247980576 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "ui-tls" (UniqueName: "kubernetes.io/secret/a13283a7-8ed3-4875-8ce1-1782fa555f33-ui-tls") pod "feast-simple-feast-setup-57576b8fcf-c5zcq" (UID: "a13283a7-8ed3-4875-8ce1-1782fa555f33") : secret "feast-simple-feast-setup-ui-tls" not found Sep 09 08:57:06.050329 ip-10-0-137-144 kubenswrapper[2564]: E0909 08:57:06.050045 2564 secret.go:189] Couldn't get secret test-ns-feast/feast-simple-feast-setup-offline-tls: secret "feast-simple-feast-setup-offline-tls" not found Sep 09 08:57:06.050329 ip-10-0-137-144 kubenswrapper[2564]: E0909 08:57:06.050193 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a13283a7-8ed3-4875-8ce1-1782fa555f33-offline-tls podName:a13283a7-8ed3-4875-8ce1-1782fa555f33 nodeName:}" failed. No retries permitted until 2026-09-09 08:57:06.550172471 +0000 UTC m=+1087.248056352 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "offline-tls" (UniqueName: "kubernetes.io/secret/a13283a7-8ed3-4875-8ce1-1782fa555f33-offline-tls") pod "feast-simple-feast-setup-57576b8fcf-c5zcq" (UID: "a13283a7-8ed3-4875-8ce1-1782fa555f33") : secret "feast-simple-feast-setup-offline-tls" not found Sep 09 08:57:06.050538 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:57:06.050376 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/a13283a7-8ed3-4875-8ce1-1782fa555f33-feast-data\") pod \"feast-simple-feast-setup-57576b8fcf-c5zcq\" (UID: \"a13283a7-8ed3-4875-8ce1-1782fa555f33\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-c5zcq" Sep 09 08:57:06.052475 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:57:06.052453 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/a13283a7-8ed3-4875-8ce1-1782fa555f33-online-tls\") pod \"feast-simple-feast-setup-57576b8fcf-c5zcq\" (UID: \"a13283a7-8ed3-4875-8ce1-1782fa555f33\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-c5zcq" Sep 09 08:57:06.052580 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:57:06.052461 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/a13283a7-8ed3-4875-8ce1-1782fa555f33-registry-tls\") pod \"feast-simple-feast-setup-57576b8fcf-c5zcq\" (UID: \"a13283a7-8ed3-4875-8ce1-1782fa555f33\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-c5zcq" Sep 09 08:57:06.057529 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:57:06.057505 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8gc5g\" (UniqueName: \"kubernetes.io/projected/a13283a7-8ed3-4875-8ce1-1782fa555f33-kube-api-access-8gc5g\") pod \"feast-simple-feast-setup-57576b8fcf-c5zcq\" (UID: \"a13283a7-8ed3-4875-8ce1-1782fa555f33\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-c5zcq" Sep 09 08:57:06.554774 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:57:06.554741 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/a13283a7-8ed3-4875-8ce1-1782fa555f33-ui-tls\") pod \"feast-simple-feast-setup-57576b8fcf-c5zcq\" (UID: \"a13283a7-8ed3-4875-8ce1-1782fa555f33\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-c5zcq" Sep 09 08:57:06.554946 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:57:06.554787 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/a13283a7-8ed3-4875-8ce1-1782fa555f33-offline-tls\") pod \"feast-simple-feast-setup-57576b8fcf-c5zcq\" (UID: \"a13283a7-8ed3-4875-8ce1-1782fa555f33\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-c5zcq" Sep 09 08:57:06.557313 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:57:06.557286 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/a13283a7-8ed3-4875-8ce1-1782fa555f33-ui-tls\") pod \"feast-simple-feast-setup-57576b8fcf-c5zcq\" (UID: \"a13283a7-8ed3-4875-8ce1-1782fa555f33\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-c5zcq" Sep 09 08:57:06.557450 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:57:06.557286 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/a13283a7-8ed3-4875-8ce1-1782fa555f33-offline-tls\") pod \"feast-simple-feast-setup-57576b8fcf-c5zcq\" (UID: \"a13283a7-8ed3-4875-8ce1-1782fa555f33\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-c5zcq" Sep 09 08:57:06.801645 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:57:06.801588 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-c5zcq" Sep 09 08:57:07.072573 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:57:07.072551 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-57576b8fcf-c5zcq"] Sep 09 08:57:07.074656 ip-10-0-137-144 kubenswrapper[2564]: W0909 08:57:07.074630 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poda13283a7_8ed3_4875_8ce1_1782fa555f33.slice/crio-868e7dbae736ed964142606d9e7d17182f10534e5a02351105713e48cb466235 WatchSource:0}: Error finding container 868e7dbae736ed964142606d9e7d17182f10534e5a02351105713e48cb466235: Status 404 returned error can't find the container with id 868e7dbae736ed964142606d9e7d17182f10534e5a02351105713e48cb466235 Sep 09 08:57:07.076488 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:57:07.076470 2564 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Sep 09 08:57:07.742599 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:57:07.742513 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-c5zcq" event={"ID":"a13283a7-8ed3-4875-8ce1-1782fa555f33","Type":"ContainerStarted","Data":"868e7dbae736ed964142606d9e7d17182f10534e5a02351105713e48cb466235"} Sep 09 08:57:19.794899 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:57:19.794805 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-c5zcq" event={"ID":"a13283a7-8ed3-4875-8ce1-1782fa555f33","Type":"ContainerStarted","Data":"0fa3917fd179953872abcd34e1c6444aa1e6b678bd3adcd85ce380fb9bcdbbb5"} Sep 09 08:57:24.815691 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:57:24.815609 2564 generic.go:356] "Generic (PLEG): container finished" podID="a13283a7-8ed3-4875-8ce1-1782fa555f33" containerID="0fa3917fd179953872abcd34e1c6444aa1e6b678bd3adcd85ce380fb9bcdbbb5" exitCode=0 Sep 09 08:57:24.815691 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:57:24.815678 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-c5zcq" event={"ID":"a13283a7-8ed3-4875-8ce1-1782fa555f33","Type":"ContainerDied","Data":"0fa3917fd179953872abcd34e1c6444aa1e6b678bd3adcd85ce380fb9bcdbbb5"} Sep 09 08:57:25.820846 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:57:25.820811 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-c5zcq" event={"ID":"a13283a7-8ed3-4875-8ce1-1782fa555f33","Type":"ContainerStarted","Data":"f32935ba7134e142d5d35fb13e3cc254f17a2fca7d4f0194bc14c17ed293d786"} Sep 09 08:57:30.847247 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:57:30.847211 2564 generic.go:356] "Generic (PLEG): container finished" podID="a13283a7-8ed3-4875-8ce1-1782fa555f33" containerID="f32935ba7134e142d5d35fb13e3cc254f17a2fca7d4f0194bc14c17ed293d786" exitCode=0 Sep 09 08:57:30.847640 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:57:30.847281 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-c5zcq" event={"ID":"a13283a7-8ed3-4875-8ce1-1782fa555f33","Type":"ContainerDied","Data":"f32935ba7134e142d5d35fb13e3cc254f17a2fca7d4f0194bc14c17ed293d786"} Sep 09 08:57:31.857462 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:57:31.857415 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-c5zcq" event={"ID":"a13283a7-8ed3-4875-8ce1-1782fa555f33","Type":"ContainerStarted","Data":"1ce53154071a478e3da0a65bca2ced41c2d7eab92b6d03eb3cbfeb9f6b4158b5"} Sep 09 08:57:31.857954 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:57:31.857489 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-c5zcq" event={"ID":"a13283a7-8ed3-4875-8ce1-1782fa555f33","Type":"ContainerStarted","Data":"738cf271fa7e22b530a0b5cf247f518244f139af08d7bf0f1fa2065653859cda"} Sep 09 08:57:31.857954 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:57:31.857511 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-c5zcq" event={"ID":"a13283a7-8ed3-4875-8ce1-1782fa555f33","Type":"ContainerStarted","Data":"6b00a9504005f83841e4859c8067821b9564b5e8230d03faa417a29f1049f7b9"} Sep 09 08:57:31.857954 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:57:31.857531 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-c5zcq" event={"ID":"a13283a7-8ed3-4875-8ce1-1782fa555f33","Type":"ContainerStarted","Data":"065d420152bff518581d4655984d30a40ce11864bf66d995f2368c488b9613f1"} Sep 09 08:57:31.879191 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:57:31.879120 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-c5zcq" podStartSLOduration=14.48146946 podStartE2EDuration="26.879097784s" totalImagesPullingTime="12.397628324s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 08:57:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 08:57:31.877614572 +0000 UTC m=+1112.575498474" watchObservedRunningTime="2026-09-09 08:57:31.879097784 +0000 UTC m=+1112.576981686" Sep 09 08:57:33.804211 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:57:33.804155 2564 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-c5zcq" podUID="a13283a7-8ed3-4875-8ce1-1782fa555f33" containerName="offline" probeResult="failure" output="dial tcp 10.132.0.20:8816: connect: connection refused" Sep 09 08:57:33.804211 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:57:33.804195 2564 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-c5zcq" podUID="a13283a7-8ed3-4875-8ce1-1782fa555f33" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.20:8443: connect: connection refused" Sep 09 08:57:33.804765 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:57:33.804221 2564 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-c5zcq" podUID="a13283a7-8ed3-4875-8ce1-1782fa555f33" containerName="online" probeResult="failure" output="Get \"https://10.132.0.20:6567/health\": dial tcp 10.132.0.20:6567: connect: connection refused" Sep 09 08:57:33.804765 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:57:33.804135 2564 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-c5zcq" podUID="a13283a7-8ed3-4875-8ce1-1782fa555f33" containerName="registry" probeResult="failure" output="dial tcp 10.132.0.20:6571: connect: connection refused" Sep 09 08:57:33.809281 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:57:33.809255 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-c5zcq" Sep 09 08:57:33.809448 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:57:33.809302 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-c5zcq" Sep 09 08:57:33.809448 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:57:33.809320 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-c5zcq" Sep 09 08:57:33.809448 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:57:33.809354 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-c5zcq" Sep 09 08:57:36.803013 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:57:36.802643 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-c5zcq" Sep 09 08:57:36.803013 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:57:36.802712 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-c5zcq" Sep 09 08:57:36.803013 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:57:36.802733 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-c5zcq" Sep 09 08:57:36.803013 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:57:36.802881 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-c5zcq" Sep 09 08:57:36.803013 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:57:36.802906 2564 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-c5zcq" podUID="a13283a7-8ed3-4875-8ce1-1782fa555f33" containerName="offline" probeResult="failure" output="dial tcp 10.132.0.20:8816: connect: connection refused" Sep 09 08:57:36.803013 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:57:36.802949 2564 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-c5zcq" podUID="a13283a7-8ed3-4875-8ce1-1782fa555f33" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.20:8443: connect: connection refused" Sep 09 08:57:36.803013 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:57:36.802907 2564 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-c5zcq" podUID="a13283a7-8ed3-4875-8ce1-1782fa555f33" containerName="registry" probeResult="failure" output="dial tcp 10.132.0.20:6571: connect: connection refused" Sep 09 08:57:36.803915 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:57:36.803875 2564 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-c5zcq" podUID="a13283a7-8ed3-4875-8ce1-1782fa555f33" containerName="online" probeResult="failure" output="Get \"https://10.132.0.20:6567/health\": dial tcp 10.132.0.20:6567: connect: connection refused" Sep 09 08:57:39.807395 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:57:39.807370 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-c5zcq" Sep 09 08:57:39.807840 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:57:39.807486 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-c5zcq" Sep 09 08:57:39.807901 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:57:39.807859 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-c5zcq" Sep 09 08:57:39.808264 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:57:39.808243 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-c5zcq" Sep 09 08:57:39.808423 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:57:39.808405 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-c5zcq" Sep 09 08:57:39.808574 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:57:39.808560 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-c5zcq" Sep 09 08:57:39.905042 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:57:39.905013 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-c5zcq" Sep 09 08:57:39.907746 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:57:39.907726 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-c5zcq" Sep 09 08:58:42.364005 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:58:42.363916 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-57576b8fcf-c5zcq"] Sep 09 08:58:42.364624 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:58:42.364165 2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-c5zcq" podUID="a13283a7-8ed3-4875-8ce1-1782fa555f33" containerName="registry" containerID="cri-o://065d420152bff518581d4655984d30a40ce11864bf66d995f2368c488b9613f1" gracePeriod=30 Sep 09 08:58:42.364624 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:58:42.364187 2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-c5zcq" podUID="a13283a7-8ed3-4875-8ce1-1782fa555f33" containerName="ui" containerID="cri-o://1ce53154071a478e3da0a65bca2ced41c2d7eab92b6d03eb3cbfeb9f6b4158b5" gracePeriod=30 Sep 09 08:58:42.364624 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:58:42.364259 2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-c5zcq" podUID="a13283a7-8ed3-4875-8ce1-1782fa555f33" containerName="offline" containerID="cri-o://738cf271fa7e22b530a0b5cf247f518244f139af08d7bf0f1fa2065653859cda" gracePeriod=30 Sep 09 08:58:42.364624 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:58:42.364259 2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-c5zcq" podUID="a13283a7-8ed3-4875-8ce1-1782fa555f33" containerName="online" containerID="cri-o://6b00a9504005f83841e4859c8067821b9564b5e8230d03faa417a29f1049f7b9" gracePeriod=30 Sep 09 08:58:42.953239 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:58:42.953203 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["test-ns-feast/feast-simple-feast-setup-57576b8fcf-45xxb"] Sep 09 08:58:42.957171 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:58:42.957152 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-45xxb" Sep 09 08:58:42.960934 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:58:42.960909 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-dockercfg-rtr4b\"" Sep 09 08:58:42.971142 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:58:42.971113 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/ad1b7c3f-c58e-4cd8-9892-cdec586ae467-ui-tls\") pod \"feast-simple-feast-setup-57576b8fcf-45xxb\" (UID: \"ad1b7c3f-c58e-4cd8-9892-cdec586ae467\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-45xxb" Sep 09 08:58:42.971274 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:58:42.971147 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wgxdq\" (UniqueName: \"kubernetes.io/projected/ad1b7c3f-c58e-4cd8-9892-cdec586ae467-kube-api-access-wgxdq\") pod \"feast-simple-feast-setup-57576b8fcf-45xxb\" (UID: \"ad1b7c3f-c58e-4cd8-9892-cdec586ae467\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-45xxb" Sep 09 08:58:42.971274 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:58:42.971188 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/ad1b7c3f-c58e-4cd8-9892-cdec586ae467-feast-data\") pod \"feast-simple-feast-setup-57576b8fcf-45xxb\" (UID: \"ad1b7c3f-c58e-4cd8-9892-cdec586ae467\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-45xxb" Sep 09 08:58:42.971274 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:58:42.971214 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/ad1b7c3f-c58e-4cd8-9892-cdec586ae467-offline-tls\") pod \"feast-simple-feast-setup-57576b8fcf-45xxb\" (UID: \"ad1b7c3f-c58e-4cd8-9892-cdec586ae467\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-45xxb" Sep 09 08:58:42.971274 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:58:42.971234 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/ad1b7c3f-c58e-4cd8-9892-cdec586ae467-registry-tls\") pod \"feast-simple-feast-setup-57576b8fcf-45xxb\" (UID: \"ad1b7c3f-c58e-4cd8-9892-cdec586ae467\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-45xxb" Sep 09 08:58:42.971478 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:58:42.971287 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/ad1b7c3f-c58e-4cd8-9892-cdec586ae467-online-tls\") pod \"feast-simple-feast-setup-57576b8fcf-45xxb\" (UID: \"ad1b7c3f-c58e-4cd8-9892-cdec586ae467\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-45xxb" Sep 09 08:58:42.982505 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:58:42.982478 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-57576b8fcf-45xxb"] Sep 09 08:58:43.072273 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:58:43.072237 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/ad1b7c3f-c58e-4cd8-9892-cdec586ae467-online-tls\") pod \"feast-simple-feast-setup-57576b8fcf-45xxb\" (UID: \"ad1b7c3f-c58e-4cd8-9892-cdec586ae467\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-45xxb" Sep 09 08:58:43.072470 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:58:43.072283 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/ad1b7c3f-c58e-4cd8-9892-cdec586ae467-ui-tls\") pod \"feast-simple-feast-setup-57576b8fcf-45xxb\" (UID: \"ad1b7c3f-c58e-4cd8-9892-cdec586ae467\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-45xxb" Sep 09 08:58:43.072470 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:58:43.072381 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wgxdq\" (UniqueName: \"kubernetes.io/projected/ad1b7c3f-c58e-4cd8-9892-cdec586ae467-kube-api-access-wgxdq\") pod \"feast-simple-feast-setup-57576b8fcf-45xxb\" (UID: \"ad1b7c3f-c58e-4cd8-9892-cdec586ae467\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-45xxb" Sep 09 08:58:43.072470 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:58:43.072438 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/ad1b7c3f-c58e-4cd8-9892-cdec586ae467-feast-data\") pod \"feast-simple-feast-setup-57576b8fcf-45xxb\" (UID: \"ad1b7c3f-c58e-4cd8-9892-cdec586ae467\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-45xxb" Sep 09 08:58:43.072639 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:58:43.072475 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/ad1b7c3f-c58e-4cd8-9892-cdec586ae467-offline-tls\") pod \"feast-simple-feast-setup-57576b8fcf-45xxb\" (UID: \"ad1b7c3f-c58e-4cd8-9892-cdec586ae467\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-45xxb" Sep 09 08:58:43.072639 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:58:43.072508 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/ad1b7c3f-c58e-4cd8-9892-cdec586ae467-registry-tls\") pod \"feast-simple-feast-setup-57576b8fcf-45xxb\" (UID: \"ad1b7c3f-c58e-4cd8-9892-cdec586ae467\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-45xxb" Sep 09 08:58:43.072639 ip-10-0-137-144 kubenswrapper[2564]: E0909 08:58:43.072625 2564 secret.go:189] Couldn't get secret test-ns-feast/feast-simple-feast-setup-registry-tls: secret "feast-simple-feast-setup-registry-tls" not found Sep 09 08:58:43.072787 ip-10-0-137-144 kubenswrapper[2564]: E0909 08:58:43.072699 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ad1b7c3f-c58e-4cd8-9892-cdec586ae467-registry-tls podName:ad1b7c3f-c58e-4cd8-9892-cdec586ae467 nodeName:}" failed. No retries permitted until 2026-09-09 08:58:43.572673653 +0000 UTC m=+1184.270557539 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/secret/ad1b7c3f-c58e-4cd8-9892-cdec586ae467-registry-tls") pod "feast-simple-feast-setup-57576b8fcf-45xxb" (UID: "ad1b7c3f-c58e-4cd8-9892-cdec586ae467") : secret "feast-simple-feast-setup-registry-tls" not found Sep 09 08:58:43.072951 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:58:43.072921 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/ad1b7c3f-c58e-4cd8-9892-cdec586ae467-feast-data\") pod \"feast-simple-feast-setup-57576b8fcf-45xxb\" (UID: \"ad1b7c3f-c58e-4cd8-9892-cdec586ae467\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-45xxb" Sep 09 08:58:43.074902 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:58:43.074872 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/ad1b7c3f-c58e-4cd8-9892-cdec586ae467-ui-tls\") pod \"feast-simple-feast-setup-57576b8fcf-45xxb\" (UID: \"ad1b7c3f-c58e-4cd8-9892-cdec586ae467\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-45xxb" Sep 09 08:58:43.075013 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:58:43.074990 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/ad1b7c3f-c58e-4cd8-9892-cdec586ae467-online-tls\") pod \"feast-simple-feast-setup-57576b8fcf-45xxb\" (UID: \"ad1b7c3f-c58e-4cd8-9892-cdec586ae467\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-45xxb" Sep 09 08:58:43.075402 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:58:43.075326 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/ad1b7c3f-c58e-4cd8-9892-cdec586ae467-offline-tls\") pod \"feast-simple-feast-setup-57576b8fcf-45xxb\" (UID: \"ad1b7c3f-c58e-4cd8-9892-cdec586ae467\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-45xxb" Sep 09 08:58:43.089601 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:58:43.089581 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wgxdq\" (UniqueName: \"kubernetes.io/projected/ad1b7c3f-c58e-4cd8-9892-cdec586ae467-kube-api-access-wgxdq\") pod \"feast-simple-feast-setup-57576b8fcf-45xxb\" (UID: \"ad1b7c3f-c58e-4cd8-9892-cdec586ae467\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-45xxb" Sep 09 08:58:43.132905 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:58:43.132873 2564 generic.go:356] "Generic (PLEG): container finished" podID="a13283a7-8ed3-4875-8ce1-1782fa555f33" containerID="1ce53154071a478e3da0a65bca2ced41c2d7eab92b6d03eb3cbfeb9f6b4158b5" exitCode=0 Sep 09 08:58:43.133056 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:58:43.132947 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-c5zcq" event={"ID":"a13283a7-8ed3-4875-8ce1-1782fa555f33","Type":"ContainerDied","Data":"1ce53154071a478e3da0a65bca2ced41c2d7eab92b6d03eb3cbfeb9f6b4158b5"} Sep 09 08:58:43.576702 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:58:43.576656 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/ad1b7c3f-c58e-4cd8-9892-cdec586ae467-registry-tls\") pod \"feast-simple-feast-setup-57576b8fcf-45xxb\" (UID: \"ad1b7c3f-c58e-4cd8-9892-cdec586ae467\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-45xxb" Sep 09 08:58:43.579140 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:58:43.579113 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/ad1b7c3f-c58e-4cd8-9892-cdec586ae467-registry-tls\") pod \"feast-simple-feast-setup-57576b8fcf-45xxb\" (UID: \"ad1b7c3f-c58e-4cd8-9892-cdec586ae467\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-45xxb" Sep 09 08:58:43.868439 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:58:43.868300 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-45xxb" Sep 09 08:58:44.140420 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:58:44.140321 2564 generic.go:356] "Generic (PLEG): container finished" podID="a13283a7-8ed3-4875-8ce1-1782fa555f33" containerID="6b00a9504005f83841e4859c8067821b9564b5e8230d03faa417a29f1049f7b9" exitCode=0 Sep 09 08:58:44.140420 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:58:44.140398 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-c5zcq" event={"ID":"a13283a7-8ed3-4875-8ce1-1782fa555f33","Type":"ContainerDied","Data":"6b00a9504005f83841e4859c8067821b9564b5e8230d03faa417a29f1049f7b9"} Sep 09 08:58:44.158061 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:58:44.158033 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-57576b8fcf-45xxb"] Sep 09 08:58:44.161303 ip-10-0-137-144 kubenswrapper[2564]: W0909 08:58:44.161276 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podad1b7c3f_c58e_4cd8_9892_cdec586ae467.slice/crio-12d6fea8387415dc82604c01a09a75257a6fe8fadcda96f0005cd2e4f5a87fc8 WatchSource:0}: Error finding container 12d6fea8387415dc82604c01a09a75257a6fe8fadcda96f0005cd2e4f5a87fc8: Status 404 returned error can't find the container with id 12d6fea8387415dc82604c01a09a75257a6fe8fadcda96f0005cd2e4f5a87fc8 Sep 09 08:58:45.146076 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:58:45.146043 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-45xxb" event={"ID":"ad1b7c3f-c58e-4cd8-9892-cdec586ae467","Type":"ContainerStarted","Data":"71f4c789560bfa54dd303b0643b3636de56a06c76a7560487d90ea65d233f193"} Sep 09 08:58:45.146510 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:58:45.146087 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-45xxb" event={"ID":"ad1b7c3f-c58e-4cd8-9892-cdec586ae467","Type":"ContainerStarted","Data":"12d6fea8387415dc82604c01a09a75257a6fe8fadcda96f0005cd2e4f5a87fc8"} Sep 09 08:58:49.163252 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:58:49.163217 2564 generic.go:356] "Generic (PLEG): container finished" podID="ad1b7c3f-c58e-4cd8-9892-cdec586ae467" containerID="71f4c789560bfa54dd303b0643b3636de56a06c76a7560487d90ea65d233f193" exitCode=0 Sep 09 08:58:49.163660 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:58:49.163294 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-45xxb" event={"ID":"ad1b7c3f-c58e-4cd8-9892-cdec586ae467","Type":"ContainerDied","Data":"71f4c789560bfa54dd303b0643b3636de56a06c76a7560487d90ea65d233f193"} Sep 09 08:58:49.808838 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:58:49.808793 2564 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-c5zcq" podUID="a13283a7-8ed3-4875-8ce1-1782fa555f33" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.20:8443: connect: connection refused" Sep 09 08:58:49.905031 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:58:49.904982 2564 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-c5zcq" podUID="a13283a7-8ed3-4875-8ce1-1782fa555f33" containerName="online" probeResult="failure" output="Get \"https://10.132.0.20:6567/health\": dial tcp 10.132.0.20:6567: connect: connection refused" Sep 09 08:58:50.169084 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:58:50.169043 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-45xxb" event={"ID":"ad1b7c3f-c58e-4cd8-9892-cdec586ae467","Type":"ContainerStarted","Data":"03e0e0e26cea94272f860b808ef791796b56371c686b19d4a5f84e0436b7eb60"} Sep 09 08:58:55.189446 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:58:55.189408 2564 generic.go:356] "Generic (PLEG): container finished" podID="ad1b7c3f-c58e-4cd8-9892-cdec586ae467" containerID="03e0e0e26cea94272f860b808ef791796b56371c686b19d4a5f84e0436b7eb60" exitCode=0 Sep 09 08:58:55.189804 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:58:55.189477 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-45xxb" event={"ID":"ad1b7c3f-c58e-4cd8-9892-cdec586ae467","Type":"ContainerDied","Data":"03e0e0e26cea94272f860b808ef791796b56371c686b19d4a5f84e0436b7eb60"} Sep 09 08:58:56.199761 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:58:56.199727 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-45xxb" event={"ID":"ad1b7c3f-c58e-4cd8-9892-cdec586ae467","Type":"ContainerStarted","Data":"e16b24dda095b683c2bdacf240cfe9c0018394fc6b206776f8d4deeef24806c2"} Sep 09 08:58:56.200269 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:58:56.200248 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-45xxb" event={"ID":"ad1b7c3f-c58e-4cd8-9892-cdec586ae467","Type":"ContainerStarted","Data":"0b3b174735f3a31838640018c67c354b84adc5fdd376f1cdf9bacc405062db1f"} Sep 09 08:58:56.200420 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:58:56.200405 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-45xxb" event={"ID":"ad1b7c3f-c58e-4cd8-9892-cdec586ae467","Type":"ContainerStarted","Data":"567a7664c0c6e0c629f95160c5e61b4e62eb7f4005686caab4d806e23131d98a"} Sep 09 08:58:56.200518 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:58:56.200507 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-45xxb" event={"ID":"ad1b7c3f-c58e-4cd8-9892-cdec586ae467","Type":"ContainerStarted","Data":"e0c7a817995ec4aa70fc2b30e6c5a1b0764b956453ef444353c5b0ec2f825dfa"} Sep 09 08:58:56.231174 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:58:56.230750 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-45xxb" podStartSLOduration=14.230724373 podStartE2EDuration="14.230724373s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 08:58:42 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 08:58:56.228377957 +0000 UTC m=+1196.926261862" watchObservedRunningTime="2026-09-09 08:58:56.230724373 +0000 UTC m=+1196.928608274" Sep 09 08:58:58.869588 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:58:58.869550 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-45xxb" Sep 09 08:58:58.870166 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:58:58.870136 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-45xxb" Sep 09 08:58:58.870166 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:58:58.870169 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-45xxb" Sep 09 08:58:58.870374 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:58:58.870189 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-45xxb" Sep 09 08:58:58.871702 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:58:58.871667 2564 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-45xxb" podUID="ad1b7c3f-c58e-4cd8-9892-cdec586ae467" containerName="registry" probeResult="failure" output="dial tcp 10.132.0.21:6571: connect: connection refused" Sep 09 08:58:58.871819 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:58:58.871737 2564 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-45xxb" podUID="ad1b7c3f-c58e-4cd8-9892-cdec586ae467" containerName="offline" probeResult="failure" output="dial tcp 10.132.0.21:8816: connect: connection refused" Sep 09 08:58:58.871819 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:58:58.871742 2564 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-45xxb" podUID="ad1b7c3f-c58e-4cd8-9892-cdec586ae467" containerName="online" probeResult="failure" output="Get \"https://10.132.0.21:6567/health\": dial tcp 10.132.0.21:6567: connect: connection refused" Sep 09 08:58:58.871935 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:58:58.871677 2564 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-45xxb" podUID="ad1b7c3f-c58e-4cd8-9892-cdec586ae467" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.21:8443: connect: connection refused" Sep 09 08:58:59.756673 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:58:59.756641 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-tdfqx_f81169f8-3c85-4cd7-8b59-684973ff46f7/console-operator/2.log" Sep 09 08:58:59.758632 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:58:59.758603 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-tdfqx_f81169f8-3c85-4cd7-8b59-684973ff46f7/console-operator/2.log" Sep 09 08:58:59.808873 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:58:59.808836 2564 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-c5zcq" podUID="a13283a7-8ed3-4875-8ce1-1782fa555f33" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.20:8443: connect: connection refused" Sep 09 08:58:59.905518 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:58:59.905464 2564 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-c5zcq" podUID="a13283a7-8ed3-4875-8ce1-1782fa555f33" containerName="online" probeResult="failure" output="Get \"https://10.132.0.20:6567/health\": dial tcp 10.132.0.20:6567: connect: connection refused" Sep 09 08:59:01.869683 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:59:01.869634 2564 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-45xxb" podUID="ad1b7c3f-c58e-4cd8-9892-cdec586ae467" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.21:8443: connect: connection refused" Sep 09 08:59:01.869683 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:59:01.869666 2564 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-45xxb" podUID="ad1b7c3f-c58e-4cd8-9892-cdec586ae467" containerName="online" probeResult="failure" output="Get \"https://10.132.0.21:6567/health\": dial tcp 10.132.0.21:6567: connect: connection refused" Sep 09 08:59:01.870216 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:59:01.869684 2564 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-45xxb" podUID="ad1b7c3f-c58e-4cd8-9892-cdec586ae467" containerName="registry" probeResult="failure" output="dial tcp 10.132.0.21:6571: connect: connection refused" Sep 09 08:59:01.870216 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:59:01.869650 2564 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-45xxb" podUID="ad1b7c3f-c58e-4cd8-9892-cdec586ae467" containerName="offline" probeResult="failure" output="dial tcp 10.132.0.21:8816: connect: connection refused" Sep 09 08:59:03.868612 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:59:03.868576 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-45xxb" Sep 09 08:59:03.868991 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:59:03.868624 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-45xxb" Sep 09 08:59:03.868991 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:59:03.868638 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-45xxb" Sep 09 08:59:03.868991 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:59:03.868651 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-45xxb" Sep 09 08:59:04.869531 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:59:04.869502 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-45xxb" Sep 09 08:59:04.869892 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:59:04.869615 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-45xxb" Sep 09 08:59:04.869892 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:59:04.869877 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-45xxb" Sep 09 08:59:04.870507 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:59:04.870481 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-45xxb" Sep 09 08:59:04.870626 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:59:04.870550 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-45xxb" Sep 09 08:59:04.870704 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:59:04.870688 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-45xxb" Sep 09 08:59:04.874516 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:59:04.874499 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-45xxb" Sep 09 08:59:05.248938 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:59:05.248849 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-45xxb" Sep 09 08:59:09.808454 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:59:09.808414 2564 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-c5zcq" podUID="a13283a7-8ed3-4875-8ce1-1782fa555f33" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.20:8443: connect: connection refused" Sep 09 08:59:09.808912 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:59:09.808551 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-c5zcq" Sep 09 08:59:09.905286 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:59:09.905243 2564 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-c5zcq" podUID="a13283a7-8ed3-4875-8ce1-1782fa555f33" containerName="online" probeResult="failure" output="Get \"https://10.132.0.20:6567/health\": dial tcp 10.132.0.20:6567: connect: connection refused" Sep 09 08:59:09.905563 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:59:09.905394 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-c5zcq" Sep 09 08:59:13.019000 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:59:13.018971 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-c5zcq" Sep 09 08:59:13.102769 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:59:13.102726 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8gc5g\" (UniqueName: \"kubernetes.io/projected/a13283a7-8ed3-4875-8ce1-1782fa555f33-kube-api-access-8gc5g\") pod \"a13283a7-8ed3-4875-8ce1-1782fa555f33\" (UID: \"a13283a7-8ed3-4875-8ce1-1782fa555f33\") " Sep 09 08:59:13.102769 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:59:13.102774 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/a13283a7-8ed3-4875-8ce1-1782fa555f33-feast-data\") pod \"a13283a7-8ed3-4875-8ce1-1782fa555f33\" (UID: \"a13283a7-8ed3-4875-8ce1-1782fa555f33\") " Sep 09 08:59:13.103012 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:59:13.102818 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/a13283a7-8ed3-4875-8ce1-1782fa555f33-online-tls\") pod \"a13283a7-8ed3-4875-8ce1-1782fa555f33\" (UID: \"a13283a7-8ed3-4875-8ce1-1782fa555f33\") " Sep 09 08:59:13.103012 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:59:13.102849 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/a13283a7-8ed3-4875-8ce1-1782fa555f33-offline-tls\") pod \"a13283a7-8ed3-4875-8ce1-1782fa555f33\" (UID: \"a13283a7-8ed3-4875-8ce1-1782fa555f33\") " Sep 09 08:59:13.103012 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:59:13.102866 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/a13283a7-8ed3-4875-8ce1-1782fa555f33-registry-tls\") pod \"a13283a7-8ed3-4875-8ce1-1782fa555f33\" (UID: \"a13283a7-8ed3-4875-8ce1-1782fa555f33\") " Sep 09 08:59:13.103012 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:59:13.102890 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/a13283a7-8ed3-4875-8ce1-1782fa555f33-ui-tls\") pod \"a13283a7-8ed3-4875-8ce1-1782fa555f33\" (UID: \"a13283a7-8ed3-4875-8ce1-1782fa555f33\") " Sep 09 08:59:13.103393 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:59:13.103364 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a13283a7-8ed3-4875-8ce1-1782fa555f33-feast-data" (OuterVolumeSpecName: "feast-data") pod "a13283a7-8ed3-4875-8ce1-1782fa555f33" (UID: "a13283a7-8ed3-4875-8ce1-1782fa555f33"). InnerVolumeSpecName "feast-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 09 08:59:13.105247 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:59:13.105220 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a13283a7-8ed3-4875-8ce1-1782fa555f33-ui-tls" (OuterVolumeSpecName: "ui-tls") pod "a13283a7-8ed3-4875-8ce1-1782fa555f33" (UID: "a13283a7-8ed3-4875-8ce1-1782fa555f33"). InnerVolumeSpecName "ui-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 09 08:59:13.105668 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:59:13.105574 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a13283a7-8ed3-4875-8ce1-1782fa555f33-kube-api-access-8gc5g" (OuterVolumeSpecName: "kube-api-access-8gc5g") pod "a13283a7-8ed3-4875-8ce1-1782fa555f33" (UID: "a13283a7-8ed3-4875-8ce1-1782fa555f33"). InnerVolumeSpecName "kube-api-access-8gc5g". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 09 08:59:13.105668 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:59:13.105566 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a13283a7-8ed3-4875-8ce1-1782fa555f33-online-tls" (OuterVolumeSpecName: "online-tls") pod "a13283a7-8ed3-4875-8ce1-1782fa555f33" (UID: "a13283a7-8ed3-4875-8ce1-1782fa555f33"). InnerVolumeSpecName "online-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 09 08:59:13.105668 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:59:13.105636 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a13283a7-8ed3-4875-8ce1-1782fa555f33-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "a13283a7-8ed3-4875-8ce1-1782fa555f33" (UID: "a13283a7-8ed3-4875-8ce1-1782fa555f33"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 09 08:59:13.105668 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:59:13.105652 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a13283a7-8ed3-4875-8ce1-1782fa555f33-offline-tls" (OuterVolumeSpecName: "offline-tls") pod "a13283a7-8ed3-4875-8ce1-1782fa555f33" (UID: "a13283a7-8ed3-4875-8ce1-1782fa555f33"). InnerVolumeSpecName "offline-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 09 08:59:13.204257 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:59:13.204154 2564 reconciler_common.go:299] "Volume detached for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/a13283a7-8ed3-4875-8ce1-1782fa555f33-online-tls\") on node \"ip-10-0-137-144.ec2.internal\" DevicePath \"\"" Sep 09 08:59:13.204257 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:59:13.204199 2564 reconciler_common.go:299] "Volume detached for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/a13283a7-8ed3-4875-8ce1-1782fa555f33-offline-tls\") on node \"ip-10-0-137-144.ec2.internal\" DevicePath \"\"" Sep 09 08:59:13.204257 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:59:13.204208 2564 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/a13283a7-8ed3-4875-8ce1-1782fa555f33-registry-tls\") on node \"ip-10-0-137-144.ec2.internal\" DevicePath \"\"" Sep 09 08:59:13.204257 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:59:13.204216 2564 reconciler_common.go:299] "Volume detached for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/a13283a7-8ed3-4875-8ce1-1782fa555f33-ui-tls\") on node \"ip-10-0-137-144.ec2.internal\" DevicePath \"\"" Sep 09 08:59:13.204257 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:59:13.204224 2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8gc5g\" (UniqueName: \"kubernetes.io/projected/a13283a7-8ed3-4875-8ce1-1782fa555f33-kube-api-access-8gc5g\") on node \"ip-10-0-137-144.ec2.internal\" DevicePath \"\"" Sep 09 08:59:13.204257 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:59:13.204235 2564 reconciler_common.go:299] "Volume detached for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/a13283a7-8ed3-4875-8ce1-1782fa555f33-feast-data\") on node \"ip-10-0-137-144.ec2.internal\" DevicePath \"\"" Sep 09 08:59:13.279385 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:59:13.279347 2564 generic.go:356] "Generic (PLEG): container finished" podID="a13283a7-8ed3-4875-8ce1-1782fa555f33" containerID="738cf271fa7e22b530a0b5cf247f518244f139af08d7bf0f1fa2065653859cda" exitCode=137 Sep 09 08:59:13.279385 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:59:13.279378 2564 generic.go:356] "Generic (PLEG): container finished" podID="a13283a7-8ed3-4875-8ce1-1782fa555f33" containerID="065d420152bff518581d4655984d30a40ce11864bf66d995f2368c488b9613f1" exitCode=137 Sep 09 08:59:13.279385 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:59:13.279376 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-c5zcq" event={"ID":"a13283a7-8ed3-4875-8ce1-1782fa555f33","Type":"ContainerDied","Data":"738cf271fa7e22b530a0b5cf247f518244f139af08d7bf0f1fa2065653859cda"} Sep 09 08:59:13.279621 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:59:13.279420 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-c5zcq" Sep 09 08:59:13.279621 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:59:13.279432 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-c5zcq" event={"ID":"a13283a7-8ed3-4875-8ce1-1782fa555f33","Type":"ContainerDied","Data":"065d420152bff518581d4655984d30a40ce11864bf66d995f2368c488b9613f1"} Sep 09 08:59:13.279621 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:59:13.279448 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-c5zcq" event={"ID":"a13283a7-8ed3-4875-8ce1-1782fa555f33","Type":"ContainerDied","Data":"868e7dbae736ed964142606d9e7d17182f10534e5a02351105713e48cb466235"} Sep 09 08:59:13.279621 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:59:13.279468 2564 scope.go:117] "RemoveContainer" containerID="1ce53154071a478e3da0a65bca2ced41c2d7eab92b6d03eb3cbfeb9f6b4158b5" Sep 09 08:59:13.287928 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:59:13.287910 2564 scope.go:117] "RemoveContainer" containerID="738cf271fa7e22b530a0b5cf247f518244f139af08d7bf0f1fa2065653859cda" Sep 09 08:59:13.295574 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:59:13.295555 2564 scope.go:117] "RemoveContainer" containerID="6b00a9504005f83841e4859c8067821b9564b5e8230d03faa417a29f1049f7b9" Sep 09 08:59:13.301059 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:59:13.301031 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-57576b8fcf-c5zcq"] Sep 09 08:59:13.303233 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:59:13.303219 2564 scope.go:117] "RemoveContainer" containerID="065d420152bff518581d4655984d30a40ce11864bf66d995f2368c488b9613f1" Sep 09 08:59:13.305709 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:59:13.305688 2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-57576b8fcf-c5zcq"] Sep 09 08:59:13.311160 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:59:13.311143 2564 scope.go:117] "RemoveContainer" containerID="f32935ba7134e142d5d35fb13e3cc254f17a2fca7d4f0194bc14c17ed293d786" Sep 09 08:59:13.317988 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:59:13.317972 2564 scope.go:117] "RemoveContainer" containerID="0fa3917fd179953872abcd34e1c6444aa1e6b678bd3adcd85ce380fb9bcdbbb5" Sep 09 08:59:13.327520 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:59:13.327503 2564 scope.go:117] "RemoveContainer" containerID="1ce53154071a478e3da0a65bca2ced41c2d7eab92b6d03eb3cbfeb9f6b4158b5" Sep 09 08:59:13.327793 ip-10-0-137-144 kubenswrapper[2564]: E0909 08:59:13.327772 2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1ce53154071a478e3da0a65bca2ced41c2d7eab92b6d03eb3cbfeb9f6b4158b5\": container with ID starting with 1ce53154071a478e3da0a65bca2ced41c2d7eab92b6d03eb3cbfeb9f6b4158b5 not found: ID does not exist" containerID="1ce53154071a478e3da0a65bca2ced41c2d7eab92b6d03eb3cbfeb9f6b4158b5" Sep 09 08:59:13.327838 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:59:13.327804 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1ce53154071a478e3da0a65bca2ced41c2d7eab92b6d03eb3cbfeb9f6b4158b5"} err="failed to get container status \"1ce53154071a478e3da0a65bca2ced41c2d7eab92b6d03eb3cbfeb9f6b4158b5\": rpc error: code = NotFound desc = could not find container \"1ce53154071a478e3da0a65bca2ced41c2d7eab92b6d03eb3cbfeb9f6b4158b5\": container with ID starting with 1ce53154071a478e3da0a65bca2ced41c2d7eab92b6d03eb3cbfeb9f6b4158b5 not found: ID does not exist" Sep 09 08:59:13.327838 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:59:13.327824 2564 scope.go:117] "RemoveContainer" containerID="738cf271fa7e22b530a0b5cf247f518244f139af08d7bf0f1fa2065653859cda" Sep 09 08:59:13.328080 ip-10-0-137-144 kubenswrapper[2564]: E0909 08:59:13.328062 2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"738cf271fa7e22b530a0b5cf247f518244f139af08d7bf0f1fa2065653859cda\": container with ID starting with 738cf271fa7e22b530a0b5cf247f518244f139af08d7bf0f1fa2065653859cda not found: ID does not exist" containerID="738cf271fa7e22b530a0b5cf247f518244f139af08d7bf0f1fa2065653859cda" Sep 09 08:59:13.328126 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:59:13.328086 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"738cf271fa7e22b530a0b5cf247f518244f139af08d7bf0f1fa2065653859cda"} err="failed to get container status \"738cf271fa7e22b530a0b5cf247f518244f139af08d7bf0f1fa2065653859cda\": rpc error: code = NotFound desc = could not find container \"738cf271fa7e22b530a0b5cf247f518244f139af08d7bf0f1fa2065653859cda\": container with ID starting with 738cf271fa7e22b530a0b5cf247f518244f139af08d7bf0f1fa2065653859cda not found: ID does not exist" Sep 09 08:59:13.328126 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:59:13.328109 2564 scope.go:117] "RemoveContainer" containerID="6b00a9504005f83841e4859c8067821b9564b5e8230d03faa417a29f1049f7b9" Sep 09 08:59:13.328320 ip-10-0-137-144 kubenswrapper[2564]: E0909 08:59:13.328302 2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6b00a9504005f83841e4859c8067821b9564b5e8230d03faa417a29f1049f7b9\": container with ID starting with 6b00a9504005f83841e4859c8067821b9564b5e8230d03faa417a29f1049f7b9 not found: ID does not exist" containerID="6b00a9504005f83841e4859c8067821b9564b5e8230d03faa417a29f1049f7b9" Sep 09 08:59:13.328401 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:59:13.328329 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6b00a9504005f83841e4859c8067821b9564b5e8230d03faa417a29f1049f7b9"} err="failed to get container status \"6b00a9504005f83841e4859c8067821b9564b5e8230d03faa417a29f1049f7b9\": rpc error: code = NotFound desc = could not find container \"6b00a9504005f83841e4859c8067821b9564b5e8230d03faa417a29f1049f7b9\": container with ID starting with 6b00a9504005f83841e4859c8067821b9564b5e8230d03faa417a29f1049f7b9 not found: ID does not exist" Sep 09 08:59:13.328401 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:59:13.328369 2564 scope.go:117] "RemoveContainer" containerID="065d420152bff518581d4655984d30a40ce11864bf66d995f2368c488b9613f1" Sep 09 08:59:13.328615 ip-10-0-137-144 kubenswrapper[2564]: E0909 08:59:13.328600 2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"065d420152bff518581d4655984d30a40ce11864bf66d995f2368c488b9613f1\": container with ID starting with 065d420152bff518581d4655984d30a40ce11864bf66d995f2368c488b9613f1 not found: ID does not exist" containerID="065d420152bff518581d4655984d30a40ce11864bf66d995f2368c488b9613f1" Sep 09 08:59:13.328656 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:59:13.328617 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"065d420152bff518581d4655984d30a40ce11864bf66d995f2368c488b9613f1"} err="failed to get container status \"065d420152bff518581d4655984d30a40ce11864bf66d995f2368c488b9613f1\": rpc error: code = NotFound desc = could not find container \"065d420152bff518581d4655984d30a40ce11864bf66d995f2368c488b9613f1\": container with ID starting with 065d420152bff518581d4655984d30a40ce11864bf66d995f2368c488b9613f1 not found: ID does not exist" Sep 09 08:59:13.328656 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:59:13.328632 2564 scope.go:117] "RemoveContainer" containerID="f32935ba7134e142d5d35fb13e3cc254f17a2fca7d4f0194bc14c17ed293d786" Sep 09 08:59:13.328898 ip-10-0-137-144 kubenswrapper[2564]: E0909 08:59:13.328879 2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f32935ba7134e142d5d35fb13e3cc254f17a2fca7d4f0194bc14c17ed293d786\": container with ID starting with f32935ba7134e142d5d35fb13e3cc254f17a2fca7d4f0194bc14c17ed293d786 not found: ID does not exist" containerID="f32935ba7134e142d5d35fb13e3cc254f17a2fca7d4f0194bc14c17ed293d786" Sep 09 08:59:13.328938 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:59:13.328903 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f32935ba7134e142d5d35fb13e3cc254f17a2fca7d4f0194bc14c17ed293d786"} err="failed to get container status \"f32935ba7134e142d5d35fb13e3cc254f17a2fca7d4f0194bc14c17ed293d786\": rpc error: code = NotFound desc = could not find container \"f32935ba7134e142d5d35fb13e3cc254f17a2fca7d4f0194bc14c17ed293d786\": container with ID starting with f32935ba7134e142d5d35fb13e3cc254f17a2fca7d4f0194bc14c17ed293d786 not found: ID does not exist" Sep 09 08:59:13.328938 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:59:13.328916 2564 scope.go:117] "RemoveContainer" containerID="0fa3917fd179953872abcd34e1c6444aa1e6b678bd3adcd85ce380fb9bcdbbb5" Sep 09 08:59:13.329161 ip-10-0-137-144 kubenswrapper[2564]: E0909 08:59:13.329145 2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0fa3917fd179953872abcd34e1c6444aa1e6b678bd3adcd85ce380fb9bcdbbb5\": container with ID starting with 0fa3917fd179953872abcd34e1c6444aa1e6b678bd3adcd85ce380fb9bcdbbb5 not found: ID does not exist" containerID="0fa3917fd179953872abcd34e1c6444aa1e6b678bd3adcd85ce380fb9bcdbbb5" Sep 09 08:59:13.329212 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:59:13.329173 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0fa3917fd179953872abcd34e1c6444aa1e6b678bd3adcd85ce380fb9bcdbbb5"} err="failed to get container status \"0fa3917fd179953872abcd34e1c6444aa1e6b678bd3adcd85ce380fb9bcdbbb5\": rpc error: code = NotFound desc = could not find container \"0fa3917fd179953872abcd34e1c6444aa1e6b678bd3adcd85ce380fb9bcdbbb5\": container with ID starting with 0fa3917fd179953872abcd34e1c6444aa1e6b678bd3adcd85ce380fb9bcdbbb5 not found: ID does not exist" Sep 09 08:59:13.329212 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:59:13.329188 2564 scope.go:117] "RemoveContainer" containerID="1ce53154071a478e3da0a65bca2ced41c2d7eab92b6d03eb3cbfeb9f6b4158b5" Sep 09 08:59:13.329396 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:59:13.329380 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1ce53154071a478e3da0a65bca2ced41c2d7eab92b6d03eb3cbfeb9f6b4158b5"} err="failed to get container status \"1ce53154071a478e3da0a65bca2ced41c2d7eab92b6d03eb3cbfeb9f6b4158b5\": rpc error: code = NotFound desc = could not find container \"1ce53154071a478e3da0a65bca2ced41c2d7eab92b6d03eb3cbfeb9f6b4158b5\": container with ID starting with 1ce53154071a478e3da0a65bca2ced41c2d7eab92b6d03eb3cbfeb9f6b4158b5 not found: ID does not exist" Sep 09 08:59:13.329450 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:59:13.329396 2564 scope.go:117] "RemoveContainer" containerID="738cf271fa7e22b530a0b5cf247f518244f139af08d7bf0f1fa2065653859cda" Sep 09 08:59:13.329625 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:59:13.329608 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"738cf271fa7e22b530a0b5cf247f518244f139af08d7bf0f1fa2065653859cda"} err="failed to get container status \"738cf271fa7e22b530a0b5cf247f518244f139af08d7bf0f1fa2065653859cda\": rpc error: code = NotFound desc = could not find container \"738cf271fa7e22b530a0b5cf247f518244f139af08d7bf0f1fa2065653859cda\": container with ID starting with 738cf271fa7e22b530a0b5cf247f518244f139af08d7bf0f1fa2065653859cda not found: ID does not exist" Sep 09 08:59:13.329675 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:59:13.329624 2564 scope.go:117] "RemoveContainer" containerID="6b00a9504005f83841e4859c8067821b9564b5e8230d03faa417a29f1049f7b9" Sep 09 08:59:13.329812 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:59:13.329791 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6b00a9504005f83841e4859c8067821b9564b5e8230d03faa417a29f1049f7b9"} err="failed to get container status \"6b00a9504005f83841e4859c8067821b9564b5e8230d03faa417a29f1049f7b9\": rpc error: code = NotFound desc = could not find container \"6b00a9504005f83841e4859c8067821b9564b5e8230d03faa417a29f1049f7b9\": container with ID starting with 6b00a9504005f83841e4859c8067821b9564b5e8230d03faa417a29f1049f7b9 not found: ID does not exist" Sep 09 08:59:13.329853 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:59:13.329812 2564 scope.go:117] "RemoveContainer" containerID="065d420152bff518581d4655984d30a40ce11864bf66d995f2368c488b9613f1" Sep 09 08:59:13.330003 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:59:13.329986 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"065d420152bff518581d4655984d30a40ce11864bf66d995f2368c488b9613f1"} err="failed to get container status \"065d420152bff518581d4655984d30a40ce11864bf66d995f2368c488b9613f1\": rpc error: code = NotFound desc = could not find container \"065d420152bff518581d4655984d30a40ce11864bf66d995f2368c488b9613f1\": container with ID starting with 065d420152bff518581d4655984d30a40ce11864bf66d995f2368c488b9613f1 not found: ID does not exist" Sep 09 08:59:13.330097 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:59:13.330004 2564 scope.go:117] "RemoveContainer" containerID="f32935ba7134e142d5d35fb13e3cc254f17a2fca7d4f0194bc14c17ed293d786" Sep 09 08:59:13.330195 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:59:13.330178 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f32935ba7134e142d5d35fb13e3cc254f17a2fca7d4f0194bc14c17ed293d786"} err="failed to get container status \"f32935ba7134e142d5d35fb13e3cc254f17a2fca7d4f0194bc14c17ed293d786\": rpc error: code = NotFound desc = could not find container \"f32935ba7134e142d5d35fb13e3cc254f17a2fca7d4f0194bc14c17ed293d786\": container with ID starting with f32935ba7134e142d5d35fb13e3cc254f17a2fca7d4f0194bc14c17ed293d786 not found: ID does not exist" Sep 09 08:59:13.330236 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:59:13.330196 2564 scope.go:117] "RemoveContainer" containerID="0fa3917fd179953872abcd34e1c6444aa1e6b678bd3adcd85ce380fb9bcdbbb5" Sep 09 08:59:13.330433 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:59:13.330414 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0fa3917fd179953872abcd34e1c6444aa1e6b678bd3adcd85ce380fb9bcdbbb5"} err="failed to get container status \"0fa3917fd179953872abcd34e1c6444aa1e6b678bd3adcd85ce380fb9bcdbbb5\": rpc error: code = NotFound desc = could not find container \"0fa3917fd179953872abcd34e1c6444aa1e6b678bd3adcd85ce380fb9bcdbbb5\": container with ID starting with 0fa3917fd179953872abcd34e1c6444aa1e6b678bd3adcd85ce380fb9bcdbbb5 not found: ID does not exist" Sep 09 08:59:13.806385 ip-10-0-137-144 kubenswrapper[2564]: I0909 08:59:13.806326 2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a13283a7-8ed3-4875-8ce1-1782fa555f33" path="/var/lib/kubelet/pods/a13283a7-8ed3-4875-8ce1-1782fa555f33/volumes" Sep 09 09:00:08.138826 ip-10-0-137-144 kubenswrapper[2564]: I0909 09:00:08.138783 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-jqzvd"] Sep 09 09:00:08.139229 ip-10-0-137-144 kubenswrapper[2564]: I0909 09:00:08.139158 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a13283a7-8ed3-4875-8ce1-1782fa555f33" containerName="offline" Sep 09 09:00:08.139229 ip-10-0-137-144 kubenswrapper[2564]: I0909 09:00:08.139175 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="a13283a7-8ed3-4875-8ce1-1782fa555f33" containerName="offline" Sep 09 09:00:08.139229 ip-10-0-137-144 kubenswrapper[2564]: I0909 09:00:08.139190 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a13283a7-8ed3-4875-8ce1-1782fa555f33" containerName="feast-apply" Sep 09 09:00:08.139229 ip-10-0-137-144 kubenswrapper[2564]: I0909 09:00:08.139198 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="a13283a7-8ed3-4875-8ce1-1782fa555f33" containerName="feast-apply" Sep 09 09:00:08.139229 ip-10-0-137-144 kubenswrapper[2564]: I0909 09:00:08.139209 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a13283a7-8ed3-4875-8ce1-1782fa555f33" containerName="online" Sep 09 09:00:08.139229 ip-10-0-137-144 kubenswrapper[2564]: I0909 09:00:08.139218 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="a13283a7-8ed3-4875-8ce1-1782fa555f33" containerName="online" Sep 09 09:00:08.139229 ip-10-0-137-144 kubenswrapper[2564]: I0909 09:00:08.139229 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a13283a7-8ed3-4875-8ce1-1782fa555f33" containerName="ui" Sep 09 09:00:08.139509 ip-10-0-137-144 kubenswrapper[2564]: I0909 09:00:08.139238 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="a13283a7-8ed3-4875-8ce1-1782fa555f33" containerName="ui" Sep 09 09:00:08.139509 ip-10-0-137-144 kubenswrapper[2564]: I0909 09:00:08.139253 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a13283a7-8ed3-4875-8ce1-1782fa555f33" containerName="registry" Sep 09 09:00:08.139509 ip-10-0-137-144 kubenswrapper[2564]: I0909 09:00:08.139261 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="a13283a7-8ed3-4875-8ce1-1782fa555f33" containerName="registry" Sep 09 09:00:08.139509 ip-10-0-137-144 kubenswrapper[2564]: I0909 09:00:08.139284 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a13283a7-8ed3-4875-8ce1-1782fa555f33" containerName="feast-init" Sep 09 09:00:08.139509 ip-10-0-137-144 kubenswrapper[2564]: I0909 09:00:08.139292 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="a13283a7-8ed3-4875-8ce1-1782fa555f33" containerName="feast-init" Sep 09 09:00:08.139509 ip-10-0-137-144 kubenswrapper[2564]: I0909 09:00:08.139384 2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="a13283a7-8ed3-4875-8ce1-1782fa555f33" containerName="registry" Sep 09 09:00:08.139509 ip-10-0-137-144 kubenswrapper[2564]: I0909 09:00:08.139395 2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="a13283a7-8ed3-4875-8ce1-1782fa555f33" containerName="ui" Sep 09 09:00:08.139509 ip-10-0-137-144 kubenswrapper[2564]: I0909 09:00:08.139405 2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="a13283a7-8ed3-4875-8ce1-1782fa555f33" containerName="offline" Sep 09 09:00:08.139509 ip-10-0-137-144 kubenswrapper[2564]: I0909 09:00:08.139416 2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="a13283a7-8ed3-4875-8ce1-1782fa555f33" containerName="online" Sep 09 09:00:08.143824 ip-10-0-137-144 kubenswrapper[2564]: I0909 09:00:08.143797 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-jqzvd" Sep 09 09:00:08.149323 ip-10-0-137-144 kubenswrapper[2564]: I0909 09:00:08.149299 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-online-tls\"" Sep 09 09:00:08.149475 ip-10-0-137-144 kubenswrapper[2564]: I0909 09:00:08.149299 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-ui-tls\"" Sep 09 09:00:08.149475 ip-10-0-137-144 kubenswrapper[2564]: I0909 09:00:08.149428 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-offline-tls\"" Sep 09 09:00:08.152215 ip-10-0-137-144 kubenswrapper[2564]: I0909 09:00:08.151608 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-remote-registry\"/\"kube-root-ca.crt\"" Sep 09 09:00:08.152215 ip-10-0-137-144 kubenswrapper[2564]: I0909 09:00:08.151728 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-dockercfg-777jq\"" Sep 09 09:00:08.170822 ip-10-0-137-144 kubenswrapper[2564]: I0909 09:00:08.170797 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-client-ca\"" Sep 09 09:00:08.177007 ip-10-0-137-144 kubenswrapper[2564]: I0909 09:00:08.176991 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-remote-registry\"/\"openshift-service-ca.crt\"" Sep 09 09:00:08.264855 ip-10-0-137-144 kubenswrapper[2564]: I0909 09:00:08.264819 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-jqzvd"] Sep 09 09:00:08.303978 ip-10-0-137-144 kubenswrapper[2564]: I0909 09:00:08.303941 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/3c99d279-fb72-4e53-9676-be80a00f39c8-feast-data\") pod \"feast-simple-feast-remote-setup-c5d49d8c6-jqzvd\" (UID: \"3c99d279-fb72-4e53-9676-be80a00f39c8\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-jqzvd" Sep 09 09:00:08.303978 ip-10-0-137-144 kubenswrapper[2564]: I0909 09:00:08.303978 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/3c99d279-fb72-4e53-9676-be80a00f39c8-online-tls\") pod \"feast-simple-feast-remote-setup-c5d49d8c6-jqzvd\" (UID: \"3c99d279-fb72-4e53-9676-be80a00f39c8\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-jqzvd" Sep 09 09:00:08.304178 ip-10-0-137-144 kubenswrapper[2564]: I0909 09:00:08.304002 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/3c99d279-fb72-4e53-9676-be80a00f39c8-ui-tls\") pod \"feast-simple-feast-remote-setup-c5d49d8c6-jqzvd\" (UID: \"3c99d279-fb72-4e53-9676-be80a00f39c8\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-jqzvd" Sep 09 09:00:08.304178 ip-10-0-137-144 kubenswrapper[2564]: I0909 09:00:08.304047 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/configmap/3c99d279-fb72-4e53-9676-be80a00f39c8-registry-tls\") pod \"feast-simple-feast-remote-setup-c5d49d8c6-jqzvd\" (UID: \"3c99d279-fb72-4e53-9676-be80a00f39c8\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-jqzvd" Sep 09 09:00:08.304178 ip-10-0-137-144 kubenswrapper[2564]: I0909 09:00:08.304073 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hdsx6\" (UniqueName: \"kubernetes.io/projected/3c99d279-fb72-4e53-9676-be80a00f39c8-kube-api-access-hdsx6\") pod \"feast-simple-feast-remote-setup-c5d49d8c6-jqzvd\" (UID: \"3c99d279-fb72-4e53-9676-be80a00f39c8\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-jqzvd" Sep 09 09:00:08.304178 ip-10-0-137-144 kubenswrapper[2564]: I0909 09:00:08.304098 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/3c99d279-fb72-4e53-9676-be80a00f39c8-offline-tls\") pod \"feast-simple-feast-remote-setup-c5d49d8c6-jqzvd\" (UID: \"3c99d279-fb72-4e53-9676-be80a00f39c8\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-jqzvd" Sep 09 09:00:08.404747 ip-10-0-137-144 kubenswrapper[2564]: I0909 09:00:08.404654 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/configmap/3c99d279-fb72-4e53-9676-be80a00f39c8-registry-tls\") pod \"feast-simple-feast-remote-setup-c5d49d8c6-jqzvd\" (UID: \"3c99d279-fb72-4e53-9676-be80a00f39c8\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-jqzvd" Sep 09 09:00:08.404747 ip-10-0-137-144 kubenswrapper[2564]: I0909 09:00:08.404700 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hdsx6\" (UniqueName: \"kubernetes.io/projected/3c99d279-fb72-4e53-9676-be80a00f39c8-kube-api-access-hdsx6\") pod \"feast-simple-feast-remote-setup-c5d49d8c6-jqzvd\" (UID: \"3c99d279-fb72-4e53-9676-be80a00f39c8\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-jqzvd" Sep 09 09:00:08.404747 ip-10-0-137-144 kubenswrapper[2564]: I0909 09:00:08.404727 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/3c99d279-fb72-4e53-9676-be80a00f39c8-offline-tls\") pod \"feast-simple-feast-remote-setup-c5d49d8c6-jqzvd\" (UID: \"3c99d279-fb72-4e53-9676-be80a00f39c8\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-jqzvd" Sep 09 09:00:08.404974 ip-10-0-137-144 kubenswrapper[2564]: I0909 09:00:08.404762 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/3c99d279-fb72-4e53-9676-be80a00f39c8-feast-data\") pod \"feast-simple-feast-remote-setup-c5d49d8c6-jqzvd\" (UID: \"3c99d279-fb72-4e53-9676-be80a00f39c8\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-jqzvd" Sep 09 09:00:08.404974 ip-10-0-137-144 kubenswrapper[2564]: I0909 09:00:08.404780 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/3c99d279-fb72-4e53-9676-be80a00f39c8-online-tls\") pod \"feast-simple-feast-remote-setup-c5d49d8c6-jqzvd\" (UID: \"3c99d279-fb72-4e53-9676-be80a00f39c8\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-jqzvd" Sep 09 09:00:08.404974 ip-10-0-137-144 kubenswrapper[2564]: I0909 09:00:08.404801 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/3c99d279-fb72-4e53-9676-be80a00f39c8-ui-tls\") pod \"feast-simple-feast-remote-setup-c5d49d8c6-jqzvd\" (UID: \"3c99d279-fb72-4e53-9676-be80a00f39c8\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-jqzvd" Sep 09 09:00:08.405296 ip-10-0-137-144 kubenswrapper[2564]: I0909 09:00:08.405272 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/3c99d279-fb72-4e53-9676-be80a00f39c8-feast-data\") pod \"feast-simple-feast-remote-setup-c5d49d8c6-jqzvd\" (UID: \"3c99d279-fb72-4e53-9676-be80a00f39c8\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-jqzvd" Sep 09 09:00:08.405499 ip-10-0-137-144 kubenswrapper[2564]: I0909 09:00:08.405474 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/configmap/3c99d279-fb72-4e53-9676-be80a00f39c8-registry-tls\") pod \"feast-simple-feast-remote-setup-c5d49d8c6-jqzvd\" (UID: \"3c99d279-fb72-4e53-9676-be80a00f39c8\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-jqzvd" Sep 09 09:00:08.407354 ip-10-0-137-144 kubenswrapper[2564]: I0909 09:00:08.407314 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/3c99d279-fb72-4e53-9676-be80a00f39c8-offline-tls\") pod \"feast-simple-feast-remote-setup-c5d49d8c6-jqzvd\" (UID: \"3c99d279-fb72-4e53-9676-be80a00f39c8\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-jqzvd" Sep 09 09:00:08.407453 ip-10-0-137-144 kubenswrapper[2564]: I0909 09:00:08.407365 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/3c99d279-fb72-4e53-9676-be80a00f39c8-online-tls\") pod \"feast-simple-feast-remote-setup-c5d49d8c6-jqzvd\" (UID: \"3c99d279-fb72-4e53-9676-be80a00f39c8\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-jqzvd" Sep 09 09:00:08.407494 ip-10-0-137-144 kubenswrapper[2564]: I0909 09:00:08.407459 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/3c99d279-fb72-4e53-9676-be80a00f39c8-ui-tls\") pod \"feast-simple-feast-remote-setup-c5d49d8c6-jqzvd\" (UID: \"3c99d279-fb72-4e53-9676-be80a00f39c8\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-jqzvd" Sep 09 09:00:08.462106 ip-10-0-137-144 kubenswrapper[2564]: I0909 09:00:08.462074 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hdsx6\" (UniqueName: \"kubernetes.io/projected/3c99d279-fb72-4e53-9676-be80a00f39c8-kube-api-access-hdsx6\") pod \"feast-simple-feast-remote-setup-c5d49d8c6-jqzvd\" (UID: \"3c99d279-fb72-4e53-9676-be80a00f39c8\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-jqzvd" Sep 09 09:00:08.755578 ip-10-0-137-144 kubenswrapper[2564]: I0909 09:00:08.755488 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-jqzvd" Sep 09 09:00:09.070311 ip-10-0-137-144 kubenswrapper[2564]: I0909 09:00:09.070205 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-jqzvd"] Sep 09 09:00:09.077869 ip-10-0-137-144 kubenswrapper[2564]: W0909 09:00:09.077840 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod3c99d279_fb72_4e53_9676_be80a00f39c8.slice/crio-25ce6ea4faf6e83f9929ab08f01e1acae2622ea2d3f1b9e44f77e4b71bdeebcd WatchSource:0}: Error finding container 25ce6ea4faf6e83f9929ab08f01e1acae2622ea2d3f1b9e44f77e4b71bdeebcd: Status 404 returned error can't find the container with id 25ce6ea4faf6e83f9929ab08f01e1acae2622ea2d3f1b9e44f77e4b71bdeebcd Sep 09 09:00:09.489497 ip-10-0-137-144 kubenswrapper[2564]: I0909 09:00:09.489455 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-jqzvd" event={"ID":"3c99d279-fb72-4e53-9676-be80a00f39c8","Type":"ContainerStarted","Data":"cf6a4be1948df5d64ce6ca80d30fbe661c8c68b07b8c03f3e8d4c04ff4e7bec2"} Sep 09 09:00:09.489890 ip-10-0-137-144 kubenswrapper[2564]: I0909 09:00:09.489512 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-jqzvd" event={"ID":"3c99d279-fb72-4e53-9676-be80a00f39c8","Type":"ContainerStarted","Data":"25ce6ea4faf6e83f9929ab08f01e1acae2622ea2d3f1b9e44f77e4b71bdeebcd"} Sep 09 09:00:14.508678 ip-10-0-137-144 kubenswrapper[2564]: I0909 09:00:14.508578 2564 generic.go:356] "Generic (PLEG): container finished" podID="3c99d279-fb72-4e53-9676-be80a00f39c8" containerID="cf6a4be1948df5d64ce6ca80d30fbe661c8c68b07b8c03f3e8d4c04ff4e7bec2" exitCode=0 Sep 09 09:00:14.509081 ip-10-0-137-144 kubenswrapper[2564]: I0909 09:00:14.508662 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-jqzvd" event={"ID":"3c99d279-fb72-4e53-9676-be80a00f39c8","Type":"ContainerDied","Data":"cf6a4be1948df5d64ce6ca80d30fbe661c8c68b07b8c03f3e8d4c04ff4e7bec2"} Sep 09 09:00:15.514873 ip-10-0-137-144 kubenswrapper[2564]: I0909 09:00:15.514837 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-jqzvd" event={"ID":"3c99d279-fb72-4e53-9676-be80a00f39c8","Type":"ContainerStarted","Data":"f6eb082efeaa9c405599e770bc88b5de8b4fe3fddb17864e107aac7433da43c1"} Sep 09 09:00:49.650953 ip-10-0-137-144 kubenswrapper[2564]: I0909 09:00:49.650863 2564 generic.go:356] "Generic (PLEG): container finished" podID="3c99d279-fb72-4e53-9676-be80a00f39c8" containerID="f6eb082efeaa9c405599e770bc88b5de8b4fe3fddb17864e107aac7433da43c1" exitCode=0 Sep 09 09:00:49.650953 ip-10-0-137-144 kubenswrapper[2564]: I0909 09:00:49.650937 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-jqzvd" event={"ID":"3c99d279-fb72-4e53-9676-be80a00f39c8","Type":"ContainerDied","Data":"f6eb082efeaa9c405599e770bc88b5de8b4fe3fddb17864e107aac7433da43c1"} Sep 09 09:00:50.659855 ip-10-0-137-144 kubenswrapper[2564]: I0909 09:00:50.659819 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-jqzvd" event={"ID":"3c99d279-fb72-4e53-9676-be80a00f39c8","Type":"ContainerStarted","Data":"d63f5013c7aba1795caede3f4b7e05d7a26520136362cbf38116f52d2bb9acff"} Sep 09 09:00:50.660567 ip-10-0-137-144 kubenswrapper[2564]: I0909 09:00:50.659869 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-jqzvd" event={"ID":"3c99d279-fb72-4e53-9676-be80a00f39c8","Type":"ContainerStarted","Data":"6e412300813340b351fa4dbb0aac2d2d5bbb14808f9ea9ab8cda7e784ecaff9c"} Sep 09 09:00:50.660567 ip-10-0-137-144 kubenswrapper[2564]: I0909 09:00:50.659882 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-jqzvd" event={"ID":"3c99d279-fb72-4e53-9676-be80a00f39c8","Type":"ContainerStarted","Data":"56c49ead9579b6ab27c407a9729de56a40d949c800e745cde00afa7a24acdda0"} Sep 09 09:00:50.756070 ip-10-0-137-144 kubenswrapper[2564]: I0909 09:00:50.756026 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-jqzvd" Sep 09 09:00:50.756264 ip-10-0-137-144 kubenswrapper[2564]: I0909 09:00:50.756088 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-jqzvd" Sep 09 09:00:50.756264 ip-10-0-137-144 kubenswrapper[2564]: I0909 09:00:50.756107 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-jqzvd" Sep 09 09:00:50.757492 ip-10-0-137-144 kubenswrapper[2564]: I0909 09:00:50.757443 2564 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-jqzvd" podUID="3c99d279-fb72-4e53-9676-be80a00f39c8" containerName="offline" probeResult="failure" output="dial tcp 10.132.0.22:8816: connect: connection refused" Sep 09 09:00:50.757633 ip-10-0-137-144 kubenswrapper[2564]: I0909 09:00:50.757497 2564 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-jqzvd" podUID="3c99d279-fb72-4e53-9676-be80a00f39c8" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.22:8443: connect: connection refused" Sep 09 09:00:50.757633 ip-10-0-137-144 kubenswrapper[2564]: I0909 09:00:50.757493 2564 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-jqzvd" podUID="3c99d279-fb72-4e53-9676-be80a00f39c8" containerName="online" probeResult="failure" output="Get \"https://10.132.0.22:6567/health\": dial tcp 10.132.0.22:6567: connect: connection refused" Sep 09 09:00:53.756687 ip-10-0-137-144 kubenswrapper[2564]: I0909 09:00:53.756642 2564 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-jqzvd" podUID="3c99d279-fb72-4e53-9676-be80a00f39c8" containerName="offline" probeResult="failure" output="dial tcp 10.132.0.22:8816: connect: connection refused" Sep 09 09:00:53.757143 ip-10-0-137-144 kubenswrapper[2564]: I0909 09:00:53.756685 2564 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-jqzvd" podUID="3c99d279-fb72-4e53-9676-be80a00f39c8" containerName="online" probeResult="failure" output="Get \"https://10.132.0.22:6567/health\": dial tcp 10.132.0.22:6567: connect: connection refused" Sep 09 09:00:53.757143 ip-10-0-137-144 kubenswrapper[2564]: I0909 09:00:53.756654 2564 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-jqzvd" podUID="3c99d279-fb72-4e53-9676-be80a00f39c8" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.22:8443: connect: connection refused" Sep 09 09:00:56.756657 ip-10-0-137-144 kubenswrapper[2564]: I0909 09:00:56.756607 2564 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-jqzvd" podUID="3c99d279-fb72-4e53-9676-be80a00f39c8" containerName="offline" probeResult="failure" output="dial tcp 10.132.0.22:8816: connect: connection refused" Sep 09 09:00:56.757146 ip-10-0-137-144 kubenswrapper[2564]: I0909 09:00:56.756661 2564 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-jqzvd" podUID="3c99d279-fb72-4e53-9676-be80a00f39c8" containerName="online" probeResult="failure" output="Get \"https://10.132.0.22:6567/health\": dial tcp 10.132.0.22:6567: connect: connection refused" Sep 09 09:00:56.757146 ip-10-0-137-144 kubenswrapper[2564]: I0909 09:00:56.756613 2564 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-jqzvd" podUID="3c99d279-fb72-4e53-9676-be80a00f39c8" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.22:8443: connect: connection refused" Sep 09 09:00:58.756512 ip-10-0-137-144 kubenswrapper[2564]: I0909 09:00:58.756471 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-jqzvd" Sep 09 09:00:58.756900 ip-10-0-137-144 kubenswrapper[2564]: I0909 09:00:58.756524 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-jqzvd" Sep 09 09:00:58.756900 ip-10-0-137-144 kubenswrapper[2564]: I0909 09:00:58.756537 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-jqzvd" Sep 09 09:00:59.756807 ip-10-0-137-144 kubenswrapper[2564]: I0909 09:00:59.756770 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-jqzvd" Sep 09 09:00:59.757216 ip-10-0-137-144 kubenswrapper[2564]: I0909 09:00:59.756944 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-jqzvd" Sep 09 09:00:59.757509 ip-10-0-137-144 kubenswrapper[2564]: I0909 09:00:59.757482 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-jqzvd" Sep 09 09:00:59.757752 ip-10-0-137-144 kubenswrapper[2564]: I0909 09:00:59.757734 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-jqzvd" Sep 09 09:00:59.797015 ip-10-0-137-144 kubenswrapper[2564]: I0909 09:00:59.796963 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-jqzvd" podStartSLOduration=51.796947108 podStartE2EDuration="51.796947108s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 09:00:08 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 09:00:50.706358762 +0000 UTC m=+1311.404242661" watchObservedRunningTime="2026-09-09 09:00:59.796947108 +0000 UTC m=+1320.494831010" Sep 09 09:01:00.756860 ip-10-0-137-144 kubenswrapper[2564]: I0909 09:01:00.756816 2564 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-jqzvd" podUID="3c99d279-fb72-4e53-9676-be80a00f39c8" containerName="online" probeResult="failure" output="Get \"https://10.132.0.22:6567/health\": context deadline exceeded" Sep 09 09:01:03.662147 ip-10-0-137-144 kubenswrapper[2564]: I0909 09:01:03.662116 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-jqzvd" Sep 09 09:01:04.575413 ip-10-0-137-144 kubenswrapper[2564]: I0909 09:01:04.575378 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-jqzvd" Sep 09 09:02:06.386872 ip-10-0-137-144 kubenswrapper[2564]: I0909 09:02:06.386826 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-jqzvd"] Sep 09 09:02:06.387419 ip-10-0-137-144 kubenswrapper[2564]: I0909 09:02:06.387116 2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-jqzvd" podUID="3c99d279-fb72-4e53-9676-be80a00f39c8" containerName="online" containerID="cri-o://56c49ead9579b6ab27c407a9729de56a40d949c800e745cde00afa7a24acdda0" gracePeriod=30 Sep 09 09:02:06.387419 ip-10-0-137-144 kubenswrapper[2564]: I0909 09:02:06.387217 2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-jqzvd" podUID="3c99d279-fb72-4e53-9676-be80a00f39c8" containerName="offline" containerID="cri-o://6e412300813340b351fa4dbb0aac2d2d5bbb14808f9ea9ab8cda7e784ecaff9c" gracePeriod=30 Sep 09 09:02:06.387419 ip-10-0-137-144 kubenswrapper[2564]: I0909 09:02:06.387217 2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-jqzvd" podUID="3c99d279-fb72-4e53-9676-be80a00f39c8" containerName="ui" containerID="cri-o://d63f5013c7aba1795caede3f4b7e05d7a26520136362cbf38116f52d2bb9acff" gracePeriod=30 Sep 09 09:02:06.586815 ip-10-0-137-144 kubenswrapper[2564]: I0909 09:02:06.586779 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-57576b8fcf-45xxb"] Sep 09 09:02:06.587041 ip-10-0-137-144 kubenswrapper[2564]: I0909 09:02:06.587014 2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-45xxb" podUID="ad1b7c3f-c58e-4cd8-9892-cdec586ae467" containerName="registry" containerID="cri-o://e0c7a817995ec4aa70fc2b30e6c5a1b0764b956453ef444353c5b0ec2f825dfa" gracePeriod=30 Sep 09 09:02:06.587140 ip-10-0-137-144 kubenswrapper[2564]: I0909 09:02:06.587108 2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-45xxb" podUID="ad1b7c3f-c58e-4cd8-9892-cdec586ae467" containerName="ui" containerID="cri-o://e16b24dda095b683c2bdacf240cfe9c0018394fc6b206776f8d4deeef24806c2" gracePeriod=30 Sep 09 09:02:06.587213 ip-10-0-137-144 kubenswrapper[2564]: I0909 09:02:06.587182 2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-45xxb" podUID="ad1b7c3f-c58e-4cd8-9892-cdec586ae467" containerName="offline" containerID="cri-o://0b3b174735f3a31838640018c67c354b84adc5fdd376f1cdf9bacc405062db1f" gracePeriod=30 Sep 09 09:02:06.587266 ip-10-0-137-144 kubenswrapper[2564]: I0909 09:02:06.587231 2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-45xxb" podUID="ad1b7c3f-c58e-4cd8-9892-cdec586ae467" containerName="online" containerID="cri-o://567a7664c0c6e0c629f95160c5e61b4e62eb7f4005686caab4d806e23131d98a" gracePeriod=30 Sep 09 09:02:07.967179 ip-10-0-137-144 kubenswrapper[2564]: I0909 09:02:07.967147 2564 generic.go:356] "Generic (PLEG): container finished" podID="3c99d279-fb72-4e53-9676-be80a00f39c8" containerID="d63f5013c7aba1795caede3f4b7e05d7a26520136362cbf38116f52d2bb9acff" exitCode=0 Sep 09 09:02:07.967179 ip-10-0-137-144 kubenswrapper[2564]: I0909 09:02:07.967172 2564 generic.go:356] "Generic (PLEG): container finished" podID="3c99d279-fb72-4e53-9676-be80a00f39c8" containerID="56c49ead9579b6ab27c407a9729de56a40d949c800e745cde00afa7a24acdda0" exitCode=0 Sep 09 09:02:07.967654 ip-10-0-137-144 kubenswrapper[2564]: I0909 09:02:07.967218 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-jqzvd" event={"ID":"3c99d279-fb72-4e53-9676-be80a00f39c8","Type":"ContainerDied","Data":"d63f5013c7aba1795caede3f4b7e05d7a26520136362cbf38116f52d2bb9acff"} Sep 09 09:02:07.967654 ip-10-0-137-144 kubenswrapper[2564]: I0909 09:02:07.967263 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-jqzvd" event={"ID":"3c99d279-fb72-4e53-9676-be80a00f39c8","Type":"ContainerDied","Data":"56c49ead9579b6ab27c407a9729de56a40d949c800e745cde00afa7a24acdda0"} Sep 09 09:02:07.970286 ip-10-0-137-144 kubenswrapper[2564]: I0909 09:02:07.970263 2564 generic.go:356] "Generic (PLEG): container finished" podID="ad1b7c3f-c58e-4cd8-9892-cdec586ae467" containerID="e16b24dda095b683c2bdacf240cfe9c0018394fc6b206776f8d4deeef24806c2" exitCode=0 Sep 09 09:02:07.970286 ip-10-0-137-144 kubenswrapper[2564]: I0909 09:02:07.970282 2564 generic.go:356] "Generic (PLEG): container finished" podID="ad1b7c3f-c58e-4cd8-9892-cdec586ae467" containerID="567a7664c0c6e0c629f95160c5e61b4e62eb7f4005686caab4d806e23131d98a" exitCode=0 Sep 09 09:02:07.970458 ip-10-0-137-144 kubenswrapper[2564]: I0909 09:02:07.970359 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-45xxb" event={"ID":"ad1b7c3f-c58e-4cd8-9892-cdec586ae467","Type":"ContainerDied","Data":"e16b24dda095b683c2bdacf240cfe9c0018394fc6b206776f8d4deeef24806c2"} Sep 09 09:02:07.970458 ip-10-0-137-144 kubenswrapper[2564]: I0909 09:02:07.970395 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-45xxb" event={"ID":"ad1b7c3f-c58e-4cd8-9892-cdec586ae467","Type":"ContainerDied","Data":"567a7664c0c6e0c629f95160c5e61b4e62eb7f4005686caab4d806e23131d98a"} Sep 09 09:02:09.757809 ip-10-0-137-144 kubenswrapper[2564]: I0909 09:02:09.757762 2564 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-jqzvd" podUID="3c99d279-fb72-4e53-9676-be80a00f39c8" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.22:8443: connect: connection refused" Sep 09 09:02:13.663237 ip-10-0-137-144 kubenswrapper[2564]: I0909 09:02:13.663188 2564 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-jqzvd" podUID="3c99d279-fb72-4e53-9676-be80a00f39c8" containerName="online" probeResult="failure" output="Get \"https://10.132.0.22:6567/health\": dial tcp 10.132.0.22:6567: connect: connection refused" Sep 09 09:02:14.870755 ip-10-0-137-144 kubenswrapper[2564]: I0909 09:02:14.870702 2564 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-45xxb" podUID="ad1b7c3f-c58e-4cd8-9892-cdec586ae467" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.21:8443: connect: connection refused" Sep 09 09:02:15.246142 ip-10-0-137-144 kubenswrapper[2564]: I0909 09:02:15.246048 2564 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-45xxb" podUID="ad1b7c3f-c58e-4cd8-9892-cdec586ae467" containerName="online" probeResult="failure" output="Get \"https://10.132.0.21:6567/health\": dial tcp 10.132.0.21:6567: connect: connection refused" Sep 09 09:02:19.757736 ip-10-0-137-144 kubenswrapper[2564]: I0909 09:02:19.757691 2564 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-jqzvd" podUID="3c99d279-fb72-4e53-9676-be80a00f39c8" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.22:8443: connect: connection refused" Sep 09 09:02:23.662979 ip-10-0-137-144 kubenswrapper[2564]: I0909 09:02:23.662934 2564 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-jqzvd" podUID="3c99d279-fb72-4e53-9676-be80a00f39c8" containerName="online" probeResult="failure" output="Get \"https://10.132.0.22:6567/health\": dial tcp 10.132.0.22:6567: connect: connection refused" Sep 09 09:02:24.871203 ip-10-0-137-144 kubenswrapper[2564]: I0909 09:02:24.871150 2564 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-45xxb" podUID="ad1b7c3f-c58e-4cd8-9892-cdec586ae467" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.21:8443: connect: connection refused" Sep 09 09:02:25.246693 ip-10-0-137-144 kubenswrapper[2564]: I0909 09:02:25.246597 2564 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-45xxb" podUID="ad1b7c3f-c58e-4cd8-9892-cdec586ae467" containerName="online" probeResult="failure" output="Get \"https://10.132.0.21:6567/health\": dial tcp 10.132.0.21:6567: connect: connection refused" Sep 09 09:02:29.758440 ip-10-0-137-144 kubenswrapper[2564]: I0909 09:02:29.758395 2564 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-jqzvd" podUID="3c99d279-fb72-4e53-9676-be80a00f39c8" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.22:8443: connect: connection refused" Sep 09 09:02:29.758859 ip-10-0-137-144 kubenswrapper[2564]: I0909 09:02:29.758541 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-jqzvd" Sep 09 09:02:33.663048 ip-10-0-137-144 kubenswrapper[2564]: I0909 09:02:33.662997 2564 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-jqzvd" podUID="3c99d279-fb72-4e53-9676-be80a00f39c8" containerName="online" probeResult="failure" output="Get \"https://10.132.0.22:6567/health\": dial tcp 10.132.0.22:6567: connect: connection refused" Sep 09 09:02:33.663461 ip-10-0-137-144 kubenswrapper[2564]: I0909 09:02:33.663119 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-jqzvd" Sep 09 09:02:34.870841 ip-10-0-137-144 kubenswrapper[2564]: I0909 09:02:34.870792 2564 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-45xxb" podUID="ad1b7c3f-c58e-4cd8-9892-cdec586ae467" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.21:8443: connect: connection refused" Sep 09 09:02:34.871294 ip-10-0-137-144 kubenswrapper[2564]: I0909 09:02:34.870935 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-45xxb" Sep 09 09:02:35.246383 ip-10-0-137-144 kubenswrapper[2564]: I0909 09:02:35.246279 2564 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-45xxb" podUID="ad1b7c3f-c58e-4cd8-9892-cdec586ae467" containerName="online" probeResult="failure" output="Get \"https://10.132.0.21:6567/health\": dial tcp 10.132.0.21:6567: connect: connection refused" Sep 09 09:02:35.246521 ip-10-0-137-144 kubenswrapper[2564]: I0909 09:02:35.246426 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-45xxb" Sep 09 09:02:37.030235 ip-10-0-137-144 kubenswrapper[2564]: I0909 09:02:37.030211 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-jqzvd" Sep 09 09:02:37.079009 ip-10-0-137-144 kubenswrapper[2564]: I0909 09:02:37.078975 2564 generic.go:356] "Generic (PLEG): container finished" podID="3c99d279-fb72-4e53-9676-be80a00f39c8" containerID="6e412300813340b351fa4dbb0aac2d2d5bbb14808f9ea9ab8cda7e784ecaff9c" exitCode=137 Sep 09 09:02:37.079197 ip-10-0-137-144 kubenswrapper[2564]: I0909 09:02:37.079040 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-jqzvd" Sep 09 09:02:37.079197 ip-10-0-137-144 kubenswrapper[2564]: I0909 09:02:37.079060 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-jqzvd" event={"ID":"3c99d279-fb72-4e53-9676-be80a00f39c8","Type":"ContainerDied","Data":"6e412300813340b351fa4dbb0aac2d2d5bbb14808f9ea9ab8cda7e784ecaff9c"} Sep 09 09:02:37.079197 ip-10-0-137-144 kubenswrapper[2564]: I0909 09:02:37.079112 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-jqzvd" event={"ID":"3c99d279-fb72-4e53-9676-be80a00f39c8","Type":"ContainerDied","Data":"25ce6ea4faf6e83f9929ab08f01e1acae2622ea2d3f1b9e44f77e4b71bdeebcd"} Sep 09 09:02:37.079197 ip-10-0-137-144 kubenswrapper[2564]: I0909 09:02:37.079140 2564 scope.go:117] "RemoveContainer" containerID="d63f5013c7aba1795caede3f4b7e05d7a26520136362cbf38116f52d2bb9acff" Sep 09 09:02:37.082279 ip-10-0-137-144 kubenswrapper[2564]: I0909 09:02:37.082256 2564 generic.go:356] "Generic (PLEG): container finished" podID="ad1b7c3f-c58e-4cd8-9892-cdec586ae467" containerID="0b3b174735f3a31838640018c67c354b84adc5fdd376f1cdf9bacc405062db1f" exitCode=137 Sep 09 09:02:37.082279 ip-10-0-137-144 kubenswrapper[2564]: I0909 09:02:37.082277 2564 generic.go:356] "Generic (PLEG): container finished" podID="ad1b7c3f-c58e-4cd8-9892-cdec586ae467" containerID="e0c7a817995ec4aa70fc2b30e6c5a1b0764b956453ef444353c5b0ec2f825dfa" exitCode=137 Sep 09 09:02:37.082451 ip-10-0-137-144 kubenswrapper[2564]: I0909 09:02:37.082322 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-45xxb" event={"ID":"ad1b7c3f-c58e-4cd8-9892-cdec586ae467","Type":"ContainerDied","Data":"0b3b174735f3a31838640018c67c354b84adc5fdd376f1cdf9bacc405062db1f"} Sep 09 09:02:37.082451 ip-10-0-137-144 kubenswrapper[2564]: I0909 09:02:37.082376 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-45xxb" event={"ID":"ad1b7c3f-c58e-4cd8-9892-cdec586ae467","Type":"ContainerDied","Data":"e0c7a817995ec4aa70fc2b30e6c5a1b0764b956453ef444353c5b0ec2f825dfa"} Sep 09 09:02:37.089554 ip-10-0-137-144 kubenswrapper[2564]: I0909 09:02:37.089532 2564 scope.go:117] "RemoveContainer" containerID="6e412300813340b351fa4dbb0aac2d2d5bbb14808f9ea9ab8cda7e784ecaff9c" Sep 09 09:02:37.097159 ip-10-0-137-144 kubenswrapper[2564]: I0909 09:02:37.097144 2564 scope.go:117] "RemoveContainer" containerID="56c49ead9579b6ab27c407a9729de56a40d949c800e745cde00afa7a24acdda0" Sep 09 09:02:37.104799 ip-10-0-137-144 kubenswrapper[2564]: I0909 09:02:37.104721 2564 scope.go:117] "RemoveContainer" containerID="f6eb082efeaa9c405599e770bc88b5de8b4fe3fddb17864e107aac7433da43c1" Sep 09 09:02:37.111632 ip-10-0-137-144 kubenswrapper[2564]: I0909 09:02:37.111613 2564 scope.go:117] "RemoveContainer" containerID="cf6a4be1948df5d64ce6ca80d30fbe661c8c68b07b8c03f3e8d4c04ff4e7bec2" Sep 09 09:02:37.119290 ip-10-0-137-144 kubenswrapper[2564]: I0909 09:02:37.119272 2564 scope.go:117] "RemoveContainer" containerID="d63f5013c7aba1795caede3f4b7e05d7a26520136362cbf38116f52d2bb9acff" Sep 09 09:02:37.119601 ip-10-0-137-144 kubenswrapper[2564]: E0909 09:02:37.119579 2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d63f5013c7aba1795caede3f4b7e05d7a26520136362cbf38116f52d2bb9acff\": container with ID starting with d63f5013c7aba1795caede3f4b7e05d7a26520136362cbf38116f52d2bb9acff not found: ID does not exist" containerID="d63f5013c7aba1795caede3f4b7e05d7a26520136362cbf38116f52d2bb9acff" Sep 09 09:02:37.119689 ip-10-0-137-144 kubenswrapper[2564]: I0909 09:02:37.119611 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d63f5013c7aba1795caede3f4b7e05d7a26520136362cbf38116f52d2bb9acff"} err="failed to get container status \"d63f5013c7aba1795caede3f4b7e05d7a26520136362cbf38116f52d2bb9acff\": rpc error: code = NotFound desc = could not find container \"d63f5013c7aba1795caede3f4b7e05d7a26520136362cbf38116f52d2bb9acff\": container with ID starting with d63f5013c7aba1795caede3f4b7e05d7a26520136362cbf38116f52d2bb9acff not found: ID does not exist" Sep 09 09:02:37.119689 ip-10-0-137-144 kubenswrapper[2564]: I0909 09:02:37.119633 2564 scope.go:117] "RemoveContainer" containerID="6e412300813340b351fa4dbb0aac2d2d5bbb14808f9ea9ab8cda7e784ecaff9c" Sep 09 09:02:37.119911 ip-10-0-137-144 kubenswrapper[2564]: E0909 09:02:37.119897 2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6e412300813340b351fa4dbb0aac2d2d5bbb14808f9ea9ab8cda7e784ecaff9c\": container with ID starting with 6e412300813340b351fa4dbb0aac2d2d5bbb14808f9ea9ab8cda7e784ecaff9c not found: ID does not exist" containerID="6e412300813340b351fa4dbb0aac2d2d5bbb14808f9ea9ab8cda7e784ecaff9c" Sep 09 09:02:37.119969 ip-10-0-137-144 kubenswrapper[2564]: I0909 09:02:37.119913 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6e412300813340b351fa4dbb0aac2d2d5bbb14808f9ea9ab8cda7e784ecaff9c"} err="failed to get container status \"6e412300813340b351fa4dbb0aac2d2d5bbb14808f9ea9ab8cda7e784ecaff9c\": rpc error: code = NotFound desc = could not find container \"6e412300813340b351fa4dbb0aac2d2d5bbb14808f9ea9ab8cda7e784ecaff9c\": container with ID starting with 6e412300813340b351fa4dbb0aac2d2d5bbb14808f9ea9ab8cda7e784ecaff9c not found: ID does not exist" Sep 09 09:02:37.119969 ip-10-0-137-144 kubenswrapper[2564]: I0909 09:02:37.119926 2564 scope.go:117] "RemoveContainer" containerID="56c49ead9579b6ab27c407a9729de56a40d949c800e745cde00afa7a24acdda0" Sep 09 09:02:37.120224 ip-10-0-137-144 kubenswrapper[2564]: E0909 09:02:37.120202 2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"56c49ead9579b6ab27c407a9729de56a40d949c800e745cde00afa7a24acdda0\": container with ID starting with 56c49ead9579b6ab27c407a9729de56a40d949c800e745cde00afa7a24acdda0 not found: ID does not exist" containerID="56c49ead9579b6ab27c407a9729de56a40d949c800e745cde00afa7a24acdda0" Sep 09 09:02:37.120276 ip-10-0-137-144 kubenswrapper[2564]: I0909 09:02:37.120232 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"56c49ead9579b6ab27c407a9729de56a40d949c800e745cde00afa7a24acdda0"} err="failed to get container status \"56c49ead9579b6ab27c407a9729de56a40d949c800e745cde00afa7a24acdda0\": rpc error: code = NotFound desc = could not find container \"56c49ead9579b6ab27c407a9729de56a40d949c800e745cde00afa7a24acdda0\": container with ID starting with 56c49ead9579b6ab27c407a9729de56a40d949c800e745cde00afa7a24acdda0 not found: ID does not exist" Sep 09 09:02:37.120276 ip-10-0-137-144 kubenswrapper[2564]: I0909 09:02:37.120248 2564 scope.go:117] "RemoveContainer" containerID="f6eb082efeaa9c405599e770bc88b5de8b4fe3fddb17864e107aac7433da43c1" Sep 09 09:02:37.120558 ip-10-0-137-144 kubenswrapper[2564]: E0909 09:02:37.120539 2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f6eb082efeaa9c405599e770bc88b5de8b4fe3fddb17864e107aac7433da43c1\": container with ID starting with f6eb082efeaa9c405599e770bc88b5de8b4fe3fddb17864e107aac7433da43c1 not found: ID does not exist" containerID="f6eb082efeaa9c405599e770bc88b5de8b4fe3fddb17864e107aac7433da43c1" Sep 09 09:02:37.120640 ip-10-0-137-144 kubenswrapper[2564]: I0909 09:02:37.120564 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f6eb082efeaa9c405599e770bc88b5de8b4fe3fddb17864e107aac7433da43c1"} err="failed to get container status \"f6eb082efeaa9c405599e770bc88b5de8b4fe3fddb17864e107aac7433da43c1\": rpc error: code = NotFound desc = could not find container \"f6eb082efeaa9c405599e770bc88b5de8b4fe3fddb17864e107aac7433da43c1\": container with ID starting with f6eb082efeaa9c405599e770bc88b5de8b4fe3fddb17864e107aac7433da43c1 not found: ID does not exist" Sep 09 09:02:37.120640 ip-10-0-137-144 kubenswrapper[2564]: I0909 09:02:37.120579 2564 scope.go:117] "RemoveContainer" containerID="cf6a4be1948df5d64ce6ca80d30fbe661c8c68b07b8c03f3e8d4c04ff4e7bec2" Sep 09 09:02:37.120866 ip-10-0-137-144 kubenswrapper[2564]: E0909 09:02:37.120848 2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cf6a4be1948df5d64ce6ca80d30fbe661c8c68b07b8c03f3e8d4c04ff4e7bec2\": container with ID starting with cf6a4be1948df5d64ce6ca80d30fbe661c8c68b07b8c03f3e8d4c04ff4e7bec2 not found: ID does not exist" containerID="cf6a4be1948df5d64ce6ca80d30fbe661c8c68b07b8c03f3e8d4c04ff4e7bec2" Sep 09 09:02:37.120917 ip-10-0-137-144 kubenswrapper[2564]: I0909 09:02:37.120868 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cf6a4be1948df5d64ce6ca80d30fbe661c8c68b07b8c03f3e8d4c04ff4e7bec2"} err="failed to get container status \"cf6a4be1948df5d64ce6ca80d30fbe661c8c68b07b8c03f3e8d4c04ff4e7bec2\": rpc error: code = NotFound desc = could not find container \"cf6a4be1948df5d64ce6ca80d30fbe661c8c68b07b8c03f3e8d4c04ff4e7bec2\": container with ID starting with cf6a4be1948df5d64ce6ca80d30fbe661c8c68b07b8c03f3e8d4c04ff4e7bec2 not found: ID does not exist" Sep 09 09:02:37.122037 ip-10-0-137-144 kubenswrapper[2564]: I0909 09:02:37.122018 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/3c99d279-fb72-4e53-9676-be80a00f39c8-ui-tls\") pod \"3c99d279-fb72-4e53-9676-be80a00f39c8\" (UID: \"3c99d279-fb72-4e53-9676-be80a00f39c8\") " Sep 09 09:02:37.122130 ip-10-0-137-144 kubenswrapper[2564]: I0909 09:02:37.122053 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/configmap/3c99d279-fb72-4e53-9676-be80a00f39c8-registry-tls\") pod \"3c99d279-fb72-4e53-9676-be80a00f39c8\" (UID: \"3c99d279-fb72-4e53-9676-be80a00f39c8\") " Sep 09 09:02:37.122130 ip-10-0-137-144 kubenswrapper[2564]: I0909 09:02:37.122090 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/3c99d279-fb72-4e53-9676-be80a00f39c8-online-tls\") pod \"3c99d279-fb72-4e53-9676-be80a00f39c8\" (UID: \"3c99d279-fb72-4e53-9676-be80a00f39c8\") " Sep 09 09:02:37.122130 ip-10-0-137-144 kubenswrapper[2564]: I0909 09:02:37.122123 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/3c99d279-fb72-4e53-9676-be80a00f39c8-feast-data\") pod \"3c99d279-fb72-4e53-9676-be80a00f39c8\" (UID: \"3c99d279-fb72-4e53-9676-be80a00f39c8\") " Sep 09 09:02:37.122242 ip-10-0-137-144 kubenswrapper[2564]: I0909 09:02:37.122185 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/3c99d279-fb72-4e53-9676-be80a00f39c8-offline-tls\") pod \"3c99d279-fb72-4e53-9676-be80a00f39c8\" (UID: \"3c99d279-fb72-4e53-9676-be80a00f39c8\") " Sep 09 09:02:37.122295 ip-10-0-137-144 kubenswrapper[2564]: I0909 09:02:37.122245 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hdsx6\" (UniqueName: \"kubernetes.io/projected/3c99d279-fb72-4e53-9676-be80a00f39c8-kube-api-access-hdsx6\") pod \"3c99d279-fb72-4e53-9676-be80a00f39c8\" (UID: \"3c99d279-fb72-4e53-9676-be80a00f39c8\") " Sep 09 09:02:37.122511 ip-10-0-137-144 kubenswrapper[2564]: I0909 09:02:37.122475 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3c99d279-fb72-4e53-9676-be80a00f39c8-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "3c99d279-fb72-4e53-9676-be80a00f39c8" (UID: "3c99d279-fb72-4e53-9676-be80a00f39c8"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 09 09:02:37.122713 ip-10-0-137-144 kubenswrapper[2564]: I0909 09:02:37.122682 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3c99d279-fb72-4e53-9676-be80a00f39c8-feast-data" (OuterVolumeSpecName: "feast-data") pod "3c99d279-fb72-4e53-9676-be80a00f39c8" (UID: "3c99d279-fb72-4e53-9676-be80a00f39c8"). InnerVolumeSpecName "feast-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 09 09:02:37.124494 ip-10-0-137-144 kubenswrapper[2564]: I0909 09:02:37.124462 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3c99d279-fb72-4e53-9676-be80a00f39c8-ui-tls" (OuterVolumeSpecName: "ui-tls") pod "3c99d279-fb72-4e53-9676-be80a00f39c8" (UID: "3c99d279-fb72-4e53-9676-be80a00f39c8"). InnerVolumeSpecName "ui-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 09 09:02:37.124494 ip-10-0-137-144 kubenswrapper[2564]: I0909 09:02:37.124475 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3c99d279-fb72-4e53-9676-be80a00f39c8-online-tls" (OuterVolumeSpecName: "online-tls") pod "3c99d279-fb72-4e53-9676-be80a00f39c8" (UID: "3c99d279-fb72-4e53-9676-be80a00f39c8"). InnerVolumeSpecName "online-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 09 09:02:37.124601 ip-10-0-137-144 kubenswrapper[2564]: I0909 09:02:37.124544 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3c99d279-fb72-4e53-9676-be80a00f39c8-offline-tls" (OuterVolumeSpecName: "offline-tls") pod "3c99d279-fb72-4e53-9676-be80a00f39c8" (UID: "3c99d279-fb72-4e53-9676-be80a00f39c8"). InnerVolumeSpecName "offline-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 09 09:02:37.124783 ip-10-0-137-144 kubenswrapper[2564]: I0909 09:02:37.124759 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3c99d279-fb72-4e53-9676-be80a00f39c8-kube-api-access-hdsx6" (OuterVolumeSpecName: "kube-api-access-hdsx6") pod "3c99d279-fb72-4e53-9676-be80a00f39c8" (UID: "3c99d279-fb72-4e53-9676-be80a00f39c8"). InnerVolumeSpecName "kube-api-access-hdsx6". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 09 09:02:37.223510 ip-10-0-137-144 kubenswrapper[2564]: I0909 09:02:37.223485 2564 reconciler_common.go:299] "Volume detached for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/3c99d279-fb72-4e53-9676-be80a00f39c8-offline-tls\") on node \"ip-10-0-137-144.ec2.internal\" DevicePath \"\"" Sep 09 09:02:37.223510 ip-10-0-137-144 kubenswrapper[2564]: I0909 09:02:37.223510 2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hdsx6\" (UniqueName: \"kubernetes.io/projected/3c99d279-fb72-4e53-9676-be80a00f39c8-kube-api-access-hdsx6\") on node \"ip-10-0-137-144.ec2.internal\" DevicePath \"\"" Sep 09 09:02:37.223679 ip-10-0-137-144 kubenswrapper[2564]: I0909 09:02:37.223519 2564 reconciler_common.go:299] "Volume detached for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/3c99d279-fb72-4e53-9676-be80a00f39c8-ui-tls\") on node \"ip-10-0-137-144.ec2.internal\" DevicePath \"\"" Sep 09 09:02:37.223679 ip-10-0-137-144 kubenswrapper[2564]: I0909 09:02:37.223528 2564 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/configmap/3c99d279-fb72-4e53-9676-be80a00f39c8-registry-tls\") on node \"ip-10-0-137-144.ec2.internal\" DevicePath \"\"" Sep 09 09:02:37.223679 ip-10-0-137-144 kubenswrapper[2564]: I0909 09:02:37.223557 2564 reconciler_common.go:299] "Volume detached for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/3c99d279-fb72-4e53-9676-be80a00f39c8-online-tls\") on node \"ip-10-0-137-144.ec2.internal\" DevicePath \"\"" Sep 09 09:02:37.223679 ip-10-0-137-144 kubenswrapper[2564]: I0909 09:02:37.223565 2564 reconciler_common.go:299] "Volume detached for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/3c99d279-fb72-4e53-9676-be80a00f39c8-feast-data\") on node \"ip-10-0-137-144.ec2.internal\" DevicePath \"\"" Sep 09 09:02:37.231599 ip-10-0-137-144 kubenswrapper[2564]: I0909 09:02:37.231575 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-45xxb" Sep 09 09:02:37.324756 ip-10-0-137-144 kubenswrapper[2564]: I0909 09:02:37.324716 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/ad1b7c3f-c58e-4cd8-9892-cdec586ae467-online-tls\") pod \"ad1b7c3f-c58e-4cd8-9892-cdec586ae467\" (UID: \"ad1b7c3f-c58e-4cd8-9892-cdec586ae467\") " Sep 09 09:02:37.324896 ip-10-0-137-144 kubenswrapper[2564]: I0909 09:02:37.324766 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/ad1b7c3f-c58e-4cd8-9892-cdec586ae467-ui-tls\") pod \"ad1b7c3f-c58e-4cd8-9892-cdec586ae467\" (UID: \"ad1b7c3f-c58e-4cd8-9892-cdec586ae467\") " Sep 09 09:02:37.324896 ip-10-0-137-144 kubenswrapper[2564]: I0909 09:02:37.324827 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wgxdq\" (UniqueName: \"kubernetes.io/projected/ad1b7c3f-c58e-4cd8-9892-cdec586ae467-kube-api-access-wgxdq\") pod \"ad1b7c3f-c58e-4cd8-9892-cdec586ae467\" (UID: \"ad1b7c3f-c58e-4cd8-9892-cdec586ae467\") " Sep 09 09:02:37.324896 ip-10-0-137-144 kubenswrapper[2564]: I0909 09:02:37.324878 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/ad1b7c3f-c58e-4cd8-9892-cdec586ae467-feast-data\") pod \"ad1b7c3f-c58e-4cd8-9892-cdec586ae467\" (UID: \"ad1b7c3f-c58e-4cd8-9892-cdec586ae467\") " Sep 09 09:02:37.325049 ip-10-0-137-144 kubenswrapper[2564]: I0909 09:02:37.324900 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/ad1b7c3f-c58e-4cd8-9892-cdec586ae467-offline-tls\") pod \"ad1b7c3f-c58e-4cd8-9892-cdec586ae467\" (UID: \"ad1b7c3f-c58e-4cd8-9892-cdec586ae467\") " Sep 09 09:02:37.325049 ip-10-0-137-144 kubenswrapper[2564]: I0909 09:02:37.324945 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/ad1b7c3f-c58e-4cd8-9892-cdec586ae467-registry-tls\") pod \"ad1b7c3f-c58e-4cd8-9892-cdec586ae467\" (UID: \"ad1b7c3f-c58e-4cd8-9892-cdec586ae467\") " Sep 09 09:02:37.325443 ip-10-0-137-144 kubenswrapper[2564]: I0909 09:02:37.325411 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ad1b7c3f-c58e-4cd8-9892-cdec586ae467-feast-data" (OuterVolumeSpecName: "feast-data") pod "ad1b7c3f-c58e-4cd8-9892-cdec586ae467" (UID: "ad1b7c3f-c58e-4cd8-9892-cdec586ae467"). InnerVolumeSpecName "feast-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 09 09:02:37.326981 ip-10-0-137-144 kubenswrapper[2564]: I0909 09:02:37.326944 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ad1b7c3f-c58e-4cd8-9892-cdec586ae467-offline-tls" (OuterVolumeSpecName: "offline-tls") pod "ad1b7c3f-c58e-4cd8-9892-cdec586ae467" (UID: "ad1b7c3f-c58e-4cd8-9892-cdec586ae467"). InnerVolumeSpecName "offline-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 09 09:02:37.327063 ip-10-0-137-144 kubenswrapper[2564]: I0909 09:02:37.326990 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ad1b7c3f-c58e-4cd8-9892-cdec586ae467-online-tls" (OuterVolumeSpecName: "online-tls") pod "ad1b7c3f-c58e-4cd8-9892-cdec586ae467" (UID: "ad1b7c3f-c58e-4cd8-9892-cdec586ae467"). InnerVolumeSpecName "online-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 09 09:02:37.327063 ip-10-0-137-144 kubenswrapper[2564]: I0909 09:02:37.327033 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ad1b7c3f-c58e-4cd8-9892-cdec586ae467-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "ad1b7c3f-c58e-4cd8-9892-cdec586ae467" (UID: "ad1b7c3f-c58e-4cd8-9892-cdec586ae467"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 09 09:02:37.327284 ip-10-0-137-144 kubenswrapper[2564]: I0909 09:02:37.327263 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ad1b7c3f-c58e-4cd8-9892-cdec586ae467-ui-tls" (OuterVolumeSpecName: "ui-tls") pod "ad1b7c3f-c58e-4cd8-9892-cdec586ae467" (UID: "ad1b7c3f-c58e-4cd8-9892-cdec586ae467"). InnerVolumeSpecName "ui-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 09 09:02:37.327284 ip-10-0-137-144 kubenswrapper[2564]: I0909 09:02:37.327271 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ad1b7c3f-c58e-4cd8-9892-cdec586ae467-kube-api-access-wgxdq" (OuterVolumeSpecName: "kube-api-access-wgxdq") pod "ad1b7c3f-c58e-4cd8-9892-cdec586ae467" (UID: "ad1b7c3f-c58e-4cd8-9892-cdec586ae467"). InnerVolumeSpecName "kube-api-access-wgxdq". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 09 09:02:37.400040 ip-10-0-137-144 kubenswrapper[2564]: I0909 09:02:37.400010 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-jqzvd"] Sep 09 09:02:37.405047 ip-10-0-137-144 kubenswrapper[2564]: I0909 09:02:37.404990 2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-jqzvd"] Sep 09 09:02:37.425937 ip-10-0-137-144 kubenswrapper[2564]: I0909 09:02:37.425905 2564 reconciler_common.go:299] "Volume detached for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/ad1b7c3f-c58e-4cd8-9892-cdec586ae467-online-tls\") on node \"ip-10-0-137-144.ec2.internal\" DevicePath \"\"" Sep 09 09:02:37.425937 ip-10-0-137-144 kubenswrapper[2564]: I0909 09:02:37.425937 2564 reconciler_common.go:299] "Volume detached for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/ad1b7c3f-c58e-4cd8-9892-cdec586ae467-ui-tls\") on node \"ip-10-0-137-144.ec2.internal\" DevicePath \"\"" Sep 09 09:02:37.426059 ip-10-0-137-144 kubenswrapper[2564]: I0909 09:02:37.425947 2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wgxdq\" (UniqueName: \"kubernetes.io/projected/ad1b7c3f-c58e-4cd8-9892-cdec586ae467-kube-api-access-wgxdq\") on node \"ip-10-0-137-144.ec2.internal\" DevicePath \"\"" Sep 09 09:02:37.426059 ip-10-0-137-144 kubenswrapper[2564]: I0909 09:02:37.425956 2564 reconciler_common.go:299] "Volume detached for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/ad1b7c3f-c58e-4cd8-9892-cdec586ae467-feast-data\") on node \"ip-10-0-137-144.ec2.internal\" DevicePath \"\"" Sep 09 09:02:37.426059 ip-10-0-137-144 kubenswrapper[2564]: I0909 09:02:37.425966 2564 reconciler_common.go:299] "Volume detached for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/ad1b7c3f-c58e-4cd8-9892-cdec586ae467-offline-tls\") on node \"ip-10-0-137-144.ec2.internal\" DevicePath \"\"" Sep 09 09:02:37.426059 ip-10-0-137-144 kubenswrapper[2564]: I0909 09:02:37.425973 2564 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/ad1b7c3f-c58e-4cd8-9892-cdec586ae467-registry-tls\") on node \"ip-10-0-137-144.ec2.internal\" DevicePath \"\"" Sep 09 09:02:37.806108 ip-10-0-137-144 kubenswrapper[2564]: I0909 09:02:37.806033 2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3c99d279-fb72-4e53-9676-be80a00f39c8" path="/var/lib/kubelet/pods/3c99d279-fb72-4e53-9676-be80a00f39c8/volumes" Sep 09 09:02:38.089642 ip-10-0-137-144 kubenswrapper[2564]: I0909 09:02:38.089603 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-45xxb" event={"ID":"ad1b7c3f-c58e-4cd8-9892-cdec586ae467","Type":"ContainerDied","Data":"12d6fea8387415dc82604c01a09a75257a6fe8fadcda96f0005cd2e4f5a87fc8"} Sep 09 09:02:38.089642 ip-10-0-137-144 kubenswrapper[2564]: I0909 09:02:38.089627 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-45xxb" Sep 09 09:02:38.090098 ip-10-0-137-144 kubenswrapper[2564]: I0909 09:02:38.089667 2564 scope.go:117] "RemoveContainer" containerID="e16b24dda095b683c2bdacf240cfe9c0018394fc6b206776f8d4deeef24806c2" Sep 09 09:02:38.097765 ip-10-0-137-144 kubenswrapper[2564]: I0909 09:02:38.097745 2564 scope.go:117] "RemoveContainer" containerID="0b3b174735f3a31838640018c67c354b84adc5fdd376f1cdf9bacc405062db1f" Sep 09 09:02:38.105674 ip-10-0-137-144 kubenswrapper[2564]: I0909 09:02:38.105625 2564 scope.go:117] "RemoveContainer" containerID="567a7664c0c6e0c629f95160c5e61b4e62eb7f4005686caab4d806e23131d98a" Sep 09 09:02:38.106545 ip-10-0-137-144 kubenswrapper[2564]: I0909 09:02:38.106522 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-57576b8fcf-45xxb"] Sep 09 09:02:38.110887 ip-10-0-137-144 kubenswrapper[2564]: I0909 09:02:38.110858 2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-57576b8fcf-45xxb"] Sep 09 09:02:38.114070 ip-10-0-137-144 kubenswrapper[2564]: I0909 09:02:38.114052 2564 scope.go:117] "RemoveContainer" containerID="e0c7a817995ec4aa70fc2b30e6c5a1b0764b956453ef444353c5b0ec2f825dfa" Sep 09 09:02:38.121850 ip-10-0-137-144 kubenswrapper[2564]: I0909 09:02:38.121832 2564 scope.go:117] "RemoveContainer" containerID="03e0e0e26cea94272f860b808ef791796b56371c686b19d4a5f84e0436b7eb60" Sep 09 09:02:38.128817 ip-10-0-137-144 kubenswrapper[2564]: I0909 09:02:38.128799 2564 scope.go:117] "RemoveContainer" containerID="71f4c789560bfa54dd303b0643b3636de56a06c76a7560487d90ea65d233f193" Sep 09 09:02:39.806494 ip-10-0-137-144 kubenswrapper[2564]: I0909 09:02:39.806458 2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ad1b7c3f-c58e-4cd8-9892-cdec586ae467" path="/var/lib/kubelet/pods/ad1b7c3f-c58e-4cd8-9892-cdec586ae467/volumes" Sep 09 09:03:16.455277 ip-10-0-137-144 kubenswrapper[2564]: I0909 09:03:16.455235 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["test-ns-feast/feast-simple-feast-setup-57576b8fcf-mj9pd"] Sep 09 09:03:16.455718 ip-10-0-137-144 kubenswrapper[2564]: I0909 09:03:16.455543 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3c99d279-fb72-4e53-9676-be80a00f39c8" containerName="feast-apply" Sep 09 09:03:16.455718 ip-10-0-137-144 kubenswrapper[2564]: I0909 09:03:16.455558 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="3c99d279-fb72-4e53-9676-be80a00f39c8" containerName="feast-apply" Sep 09 09:03:16.455718 ip-10-0-137-144 kubenswrapper[2564]: I0909 09:03:16.455568 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3c99d279-fb72-4e53-9676-be80a00f39c8" containerName="ui" Sep 09 09:03:16.455718 ip-10-0-137-144 kubenswrapper[2564]: I0909 09:03:16.455573 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="3c99d279-fb72-4e53-9676-be80a00f39c8" containerName="ui" Sep 09 09:03:16.455718 ip-10-0-137-144 kubenswrapper[2564]: I0909 09:03:16.455581 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ad1b7c3f-c58e-4cd8-9892-cdec586ae467" containerName="online" Sep 09 09:03:16.455718 ip-10-0-137-144 kubenswrapper[2564]: I0909 09:03:16.455588 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="ad1b7c3f-c58e-4cd8-9892-cdec586ae467" containerName="online" Sep 09 09:03:16.455718 ip-10-0-137-144 kubenswrapper[2564]: I0909 09:03:16.455597 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ad1b7c3f-c58e-4cd8-9892-cdec586ae467" containerName="ui" Sep 09 09:03:16.455718 ip-10-0-137-144 kubenswrapper[2564]: I0909 09:03:16.455602 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="ad1b7c3f-c58e-4cd8-9892-cdec586ae467" containerName="ui" Sep 09 09:03:16.455718 ip-10-0-137-144 kubenswrapper[2564]: I0909 09:03:16.455609 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ad1b7c3f-c58e-4cd8-9892-cdec586ae467" containerName="feast-init" Sep 09 09:03:16.455718 ip-10-0-137-144 kubenswrapper[2564]: I0909 09:03:16.455616 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="ad1b7c3f-c58e-4cd8-9892-cdec586ae467" containerName="feast-init" Sep 09 09:03:16.455718 ip-10-0-137-144 kubenswrapper[2564]: I0909 09:03:16.455623 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ad1b7c3f-c58e-4cd8-9892-cdec586ae467" containerName="registry" Sep 09 09:03:16.455718 ip-10-0-137-144 kubenswrapper[2564]: I0909 09:03:16.455628 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="ad1b7c3f-c58e-4cd8-9892-cdec586ae467" containerName="registry" Sep 09 09:03:16.455718 ip-10-0-137-144 kubenswrapper[2564]: I0909 09:03:16.455632 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ad1b7c3f-c58e-4cd8-9892-cdec586ae467" containerName="offline" Sep 09 09:03:16.455718 ip-10-0-137-144 kubenswrapper[2564]: I0909 09:03:16.455637 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="ad1b7c3f-c58e-4cd8-9892-cdec586ae467" containerName="offline" Sep 09 09:03:16.455718 ip-10-0-137-144 kubenswrapper[2564]: I0909 09:03:16.455645 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ad1b7c3f-c58e-4cd8-9892-cdec586ae467" containerName="feast-apply" Sep 09 09:03:16.455718 ip-10-0-137-144 kubenswrapper[2564]: I0909 09:03:16.455650 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="ad1b7c3f-c58e-4cd8-9892-cdec586ae467" containerName="feast-apply" Sep 09 09:03:16.455718 ip-10-0-137-144 kubenswrapper[2564]: I0909 09:03:16.455656 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3c99d279-fb72-4e53-9676-be80a00f39c8" containerName="feast-init" Sep 09 09:03:16.455718 ip-10-0-137-144 kubenswrapper[2564]: I0909 09:03:16.455661 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="3c99d279-fb72-4e53-9676-be80a00f39c8" containerName="feast-init" Sep 09 09:03:16.455718 ip-10-0-137-144 kubenswrapper[2564]: I0909 09:03:16.455666 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3c99d279-fb72-4e53-9676-be80a00f39c8" containerName="offline" Sep 09 09:03:16.455718 ip-10-0-137-144 kubenswrapper[2564]: I0909 09:03:16.455671 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="3c99d279-fb72-4e53-9676-be80a00f39c8" containerName="offline" Sep 09 09:03:16.455718 ip-10-0-137-144 kubenswrapper[2564]: I0909 09:03:16.455678 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3c99d279-fb72-4e53-9676-be80a00f39c8" containerName="online" Sep 09 09:03:16.455718 ip-10-0-137-144 kubenswrapper[2564]: I0909 09:03:16.455682 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="3c99d279-fb72-4e53-9676-be80a00f39c8" containerName="online" Sep 09 09:03:16.455718 ip-10-0-137-144 kubenswrapper[2564]: I0909 09:03:16.455722 2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="ad1b7c3f-c58e-4cd8-9892-cdec586ae467" containerName="registry" Sep 09 09:03:16.455718 ip-10-0-137-144 kubenswrapper[2564]: I0909 09:03:16.455730 2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="3c99d279-fb72-4e53-9676-be80a00f39c8" containerName="offline" Sep 09 09:03:16.456505 ip-10-0-137-144 kubenswrapper[2564]: I0909 09:03:16.455736 2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="3c99d279-fb72-4e53-9676-be80a00f39c8" containerName="online" Sep 09 09:03:16.456505 ip-10-0-137-144 kubenswrapper[2564]: I0909 09:03:16.455741 2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="ad1b7c3f-c58e-4cd8-9892-cdec586ae467" containerName="offline" Sep 09 09:03:16.456505 ip-10-0-137-144 kubenswrapper[2564]: I0909 09:03:16.455746 2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="ad1b7c3f-c58e-4cd8-9892-cdec586ae467" containerName="ui" Sep 09 09:03:16.456505 ip-10-0-137-144 kubenswrapper[2564]: I0909 09:03:16.455751 2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="3c99d279-fb72-4e53-9676-be80a00f39c8" containerName="ui" Sep 09 09:03:16.456505 ip-10-0-137-144 kubenswrapper[2564]: I0909 09:03:16.455756 2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="ad1b7c3f-c58e-4cd8-9892-cdec586ae467" containerName="online" Sep 09 09:03:16.458766 ip-10-0-137-144 kubenswrapper[2564]: I0909 09:03:16.458750 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-mj9pd" Sep 09 09:03:16.461144 ip-10-0-137-144 kubenswrapper[2564]: I0909 09:03:16.461118 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-online-tls\"" Sep 09 09:03:16.461290 ip-10-0-137-144 kubenswrapper[2564]: I0909 09:03:16.461163 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast\"/\"openshift-service-ca.crt\"" Sep 09 09:03:16.461290 ip-10-0-137-144 kubenswrapper[2564]: I0909 09:03:16.461210 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-ui-tls\"" Sep 09 09:03:16.461290 ip-10-0-137-144 kubenswrapper[2564]: I0909 09:03:16.461224 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast\"/\"kube-root-ca.crt\"" Sep 09 09:03:16.461482 ip-10-0-137-144 kubenswrapper[2564]: I0909 09:03:16.461318 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-dockercfg-9xl7z\"" Sep 09 09:03:16.461482 ip-10-0-137-144 kubenswrapper[2564]: I0909 09:03:16.461462 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-offline-tls\"" Sep 09 09:03:16.461482 ip-10-0-137-144 kubenswrapper[2564]: I0909 09:03:16.461476 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-registry-tls\"" Sep 09 09:03:16.471027 ip-10-0-137-144 kubenswrapper[2564]: I0909 09:03:16.471005 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-57576b8fcf-mj9pd"] Sep 09 09:03:16.610438 ip-10-0-137-144 kubenswrapper[2564]: I0909 09:03:16.610402 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/6f9710e5-1a24-4cb6-83f3-704c7bfb3d23-feast-data\") pod \"feast-simple-feast-setup-57576b8fcf-mj9pd\" (UID: \"6f9710e5-1a24-4cb6-83f3-704c7bfb3d23\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-mj9pd" Sep 09 09:03:16.610619 ip-10-0-137-144 kubenswrapper[2564]: I0909 09:03:16.610448 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vds8x\" (UniqueName: \"kubernetes.io/projected/6f9710e5-1a24-4cb6-83f3-704c7bfb3d23-kube-api-access-vds8x\") pod \"feast-simple-feast-setup-57576b8fcf-mj9pd\" (UID: \"6f9710e5-1a24-4cb6-83f3-704c7bfb3d23\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-mj9pd" Sep 09 09:03:16.610619 ip-10-0-137-144 kubenswrapper[2564]: I0909 09:03:16.610476 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/6f9710e5-1a24-4cb6-83f3-704c7bfb3d23-registry-tls\") pod \"feast-simple-feast-setup-57576b8fcf-mj9pd\" (UID: \"6f9710e5-1a24-4cb6-83f3-704c7bfb3d23\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-mj9pd" Sep 09 09:03:16.610619 ip-10-0-137-144 kubenswrapper[2564]: I0909 09:03:16.610518 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/6f9710e5-1a24-4cb6-83f3-704c7bfb3d23-ui-tls\") pod \"feast-simple-feast-setup-57576b8fcf-mj9pd\" (UID: \"6f9710e5-1a24-4cb6-83f3-704c7bfb3d23\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-mj9pd" Sep 09 09:03:16.610619 ip-10-0-137-144 kubenswrapper[2564]: I0909 09:03:16.610559 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/6f9710e5-1a24-4cb6-83f3-704c7bfb3d23-online-tls\") pod \"feast-simple-feast-setup-57576b8fcf-mj9pd\" (UID: \"6f9710e5-1a24-4cb6-83f3-704c7bfb3d23\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-mj9pd" Sep 09 09:03:16.610619 ip-10-0-137-144 kubenswrapper[2564]: I0909 09:03:16.610610 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/6f9710e5-1a24-4cb6-83f3-704c7bfb3d23-offline-tls\") pod \"feast-simple-feast-setup-57576b8fcf-mj9pd\" (UID: \"6f9710e5-1a24-4cb6-83f3-704c7bfb3d23\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-mj9pd" Sep 09 09:03:16.711969 ip-10-0-137-144 kubenswrapper[2564]: I0909 09:03:16.711880 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/6f9710e5-1a24-4cb6-83f3-704c7bfb3d23-feast-data\") pod \"feast-simple-feast-setup-57576b8fcf-mj9pd\" (UID: \"6f9710e5-1a24-4cb6-83f3-704c7bfb3d23\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-mj9pd" Sep 09 09:03:16.711969 ip-10-0-137-144 kubenswrapper[2564]: I0909 09:03:16.711932 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vds8x\" (UniqueName: \"kubernetes.io/projected/6f9710e5-1a24-4cb6-83f3-704c7bfb3d23-kube-api-access-vds8x\") pod \"feast-simple-feast-setup-57576b8fcf-mj9pd\" (UID: \"6f9710e5-1a24-4cb6-83f3-704c7bfb3d23\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-mj9pd" Sep 09 09:03:16.711969 ip-10-0-137-144 kubenswrapper[2564]: I0909 09:03:16.711953 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/6f9710e5-1a24-4cb6-83f3-704c7bfb3d23-registry-tls\") pod \"feast-simple-feast-setup-57576b8fcf-mj9pd\" (UID: \"6f9710e5-1a24-4cb6-83f3-704c7bfb3d23\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-mj9pd" Sep 09 09:03:16.712249 ip-10-0-137-144 kubenswrapper[2564]: I0909 09:03:16.711976 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/6f9710e5-1a24-4cb6-83f3-704c7bfb3d23-ui-tls\") pod \"feast-simple-feast-setup-57576b8fcf-mj9pd\" (UID: \"6f9710e5-1a24-4cb6-83f3-704c7bfb3d23\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-mj9pd" Sep 09 09:03:16.712249 ip-10-0-137-144 kubenswrapper[2564]: I0909 09:03:16.712004 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/6f9710e5-1a24-4cb6-83f3-704c7bfb3d23-online-tls\") pod \"feast-simple-feast-setup-57576b8fcf-mj9pd\" (UID: \"6f9710e5-1a24-4cb6-83f3-704c7bfb3d23\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-mj9pd" Sep 09 09:03:16.712249 ip-10-0-137-144 kubenswrapper[2564]: I0909 09:03:16.712051 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/6f9710e5-1a24-4cb6-83f3-704c7bfb3d23-offline-tls\") pod \"feast-simple-feast-setup-57576b8fcf-mj9pd\" (UID: \"6f9710e5-1a24-4cb6-83f3-704c7bfb3d23\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-mj9pd" Sep 09 09:03:16.712249 ip-10-0-137-144 kubenswrapper[2564]: E0909 09:03:16.712074 2564 secret.go:189] Couldn't get secret test-ns-feast/feast-simple-feast-setup-registry-tls: secret "feast-simple-feast-setup-registry-tls" not found Sep 09 09:03:16.712249 ip-10-0-137-144 kubenswrapper[2564]: E0909 09:03:16.712157 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6f9710e5-1a24-4cb6-83f3-704c7bfb3d23-registry-tls podName:6f9710e5-1a24-4cb6-83f3-704c7bfb3d23 nodeName:}" failed. No retries permitted until 2026-09-09 09:03:17.212134201 +0000 UTC m=+1457.910018096 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/secret/6f9710e5-1a24-4cb6-83f3-704c7bfb3d23-registry-tls") pod "feast-simple-feast-setup-57576b8fcf-mj9pd" (UID: "6f9710e5-1a24-4cb6-83f3-704c7bfb3d23") : secret "feast-simple-feast-setup-registry-tls" not found Sep 09 09:03:16.712509 ip-10-0-137-144 kubenswrapper[2564]: I0909 09:03:16.712316 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/6f9710e5-1a24-4cb6-83f3-704c7bfb3d23-feast-data\") pod \"feast-simple-feast-setup-57576b8fcf-mj9pd\" (UID: \"6f9710e5-1a24-4cb6-83f3-704c7bfb3d23\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-mj9pd" Sep 09 09:03:16.714580 ip-10-0-137-144 kubenswrapper[2564]: I0909 09:03:16.714554 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/6f9710e5-1a24-4cb6-83f3-704c7bfb3d23-online-tls\") pod \"feast-simple-feast-setup-57576b8fcf-mj9pd\" (UID: \"6f9710e5-1a24-4cb6-83f3-704c7bfb3d23\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-mj9pd" Sep 09 09:03:16.714688 ip-10-0-137-144 kubenswrapper[2564]: I0909 09:03:16.714581 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/6f9710e5-1a24-4cb6-83f3-704c7bfb3d23-offline-tls\") pod \"feast-simple-feast-setup-57576b8fcf-mj9pd\" (UID: \"6f9710e5-1a24-4cb6-83f3-704c7bfb3d23\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-mj9pd" Sep 09 09:03:16.714688 ip-10-0-137-144 kubenswrapper[2564]: I0909 09:03:16.714614 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/6f9710e5-1a24-4cb6-83f3-704c7bfb3d23-ui-tls\") pod \"feast-simple-feast-setup-57576b8fcf-mj9pd\" (UID: \"6f9710e5-1a24-4cb6-83f3-704c7bfb3d23\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-mj9pd" Sep 09 09:03:16.720127 ip-10-0-137-144 kubenswrapper[2564]: I0909 09:03:16.720109 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vds8x\" (UniqueName: \"kubernetes.io/projected/6f9710e5-1a24-4cb6-83f3-704c7bfb3d23-kube-api-access-vds8x\") pod \"feast-simple-feast-setup-57576b8fcf-mj9pd\" (UID: \"6f9710e5-1a24-4cb6-83f3-704c7bfb3d23\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-mj9pd" Sep 09 09:03:17.216291 ip-10-0-137-144 kubenswrapper[2564]: I0909 09:03:17.216250 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/6f9710e5-1a24-4cb6-83f3-704c7bfb3d23-registry-tls\") pod \"feast-simple-feast-setup-57576b8fcf-mj9pd\" (UID: \"6f9710e5-1a24-4cb6-83f3-704c7bfb3d23\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-mj9pd" Sep 09 09:03:17.218771 ip-10-0-137-144 kubenswrapper[2564]: I0909 09:03:17.218729 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/6f9710e5-1a24-4cb6-83f3-704c7bfb3d23-registry-tls\") pod \"feast-simple-feast-setup-57576b8fcf-mj9pd\" (UID: \"6f9710e5-1a24-4cb6-83f3-704c7bfb3d23\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-mj9pd" Sep 09 09:03:17.368055 ip-10-0-137-144 kubenswrapper[2564]: I0909 09:03:17.368014 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-mj9pd" Sep 09 09:03:17.643279 ip-10-0-137-144 kubenswrapper[2564]: I0909 09:03:17.643252 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-57576b8fcf-mj9pd"] Sep 09 09:03:17.644932 ip-10-0-137-144 kubenswrapper[2564]: W0909 09:03:17.644899 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod6f9710e5_1a24_4cb6_83f3_704c7bfb3d23.slice/crio-87e017a42f7b8cd7952cf11eb3a954807d26f57d5d97def7702b166c8898bab4 WatchSource:0}: Error finding container 87e017a42f7b8cd7952cf11eb3a954807d26f57d5d97def7702b166c8898bab4: Status 404 returned error can't find the container with id 87e017a42f7b8cd7952cf11eb3a954807d26f57d5d97def7702b166c8898bab4 Sep 09 09:03:18.238613 ip-10-0-137-144 kubenswrapper[2564]: I0909 09:03:18.238570 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-mj9pd" event={"ID":"6f9710e5-1a24-4cb6-83f3-704c7bfb3d23","Type":"ContainerStarted","Data":"1afc3fedde9a2db9595c2808d9d225e44d1b76693411aebb77e73a52b810be41"} Sep 09 09:03:18.238767 ip-10-0-137-144 kubenswrapper[2564]: I0909 09:03:18.238626 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-mj9pd" event={"ID":"6f9710e5-1a24-4cb6-83f3-704c7bfb3d23","Type":"ContainerStarted","Data":"87e017a42f7b8cd7952cf11eb3a954807d26f57d5d97def7702b166c8898bab4"} Sep 09 09:03:23.259615 ip-10-0-137-144 kubenswrapper[2564]: I0909 09:03:23.259578 2564 generic.go:356] "Generic (PLEG): container finished" podID="6f9710e5-1a24-4cb6-83f3-704c7bfb3d23" containerID="1afc3fedde9a2db9595c2808d9d225e44d1b76693411aebb77e73a52b810be41" exitCode=0 Sep 09 09:03:23.260043 ip-10-0-137-144 kubenswrapper[2564]: I0909 09:03:23.259651 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-mj9pd" event={"ID":"6f9710e5-1a24-4cb6-83f3-704c7bfb3d23","Type":"ContainerDied","Data":"1afc3fedde9a2db9595c2808d9d225e44d1b76693411aebb77e73a52b810be41"} Sep 09 09:03:24.265008 ip-10-0-137-144 kubenswrapper[2564]: I0909 09:03:24.264978 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-mj9pd" event={"ID":"6f9710e5-1a24-4cb6-83f3-704c7bfb3d23","Type":"ContainerStarted","Data":"2380e0d540add92eb55f3919c3c6305aa67497ed965023487e67af07a49d61d8"} Sep 09 09:03:29.284071 ip-10-0-137-144 kubenswrapper[2564]: I0909 09:03:29.284039 2564 generic.go:356] "Generic (PLEG): container finished" podID="6f9710e5-1a24-4cb6-83f3-704c7bfb3d23" containerID="2380e0d540add92eb55f3919c3c6305aa67497ed965023487e67af07a49d61d8" exitCode=0 Sep 09 09:03:29.284472 ip-10-0-137-144 kubenswrapper[2564]: I0909 09:03:29.284080 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-mj9pd" event={"ID":"6f9710e5-1a24-4cb6-83f3-704c7bfb3d23","Type":"ContainerDied","Data":"2380e0d540add92eb55f3919c3c6305aa67497ed965023487e67af07a49d61d8"} Sep 09 09:03:30.293783 ip-10-0-137-144 kubenswrapper[2564]: I0909 09:03:30.293736 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-mj9pd" event={"ID":"6f9710e5-1a24-4cb6-83f3-704c7bfb3d23","Type":"ContainerStarted","Data":"8c20c27aea63da5e2248b5249cedf7504cf49f967d578f067dd0300eed10a2d9"} Sep 09 09:03:30.294279 ip-10-0-137-144 kubenswrapper[2564]: I0909 09:03:30.293810 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-mj9pd" event={"ID":"6f9710e5-1a24-4cb6-83f3-704c7bfb3d23","Type":"ContainerStarted","Data":"99ff7e63c8385cae6b96434add8012a964a0e1fb266ed99df7ac9a0821bba3b3"} Sep 09 09:03:30.294279 ip-10-0-137-144 kubenswrapper[2564]: I0909 09:03:30.293831 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-mj9pd" event={"ID":"6f9710e5-1a24-4cb6-83f3-704c7bfb3d23","Type":"ContainerStarted","Data":"13708c91b97a4375d645b8fa2b58a2022ddd39145c53dbb5d3a3137e9172347a"} Sep 09 09:03:30.294279 ip-10-0-137-144 kubenswrapper[2564]: I0909 09:03:30.293850 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-mj9pd" event={"ID":"6f9710e5-1a24-4cb6-83f3-704c7bfb3d23","Type":"ContainerStarted","Data":"eb35aa4e722e0bba396a38e9a2d16df528f410e58e6f4a6d02f950b9aa1c6012"} Sep 09 09:03:30.318820 ip-10-0-137-144 kubenswrapper[2564]: I0909 09:03:30.318756 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-mj9pd" podStartSLOduration=14.31873405 podStartE2EDuration="14.31873405s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 09:03:16 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 09:03:30.316084736 +0000 UTC m=+1471.013968664" watchObservedRunningTime="2026-09-09 09:03:30.31873405 +0000 UTC m=+1471.016617952" Sep 09 09:03:32.369264 ip-10-0-137-144 kubenswrapper[2564]: I0909 09:03:32.369143 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-mj9pd" Sep 09 09:03:32.369264 ip-10-0-137-144 kubenswrapper[2564]: I0909 09:03:32.369222 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-mj9pd" Sep 09 09:03:32.369264 ip-10-0-137-144 kubenswrapper[2564]: I0909 09:03:32.369243 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-mj9pd" Sep 09 09:03:32.370597 ip-10-0-137-144 kubenswrapper[2564]: I0909 09:03:32.370129 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-mj9pd" Sep 09 09:03:32.371530 ip-10-0-137-144 kubenswrapper[2564]: I0909 09:03:32.371492 2564 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-mj9pd" podUID="6f9710e5-1a24-4cb6-83f3-704c7bfb3d23" containerName="registry" probeResult="failure" output="dial tcp 10.132.0.23:6571: connect: connection refused" Sep 09 09:03:32.371530 ip-10-0-137-144 kubenswrapper[2564]: I0909 09:03:32.371515 2564 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-mj9pd" podUID="6f9710e5-1a24-4cb6-83f3-704c7bfb3d23" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.23:8443: connect: connection refused" Sep 09 09:03:32.371719 ip-10-0-137-144 kubenswrapper[2564]: I0909 09:03:32.371519 2564 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-mj9pd" podUID="6f9710e5-1a24-4cb6-83f3-704c7bfb3d23" containerName="offline" probeResult="failure" output="dial tcp 10.132.0.23:8816: connect: connection refused" Sep 09 09:03:32.371719 ip-10-0-137-144 kubenswrapper[2564]: I0909 09:03:32.371619 2564 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-mj9pd" podUID="6f9710e5-1a24-4cb6-83f3-704c7bfb3d23" containerName="online" probeResult="failure" output="Get \"https://10.132.0.23:6567/health\": dial tcp 10.132.0.23:6567: connect: connection refused" Sep 09 09:03:35.369062 ip-10-0-137-144 kubenswrapper[2564]: I0909 09:03:35.369014 2564 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-mj9pd" podUID="6f9710e5-1a24-4cb6-83f3-704c7bfb3d23" containerName="offline" probeResult="failure" output="dial tcp 10.132.0.23:8816: connect: connection refused" Sep 09 09:03:35.369561 ip-10-0-137-144 kubenswrapper[2564]: I0909 09:03:35.369082 2564 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-mj9pd" podUID="6f9710e5-1a24-4cb6-83f3-704c7bfb3d23" containerName="online" probeResult="failure" output="Get \"https://10.132.0.23:6567/health\": dial tcp 10.132.0.23:6567: connect: connection refused" Sep 09 09:03:35.369561 ip-10-0-137-144 kubenswrapper[2564]: I0909 09:03:35.369014 2564 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-mj9pd" podUID="6f9710e5-1a24-4cb6-83f3-704c7bfb3d23" containerName="registry" probeResult="failure" output="dial tcp 10.132.0.23:6571: connect: connection refused" Sep 09 09:03:35.369561 ip-10-0-137-144 kubenswrapper[2564]: I0909 09:03:35.369485 2564 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-mj9pd" podUID="6f9710e5-1a24-4cb6-83f3-704c7bfb3d23" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.23:8443: connect: connection refused" Sep 09 09:03:37.368445 ip-10-0-137-144 kubenswrapper[2564]: I0909 09:03:37.368403 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-mj9pd" Sep 09 09:03:37.368821 ip-10-0-137-144 kubenswrapper[2564]: I0909 09:03:37.368472 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-mj9pd" Sep 09 09:03:37.368821 ip-10-0-137-144 kubenswrapper[2564]: I0909 09:03:37.368495 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-mj9pd" Sep 09 09:03:37.368821 ip-10-0-137-144 kubenswrapper[2564]: I0909 09:03:37.368513 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-mj9pd" Sep 09 09:03:38.369447 ip-10-0-137-144 kubenswrapper[2564]: I0909 09:03:38.369411 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-mj9pd" Sep 09 09:03:38.369801 ip-10-0-137-144 kubenswrapper[2564]: I0909 09:03:38.369616 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-mj9pd" Sep 09 09:03:38.369928 ip-10-0-137-144 kubenswrapper[2564]: I0909 09:03:38.369911 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-mj9pd" Sep 09 09:03:38.370443 ip-10-0-137-144 kubenswrapper[2564]: I0909 09:03:38.370416 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-mj9pd" Sep 09 09:03:38.370559 ip-10-0-137-144 kubenswrapper[2564]: I0909 09:03:38.370479 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-mj9pd" Sep 09 09:03:38.370559 ip-10-0-137-144 kubenswrapper[2564]: I0909 09:03:38.370511 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-mj9pd" Sep 09 09:03:38.374791 ip-10-0-137-144 kubenswrapper[2564]: I0909 09:03:38.374772 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-mj9pd" Sep 09 09:03:39.341473 ip-10-0-137-144 kubenswrapper[2564]: I0909 09:03:39.341440 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-mj9pd" Sep 09 09:03:59.783466 ip-10-0-137-144 kubenswrapper[2564]: I0909 09:03:59.783439 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-tdfqx_f81169f8-3c85-4cd7-8b59-684973ff46f7/console-operator/2.log" Sep 09 09:03:59.786276 ip-10-0-137-144 kubenswrapper[2564]: I0909 09:03:59.786253 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-tdfqx_f81169f8-3c85-4cd7-8b59-684973ff46f7/console-operator/2.log" Sep 09 09:04:41.113415 ip-10-0-137-144 kubenswrapper[2564]: I0909 09:04:41.113299 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-57576b8fcf-mj9pd"] Sep 09 09:04:41.113991 ip-10-0-137-144 kubenswrapper[2564]: I0909 09:04:41.113564 2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-mj9pd" podUID="6f9710e5-1a24-4cb6-83f3-704c7bfb3d23" containerName="registry" containerID="cri-o://eb35aa4e722e0bba396a38e9a2d16df528f410e58e6f4a6d02f950b9aa1c6012" gracePeriod=30 Sep 09 09:04:41.113991 ip-10-0-137-144 kubenswrapper[2564]: I0909 09:04:41.113607 2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-mj9pd" podUID="6f9710e5-1a24-4cb6-83f3-704c7bfb3d23" containerName="offline" containerID="cri-o://99ff7e63c8385cae6b96434add8012a964a0e1fb266ed99df7ac9a0821bba3b3" gracePeriod=30 Sep 09 09:04:41.113991 ip-10-0-137-144 kubenswrapper[2564]: I0909 09:04:41.113650 2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-mj9pd" podUID="6f9710e5-1a24-4cb6-83f3-704c7bfb3d23" containerName="ui" containerID="cri-o://8c20c27aea63da5e2248b5249cedf7504cf49f967d578f067dd0300eed10a2d9" gracePeriod=30 Sep 09 09:04:41.113991 ip-10-0-137-144 kubenswrapper[2564]: I0909 09:04:41.113687 2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-mj9pd" podUID="6f9710e5-1a24-4cb6-83f3-704c7bfb3d23" containerName="online" containerID="cri-o://13708c91b97a4375d645b8fa2b58a2022ddd39145c53dbb5d3a3137e9172347a" gracePeriod=30 Sep 09 09:04:41.626391 ip-10-0-137-144 kubenswrapper[2564]: I0909 09:04:41.626357 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["test-ns-feast/feast-simple-feast-setup-57576b8fcf-td44r"] Sep 09 09:04:41.629948 ip-10-0-137-144 kubenswrapper[2564]: I0909 09:04:41.629921 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-td44r" Sep 09 09:04:41.632958 ip-10-0-137-144 kubenswrapper[2564]: I0909 09:04:41.632935 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-dockercfg-5nlgj\"" Sep 09 09:04:41.641399 ip-10-0-137-144 kubenswrapper[2564]: I0909 09:04:41.641372 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-57576b8fcf-td44r"] Sep 09 09:04:41.765461 ip-10-0-137-144 kubenswrapper[2564]: I0909 09:04:41.765430 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/d7a2cfa0-04ea-4dec-8fa9-bbb5562f4eed-offline-tls\") pod \"feast-simple-feast-setup-57576b8fcf-td44r\" (UID: \"d7a2cfa0-04ea-4dec-8fa9-bbb5562f4eed\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-td44r" Sep 09 09:04:41.765606 ip-10-0-137-144 kubenswrapper[2564]: I0909 09:04:41.765489 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s8m87\" (UniqueName: \"kubernetes.io/projected/d7a2cfa0-04ea-4dec-8fa9-bbb5562f4eed-kube-api-access-s8m87\") pod \"feast-simple-feast-setup-57576b8fcf-td44r\" (UID: \"d7a2cfa0-04ea-4dec-8fa9-bbb5562f4eed\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-td44r" Sep 09 09:04:41.765606 ip-10-0-137-144 kubenswrapper[2564]: I0909 09:04:41.765568 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/d7a2cfa0-04ea-4dec-8fa9-bbb5562f4eed-online-tls\") pod \"feast-simple-feast-setup-57576b8fcf-td44r\" (UID: \"d7a2cfa0-04ea-4dec-8fa9-bbb5562f4eed\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-td44r" Sep 09 09:04:41.765712 ip-10-0-137-144 kubenswrapper[2564]: I0909 09:04:41.765620 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/d7a2cfa0-04ea-4dec-8fa9-bbb5562f4eed-ui-tls\") pod \"feast-simple-feast-setup-57576b8fcf-td44r\" (UID: \"d7a2cfa0-04ea-4dec-8fa9-bbb5562f4eed\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-td44r" Sep 09 09:04:41.765712 ip-10-0-137-144 kubenswrapper[2564]: I0909 09:04:41.765675 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/d7a2cfa0-04ea-4dec-8fa9-bbb5562f4eed-registry-tls\") pod \"feast-simple-feast-setup-57576b8fcf-td44r\" (UID: \"d7a2cfa0-04ea-4dec-8fa9-bbb5562f4eed\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-td44r" Sep 09 09:04:41.765805 ip-10-0-137-144 kubenswrapper[2564]: I0909 09:04:41.765722 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/d7a2cfa0-04ea-4dec-8fa9-bbb5562f4eed-feast-data\") pod \"feast-simple-feast-setup-57576b8fcf-td44r\" (UID: \"d7a2cfa0-04ea-4dec-8fa9-bbb5562f4eed\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-td44r" Sep 09 09:04:41.866316 ip-10-0-137-144 kubenswrapper[2564]: I0909 09:04:41.866262 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/d7a2cfa0-04ea-4dec-8fa9-bbb5562f4eed-online-tls\") pod \"feast-simple-feast-setup-57576b8fcf-td44r\" (UID: \"d7a2cfa0-04ea-4dec-8fa9-bbb5562f4eed\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-td44r" Sep 09 09:04:41.866497 ip-10-0-137-144 kubenswrapper[2564]: I0909 09:04:41.866323 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/d7a2cfa0-04ea-4dec-8fa9-bbb5562f4eed-ui-tls\") pod \"feast-simple-feast-setup-57576b8fcf-td44r\" (UID: \"d7a2cfa0-04ea-4dec-8fa9-bbb5562f4eed\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-td44r" Sep 09 09:04:41.866497 ip-10-0-137-144 kubenswrapper[2564]: I0909 09:04:41.866402 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/d7a2cfa0-04ea-4dec-8fa9-bbb5562f4eed-registry-tls\") pod \"feast-simple-feast-setup-57576b8fcf-td44r\" (UID: \"d7a2cfa0-04ea-4dec-8fa9-bbb5562f4eed\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-td44r" Sep 09 09:04:41.866497 ip-10-0-137-144 kubenswrapper[2564]: I0909 09:04:41.866420 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/d7a2cfa0-04ea-4dec-8fa9-bbb5562f4eed-feast-data\") pod \"feast-simple-feast-setup-57576b8fcf-td44r\" (UID: \"d7a2cfa0-04ea-4dec-8fa9-bbb5562f4eed\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-td44r" Sep 09 09:04:41.866497 ip-10-0-137-144 kubenswrapper[2564]: I0909 09:04:41.866440 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/d7a2cfa0-04ea-4dec-8fa9-bbb5562f4eed-offline-tls\") pod \"feast-simple-feast-setup-57576b8fcf-td44r\" (UID: \"d7a2cfa0-04ea-4dec-8fa9-bbb5562f4eed\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-td44r" Sep 09 09:04:41.866708 ip-10-0-137-144 kubenswrapper[2564]: I0909 09:04:41.866519 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s8m87\" (UniqueName: \"kubernetes.io/projected/d7a2cfa0-04ea-4dec-8fa9-bbb5562f4eed-kube-api-access-s8m87\") pod \"feast-simple-feast-setup-57576b8fcf-td44r\" (UID: \"d7a2cfa0-04ea-4dec-8fa9-bbb5562f4eed\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-td44r" Sep 09 09:04:41.866708 ip-10-0-137-144 kubenswrapper[2564]: E0909 09:04:41.866543 2564 secret.go:189] Couldn't get secret test-ns-feast/feast-simple-feast-setup-ui-tls: secret "feast-simple-feast-setup-ui-tls" not found Sep 09 09:04:41.866708 ip-10-0-137-144 kubenswrapper[2564]: E0909 09:04:41.866617 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d7a2cfa0-04ea-4dec-8fa9-bbb5562f4eed-ui-tls podName:d7a2cfa0-04ea-4dec-8fa9-bbb5562f4eed nodeName:}" failed. No retries permitted until 2026-09-09 09:04:42.366595402 +0000 UTC m=+1543.064479309 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "ui-tls" (UniqueName: "kubernetes.io/secret/d7a2cfa0-04ea-4dec-8fa9-bbb5562f4eed-ui-tls") pod "feast-simple-feast-setup-57576b8fcf-td44r" (UID: "d7a2cfa0-04ea-4dec-8fa9-bbb5562f4eed") : secret "feast-simple-feast-setup-ui-tls" not found Sep 09 09:04:41.866920 ip-10-0-137-144 kubenswrapper[2564]: I0909 09:04:41.866887 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/d7a2cfa0-04ea-4dec-8fa9-bbb5562f4eed-feast-data\") pod \"feast-simple-feast-setup-57576b8fcf-td44r\" (UID: \"d7a2cfa0-04ea-4dec-8fa9-bbb5562f4eed\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-td44r" Sep 09 09:04:41.868833 ip-10-0-137-144 kubenswrapper[2564]: I0909 09:04:41.868816 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/d7a2cfa0-04ea-4dec-8fa9-bbb5562f4eed-offline-tls\") pod \"feast-simple-feast-setup-57576b8fcf-td44r\" (UID: \"d7a2cfa0-04ea-4dec-8fa9-bbb5562f4eed\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-td44r" Sep 09 09:04:41.869409 ip-10-0-137-144 kubenswrapper[2564]: I0909 09:04:41.869380 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/d7a2cfa0-04ea-4dec-8fa9-bbb5562f4eed-registry-tls\") pod \"feast-simple-feast-setup-57576b8fcf-td44r\" (UID: \"d7a2cfa0-04ea-4dec-8fa9-bbb5562f4eed\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-td44r" Sep 09 09:04:41.869494 ip-10-0-137-144 kubenswrapper[2564]: I0909 09:04:41.869391 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/d7a2cfa0-04ea-4dec-8fa9-bbb5562f4eed-online-tls\") pod \"feast-simple-feast-setup-57576b8fcf-td44r\" (UID: \"d7a2cfa0-04ea-4dec-8fa9-bbb5562f4eed\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-td44r" Sep 09 09:04:41.876974 ip-10-0-137-144 kubenswrapper[2564]: I0909 09:04:41.876926 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-s8m87\" (UniqueName: \"kubernetes.io/projected/d7a2cfa0-04ea-4dec-8fa9-bbb5562f4eed-kube-api-access-s8m87\") pod \"feast-simple-feast-setup-57576b8fcf-td44r\" (UID: \"d7a2cfa0-04ea-4dec-8fa9-bbb5562f4eed\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-td44r" Sep 09 09:04:42.371010 ip-10-0-137-144 kubenswrapper[2564]: I0909 09:04:42.370975 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/d7a2cfa0-04ea-4dec-8fa9-bbb5562f4eed-ui-tls\") pod \"feast-simple-feast-setup-57576b8fcf-td44r\" (UID: \"d7a2cfa0-04ea-4dec-8fa9-bbb5562f4eed\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-td44r" Sep 09 09:04:42.373440 ip-10-0-137-144 kubenswrapper[2564]: I0909 09:04:42.373419 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/d7a2cfa0-04ea-4dec-8fa9-bbb5562f4eed-ui-tls\") pod \"feast-simple-feast-setup-57576b8fcf-td44r\" (UID: \"d7a2cfa0-04ea-4dec-8fa9-bbb5562f4eed\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-td44r" Sep 09 09:04:42.539906 ip-10-0-137-144 kubenswrapper[2564]: I0909 09:04:42.539868 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-td44r" Sep 09 09:04:42.575766 ip-10-0-137-144 kubenswrapper[2564]: I0909 09:04:42.575733 2564 generic.go:356] "Generic (PLEG): container finished" podID="6f9710e5-1a24-4cb6-83f3-704c7bfb3d23" containerID="8c20c27aea63da5e2248b5249cedf7504cf49f967d578f067dd0300eed10a2d9" exitCode=0 Sep 09 09:04:42.575766 ip-10-0-137-144 kubenswrapper[2564]: I0909 09:04:42.575760 2564 generic.go:356] "Generic (PLEG): container finished" podID="6f9710e5-1a24-4cb6-83f3-704c7bfb3d23" containerID="13708c91b97a4375d645b8fa2b58a2022ddd39145c53dbb5d3a3137e9172347a" exitCode=0 Sep 09 09:04:42.575972 ip-10-0-137-144 kubenswrapper[2564]: I0909 09:04:42.575807 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-mj9pd" event={"ID":"6f9710e5-1a24-4cb6-83f3-704c7bfb3d23","Type":"ContainerDied","Data":"8c20c27aea63da5e2248b5249cedf7504cf49f967d578f067dd0300eed10a2d9"} Sep 09 09:04:42.575972 ip-10-0-137-144 kubenswrapper[2564]: I0909 09:04:42.575850 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-mj9pd" event={"ID":"6f9710e5-1a24-4cb6-83f3-704c7bfb3d23","Type":"ContainerDied","Data":"13708c91b97a4375d645b8fa2b58a2022ddd39145c53dbb5d3a3137e9172347a"} Sep 09 09:04:42.816559 ip-10-0-137-144 kubenswrapper[2564]: I0909 09:04:42.816534 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-57576b8fcf-td44r"] Sep 09 09:04:42.818015 ip-10-0-137-144 kubenswrapper[2564]: W0909 09:04:42.817985 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podd7a2cfa0_04ea_4dec_8fa9_bbb5562f4eed.slice/crio-ec0468ea0e1f5e1caacb4e0d4e0b5775413efea3a18803e730ca459362402d34 WatchSource:0}: Error finding container ec0468ea0e1f5e1caacb4e0d4e0b5775413efea3a18803e730ca459362402d34: Status 404 returned error can't find the container with id ec0468ea0e1f5e1caacb4e0d4e0b5775413efea3a18803e730ca459362402d34 Sep 09 09:04:43.587455 ip-10-0-137-144 kubenswrapper[2564]: I0909 09:04:43.587418 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-td44r" event={"ID":"d7a2cfa0-04ea-4dec-8fa9-bbb5562f4eed","Type":"ContainerStarted","Data":"ad3f3ddf6cd19d942539bc666fb7970f9eb21113694102c86bc572a2f3dc54c9"} Sep 09 09:04:43.587810 ip-10-0-137-144 kubenswrapper[2564]: I0909 09:04:43.587466 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-td44r" event={"ID":"d7a2cfa0-04ea-4dec-8fa9-bbb5562f4eed","Type":"ContainerStarted","Data":"ec0468ea0e1f5e1caacb4e0d4e0b5775413efea3a18803e730ca459362402d34"} Sep 09 09:04:48.370910 ip-10-0-137-144 kubenswrapper[2564]: I0909 09:04:48.370862 2564 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-mj9pd" podUID="6f9710e5-1a24-4cb6-83f3-704c7bfb3d23" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.23:8443: connect: connection refused" Sep 09 09:04:48.608955 ip-10-0-137-144 kubenswrapper[2564]: I0909 09:04:48.608916 2564 generic.go:356] "Generic (PLEG): container finished" podID="d7a2cfa0-04ea-4dec-8fa9-bbb5562f4eed" containerID="ad3f3ddf6cd19d942539bc666fb7970f9eb21113694102c86bc572a2f3dc54c9" exitCode=0 Sep 09 09:04:48.608955 ip-10-0-137-144 kubenswrapper[2564]: I0909 09:04:48.608955 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-td44r" event={"ID":"d7a2cfa0-04ea-4dec-8fa9-bbb5562f4eed","Type":"ContainerDied","Data":"ad3f3ddf6cd19d942539bc666fb7970f9eb21113694102c86bc572a2f3dc54c9"} Sep 09 09:04:49.338429 ip-10-0-137-144 kubenswrapper[2564]: I0909 09:04:49.338379 2564 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-mj9pd" podUID="6f9710e5-1a24-4cb6-83f3-704c7bfb3d23" containerName="online" probeResult="failure" output="Get \"https://10.132.0.23:6567/health\": dial tcp 10.132.0.23:6567: connect: connection refused" Sep 09 09:04:49.615020 ip-10-0-137-144 kubenswrapper[2564]: I0909 09:04:49.614931 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-td44r" event={"ID":"d7a2cfa0-04ea-4dec-8fa9-bbb5562f4eed","Type":"ContainerStarted","Data":"f405e89834e659804f44959035833796cc19ed02873cc26836d9d72afe97ee79"} Sep 09 09:04:54.635422 ip-10-0-137-144 kubenswrapper[2564]: I0909 09:04:54.635386 2564 generic.go:356] "Generic (PLEG): container finished" podID="d7a2cfa0-04ea-4dec-8fa9-bbb5562f4eed" containerID="f405e89834e659804f44959035833796cc19ed02873cc26836d9d72afe97ee79" exitCode=0 Sep 09 09:04:54.635763 ip-10-0-137-144 kubenswrapper[2564]: I0909 09:04:54.635438 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-td44r" event={"ID":"d7a2cfa0-04ea-4dec-8fa9-bbb5562f4eed","Type":"ContainerDied","Data":"f405e89834e659804f44959035833796cc19ed02873cc26836d9d72afe97ee79"} Sep 09 09:04:55.645693 ip-10-0-137-144 kubenswrapper[2564]: I0909 09:04:55.645649 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-td44r" event={"ID":"d7a2cfa0-04ea-4dec-8fa9-bbb5562f4eed","Type":"ContainerStarted","Data":"bf6691b0d8449545b0e4769d9af25a137105120f4cfb022465fb8477929c3849"} Sep 09 09:04:55.646131 ip-10-0-137-144 kubenswrapper[2564]: I0909 09:04:55.645719 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-td44r" event={"ID":"d7a2cfa0-04ea-4dec-8fa9-bbb5562f4eed","Type":"ContainerStarted","Data":"c9153b9b939424ebf3013b87448334d25e5b14708eb2db334499a89165537241"} Sep 09 09:04:55.646131 ip-10-0-137-144 kubenswrapper[2564]: I0909 09:04:55.645740 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-td44r" event={"ID":"d7a2cfa0-04ea-4dec-8fa9-bbb5562f4eed","Type":"ContainerStarted","Data":"73c730b525a70427f0910a8b26086c45f3a92e3830910f83be375d068b60779d"} Sep 09 09:04:55.646131 ip-10-0-137-144 kubenswrapper[2564]: I0909 09:04:55.645758 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-td44r" event={"ID":"d7a2cfa0-04ea-4dec-8fa9-bbb5562f4eed","Type":"ContainerStarted","Data":"2d9c6743777ca046ecfaaa618aa4f078a0f1798ea9d1631044482ec0347c8692"} Sep 09 09:04:55.671406 ip-10-0-137-144 kubenswrapper[2564]: I0909 09:04:55.671319 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-td44r" podStartSLOduration=14.671296764000001 podStartE2EDuration="14.671296764s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 09:04:41 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 09:04:55.668673835 +0000 UTC m=+1556.366557737" watchObservedRunningTime="2026-09-09 09:04:55.671296764 +0000 UTC m=+1556.369180666" Sep 09 09:04:57.541096 ip-10-0-137-144 kubenswrapper[2564]: I0909 09:04:57.540849 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-td44r" Sep 09 09:04:57.541096 ip-10-0-137-144 kubenswrapper[2564]: I0909 09:04:57.540923 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-td44r" Sep 09 09:04:57.541096 ip-10-0-137-144 kubenswrapper[2564]: I0909 09:04:57.540943 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-td44r" Sep 09 09:04:57.541096 ip-10-0-137-144 kubenswrapper[2564]: I0909 09:04:57.540961 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-td44r" Sep 09 09:04:57.542987 ip-10-0-137-144 kubenswrapper[2564]: I0909 09:04:57.542946 2564 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-td44r" podUID="d7a2cfa0-04ea-4dec-8fa9-bbb5562f4eed" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.24:8443: connect: connection refused" Sep 09 09:04:57.542987 ip-10-0-137-144 kubenswrapper[2564]: I0909 09:04:57.542970 2564 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-td44r" podUID="d7a2cfa0-04ea-4dec-8fa9-bbb5562f4eed" containerName="registry" probeResult="failure" output="dial tcp 10.132.0.24:6571: connect: connection refused" Sep 09 09:04:57.543177 ip-10-0-137-144 kubenswrapper[2564]: I0909 09:04:57.542984 2564 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-td44r" podUID="d7a2cfa0-04ea-4dec-8fa9-bbb5562f4eed" containerName="offline" probeResult="failure" output="dial tcp 10.132.0.24:8816: connect: connection refused" Sep 09 09:04:57.543177 ip-10-0-137-144 kubenswrapper[2564]: I0909 09:04:57.543068 2564 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-td44r" podUID="d7a2cfa0-04ea-4dec-8fa9-bbb5562f4eed" containerName="online" probeResult="failure" output="Get \"https://10.132.0.24:6567/health\": dial tcp 10.132.0.24:6567: connect: connection refused" Sep 09 09:04:58.371102 ip-10-0-137-144 kubenswrapper[2564]: I0909 09:04:58.371053 2564 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-mj9pd" podUID="6f9710e5-1a24-4cb6-83f3-704c7bfb3d23" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.23:8443: connect: connection refused" Sep 09 09:04:59.339032 ip-10-0-137-144 kubenswrapper[2564]: I0909 09:04:59.338981 2564 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-mj9pd" podUID="6f9710e5-1a24-4cb6-83f3-704c7bfb3d23" containerName="online" probeResult="failure" output="Get \"https://10.132.0.23:6567/health\": dial tcp 10.132.0.23:6567: connect: connection refused" Sep 09 09:05:00.540817 ip-10-0-137-144 kubenswrapper[2564]: I0909 09:05:00.540758 2564 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-td44r" podUID="d7a2cfa0-04ea-4dec-8fa9-bbb5562f4eed" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.24:8443: connect: connection refused" Sep 09 09:05:00.541289 ip-10-0-137-144 kubenswrapper[2564]: I0909 09:05:00.540758 2564 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-td44r" podUID="d7a2cfa0-04ea-4dec-8fa9-bbb5562f4eed" containerName="offline" probeResult="failure" output="dial tcp 10.132.0.24:8816: connect: connection refused" Sep 09 09:05:00.541289 ip-10-0-137-144 kubenswrapper[2564]: I0909 09:05:00.540773 2564 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-td44r" podUID="d7a2cfa0-04ea-4dec-8fa9-bbb5562f4eed" containerName="online" probeResult="failure" output="Get \"https://10.132.0.24:6567/health\": dial tcp 10.132.0.24:6567: connect: connection refused" Sep 09 09:05:00.541289 ip-10-0-137-144 kubenswrapper[2564]: I0909 09:05:00.540783 2564 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-td44r" podUID="d7a2cfa0-04ea-4dec-8fa9-bbb5562f4eed" containerName="registry" probeResult="failure" output="dial tcp 10.132.0.24:6571: connect: connection refused" Sep 09 09:05:02.540367 ip-10-0-137-144 kubenswrapper[2564]: I0909 09:05:02.540296 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-td44r" Sep 09 09:05:02.540871 ip-10-0-137-144 kubenswrapper[2564]: I0909 09:05:02.540386 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-td44r" Sep 09 09:05:02.540871 ip-10-0-137-144 kubenswrapper[2564]: I0909 09:05:02.540410 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-td44r" Sep 09 09:05:02.540871 ip-10-0-137-144 kubenswrapper[2564]: I0909 09:05:02.540440 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-td44r" Sep 09 09:05:03.541577 ip-10-0-137-144 kubenswrapper[2564]: I0909 09:05:03.541525 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-td44r" Sep 09 09:05:03.541980 ip-10-0-137-144 kubenswrapper[2564]: I0909 09:05:03.541815 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-td44r" Sep 09 09:05:03.541980 ip-10-0-137-144 kubenswrapper[2564]: I0909 09:05:03.541905 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-td44r" Sep 09 09:05:03.546956 ip-10-0-137-144 kubenswrapper[2564]: I0909 09:05:03.546937 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-td44r" Sep 09 09:05:03.689558 ip-10-0-137-144 kubenswrapper[2564]: I0909 09:05:03.689523 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-td44r" Sep 09 09:05:03.689744 ip-10-0-137-144 kubenswrapper[2564]: I0909 09:05:03.689651 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-td44r" Sep 09 09:05:03.689842 ip-10-0-137-144 kubenswrapper[2564]: I0909 09:05:03.689821 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-td44r" Sep 09 09:05:03.692421 ip-10-0-137-144 kubenswrapper[2564]: I0909 09:05:03.692402 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-td44r" Sep 09 09:05:08.370159 ip-10-0-137-144 kubenswrapper[2564]: I0909 09:05:08.370110 2564 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-mj9pd" podUID="6f9710e5-1a24-4cb6-83f3-704c7bfb3d23" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.23:8443: connect: connection refused" Sep 09 09:05:08.370609 ip-10-0-137-144 kubenswrapper[2564]: I0909 09:05:08.370269 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-mj9pd" Sep 09 09:05:09.338333 ip-10-0-137-144 kubenswrapper[2564]: I0909 09:05:09.338281 2564 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-mj9pd" podUID="6f9710e5-1a24-4cb6-83f3-704c7bfb3d23" containerName="online" probeResult="failure" output="Get \"https://10.132.0.23:6567/health\": dial tcp 10.132.0.23:6567: connect: connection refused" Sep 09 09:05:09.338550 ip-10-0-137-144 kubenswrapper[2564]: I0909 09:05:09.338429 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-mj9pd" Sep 09 09:05:11.723075 ip-10-0-137-144 kubenswrapper[2564]: I0909 09:05:11.723042 2564 generic.go:356] "Generic (PLEG): container finished" podID="6f9710e5-1a24-4cb6-83f3-704c7bfb3d23" containerID="99ff7e63c8385cae6b96434add8012a964a0e1fb266ed99df7ac9a0821bba3b3" exitCode=137 Sep 09 09:05:11.723075 ip-10-0-137-144 kubenswrapper[2564]: I0909 09:05:11.723068 2564 generic.go:356] "Generic (PLEG): container finished" podID="6f9710e5-1a24-4cb6-83f3-704c7bfb3d23" containerID="eb35aa4e722e0bba396a38e9a2d16df528f410e58e6f4a6d02f950b9aa1c6012" exitCode=137 Sep 09 09:05:11.723489 ip-10-0-137-144 kubenswrapper[2564]: I0909 09:05:11.723095 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-mj9pd" event={"ID":"6f9710e5-1a24-4cb6-83f3-704c7bfb3d23","Type":"ContainerDied","Data":"99ff7e63c8385cae6b96434add8012a964a0e1fb266ed99df7ac9a0821bba3b3"} Sep 09 09:05:11.723489 ip-10-0-137-144 kubenswrapper[2564]: I0909 09:05:11.723125 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-mj9pd" event={"ID":"6f9710e5-1a24-4cb6-83f3-704c7bfb3d23","Type":"ContainerDied","Data":"eb35aa4e722e0bba396a38e9a2d16df528f410e58e6f4a6d02f950b9aa1c6012"} Sep 09 09:05:11.762120 ip-10-0-137-144 kubenswrapper[2564]: I0909 09:05:11.762092 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-mj9pd" Sep 09 09:05:11.788198 ip-10-0-137-144 kubenswrapper[2564]: I0909 09:05:11.788165 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vds8x\" (UniqueName: \"kubernetes.io/projected/6f9710e5-1a24-4cb6-83f3-704c7bfb3d23-kube-api-access-vds8x\") pod \"6f9710e5-1a24-4cb6-83f3-704c7bfb3d23\" (UID: \"6f9710e5-1a24-4cb6-83f3-704c7bfb3d23\") " Sep 09 09:05:11.788377 ip-10-0-137-144 kubenswrapper[2564]: I0909 09:05:11.788210 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/6f9710e5-1a24-4cb6-83f3-704c7bfb3d23-ui-tls\") pod \"6f9710e5-1a24-4cb6-83f3-704c7bfb3d23\" (UID: \"6f9710e5-1a24-4cb6-83f3-704c7bfb3d23\") " Sep 09 09:05:11.788377 ip-10-0-137-144 kubenswrapper[2564]: I0909 09:05:11.788267 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/6f9710e5-1a24-4cb6-83f3-704c7bfb3d23-online-tls\") pod \"6f9710e5-1a24-4cb6-83f3-704c7bfb3d23\" (UID: \"6f9710e5-1a24-4cb6-83f3-704c7bfb3d23\") " Sep 09 09:05:11.788377 ip-10-0-137-144 kubenswrapper[2564]: I0909 09:05:11.788300 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/6f9710e5-1a24-4cb6-83f3-704c7bfb3d23-offline-tls\") pod \"6f9710e5-1a24-4cb6-83f3-704c7bfb3d23\" (UID: \"6f9710e5-1a24-4cb6-83f3-704c7bfb3d23\") " Sep 09 09:05:11.788377 ip-10-0-137-144 kubenswrapper[2564]: I0909 09:05:11.788359 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/6f9710e5-1a24-4cb6-83f3-704c7bfb3d23-registry-tls\") pod \"6f9710e5-1a24-4cb6-83f3-704c7bfb3d23\" (UID: \"6f9710e5-1a24-4cb6-83f3-704c7bfb3d23\") " Sep 09 09:05:11.788536 ip-10-0-137-144 kubenswrapper[2564]: I0909 09:05:11.788390 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/6f9710e5-1a24-4cb6-83f3-704c7bfb3d23-feast-data\") pod \"6f9710e5-1a24-4cb6-83f3-704c7bfb3d23\" (UID: \"6f9710e5-1a24-4cb6-83f3-704c7bfb3d23\") " Sep 09 09:05:11.789082 ip-10-0-137-144 kubenswrapper[2564]: I0909 09:05:11.789053 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6f9710e5-1a24-4cb6-83f3-704c7bfb3d23-feast-data" (OuterVolumeSpecName: "feast-data") pod "6f9710e5-1a24-4cb6-83f3-704c7bfb3d23" (UID: "6f9710e5-1a24-4cb6-83f3-704c7bfb3d23"). InnerVolumeSpecName "feast-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 09 09:05:11.794397 ip-10-0-137-144 kubenswrapper[2564]: I0909 09:05:11.791959 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6f9710e5-1a24-4cb6-83f3-704c7bfb3d23-ui-tls" (OuterVolumeSpecName: "ui-tls") pod "6f9710e5-1a24-4cb6-83f3-704c7bfb3d23" (UID: "6f9710e5-1a24-4cb6-83f3-704c7bfb3d23"). InnerVolumeSpecName "ui-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 09 09:05:11.794397 ip-10-0-137-144 kubenswrapper[2564]: I0909 09:05:11.792018 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6f9710e5-1a24-4cb6-83f3-704c7bfb3d23-kube-api-access-vds8x" (OuterVolumeSpecName: "kube-api-access-vds8x") pod "6f9710e5-1a24-4cb6-83f3-704c7bfb3d23" (UID: "6f9710e5-1a24-4cb6-83f3-704c7bfb3d23"). InnerVolumeSpecName "kube-api-access-vds8x". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 09 09:05:11.794397 ip-10-0-137-144 kubenswrapper[2564]: I0909 09:05:11.792046 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6f9710e5-1a24-4cb6-83f3-704c7bfb3d23-online-tls" (OuterVolumeSpecName: "online-tls") pod "6f9710e5-1a24-4cb6-83f3-704c7bfb3d23" (UID: "6f9710e5-1a24-4cb6-83f3-704c7bfb3d23"). InnerVolumeSpecName "online-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 09 09:05:11.794397 ip-10-0-137-144 kubenswrapper[2564]: I0909 09:05:11.792354 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6f9710e5-1a24-4cb6-83f3-704c7bfb3d23-offline-tls" (OuterVolumeSpecName: "offline-tls") pod "6f9710e5-1a24-4cb6-83f3-704c7bfb3d23" (UID: "6f9710e5-1a24-4cb6-83f3-704c7bfb3d23"). InnerVolumeSpecName "offline-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 09 09:05:11.797573 ip-10-0-137-144 kubenswrapper[2564]: I0909 09:05:11.795076 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6f9710e5-1a24-4cb6-83f3-704c7bfb3d23-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "6f9710e5-1a24-4cb6-83f3-704c7bfb3d23" (UID: "6f9710e5-1a24-4cb6-83f3-704c7bfb3d23"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 09 09:05:11.888971 ip-10-0-137-144 kubenswrapper[2564]: I0909 09:05:11.888885 2564 reconciler_common.go:299] "Volume detached for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/6f9710e5-1a24-4cb6-83f3-704c7bfb3d23-online-tls\") on node \"ip-10-0-137-144.ec2.internal\" DevicePath \"\"" Sep 09 09:05:11.888971 ip-10-0-137-144 kubenswrapper[2564]: I0909 09:05:11.888917 2564 reconciler_common.go:299] "Volume detached for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/6f9710e5-1a24-4cb6-83f3-704c7bfb3d23-offline-tls\") on node \"ip-10-0-137-144.ec2.internal\" DevicePath \"\"" Sep 09 09:05:11.888971 ip-10-0-137-144 kubenswrapper[2564]: I0909 09:05:11.888928 2564 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/6f9710e5-1a24-4cb6-83f3-704c7bfb3d23-registry-tls\") on node \"ip-10-0-137-144.ec2.internal\" DevicePath \"\"" Sep 09 09:05:11.888971 ip-10-0-137-144 kubenswrapper[2564]: I0909 09:05:11.888939 2564 reconciler_common.go:299] "Volume detached for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/6f9710e5-1a24-4cb6-83f3-704c7bfb3d23-feast-data\") on node \"ip-10-0-137-144.ec2.internal\" DevicePath \"\"" Sep 09 09:05:11.888971 ip-10-0-137-144 kubenswrapper[2564]: I0909 09:05:11.888952 2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vds8x\" (UniqueName: \"kubernetes.io/projected/6f9710e5-1a24-4cb6-83f3-704c7bfb3d23-kube-api-access-vds8x\") on node \"ip-10-0-137-144.ec2.internal\" DevicePath \"\"" Sep 09 09:05:11.888971 ip-10-0-137-144 kubenswrapper[2564]: I0909 09:05:11.888966 2564 reconciler_common.go:299] "Volume detached for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/6f9710e5-1a24-4cb6-83f3-704c7bfb3d23-ui-tls\") on node \"ip-10-0-137-144.ec2.internal\" DevicePath \"\"" Sep 09 09:05:12.732456 ip-10-0-137-144 kubenswrapper[2564]: I0909 09:05:12.732416 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-mj9pd" event={"ID":"6f9710e5-1a24-4cb6-83f3-704c7bfb3d23","Type":"ContainerDied","Data":"87e017a42f7b8cd7952cf11eb3a954807d26f57d5d97def7702b166c8898bab4"} Sep 09 09:05:12.733050 ip-10-0-137-144 kubenswrapper[2564]: I0909 09:05:12.732472 2564 scope.go:117] "RemoveContainer" containerID="8c20c27aea63da5e2248b5249cedf7504cf49f967d578f067dd0300eed10a2d9" Sep 09 09:05:12.733050 ip-10-0-137-144 kubenswrapper[2564]: I0909 09:05:12.732488 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-mj9pd" Sep 09 09:05:12.740949 ip-10-0-137-144 kubenswrapper[2564]: I0909 09:05:12.740929 2564 scope.go:117] "RemoveContainer" containerID="99ff7e63c8385cae6b96434add8012a964a0e1fb266ed99df7ac9a0821bba3b3" Sep 09 09:05:12.748688 ip-10-0-137-144 kubenswrapper[2564]: I0909 09:05:12.748669 2564 scope.go:117] "RemoveContainer" containerID="13708c91b97a4375d645b8fa2b58a2022ddd39145c53dbb5d3a3137e9172347a" Sep 09 09:05:12.750932 ip-10-0-137-144 kubenswrapper[2564]: I0909 09:05:12.750907 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-57576b8fcf-mj9pd"] Sep 09 09:05:12.756149 ip-10-0-137-144 kubenswrapper[2564]: I0909 09:05:12.756128 2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-57576b8fcf-mj9pd"] Sep 09 09:05:12.757099 ip-10-0-137-144 kubenswrapper[2564]: I0909 09:05:12.757074 2564 scope.go:117] "RemoveContainer" containerID="eb35aa4e722e0bba396a38e9a2d16df528f410e58e6f4a6d02f950b9aa1c6012" Sep 09 09:05:12.764684 ip-10-0-137-144 kubenswrapper[2564]: I0909 09:05:12.764663 2564 scope.go:117] "RemoveContainer" containerID="2380e0d540add92eb55f3919c3c6305aa67497ed965023487e67af07a49d61d8" Sep 09 09:05:12.772173 ip-10-0-137-144 kubenswrapper[2564]: I0909 09:05:12.772155 2564 scope.go:117] "RemoveContainer" containerID="1afc3fedde9a2db9595c2808d9d225e44d1b76693411aebb77e73a52b810be41" Sep 09 09:05:13.806475 ip-10-0-137-144 kubenswrapper[2564]: I0909 09:05:13.806441 2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6f9710e5-1a24-4cb6-83f3-704c7bfb3d23" path="/var/lib/kubelet/pods/6f9710e5-1a24-4cb6-83f3-704c7bfb3d23/volumes" Sep 09 09:06:06.164317 ip-10-0-137-144 kubenswrapper[2564]: I0909 09:06:06.164281 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-57cgx"] Sep 09 09:06:06.164721 ip-10-0-137-144 kubenswrapper[2564]: I0909 09:06:06.164585 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6f9710e5-1a24-4cb6-83f3-704c7bfb3d23" containerName="ui" Sep 09 09:06:06.164721 ip-10-0-137-144 kubenswrapper[2564]: I0909 09:06:06.164600 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="6f9710e5-1a24-4cb6-83f3-704c7bfb3d23" containerName="ui" Sep 09 09:06:06.164721 ip-10-0-137-144 kubenswrapper[2564]: I0909 09:06:06.164616 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6f9710e5-1a24-4cb6-83f3-704c7bfb3d23" containerName="registry" Sep 09 09:06:06.164721 ip-10-0-137-144 kubenswrapper[2564]: I0909 09:06:06.164621 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="6f9710e5-1a24-4cb6-83f3-704c7bfb3d23" containerName="registry" Sep 09 09:06:06.164721 ip-10-0-137-144 kubenswrapper[2564]: I0909 09:06:06.164628 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6f9710e5-1a24-4cb6-83f3-704c7bfb3d23" containerName="feast-init" Sep 09 09:06:06.164721 ip-10-0-137-144 kubenswrapper[2564]: I0909 09:06:06.164634 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="6f9710e5-1a24-4cb6-83f3-704c7bfb3d23" containerName="feast-init" Sep 09 09:06:06.164721 ip-10-0-137-144 kubenswrapper[2564]: I0909 09:06:06.164648 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6f9710e5-1a24-4cb6-83f3-704c7bfb3d23" containerName="online" Sep 09 09:06:06.164721 ip-10-0-137-144 kubenswrapper[2564]: I0909 09:06:06.164653 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="6f9710e5-1a24-4cb6-83f3-704c7bfb3d23" containerName="online" Sep 09 09:06:06.164721 ip-10-0-137-144 kubenswrapper[2564]: I0909 09:06:06.164658 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6f9710e5-1a24-4cb6-83f3-704c7bfb3d23" containerName="offline" Sep 09 09:06:06.164721 ip-10-0-137-144 kubenswrapper[2564]: I0909 09:06:06.164663 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="6f9710e5-1a24-4cb6-83f3-704c7bfb3d23" containerName="offline" Sep 09 09:06:06.164721 ip-10-0-137-144 kubenswrapper[2564]: I0909 09:06:06.164670 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6f9710e5-1a24-4cb6-83f3-704c7bfb3d23" containerName="feast-apply" Sep 09 09:06:06.164721 ip-10-0-137-144 kubenswrapper[2564]: I0909 09:06:06.164675 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="6f9710e5-1a24-4cb6-83f3-704c7bfb3d23" containerName="feast-apply" Sep 09 09:06:06.164721 ip-10-0-137-144 kubenswrapper[2564]: I0909 09:06:06.164717 2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="6f9710e5-1a24-4cb6-83f3-704c7bfb3d23" containerName="ui" Sep 09 09:06:06.164721 ip-10-0-137-144 kubenswrapper[2564]: I0909 09:06:06.164726 2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="6f9710e5-1a24-4cb6-83f3-704c7bfb3d23" containerName="online" Sep 09 09:06:06.165134 ip-10-0-137-144 kubenswrapper[2564]: I0909 09:06:06.164732 2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="6f9710e5-1a24-4cb6-83f3-704c7bfb3d23" containerName="offline" Sep 09 09:06:06.165134 ip-10-0-137-144 kubenswrapper[2564]: I0909 09:06:06.164738 2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="6f9710e5-1a24-4cb6-83f3-704c7bfb3d23" containerName="registry" Sep 09 09:06:06.168007 ip-10-0-137-144 kubenswrapper[2564]: I0909 09:06:06.167987 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-57cgx" Sep 09 09:06:06.170273 ip-10-0-137-144 kubenswrapper[2564]: I0909 09:06:06.170248 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-online-tls\"" Sep 09 09:06:06.170273 ip-10-0-137-144 kubenswrapper[2564]: I0909 09:06:06.170259 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-dockercfg-crs96\"" Sep 09 09:06:06.170535 ip-10-0-137-144 kubenswrapper[2564]: I0909 09:06:06.170291 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-client-ca\"" Sep 09 09:06:06.170535 ip-10-0-137-144 kubenswrapper[2564]: I0909 09:06:06.170390 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-ui-tls\"" Sep 09 09:06:06.170535 ip-10-0-137-144 kubenswrapper[2564]: I0909 09:06:06.170511 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-offline-tls\"" Sep 09 09:06:06.170681 ip-10-0-137-144 kubenswrapper[2564]: I0909 09:06:06.170643 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-remote-registry\"/\"openshift-service-ca.crt\"" Sep 09 09:06:06.170721 ip-10-0-137-144 kubenswrapper[2564]: I0909 09:06:06.170698 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-remote-registry\"/\"kube-root-ca.crt\"" Sep 09 09:06:06.179946 ip-10-0-137-144 kubenswrapper[2564]: I0909 09:06:06.179921 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-57cgx"] Sep 09 09:06:06.254234 ip-10-0-137-144 kubenswrapper[2564]: I0909 09:06:06.254203 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/583c5cca-7e45-4dce-849e-1f22ffc3c53e-online-tls\") pod \"feast-simple-feast-remote-setup-c5d49d8c6-57cgx\" (UID: \"583c5cca-7e45-4dce-849e-1f22ffc3c53e\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-57cgx" Sep 09 09:06:06.254451 ip-10-0-137-144 kubenswrapper[2564]: I0909 09:06:06.254252 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qkjjt\" (UniqueName: \"kubernetes.io/projected/583c5cca-7e45-4dce-849e-1f22ffc3c53e-kube-api-access-qkjjt\") pod \"feast-simple-feast-remote-setup-c5d49d8c6-57cgx\" (UID: \"583c5cca-7e45-4dce-849e-1f22ffc3c53e\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-57cgx" Sep 09 09:06:06.254451 ip-10-0-137-144 kubenswrapper[2564]: I0909 09:06:06.254283 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/583c5cca-7e45-4dce-849e-1f22ffc3c53e-feast-data\") pod \"feast-simple-feast-remote-setup-c5d49d8c6-57cgx\" (UID: \"583c5cca-7e45-4dce-849e-1f22ffc3c53e\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-57cgx" Sep 09 09:06:06.254451 ip-10-0-137-144 kubenswrapper[2564]: I0909 09:06:06.254315 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/583c5cca-7e45-4dce-849e-1f22ffc3c53e-offline-tls\") pod \"feast-simple-feast-remote-setup-c5d49d8c6-57cgx\" (UID: \"583c5cca-7e45-4dce-849e-1f22ffc3c53e\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-57cgx" Sep 09 09:06:06.254451 ip-10-0-137-144 kubenswrapper[2564]: I0909 09:06:06.254361 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/583c5cca-7e45-4dce-849e-1f22ffc3c53e-ui-tls\") pod \"feast-simple-feast-remote-setup-c5d49d8c6-57cgx\" (UID: \"583c5cca-7e45-4dce-849e-1f22ffc3c53e\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-57cgx" Sep 09 09:06:06.254451 ip-10-0-137-144 kubenswrapper[2564]: I0909 09:06:06.254416 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/configmap/583c5cca-7e45-4dce-849e-1f22ffc3c53e-registry-tls\") pod \"feast-simple-feast-remote-setup-c5d49d8c6-57cgx\" (UID: \"583c5cca-7e45-4dce-849e-1f22ffc3c53e\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-57cgx" Sep 09 09:06:06.355168 ip-10-0-137-144 kubenswrapper[2564]: I0909 09:06:06.355119 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/583c5cca-7e45-4dce-849e-1f22ffc3c53e-online-tls\") pod \"feast-simple-feast-remote-setup-c5d49d8c6-57cgx\" (UID: \"583c5cca-7e45-4dce-849e-1f22ffc3c53e\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-57cgx" Sep 09 09:06:06.355394 ip-10-0-137-144 kubenswrapper[2564]: I0909 09:06:06.355181 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qkjjt\" (UniqueName: \"kubernetes.io/projected/583c5cca-7e45-4dce-849e-1f22ffc3c53e-kube-api-access-qkjjt\") pod \"feast-simple-feast-remote-setup-c5d49d8c6-57cgx\" (UID: \"583c5cca-7e45-4dce-849e-1f22ffc3c53e\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-57cgx" Sep 09 09:06:06.355394 ip-10-0-137-144 kubenswrapper[2564]: E0909 09:06:06.355326 2564 secret.go:189] Couldn't get secret test-ns-remote-registry/feast-simple-feast-remote-setup-online-tls: secret "feast-simple-feast-remote-setup-online-tls" not found Sep 09 09:06:06.355513 ip-10-0-137-144 kubenswrapper[2564]: E0909 09:06:06.355416 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/583c5cca-7e45-4dce-849e-1f22ffc3c53e-online-tls podName:583c5cca-7e45-4dce-849e-1f22ffc3c53e nodeName:}" failed. No retries permitted until 2026-09-09 09:06:06.855396436 +0000 UTC m=+1627.553280319 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "online-tls" (UniqueName: "kubernetes.io/secret/583c5cca-7e45-4dce-849e-1f22ffc3c53e-online-tls") pod "feast-simple-feast-remote-setup-c5d49d8c6-57cgx" (UID: "583c5cca-7e45-4dce-849e-1f22ffc3c53e") : secret "feast-simple-feast-remote-setup-online-tls" not found Sep 09 09:06:06.355513 ip-10-0-137-144 kubenswrapper[2564]: I0909 09:06:06.355437 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/583c5cca-7e45-4dce-849e-1f22ffc3c53e-feast-data\") pod \"feast-simple-feast-remote-setup-c5d49d8c6-57cgx\" (UID: \"583c5cca-7e45-4dce-849e-1f22ffc3c53e\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-57cgx" Sep 09 09:06:06.355513 ip-10-0-137-144 kubenswrapper[2564]: I0909 09:06:06.355482 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/583c5cca-7e45-4dce-849e-1f22ffc3c53e-offline-tls\") pod \"feast-simple-feast-remote-setup-c5d49d8c6-57cgx\" (UID: \"583c5cca-7e45-4dce-849e-1f22ffc3c53e\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-57cgx" Sep 09 09:06:06.355513 ip-10-0-137-144 kubenswrapper[2564]: I0909 09:06:06.355504 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/583c5cca-7e45-4dce-849e-1f22ffc3c53e-ui-tls\") pod \"feast-simple-feast-remote-setup-c5d49d8c6-57cgx\" (UID: \"583c5cca-7e45-4dce-849e-1f22ffc3c53e\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-57cgx" Sep 09 09:06:06.355714 ip-10-0-137-144 kubenswrapper[2564]: E0909 09:06:06.355595 2564 secret.go:189] Couldn't get secret test-ns-remote-registry/feast-simple-feast-remote-setup-ui-tls: secret "feast-simple-feast-remote-setup-ui-tls" not found Sep 09 09:06:06.355714 ip-10-0-137-144 kubenswrapper[2564]: I0909 09:06:06.355638 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/configmap/583c5cca-7e45-4dce-849e-1f22ffc3c53e-registry-tls\") pod \"feast-simple-feast-remote-setup-c5d49d8c6-57cgx\" (UID: \"583c5cca-7e45-4dce-849e-1f22ffc3c53e\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-57cgx" Sep 09 09:06:06.355714 ip-10-0-137-144 kubenswrapper[2564]: E0909 09:06:06.355713 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/583c5cca-7e45-4dce-849e-1f22ffc3c53e-ui-tls podName:583c5cca-7e45-4dce-849e-1f22ffc3c53e nodeName:}" failed. No retries permitted until 2026-09-09 09:06:06.855696968 +0000 UTC m=+1627.553580846 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "ui-tls" (UniqueName: "kubernetes.io/secret/583c5cca-7e45-4dce-849e-1f22ffc3c53e-ui-tls") pod "feast-simple-feast-remote-setup-c5d49d8c6-57cgx" (UID: "583c5cca-7e45-4dce-849e-1f22ffc3c53e") : secret "feast-simple-feast-remote-setup-ui-tls" not found Sep 09 09:06:06.355935 ip-10-0-137-144 kubenswrapper[2564]: I0909 09:06:06.355917 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/583c5cca-7e45-4dce-849e-1f22ffc3c53e-feast-data\") pod \"feast-simple-feast-remote-setup-c5d49d8c6-57cgx\" (UID: \"583c5cca-7e45-4dce-849e-1f22ffc3c53e\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-57cgx" Sep 09 09:06:06.356268 ip-10-0-137-144 kubenswrapper[2564]: I0909 09:06:06.356245 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/configmap/583c5cca-7e45-4dce-849e-1f22ffc3c53e-registry-tls\") pod \"feast-simple-feast-remote-setup-c5d49d8c6-57cgx\" (UID: \"583c5cca-7e45-4dce-849e-1f22ffc3c53e\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-57cgx" Sep 09 09:06:06.357974 ip-10-0-137-144 kubenswrapper[2564]: I0909 09:06:06.357955 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/583c5cca-7e45-4dce-849e-1f22ffc3c53e-offline-tls\") pod \"feast-simple-feast-remote-setup-c5d49d8c6-57cgx\" (UID: \"583c5cca-7e45-4dce-849e-1f22ffc3c53e\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-57cgx" Sep 09 09:06:06.364018 ip-10-0-137-144 kubenswrapper[2564]: I0909 09:06:06.363997 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qkjjt\" (UniqueName: \"kubernetes.io/projected/583c5cca-7e45-4dce-849e-1f22ffc3c53e-kube-api-access-qkjjt\") pod \"feast-simple-feast-remote-setup-c5d49d8c6-57cgx\" (UID: \"583c5cca-7e45-4dce-849e-1f22ffc3c53e\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-57cgx" Sep 09 09:06:06.859425 ip-10-0-137-144 kubenswrapper[2564]: I0909 09:06:06.859376 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/583c5cca-7e45-4dce-849e-1f22ffc3c53e-online-tls\") pod \"feast-simple-feast-remote-setup-c5d49d8c6-57cgx\" (UID: \"583c5cca-7e45-4dce-849e-1f22ffc3c53e\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-57cgx" Sep 09 09:06:06.859617 ip-10-0-137-144 kubenswrapper[2564]: I0909 09:06:06.859444 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/583c5cca-7e45-4dce-849e-1f22ffc3c53e-ui-tls\") pod \"feast-simple-feast-remote-setup-c5d49d8c6-57cgx\" (UID: \"583c5cca-7e45-4dce-849e-1f22ffc3c53e\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-57cgx" Sep 09 09:06:06.861779 ip-10-0-137-144 kubenswrapper[2564]: I0909 09:06:06.861752 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/583c5cca-7e45-4dce-849e-1f22ffc3c53e-ui-tls\") pod \"feast-simple-feast-remote-setup-c5d49d8c6-57cgx\" (UID: \"583c5cca-7e45-4dce-849e-1f22ffc3c53e\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-57cgx" Sep 09 09:06:06.861924 ip-10-0-137-144 kubenswrapper[2564]: I0909 09:06:06.861895 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/583c5cca-7e45-4dce-849e-1f22ffc3c53e-online-tls\") pod \"feast-simple-feast-remote-setup-c5d49d8c6-57cgx\" (UID: \"583c5cca-7e45-4dce-849e-1f22ffc3c53e\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-57cgx" Sep 09 09:06:07.077051 ip-10-0-137-144 kubenswrapper[2564]: I0909 09:06:07.077011 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-57cgx" Sep 09 09:06:07.351203 ip-10-0-137-144 kubenswrapper[2564]: I0909 09:06:07.351178 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-57cgx"] Sep 09 09:06:07.353641 ip-10-0-137-144 kubenswrapper[2564]: W0909 09:06:07.353614 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod583c5cca_7e45_4dce_849e_1f22ffc3c53e.slice/crio-f25e397d701a46b5363a5de6031687d43058514e18302b67dab97f5ba983e3ec WatchSource:0}: Error finding container f25e397d701a46b5363a5de6031687d43058514e18302b67dab97f5ba983e3ec: Status 404 returned error can't find the container with id f25e397d701a46b5363a5de6031687d43058514e18302b67dab97f5ba983e3ec Sep 09 09:06:07.935276 ip-10-0-137-144 kubenswrapper[2564]: I0909 09:06:07.935239 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-57cgx" event={"ID":"583c5cca-7e45-4dce-849e-1f22ffc3c53e","Type":"ContainerStarted","Data":"71b1c58bbb43cba97068f077cf147579c8d92fd6b4b943a42219d795c0d0065d"} Sep 09 09:06:07.935462 ip-10-0-137-144 kubenswrapper[2564]: I0909 09:06:07.935284 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-57cgx" event={"ID":"583c5cca-7e45-4dce-849e-1f22ffc3c53e","Type":"ContainerStarted","Data":"f25e397d701a46b5363a5de6031687d43058514e18302b67dab97f5ba983e3ec"} Sep 09 09:06:12.956449 ip-10-0-137-144 kubenswrapper[2564]: I0909 09:06:12.956409 2564 generic.go:356] "Generic (PLEG): container finished" podID="583c5cca-7e45-4dce-849e-1f22ffc3c53e" containerID="71b1c58bbb43cba97068f077cf147579c8d92fd6b4b943a42219d795c0d0065d" exitCode=0 Sep 09 09:06:12.956838 ip-10-0-137-144 kubenswrapper[2564]: I0909 09:06:12.956482 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-57cgx" event={"ID":"583c5cca-7e45-4dce-849e-1f22ffc3c53e","Type":"ContainerDied","Data":"71b1c58bbb43cba97068f077cf147579c8d92fd6b4b943a42219d795c0d0065d"} Sep 09 09:06:13.963774 ip-10-0-137-144 kubenswrapper[2564]: I0909 09:06:13.963736 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-57cgx" event={"ID":"583c5cca-7e45-4dce-849e-1f22ffc3c53e","Type":"ContainerStarted","Data":"1042f24d76b717e4fbce1615038e1fa330d092b57818472181c10de0e9d42b96"} Sep 09 09:06:36.047602 ip-10-0-137-144 kubenswrapper[2564]: I0909 09:06:36.047568 2564 generic.go:356] "Generic (PLEG): container finished" podID="583c5cca-7e45-4dce-849e-1f22ffc3c53e" containerID="1042f24d76b717e4fbce1615038e1fa330d092b57818472181c10de0e9d42b96" exitCode=0 Sep 09 09:06:36.048036 ip-10-0-137-144 kubenswrapper[2564]: I0909 09:06:36.047646 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-57cgx" event={"ID":"583c5cca-7e45-4dce-849e-1f22ffc3c53e","Type":"ContainerDied","Data":"1042f24d76b717e4fbce1615038e1fa330d092b57818472181c10de0e9d42b96"} Sep 09 09:06:37.055835 ip-10-0-137-144 kubenswrapper[2564]: I0909 09:06:37.055801 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-57cgx" event={"ID":"583c5cca-7e45-4dce-849e-1f22ffc3c53e","Type":"ContainerStarted","Data":"b624c4847c30516c1ff58ac2192ddcfc9addad440ebeeffc27ba0571296fbff5"} Sep 09 09:06:37.056327 ip-10-0-137-144 kubenswrapper[2564]: I0909 09:06:37.055847 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-57cgx" event={"ID":"583c5cca-7e45-4dce-849e-1f22ffc3c53e","Type":"ContainerStarted","Data":"baed77adb6d1395402c92f466bd747c0af31ab0464fad61f100aac2fc2a5f39f"} Sep 09 09:06:37.056327 ip-10-0-137-144 kubenswrapper[2564]: I0909 09:06:37.055861 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-57cgx" event={"ID":"583c5cca-7e45-4dce-849e-1f22ffc3c53e","Type":"ContainerStarted","Data":"1115794e45c38e73518b588f50ecfbef6c108c87da34282528e8d6de8f1f7209"} Sep 09 09:06:37.077614 ip-10-0-137-144 kubenswrapper[2564]: I0909 09:06:37.077578 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-57cgx" Sep 09 09:06:37.077772 ip-10-0-137-144 kubenswrapper[2564]: I0909 09:06:37.077648 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-57cgx" Sep 09 09:06:37.077772 ip-10-0-137-144 kubenswrapper[2564]: I0909 09:06:37.077669 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-57cgx" Sep 09 09:06:37.077772 ip-10-0-137-144 kubenswrapper[2564]: I0909 09:06:37.077685 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-57cgx" Sep 09 09:06:37.077772 ip-10-0-137-144 kubenswrapper[2564]: I0909 09:06:37.077700 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-57cgx" Sep 09 09:06:37.077772 ip-10-0-137-144 kubenswrapper[2564]: I0909 09:06:37.077715 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-57cgx" Sep 09 09:06:37.079642 ip-10-0-137-144 kubenswrapper[2564]: I0909 09:06:37.079554 2564 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-57cgx" podUID="583c5cca-7e45-4dce-849e-1f22ffc3c53e" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.25:8443: connect: connection refused" Sep 09 09:06:37.079642 ip-10-0-137-144 kubenswrapper[2564]: I0909 09:06:37.079597 2564 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-57cgx" podUID="583c5cca-7e45-4dce-849e-1f22ffc3c53e" containerName="online" probeResult="failure" output="Get \"https://10.132.0.25:6567/health\": dial tcp 10.132.0.25:6567: connect: connection refused" Sep 09 09:06:37.079642 ip-10-0-137-144 kubenswrapper[2564]: I0909 09:06:37.079607 2564 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-57cgx" podUID="583c5cca-7e45-4dce-849e-1f22ffc3c53e" containerName="offline" probeResult="failure" output="dial tcp 10.132.0.25:8816: connect: connection refused" Sep 09 09:06:40.077412 ip-10-0-137-144 kubenswrapper[2564]: I0909 09:06:40.077364 2564 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-57cgx" podUID="583c5cca-7e45-4dce-849e-1f22ffc3c53e" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.25:8443: connect: connection refused" Sep 09 09:06:40.077887 ip-10-0-137-144 kubenswrapper[2564]: I0909 09:06:40.077371 2564 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-57cgx" podUID="583c5cca-7e45-4dce-849e-1f22ffc3c53e" containerName="offline" probeResult="failure" output="dial tcp 10.132.0.25:8816: connect: connection refused" Sep 09 09:06:40.077887 ip-10-0-137-144 kubenswrapper[2564]: I0909 09:06:40.077379 2564 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-57cgx" podUID="583c5cca-7e45-4dce-849e-1f22ffc3c53e" containerName="online" probeResult="failure" output="Get \"https://10.132.0.25:6567/health\": dial tcp 10.132.0.25:6567: connect: connection refused" Sep 09 09:06:43.077620 ip-10-0-137-144 kubenswrapper[2564]: I0909 09:06:43.077571 2564 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-57cgx" podUID="583c5cca-7e45-4dce-849e-1f22ffc3c53e" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.25:8443: connect: connection refused" Sep 09 09:06:43.078082 ip-10-0-137-144 kubenswrapper[2564]: I0909 09:06:43.077582 2564 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-57cgx" podUID="583c5cca-7e45-4dce-849e-1f22ffc3c53e" containerName="online" probeResult="failure" output="Get \"https://10.132.0.25:6567/health\": dial tcp 10.132.0.25:6567: connect: connection refused" Sep 09 09:06:43.078082 ip-10-0-137-144 kubenswrapper[2564]: I0909 09:06:43.077581 2564 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-57cgx" podUID="583c5cca-7e45-4dce-849e-1f22ffc3c53e" containerName="offline" probeResult="failure" output="dial tcp 10.132.0.25:8816: connect: connection refused" Sep 09 09:06:46.078242 ip-10-0-137-144 kubenswrapper[2564]: I0909 09:06:46.078211 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-57cgx" Sep 09 09:06:46.078642 ip-10-0-137-144 kubenswrapper[2564]: I0909 09:06:46.078389 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-57cgx" Sep 09 09:06:46.079033 ip-10-0-137-144 kubenswrapper[2564]: I0909 09:06:46.079011 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-57cgx" Sep 09 09:06:46.079259 ip-10-0-137-144 kubenswrapper[2564]: I0909 09:06:46.079241 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-57cgx" Sep 09 09:06:46.104953 ip-10-0-137-144 kubenswrapper[2564]: I0909 09:06:46.104901 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-57cgx" podStartSLOduration=40.104883763 podStartE2EDuration="40.104883763s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 09:06:06 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 09:06:37.117367325 +0000 UTC m=+1657.815251227" watchObservedRunningTime="2026-09-09 09:06:46.104883763 +0000 UTC m=+1666.802767660" Sep 09 09:06:47.081471 ip-10-0-137-144 kubenswrapper[2564]: I0909 09:06:47.081430 2564 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-57cgx" podUID="583c5cca-7e45-4dce-849e-1f22ffc3c53e" containerName="online" probeResult="failure" output="Get \"https://10.132.0.25:6567/health\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Sep 09 09:06:49.822997 ip-10-0-137-144 kubenswrapper[2564]: I0909 09:06:49.822966 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-57cgx" Sep 09 09:06:50.527631 ip-10-0-137-144 kubenswrapper[2564]: I0909 09:06:50.527600 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-57cgx" Sep 09 09:07:48.081542 ip-10-0-137-144 kubenswrapper[2564]: I0909 09:07:48.081440 2564 prober.go:120] "Probe failed" probeType="Liveness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-57cgx" podUID="583c5cca-7e45-4dce-849e-1f22ffc3c53e" containerName="online" probeResult="failure" output="Get \"https://10.132.0.25:6567/health\": net/http: request canceled (Client.Timeout exceeded while awaiting headers)" Sep 09 09:07:52.324276 ip-10-0-137-144 kubenswrapper[2564]: I0909 09:07:52.324243 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-57cgx"] Sep 09 09:07:52.324810 ip-10-0-137-144 kubenswrapper[2564]: I0909 09:07:52.324468 2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-57cgx" podUID="583c5cca-7e45-4dce-849e-1f22ffc3c53e" containerName="online" containerID="cri-o://1115794e45c38e73518b588f50ecfbef6c108c87da34282528e8d6de8f1f7209" gracePeriod=30 Sep 09 09:07:52.324810 ip-10-0-137-144 kubenswrapper[2564]: I0909 09:07:52.324552 2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-57cgx" podUID="583c5cca-7e45-4dce-849e-1f22ffc3c53e" containerName="offline" containerID="cri-o://baed77adb6d1395402c92f466bd747c0af31ab0464fad61f100aac2fc2a5f39f" gracePeriod=30 Sep 09 09:07:52.324810 ip-10-0-137-144 kubenswrapper[2564]: I0909 09:07:52.324617 2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-57cgx" podUID="583c5cca-7e45-4dce-849e-1f22ffc3c53e" containerName="ui" containerID="cri-o://b624c4847c30516c1ff58ac2192ddcfc9addad440ebeeffc27ba0571296fbff5" gracePeriod=30 Sep 09 09:07:52.523848 ip-10-0-137-144 kubenswrapper[2564]: I0909 09:07:52.523812 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-57576b8fcf-td44r"] Sep 09 09:07:52.524199 ip-10-0-137-144 kubenswrapper[2564]: I0909 09:07:52.524121 2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-td44r" podUID="d7a2cfa0-04ea-4dec-8fa9-bbb5562f4eed" containerName="registry" containerID="cri-o://2d9c6743777ca046ecfaaa618aa4f078a0f1798ea9d1631044482ec0347c8692" gracePeriod=30 Sep 09 09:07:52.524199 ip-10-0-137-144 kubenswrapper[2564]: I0909 09:07:52.524171 2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-td44r" podUID="d7a2cfa0-04ea-4dec-8fa9-bbb5562f4eed" containerName="ui" containerID="cri-o://bf6691b0d8449545b0e4769d9af25a137105120f4cfb022465fb8477929c3849" gracePeriod=30 Sep 09 09:07:52.524403 ip-10-0-137-144 kubenswrapper[2564]: I0909 09:07:52.524178 2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-td44r" podUID="d7a2cfa0-04ea-4dec-8fa9-bbb5562f4eed" containerName="online" containerID="cri-o://73c730b525a70427f0910a8b26086c45f3a92e3830910f83be375d068b60779d" gracePeriod=30 Sep 09 09:07:52.524473 ip-10-0-137-144 kubenswrapper[2564]: I0909 09:07:52.524195 2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-td44r" podUID="d7a2cfa0-04ea-4dec-8fa9-bbb5562f4eed" containerName="offline" containerID="cri-o://c9153b9b939424ebf3013b87448334d25e5b14708eb2db334499a89165537241" gracePeriod=30 Sep 09 09:07:53.345770 ip-10-0-137-144 kubenswrapper[2564]: I0909 09:07:53.345741 2564 generic.go:356] "Generic (PLEG): container finished" podID="d7a2cfa0-04ea-4dec-8fa9-bbb5562f4eed" containerID="bf6691b0d8449545b0e4769d9af25a137105120f4cfb022465fb8477929c3849" exitCode=0 Sep 09 09:07:53.345770 ip-10-0-137-144 kubenswrapper[2564]: I0909 09:07:53.345765 2564 generic.go:356] "Generic (PLEG): container finished" podID="d7a2cfa0-04ea-4dec-8fa9-bbb5562f4eed" containerID="73c730b525a70427f0910a8b26086c45f3a92e3830910f83be375d068b60779d" exitCode=0 Sep 09 09:07:53.346116 ip-10-0-137-144 kubenswrapper[2564]: I0909 09:07:53.345808 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-td44r" event={"ID":"d7a2cfa0-04ea-4dec-8fa9-bbb5562f4eed","Type":"ContainerDied","Data":"bf6691b0d8449545b0e4769d9af25a137105120f4cfb022465fb8477929c3849"} Sep 09 09:07:53.346116 ip-10-0-137-144 kubenswrapper[2564]: I0909 09:07:53.345851 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-td44r" event={"ID":"d7a2cfa0-04ea-4dec-8fa9-bbb5562f4eed","Type":"ContainerDied","Data":"73c730b525a70427f0910a8b26086c45f3a92e3830910f83be375d068b60779d"} Sep 09 09:07:53.348392 ip-10-0-137-144 kubenswrapper[2564]: I0909 09:07:53.348370 2564 generic.go:356] "Generic (PLEG): container finished" podID="583c5cca-7e45-4dce-849e-1f22ffc3c53e" containerID="b624c4847c30516c1ff58ac2192ddcfc9addad440ebeeffc27ba0571296fbff5" exitCode=0 Sep 09 09:07:53.348392 ip-10-0-137-144 kubenswrapper[2564]: I0909 09:07:53.348391 2564 generic.go:356] "Generic (PLEG): container finished" podID="583c5cca-7e45-4dce-849e-1f22ffc3c53e" containerID="1115794e45c38e73518b588f50ecfbef6c108c87da34282528e8d6de8f1f7209" exitCode=0 Sep 09 09:07:53.348481 ip-10-0-137-144 kubenswrapper[2564]: I0909 09:07:53.348426 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-57cgx" event={"ID":"583c5cca-7e45-4dce-849e-1f22ffc3c53e","Type":"ContainerDied","Data":"b624c4847c30516c1ff58ac2192ddcfc9addad440ebeeffc27ba0571296fbff5"} Sep 09 09:07:53.348481 ip-10-0-137-144 kubenswrapper[2564]: I0909 09:07:53.348449 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-57cgx" event={"ID":"583c5cca-7e45-4dce-849e-1f22ffc3c53e","Type":"ContainerDied","Data":"1115794e45c38e73518b588f50ecfbef6c108c87da34282528e8d6de8f1f7209"} Sep 09 09:07:53.690274 ip-10-0-137-144 kubenswrapper[2564]: I0909 09:07:53.690205 2564 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-td44r" podUID="d7a2cfa0-04ea-4dec-8fa9-bbb5562f4eed" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.24:8443: connect: connection refused" Sep 09 09:07:53.690500 ip-10-0-137-144 kubenswrapper[2564]: I0909 09:07:53.690211 2564 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-td44r" podUID="d7a2cfa0-04ea-4dec-8fa9-bbb5562f4eed" containerName="online" probeResult="failure" output="Get \"https://10.132.0.24:6567/health\": dial tcp 10.132.0.24:6567: connect: connection refused" Sep 09 09:07:56.078985 ip-10-0-137-144 kubenswrapper[2564]: I0909 09:07:56.078938 2564 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-57cgx" podUID="583c5cca-7e45-4dce-849e-1f22ffc3c53e" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.25:8443: connect: connection refused" Sep 09 09:07:59.823557 ip-10-0-137-144 kubenswrapper[2564]: I0909 09:07:59.823515 2564 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-57cgx" podUID="583c5cca-7e45-4dce-849e-1f22ffc3c53e" containerName="online" probeResult="failure" output="Get \"https://10.132.0.25:6567/health\": dial tcp 10.132.0.25:6567: connect: connection refused" Sep 09 09:08:03.689787 ip-10-0-137-144 kubenswrapper[2564]: I0909 09:08:03.689739 2564 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-td44r" podUID="d7a2cfa0-04ea-4dec-8fa9-bbb5562f4eed" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.24:8443: connect: connection refused" Sep 09 09:08:03.690185 ip-10-0-137-144 kubenswrapper[2564]: I0909 09:08:03.689747 2564 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-td44r" podUID="d7a2cfa0-04ea-4dec-8fa9-bbb5562f4eed" containerName="online" probeResult="failure" output="Get \"https://10.132.0.24:6567/health\": dial tcp 10.132.0.24:6567: connect: connection refused" Sep 09 09:08:06.079359 ip-10-0-137-144 kubenswrapper[2564]: I0909 09:08:06.079306 2564 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-57cgx" podUID="583c5cca-7e45-4dce-849e-1f22ffc3c53e" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.25:8443: connect: connection refused" Sep 09 09:08:09.823752 ip-10-0-137-144 kubenswrapper[2564]: I0909 09:08:09.823706 2564 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-57cgx" podUID="583c5cca-7e45-4dce-849e-1f22ffc3c53e" containerName="online" probeResult="failure" output="Get \"https://10.132.0.25:6567/health\": dial tcp 10.132.0.25:6567: connect: connection refused" Sep 09 09:08:13.689375 ip-10-0-137-144 kubenswrapper[2564]: I0909 09:08:13.689301 2564 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-td44r" podUID="d7a2cfa0-04ea-4dec-8fa9-bbb5562f4eed" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.24:8443: connect: connection refused" Sep 09 09:08:13.689867 ip-10-0-137-144 kubenswrapper[2564]: I0909 09:08:13.689331 2564 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-td44r" podUID="d7a2cfa0-04ea-4dec-8fa9-bbb5562f4eed" containerName="online" probeResult="failure" output="Get \"https://10.132.0.24:6567/health\": dial tcp 10.132.0.24:6567: connect: connection refused" Sep 09 09:08:13.689867 ip-10-0-137-144 kubenswrapper[2564]: I0909 09:08:13.689634 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-td44r" Sep 09 09:08:13.689867 ip-10-0-137-144 kubenswrapper[2564]: I0909 09:08:13.689735 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-td44r" Sep 09 09:08:16.079211 ip-10-0-137-144 kubenswrapper[2564]: I0909 09:08:16.079166 2564 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-57cgx" podUID="583c5cca-7e45-4dce-849e-1f22ffc3c53e" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.25:8443: connect: connection refused" Sep 09 09:08:16.079652 ip-10-0-137-144 kubenswrapper[2564]: I0909 09:08:16.079281 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-57cgx" Sep 09 09:08:19.823664 ip-10-0-137-144 kubenswrapper[2564]: I0909 09:08:19.823620 2564 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-57cgx" podUID="583c5cca-7e45-4dce-849e-1f22ffc3c53e" containerName="online" probeResult="failure" output="Get \"https://10.132.0.25:6567/health\": dial tcp 10.132.0.25:6567: connect: connection refused" Sep 09 09:08:19.824178 ip-10-0-137-144 kubenswrapper[2564]: I0909 09:08:19.823759 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-57cgx" Sep 09 09:08:22.462838 ip-10-0-137-144 kubenswrapper[2564]: I0909 09:08:22.462797 2564 generic.go:356] "Generic (PLEG): container finished" podID="583c5cca-7e45-4dce-849e-1f22ffc3c53e" containerID="baed77adb6d1395402c92f466bd747c0af31ab0464fad61f100aac2fc2a5f39f" exitCode=137 Sep 09 09:08:22.463201 ip-10-0-137-144 kubenswrapper[2564]: I0909 09:08:22.462871 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-57cgx" event={"ID":"583c5cca-7e45-4dce-849e-1f22ffc3c53e","Type":"ContainerDied","Data":"baed77adb6d1395402c92f466bd747c0af31ab0464fad61f100aac2fc2a5f39f"} Sep 09 09:08:22.970206 ip-10-0-137-144 kubenswrapper[2564]: I0909 09:08:22.970185 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-57cgx" Sep 09 09:08:23.105899 ip-10-0-137-144 kubenswrapper[2564]: I0909 09:08:23.105871 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/583c5cca-7e45-4dce-849e-1f22ffc3c53e-online-tls\") pod \"583c5cca-7e45-4dce-849e-1f22ffc3c53e\" (UID: \"583c5cca-7e45-4dce-849e-1f22ffc3c53e\") " Sep 09 09:08:23.106048 ip-10-0-137-144 kubenswrapper[2564]: I0909 09:08:23.105906 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/583c5cca-7e45-4dce-849e-1f22ffc3c53e-offline-tls\") pod \"583c5cca-7e45-4dce-849e-1f22ffc3c53e\" (UID: \"583c5cca-7e45-4dce-849e-1f22ffc3c53e\") " Sep 09 09:08:23.106048 ip-10-0-137-144 kubenswrapper[2564]: I0909 09:08:23.105964 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qkjjt\" (UniqueName: \"kubernetes.io/projected/583c5cca-7e45-4dce-849e-1f22ffc3c53e-kube-api-access-qkjjt\") pod \"583c5cca-7e45-4dce-849e-1f22ffc3c53e\" (UID: \"583c5cca-7e45-4dce-849e-1f22ffc3c53e\") " Sep 09 09:08:23.106048 ip-10-0-137-144 kubenswrapper[2564]: I0909 09:08:23.105987 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/configmap/583c5cca-7e45-4dce-849e-1f22ffc3c53e-registry-tls\") pod \"583c5cca-7e45-4dce-849e-1f22ffc3c53e\" (UID: \"583c5cca-7e45-4dce-849e-1f22ffc3c53e\") " Sep 09 09:08:23.106048 ip-10-0-137-144 kubenswrapper[2564]: I0909 09:08:23.106025 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/583c5cca-7e45-4dce-849e-1f22ffc3c53e-feast-data\") pod \"583c5cca-7e45-4dce-849e-1f22ffc3c53e\" (UID: \"583c5cca-7e45-4dce-849e-1f22ffc3c53e\") " Sep 09 09:08:23.106248 ip-10-0-137-144 kubenswrapper[2564]: I0909 09:08:23.106054 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/583c5cca-7e45-4dce-849e-1f22ffc3c53e-ui-tls\") pod \"583c5cca-7e45-4dce-849e-1f22ffc3c53e\" (UID: \"583c5cca-7e45-4dce-849e-1f22ffc3c53e\") " Sep 09 09:08:23.109359 ip-10-0-137-144 kubenswrapper[2564]: I0909 09:08:23.106439 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/583c5cca-7e45-4dce-849e-1f22ffc3c53e-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "583c5cca-7e45-4dce-849e-1f22ffc3c53e" (UID: "583c5cca-7e45-4dce-849e-1f22ffc3c53e"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 09 09:08:23.109359 ip-10-0-137-144 kubenswrapper[2564]: I0909 09:08:23.106784 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/583c5cca-7e45-4dce-849e-1f22ffc3c53e-feast-data" (OuterVolumeSpecName: "feast-data") pod "583c5cca-7e45-4dce-849e-1f22ffc3c53e" (UID: "583c5cca-7e45-4dce-849e-1f22ffc3c53e"). InnerVolumeSpecName "feast-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 09 09:08:23.109359 ip-10-0-137-144 kubenswrapper[2564]: I0909 09:08:23.108834 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/583c5cca-7e45-4dce-849e-1f22ffc3c53e-online-tls" (OuterVolumeSpecName: "online-tls") pod "583c5cca-7e45-4dce-849e-1f22ffc3c53e" (UID: "583c5cca-7e45-4dce-849e-1f22ffc3c53e"). InnerVolumeSpecName "online-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 09 09:08:23.109740 ip-10-0-137-144 kubenswrapper[2564]: I0909 09:08:23.109671 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/583c5cca-7e45-4dce-849e-1f22ffc3c53e-offline-tls" (OuterVolumeSpecName: "offline-tls") pod "583c5cca-7e45-4dce-849e-1f22ffc3c53e" (UID: "583c5cca-7e45-4dce-849e-1f22ffc3c53e"). InnerVolumeSpecName "offline-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 09 09:08:23.110070 ip-10-0-137-144 kubenswrapper[2564]: I0909 09:08:23.110036 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/583c5cca-7e45-4dce-849e-1f22ffc3c53e-kube-api-access-qkjjt" (OuterVolumeSpecName: "kube-api-access-qkjjt") pod "583c5cca-7e45-4dce-849e-1f22ffc3c53e" (UID: "583c5cca-7e45-4dce-849e-1f22ffc3c53e"). InnerVolumeSpecName "kube-api-access-qkjjt". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 09 09:08:23.110070 ip-10-0-137-144 kubenswrapper[2564]: I0909 09:08:23.110084 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/583c5cca-7e45-4dce-849e-1f22ffc3c53e-ui-tls" (OuterVolumeSpecName: "ui-tls") pod "583c5cca-7e45-4dce-849e-1f22ffc3c53e" (UID: "583c5cca-7e45-4dce-849e-1f22ffc3c53e"). InnerVolumeSpecName "ui-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 09 09:08:23.161779 ip-10-0-137-144 kubenswrapper[2564]: I0909 09:08:23.161755 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-td44r" Sep 09 09:08:23.206966 ip-10-0-137-144 kubenswrapper[2564]: I0909 09:08:23.206933 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/d7a2cfa0-04ea-4dec-8fa9-bbb5562f4eed-ui-tls\") pod \"d7a2cfa0-04ea-4dec-8fa9-bbb5562f4eed\" (UID: \"d7a2cfa0-04ea-4dec-8fa9-bbb5562f4eed\") " Sep 09 09:08:23.207111 ip-10-0-137-144 kubenswrapper[2564]: I0909 09:08:23.207014 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/d7a2cfa0-04ea-4dec-8fa9-bbb5562f4eed-registry-tls\") pod \"d7a2cfa0-04ea-4dec-8fa9-bbb5562f4eed\" (UID: \"d7a2cfa0-04ea-4dec-8fa9-bbb5562f4eed\") " Sep 09 09:08:23.207111 ip-10-0-137-144 kubenswrapper[2564]: I0909 09:08:23.207067 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/d7a2cfa0-04ea-4dec-8fa9-bbb5562f4eed-online-tls\") pod \"d7a2cfa0-04ea-4dec-8fa9-bbb5562f4eed\" (UID: \"d7a2cfa0-04ea-4dec-8fa9-bbb5562f4eed\") " Sep 09 09:08:23.207111 ip-10-0-137-144 kubenswrapper[2564]: I0909 09:08:23.207108 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/d7a2cfa0-04ea-4dec-8fa9-bbb5562f4eed-feast-data\") pod \"d7a2cfa0-04ea-4dec-8fa9-bbb5562f4eed\" (UID: \"d7a2cfa0-04ea-4dec-8fa9-bbb5562f4eed\") " Sep 09 09:08:23.207279 ip-10-0-137-144 kubenswrapper[2564]: I0909 09:08:23.207134 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-s8m87\" (UniqueName: \"kubernetes.io/projected/d7a2cfa0-04ea-4dec-8fa9-bbb5562f4eed-kube-api-access-s8m87\") pod \"d7a2cfa0-04ea-4dec-8fa9-bbb5562f4eed\" (UID: \"d7a2cfa0-04ea-4dec-8fa9-bbb5562f4eed\") " Sep 09 09:08:23.207411 ip-10-0-137-144 kubenswrapper[2564]: I0909 09:08:23.207385 2564 reconciler_common.go:299] "Volume detached for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/583c5cca-7e45-4dce-849e-1f22ffc3c53e-online-tls\") on node \"ip-10-0-137-144.ec2.internal\" DevicePath \"\"" Sep 09 09:08:23.207411 ip-10-0-137-144 kubenswrapper[2564]: I0909 09:08:23.207407 2564 reconciler_common.go:299] "Volume detached for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/583c5cca-7e45-4dce-849e-1f22ffc3c53e-offline-tls\") on node \"ip-10-0-137-144.ec2.internal\" DevicePath \"\"" Sep 09 09:08:23.207548 ip-10-0-137-144 kubenswrapper[2564]: I0909 09:08:23.207419 2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qkjjt\" (UniqueName: \"kubernetes.io/projected/583c5cca-7e45-4dce-849e-1f22ffc3c53e-kube-api-access-qkjjt\") on node \"ip-10-0-137-144.ec2.internal\" DevicePath \"\"" Sep 09 09:08:23.207548 ip-10-0-137-144 kubenswrapper[2564]: I0909 09:08:23.207432 2564 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/configmap/583c5cca-7e45-4dce-849e-1f22ffc3c53e-registry-tls\") on node \"ip-10-0-137-144.ec2.internal\" DevicePath \"\"" Sep 09 09:08:23.207548 ip-10-0-137-144 kubenswrapper[2564]: I0909 09:08:23.207446 2564 reconciler_common.go:299] "Volume detached for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/583c5cca-7e45-4dce-849e-1f22ffc3c53e-feast-data\") on node \"ip-10-0-137-144.ec2.internal\" DevicePath \"\"" Sep 09 09:08:23.207548 ip-10-0-137-144 kubenswrapper[2564]: I0909 09:08:23.207456 2564 reconciler_common.go:299] "Volume detached for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/583c5cca-7e45-4dce-849e-1f22ffc3c53e-ui-tls\") on node \"ip-10-0-137-144.ec2.internal\" DevicePath \"\"" Sep 09 09:08:23.207738 ip-10-0-137-144 kubenswrapper[2564]: I0909 09:08:23.207629 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d7a2cfa0-04ea-4dec-8fa9-bbb5562f4eed-feast-data" (OuterVolumeSpecName: "feast-data") pod "d7a2cfa0-04ea-4dec-8fa9-bbb5562f4eed" (UID: "d7a2cfa0-04ea-4dec-8fa9-bbb5562f4eed"). InnerVolumeSpecName "feast-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 09 09:08:23.209208 ip-10-0-137-144 kubenswrapper[2564]: I0909 09:08:23.209186 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d7a2cfa0-04ea-4dec-8fa9-bbb5562f4eed-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "d7a2cfa0-04ea-4dec-8fa9-bbb5562f4eed" (UID: "d7a2cfa0-04ea-4dec-8fa9-bbb5562f4eed"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 09 09:08:23.209420 ip-10-0-137-144 kubenswrapper[2564]: I0909 09:08:23.209402 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d7a2cfa0-04ea-4dec-8fa9-bbb5562f4eed-ui-tls" (OuterVolumeSpecName: "ui-tls") pod "d7a2cfa0-04ea-4dec-8fa9-bbb5562f4eed" (UID: "d7a2cfa0-04ea-4dec-8fa9-bbb5562f4eed"). InnerVolumeSpecName "ui-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 09 09:08:23.209638 ip-10-0-137-144 kubenswrapper[2564]: I0909 09:08:23.209616 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d7a2cfa0-04ea-4dec-8fa9-bbb5562f4eed-kube-api-access-s8m87" (OuterVolumeSpecName: "kube-api-access-s8m87") pod "d7a2cfa0-04ea-4dec-8fa9-bbb5562f4eed" (UID: "d7a2cfa0-04ea-4dec-8fa9-bbb5562f4eed"). InnerVolumeSpecName "kube-api-access-s8m87". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 09 09:08:23.209638 ip-10-0-137-144 kubenswrapper[2564]: I0909 09:08:23.209626 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d7a2cfa0-04ea-4dec-8fa9-bbb5562f4eed-online-tls" (OuterVolumeSpecName: "online-tls") pod "d7a2cfa0-04ea-4dec-8fa9-bbb5562f4eed" (UID: "d7a2cfa0-04ea-4dec-8fa9-bbb5562f4eed"). InnerVolumeSpecName "online-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 09 09:08:23.308051 ip-10-0-137-144 kubenswrapper[2564]: I0909 09:08:23.308012 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/d7a2cfa0-04ea-4dec-8fa9-bbb5562f4eed-offline-tls\") pod \"d7a2cfa0-04ea-4dec-8fa9-bbb5562f4eed\" (UID: \"d7a2cfa0-04ea-4dec-8fa9-bbb5562f4eed\") " Sep 09 09:08:23.308210 ip-10-0-137-144 kubenswrapper[2564]: I0909 09:08:23.308196 2564 reconciler_common.go:299] "Volume detached for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/d7a2cfa0-04ea-4dec-8fa9-bbb5562f4eed-feast-data\") on node \"ip-10-0-137-144.ec2.internal\" DevicePath \"\"" Sep 09 09:08:23.308281 ip-10-0-137-144 kubenswrapper[2564]: I0909 09:08:23.308218 2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-s8m87\" (UniqueName: \"kubernetes.io/projected/d7a2cfa0-04ea-4dec-8fa9-bbb5562f4eed-kube-api-access-s8m87\") on node \"ip-10-0-137-144.ec2.internal\" DevicePath \"\"" Sep 09 09:08:23.308281 ip-10-0-137-144 kubenswrapper[2564]: I0909 09:08:23.308231 2564 reconciler_common.go:299] "Volume detached for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/d7a2cfa0-04ea-4dec-8fa9-bbb5562f4eed-ui-tls\") on node \"ip-10-0-137-144.ec2.internal\" DevicePath \"\"" Sep 09 09:08:23.308281 ip-10-0-137-144 kubenswrapper[2564]: I0909 09:08:23.308243 2564 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/d7a2cfa0-04ea-4dec-8fa9-bbb5562f4eed-registry-tls\") on node \"ip-10-0-137-144.ec2.internal\" DevicePath \"\"" Sep 09 09:08:23.308281 ip-10-0-137-144 kubenswrapper[2564]: I0909 09:08:23.308256 2564 reconciler_common.go:299] "Volume detached for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/d7a2cfa0-04ea-4dec-8fa9-bbb5562f4eed-online-tls\") on node \"ip-10-0-137-144.ec2.internal\" DevicePath \"\"" Sep 09 09:08:23.309943 ip-10-0-137-144 kubenswrapper[2564]: I0909 09:08:23.309915 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d7a2cfa0-04ea-4dec-8fa9-bbb5562f4eed-offline-tls" (OuterVolumeSpecName: "offline-tls") pod "d7a2cfa0-04ea-4dec-8fa9-bbb5562f4eed" (UID: "d7a2cfa0-04ea-4dec-8fa9-bbb5562f4eed"). InnerVolumeSpecName "offline-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 09 09:08:23.408615 ip-10-0-137-144 kubenswrapper[2564]: I0909 09:08:23.408519 2564 reconciler_common.go:299] "Volume detached for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/d7a2cfa0-04ea-4dec-8fa9-bbb5562f4eed-offline-tls\") on node \"ip-10-0-137-144.ec2.internal\" DevicePath \"\"" Sep 09 09:08:23.469827 ip-10-0-137-144 kubenswrapper[2564]: I0909 09:08:23.469793 2564 generic.go:356] "Generic (PLEG): container finished" podID="d7a2cfa0-04ea-4dec-8fa9-bbb5562f4eed" containerID="c9153b9b939424ebf3013b87448334d25e5b14708eb2db334499a89165537241" exitCode=137 Sep 09 09:08:23.469827 ip-10-0-137-144 kubenswrapper[2564]: I0909 09:08:23.469819 2564 generic.go:356] "Generic (PLEG): container finished" podID="d7a2cfa0-04ea-4dec-8fa9-bbb5562f4eed" containerID="2d9c6743777ca046ecfaaa618aa4f078a0f1798ea9d1631044482ec0347c8692" exitCode=137 Sep 09 09:08:23.470251 ip-10-0-137-144 kubenswrapper[2564]: I0909 09:08:23.469868 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-td44r" Sep 09 09:08:23.470251 ip-10-0-137-144 kubenswrapper[2564]: I0909 09:08:23.469877 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-td44r" event={"ID":"d7a2cfa0-04ea-4dec-8fa9-bbb5562f4eed","Type":"ContainerDied","Data":"c9153b9b939424ebf3013b87448334d25e5b14708eb2db334499a89165537241"} Sep 09 09:08:23.470251 ip-10-0-137-144 kubenswrapper[2564]: I0909 09:08:23.469929 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-td44r" event={"ID":"d7a2cfa0-04ea-4dec-8fa9-bbb5562f4eed","Type":"ContainerDied","Data":"2d9c6743777ca046ecfaaa618aa4f078a0f1798ea9d1631044482ec0347c8692"} Sep 09 09:08:23.470251 ip-10-0-137-144 kubenswrapper[2564]: I0909 09:08:23.469942 2564 scope.go:117] "RemoveContainer" containerID="bf6691b0d8449545b0e4769d9af25a137105120f4cfb022465fb8477929c3849" Sep 09 09:08:23.470251 ip-10-0-137-144 kubenswrapper[2564]: I0909 09:08:23.469954 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-td44r" event={"ID":"d7a2cfa0-04ea-4dec-8fa9-bbb5562f4eed","Type":"ContainerDied","Data":"ec0468ea0e1f5e1caacb4e0d4e0b5775413efea3a18803e730ca459362402d34"} Sep 09 09:08:23.472770 ip-10-0-137-144 kubenswrapper[2564]: I0909 09:08:23.472745 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-57cgx" event={"ID":"583c5cca-7e45-4dce-849e-1f22ffc3c53e","Type":"ContainerDied","Data":"f25e397d701a46b5363a5de6031687d43058514e18302b67dab97f5ba983e3ec"} Sep 09 09:08:23.472770 ip-10-0-137-144 kubenswrapper[2564]: I0909 09:08:23.472767 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-57cgx" Sep 09 09:08:23.480825 ip-10-0-137-144 kubenswrapper[2564]: I0909 09:08:23.480805 2564 scope.go:117] "RemoveContainer" containerID="c9153b9b939424ebf3013b87448334d25e5b14708eb2db334499a89165537241" Sep 09 09:08:23.488695 ip-10-0-137-144 kubenswrapper[2564]: I0909 09:08:23.488676 2564 scope.go:117] "RemoveContainer" containerID="73c730b525a70427f0910a8b26086c45f3a92e3830910f83be375d068b60779d" Sep 09 09:08:23.494809 ip-10-0-137-144 kubenswrapper[2564]: I0909 09:08:23.494789 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-57576b8fcf-td44r"] Sep 09 09:08:23.495938 ip-10-0-137-144 kubenswrapper[2564]: I0909 09:08:23.495923 2564 scope.go:117] "RemoveContainer" containerID="2d9c6743777ca046ecfaaa618aa4f078a0f1798ea9d1631044482ec0347c8692" Sep 09 09:08:23.499312 ip-10-0-137-144 kubenswrapper[2564]: I0909 09:08:23.499291 2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-57576b8fcf-td44r"] Sep 09 09:08:23.504145 ip-10-0-137-144 kubenswrapper[2564]: I0909 09:08:23.504126 2564 scope.go:117] "RemoveContainer" containerID="f405e89834e659804f44959035833796cc19ed02873cc26836d9d72afe97ee79" Sep 09 09:08:23.510820 ip-10-0-137-144 kubenswrapper[2564]: I0909 09:08:23.510800 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-57cgx"] Sep 09 09:08:23.511647 ip-10-0-137-144 kubenswrapper[2564]: I0909 09:08:23.511633 2564 scope.go:117] "RemoveContainer" containerID="ad3f3ddf6cd19d942539bc666fb7970f9eb21113694102c86bc572a2f3dc54c9" Sep 09 09:08:23.514406 ip-10-0-137-144 kubenswrapper[2564]: I0909 09:08:23.514387 2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-57cgx"] Sep 09 09:08:23.518585 ip-10-0-137-144 kubenswrapper[2564]: I0909 09:08:23.518570 2564 scope.go:117] "RemoveContainer" containerID="bf6691b0d8449545b0e4769d9af25a137105120f4cfb022465fb8477929c3849" Sep 09 09:08:23.518851 ip-10-0-137-144 kubenswrapper[2564]: E0909 09:08:23.518824 2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bf6691b0d8449545b0e4769d9af25a137105120f4cfb022465fb8477929c3849\": container with ID starting with bf6691b0d8449545b0e4769d9af25a137105120f4cfb022465fb8477929c3849 not found: ID does not exist" containerID="bf6691b0d8449545b0e4769d9af25a137105120f4cfb022465fb8477929c3849" Sep 09 09:08:23.518893 ip-10-0-137-144 kubenswrapper[2564]: I0909 09:08:23.518857 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bf6691b0d8449545b0e4769d9af25a137105120f4cfb022465fb8477929c3849"} err="failed to get container status \"bf6691b0d8449545b0e4769d9af25a137105120f4cfb022465fb8477929c3849\": rpc error: code = NotFound desc = could not find container \"bf6691b0d8449545b0e4769d9af25a137105120f4cfb022465fb8477929c3849\": container with ID starting with bf6691b0d8449545b0e4769d9af25a137105120f4cfb022465fb8477929c3849 not found: ID does not exist" Sep 09 09:08:23.518893 ip-10-0-137-144 kubenswrapper[2564]: I0909 09:08:23.518874 2564 scope.go:117] "RemoveContainer" containerID="c9153b9b939424ebf3013b87448334d25e5b14708eb2db334499a89165537241" Sep 09 09:08:23.519131 ip-10-0-137-144 kubenswrapper[2564]: E0909 09:08:23.519111 2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c9153b9b939424ebf3013b87448334d25e5b14708eb2db334499a89165537241\": container with ID starting with c9153b9b939424ebf3013b87448334d25e5b14708eb2db334499a89165537241 not found: ID does not exist" containerID="c9153b9b939424ebf3013b87448334d25e5b14708eb2db334499a89165537241" Sep 09 09:08:23.519205 ip-10-0-137-144 kubenswrapper[2564]: I0909 09:08:23.519141 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c9153b9b939424ebf3013b87448334d25e5b14708eb2db334499a89165537241"} err="failed to get container status \"c9153b9b939424ebf3013b87448334d25e5b14708eb2db334499a89165537241\": rpc error: code = NotFound desc = could not find container \"c9153b9b939424ebf3013b87448334d25e5b14708eb2db334499a89165537241\": container with ID starting with c9153b9b939424ebf3013b87448334d25e5b14708eb2db334499a89165537241 not found: ID does not exist" Sep 09 09:08:23.519205 ip-10-0-137-144 kubenswrapper[2564]: I0909 09:08:23.519164 2564 scope.go:117] "RemoveContainer" containerID="73c730b525a70427f0910a8b26086c45f3a92e3830910f83be375d068b60779d" Sep 09 09:08:23.519448 ip-10-0-137-144 kubenswrapper[2564]: E0909 09:08:23.519426 2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"73c730b525a70427f0910a8b26086c45f3a92e3830910f83be375d068b60779d\": container with ID starting with 73c730b525a70427f0910a8b26086c45f3a92e3830910f83be375d068b60779d not found: ID does not exist" containerID="73c730b525a70427f0910a8b26086c45f3a92e3830910f83be375d068b60779d" Sep 09 09:08:23.519496 ip-10-0-137-144 kubenswrapper[2564]: I0909 09:08:23.519452 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"73c730b525a70427f0910a8b26086c45f3a92e3830910f83be375d068b60779d"} err="failed to get container status \"73c730b525a70427f0910a8b26086c45f3a92e3830910f83be375d068b60779d\": rpc error: code = NotFound desc = could not find container \"73c730b525a70427f0910a8b26086c45f3a92e3830910f83be375d068b60779d\": container with ID starting with 73c730b525a70427f0910a8b26086c45f3a92e3830910f83be375d068b60779d not found: ID does not exist" Sep 09 09:08:23.519496 ip-10-0-137-144 kubenswrapper[2564]: I0909 09:08:23.519465 2564 scope.go:117] "RemoveContainer" containerID="2d9c6743777ca046ecfaaa618aa4f078a0f1798ea9d1631044482ec0347c8692" Sep 09 09:08:23.519665 ip-10-0-137-144 kubenswrapper[2564]: E0909 09:08:23.519647 2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2d9c6743777ca046ecfaaa618aa4f078a0f1798ea9d1631044482ec0347c8692\": container with ID starting with 2d9c6743777ca046ecfaaa618aa4f078a0f1798ea9d1631044482ec0347c8692 not found: ID does not exist" containerID="2d9c6743777ca046ecfaaa618aa4f078a0f1798ea9d1631044482ec0347c8692" Sep 09 09:08:23.519751 ip-10-0-137-144 kubenswrapper[2564]: I0909 09:08:23.519664 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2d9c6743777ca046ecfaaa618aa4f078a0f1798ea9d1631044482ec0347c8692"} err="failed to get container status \"2d9c6743777ca046ecfaaa618aa4f078a0f1798ea9d1631044482ec0347c8692\": rpc error: code = NotFound desc = could not find container \"2d9c6743777ca046ecfaaa618aa4f078a0f1798ea9d1631044482ec0347c8692\": container with ID starting with 2d9c6743777ca046ecfaaa618aa4f078a0f1798ea9d1631044482ec0347c8692 not found: ID does not exist" Sep 09 09:08:23.519751 ip-10-0-137-144 kubenswrapper[2564]: I0909 09:08:23.519676 2564 scope.go:117] "RemoveContainer" containerID="f405e89834e659804f44959035833796cc19ed02873cc26836d9d72afe97ee79" Sep 09 09:08:23.519911 ip-10-0-137-144 kubenswrapper[2564]: E0909 09:08:23.519894 2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f405e89834e659804f44959035833796cc19ed02873cc26836d9d72afe97ee79\": container with ID starting with f405e89834e659804f44959035833796cc19ed02873cc26836d9d72afe97ee79 not found: ID does not exist" containerID="f405e89834e659804f44959035833796cc19ed02873cc26836d9d72afe97ee79" Sep 09 09:08:23.519955 ip-10-0-137-144 kubenswrapper[2564]: I0909 09:08:23.519916 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f405e89834e659804f44959035833796cc19ed02873cc26836d9d72afe97ee79"} err="failed to get container status \"f405e89834e659804f44959035833796cc19ed02873cc26836d9d72afe97ee79\": rpc error: code = NotFound desc = could not find container \"f405e89834e659804f44959035833796cc19ed02873cc26836d9d72afe97ee79\": container with ID starting with f405e89834e659804f44959035833796cc19ed02873cc26836d9d72afe97ee79 not found: ID does not exist" Sep 09 09:08:23.519955 ip-10-0-137-144 kubenswrapper[2564]: I0909 09:08:23.519930 2564 scope.go:117] "RemoveContainer" containerID="ad3f3ddf6cd19d942539bc666fb7970f9eb21113694102c86bc572a2f3dc54c9" Sep 09 09:08:23.520190 ip-10-0-137-144 kubenswrapper[2564]: E0909 09:08:23.520172 2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ad3f3ddf6cd19d942539bc666fb7970f9eb21113694102c86bc572a2f3dc54c9\": container with ID starting with ad3f3ddf6cd19d942539bc666fb7970f9eb21113694102c86bc572a2f3dc54c9 not found: ID does not exist" containerID="ad3f3ddf6cd19d942539bc666fb7970f9eb21113694102c86bc572a2f3dc54c9" Sep 09 09:08:23.520251 ip-10-0-137-144 kubenswrapper[2564]: I0909 09:08:23.520198 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ad3f3ddf6cd19d942539bc666fb7970f9eb21113694102c86bc572a2f3dc54c9"} err="failed to get container status \"ad3f3ddf6cd19d942539bc666fb7970f9eb21113694102c86bc572a2f3dc54c9\": rpc error: code = NotFound desc = could not find container \"ad3f3ddf6cd19d942539bc666fb7970f9eb21113694102c86bc572a2f3dc54c9\": container with ID starting with ad3f3ddf6cd19d942539bc666fb7970f9eb21113694102c86bc572a2f3dc54c9 not found: ID does not exist" Sep 09 09:08:23.520251 ip-10-0-137-144 kubenswrapper[2564]: I0909 09:08:23.520235 2564 scope.go:117] "RemoveContainer" containerID="bf6691b0d8449545b0e4769d9af25a137105120f4cfb022465fb8477929c3849" Sep 09 09:08:23.520507 ip-10-0-137-144 kubenswrapper[2564]: I0909 09:08:23.520489 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bf6691b0d8449545b0e4769d9af25a137105120f4cfb022465fb8477929c3849"} err="failed to get container status \"bf6691b0d8449545b0e4769d9af25a137105120f4cfb022465fb8477929c3849\": rpc error: code = NotFound desc = could not find container \"bf6691b0d8449545b0e4769d9af25a137105120f4cfb022465fb8477929c3849\": container with ID starting with bf6691b0d8449545b0e4769d9af25a137105120f4cfb022465fb8477929c3849 not found: ID does not exist" Sep 09 09:08:23.520591 ip-10-0-137-144 kubenswrapper[2564]: I0909 09:08:23.520507 2564 scope.go:117] "RemoveContainer" containerID="c9153b9b939424ebf3013b87448334d25e5b14708eb2db334499a89165537241" Sep 09 09:08:23.520708 ip-10-0-137-144 kubenswrapper[2564]: I0909 09:08:23.520694 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c9153b9b939424ebf3013b87448334d25e5b14708eb2db334499a89165537241"} err="failed to get container status \"c9153b9b939424ebf3013b87448334d25e5b14708eb2db334499a89165537241\": rpc error: code = NotFound desc = could not find container \"c9153b9b939424ebf3013b87448334d25e5b14708eb2db334499a89165537241\": container with ID starting with c9153b9b939424ebf3013b87448334d25e5b14708eb2db334499a89165537241 not found: ID does not exist" Sep 09 09:08:23.520757 ip-10-0-137-144 kubenswrapper[2564]: I0909 09:08:23.520708 2564 scope.go:117] "RemoveContainer" containerID="73c730b525a70427f0910a8b26086c45f3a92e3830910f83be375d068b60779d" Sep 09 09:08:23.520931 ip-10-0-137-144 kubenswrapper[2564]: I0909 09:08:23.520914 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"73c730b525a70427f0910a8b26086c45f3a92e3830910f83be375d068b60779d"} err="failed to get container status \"73c730b525a70427f0910a8b26086c45f3a92e3830910f83be375d068b60779d\": rpc error: code = NotFound desc = could not find container \"73c730b525a70427f0910a8b26086c45f3a92e3830910f83be375d068b60779d\": container with ID starting with 73c730b525a70427f0910a8b26086c45f3a92e3830910f83be375d068b60779d not found: ID does not exist" Sep 09 09:08:23.520969 ip-10-0-137-144 kubenswrapper[2564]: I0909 09:08:23.520932 2564 scope.go:117] "RemoveContainer" containerID="2d9c6743777ca046ecfaaa618aa4f078a0f1798ea9d1631044482ec0347c8692" Sep 09 09:08:23.521127 ip-10-0-137-144 kubenswrapper[2564]: I0909 09:08:23.521113 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2d9c6743777ca046ecfaaa618aa4f078a0f1798ea9d1631044482ec0347c8692"} err="failed to get container status \"2d9c6743777ca046ecfaaa618aa4f078a0f1798ea9d1631044482ec0347c8692\": rpc error: code = NotFound desc = could not find container \"2d9c6743777ca046ecfaaa618aa4f078a0f1798ea9d1631044482ec0347c8692\": container with ID starting with 2d9c6743777ca046ecfaaa618aa4f078a0f1798ea9d1631044482ec0347c8692 not found: ID does not exist" Sep 09 09:08:23.521167 ip-10-0-137-144 kubenswrapper[2564]: I0909 09:08:23.521127 2564 scope.go:117] "RemoveContainer" containerID="f405e89834e659804f44959035833796cc19ed02873cc26836d9d72afe97ee79" Sep 09 09:08:23.521348 ip-10-0-137-144 kubenswrapper[2564]: I0909 09:08:23.521316 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f405e89834e659804f44959035833796cc19ed02873cc26836d9d72afe97ee79"} err="failed to get container status \"f405e89834e659804f44959035833796cc19ed02873cc26836d9d72afe97ee79\": rpc error: code = NotFound desc = could not find container \"f405e89834e659804f44959035833796cc19ed02873cc26836d9d72afe97ee79\": container with ID starting with f405e89834e659804f44959035833796cc19ed02873cc26836d9d72afe97ee79 not found: ID does not exist" Sep 09 09:08:23.521400 ip-10-0-137-144 kubenswrapper[2564]: I0909 09:08:23.521350 2564 scope.go:117] "RemoveContainer" containerID="ad3f3ddf6cd19d942539bc666fb7970f9eb21113694102c86bc572a2f3dc54c9" Sep 09 09:08:23.521572 ip-10-0-137-144 kubenswrapper[2564]: I0909 09:08:23.521556 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ad3f3ddf6cd19d942539bc666fb7970f9eb21113694102c86bc572a2f3dc54c9"} err="failed to get container status \"ad3f3ddf6cd19d942539bc666fb7970f9eb21113694102c86bc572a2f3dc54c9\": rpc error: code = NotFound desc = could not find container \"ad3f3ddf6cd19d942539bc666fb7970f9eb21113694102c86bc572a2f3dc54c9\": container with ID starting with ad3f3ddf6cd19d942539bc666fb7970f9eb21113694102c86bc572a2f3dc54c9 not found: ID does not exist" Sep 09 09:08:23.521619 ip-10-0-137-144 kubenswrapper[2564]: I0909 09:08:23.521572 2564 scope.go:117] "RemoveContainer" containerID="b624c4847c30516c1ff58ac2192ddcfc9addad440ebeeffc27ba0571296fbff5" Sep 09 09:08:23.528158 ip-10-0-137-144 kubenswrapper[2564]: I0909 09:08:23.528135 2564 scope.go:117] "RemoveContainer" containerID="baed77adb6d1395402c92f466bd747c0af31ab0464fad61f100aac2fc2a5f39f" Sep 09 09:08:23.535024 ip-10-0-137-144 kubenswrapper[2564]: I0909 09:08:23.535009 2564 scope.go:117] "RemoveContainer" containerID="1115794e45c38e73518b588f50ecfbef6c108c87da34282528e8d6de8f1f7209" Sep 09 09:08:23.541735 ip-10-0-137-144 kubenswrapper[2564]: I0909 09:08:23.541719 2564 scope.go:117] "RemoveContainer" containerID="1042f24d76b717e4fbce1615038e1fa330d092b57818472181c10de0e9d42b96" Sep 09 09:08:23.548229 ip-10-0-137-144 kubenswrapper[2564]: I0909 09:08:23.548213 2564 scope.go:117] "RemoveContainer" containerID="71b1c58bbb43cba97068f077cf147579c8d92fd6b4b943a42219d795c0d0065d" Sep 09 09:08:23.806398 ip-10-0-137-144 kubenswrapper[2564]: I0909 09:08:23.806305 2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="583c5cca-7e45-4dce-849e-1f22ffc3c53e" path="/var/lib/kubelet/pods/583c5cca-7e45-4dce-849e-1f22ffc3c53e/volumes" Sep 09 09:08:23.806866 ip-10-0-137-144 kubenswrapper[2564]: I0909 09:08:23.806852 2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d7a2cfa0-04ea-4dec-8fa9-bbb5562f4eed" path="/var/lib/kubelet/pods/d7a2cfa0-04ea-4dec-8fa9-bbb5562f4eed/volumes" Sep 09 09:08:59.811796 ip-10-0-137-144 kubenswrapper[2564]: I0909 09:08:59.811762 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-tdfqx_f81169f8-3c85-4cd7-8b59-684973ff46f7/console-operator/2.log" Sep 09 09:08:59.814218 ip-10-0-137-144 kubenswrapper[2564]: I0909 09:08:59.814192 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-tdfqx_f81169f8-3c85-4cd7-8b59-684973ff46f7/console-operator/2.log" Sep 09 09:09:00.763464 ip-10-0-137-144 kubenswrapper[2564]: I0909 09:09:00.763427 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-pnrnn/must-gather-dtxbj"] Sep 09 09:09:00.763769 ip-10-0-137-144 kubenswrapper[2564]: I0909 09:09:00.763752 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="583c5cca-7e45-4dce-849e-1f22ffc3c53e" containerName="feast-apply" Sep 09 09:09:00.763846 ip-10-0-137-144 kubenswrapper[2564]: I0909 09:09:00.763771 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="583c5cca-7e45-4dce-849e-1f22ffc3c53e" containerName="feast-apply" Sep 09 09:09:00.763846 ip-10-0-137-144 kubenswrapper[2564]: I0909 09:09:00.763790 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="583c5cca-7e45-4dce-849e-1f22ffc3c53e" containerName="feast-init" Sep 09 09:09:00.763846 ip-10-0-137-144 kubenswrapper[2564]: I0909 09:09:00.763799 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="583c5cca-7e45-4dce-849e-1f22ffc3c53e" containerName="feast-init" Sep 09 09:09:00.763846 ip-10-0-137-144 kubenswrapper[2564]: I0909 09:09:00.763808 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d7a2cfa0-04ea-4dec-8fa9-bbb5562f4eed" containerName="feast-init" Sep 09 09:09:00.763846 ip-10-0-137-144 kubenswrapper[2564]: I0909 09:09:00.763817 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="d7a2cfa0-04ea-4dec-8fa9-bbb5562f4eed" containerName="feast-init" Sep 09 09:09:00.763846 ip-10-0-137-144 kubenswrapper[2564]: I0909 09:09:00.763828 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d7a2cfa0-04ea-4dec-8fa9-bbb5562f4eed" containerName="registry" Sep 09 09:09:00.763846 ip-10-0-137-144 kubenswrapper[2564]: I0909 09:09:00.763837 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="d7a2cfa0-04ea-4dec-8fa9-bbb5562f4eed" containerName="registry" Sep 09 09:09:00.764192 ip-10-0-137-144 kubenswrapper[2564]: I0909 09:09:00.763853 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d7a2cfa0-04ea-4dec-8fa9-bbb5562f4eed" containerName="online" Sep 09 09:09:00.764192 ip-10-0-137-144 kubenswrapper[2564]: I0909 09:09:00.763861 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="d7a2cfa0-04ea-4dec-8fa9-bbb5562f4eed" containerName="online" Sep 09 09:09:00.764192 ip-10-0-137-144 kubenswrapper[2564]: I0909 09:09:00.763869 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="583c5cca-7e45-4dce-849e-1f22ffc3c53e" containerName="offline" Sep 09 09:09:00.764192 ip-10-0-137-144 kubenswrapper[2564]: I0909 09:09:00.763878 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="583c5cca-7e45-4dce-849e-1f22ffc3c53e" containerName="offline" Sep 09 09:09:00.764192 ip-10-0-137-144 kubenswrapper[2564]: I0909 09:09:00.763889 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d7a2cfa0-04ea-4dec-8fa9-bbb5562f4eed" containerName="ui" Sep 09 09:09:00.764192 ip-10-0-137-144 kubenswrapper[2564]: I0909 09:09:00.763897 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="d7a2cfa0-04ea-4dec-8fa9-bbb5562f4eed" containerName="ui" Sep 09 09:09:00.764192 ip-10-0-137-144 kubenswrapper[2564]: I0909 09:09:00.763912 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d7a2cfa0-04ea-4dec-8fa9-bbb5562f4eed" containerName="feast-apply" Sep 09 09:09:00.764192 ip-10-0-137-144 kubenswrapper[2564]: I0909 09:09:00.763921 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="d7a2cfa0-04ea-4dec-8fa9-bbb5562f4eed" containerName="feast-apply" Sep 09 09:09:00.764192 ip-10-0-137-144 kubenswrapper[2564]: I0909 09:09:00.763932 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="583c5cca-7e45-4dce-849e-1f22ffc3c53e" containerName="ui" Sep 09 09:09:00.764192 ip-10-0-137-144 kubenswrapper[2564]: I0909 09:09:00.763939 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="583c5cca-7e45-4dce-849e-1f22ffc3c53e" containerName="ui" Sep 09 09:09:00.764192 ip-10-0-137-144 kubenswrapper[2564]: I0909 09:09:00.763949 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="583c5cca-7e45-4dce-849e-1f22ffc3c53e" containerName="online" Sep 09 09:09:00.764192 ip-10-0-137-144 kubenswrapper[2564]: I0909 09:09:00.763957 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="583c5cca-7e45-4dce-849e-1f22ffc3c53e" containerName="online" Sep 09 09:09:00.764192 ip-10-0-137-144 kubenswrapper[2564]: I0909 09:09:00.763967 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d7a2cfa0-04ea-4dec-8fa9-bbb5562f4eed" containerName="offline" Sep 09 09:09:00.764192 ip-10-0-137-144 kubenswrapper[2564]: I0909 09:09:00.763977 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="d7a2cfa0-04ea-4dec-8fa9-bbb5562f4eed" containerName="offline" Sep 09 09:09:00.764192 ip-10-0-137-144 kubenswrapper[2564]: I0909 09:09:00.764039 2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="583c5cca-7e45-4dce-849e-1f22ffc3c53e" containerName="ui" Sep 09 09:09:00.764192 ip-10-0-137-144 kubenswrapper[2564]: I0909 09:09:00.764051 2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="583c5cca-7e45-4dce-849e-1f22ffc3c53e" containerName="online" Sep 09 09:09:00.764192 ip-10-0-137-144 kubenswrapper[2564]: I0909 09:09:00.764063 2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="583c5cca-7e45-4dce-849e-1f22ffc3c53e" containerName="offline" Sep 09 09:09:00.764192 ip-10-0-137-144 kubenswrapper[2564]: I0909 09:09:00.764072 2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="d7a2cfa0-04ea-4dec-8fa9-bbb5562f4eed" containerName="online" Sep 09 09:09:00.764192 ip-10-0-137-144 kubenswrapper[2564]: I0909 09:09:00.764080 2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="d7a2cfa0-04ea-4dec-8fa9-bbb5562f4eed" containerName="offline" Sep 09 09:09:00.764192 ip-10-0-137-144 kubenswrapper[2564]: I0909 09:09:00.764089 2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="d7a2cfa0-04ea-4dec-8fa9-bbb5562f4eed" containerName="ui" Sep 09 09:09:00.764192 ip-10-0-137-144 kubenswrapper[2564]: I0909 09:09:00.764098 2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="d7a2cfa0-04ea-4dec-8fa9-bbb5562f4eed" containerName="registry" Sep 09 09:09:00.768616 ip-10-0-137-144 kubenswrapper[2564]: I0909 09:09:00.768595 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-pnrnn/must-gather-dtxbj" Sep 09 09:09:00.770828 ip-10-0-137-144 kubenswrapper[2564]: I0909 09:09:00.770807 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-pnrnn\"/\"kube-root-ca.crt\"" Sep 09 09:09:00.771506 ip-10-0-137-144 kubenswrapper[2564]: I0909 09:09:00.771482 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-pnrnn\"/\"default-dockercfg-hm2qb\"" Sep 09 09:09:00.771506 ip-10-0-137-144 kubenswrapper[2564]: I0909 09:09:00.771495 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-pnrnn\"/\"openshift-service-ca.crt\"" Sep 09 09:09:00.775968 ip-10-0-137-144 kubenswrapper[2564]: I0909 09:09:00.775948 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-pnrnn/must-gather-dtxbj"] Sep 09 09:09:00.865017 ip-10-0-137-144 kubenswrapper[2564]: I0909 09:09:00.864976 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/b0599f27-f4a5-4cf8-beac-111a3f6d0f11-must-gather-output\") pod \"must-gather-dtxbj\" (UID: \"b0599f27-f4a5-4cf8-beac-111a3f6d0f11\") " pod="openshift-must-gather-pnrnn/must-gather-dtxbj" Sep 09 09:09:00.865017 ip-10-0-137-144 kubenswrapper[2564]: I0909 09:09:00.865018 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p5r5k\" (UniqueName: \"kubernetes.io/projected/b0599f27-f4a5-4cf8-beac-111a3f6d0f11-kube-api-access-p5r5k\") pod \"must-gather-dtxbj\" (UID: \"b0599f27-f4a5-4cf8-beac-111a3f6d0f11\") " pod="openshift-must-gather-pnrnn/must-gather-dtxbj" Sep 09 09:09:00.966287 ip-10-0-137-144 kubenswrapper[2564]: I0909 09:09:00.966236 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/b0599f27-f4a5-4cf8-beac-111a3f6d0f11-must-gather-output\") pod \"must-gather-dtxbj\" (UID: \"b0599f27-f4a5-4cf8-beac-111a3f6d0f11\") " pod="openshift-must-gather-pnrnn/must-gather-dtxbj" Sep 09 09:09:00.966287 ip-10-0-137-144 kubenswrapper[2564]: I0909 09:09:00.966285 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p5r5k\" (UniqueName: \"kubernetes.io/projected/b0599f27-f4a5-4cf8-beac-111a3f6d0f11-kube-api-access-p5r5k\") pod \"must-gather-dtxbj\" (UID: \"b0599f27-f4a5-4cf8-beac-111a3f6d0f11\") " pod="openshift-must-gather-pnrnn/must-gather-dtxbj" Sep 09 09:09:00.966654 ip-10-0-137-144 kubenswrapper[2564]: I0909 09:09:00.966631 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/b0599f27-f4a5-4cf8-beac-111a3f6d0f11-must-gather-output\") pod \"must-gather-dtxbj\" (UID: \"b0599f27-f4a5-4cf8-beac-111a3f6d0f11\") " pod="openshift-must-gather-pnrnn/must-gather-dtxbj" Sep 09 09:09:00.976476 ip-10-0-137-144 kubenswrapper[2564]: I0909 09:09:00.976447 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-p5r5k\" (UniqueName: \"kubernetes.io/projected/b0599f27-f4a5-4cf8-beac-111a3f6d0f11-kube-api-access-p5r5k\") pod \"must-gather-dtxbj\" (UID: \"b0599f27-f4a5-4cf8-beac-111a3f6d0f11\") " pod="openshift-must-gather-pnrnn/must-gather-dtxbj" Sep 09 09:09:01.078323 ip-10-0-137-144 kubenswrapper[2564]: I0909 09:09:01.078295 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-pnrnn/must-gather-dtxbj" Sep 09 09:09:01.342895 ip-10-0-137-144 kubenswrapper[2564]: I0909 09:09:01.342816 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-pnrnn/must-gather-dtxbj"] Sep 09 09:09:01.345538 ip-10-0-137-144 kubenswrapper[2564]: W0909 09:09:01.345509 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podb0599f27_f4a5_4cf8_beac_111a3f6d0f11.slice/crio-a206df23496527fc21d0354ebe0e74fed88d530ea4dd7754c95e6f0dec7db74c WatchSource:0}: Error finding container a206df23496527fc21d0354ebe0e74fed88d530ea4dd7754c95e6f0dec7db74c: Status 404 returned error can't find the container with id a206df23496527fc21d0354ebe0e74fed88d530ea4dd7754c95e6f0dec7db74c Sep 09 09:09:01.347478 ip-10-0-137-144 kubenswrapper[2564]: I0909 09:09:01.347461 2564 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Sep 09 09:09:01.615915 ip-10-0-137-144 kubenswrapper[2564]: I0909 09:09:01.615836 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-pnrnn/must-gather-dtxbj" event={"ID":"b0599f27-f4a5-4cf8-beac-111a3f6d0f11","Type":"ContainerStarted","Data":"a206df23496527fc21d0354ebe0e74fed88d530ea4dd7754c95e6f0dec7db74c"} Sep 09 09:09:02.624215 ip-10-0-137-144 kubenswrapper[2564]: I0909 09:09:02.623415 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-pnrnn/must-gather-dtxbj" event={"ID":"b0599f27-f4a5-4cf8-beac-111a3f6d0f11","Type":"ContainerStarted","Data":"760b291e2400c9a8ad475162434574b92da70b653c0af45def5d17e008301356"} Sep 09 09:09:02.624215 ip-10-0-137-144 kubenswrapper[2564]: I0909 09:09:02.623472 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-pnrnn/must-gather-dtxbj" event={"ID":"b0599f27-f4a5-4cf8-beac-111a3f6d0f11","Type":"ContainerStarted","Data":"12256f9cb81c4e040d516494f1456535a00cbe355dffe26304f3b5774767c985"} Sep 09 09:09:02.639815 ip-10-0-137-144 kubenswrapper[2564]: I0909 09:09:02.639763 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-pnrnn/must-gather-dtxbj" podStartSLOduration=1.668929125 podStartE2EDuration="2.639748216s" totalImagesPullingTime="970.819091ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 09:09:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 09:09:02.63837205 +0000 UTC m=+1803.336255952" watchObservedRunningTime="2026-09-09 09:09:02.639748216 +0000 UTC m=+1803.337632117" Sep 09 09:09:03.648078 ip-10-0-137-144 kubenswrapper[2564]: I0909 09:09:03.648047 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-dvhwl_950a27f9-3274-48f2-a23e-21f86398eb00/global-pull-secret-syncer/0.log" Sep 09 09:09:03.797453 ip-10-0-137-144 kubenswrapper[2564]: I0909 09:09:03.797419 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-p7hs5_c50a1df3-102a-4460-b42a-0be6714665ea/konnectivity-agent/0.log" Sep 09 09:09:03.863838 ip-10-0-137-144 kubenswrapper[2564]: I0909 09:09:03.863807 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-137-144.ec2.internal_efe7ba22b7eb392835b6437abb5fbd2b/haproxy/0.log" Sep 09 09:09:07.489066 ip-10-0-137-144 kubenswrapper[2564]: I0909 09:09:07.489019 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-6cdcc96965-q4nst_15de325d-9020-4dc9-8666-b1b02a3b2e2e/cluster-monitoring-operator/0.log" Sep 09 09:09:07.752909 ip-10-0-137-144 kubenswrapper[2564]: I0909 09:09:07.752824 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-l925d_e97ee2b5-650a-40ad-8d02-927b4086df5d/node-exporter/0.log" Sep 09 09:09:07.792393 ip-10-0-137-144 kubenswrapper[2564]: I0909 09:09:07.792290 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-l925d_e97ee2b5-650a-40ad-8d02-927b4086df5d/kube-rbac-proxy/0.log" Sep 09 09:09:07.832324 ip-10-0-137-144 kubenswrapper[2564]: I0909 09:09:07.832296 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-l925d_e97ee2b5-650a-40ad-8d02-927b4086df5d/init-textfile/0.log" Sep 09 09:09:09.804061 ip-10-0-137-144 kubenswrapper[2564]: I0909 09:09:09.804024 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-79977f9844-9nmsv_7b2288b4-72fd-45bc-a286-f1ff2580d3cc/networking-console-plugin/0.log" Sep 09 09:09:10.273878 ip-10-0-137-144 kubenswrapper[2564]: I0909 09:09:10.273846 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-tdfqx_f81169f8-3c85-4cd7-8b59-684973ff46f7/console-operator/2.log" Sep 09 09:09:10.280261 ip-10-0-137-144 kubenswrapper[2564]: I0909 09:09:10.280233 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-tdfqx_f81169f8-3c85-4cd7-8b59-684973ff46f7/console-operator/3.log" Sep 09 09:09:11.286912 ip-10-0-137-144 kubenswrapper[2564]: I0909 09:09:11.286875 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-pnrnn/perf-node-gather-daemonset-b4sv2"] Sep 09 09:09:11.292454 ip-10-0-137-144 kubenswrapper[2564]: I0909 09:09:11.292425 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-pnrnn/perf-node-gather-daemonset-b4sv2" Sep 09 09:09:11.307947 ip-10-0-137-144 kubenswrapper[2564]: I0909 09:09:11.307918 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-pnrnn/perf-node-gather-daemonset-b4sv2"] Sep 09 09:09:11.353812 ip-10-0-137-144 kubenswrapper[2564]: I0909 09:09:11.353760 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/eb73495c-f56a-49fa-9e89-69fe53588a0e-lib-modules\") pod \"perf-node-gather-daemonset-b4sv2\" (UID: \"eb73495c-f56a-49fa-9e89-69fe53588a0e\") " pod="openshift-must-gather-pnrnn/perf-node-gather-daemonset-b4sv2" Sep 09 09:09:11.354005 ip-10-0-137-144 kubenswrapper[2564]: I0909 09:09:11.353865 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/eb73495c-f56a-49fa-9e89-69fe53588a0e-sys\") pod \"perf-node-gather-daemonset-b4sv2\" (UID: \"eb73495c-f56a-49fa-9e89-69fe53588a0e\") " pod="openshift-must-gather-pnrnn/perf-node-gather-daemonset-b4sv2" Sep 09 09:09:11.354005 ip-10-0-137-144 kubenswrapper[2564]: I0909 09:09:11.353898 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k75lw\" (UniqueName: \"kubernetes.io/projected/eb73495c-f56a-49fa-9e89-69fe53588a0e-kube-api-access-k75lw\") pod \"perf-node-gather-daemonset-b4sv2\" (UID: \"eb73495c-f56a-49fa-9e89-69fe53588a0e\") " pod="openshift-must-gather-pnrnn/perf-node-gather-daemonset-b4sv2" Sep 09 09:09:11.354005 ip-10-0-137-144 kubenswrapper[2564]: I0909 09:09:11.353937 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/eb73495c-f56a-49fa-9e89-69fe53588a0e-proc\") pod \"perf-node-gather-daemonset-b4sv2\" (UID: \"eb73495c-f56a-49fa-9e89-69fe53588a0e\") " pod="openshift-must-gather-pnrnn/perf-node-gather-daemonset-b4sv2" Sep 09 09:09:11.354005 ip-10-0-137-144 kubenswrapper[2564]: I0909 09:09:11.353965 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/eb73495c-f56a-49fa-9e89-69fe53588a0e-podres\") pod \"perf-node-gather-daemonset-b4sv2\" (UID: \"eb73495c-f56a-49fa-9e89-69fe53588a0e\") " pod="openshift-must-gather-pnrnn/perf-node-gather-daemonset-b4sv2" Sep 09 09:09:11.455087 ip-10-0-137-144 kubenswrapper[2564]: I0909 09:09:11.455041 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/eb73495c-f56a-49fa-9e89-69fe53588a0e-sys\") pod \"perf-node-gather-daemonset-b4sv2\" (UID: \"eb73495c-f56a-49fa-9e89-69fe53588a0e\") " pod="openshift-must-gather-pnrnn/perf-node-gather-daemonset-b4sv2" Sep 09 09:09:11.455356 ip-10-0-137-144 kubenswrapper[2564]: I0909 09:09:11.455317 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k75lw\" (UniqueName: \"kubernetes.io/projected/eb73495c-f56a-49fa-9e89-69fe53588a0e-kube-api-access-k75lw\") pod \"perf-node-gather-daemonset-b4sv2\" (UID: \"eb73495c-f56a-49fa-9e89-69fe53588a0e\") " pod="openshift-must-gather-pnrnn/perf-node-gather-daemonset-b4sv2" Sep 09 09:09:11.455549 ip-10-0-137-144 kubenswrapper[2564]: I0909 09:09:11.455197 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/eb73495c-f56a-49fa-9e89-69fe53588a0e-sys\") pod \"perf-node-gather-daemonset-b4sv2\" (UID: \"eb73495c-f56a-49fa-9e89-69fe53588a0e\") " pod="openshift-must-gather-pnrnn/perf-node-gather-daemonset-b4sv2" Sep 09 09:09:11.455630 ip-10-0-137-144 kubenswrapper[2564]: I0909 09:09:11.455523 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/eb73495c-f56a-49fa-9e89-69fe53588a0e-proc\") pod \"perf-node-gather-daemonset-b4sv2\" (UID: \"eb73495c-f56a-49fa-9e89-69fe53588a0e\") " pod="openshift-must-gather-pnrnn/perf-node-gather-daemonset-b4sv2" Sep 09 09:09:11.455691 ip-10-0-137-144 kubenswrapper[2564]: I0909 09:09:11.455624 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/eb73495c-f56a-49fa-9e89-69fe53588a0e-podres\") pod \"perf-node-gather-daemonset-b4sv2\" (UID: \"eb73495c-f56a-49fa-9e89-69fe53588a0e\") " pod="openshift-must-gather-pnrnn/perf-node-gather-daemonset-b4sv2" Sep 09 09:09:11.455753 ip-10-0-137-144 kubenswrapper[2564]: I0909 09:09:11.455709 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/eb73495c-f56a-49fa-9e89-69fe53588a0e-lib-modules\") pod \"perf-node-gather-daemonset-b4sv2\" (UID: \"eb73495c-f56a-49fa-9e89-69fe53588a0e\") " pod="openshift-must-gather-pnrnn/perf-node-gather-daemonset-b4sv2" Sep 09 09:09:11.455890 ip-10-0-137-144 kubenswrapper[2564]: I0909 09:09:11.455867 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/eb73495c-f56a-49fa-9e89-69fe53588a0e-podres\") pod \"perf-node-gather-daemonset-b4sv2\" (UID: \"eb73495c-f56a-49fa-9e89-69fe53588a0e\") " pod="openshift-must-gather-pnrnn/perf-node-gather-daemonset-b4sv2" Sep 09 09:09:11.455959 ip-10-0-137-144 kubenswrapper[2564]: I0909 09:09:11.455870 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/eb73495c-f56a-49fa-9e89-69fe53588a0e-proc\") pod \"perf-node-gather-daemonset-b4sv2\" (UID: \"eb73495c-f56a-49fa-9e89-69fe53588a0e\") " pod="openshift-must-gather-pnrnn/perf-node-gather-daemonset-b4sv2" Sep 09 09:09:11.455959 ip-10-0-137-144 kubenswrapper[2564]: I0909 09:09:11.455942 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/eb73495c-f56a-49fa-9e89-69fe53588a0e-lib-modules\") pod \"perf-node-gather-daemonset-b4sv2\" (UID: \"eb73495c-f56a-49fa-9e89-69fe53588a0e\") " pod="openshift-must-gather-pnrnn/perf-node-gather-daemonset-b4sv2" Sep 09 09:09:11.464000 ip-10-0-137-144 kubenswrapper[2564]: I0909 09:09:11.463976 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-k75lw\" (UniqueName: \"kubernetes.io/projected/eb73495c-f56a-49fa-9e89-69fe53588a0e-kube-api-access-k75lw\") pod \"perf-node-gather-daemonset-b4sv2\" (UID: \"eb73495c-f56a-49fa-9e89-69fe53588a0e\") " pod="openshift-must-gather-pnrnn/perf-node-gather-daemonset-b4sv2" Sep 09 09:09:11.606074 ip-10-0-137-144 kubenswrapper[2564]: I0909 09:09:11.606035 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-pnrnn/perf-node-gather-daemonset-b4sv2" Sep 09 09:09:11.889296 ip-10-0-137-144 kubenswrapper[2564]: I0909 09:09:11.889210 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-pnrnn/perf-node-gather-daemonset-b4sv2"] Sep 09 09:09:11.892101 ip-10-0-137-144 kubenswrapper[2564]: W0909 09:09:11.892071 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podeb73495c_f56a_49fa_9e89_69fe53588a0e.slice/crio-d8108de37b1681eacfed3d032184f990604065bfc7b0503fda1d9e249741b306 WatchSource:0}: Error finding container d8108de37b1681eacfed3d032184f990604065bfc7b0503fda1d9e249741b306: Status 404 returned error can't find the container with id d8108de37b1681eacfed3d032184f990604065bfc7b0503fda1d9e249741b306 Sep 09 09:09:12.168985 ip-10-0-137-144 kubenswrapper[2564]: I0909 09:09:12.168911 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-v2cwj_025bcb2f-08a5-4ea4-98f9-8ca84afd9b33/dns/0.log" Sep 09 09:09:12.189620 ip-10-0-137-144 kubenswrapper[2564]: I0909 09:09:12.189599 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-v2cwj_025bcb2f-08a5-4ea4-98f9-8ca84afd9b33/kube-rbac-proxy/0.log" Sep 09 09:09:12.213460 ip-10-0-137-144 kubenswrapper[2564]: I0909 09:09:12.213436 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-b6v64_5cfc7f17-0984-4eb8-bf5f-a4c593b2d411/dns-node-resolver/0.log" Sep 09 09:09:12.671354 ip-10-0-137-144 kubenswrapper[2564]: I0909 09:09:12.671297 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-pnrnn/perf-node-gather-daemonset-b4sv2" event={"ID":"eb73495c-f56a-49fa-9e89-69fe53588a0e","Type":"ContainerStarted","Data":"f232c875f32519de41c6e46d811957ebf6d8f2af360ac3d9ba53c1766ce6a31c"} Sep 09 09:09:12.671736 ip-10-0-137-144 kubenswrapper[2564]: I0909 09:09:12.671374 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-pnrnn/perf-node-gather-daemonset-b4sv2" event={"ID":"eb73495c-f56a-49fa-9e89-69fe53588a0e","Type":"ContainerStarted","Data":"d8108de37b1681eacfed3d032184f990604065bfc7b0503fda1d9e249741b306"} Sep 09 09:09:12.671736 ip-10-0-137-144 kubenswrapper[2564]: I0909 09:09:12.671454 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-pnrnn/perf-node-gather-daemonset-b4sv2" Sep 09 09:09:12.686751 ip-10-0-137-144 kubenswrapper[2564]: I0909 09:09:12.686699 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-pnrnn/perf-node-gather-daemonset-b4sv2" podStartSLOduration=1.686687133 podStartE2EDuration="1.686687133s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-09 09:09:11 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 09:09:12.685175587 +0000 UTC m=+1813.383059487" watchObservedRunningTime="2026-09-09 09:09:12.686687133 +0000 UTC m=+1813.384571072" Sep 09 09:09:12.695425 ip-10-0-137-144 kubenswrapper[2564]: I0909 09:09:12.695404 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-pdgxz_806a2d46-69ad-493c-a1cc-5796636d6a06/node-ca/0.log" Sep 09 09:09:13.720844 ip-10-0-137-144 kubenswrapper[2564]: I0909 09:09:13.720818 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-w944n_77658115-dcd3-45b6-905e-2cfc02b948ed/serve-healthcheck-canary/0.log" Sep 09 09:09:14.193576 ip-10-0-137-144 kubenswrapper[2564]: I0909 09:09:14.193543 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-mk45q_48111af4-bcee-4838-9408-fafc202c8f7b/kube-rbac-proxy/0.log" Sep 09 09:09:14.213428 ip-10-0-137-144 kubenswrapper[2564]: I0909 09:09:14.213402 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-mk45q_48111af4-bcee-4838-9408-fafc202c8f7b/exporter/0.log" Sep 09 09:09:14.234361 ip-10-0-137-144 kubenswrapper[2564]: I0909 09:09:14.234310 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-mk45q_48111af4-bcee-4838-9408-fafc202c8f7b/extractor/0.log" Sep 09 09:09:18.062925 ip-10-0-137-144 kubenswrapper[2564]: I0909 09:09:18.062894 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-fdbb8fdff-cdz72_2fb3fbb8-ab1e-41bd-bee8-f5fbf7872e2d/migrator/0.log" Sep 09 09:09:18.087054 ip-10-0-137-144 kubenswrapper[2564]: I0909 09:09:18.087026 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-fdbb8fdff-cdz72_2fb3fbb8-ab1e-41bd-bee8-f5fbf7872e2d/graceful-termination/0.log" Sep 09 09:09:18.360243 ip-10-0-137-144 kubenswrapper[2564]: I0909 09:09:18.360208 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-8d7dd4675-6blnq_adccc815-e6f4-4a83-a484-53522f06da20/kube-storage-version-migrator-operator/1.log" Sep 09 09:09:18.361192 ip-10-0-137-144 kubenswrapper[2564]: I0909 09:09:18.361168 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-8d7dd4675-6blnq_adccc815-e6f4-4a83-a484-53522f06da20/kube-storage-version-migrator-operator/0.log" Sep 09 09:09:18.685272 ip-10-0-137-144 kubenswrapper[2564]: I0909 09:09:18.685201 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-pnrnn/perf-node-gather-daemonset-b4sv2" Sep 09 09:09:19.530010 ip-10-0-137-144 kubenswrapper[2564]: I0909 09:09:19.529915 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-tszfd_6c33c8b3-58fb-4539-92c2-da514e6d52ef/kube-multus-additional-cni-plugins/0.log" Sep 09 09:09:19.553362 ip-10-0-137-144 kubenswrapper[2564]: I0909 09:09:19.553326 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-tszfd_6c33c8b3-58fb-4539-92c2-da514e6d52ef/egress-router-binary-copy/0.log" Sep 09 09:09:19.578295 ip-10-0-137-144 kubenswrapper[2564]: I0909 09:09:19.578274 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-tszfd_6c33c8b3-58fb-4539-92c2-da514e6d52ef/cni-plugins/0.log" Sep 09 09:09:19.602650 ip-10-0-137-144 kubenswrapper[2564]: I0909 09:09:19.602616 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-tszfd_6c33c8b3-58fb-4539-92c2-da514e6d52ef/bond-cni-plugin/0.log" Sep 09 09:09:19.625444 ip-10-0-137-144 kubenswrapper[2564]: I0909 09:09:19.625411 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-tszfd_6c33c8b3-58fb-4539-92c2-da514e6d52ef/routeoverride-cni/0.log" Sep 09 09:09:19.648636 ip-10-0-137-144 kubenswrapper[2564]: I0909 09:09:19.648607 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-tszfd_6c33c8b3-58fb-4539-92c2-da514e6d52ef/whereabouts-cni-bincopy/0.log" Sep 09 09:09:19.670709 ip-10-0-137-144 kubenswrapper[2564]: I0909 09:09:19.670684 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-tszfd_6c33c8b3-58fb-4539-92c2-da514e6d52ef/whereabouts-cni/0.log" Sep 09 09:09:19.764042 ip-10-0-137-144 kubenswrapper[2564]: I0909 09:09:19.764011 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-tm68w_247ba8ee-92a3-4333-b1e1-e98c71402928/kube-multus/0.log" Sep 09 09:09:19.783841 ip-10-0-137-144 kubenswrapper[2564]: I0909 09:09:19.783763 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-b2965_50f8cfa3-6f41-47be-899d-cf16c3251f84/network-metrics-daemon/0.log" Sep 09 09:09:19.804879 ip-10-0-137-144 kubenswrapper[2564]: I0909 09:09:19.804854 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-b2965_50f8cfa3-6f41-47be-899d-cf16c3251f84/kube-rbac-proxy/0.log" Sep 09 09:09:20.712955 ip-10-0-137-144 kubenswrapper[2564]: I0909 09:09:20.712899 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-4h8qf_17eb483a-cd23-4d7e-b8fe-ad1b77d1537a/ovn-controller/0.log" Sep 09 09:09:20.730425 ip-10-0-137-144 kubenswrapper[2564]: I0909 09:09:20.730401 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-4h8qf_17eb483a-cd23-4d7e-b8fe-ad1b77d1537a/ovn-acl-logging/0.log" Sep 09 09:09:20.755808 ip-10-0-137-144 kubenswrapper[2564]: I0909 09:09:20.755780 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-4h8qf_17eb483a-cd23-4d7e-b8fe-ad1b77d1537a/kube-rbac-proxy-node/0.log" Sep 09 09:09:20.777015 ip-10-0-137-144 kubenswrapper[2564]: I0909 09:09:20.776983 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-4h8qf_17eb483a-cd23-4d7e-b8fe-ad1b77d1537a/kube-rbac-proxy-ovn-metrics/0.log" Sep 09 09:09:20.810520 ip-10-0-137-144 kubenswrapper[2564]: I0909 09:09:20.810489 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-4h8qf_17eb483a-cd23-4d7e-b8fe-ad1b77d1537a/northd/0.log" Sep 09 09:09:20.832041 ip-10-0-137-144 kubenswrapper[2564]: I0909 09:09:20.832018 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-4h8qf_17eb483a-cd23-4d7e-b8fe-ad1b77d1537a/nbdb/0.log" Sep 09 09:09:20.854110 ip-10-0-137-144 kubenswrapper[2564]: I0909 09:09:20.854087 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-4h8qf_17eb483a-cd23-4d7e-b8fe-ad1b77d1537a/sbdb/0.log" Sep 09 09:09:20.892789 ip-10-0-137-144 kubenswrapper[2564]: I0909 09:09:20.892698 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-4h8qf_17eb483a-cd23-4d7e-b8fe-ad1b77d1537a/ovnkube-controller/0.log" Sep 09 09:09:22.242524 ip-10-0-137-144 kubenswrapper[2564]: I0909 09:09:22.242474 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-diagnostics_network-check-source-685456655f-p45dk_2c0efc1d-4b09-4830-ab44-3a8e07964f13/check-endpoints/0.log" Sep 09 09:09:22.278409 ip-10-0-137-144 kubenswrapper[2564]: I0909 09:09:22.278323 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-diagnostics_network-check-target-2zg7w_96601efb-dd16-407b-9899-22f67a88b7f0/network-check-target-container/0.log" Sep 09 09:09:23.175560 ip-10-0-137-144 kubenswrapper[2564]: I0909 09:09:23.175530 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-operator_iptables-alerter-kq8xr_0bdb3c4d-ae9d-4a19-b79f-da2080ee1cf5/iptables-alerter/0.log" Sep 09 09:09:23.871150 ip-10-0-137-144 kubenswrapper[2564]: I0909 09:09:23.871122 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-node-tuning-operator_tuned-wdpws_3526e800-9ea7-4be9-8320-dc4e8f536116/tuned/0.log" Sep 09 09:09:26.398276 ip-10-0-137-144 kubenswrapper[2564]: I0909 09:09:26.398250 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-service-ca-operator_service-ca-operator-859f94c4b-njzs5_aaa6f86d-29c1-45fb-bec3-3bf3bfb3d0bc/service-ca-operator/1.log" Sep 09 09:09:26.399543 ip-10-0-137-144 kubenswrapper[2564]: I0909 09:09:26.399522 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-service-ca-operator_service-ca-operator-859f94c4b-njzs5_aaa6f86d-29c1-45fb-bec3-3bf3bfb3d0bc/service-ca-operator/0.log" Sep 09 09:09:27.155512 ip-10-0-137-144 kubenswrapper[2564]: I0909 09:09:27.155432 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-csi-drivers_aws-ebs-csi-driver-node-dh9g8_857d0c30-88d7-429b-8487-bca1106267e2/csi-driver/0.log" Sep 09 09:09:27.176193 ip-10-0-137-144 kubenswrapper[2564]: I0909 09:09:27.176137 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-csi-drivers_aws-ebs-csi-driver-node-dh9g8_857d0c30-88d7-429b-8487-bca1106267e2/csi-node-driver-registrar/0.log" Sep 09 09:09:27.198312 ip-10-0-137-144 kubenswrapper[2564]: I0909 09:09:27.198280 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-csi-drivers_aws-ebs-csi-driver-node-dh9g8_857d0c30-88d7-429b-8487-bca1106267e2/csi-liveness-probe/0.log"